KUBERNETES

• How to Create a Kubernetes Cluster Using CREODIAS OpenStack Magnum
  • Prerequisites
  • Step 1 Create New Cluster Screen
  • Step 2 Define Master and Worker Nodes
  • Step 3 Defining Network and LoadBalancer
  • Step 4 Advanced options
  • Step 5 Forming of the Cluster
  • Step 6 Review cluster state
  • How to delete a cluster
  • What To Do Next
• Default Kubernetes cluster templates in CREODIAS Cloud
  • What We Are Going To Cover
  • Prerequisites
  • Templates available on your cloud
  • How to choose a proper template
• How To Install OpenStack and Magnum Clients for Command Line Interface to CREODIAS Horizon
  • How To Issue Commands to the OpenStack and Magnum Servers
  • What We Are Going To Cover
  • Notes On Python Versions and Environments for Installation
  • Prerequisites
  • Step 1 Install the CLI for Kubernetes on OpenStack Magnum
  • Step 2 How to Use the OpenStack Client
  • The Help Command
  • Step 4 How to Use the Magnum Client
  • What To Do Next
• How To Use Command Line Interface for Kubernetes Clusters On CREODIAS OpenStack Magnum
  • What We Are Going To Cover
  • Prerequisites
  • The Advantages of Using the CLI
  • How to Enter OpenStack Commands
  • OpenStack Command for Creation of Cluster
  • How To Check Upon the Status of the Cluster
  • Failure to Create a Cluster
  • CLI Commands to Delete a Cluster
  • What To Do Next
• How To Access Kubernetes Cluster Post Deployment Using Kubectl On CREODIAS OpenStack Magnum
  • What We Are Going To Cover
  • Prerequisites
  • The Plan
  • Step 1 Create directory to download the certificates
  • Step 2A Download Certificates From the Server using the CLI commands
  • Step 2B Download Certificates From the Server using Horizon commands
  • Step 3 Verify That kubectl Has Access to the Cloud
  • What To Do Next
• Using Dashboard To Access Kubernetes Cluster Post Deployment On CREODIAS OpenStack Magnum
  • What We Are Going To Cover
  • Prerequisites
  • Step 1 Deploying the Dashboard
  • Step 2 Creating a sample user
  • Step 3 Create secret for admin-user
  • Step 4 Get the bearer token for authentication to dashboard
  • Step 5 Create a separate terminal window for proxy access
  • Step 6 See the dashboard in browser
  • What To Do Next
• How To Create API Server LoadBalancer for Kubernetes Cluster on CREODIAS OpenStack Magnum
  • What We Are Going To Do
  • Prerequisites
  • How To Enable or Disable Load Balancer for Master Nodes
  • One Master Node, No Load Balancer and the Problem It All Creates
  • Step 1 Create a Cluster With One Master Node and No Load Balancer
  • Step 2 Create Floating IP for Master Node
  • Step 3 Create config File for Kubernetes Cluster
  • Step 4 Swap Existing Floating IP Address for the Network Address
  • Step 4 Add Parameter –insecure-skip-tls-verify=true to Make kubectl Work
• Creating Additional Nodegroups in Kubernetes Cluster on CREODIAS OpenStack Magnum
  • The Benefits of Using Nodegroups
  • What We Are Going To Cover
  • Prerequisites
  • Nodegroup Subcommands
  • Step 1 Access the Current State of Clusters and Their Nodegroups
  • Step 2 How to Create a New Nodegroup
  • Step 3 Using role to Filter Nodegroups in the Cluster
  • Step 4 Show Details of the Nodegroup Created
  • Step 5 Delete the Existing Nodegroup
  • Step 6 Update the Existing Nodegroup
  • Step 7 Resize the Nodegroup
• Autoscaling Kubernetes Cluster Resources on CREODIAS OpenStack Magnum
  • What We Are Going To Cover
  • Prerequisites
  • Horizontal Pod Autoscaler
  • Vertical Pod Autoscaler
  • Cluster Autoscaler
  • Define Autoscaling When Creating a Cluster
  • Autoscaling Node Groups at Run Time
  • How Autoscaling Detects Upper Limit
  • Autoscaling Labels for Clusters
  • Create New Cluster Using CLI With Autoscaling On
  • Nodegroups With Worker Role Will Be Automatically Autoscalled
  • How to Obtain All Labels From Horizon Interface
  • How To Obtain All Labels From the CLI
  • Use Labels String When Creating Cluster in Horizon
  • What To Do Next
• Volume-based vs Ephemeral-based Storage for Kubernetes Clusters on CREODIAS OpenStack Magnum
  • What We Are Going To Cover
  • Prerequisites
  • Step 1 - Create Cluster Using –docker-volume-size
  • Step 2 - Create Pod Manifest
  • Step 3 - Create a Pod on Node 0 of dockerspace
  • Step 4 - Executing bash Commands in the Container
  • Step 5 - Saving a File Into Persistent Storage
  • Step 6 - Check the File Saved in Previous Step
  • What To Do Next
• Backup of Kubernetes Cluster using Velero
  • What is Velero
  • What We Are Going To Cover
  • Prerequisites
  • Before Installing Velero
  • Working with Velero
  • Example 1 Basics of Restoring an Application
  • Example 2 Snapshot of restoring an application
  • Delete a Velero backup
  • Removing Velero from the cluster
  • What To Do Next
• Kubernetes Persistent Volume Claims on CREODIAS
  • What We Are Going To Cover
  • Prerequisites
  • Types of Cinder CSI Persistence
  • Inspect Cinder CSI Driver on Your Kubernetes Cluster
  • Creating Persistent Volume Claims Dynamically
  • Storing Data to the Mounted Persistent Volume
  • Verify That the Data Persists After pod Deletion
• Using Kubernetes Ingress on CREODIAS OpenStack Magnum
  • What We Are Going To Cover
  • Prerequisites
  • Step 1 Create a Magnum Kubernetes cluster with NGINX Ingress enabled
  • Step 2 Creating services for Nginx and Apache webserver
  • Step 3 Create Ingress Resource
  • Step 4 Verify that it works
  • What To Do Next
• Deploying Helm Charts on Magnum Kubernetes Clusters on CREODIAS Cloud
  • What We Are Going To Cover
  • Prerequisites
  • Background - How Helm works
  • Install Helm
  • Add a Helm repository
  • Helm chart repositories
  • Check whether kubectl has access to the cluster
  • Deploy a Helm chart on a cluster
  • Customizing the chart deployment
  • What To Do Next
• Deploying HTTPS Services on Magnum Kubernetes in CREODIAS Cloud
  • What We are Going to Cover
  • Prerequisites
  • Step 1 Install Cert Manager’s Custom Resource Definitions (CRDs)
  • Step 2 Install CertManager Helm chart
  • Step 3 Create a Deployment and a Service
  • Step 4 Create and Deploy an Issuer
  • Step 5 Associate the Domain with NGINX Ingress
  • Step 6 Create and Deploy an Ingress Resource
  • What To Do Next
• Installing JupyterHub on Magnum Kubernetes Cluster in CREODIAS Cloud
  • What We are Going to Cover
  • Prerequisites
  • Step 1 Authenticate to the cluster
  • Step 2 Apply preliminary configuration
  • Step 3 Run Jupyterhub Helm chart installation
  • Step 4 Retrieve details of your service
  • Step 5 Run on HTTPS
  • What To Do Next
• Install and run Argo Workflows on CREODIAS Magnum Kubernetes
  • What We Are Going To Cover
  • Prerequisites
  • Authenticate to the cluster
  • Apply preliminary configuration
  • Install Argo Workflows
  • Run Argo Workflows from the cloud
  • Run sample workflow with two tasks
  • What To Do Next
• Installing HashiCorp Vault on CREODIAS Magnum
  • What We Are Going To Cover
  • Prerequisites
  • Step 1 Install CFSSL
  • Step 2 Generate TLS certificates
  • Step 3 Install Consul Helm chart
  • Step 4 Install Vault Helm chart
  • Sealing and unsealing the Vault
  • Step 5 Unseal Vault
  • Step 6 Run Vault UI
  • Return livenessProbe to production value
  • Troubleshooting
  • What To Do Next
• HTTP Request-based Autoscaling on K8S using Prometheus and Keda on CREODIAS
  • What We Are Going To Cover
  • Prerequisites
  • Install NGINX ingress on Magnum cluster
  • Install Prometheus
  • Install Keda
  • Deploy a sample app
  • Deploy our app ingress
  • Access Prometheus dashboard
  • Deploy KEDA ScaledObject
  • Test with Locust
  • Cooling down
• Accessing EODATA from Kubernetes Pods in CREODIAS Cloud using boto3
  • Prerequisites
  • What We Are Going To Do
  • Step 1 Create Kubernetes cluster with EODATA
  • Step 2 Prepare the application’s Docker image
  • Step 3 Build the app’s image and push to DockerHub
  • Step 4 Deploy the application on Kubernetes
  • What To Do Next
• Create and access NFS server from Kubernetes on CREODIAS
  • What We Are Going To Cover
  • Prerequisites
  • 1. Set up NFS server on a VM
  • 2. Set up a share folder on the NFS server
  • 3. Make the share available
  • 4. Deploy a test pod on the cluster
• Deploy Keycloak on Kubernetes with a sample app on CREODIAS
  • What We Are Going To Do
  • Prerequisites
  • Step 1 Deploy Keycloak on Kubernetes
  • Step 2 Create Keycloak realm
  • Step 3 Create and configure Keycloak client
  • Step 4 Create a User in Keycloak
  • Step 5 Retrieve client secret from Keycloak
  • Step 6 Create a Flask web app utilizing Keycloak authentication
  • Step 7 Test the application
• Install and run Dask on a Kubernetes cluster in CREODIAS cloud
  • What We Are Going To Cover
  • Prerequisites
  • Step 1 Install Dask on Kubernetes
  • Step 2 Access Jupyter and Dask Scheduler dashboard
  • Step 3 Run a sample computing task
  • Step 4 Configure Dask cluster on Kubernetes from Python
  • Resolving errors
• Install and run NooBaa on Kubernetes cluster in single- and multicloud-environment on CREODIAS
  • What We Are Going To Cover
  • Prerequisites
  • Install NooBaa in local environment
  • Apply preliminary configuration
  • Install NooBaa on the Kubernetes cluster
  • Create a NooBaa backing store
  • Connect NooBaa in a multi-cloud setup
• Private container registries with Harbor on CREODIAS Kubernetes
  • Benefits of using your own private container registry
  • What We Are Going To Cover
  • Prerequisites
  • Deploy Harbor private registry with Bitnami-Harbor Helm chart
  • Access Harbor from browser
  • Associate the A record of your domain to Harbor’s IP address
  • Create a project in Harbor
  • Create a Dockerfile for our custom image
  • Ensure trust from our local Docker instance
  • Build our image locally
  • Upload a Docker image to your Harbor instance
  • Download a Docker image from your Harbor instance
• Deploying vGPU workloads on CREODIAS Kubernetes
  • What Are We Going To Cover
  • Prerequisites
  • Scenario 1 - Add vGPU nodes as a nodegroup on a non-GPU Kubernetes clusters created after June 21st 2023
  • Scenario 2 - Add vGPU nodes as nodegroups on non-GPU Kubernetes clusters created before June 21st 2023
  • Verify the vGPU installation
• Kubernetes cluster observability with Prometheus and Grafana on CREODIAS
  • What Are We Going To Cover
  • Prerequisites
  • 1. Install Prometheus with Helm
  • 2. Install Grafana
  • 3. Add Prometheus as datasource to Grafana
  • 4. Add cluster observability dashboard
  • What To Do Next
• Enable Kubeapps app launcher on CREODIAS Magnum Kubernetes cluster
  • What We Are Going To Cover
  • Prerequisites
  • Background
  • Create Kubernetes cluster with Kubeapps quick-launcher enabled
  • Access Kubeapps service locally from your browser
  • Launch sample application from Kubeapps
  • Current limitations
• Accessing EODATA as s3fs mounts from Kubernetes pods on CREODIAS
  • Prerequisites
  • What We Are Going To Do
  • Background – EODATA mounter feature
  • Step 1. Create a new Kubernetes cluster on WAW4-1, WAW3-2 or FRA1-2 clouds
  • Step 2. Deploy Kubernetes pod which uses the EODATA mounter
  • Step 3. Verify access to the mount
• Install GitLab on CREODIAS Kubernetes
  • What We Are Going To Cover
  • Prerequisites
  • Step 1 Create a Floating IP and associate the A record in DNS
  • Step 2 Apply preliminary configuration
  • Step 3 Install GitLab Helm chart
  • Step 4 Verify the installation
  • Errors during the installation
  • What To Do Next
• Sealed Secrets on CREODIAS Kubernetes
  • What We Are Going To Cover
  • Prerequisites
  • Step 1 Install the Sealed Secrets controller
  • Step 2 Install the kubeseal command line utility
  • Step 3 Create a sealed secret
  • Step 4 Unseal the secret
  • Step 5 Verify
  • What To Do Next
• CI/CD pipelines with GitLab on CREODIAS Kubernetes - building a Docker image
  • What We Are Going To Cover
  • Prerequisites
  • Step 1 Add your public key to GitLab and access GitLab from your command line
  • Step 2 Create project in GitLab and add sample application code
  • Step 3 Define environment variables with your DockerHub coordinates in GitLab
  • Step 4 Create a pipeline to build your app’s Docker image using Kaniko
  • Step 5 Trigger pipeline build
  • What To Do Next
• How to create Kubernetes cluster using Terraform on CREODIAS
  • Prerequisites
  • Define provider for Terraform
  • Define cluster resource in Terraform
  • Apply the configurations and create the cluster
  • What To Do Next
• GitOps with Argo CD on CREODIAS Kubernetes
  • What We Are Going To Cover
  • Prerequisites
  • Step 1 Install Argo CD
  • Step 2 Access Argo CD from your browser
  • Step 3 Create a Git repository
  • Step 4 Download Flask application
  • Step 5 Push your app deployment configurations
  • Step 6 Create Argo CD application resource
  • Step 7 Deploy Argo CD application
  • Step 8 View the deployed resources
  • What To Do Next
• Configuring IP Whitelisting for OpenStack Load Balancer using Horizon and CLI on CREODIAS
  • What We Are Going To Cover
  • Prerequisites
  • State of Security: Before and After
  • Verification Tools
  • What To Do Next
• Configuring IP Whitelisting for OpenStack Load Balancer using Terraform on CREODIAS
  • What We Are Going To Cover
  • Prerequisites
  • Prepare Your Environment
  • Configure Terraform for whitelisting
  • Import Existing Load Balancer Listener
  • Run Terraform
  • Tests
  • What To Do Next
• Implementing IP Whitelisting for Load Balancers with Security Groups on CREODIAS
  • What Are We Going To Do
  • Introduction
  • Prerequisites
  • Horizon: Whitelisting Load Balancers
  • CLI: Whitelisting Load Balancers
  • Terraform: Whitelisting Load Balancers
  • State of Security: Before and after whitelisting the balancers
  • What To Do Next
• How to install Rancher RKE2 Kubernetes on CREODIAS
  • What We Are Going To Cover
  • Prerequisites
  • Step 1 Perform the preliminary setup
  • Step 2 Use Terraform configuration for RKE2 from CloudFerro’s GitHub repository
  • Step 3 Provision an RKE2 cluster
  • Step 4 Demonstrate cloud-native integration covered by the repo
  • Implementation details
  • Further customization
  • What To Do Next
• Automatic Kubernetes cluster upgrade on CREODIAS OpenStack Magnum
  • How the upgrade works automatically in Magnum
  • Prerequisites
  • Backup and observe the state of the cluster before the upgrade
  • Prepare the upgrade
  • Trigger the upgrade
  • Verify the upgrade