Merge "Update Airshipctl and CAPD Documentation"
This commit is contained in:
Zuul
Gerrit Code Review
commit
36d5f9822a
@ -1,719 +1,229 @@
|
|||||||
# Airshipctl and Cluster API Docker Integration
|
# Airshipctl and Cluster API Docker Integration
|
||||||
|
|
||||||
## Overview
|
## Overview
|
||||||
Airshipctl and cluster api docker integration facilitates usage of `airshipctl`
|
|
||||||
to create cluster api management and workload clusters using `docker as
|
This document demonstrates usage of airshipctl to create kubernetes clusters
|
||||||
infrastructure provider`.
|
locally using docker and kind.
|
||||||
|
|
||||||
|
Airshipctl requires an existing Kubernetes cluster accessible via kubectl.
|
||||||
|
We will use kind as a local bootstrap cluster, to provision a target management
|
||||||
|
cluster on the docker infrastructure provider. The target management cluster
|
||||||
|
will then be used to create a workload cluster with one or more worker nodes.
|
||||||
|
|
||||||
## Workflow
|
## Workflow
|
||||||
A simple workflow that can be tested involves the following operations:
|
|
||||||
|
|
||||||
**Initialize the management cluster with cluster api and docker provider
|
Below are the steps that we will go through to create the kubernetes clusters
|
||||||
components**
|
locally using docker and kind.
|
||||||
|
|
||||||
> airshipctl cluster init --debug
|
- create a single node kubernetes cluster using kind
|
||||||
|
- initialize the kind cluster with cluster api management components
|
||||||
|
- use the kind management cluster to create a target cluster with one control
|
||||||
|
plane
|
||||||
|
- apply cni solution on the target cluster
|
||||||
|
- initialize the target cluster with cluster api management components
|
||||||
|
- move the cluster api management crds from kind cluster to target management
|
||||||
|
cluster
|
||||||
|
- tear down the kind management cluster
|
||||||
|
- use the target management cluster to create worker nodes
|
||||||
|
- increase/decrease the worker count as required
|
||||||
|
|
||||||
**Create a workload cluster, with control plane and worker nodes**
|
## Airshipctl Commands Used And Purpose
|
||||||
|
|
||||||
> airshipctl phase run controlplane
|
`Pull documents from the remote git repository`
|
||||||
|
> airshipctl document pull
|
||||||
|
|
||||||
> airshipctl phase run workers
|
`Initialize the kind cluster with cluster api and docker provider components`
|
||||||
|
> airshipctl phase run clusterctl-init-ephemeral
|
||||||
|
|
||||||
Note: `airshipctl phase run initinfra-ephemeral` is not used because all the provider
|
`Use the management cluster to create a target cluster with one control plane`
|
||||||
components are initialized using `airshipctl cluster init`
|
> airshipctl phase run controlplane-ephemeral
|
||||||
|
|
||||||
The phase `initinfra` is included just to get `validate docs` to
|
`Get multiple contexts for every cluster in the airship site`
|
||||||
pass.
|
> airshipctl cluster get-kubeconfig > ~/.airship/kubeconfig-tmp
|
||||||
|
|
||||||
## Common Pre-requisites
|
`Initialize CNI on target cluster`
|
||||||
|
> airshipctl phase run initinfra-networking-target
|
||||||
|
|
||||||
|
`Initialize Target Cluster with cluster api and docker proivder components`
|
||||||
|
> airshipctl phase run clusterctl-init-target
|
||||||
|
|
||||||
|
`Move managment CRDs from kind management cluster to target management cluster`
|
||||||
|
> airshipctl phase run clusterctl-move
|
||||||
|
|
||||||
|
`Use target management cluster to deploy workers`
|
||||||
|
> airshipctl phase run workers-target
|
||||||
|
|
||||||
|
## Getting Started
|
||||||
|
|
||||||
|
### Build [Airshipctl](https://docs.airshipit.org/airshipctl/developers.html)
|
||||||
|
|
||||||
|
```
|
||||||
|
$ git clone https://review.opendev.org/airship/airshipctl
|
||||||
|
|
||||||
|
$ cd airshipctl
|
||||||
|
|
||||||
|
$ ./tools/deployment/21_systemwide_executable.sh
|
||||||
|
```
|
||||||
|
|
||||||
|
### Create airship configuration
|
||||||
|
|
||||||
|
```
|
||||||
|
$ cat ~/.airship/config
|
||||||
|
|
||||||
|
apiVersion: airshipit.org/v1alpha1
|
||||||
|
managementConfiguration:
|
||||||
|
dummy_management_config:
|
||||||
|
type: redfish
|
||||||
|
insecure: true
|
||||||
|
useproxy: false
|
||||||
|
systemActionRetries: 30
|
||||||
|
systemRebootDelay: 30
|
||||||
|
contexts:
|
||||||
|
ephemeral-cluster:
|
||||||
|
contextKubeconf: ephemeral-cluster_ephemeral
|
||||||
|
manifest: dummy_manifest
|
||||||
|
managementConfiguration: dummy_management_config
|
||||||
|
target-cluster:
|
||||||
|
contextKubeconf: target-cluster_target
|
||||||
|
manifest: dummy_manifest
|
||||||
|
managementConfiguration: dummy_management_config
|
||||||
|
currentContext: ephemeral-cluster
|
||||||
|
kind: Config
|
||||||
|
manifests:
|
||||||
|
dummy_manifest:
|
||||||
|
phaseRepositoryName: primary
|
||||||
|
repositories:
|
||||||
|
primary:
|
||||||
|
checkout:
|
||||||
|
branch: master
|
||||||
|
force: false
|
||||||
|
remoteRef: ""
|
||||||
|
tag: ""
|
||||||
|
url: https://review.opendev.org/airship/airshipctl
|
||||||
|
metadataPath: manifests/site/docker-test-site/metadata.yaml
|
||||||
|
targetPath: /tmp/airship
|
||||||
|
```
|
||||||
|
|
||||||
|
### Deploy Control plane and Workers
|
||||||
|
|
||||||
|
```
|
||||||
|
$ export KIND_EXPERIMENTAL_DOCKER_NETWORK=bridge
|
||||||
|
|
||||||
|
$ export KUBECONFIG="${HOME}/.airship/kubeconfig"
|
||||||
|
|
||||||
|
$ kind create cluster --name ephemeral-cluster --wait 120s --kubeconfig \
|
||||||
|
"${HOME}/.airship/kubeconfig" \
|
||||||
|
--config ./tools/deployment/templates/kind-cluster-with-extramounts
|
||||||
|
|
||||||
|
$ kubectl config set-context ephemeral-cluster \
|
||||||
|
--cluster kind-ephemeral-cluster \
|
||||||
|
--user kind-ephemeral-cluster --kubeconfig $KUBECONFIG
|
||||||
|
|
||||||
|
$ airshipctl document pull -n --debug
|
||||||
|
|
||||||
|
$ airshipctl phase run clusterctl-init-ephemeral --debug --wait-timeout 300s
|
||||||
|
|
||||||
|
$ airshipctl phase run controlplane-ephemeral --debug --wait-timeout 300s
|
||||||
|
|
||||||
|
$ airshipctl cluster get-kubeconfig > ~/.airship/kubeconfig-tmp
|
||||||
|
|
||||||
|
$ mv ~/.airship/kubeconfig-tmp "${KUBECONFIG}"
|
||||||
|
|
||||||
|
$ airshipctl phase run initinfra-networking-target --debug
|
||||||
|
|
||||||
|
$ kubectl --context target-cluster wait \
|
||||||
|
--for=condition=Ready nodes --all --timeout 300s
|
||||||
|
|
||||||
|
$ kubectl get nodes --context target-cluster -A
|
||||||
|
|
||||||
|
```
|
||||||
|
|
||||||
|
`Note:
|
||||||
|
Please take note of the control plane node name because it is untainted
|
||||||
|
in the next step.
|
||||||
|
For eg. control plane node name could be something like
|
||||||
|
target-cluster-control-plane-twwsv
|
||||||
|
`
|
||||||
|
|
||||||
|
```
|
||||||
|
|
||||||
|
$ kubectl taint node target-cluster-control-plane-twwsv \
|
||||||
|
node-role.kubernetes.io/master- --context target-cluster --request-timeout 10s
|
||||||
|
|
||||||
|
$ airshipctl phase run clusterctl-init-target --debug --wait-timeout 300s
|
||||||
|
|
||||||
|
$ kubectl get pods -A --context target-cluster
|
||||||
|
|
||||||
|
$ airshipctl phase run clusterctl-move --debug --progress
|
||||||
|
|
||||||
|
$ kubectl get machines --context target-cluster
|
||||||
|
|
||||||
|
$ kind delete cluster --name "ephemeral-cluster"
|
||||||
|
|
||||||
|
$ airshipctl phase run workers-target --debug
|
||||||
|
|
||||||
|
$ kubectl get machines --context target-cluster
|
||||||
|
|
||||||
|
NAME PROVIDERID PHASE
|
||||||
|
target-cluster-control-plane-m5jf7 docker:////target-cluster-control-plane-m5jf7 Running
|
||||||
|
target-cluster-md-0-84db44cdff-r8dkr docker:////target-cluster-md-0-84db44cdff-r8dkr Running
|
||||||
|
|
||||||
|
```
|
||||||
|
|
||||||
|
## Scale Workers
|
||||||
|
|
||||||
|
Worker count can be adjusted in airshipctl/manifests/site/docker-test-site/
|
||||||
|
target/workers/machine_count.json.
|
||||||
|
|
||||||
|
In this example, we have changed it to 3.
|
||||||
|
|
||||||
|
```
|
||||||
|
|
||||||
|
$ cat /tmp/airship/airshipctl/manifests/site/docker-test-site/target/workers/machine_count.json
|
||||||
|
|
||||||
|
[
|
||||||
|
{ "op": "replace","path": "/spec/replicas","value": 3 }
|
||||||
|
]
|
||||||
|
|
||||||
|
$ airshipctl phase run workers-target --debug
|
||||||
|
|
||||||
|
$ kubectl get machines --kubeconfig /tmp/target-cluster.kubeconfig
|
||||||
|
|
||||||
|
NAME PROVIDERID PHASE
|
||||||
|
target-cluster-control-plane-m5jf7 docker:////target-cluster-control-plane-m5jf7 Running
|
||||||
|
target-cluster-md-0-84db44cdff-b6zp6 docker:////target-cluster-md-0-84db44cdff-b6zp6 Running
|
||||||
|
target-cluster-md-0-84db44cdff-g4nm7 docker:////target-cluster-md-0-84db44cdff-g4nm7 Running
|
||||||
|
target-cluster-md-0-84db44cdff-r8dkr docker:////target-cluster-md-0-84db44cdff-r8dkr Running
|
||||||
|
```
|
||||||
|
|
||||||
|
## Clean Up
|
||||||
|
|
||||||
|
```
|
||||||
|
$ kind get clusters
|
||||||
|
target-cluster
|
||||||
|
|
||||||
|
$ kind delete cluster --name target-cluster
|
||||||
|
```
|
||||||
|
|
||||||
|
## More Information
|
||||||
|
|
||||||
|
- worker count can be adjusted from airshipctl/manifests/site/docker-test-site/
|
||||||
|
target/workers/machine_count.json
|
||||||
|
|
||||||
|
- control plane count can be adjusted from airshipctl/manifests/site/
|
||||||
|
docker-test-site/ephemeral/controlplane/machine_count.json
|
||||||
|
|
||||||
|
## Reference
|
||||||
|
|
||||||
|
### Pre-requisites
|
||||||
|
|
||||||
* Install [Docker](https://www.docker.com/)
|
* Install [Docker](https://www.docker.com/)
|
||||||
* Install [Kubectl](https://kubernetes.io/docs/tasks/tools/install-kubectl/)
|
* Install [Kubectl](https://kubernetes.io/docs/tasks/tools/install-kubectl/)
|
||||||
* Install [Kind](https://kind.sigs.k8s.io/)
|
* Install [Kind](https://kind.sigs.k8s.io/)
|
||||||
* Install
|
* Check [Software Version Information](#Software-Version-Information),
|
||||||
[Kustomize](https://kubernetes-sigs.github.io/kustomize/installation/binaries/)
|
|
||||||
* Install [Airshipctl](https://docs.airshipit.org/airshipctl/developers.html)
|
|
||||||
|
|
||||||
Also, check [Software Version Information](#Software-Version-Information),
|
|
||||||
[Special Instructions](#Special-Instructions) and [Virtual Machine
|
[Special Instructions](#Special-Instructions) and [Virtual Machine
|
||||||
Specification](#Virtual-Machine-Specification)
|
Specification](#Virtual-Machine-Specification)
|
||||||
|
|
||||||
## Getting Started
|
|
||||||
|
|
||||||
Kind will be used to setup a kubernetes cluster, that will be later transformed
|
|
||||||
into a management cluster using airshipctl. The kind kubernetes cluster will be
|
|
||||||
initialized with cluster API and Cluster API docker provider components.
|
|
||||||
|
|
||||||
Run the following command to create a kind configuration file, that would mount
|
|
||||||
the docker.sock file from the host operating system into the kind cluster. This
|
|
||||||
is required by the management cluster to create machines on host as docker
|
|
||||||
containers.
|
|
||||||
|
|
||||||
$ vim kind-cluster-with-extramounts.yaml
|
|
||||||
|
|
||||||
```
|
|
||||||
kind: Cluster
|
|
||||||
apiVersion: kind.sigs.k8s.io/v1alpha3
|
|
||||||
nodes:
|
|
||||||
- role: control-plane
|
|
||||||
extraMounts:
|
|
||||||
- hostPath: /var/run/docker.sock
|
|
||||||
containerPath: /var/run/docker.sock
|
|
||||||
|
|
||||||
```
|
|
||||||
|
|
||||||
Save and exit.
|
|
||||||
|
|
||||||
$ export KIND_EXPERIMENTAL_DOCKER_NETWORK=bridge
|
|
||||||
|
|
||||||
$ kind create cluster --name capi-docker --config ~/kind-cluster-with-extramounts.yaml
|
|
||||||
|
|
||||||
```
|
|
||||||
Creating cluster "capi-docker" ...
|
|
||||||
WARNING: Overriding docker network due to KIND_EXPERIMENTAL_DOCKER_NETWORK
|
|
||||||
WARNING: Here be dragons! This is not supported currently.
|
|
||||||
✓ Ensuring node image (kindest/node:v1.18.2) 🖼
|
|
||||||
✓ Preparing nodes 📦
|
|
||||||
✓ Writing configuration 📜
|
|
||||||
✓ Starting control-plane 🕹️
|
|
||||||
✓ Installing CNI 🔌
|
|
||||||
✓ Installing StorageClass 💾
|
|
||||||
Set kubectl context to "kind-capi-docker"
|
|
||||||
You can now use your cluster with:
|
|
||||||
|
|
||||||
kubectl cluster-info --context kind-capi-docker
|
|
||||||
Check if all the pods are up.
|
|
||||||
```
|
|
||||||
|
|
||||||
$ kubectl get pods -A
|
|
||||||
|
|
||||||
```
|
|
||||||
NAMESPACE NAME READY STATUS RESTARTS AGE
|
|
||||||
kube-system coredns-6955765f44-fvg8p 1/1 Running 0 72s
|
|
||||||
kube-system coredns-6955765f44-gm96d 1/1 Running 0 72s
|
|
||||||
kube-system etcd-capi-docker-control-plane 1/1 Running 0 83s
|
|
||||||
kube-system kindnet-7fqv6 1/1 Running 0 72s
|
|
||||||
kube-system kube-apiserver-capi-docker-control-plane 1/1 Running 0 83s
|
|
||||||
kube-system kube-controller-manager-capi-docker-control-plane 1/1 Running 0 83s
|
|
||||||
kube-system kube-proxy-gqlnm 1/1 Running 0 72s
|
|
||||||
kube-system kube-scheduler-capi-docker-control-plane 1/1 Running 0 83s
|
|
||||||
local-path-storage local-path-provisioner-7745554f7f-2qcv7 1/1 Running 0 72s
|
|
||||||
```
|
|
||||||
|
|
||||||
## Create airshipctl configuration files
|
|
||||||
|
|
||||||
$ mkdir ~/.airship
|
|
||||||
|
|
||||||
$ airshipctl config init
|
|
||||||
|
|
||||||
Run the below command to configure docker manifest, and add it to airship config
|
|
||||||
|
|
||||||
```
|
|
||||||
$ airshipctl config set-manifest docker_manifest --repo primary \
|
|
||||||
--url https://opendev.org/airship/airshipctl --branch master \
|
|
||||||
--phase --sub-path manifests/site/docker-test-site --target-path /tmp/airship
|
|
||||||
```
|
|
||||||
|
|
||||||
$ airshipctl config set-context kind-capi-docker --manifest docker_manifest
|
|
||||||
|
|
||||||
```
|
|
||||||
Context "kind-capi-docker" modified.
|
|
||||||
```
|
|
||||||
$ cp ~/.kube/config ~/.airship/kubeconfig
|
|
||||||
|
|
||||||
$ airshipctl config get-context
|
|
||||||
|
|
||||||
```
|
|
||||||
Context: kind-capi-docker
|
|
||||||
contextKubeconf: kind-capi-docker_target
|
|
||||||
manifest: docker_manifest
|
|
||||||
|
|
||||||
LocationOfOrigin: /home/rishabh/.airship/kubeconfig
|
|
||||||
cluster: kind-capi-docker_target
|
|
||||||
user: kind-capi-docker
|
|
||||||
```
|
|
||||||
$ airshipctl config use-context kind-capi-docker
|
|
||||||
|
|
||||||
```
|
|
||||||
Manifest "docker_manifest" created.
|
|
||||||
```
|
|
||||||
|
|
||||||
$ airshipctl document pull --debug
|
|
||||||
|
|
||||||
```
|
|
||||||
[airshipctl] 2020/08/12 14:07:13 Reading current context manifest information from /home/rishabh/.airship/config
|
|
||||||
[airshipctl] 2020/08/12 14:07:13 Downloading primary repository airshipctl from https://review.opendev.org/airship/airshipctl into /tmp/airship
|
|
||||||
[airshipctl] 2020/08/12 14:07:13 Attempting to download the repository airshipctl
|
|
||||||
[airshipctl] 2020/08/12 14:07:13 Attempting to clone the repository airshipctl from https://review.opendev.org/airship/airshipctl
|
|
||||||
[airshipctl] 2020/08/12 14:07:23 Attempting to checkout the repository airshipctl from branch refs/heads/master
|
|
||||||
```
|
|
||||||
$ airshipctl config set-manifest docker_manifest --target-path /tmp/airship/airshipctl
|
|
||||||
|
|
||||||
## Initialize the management cluster
|
|
||||||
|
|
||||||
$ airshipctl cluster init --debug
|
|
||||||
|
|
||||||
```
|
|
||||||
[airshipctl] 2020/08/12 14:08:23 Starting cluster-api initiation
|
|
||||||
Installing the clusterctl inventory CRD
|
|
||||||
Creating CustomResourceDefinition="providers.clusterctl.cluster.x-k8s.io"
|
|
||||||
Fetching providers
|
|
||||||
[airshipctl] 2020/08/12 14:08:23 Creating arishipctl repository implementation interface for provider cluster-api of type CoreProvider
|
|
||||||
[airshipctl] 2020/08/12 14:08:23 Setting up airshipctl provider Components client
|
|
||||||
Provider type: CoreProvider, name: cluster-api
|
|
||||||
[airshipctl] 2020/08/12 14:08:23 Getting airshipctl provider components, skipping variable substitution: true.
|
|
||||||
Provider type: CoreProvider, name: cluster-api
|
|
||||||
Fetching File="components.yaml" Provider="cluster-api" Version="v0.3.3"
|
|
||||||
[airshipctl] 2020/08/12 14:08:23 Building cluster-api provider component documents from kustomize path at /tmp/airship/airshipctl/manifests/function/capi/v0.3.3
|
|
||||||
[airshipctl] 2020/08/12 14:08:24 Creating arishipctl repository implementation interface for provider kubeadm of type BootstrapProvider
|
|
||||||
[airshipctl] 2020/08/12 14:08:24 Setting up airshipctl provider Components client
|
|
||||||
Provider type: BootstrapProvider, name: kubeadm
|
|
||||||
[airshipctl] 2020/08/12 14:08:24 Getting airshipctl provider components, skipping variable substitution: true.
|
|
||||||
Provider type: BootstrapProvider, name: kubeadm
|
|
||||||
Fetching File="components.yaml" Provider="bootstrap-kubeadm" Version="v0.3.3"
|
|
||||||
[airshipctl] 2020/08/12 14:08:24 Building cluster-api provider component documents from kustomize path at /tmp/airship/airshipctl/manifests/function/cabpk/v0.3.3
|
|
||||||
[airshipctl] 2020/08/12 14:08:24 Creating arishipctl repository implementation interface for provider kubeadm of type ControlPlaneProvider
|
|
||||||
[airshipctl] 2020/08/12 14:08:24 Setting up airshipctl provider Components client
|
|
||||||
Provider type: ControlPlaneProvider, name: kubeadm
|
|
||||||
[airshipctl] 2020/08/12 14:08:24 Getting airshipctl provider components, skipping variable substitution: true.
|
|
||||||
Provider type: ControlPlaneProvider, name: kubeadm
|
|
||||||
Fetching File="components.yaml" Provider="control-plane-kubeadm" Version="v0.3.3"
|
|
||||||
[airshipctl] 2020/08/12 14:08:24 Building cluster-api provider component documents from kustomize path at /tmp/airship/airshipctl/manifests/function/cacpk/v0.3.3
|
|
||||||
[airshipctl] 2020/08/12 14:08:24 Creating arishipctl repository implementation interface for provider docker of type InfrastructureProvider
|
|
||||||
[airshipctl] 2020/08/12 14:08:24 Setting up airshipctl provider Components client
|
|
||||||
Provider type: InfrastructureProvider, name: docker
|
|
||||||
[airshipctl] 2020/08/12 14:08:24 Getting airshipctl provider components, skipping variable substitution: true.
|
|
||||||
Provider type: InfrastructureProvider, name: docker
|
|
||||||
Fetching File="components.yaml" Provider="infrastructure-docker" Version="v0.3.7"
|
|
||||||
[airshipctl] 2020/08/12 14:08:24 Building cluster-api provider component documents from kustomize path at /tmp/airship/airshipctl/manifests/function/capd/v0.3.7
|
|
||||||
[airshipctl] 2020/08/12 14:08:24 Creating arishipctl repository implementation interface for provider cluster-api of type CoreProvider
|
|
||||||
Fetching File="metadata.yaml" Provider="cluster-api" Version="v0.3.3"
|
|
||||||
[airshipctl] 2020/08/12 14:08:24 Building cluster-api provider component documents from kustomize path at /tmp/airship/airshipctl/manifests/function/capi/v0.3.3
|
|
||||||
[airshipctl] 2020/08/12 14:08:25 Creating arishipctl repository implementation interface for provider kubeadm of type BootstrapProvider
|
|
||||||
Fetching File="metadata.yaml" Provider="bootstrap-kubeadm" Version="v0.3.3"
|
|
||||||
[airshipctl] 2020/08/12 14:08:25 Building cluster-api provider component documents from kustomize path at /tmp/airship/airshipctl/manifests/function/cabpk/v0.3.3
|
|
||||||
[airshipctl] 2020/08/12 14:08:25 Creating arishipctl repository implementation interface for provider kubeadm of type ControlPlaneProvider
|
|
||||||
Fetching File="metadata.yaml" Provider="control-plane-kubeadm" Version="v0.3.3"
|
|
||||||
[airshipctl] 2020/08/12 14:08:25 Building cluster-api provider component documents from kustomize path at /tmp/airship/airshipctl/manifests/function/cacpk/v0.3.3
|
|
||||||
[airshipctl] 2020/08/12 14:08:25 Creating arishipctl repository implementation interface for provider docker of type InfrastructureProvider
|
|
||||||
Fetching File="metadata.yaml" Provider="infrastructure-docker" Version="v0.3.7"
|
|
||||||
[airshipctl] 2020/08/12 14:08:25 Building cluster-api provider component documents from kustomize path at /tmp/airship/airshipctl/manifests/function/capd/v0.3.7
|
|
||||||
Installing cert-manager
|
|
||||||
Creating Namespace="cert-manager"
|
|
||||||
Creating CustomResourceDefinition="challenges.acme.cert-manager.io"
|
|
||||||
Creating CustomResourceDefinition="orders.acme.cert-manager.io"
|
|
||||||
Creating CustomResourceDefinition="certificaterequests.cert-manager.io"
|
|
||||||
Creating CustomResourceDefinition="certificates.cert-manager.io"
|
|
||||||
Creating CustomResourceDefinition="clusterissuers.cert-manager.io"
|
|
||||||
Creating CustomResourceDefinition="issuers.cert-manager.io"
|
|
||||||
Creating ServiceAccount="cert-manager-cainjector" Namespace="cert-manager"
|
|
||||||
Creating ServiceAccount="cert-manager" Namespace="cert-manager"
|
|
||||||
Creating ServiceAccount="cert-manager-webhook" Namespace="cert-manager"
|
|
||||||
Creating ClusterRole="cert-manager-cainjector"
|
|
||||||
Creating ClusterRoleBinding="cert-manager-cainjector"
|
|
||||||
Creating Role="cert-manager-cainjector:leaderelection" Namespace="kube-system"
|
|
||||||
Creating RoleBinding="cert-manager-cainjector:leaderelection" Namespace="kube-system"
|
|
||||||
Creating ClusterRoleBinding="cert-manager-webhook:auth-delegator"
|
|
||||||
Creating RoleBinding="cert-manager-webhook:webhook-authentication-reader" Namespace="kube-system"
|
|
||||||
Creating ClusterRole="cert-manager-webhook:webhook-requester"
|
|
||||||
Creating Role="cert-manager:leaderelection" Namespace="kube-system"
|
|
||||||
Creating RoleBinding="cert-manager:leaderelection" Namespace="kube-system"
|
|
||||||
Creating ClusterRole="cert-manager-controller-issuers"
|
|
||||||
Creating ClusterRole="cert-manager-controller-clusterissuers"
|
|
||||||
Creating ClusterRole="cert-manager-controller-certificates"
|
|
||||||
Creating ClusterRole="cert-manager-controller-orders"
|
|
||||||
Creating ClusterRole="cert-manager-controller-challenges"
|
|
||||||
Creating ClusterRole="cert-manager-controller-ingress-shim"
|
|
||||||
Creating ClusterRoleBinding="cert-manager-controller-issuers"
|
|
||||||
Creating ClusterRoleBinding="cert-manager-controller-clusterissuers"
|
|
||||||
Creating ClusterRoleBinding="cert-manager-controller-certificates"
|
|
||||||
Creating ClusterRoleBinding="cert-manager-controller-orders"
|
|
||||||
Creating ClusterRoleBinding="cert-manager-controller-challenges"
|
|
||||||
Creating ClusterRoleBinding="cert-manager-controller-ingress-shim"
|
|
||||||
Creating ClusterRole="cert-manager-view"
|
|
||||||
Creating ClusterRole="cert-manager-edit"
|
|
||||||
Creating Service="cert-manager" Namespace="cert-manager"
|
|
||||||
Creating Service="cert-manager-webhook" Namespace="cert-manager"
|
|
||||||
Creating Deployment="cert-manager-cainjector" Namespace="cert-manager"
|
|
||||||
Creating Deployment="cert-manager" Namespace="cert-manager"
|
|
||||||
Creating Deployment="cert-manager-webhook" Namespace="cert-manager"
|
|
||||||
Creating APIService="v1beta1.webhook.cert-manager.io"
|
|
||||||
Creating MutatingWebhookConfiguration="cert-manager-webhook"
|
|
||||||
Creating ValidatingWebhookConfiguration="cert-manager-webhook"
|
|
||||||
Waiting for cert-manager to be available...
|
|
||||||
Installing Provider="cluster-api" Version="v0.3.3" TargetNamespace="capi-system"
|
|
||||||
Creating shared objects Provider="cluster-api" Version="v0.3.3"
|
|
||||||
Creating Namespace="capi-webhook-system"
|
|
||||||
Creating CustomResourceDefinition="clusters.cluster.x-k8s.io"
|
|
||||||
Creating CustomResourceDefinition="machinedeployments.cluster.x-k8s.io"
|
|
||||||
Creating CustomResourceDefinition="machinehealthchecks.cluster.x-k8s.io"
|
|
||||||
Creating CustomResourceDefinition="machinepools.exp.cluster.x-k8s.io"
|
|
||||||
Creating CustomResourceDefinition="machines.cluster.x-k8s.io"
|
|
||||||
Creating CustomResourceDefinition="machinesets.cluster.x-k8s.io"
|
|
||||||
Creating MutatingWebhookConfiguration="capi-mutating-webhook-configuration"
|
|
||||||
Creating Service="capi-webhook-service" Namespace="capi-webhook-system"
|
|
||||||
Creating Deployment="capi-controller-manager" Namespace="capi-webhook-system"
|
|
||||||
Creating Certificate="capi-serving-cert" Namespace="capi-webhook-system"
|
|
||||||
Creating Issuer="capi-selfsigned-issuer" Namespace="capi-webhook-system"
|
|
||||||
Creating ValidatingWebhookConfiguration="capi-validating-webhook-configuration"
|
|
||||||
Creating instance objects Provider="cluster-api" Version="v0.3.3" TargetNamespace="capi-system"
|
|
||||||
Creating Namespace="capi-system"
|
|
||||||
Creating Role="capi-leader-election-role" Namespace="capi-system"
|
|
||||||
Creating ClusterRole="capi-system-capi-aggregated-manager-role"
|
|
||||||
Creating ClusterRole="capi-system-capi-manager-role"
|
|
||||||
Creating ClusterRole="capi-system-capi-proxy-role"
|
|
||||||
Creating RoleBinding="capi-leader-election-rolebinding" Namespace="capi-system"
|
|
||||||
Creating ClusterRoleBinding="capi-system-capi-manager-rolebinding"
|
|
||||||
Creating ClusterRoleBinding="capi-system-capi-proxy-rolebinding"
|
|
||||||
Creating Service="capi-controller-manager-metrics-service" Namespace="capi-system"
|
|
||||||
Creating Deployment="capi-controller-manager" Namespace="capi-system"
|
|
||||||
Creating inventory entry Provider="cluster-api" Version="v0.3.3" TargetNamespace="capi-system"
|
|
||||||
Installing Provider="bootstrap-kubeadm" Version="v0.3.3" TargetNamespace="capi-kubeadm-bootstrap-system"
|
|
||||||
Creating shared objects Provider="bootstrap-kubeadm" Version="v0.3.3"
|
|
||||||
Creating CustomResourceDefinition="kubeadmconfigs.bootstrap.cluster.x-k8s.io"
|
|
||||||
Creating CustomResourceDefinition="kubeadmconfigtemplates.bootstrap.cluster.x-k8s.io"
|
|
||||||
Creating Service="capi-kubeadm-bootstrap-webhook-service" Namespace="capi-webhook-system"
|
|
||||||
Creating Deployment="capi-kubeadm-bootstrap-controller-manager" Namespace="capi-webhook-system"
|
|
||||||
Creating Certificate="capi-kubeadm-bootstrap-serving-cert" Namespace="capi-webhook-system"
|
|
||||||
Creating Issuer="capi-kubeadm-bootstrap-selfsigned-issuer" Namespace="capi-webhook-system"
|
|
||||||
Creating instance objects Provider="bootstrap-kubeadm" Version="v0.3.3" TargetNamespace="capi-kubeadm-bootstrap-system"
|
|
||||||
Creating Namespace="capi-kubeadm-bootstrap-system"
|
|
||||||
Creating Role="capi-kubeadm-bootstrap-leader-election-role" Namespace="capi-kubeadm-bootstrap-system"
|
|
||||||
Creating ClusterRole="capi-kubeadm-bootstrap-system-capi-kubeadm-bootstrap-manager-role"
|
|
||||||
Creating ClusterRole="capi-kubeadm-bootstrap-system-capi-kubeadm-bootstrap-proxy-role"
|
|
||||||
Creating RoleBinding="capi-kubeadm-bootstrap-leader-election-rolebinding" Namespace="capi-kubeadm-bootstrap-system"
|
|
||||||
Creating ClusterRoleBinding="capi-kubeadm-bootstrap-system-capi-kubeadm-bootstrap-manager-rolebinding"
|
|
||||||
Creating ClusterRoleBinding="capi-kubeadm-bootstrap-system-capi-kubeadm-bootstrap-proxy-rolebinding"
|
|
||||||
Creating Service="capi-kubeadm-bootstrap-controller-manager-metrics-service" Namespace="capi-kubeadm-bootstrap-system"
|
|
||||||
Creating Deployment="capi-kubeadm-bootstrap-controller-manager" Namespace="capi-kubeadm-bootstrap-system"
|
|
||||||
Creating inventory entry Provider="bootstrap-kubeadm" Version="v0.3.3" TargetNamespace="capi-kubeadm-bootstrap-system"
|
|
||||||
Installing Provider="control-plane-kubeadm" Version="v0.3.3" TargetNamespace="capi-kubeadm-control-plane-system"
|
|
||||||
Creating shared objects Provider="control-plane-kubeadm" Version="v0.3.3"
|
|
||||||
Creating CustomResourceDefinition="kubeadmcontrolplanes.controlplane.cluster.x-k8s.io"
|
|
||||||
Creating MutatingWebhookConfiguration="capi-kubeadm-control-plane-mutating-webhook-configuration"
|
|
||||||
Creating Service="capi-kubeadm-control-plane-webhook-service" Namespace="capi-webhook-system"
|
|
||||||
Creating Deployment="capi-kubeadm-control-plane-controller-manager" Namespace="capi-webhook-system"
|
|
||||||
Creating Certificate="capi-kubeadm-control-plane-serving-cert" Namespace="capi-webhook-system"
|
|
||||||
Creating Issuer="capi-kubeadm-control-plane-selfsigned-issuer" Namespace="capi-webhook-system"
|
|
||||||
Creating ValidatingWebhookConfiguration="capi-kubeadm-control-plane-validating-webhook-configuration"
|
|
||||||
Creating instance objects Provider="control-plane-kubeadm" Version="v0.3.3" TargetNamespace="capi-kubeadm-control-plane-system"
|
|
||||||
Creating Namespace="capi-kubeadm-control-plane-system"
|
|
||||||
Creating Role="capi-kubeadm-control-plane-leader-election-role" Namespace="capi-kubeadm-control-plane-system"
|
|
||||||
Creating Role="capi-kubeadm-control-plane-manager-role" Namespace="capi-kubeadm-control-plane-system"
|
|
||||||
Creating ClusterRole="capi-kubeadm-control-plane-system-capi-kubeadm-control-plane-manager-role"
|
|
||||||
Creating ClusterRole="capi-kubeadm-control-plane-system-capi-kubeadm-control-plane-proxy-role"
|
|
||||||
Creating RoleBinding="capi-kubeadm-control-plane-leader-election-rolebinding" Namespace="capi-kubeadm-control-plane-system"
|
|
||||||
Creating ClusterRoleBinding="capi-kubeadm-control-plane-system-capi-kubeadm-control-plane-manager-rolebinding"
|
|
||||||
Creating ClusterRoleBinding="capi-kubeadm-control-plane-system-capi-kubeadm-control-plane-proxy-rolebinding"
|
|
||||||
Creating Service="capi-kubeadm-control-plane-controller-manager-metrics-service" Namespace="capi-kubeadm-control-plane-system"
|
|
||||||
Creating Deployment="capi-kubeadm-control-plane-controller-manager" Namespace="capi-kubeadm-control-plane-system"
|
|
||||||
Creating inventory entry Provider="control-plane-kubeadm" Version="v0.3.3" TargetNamespace="capi-kubeadm-control-plane-system"
|
|
||||||
Installing Provider="infrastructure-docker" Version="v0.3.7" TargetNamespace="capd-system"
|
|
||||||
Creating shared objects Provider="infrastructure-docker" Version="v0.3.7"
|
|
||||||
Creating CustomResourceDefinition="dockerclusters.infrastructure.cluster.x-k8s.io"
|
|
||||||
Creating CustomResourceDefinition="dockermachines.infrastructure.cluster.x-k8s.io"
|
|
||||||
Creating CustomResourceDefinition="dockermachinetemplates.infrastructure.cluster.x-k8s.io"
|
|
||||||
Creating ValidatingWebhookConfiguration="capd-validating-webhook-configuration"
|
|
||||||
Creating instance objects Provider="infrastructure-docker" Version="v0.3.7" TargetNamespace="capd-system"
|
|
||||||
Creating Namespace="capd-system"
|
|
||||||
Creating Role="capd-leader-election-role" Namespace="capd-system"
|
|
||||||
Creating ClusterRole="capd-system-capd-manager-role"
|
|
||||||
Creating ClusterRole="capd-system-capd-proxy-role"
|
|
||||||
Creating RoleBinding="capd-leader-election-rolebinding" Namespace="capd-system"
|
|
||||||
Creating ClusterRoleBinding="capd-system-capd-manager-rolebinding"
|
|
||||||
Creating ClusterRoleBinding="capd-system-capd-proxy-rolebinding"
|
|
||||||
Creating Service="capd-controller-manager-metrics-service" Namespace="capd-system"
|
|
||||||
Creating Service="capd-webhook-service" Namespace="capd-system"
|
|
||||||
Creating Deployment="capd-controller-manager" Namespace="capd-system"
|
|
||||||
Creating Certificate="capd-serving-cert" Namespace="capd-system"
|
|
||||||
Creating Issuer="capd-selfsigned-issuer" Namespace="capd-system"
|
|
||||||
Creating inventory entry Provider="infrastructure-docker" Version="v0.3.7" TargetNamespace="capd-system"
|
|
||||||
```
|
|
||||||
|
|
||||||
Wait for all the pods to be up.
|
|
||||||
|
|
||||||
$ kubectl get pods -A
|
|
||||||
```
|
|
||||||
NAMESPACE NAME READY STATUS RESTARTS AGE
|
|
||||||
capd-system capd-controller-manager-75f5d546d7-frrm5 2/2 Running 0 77s
|
|
||||||
capi-kubeadm-bootstrap-system capi-kubeadm-bootstrap-controller-manager-5bb9bfdc46-mhbqz 2/2 Running 0 85s
|
|
||||||
capi-kubeadm-control-plane-system capi-kubeadm-control-plane-controller-manager-77466c7666-t69m5 2/2 Running 0 81s
|
|
||||||
capi-system capi-controller-manager-5798474d9f-tp2c2 2/2 Running 0 89s
|
|
||||||
capi-webhook-system capi-controller-manager-5d64dd9dfb-r6mb2 2/2 Running 1 91s
|
|
||||||
capi-webhook-system capi-kubeadm-bootstrap-controller-manager-7c78fff45-dmnlc 2/2 Running 0 88s
|
|
||||||
capi-webhook-system capi-kubeadm-control-plane-controller-manager-58465bb88f-c6j5q 2/2 Running 0 84s
|
|
||||||
cert-manager cert-manager-69b4f77ffc-8vchm 1/1 Running 0 117s
|
|
||||||
cert-manager cert-manager-cainjector-576978ffc8-frsxg 1/1 Running 0 117s
|
|
||||||
cert-manager cert-manager-webhook-c67fbc858-qxrcj 1/1 Running 1 117s
|
|
||||||
kube-system coredns-6955765f44-f28p7 1/1 Running 0 3m12s
|
|
||||||
kube-system coredns-6955765f44-nq5qk 1/1 Running 0 3m12s
|
|
||||||
kube-system etcd-capi-docker-control-plane 1/1 Running 0 3m25s
|
|
||||||
kube-system kindnet-nxm6k 1/1 Running 0 3m12s
|
|
||||||
kube-system kube-apiserver-capi-docker-control-plane 1/1 Running 0 3m25s
|
|
||||||
kube-system kube-controller-manager-capi-docker-control-plane 1/1 Running 0 3m25s
|
|
||||||
kube-system kube-proxy-5jmc5 1/1 Running 0 3m12s
|
|
||||||
kube-system kube-scheduler-capi-docker-control-plane 1/1 Running 0 3m25s
|
|
||||||
local-path-storage local-path-provisioner-7745554f7f-ms989 1/1 Running 0 3m12s
|
|
||||||
```
|
|
||||||
Now, the management cluster is initialized with cluster api and cluster api
|
|
||||||
docker provider components.
|
|
||||||
|
|
||||||
$ kubectl get providers -A
|
|
||||||
|
|
||||||
```
|
|
||||||
NAMESPACE NAME TYPE PROVIDER VERSION WATCH NAMESPACE
|
|
||||||
capd-system infrastructure-docker InfrastructureProvider v0.3.7
|
|
||||||
capi-kubeadm-bootstrap-system bootstrap-kubeadm BootstrapProvider v0.3.3
|
|
||||||
capi-kubeadm-control-plane-system control-plane-kubeadm ControlPlaneProvider v0.3.3
|
|
||||||
capi-system cluster-api CoreProvider v0.3.3
|
|
||||||
```
|
|
||||||
|
|
||||||
$ docker ps
|
|
||||||
|
|
||||||
```
|
|
||||||
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
|
|
||||||
b9690cecdcf2 kindest/node:v1.18.2 "/usr/local/bin/entr…" 14 minutes ago Up 14 minutes 127.0.0.1:32773->6443/tcp capi-docker-control-plane
|
|
||||||
```
|
|
||||||
|
|
||||||
|
|
||||||
## Create your first workload cluster
|
|
||||||
|
|
||||||
$ airshipctl phase run controlplane --debug
|
|
||||||
|
|
||||||
```
|
|
||||||
[airshipctl] 2020/08/12 14:10:12 building bundle from kustomize path /tmp/airship/airshipctl/manifests/site/docker-test-site/target/controlplane
|
|
||||||
[airshipctl] 2020/08/12 14:10:12 Applying bundle, inventory id: kind-capi-docker-target-controlplane
|
|
||||||
[airshipctl] 2020/08/12 14:10:12 Inventory Object config Map not found, auto generating Invetory object
|
|
||||||
[airshipctl] 2020/08/12 14:10:12 Injecting Invetory Object: {"apiVersion":"v1","kind":"ConfigMap","metadata":{"creationTimestamp":null,"labels":{"cli-utils.sigs.k8s.io/inventory-id":"kind-capi-docker-target-controlplane"},"name":"airshipit-kind-capi-docker-target-controlplane","namespace":"airshipit"}}{nsfx:false,beh:unspecified} into bundle
|
|
||||||
[airshipctl] 2020/08/12 14:10:12 Making sure that inventory object namespace airshipit exists
|
|
||||||
configmap/airshipit-kind-capi-docker-target-controlplane-87efb53a created
|
|
||||||
cluster.cluster.x-k8s.io/dtc created
|
|
||||||
machinehealthcheck.cluster.x-k8s.io/dtc-mhc-0 created
|
|
||||||
kubeadmcontrolplane.controlplane.cluster.x-k8s.io/dtc-control-plane created
|
|
||||||
dockercluster.infrastructure.cluster.x-k8s.io/dtc created
|
|
||||||
dockermachinetemplate.infrastructure.cluster.x-k8s.io/dtc-control-plane created
|
|
||||||
6 resource(s) applied. 6 created, 0 unchanged, 0 configured
|
|
||||||
machinehealthcheck.cluster.x-k8s.io/dtc-mhc-0 is NotFound: Resource not found
|
|
||||||
kubeadmcontrolplane.controlplane.cluster.x-k8s.io/dtc-control-plane is NotFound: Resource not found
|
|
||||||
dockercluster.infrastructure.cluster.x-k8s.io/dtc is NotFound: Resource not found
|
|
||||||
dockermachinetemplate.infrastructure.cluster.x-k8s.io/dtc-control-plane is NotFound: Resource not found
|
|
||||||
configmap/airshipit-kind-capi-docker-target-controlplane-87efb53a is NotFound: Resource not found
|
|
||||||
cluster.cluster.x-k8s.io/dtc is NotFound: Resource not found
|
|
||||||
configmap/airshipit-kind-capi-docker-target-controlplane-87efb53a is Current: Resource is always ready
|
|
||||||
cluster.cluster.x-k8s.io/dtc is Current: Resource is current
|
|
||||||
machinehealthcheck.cluster.x-k8s.io/dtc-mhc-0 is Current: Resource is current
|
|
||||||
kubeadmcontrolplane.controlplane.cluster.x-k8s.io/dtc-control-plane is Current: Resource is current
|
|
||||||
dockercluster.infrastructure.cluster.x-k8s.io/dtc is Current: Resource is current
|
|
||||||
dockermachinetemplate.infrastructure.cluster.x-k8s.io/dtc-control-plane is Current: Resource is current
|
|
||||||
all resources has reached the Current status
|
|
||||||
```
|
|
||||||
|
|
||||||
$ kubectl get pods -A
|
|
||||||
```
|
|
||||||
NAMESPACE NAME READY STATUS RESTARTS AGE
|
|
||||||
capd-system capd-controller-manager-75f5d546d7-frrm5 2/2 Running 0 77s
|
|
||||||
capi-kubeadm-bootstrap-system capi-kubeadm-bootstrap-controller-manager-5bb9bfdc46-mhbqz 2/2 Running 0 85s
|
|
||||||
capi-kubeadm-control-plane-system capi-kubeadm-control-plane-controller-manager-77466c7666-t69m5 2/2 Running 0 81s
|
|
||||||
capi-system capi-controller-manager-5798474d9f-tp2c2 2/2 Running 0 89s
|
|
||||||
capi-webhook-system capi-controller-manager-5d64dd9dfb-r6mb2 2/2 Running 1 91s
|
|
||||||
capi-webhook-system capi-kubeadm-bootstrap-controller-manager-7c78fff45-dmnlc 2/2 Running 0 88s
|
|
||||||
capi-webhook-system capi-kubeadm-control-plane-controller-manager-58465bb88f-c6j5q 2/2 Running 0 84s
|
|
||||||
cert-manager cert-manager-69b4f77ffc-8vchm 1/1 Running 0 117s
|
|
||||||
cert-manager cert-manager-cainjector-576978ffc8-frsxg 1/1 Running 0 117s
|
|
||||||
cert-manager cert-manager-webhook-c67fbc858-qxrcj 1/1 Running 1 117s
|
|
||||||
kube-system coredns-6955765f44-f28p7 1/1 Running 0 3m12s
|
|
||||||
kube-system coredns-6955765f44-nq5qk 1/1 Running 0 3m12s
|
|
||||||
kube-system etcd-capi-docker-control-plane 1/1 Running 0 3m25s
|
|
||||||
kube-system kindnet-nxm6k 1/1 Running 0 3m12s
|
|
||||||
kube-system kube-apiserver-capi-docker-control-plane 1/1 Running 0 3m25s
|
|
||||||
kube-system kube-controller-manager-capi-docker-control-plane 1/1 Running 0 3m25s
|
|
||||||
kube-system kube-proxy-5jmc5 1/1 Running 0 3m12s
|
|
||||||
kube-system kube-scheduler-capi-docker-control-plane 1/1 Running 0 3m25s
|
|
||||||
local-path-storage local-path-provisioner-7745554f7f-ms989 1/1 Running 0 3m12s
|
|
||||||
```
|
|
||||||
|
|
||||||
$ kubectl logs capd-controller-manager-75f5d546d7-frrm5 -n capd-system --all-containers=true -f
|
|
||||||
|
|
||||||
```
|
|
||||||
I0812 21:11:24.761608 1 controller.go:272] controller-runtime/controller "msg"="Successfully Reconciled" "controller"="dockermachine" "name"="dtc-control-plane-zc5bw" "namespace"="default"
|
|
||||||
I0812 21:11:25.189401 1 controller.go:272] controller-runtime/controller "msg"="Successfully Reconciled" "controller"="dockermachine" "name"="dtc-control-plane-zc5bw" "namespace"="default"
|
|
||||||
I0812 21:11:26.219320 1 generic_predicates.go:38] controllers/DockerMachine "msg"="One of the provided predicates returned false, blocking further processing" "predicate"="ClusterUnpausedAndInfrastructureReady" "predicateAggregation"="All"
|
|
||||||
I0812 21:11:26.219774 1 cluster_predicates.go:143] controllers/DockerMachine "msg"="Cluster was not unpaused, blocking further processing" "cluster"="dtc" "eventType"="update" "namespace"="default" "predicate"="ClusterUpdateUnpaused"
|
|
||||||
I0812 21:11:26.222004 1 cluster_predicates.go:111] controllers/DockerMachine "msg"="Cluster infrastructure did not become ready, blocking further processing" "cluster"="dtc" "eventType"="update" "namespace"="default" "predicate"="ClusterUpdateInfraReady"
|
|
||||||
I0812 21:11:26.223003 1 generic_predicates.go:89] controllers/DockerMachine "msg"="All of the provided predicates returned false, blocking further processing" "predicate"="ClusterUnpausedAndInfrastructureReady" "predicateAggregation"="Any"
|
|
||||||
I0812 21:11:26.223239 1 generic_predicates.go:89] controllers/DockerMachine "msg"="All of the provided predicates returned false, blocking further processing" "predicate"="ClusterUnpausedAndInfrastructureReady" "predicateAggregation"="Any"
|
|
||||||
I0812 21:11:26.219658 1 cluster_predicates.go:143] controllers/DockerCluster "msg"="Cluster was not unpaused, blocking further processing" "cluster"="dtc" "eventType"="update" "namespace"="default" "predicate"="ClusterUpdateUnpaused"
|
|
||||||
I0812 21:11:26.229665 1 generic_predicates.go:89] controllers/DockerCluster "msg"="All of the provided predicates returned false, blocking further processing" "predicate"="ClusterUnpaused" "predicateAggregation"="Any"
|
|
||||||
```
|
|
||||||
|
|
||||||
$ kubectl get machines
|
|
||||||
```
|
|
||||||
NAME PROVIDERID PHASE
|
|
||||||
dtc-control-plane-p4fsx docker:////dtc-dtc-control-plane-p4fsx Running
|
|
||||||
```
|
|
||||||
|
|
||||||
$ airshipctl phase run workers --debug
|
|
||||||
|
|
||||||
```
|
|
||||||
[airshipctl] 2020/08/12 14:11:55 building bundle from kustomize path /tmp/airship/airshipctl/manifests/site/docker-test-site/target/worker
|
|
||||||
[airshipctl] 2020/08/12 14:11:55 Applying bundle, inventory id: kind-capi-docker-target-worker
|
|
||||||
[airshipctl] 2020/08/12 14:11:55 Inventory Object config Map not found, auto generating Invetory object
|
|
||||||
[airshipctl] 2020/08/12 14:11:55 Injecting Invetory Object: {"apiVersion":"v1","kind":"ConfigMap","metadata":{"creationTimestamp":null,"labels":{"cli-utils.sigs.k8s.io/inventory-id":"kind-capi-docker-target-worker"},"name":"airshipit-kind-capi-docker-target-worker","namespace":"airshipit"}}{nsfx:false,beh:unspecified} into bundle
|
|
||||||
[airshipctl] 2020/08/12 14:11:55 Making sure that inventory object namespace airshipit exists
|
|
||||||
configmap/airshipit-kind-capi-docker-target-worker-b56f83 created
|
|
||||||
kubeadmconfigtemplate.bootstrap.cluster.x-k8s.io/dtc-md-0 created
|
|
||||||
machinedeployment.cluster.x-k8s.io/dtc-md-0 created
|
|
||||||
dockermachinetemplate.infrastructure.cluster.x-k8s.io/dtc-md-0 created
|
|
||||||
4 resource(s) applied. 4 created, 0 unchanged, 0 configured
|
|
||||||
dockermachinetemplate.infrastructure.cluster.x-k8s.io/dtc-md-0 is NotFound: Resource not found
|
|
||||||
configmap/airshipit-kind-capi-docker-target-worker-b56f83 is NotFound: Resource not found
|
|
||||||
kubeadmconfigtemplate.bootstrap.cluster.x-k8s.io/dtc-md-0 is NotFound: Resource not found
|
|
||||||
machinedeployment.cluster.x-k8s.io/dtc-md-0 is NotFound: Resource not found
|
|
||||||
configmap/airshipit-kind-capi-docker-target-worker-b56f83 is Current: Resource is always ready
|
|
||||||
kubeadmconfigtemplate.bootstrap.cluster.x-k8s.io/dtc-md-0 is Current: Resource is current
|
|
||||||
machinedeployment.cluster.x-k8s.io/dtc-md-0 is Current: Resource is current
|
|
||||||
dockermachinetemplate.infrastructure.cluster.x-k8s.io/dtc-md-0 is Current: Resource is current
|
|
||||||
```
|
|
||||||
|
|
||||||
$ kubectl get machines
|
|
||||||
```
|
|
||||||
NAME PROVIDERID PHASE
|
|
||||||
dtc-control-plane-p4fsx docker:////dtc-dtc-control-plane-p4fsx Running
|
|
||||||
dtc-md-0-94c79cf9c-8ct2g Provisioning
|
|
||||||
```
|
|
||||||
|
|
||||||
$ kubectl logs capd-controller-manager-75f5d546d7-frrm5 -n capd-system --all-containers=true -f
|
|
||||||
|
|
||||||
```
|
|
||||||
I0812 21:10:14.071166 1 cluster_predicates.go:111] controllers/DockerMachine "msg"="Cluster infrastructure did not become ready, blocking further processing" "cluster"="dtc" "eventType"="update" "namespace"="default" "predicate"="ClusterUpdateInfraReady"
|
|
||||||
I0812 21:10:14.071204 1 generic_predicates.go:89] controllers/DockerMachine "msg"="All of the provided predicates returned false, blocking further processing" "predicate"="ClusterUnpausedAndInfrastructureReady" "predicateAggregation"="Any"
|
|
||||||
I0812 21:10:14.071325 1 generic_predicates.go:89] controllers/DockerMachine "msg"="All of the provided predicates returned false, blocking further processing" "predicate"="ClusterUnpausedAndInfrastructureReady" "predicateAggregation"="Any"
|
|
||||||
I0812 21:10:14.082937 1 generic_predicates.go:38] controllers/DockerMachine "msg"="One of the provided predicates returned false, blocking further processing" "predicate"="ClusterUnpausedAndInfrastructureReady" "predicateAggregation"="All"
|
|
||||||
I0812 21:10:14.082981 1 cluster_predicates.go:143] controllers/DockerMachine "msg"="Cluster was not unpaused, blocking further processing" "cluster"="dtc" "eventType"="update" "namespace"="default" "predicate"="ClusterUpdateUnpaused"
|
|
||||||
I0812 21:10:14.082994 1 cluster_predicates.go:143] controllers/DockerCluster "msg"="Cluster was not unpaused, blocking further processing" "cluster"="dtc" "eventType"="update" "namespace"="default" "predicate"="ClusterUpdateUnpaused"
|
|
||||||
I0812 21:10:14.083012 1 cluster_predicates.go:111] controllers/DockerMachine "msg"="Cluster infrastructure did not become ready, blocking further processing" "cluster"="dtc" "eventType"="update" "namespace"="default" "predicate"="ClusterUpdateInfraReady"
|
|
||||||
I0812 21:10:14.083024 1 generic_predicates.go:89] controllers/DockerCluster "msg"="All of the provided predicates returned false, blocking further processing" "predicate"="ClusterUnpaused" "predicateAggregation"="Any"
|
|
||||||
I0812 21:10:14.083036 1 generic_predicates.go:89] controllers/DockerMachine "msg"="All of the provided predicates returned false, blocking further processing"
|
|
||||||
```
|
|
||||||
$ kubectl get machines
|
|
||||||
```
|
|
||||||
NAME PROVIDERID PHASE
|
|
||||||
dtc-control-plane-p4fsx docker:////dtc-dtc-control-plane-p4fsx Running
|
|
||||||
dtc-md-0-94c79cf9c-8ct2g docker:////dtc-dtc-md-0-94c79cf9c-8ct2g Running
|
|
||||||
```
|
|
||||||
|
|
||||||
$ kubectl --namespace=default get secret/dtc-kubeconfig -o jsonpath={.data.value} | base64 --decode > ./dtc.kubeconfig
|
|
||||||
|
|
||||||
$ kubectl get nodes --kubeconfig dtc.kubeconfig
|
|
||||||
|
|
||||||
```
|
|
||||||
NAME STATUS ROLES AGE VERSION
|
|
||||||
dtc-dtc-control-plane-p4fsx Ready master 5m45s v1.18.6
|
|
||||||
dtc-dtc-md-0-94c79cf9c-8ct2g Ready <none> 4m45s v1.18.6
|
|
||||||
```
|
|
||||||
|
|
||||||
$ kubectl get pods -A --kubeconfig dtc.kubeconfig
|
|
||||||
```
|
|
||||||
NAMESPACE NAME READY STATUS RESTARTS AGE
|
|
||||||
kube-system calico-kube-controllers-59b699859f-xp8dv 1/1 Running 0 5m40s
|
|
||||||
kube-system calico-node-5drwf 1/1 Running 0 5m39s
|
|
||||||
kube-system calico-node-bqw5j 1/1 Running 0 4m53s
|
|
||||||
kube-system coredns-6955765f44-8kg27 1/1 Running 0 5m40s
|
|
||||||
kube-system coredns-6955765f44-lqzzq 1/1 Running 0 5m40s
|
|
||||||
kube-system etcd-dtc-dtc-control-plane-p4fsx 1/1 Running 0 5m49s
|
|
||||||
kube-system kube-apiserver-dtc-dtc-control-plane-p4fsx 1/1 Running 0 5m49s
|
|
||||||
kube-system kube-controller-manager-dtc-dtc-control-plane-p4fsx 1/1 Running 0 5m49s
|
|
||||||
kube-system kube-proxy-cjcls 1/1 Running 0 5m39s
|
|
||||||
kube-system kube-proxy-fkvpc 1/1 Running 0 4m53s
|
|
||||||
kube-system kube-scheduler-dtc-dtc-control-plane-p4fsx 1/1 Running 0 5m49s
|
|
||||||
```
|
|
||||||
|
|
||||||
## Tear Down Clusters
|
|
||||||
|
|
||||||
The command shown below can be used to delete the control plane, worker nodes and all
|
|
||||||
associated cluster resources
|
|
||||||
|
|
||||||
$ airshipctl phase render --phase-name controlplane -k Cluster | kubectl delete -f -
|
|
||||||
|
|
||||||
```
|
|
||||||
cluster.cluster.x-k8s.io "dtc" deleted
|
|
||||||
```
|
|
||||||
|
|
||||||
To delete the kind cluster, use the following command:
|
|
||||||
|
|
||||||
$ kind delete cluster --name capi-docker
|
|
||||||
|
|
||||||
```
|
|
||||||
Deleting cluster "capi-docker" ...
|
|
||||||
```
|
|
||||||
|
|
||||||
## Reference
|
|
||||||
|
|
||||||
### Provider Manifests
|
|
||||||
|
|
||||||
Provider Configuration is referenced from
|
|
||||||
[config](https://github.com/kubernetes-sigs/cluster-api/tree/master/test/infrastructure/docker/config)
|
|
||||||
Cluster API does not support docker out of the box. Therefore, the metadata
|
|
||||||
infromation is added using files in `airshipctl/manifests/function/capd/data`
|
|
||||||
|
|
||||||
$ tree airshipctl/manifests/function/capd
|
|
||||||
|
|
||||||
```
|
|
||||||
airshipctl/manifests/function/capd
|
|
||||||
└── v0.3.7
|
|
||||||
├── certmanager
|
|
||||||
│ ├── certificate.yaml
|
|
||||||
│ ├── kustomization.yaml
|
|
||||||
│ └── kustomizeconfig.yaml
|
|
||||||
├── crd
|
|
||||||
│ ├── bases
|
|
||||||
│ │ ├── infrastructure.cluster.x-k8s.io_dockerclusters.yaml
|
|
||||||
│ │ ├── infrastructure.cluster.x-k8s.io_dockermachines.yaml
|
|
||||||
│ │ └── infrastructure.cluster.x-k8s.io_dockermachinetemplates.yaml
|
|
||||||
│ ├── kustomization.yaml
|
|
||||||
│ ├── kustomizeconfig.yaml
|
|
||||||
│ └── patches
|
|
||||||
│ ├── cainjection_in_dockerclusters.yaml
|
|
||||||
│ ├── cainjection_in_dockermachines.yaml
|
|
||||||
│ ├── webhook_in_dockerclusters.yaml
|
|
||||||
│ └── webhook_in_dockermachines.yaml
|
|
||||||
├── data
|
|
||||||
│ ├── kustomization.yaml
|
|
||||||
│ └── metadata.yaml
|
|
||||||
├── default
|
|
||||||
│ ├── kustomization.yaml
|
|
||||||
│ └── namespace.yaml
|
|
||||||
├── kustomization.yaml
|
|
||||||
├── manager
|
|
||||||
│ ├── kustomization.yaml
|
|
||||||
│ ├── manager_auth_proxy_patch.yaml
|
|
||||||
│ ├── manager_image_patch.yaml
|
|
||||||
│ ├── manager_prometheus_metrics_patch.yaml
|
|
||||||
│ ├── manager_pull_policy.yaml
|
|
||||||
│ └── manager.yaml
|
|
||||||
├── rbac
|
|
||||||
│ ├── auth_proxy_role_binding.yaml
|
|
||||||
│ ├── auth_proxy_role.yaml
|
|
||||||
│ ├── auth_proxy_service.yaml
|
|
||||||
│ ├── kustomization.yaml
|
|
||||||
│ ├── leader_election_role_binding.yaml
|
|
||||||
│ ├── leader_election_role.yaml
|
|
||||||
│ ├── role_binding.yaml
|
|
||||||
│ └── role.yaml
|
|
||||||
└── webhook
|
|
||||||
├── kustomization.yaml
|
|
||||||
├── kustomizeconfig.yaml
|
|
||||||
├── manager_webhook_patch.yaml
|
|
||||||
├── manifests.yaml
|
|
||||||
├── service.yaml
|
|
||||||
└── webhookcainjection_patch.yaml
|
|
||||||
|
|
||||||
10 directories, 37 files
|
|
||||||
```
|
|
||||||
|
|
||||||
### Cluster Templates
|
|
||||||
|
|
||||||
`manifests/function/k8scontrol-capd` contains cluster.yaml, controlplane.yaml
|
|
||||||
templates referenced from
|
|
||||||
[cluster-template](https://github.com/kubernetes-sigs/cluster-api/blob/master/test/e2e/data/infrastructure-docker/cluster-template.yaml)
|
|
||||||
|
|
||||||
|
|
||||||
| Template Name | CRDs |
|
|
||||||
| ----------------- | ---- |
|
|
||||||
| cluster.yaml | Cluster, DockerCluster |
|
|
||||||
| controlplane.yaml | KubeadmControlPlane, DockerMachineTemplate, MachineHealthCheck |
|
|
||||||
|
|
||||||
$ tree airshipctl/manifests/function/k8scontrol-capd
|
|
||||||
|
|
||||||
```
|
|
||||||
airshipctl/manifests/function/k8scontrol-capd
|
|
||||||
├── cluster.yaml
|
|
||||||
├── controlplane.yaml
|
|
||||||
└── kustomization.yaml
|
|
||||||
```
|
|
||||||
|
|
||||||
`airshipctl/manifests/function/workers-capd` contains workers.yaml referenced
|
|
||||||
from
|
|
||||||
[cluster-template](https://github.com/kubernetes-sigs/cluster-api/blob/master/test/e2e/data/infrastructure-docker/cluster-template.yaml)
|
|
||||||
|
|
||||||
| Template Name | CRDs |
|
|
||||||
| ----------------- | ---- |
|
|
||||||
| workers.yaml | KubeadmConfigTemplate, MachineDeployment, DockerMachineTemplate |
|
|
||||||
|
|
||||||
$ tree airshipctl/manifests/function/workers-capd
|
|
||||||
|
|
||||||
```
|
|
||||||
airshipctl/manifests/function/workers-capd
|
|
||||||
├── kustomization.yaml
|
|
||||||
└── workers.yaml
|
|
||||||
```
|
|
||||||
|
|
||||||
### Test Site Manifests
|
|
||||||
|
|
||||||
#### docker-test-site/shared
|
|
||||||
|
|
||||||
`airshipctl cluster init` uses `airshipctl/manifests/site/docker-test-site/shared/clusterctl`
|
|
||||||
to initialize management cluster with defined provider components and version.
|
|
||||||
|
|
||||||
`$ tree airshipctl/manifests/site/docker-test-site/shared`
|
|
||||||
|
|
||||||
```
|
|
||||||
/tmp/airship/airshipctl/manifests/site/docker-test-site/shared
|
|
||||||
└── clusterctl
|
|
||||||
├── clusterctl.yaml
|
|
||||||
└── kustomization.yaml
|
|
||||||
|
|
||||||
1 directory, 2 files
|
|
||||||
```
|
|
||||||
|
|
||||||
#### docker-test-site/target
|
|
||||||
|
|
||||||
There are 3 phases currently available in `docker-test-site/target`.
|
|
||||||
|
|
||||||
| Phase Name | Purpose |
|
|
||||||
| ----------- | --------- |
|
|
||||||
| controlplane | Patches templates in manifests/function/k8scontrol-capd |
|
|
||||||
| workers | Patches template in manifests/function/workers-capd |
|
|
||||||
| initinfra | Simply calls `docker-test-site/shared/clusterctl` |
|
|
||||||
|
|
||||||
Note: `airshipctl cluster init` initializes all the provider components
|
|
||||||
including the docker infrastructure provider component. As a result, `airshipctl
|
|
||||||
phase run initinfra-ephemeral` is not used.
|
|
||||||
|
|
||||||
At the moment, `phase initinfra` is only present for two reasons:
|
|
||||||
- `airshipctl` complains if the phase is not found
|
|
||||||
- `validate site docs to pass`
|
|
||||||
|
|
||||||
#### Patch Merge Strategy
|
|
||||||
|
|
||||||
Json patch to patch `control plane machine count` is applied on templates in `manifests/function/k8scontrol-capd`
|
|
||||||
from `airshipctl/manifests/site/docker-test-site/target/controlplane` when `airshipctl phase run
|
|
||||||
controlplane` is executed
|
|
||||||
|
|
||||||
Json patch to patch `workers machine count` is applied on templates in `manifests/function/workers-capd`
|
|
||||||
from `airshipctl/manifests/site/docker-test-site/target/workers` when `airshipctl phase run
|
|
||||||
workers` is executed.
|
|
||||||
|
|
||||||
| Patch Name | Purpose |
|
|
||||||
| ---------- | -------- |
|
|
||||||
| controlplane/machine_count.json | patches control plane machine count in template function/k8scontrol-capd |
|
|
||||||
| workers/machine_count.json | patches workers machine count in template function/workers-capd |
|
|
||||||
|
|
||||||
$ tree airshipctl/manifests/site/docker-test-site/target/
|
|
||||||
|
|
||||||
```
|
|
||||||
airshipctl/manifests/site/docker-test-site/target/
|
|
||||||
├── controlplane
|
|
||||||
│ ├── kustomization.yaml
|
|
||||||
│ └── machine_count.json
|
|
||||||
├── initinfra
|
|
||||||
│ └── kustomization.yaml
|
|
||||||
└── workers
|
|
||||||
├── kustomization.yaml
|
|
||||||
└── machine_count.json
|
|
||||||
|
|
||||||
3 directories, 7 files
|
|
||||||
```
|
|
||||||
|
|
||||||
### Software Version Information
|
### Software Version Information
|
||||||
|
|
||||||
@ -726,10 +236,9 @@ All the instructions in the document were perfomed on a Oracle Virtual Box(6.1)
|
|||||||
VM running Ubuntu 18.04.4 LTS (Bionic Beaver) with 16G of memory and 4 VCPUs
|
VM running Ubuntu 18.04.4 LTS (Bionic Beaver) with 16G of memory and 4 VCPUs
|
||||||
|
|
||||||
#### Docker
|
#### Docker
|
||||||
|
```
|
||||||
$ docker version
|
$ docker version
|
||||||
|
|
||||||
```
|
|
||||||
Client: Docker Engine - Community
|
Client: Docker Engine - Community
|
||||||
Version: 19.03.9
|
Version: 19.03.9
|
||||||
API version: 1.40
|
API version: 1.40
|
||||||
@ -761,42 +270,31 @@ Server: Docker Engine - Community
|
|||||||
|
|
||||||
#### Kind
|
#### Kind
|
||||||
|
|
||||||
|
```
|
||||||
$ kind version
|
$ kind version
|
||||||
|
|
||||||
```
|
|
||||||
kind v0.8.1 go1.14.2 linux/amd64
|
kind v0.8.1 go1.14.2 linux/amd64
|
||||||
```
|
```
|
||||||
|
|
||||||
#### Kubectl
|
#### Kubectl
|
||||||
|
|
||||||
|
```
|
||||||
$ kubectl version
|
$ kubectl version
|
||||||
|
|
||||||
```
|
|
||||||
Client Version: version.Info{Major:"1", Minor:"17", GitVersion:"v1.17.4", GitCommit:"8d8aa39598534325ad77120c120a22b3a990b5ea", GitTreeState:"clean", BuildDate:"2020-03-12T21:03:42Z", GoVersion:"go1.13.8", Compiler:"gc", Platform:"linux/amd64"}
|
Client Version: version.Info{Major:"1", Minor:"17", GitVersion:"v1.17.4", GitCommit:"8d8aa39598534325ad77120c120a22b3a990b5ea", GitTreeState:"clean", BuildDate:"2020-03-12T21:03:42Z", GoVersion:"go1.13.8", Compiler:"gc", Platform:"linux/amd64"}
|
||||||
Server Version: version.Info{Major:"1", Minor:"17", GitVersion:"v1.17.0", GitCommit:"70132b0f130acc0bed193d9ba59dd186f0e634cf", GitTreeState:"clean", BuildDate:"2020-01-14T00:09:19Z", GoVersion:"go1.13.4", Compiler:"gc", Platform:"linux/amd64"}
|
Server Version: version.Info{Major:"1", Minor:"17", GitVersion:"v1.17.0", GitCommit:"70132b0f130acc0bed193d9ba59dd186f0e634cf", GitTreeState:"clean", BuildDate:"2020-01-14T00:09:19Z", GoVersion:"go1.13.4", Compiler:"gc", Platform:"linux/amd64"}
|
||||||
```
|
```
|
||||||
|
|
||||||
#### Go
|
#### Go
|
||||||
|
|
||||||
$ go version
|
|
||||||
|
|
||||||
```
|
```
|
||||||
|
$ go version
|
||||||
go version go1.14.1 linux/amd64
|
go version go1.14.1 linux/amd64
|
||||||
```
|
```
|
||||||
|
|
||||||
#### Kustomize
|
|
||||||
|
|
||||||
$ kustomize version
|
|
||||||
|
|
||||||
```
|
|
||||||
{Version:kustomize/v3.8.0 GitCommit:6a50372dd5686df22750b0c729adaf369fbf193c BuildDate:2020-07-05T14:08:42Z GoOs:linux GoArch:amd64}
|
|
||||||
```
|
|
||||||
|
|
||||||
#### OS
|
#### OS
|
||||||
|
```
|
||||||
$ cat /etc/os-release
|
$ cat /etc/os-release
|
||||||
|
|
||||||
```
|
|
||||||
NAME="Ubuntu"
|
NAME="Ubuntu"
|
||||||
VERSION="18.04.4 LTS (Bionic Beaver)"
|
VERSION="18.04.4 LTS (Bionic Beaver)"
|
||||||
ID=ubuntu
|
ID=ubuntu
|
||||||
@ -811,6 +309,6 @@ VERSION_CODENAME=bionic
|
|||||||
UBUNTU_CODENAME=bionic
|
UBUNTU_CODENAME=bionic
|
||||||
```
|
```
|
||||||
|
|
||||||
## Special Instructions
|
### Special Instructions
|
||||||
|
|
||||||
Swap was disabled on the VM using `sudo swapoff -a`
|
Swap was disabled on the VM using `sudo swapoff -a`
|
||||||
|
|||||||
Loading…
x
Reference in New Issue
Block a user