Control plane adding/scaling problem #2502

clickersmudge · 2022-11-25T12:33:57Z

clickersmudge
Nov 25, 2022

Hi,
We deploy KubeOne cluster (Hetzner) with one "control plane" and one "worker node".

terraform.tfvars

apiserver_alternative_names = []
cluster_name = "kubeone"
control_plane_replicas = 1
control_plane_type = "cx21"
datacenter = "nbg1"
disable_kubeapi_loadbalancer = false
image = "ubuntu-22.04"
initial_machinedeployment_operating_system_profile = ""
initial_machinedeployment_replicas = 1
ip_range = "192.168.0.0/16"
lb_type = "lb11"
network_zone = "eu-central"
ssh_agent_socket = "env:SSH_AUTH_SOCK"
ssh_port = 22
ssh_private_key_file = ""
ssh_public_key_file = "~/.ssh/id_rsa.pub"
ssh_username = "root"
worker_os = "ubuntu"
worker_type = "cx21"

kubeone.yaml

apiVersion: kubeone.k8c.io/v1beta2
kind: KubeOneCluster

versions:
  kubernetes: "1.24.8"

clusterNetwork:
  # kube-proxy configurations
  kubeProxy:
    # skipInstallation will skip the installation of kube-proxy
    skipInstallation: true
  # CNI plugin of choice. CNI can not be changed later at upgrade time.
  cni:
    # Only one CNI plugin can be defined at the same time
    # Supported CNI plugins:
    # * canal
    # * weave-net
    # * cilium
    # * external - The CNI plugin can be installed as an addon or manually
    cilium:
      # enableHubble to deploy Hubble relay and UI
      enableHubble: true
      # kubeProxyReplacement defines weather cilium relies on underlying Kernel support to replace kube-proxy functionality by eBPF (strict),
      # or disables a subset of those features so cilium does not bail out if the kernel support is missing (disabled).
      kubeProxyReplacement: "strict"

cloudProvider:
  # Only one cloud provider can be defined at the same time.
  # Possible values:
  # aws: {}
  # azure: {}
  # digitalocean: {}
  # gce: {}
  # hetzner:
  #   networkID: ""
  # openstack: {}
  # equinixmetal: {}
  # vsphere: {}
  # none: {}
  hetzner: {}
  # Set the kubelet flag '--cloud-provider=external' and deploy the external CCM for supported providers
  external: true

features:
  # Configure the CoreDNS deployment
  coreDNS:
    replicas: 3

# Addons are Kubernetes manifests to be deployed after provisioning the cluster
addons:
  enable: true
  # addons is used to enable addons embedded in the KubeOne binary.
  # Currently backups-restic, default-storage-class, and unattended-upgrades are
  # available addons.
  # Check out the documentation to find more information about what are embedded
  # addons and how to use them:
  # https://docs.kubermatic.com/kubeone/v1.5/guides/addons/
  addons:
    # name of the addon to be enabled/deployed (e.g. backups-restic)
    - name: "backups-restic"
      # delete triggers deletion of the deployed addon
      delete: false
      # params is a key-value map of values passed to the addons templating engine,
      # to be used in the addon's manifests. Values defined here override the values
      # defined in globalParams.
      params:
        resticPassword: "YOURS_RESTIC_PASSWORD"
        s3Bucket: "YOURS_S3_BUCKET"
        awsDefaultRegion: ""YOURS_AWS_DEFAULT_REGION"
    # name of the addon to be enabled/deployed (e.g. backups-restic)
    - name: "cluster-autoscaler"
      # delete triggers deletion of the deployed addon
      delete: false
    # name of the addon to be enabled/deployed (e.g. backups-restic)
    - name: "default-storage-class"
      # delete triggers deletion of the deployed addon
      delete: false
    # name of the addon to be enabled/deployed (e.g. backups-restic)
    - name: "unattended-upgrades"
      # delete triggers deletion of the deployed addon
      delete: false

kubectl get nodes

NAME                             STATUS   ROLES           AGE     VERSION
kubeone-control-plane-1          Ready    control-plane   9m45s   v1.24.8
kubeone-pool1-7df9f56946-62kv6   Ready    <none>          2m1s    v1.24.8

kubectl get pods -A

NAMESPACE            NAME                                                READY   STATUS      RESTARTS       AGE
kube-system          cilium-operator-76c47f5d8d-rpgxm                    1/1     Running     0              9m3s
kube-system          cilium-r6rlp                                        1/1     Running     0              9m3s
kube-system          cilium-wbm84                                        1/1     Running     0              2m31s
kube-system          cluster-autoscaler-c9b79c6dd-rxlws                  1/1     Running     0              9m3s
kube-system          coredns-56fc8c7fff-l7lzc                            1/1     Running     0              7m52s
kube-system          coredns-56fc8c7fff-s8ndf                            1/1     Running     0              9m1s
kube-system          coredns-56fc8c7fff-tjw4s                            1/1     Running     0              9m2s
kube-system          etcd-kubeone-control-plane-1                        1/1     Running     0              10m
kube-system          hcloud-cloud-controller-manager-5c68b69b45-dhg9h    1/1     Running     1 (8m4s ago)   9m3s
kube-system          hcloud-csi-controller-0                             5/5     Running     0              9m3s
kube-system          hcloud-csi-node-9lp96                               3/3     Running     0              9m3s
kube-system          hcloud-csi-node-qwzvf                               3/3     Running     0              2m31s
kube-system          hubble-generate-certs-394f790584-c9wct              0/1     Completed   1              9m4s
kube-system          hubble-relay-f778d765-qzdbl                         1/1     Running     0              9m3s
kube-system          hubble-ui-5fccbbf484-l5czg                          2/2     Running     0              9m3s
kube-system          kube-apiserver-kubeone-control-plane-1              1/1     Running     0              10m
kube-system          kube-controller-manager-kubeone-control-plane-1     1/1     Running     0              9m37s
kube-system          kube-scheduler-kubeone-control-plane-1              1/1     Running     0              10m
kube-system          kured-6p2qh                                         1/1     Running     0              2m
kube-system          kured-zk8rv                                         1/1     Running     0              7m55s
kube-system          machine-controller-5b8c859cd4-nhbms                 1/1     Running     0              9m3s
kube-system          machine-controller-webhook-795d94c5fd-vqnx7         1/1     Running     0              9m3s
kube-system          metrics-server-6c8f44fb59-h8kwq                     1/1     Running     0              9m3s
kube-system          node-local-dns-lmkkv                                1/1     Running     0              2m31s
kube-system          node-local-dns-vcqk2                                1/1     Running     0              9m3s
kube-system          operating-system-manager-c4c5cf67d-rlpbb            1/1     Running     0              9m3s
kube-system          operating-system-manager-webhook-7699ff78b9-nrt6b   1/1     Running     0              9m3s
kube-system          unattended-upgrades-install-pq8ll                   1/1     Running     0              7m55s
kube-system          unattended-upgrades-install-sgzkj                   1/1     Running     0              2m
reboot-coordinator   flatcar-linux-update-operator-755886c688-jkvqm      0/1     Pending     0              9m3s

How we scale control plane?

nano terraform.tfvars
  control_plane_replicas = 2
terraform apply

terraform output -json > tf.json
kubeone apply --manifest kubeone.yaml --credentials credentials.yaml --tfjson tf.json

Errors occur after this step.

Pods it's going to crash

kubectl get pods -A
NAMESPACE            NAME                                                READY   STATUS             RESTARTS        AGE
kube-system          cilium-operator-76c47f5d8d-rpgxm                    1/1     Running            0               19m
kube-system          cilium-r6rlp                                        1/1     Running            0               19m
kube-system          cilium-wbm84                                        1/1     Running            0               12m
kube-system          cluster-autoscaler-c9b79c6dd-rxlws                  1/1     Running            1 (2m34s ago)   19m
kube-system          coredns-56fc8c7fff-l7lzc                            0/1     Running            2 (40s ago)     18m
kube-system          coredns-56fc8c7fff-s8ndf                            0/1     Running            2 (36s ago)     19m
kube-system          coredns-56fc8c7fff-tjw4s                            0/1     Running            2 (45s ago)     19m
kube-system          etcd-kubeone-control-plane-1                        1/1     Running            0               20m
kube-system          hcloud-cloud-controller-manager-5c68b69b45-dhg9h    1/1     Running            1 (18m ago)     19m
kube-system          hcloud-csi-controller-0                             5/5     Running            12 (47s ago)    19m
kube-system          hcloud-csi-node-9lp96                               3/3     Running            7 (55s ago)     19m
kube-system          hcloud-csi-node-qwzvf                               3/3     Running            0               12m
kube-system          hubble-generate-certs-394f790584-c9wct              0/1     Completed          1               19m
kube-system          hubble-relay-f778d765-qzdbl                         1/1     Running            0               19m
kube-system          hubble-ui-5fccbbf484-l5czg                          2/2     Running            0               19m
kube-system          kube-apiserver-kubeone-control-plane-1              1/1     Running            0               20m
kube-system          kube-controller-manager-kubeone-control-plane-1     1/1     Running            0               19m
kube-system          kube-scheduler-kubeone-control-plane-1              1/1     Running            0               20m
kube-system          kured-6p2qh                                         1/1     Running            0               12m
kube-system          kured-zk8rv                                         1/1     Running            4 (46s ago)     18m
kube-system          machine-controller-5b8c859cd4-nhbms                 0/1     CrashLoopBackOff   4 (27s ago)     19m
kube-system          machine-controller-webhook-795d94c5fd-vqnx7         0/1     CrashLoopBackOff   5 (17s ago)     19m
kube-system          metrics-server-6c8f44fb59-h8kwq                     0/1     CrashLoopBackOff   4 (23s ago)     19m
kube-system          node-local-dns-lmkkv                                1/1     Running            0               12m
kube-system          node-local-dns-vcqk2                                1/1     Running            0               19m
kube-system          operating-system-manager-c4c5cf67d-rlpbb            0/1     CrashLoopBackOff   5 (21s ago)     19m
kube-system          operating-system-manager-webhook-7699ff78b9-nrt6b   0/1     Running            4 (48s ago)     19m
kube-system          unattended-upgrades-install-pq8ll                   0/1     CrashLoopBackOff   5 (16s ago)     18m
kube-system          unattended-upgrades-install-sgzkj                   1/1     Running            0               12m
reboot-coordinator   flatcar-linux-update-operator-755886c688-jkvqm      0/1     Pending            0               19m

kubectl logs -n kube-system          machine-controller-5b8c859cd4-nhbms
W1125 12:29:59.700943       1 client_config.go:617] Neither --kubeconfig nor --master was specified.  Using the inClusterConfig.  This might not work.
W1125 12:29:59.701402       1 client_config.go:617] Neither --kubeconfig nor --master was specified.  Using the inClusterConfig.  This might not work.

xmudrii · 2022-11-25T16:11:01Z

xmudrii
Nov 25, 2022
Maintainer

First of all, running an even number of the control plane nodes is strongly discouraged. You should always run an odd number of control plane nodes (1, 3, 5...) so that you don't run into issues with the etcd quorum.

The second problem that I see is that there are no control plane components for the second control plane node. For example, there's only one kube-apiserver, kube-controller-manager...

The third problem is that the machine-controller logs that you shared are not telling anything about the issue.

Can you please do the following:

Post the output of kubectl get nodes -o wide
Try to get logs of a previous pod run, for example, kubectl logs -n kube-system -p machine-controller-...
i. Note the -p flag which means that kubectl will try to get logs from a previous run: If true, print the logs for the previous instance of the container in a pod if it exists.
Try to run kubeone apply --manifest kubeone.yaml --credentials credentials.yaml --tfjson tf.json -v
i. Note the -v flag which means verbose so it should include more details about what's actually going on when trying to join the second control plane node
ii. Please post complete logs of the kubeone apply run here (or in some gist if the output is too large)

Please make sure to redact the secrets when posting logs if there are any.

0 replies

clickersmudge · 2022-11-25T19:30:07Z

clickersmudge
Nov 25, 2022
Author

@xmudrii Hi,

First of all, running an even number of the control plane nodes is strongly discouraged. You should always run an odd number of control plane nodes (1, 3, 5...) so that you don't run into issues with the etcd quorum.

You're right. The development version has one cluster and one machine, but we tested whether we would be able to scale control plane to high availability after the project was completed. Of course, the number of two machines was wrong.

We tested on 3 but the problem is the same.

kubectl get nodes -o wide
NAME                             STATUS     ROLES           AGE     VERSION   INTERNAL-IP   EXTERNAL-IP      OS-IMAGE             KERNEL-VERSION      CONTAINER-RUNTIME
kubeone-control-plane-1          Ready      control-plane   14m     v1.24.8   192.168.0.3   188.34.204.170   Ubuntu 22.04.1 LTS   5.15.0-46-generic   containerd://1.6.10
kubeone-control-plane-2          NotReady   control-plane   36s     v1.24.8   192.168.0.6   5.75.173.127     Ubuntu 22.04.1 LTS   5.15.0-46-generic   containerd://1.6.10
kubeone-pool1-669f596c98-65fgc   Ready      <none>          6m29s   v1.24.8   192.168.0.4   5.75.175.133     Ubuntu 22.04.1 LTS   5.15.0-46-generic   containerd://1.6.10

kubectl logs -n kube-system -p machine-controller-webhook-96877d7bc-7zv8r
W1125 19:08:40.260162       1 client_config.go:617] Neither --kubeconfig nor --master was specified.  Using the inClusterConfig.  This might not work.

kubeone apply --manifest kubeone.yaml --credentials credentials.yaml --tfjson tf.json -v
INFO[20:16:00 CET] Determine hostname...                        
DEBU[20:16:00 CET] Hostname is already set to "kubeone-control-plane-5"  node=5.75.162.44
DEBU[20:16:01 CET] Hostname is already set to "kubeone-control-plane-4"  node=167.235.144.141
DEBU[20:16:01 CET] Hostname is already set to "kubeone-control-plane-2"  node=5.75.173.127
DEBU[20:16:02 CET] Hostname is already set to "kubeone-control-plane-3"  node=5.75.175.139
DEBU[20:16:03 CET] Hostname is already set to "kubeone-control-plane-1"  node=188.34.204.170
INFO[20:16:03 CET] Determine operating system...                
DEBU[20:16:03 CET] Operating system detected: "ubuntu"           node=5.75.162.44
DEBU[20:16:03 CET] Operating system detected: "ubuntu"           node=167.235.144.141
DEBU[20:16:03 CET] Operating system detected: "ubuntu"           node=5.75.173.127
DEBU[20:16:03 CET] Operating system detected: "ubuntu"           node=5.75.175.139
DEBU[20:16:04 CET] Operating system detected: "ubuntu"           node=188.34.204.170
INFO[20:16:04 CET] Running host probes...                       
INFO[20:16:08 CET] Electing cluster leader...                   
INFO[20:16:08 CET] Elected leader "kubeone-control-plane-1"...  
INFO[20:16:12 CET] Building Kubernetes clientset...             
INFO[20:16:13 CET] Running cluster probes...                    
Host: "kubeone-control-plane-1"
	Host initialized: yes
	containerd healthy: yes (1.6.10)
	Kubelet healthy: yes (1.24.8)

	containerd is installed: yes
	containerd is running: yes
	containerd is active: yes
	containerd is restarting: no

	kubelet is installed: yes
	kubelet is running: yes
	kubelet is active: yes
	kubelet is restarting: no

Host: "kubeone-control-plane-2"
	Host initialized: yes
	containerd healthy: yes (1.6.10)
	Kubelet healthy: yes (1.24.8)

	containerd is installed: yes
	containerd is running: yes
	containerd is active: yes
	containerd is restarting: no

	kubelet is installed: yes
	kubelet is running: yes
	kubelet is active: yes
	kubelet is restarting: no

Host: "kubeone-control-plane-3"
	Host initialized: yes
	containerd healthy: yes (1.6.10)
	Kubelet healthy: yes (1.24.8)

	containerd is installed: yes
	containerd is running: yes
	containerd is active: yes
	containerd is restarting: no

	kubelet is installed: yes
	kubelet is running: yes
	kubelet is active: yes
	kubelet is restarting: no

Host: "kubeone-control-plane-4"
	Host initialized: no
	containerd healthy: no (unknown)
	Kubelet healthy: no (unknown)

	containerd is installed: no
	containerd is running: no
	containerd is active: no
	containerd is restarting: no

	kubelet is installed: no
	kubelet is running: no
	kubelet is active: no
	kubelet is restarting: no

Host: "kubeone-control-plane-5"
	Host initialized: no
	containerd healthy: no (unknown)
	Kubelet healthy: no (unknown)

	containerd is installed: no
	containerd is running: no
	containerd is active: no
	containerd is restarting: no

	kubelet is installed: no
	kubelet is running: no
	kubelet is active: no
	kubelet is restarting: no

The following actions will be taken: 
Run with --verbose flag for more information.
	+ join control plane node "kubeone-control-plane-4" (192.168.0.8) using 1.24.8
	+ join control plane node "kubeone-control-plane-5" (192.168.0.7) using 1.24.8
	+ apply embedded addons
Do you want to proceed (yes/no):

kubeone apply --manifest kubeone.yaml --credentials credentials.yaml --tfjson tf.json -v
INFO[20:16:00 CET] Determine hostname...                        
DEBU[20:16:00 CET] Hostname is already set to "kubeone-control-plane-5"  node=5.75.162.44
DEBU[20:16:01 CET] Hostname is already set to "kubeone-control-plane-4"  node=167.235.144.141
DEBU[20:16:01 CET] Hostname is already set to "kubeone-control-plane-2"  node=5.75.173.127
DEBU[20:16:02 CET] Hostname is already set to "kubeone-control-plane-3"  node=5.75.175.139
DEBU[20:16:03 CET] Hostname is already set to "kubeone-control-plane-1"  node=188.34.204.170
INFO[20:16:03 CET] Determine operating system...                
DEBU[20:16:03 CET] Operating system detected: "ubuntu"           node=5.75.162.44
DEBU[20:16:03 CET] Operating system detected: "ubuntu"           node=167.235.144.141
DEBU[20:16:03 CET] Operating system detected: "ubuntu"           node=5.75.173.127
DEBU[20:16:03 CET] Operating system detected: "ubuntu"           node=5.75.175.139
DEBU[20:16:04 CET] Operating system detected: "ubuntu"           node=188.34.204.170
INFO[20:16:04 CET] Running host probes...                       
INFO[20:16:08 CET] Electing cluster leader...                   
INFO[20:16:08 CET] Elected leader "kubeone-control-plane-1"...  
INFO[20:16:12 CET] Building Kubernetes clientset...             
INFO[20:16:13 CET] Running cluster probes...                    
Host: "kubeone-control-plane-1"
	Host initialized: yes
	containerd healthy: yes (1.6.10)
	Kubelet healthy: yes (1.24.8)

	containerd is installed: yes
	containerd is running: yes
	containerd is active: yes
	containerd is restarting: no

	kubelet is installed: yes
	kubelet is running: yes
	kubelet is active: yes
	kubelet is restarting: no

Host: "kubeone-control-plane-2"
	Host initialized: yes
	containerd healthy: yes (1.6.10)
	Kubelet healthy: yes (1.24.8)

	containerd is installed: yes
	containerd is running: yes
	containerd is active: yes
	containerd is restarting: no

	kubelet is installed: yes
	kubelet is running: yes
	kubelet is active: yes
	kubelet is restarting: no

Host: "kubeone-control-plane-3"
	Host initialized: yes
	containerd healthy: yes (1.6.10)
	Kubelet healthy: yes (1.24.8)

	containerd is installed: yes
	containerd is running: yes
	containerd is active: yes
	containerd is restarting: no

	kubelet is installed: yes
	kubelet is running: yes
	kubelet is active: yes
	kubelet is restarting: no

Host: "kubeone-control-plane-4"
	Host initialized: no
	containerd healthy: no (unknown)
	Kubelet healthy: no (unknown)

	containerd is installed: no
	containerd is running: no
	containerd is active: no
	containerd is restarting: no

	kubelet is installed: no
	kubelet is running: no
	kubelet is active: no
	kubelet is restarting: no

Host: "kubeone-control-plane-5"
	Host initialized: no
	containerd healthy: no (unknown)
	Kubelet healthy: no (unknown)

	containerd is installed: no
	containerd is running: no
	containerd is active: no
	containerd is restarting: no

	kubelet is installed: no
	kubelet is running: no
	kubelet is active: no
	kubelet is restarting: no

The following actions will be taken: 
Run with --verbose flag for more information.
	+ join control plane node "kubeone-control-plane-4" (192.168.0.8) using 1.24.8
	+ join control plane node "kubeone-control-plane-5" (192.168.0.7) using 1.24.8
	+ apply embedded addons
Do you want to proceed (yes/no): yes

INFO[20:16:38 CET] Determine hostname...                        
DEBU[20:16:38 CET] Hostname is already set to "kubeone-control-plane-5"  node=5.75.162.44
DEBU[20:16:38 CET] Hostname is already set to "kubeone-control-plane-1"  node=188.34.204.170
DEBU[20:16:38 CET] Hostname is already set to "kubeone-control-plane-2"  node=5.75.173.127
DEBU[20:16:38 CET] Hostname is already set to "kubeone-control-plane-3"  node=5.75.175.139
DEBU[20:16:38 CET] Hostname is already set to "kubeone-control-plane-4"  node=167.235.144.141
INFO[20:16:38 CET] Determine operating system...                
DEBU[20:16:38 CET] Operating system is already set to "ubuntu"   node=5.75.175.139
DEBU[20:16:38 CET] Operating system is already set to "ubuntu"   node=5.75.162.44
DEBU[20:16:38 CET] Operating system is already set to "ubuntu"   node=5.75.173.127
DEBU[20:16:38 CET] Operating system is already set to "ubuntu"   node=188.34.204.170
DEBU[20:16:38 CET] Operating system is already set to "ubuntu"   node=167.235.144.141
INFO[20:16:38 CET] Running host probes...                       
INFO[20:16:41 CET] Electing cluster leader...                   
INFO[20:16:41 CET] Elected leader "kubeone-control-plane-1"...  
INFO[20:16:47 CET] Running cluster probes...                    
INFO[20:16:48 CET] Installing prerequisites...                  
INFO[20:16:48 CET] Creating environment file...                  node=5.75.162.44 os=ubuntu
INFO[20:16:48 CET] Creating environment file...                  node=5.75.175.139 os=ubuntu
INFO[20:16:48 CET] Creating environment file...                  node=188.34.204.170 os=ubuntu
INFO[20:16:48 CET] Creating environment file...                  node=5.75.173.127 os=ubuntu
INFO[20:16:48 CET] Creating environment file...                  node=167.235.144.141 os=ubuntu
[167.235.144.141] + export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[167.235.144.141] + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[188.34.204.170] + export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[188.34.204.170] + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[188.34.204.170] + sudo mkdir -p /etc/kubeone
[5.75.162.44] + export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.162.44] + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[167.235.144.141] + sudo mkdir -p /etc/kubeone
[5.75.175.139] + export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.175.139] + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.162.44] + sudo mkdir -p /etc/kubeone
[5.75.175.139] + sudo mkdir -p /etc/kubeone
[188.34.204.170] + cat
[188.34.204.170] + sudo tee /etc/kubeone/proxy-env
[167.235.144.141] + cat
[167.235.144.141] + sudo tee /etc/kubeone/proxy-env
[188.34.204.170] 
[188.34.204.170] + envtmp=/tmp/k1-etc-environment
[188.34.204.170] + grep -v '#kubeone$' /etc/environment
[5.75.162.44] + cat
[5.75.162.44] + sudo tee /etc/kubeone/proxy-env
[188.34.204.170] + set +o pipefail
[188.34.204.170] + sed 's/$/#kubeone/'
[5.75.175.139] + cat
[5.75.175.139] + sudo tee /etc/kubeone/proxy-env
[188.34.204.170] + grep = /etc/kubeone/proxy-env
[167.235.144.141] 
[167.235.144.141] + envtmp=/tmp/k1-etc-environment
[167.235.144.141] + grep -v '#kubeone$' /etc/environment
[5.75.162.44] + envtmp=/tmp/k1-etc-environment
[5.75.162.44] 
[167.235.144.141] + set +o pipefail
[167.235.144.141] + grep = /etc/kubeone/proxy-env
[5.75.162.44] + grep -v '#kubeone$' /etc/environment
[5.75.162.44] + set +o pipefail
[5.75.162.44] + grep = /etc/kubeone/proxy-env
[5.75.162.44] + sed 's/$/#kubeone/'
[5.75.162.44] + sudo tee /etc/environment
[5.75.175.139] 
[5.75.175.139] + envtmp=/tmp/k1-etc-environment
[5.75.175.139] + grep -v '#kubeone$' /etc/environment
[5.75.175.139] + set +o pipefail
[5.75.175.139] + grep = /etc/kubeone/proxy-env
[188.34.204.170] + sudo tee /etc/environment
[188.34.204.170] PATH="/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin"
INFO[20:16:48 CET] Configuring proxy...                          node=188.34.204.170 os=ubuntu
INFO[20:16:48 CET] Installing kubeadm...                         node=188.34.204.170 os=ubuntu
[5.75.162.44] PATH="/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin"
INFO[20:16:48 CET] Configuring proxy...                          node=5.75.162.44 os=ubuntu
INFO[20:16:48 CET] Installing kubeadm...                         node=5.75.162.44 os=ubuntu
[5.75.173.127] + export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.173.127] + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.173.127] + sudo mkdir -p /etc/kubeone
[5.75.173.127] + cat
[5.75.173.127] + sudo tee /etc/kubeone/proxy-env
[167.235.144.141] + sed 's/$/#kubeone/'
[167.235.144.141] + sudo tee /etc/environment
[167.235.144.141] PATH="/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin"
INFO[20:16:48 CET] Configuring proxy...                          node=167.235.144.141 os=ubuntu
INFO[20:16:48 CET] Installing kubeadm...                         node=167.235.144.141 os=ubuntu
[5.75.175.139] + sed 's/$/#kubeone/'
[5.75.175.139] + sudo tee /etc/environment
[5.75.175.139] PATH="/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin"
INFO[20:16:48 CET] Configuring proxy...                          node=5.75.175.139 os=ubuntu
INFO[20:16:48 CET] Installing kubeadm...                         node=5.75.175.139 os=ubuntu
[5.75.173.127] + envtmp=/tmp/k1-etc-environment
[5.75.173.127] + grep -v '#kubeone$' /etc/environment
[5.75.173.127] 
[5.75.173.127] + set +o pipefail
[5.75.173.127] + grep = /etc/kubeone/proxy-env
[5.75.173.127] + sed 's/$/#kubeone/'
[5.75.173.127] + sudo tee /etc/environment
[5.75.173.127] PATH="/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin"
INFO[20:16:48 CET] Configuring proxy...                          node=5.75.173.127 os=ubuntu
INFO[20:16:48 CET] Installing kubeadm...                         node=5.75.173.127 os=ubuntu
[188.34.204.170] + export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[188.34.204.170] + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[188.34.204.170] + sudo swapoff -a
[5.75.162.44] + export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.162.44] + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.162.44] + sudo swapoff -a
[188.34.204.170] + sudo sed -i '/.*swap.*/d' /etc/fstab
[167.235.144.141] + export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[167.235.144.141] + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[167.235.144.141] + sudo swapoff -a
[188.34.204.170] + sudo systemctl disable --now ufw
[5.75.162.44] + sudo sed -i '/.*swap.*/d' /etc/fstab
[188.34.204.170] Synchronizing state of ufw.service with SysV service script with /lib/systemd/systemd-sysv-install.
[188.34.204.170] Executing: /lib/systemd/systemd-sysv-install disable ufw
[167.235.144.141] + sudo sed -i '/.*swap.*/d' /etc/fstab
[5.75.162.44] + sudo systemctl disable --now ufw
[5.75.175.139] + export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.175.139] + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.175.139] + sudo swapoff -a
[5.75.162.44] Synchronizing state of ufw.service with SysV service script with /lib/systemd/systemd-sysv-install.
[5.75.162.44] Executing: /lib/systemd/systemd-sysv-install disable ufw
[167.235.144.141] + sudo systemctl disable --now ufw
[5.75.175.139] + sudo sed -i '/.*swap.*/d' /etc/fstab
[5.75.173.127] + export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.173.127] + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.173.127] + sudo swapoff -a
[5.75.175.139] + sudo systemctl disable --now ufw
[167.235.144.141] Synchronizing state of ufw.service with SysV service script with /lib/systemd/systemd-sysv-install.
[167.235.144.141] Executing: /lib/systemd/systemd-sysv-install disable ufw
[5.75.173.127] + sudo sed -i '/.*swap.*/d' /etc/fstab
[5.75.175.139] Synchronizing state of ufw.service with SysV service script with /lib/systemd/systemd-sysv-install.
[5.75.175.139] Executing: /lib/systemd/systemd-sysv-install disable ufw
[5.75.173.127] + sudo systemctl disable --now ufw
[5.75.173.127] Synchronizing state of ufw.service with SysV service script with /lib/systemd/systemd-sysv-install.
[5.75.173.127] Executing: /lib/systemd/systemd-sysv-install disable ufw
[167.235.144.141] Removed /etc/systemd/system/multi-user.target.wants/ufw.service.
[5.75.162.44] Removed /etc/systemd/system/multi-user.target.wants/ufw.service.
[167.235.144.141] + source /etc/kubeone/proxy-env
[167.235.144.141] + cat
[167.235.144.141] + sudo tee /etc/modules-load.d/containerd.conf
[167.235.144.141] + sudo modprobe overlay
[167.235.144.141] overlay
[167.235.144.141] br_netfilter
[167.235.144.141] ip_tables
[167.235.144.141] + sudo modprobe br_netfilter
[167.235.144.141] + sudo modprobe ip_tables
[5.75.162.44] + source /etc/kubeone/proxy-env
[5.75.162.44] + sudo tee /etc/modules-load.d/containerd.conf
[167.235.144.141] + modinfo nf_conntrack_ipv4
[5.75.162.44] + cat
[5.75.162.44] overlay
[5.75.162.44] br_netfilter
[5.75.162.44] ip_tables
[167.235.144.141] + sudo modprobe nf_conntrack
[5.75.162.44] + sudo modprobe overlay
[167.235.144.141] + sudo mkdir -p /etc/sysctl.d
[5.75.162.44] + sudo modprobe br_netfilter
[167.235.144.141] + cat
[167.235.144.141] + sudo tee /etc/sysctl.d/k8s.conf
[167.235.144.141] fs.inotify.max_user_watches         = 1048576
[167.235.144.141] kernel.panic                        = 10
[167.235.144.141] kernel.panic_on_oops                = 1
[167.235.144.141] net.bridge.bridge-nf-call-ip6tables = 1
[167.235.144.141] net.bridge.bridge-nf-call-iptables  = 1
[167.235.144.141] net.ipv4.ip_forward                 = 1
[167.235.144.141] net.netfilter.nf_conntrack_max      = 1000000
[167.235.144.141] vm.overcommit_memory                = 1
[5.75.162.44] + sudo modprobe ip_tables
[167.235.144.141] + cat
[167.235.144.141] + sudo tee /etc/sysctl.d/99-zzz-override_cilium.conf
[167.235.144.141] + sudo sysctl --system
[167.235.144.141] # Disable rp_filter on ALL interfaces since it may cause mangled packets to be dropped
[167.235.144.141] # https://github.com/cilium/cilium/blob/v1.11.1/pkg/datapath/loader/base.go#L244
[167.235.144.141] net.ipv4.conf.all.rp_filter = 0
[5.75.162.44] + modinfo nf_conntrack_ipv4
[5.75.162.44] + sudo modprobe nf_conntrack
[167.235.144.141] sysctl: setting key "net.ipv4.conf.all.accept_source_route": Invalid argument
[167.235.144.141] * Applying /etc/sysctl.d/10-console-messages.conf ...
[167.235.144.141] kernel.printk = 4 4 1 7
[167.235.144.141] * Applying /etc/sysctl.d/10-ipv6-privacy.conf ...
[167.235.144.141] net.ipv6.conf.all.use_tempaddr = 2
[167.235.144.141] net.ipv6.conf.default.use_tempaddr = 2
[167.235.144.141] * Applying /etc/sysctl.d/10-kernel-hardening.conf ...
[167.235.144.141] kernel.kptr_restrict = 1
[167.235.144.141] * Applying /etc/sysctl.d/10-magic-sysrq.conf ...
[167.235.144.141] kernel.sysrq = 176
[167.235.144.141] * Applying /etc/sysctl.d/10-network-security.conf ...
[167.235.144.141] net.ipv4.conf.default.rp_filter = 2
[167.235.144.141] net.ipv4.conf.all.rp_filter = 2
[167.235.144.141] * Applying /etc/sysctl.d/10-ptrace.conf ...
[167.235.144.141] kernel.yama.ptrace_scope = 1
[167.235.144.141] * Applying /etc/sysctl.d/10-zeropage.conf ...
[167.235.144.141] vm.mmap_min_addr = 65536
[167.235.144.141] * Applying /usr/lib/sysctl.d/50-default.conf ...
[167.235.144.141] kernel.core_uses_pid = 1
[167.235.144.141] net.ipv4.conf.default.rp_filter = 2
[167.235.144.141] net.ipv4.conf.default.accept_source_route = 0
[167.235.144.141] sysctl: setting key "net.ipv4.conf.all.promote_secondaries": Invalid argument
[167.235.144.141] net.ipv4.conf.default.promote_secondaries = 1
[167.235.144.141] + sudo mkdir -p /etc/systemd/journald.conf.d
[167.235.144.141] net.ipv4.ping_group_range = 0 2147483647
[167.235.144.141] net.core.default_qdisc = fq_codel
[167.235.144.141] fs.protected_hardlinks = 1
[167.235.144.141] fs.protected_symlinks = 1
[167.235.144.141] fs.protected_regular = 1
[167.235.144.141] fs.protected_fifos = 1
[167.235.144.141] * Applying /usr/lib/sysctl.d/50-pid-max.conf ...
[167.235.144.141] kernel.pid_max = 4194304
[167.235.144.141] * Applying /usr/lib/sysctl.d/99-protect-links.conf ...
[167.235.144.141] fs.protected_fifos = 1
[167.235.144.141] fs.protected_hardlinks = 1
[167.235.144.141] fs.protected_regular = 2
[167.235.144.141] fs.protected_symlinks = 1
[167.235.144.141] * Applying /etc/sysctl.d/99-sysctl.conf ...
[167.235.144.141] * Applying /etc/sysctl.d/99-zzz-override_cilium.conf ...
[167.235.144.141] net.ipv4.conf.all.rp_filter = 0
[167.235.144.141] * Applying /etc/sysctl.d/k8s.conf ...
[167.235.144.141] fs.inotify.max_user_watches = 1048576
[167.235.144.141] kernel.panic = 10
[167.235.144.141] kernel.panic_on_oops = 1
[167.235.144.141] net.bridge.bridge-nf-call-ip6tables = 1
[167.235.144.141] net.bridge.bridge-nf-call-iptables = 1
[167.235.144.141] net.ipv4.ip_forward = 1
[167.235.144.141] net.netfilter.nf_conntrack_max = 1000000
[167.235.144.141] vm.overcommit_memory = 1
[167.235.144.141] * Applying /etc/sysctl.conf ...
[167.235.144.141] + cat
[167.235.144.141] + sudo tee /etc/systemd/journald.conf.d/max_disk_use.conf
[5.75.162.44] + sudo mkdir -p /etc/sysctl.d
[167.235.144.141] + sudo systemctl force-reload systemd-journald
[167.235.144.141] [Journal]
[167.235.144.141] SystemMaxUse=5G
[5.75.162.44] + cat
[5.75.162.44] fs.inotify.max_user_watches         = 1048576
[5.75.162.44] kernel.panic                        = 10
[5.75.162.44] kernel.panic_on_oops                = 1
[5.75.162.44] net.bridge.bridge-nf-call-ip6tables = 1
[5.75.162.44] net.bridge.bridge-nf-call-iptables  = 1
[5.75.162.44] net.ipv4.ip_forward                 = 1
[5.75.162.44] net.netfilter.nf_conntrack_max      = 1000000
[5.75.162.44] vm.overcommit_memory                = 1
[5.75.162.44] + sudo tee /etc/sysctl.d/k8s.conf
[5.75.162.44] + cat
[5.75.162.44] # Disable rp_filter on ALL interfaces since it may cause mangled packets to be dropped
[5.75.162.44] # https://github.com/cilium/cilium/blob/v1.11.1/pkg/datapath/loader/base.go#L244
[5.75.162.44] net.ipv4.conf.all.rp_filter = 0
[5.75.162.44] + sudo tee /etc/sysctl.d/99-zzz-override_cilium.conf
[5.75.162.44] * Applying /etc/sysctl.d/10-console-messages.conf ...
[5.75.162.44] kernel.printk = 4 4 1 7
[5.75.162.44] * Applying /etc/sysctl.d/10-ipv6-privacy.conf ...
[5.75.162.44] net.ipv6.conf.all.use_tempaddr = 2
[5.75.162.44] net.ipv6.conf.default.use_tempaddr = 2
[5.75.162.44] * Applying /etc/sysctl.d/10-kernel-hardening.conf ...
[5.75.162.44] kernel.kptr_restrict = 1
[5.75.162.44] * Applying /etc/sysctl.d/10-magic-sysrq.conf ...
[5.75.162.44] kernel.sysrq = 176
[5.75.162.44] * Applying /etc/sysctl.d/10-network-security.conf ...
[5.75.162.44] net.ipv4.conf.default.rp_filter = 2
[5.75.162.44] net.ipv4.conf.all.rp_filter = 2
[5.75.162.44] * Applying /etc/sysctl.d/10-ptrace.conf ...
[5.75.162.44] kernel.yama.ptrace_scope = 1
[5.75.162.44] * Applying /etc/sysctl.d/10-zeropage.conf ...
[5.75.162.44] vm.mmap_min_addr = 65536
[5.75.162.44] * Applying /usr/lib/sysctl.d/50-default.conf ...
[5.75.162.44] kernel.core_uses_pid = 1
[5.75.162.44] net.ipv4.conf.default.rp_filter = 2
[5.75.162.44] net.ipv4.conf.default.accept_source_route = 0
[5.75.162.44] + sudo sysctl --system
[5.75.162.44] net.ipv4.conf.default.promote_secondaries = 1
[5.75.162.44] sysctl: setting key "net.ipv4.conf.all.accept_source_route": Invalid argument
[167.235.144.141] + sudo mkdir -p /etc/apt/apt.conf.d
[5.75.162.44] net.ipv4.ping_group_range = 0 2147483647
[5.75.162.44] net.core.default_qdisc = fq_codel
[5.75.162.44] fs.protected_hardlinks = 1
[5.75.162.44] fs.protected_symlinks = 1
[5.75.162.44] fs.protected_regular = 1
[5.75.162.44] fs.protected_fifos = 1
[5.75.162.44] * Applying /usr/lib/sysctl.d/50-pid-max.conf ...
[5.75.162.44] kernel.pid_max = 4194304
[5.75.162.44] * Applying /usr/lib/sysctl.d/99-protect-links.conf ...
[5.75.162.44] fs.protected_fifos = 1
[5.75.162.44] fs.protected_hardlinks = 1
[5.75.162.44] fs.protected_regular = 2
[5.75.162.44] fs.protected_symlinks = 1
[5.75.162.44] * Applying /etc/sysctl.d/99-sysctl.conf ...
[5.75.162.44] * Applying /etc/sysctl.d/99-zzz-override_cilium.conf ...
[5.75.162.44] net.ipv4.conf.all.rp_filter = 0
[5.75.162.44] * Applying /etc/sysctl.d/k8s.conf ...
[5.75.162.44] fs.inotify.max_user_watches = 1048576
[5.75.162.44] kernel.panic = 10
[5.75.162.44] kernel.panic_on_oops = 1
[5.75.162.44] net.bridge.bridge-nf-call-ip6tables = 1
[5.75.162.44] net.bridge.bridge-nf-call-iptables = 1
[5.75.162.44] net.ipv4.ip_forward = 1
[5.75.162.44] net.netfilter.nf_conntrack_max = 1000000
[5.75.162.44] vm.overcommit_memory = 1
[5.75.162.44] * Applying /etc/sysctl.conf ...
[5.75.162.44] [Journal]
[5.75.162.44] SystemMaxUse=5G
[5.75.162.44] sysctl: setting key "net.ipv4.conf.all.promote_secondaries": Invalid argument
[5.75.162.44] + sudo mkdir -p /etc/systemd/journald.conf.d
[5.75.162.44] + cat
[5.75.162.44] + sudo tee /etc/systemd/journald.conf.d/max_disk_use.conf
[5.75.162.44] + sudo systemctl force-reload systemd-journald
[167.235.144.141] + cat
[167.235.144.141] + sudo tee /etc/apt/apt.conf.d/proxy.conf
[167.235.144.141] + sudo apt-get update
[5.75.162.44] + sudo mkdir -p /etc/apt/apt.conf.d
[5.75.162.44] + cat
[5.75.162.44] + sudo tee /etc/apt/apt.conf.d/proxy.conf
[5.75.162.44] + sudo apt-get update
[167.235.144.141] Get:1 https://mirror.hetzner.com/ubuntu/packages jammy InRelease [270 kB]
[167.235.144.141] Get:2 https://mirror.hetzner.com/ubuntu/packages jammy-updates InRelease [114 kB]
[167.235.144.141] Get:3 https://mirror.hetzner.com/ubuntu/packages jammy-backports InRelease [99.8 kB]
[167.235.144.141] Get:4 https://mirror.hetzner.com/ubuntu/security jammy-security InRelease [110 kB]
[5.75.162.44] Get:1 https://mirror.hetzner.com/ubuntu/packages jammy InRelease [270 kB]
[5.75.162.44] Get:2 https://mirror.hetzner.com/ubuntu/packages jammy-updates InRelease [114 kB]
[5.75.162.44] Get:3 https://mirror.hetzner.com/ubuntu/packages jammy-backports InRelease [99.8 kB]
[5.75.162.44] Get:4 https://mirror.hetzner.com/ubuntu/security jammy-security InRelease [110 kB]
[167.235.144.141] Get:5 https://mirror.hetzner.com/ubuntu/packages jammy/main amd64 Packages [1,395 kB]
[167.235.144.141] Get:6 https://mirror.hetzner.com/ubuntu/packages jammy/main Translation-en [510 kB]
[167.235.144.141] Get:7 https://mirror.hetzner.com/ubuntu/packages jammy/main amd64 c-n-f Metadata [30.3 kB]
[167.235.144.141] Get:8 https://mirror.hetzner.com/ubuntu/packages jammy/restricted amd64 Packages [129 kB]
[167.235.144.141] Get:9 https://mirror.hetzner.com/ubuntu/packages jammy/restricted Translation-en [18.6 kB]
[167.235.144.141] Get:10 https://mirror.hetzner.com/ubuntu/packages jammy/restricted amd64 c-n-f Metadata [488 B]
[167.235.144.141] Get:11 https://mirror.hetzner.com/ubuntu/packages jammy/universe amd64 Packages [14.1 MB]
[5.75.162.44] Get:5 https://mirror.hetzner.com/ubuntu/packages jammy/main amd64 Packages [1,395 kB]
[5.75.175.139] + source /etc/kubeone/proxy-env
[5.75.175.139] + cat
[5.75.175.139] + sudo tee /etc/modules-load.d/containerd.conf
[5.75.175.139] + sudo modprobe overlay
[5.75.175.139] overlay
[5.75.175.139] br_netfilter
[5.75.175.139] ip_tables
[5.75.175.139] + sudo modprobe br_netfilter
[5.75.162.44] Get:6 https://mirror.hetzner.com/ubuntu/packages jammy/main Translation-en [510 kB]
[5.75.162.44] Get:7 https://mirror.hetzner.com/ubuntu/packages jammy/main amd64 c-n-f Metadata [30.3 kB]
[5.75.175.139] + sudo modprobe ip_tables
[5.75.162.44] Get:8 https://mirror.hetzner.com/ubuntu/packages jammy/restricted amd64 Packages [129 kB]
[5.75.162.44] Get:9 https://mirror.hetzner.com/ubuntu/packages jammy/restricted Translation-en [18.6 kB]
[5.75.162.44] Get:10 https://mirror.hetzner.com/ubuntu/packages jammy/restricted amd64 c-n-f Metadata [488 B]
[5.75.162.44] Get:11 https://mirror.hetzner.com/ubuntu/packages jammy/universe amd64 Packages [14.1 MB]
[5.75.175.139] + modinfo nf_conntrack_ipv4
[5.75.175.139] + sudo modprobe nf_conntrack
[5.75.173.127] + source /etc/kubeone/proxy-env
[5.75.175.139] + sudo mkdir -p /etc/sysctl.d
[188.34.204.170] + source /etc/kubeone/proxy-env
[188.34.204.170] + cat
[5.75.173.127] + sudo tee /etc/modules-load.d/containerd.conf
[5.75.173.127] + cat
[188.34.204.170] + sudo tee /etc/modules-load.d/containerd.conf
[188.34.204.170] overlay
[188.34.204.170] br_netfilter
[188.34.204.170] ip_tables
[5.75.173.127] overlay
[5.75.173.127] br_netfilter
[5.75.173.127] ip_tables
[188.34.204.170] + sudo modprobe overlay
[5.75.173.127] + sudo modprobe overlay
[188.34.204.170] + sudo modprobe br_netfilter
[188.34.204.170] + sudo modprobe ip_tables
[5.75.173.127] + sudo modprobe br_netfilter
[5.75.173.127] + sudo modprobe ip_tables
[167.235.144.141] Get:12 https://mirror.hetzner.com/ubuntu/packages jammy/universe Translation-en [5,652 kB]
[188.34.204.170] + modinfo nf_conntrack_ipv4
[188.34.204.170] + sudo modprobe nf_conntrack
[5.75.173.127] + modinfo nf_conntrack_ipv4
[5.75.173.127] + sudo modprobe nf_conntrack
[5.75.173.127] + sudo mkdir -p /etc/sysctl.d
[188.34.204.170] + sudo mkdir -p /etc/sysctl.d
[188.34.204.170] + cat
[5.75.175.139] fs.inotify.max_user_watches         = 1048576
[5.75.175.139] kernel.panic                        = 10
[5.75.175.139] kernel.panic_on_oops                = 1
[5.75.175.139] net.bridge.bridge-nf-call-ip6tables = 1
[5.75.175.139] net.bridge.bridge-nf-call-iptables  = 1
[5.75.175.139] net.ipv4.ip_forward                 = 1
[5.75.175.139] net.netfilter.nf_conntrack_max      = 1000000
[5.75.175.139] vm.overcommit_memory                = 1
[5.75.175.139] # Disable rp_filter on ALL interfaces since it may cause mangled packets to be dropped
[5.75.175.139] # https://github.com/cilium/cilium/blob/v1.11.1/pkg/datapath/loader/base.go#L244
[5.75.175.139] net.ipv4.conf.all.rp_filter = 0
[5.75.175.139] + cat
[5.75.175.139] + sudo tee /etc/sysctl.d/k8s.conf
[5.75.175.139] + cat
[5.75.175.139] + sudo tee /etc/sysctl.d/99-zzz-override_cilium.conf
[5.75.175.139] + sudo sysctl --system
[5.75.162.44] Get:12 https://mirror.hetzner.com/ubuntu/packages jammy/universe Translation-en [5,652 kB]
[167.235.144.141] Get:13 https://mirror.hetzner.com/ubuntu/packages jammy/universe amd64 c-n-f Metadata [286 kB]
[5.75.173.127] fs.inotify.max_user_watches         = 1048576
[5.75.173.127] kernel.panic                        = 10
[5.75.173.127] kernel.panic_on_oops                = 1
[5.75.173.127] net.bridge.bridge-nf-call-ip6tables = 1
[5.75.173.127] net.bridge.bridge-nf-call-iptables  = 1
[5.75.173.127] net.ipv4.ip_forward                 = 1
[5.75.173.127] net.netfilter.nf_conntrack_max      = 1000000
[5.75.173.127] vm.overcommit_memory                = 1
[5.75.173.127] # Disable rp_filter on ALL interfaces since it may cause mangled packets to be dropped
[5.75.173.127] # https://github.com/cilium/cilium/blob/v1.11.1/pkg/datapath/loader/base.go#L244
[5.75.173.127] net.ipv4.conf.all.rp_filter = 0
[5.75.173.127] + cat
[5.75.173.127] + sudo tee /etc/sysctl.d/k8s.conf
[5.75.173.127] + cat
[5.75.173.127] + sudo tee /etc/sysctl.d/99-zzz-override_cilium.conf
[5.75.173.127] + sudo sysctl --system
[5.75.162.44] Get:13 https://mirror.hetzner.com/ubuntu/packages jammy/universe amd64 c-n-f Metadata [286 kB]
[188.34.204.170] fs.inotify.max_user_watches         = 1048576
[188.34.204.170] kernel.panic                        = 10
[188.34.204.170] kernel.panic_on_oops                = 1
[188.34.204.170] net.bridge.bridge-nf-call-ip6tables = 1
[188.34.204.170] net.bridge.bridge-nf-call-iptables  = 1
[188.34.204.170] net.ipv4.ip_forward                 = 1
[188.34.204.170] net.netfilter.nf_conntrack_max      = 1000000
[188.34.204.170] vm.overcommit_memory                = 1
[188.34.204.170] # Disable rp_filter on ALL interfaces since it may cause mangled packets to be dropped
[188.34.204.170] # https://github.com/cilium/cilium/blob/v1.11.1/pkg/datapath/loader/base.go#L244
[188.34.204.170] net.ipv4.conf.all.rp_filter = 0
[188.34.204.170] + sudo tee /etc/sysctl.d/k8s.conf
[188.34.204.170] + cat
[188.34.204.170] + sudo tee /etc/sysctl.d/99-zzz-override_cilium.conf
[188.34.204.170] + sudo sysctl --system
[167.235.144.141] Get:14 https://mirror.hetzner.com/ubuntu/packages jammy/multiverse amd64 Packages [217 kB]
[167.235.144.141] Get:15 https://mirror.hetzner.com/ubuntu/packages jammy/multiverse Translation-en [112 kB]
[167.235.144.141] Get:16 https://mirror.hetzner.com/ubuntu/packages jammy/multiverse amd64 c-n-f Metadata [8,372 B]
[167.235.144.141] Get:17 https://mirror.hetzner.com/ubuntu/packages jammy-updates/main amd64 Packages [731 kB]
[167.235.144.141] Get:18 https://mirror.hetzner.com/ubuntu/packages jammy-updates/main Translation-en [164 kB]
[167.235.144.141] Get:19 https://mirror.hetzner.com/ubuntu/packages jammy-updates/main amd64 c-n-f Metadata [10.9 kB]
[167.235.144.141] Get:20 https://mirror.hetzner.com/ubuntu/packages jammy-updates/restricted amd64 Packages [449 kB]
[167.235.144.141] Get:21 https://mirror.hetzner.com/ubuntu/packages jammy-updates/restricted Translation-en [68.7 kB]
[167.235.144.141] Get:22 https://mirror.hetzner.com/ubuntu/packages jammy-updates/restricted amd64 c-n-f Metadata [584 B]
[167.235.144.141] Get:23 https://mirror.hetzner.com/ubuntu/packages jammy-updates/universe amd64 Packages [757 kB]
[167.235.144.141] Get:24 https://mirror.hetzner.com/ubuntu/packages jammy-updates/universe Translation-en [126 kB]
[167.235.144.141] Get:25 https://mirror.hetzner.com/ubuntu/packages jammy-updates/universe amd64 c-n-f Metadata [4,404 B]
[167.235.144.141] Get:26 https://mirror.hetzner.com/ubuntu/packages jammy-updates/multiverse amd64 Packages [7,216 B]
[167.235.144.141] Get:27 https://mirror.hetzner.com/ubuntu/packages jammy-updates/multiverse Translation-en [2,360 B]
[167.235.144.141] Get:28 https://mirror.hetzner.com/ubuntu/packages jammy-updates/multiverse amd64 c-n-f Metadata [420 B]
[167.235.144.141] Get:29 https://mirror.hetzner.com/ubuntu/packages jammy-backports/main amd64 Packages [3,008 B]
[167.235.144.141] Get:30 https://mirror.hetzner.com/ubuntu/packages jammy-backports/main Translation-en [1,432 B]
[167.235.144.141] Get:31 https://mirror.hetzner.com/ubuntu/packages jammy-backports/main amd64 c-n-f Metadata [272 B]
[167.235.144.141] Get:32 https://mirror.hetzner.com/ubuntu/packages jammy-backports/restricted amd64 c-n-f Metadata [116 B]
[167.235.144.141] Get:33 https://mirror.hetzner.com/ubuntu/packages jammy-backports/universe amd64 Packages [6,740 B]
[167.235.144.141] Get:34 https://mirror.hetzner.com/ubuntu/packages jammy-backports/universe Translation-en [9,360 B]
[167.235.144.141] Get:35 https://mirror.hetzner.com/ubuntu/packages jammy-backports/universe amd64 c-n-f Metadata [352 B]
[167.235.144.141] Get:36 https://mirror.hetzner.com/ubuntu/packages jammy-backports/multiverse amd64 c-n-f Metadata [116 B]
[167.235.144.141] Get:37 https://mirror.hetzner.com/ubuntu/security jammy-security/main amd64 Packages [493 kB]
[167.235.144.141] Get:38 https://mirror.hetzner.com/ubuntu/security jammy-security/main Translation-en [108 kB]
[167.235.144.141] Get:39 https://mirror.hetzner.com/ubuntu/security jammy-security/main amd64 c-n-f Metadata [3,924 B]
[167.235.144.141] Get:40 https://mirror.hetzner.com/ubuntu/security jammy-security/restricted amd64 Packages [404 kB]
[167.235.144.141] Get:41 https://mirror.hetzner.com/ubuntu/security jammy-security/restricted Translation-en [62.0 kB]
[167.235.144.141] Get:42 https://mirror.hetzner.com/ubuntu/security jammy-security/restricted amd64 c-n-f Metadata [524 B]
[167.235.144.141] Get:43 https://mirror.hetzner.com/ubuntu/security jammy-security/universe amd64 Packages [618 kB]
[167.235.144.141] Get:44 https://mirror.hetzner.com/ubuntu/security jammy-security/universe Translation-en [80.9 kB]
[167.235.144.141] Get:45 https://mirror.hetzner.com/ubuntu/security jammy-security/universe amd64 c-n-f Metadata [2,408 B]
[167.235.144.141] Get:46 https://mirror.hetzner.com/ubuntu/security jammy-security/multiverse amd64 Packages [4,192 B]
[167.235.144.141] Get:47 https://mirror.hetzner.com/ubuntu/security jammy-security/multiverse Translation-en [900 B]
[167.235.144.141] Get:48 https://mirror.hetzner.com/ubuntu/security jammy-security/multiverse amd64 c-n-f Metadata [228 B]
[5.75.173.127] sysctl: setting key "net.ipv4.conf.all.accept_source_route": Invalid argument
[5.75.173.127] sysctl: setting key "net.ipv4.conf.all.promote_secondaries": Invalid argument
[5.75.173.127] + sudo mkdir -p /etc/systemd/journald.conf.d
[5.75.173.127] + cat
[5.75.173.127] + sudo tee /etc/systemd/journald.conf.d/max_disk_use.conf
[5.75.173.127] + sudo systemctl force-reload systemd-journald
[5.75.173.127] + sudo mkdir -p /etc/apt/apt.conf.d
[5.75.173.127] + cat
[5.75.173.127] + sudo tee /etc/apt/apt.conf.d/proxy.conf
[5.75.173.127] + sudo apt-get update
[5.75.173.127] * Applying /etc/sysctl.d/10-console-messages.conf ...
[5.75.173.127] kernel.printk = 4 4 1 7
[5.75.173.127] * Applying /etc/sysctl.d/10-ipv6-privacy.conf ...
[5.75.173.127] net.ipv6.conf.all.use_tempaddr = 2
[5.75.173.127] net.ipv6.conf.default.use_tempaddr = 2
[5.75.173.127] * Applying /etc/sysctl.d/10-kernel-hardening.conf ...
[5.75.173.127] kernel.kptr_restrict = 1
[5.75.173.127] * Applying /etc/sysctl.d/10-magic-sysrq.conf ...
[5.75.173.127] kernel.sysrq = 176
[5.75.173.127] * Applying /etc/sysctl.d/10-network-security.conf ...
[5.75.173.127] net.ipv4.conf.default.rp_filter = 2
[5.75.173.127] net.ipv4.conf.all.rp_filter = 2
[5.75.173.127] * Applying /etc/sysctl.d/10-ptrace.conf ...
[5.75.173.127] kernel.yama.ptrace_scope = 1
[5.75.173.127] * Applying /etc/sysctl.d/10-zeropage.conf ...
[5.75.173.127] vm.mmap_min_addr = 65536
[5.75.173.127] * Applying /usr/lib/sysctl.d/50-default.conf ...
[5.75.173.127] kernel.core_uses_pid = 1
[5.75.173.127] net.ipv4.conf.default.rp_filter = 2
[5.75.173.127] net.ipv4.conf.default.accept_source_route = 0
[5.75.173.127] net.ipv4.conf.default.promote_secondaries = 1
[5.75.173.127] net.ipv4.ping_group_range = 0 2147483647
[5.75.173.127] net.core.default_qdisc = fq_codel
[5.75.173.127] fs.protected_hardlinks = 1
[5.75.173.127] fs.protected_symlinks = 1
[5.75.173.127] fs.protected_regular = 1
[5.75.173.127] fs.protected_fifos = 1
[5.75.173.127] * Applying /usr/lib/sysctl.d/50-pid-max.conf ...
[5.75.173.127] kernel.pid_max = 4194304
[5.75.173.127] * Applying /usr/lib/sysctl.d/99-protect-links.conf ...
[5.75.173.127] fs.protected_fifos = 1
[5.75.173.127] fs.protected_hardlinks = 1
[5.75.173.127] fs.protected_regular = 2
[5.75.173.127] fs.protected_symlinks = 1
[5.75.173.127] * Applying /etc/sysctl.d/99-sysctl.conf ...
[5.75.173.127] * Applying /etc/sysctl.d/99-zzz-override_cilium.conf ...
[5.75.173.127] net.ipv4.conf.all.rp_filter = 0
[5.75.173.127] * Applying /etc/sysctl.d/k8s.conf ...
[5.75.173.127] fs.inotify.max_user_watches = 1048576
[5.75.173.127] kernel.panic = 10
[5.75.173.127] kernel.panic_on_oops = 1
[5.75.173.127] net.bridge.bridge-nf-call-ip6tables = 1
[5.75.173.127] net.bridge.bridge-nf-call-iptables = 1
[5.75.173.127] net.ipv4.ip_forward = 1
[5.75.173.127] net.netfilter.nf_conntrack_max = 1000000
[5.75.173.127] vm.overcommit_memory = 1
[5.75.173.127] * Applying /etc/sysctl.conf ...
[5.75.173.127] [Journal]
[5.75.173.127] SystemMaxUse=5G
[188.34.204.170] sysctl: setting key "net.ipv4.conf.all.accept_source_route": Invalid argument
[188.34.204.170] sysctl: setting key "net.ipv4.conf.all.promote_secondaries": Invalid argument
[188.34.204.170] + sudo mkdir -p /etc/systemd/journald.conf.d
[188.34.204.170] + cat
[188.34.204.170] + sudo tee /etc/systemd/journald.conf.d/max_disk_use.conf
[188.34.204.170] + sudo systemctl force-reload systemd-journald
[188.34.204.170] + sudo mkdir -p /etc/apt/apt.conf.d
[188.34.204.170] + cat
[188.34.204.170] + sudo tee /etc/apt/apt.conf.d/proxy.conf
[188.34.204.170] + sudo apt-get update
[188.34.204.170] * Applying /etc/sysctl.d/10-console-messages.conf ...
[188.34.204.170] kernel.printk = 4 4 1 7
[188.34.204.170] * Applying /etc/sysctl.d/10-ipv6-privacy.conf ...
[188.34.204.170] net.ipv6.conf.all.use_tempaddr = 2
[188.34.204.170] net.ipv6.conf.default.use_tempaddr = 2
[188.34.204.170] * Applying /etc/sysctl.d/10-kernel-hardening.conf ...
[188.34.204.170] kernel.kptr_restrict = 1
[188.34.204.170] * Applying /etc/sysctl.d/10-magic-sysrq.conf ...
[188.34.204.170] kernel.sysrq = 176
[188.34.204.170] * Applying /etc/sysctl.d/10-network-security.conf ...
[188.34.204.170] net.ipv4.conf.default.rp_filter = 2
[188.34.204.170] net.ipv4.conf.all.rp_filter = 2
[188.34.204.170] * Applying /etc/sysctl.d/10-ptrace.conf ...
[188.34.204.170] kernel.yama.ptrace_scope = 1
[188.34.204.170] * Applying /etc/sysctl.d/10-zeropage.conf ...
[188.34.204.170] vm.mmap_min_addr = 65536
[188.34.204.170] * Applying /usr/lib/sysctl.d/50-default.conf ...
[188.34.204.170] kernel.core_uses_pid = 1
[188.34.204.170] net.ipv4.conf.default.rp_filter = 2
[188.34.204.170] net.ipv4.conf.default.accept_source_route = 0
[188.34.204.170] net.ipv4.conf.default.promote_secondaries = 1
[188.34.204.170] net.ipv4.ping_group_range = 0 2147483647
[188.34.204.170] net.core.default_qdisc = fq_codel
[188.34.204.170] fs.protected_hardlinks = 1
[188.34.204.170] fs.protected_symlinks = 1
[188.34.204.170] fs.protected_regular = 1
[188.34.204.170] fs.protected_fifos = 1
[188.34.204.170] * Applying /usr/lib/sysctl.d/50-pid-max.conf ...
[188.34.204.170] kernel.pid_max = 4194304
[188.34.204.170] * Applying /usr/lib/sysctl.d/99-protect-links.conf ...
[188.34.204.170] fs.protected_fifos = 1
[188.34.204.170] fs.protected_hardlinks = 1
[188.34.204.170] fs.protected_regular = 2
[188.34.204.170] fs.protected_symlinks = 1
[188.34.204.170] * Applying /etc/sysctl.d/99-sysctl.conf ...
[188.34.204.170] * Applying /etc/sysctl.d/99-zzz-override_cilium.conf ...
[188.34.204.170] net.ipv4.conf.all.rp_filter = 0
[188.34.204.170] * Applying /etc/sysctl.d/k8s.conf ...
[188.34.204.170] fs.inotify.max_user_watches = 1048576
[188.34.204.170] kernel.panic = 10
[188.34.204.170] kernel.panic_on_oops = 1
[188.34.204.170] net.bridge.bridge-nf-call-ip6tables = 1
[188.34.204.170] net.bridge.bridge-nf-call-iptables = 1
[188.34.204.170] net.ipv4.ip_forward = 1
[188.34.204.170] net.netfilter.nf_conntrack_max = 1000000
[188.34.204.170] vm.overcommit_memory = 1
[188.34.204.170] * Applying /etc/sysctl.conf ...
[188.34.204.170] [Journal]
[188.34.204.170] SystemMaxUse=5G
[188.34.204.170] Hit:1 https://mirror.hetzner.com/ubuntu/packages jammy InRelease
[188.34.204.170] Hit:2 https://mirror.hetzner.com/ubuntu/packages jammy-updates InRelease
[188.34.204.170] Hit:3 https://mirror.hetzner.com/ubuntu/packages jammy-backports InRelease
[188.34.204.170] Hit:4 https://mirror.hetzner.com/ubuntu/security jammy-security InRelease
[188.34.204.170] Get:5 https://download.docker.com/linux/ubuntu jammy InRelease [48.9 kB]
[5.75.175.139] sysctl: setting key "net.ipv4.conf.all.accept_source_route": Invalid argument
[5.75.175.139] sysctl: setting key "net.ipv4.conf.all.promote_secondaries": Invalid argument
[5.75.175.139] + sudo mkdir -p /etc/systemd/journald.conf.d
[5.75.175.139] + cat
[5.75.175.139] + sudo tee /etc/systemd/journald.conf.d/max_disk_use.conf
[5.75.175.139] + sudo systemctl force-reload systemd-journald
[5.75.175.139] + sudo mkdir -p /etc/apt/apt.conf.d
[5.75.175.139] + cat
[5.75.175.139] + sudo tee /etc/apt/apt.conf.d/proxy.conf
[5.75.175.139] + sudo apt-get update
[5.75.175.139] * Applying /etc/sysctl.d/10-console-messages.conf ...
[5.75.175.139] kernel.printk = 4 4 1 7
[5.75.175.139] * Applying /etc/sysctl.d/10-ipv6-privacy.conf ...
[5.75.175.139] net.ipv6.conf.all.use_tempaddr = 2
[5.75.175.139] net.ipv6.conf.default.use_tempaddr = 2
[5.75.175.139] * Applying /etc/sysctl.d/10-kernel-hardening.conf ...
[5.75.175.139] kernel.kptr_restrict = 1
[5.75.175.139] * Applying /etc/sysctl.d/10-magic-sysrq.conf ...
[5.75.175.139] kernel.sysrq = 176
[5.75.175.139] * Applying /etc/sysctl.d/10-network-security.conf ...
[5.75.175.139] net.ipv4.conf.default.rp_filter = 2
[5.75.175.139] net.ipv4.conf.all.rp_filter = 2
[5.75.175.139] * Applying /etc/sysctl.d/10-ptrace.conf ...
[5.75.175.139] kernel.yama.ptrace_scope = 1
[5.75.175.139] * Applying /etc/sysctl.d/10-zeropage.conf ...
[5.75.175.139] vm.mmap_min_addr = 65536
[5.75.175.139] * Applying /usr/lib/sysctl.d/50-default.conf ...
[5.75.175.139] kernel.core_uses_pid = 1
[5.75.175.139] net.ipv4.conf.default.rp_filter = 2
[5.75.175.139] net.ipv4.conf.default.accept_source_route = 0
[5.75.175.139] net.ipv4.conf.default.promote_secondaries = 1
[5.75.175.139] net.ipv4.ping_group_range = 0 2147483647
[5.75.175.139] net.core.default_qdisc = fq_codel
[5.75.175.139] fs.protected_hardlinks = 1
[5.75.175.139] fs.protected_symlinks = 1
[5.75.175.139] fs.protected_regular = 1
[5.75.175.139] fs.protected_fifos = 1
[5.75.175.139] * Applying /usr/lib/sysctl.d/50-pid-max.conf ...
[5.75.175.139] kernel.pid_max = 4194304
[5.75.175.139] * Applying /usr/lib/sysctl.d/99-protect-links.conf ...
[5.75.175.139] fs.protected_fifos = 1
[5.75.175.139] fs.protected_hardlinks = 1
[5.75.175.139] fs.protected_regular = 2
[5.75.175.139] fs.protected_symlinks = 1
[5.75.175.139] * Applying /etc/sysctl.d/99-sysctl.conf ...
[5.75.175.139] * Applying /etc/sysctl.d/99-zzz-override_cilium.conf ...
[5.75.175.139] net.ipv4.conf.all.rp_filter = 0
[5.75.175.139] * Applying /etc/sysctl.d/k8s.conf ...
[5.75.175.139] fs.inotify.max_user_watches = 1048576
[5.75.175.139] kernel.panic = 10
[5.75.175.139] kernel.panic_on_oops = 1
[5.75.175.139] net.bridge.bridge-nf-call-ip6tables = 1
[5.75.175.139] net.bridge.bridge-nf-call-iptables = 1
[5.75.175.139] net.ipv4.ip_forward = 1
[5.75.175.139] net.netfilter.nf_conntrack_max = 1000000
[5.75.175.139] vm.overcommit_memory = 1
[5.75.175.139] * Applying /etc/sysctl.conf ...
[5.75.175.139] [Journal]
[5.75.175.139] SystemMaxUse=5G
[5.75.175.139] Get:1 https://download.docker.com/linux/ubuntu jammy InRelease [48.9 kB]
[5.75.175.139] Hit:2 https://mirror.hetzner.com/ubuntu/packages jammy InRelease
[5.75.175.139] Hit:3 https://mirror.hetzner.com/ubuntu/packages jammy-updates InRelease
[5.75.175.139] Hit:4 https://mirror.hetzner.com/ubuntu/packages jammy-backports InRelease
[5.75.175.139] Hit:5 https://mirror.hetzner.com/ubuntu/security jammy-security InRelease
[5.75.162.44] Get:14 https://mirror.hetzner.com/ubuntu/packages jammy/multiverse amd64 Packages [217 kB]
[5.75.162.44] Get:15 https://mirror.hetzner.com/ubuntu/packages jammy/multiverse Translation-en [112 kB]
[5.75.162.44] Get:16 https://mirror.hetzner.com/ubuntu/packages jammy/multiverse amd64 c-n-f Metadata [8,372 B]
[5.75.162.44] Get:17 https://mirror.hetzner.com/ubuntu/packages jammy-updates/main amd64 Packages [731 kB]
[5.75.162.44] Get:18 https://mirror.hetzner.com/ubuntu/packages jammy-updates/main Translation-en [164 kB]
[5.75.162.44] Get:19 https://mirror.hetzner.com/ubuntu/packages jammy-updates/main amd64 c-n-f Metadata [10.9 kB]
[5.75.162.44] Get:20 https://mirror.hetzner.com/ubuntu/packages jammy-updates/restricted amd64 Packages [449 kB]
[5.75.162.44] Get:21 https://mirror.hetzner.com/ubuntu/packages jammy-updates/restricted Translation-en [68.7 kB]
[5.75.162.44] Get:22 https://mirror.hetzner.com/ubuntu/packages jammy-updates/restricted amd64 c-n-f Metadata [584 B]
[5.75.162.44] Get:23 https://mirror.hetzner.com/ubuntu/packages jammy-updates/universe amd64 Packages [757 kB]
[5.75.162.44] Get:24 https://mirror.hetzner.com/ubuntu/packages jammy-updates/universe Translation-en [126 kB]
[5.75.162.44] Get:25 https://mirror.hetzner.com/ubuntu/packages jammy-updates/universe amd64 c-n-f Metadata [4,404 B]
[5.75.162.44] Get:26 https://mirror.hetzner.com/ubuntu/packages jammy-updates/multiverse amd64 Packages [7,216 B]
[5.75.162.44] Get:27 https://mirror.hetzner.com/ubuntu/packages jammy-updates/multiverse Translation-en [2,360 B]
[5.75.162.44] Get:28 https://mirror.hetzner.com/ubuntu/packages jammy-updates/multiverse amd64 c-n-f Metadata [420 B]
[5.75.162.44] Get:29 https://mirror.hetzner.com/ubuntu/packages jammy-backports/main amd64 Packages [3,008 B]
[5.75.162.44] Get:30 https://mirror.hetzner.com/ubuntu/packages jammy-backports/main Translation-en [1,432 B]
[5.75.162.44] Get:31 https://mirror.hetzner.com/ubuntu/packages jammy-backports/main amd64 c-n-f Metadata [272 B]
[5.75.162.44] Get:32 https://mirror.hetzner.com/ubuntu/packages jammy-backports/restricted amd64 c-n-f Metadata [116 B]
[5.75.162.44] Get:33 https://mirror.hetzner.com/ubuntu/packages jammy-backports/universe amd64 Packages [6,740 B]
[5.75.162.44] Get:34 https://mirror.hetzner.com/ubuntu/packages jammy-backports/universe Translation-en [9,360 B]
[5.75.162.44] Get:35 https://mirror.hetzner.com/ubuntu/packages jammy-backports/universe amd64 c-n-f Metadata [352 B]
[5.75.162.44] Get:36 https://mirror.hetzner.com/ubuntu/packages jammy-backports/multiverse amd64 c-n-f Metadata [116 B]
[5.75.162.44] Get:37 https://mirror.hetzner.com/ubuntu/security jammy-security/main amd64 Packages [493 kB]
[5.75.162.44] Get:38 https://mirror.hetzner.com/ubuntu/security jammy-security/main Translation-en [108 kB]
[5.75.162.44] Get:39 https://mirror.hetzner.com/ubuntu/security jammy-security/main amd64 c-n-f Metadata [3,924 B]
[5.75.162.44] Get:40 https://mirror.hetzner.com/ubuntu/security jammy-security/restricted amd64 Packages [404 kB]
[5.75.162.44] Get:41 https://mirror.hetzner.com/ubuntu/security jammy-security/restricted Translation-en [62.0 kB]
[5.75.162.44] Get:42 https://mirror.hetzner.com/ubuntu/security jammy-security/restricted amd64 c-n-f Metadata [524 B]
[5.75.162.44] Get:43 https://mirror.hetzner.com/ubuntu/security jammy-security/universe amd64 Packages [618 kB]
[5.75.162.44] Get:44 https://mirror.hetzner.com/ubuntu/security jammy-security/universe Translation-en [80.9 kB]
[5.75.162.44] Get:45 https://mirror.hetzner.com/ubuntu/security jammy-security/universe amd64 c-n-f Metadata [2,408 B]
[5.75.162.44] Get:46 https://mirror.hetzner.com/ubuntu/security jammy-security/multiverse amd64 Packages [4,192 B]
[5.75.162.44] Get:47 https://mirror.hetzner.com/ubuntu/security jammy-security/multiverse Translation-en [900 B]
[5.75.162.44] Get:48 https://mirror.hetzner.com/ubuntu/security jammy-security/multiverse amd64 c-n-f Metadata [228 B]
[5.75.173.127] Hit:1 https://mirror.hetzner.com/ubuntu/packages jammy InRelease
[5.75.173.127] Hit:2 https://mirror.hetzner.com/ubuntu/packages jammy-updates InRelease
[5.75.173.127] Hit:3 https://mirror.hetzner.com/ubuntu/packages jammy-backports InRelease
[5.75.173.127] Hit:4 https://mirror.hetzner.com/ubuntu/security jammy-security InRelease
[5.75.173.127] Get:5 https://download.docker.com/linux/ubuntu jammy InRelease [48.9 kB]
[5.75.175.139] Get:6 https://packages.cloud.google.com/apt kubernetes-xenial InRelease [9,383 B]
[5.75.173.127] Get:6 https://packages.cloud.google.com/apt kubernetes-xenial InRelease [9,383 B]
[188.34.204.170] Get:6 https://packages.cloud.google.com/apt kubernetes-xenial InRelease [9,383 B]
[5.75.175.139] Fetched 58.2 kB in 1s (43.9 kB/s)
[5.75.173.127] Fetched 58.2 kB in 1s (41.9 kB/s)
[5.75.175.139] Reading package lists...
[5.75.175.139] W: https://download.docker.com/linux/ubuntu/dists/jammy/InRelease: Key is stored in legacy trusted.gpg keyring (/etc/apt/trusted.gpg), see the DEPRECATION section in apt-key(8) for details.
[5.75.175.139] W: http://apt.kubernetes.io/dists/kubernetes-xenial/InRelease: Key is stored in legacy trusted.gpg keyring (/etc/apt/trusted.gpg), see the DEPRECATION section in apt-key(8) for details.
[5.75.175.139] + sudo DEBIAN_FRONTEND=noninteractive apt-get install --option Dpkg::Options::=--force-confold -y --no-install-recommends apt-transport-https ca-certificates curl gnupg lsb-release rsync
[5.75.175.139] Reading package lists...
[5.75.173.127] Reading package lists...
[5.75.173.127] W: https://download.docker.com/linux/ubuntu/dists/jammy/InRelease: Key is stored in legacy trusted.gpg keyring (/etc/apt/trusted.gpg), see the DEPRECATION section in apt-key(8) for details.
[5.75.173.127] W: http://apt.kubernetes.io/dists/kubernetes-xenial/InRelease: Key is stored in legacy trusted.gpg keyring (/etc/apt/trusted.gpg), see the DEPRECATION section in apt-key(8) for details.
[5.75.173.127] + sudo DEBIAN_FRONTEND=noninteractive apt-get install --option Dpkg::Options::=--force-confold -y --no-install-recommends apt-transport-https ca-certificates curl gnupg lsb-release rsync
[5.75.175.139] Building dependency tree...
[5.75.175.139] Reading state information...
[5.75.173.127] Reading package lists...
[5.75.175.139] + curl -fsSL https://packages.cloud.google.com/apt/doc/apt-key.gpg
[5.75.175.139] + sudo apt-key add -
[5.75.175.139] ca-certificates is already the newest version (20211016).
[5.75.175.139] lsb-release is already the newest version (11.1.0ubuntu4).
[5.75.175.139] curl is already the newest version (7.81.0-1ubuntu1.6).
[5.75.175.139] gnupg is already the newest version (2.2.27-3ubuntu2.1).
[5.75.175.139] rsync is already the newest version (3.2.3-8ubuntu3.1).
[5.75.175.139] apt-transport-https is already the newest version (2.4.8).
[5.75.175.139] 0 upgraded, 0 newly installed, 0 to remove and 88 not upgraded.
[5.75.175.139] Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)).
[5.75.173.127] Building dependency tree...
[5.75.173.127] Reading state information...
[5.75.175.139] OK
[5.75.175.139] + echo 'deb http://apt.kubernetes.io/ kubernetes-xenial main'
[5.75.175.139] + sudo tee /etc/apt/sources.list.d/kubernetes.list
[5.75.175.139] + sudo apt-get update
[5.75.175.139] deb http://apt.kubernetes.io/ kubernetes-xenial main
[5.75.175.139] Hit:1 https://mirror.hetzner.com/ubuntu/packages jammy InRelease
[5.75.175.139] Hit:2 https://mirror.hetzner.com/ubuntu/packages jammy-updates InRelease
[5.75.175.139] Hit:3 https://mirror.hetzner.com/ubuntu/packages jammy-backports InRelease
[5.75.175.139] Hit:4 https://mirror.hetzner.com/ubuntu/security jammy-security InRelease
[5.75.173.127] ca-certificates is already the newest version (20211016).
[5.75.173.127] lsb-release is already the newest version (11.1.0ubuntu4).
[5.75.173.127] curl is already the newest version (7.81.0-1ubuntu1.6).
[5.75.173.127] gnupg is already the newest version (2.2.27-3ubuntu2.1).
[5.75.173.127] rsync is already the newest version (3.2.3-8ubuntu3.1).
[5.75.173.127] apt-transport-https is already the newest version (2.4.8).
[5.75.173.127] 0 upgraded, 0 newly installed, 0 to remove and 88 not upgraded.
[5.75.175.139] Get:5 https://download.docker.com/linux/ubuntu jammy InRelease [48.9 kB]
[5.75.173.127] + curl -fsSL https://packages.cloud.google.com/apt/doc/apt-key.gpg
[5.75.173.127] + sudo apt-key add -
[5.75.175.139] Hit:6 https://packages.cloud.google.com/apt kubernetes-xenial InRelease
[5.75.173.127] Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)).
[5.75.173.127] OK
[5.75.173.127] + echo 'deb http://apt.kubernetes.io/ kubernetes-xenial main'
[5.75.173.127] + sudo tee /etc/apt/sources.list.d/kubernetes.list
[5.75.173.127] deb http://apt.kubernetes.io/ kubernetes-xenial main
[5.75.173.127] + sudo apt-get update
[5.75.173.127] Get:1 https://download.docker.com/linux/ubuntu jammy InRelease [48.9 kB]
[5.75.173.127] Hit:2 https://mirror.hetzner.com/ubuntu/packages jammy InRelease
[5.75.173.127] Hit:3 https://mirror.hetzner.com/ubuntu/packages jammy-updates InRelease
[5.75.173.127] Hit:4 https://mirror.hetzner.com/ubuntu/packages jammy-backports InRelease
[5.75.173.127] Hit:5 https://mirror.hetzner.com/ubuntu/security jammy-security InRelease
[5.75.173.127] Get:6 https://packages.cloud.google.com/apt kubernetes-xenial InRelease [9,383 B]
[5.75.175.139] Fetched 48.9 kB in 1s (40.2 kB/s)
[5.75.173.127] Fetched 58.2 kB in 1s (43.2 kB/s)
[5.75.175.139] Reading package lists...
[5.75.175.139] W: https://download.docker.com/linux/ubuntu/dists/jammy/InRelease: Key is stored in legacy trusted.gpg keyring (/etc/apt/trusted.gpg), see the DEPRECATION section in apt-key(8) for details.
[5.75.175.139] W: http://apt.kubernetes.io/dists/kubernetes-xenial/InRelease: Key is stored in legacy trusted.gpg keyring (/etc/apt/trusted.gpg), see the DEPRECATION section in apt-key(8) for details.
[5.75.175.139] + kube_ver='1.24.8*'
[5.75.175.139] + cni_ver='1.1.1*'
[5.75.175.139] + sudo apt-get update
[5.75.175.139] Hit:1 https://mirror.hetzner.com/ubuntu/packages jammy InRelease
[5.75.175.139] Hit:2 https://mirror.hetzner.com/ubuntu/packages jammy-updates InRelease
[5.75.175.139] Hit:3 https://mirror.hetzner.com/ubuntu/packages jammy-backports InRelease
[5.75.175.139] Hit:4 https://mirror.hetzner.com/ubuntu/security jammy-security InRelease
[5.75.175.139] Get:5 https://download.docker.com/linux/ubuntu jammy InRelease [48.9 kB]
[5.75.175.139] Get:6 https://packages.cloud.google.com/apt kubernetes-xenial InRelease [9,383 B]
[5.75.173.127] W: https://download.docker.com/linux/ubuntu/dists/jammy/InRelease: Key is stored in legacy trusted.gpg keyring (/etc/apt/trusted.gpg), see the DEPRECATION section in apt-key(8) for details.
[5.75.173.127] W: http://apt.kubernetes.io/dists/kubernetes-xenial/InRelease: Key is stored in legacy trusted.gpg keyring (/etc/apt/trusted.gpg), see the DEPRECATION section in apt-key(8) for details.
[5.75.173.127] Reading package lists...
[5.75.173.127] + kube_ver='1.24.8*'
[5.75.173.127] + cni_ver='1.1.1*'
[5.75.173.127] + sudo apt-get update
[5.75.173.127] Hit:1 https://mirror.hetzner.com/ubuntu/packages jammy InRelease
[5.75.173.127] Hit:2 https://mirror.hetzner.com/ubuntu/packages jammy-updates InRelease
[5.75.173.127] Hit:3 https://mirror.hetzner.com/ubuntu/packages jammy-backports InRelease
[188.34.204.170] Fetched 58.2 kB in 1s (43.9 kB/s)
[5.75.173.127] Hit:4 https://mirror.hetzner.com/ubuntu/security jammy-security InRelease
[5.75.173.127] Get:5 https://download.docker.com/linux/ubuntu jammy InRelease [48.9 kB]
[5.75.173.127] Hit:6 https://packages.cloud.google.com/apt kubernetes-xenial InRelease
[5.75.175.139] Fetched 58.2 kB in 1s (47.9 kB/s)
[5.75.173.127] Fetched 48.9 kB in 1s (38.8 kB/s)
[5.75.175.139] Reading package lists...
[5.75.175.139] W: https://download.docker.com/linux/ubuntu/dists/jammy/InRelease: Key is stored in legacy trusted.gpg keyring (/etc/apt/trusted.gpg), see the DEPRECATION section in apt-key(8) for details.
[5.75.175.139] W: http://apt.kubernetes.io/dists/kubernetes-xenial/InRelease: Key is stored in legacy trusted.gpg keyring (/etc/apt/trusted.gpg), see the DEPRECATION section in apt-key(8) for details.
[188.34.204.170] Reading package lists...
[5.75.175.139] + sudo apt-get install -y apt-transport-https ca-certificates curl software-properties-common lsb-release
[188.34.204.170] W: https://download.docker.com/linux/ubuntu/dists/jammy/InRelease: Key is stored in legacy trusted.gpg keyring (/etc/apt/trusted.gpg), see the DEPRECATION section in apt-key(8) for details.
[188.34.204.170] W: http://apt.kubernetes.io/dists/kubernetes-xenial/InRelease: Key is stored in legacy trusted.gpg keyring (/etc/apt/trusted.gpg), see the DEPRECATION section in apt-key(8) for details.
[188.34.204.170] + sudo DEBIAN_FRONTEND=noninteractive apt-get install --option Dpkg::Options::=--force-confold -y --no-install-recommends apt-transport-https ca-certificates curl gnupg lsb-release rsync
[5.75.175.139] Reading package lists...
[188.34.204.170] Reading package lists...
[5.75.175.139] Building dependency tree...
[5.75.175.139] Reading state information...
[188.34.204.170] Building dependency tree...
[188.34.204.170] Reading state information...
[5.75.175.139] + sudo apt-key add -
[5.75.175.139] + curl -fsSL https://download.docker.com/linux/ubuntu/gpg
[5.75.175.139] ca-certificates is already the newest version (20211016).
[5.75.175.139] lsb-release is already the newest version (11.1.0ubuntu4).
[5.75.175.139] curl is already the newest version (7.81.0-1ubuntu1.6).
[5.75.175.139] software-properties-common is already the newest version (0.99.22.3).
[5.75.175.139] apt-transport-https is already the newest version (2.4.8).
[5.75.175.139] 0 upgraded, 0 newly installed, 0 to remove and 88 not upgraded.
[5.75.175.139] Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)).
[188.34.204.170] ca-certificates is already the newest version (20211016).
[188.34.204.170] lsb-release is already the newest version (11.1.0ubuntu4).
[188.34.204.170] curl is already the newest version (7.81.0-1ubuntu1.6).
[188.34.204.170] gnupg is already the newest version (2.2.27-3ubuntu2.1).
[188.34.204.170] rsync is already the newest version (3.2.3-8ubuntu3.1).
[188.34.204.170] apt-transport-https is already the newest version (2.4.8).
[188.34.204.170] 0 upgraded, 0 newly installed, 0 to remove and 88 not upgraded.
[188.34.204.170] + sudo apt-key add -
[188.34.204.170] + curl -fsSL https://packages.cloud.google.com/apt/doc/apt-key.gpg
[5.75.175.139] OK
[5.75.175.139] ++ lsb_release -cs
[5.75.175.139] + sudo add-apt-repository 'deb https://download.docker.com/linux/ubuntu jammy stable'
[188.34.204.170] Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)).
[188.34.204.170] OK
[188.34.204.170] + echo 'deb http://apt.kubernetes.io/ kubernetes-xenial main'
[188.34.204.170] deb http://apt.kubernetes.io/ kubernetes-xenial main
[188.34.204.170] + sudo tee /etc/apt/sources.list.d/kubernetes.list
[188.34.204.170] + sudo apt-get update
[5.75.173.127] Reading package lists...
[5.75.173.127] W: https://download.docker.com/linux/ubuntu/dists/jammy/InRelease: Key is stored in legacy trusted.gpg keyring (/etc/apt/trusted.gpg), see the DEPRECATION section in apt-key(8) for details.
[5.75.173.127] W: http://apt.kubernetes.io/dists/kubernetes-xenial/InRelease: Key is stored in legacy trusted.gpg keyring (/etc/apt/trusted.gpg), see the DEPRECATION section in apt-key(8) for details.
[5.75.173.127] + sudo apt-get install -y apt-transport-https ca-certificates curl software-properties-common lsb-release
[188.34.204.170] Hit:1 https://mirror.hetzner.com/ubuntu/packages jammy InRelease
[188.34.204.170] Hit:2 https://mirror.hetzner.com/ubuntu/packages jammy-updates InRelease
[188.34.204.170] Hit:3 https://mirror.hetzner.com/ubuntu/packages jammy-backports InRelease
[188.34.204.170] Hit:4 https://mirror.hetzner.com/ubuntu/security jammy-security InRelease
[188.34.204.170] Get:5 https://download.docker.com/linux/ubuntu jammy InRelease [48.9 kB]
[5.75.173.127] Reading package lists...
[188.34.204.170] Hit:6 https://packages.cloud.google.com/apt kubernetes-xenial InRelease
[5.75.173.127] Building dependency tree...
[5.75.173.127] Reading state information...
[5.75.173.127] + sudo apt-key add -
[5.75.173.127] ca-certificates is already the newest version (20211016).
[5.75.173.127] lsb-release is already the newest version (11.1.0ubuntu4).
[5.75.173.127] curl is already the newest version (7.81.0-1ubuntu1.6).
[5.75.173.127] software-properties-common is already the newest version (0.99.22.3).
[5.75.173.127] apt-transport-https is already the newest version (2.4.8).
[5.75.173.127] 0 upgraded, 0 newly installed, 0 to remove and 88 not upgraded.
[5.75.173.127] + curl -fsSL https://download.docker.com/linux/ubuntu/gpg
[5.75.173.127] Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)).
[5.75.173.127] OK
[5.75.173.127] ++ lsb_release -cs
[5.75.173.127] + sudo add-apt-repository 'deb https://download.docker.com/linux/ubuntu jammy stable'
[188.34.204.170] Fetched 48.9 kB in 1s (34.6 kB/s)
[5.75.175.139] Hit:1 https://mirror.hetzner.com/ubuntu/packages jammy InRelease
[5.75.175.139] Hit:2 https://mirror.hetzner.com/ubuntu/packages jammy-updates InRelease
[5.75.175.139] Hit:3 https://mirror.hetzner.com/ubuntu/packages jammy-backports InRelease
[5.75.175.139] Hit:4 https://mirror.hetzner.com/ubuntu/security jammy-security InRelease
[5.75.175.139] Get:5 https://download.docker.com/linux/ubuntu jammy InRelease [48.9 kB]
[5.75.175.139] Get:6 https://packages.cloud.google.com/apt kubernetes-xenial InRelease [9,383 B]
[188.34.204.170] Reading package lists...
[188.34.204.170] W: https://download.docker.com/linux/ubuntu/dists/jammy/InRelease: Key is stored in legacy trusted.gpg keyring (/etc/apt/trusted.gpg), see the DEPRECATION section in apt-key(8) for details.
[188.34.204.170] W: http://apt.kubernetes.io/dists/kubernetes-xenial/InRelease: Key is stored in legacy trusted.gpg keyring (/etc/apt/trusted.gpg), see the DEPRECATION section in apt-key(8) for details.
[188.34.204.170] + kube_ver='1.24.8*'
[188.34.204.170] + cni_ver='1.1.1*'
[188.34.204.170] + sudo apt-get update
[188.34.204.170] Hit:1 https://mirror.hetzner.com/ubuntu/packages jammy InRelease
[188.34.204.170] Hit:2 https://mirror.hetzner.com/ubuntu/packages jammy-updates InRelease
[188.34.204.170] Hit:3 https://mirror.hetzner.com/ubuntu/packages jammy-backports InRelease
[188.34.204.170] Hit:4 https://mirror.hetzner.com/ubuntu/security jammy-security InRelease
[188.34.204.170] Get:5 https://download.docker.com/linux/ubuntu jammy InRelease [48.9 kB]
[188.34.204.170] Hit:6 https://packages.cloud.google.com/apt kubernetes-xenial InRelease
[5.75.173.127] Hit:1 https://mirror.hetzner.com/ubuntu/packages jammy InRelease
[5.75.173.127] Hit:2 https://mirror.hetzner.com/ubuntu/packages jammy-updates InRelease
[5.75.173.127] Hit:3 https://mirror.hetzner.com/ubuntu/packages jammy-backports InRelease
[5.75.173.127] Hit:4 https://mirror.hetzner.com/ubuntu/security jammy-security InRelease
[5.75.173.127] Get:5 https://download.docker.com/linux/ubuntu jammy InRelease [48.9 kB]
[5.75.173.127] Hit:6 https://packages.cloud.google.com/apt kubernetes-xenial InRelease
[167.235.144.141] Fetched 27.2 MB in 4s (6,292 kB/s)
[5.75.162.44] Fetched 27.2 MB in 5s (5,798 kB/s)
[188.34.204.170] Fetched 48.9 kB in 1s (39.3 kB/s)
[167.235.144.141] Reading package lists...
[167.235.144.141] + sudo DEBIAN_FRONTEND=noninteractive apt-get install --option Dpkg::Options::=--force-confold -y --no-install-recommends apt-transport-https ca-certificates curl gnupg lsb-release rsync
[167.235.144.141] Reading package lists...
[5.75.162.44] Reading package lists...
[167.235.144.141] Building dependency tree...
[167.235.144.141] Reading state information...
[5.75.162.44] + sudo DEBIAN_FRONTEND=noninteractive apt-get install --option Dpkg::Options::=--force-confold -y --no-install-recommends apt-transport-https ca-certificates curl gnupg lsb-release rsync
[5.75.162.44] Reading package lists...
[167.235.144.141] ca-certificates is already the newest version (20211016).
[167.235.144.141] ca-certificates set to manually installed.
[167.235.144.141] lsb-release is already the newest version (11.1.0ubuntu4).
[167.235.144.141] gnupg is already the newest version (2.2.27-3ubuntu2.1).
[167.235.144.141] The following additional packages will be installed:
[167.235.144.141]   libcurl4
[167.235.144.141] The following NEW packages will be installed:
[167.235.144.141]   apt-transport-https
[167.235.144.141] The following packages will be upgraded:
[167.235.144.141]   curl libcurl4 rsync
[188.34.204.170] Reading package lists...
[188.34.204.170] W: https://download.docker.com/linux/ubuntu/dists/jammy/InRelease: Key is stored in legacy trusted.gpg keyring (/etc/apt/trusted.gpg), see the DEPRECATION section in apt-key(8) for details.
[188.34.204.170] W: http://apt.kubernetes.io/dists/kubernetes-xenial/InRelease: Key is stored in legacy trusted.gpg keyring (/etc/apt/trusted.gpg), see the DEPRECATION section in apt-key(8) for details.
[188.34.204.170] + sudo apt-get install -y apt-transport-https ca-certificates curl software-properties-common lsb-release
[167.235.144.141] 3 upgraded, 1 newly installed, 0 to remove and 88 not upgraded.
[167.235.144.141] Need to get 889 kB of archives.
[167.235.144.141] After this operation, 169 kB of additional disk space will be used.
[167.235.144.141] Get:1 https://mirror.hetzner.com/ubuntu/packages jammy-updates/main amd64 rsync amd64 3.2.3-8ubuntu3.1 [404 kB]
[5.75.162.44] Building dependency tree...
[5.75.162.44] Reading state information...
[167.235.144.141] Get:2 https://mirror.hetzner.com/ubuntu/packages jammy-updates/universe amd64 apt-transport-https all 2.4.8 [1,506 B]
[167.235.144.141] Get:3 https://mirror.hetzner.com/ubuntu/packages jammy-updates/main amd64 curl amd64 7.81.0-1ubuntu1.6 [194 kB]
[167.235.144.141] Get:4 https://mirror.hetzner.com/ubuntu/packages jammy-updates/main amd64 libcurl4 amd64 7.81.0-1ubuntu1.6 [290 kB]
[188.34.204.170] Reading package lists...
[5.75.162.44] ca-certificates is already the newest version (20211016).
[5.75.162.44] ca-certificates set to manually installed.
[5.75.162.44] lsb-release is already the newest version (11.1.0ubuntu4).
[5.75.162.44] gnupg is already the newest version (2.2.27-3ubuntu2.1).
[5.75.162.44] The following additional packages will be installed:
[5.75.162.44]   libcurl4
[5.75.162.44] The following NEW packages will be installed:
[5.75.162.44]   apt-transport-https
[5.75.162.44] The following packages will be upgraded:
[5.75.162.44]   curl libcurl4 rsync
[5.75.162.44] 3 upgraded, 1 newly installed, 0 to remove and 88 not upgraded.
[5.75.162.44] Need to get 889 kB of archives.
[5.75.162.44] After this operation, 169 kB of additional disk space will be used.
[5.75.162.44] Get:1 https://mirror.hetzner.com/ubuntu/packages jammy-updates/main amd64 rsync amd64 3.2.3-8ubuntu3.1 [404 kB]
[5.75.162.44] Get:2 https://mirror.hetzner.com/ubuntu/packages jammy-updates/universe amd64 apt-transport-https all 2.4.8 [1,506 B]
[5.75.162.44] Get:3 https://mirror.hetzner.com/ubuntu/packages jammy-updates/main amd64 curl amd64 7.81.0-1ubuntu1.6 [194 kB]
[5.75.162.44] Get:4 https://mirror.hetzner.com/ubuntu/packages jammy-updates/main amd64 libcurl4 amd64 7.81.0-1ubuntu1.6 [290 kB]
[188.34.204.170] Building dependency tree...
[188.34.204.170] Reading state information...
[167.235.144.141] Fetched 889 kB in 0s (8,078 kB/s)
(Reading database ... 38840 files and directories currently installed.)
[167.235.144.141] Preparing to unpack .../rsync_3.2.3-8ubuntu3.1_amd64.deb ...
[167.235.144.141] Unpacking rsync (3.2.3-8ubuntu3.1) over (3.2.3-8ubuntu3) ...
[167.235.144.141] Selecting previously unselected package apt-transport-https.
[5.75.162.44] Fetched 889 kB in 0s (10.4 MB/s)
[167.235.144.141] Preparing to unpack .../apt-transport-https_2.4.8_all.deb ...
[167.235.144.141] Unpacking apt-transport-https (2.4.8) ...
[188.34.204.170] ca-certificates is already the newest version (20211016).
[188.34.204.170] lsb-release is already the newest version (11.1.0ubuntu4).
[188.34.204.170] curl is already the newest version (7.81.0-1ubuntu1.6).
[188.34.204.170] software-properties-common is already the newest version (0.99.22.3).
[188.34.204.170] apt-transport-https is already the newest version (2.4.8).
[188.34.204.170] 0 upgraded, 0 newly installed, 0 to remove and 88 not upgraded.
[188.34.204.170] + sudo apt-key add -
[188.34.204.170] + curl -fsSL https://download.docker.com/linux/ubuntu/gpg
[167.235.144.141] Preparing to unpack .../curl_7.81.0-1ubuntu1.6_amd64.deb ...
[167.235.144.141] Unpacking curl (7.81.0-1ubuntu1.6) over (7.81.0-1ubuntu1.3) ...
[167.235.144.141] Preparing to unpack .../libcurl4_7.81.0-1ubuntu1.6_amd64.deb ...
[167.235.144.141] Unpacking libcurl4:amd64 (7.81.0-1ubuntu1.6) over (7.81.0-1ubuntu1.3) ...
[188.34.204.170] Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)).
[167.235.144.141] Setting up apt-transport-https (2.4.8) ...
[167.235.144.141] Setting up libcurl4:amd64 (7.81.0-1ubuntu1.6) ...
[167.235.144.141] Setting up curl (7.81.0-1ubuntu1.6) ...
[167.235.144.141] Setting up rsync (3.2.3-8ubuntu3.1) ...
[188.34.204.170] OK
[188.34.204.170] ++ lsb_release -cs
(Reading database ... 38840 files and directories currently installed.)
[5.75.162.44] Preparing to unpack .../rsync_3.2.3-8ubuntu3.1_amd64.deb ...
[5.75.162.44] Unpacking rsync (3.2.3-8ubuntu3.1) over (3.2.3-8ubuntu3) ...
[188.34.204.170] + sudo add-apt-repository 'deb https://download.docker.com/linux/ubuntu jammy stable'
[5.75.162.44] Selecting previously unselected package apt-transport-https.
[5.75.162.44] Preparing to unpack .../apt-transport-https_2.4.8_all.deb ...
[5.75.162.44] Unpacking apt-transport-https (2.4.8) ...
[5.75.162.44] Preparing to unpack .../curl_7.81.0-1ubuntu1.6_amd64.deb ...
[5.75.162.44] Unpacking curl (7.81.0-1ubuntu1.6) over (7.81.0-1ubuntu1.3) ...
[5.75.162.44] Preparing to unpack .../libcurl4_7.81.0-1ubuntu1.6_amd64.deb ...
[5.75.162.44] Unpacking libcurl4:amd64 (7.81.0-1ubuntu1.6) over (7.81.0-1ubuntu1.3) ...
[5.75.162.44] Setting up apt-transport-https (2.4.8) ...
[5.75.162.44] Setting up libcurl4:amd64 (7.81.0-1ubuntu1.6) ...
[5.75.162.44] Setting up curl (7.81.0-1ubuntu1.6) ...
[5.75.162.44] Setting up rsync (3.2.3-8ubuntu3.1) ...
[5.75.175.139] Fetched 58.2 kB in 1s (45.1 kB/s)
[167.235.144.141] rsync.service is a disabled or a static unit not running, not starting it.
[167.235.144.141] Processing triggers for man-db (2.10.2-1) ...
[167.235.144.141] Processing triggers for libc-bin (2.35-0ubuntu3.1) ...
[5.75.162.44] rsync.service is a disabled or a static unit not running, not starting it.
[5.75.162.44] Processing triggers for man-db (2.10.2-1) ...
[5.75.162.44] Processing triggers for libc-bin (2.35-0ubuntu3.1) ...
[167.235.144.141] NEEDRESTART-VER: 3.5
[5.75.175.139] Reading package lists...
[5.75.175.139] W: https://download.docker.com/linux/ubuntu/dists/jammy/InRelease: Key is stored in legacy trusted.gpg keyring (/etc/apt/trusted.gpg), see the DEPRECATION section in apt-key(8) for details.
[5.75.175.139] W: http://apt.kubernetes.io/dists/kubernetes-xenial/InRelease: Key is stored in legacy trusted.gpg keyring (/etc/apt/trusted.gpg), see the DEPRECATION section in apt-key(8) for details.
[5.75.175.139] Repository: 'deb https://download.docker.com/linux/ubuntu jammy stable'
[5.75.175.139] Description:
[5.75.175.139] Archive for codename: jammy components: stable
[5.75.175.139] More info: https://download.docker.com/linux/ubuntu
[5.75.175.139] Adding repository.
[5.75.175.139] Found existing deb entry in /etc/apt/sources.list.d/archive_uri-https_download_docker_com_linux_ubuntu-jammy.list
[5.75.175.139] Adding deb entry to /etc/apt/sources.list.d/archive_uri-https_download_docker_com_linux_ubuntu-jammy.list
[5.75.175.139] Found existing deb-src entry in /etc/apt/sources.list.d/archive_uri-https_download_docker_com_linux_ubuntu-jammy.list
[5.75.175.139] Adding disabled deb-src entry to /etc/apt/sources.list.d/archive_uri-https_download_docker_com_linux_ubuntu-jammy.list
[188.34.204.170] Hit:1 https://mirror.hetzner.com/ubuntu/packages jammy InRelease
[188.34.204.170] Hit:2 https://mirror.hetzner.com/ubuntu/packages jammy-updates InRelease
[188.34.204.170] Hit:3 https://mirror.hetzner.com/ubuntu/packages jammy-backports InRelease
[188.34.204.170] Hit:4 https://mirror.hetzner.com/ubuntu/security jammy-security InRelease
[188.34.204.170] Get:5 https://download.docker.com/linux/ubuntu jammy InRelease [48.9 kB]
[5.75.175.139] + sudo apt-mark unhold containerd.io
[188.34.204.170] Hit:6 https://packages.cloud.google.com/apt kubernetes-xenial InRelease
[5.75.175.139] + sudo DEBIAN_FRONTEND=noninteractive apt-get install --option Dpkg::Options::=--force-confold --no-install-recommends -y 'containerd.io=1.6.*'
[5.75.175.139] Canceled hold on containerd.io.
[5.75.162.44] NEEDRESTART-VER: 3.5
[167.235.144.141] NEEDRESTART-KCUR: 5.15.0-46-generic
[167.235.144.141] NEEDRESTART-KEXP: 5.15.0-46-generic
[167.235.144.141] NEEDRESTART-KSTA: 1
[5.75.175.139] Reading package lists...
[5.75.175.139] Building dependency tree...
[5.75.175.139] Reading state information...
[5.75.175.139] containerd.io is already the newest version (1.6.10-1).
[5.75.175.139] 0 upgraded, 0 newly installed, 0 to remove and 88 not upgraded.
[5.75.175.139] + sudo apt-mark hold containerd.io
[5.75.162.44] NEEDRESTART-KCUR: 5.15.0-46-generic
[5.75.162.44] NEEDRESTART-KEXP: 5.15.0-46-generic
[5.75.162.44] NEEDRESTART-KSTA: 1
[5.75.175.139] containerd.io set on hold.
[5.75.175.139] ++ dirname /etc/containerd/config.toml
[5.75.175.139] + sudo mkdir -p /etc/containerd
[5.75.175.139] + sudo touch /etc/containerd/config.toml
[5.75.175.139] + sudo chmod 600 /etc/containerd/config.toml
[5.75.175.139] + sudo tee /etc/containerd/config.toml
[5.75.175.139] version = 2
[5.75.175.139] 
[5.75.175.139] [metrics]
[5.75.175.139] address = "127.0.0.1:1338"
[5.75.175.139] 
[5.75.175.139] [plugins]
[5.75.175.139] [plugins."io.containerd.grpc.v1.cri"]
[5.75.175.139] [plugins."io.containerd.grpc.v1.cri".containerd]
[5.75.175.139] [plugins."io.containerd.grpc.v1.cri".containerd.runtimes]
[5.75.175.139] [plugins."io.containerd.grpc.v1.cri".containerd.runtimes.runc]
[5.75.175.139] runtime_type = "io.containerd.runc.v2"
[5.75.175.139] [plugins."io.containerd.grpc.v1.cri".containerd.runtimes.runc.options]
[5.75.175.139] SystemdCgroup = true
[5.75.175.139] [plugins."io.containerd.grpc.v1.cri".registry]
[5.75.175.139] [plugins."io.containerd.grpc.v1.cri".registry.mirrors]
[5.75.175.139] [plugins."io.containerd.grpc.v1.cri".registry.mirrors."docker.io"]
[5.75.175.139] endpoint = ["https://registry-1.docker.io"]
[5.75.175.139] 
[5.75.175.139] + cat
[5.75.175.139] + sudo tee /etc/crictl.yaml
[5.75.175.139] runtime-endpoint: unix:///run/containerd/containerd.sock
[5.75.175.139] + cat
[5.75.175.139] + sudo systemctl daemon-reload
[5.75.173.127] Fetched 48.9 kB in 1s (37.6 kB/s)
[5.75.175.139] + sudo systemctl enable containerd
[5.75.175.139] + sudo systemctl restart containerd
[5.75.173.127] Reading package lists...
[5.75.173.127] Repository: 'deb https://download.docker.com/linux/ubuntu jammy stable'
[5.75.173.127] Description:
[5.75.173.127] Archive for codename: jammy components: stable
[5.75.173.127] More info: https://download.docker.com/linux/ubuntu
[5.75.173.127] Adding repository.
[5.75.173.127] Found existing deb entry in /etc/apt/sources.list.d/archive_uri-https_download_docker_com_linux_ubuntu-jammy.list
[5.75.173.127] Adding deb entry to /etc/apt/sources.list.d/archive_uri-https_download_docker_com_linux_ubuntu-jammy.list
[5.75.173.127] Found existing deb-src entry in /etc/apt/sources.list.d/archive_uri-https_download_docker_com_linux_ubuntu-jammy.list
[5.75.173.127] Adding disabled deb-src entry to /etc/apt/sources.list.d/archive_uri-https_download_docker_com_linux_ubuntu-jammy.list
[5.75.173.127] W: https://download.docker.com/linux/ubuntu/dists/jammy/InRelease: Key is stored in legacy trusted.gpg keyring (/etc/apt/trusted.gpg), see the DEPRECATION section in apt-key(8) for details.
[5.75.173.127] W: http://apt.kubernetes.io/dists/kubernetes-xenial/InRelease: Key is stored in legacy trusted.gpg keyring (/etc/apt/trusted.gpg), see the DEPRECATION section in apt-key(8) for details.
[5.75.173.127] + sudo apt-mark unhold containerd.io
[5.75.175.139] + sudo DEBIAN_FRONTEND=noninteractive apt-get install --option Dpkg::Options::=--force-confold --no-install-recommends -y 'kubelet=1.24.8*' 'kubeadm=1.24.8*' 'kubectl=1.24.8*' 'kubernetes-cni=1.1.1*'
[5.75.173.127] + sudo DEBIAN_FRONTEND=noninteractive apt-get install --option Dpkg::Options::=--force-confold --no-install-recommends -y 'containerd.io=1.6.*'
[5.75.173.127] Canceled hold on containerd.io.
[5.75.173.127] Reading package lists...
[5.75.175.139] Reading package lists...
[5.75.175.139] Building dependency tree...
[5.75.175.139] Reading state information...
[5.75.173.127] Building dependency tree...
[5.75.173.127] Reading state information...
[5.75.175.139] kubeadm is already the newest version (1.24.8-00).
[5.75.175.139] kubectl is already the newest version (1.24.8-00).
[5.75.175.139] kubelet is already the newest version (1.24.8-00).
[5.75.175.139] kubernetes-cni is already the newest version (1.1.1-00).
[5.75.175.139] 0 upgraded, 0 newly installed, 0 to remove and 85 not upgraded.
[5.75.175.139] + sudo apt-mark hold kubelet kubeadm kubectl kubernetes-cni
[5.75.175.139] + sudo systemctl daemon-reload
[5.75.175.139] kubelet was already set on hold.
[5.75.175.139] kubeadm was already set on hold.
[5.75.175.139] kubectl was already set on hold.
[5.75.175.139] kubernetes-cni was already set on hold.
[5.75.173.127] + sudo apt-mark hold containerd.io
[5.75.173.127] containerd.io is already the newest version (1.6.10-1).
[5.75.173.127] 0 upgraded, 0 newly installed, 0 to remove and 88 not upgraded.
[5.75.173.127] ++ dirname /etc/containerd/config.toml
[5.75.173.127] containerd.io set on hold.
[5.75.173.127] + sudo mkdir -p /etc/containerd
[5.75.173.127] + sudo touch /etc/containerd/config.toml
[5.75.173.127] + sudo chmod 600 /etc/containerd/config.toml
[5.75.173.127] + sudo tee /etc/containerd/config.toml
[5.75.173.127] + cat
[5.75.173.127] + cat
[5.75.173.127] + sudo tee /etc/crictl.yaml
[5.75.173.127] version = 2
[5.75.173.127] 
[5.75.173.127] [metrics]
[5.75.173.127] address = "127.0.0.1:1338"
[5.75.173.127] 
[5.75.173.127] [plugins]
[5.75.173.127] [plugins."io.containerd.grpc.v1.cri"]
[5.75.173.127] [plugins."io.containerd.grpc.v1.cri".containerd]
[5.75.173.127] [plugins."io.containerd.grpc.v1.cri".containerd.runtimes]
[5.75.173.127] [plugins."io.containerd.grpc.v1.cri".containerd.runtimes.runc]
[5.75.173.127] runtime_type = "io.containerd.runc.v2"
[5.75.173.127] [plugins."io.containerd.grpc.v1.cri".containerd.runtimes.runc.options]
[5.75.173.127] SystemdCgroup = true
[5.75.173.127] [plugins."io.containerd.grpc.v1.cri".registry]
[5.75.173.127] [plugins."io.containerd.grpc.v1.cri".registry.mirrors]
[5.75.173.127] [plugins."io.containerd.grpc.v1.cri".registry.mirrors."docker.io"]
[5.75.173.127] endpoint = ["https://registry-1.docker.io"]
[5.75.173.127] 
[5.75.173.127] + sudo systemctl daemon-reload
[5.75.173.127] runtime-endpoint: unix:///run/containerd/containerd.sock
[5.75.175.139] + sudo systemctl enable --now kubelet
[167.235.144.141] + sudo apt-key add -
[167.235.144.141] + curl -fsSL https://packages.cloud.google.com/apt/doc/apt-key.gpg
[167.235.144.141] Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)).
[5.75.173.127] + sudo systemctl enable containerd
[167.235.144.141] + echo 'deb http://apt.kubernetes.io/ kubernetes-xenial main'
[167.235.144.141] OK
[167.235.144.141] + sudo tee /etc/apt/sources.list.d/kubernetes.list
[167.235.144.141] deb http://apt.kubernetes.io/ kubernetes-xenial main
[167.235.144.141] + sudo apt-get update
[167.235.144.141] Hit:1 https://mirror.hetzner.com/ubuntu/packages jammy InRelease
[167.235.144.141] Hit:2 https://mirror.hetzner.com/ubuntu/packages jammy-updates InRelease
[167.235.144.141] Hit:3 https://mirror.hetzner.com/ubuntu/packages jammy-backports InRelease
[167.235.144.141] Hit:4 https://mirror.hetzner.com/ubuntu/security jammy-security InRelease
[5.75.175.139] + sudo systemctl restart kubelet
[5.75.162.44] + curl -fsSL https://packages.cloud.google.com/apt/doc/apt-key.gpg
[5.75.162.44] + sudo apt-key add -
[5.75.162.44] Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)).
[5.75.173.127] + sudo systemctl restart containerd
[167.235.144.141] Get:5 https://packages.cloud.google.com/apt kubernetes-xenial InRelease [9,383 B]
[5.75.173.127] + sudo DEBIAN_FRONTEND=noninteractive apt-get install --option Dpkg::Options::=--force-confold --no-install-recommends -y 'kubelet=1.24.8*' 'kubeadm=1.24.8*' 'kubectl=1.24.8*' 'kubernetes-cni=1.1.1*'
[5.75.162.44] OK
[5.75.162.44] + echo 'deb http://apt.kubernetes.io/ kubernetes-xenial main'
[5.75.162.44] + sudo tee /etc/apt/sources.list.d/kubernetes.list
[5.75.162.44] + sudo apt-get update
[5.75.162.44] deb http://apt.kubernetes.io/ kubernetes-xenial main
[5.75.162.44] Hit:1 https://mirror.hetzner.com/ubuntu/packages jammy InRelease
[5.75.162.44] Hit:2 https://mirror.hetzner.com/ubuntu/packages jammy-updates InRelease
[5.75.162.44] Hit:3 https://mirror.hetzner.com/ubuntu/packages jammy-backports InRelease
[5.75.162.44] Hit:4 https://mirror.hetzner.com/ubuntu/security jammy-security InRelease
[167.235.144.141] Get:6 https://packages.cloud.google.com/apt kubernetes-xenial/main amd64 Packages [61.4 kB]
[5.75.173.127] Reading package lists...
[167.235.144.141] Fetched 70.8 kB in 1s (64.3 kB/s)
[5.75.173.127] Building dependency tree...
[5.75.173.127] Reading state information...
[5.75.162.44] Get:5 https://packages.cloud.google.com/apt kubernetes-xenial InRelease [9,383 B]
[5.75.173.127] + sudo apt-mark hold kubelet kubeadm kubectl kubernetes-cni
[5.75.173.127] kubeadm is already the newest version (1.24.8-00).
[5.75.173.127] kubectl is already the newest version (1.24.8-00).
[5.75.173.127] kubelet is already the newest version (1.24.8-00).
[5.75.173.127] kubernetes-cni is already the newest version (1.1.1-00).
[5.75.173.127] 0 upgraded, 0 newly installed, 0 to remove and 85 not upgraded.
[5.75.162.44] Get:6 https://packages.cloud.google.com/apt kubernetes-xenial/main amd64 Packages [61.4 kB]
[5.75.173.127] + sudo systemctl daemon-reload
[5.75.173.127] kubelet was already set on hold.
[5.75.173.127] kubeadm was already set on hold.
[5.75.173.127] kubectl was already set on hold.
[5.75.173.127] kubernetes-cni was already set on hold.
[5.75.162.44] Fetched 70.8 kB in 1s (63.0 kB/s)
[188.34.204.170] Fetched 48.9 kB in 1s (37.8 kB/s)
[167.235.144.141] Reading package lists...
[167.235.144.141] W: http://apt.kubernetes.io/dists/kubernetes-xenial/InRelease: Key is stored in legacy trusted.gpg keyring (/etc/apt/trusted.gpg), see the DEPRECATION section in apt-key(8) for details.
[167.235.144.141] + kube_ver='1.24.8*'
[167.235.144.141] + cni_ver='1.1.1*'
[167.235.144.141] + sudo apt-get update
[5.75.173.127] + sudo systemctl enable --now kubelet
[167.235.144.141] Hit:1 https://mirror.hetzner.com/ubuntu/packages jammy InRelease
[167.235.144.141] Hit:2 https://mirror.hetzner.com/ubuntu/packages jammy-updates InRelease
[167.235.144.141] Hit:3 https://mirror.hetzner.com/ubuntu/packages jammy-backports InRelease
[167.235.144.141] Hit:4 https://mirror.hetzner.com/ubuntu/security jammy-security InRelease
[167.235.144.141] Hit:5 https://packages.cloud.google.com/apt kubernetes-xenial InRelease
[5.75.162.44] Reading package lists...
[5.75.162.44] W: http://apt.kubernetes.io/dists/kubernetes-xenial/InRelease: Key is stored in legacy trusted.gpg keyring (/etc/apt/trusted.gpg), see the DEPRECATION section in apt-key(8) for details.
[5.75.162.44] + kube_ver='1.24.8*'
[5.75.162.44] + cni_ver='1.1.1*'
[5.75.162.44] + sudo apt-get update
[5.75.173.127] + sudo systemctl restart kubelet
[5.75.162.44] Hit:1 https://mirror.hetzner.com/ubuntu/packages jammy InRelease
[5.75.162.44] Hit:2 https://mirror.hetzner.com/ubuntu/packages jammy-updates InRelease
[5.75.162.44] Hit:3 https://mirror.hetzner.com/ubuntu/packages jammy-backports InRelease
[5.75.162.44] Hit:4 https://mirror.hetzner.com/ubuntu/security jammy-security InRelease
[5.75.162.44] Hit:5 https://packages.cloud.google.com/apt kubernetes-xenial InRelease
[188.34.204.170] Reading package lists...
[188.34.204.170] Repository: 'deb https://download.docker.com/linux/ubuntu jammy stable'
[188.34.204.170] Description:
[188.34.204.170] Archive for codename: jammy components: stable
[188.34.204.170] More info: https://download.docker.com/linux/ubuntu
[188.34.204.170] Adding repository.
[188.34.204.170] Found existing deb entry in /etc/apt/sources.list.d/archive_uri-https_download_docker_com_linux_ubuntu-jammy.list
[188.34.204.170] Adding deb entry to /etc/apt/sources.list.d/archive_uri-https_download_docker_com_linux_ubuntu-jammy.list
[188.34.204.170] Found existing deb-src entry in /etc/apt/sources.list.d/archive_uri-https_download_docker_com_linux_ubuntu-jammy.list
[188.34.204.170] Adding disabled deb-src entry to /etc/apt/sources.list.d/archive_uri-https_download_docker_com_linux_ubuntu-jammy.list
[188.34.204.170] W: https://download.docker.com/linux/ubuntu/dists/jammy/InRelease: Key is stored in legacy trusted.gpg keyring (/etc/apt/trusted.gpg), see the DEPRECATION section in apt-key(8) for details.
[188.34.204.170] W: http://apt.kubernetes.io/dists/kubernetes-xenial/InRelease: Key is stored in legacy trusted.gpg keyring (/etc/apt/trusted.gpg), see the DEPRECATION section in apt-key(8) for details.
[188.34.204.170] + sudo apt-mark unhold containerd.io
[188.34.204.170] + sudo DEBIAN_FRONTEND=noninteractive apt-get install --option Dpkg::Options::=--force-confold --no-install-recommends -y 'containerd.io=1.6.*'
[188.34.204.170] Canceled hold on containerd.io.
[188.34.204.170] Reading package lists...
[188.34.204.170] Building dependency tree...
[188.34.204.170] Reading state information...
[188.34.204.170] containerd.io is already the newest version (1.6.10-1).
[188.34.204.170] 0 upgraded, 0 newly installed, 0 to remove and 88 not upgraded.
[188.34.204.170] + sudo apt-mark hold containerd.io
[188.34.204.170] containerd.io set on hold.
[188.34.204.170] ++ dirname /etc/containerd/config.toml
[188.34.204.170] + sudo mkdir -p /etc/containerd
[167.235.144.141] Reading package lists...
[188.34.204.170] + sudo touch /etc/containerd/config.toml
[188.34.204.170] + sudo chmod 600 /etc/containerd/config.toml
[167.235.144.141] W: http://apt.kubernetes.io/dists/kubernetes-xenial/InRelease: Key is stored in legacy trusted.gpg keyring (/etc/apt/trusted.gpg), see the DEPRECATION section in apt-key(8) for details.
[167.235.144.141] + sudo apt-get install -y apt-transport-https ca-certificates curl software-properties-common lsb-release
[188.34.204.170] + cat
[188.34.204.170] + sudo tee /etc/containerd/config.toml
[188.34.204.170] + cat
[188.34.204.170] + sudo tee /etc/crictl.yaml
[188.34.204.170] version = 2
[188.34.204.170] 
[188.34.204.170] [metrics]
[188.34.204.170] address = "127.0.0.1:1338"
[188.34.204.170] 
[188.34.204.170] [plugins]
[188.34.204.170] [plugins."io.containerd.grpc.v1.cri"]
[188.34.204.170] [plugins."io.containerd.grpc.v1.cri".containerd]
[188.34.204.170] [plugins."io.containerd.grpc.v1.cri".containerd.runtimes]
[188.34.204.170] [plugins."io.containerd.grpc.v1.cri".containerd.runtimes.runc]
[188.34.204.170] runtime_type = "io.containerd.runc.v2"
[188.34.204.170] [plugins."io.containerd.grpc.v1.cri".containerd.runtimes.runc.options]
[188.34.204.170] SystemdCgroup = true
[188.34.204.170] [plugins."io.containerd.grpc.v1.cri".registry]
[188.34.204.170] [plugins."io.containerd.grpc.v1.cri".registry.mirrors]
[188.34.204.170] [plugins."io.containerd.grpc.v1.cri".registry.mirrors."docker.io"]
[188.34.204.170] endpoint = ["https://registry-1.docker.io"]
[188.34.204.170] 
[188.34.204.170] + sudo systemctl daemon-reload
[188.34.204.170] runtime-endpoint: unix:///run/containerd/containerd.sock
[167.235.144.141] Reading package lists...
[167.235.144.141] Building dependency tree...
[167.235.144.141] Reading state information...
[167.235.144.141] + sudo apt-key add -
[167.235.144.141] + curl -fsSL https://download.docker.com/linux/ubuntu/gpg
[5.75.162.44] Reading package lists...
[167.235.144.141] ca-certificates is already the newest version (20211016).
[167.235.144.141] lsb-release is already the newest version (11.1.0ubuntu4).
[167.235.144.141] curl is already the newest version (7.81.0-1ubuntu1.6).
[167.235.144.141] software-properties-common is already the newest version (0.99.22.3).
[167.235.144.141] apt-transport-https is already the newest version (2.4.8).
[167.235.144.141] 0 upgraded, 0 newly installed, 0 to remove and 88 not upgraded.
[5.75.162.44] W: http://apt.kubernetes.io/dists/kubernetes-xenial/InRelease: Key is stored in legacy trusted.gpg keyring (/etc/apt/trusted.gpg), see the DEPRECATION section in apt-key(8) for details.
[5.75.162.44] + sudo apt-get install -y apt-transport-https ca-certificates curl software-properties-common lsb-release
[167.235.144.141] Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)).
[5.75.162.44] Reading package lists...
[188.34.204.170] + sudo systemctl enable containerd
[167.235.144.141] OK
[167.235.144.141] ++ lsb_release -cs
[167.235.144.141] + sudo add-apt-repository 'deb https://download.docker.com/linux/ubuntu jammy stable'
[5.75.162.44] Building dependency tree...
[5.75.162.44] Reading state information...
[5.75.162.44] + sudo apt-key add -
[5.75.162.44] + curl -fsSL https://download.docker.com/linux/ubuntu/gpg
[5.75.162.44] ca-certificates is already the newest version (20211016).
[5.75.162.44] lsb-release is already the newest version (11.1.0ubuntu4).
[5.75.162.44] curl is already the newest version (7.81.0-1ubuntu1.6).
[5.75.162.44] software-properties-common is already the newest version (0.99.22.3).
[5.75.162.44] apt-transport-https is already the newest version (2.4.8).
[5.75.162.44] 0 upgraded, 0 newly installed, 0 to remove and 88 not upgraded.
[5.75.162.44] Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)).
[5.75.162.44] ++ lsb_release -cs
[5.75.162.44] OK
[188.34.204.170] + sudo systemctl restart containerd
[5.75.162.44] + sudo add-apt-repository 'deb https://download.docker.com/linux/ubuntu jammy stable'
[188.34.204.170] + sudo DEBIAN_FRONTEND=noninteractive apt-get install --option Dpkg::Options::=--force-confold --no-install-recommends -y 'kubelet=1.24.8*' 'kubeadm=1.24.8*' 'kubectl=1.24.8*' 'kubernetes-cni=1.1.1*'
[188.34.204.170] Reading package lists...
[188.34.204.170] Building dependency tree...
[188.34.204.170] Reading state information...
[167.235.144.141] Hit:1 https://mirror.hetzner.com/ubuntu/packages jammy InRelease
[167.235.144.141] Hit:2 https://mirror.hetzner.com/ubuntu/packages jammy-updates InRelease
[167.235.144.141] Hit:3 https://mirror.hetzner.com/ubuntu/packages jammy-backports InRelease
[167.235.144.141] Hit:4 https://mirror.hetzner.com/ubuntu/security jammy-security InRelease
[167.235.144.141] Get:5 https://download.docker.com/linux/ubuntu jammy InRelease [48.9 kB]
[167.235.144.141] Hit:6 https://packages.cloud.google.com/apt kubernetes-xenial InRelease
[188.34.204.170] + sudo apt-mark hold kubelet kubeadm kubectl kubernetes-cni
[188.34.204.170] kubeadm is already the newest version (1.24.8-00).
[188.34.204.170] kubectl is already the newest version (1.24.8-00).
[188.34.204.170] kubelet is already the newest version (1.24.8-00).
[188.34.204.170] kubernetes-cni is already the newest version (1.1.1-00).
[188.34.204.170] 0 upgraded, 0 newly installed, 0 to remove and 85 not upgraded.
[5.75.162.44] Hit:1 https://mirror.hetzner.com/ubuntu/packages jammy InRelease
[5.75.162.44] Hit:2 https://mirror.hetzner.com/ubuntu/packages jammy-updates InRelease
[5.75.162.44] Hit:3 https://mirror.hetzner.com/ubuntu/packages jammy-backports InRelease
[5.75.162.44] Hit:4 https://mirror.hetzner.com/ubuntu/security jammy-security InRelease
[5.75.162.44] Get:5 https://download.docker.com/linux/ubuntu jammy InRelease [48.9 kB]
[5.75.162.44] Hit:6 https://packages.cloud.google.com/apt kubernetes-xenial InRelease
[167.235.144.141] Get:7 https://download.docker.com/linux/ubuntu jammy/stable amd64 Packages [9,632 B]
[188.34.204.170] + sudo systemctl daemon-reload
[188.34.204.170] kubelet was already set on hold.
[188.34.204.170] kubeadm was already set on hold.
[188.34.204.170] kubectl was already set on hold.
[188.34.204.170] kubernetes-cni was already set on hold.
[188.34.204.170] + sudo systemctl enable --now kubelet
[5.75.162.44] Get:7 https://download.docker.com/linux/ubuntu jammy/stable amd64 Packages [9,632 B]
[188.34.204.170] + sudo systemctl restart kubelet
[167.235.144.141] Fetched 58.5 kB in 1s (42.1 kB/s)
[5.75.162.44] Fetched 58.5 kB in 1s (43.6 kB/s)
[167.235.144.141] Reading package lists...
[167.235.144.141] W: https://download.docker.com/linux/ubuntu/dists/jammy/InRelease: Key is stored in legacy trusted.gpg keyring (/etc/apt/trusted.gpg), see the DEPRECATION section in apt-key(8) for details.
[167.235.144.141] W: http://apt.kubernetes.io/dists/kubernetes-xenial/InRelease: Key is stored in legacy trusted.gpg keyring (/etc/apt/trusted.gpg), see the DEPRECATION section in apt-key(8) for details.
[167.235.144.141] Repository: 'deb https://download.docker.com/linux/ubuntu jammy stable'
[167.235.144.141] Description:
[167.235.144.141] Archive for codename: jammy components: stable
[167.235.144.141] More info: https://download.docker.com/linux/ubuntu
[167.235.144.141] Adding repository.
[167.235.144.141] Adding deb entry to /etc/apt/sources.list.d/archive_uri-https_download_docker_com_linux_ubuntu-jammy.list
[167.235.144.141] Adding disabled deb-src entry to /etc/apt/sources.list.d/archive_uri-https_download_docker_com_linux_ubuntu-jammy.list
[167.235.144.141] + sudo apt-mark unhold containerd.io
[167.235.144.141] + sudo DEBIAN_FRONTEND=noninteractive apt-get install --option Dpkg::Options::=--force-confold --no-install-recommends -y 'containerd.io=1.6.*'
[167.235.144.141] containerd.io was already not on hold.
[5.75.162.44] Reading package lists...
[5.75.162.44] Repository: 'deb https://download.docker.com/linux/ubuntu jammy stable'
[5.75.162.44] Description:
[5.75.162.44] Archive for codename: jammy components: stable
[5.75.162.44] More info: https://download.docker.com/linux/ubuntu
[5.75.162.44] Adding repository.
[5.75.162.44] Adding deb entry to /etc/apt/sources.list.d/archive_uri-https_download_docker_com_linux_ubuntu-jammy.list
[5.75.162.44] Adding disabled deb-src entry to /etc/apt/sources.list.d/archive_uri-https_download_docker_com_linux_ubuntu-jammy.list
[5.75.162.44] W: https://download.docker.com/linux/ubuntu/dists/jammy/InRelease: Key is stored in legacy trusted.gpg keyring (/etc/apt/trusted.gpg), see the DEPRECATION section in apt-key(8) for details.
[5.75.162.44] W: http://apt.kubernetes.io/dists/kubernetes-xenial/InRelease: Key is stored in legacy trusted.gpg keyring (/etc/apt/trusted.gpg), see the DEPRECATION section in apt-key(8) for details.
[167.235.144.141] Reading package lists...
[5.75.162.44] + sudo apt-mark unhold containerd.io
[5.75.162.44] containerd.io was already not on hold.
[5.75.162.44] Reading package lists...
[5.75.162.44] + sudo DEBIAN_FRONTEND=noninteractive apt-get install --option Dpkg::Options::=--force-confold --no-install-recommends -y 'containerd.io=1.6.*'
[167.235.144.141] Building dependency tree...
[167.235.144.141] Reading state information...
[5.75.162.44] Building dependency tree...
[5.75.162.44] Reading state information...
[167.235.144.141] The following NEW packages will be installed:
[167.235.144.141]   containerd.io
[167.235.144.141] 0 upgraded, 1 newly installed, 0 to remove and 88 not upgraded.
[167.235.144.141] Need to get 27.7 MB of archives.
[167.235.144.141] After this operation, 114 MB of additional disk space will be used.
[167.235.144.141] Get:1 https://download.docker.com/linux/ubuntu jammy/stable amd64 containerd.io amd64 1.6.10-1 [27.7 MB]
[5.75.162.44] The following NEW packages will be installed:
[5.75.162.44]   containerd.io
[5.75.162.44] 0 upgraded, 1 newly installed, 0 to remove and 88 not upgraded.
[5.75.162.44] Need to get 27.7 MB of archives.
[5.75.162.44] After this operation, 114 MB of additional disk space will be used.
[5.75.162.44] Get:1 https://download.docker.com/linux/ubuntu jammy/stable amd64 containerd.io amd64 1.6.10-1 [27.7 MB]
[167.235.144.141] Fetched 27.7 MB in 0s (59.8 MB/s)
[167.235.144.141] Selecting previously unselected package containerd.io.
[5.75.162.44] Fetched 27.7 MB in 0s (63.9 MB/s)
[5.75.162.44] Selecting previously unselected package containerd.io.
(Reading database ... 38844 files and directories currently installed.)
[167.235.144.141] Preparing to unpack .../containerd.io_1.6.10-1_amd64.deb ...
[167.235.144.141] Unpacking containerd.io (1.6.10-1) ...
(Reading database ... 38844 files and directories currently installed.)
[5.75.162.44] Preparing to unpack .../containerd.io_1.6.10-1_amd64.deb ...
[5.75.162.44] Unpacking containerd.io (1.6.10-1) ...
[5.75.162.44] Setting up containerd.io (1.6.10-1) ...
[5.75.162.44] Created symlink /etc/systemd/system/multi-user.target.wants/containerd.service → /lib/systemd/system/containerd.service.
[167.235.144.141] Setting up containerd.io (1.6.10-1) ...
[167.235.144.141] Created symlink /etc/systemd/system/multi-user.target.wants/containerd.service → /lib/systemd/system/containerd.service.
[5.75.162.44] Processing triggers for man-db (2.10.2-1) ...
[167.235.144.141] Processing triggers for man-db (2.10.2-1) ...
[5.75.162.44] NEEDRESTART-VER: 3.5
[167.235.144.141] NEEDRESTART-VER: 3.5
[5.75.162.44] NEEDRESTART-KCUR: 5.15.0-46-generic
[5.75.162.44] NEEDRESTART-KEXP: 5.15.0-46-generic
[5.75.162.44] NEEDRESTART-KSTA: 1
[167.235.144.141] NEEDRESTART-KCUR: 5.15.0-46-generic
[167.235.144.141] NEEDRESTART-KEXP: 5.15.0-46-generic
[167.235.144.141] NEEDRESTART-KSTA: 1
[5.75.162.44] + sudo apt-mark hold containerd.io
[5.75.162.44] ++ dirname /etc/containerd/config.toml
[5.75.162.44] + sudo mkdir -p /etc/containerd
[5.75.162.44] containerd.io set on hold.
[5.75.162.44] + sudo touch /etc/containerd/config.toml
[5.75.162.44] + sudo chmod 600 /etc/containerd/config.toml
[5.75.162.44] + sudo tee /etc/containerd/config.toml
[5.75.162.44] + cat
[5.75.162.44] + sudo tee /etc/crictl.yaml
[5.75.162.44] + cat
[5.75.162.44] version = 2
[5.75.162.44] 
[5.75.162.44] [metrics]
[5.75.162.44] address = "127.0.0.1:1338"
[5.75.162.44] 
[5.75.162.44] [plugins]
[5.75.162.44] [plugins."io.containerd.grpc.v1.cri"]
[5.75.162.44] [plugins."io.containerd.grpc.v1.cri".containerd]
[5.75.162.44] [plugins."io.containerd.grpc.v1.cri".containerd.runtimes]
[5.75.162.44] [plugins."io.containerd.grpc.v1.cri".containerd.runtimes.runc]
[5.75.162.44] runtime_type = "io.containerd.runc.v2"
[5.75.162.44] [plugins."io.containerd.grpc.v1.cri".containerd.runtimes.runc.options]
[5.75.162.44] SystemdCgroup = true
[5.75.162.44] [plugins."io.containerd.grpc.v1.cri".registry]
[5.75.162.44] [plugins."io.containerd.grpc.v1.cri".registry.mirrors]
[5.75.162.44] [plugins."io.containerd.grpc.v1.cri".registry.mirrors."docker.io"]
[5.75.162.44] endpoint = ["https://registry-1.docker.io"]
[5.75.162.44] 
[5.75.162.44] + sudo systemctl daemon-reload
[5.75.162.44] runtime-endpoint: unix:///run/containerd/containerd.sock
[167.235.144.141] + sudo apt-mark hold containerd.io
[167.235.144.141] ++ dirname /etc/containerd/config.toml
[167.235.144.141] containerd.io set on hold.
[167.235.144.141] + sudo mkdir -p /etc/containerd
[167.235.144.141] + sudo touch /etc/containerd/config.toml
[167.235.144.141] + sudo chmod 600 /etc/containerd/config.toml
[167.235.144.141] + cat
[167.235.144.141] + sudo tee /etc/containerd/config.toml
[167.235.144.141] + sudo tee /etc/crictl.yaml
[167.235.144.141] + cat
[167.235.144.141] version = 2
[167.235.144.141] 
[167.235.144.141] [metrics]
[167.235.144.141] address = "127.0.0.1:1338"
[167.235.144.141] 
[167.235.144.141] [plugins]
[167.235.144.141] [plugins."io.containerd.grpc.v1.cri"]
[167.235.144.141] [plugins."io.containerd.grpc.v1.cri".containerd]
[167.235.144.141] [plugins."io.containerd.grpc.v1.cri".containerd.runtimes]
[167.235.144.141] [plugins."io.containerd.grpc.v1.cri".containerd.runtimes.runc]
[167.235.144.141] runtime_type = "io.containerd.runc.v2"
[167.235.144.141] [plugins."io.containerd.grpc.v1.cri".containerd.runtimes.runc.options]
[167.235.144.141] SystemdCgroup = true
[167.235.144.141] [plugins."io.containerd.grpc.v1.cri".registry]
[167.235.144.141] [plugins."io.containerd.grpc.v1.cri".registry.mirrors]
[167.235.144.141] [plugins."io.containerd.grpc.v1.cri".registry.mirrors."docker.io"]
[167.235.144.141] endpoint = ["https://registry-1.docker.io"]
[167.235.144.141] 
[167.235.144.141] runtime-endpoint: unix:///run/containerd/containerd.sock
[167.235.144.141] + sudo systemctl daemon-reload
[5.75.162.44] + sudo systemctl enable containerd
[167.235.144.141] + sudo systemctl enable containerd
[5.75.162.44] + sudo systemctl restart containerd
[5.75.162.44] + sudo DEBIAN_FRONTEND=noninteractive apt-get install --option Dpkg::Options::=--force-confold --no-install-recommends -y 'kubelet=1.24.8*' 'kubeadm=1.24.8*' 'kubectl=1.24.8*' 'kubernetes-cni=1.1.1*'
[5.75.162.44] Reading package lists...
[167.235.144.141] + sudo systemctl restart containerd
[167.235.144.141] + sudo DEBIAN_FRONTEND=noninteractive apt-get install --option Dpkg::Options::=--force-confold --no-install-recommends -y 'kubelet=1.24.8*' 'kubeadm=1.24.8*' 'kubectl=1.24.8*' 'kubernetes-cni=1.1.1*'
[5.75.162.44] Building dependency tree...
[5.75.162.44] Reading state information...
[5.75.162.44] The following additional packages will be installed:
[5.75.162.44]   conntrack cri-tools ebtables socat
[167.235.144.141] Reading package lists...
[5.75.162.44] The following NEW packages will be installed:
[5.75.162.44]   conntrack cri-tools ebtables kubeadm kubectl kubelet kubernetes-cni socat
[5.75.162.44] 0 upgraded, 8 newly installed, 0 to remove and 88 not upgraded.
[5.75.162.44] Need to get 80.9 MB of archives.
[5.75.162.44] After this operation, 330 MB of additional disk space will be used.
[5.75.162.44] Get:1 https://mirror.hetzner.com/ubuntu/packages jammy/main amd64 conntrack amd64 1:1.4.6-2build2 [33.5 kB]
[5.75.162.44] Get:2 https://mirror.hetzner.com/ubuntu/packages jammy/main amd64 ebtables amd64 2.0.11-4build2 [84.9 kB]
[5.75.162.44] Get:3 https://mirror.hetzner.com/ubuntu/packages jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB]
[167.235.144.141] Building dependency tree...
[167.235.144.141] Reading state information...
[5.75.162.44] Get:4 https://packages.cloud.google.com/apt kubernetes-xenial/main amd64 cri-tools amd64 1.25.0-00 [17.9 MB]
[167.235.144.141] The following additional packages will be installed:
[167.235.144.141]   conntrack cri-tools ebtables socat
[167.235.144.141] The following NEW packages will be installed:
[5.75.162.44] Get:5 https://packages.cloud.google.com/apt kubernetes-xenial/main amd64 kubernetes-cni amd64 1.1.1-00 [25.0 MB]
[167.235.144.141]   conntrack cri-tools ebtables kubeadm kubectl kubelet kubernetes-cni socat
[167.235.144.141] 0 upgraded, 8 newly installed, 0 to remove and 88 not upgraded.
[167.235.144.141] Need to get 80.9 MB of archives.
[167.235.144.141] After this operation, 330 MB of additional disk space will be used.
[167.235.144.141] Get:1 https://mirror.hetzner.com/ubuntu/packages jammy/main amd64 conntrack amd64 1:1.4.6-2build2 [33.5 kB]
[167.235.144.141] Get:2 https://mirror.hetzner.com/ubuntu/packages jammy/main amd64 ebtables amd64 2.0.11-4build2 [84.9 kB]
[167.235.144.141] Get:3 https://mirror.hetzner.com/ubuntu/packages jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB]
[167.235.144.141] Get:4 https://packages.cloud.google.com/apt kubernetes-xenial/main amd64 cri-tools amd64 1.25.0-00 [17.9 MB]
[5.75.162.44] Get:6 https://packages.cloud.google.com/apt kubernetes-xenial/main amd64 kubelet amd64 1.24.8-00 [19.2 MB]
[167.235.144.141] Get:5 https://packages.cloud.google.com/apt kubernetes-xenial/main amd64 kubernetes-cni amd64 1.1.1-00 [25.0 MB]
[5.75.162.44] Get:7 https://packages.cloud.google.com/apt kubernetes-xenial/main amd64 kubectl amd64 1.24.8-00 [9,333 kB]
[5.75.162.44] Get:8 https://packages.cloud.google.com/apt kubernetes-xenial/main amd64 kubeadm amd64 1.24.8-00 [9,011 kB]
[167.235.144.141] Get:6 https://packages.cloud.google.com/apt kubernetes-xenial/main amd64 kubelet amd64 1.24.8-00 [19.2 MB]
[167.235.144.141] Get:7 https://packages.cloud.google.com/apt kubernetes-xenial/main amd64 kubectl amd64 1.24.8-00 [9,333 kB]
[5.75.162.44] Fetched 80.9 MB in 2s (41.4 MB/s)
[5.75.162.44] Selecting previously unselected package conntrack.
[167.235.144.141] Get:8 https://packages.cloud.google.com/apt kubernetes-xenial/main amd64 kubeadm amd64 1.24.8-00 [9,011 kB]
(Reading database ... 38860 files and directories currently installed.)
[5.75.162.44] Preparing to unpack .../0-conntrack_1%3a1.4.6-2build2_amd64.deb ...
[5.75.162.44] Unpacking conntrack (1:1.4.6-2build2) ...
[5.75.162.44] Selecting previously unselected package cri-tools.
[5.75.162.44] Preparing to unpack .../1-cri-tools_1.25.0-00_amd64.deb ...
[5.75.162.44] Unpacking cri-tools (1.25.0-00) ...
[167.235.144.141] Fetched 80.9 MB in 2s (36.6 MB/s)
[167.235.144.141] Selecting previously unselected package conntrack.
(Reading database ... 38860 files and directories currently installed.)
[167.235.144.141] Preparing to unpack .../0-conntrack_1%3a1.4.6-2build2_amd64.deb ...
[167.235.144.141] Unpacking conntrack (1:1.4.6-2build2) ...
[167.235.144.141] Selecting previously unselected package cri-tools.
[167.235.144.141] Preparing to unpack .../1-cri-tools_1.25.0-00_amd64.deb ...
[167.235.144.141] Unpacking cri-tools (1.25.0-00) ...
[5.75.162.44] Selecting previously unselected package ebtables.
[5.75.162.44] Preparing to unpack .../2-ebtables_2.0.11-4build2_amd64.deb ...
[5.75.162.44] Unpacking ebtables (2.0.11-4build2) ...
[5.75.162.44] Selecting previously unselected package kubernetes-cni.
[5.75.162.44] Preparing to unpack .../3-kubernetes-cni_1.1.1-00_amd64.deb ...
[5.75.162.44] Unpacking kubernetes-cni (1.1.1-00) ...
[167.235.144.141] Selecting previously unselected package ebtables.
[167.235.144.141] Preparing to unpack .../2-ebtables_2.0.11-4build2_amd64.deb ...
[167.235.144.141] Unpacking ebtables (2.0.11-4build2) ...
[167.235.144.141] Selecting previously unselected package kubernetes-cni.
[167.235.144.141] Preparing to unpack .../3-kubernetes-cni_1.1.1-00_amd64.deb ...
[167.235.144.141] Unpacking kubernetes-cni (1.1.1-00) ...
[5.75.162.44] Selecting previously unselected package socat.
[5.75.162.44] Preparing to unpack .../4-socat_1.7.4.1-3ubuntu4_amd64.deb ...
[5.75.162.44] Unpacking socat (1.7.4.1-3ubuntu4) ...
[5.75.162.44] Selecting previously unselected package kubelet.
[5.75.162.44] Preparing to unpack .../5-kubelet_1.24.8-00_amd64.deb ...
[5.75.162.44] Unpacking kubelet (1.24.8-00) ...
[167.235.144.141] Selecting previously unselected package socat.
[167.235.144.141] Preparing to unpack .../4-socat_1.7.4.1-3ubuntu4_amd64.deb ...
[167.235.144.141] Unpacking socat (1.7.4.1-3ubuntu4) ...
[167.235.144.141] Selecting previously unselected package kubelet.
[167.235.144.141] Preparing to unpack .../5-kubelet_1.24.8-00_amd64.deb ...
[167.235.144.141] Unpacking kubelet (1.24.8-00) ...
[5.75.162.44] Selecting previously unselected package kubectl.
[5.75.162.44] Preparing to unpack .../6-kubectl_1.24.8-00_amd64.deb ...
[5.75.162.44] Unpacking kubectl (1.24.8-00) ...
[167.235.144.141] Selecting previously unselected package kubectl.
[167.235.144.141] Preparing to unpack .../6-kubectl_1.24.8-00_amd64.deb ...
[167.235.144.141] Unpacking kubectl (1.24.8-00) ...
[5.75.162.44] Selecting previously unselected package kubeadm.
[5.75.162.44] Preparing to unpack .../7-kubeadm_1.24.8-00_amd64.deb ...
[5.75.162.44] Unpacking kubeadm (1.24.8-00) ...
[167.235.144.141] Selecting previously unselected package kubeadm.
[167.235.144.141] Preparing to unpack .../7-kubeadm_1.24.8-00_amd64.deb ...
[167.235.144.141] Unpacking kubeadm (1.24.8-00) ...
[5.75.162.44] Setting up conntrack (1:1.4.6-2build2) ...
[5.75.162.44] Setting up kubectl (1.24.8-00) ...
[5.75.162.44] Setting up ebtables (2.0.11-4build2) ...
[167.235.144.141] Setting up conntrack (1:1.4.6-2build2) ...
[167.235.144.141] Setting up kubectl (1.24.8-00) ...
[167.235.144.141] Setting up ebtables (2.0.11-4build2) ...
[5.75.162.44] Setting up socat (1.7.4.1-3ubuntu4) ...
[5.75.162.44] Setting up cri-tools (1.25.0-00) ...
[5.75.162.44] Setting up kubernetes-cni (1.1.1-00) ...
[5.75.162.44] Setting up kubelet (1.24.8-00) ...
[5.75.162.44] Created symlink /etc/systemd/system/multi-user.target.wants/kubelet.service → /lib/systemd/system/kubelet.service.
[167.235.144.141] Setting up socat (1.7.4.1-3ubuntu4) ...
[167.235.144.141] Setting up cri-tools (1.25.0-00) ...
[167.235.144.141] Setting up kubernetes-cni (1.1.1-00) ...
[167.235.144.141] Setting up kubelet (1.24.8-00) ...
[167.235.144.141] Created symlink /etc/systemd/system/multi-user.target.wants/kubelet.service → /lib/systemd/system/kubelet.service.
[5.75.162.44] Setting up kubeadm (1.24.8-00) ...
[167.235.144.141] Setting up kubeadm (1.24.8-00) ...
[5.75.162.44] Processing triggers for man-db (2.10.2-1) ...
[5.75.162.44] NEEDRESTART-VER: 3.5
[167.235.144.141] Processing triggers for man-db (2.10.2-1) ...
[5.75.162.44] NEEDRESTART-KCUR: 5.15.0-46-generic
[5.75.162.44] NEEDRESTART-KEXP: 5.15.0-46-generic
[5.75.162.44] NEEDRESTART-KSTA: 1
[167.235.144.141] NEEDRESTART-VER: 3.5
[167.235.144.141] NEEDRESTART-KCUR: 5.15.0-46-generic
[167.235.144.141] NEEDRESTART-KEXP: 5.15.0-46-generic
[167.235.144.141] NEEDRESTART-KSTA: 1
[5.75.162.44] kubelet set on hold.
[5.75.162.44] kubeadm set on hold.
[5.75.162.44] kubectl set on hold.
[5.75.162.44] kubernetes-cni set on hold.
[5.75.162.44] + sudo apt-mark hold kubelet kubeadm kubectl kubernetes-cni
[5.75.162.44] + sudo systemctl daemon-reload
[5.75.162.44] + sudo systemctl enable --now kubelet
[167.235.144.141] + sudo apt-mark hold kubelet kubeadm kubectl kubernetes-cni
[167.235.144.141] + sudo systemctl daemon-reload
[167.235.144.141] kubelet set on hold.
[167.235.144.141] kubeadm set on hold.
[167.235.144.141] kubectl set on hold.
[167.235.144.141] kubernetes-cni set on hold.
[167.235.144.141] + sudo systemctl enable --now kubelet
[5.75.162.44] + sudo systemctl restart kubelet
[167.235.144.141] + sudo systemctl restart kubelet
INFO[20:18:16 CET] Generating kubeadm config file...            
INFO[20:18:20 CET] Uploading config files...                     node=188.34.204.170
INFO[20:18:20 CET] Uploading config files...                     node=5.75.173.127
INFO[20:18:20 CET] Uploading config files...                     node=5.75.162.44
INFO[20:18:20 CET] Uploading config files...                     node=5.75.175.139
INFO[20:18:20 CET] Uploading config files...                     node=167.235.144.141
[167.235.144.141] + export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[167.235.144.141] + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[167.235.144.141] + sudo mkdir -p /etc/systemd/system/kubelet.service.d/ /etc/kubernetes
[5.75.173.127] + export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.173.127] + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.173.127] + sudo mkdir -p /etc/systemd/system/kubelet.service.d/ /etc/kubernetes
[167.235.144.141] + sudo mv ./kubeone/cfg/cloud-config /etc/kubernetes/cloud-config
[5.75.173.127] + sudo mv ./kubeone/cfg/cloud-config /etc/kubernetes/cloud-config
[167.235.144.141] + sudo chown root:root /etc/kubernetes/cloud-config
[5.75.173.127] + sudo chown root:root /etc/kubernetes/cloud-config
[167.235.144.141] + sudo chmod 600 /etc/kubernetes/cloud-config
[5.75.173.127] + sudo chmod 600 /etc/kubernetes/cloud-config
[188.34.204.170] + export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[188.34.204.170] + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[188.34.204.170] + sudo mkdir -p /etc/systemd/system/kubelet.service.d/ /etc/kubernetes
[188.34.204.170] + sudo mv ./kubeone/cfg/cloud-config /etc/kubernetes/cloud-config
[5.75.173.127] + export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.173.127] + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.173.127] + sudo test -f ./kubeone/cfg/audit-policy.yaml
[167.235.144.141] + export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[167.235.144.141] + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[167.235.144.141] + sudo test -f ./kubeone/cfg/audit-policy.yaml
[5.75.162.44] + export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.162.44] + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.162.44] + sudo mkdir -p /etc/systemd/system/kubelet.service.d/ /etc/kubernetes
[188.34.204.170] + sudo chown root:root /etc/kubernetes/cloud-config
[188.34.204.170] + sudo chmod 600 /etc/kubernetes/cloud-config
[5.75.162.44] + sudo mv ./kubeone/cfg/cloud-config /etc/kubernetes/cloud-config
[5.75.162.44] + sudo chown root:root /etc/kubernetes/cloud-config
[5.75.175.139] + export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.175.139] + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.175.139] + sudo mkdir -p /etc/systemd/system/kubelet.service.d/ /etc/kubernetes
[5.75.162.44] + sudo chmod 600 /etc/kubernetes/cloud-config
[5.75.175.139] + sudo mv ./kubeone/cfg/cloud-config /etc/kubernetes/cloud-config
[5.75.175.139] + sudo chown root:root /etc/kubernetes/cloud-config
[5.75.175.139] + sudo chmod 600 /etc/kubernetes/cloud-config
[5.75.173.127] + export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.173.127] + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.173.127] + sudo test -f ./kubeone/cfg/podnodeselector.yaml
[167.235.144.141] + export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[167.235.144.141] + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[188.34.204.170] + export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[188.34.204.170] + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[188.34.204.170] + sudo test -f ./kubeone/cfg/audit-policy.yaml
[167.235.144.141] + sudo test -f ./kubeone/cfg/podnodeselector.yaml
[5.75.162.44] + export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.162.44] + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.162.44] + sudo test -f ./kubeone/cfg/audit-policy.yaml
[5.75.175.139] + export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.175.139] + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.175.139] + sudo test -f ./kubeone/cfg/audit-policy.yaml
[5.75.173.127] + export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.173.127] + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.173.127] + sudo test -f ./kubeone/cfg/encryption-providers.yaml
[188.34.204.170] + export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[167.235.144.141] + export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[167.235.144.141] + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[188.34.204.170] + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[188.34.204.170] + sudo test -f ./kubeone/cfg/podnodeselector.yaml
[167.235.144.141] + sudo test -f ./kubeone/cfg/encryption-providers.yaml
[5.75.175.139] + export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.175.139] + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.175.139] + sudo test -f ./kubeone/cfg/podnodeselector.yaml
[5.75.162.44] + export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.162.44] + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.162.44] + sudo test -f ./kubeone/cfg/podnodeselector.yaml
[188.34.204.170] + export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[188.34.204.170] + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[188.34.204.170] + sudo test -f ./kubeone/cfg/encryption-providers.yaml
[5.75.162.44] + export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.162.44] + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.162.44] + sudo test -f ./kubeone/cfg/encryption-providers.yaml
[5.75.175.139] + export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.175.139] + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.175.139] + sudo test -f ./kubeone/cfg/encryption-providers.yaml
INFO[20:18:26 CET] Pre-pull images                               node=5.75.173.127
INFO[20:18:26 CET] Pre-pull images                               node=167.235.144.141
INFO[20:18:26 CET] Pre-pull images                               node=188.34.204.170
INFO[20:18:26 CET] Pre-pull images                               node=5.75.175.139
INFO[20:18:26 CET] Pre-pull images                               node=5.75.162.44
[5.75.175.139] + export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.175.139] + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.175.139] + sudo kubeadm config images pull --config=./kubeone/cfg/master_2.yaml
[188.34.204.170] + export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[188.34.204.170] + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[188.34.204.170] + sudo kubeadm config images pull --config=./kubeone/cfg/master_0.yaml
[5.75.173.127] + export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.173.127] + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.173.127] + sudo kubeadm config images pull --config=./kubeone/cfg/master_1.yaml
[5.75.162.44] + export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.162.44] + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.162.44] + sudo kubeadm config images pull --config=./kubeone/cfg/master_4.yaml
[167.235.144.141] + export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[167.235.144.141] + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[167.235.144.141] + sudo kubeadm config images pull --config=./kubeone/cfg/master_3.yaml
[5.75.162.44] W1125 19:18:26.230093    4102 initconfiguration.go:332] [config] WARNING: Ignored YAML document with GroupVersionKind kubeadm.k8s.io/v1beta3, Kind=JoinConfiguration
[5.75.162.44] W1125 19:18:26.234329    4102 initconfiguration.go:120] Usage of CRI endpoints without URL scheme is deprecated and can cause kubelet errors in the future. Automatically prepending scheme "unix" to the "criSocket" with value "/run/containerd/containerd.sock". Please update your configuration!
[5.75.162.44] W1125 19:18:26.234465    4102 utils.go:69] The recommended value for "clusterDNS" in "KubeletConfiguration" is: [10.96.0.10]; the provided value is: [169.254.20.10]
[167.235.144.141] W1125 19:18:26.236769    4104 initconfiguration.go:332] [config] WARNING: Ignored YAML document with GroupVersionKind kubeadm.k8s.io/v1beta3, Kind=JoinConfiguration
[167.235.144.141] W1125 19:18:26.244230    4104 initconfiguration.go:120] Usage of CRI endpoints without URL scheme is deprecated and can cause kubelet errors in the future. Automatically prepending scheme "unix" to the "criSocket" with value "/run/containerd/containerd.sock". Please update your configuration!
[167.235.144.141] W1125 19:18:26.244284    4104 utils.go:69] The recommended value for "clusterDNS" in "KubeletConfiguration" is: [10.96.0.10]; the provided value is: [169.254.20.10]
[188.34.204.170] W1125 19:18:26.241331   27427 initconfiguration.go:332] [config] WARNING: Ignored YAML document with GroupVersionKind kubeadm.k8s.io/v1beta3, Kind=JoinConfiguration
[188.34.204.170] W1125 19:18:26.248221   27427 initconfiguration.go:120] Usage of CRI endpoints without URL scheme is deprecated and can cause kubelet errors in the future. Automatically prepending scheme "unix" to the "criSocket" with value "/run/containerd/containerd.sock". Please update your configuration!
[188.34.204.170] W1125 19:18:26.248306   27427 utils.go:69] The recommended value for "clusterDNS" in "KubeletConfiguration" is: [10.96.0.10]; the provided value is: [169.254.20.10]
[5.75.173.127] W1125 19:18:26.253722   11167 initconfiguration.go:332] [config] WARNING: Ignored YAML document with GroupVersionKind kubeadm.k8s.io/v1beta3, Kind=JoinConfiguration
[5.75.175.139] W1125 19:18:26.240799   11505 initconfiguration.go:332] [config] WARNING: Ignored YAML document with GroupVersionKind kubeadm.k8s.io/v1beta3, Kind=JoinConfiguration
[5.75.175.139] W1125 19:18:26.243515   11505 initconfiguration.go:120] Usage of CRI endpoints without URL scheme is deprecated and can cause kubelet errors in the future. Automatically prepending scheme "unix" to the "criSocket" with value "/run/containerd/containerd.sock". Please update your configuration!
[5.75.175.139] W1125 19:18:26.243569   11505 utils.go:69] The recommended value for "clusterDNS" in "KubeletConfiguration" is: [10.96.0.10]; the provided value is: [169.254.20.10]
[5.75.173.127] W1125 19:18:26.260709   11167 initconfiguration.go:120] Usage of CRI endpoints without URL scheme is deprecated and can cause kubelet errors in the future. Automatically prepending scheme "unix" to the "criSocket" with value "/run/containerd/containerd.sock". Please update your configuration!
[5.75.173.127] W1125 19:18:26.260827   11167 utils.go:69] The recommended value for "clusterDNS" in "KubeletConfiguration" is: [10.96.0.10]; the provided value is: [169.254.20.10]
[5.75.173.127] [config/images] Pulled k8s.gcr.io/kube-apiserver:v1.24.8
[5.75.175.139] [config/images] Pulled k8s.gcr.io/kube-apiserver:v1.24.8
[5.75.175.139] [config/images] Pulled k8s.gcr.io/kube-controller-manager:v1.24.8
[188.34.204.170] [config/images] Pulled k8s.gcr.io/kube-apiserver:v1.24.8
[5.75.173.127] [config/images] Pulled k8s.gcr.io/kube-controller-manager:v1.24.8
[188.34.204.170] [config/images] Pulled k8s.gcr.io/kube-controller-manager:v1.24.8
[5.75.173.127] [config/images] Pulled k8s.gcr.io/kube-scheduler:v1.24.8
[5.75.175.139] [config/images] Pulled k8s.gcr.io/kube-scheduler:v1.24.8
[5.75.173.127] [config/images] Pulled k8s.gcr.io/kube-proxy:v1.24.8
[5.75.175.139] [config/images] Pulled k8s.gcr.io/kube-proxy:v1.24.8
[188.34.204.170] [config/images] Pulled k8s.gcr.io/kube-scheduler:v1.24.8
[5.75.173.127] [config/images] Pulled k8s.gcr.io/pause:3.7
[188.34.204.170] [config/images] Pulled k8s.gcr.io/kube-proxy:v1.24.8
[5.75.175.139] [config/images] Pulled k8s.gcr.io/pause:3.7
[5.75.173.127] [config/images] Pulled k8s.gcr.io/etcd:3.5.5-0
[188.34.204.170] [config/images] Pulled k8s.gcr.io/pause:3.7
[5.75.175.139] [config/images] Pulled k8s.gcr.io/etcd:3.5.5-0
[188.34.204.170] [config/images] Pulled k8s.gcr.io/etcd:3.5.5-0
[5.75.173.127] [config/images] Pulled k8s.gcr.io/coredns/coredns:v1.8.6
[5.75.175.139] [config/images] Pulled k8s.gcr.io/coredns/coredns:v1.8.6
[188.34.204.170] [config/images] Pulled k8s.gcr.io/coredns/coredns:v1.8.6
[5.75.162.44] [config/images] Pulled k8s.gcr.io/kube-apiserver:v1.24.8
[167.235.144.141] [config/images] Pulled k8s.gcr.io/kube-apiserver:v1.24.8
[5.75.162.44] [config/images] Pulled k8s.gcr.io/kube-controller-manager:v1.24.8
[167.235.144.141] [config/images] Pulled k8s.gcr.io/kube-controller-manager:v1.24.8
[5.75.162.44] [config/images] Pulled k8s.gcr.io/kube-scheduler:v1.24.8
[167.235.144.141] [config/images] Pulled k8s.gcr.io/kube-scheduler:v1.24.8
[5.75.162.44] [config/images] Pulled k8s.gcr.io/kube-proxy:v1.24.8
[167.235.144.141] [config/images] Pulled k8s.gcr.io/kube-proxy:v1.24.8
[167.235.144.141] [config/images] Pulled k8s.gcr.io/pause:3.7
[5.75.162.44] [config/images] Pulled k8s.gcr.io/pause:3.7
[5.75.162.44] [config/images] Pulled k8s.gcr.io/etcd:3.5.5-0
[167.235.144.141] [config/images] Pulled k8s.gcr.io/etcd:3.5.5-0
[167.235.144.141] [config/images] Pulled k8s.gcr.io/coredns/coredns:v1.8.6
[5.75.162.44] [config/images] Pulled k8s.gcr.io/coredns/coredns:v1.8.6
INFO[20:18:49 CET] Configuring certs and etcd on control plane node... 
INFO[20:18:49 CET] Ensuring Certificates...                      node=188.34.204.170
[188.34.204.170] + export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[188.34.204.170] + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[188.34.204.170] + sudo kubeadm --v=6 init phase certs all --config=./kubeone/cfg/master_0.yaml
[188.34.204.170] I1125 19:18:50.026557   28127 initconfiguration.go:255] loading configuration from "./kubeone/cfg/master_0.yaml"
[188.34.204.170] W1125 19:18:50.029623   28127 initconfiguration.go:332] [config] WARNING: Ignored YAML document with GroupVersionKind kubeadm.k8s.io/v1beta3, Kind=JoinConfiguration
[188.34.204.170] W1125 19:18:50.035317   28127 initconfiguration.go:120] Usage of CRI endpoints without URL scheme is deprecated and can cause kubelet errors in the future. Automatically prepending scheme "unix" to the "criSocket" with value "/run/containerd/containerd.sock". Please update your configuration!
[188.34.204.170] W1125 19:18:50.035367   28127 utils.go:69] The recommended value for "clusterDNS" in "KubeletConfiguration" is: [10.96.0.10]; the provided value is: [169.254.20.10]
[188.34.204.170] I1125 19:18:50.055594   28127 certs.go:522] validating certificate period for CA certificate
[188.34.204.170] I1125 19:18:50.055925   28127 certs.go:522] validating certificate period for front-proxy CA certificate
[188.34.204.170] I1125 19:18:50.056269   28127 certs.go:522] validating certificate period for ca certificate
[188.34.204.170] [certs] Using certificateDir folder "/etc/kubernetes/pki"
[188.34.204.170] I1125 19:18:50.056637   28127 certs.go:522] validating certificate period for apiserver certificate
[188.34.204.170] [certs] Using existing ca certificate authority
[188.34.204.170] [certs] Using existing apiserver certificate and key on disk
[188.34.204.170] [certs] Using existing apiserver-kubelet-client certificate and key on disk
[188.34.204.170] [certs] Using existing front-proxy-ca certificate authority
[188.34.204.170] [certs] Using existing front-proxy-client certificate and key on disk
[188.34.204.170] [certs] Using existing etcd/ca certificate authority
[188.34.204.170] [certs] Using existing etcd/server certificate and key on disk
[188.34.204.170] [certs] Using existing etcd/peer certificate and key on disk
[188.34.204.170] [certs] Using existing etcd/healthcheck-client certificate and key on disk
[188.34.204.170] [certs] Using existing apiserver-etcd-client certificate and key on disk
[188.34.204.170] [certs] Using the existing "sa" key
[188.34.204.170] I1125 19:18:50.056926   28127 certs.go:522] validating certificate period for apiserver-kubelet-client certificate
[188.34.204.170] I1125 19:18:50.057203   28127 certs.go:522] validating certificate period for front-proxy-ca certificate
[188.34.204.170] I1125 19:18:50.057432   28127 certs.go:522] validating certificate period for front-proxy-client certificate
[188.34.204.170] I1125 19:18:50.057687   28127 certs.go:522] validating certificate period for etcd/ca certificate
[188.34.204.170] I1125 19:18:50.057918   28127 certs.go:522] validating certificate period for etcd/server certificate
[188.34.204.170] I1125 19:18:50.058191   28127 certs.go:522] validating certificate period for etcd/peer certificate
[188.34.204.170] I1125 19:18:50.058454   28127 certs.go:522] validating certificate period for etcd/healthcheck-client certificate
[188.34.204.170] I1125 19:18:50.058734   28127 certs.go:522] validating certificate period for apiserver-etcd-client certificate
[188.34.204.170] I1125 19:18:50.058962   28127 certs.go:78] creating new public/private key files for signing service account users
INFO[20:18:50 CET] Downloading PKI...                           
INFO[20:18:51 CET] Creating local backup...                      node=188.34.204.170
INFO[20:18:51 CET] Uploading PKI...                             
INFO[20:18:56 CET] Configuring certs and etcd on consecutive control plane node... 
INFO[20:18:56 CET] Ensuring Certificates...                      node=5.75.162.44
INFO[20:18:56 CET] Ensuring Certificates...                      node=5.75.175.139
INFO[20:18:56 CET] Ensuring Certificates...                      node=5.75.173.127
INFO[20:18:56 CET] Ensuring Certificates...                      node=167.235.144.141
[5.75.173.127] + export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.173.127] + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.173.127] + sudo kubeadm --v=6 init phase certs all --config=./kubeone/cfg/master_1.yaml
[5.75.175.139] + export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.175.139] + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.175.139] + sudo kubeadm --v=6 init phase certs all --config=./kubeone/cfg/master_2.yaml
[167.235.144.141] + export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[167.235.144.141] + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.162.44] + export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.162.44] + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.162.44] + sudo kubeadm --v=6 init phase certs all --config=./kubeone/cfg/master_4.yaml
[167.235.144.141] + sudo kubeadm --v=6 init phase certs all --config=./kubeone/cfg/master_3.yaml
[5.75.175.139] I1125 19:18:56.972449   11820 initconfiguration.go:255] loading configuration from "./kubeone/cfg/master_2.yaml"
[5.75.175.139] W1125 19:18:56.976626   11820 initconfiguration.go:332] [config] WARNING: Ignored YAML document with GroupVersionKind kubeadm.k8s.io/v1beta3, Kind=JoinConfiguration
[5.75.173.127] I1125 19:18:56.983194   11482 initconfiguration.go:255] loading configuration from "./kubeone/cfg/master_1.yaml"
[5.75.173.127] W1125 19:18:56.989889   11482 initconfiguration.go:332] [config] WARNING: Ignored YAML document with GroupVersionKind kubeadm.k8s.io/v1beta3, Kind=JoinConfiguration
[5.75.173.127] W1125 19:18:56.993527   11482 initconfiguration.go:120] Usage of CRI endpoints without URL scheme is deprecated and can cause kubelet errors in the future. Automatically prepending scheme "unix" to the "criSocket" with value "/run/containerd/containerd.sock". Please update your configuration!
[5.75.173.127] W1125 19:18:56.993567   11482 utils.go:69] The recommended value for "clusterDNS" in "KubeletConfiguration" is: [10.96.0.10]; the provided value is: [169.254.20.10]
[5.75.175.139] W1125 19:18:56.980083   11820 initconfiguration.go:120] Usage of CRI endpoints without URL scheme is deprecated and can cause kubelet errors in the future. Automatically prepending scheme "unix" to the "criSocket" with value "/run/containerd/containerd.sock". Please update your configuration!
[5.75.175.139] W1125 19:18:56.980129   11820 utils.go:69] The recommended value for "clusterDNS" in "KubeletConfiguration" is: [10.96.0.10]; the provided value is: [169.254.20.10]
[167.235.144.141] I1125 19:18:56.995019    4236 initconfiguration.go:255] loading configuration from "./kubeone/cfg/master_3.yaml"
[167.235.144.141] W1125 19:18:56.997605    4236 initconfiguration.go:332] [config] WARNING: Ignored YAML document with GroupVersionKind kubeadm.k8s.io/v1beta3, Kind=JoinConfiguration
[5.75.175.139] I1125 19:18:56.992236   11820 certs.go:522] validating certificate period for CA certificate
[5.75.175.139] I1125 19:18:56.992511   11820 certs.go:522] validating certificate period for front-proxy CA certificate
[5.75.175.139] I1125 19:18:56.992696   11820 certs.go:522] validating certificate period for ca certificate
[5.75.175.139] [certs] Using certificateDir folder "/etc/kubernetes/pki"
[5.75.175.139] I1125 19:18:56.993296   11820 certs.go:522] validating certificate period for apiserver certificate
[5.75.175.139] [certs] Using existing ca certificate authority
[5.75.173.127] I1125 19:18:57.000748   11482 certs.go:522] validating certificate period for CA certificate
[5.75.175.139] [certs] Using existing apiserver certificate and key on disk
[5.75.173.127] [certs] Using certificateDir folder "/etc/kubernetes/pki"
[5.75.173.127] I1125 19:18:57.001052   11482 certs.go:522] validating certificate period for front-proxy CA certificate
[5.75.173.127] I1125 19:18:57.001146   11482 certs.go:522] validating certificate period for ca certificate
[5.75.173.127] [certs] Using existing ca certificate authority
[5.75.173.127] [certs] Using existing apiserver certificate and key on disk
[5.75.173.127] I1125 19:18:57.001487   11482 certs.go:522] validating certificate period for apiserver certificate
[167.235.144.141] W1125 19:18:57.003973    4236 initconfiguration.go:120] Usage of CRI endpoints without URL scheme is deprecated and can cause kubelet errors in the future. Automatically prepending scheme "unix" to the "criSocket" with value "/run/containerd/containerd.sock". Please update your configuration!
[5.75.173.127] I1125 19:18:57.001788   11482 certs.go:522] validating certificate period for apiserver-kubelet-client certificate
[167.235.144.141] W1125 19:18:57.004023    4236 utils.go:69] The recommended value for "clusterDNS" in "KubeletConfiguration" is: [10.96.0.10]; the provided value is: [169.254.20.10]
[5.75.162.44] I1125 19:18:57.019247    4233 initconfiguration.go:255] loading configuration from "./kubeone/cfg/master_4.yaml"
[167.235.144.141] I1125 19:18:57.026279    4236 certs.go:522] validating certificate period for CA certificate
[167.235.144.141] I1125 19:18:57.026465    4236 certs.go:522] validating certificate period for front-proxy CA certificate
[167.235.144.141] I1125 19:18:57.026626    4236 certs.go:522] validating certificate period for ca certificate
[167.235.144.141] [certs] Using certificateDir folder "/etc/kubernetes/pki"
[5.75.162.44] W1125 19:18:57.021239    4233 initconfiguration.go:332] [config] WARNING: Ignored YAML document with GroupVersionKind kubeadm.k8s.io/v1beta3, Kind=JoinConfiguration
[167.235.144.141] [certs] Using existing ca certificate authority
[5.75.175.139] I1125 19:18:56.994006   11820 certs.go:522] validating certificate period for apiserver-kubelet-client certificate
[5.75.175.139] I1125 19:18:56.994721   11820 certs.go:522] validating certificate period for front-proxy-ca certificate
[5.75.175.139] I1125 19:18:56.996216   11820 certs.go:522] validating certificate period for front-proxy-client certificate
[5.75.175.139] I1125 19:18:56.996906   11820 certs.go:522] validating certificate period for etcd/ca certificate
[5.75.175.139] I1125 19:18:56.997500   11820 certs.go:522] validating certificate period for etcd/server certificate
[5.75.175.139] I1125 19:18:56.998223   11820 certs.go:522] validating certificate period for etcd/peer certificate
[5.75.175.139] I1125 19:18:56.999827   11820 certs.go:522] validating certificate period for etcd/healthcheck-client certificate
[5.75.175.139] I1125 19:18:57.000385   11820 certs.go:522] validating certificate period for apiserver-etcd-client certificate
[5.75.175.139] I1125 19:18:57.000928   11820 certs.go:78] creating new public/private key files for signing service account users
[5.75.175.139] [certs] Using existing apiserver-kubelet-client certificate and key on disk
[5.75.175.139] [certs] Using existing front-proxy-ca certificate authority
[5.75.175.139] [certs] Using existing front-proxy-client certificate and key on disk
[5.75.175.139] [certs] Using existing etcd/ca certificate authority
[5.75.175.139] [certs] Using existing etcd/server certificate and key on disk
[5.75.175.139] [certs] Using existing etcd/peer certificate and key on disk
[5.75.175.139] [certs] Using existing etcd/healthcheck-client certificate and key on disk
[5.75.175.139] [certs] Using existing apiserver-etcd-client certificate and key on disk
[5.75.175.139] [certs] Using the existing "sa" key
[5.75.162.44] W1125 19:18:57.025889    4233 initconfiguration.go:120] Usage of CRI endpoints without URL scheme is deprecated and can cause kubelet errors in the future. Automatically prepending scheme "unix" to the "criSocket" with value "/run/containerd/containerd.sock". Please update your configuration!
[5.75.162.44] W1125 19:18:57.025946    4233 utils.go:69] The recommended value for "clusterDNS" in "KubeletConfiguration" is: [10.96.0.10]; the provided value is: [169.254.20.10]
[5.75.162.44] I1125 19:18:57.032664    4233 certs.go:522] validating certificate period for CA certificate
[5.75.162.44] I1125 19:18:57.032822    4233 certs.go:522] validating certificate period for front-proxy CA certificate
[5.75.173.127] I1125 19:18:57.002034   11482 certs.go:522] validating certificate period for front-proxy-ca certificate
[5.75.173.127] I1125 19:18:57.002256   11482 certs.go:522] validating certificate period for front-proxy-client certificate
[5.75.173.127] I1125 19:18:57.002520   11482 certs.go:522] validating certificate period for etcd/ca certificate
[5.75.173.127] I1125 19:18:57.002690   11482 certs.go:522] validating certificate period for etcd/server certificate
[5.75.173.127] I1125 19:18:57.002960   11482 certs.go:522] validating certificate period for etcd/peer certificate
[5.75.173.127] I1125 19:18:57.003205   11482 certs.go:522] validating certificate period for etcd/healthcheck-client certificate
[5.75.173.127] I1125 19:18:57.003491   11482 certs.go:522] validating certificate period for apiserver-etcd-client certificate
[5.75.173.127] I1125 19:18:57.003680   11482 certs.go:78] creating new public/private key files for signing service account users
[5.75.173.127] [certs] Using existing apiserver-kubelet-client certificate and key on disk
[5.75.173.127] [certs] Using existing front-proxy-ca certificate authority
[5.75.173.127] [certs] Using existing front-proxy-client certificate and key on disk
[5.75.173.127] [certs] Using existing etcd/ca certificate authority
[5.75.173.127] [certs] Using existing etcd/server certificate and key on disk
[5.75.173.127] [certs] Using existing etcd/peer certificate and key on disk
[5.75.173.127] [certs] Using existing etcd/healthcheck-client certificate and key on disk
[5.75.173.127] [certs] Using existing apiserver-etcd-client certificate and key on disk
[5.75.173.127] [certs] Using the existing "sa" key
[5.75.162.44] I1125 19:18:57.032950    4233 certs.go:522] validating certificate period for ca certificate
[5.75.162.44] [certs] Using certificateDir folder "/etc/kubernetes/pki"
[5.75.162.44] [certs] Using existing ca certificate authority
[5.75.162.44] [certs] Generating "apiserver" certificate and key
[5.75.162.44] [certs] apiserver serving cert is signed for DNS names [kubeone-control-plane-5 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local] and IPs [10.96.0.1 192.168.0.7 167.235.104.208]
[5.75.162.44] I1125 19:18:57.336003    4233 certs.go:522] validating certificate period for front-proxy-ca certificate
[5.75.162.44] [certs] Generating "apiserver-kubelet-client" certificate and key
[5.75.162.44] [certs] Using existing front-proxy-ca certificate authority
[167.235.144.141] [certs] Generating "apiserver" certificate and key
[167.235.144.141] [certs] apiserver serving cert is signed for DNS names [kubeone-control-plane-4 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local] and IPs [10.96.0.1 192.168.0.8 167.235.104.208]
[167.235.144.141] [certs] Generating "apiserver-kubelet-client" certificate and key
[167.235.144.141] I1125 19:18:57.452190    4236 certs.go:522] validating certificate period for front-proxy-ca certificate
[167.235.144.141] [certs] Using existing front-proxy-ca certificate authority
[5.75.162.44] I1125 19:18:57.654805    4233 certs.go:522] validating certificate period for etcd/ca certificate
[5.75.162.44] [certs] Generating "front-proxy-client" certificate and key
[5.75.162.44] [certs] Using existing etcd/ca certificate authority
[5.75.162.44] [certs] Generating "etcd/server" certificate and key
[5.75.162.44] [certs] etcd/server serving cert is signed for DNS names [kubeone-control-plane-5 localhost] and IPs [192.168.0.7 127.0.0.1 ::1]
[167.235.144.141] I1125 19:18:57.918452    4236 certs.go:522] validating certificate period for etcd/ca certificate
[167.235.144.141] [certs] Generating "front-proxy-client" certificate and key
[167.235.144.141] [certs] Using existing etcd/ca certificate authority
[5.75.162.44] [certs] Generating "etcd/peer" certificate and key
[5.75.162.44] [certs] etcd/peer serving cert is signed for DNS names [kubeone-control-plane-5 localhost] and IPs [192.168.0.7 127.0.0.1 ::1]
[5.75.162.44] [certs] Generating "etcd/healthcheck-client" certificate and key
[167.235.144.141] [certs] Generating "etcd/server" certificate and key
[5.75.162.44] [certs] Generating "apiserver-etcd-client" certificate and key
[167.235.144.141] [certs] etcd/server serving cert is signed for DNS names [kubeone-control-plane-4 localhost] and IPs [192.168.0.8 127.0.0.1 ::1]
[5.75.162.44] I1125 19:18:58.258631    4233 certs.go:78] creating new public/private key files for signing service account users
[5.75.162.44] [certs] Using the existing "sa" key
[167.235.144.141] [certs] Generating "etcd/peer" certificate and key
[167.235.144.141] [certs] etcd/peer serving cert is signed for DNS names [kubeone-control-plane-4 localhost] and IPs [192.168.0.8 127.0.0.1 ::1]
[167.235.144.141] [certs] Generating "etcd/healthcheck-client" certificate and key
[167.235.144.141] [certs] Generating "apiserver-etcd-client" certificate and key
[167.235.144.141] [certs] Using the existing "sa" key
[167.235.144.141] I1125 19:18:58.780660    4236 certs.go:78] creating new public/private key files for signing service account users
INFO[20:18:58 CET] Initializing Kubernetes on leader...         
INFO[20:18:58 CET] Running kubeadm...                            node=188.34.204.170
[188.34.204.170] + export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[188.34.204.170] + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[188.34.204.170] + [[ -f /etc/kubernetes/admin.conf ]]
[188.34.204.170] + sudo kubeadm --v=6 token create 6tymn9.z2pnlw6padrawrbi --ttl 1h0m0s
[188.34.204.170] I1125 19:18:59.053129   28275 token.go:122] [token] validating mixed arguments
[188.34.204.170] I1125 19:18:59.053235   28275 token.go:131] [token] getting Clientsets from kubeconfig file
[188.34.204.170] I1125 19:18:59.053273   28275 cmdutil.go:81] Using kubeconfig file: /etc/kubernetes/admin.conf
[188.34.204.170] I1125 19:18:59.054549   28275 loader.go:372] Config loaded from file:  /etc/kubernetes/admin.conf
[188.34.204.170] I1125 19:18:59.055817   28275 token.go:246] [token] loading configurations
[188.34.204.170] I1125 19:18:59.056442   28275 interface.go:432] Looking for default routes with IPv4 addresses
[188.34.204.170] I1125 19:18:59.056472   28275 interface.go:437] Default route transits interface "eth0"
[188.34.204.170] I1125 19:18:59.057188   28275 interface.go:209] Interface eth0 is up
[188.34.204.170] I1125 19:18:59.057376   28275 interface.go:257] Interface "eth0" has 3 addresses :[188.34.204.170/32 2a01:4f8:1c1e:eb4b::1/64 fe80::9400:1ff:feb1:a135/64].
[188.34.204.170] I1125 19:18:59.057427   28275 interface.go:224] Checking addr  188.34.204.170/32.
[188.34.204.170] I1125 19:18:59.057443   28275 interface.go:231] IP found 188.34.204.170
[188.34.204.170] I1125 19:18:59.057456   28275 interface.go:263] Found valid IPv4 address 188.34.204.170 for interface "eth0".
[188.34.204.170] I1125 19:18:59.057468   28275 interface.go:443] Found active IP 188.34.204.170 
[188.34.204.170] I1125 19:18:59.057506   28275 kubelet.go:218] the value of KubeletConfiguration.cgroupDriver is empty; setting it to "systemd"
[188.34.204.170] I1125 19:18:59.066083   28275 token.go:253] [token] creating token
[188.34.204.170] I1125 19:18:59.089887   28275 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/namespaces/kube-system/secrets/bootstrap-token-6tymn9?timeout=10s 404 Not Found in 23 milliseconds
[188.34.204.170] 6tymn9.z2pnlw6padrawrbi
[188.34.204.170] I1125 19:18:59.109749   28275 round_trippers.go:553] POST https://167.235.104.208:6443/api/v1/namespaces/kube-system/secrets?timeout=10s 201 Created in 18 milliseconds
[188.34.204.170] + exit 0
INFO[20:18:59 CET] Building Kubernetes clientset...             
INFO[20:19:00 CET] Waiting 20s for CSRs to approve...            node=188.34.204.170
INFO[20:19:21 CET] Check if cluster needs any repairs...        
INFO[20:19:23 CET] Joining controlplane node...                 
INFO[20:19:23 CET] Waiting 15s to ensure main control plane components are up...  node=5.75.173.127
INFO[20:19:38 CET] Joining control plane node                    node=5.75.173.127
[5.75.173.127] + export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.173.127] + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.173.127] + [[ -f /etc/kubernetes/admin.conf ]]
[5.75.173.127] + exit 0
INFO[20:19:38 CET] Waiting 20s for CSRs to approve...            node=5.75.173.127
INFO[20:19:58 CET] Approve pending CSR "csr-5jz7f" for username "system:node:kubeone-control-plane-2"  node=5.75.173.127
INFO[20:19:58 CET] Approve pending CSR "csr-z8mrl" for username "system:node:kubeone-control-plane-2"  node=5.75.173.127
INFO[20:19:59 CET] Waiting 15s to ensure main control plane components are up...  node=5.75.175.139
INFO[20:20:14 CET] Joining control plane node                    node=5.75.175.139
[5.75.175.139] + export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.175.139] + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.175.139] + [[ -f /etc/kubernetes/admin.conf ]]
[5.75.175.139] + exit 0
INFO[20:20:14 CET] Waiting 20s for CSRs to approve...            node=5.75.175.139
INFO[20:20:34 CET] Approve pending CSR "csr-2zxbg" for username "system:node:kubeone-control-plane-3"  node=5.75.175.139
INFO[20:20:34 CET] Approve pending CSR "csr-w4x5p" for username "system:node:kubeone-control-plane-3"  node=5.75.175.139
INFO[20:20:34 CET] Waiting 15s to ensure main control plane components are up...  node=167.235.144.141
INFO[20:20:49 CET] Joining control plane node                    node=167.235.144.141
[167.235.144.141] + export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[167.235.144.141] + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[167.235.144.141] + [[ -f /etc/kubernetes/admin.conf ]]
[167.235.144.141] + sudo kubeadm --v=6 join --config=./kubeone/cfg/master_3.yaml
[167.235.144.141] I1125 19:20:49.936244    4311 join.go:413] [preflight] found NodeName empty; using OS hostname as NodeName
[167.235.144.141] I1125 19:20:49.936325    4311 joinconfiguration.go:76] loading configuration from "./kubeone/cfg/master_3.yaml"
[167.235.144.141] W1125 19:20:49.938828    4311 initconfiguration.go:120] Usage of CRI endpoints without URL scheme is deprecated and can cause kubelet errors in the future. Automatically prepending scheme "unix" to the "criSocket" with value "/run/containerd/containerd.sock". Please update your configuration!
[167.235.144.141] I1125 19:20:49.938960    4311 preflight.go:92] [preflight] Running general checks
[167.235.144.141] I1125 19:20:49.939008    4311 checks.go:282] validating the existence of file /etc/kubernetes/kubelet.conf
[167.235.144.141] I1125 19:20:49.939043    4311 checks.go:282] validating the existence of file /etc/kubernetes/bootstrap-kubelet.conf
[167.235.144.141] I1125 19:20:49.939065    4311 checks.go:106] validating the container runtime
[167.235.144.141] [preflight] Running pre-flight checks
[167.235.144.141] I1125 19:20:49.992338    4311 checks.go:331] validating the contents of file /proc/sys/net/bridge/bridge-nf-call-iptables
[167.235.144.141] I1125 19:20:49.992488    4311 checks.go:331] validating the contents of file /proc/sys/net/ipv4/ip_forward
[167.235.144.141] I1125 19:20:49.992547    4311 checks.go:646] validating whether swap is enabled or not
[167.235.144.141] I1125 19:20:49.992661    4311 checks.go:372] validating the presence of executable crictl
[167.235.144.141] I1125 19:20:49.992726    4311 checks.go:372] validating the presence of executable conntrack
[167.235.144.141] I1125 19:20:49.992817    4311 checks.go:372] validating the presence of executable ip
[167.235.144.141] I1125 19:20:49.992854    4311 checks.go:372] validating the presence of executable iptables
[167.235.144.141] I1125 19:20:49.992977    4311 checks.go:372] validating the presence of executable mount
[167.235.144.141] I1125 19:20:49.993011    4311 checks.go:372] validating the presence of executable nsenter
[167.235.144.141] I1125 19:20:49.993097    4311 checks.go:372] validating the presence of executable ebtables
[167.235.144.141] I1125 19:20:49.993134    4311 checks.go:372] validating the presence of executable ethtool
[167.235.144.141] I1125 19:20:49.993180    4311 checks.go:372] validating the presence of executable socat
[167.235.144.141] I1125 19:20:49.993254    4311 checks.go:372] validating the presence of executable tc
[167.235.144.141] I1125 19:20:49.993302    4311 checks.go:372] validating the presence of executable touch
[167.235.144.141] I1125 19:20:49.993343    4311 checks.go:518] running all checks
[167.235.144.141] 	[WARNING SystemVerification]: missing optional cgroups: blkio
[167.235.144.141] I1125 19:20:50.020987    4311 checks.go:403] checking whether the given node name is valid and reachable using net.LookupHost
[167.235.144.141] I1125 19:20:50.021181    4311 checks.go:612] validating kubelet version
[167.235.144.141] I1125 19:20:50.105786    4311 checks.go:132] validating if the "kubelet" service is enabled and active
[167.235.144.141] I1125 19:20:50.140964    4311 checks.go:205] validating availability of port 10250
[167.235.144.141] I1125 19:20:50.141431    4311 checks.go:432] validating if the connectivity type is via proxy or direct
[167.235.144.141] I1125 19:20:50.141493    4311 join.go:530] [preflight] Discovering cluster-info
[167.235.144.141] I1125 19:20:50.141542    4311 token.go:80] [discovery] Created cluster-info discovery client, requesting info from "167.235.104.208:6443"
[167.235.144.141] I1125 19:20:50.199124    4311 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s 200 OK in 55 milliseconds
[167.235.144.141] I1125 19:20:50.202388    4311 token.go:105] [discovery] Cluster info signature and contents are valid and no TLS pinning was specified, will use API Server "167.235.104.208:6443"
[167.235.144.141] I1125 19:20:50.202435    4311 discovery.go:52] [discovery] Using provided TLSBootstrapToken as authentication credentials for the join process
[167.235.144.141] [preflight] Reading configuration from the cluster...
[167.235.144.141] [preflight] FYI: You can look at this config file with 'kubectl -n kube-system get cm kubeadm-config -o yaml'
[167.235.144.141] I1125 19:20:50.202457    4311 join.go:544] [preflight] Fetching init configuration
[167.235.144.141] I1125 19:20:50.202468    4311 join.go:590] [preflight] Retrieving KubeConfig objects
[167.235.144.141] I1125 19:20:50.249099    4311 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/namespaces/kube-system/configmaps/kubeadm-config?timeout=10s 200 OK in 45 milliseconds
[167.235.144.141] I1125 19:20:50.255772    4311 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/namespaces/kube-system/configmaps/kube-proxy?timeout=10s 403 Forbidden in 3 milliseconds
[167.235.144.141] I1125 19:20:50.269702    4311 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/namespaces/kube-system/configmaps/kube-proxy?timeout=10s 403 Forbidden in 2 milliseconds
[167.235.144.141] I1125 19:20:50.328217    4311 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/namespaces/kube-system/configmaps/kube-proxy?timeout=10s 403 Forbidden in 3 milliseconds
[167.235.144.141] I1125 19:20:50.594484    4311 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/namespaces/kube-system/configmaps/kube-proxy?timeout=10s 403 Forbidden in 4 milliseconds
[167.235.144.141] W1125 19:20:50.594802    4311 configset.go:78] Warning: No kubeproxy.config.k8s.io/v1alpha1 config is loaded. Continuing without it: configmaps "kube-proxy" is forbidden: User "system:bootstrap:6tymn9" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
[167.235.144.141] I1125 19:20:50.594886    4311 kubelet.go:92] attempting to download the KubeletConfiguration from the new format location (UnversionedKubeletConfigMap=true)
[167.235.144.141] I1125 19:20:50.603748    4311 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/namespaces/kube-system/configmaps/kubelet-config?timeout=10s 200 OK in 8 milliseconds
[167.235.144.141] I1125 19:20:50.606263    4311 interface.go:432] Looking for default routes with IPv4 addresses
[167.235.144.141] I1125 19:20:50.606350    4311 interface.go:437] Default route transits interface "eth0"
[167.235.144.141] I1125 19:20:50.606488    4311 interface.go:209] Interface eth0 is up
[167.235.144.141] I1125 19:20:50.606551    4311 interface.go:257] Interface "eth0" has 3 addresses :[167.235.144.141/32 2a01:4f8:1c1e:be24::1/64 fe80::9400:1ff:feb1:a345/64].
[167.235.144.141] I1125 19:20:50.606571    4311 interface.go:224] Checking addr  167.235.144.141/32.
[167.235.144.141] I1125 19:20:50.606582    4311 interface.go:231] IP found 167.235.144.141
[167.235.144.141] I1125 19:20:50.606591    4311 interface.go:263] Found valid IPv4 address 167.235.144.141 for interface "eth0".
[167.235.144.141] I1125 19:20:50.606600    4311 interface.go:443] Found active IP 167.235.144.141 
[167.235.144.141] W1125 19:20:50.606615    4311 utils.go:69] The recommended value for "clusterDNS" in "KubeletConfiguration" is: [10.96.0.10]; the provided value is: [169.254.20.10]
[167.235.144.141] I1125 19:20:50.616413    4311 preflight.go:103] [preflight] Running configuration dependant checks
[167.235.144.141] I1125 19:20:50.616504    4311 certs.go:522] validating certificate period for CA certificate
[167.235.144.141] [preflight] Running pre-flight checks before initializing the new control plane instance
[167.235.144.141] I1125 19:20:50.617044    4311 certs.go:522] validating certificate period for front-proxy CA certificate
[167.235.144.141] I1125 19:20:50.617271    4311 certs.go:522] validating certificate period for etcd CA certificate
[167.235.144.141] I1125 19:20:50.617438    4311 checks.go:570] validating Kubernetes and kubeadm version
[167.235.144.141] I1125 19:20:50.617465    4311 checks.go:170] validating if the firewall is enabled and active
[167.235.144.141] I1125 19:20:50.631969    4311 checks.go:205] validating availability of port 6443
[167.235.144.141] I1125 19:20:50.632141    4311 checks.go:205] validating availability of port 10259
[167.235.144.141] I1125 19:20:50.632225    4311 checks.go:205] validating availability of port 10257
[167.235.144.141] I1125 19:20:50.632306    4311 checks.go:282] validating the existence of file /etc/kubernetes/manifests/kube-apiserver.yaml
[167.235.144.141] [preflight] Pulling images required for setting up a Kubernetes cluster
[167.235.144.141] [preflight] This might take a minute or two, depending on the speed of your internet connection
[167.235.144.141] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[167.235.144.141] I1125 19:20:50.632374    4311 checks.go:282] validating the existence of file /etc/kubernetes/manifests/kube-controller-manager.yaml
[167.235.144.141] I1125 19:20:50.632410    4311 checks.go:282] validating the existence of file /etc/kubernetes/manifests/kube-scheduler.yaml
[167.235.144.141] I1125 19:20:50.632444    4311 checks.go:282] validating the existence of file /etc/kubernetes/manifests/etcd.yaml
[167.235.144.141] I1125 19:20:50.632478    4311 checks.go:432] validating if the connectivity type is via proxy or direct
[167.235.144.141] I1125 19:20:50.632523    4311 checks.go:471] validating http connectivity to first IP address in the CIDR
[167.235.144.141] I1125 19:20:50.632586    4311 checks.go:471] validating http connectivity to first IP address in the CIDR
[167.235.144.141] I1125 19:20:50.632659    4311 checks.go:205] validating availability of port 2379
[167.235.144.141] I1125 19:20:50.632757    4311 checks.go:205] validating availability of port 2380
[167.235.144.141] I1125 19:20:50.632836    4311 checks.go:245] validating the existence and emptiness of directory /var/lib/etcd
[167.235.144.141] I1125 19:20:50.633103    4311 checks.go:834] using image pull policy: IfNotPresent
[167.235.144.141] I1125 19:20:50.672319    4311 checks.go:843] image exists: k8s.gcr.io/kube-apiserver:v1.24.8
[167.235.144.141] I1125 19:20:50.714883    4311 checks.go:843] image exists: k8s.gcr.io/kube-controller-manager:v1.24.8
[167.235.144.141] I1125 19:20:50.761748    4311 checks.go:843] image exists: k8s.gcr.io/kube-scheduler:v1.24.8
[167.235.144.141] I1125 19:20:50.806420    4311 checks.go:843] image exists: k8s.gcr.io/kube-proxy:v1.24.8
[167.235.144.141] I1125 19:20:50.849630    4311 checks.go:843] image exists: k8s.gcr.io/pause:3.7
[167.235.144.141] I1125 19:20:50.894220    4311 checks.go:843] image exists: k8s.gcr.io/etcd:3.5.5-0
[167.235.144.141] I1125 19:20:50.934913    4311 checks.go:843] image exists: k8s.gcr.io/coredns/coredns:v1.8.6
[167.235.144.141] I1125 19:20:50.934950    4311 controlplaneprepare.go:220] [download-certs] Skipping certs download
[167.235.144.141] I1125 19:20:50.934963    4311 certs.go:47] creating PKI assets
[167.235.144.141] I1125 19:20:50.935074    4311 certs.go:522] validating certificate period for ca certificate
[167.235.144.141] [certs] Using certificateDir folder "/etc/kubernetes/pki"
[167.235.144.141] [certs] Using the existing "apiserver" certificate and key
[167.235.144.141] I1125 19:20:51.270079    4311 certs.go:522] validating certificate period for apiserver certificate
[167.235.144.141] [certs] Using the existing "apiserver-kubelet-client" certificate and key
[167.235.144.141] I1125 19:20:51.338557    4311 certs.go:522] validating certificate period for apiserver-kubelet-client certificate
[167.235.144.141] I1125 19:20:51.338734    4311 certs.go:522] validating certificate period for etcd/ca certificate
[167.235.144.141] [certs] Using the existing "etcd/server" certificate and key
[167.235.144.141] I1125 19:20:51.547207    4311 certs.go:522] validating certificate period for etcd/server certificate
[167.235.144.141] [certs] Using the existing "etcd/peer" certificate and key
[167.235.144.141] I1125 19:20:51.737045    4311 certs.go:522] validating certificate period for etcd/peer certificate
[167.235.144.141] [certs] Using the existing "etcd/healthcheck-client" certificate and key
[167.235.144.141] I1125 19:20:52.114282    4311 certs.go:522] validating certificate period for etcd/healthcheck-client certificate
[167.235.144.141] [certs] Using the existing "apiserver-etcd-client" certificate and key
[167.235.144.141] I1125 19:20:52.292115    4311 certs.go:522] validating certificate period for apiserver-etcd-client certificate
[167.235.144.141] I1125 19:20:52.292277    4311 certs.go:522] validating certificate period for front-proxy-ca certificate
[167.235.144.141] [certs] Using the existing "front-proxy-client" certificate and key
[167.235.144.141] [certs] Valid certificates and keys now exist in "/etc/kubernetes/pki"
[167.235.144.141] I1125 19:20:52.440349    4311 certs.go:522] validating certificate period for front-proxy-client certificate
[167.235.144.141] I1125 19:20:52.440478    4311 certs.go:78] creating new public/private key files for signing service account users
[167.235.144.141] [certs] Using the existing "sa" key
[167.235.144.141] [kubeconfig] Generating kubeconfig files
[167.235.144.141] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[167.235.144.141] [kubeconfig] Writing "admin.conf" kubeconfig file
[167.235.144.141] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
[167.235.144.141] [kubeconfig] Writing "scheduler.conf" kubeconfig file
[167.235.144.141] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
[167.235.144.141] [control-plane] Creating static Pod manifest for "kube-apiserver"
[167.235.144.141] I1125 19:20:53.350506    4311 manifests.go:99] [control-plane] getting StaticPodSpecs
[167.235.144.141] I1125 19:20:53.350828    4311 manifests.go:125] [control-plane] adding volume "ca-certs" for component "kube-apiserver"
[167.235.144.141] I1125 19:20:53.350849    4311 manifests.go:125] [control-plane] adding volume "etc-ca-certificates" for component "kube-apiserver"
[167.235.144.141] I1125 19:20:53.350858    4311 manifests.go:125] [control-plane] adding volume "etc-pki" for component "kube-apiserver"
[167.235.144.141] [control-plane] Creating static Pod manifest for "kube-controller-manager"
[167.235.144.141] I1125 19:20:53.350867    4311 manifests.go:125] [control-plane] adding volume "k8s-certs" for component "kube-apiserver"
[167.235.144.141] I1125 19:20:53.350876    4311 manifests.go:125] [control-plane] adding volume "usr-local-share-ca-certificates" for component "kube-apiserver"
[167.235.144.141] I1125 19:20:53.350885    4311 manifests.go:125] [control-plane] adding volume "usr-share-ca-certificates" for component "kube-apiserver"
[167.235.144.141] I1125 19:20:53.357041    4311 manifests.go:154] [control-plane] wrote static Pod manifest for component "kube-apiserver" to "/etc/kubernetes/manifests/kube-apiserver.yaml"
[167.235.144.141] I1125 19:20:53.357085    4311 manifests.go:99] [control-plane] getting StaticPodSpecs
[167.235.144.141] I1125 19:20:53.357446    4311 manifests.go:125] [control-plane] adding volume "ca-certs" for component "kube-controller-manager"
[167.235.144.141] I1125 19:20:53.357523    4311 manifests.go:125] [control-plane] adding volume "etc-ca-certificates" for component "kube-controller-manager"
[167.235.144.141] I1125 19:20:53.357546    4311 manifests.go:125] [control-plane] adding volume "etc-pki" for component "kube-controller-manager"
[167.235.144.141] I1125 19:20:53.357558    4311 manifests.go:125] [control-plane] adding volume "flexvolume-dir" for component "kube-controller-manager"
[167.235.144.141] I1125 19:20:53.357576    4311 manifests.go:125] [control-plane] adding volume "k8s-certs" for component "kube-controller-manager"
[167.235.144.141] I1125 19:20:53.357586    4311 manifests.go:125] [control-plane] adding volume "kubeconfig" for component "kube-controller-manager"
[167.235.144.141] I1125 19:20:53.357595    4311 manifests.go:125] [control-plane] adding volume "usr-local-share-ca-certificates" for component "kube-controller-manager"
[167.235.144.141] I1125 19:20:53.357605    4311 manifests.go:125] [control-plane] adding volume "usr-share-ca-certificates" for component "kube-controller-manager"
[167.235.144.141] I1125 19:20:53.358970    4311 manifests.go:154] [control-plane] wrote static Pod manifest for component "kube-controller-manager" to "/etc/kubernetes/manifests/kube-controller-manager.yaml"
[167.235.144.141] [control-plane] Creating static Pod manifest for "kube-scheduler"
[167.235.144.141] [check-etcd] Checking that the etcd cluster is healthy
[167.235.144.141] I1125 19:20:53.359011    4311 manifests.go:99] [control-plane] getting StaticPodSpecs
[167.235.144.141] I1125 19:20:53.359292    4311 manifests.go:125] [control-plane] adding volume "kubeconfig" for component "kube-scheduler"
[167.235.144.141] I1125 19:20:53.360014    4311 manifests.go:154] [control-plane] wrote static Pod manifest for component "kube-scheduler" to "/etc/kubernetes/manifests/kube-scheduler.yaml"
[167.235.144.141] I1125 19:20:53.360664    4311 loader.go:372] Config loaded from file:  /etc/kubernetes/admin.conf
[167.235.144.141] I1125 19:20:53.361326    4311 local.go:71] [etcd] Checking etcd cluster health
[167.235.144.141] I1125 19:20:53.361350    4311 local.go:74] creating etcd client that connects to etcd pods
[167.235.144.141] I1125 19:20:53.361358    4311 etcd.go:168] retrieving etcd endpoints from "kubeadm.kubernetes.io/etcd.advertise-client-urls" annotation in etcd Pods
[167.235.144.141] I1125 19:20:53.392060    4311 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/namespaces/kube-system/pods?labelSelector=component%3Detcd%2Ctier%3Dcontrol-plane 200 OK in 30 milliseconds
[167.235.144.141] I1125 19:20:53.403012    4311 etcd.go:104] etcd endpoints read from pods: https://192.168.0.3:2379,https://192.168.0.6:2379,https://192.168.0.5:2379
[167.235.144.141] I1125 19:20:53.427192    4311 etcd.go:224] etcd endpoints read from etcd: https://192.168.0.5:2379,https://192.168.0.3:2379,https://192.168.0.6:2379
[167.235.144.141] I1125 19:20:53.427215    4311 etcd.go:122] update etcd endpoints: https://192.168.0.5:2379,https://192.168.0.3:2379,https://192.168.0.6:2379
[167.235.144.141] I1125 19:20:53.527776    4311 kubelet.go:119] [kubelet-start] writing bootstrap kubelet config file at /etc/kubernetes/bootstrap-kubelet.conf
[167.235.144.141] I1125 19:20:53.528855    4311 loader.go:372] Config loaded from file:  /etc/kubernetes/bootstrap-kubelet.conf
[167.235.144.141] I1125 19:20:53.529414    4311 kubelet.go:155] [kubelet-start] Checking for an existing Node in the cluster with name "kubeone-control-plane-4" and status "Ready"
[167.235.144.141] I1125 19:20:53.549761    4311 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/nodes/kubeone-control-plane-4?timeout=10s 404 Not Found in 20 milliseconds
[167.235.144.141] I1125 19:20:53.550084    4311 kubelet.go:170] [kubelet-start] Stopping the kubelet
[167.235.144.141] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[167.235.144.141] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[167.235.144.141] [kubelet-start] Starting the kubelet
[167.235.144.141] [kubelet-start] Waiting for the kubelet to perform the TLS Bootstrap...
[167.235.144.141] I1125 19:20:59.290815    4311 loader.go:372] Config loaded from file:  /etc/kubernetes/kubelet.conf
[167.235.144.141] I1125 19:20:59.293036    4311 cert_rotation.go:137] Starting client certificate rotation controller
[167.235.144.141] I1125 19:20:59.294326    4311 loader.go:372] Config loaded from file:  /etc/kubernetes/kubelet.conf
[167.235.144.141] I1125 19:20:59.295447    4311 kubelet.go:218] [kubelet-start] preserving the crisocket information for the node
[167.235.144.141] I1125 19:20:59.295501    4311 patchnode.go:31] [patchnode] Uploading the CRI Socket information "unix:///run/containerd/containerd.sock" to the Node API object "kubeone-control-plane-4" as an annotation
[167.235.144.141] I1125 19:20:59.847178    4311 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/nodes/kubeone-control-plane-4?timeout=10s 404 Not Found in 50 milliseconds
[167.235.144.141] I1125 19:21:00.303226    4311 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/nodes/kubeone-control-plane-4?timeout=10s 404 Not Found in 6 milliseconds
[167.235.144.141] I1125 19:21:00.812242    4311 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/nodes/kubeone-control-plane-4?timeout=10s 404 Not Found in 16 milliseconds
[167.235.144.141] I1125 19:21:01.310900    4311 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/nodes/kubeone-control-plane-4?timeout=10s 404 Not Found in 14 milliseconds
[167.235.144.141] I1125 19:21:01.813677    4311 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/nodes/kubeone-control-plane-4?timeout=10s 404 Not Found in 16 milliseconds
[167.235.144.141] I1125 19:21:02.310751    4311 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/nodes/kubeone-control-plane-4?timeout=10s 404 Not Found in 14 milliseconds
[167.235.144.141] I1125 19:21:02.814703    4311 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/nodes/kubeone-control-plane-4?timeout=10s 404 Not Found in 17 milliseconds
[167.235.144.141] I1125 19:21:03.312144    4311 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/nodes/kubeone-control-plane-4?timeout=10s 404 Not Found in 15 milliseconds
[167.235.144.141] I1125 19:21:03.808078    4311 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/nodes/kubeone-control-plane-4?timeout=10s 404 Not Found in 12 milliseconds
[167.235.144.141] I1125 19:21:04.305945    4311 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/nodes/kubeone-control-plane-4?timeout=10s 404 Not Found in 9 milliseconds
[167.235.144.141] I1125 19:21:04.811098    4311 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/nodes/kubeone-control-plane-4?timeout=10s 404 Not Found in 14 milliseconds
[167.235.144.141] I1125 19:21:05.311241    4311 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/nodes/kubeone-control-plane-4?timeout=10s 404 Not Found in 14 milliseconds
[167.235.144.141] I1125 19:21:05.812815    4311 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/nodes/kubeone-control-plane-4?timeout=10s 404 Not Found in 16 milliseconds
[167.235.144.141] I1125 19:21:06.324906    4311 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/nodes/kubeone-control-plane-4?timeout=10s 404 Not Found in 28 milliseconds
[167.235.144.141] I1125 19:21:06.812297    4311 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/nodes/kubeone-control-plane-4?timeout=10s 404 Not Found in 15 milliseconds
[167.235.144.141] I1125 19:21:07.310852    4311 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/nodes/kubeone-control-plane-4?timeout=10s 404 Not Found in 14 milliseconds
[167.235.144.141] I1125 19:21:07.813112    4311 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/nodes/kubeone-control-plane-4?timeout=10s 200 OK in 16 milliseconds
[167.235.144.141] I1125 19:21:07.856643    4311 round_trippers.go:553] PATCH https://167.235.104.208:6443/api/v1/nodes/kubeone-control-plane-4?timeout=10s 200 OK in 37 milliseconds
[167.235.144.141] I1125 19:21:07.858725    4311 local.go:139] creating etcd client that connects to etcd pods
[167.235.144.141] I1125 19:21:07.858763    4311 etcd.go:168] retrieving etcd endpoints from "kubeadm.kubernetes.io/etcd.advertise-client-urls" annotation in etcd Pods
[167.235.144.141] I1125 19:21:07.890101    4311 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/namespaces/kube-system/pods?labelSelector=component%3Detcd%2Ctier%3Dcontrol-plane 200 OK in 30 milliseconds
[167.235.144.141] I1125 19:21:07.896059    4311 etcd.go:104] etcd endpoints read from pods: https://192.168.0.3:2379,https://192.168.0.6:2379,https://192.168.0.5:2379
[167.235.144.141] I1125 19:21:07.930819    4311 etcd.go:224] etcd endpoints read from etcd: https://192.168.0.5:2379,https://192.168.0.3:2379,https://192.168.0.6:2379
[167.235.144.141] I1125 19:21:07.930842    4311 etcd.go:122] update etcd endpoints: https://192.168.0.5:2379,https://192.168.0.3:2379,https://192.168.0.6:2379
[167.235.144.141] I1125 19:21:07.930870    4311 local.go:151] [etcd] Adding etcd member: https://192.168.0.8:2380
[167.235.144.141] [etcd] Announced new etcd member joining to the existing etcd cluster
[167.235.144.141] I1125 19:21:07.960732    4311 local.go:157] Updated etcd member list: [{kubeone-control-plane-3 https://192.168.0.5:2380} {kubeone-control-plane-4 https://192.168.0.8:2380} {kubeone-control-plane-1 https://192.168.0.3:2380} {kubeone-control-plane-2 https://192.168.0.6:2380}]
[167.235.144.141] [etcd] Creating static Pod manifest for "etcd"
[167.235.144.141] I1125 19:21:07.963878    4311 etcd.go:484] [etcd] attempting to see if all cluster endpoints ([https://192.168.0.5:2379 https://192.168.0.3:2379 https://192.168.0.6:2379 https://192.168.0.8:2379]) are available 1/8
[167.235.144.141] [etcd] Waiting for the new etcd member to join the cluster. This can take up to 40s
[167.235.144.141] The 'update-status' phase is deprecated and will be removed in a future release. Currently it performs no operation
[167.235.144.141] [mark-control-plane] Marking the node kubeone-control-plane-4 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
[167.235.144.141] [mark-control-plane] Marking the node kubeone-control-plane-4 as control-plane by adding the taints [node-role.kubernetes.io/master:NoSchedule node-role.kubernetes.io/control-plane:NoSchedule]
[167.235.144.141] I1125 19:21:09.995061    4311 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/nodes/kubeone-control-plane-4?timeout=10s 200 OK in 6 milliseconds
[167.235.144.141] 
[167.235.144.141] This node has joined the cluster and a new control plane instance was created:
[167.235.144.141] 
[167.235.144.141] * Certificate signing request was sent to apiserver and approval was received.
[167.235.144.141] * The Kubelet was informed of the new secure connection details.
[167.235.144.141] * Control plane label and taint were applied to the new node.
[167.235.144.141] * The Kubernetes control plane instances scaled up.
[167.235.144.141] * A new etcd member was added to the local/stacked etcd cluster.
[167.235.144.141] 
[167.235.144.141] To start administering your cluster from this node, you need to run the following as a regular user:
[167.235.144.141] 
[167.235.144.141] 	mkdir -p $HOME/.kube
[167.235.144.141] 	sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
[167.235.144.141] 	sudo chown $(id -u):$(id -g) $HOME/.kube/config
[167.235.144.141] 
[167.235.144.141] Run 'kubectl get nodes' to see this node join the cluster.
[167.235.144.141] 
[167.235.144.141] I1125 19:21:10.012565    4311 round_trippers.go:553] PATCH https://167.235.104.208:6443/api/v1/nodes/kubeone-control-plane-4?timeout=10s 200 OK in 12 milliseconds
INFO[20:21:09 CET] Waiting 20s for CSRs to approve...            node=167.235.144.141
INFO[20:21:30 CET] Approve pending CSR "csr-qnnrc" for username "system:node:kubeone-control-plane-4"  node=167.235.144.141
INFO[20:21:30 CET] Waiting 15s to ensure main control plane components are up...  node=5.75.162.44
INFO[20:21:45 CET] Joining control plane node                    node=5.75.162.44
[5.75.162.44] + export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.162.44] + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.162.44] + [[ -f /etc/kubernetes/admin.conf ]]
[5.75.162.44] + sudo kubeadm --v=6 join --config=./kubeone/cfg/master_4.yaml
[5.75.162.44] I1125 19:21:45.626951    4341 join.go:413] [preflight] found NodeName empty; using OS hostname as NodeName
[5.75.162.44] I1125 19:21:45.627142    4341 joinconfiguration.go:76] loading configuration from "./kubeone/cfg/master_4.yaml"
[5.75.162.44] W1125 19:21:45.631574    4341 initconfiguration.go:120] Usage of CRI endpoints without URL scheme is deprecated and can cause kubelet errors in the future. Automatically prepending scheme "unix" to the "criSocket" with value "/run/containerd/containerd.sock". Please update your configuration!
[5.75.162.44] I1125 19:21:45.631749    4341 preflight.go:92] [preflight] Running general checks
[5.75.162.44] I1125 19:21:45.631812    4341 checks.go:282] validating the existence of file /etc/kubernetes/kubelet.conf
[5.75.162.44] I1125 19:21:45.631867    4341 checks.go:282] validating the existence of file /etc/kubernetes/bootstrap-kubelet.conf
[5.75.162.44] I1125 19:21:45.631898    4341 checks.go:106] validating the container runtime
[5.75.162.44] I1125 19:21:45.682812    4341 checks.go:331] validating the contents of file /proc/sys/net/bridge/bridge-nf-call-iptables
[5.75.162.44] I1125 19:21:45.682998    4341 checks.go:331] validating the contents of file /proc/sys/net/ipv4/ip_forward
[5.75.162.44] I1125 19:21:45.683089    4341 checks.go:646] validating whether swap is enabled or not
[5.75.162.44] I1125 19:21:45.683192    4341 checks.go:372] validating the presence of executable crictl
[5.75.162.44] I1125 19:21:45.683256    4341 checks.go:372] validating the presence of executable conntrack
[5.75.162.44] [preflight] Running pre-flight checks
[5.75.162.44] I1125 19:21:45.683335    4341 checks.go:372] validating the presence of executable ip
[5.75.162.44] I1125 19:21:45.683380    4341 checks.go:372] validating the presence of executable iptables
[5.75.162.44] I1125 19:21:45.683532    4341 checks.go:372] validating the presence of executable mount
[5.75.162.44] I1125 19:21:45.683598    4341 checks.go:372] validating the presence of executable nsenter
[5.75.162.44] I1125 19:21:45.683710    4341 checks.go:372] validating the presence of executable ebtables
[5.75.162.44] I1125 19:21:45.683765    4341 checks.go:372] validating the presence of executable ethtool
[5.75.162.44] I1125 19:21:45.683825    4341 checks.go:372] validating the presence of executable socat
[5.75.162.44] I1125 19:21:45.683896    4341 checks.go:372] validating the presence of executable tc
[5.75.162.44] I1125 19:21:45.683988    4341 checks.go:372] validating the presence of executable touch
[5.75.162.44] I1125 19:21:45.684044    4341 checks.go:518] running all checks
[5.75.162.44] 	[WARNING SystemVerification]: missing optional cgroups: blkio
[5.75.162.44] I1125 19:21:45.709320    4341 checks.go:403] checking whether the given node name is valid and reachable using net.LookupHost
[5.75.162.44] I1125 19:21:45.709585    4341 checks.go:612] validating kubelet version
[5.75.162.44] I1125 19:21:45.801889    4341 checks.go:132] validating if the "kubelet" service is enabled and active
[5.75.162.44] [preflight] Reading configuration from the cluster...
[5.75.162.44] [preflight] FYI: You can look at this config file with 'kubectl -n kube-system get cm kubeadm-config -o yaml'
[5.75.162.44] I1125 19:21:45.822787    4341 checks.go:205] validating availability of port 10250
[5.75.162.44] I1125 19:21:45.823205    4341 checks.go:432] validating if the connectivity type is via proxy or direct
[5.75.162.44] I1125 19:21:45.823256    4341 join.go:530] [preflight] Discovering cluster-info
[5.75.162.44] I1125 19:21:45.823285    4341 token.go:80] [discovery] Created cluster-info discovery client, requesting info from "167.235.104.208:6443"
[5.75.162.44] I1125 19:21:45.869772    4341 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/namespaces/kube-public/configmaps/cluster-info?timeout=10s 200 OK in 45 milliseconds
[5.75.162.44] I1125 19:21:45.871810    4341 token.go:105] [discovery] Cluster info signature and contents are valid and no TLS pinning was specified, will use API Server "167.235.104.208:6443"
[5.75.162.44] I1125 19:21:45.871836    4341 discovery.go:52] [discovery] Using provided TLSBootstrapToken as authentication credentials for the join process
[5.75.162.44] I1125 19:21:45.871851    4341 join.go:544] [preflight] Fetching init configuration
[5.75.162.44] I1125 19:21:45.871859    4341 join.go:590] [preflight] Retrieving KubeConfig objects
[5.75.162.44] I1125 19:21:45.914228    4341 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/namespaces/kube-system/configmaps/kubeadm-config?timeout=10s 200 OK in 41 milliseconds
[5.75.162.44] I1125 19:21:45.920630    4341 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/namespaces/kube-system/configmaps/kube-proxy?timeout=10s 403 Forbidden in 2 milliseconds
[5.75.162.44] I1125 19:21:45.936504    4341 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/namespaces/kube-system/configmaps/kube-proxy?timeout=10s 403 Forbidden in 3 milliseconds
[5.75.162.44] I1125 19:21:45.994709    4341 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/namespaces/kube-system/configmaps/kube-proxy?timeout=10s 403 Forbidden in 3 milliseconds
[5.75.162.44] I1125 19:21:46.263355    4341 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/namespaces/kube-system/configmaps/kube-proxy?timeout=10s 403 Forbidden in 6 milliseconds
[5.75.162.44] W1125 19:21:46.263633    4341 configset.go:78] Warning: No kubeproxy.config.k8s.io/v1alpha1 config is loaded. Continuing without it: configmaps "kube-proxy" is forbidden: User "system:bootstrap:6tymn9" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
[5.75.162.44] I1125 19:21:46.263736    4341 kubelet.go:92] attempting to download the KubeletConfiguration from the new format location (UnversionedKubeletConfigMap=true)
[5.75.162.44] I1125 19:21:46.270599    4341 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/namespaces/kube-system/configmaps/kubelet-config?timeout=10s 200 OK in 6 milliseconds
[5.75.162.44] I1125 19:21:46.280057    4341 interface.go:432] Looking for default routes with IPv4 addresses
[5.75.162.44] I1125 19:21:46.280112    4341 interface.go:437] Default route transits interface "eth0"
[5.75.162.44] I1125 19:21:46.280335    4341 interface.go:209] Interface eth0 is up
[5.75.162.44] [preflight] Running pre-flight checks before initializing the new control plane instance
[5.75.162.44] I1125 19:21:46.280482    4341 interface.go:257] Interface "eth0" has 3 addresses :[5.75.162.44/32 2a01:4f8:1c1c:bfe2::1/64 fe80::9400:1ff:feb1:a31e/64].
[5.75.162.44] I1125 19:21:46.280519    4341 interface.go:224] Checking addr  5.75.162.44/32.
[5.75.162.44] I1125 19:21:46.280548    4341 interface.go:231] IP found 5.75.162.44
[5.75.162.44] I1125 19:21:46.280572    4341 interface.go:263] Found valid IPv4 address 5.75.162.44 for interface "eth0".
[5.75.162.44] I1125 19:21:46.280610    4341 interface.go:443] Found active IP 5.75.162.44 
[5.75.162.44] W1125 19:21:46.280687    4341 utils.go:69] The recommended value for "clusterDNS" in "KubeletConfiguration" is: [10.96.0.10]; the provided value is: [169.254.20.10]
[5.75.162.44] I1125 19:21:46.293058    4341 preflight.go:103] [preflight] Running configuration dependant checks
[5.75.162.44] I1125 19:21:46.293181    4341 certs.go:522] validating certificate period for CA certificate
[5.75.162.44] I1125 19:21:46.293883    4341 certs.go:522] validating certificate period for front-proxy CA certificate
[5.75.162.44] I1125 19:21:46.294120    4341 certs.go:522] validating certificate period for etcd CA certificate
[5.75.162.44] I1125 19:21:46.294318    4341 checks.go:570] validating Kubernetes and kubeadm version
[5.75.162.44] I1125 19:21:46.294350    4341 checks.go:170] validating if the firewall is enabled and active
[5.75.162.44] I1125 19:21:46.317020    4341 checks.go:205] validating availability of port 6443
[5.75.162.44] I1125 19:21:46.317195    4341 checks.go:205] validating availability of port 10259
[5.75.162.44] I1125 19:21:46.317270    4341 checks.go:205] validating availability of port 10257
[5.75.162.44] I1125 19:21:46.317348    4341 checks.go:282] validating the existence of file /etc/kubernetes/manifests/kube-apiserver.yaml
[5.75.162.44] I1125 19:21:46.317391    4341 checks.go:282] validating the existence of file /etc/kubernetes/manifests/kube-controller-manager.yaml
[5.75.162.44] I1125 19:21:46.317418    4341 checks.go:282] validating the existence of file /etc/kubernetes/manifests/kube-scheduler.yaml
[5.75.162.44] I1125 19:21:46.317444    4341 checks.go:282] validating the existence of file /etc/kubernetes/manifests/etcd.yaml
[5.75.162.44] I1125 19:21:46.317467    4341 checks.go:432] validating if the connectivity type is via proxy or direct
[5.75.162.44] I1125 19:21:46.317522    4341 checks.go:471] validating http connectivity to first IP address in the CIDR
[5.75.162.44] I1125 19:21:46.317555    4341 checks.go:471] validating http connectivity to first IP address in the CIDR
[5.75.162.44] I1125 19:21:46.317575    4341 checks.go:205] validating availability of port 2379
[5.75.162.44] I1125 19:21:46.317673    4341 checks.go:205] validating availability of port 2380
[5.75.162.44] I1125 19:21:46.317746    4341 checks.go:245] validating the existence and emptiness of directory /var/lib/etcd
[5.75.162.44] I1125 19:21:46.317948    4341 checks.go:834] using image pull policy: IfNotPresent
[5.75.162.44] [preflight] Pulling images required for setting up a Kubernetes cluster
[5.75.162.44] [preflight] This might take a minute or two, depending on the speed of your internet connection
[5.75.162.44] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[5.75.162.44] I1125 19:21:46.365542    4341 checks.go:843] image exists: k8s.gcr.io/kube-apiserver:v1.24.8
[5.75.162.44] I1125 19:21:46.409371    4341 checks.go:843] image exists: k8s.gcr.io/kube-controller-manager:v1.24.8
[5.75.162.44] I1125 19:21:46.447823    4341 checks.go:843] image exists: k8s.gcr.io/kube-scheduler:v1.24.8
[5.75.162.44] I1125 19:21:46.480303    4341 checks.go:843] image exists: k8s.gcr.io/kube-proxy:v1.24.8
[5.75.162.44] I1125 19:21:46.512970    4341 checks.go:843] image exists: k8s.gcr.io/pause:3.7
[5.75.162.44] I1125 19:21:46.550730    4341 checks.go:843] image exists: k8s.gcr.io/etcd:3.5.5-0
[5.75.162.44] [certs] Using certificateDir folder "/etc/kubernetes/pki"
[5.75.162.44] I1125 19:21:46.602808    4341 checks.go:843] image exists: k8s.gcr.io/coredns/coredns:v1.8.6
[5.75.162.44] I1125 19:21:46.603053    4341 controlplaneprepare.go:220] [download-certs] Skipping certs download
[5.75.162.44] I1125 19:21:46.603101    4341 certs.go:47] creating PKI assets
[5.75.162.44] I1125 19:21:46.603277    4341 certs.go:522] validating certificate period for etcd/ca certificate
[5.75.162.44] [certs] Using the existing "etcd/healthcheck-client" certificate and key
[5.75.162.44] I1125 19:21:46.796127    4341 certs.go:522] validating certificate period for etcd/healthcheck-client certificate
[5.75.162.44] I1125 19:21:47.409434    4341 certs.go:522] validating certificate period for apiserver-etcd-client certificate
[5.75.162.44] [certs] Using the existing "apiserver-etcd-client" certificate and key
[5.75.162.44] [certs] Using the existing "etcd/peer" certificate and key
[5.75.162.44] I1125 19:21:47.513099    4341 certs.go:522] validating certificate period for etcd/peer certificate
[5.75.162.44] [certs] Using the existing "etcd/server" certificate and key
[5.75.162.44] I1125 19:21:47.600923    4341 certs.go:522] validating certificate period for etcd/server certificate
[5.75.162.44] I1125 19:21:47.601089    4341 certs.go:522] validating certificate period for ca certificate
[5.75.162.44] [certs] Using the existing "apiserver-kubelet-client" certificate and key
[5.75.162.44] I1125 19:21:47.710874    4341 certs.go:522] validating certificate period for apiserver-kubelet-client certificate
[5.75.162.44] [certs] Using the existing "apiserver" certificate and key
[5.75.162.44] I1125 19:21:48.055568    4341 certs.go:522] validating certificate period for apiserver certificate
[5.75.162.44] I1125 19:21:48.055736    4341 certs.go:522] validating certificate period for front-proxy-ca certificate
[5.75.162.44] [certs] Using the existing "front-proxy-client" certificate and key
[5.75.162.44] [certs] Valid certificates and keys now exist in "/etc/kubernetes/pki"
[5.75.162.44] [certs] Using the existing "sa" key
[5.75.162.44] [kubeconfig] Generating kubeconfig files
[5.75.162.44] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[5.75.162.44] I1125 19:21:48.530599    4341 certs.go:522] validating certificate period for front-proxy-client certificate
[5.75.162.44] I1125 19:21:48.530725    4341 certs.go:78] creating new public/private key files for signing service account users
[5.75.162.44] [kubeconfig] Writing "admin.conf" kubeconfig file
[5.75.162.44] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
[5.75.162.44] [kubeconfig] Writing "scheduler.conf" kubeconfig file
[5.75.162.44] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
[5.75.162.44] [control-plane] Creating static Pod manifest for "kube-apiserver"
[5.75.162.44] I1125 19:21:49.637181    4341 manifests.go:99] [control-plane] getting StaticPodSpecs
[5.75.162.44] I1125 19:21:49.637488    4341 manifests.go:125] [control-plane] adding volume "ca-certs" for component "kube-apiserver"
[5.75.162.44] I1125 19:21:49.637509    4341 manifests.go:125] [control-plane] adding volume "etc-ca-certificates" for component "kube-apiserver"
[5.75.162.44] I1125 19:21:49.637518    4341 manifests.go:125] [control-plane] adding volume "etc-pki" for component "kube-apiserver"
[5.75.162.44] [control-plane] Creating static Pod manifest for "kube-controller-manager"
[5.75.162.44] [control-plane] Creating static Pod manifest for "kube-scheduler"
[5.75.162.44] [check-etcd] Checking that the etcd cluster is healthy
[5.75.162.44] I1125 19:21:49.637527    4341 manifests.go:125] [control-plane] adding volume "k8s-certs" for component "kube-apiserver"
[5.75.162.44] I1125 19:21:49.637535    4341 manifests.go:125] [control-plane] adding volume "usr-local-share-ca-certificates" for component "kube-apiserver"
[5.75.162.44] I1125 19:21:49.637545    4341 manifests.go:125] [control-plane] adding volume "usr-share-ca-certificates" for component "kube-apiserver"
[5.75.162.44] I1125 19:21:49.642027    4341 manifests.go:154] [control-plane] wrote static Pod manifest for component "kube-apiserver" to "/etc/kubernetes/manifests/kube-apiserver.yaml"
[5.75.162.44] I1125 19:21:49.642055    4341 manifests.go:99] [control-plane] getting StaticPodSpecs
[5.75.162.44] I1125 19:21:49.642481    4341 manifests.go:125] [control-plane] adding volume "ca-certs" for component "kube-controller-manager"
[5.75.162.44] I1125 19:21:49.642501    4341 manifests.go:125] [control-plane] adding volume "etc-ca-certificates" for component "kube-controller-manager"
[5.75.162.44] I1125 19:21:49.642511    4341 manifests.go:125] [control-plane] adding volume "etc-pki" for component "kube-controller-manager"
[5.75.162.44] I1125 19:21:49.642520    4341 manifests.go:125] [control-plane] adding volume "flexvolume-dir" for component "kube-controller-manager"
[5.75.162.44] I1125 19:21:49.642534    4341 manifests.go:125] [control-plane] adding volume "k8s-certs" for component "kube-controller-manager"
[5.75.162.44] I1125 19:21:49.642543    4341 manifests.go:125] [control-plane] adding volume "kubeconfig" for component "kube-controller-manager"
[5.75.162.44] I1125 19:21:49.642553    4341 manifests.go:125] [control-plane] adding volume "usr-local-share-ca-certificates" for component "kube-controller-manager"
[5.75.162.44] I1125 19:21:49.642562    4341 manifests.go:125] [control-plane] adding volume "usr-share-ca-certificates" for component "kube-controller-manager"
[5.75.162.44] I1125 19:21:49.645413    4341 manifests.go:154] [control-plane] wrote static Pod manifest for component "kube-controller-manager" to "/etc/kubernetes/manifests/kube-controller-manager.yaml"
[5.75.162.44] I1125 19:21:49.645438    4341 manifests.go:99] [control-plane] getting StaticPodSpecs
[5.75.162.44] I1125 19:21:49.645655    4341 manifests.go:125] [control-plane] adding volume "kubeconfig" for component "kube-scheduler"
[5.75.162.44] I1125 19:21:49.646186    4341 manifests.go:154] [control-plane] wrote static Pod manifest for component "kube-scheduler" to "/etc/kubernetes/manifests/kube-scheduler.yaml"
[5.75.162.44] I1125 19:21:49.646919    4341 loader.go:372] Config loaded from file:  /etc/kubernetes/admin.conf
[5.75.162.44] I1125 19:21:49.647354    4341 local.go:71] [etcd] Checking etcd cluster health
[5.75.162.44] I1125 19:21:49.647371    4341 local.go:74] creating etcd client that connects to etcd pods
[5.75.162.44] I1125 19:21:49.647378    4341 etcd.go:168] retrieving etcd endpoints from "kubeadm.kubernetes.io/etcd.advertise-client-urls" annotation in etcd Pods
[5.75.162.44] I1125 19:21:49.683672    4341 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/namespaces/kube-system/pods?labelSelector=component%3Detcd%2Ctier%3Dcontrol-plane 200 OK in 36 milliseconds
[5.75.162.44] I1125 19:21:49.696194    4341 etcd.go:104] etcd endpoints read from pods: https://192.168.0.3:2379,https://192.168.0.6:2379,https://192.168.0.5:2379,https://192.168.0.8:2379
[5.75.162.44] I1125 19:21:49.724202    4341 etcd.go:224] etcd endpoints read from etcd: https://192.168.0.5:2379,https://192.168.0.8:2379,https://192.168.0.3:2379,https://192.168.0.6:2379
[5.75.162.44] I1125 19:21:49.724226    4341 etcd.go:122] update etcd endpoints: https://192.168.0.5:2379,https://192.168.0.8:2379,https://192.168.0.3:2379,https://192.168.0.6:2379
[5.75.162.44] I1125 19:21:49.835414    4341 kubelet.go:119] [kubelet-start] writing bootstrap kubelet config file at /etc/kubernetes/bootstrap-kubelet.conf
[5.75.162.44] I1125 19:21:49.837081    4341 loader.go:372] Config loaded from file:  /etc/kubernetes/bootstrap-kubelet.conf
[5.75.162.44] I1125 19:21:49.837594    4341 kubelet.go:155] [kubelet-start] Checking for an existing Node in the cluster with name "kubeone-control-plane-5" and status "Ready"
[5.75.162.44] I1125 19:21:49.858787    4341 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/nodes/kubeone-control-plane-5?timeout=10s 404 Not Found in 20 milliseconds
[5.75.162.44] I1125 19:21:49.859096    4341 kubelet.go:170] [kubelet-start] Stopping the kubelet
[5.75.162.44] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[5.75.162.44] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[5.75.162.44] [kubelet-start] Starting the kubelet
[5.75.162.44] [kubelet-start] Waiting for the kubelet to perform the TLS Bootstrap...
[5.75.162.44] I1125 19:21:55.615803    4341 loader.go:372] Config loaded from file:  /etc/kubernetes/kubelet.conf
[5.75.162.44] I1125 19:21:55.617765    4341 cert_rotation.go:137] Starting client certificate rotation controller
[5.75.162.44] I1125 19:21:55.619068    4341 loader.go:372] Config loaded from file:  /etc/kubernetes/kubelet.conf
[5.75.162.44] I1125 19:21:55.620109    4341 kubelet.go:218] [kubelet-start] preserving the crisocket information for the node
[5.75.162.44] I1125 19:21:55.620152    4341 patchnode.go:31] [patchnode] Uploading the CRI Socket information "unix:///run/containerd/containerd.sock" to the Node API object "kubeone-control-plane-5" as an annotation
[5.75.162.44] I1125 19:21:56.139727    4341 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/nodes/kubeone-control-plane-5?timeout=10s 404 Not Found in 18 milliseconds
[5.75.162.44] I1125 19:21:56.628910    4341 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/nodes/kubeone-control-plane-5?timeout=10s 404 Not Found in 8 milliseconds
[5.75.162.44] I1125 19:21:57.127974    4341 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/nodes/kubeone-control-plane-5?timeout=10s 404 Not Found in 7 milliseconds
[5.75.162.44] I1125 19:21:57.632601    4341 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/nodes/kubeone-control-plane-5?timeout=10s 404 Not Found in 11 milliseconds
[5.75.162.44] I1125 19:21:58.129453    4341 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/nodes/kubeone-control-plane-5?timeout=10s 404 Not Found in 7 milliseconds
[5.75.162.44] I1125 19:21:58.629983    4341 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/nodes/kubeone-control-plane-5?timeout=10s 404 Not Found in 8 milliseconds
[5.75.162.44] I1125 19:21:59.127220    4341 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/nodes/kubeone-control-plane-5?timeout=10s 404 Not Found in 6 milliseconds
[5.75.162.44] I1125 19:21:59.631511    4341 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/nodes/kubeone-control-plane-5?timeout=10s 404 Not Found in 10 milliseconds
[5.75.162.44] I1125 19:22:00.135769    4341 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/nodes/kubeone-control-plane-5?timeout=10s 404 Not Found in 14 milliseconds
[5.75.162.44] I1125 19:22:00.630533    4341 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/nodes/kubeone-control-plane-5?timeout=10s 404 Not Found in 9 milliseconds
[5.75.162.44] I1125 19:22:01.137519    4341 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/nodes/kubeone-control-plane-5?timeout=10s 404 Not Found in 15 milliseconds
[5.75.162.44] I1125 19:22:01.630164    4341 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/nodes/kubeone-control-plane-5?timeout=10s 404 Not Found in 8 milliseconds
[5.75.162.44] I1125 19:22:02.133906    4341 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/nodes/kubeone-control-plane-5?timeout=10s 404 Not Found in 13 milliseconds
[5.75.162.44] I1125 19:22:02.629835    4341 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/nodes/kubeone-control-plane-5?timeout=10s 404 Not Found in 8 milliseconds
[5.75.162.44] I1125 19:22:03.128800    4341 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/nodes/kubeone-control-plane-5?timeout=10s 404 Not Found in 8 milliseconds
[5.75.162.44] I1125 19:22:03.629149    4341 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/nodes/kubeone-control-plane-5?timeout=10s 404 Not Found in 8 milliseconds
[5.75.162.44] I1125 19:22:04.140317    4341 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/nodes/kubeone-control-plane-5?timeout=10s 200 OK in 19 milliseconds
[5.75.162.44] I1125 19:22:04.164611    4341 round_trippers.go:553] PATCH https://167.235.104.208:6443/api/v1/nodes/kubeone-control-plane-5?timeout=10s 200 OK in 20 milliseconds
[5.75.162.44] I1125 19:22:04.175952    4341 local.go:139] creating etcd client that connects to etcd pods
[5.75.162.44] I1125 19:22:04.175975    4341 etcd.go:168] retrieving etcd endpoints from "kubeadm.kubernetes.io/etcd.advertise-client-urls" annotation in etcd Pods
[5.75.162.44] I1125 19:22:04.223104    4341 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/namespaces/kube-system/pods?labelSelector=component%3Detcd%2Ctier%3Dcontrol-plane 200 OK in 46 milliseconds
[5.75.162.44] I1125 19:22:04.233071    4341 etcd.go:104] etcd endpoints read from pods: https://192.168.0.3:2379,https://192.168.0.6:2379,https://192.168.0.5:2379,https://192.168.0.8:2379
[5.75.162.44] I1125 19:22:04.259640    4341 etcd.go:224] etcd endpoints read from etcd: https://192.168.0.5:2379,https://192.168.0.8:2379,https://192.168.0.3:2379,https://192.168.0.6:2379
[5.75.162.44] I1125 19:22:04.259662    4341 etcd.go:122] update etcd endpoints: https://192.168.0.5:2379,https://192.168.0.8:2379,https://192.168.0.3:2379,https://192.168.0.6:2379
[5.75.162.44] I1125 19:22:04.259672    4341 local.go:151] [etcd] Adding etcd member: https://192.168.0.7:2380
[5.75.162.44] I1125 19:22:04.278229    4341 local.go:157] Updated etcd member list: [{kubeone-control-plane-3 https://192.168.0.5:2380} {kubeone-control-plane-4 https://192.168.0.8:2380} {kubeone-control-plane-1 https://192.168.0.3:2380} {kubeone-control-plane-2 https://192.168.0.6:2380} {kubeone-control-plane-5 https://192.168.0.7:2380}]
[5.75.162.44] [etcd] Announced new etcd member joining to the existing etcd cluster
[5.75.162.44] [etcd] Creating static Pod manifest for "etcd"
[5.75.162.44] [etcd] Waiting for the new etcd member to join the cluster. This can take up to 40s
[5.75.162.44] I1125 19:22:04.283247    4341 etcd.go:484] [etcd] attempting to see if all cluster endpoints ([https://192.168.0.5:2379 https://192.168.0.8:2379 https://192.168.0.3:2379 https://192.168.0.6:2379 https://192.168.0.7:2379]) are available 1/8
[5.75.162.44] I1125 19:22:06.467012    4341 etcd.go:464] Failed to get etcd status for https://192.168.0.7:2379: failed to dial endpoint https://192.168.0.7:2379 with maintenance client: context deadline exceeded
[5.75.162.44] I1125 19:22:08.590893    4341 etcd.go:464] Failed to get etcd status for https://192.168.0.7:2379: failed to dial endpoint https://192.168.0.7:2379 with maintenance client: context deadline exceeded
[5.75.162.44] I1125 19:22:10.778325    4341 etcd.go:464] Failed to get etcd status for https://192.168.0.7:2379: failed to dial endpoint https://192.168.0.7:2379 with maintenance client: context deadline exceeded
[5.75.162.44] I1125 19:22:13.027443    4341 etcd.go:464] Failed to get etcd status for https://192.168.0.7:2379: failed to dial endpoint https://192.168.0.7:2379 with maintenance client: context deadline exceeded
[5.75.162.44] The 'update-status' phase is deprecated and will be removed in a future release. Currently it performs no operation
[5.75.162.44] [mark-control-plane] Marking the node kubeone-control-plane-5 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
[5.75.162.44] [mark-control-plane] Marking the node kubeone-control-plane-5 as control-plane by adding the taints [node-role.kubernetes.io/master:NoSchedule node-role.kubernetes.io/control-plane:NoSchedule]
[5.75.162.44] I1125 19:22:14.163764    4341 round_trippers.go:553] GET https://167.235.104.208:6443/api/v1/nodes/kubeone-control-plane-5?timeout=10s 200 OK in 8 milliseconds
[5.75.162.44] I1125 19:22:14.179862    4341 round_trippers.go:553] PATCH https://167.235.104.208:6443/api/v1/nodes/kubeone-control-plane-5?timeout=10s 200 OK in 13 milliseconds
[5.75.162.44] 
[5.75.162.44] This node has joined the cluster and a new control plane instance was created:
[5.75.162.44] 
[5.75.162.44] * Certificate signing request was sent to apiserver and approval was received.
[5.75.162.44] * The Kubelet was informed of the new secure connection details.
[5.75.162.44] * Control plane label and taint were applied to the new node.
[5.75.162.44] * The Kubernetes control plane instances scaled up.
[5.75.162.44] * A new etcd member was added to the local/stacked etcd cluster.
[5.75.162.44] 
[5.75.162.44] To start administering your cluster from this node, you need to run the following as a regular user:
[5.75.162.44] 
[5.75.162.44] 	mkdir -p $HOME/.kube
[5.75.162.44] 	sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
[5.75.162.44] 	sudo chown $(id -u):$(id -g) $HOME/.kube/config
[5.75.162.44] 
[5.75.162.44] Run 'kubectl get nodes' to see this node join the cluster.
[5.75.162.44] 
INFO[20:22:14 CET] Waiting 20s for CSRs to approve...            node=5.75.162.44
INFO[20:22:34 CET] Approve pending CSR "csr-rm8cj" for username "system:node:kubeone-control-plane-5"  node=5.75.162.44
INFO[20:22:34 CET] Restarting unhealthy API servers if needed... 
[188.34.204.170] + export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[188.34.204.170] + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[188.34.204.170] + set +e
[188.34.204.170] ++ sudo crictl ps --name=kube-apiserver -q
[188.34.204.170] + apiserver_id=4c7d707b8466367e4bffc607197741f29e1f3756f7a4d3ae318335030bd98790
[188.34.204.170] + '[' -z 4c7d707b8466367e4bffc607197741f29e1f3756f7a4d3ae318335030bd98790 ']'
[188.34.204.170] + sudo crictl logs 4c7d707b8466367e4bffc607197741f29e1f3756f7a4d3ae318335030bd98790
[188.34.204.170] + sudo grep -q 'etcdserver: no leader\|failed to open log file' /tmp/kube-apiserver.log
[5.75.173.127] + export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.173.127] + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.173.127] + set +e
[5.75.173.127] ++ sudo crictl ps --name=kube-apiserver -q
[5.75.173.127] + apiserver_id=7ff314b8ae8e6eb6bd31ab47a3c36e728662ced7ffa13437cf2d204c8b6b8bf9
[5.75.173.127] + '[' -z 7ff314b8ae8e6eb6bd31ab47a3c36e728662ced7ffa13437cf2d204c8b6b8bf9 ']'
[5.75.173.127] + sudo crictl logs 7ff314b8ae8e6eb6bd31ab47a3c36e728662ced7ffa13437cf2d204c8b6b8bf9
[5.75.173.127] + sudo grep -q 'etcdserver: no leader\|failed to open log file' /tmp/kube-apiserver.log
[5.75.175.139] + export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.175.139] + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.175.139] + set +e
[5.75.175.139] ++ sudo crictl ps --name=kube-apiserver -q
[5.75.175.139] + apiserver_id=9d77d4546949cc0285a55478f512a1fd9d5c49377d07e6ac0a4457efe378175b
[5.75.175.139] + '[' -z 9d77d4546949cc0285a55478f512a1fd9d5c49377d07e6ac0a4457efe378175b ']'
[5.75.175.139] + sudo crictl logs 9d77d4546949cc0285a55478f512a1fd9d5c49377d07e6ac0a4457efe378175b
[5.75.175.139] + sudo grep -q 'etcdserver: no leader\|failed to open log file' /tmp/kube-apiserver.log
[167.235.144.141] + export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[167.235.144.141] + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[167.235.144.141] + set +e
[167.235.144.141] ++ sudo crictl ps --name=kube-apiserver -q
[167.235.144.141] + apiserver_id=b2fd5f16b79d63dfcfe3c6664e45d4a46c98e9ba5f925ec6ef165c2b759a28f4
[167.235.144.141] + '[' -z b2fd5f16b79d63dfcfe3c6664e45d4a46c98e9ba5f925ec6ef165c2b759a28f4 ']'
[167.235.144.141] + sudo crictl logs b2fd5f16b79d63dfcfe3c6664e45d4a46c98e9ba5f925ec6ef165c2b759a28f4
[167.235.144.141] + sudo grep -q 'etcdserver: no leader\|failed to open log file' /tmp/kube-apiserver.log
[5.75.162.44] + export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.162.44] + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/usr/local/bin:/opt/bin
[5.75.162.44] + set +e
[5.75.162.44] ++ sudo crictl ps --name=kube-apiserver -q
[5.75.162.44] + apiserver_id=5fa3dcf1d39b05527338f999f2774b3e09a40dd814c38b390b892e6d69d636ba
[5.75.162.44] + '[' -z 5fa3dcf1d39b05527338f999f2774b3e09a40dd814c38b390b892e6d69d636ba ']'
[5.75.162.44] + sudo crictl logs 5fa3dcf1d39b05527338f999f2774b3e09a40dd814c38b390b892e6d69d636ba
[5.75.162.44] + sudo grep -q 'etcdserver: no leader\|failed to open log file' /tmp/kube-apiserver.log
INFO[20:22:36 CET] Patching static pods...                      
INFO[20:22:36 CET] Patching static pods...                      
INFO[20:22:36 CET] Patching static pods...                      
INFO[20:22:36 CET] Patching static pods...                      
INFO[20:22:36 CET] Patching static pods...                      
INFO[20:22:38 CET] Downloading kubeconfig...                    
INFO[20:22:38 CET] Downloading PKI...                           
INFO[20:22:39 CET] Creating local backup...                      node=188.34.204.170
INFO[20:22:39 CET] Activating additional features...            
INFO[20:22:39 CET] Patching coreDNS...                          
INFO[20:22:40 CET] Creating machine-controller credentials secret... 
INFO[20:22:41 CET] Creating CCM credentials secret...           
INFO[20:22:41 CET] Applying addon coredns-pdb...                
INFO[20:22:41 CET] Parsing addons manifest 'poddisruptionbudget.yaml' 
+ sudo KUBECONFIG=/etc/kubernetes/admin.conf \
kubectl apply -f - --prune -l "kubeone.io/addon=coredns-pdb"

poddisruptionbudget.policy/coredns configured
INFO[20:22:45 CET] Applying addon metrics-server...             
INFO[20:22:45 CET] Parsing addons manifest 'metrics-server.yaml' 
INFO[20:22:45 CET] Parsing addons manifest 'poddisruptionbudget.yaml' 
+ sudo KUBECONFIG=/etc/kubernetes/admin.conf \
kubectl apply -f - --prune -l "kubeone.io/addon=metrics-server"

clusterrole.rbac.authorization.k8s.io/system:aggregated-metrics-reader unchanged
serviceaccount/metrics-server unchanged
rolebinding.rbac.authorization.k8s.io/metrics-server-auth-reader unchanged
clusterrolebinding.rbac.authorization.k8s.io/metrics-server:system:auth-delegator unchanged
clusterrole.rbac.authorization.k8s.io/system:metrics-server unchanged
clusterrolebinding.rbac.authorization.k8s.io/system:metrics-server unchanged
apiservice.apiregistration.k8s.io/v1beta1.metrics.k8s.io unchanged
secret/metrics-server-serving-cert configured
deployment.apps/metrics-server configured
service/metrics-server unchanged
poddisruptionbudget.policy/metrics-server configured
INFO[20:22:48 CET] Applying addon cni-cilium...                 
INFO[20:22:48 CET] Skipping file "README.md" because it's not .yaml/.yml/.json file 
INFO[20:22:48 CET] Parsing addons manifest 'cilium.yaml'        
INFO[20:22:48 CET] Parsing addons manifest 'poddisruptionbudgets.yaml' 
+ sudo KUBECONFIG=/etc/kubernetes/admin.conf \
kubectl apply -f - --prune -l "kubeone.io/addon=cni-cilium"

serviceaccount/cilium unchanged
serviceaccount/cilium-operator unchanged
serviceaccount/hubble-relay unchanged
serviceaccount/hubble-ui unchanged
serviceaccount/hubble-generate-certs unchanged
configmap/cilium-config unchanged
configmap/hubble-relay-config unchanged
configmap/hubble-ui-nginx unchanged
clusterrole.rbac.authorization.k8s.io/cilium unchanged
clusterrole.rbac.authorization.k8s.io/cilium-operator unchanged
clusterrole.rbac.authorization.k8s.io/hubble-ui unchanged
clusterrole.rbac.authorization.k8s.io/hubble-generate-certs unchanged
clusterrolebinding.rbac.authorization.k8s.io/cilium unchanged
clusterrolebinding.rbac.authorization.k8s.io/cilium-operator unchanged
clusterrolebinding.rbac.authorization.k8s.io/hubble-ui unchanged
clusterrolebinding.rbac.authorization.k8s.io/hubble-generate-certs unchanged
service/hubble-relay unchanged
service/hubble-ui unchanged
service/hubble-peer unchanged
daemonset.apps/cilium unchanged
deployment.apps/cilium-operator configured
deployment.apps/hubble-relay configured
deployment.apps/hubble-ui configured
job.batch/hubble-generate-certs-394f790584 unchanged
cronjob.batch/hubble-generate-certs unchanged
poddisruptionbudget.policy/cilium-operator configured
poddisruptionbudget.policy/hubble-relay configured
poddisruptionbudget.policy/hubble-ui configured
INFO[20:22:51 CET] Applying addon nodelocaldns...               
INFO[20:22:51 CET] Parsing addons manifest 'nodelocaldns.yaml'  
+ sudo KUBECONFIG=/etc/kubernetes/admin.conf \
kubectl apply -f - --prune -l "kubeone.io/addon=nodelocaldns"

serviceaccount/node-local-dns unchanged
service/kube-dns-upstream unchanged
configmap/node-local-dns unchanged
daemonset.apps/node-local-dns configured
service/node-local-dns unchanged
INFO[20:22:53 CET] Applying addon machinecontroller...          
INFO[20:22:53 CET] Skipping file "README.md" because it's not .yaml/.yml/.json file 
INFO[20:22:53 CET] Parsing addons manifest 'crd-machine-deployment.yaml' 
INFO[20:22:53 CET] Parsing addons manifest 'crd-machine-set.yaml' 
INFO[20:22:53 CET] Parsing addons manifest 'crd-machine.yaml'   
INFO[20:22:53 CET] Parsing addons manifest 'deployment-controller.yaml' 
INFO[20:22:53 CET] Parsing addons manifest 'poddisruptionbudgets.yaml' 
INFO[20:22:53 CET] Parsing addons manifest 'rbac-controller.yaml' 
INFO[20:22:53 CET] Parsing addons manifest 'rbac-webhook.yaml'  
INFO[20:22:53 CET] Parsing addons manifest 'webhook.yaml'       
+ sudo KUBECONFIG=/etc/kubernetes/admin.conf \
kubectl apply -f - --prune -l "kubeone.io/addon=machinecontroller"

customresourcedefinition.apiextensions.k8s.io/machinedeployments.cluster.k8s.io unchanged
customresourcedefinition.apiextensions.k8s.io/machinesets.cluster.k8s.io unchanged
customresourcedefinition.apiextensions.k8s.io/machines.cluster.k8s.io unchanged
deployment.apps/machine-controller configured
poddisruptionbudget.policy/machine-controller configured
poddisruptionbudget.policy/machine-controller-webhook configured
serviceaccount/machine-controller unchanged
role.rbac.authorization.k8s.io/machine-controller unchanged
role.rbac.authorization.k8s.io/machine-controller unchanged
role.rbac.authorization.k8s.io/machine-controller unchanged
rolebinding.rbac.authorization.k8s.io/machine-controller unchanged
rolebinding.rbac.authorization.k8s.io/machine-controller unchanged
rolebinding.rbac.authorization.k8s.io/machine-controller unchanged
clusterrole.rbac.authorization.k8s.io/machine-controller unchanged
clusterrolebinding.rbac.authorization.k8s.io/machine-controller:kubelet-bootstrap unchanged
clusterrolebinding.rbac.authorization.k8s.io/machine-controller:node-signer unchanged
clusterrolebinding.rbac.authorization.k8s.io/machine-controller unchanged
serviceaccount/machine-controller-webhook unchanged
role.rbac.authorization.k8s.io/machine-controller-webhook unchanged
rolebinding.rbac.authorization.k8s.io/machine-controller-webhook unchanged
secret/machinecontroller-webhook-serving-cert configured
service/machine-controller-webhook unchanged
deployment.apps/machine-controller-webhook configured
mutatingwebhookconfiguration.admissionregistration.k8s.io/machinedeployments.machine-controller.kubermatic.io configured
INFO[20:23:02 CET] Applying addon operating-system-manager...   
INFO[20:23:02 CET] Skipping file "README.md" because it's not .yaml/.yml/.json file 
INFO[20:23:02 CET] Parsing addons manifest 'cloud-init-settings.yaml' 
INFO[20:23:02 CET] Parsing addons manifest 'crd-operating-system-config.yaml' 
INFO[20:23:02 CET] Parsing addons manifest 'crd-operating-system-profile.yaml' 
INFO[20:23:02 CET] Parsing addons manifest 'deployment-controller.yaml' 
INFO[20:23:02 CET] Parsing addons manifest 'poddisruptionbudgets.yaml' 
INFO[20:23:02 CET] Parsing addons manifest 'rbac-controller.yaml' 
INFO[20:23:02 CET] Parsing addons manifest 'rbac-webhook.yaml'  
INFO[20:23:02 CET] Parsing addons manifest 'webhook.yaml'       
+ sudo KUBECONFIG=/etc/kubernetes/admin.conf \
kubectl apply -f - --prune -l "kubeone.io/addon=operating-system-manager"

namespace/cloud-init-settings unchanged
serviceaccount/cloud-init-getter unchanged
secret/cloud-init-getter-token unchanged
role.rbac.authorization.k8s.io/cloud-init-getter unchanged
rolebinding.rbac.authorization.k8s.io/cloud-init-getter unchanged
customresourcedefinition.apiextensions.k8s.io/operatingsystemconfigs.operatingsystemmanager.k8c.io unchanged
customresourcedefinition.apiextensions.k8s.io/operatingsystemprofiles.operatingsystemmanager.k8c.io unchanged
deployment.apps/operating-system-manager configured
poddisruptionbudget.policy/operating-system-manager configured
poddisruptionbudget.policy/operating-system-manager-webhook configured
serviceaccount/operating-system-manager unchanged
role.rbac.authorization.k8s.io/operating-system-manager unchanged
role.rbac.authorization.k8s.io/operating-system-manager unchanged
role.rbac.authorization.k8s.io/operating-system-manager unchanged
role.rbac.authorization.k8s.io/operating-system-manager unchanged
rolebinding.rbac.authorization.k8s.io/operating-system-manager unchanged
rolebinding.rbac.authorization.k8s.io/operating-system-manager unchanged
rolebinding.rbac.authorization.k8s.io/operating-system-manager unchanged
rolebinding.rbac.authorization.k8s.io/operating-system-manager unchanged
clusterrole.rbac.authorization.k8s.io/system:operating-system-manager unchanged
clusterrolebinding.rbac.authorization.k8s.io/system:operating-system-manager unchanged
serviceaccount/operating-system-manager-webhook unchanged
clusterrole.rbac.authorization.k8s.io/operating-system-manager-webhook unchanged
clusterrolebinding.rbac.authorization.k8s.io/operating-system-manager-webhook unchanged
secret/operating-system-manager-webhook-serving-cert configured
service/operating-system-manager-webhook unchanged
deployment.apps/operating-system-manager-webhook unchanged
validatingwebhookconfiguration.admissionregistration.k8s.io/operatingsystemmanager.k8c.io configured
INFO[20:23:13 CET] Applying addon csi-hetzner...                
INFO[20:23:13 CET] Parsing addons manifest 'hcloud-csi.yml'     
+ sudo KUBECONFIG=/etc/kubernetes/admin.conf \
kubectl apply -f - --prune -l "kubeone.io/addon=csi-hetzner"

csidriver.storage.k8s.io/csi.hetzner.cloud unchanged
serviceaccount/hcloud-csi unchanged
clusterrole.rbac.authorization.k8s.io/hcloud-csi unchanged
clusterrolebinding.rbac.authorization.k8s.io/hcloud-csi unchanged
statefulset.apps/hcloud-csi-controller unchanged
daemonset.apps/hcloud-csi-node unchanged
service/hcloud-csi-controller-metrics unchanged
service/hcloud-csi-node-metrics unchanged
INFO[20:23:16 CET] Applying addon ccm-hetzner...                
INFO[20:23:16 CET] Parsing addons manifest 'ccm-hetzner.yaml'   
INFO[20:23:16 CET] Parsing addons manifest 'poddisruptionbudget.yaml' 
+ sudo KUBECONFIG=/etc/kubernetes/admin.conf \
kubectl apply -f - --prune -l "kubeone.io/addon=ccm-hetzner"

serviceaccount/cloud-controller-manager unchanged
clusterrolebinding.rbac.authorization.k8s.io/system:cloud-controller-manager unchanged
deployment.apps/hcloud-cloud-controller-manager unchanged
poddisruptionbudget.policy/hcloud-cloud-controller-manager configured
INFO[20:23:19 CET] Applying user provided addons...             
INFO[20:23:20 CET] Applying addon backups-restic...             
INFO[20:23:20 CET] Skipping file "README.md" because it's not .yaml/.yml/.json file 
INFO[20:23:20 CET] Parsing addons manifest 'backups-restic.yaml' 
+ sudo KUBECONFIG=/etc/kubernetes/admin.conf \
kubectl apply -f - --prune -l "kubeone.io/addon=backups-restic"

Warning: batch/v1beta1 CronJob is deprecated in v1.21+, unavailable in v1.25+; use batch/v1 CronJob
secret/kubeone-backups-credentials unchanged
secret/restic-config unchanged
cronjob.batch/etcd-s3-backup unchanged
INFO[20:23:22 CET] Applying addon cluster-autoscaler...         
INFO[20:23:22 CET] Skipping file "README.md" because it's not .yaml/.yml/.json file 
INFO[20:23:22 CET] Parsing addons manifest 'cluster-autoscaler.yaml' 
INFO[20:23:22 CET] Parsing addons manifest 'poddisruptionbudget.yaml' 
+ sudo KUBECONFIG=/etc/kubernetes/admin.conf \
kubectl apply -f - --prune -l "kubeone.io/addon=cluster-autoscaler"

serviceaccount/cluster-autoscaler unchanged
clusterrole.rbac.authorization.k8s.io/cluster-autoscaler unchanged
role.rbac.authorization.k8s.io/cluster-autoscaler unchanged
clusterrole.rbac.authorization.k8s.io/cluster-autoscaler-management unchanged
clusterrolebinding.rbac.authorization.k8s.io/cluster-autoscaler unchanged
rolebinding.rbac.authorization.k8s.io/cluster-autoscaler unchanged
clusterrolebinding.rbac.authorization.k8s.io/cluster-autoscaler-management unchanged
deployment.apps/cluster-autoscaler unchanged
poddisruptionbudget.policy/cluster-autoscaler configured
INFO[20:23:24 CET] Applying addon default-storage-class...      
INFO[20:23:24 CET] Parsing addons manifest 'storage-class.yaml' 
+ sudo KUBECONFIG=/etc/kubernetes/admin.conf \
kubectl apply -f - --prune -l "kubeone.io/addon=default-storage-class"

storageclass.storage.k8s.io/hcloud-volumes unchanged
INFO[20:23:25 CET] Applying addon unattended-upgrades...        
INFO[20:23:25 CET] Skipping file "README.md" because it's not .yaml/.yml/.json file 
INFO[20:23:25 CET] Parsing addons manifest 'apt.yaml'           
INFO[20:23:25 CET] Parsing addons manifest 'fluo.yaml'          
INFO[20:23:25 CET] Parsing addons manifest 'kured.yaml'         
INFO[20:23:25 CET] Parsing addons manifest 'poddisruptionbudget.yaml' 
INFO[20:23:25 CET] Parsing addons manifest 'yum.yaml'           
+ sudo KUBECONFIG=/etc/kubernetes/admin.conf \
kubectl apply -f - --prune -l "kubeone.io/addon=unattended-upgrades"

Warning: policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+
daemonset.apps/unattended-upgrades-install unchanged
namespace/reboot-coordinator unchanged
clusterrole.rbac.authorization.k8s.io/flatcar-linux-update-operator unchanged
clusterrole.rbac.authorization.k8s.io/flatcar-linux-update-agent unchanged
clusterrolebinding.rbac.authorization.k8s.io/flatcar-linux-update-operator unchanged
clusterrolebinding.rbac.authorization.k8s.io/flatcar-linux-update-agent unchanged
podsecuritypolicy.policy/flatcar-linux-update-operator configured
podsecuritypolicy.policy/flatcar-linux-update-agent configured
daemonset.apps/flatcar-linux-update-agent configured
serviceaccount/flatcar-linux-update-operator-sa unchanged
deployment.apps/flatcar-linux-update-operator unchanged
serviceaccount/flatcar-linux-update-agent unchanged
daemonset.apps/flatcar-updates-config unchanged
clusterrole.rbac.authorization.k8s.io/kured unchanged
clusterrolebinding.rbac.authorization.k8s.io/kured unchanged
role.rbac.authorization.k8s.io/kured unchanged
rolebinding.rbac.authorization.k8s.io/kured unchanged
serviceaccount/kured unchanged
daemonset.apps/kured unchanged
poddisruptionbudget.policy/flatcar-linux-update-operator configured
daemonset.apps/yum-cron-install unchanged
INFO[20:23:30 CET] Waiting for nodes to initialize by CCM...    
INFO[20:23:37 CET] Waiting for machine-controller to come up... 
WARN[20:26:37 CET] Task failed, error was: kubernetes: waiting for machine-controller webhook to became ready
timed out waiting for the condition 
WARN[20:26:48 CET] Retrying task...                             
INFO[20:26:48 CET] Waiting for machine-controller to come up...

kubectl get pods -A
NAMESPACE            NAME                                                READY   STATUS             RESTARTS         AGE
kube-system          cilium-5lctc                                        1/1     Running            0                48m
kube-system          cilium-dw2x9                                        1/1     Running            0                18m
kube-system          cilium-g9kwh                                        1/1     Running            0                35m
kube-system          cilium-operator-7788864c45-cw7k9                    1/1     Running            0                48m
kube-system          cilium-pl9kz                                        1/1     Running            0                18m
kube-system          cilium-q5rtm                                        1/1     Running            0                41m
kube-system          cilium-qpqct                                        1/1     Running            0                34m
kube-system          cluster-autoscaler-c9b79c6dd-ppxcx                  0/1     CrashLoopBackOff   16 (2m23s ago)   48m
kube-system          coredns-d6b9ffdd5-6zfff                             0/1     Running            7 (4m22s ago)    17m
kube-system          coredns-d6b9ffdd5-gvggt                             1/1     Running            0                17m
kube-system          coredns-d6b9ffdd5-pg4q7                             1/1     Running            0                17m
kube-system          etcd-kubeone-control-plane-1                        1/1     Running            0                49m
kube-system          etcd-kubeone-control-plane-2                        1/1     Running            0                35m
kube-system          etcd-kubeone-control-plane-3                        1/1     Running            0                34m
kube-system          etcd-kubeone-control-plane-4                        1/1     Running            0                18m
kube-system          etcd-kubeone-control-plane-5                        1/1     Running            0                17m
kube-system          hcloud-cloud-controller-manager-df78f4ccb-9lb94     1/1     Running            2 (46m ago)      48m
kube-system          hcloud-csi-controller-0                             3/5     CrashLoopBackOff   41 (2m32s ago)   48m
kube-system          hcloud-csi-node-2f67t                               2/3     CrashLoopBackOff   13 (2m44s ago)   34m
kube-system          hcloud-csi-node-k6sgq                               3/3     Running            0                18m
kube-system          hcloud-csi-node-k6xbm                               2/3     CrashLoopBackOff   23 (2m42s ago)   48m
kube-system          hcloud-csi-node-rc6gh                               3/3     Running            0                18m
kube-system          hcloud-csi-node-rwwjr                               3/3     Running            0                41m
kube-system          hcloud-csi-node-t5wzr                               2/3     CrashLoopBackOff   13 (2m33s ago)   35m
kube-system          hubble-relay-f778d765-jq6gj                         1/1     Running            0                48m
kube-system          hubble-ui-5fccbbf484-lqb5f                          2/2     Running            0                48m
kube-system          kube-apiserver-kubeone-control-plane-1              1/1     Running            1                49m
kube-system          kube-apiserver-kubeone-control-plane-2              1/1     Running            0                35m
kube-system          kube-apiserver-kubeone-control-plane-3              1/1     Running            0                34m
kube-system          kube-apiserver-kubeone-control-plane-4              1/1     Running            0                18m
kube-system          kube-apiserver-kubeone-control-plane-5              1/1     Running            0                17m
kube-system          kube-controller-manager-kubeone-control-plane-1     1/1     Running            0                48m
kube-system          kube-controller-manager-kubeone-control-plane-2     1/1     Running            0                33m
kube-system          kube-controller-manager-kubeone-control-plane-3     1/1     Running            0                33m
kube-system          kube-controller-manager-kubeone-control-plane-4     1/1     Running            0                17m
kube-system          kube-controller-manager-kubeone-control-plane-5     1/1     Running            0                17m
kube-system          kube-scheduler-kubeone-control-plane-1              1/1     Running            0                49m
kube-system          kube-scheduler-kubeone-control-plane-2              1/1     Running            0                35m
kube-system          kube-scheduler-kubeone-control-plane-3              1/1     Running            0                34m
kube-system          kube-scheduler-kubeone-control-plane-4              1/1     Running            0                18m
kube-system          kube-scheduler-kubeone-control-plane-5              1/1     Running            0                17m
kube-system          kured-6r9cc                                         1/1     Running            0                16m
kube-system          kured-6s5fn                                         1/1     Running            0                41m
kube-system          kured-gjtbf                                         0/1     CrashLoopBackOff   9 (2m12s ago)    32m
kube-system          kured-k9xl5                                         0/1     CrashLoopBackOff   9 (2m7s ago)     32m
kube-system          kured-lmvsg                                         0/1     CrashLoopBackOff   16 (2m30s ago)   46m
kube-system          kured-rc9l7                                         1/1     Running            0                16m
kube-system          machine-controller-58fbb9bcc9-tk7zw                 0/1     CrashLoopBackOff   19 (2m6s ago)    48m
kube-system          machine-controller-webhook-96877d7bc-7zv8r          0/1     CrashLoopBackOff   19 (3m31s ago)   48m
kube-system          metrics-server-6c8f44fb59-n7wrc                     0/1     CrashLoopBackOff   19 (2m21s ago)   48m
kube-system          node-local-dns-97lbd                                1/1     Running            0                35m
kube-system          node-local-dns-9l42n                                1/1     Running            0                18m
kube-system          node-local-dns-ctdnb                                1/1     Running            0                34m
kube-system          node-local-dns-dswcq                                1/1     Running            0                41m
kube-system          node-local-dns-r6m8k                                1/1     Running            0                18m
kube-system          node-local-dns-tnwjn                                1/1     Running            0                48m
kube-system          operating-system-manager-5bd9bb4fd9-gzz25           0/1     CrashLoopBackOff   19 (3m55s ago)   48m
kube-system          operating-system-manager-webhook-77f6c5cd96-2k2hb   0/1     CrashLoopBackOff   17 (2m17s ago)   48m
kube-system          unattended-upgrades-install-2hhsp                   1/1     Running            0                16m
kube-system          unattended-upgrades-install-4jmrt                   1/1     Running            10 (5m15s ago)   32m
kube-system          unattended-upgrades-install-9pldh                   1/1     Running            0                16m
kube-system          unattended-upgrades-install-mq9gb                   1/1     Running            0                41m
kube-system          unattended-upgrades-install-wz86z                   1/1     Running            17 (5m16s ago)   46m
kube-system          unattended-upgrades-install-z8fkr                   0/1     Error              10 (5m19s ago)   32m
reboot-coordinator   flatcar-linux-update-operator-755886c688-nxc8p      0/1     Pending            0                48m

kubectl logs -n kube-system -p operating-system-manager-webhook-77f6c5cd96-2k2hb
F1125 19:37:47.359737       1 main.go:90] failed to create the manager{error 26 0  Get "https://10.96.0.1:443/api?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout}

kubectl logs -n kube-system -p machine-controller-58fbb9bcc9-tk7zw
W1125 19:37:28.207475       1 client_config.go:617] Neither --kubeconfig nor --master was specified.  Using the inClusterConfig.  This might not work.
W1125 19:37:28.207939       1 client_config.go:617] Neither --kubeconfig nor --master was specified.  Using the inClusterConfig.  This might not work.
I1125 19:37:48.061393       1 main.go:292] caught signal, shutting down...
F1125 19:37:58.210370       1 main.go:297] failed to create runtime manager: error building ctrlruntime manager: Get "https://10.96.0.1:443/api?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout

kubectl logs -n kube-system -p machine-controller-webhook-96877d7bc-7zv8r
W1125 19:41:59.323557       1 client_config.go:617] Neither --kubeconfig nor --master was specified.  Using the inClusterConfig.  This might not work.

0 replies

clickersmudge · 2022-11-26T09:06:45Z

clickersmudge
Nov 26, 2022
Author

@xmudrii I found the cause. But not solution.

clusterNetwork:
  # kube-proxy configurations
  kubeProxy:
    # skipInstallation will skip the installation of kube-proxy
    skipInstallation: true
  # CNI plugin of choice. CNI can not be changed later at upgrade time.
  cni:
    # Only one CNI plugin can be defined at the same time
    # Supported CNI plugins:
    # * canal
    # * weave-net
    # * cilium
    # * external - The CNI plugin can be installed as an addon or manually
    cilium:
      # enableHubble to deploy Hubble relay and UI
      enableHubble: true
      # kubeProxyReplacement defines weather cilium relies on underlying Kernel support to replace kube-proxy functionality by eBPF (strict),
      # or disables a subset of those features so cilium does not bail out if the kernel support is missing (disabled).
      kubeProxyReplacement: "strict"

It seems that changing the CNI to cilium or kubeProxyReplacement causes the problem.
I checked and without changing to Cilium it works.
Maybe I missed something?
I don't see the connectivity pod.

Should I change anything else in the configuration?

1 reply

xmudrii Nov 26, 2022
Maintainer

@clickersmudge I'll try to reproduce this issue and report back with more details.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Control plane adding/scaling problem #2502

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Replies: 3 comments 1 reply

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

Select a reply

Control plane adding/scaling problem #2502

clickersmudge Nov 25, 2022

How we scale control plane?

Errors occur after this step.

Replies: 3 comments · 1 reply

xmudrii Nov 25, 2022 Maintainer

clickersmudge Nov 25, 2022 Author

clickersmudge Nov 26, 2022 Author

xmudrii Nov 26, 2022 Maintainer

clickersmudge
Nov 25, 2022

Replies: 3 comments 1 reply

xmudrii
Nov 25, 2022
Maintainer

clickersmudge
Nov 25, 2022
Author

clickersmudge
Nov 26, 2022
Author

xmudrii Nov 26, 2022
Maintainer