### Test report for 4859.0.0+nightly-20261020-2100 / amd64 **Platforms tested** : qemu 🟢 ok **bpf.ig**; Succeeded: qemu (1) 🟢 ok **cl.basic**; Succeeded: qemu (1) 🟢 ok **cl.cloudinit.basic**; Succeeded: qemu (1) 🟢 ok **cl.cloudinit.multipart-mime**; Succeeded: qemu (1) 🟢 ok **cl.cloudinit.script**; Succeeded: qemu (1) 🟢 ok **cl.disk.raid0.data**; Succeeded: qemu (1) 🟢 ok **cl.disk.raid0.root**; Succeeded: qemu (1) 🟢 ok **cl.disk.raid1.data**; Succeeded: qemu (1) 🟢 ok **cl.disk.raid1.root**; Succeeded: qemu (1) 🟢 ok **cl.etcd-member.discovery**; Succeeded: qemu (1) 🟢 ok **cl.etcd-member.etcdctlv3**; Succeeded: qemu (1) 🟢 ok **cl.etcd-member.v2-backup-restore**; Succeeded: qemu (1) 🟢 ok **cl.filesystem**; Succeeded: qemu (1) 🟢 ok **cl.flannel.udp**; Succeeded: qemu (1) 🟢 ok **cl.flannel.vxlan**; Succeeded: qemu (2); Failed: qemu (1) 🟢 ok **cl.ignition.instantiated.enable-unit**; Succeeded: qemu (1) 🟢 ok **cl.ignition.kargs**; Succeeded: qemu (1) 🟢 ok **cl.ignition.luks**; Succeeded: qemu (1) 🟢 ok **cl.ignition.oem.indirect**; Succeeded: qemu (1) 🟢 ok **cl.ignition.oem.indirect.new**; Succeeded: qemu (1) 🟢 ok **cl.ignition.oem.regular**; Succeeded: qemu (1) 🟢 ok **cl.ignition.oem.regular.new**; Succeeded: qemu (1) 🟢 ok **cl.ignition.oem.reuse**; Succeeded: qemu (1) 🟢 ok **cl.ignition.oem.wipe**; Succeeded: qemu (1) 🟢 ok **cl.ignition.partition_on_boot_disk**; Succeeded: qemu (1) 🟢 ok **cl.ignition.symlink**; Succeeded: qemu (1) 🟢 ok **cl.ignition.translation**; Succeeded: qemu (1) 🟢 ok **cl.ignition.v1.btrfsroot**; Succeeded: qemu (1) 🟢 ok **cl.ignition.v1.ext4root**; Succeeded: qemu (1) 🟢 ok **cl.ignition.v1.groups**; Succeeded: qemu (1) 🟢 ok **cl.ignition.v1.once**; Succeeded: qemu (1) 🟢 ok **cl.ignition.v1.sethostname**; Succeeded: qemu (1) 🟢 ok **cl.ignition.v1.users**; Succeeded: qemu (1) 🟢 ok **cl.ignition.v1.xfsroot**; Succeeded: qemu (1) 🟢 ok **cl.ignition.v2.btrfsroot**; Succeeded: qemu (1) 🟢 ok **cl.ignition.v2.ext4root**; Succeeded: qemu (1) 🟢 ok **cl.ignition.v2.users**; Succeeded: qemu (1) 🟢 ok **cl.ignition.v2.xfsroot**; Succeeded: qemu (1) 🟢 ok **cl.ignition.v2_1.ext4checkexisting**; Succeeded: qemu (1) 🟢 ok **cl.ignition.v2_1.swap**; Succeeded: qemu (1) 🟢 ok **cl.ignition.v2_1.vfat**; Succeeded: qemu (1) 🟢 ok **cl.install.cloudinit**; Succeeded: qemu (1) 🟢 ok **cl.internet**; Succeeded: qemu (1) 🟢 ok **cl.locksmith.cluster**; Succeeded: qemu (4); Failed: qemu (1, 2, 3) 🟢 ok **cl.network.initramfs.second-boot**; Succeeded: qemu (1) 🟢 ok **cl.network.iptables**; Succeeded: qemu (1) 🟢 ok **cl.network.listeners**; Succeeded: qemu (1) 🟢 ok **cl.network.nftables**; Succeeded: qemu (1) 🟢 ok **cl.network.wireguard**; Succeeded: qemu (1) 🟢 ok **cl.omaha.ping**; Succeeded: qemu (1) 🟢 ok **cl.osreset.ignition-rerun**; Succeeded: qemu (2); Failed: qemu (1) 🟢 ok **cl.overlay.cleanup**; Succeeded: qemu (1) 🟢 ok **cl.swap_activation**; Succeeded: qemu (1) 🟢 ok **cl.sysext.boot**; Succeeded: qemu (2); Failed: qemu (1) 🟢 ok **cl.sysext.fallbackdownload**; Succeeded: qemu (1) 🟢 ok **cl.tang.nonroot**; Succeeded: qemu (1) 🟢 ok **cl.tang.root**; Succeeded: qemu (1) 🟢 ok **cl.toolbox.dnf-install**; Succeeded: qemu (1) 🟢 ok **cl.tpm.eventlog**; Succeeded: qemu (2); Failed: qemu (1) 🟢 ok **cl.tpm.nonroot**; Succeeded: qemu (1) 🟢 ok **cl.tpm.root**; Succeeded: qemu (1) 🟢 ok **cl.tpm.root-cryptenroll**; Succeeded: qemu (2); Failed: qemu (1) 🟢 ok **cl.tpm.root-cryptenroll-pcr-noupdate**; Succeeded: qemu (1) 🟢 ok **cl.tpm.root-cryptenroll-pcr-withupdate**; Succeeded: qemu (1) 🟢 ok **cl.update.badverity**; Succeeded: qemu (1) 🟢 ok **cl.update.reboot**; Succeeded: qemu (1) 🟢 ok **cl.users.shells**; Succeeded: qemu (1) 🟢 ok **cl.verity**; Succeeded: qemu (1) 🟢 ok **confext.skiprefresh**; Succeeded: qemu (1) 🟢 ok **coreos.auth.verify**; Succeeded: qemu (1) 🟢 ok **coreos.ignition.groups**; Succeeded: qemu (1) 🟢 ok **coreos.ignition.once**; Succeeded: qemu (1) 🟢 ok **coreos.ignition.resource.local**; Succeeded: qemu (1) 🟢 ok **coreos.ignition.resource.remote**; Succeeded: qemu (1) 🟢 ok **coreos.ignition.resource.s3.versioned**; Succeeded: qemu (1) 🟢 ok **coreos.ignition.security.tls**; Succeeded: qemu (1) 🟢 ok **coreos.ignition.sethostname**; Succeeded: qemu (1) 🟢 ok **coreos.ignition.systemd.enable-service**; Succeeded: qemu (1) 🟢 ok **coreos.locksmith.reboot**; Succeeded: qemu (3); Failed: qemu (1, 2) 🟢 ok **coreos.locksmith.tls**; Succeeded: qemu (1) 🟢 ok **coreos.selinux.boolean**; Succeeded: qemu (1) 🟢 ok **coreos.selinux.enforce**; Succeeded: qemu (1) 🟢 ok **coreos.tls.fetch-urls**; Succeeded: qemu (1) 🟢 ok **coreos.update.badusr**; Succeeded: qemu (1) 🟢 ok **devcontainer.docker**; Succeeded: qemu (1) 🟢 ok **devcontainer.systemd-nspawn**; Succeeded: qemu (1) 🟢 ok **docker.base**; Succeeded: qemu (1) 🟢 ok **docker.btrfs-storage**; Succeeded: qemu (1) 🟢 ok **docker.containerd-restart**; Succeeded: qemu (1) 🟢 ok **docker.enable-service.sysext**; Succeeded: qemu (1) 🟢 ok **docker.lib-coreos-dockerd-compat**; Succeeded: qemu (1) 🟢 ok **docker.network-openbsd-nc**; Succeeded: qemu (1) 🟢 ok **docker.selinux**; Succeeded: qemu (1) 🟢 ok **docker.userns**; Succeeded: qemu (1) ❌ not ok **kubeadm.v1.35.1.calico.base**; Failed: qemu (1, 2, 3, 4, 5)
                Diagnostic output for qemu, run 5 ``` L1: " Error: _cluster.go:125: I1021 14:54:37.423868 1960 version.go:260] remote version is much newer: v1.37.1; falling back to: stable-1.35" L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.35.9" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.35.9" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.35.9" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.35.9" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.13.1" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.1" L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.6-0" L9: "cluster.go:125: W1021 15:01:53.620304 2502 version.go:108] could not fetch a Kubernetes version from the internet: unable to get URL __https://dl.k8s.io/release/stable-1.txt__: Get __https://dl.k8s?.io/release/stable-1.txt__: context deadline exceeded (Client.Timeout exceeded while awaiting headers)" L10: "cluster.go:125: W1021 15:01:53.637145 2502 version.go:109] falling back to the local client version: v1.35.1" L11: "cluster.go:125: [init] Using Kubernetes version: v1.35.1" L12: "cluster.go:125: [preflight] Running pre-flight checks" L13: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L14: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L15: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L16: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L17: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L18: "cluster.go:125: [certs] Generating __ca__ certificate and key" L19: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L20: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local localhost] and IPs [10.96.0.1 10.0.0.6?]" L21: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L22: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L23: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L24: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L25: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L26: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L27: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L28: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L29: "cluster.go:125: [certs] Generating __sa__ key and public key" L30: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L31: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L32: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L33: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L34: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L35: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L36: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L37: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L38: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L39: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L40: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L41: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__" L42: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__" L43: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L44: "cluster.go:125: [kubelet-start] Starting the kubelet" L45: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__" L46: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s" L47: "cluster.go:125: [kubelet-check] The kubelet is healthy after 15.636853687s" L48: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s" L49: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.6:6443/livez" L50: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz" L51: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez" L52: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 34.714418114s" L53: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 1m2.638802857s" L54: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 3m47.16172063s" L55: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace" L56: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster" L57: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs" L58: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]" L59: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]" L60: "cluster.go:125: [bootstrap-token] Using token: 36y6ck.ak8f9fu3oymd9eq8" L61: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles" L62: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes" L63: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials" L64: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token" L65: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster" L66: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace" L67: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key" L68: "cluster.go:125: [addons] Applied essential addon: CoreDNS" L69: "cluster.go:125: [addons] Applied essential addon: kube-proxy" L70: "cluster.go:125: " L71: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!" L72: "cluster.go:125: " L73: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:" L74: "cluster.go:125: " L75: "cluster.go:125: mkdir -p $HOME/.kube" L76: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config" L77: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config" L78: "cluster.go:125: " L79: "cluster.go:125: Alternatively, if you are the root user, you can run:" L80: "cluster.go:125: " L81: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf" L82: "cluster.go:125: " L83: "cluster.go:125: You should now deploy a pod network to the cluster." L84: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:" L85: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/" L86: "cluster.go:125: " L87: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:" L88: "cluster.go:125: " L89: "cluster.go:125: kubeadm join 10.0.0.6:6443 --token 36y6ck.ak8f9fu3oymd9eq8 _" L90: "cluster.go:125: --discovery-token-ca-cert-hash sha256:fe9383a0296524b1f79ba138dc0bdfd57fd7a998fa6400aac59d7d9692fb1c54 " L91: "cluster.go:125: namespace/tigera-operator created" L92: "cluster.go:125: serviceaccount/tigera-operator created" L93: "cluster.go:125: clusterrole.rbac.authorization.k8s.io/tigera-operator-secrets created" L94: "cluster.go:125: clusterrole.rbac.authorization.k8s.io/tigera-operator created" L95: "cluster.go:125: clusterrolebinding.rbac.authorization.k8s.io/tigera-operator created" L96: "cluster.go:125: rolebinding.rbac.authorization.k8s.io/tigera-operator-secrets created" L97: "cluster.go:125: deployment.apps/tigera-operator created" L98: "cluster.go:125: error: timed out waiting for the condition" L99: "kubeadm.go:197: unable to setup cluster: unable to run master script: Process exited with status 1" L100: "harness.go:621: Found systemd dependency unit failed to start (?[0;1;39msystemd-fsck????[0mle System Check on /dev/mapper/usr. ) on machine 29ac106e-213d-4d1f-bb40-eeec0754c512 console_" L101: " " ```                 Diagnostic output for qemu, run 4 ``` L1: " Error: _cluster.go:125: I1021 14:25:58.990921 1905 version.go:260] remote version is much newer: v1.37.1; falling back to: stable-1.35" L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.35.9" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.35.9" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.35.9" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.35.9" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.13.1" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.1" L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.6-0" L9: "cluster.go:125: I1021 14:27:27.601269 2218 version.go:260] remote version is much newer: v1.37.1; falling back to: stable-1.35" L10: "cluster.go:125: [init] Using Kubernetes version: v1.35.9" L11: "cluster.go:125: [preflight] Running pre-flight checks" L12: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L13: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L14: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L15: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L16: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L17: "cluster.go:125: [certs] Generating __ca__ certificate and key" L18: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L19: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local localhost] and IPs [10.96.0.1 10.0.0.1?2]" L20: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L21: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L22: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L23: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L24: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L25: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L26: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L27: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L28: "cluster.go:125: [certs] Generating __sa__ key and public key" L29: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L30: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L31: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L32: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L33: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L34: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L35: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L36: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L37: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L38: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L39: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L40: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__" L41: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__" L42: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L43: "cluster.go:125: [kubelet-start] Starting the kubelet" L44: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__" L45: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s" L46: "cluster.go:125: [kubelet-check] The kubelet is healthy after 1.005507399s" L47: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s" L48: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.12:6443/livez" L49: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz" L50: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez" L51: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 5.10343447s" L52: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 25.064471546s" L53: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 54.590343013s" L54: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace" L55: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster" L56: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs" L57: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]" L58: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]" L59: "cluster.go:125: [bootstrap-token] Using token: oicqqw.cmmmdy8cgocyyx8t" L60: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles" L61: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes" L62: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials" L63: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token" L64: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster" L65: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace" L66: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key" L67: "cluster.go:125: [addons] Applied essential addon: CoreDNS" L68: "cluster.go:125: [addons] Applied essential addon: kube-proxy" L69: "cluster.go:125: " L70: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!" L71: "cluster.go:125: " L72: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:" L73: "cluster.go:125: " L74: "cluster.go:125: mkdir -p $HOME/.kube" L75: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config" L76: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config" L77: "cluster.go:125: " L78: "cluster.go:125: Alternatively, if you are the root user, you can run:" L79: "cluster.go:125: " L80: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf" L81: "cluster.go:125: " L82: "cluster.go:125: You should now deploy a pod network to the cluster." L83: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:" L84: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/" L85: "cluster.go:125: " L86: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:" L87: "cluster.go:125: " L88: "cluster.go:125: kubeadm join 10.0.0.12:6443 --token oicqqw.cmmmdy8cgocyyx8t _" L89: "cluster.go:125: --discovery-token-ca-cert-hash sha256:a8bff9845bf7d5fb7b5a51d35dcec0a27d6cbec6bd748bd2c64a2156551b1573 " L90: "cluster.go:125: namespace/tigera-operator created" L91: "cluster.go:125: serviceaccount/tigera-operator created" L92: "cluster.go:125: clusterrole.rbac.authorization.k8s.io/tigera-operator-secrets created" L93: "cluster.go:125: clusterrole.rbac.authorization.k8s.io/tigera-operator created" L94: "cluster.go:125: clusterrolebinding.rbac.authorization.k8s.io/tigera-operator created" L95: "cluster.go:125: rolebinding.rbac.authorization.k8s.io/tigera-operator-secrets created" L96: "cluster.go:125: deployment.apps/tigera-operator created" L97: "cluster.go:125: error: timed out waiting for the condition" L98: "kubeadm.go:197: unable to setup cluster: unable to run master script: Process exited with status 1_" L99: " " ```                 Diagnostic output for qemu, run 3 ``` L1: " Error: _cluster.go:125: I1021 13:52:59.886981 1836 version.go:260] remote version is much newer: v1.37.1; falling back to: stable-1.35" L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.35.9" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.35.9" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.35.9" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.35.9" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.13.1" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.1" L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.6-0" L9: "cluster.go:125: I1021 13:54:00.142645 2141 version.go:260] remote version is much newer: v1.37.1; falling back to: stable-1.35" L10: "cluster.go:125: [init] Using Kubernetes version: v1.35.9" L11: "cluster.go:125: [preflight] Running pre-flight checks" L12: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L13: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L14: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L15: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L16: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L17: "cluster.go:125: [certs] Generating __ca__ certificate and key" L18: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L19: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local localhost] and IPs [10.96.0.1 10.0.0.1?5]" L20: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L21: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L22: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L23: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L24: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L25: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L26: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L27: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L28: "cluster.go:125: [certs] Generating __sa__ key and public key" L29: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L30: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L31: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L32: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L33: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L34: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L35: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L36: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L37: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L38: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L39: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L40: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__" L41: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__" L42: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L43: "cluster.go:125: [kubelet-start] Starting the kubelet" L44: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__" L45: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s" L46: "cluster.go:125: [kubelet-check] The kubelet is healthy after 2.008335023s" L47: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s" L48: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.15:6443/livez" L49: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz" L50: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez" L51: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 7.541047561s" L52: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 21.236847234s" L53: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 41.049977106s" L54: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace" L55: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster" L56: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs" L57: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]" L58: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]" L59: "cluster.go:125: [bootstrap-token] Using token: fm5ktf.zk2ttc3dttt1yqo2" L60: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles" L61: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes" L62: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials" L63: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token" L64: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster" L65: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace" L66: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key" L67: "cluster.go:125: [addons] Applied essential addon: CoreDNS" L68: "cluster.go:125: [addons] Applied essential addon: kube-proxy" L69: "cluster.go:125: " L70: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!" L71: "cluster.go:125: " L72: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:" L73: "cluster.go:125: " L74: "cluster.go:125: mkdir -p $HOME/.kube" L75: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config" L76: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config" L77: "cluster.go:125: " L78: "cluster.go:125: Alternatively, if you are the root user, you can run:" L79: "cluster.go:125: " L80: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf" L81: "cluster.go:125: " L82: "cluster.go:125: You should now deploy a pod network to the cluster." L83: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:" L84: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/" L85: "cluster.go:125: " L86: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:" L87: "cluster.go:125: " L88: "cluster.go:125: kubeadm join 10.0.0.15:6443 --token fm5ktf.zk2ttc3dttt1yqo2 _" L89: "cluster.go:125: --discovery-token-ca-cert-hash sha256:3b7321a81e28a2ee2162c4350444cefcc1a3848eafc0130487ef1cde27876e4e " L90: "cluster.go:125: namespace/tigera-operator created" L91: "cluster.go:125: serviceaccount/tigera-operator created" L92: "cluster.go:125: clusterrole.rbac.authorization.k8s.io/tigera-operator-secrets created" L93: "cluster.go:125: clusterrole.rbac.authorization.k8s.io/tigera-operator created" L94: "cluster.go:125: clusterrolebinding.rbac.authorization.k8s.io/tigera-operator created" L95: "cluster.go:125: rolebinding.rbac.authorization.k8s.io/tigera-operator-secrets created" L96: "cluster.go:125: deployment.apps/tigera-operator created" L97: "cluster.go:125: error: timed out waiting for the condition" L98: "kubeadm.go:197: unable to setup cluster: unable to run master script: Process exited with status 1_" L99: " " ```                 Diagnostic output for qemu, run 2 ``` L1: " Error: _cluster.go:125: I1021 12:48:43.206417 1944 version.go:260] remote version is much newer: v1.37.1; falling back to: stable-1.35" L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.35.9" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.35.9" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.35.9" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.35.9" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.13.1" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.1" L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.6-0" L9: "cluster.go:125: I1021 12:51:12.159819 2322 version.go:260] remote version is much newer: v1.37.1; falling back to: stable-1.35" L10: "cluster.go:125: [init] Using Kubernetes version: v1.35.9" L11: "cluster.go:125: [preflight] Running pre-flight checks" L12: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L13: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L14: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L15: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L16: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L17: "cluster.go:125: [certs] Generating __ca__ certificate and key" L18: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L19: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local localhost] and IPs [10.96.0.1 10.0.0.7?]" L20: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L21: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L22: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L23: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L24: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L25: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L26: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L27: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L28: "cluster.go:125: [certs] Generating __sa__ key and public key" L29: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L30: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L31: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L32: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L33: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L34: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L35: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L36: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L37: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L38: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L39: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L40: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__" L41: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__" L42: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L43: "cluster.go:125: [kubelet-start] Starting the kubelet" L44: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__" L45: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s" L46: "cluster.go:125: [kubelet-check] The kubelet is healthy after 12.593790869s" L47: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s" L48: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.7:6443/livez" L49: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz" L50: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez" L51: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 32.086664033s" L52: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 47.997113424s" L53: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 4m7.56429623s" L54: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace" L55: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster" L56: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs" L57: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]" L58: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]" L59: "cluster.go:125: [bootstrap-token] Using token: k1r1c9.cumhk1j8p41qv1st" L60: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles" L61: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes" L62: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials" L63: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token" L64: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster" L65: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace" L66: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key" L67: "cluster.go:125: [addons] Applied essential addon: CoreDNS" L68: "cluster.go:125: [addons] Applied essential addon: kube-proxy" L69: "cluster.go:125: " L70: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!" L71: "cluster.go:125: " L72: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:" L73: "cluster.go:125: " L74: "cluster.go:125: mkdir -p $HOME/.kube" L75: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config" L76: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config" L77: "cluster.go:125: " L78: "cluster.go:125: Alternatively, if you are the root user, you can run:" L79: "cluster.go:125: " L80: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf" L81: "cluster.go:125: " L82: "cluster.go:125: You should now deploy a pod network to the cluster." L83: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:" L84: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/" L85: "cluster.go:125: " L86: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:" L87: "cluster.go:125: " L88: "cluster.go:125: kubeadm join 10.0.0.7:6443 --token k1r1c9.cumhk1j8p41qv1st _" L89: "cluster.go:125: --discovery-token-ca-cert-hash sha256:266882e10a1b6b1fe5f9d5299e9462f11f3a2d0c0cb1b3a274d5f3cfddee5bef " L90: "cluster.go:125: namespace/tigera-operator created" L91: "cluster.go:125: serviceaccount/tigera-operator created" L92: "cluster.go:125: clusterrole.rbac.authorization.k8s.io/tigera-operator-secrets created" L93: "cluster.go:125: clusterrole.rbac.authorization.k8s.io/tigera-operator created" L94: "cluster.go:125: clusterrolebinding.rbac.authorization.k8s.io/tigera-operator created" L95: "cluster.go:125: rolebinding.rbac.authorization.k8s.io/tigera-operator-secrets created" L96: "cluster.go:125: deployment.apps/tigera-operator created" L97: "cluster.go:125: error: timed out waiting for the condition" L98: "kubeadm.go:197: unable to setup cluster: unable to run master script: Process exited with status 1" L99: "harness.go:621: Found systemd dependency unit failed to start (?[0;1;39msystemd-fsck????[0mle System Check on /dev/mapper/usr. ) on machine 3474bf22-66af-477a-b94a-3cd532116911 console_" L100: " " ```                 Diagnostic output for qemu, run 1 ``` L1: " Error: _cluster.go:125: I1021 10:00:25.254081 1811 version.go:260] remote version is much newer: v1.37.1; falling back to: stable-1.35" L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.35.9" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.35.9" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.35.9" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.35.9" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.13.1" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.1" L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.6-0" L9: "cluster.go:125: I1021 10:00:53.419186 2065 version.go:260] remote version is much newer: v1.37.1; falling back to: stable-1.35" L10: "cluster.go:125: [init] Using Kubernetes version: v1.35.9" L11: "cluster.go:125: [preflight] Running pre-flight checks" L12: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L13: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L14: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L15: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L16: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L17: "cluster.go:125: [certs] Generating __ca__ certificate and key" L18: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L19: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local localhost] and IPs [10.96.0.1 10.0.0.5?8]" L20: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L21: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L22: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L23: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L24: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L25: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L26: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L27: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L28: "cluster.go:125: [certs] Generating __sa__ key and public key" L29: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L30: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L31: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L32: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L33: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L34: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L35: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L36: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L37: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L38: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L39: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L40: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__" L41: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__" L42: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L43: "cluster.go:125: [kubelet-start] Starting the kubelet" L44: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__" L45: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s" L46: "cluster.go:125: [kubelet-check] The kubelet is healthy after 1.005256579s" L47: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s" L48: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.58:6443/livez" L49: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz" L50: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez" L51: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 4.180295653s" L52: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 13.878275322s" L53: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 28.56609849s" L54: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace" L55: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster" L56: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs" L57: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]" L58: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]" L59: "cluster.go:125: [bootstrap-token] Using token: 1iu7zw.608xmgjz87owyi15" L60: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles" L61: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes" L62: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials" L63: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token" L64: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster" L65: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace" L66: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key" L67: "cluster.go:125: [addons] Applied essential addon: CoreDNS" L68: "cluster.go:125: [addons] Applied essential addon: kube-proxy" L69: "cluster.go:125: " L70: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!" L71: "cluster.go:125: " L72: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:" L73: "cluster.go:125: " L74: "cluster.go:125: mkdir -p $HOME/.kube" L75: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config" L76: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config" L77: "cluster.go:125: " L78: "cluster.go:125: Alternatively, if you are the root user, you can run:" L79: "cluster.go:125: " L80: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf" L81: "cluster.go:125: " L82: "cluster.go:125: You should now deploy a pod network to the cluster." L83: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:" L84: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/" L85: "cluster.go:125: " L86: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:" L87: "cluster.go:125: " L88: "cluster.go:125: kubeadm join 10.0.0.58:6443 --token 1iu7zw.608xmgjz87owyi15 _" L89: "cluster.go:125: --discovery-token-ca-cert-hash sha256:49c194cb3df0cda594a50b77929fe04bc5bb1855efdd1373f194ee1dfb88601d " L90: "cluster.go:125: namespace/tigera-operator created" L91: "cluster.go:125: serviceaccount/tigera-operator created" L92: "cluster.go:125: clusterrole.rbac.authorization.k8s.io/tigera-operator-secrets created" L93: "cluster.go:125: clusterrole.rbac.authorization.k8s.io/tigera-operator created" L94: "cluster.go:125: clusterrolebinding.rbac.authorization.k8s.io/tigera-operator created" L95: "cluster.go:125: rolebinding.rbac.authorization.k8s.io/tigera-operator-secrets created" L96: "cluster.go:125: deployment.apps/tigera-operator created" L97: "cluster.go:125: customresourcedefinition.apiextensions.k8s.io/installations.operator.tigera.io condition met" L98: "cluster.go:125: error: .status.conditions accessor error: 🟢 ok **kubeadm.v1.35.1.cilium.base**; Succeeded: qemu (1) 🟢 ok **kubeadm.v1.35.1.flannel.base**; Succeeded: qemu (2); Failed: qemu (1) 🟢 ok **kubeadm.v1.36.1.calico.base**; Succeeded: qemu (1) ❌ not ok **kubeadm.v1.36.1.cilium.base**; Failed: qemu (1, 2, 3, 4, 5)
                Diagnostic output for qemu, run 5 ``` L1: " Error: _cluster.go:125: I1021 15:07:50.375067 1836 version.go:260] remote version is much newer: v1.37.1; falling back to: stable-1.36" L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.36.5" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.36.5" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.36.5" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.36.5" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.14.2" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.2" L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.8-0" L9: "cluster.go:125: I1021 15:09:35.336166 2209 version.go:260] remote version is much newer: v1.37.1; falling back to: stable-1.36" L10: "cluster.go:125: [init] Using Kubernetes version: v1.36.5" L11: "cluster.go:125: [preflight] Running pre-flight checks" L12: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L13: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L14: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L15: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L16: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L17: "cluster.go:125: [certs] Generating __ca__ certificate and key" L18: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L19: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local localhost] and IPs [10.96.0.1 10.0.0.1?1]" L20: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L21: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L22: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L23: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L24: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L25: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L26: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L27: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L28: "cluster.go:125: [certs] Generating __sa__ key and public key" L29: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L30: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L31: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L32: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L33: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L34: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L35: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L36: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L37: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L38: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L39: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L40: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__" L41: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__" L42: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L43: "cluster.go:125: [kubelet-start] Starting the kubelet" L44: "cluster.go:125: error: error execution phase wait-control-plane: cannot obtain client without bootstrap: could not bootstrap the admin user in file admin.conf: unable to create ClusterRoleBinding: Pos?t __https://10.0.0.11:6443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings?timeout=10s__: context deadline exceeded" L45: "cluster.go:125: To see the stack trace of this error execute with --v=5 or higher" L46: "kubeadm.go:197: unable to setup cluster: unable to run master script: Process exited with status 1" L47: "harness.go:621: Found systemd dependency unit failed to start (?[0;1;39msystemd-fsck????[0mle System Check on /dev/mapper/usr. ) on machine 39b30038-e278-4d9e-98d7-9e4583c6a6d2 console_" L48: " " ```                 Diagnostic output for qemu, run 4 ``` L1: " Error: _cluster.go:125: I1021 14:24:48.656490 1864 version.go:260] remote version is much newer: v1.37.1; falling back to: stable-1.36" L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.36.5" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.36.5" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.36.5" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.36.5" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.14.2" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.2" L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.8-0" L9: "cluster.go:125: I1021 14:26:59.440419 2258 version.go:260] remote version is much newer: v1.37.1; falling back to: stable-1.36" L10: "cluster.go:125: [init] Using Kubernetes version: v1.36.5" L11: "cluster.go:125: [preflight] Running pre-flight checks" L12: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L13: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L14: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L15: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L16: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L17: "cluster.go:125: [certs] Generating __ca__ certificate and key" L18: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L19: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local localhost] and IPs [10.96.0.1 10.0.0.1?0]" L20: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L21: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L22: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L23: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L24: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L25: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L26: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L27: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L28: "cluster.go:125: [certs] Generating __sa__ key and public key" L29: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L30: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L31: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L32: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L33: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L34: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L35: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L36: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L37: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L38: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L39: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L40: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__" L41: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__" L42: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L43: "cluster.go:125: [kubelet-start] Starting the kubelet" L44: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__" L45: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s" L46: "cluster.go:125: [kubelet-check] The kubelet is healthy after 7.50345ms" L47: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s" L48: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.10:6443/livez" L49: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz" L50: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez" L51: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 36.453177ms" L52: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 51.749379ms" L53: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 17.052312224s" L54: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace" L55: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster" L56: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs" L57: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]" L58: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]" L59: "cluster.go:125: [bootstrap-token] Using token: 8msgwn.tujxb2ew6ibgshh8" L60: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles" L61: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes" L62: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials" L63: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token" L64: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster" L65: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the API server kubelet client certificate to access the kubelet API" L66: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace" L67: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key" L68: "cluster.go:125: [addons] Applied essential addon: CoreDNS" L69: "cluster.go:125: [addons] Applied essential addon: kube-proxy" L70: "cluster.go:125: " L71: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!" L72: "cluster.go:125: " L73: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:" L74: "cluster.go:125: " L75: "cluster.go:125: mkdir -p $HOME/.kube" L76: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config" L77: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config" L78: "cluster.go:125: " L79: "cluster.go:125: Alternatively, if you are the root user, you can run:" L80: "cluster.go:125: " L81: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf" L82: "cluster.go:125: " L83: "cluster.go:125: You should now deploy a pod network to the cluster." L84: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:" L85: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/" L86: "cluster.go:125: " L87: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:" L88: "cluster.go:125: " L89: "cluster.go:125: kubeadm join 10.0.0.10:6443 --token 8msgwn.tujxb2ew6ibgshh8 _" L90: "cluster.go:125: --discovery-token-ca-cert-hash sha256:b3f3374a158f0874c87a613a71ea0dfc579497d2f83adbad01398534268e9ab4 " L91: "cluster.go:125: i Using Cilium version 1.12.5" L92: "cluster.go:125: ? Auto-detected cluster name: kubernetes" L93: "cluster.go:125: ? Auto-detected datapath mode: tunnel" L94: "cluster.go:125: ? Auto-detected kube-proxy has been installed" L95: "cluster.go:125: i helm template --namespace kube-system cilium cilium/cilium --version 1.12.5 --set cluster.id=0,cluster.name=kubernetes,encryption.nodeEncryption=false,extraConfig.cluster-pool-ipv4-?cidr=192.168.0.0/17,extraConfig.enable-endpoint-routes=true,kubeProxyReplacement=disabled,operator.replicas=1,serviceAccounts.cilium.name=cilium,serviceAccounts.operator.name=cilium-operator,tunnel=vx?lan" L96: "cluster.go:125: i Storing helm values file in kube-system/cilium-cli-helm-values Secret" L97: "cluster.go:125: ? Created CA in secret cilium-ca" L98: "cluster.go:125: ? Generating certificates for Hubble..." L99: "cluster.go:125: ? Creating Service accounts..." L100: "cluster.go:125: ? Creating Cluster roles..." L101: "cluster.go:125: ? Creating ConfigMap for Cilium version 1.12.5..." L102: "cluster.go:125: i Manual overwrite in ConfigMap: enable-endpoint-routes=true" L103: "cluster.go:125: i Manual overwrite in ConfigMap: cluster-pool-ipv4-cidr=192.168.0.0/17" L104: "cluster.go:125: ? Creating Agent DaemonSet..." L105: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/mount-cgroup]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L106: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/apply-sysctl-overwrites]: deprecated since v1.30; use the ___appArmorProfile___ fi?eld instead__ subsys=klog" L107: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/clean-cilium-state]: deprecated since v1.30; use the ___appArmorProfile___ field i?nstead__ subsys=klog" L108: "cluster.go:125: ? Creating Operator Deployment..." L109: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/cilium-agent]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L110: "cluster.go:125: ? Waiting for Cilium to be installed and ready..." L111: "cluster.go:125: ? Cilium was successfully installed! Run _cilium status_ to view installation health" L112: "cluster.go:125: ?[33m /??_" L113: "cluster.go:125: ?[36m /???[33m___/?[32m??_?[0m Cilium: ?[32mOK?[0m" L114: "cluster.go:125: ?[36m ___?[31m/??_?[32m__/?[0m Operator: ?[32mOK?[0m" L115: "cluster.go:125: ?[32m /???[31m___/?[35m??_?[0m Hubble: ?[36mdisabled?[0m" L116: "cluster.go:125: ?[32m ___?[34m/??_?[35m__/?[0m ClusterMesh: ?[36mdisabled?[0m" L117: "cluster.go:125: ?[34m ___/" L118: "cluster.go:125: ?[0m" L119: "cluster.go:125: Deployment cilium-operator Desired: 1, Ready: ?[32m1/1?[0m, Available: ?[32m1/1?[0m" L120: "cluster.go:125: DaemonSet cilium Desired: 1, Ready: ?[32m1/1?[0m, Available: ?[32m1/1?[0m" L121: "cluster.go:125: Containers: cilium Running: ?[32m1?[0m" L122: "cluster.go:125: cilium-operator Running: ?[32m1?[0m" L123: "cluster.go:125: Cluster Pods: 2/2 managed by Cilium" L124: "cluster.go:125: Image versions cilium quay.io/cilium/cilium:v1.12.5@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5: 1" L125: "cluster.go:125: cilium-operator quay.io/cilium/operator-generic:v1.12.5@sha256:b296eb7f0f7656a5cc19724f40a8a7121b7fd725278b7d61dc91fe0b7ffd7c0e: 1" L126: "cluster.go:125: W1021 14:31:48.855233 1568 joinconfiguration.go:112] [config] WARNING: Ignored configuration document with GroupVersionKind kubelet.config.k8s.io/v1beta1, Kind=KubeletConfiguration" L127: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L128: "cluster.go:125: W1021 14:31:51.792355 1568 utils.go:69] The recommended value for __bindAddress__ in __KubeProxyConfiguration__ is: ::; the provided value is: 0.0.0.0" L129: "--- FAIL: kubeadm.v1.36.1.cilium.base/IPSec_encryption (98.16s)" L130: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/mount-cgroup]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L131: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/apply-sysctl-overwrites]: deprecated since v1.30; use the ___appArmorProfile___ fi?eld instead__ subsys=klog" L132: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/clean-cilium-state]: deprecated since v1.30; use the ___appArmorProfile___ field i?nstead__ subsys=klog" L133: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/cilium-agent]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L134: "cluster.go:125: Error: Unable to determine status: timeout while waiting for status to become successful: context deadline exceeded" L135: "cluster.go:145: __/opt/bin/cilium status --wait --wait-duration 1m__ failed: output ?[33m /????_" L136: "?[36m /?????[33m___/?[32m????_?[0m Cilium: ?[31m2 errors?[0m" L137: "?[36m ___?[31m/????_?[32m__/?[0m Operator: ?[32mOK?[0m" L138: "?[32m /?????[31m___/?[35m????_?[0m Hubble: ?[36mdisabled?[0m" L139: "?[32m ___?[34m/????_?[35m__/?[0m ClusterMesh: ?[36mdisabled?[0m" L140: "?[34m ___/" L141: "?[0m" L142: "Deployment cilium-operator Desired: 1, Ready: ?[32m1/1?[0m, Available: ?[32m1/1?[0m" L143: "DaemonSet cilium Desired: 2, Ready: ?[33m1/2?[0m, Available: ?[33m1/2?[0m, Unavailable: ?[31m1/2?[0m" L144: "Containers: cilium Running: ?[32m2?[0m" L145: "cilium-operator Running: ?[32m1?[0m" L146: "Cluster Pods: 5/5 managed by Cilium" L147: "Image versions cilium-operator quay.io/cilium/operator-generic:v1.12.5@sha256:b296eb7f0f7656a5cc19724f40a8a7121b7fd725278b7d61dc91fe0b7ffd7c0e: 1" L148: "cilium quay.io/cilium/cilium:v1.12.5@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5: 2" L149: "Errors: cilium cilium-kztv6 unable to retrieve cilium status: command terminated with exit code 1" L150: "cilium cilium 1 pods of DaemonSet cilium are not ready, status Process exited with status 1_" L151: " " ```                 Diagnostic output for qemu, run 3 ``` L1: " Error: _cluster.go:125: I1021 13:58:39.830307 1809 version.go:260] remote version is much newer: v1.37.1; falling back to: stable-1.36" L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.36.5" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.36.5" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.36.5" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.36.5" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.14.2" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.2" L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.8-0" L9: "cluster.go:125: I1021 13:59:41.584423 2150 version.go:260] remote version is much newer: v1.37.1; falling back to: stable-1.36" L10: "cluster.go:125: [init] Using Kubernetes version: v1.36.5" L11: "cluster.go:125: [preflight] Running pre-flight checks" L12: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L13: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L14: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L15: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L16: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L17: "cluster.go:125: [certs] Generating __ca__ certificate and key" L18: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L19: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local localhost] and IPs [10.96.0.1 10.0.0.1?9]" L20: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L21: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L22: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L23: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L24: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L25: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L26: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L27: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L28: "cluster.go:125: [certs] Generating __sa__ key and public key" L29: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L30: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L31: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L32: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L33: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L34: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L35: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L36: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L37: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L38: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L39: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L40: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__" L41: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__" L42: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L43: "cluster.go:125: [kubelet-start] Starting the kubelet" L44: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__" L45: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s" L46: "cluster.go:125: [kubelet-check] The kubelet is healthy after 7.049922ms" L47: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s" L48: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.19:6443/livez" L49: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz" L50: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez" L51: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 21.411052ms" L52: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 27.321727ms" L53: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 12.019633389s" L54: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace" L55: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster" L56: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs" L57: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]" L58: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]" L59: "cluster.go:125: [bootstrap-token] Using token: qys698.qwl9yz5mvps86xat" L60: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles" L61: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes" L62: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials" L63: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token" L64: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster" L65: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the API server kubelet client certificate to access the kubelet API" L66: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace" L67: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key" L68: "cluster.go:125: [addons] Applied essential addon: CoreDNS" L69: "cluster.go:125: [addons] Applied essential addon: kube-proxy" L70: "cluster.go:125: " L71: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!" L72: "cluster.go:125: " L73: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:" L74: "cluster.go:125: " L75: "cluster.go:125: mkdir -p $HOME/.kube" L76: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config" L77: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config" L78: "cluster.go:125: " L79: "cluster.go:125: Alternatively, if you are the root user, you can run:" L80: "cluster.go:125: " L81: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf" L82: "cluster.go:125: " L83: "cluster.go:125: You should now deploy a pod network to the cluster." L84: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:" L85: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/" L86: "cluster.go:125: " L87: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:" L88: "cluster.go:125: " L89: "cluster.go:125: kubeadm join 10.0.0.19:6443 --token qys698.qwl9yz5mvps86xat _" L90: "cluster.go:125: --discovery-token-ca-cert-hash sha256:8f44c13c79818851dda78a6ac562fb6cd0cb87dd3fc2e6c0f73acd7b95021f67 " L91: "cluster.go:125: i Using Cilium version 1.12.5" L92: "cluster.go:125: ? Auto-detected cluster name: kubernetes" L93: "cluster.go:125: ? Auto-detected datapath mode: tunnel" L94: "cluster.go:125: ? Auto-detected kube-proxy has been installed" L95: "cluster.go:125: i helm template --namespace kube-system cilium cilium/cilium --version 1.12.5 --set cluster.id=0,cluster.name=kubernetes,encryption.nodeEncryption=false,extraConfig.cluster-pool-ipv4-?cidr=192.168.0.0/17,extraConfig.enable-endpoint-routes=true,kubeProxyReplacement=disabled,operator.replicas=1,serviceAccounts.cilium.name=cilium,serviceAccounts.operator.name=cilium-operator,tunnel=vx?lan" L96: "cluster.go:125: i Storing helm values file in kube-system/cilium-cli-helm-values Secret" L97: "cluster.go:125: ? Created CA in secret cilium-ca" L98: "cluster.go:125: ? Generating certificates for Hubble..." L99: "cluster.go:125: ? Creating Service accounts..." L100: "cluster.go:125: ? Creating Cluster roles..." L101: "cluster.go:125: ? Creating ConfigMap for Cilium version 1.12.5..." L102: "cluster.go:125: i Manual overwrite in ConfigMap: enable-endpoint-routes=true" L103: "cluster.go:125: i Manual overwrite in ConfigMap: cluster-pool-ipv4-cidr=192.168.0.0/17" L104: "cluster.go:125: ? Creating Agent DaemonSet..." L105: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/mount-cgroup]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L106: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/apply-sysctl-overwrites]: deprecated since v1.30; use the ___appArmorProfile___ fi?eld instead__ subsys=klog" L107: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/clean-cilium-state]: deprecated since v1.30; use the ___appArmorProfile___ field i?nstead__ subsys=klog" L108: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/cilium-agent]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L109: "cluster.go:125: ? Creating Operator Deployment..." L110: "cluster.go:125: ? Waiting for Cilium to be installed and ready..." L111: "cluster.go:125: ? Restarting unmanaged pods..." L112: "cluster.go:125: ? Restarted unmanaged pod kube-system/coredns-589f44dc88-668lv" L113: "cluster.go:125: ? Restarted unmanaged pod kube-system/coredns-589f44dc88-cl6fv" L114: "cluster.go:125: ? Cilium was successfully installed! Run _cilium status_ to view installation health" L115: "cluster.go:125: ?[33m /??_" L116: "cluster.go:125: ?[36m /???[33m___/?[32m??_?[0m Cilium: ?[32mOK?[0m" L117: "cluster.go:125: ?[36m ___?[31m/??_?[32m__/?[0m Operator: ?[32mOK?[0m" L118: "cluster.go:125: ?[32m /???[31m___/?[35m??_?[0m Hubble: ?[36mdisabled?[0m" L119: "cluster.go:125: ?[32m ___?[34m/??_?[35m__/?[0m ClusterMesh: ?[36mdisabled?[0m" L120: "cluster.go:125: ?[34m ___/" L121: "cluster.go:125: ?[0m" L122: "cluster.go:125: DaemonSet cilium Desired: 1, Ready: ?[32m1/1?[0m, Available: ?[32m1/1?[0m" L123: "cluster.go:125: Deployment cilium-operator Desired: 1, Ready: ?[32m1/1?[0m, Available: ?[32m1/1?[0m" L124: "cluster.go:125: Containers: cilium Running: ?[32m1?[0m" L125: "cluster.go:125: cilium-operator Running: ?[32m1?[0m" L126: "cluster.go:125: Cluster Pods: 0/4 managed by Cilium" L127: "cluster.go:125: Image versions cilium quay.io/cilium/cilium:v1.12.5@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5: 1" L128: "cluster.go:125: cilium-operator quay.io/cilium/operator-generic:v1.12.5@sha256:b296eb7f0f7656a5cc19724f40a8a7121b7fd725278b7d61dc91fe0b7ffd7c0e: 1" L129: "cluster.go:125: W1021 14:04:59.159955 1581 joinconfiguration.go:112] [config] WARNING: Ignored configuration document with GroupVersionKind kubelet.config.k8s.io/v1beta1, Kind=KubeletConfiguration" L130: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L131: "cluster.go:125: W1021 14:05:00.819557 1581 utils.go:69] The recommended value for __bindAddress__ in __KubeProxyConfiguration__ is: ::; the provided value is: 0.0.0.0" L132: "--- FAIL: kubeadm.v1.36.1.cilium.base/IPSec_encryption (97.60s)" L133: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/mount-cgroup]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L134: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/apply-sysctl-overwrites]: deprecated since v1.30; use the ___appArmorProfile___ fi?eld instead__ subsys=klog" L135: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/clean-cilium-state]: deprecated since v1.30; use the ___appArmorProfile___ field i?nstead__ subsys=klog" L136: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/cilium-agent]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L137: "cluster.go:125: Error: Unable to determine status: timeout while waiting for status to become successful: context deadline exceeded" L138: "cluster.go:145: __/opt/bin/cilium status --wait --wait-duration 1m__ failed: output ?[33m /????_" L139: "?[36m /?????[33m___/?[32m????_?[0m Cilium: ?[31m2 errors?[0m" L140: "?[36m ___?[31m/????_?[32m__/?[0m Operator: ?[32mOK?[0m" L141: "?[32m /?????[31m___/?[35m????_?[0m Hubble: ?[36mdisabled?[0m" L142: "?[32m ___?[34m/????_?[35m__/?[0m ClusterMesh: ?[36mdisabled?[0m" L143: "?[34m ___/" L144: "?[0m" L145: "Deployment cilium-operator Desired: 1, Ready: ?[32m1/1?[0m, Available: ?[32m1/1?[0m" L146: "DaemonSet cilium Desired: 2, Ready: ?[33m1/2?[0m, Available: ?[33m1/2?[0m, Unavailable: ?[31m1/2?[0m" L147: "Containers: cilium Running: ?[32m2?[0m" L148: "cilium-operator Running: ?[32m1?[0m" L149: "Cluster Pods: 5/5 managed by Cilium" L150: "Image versions cilium quay.io/cilium/cilium:v1.12.5@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5: 2" L151: "cilium-operator quay.io/cilium/operator-generic:v1.12.5@sha256:b296eb7f0f7656a5cc19724f40a8a7121b7fd725278b7d61dc91fe0b7ffd7c0e: 1" L152: "Errors: cilium cilium 1 pods of DaemonSet cilium are not ready" L153: "cilium cilium-729tp unable to retrieve cilium status: command terminated with exit code 1, status Process exited with status 1_" L154: " " ```                 Diagnostic output for qemu, run 2 ``` L1: " Error: _cluster.go:125: I1021 13:01:40.919058 1893 version.go:260] remote version is much newer: v1.37.1; falling back to: stable-1.36" L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.36.5" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.36.5" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.36.5" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.36.5" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.14.2" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.2" L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.8-0" L9: "cluster.go:125: I1021 13:05:53.908115 2403 version.go:260] remote version is much newer: v1.37.1; falling back to: stable-1.36" L10: "cluster.go:125: [init] Using Kubernetes version: v1.36.5" L11: "cluster.go:125: [preflight] Running pre-flight checks" L12: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L13: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L14: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L15: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L16: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L17: "cluster.go:125: [certs] Generating __ca__ certificate and key" L18: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L19: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local localhost] and IPs [10.96.0.1 10.0.0.1?3]" L20: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L21: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L22: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L23: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L24: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L25: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L26: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L27: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L28: "cluster.go:125: [certs] Generating __sa__ key and public key" L29: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L30: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L31: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L32: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L33: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L34: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L35: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L36: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L37: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L38: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L39: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L40: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__" L41: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__" L42: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L43: "cluster.go:125: [kubelet-start] Starting the kubelet" L44: "cluster.go:125: error: error execution phase wait-control-plane: cannot obtain client without bootstrap: could not bootstrap the admin user in file admin.conf: unable to create ClusterRoleBinding: Pos?t __https://10.0.0.13:6443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings?timeout=10s__: context deadline exceeded" L45: "cluster.go:125: To see the stack trace of this error execute with --v=5 or higher" L46: "kubeadm.go:197: unable to setup cluster: unable to run master script: Process exited with status 1_" L47: " " ```                 Diagnostic output for qemu, run 1 ``` L1: " Error: _kubeadm.go:197: unable to setup cluster: unable to create master node with large disk: machine __86bd169e-b3b4-4aa2-8fcc-fc953702440e__ failed basic checks: some systemd units failed:" L2: "??? systemd-hwdb-update.service loaded failed failed Rebuild Hardware Database" L3: "status: " L4: "journal:-- No entries --" L5: "harness.go:621: Found systemd unit failed to start (?[0;1;39msystemd-hwdb-updat???ervice?[0m - Rebuild Hardware Database. ) on machine 86bd169e-b3b4-4aa2-8fcc-fc953702440e console" L6: "harness.go:621: Found systemd dependency unit failed to start (?[0;1;39msystemd-fsck????[0mem Check on /dev/disk/by-label/OEM. ) on machine 86bd169e-b3b4-4aa2-8fcc-fc953702440e console_" L7: " " ```
🟢 ok **kubeadm.v1.36.1.flannel.base**; Succeeded: qemu (3); Failed: qemu (1, 2) ❌ not ok **kubeadm.v1.37.0.calico.base**; Failed: qemu (1, 2, 3, 4, 5)
                Diagnostic output for qemu, run 5 ``` L1: " Error: _cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.37.1" L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.37.1" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.37.1" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.37.1" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.14.6" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.2" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.7.0-0" L8: "cluster.go:125: [init] Using Kubernetes version: v1.37.1" L9: "cluster.go:125: [preflight] Running pre-flight checks" L10: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L11: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L12: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L13: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L14: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L15: "cluster.go:125: [certs] Generating __ca__ certificate and key" L16: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L17: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local localhost] and IPs [10.96.0.1 10.0.0.7?]" L18: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L19: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L20: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L21: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L22: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L23: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L24: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L25: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L26: "cluster.go:125: [certs] Generating __sa__ key and public key" L27: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L28: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L29: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L30: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L31: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L32: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L33: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L34: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L35: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L36: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L37: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L38: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__" L39: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__" L40: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L41: "cluster.go:125: [kubelet-start] Starting the kubelet" L42: "cluster.go:125: error: error execution phase wait-control-plane: cannot obtain client without bootstrap: could not bootstrap the admin user in file admin.conf: unable to create ClusterRoleBinding: con?text deadline exceeded" L43: "cluster.go:125: To see the stack trace of this error execute with --v=5 or higher" L44: "kubeadm.go:197: unable to setup cluster: unable to run master script: Process exited with status 1_" L45: " " ```                 Diagnostic output for qemu, run 4 ``` L1: " Error: _cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.37.1" L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.37.1" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.37.1" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.37.1" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.14.6" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.2" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.7.0-0" L8: "cluster.go:125: [init] Using Kubernetes version: v1.37.1" L9: "cluster.go:125: [preflight] Running pre-flight checks" L10: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L11: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L12: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L13: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L14: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L15: "cluster.go:125: [certs] Generating __ca__ certificate and key" L16: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L17: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local localhost] and IPs [10.96.0.1 10.0.0.7?]" L18: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L19: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L20: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L21: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L22: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L23: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L24: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L25: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L26: "cluster.go:125: [certs] Generating __sa__ key and public key" L27: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L28: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L29: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L30: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L31: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L32: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L33: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L34: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L35: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L36: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L37: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L38: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__" L39: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__" L40: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L41: "cluster.go:125: [kubelet-start] Starting the kubelet" L42: "cluster.go:125: error: error execution phase wait-control-plane: cannot obtain client without bootstrap: could not bootstrap the admin user in file admin.conf: unable to create ClusterRoleBinding: Pos?t __https://10.0.0.7:6443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings?timeout=10s__: context deadline exceeded" L43: "cluster.go:125: To see the stack trace of this error execute with --v=5 or higher" L44: "kubeadm.go:197: unable to setup cluster: unable to run master script: Process exited with status 1_" L45: " " ```                 Diagnostic output for qemu, run 3 ``` L1: " Error: _cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.37.1" L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.37.1" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.37.1" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.37.1" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.14.6" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.2" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.7.0-0" L8: "cluster.go:125: [init] Using Kubernetes version: v1.37.1" L9: "cluster.go:125: [preflight] Running pre-flight checks" L10: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L11: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L12: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L13: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L14: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L15: "cluster.go:125: [certs] Generating __ca__ certificate and key" L16: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L17: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local localhost] and IPs [10.96.0.1 10.0.0.1?0]" L18: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L19: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L20: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L21: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L22: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L23: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L24: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L25: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L26: "cluster.go:125: [certs] Generating __sa__ key and public key" L27: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L28: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L29: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L30: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L31: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L32: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L33: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L34: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L35: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L36: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L37: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L38: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__" L39: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__" L40: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L41: "cluster.go:125: [kubelet-start] Starting the kubelet" L42: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__" L43: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s" L44: "cluster.go:125: [kubelet-check] The kubelet is healthy after 185.126671ms" L45: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s" L46: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.10:6443/livez" L47: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz" L48: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez" L49: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 146.942049ms" L50: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 189.58473ms" L51: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 28.548649446s" L52: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace" L53: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster" L54: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs" L55: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]" L56: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]" L57: "cluster.go:125: [bootstrap-token] Using token: suqtar.cnu12v7zo7toxw8b" L58: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles" L59: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes" L60: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials" L61: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token" L62: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster" L63: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the API server kubelet client certificate to access the kubelet API" L64: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace" L65: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key" L66: "cluster.go:125: [addons] Applied essential addon: CoreDNS" L67: "cluster.go:125: [addons] Applied essential addon: kube-proxy" L68: "cluster.go:125: " L69: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!" L70: "cluster.go:125: " L71: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:" L72: "cluster.go:125: " L73: "cluster.go:125: mkdir -p $HOME/.kube" L74: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config" L75: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config" L76: "cluster.go:125: " L77: "cluster.go:125: Alternatively, if you are the root user, you can run:" L78: "cluster.go:125: " L79: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf" L80: "cluster.go:125: " L81: "cluster.go:125: You should now deploy a pod network to the cluster." L82: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:" L83: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/" L84: "cluster.go:125: " L85: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:" L86: "cluster.go:125: " L87: "cluster.go:125: kubeadm join 10.0.0.10:6443 --token suqtar.cnu12v7zo7toxw8b _" L88: "cluster.go:125: --discovery-token-ca-cert-hash sha256:88bd5271254e74a193354e3a13cd0adb1891c9794d275bc3f04556789097fac7 " L89: "cluster.go:125: namespace/tigera-operator created" L90: "cluster.go:125: serviceaccount/tigera-operator created" L91: "cluster.go:125: clusterrole.rbac.authorization.k8s.io/tigera-operator-secrets created" L92: "cluster.go:125: clusterrole.rbac.authorization.k8s.io/tigera-operator created" L93: "cluster.go:125: clusterrolebinding.rbac.authorization.k8s.io/tigera-operator created" L94: "cluster.go:125: rolebinding.rbac.authorization.k8s.io/tigera-operator-secrets created" L95: "cluster.go:125: deployment.apps/tigera-operator created" L96: "cluster.go:125: error: timed out waiting for the condition" L97: "kubeadm.go:197: unable to setup cluster: unable to run master script: Process exited with status 1_" L98: " " ```                 Diagnostic output for qemu, run 2 ``` L1: " Error: _cluster.go:125: W1021 13:32:27.536893 1951 version.go:108] could not fetch a Kubernetes version from the internet: unable to get URL __https://dl.k8s.io/release/stable-1.txt__: Get __https:?//dl.k8s.io/release/stable-1.txt__: context deadline exceeded (Client.Timeout exceeded while awaiting headers)" L2: "cluster.go:125: W1021 13:32:27.546969 1951 version.go:109] falling back to the local client version: v1.37.0" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.37.0" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.37.0" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.37.0" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.37.0" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.14.6" L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.2" L9: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.7.0-0" L10: "cluster.go:125: [init] Using Kubernetes version: v1.37.1" L11: "cluster.go:125: [preflight] Running pre-flight checks" L12: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L13: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L14: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L15: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L16: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L17: "cluster.go:125: [certs] Generating __ca__ certificate and key" L18: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L19: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local localhost] and IPs [10.96.0.1 10.0.0.2?8]" L20: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L21: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L22: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L23: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L24: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L25: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L26: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L27: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L28: "cluster.go:125: [certs] Generating __sa__ key and public key" L29: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L30: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L31: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L32: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L33: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L34: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L35: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L36: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L37: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L38: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L39: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L40: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__" L41: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__" L42: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L43: "cluster.go:125: [kubelet-start] Starting the kubelet" L44: "cluster.go:125: error: error execution phase wait-control-plane: cannot obtain client without bootstrap: could not bootstrap the admin user in file admin.conf: unable to create ClusterRoleBinding: Pos?t __https://10.0.0.28:6443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings?timeout=10s__: context deadline exceeded" L45: "cluster.go:125: To see the stack trace of this error execute with --v=5 or higher" L46: "kubeadm.go:197: unable to setup cluster: unable to run master script: Process exited with status 1_" L47: " " ```                 Diagnostic output for qemu, run 1 ``` L1: " Error: _cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.37.1" L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.37.1" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.37.1" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.37.1" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.14.6" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.2" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.7.0-0" L8: "cluster.go:125: [init] Using Kubernetes version: v1.37.1" L9: "cluster.go:125: [preflight] Running pre-flight checks" L10: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L11: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L12: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L13: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L14: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L15: "cluster.go:125: [certs] Generating __ca__ certificate and key" L16: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L17: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local localhost] and IPs [10.96.0.1 10.0.0.1?46]" L18: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L19: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L20: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L21: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L22: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L23: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L24: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L25: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L26: "cluster.go:125: [certs] Generating __sa__ key and public key" L27: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L28: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L29: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L30: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L31: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L32: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L33: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L34: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L35: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L36: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L37: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L38: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__" L39: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__" L40: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L41: "cluster.go:125: [kubelet-start] Starting the kubelet" L42: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__" L43: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s" L44: "cluster.go:125: [kubelet-check] The kubelet is healthy after 25.82909ms" L45: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s" L46: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.146:6443/livez" L47: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz" L48: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez" L49: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 19.015068ms" L50: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 33.094383ms" L51: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 38.506208779s" L52: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace" L53: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster" L54: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs" L55: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]" L56: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]" L57: "cluster.go:125: [bootstrap-token] Using token: zqjf21.qict00iubmt6z75u" L58: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles" L59: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes" L60: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials" L61: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token" L62: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster" L63: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the API server kubelet client certificate to access the kubelet API" L64: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace" L65: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key" L66: "cluster.go:125: [addons] Applied essential addon: CoreDNS" L67: "cluster.go:125: [addons] Applied essential addon: kube-proxy" L68: "cluster.go:125: " L69: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!" L70: "cluster.go:125: " L71: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:" L72: "cluster.go:125: " L73: "cluster.go:125: mkdir -p $HOME/.kube" L74: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config" L75: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config" L76: "cluster.go:125: " L77: "cluster.go:125: Alternatively, if you are the root user, you can run:" L78: "cluster.go:125: " L79: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf" L80: "cluster.go:125: " L81: "cluster.go:125: You should now deploy a pod network to the cluster." L82: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:" L83: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/" L84: "cluster.go:125: " L85: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:" L86: "cluster.go:125: " L87: "cluster.go:125: kubeadm join 10.0.0.146:6443 --token zqjf21.qict00iubmt6z75u _" L88: "cluster.go:125: --discovery-token-ca-cert-hash sha256:3a667712742c89d741516f62c0973923a04b053e866d82627e6552b735a27d60 " L89: "cluster.go:125: namespace/tigera-operator created" L90: "cluster.go:125: serviceaccount/tigera-operator created" L91: "cluster.go:125: clusterrole.rbac.authorization.k8s.io/tigera-operator-secrets created" L92: "cluster.go:125: clusterrole.rbac.authorization.k8s.io/tigera-operator created" L93: "cluster.go:125: clusterrolebinding.rbac.authorization.k8s.io/tigera-operator created" L94: "cluster.go:125: rolebinding.rbac.authorization.k8s.io/tigera-operator-secrets created" L95: "cluster.go:125: deployment.apps/tigera-operator created" L96: "cluster.go:125: error: timed out waiting for the condition" L97: "kubeadm.go:197: unable to setup cluster: unable to run master script: Process exited with status 1_" L98: " " ```
❌ not ok **kubeadm.v1.37.0.cilium.base**; Failed: qemu (1, 2, 3, 4, 5)
                Diagnostic output for qemu, run 5 ``` L1: " Error: _cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.37.1" L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.37.1" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.37.1" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.37.1" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.14.6" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.2" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.7.0-0" L8: "cluster.go:125: [init] Using Kubernetes version: v1.37.1" L9: "cluster.go:125: [preflight] Running pre-flight checks" L10: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L11: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L12: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L13: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L14: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L15: "cluster.go:125: [certs] Generating __ca__ certificate and key" L16: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L17: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local localhost] and IPs [10.96.0.1 10.0.0.9?]" L18: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L19: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L20: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L21: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L22: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L23: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L24: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L25: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L26: "cluster.go:125: [certs] Generating __sa__ key and public key" L27: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L28: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L29: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L30: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L31: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L32: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L33: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L34: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L35: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L36: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L37: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L38: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__" L39: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__" L40: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L41: "cluster.go:125: [kubelet-start] Starting the kubelet" L42: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__" L43: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s" L44: "cluster.go:125: [kubelet-check] The kubelet is healthy after 222.788054ms" L45: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s" L46: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.9:6443/livez" L47: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz" L48: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez" L49: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 136.095599ms" L50: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 478.420543ms" L51: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 1m13.04764341s" L52: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace" L53: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster" L54: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs" L55: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]" L56: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]" L57: "cluster.go:125: [bootstrap-token] Using token: gguleb.70287rw9fcr9ftht" L58: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles" L59: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes" L60: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials" L61: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token" L62: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster" L63: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the API server kubelet client certificate to access the kubelet API" L64: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace" L65: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key" L66: "cluster.go:125: [addons] Applied essential addon: CoreDNS" L67: "cluster.go:125: [addons] Applied essential addon: kube-proxy" L68: "cluster.go:125: " L69: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!" L70: "cluster.go:125: " L71: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:" L72: "cluster.go:125: " L73: "cluster.go:125: mkdir -p $HOME/.kube" L74: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config" L75: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config" L76: "cluster.go:125: " L77: "cluster.go:125: Alternatively, if you are the root user, you can run:" L78: "cluster.go:125: " L79: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf" L80: "cluster.go:125: " L81: "cluster.go:125: You should now deploy a pod network to the cluster." L82: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:" L83: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/" L84: "cluster.go:125: " L85: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:" L86: "cluster.go:125: " L87: "cluster.go:125: kubeadm join 10.0.0.9:6443 --token gguleb.70287rw9fcr9ftht _" L88: "cluster.go:125: --discovery-token-ca-cert-hash sha256:fcff5dcec4cd220deb2ccccc4bc708bb5dc119c06bbb9986cef5f8b7a95005d8 " L89: "cluster.go:125: i Using Cilium version 1.12.5" L90: "cluster.go:125: ? Auto-detected cluster name: kubernetes" L91: "cluster.go:125: ? Auto-detected datapath mode: tunnel" L92: "cluster.go:125: ? Auto-detected kube-proxy has been installed" L93: "cluster.go:125: i helm template --namespace kube-system cilium cilium/cilium --version 1.12.5 --set cluster.id=0,cluster.name=kubernetes,encryption.nodeEncryption=false,extraConfig.cluster-pool-ipv4-?cidr=192.168.0.0/17,extraConfig.enable-endpoint-routes=true,kubeProxyReplacement=disabled,operator.replicas=1,serviceAccounts.cilium.name=cilium,serviceAccounts.operator.name=cilium-operator,tunnel=vx?lan" L94: "cluster.go:125: i Storing helm values file in kube-system/cilium-cli-helm-values Secret" L95: "cluster.go:125: ? Created CA in secret cilium-ca" L96: "cluster.go:125: ? Generating certificates for Hubble..." L97: "cluster.go:125: ? Creating Service accounts..." L98: "cluster.go:125: ? Creating Cluster roles..." L99: "cluster.go:125: ? Creating ConfigMap for Cilium version 1.12.5..." L100: "cluster.go:125: i Manual overwrite in ConfigMap: enable-endpoint-routes=true" L101: "cluster.go:125: i Manual overwrite in ConfigMap: cluster-pool-ipv4-cidr=192.168.0.0/17" L102: "cluster.go:125: ? Creating Agent DaemonSet..." L103: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/mount-cgroup]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L104: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/apply-sysctl-overwrites]: deprecated since v1.30; use the ___appArmorProfile___ fi?eld instead__ subsys=klog" L105: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/clean-cilium-state]: deprecated since v1.30; use the ___appArmorProfile___ field i?nstead__ subsys=klog" L106: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/cilium-agent]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L107: "cluster.go:125: ? Creating Operator Deployment..." L108: "cluster.go:125: ? Waiting for Cilium to be installed and ready..." L109: "cluster.go:125: ? Cilium was successfully installed! Run _cilium status_ to view installation health" L110: "cluster.go:125: ?[33m /??_" L111: "cluster.go:125: ?[36m /???[33m___/?[32m??_?[0m Cilium: ?[32mOK?[0m" L112: "cluster.go:125: ?[36m ___?[31m/??_?[32m__/?[0m Operator: ?[32mOK?[0m" L113: "cluster.go:125: ?[32m /???[31m___/?[35m??_?[0m Hubble: ?[36mdisabled?[0m" L114: "cluster.go:125: ?[32m ___?[34m/??_?[35m__/?[0m ClusterMesh: ?[36mdisabled?[0m" L115: "cluster.go:125: ?[34m ___/" L116: "cluster.go:125: ?[0m" L117: "cluster.go:125: Deployment cilium-operator " L118: "cluster.go:125: DaemonSet cilium " L119: "cluster.go:125: Containers: cilium " L120: "cluster.go:125: cilium-operator " L121: "cluster.go:125: Cluster Pods: 0/0 managed by Cilium" L122: "cluster.go:125: W1021 15:12:57.814793 1584 joinconfiguration.go:112] [config] WARNING: Ignored configuration document with GroupVersionKind kubelet.config.k8s.io/v1beta1, Kind=KubeletConfiguration" L123: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L124: "--- FAIL: kubeadm.v1.37.0.cilium.base/IPSec_encryption (102.98s)" L125: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/mount-cgroup]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L126: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/apply-sysctl-overwrites]: deprecated since v1.30; use the ___appArmorProfile___ fi?eld instead__ subsys=klog" L127: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/clean-cilium-state]: deprecated since v1.30; use the ___appArmorProfile___ field i?nstead__ subsys=klog" L128: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/cilium-agent]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L129: "cluster.go:125: Error: Unable to determine status: timeout while waiting for status to become successful: context deadline exceeded" L130: "cluster.go:145: __/opt/bin/cilium status --wait --wait-duration 1m__ failed: output ?[33m /????_" L131: "?[36m /?????[33m___/?[32m????_?[0m Cilium: ?[31m2 errors?[0m" L132: "?[36m ___?[31m/????_?[32m__/?[0m Operator: ?[32mOK?[0m" L133: "?[32m /?????[31m___/?[35m????_?[0m Hubble: ?[36mdisabled?[0m" L134: "?[32m ___?[34m/????_?[35m__/?[0m ClusterMesh: ?[36mdisabled?[0m" L135: "?[34m ___/" L136: "?[0m" L137: "Deployment cilium-operator Desired: 1, Ready: ?[32m1/1?[0m, Available: ?[32m1/1?[0m" L138: "DaemonSet cilium Desired: 2, Ready: ?[33m1/2?[0m, Available: ?[33m1/2?[0m, Unavailable: ?[31m1/2?[0m" L139: "Containers: cilium Running: ?[32m2?[0m" L140: "cilium-operator Running: ?[32m1?[0m" L141: "Cluster Pods: 5/5 managed by Cilium" L142: "Image versions cilium quay.io/cilium/cilium:v1.12.5@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5: 2" L143: "cilium-operator quay.io/cilium/operator-generic:v1.12.5@sha256:b296eb7f0f7656a5cc19724f40a8a7121b7fd725278b7d61dc91fe0b7ffd7c0e: 1" L144: "Errors: cilium cilium 1 pods of DaemonSet cilium are not ready" L145: "cilium cilium-zl99z unable to retrieve cilium status: command terminated with exit code 1, status Process exited with status 1_" L146: " " ```                 Diagnostic output for qemu, run 4 ``` L1: " Error: _cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.37.1" L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.37.1" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.37.1" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.37.1" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.14.6" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.2" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.7.0-0" L8: "cluster.go:125: [init] Using Kubernetes version: v1.37.1" L9: "cluster.go:125: [preflight] Running pre-flight checks" L10: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L11: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L12: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L13: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L14: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L15: "cluster.go:125: [certs] Generating __ca__ certificate and key" L16: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L17: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local localhost] and IPs [10.96.0.1 10.0.0.1?6]" L18: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L19: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L20: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L21: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L22: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L23: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L24: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L25: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L26: "cluster.go:125: [certs] Generating __sa__ key and public key" L27: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L28: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L29: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L30: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L31: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L32: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L33: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L34: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L35: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L36: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L37: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L38: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__" L39: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__" L40: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L41: "cluster.go:125: [kubelet-start] Starting the kubelet" L42: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__" L43: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s" L44: "cluster.go:125: [kubelet-check] The kubelet is healthy after 10.563375ms" L45: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s" L46: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.16:6443/livez" L47: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz" L48: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez" L49: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 30.873173ms" L50: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 99.175537ms" L51: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 8.017726902s" L52: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace" L53: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster" L54: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs" L55: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]" L56: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]" L57: "cluster.go:125: [bootstrap-token] Using token: k5evlr.w9pwt2c7oh20q0qi" L58: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles" L59: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes" L60: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials" L61: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token" L62: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster" L63: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the API server kubelet client certificate to access the kubelet API" L64: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace" L65: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key" L66: "cluster.go:125: [addons] Applied essential addon: CoreDNS" L67: "cluster.go:125: [addons] Applied essential addon: kube-proxy" L68: "cluster.go:125: " L69: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!" L70: "cluster.go:125: " L71: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:" L72: "cluster.go:125: " L73: "cluster.go:125: mkdir -p $HOME/.kube" L74: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config" L75: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config" L76: "cluster.go:125: " L77: "cluster.go:125: Alternatively, if you are the root user, you can run:" L78: "cluster.go:125: " L79: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf" L80: "cluster.go:125: " L81: "cluster.go:125: You should now deploy a pod network to the cluster." L82: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:" L83: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/" L84: "cluster.go:125: " L85: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:" L86: "cluster.go:125: " L87: "cluster.go:125: kubeadm join 10.0.0.16:6443 --token k5evlr.w9pwt2c7oh20q0qi _" L88: "cluster.go:125: --discovery-token-ca-cert-hash sha256:40226b7163929113d3f3925ef6f748f327b80bd01741201cadd045463cfeb292 " L89: "cluster.go:125: i Using Cilium version 1.12.5" L90: "cluster.go:125: ? Auto-detected cluster name: kubernetes" L91: "cluster.go:125: ? Auto-detected datapath mode: tunnel" L92: "cluster.go:125: ? Auto-detected kube-proxy has been installed" L93: "cluster.go:125: i helm template --namespace kube-system cilium cilium/cilium --version 1.12.5 --set cluster.id=0,cluster.name=kubernetes,encryption.nodeEncryption=false,extraConfig.cluster-pool-ipv4-?cidr=192.168.0.0/17,extraConfig.enable-endpoint-routes=true,kubeProxyReplacement=disabled,operator.replicas=1,serviceAccounts.cilium.name=cilium,serviceAccounts.operator.name=cilium-operator,tunnel=vx?lan" L94: "cluster.go:125: i Storing helm values file in kube-system/cilium-cli-helm-values Secret" L95: "cluster.go:125: ? Created CA in secret cilium-ca" L96: "cluster.go:125: ? Generating certificates for Hubble..." L97: "cluster.go:125: ? Creating Service accounts..." L98: "cluster.go:125: ? Creating Cluster roles..." L99: "cluster.go:125: ? Creating ConfigMap for Cilium version 1.12.5..." L100: "cluster.go:125: i Manual overwrite in ConfigMap: enable-endpoint-routes=true" L101: "cluster.go:125: i Manual overwrite in ConfigMap: cluster-pool-ipv4-cidr=192.168.0.0/17" L102: "cluster.go:125: ? Creating Agent DaemonSet..." L103: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/mount-cgroup]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L104: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/apply-sysctl-overwrites]: deprecated since v1.30; use the ___appArmorProfile___ fi?eld instead__ subsys=klog" L105: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/clean-cilium-state]: deprecated since v1.30; use the ___appArmorProfile___ field i?nstead__ subsys=klog" L106: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/cilium-agent]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L107: "cluster.go:125: ? Creating Operator Deployment..." L108: "cluster.go:125: ? Waiting for Cilium to be installed and ready..." L109: "cluster.go:125: ? Restarting unmanaged pods..." L110: "cluster.go:125: ? Restarted unmanaged pod kube-system/coredns-559f6c778d-m6l8t" L111: "cluster.go:125: ? Restarted unmanaged pod kube-system/coredns-559f6c778d-v7sch" L112: "cluster.go:125: ? Cilium was successfully installed! Run _cilium status_ to view installation health" L113: "cluster.go:125: ?[33m /??_" L114: "cluster.go:125: ?[36m /???[33m___/?[32m??_?[0m Cilium: ?[32mOK?[0m" L115: "cluster.go:125: ?[36m ___?[31m/??_?[32m__/?[0m Operator: ?[32mOK?[0m" L116: "cluster.go:125: ?[32m /???[31m___/?[35m??_?[0m Hubble: ?[36mdisabled?[0m" L117: "cluster.go:125: ?[32m ___?[34m/??_?[35m__/?[0m ClusterMesh: ?[36mdisabled?[0m" L118: "cluster.go:125: ?[34m ___/" L119: "cluster.go:125: ?[0m" L120: "cluster.go:125: Deployment cilium-operator Desired: 1, Ready: ?[32m1/1?[0m, Available: ?[32m1/1?[0m" L121: "cluster.go:125: DaemonSet cilium Desired: 1, Ready: ?[32m1/1?[0m, Available: ?[32m1/1?[0m" L122: "cluster.go:125: Containers: cilium Running: ?[32m1?[0m" L123: "cluster.go:125: cilium-operator Running: ?[32m1?[0m" L124: "cluster.go:125: Cluster Pods: 0/4 managed by Cilium" L125: "cluster.go:125: Image versions cilium quay.io/cilium/cilium:v1.12.5@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5: 1" L126: "cluster.go:125: cilium-operator quay.io/cilium/operator-generic:v1.12.5@sha256:b296eb7f0f7656a5cc19724f40a8a7121b7fd725278b7d61dc91fe0b7ffd7c0e: 1" L127: "cluster.go:125: W1021 14:38:02.957511 1609 joinconfiguration.go:112] [config] WARNING: Ignored configuration document with GroupVersionKind kubelet.config.k8s.io/v1beta1, Kind=KubeletConfiguration" L128: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L129: "--- FAIL: kubeadm.v1.37.0.cilium.base/IPSec_encryption (74.78s)" L130: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/mount-cgroup]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L131: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/apply-sysctl-overwrites]: deprecated since v1.30; use the ___appArmorProfile___ fi?eld instead__ subsys=klog" L132: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/clean-cilium-state]: deprecated since v1.30; use the ___appArmorProfile___ field i?nstead__ subsys=klog" L133: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/cilium-agent]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L134: "cluster.go:125: Error: Unable to determine status: timeout while waiting for status to become successful: context deadline exceeded" L135: "cluster.go:145: __/opt/bin/cilium status --wait --wait-duration 1m__ failed: output ?[33m /????_" L136: "?[36m /?????[33m___/?[32m????_?[0m Cilium: ?[31m1 errors?[0m, ?[33m1 warnings?[0m" L137: "?[36m ___?[31m/????_?[32m__/?[0m Operator: ?[32mOK?[0m" L138: "?[32m /?????[31m___/?[35m????_?[0m Hubble: ?[36mdisabled?[0m" L139: "?[32m ___?[34m/????_?[35m__/?[0m ClusterMesh: ?[36mdisabled?[0m" L140: "?[34m ___/" L141: "?[0m" L142: "DaemonSet cilium Desired: 2, Ready: ?[33m1/2?[0m, Available: ?[33m1/2?[0m, Unavailable: ?[31m1/2?[0m" L143: "Deployment cilium-operator Desired: 1, Ready: ?[32m1/1?[0m, Available: ?[32m1/1?[0m" L144: "Containers: cilium Running: ?[32m2?[0m" L145: "cilium-operator Running: ?[32m1?[0m" L146: "Cluster Pods: 5/5 managed by Cilium" L147: "Image versions cilium quay.io/cilium/cilium:v1.12.5@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5: 2" L148: "cilium-operator quay.io/cilium/operator-generic:v1.12.5@sha256:b296eb7f0f7656a5cc19724f40a8a7121b7fd725278b7d61dc91fe0b7ffd7c0e: 1" L149: "Errors: cilium cilium 1 pods of DaemonSet cilium are not ready" L150: "Warnings: cilium cilium-dp855 Hubble: Server not initialized, status Process exited with status 1_" L151: " " ```                 Diagnostic output for qemu, run 3 ``` L1: " Error: _cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.37.1" L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.37.1" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.37.1" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.37.1" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.14.6" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.2" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.7.0-0" L8: "cluster.go:125: [init] Using Kubernetes version: v1.37.1" L9: "cluster.go:125: [preflight] Running pre-flight checks" L10: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L11: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L12: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L13: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L14: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L15: "cluster.go:125: [certs] Generating __ca__ certificate and key" L16: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L17: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local localhost] and IPs [10.96.0.1 10.0.0.6?]" L18: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L19: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L20: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L21: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L22: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L23: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L24: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L25: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L26: "cluster.go:125: [certs] Generating __sa__ key and public key" L27: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L28: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L29: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L30: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L31: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L32: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L33: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L34: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L35: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L36: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L37: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L38: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__" L39: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__" L40: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L41: "cluster.go:125: [kubelet-start] Starting the kubelet" L42: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__" L43: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s" L44: "cluster.go:125: [kubelet-check] The kubelet is healthy after 957.862??s" L45: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s" L46: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.6:6443/livez" L47: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz" L48: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez" L49: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 9.506407ms" L50: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 11.270815ms" L51: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 3.01633068s" L52: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace" L53: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster" L54: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs" L55: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]" L56: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]" L57: "cluster.go:125: [bootstrap-token] Using token: fm8sfc.crpyr1ajoknslctz" L58: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles" L59: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes" L60: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials" L61: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token" L62: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster" L63: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the API server kubelet client certificate to access the kubelet API" L64: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace" L65: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key" L66: "cluster.go:125: [addons] Applied essential addon: CoreDNS" L67: "cluster.go:125: [addons] Applied essential addon: kube-proxy" L68: "cluster.go:125: " L69: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!" L70: "cluster.go:125: " L71: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:" L72: "cluster.go:125: " L73: "cluster.go:125: mkdir -p $HOME/.kube" L74: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config" L75: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config" L76: "cluster.go:125: " L77: "cluster.go:125: Alternatively, if you are the root user, you can run:" L78: "cluster.go:125: " L79: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf" L80: "cluster.go:125: " L81: "cluster.go:125: You should now deploy a pod network to the cluster." L82: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:" L83: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/" L84: "cluster.go:125: " L85: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:" L86: "cluster.go:125: " L87: "cluster.go:125: kubeadm join 10.0.0.6:6443 --token fm8sfc.crpyr1ajoknslctz _" L88: "cluster.go:125: --discovery-token-ca-cert-hash sha256:7ff0e3a62e138869dd9a7c916e39e0419976977134e18811d7e04ba10b319d80 " L89: "cluster.go:125: i Using Cilium version 1.12.5" L90: "cluster.go:125: ? Auto-detected cluster name: kubernetes" L91: "cluster.go:125: ? Auto-detected datapath mode: tunnel" L92: "cluster.go:125: ? Auto-detected kube-proxy has been installed" L93: "cluster.go:125: i helm template --namespace kube-system cilium cilium/cilium --version 1.12.5 --set cluster.id=0,cluster.name=kubernetes,encryption.nodeEncryption=false,extraConfig.cluster-pool-ipv4-?cidr=192.168.0.0/17,extraConfig.enable-endpoint-routes=true,kubeProxyReplacement=disabled,operator.replicas=1,serviceAccounts.cilium.name=cilium,serviceAccounts.operator.name=cilium-operator,tunnel=vx?lan" L94: "cluster.go:125: i Storing helm values file in kube-system/cilium-cli-helm-values Secret" L95: "cluster.go:125: ? Created CA in secret cilium-ca" L96: "cluster.go:125: ? Generating certificates for Hubble..." L97: "cluster.go:125: ? Creating Service accounts..." L98: "cluster.go:125: ? Creating Cluster roles..." L99: "cluster.go:125: ? Creating ConfigMap for Cilium version 1.12.5..." L100: "cluster.go:125: i Manual overwrite in ConfigMap: enable-endpoint-routes=true" L101: "cluster.go:125: i Manual overwrite in ConfigMap: cluster-pool-ipv4-cidr=192.168.0.0/17" L102: "cluster.go:125: ? Creating Agent DaemonSet..." L103: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/mount-cgroup]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L104: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/apply-sysctl-overwrites]: deprecated since v1.30; use the ___appArmorProfile___ fi?eld instead__ subsys=klog" L105: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/clean-cilium-state]: deprecated since v1.30; use the ___appArmorProfile___ field i?nstead__ subsys=klog" L106: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/cilium-agent]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L107: "cluster.go:125: ? Creating Operator Deployment..." L108: "cluster.go:125: ? Waiting for Cilium to be installed and ready..." L109: "cluster.go:125: ? Cilium was successfully installed! Run _cilium status_ to view installation health" L110: "cluster.go:125: ?[33m /??_" L111: "cluster.go:125: ?[36m /???[33m___/?[32m??_?[0m Cilium: ?[32mOK?[0m" L112: "cluster.go:125: ?[36m ___?[31m/??_?[32m__/?[0m Operator: ?[32mOK?[0m" L113: "cluster.go:125: ?[32m /???[31m___/?[35m??_?[0m Hubble: ?[36mdisabled?[0m" L114: "cluster.go:125: ?[32m ___?[34m/??_?[35m__/?[0m ClusterMesh: ?[36mdisabled?[0m" L115: "cluster.go:125: ?[34m ___/" L116: "cluster.go:125: ?[0m" L117: "cluster.go:125: DaemonSet cilium " L118: "cluster.go:125: Deployment cilium-operator " L119: "cluster.go:125: Containers: cilium " L120: "cluster.go:125: cilium-operator " L121: "cluster.go:125: Cluster Pods: 0/0 managed by Cilium" L122: "cluster.go:125: W1021 13:45:24.073792 1619 joinconfiguration.go:112] [config] WARNING: Ignored configuration document with GroupVersionKind kubelet.config.k8s.io/v1beta1, Kind=KubeletConfiguration" L123: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L124: "--- FAIL: kubeadm.v1.37.0.cilium.base/IPSec_encryption (68.95s)" L125: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/mount-cgroup]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L126: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/apply-sysctl-overwrites]: deprecated since v1.30; use the ___appArmorProfile___ fi?eld instead__ subsys=klog" L127: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/clean-cilium-state]: deprecated since v1.30; use the ___appArmorProfile___ field i?nstead__ subsys=klog" L128: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/cilium-agent]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L129: "cluster.go:125: Error: Unable to determine status: timeout while waiting for status to become successful: context deadline exceeded" L130: "cluster.go:145: __/opt/bin/cilium status --wait --wait-duration 1m__ failed: output ?[33m /????_" L131: "?[36m /?????[33m___/?[32m????_?[0m Cilium: ?[31m2 errors?[0m" L132: "?[36m ___?[31m/????_?[32m__/?[0m Operator: ?[32mOK?[0m" L133: "?[32m /?????[31m___/?[35m????_?[0m Hubble: ?[36mdisabled?[0m" L134: "?[32m ___?[34m/????_?[35m__/?[0m ClusterMesh: ?[36mdisabled?[0m" L135: "?[34m ___/" L136: "?[0m" L137: "DaemonSet cilium Desired: 2, Ready: ?[33m1/2?[0m, Available: ?[33m1/2?[0m, Unavailable: ?[31m1/2?[0m" L138: "Deployment cilium-operator Desired: 1, Ready: ?[32m1/1?[0m, Available: ?[32m1/1?[0m" L139: "Containers: cilium Running: ?[32m2?[0m" L140: "cilium-operator Running: ?[32m1?[0m" L141: "Cluster Pods: 5/5 managed by Cilium" L142: "Image versions cilium quay.io/cilium/cilium:v1.12.5@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5: 2" L143: "cilium-operator quay.io/cilium/operator-generic:v1.12.5@sha256:b296eb7f0f7656a5cc19724f40a8a7121b7fd725278b7d61dc91fe0b7ffd7c0e: 1" L144: "Errors: cilium cilium 1 pods of DaemonSet cilium are not ready" L145: "cilium cilium-h5m5g unable to retrieve cilium status: command terminated with exit code 1, status Process exited with status 1_" L146: " " ```                 Diagnostic output for qemu, run 2 ``` L1: " Error: _cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.37.1" L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.37.1" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.37.1" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.37.1" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.14.6" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.2" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.7.0-0" L8: "cluster.go:125: W1021 12:53:46.697718 2436 version.go:108] could not fetch a Kubernetes version from the internet: unable to get URL __https://dl.k8s.io/release/stable-1.txt__: Get __https://dl.k8s?.io/release/stable-1.txt__: context deadline exceeded (Client.Timeout exceeded while awaiting headers)" L9: "cluster.go:125: W1021 12:53:46.733056 2436 version.go:109] falling back to the local client version: v1.37.0" L10: "cluster.go:125: [init] Using Kubernetes version: v1.37.0" L11: "cluster.go:125: [preflight] Running pre-flight checks" L12: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L13: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L14: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L15: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L16: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L17: "cluster.go:125: [certs] Generating __ca__ certificate and key" L18: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L19: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local localhost] and IPs [10.96.0.1 10.0.0.8?]" L20: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L21: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L22: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L23: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L24: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L25: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L26: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L27: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L28: "cluster.go:125: [certs] Generating __sa__ key and public key" L29: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L30: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L31: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L32: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L33: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L34: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L35: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L36: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L37: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L38: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L39: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L40: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__" L41: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__" L42: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L43: "cluster.go:125: [kubelet-start] Starting the kubelet" L44: "cluster.go:125: error: error execution phase wait-control-plane: cannot obtain client without bootstrap: could not bootstrap the admin user in file admin.conf: unable to create ClusterRoleBinding: Pos?t __https://10.0.0.8:6443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings?timeout=10s__: context deadline exceeded" L45: "cluster.go:125: To see the stack trace of this error execute with --v=5 or higher" L46: "kubeadm.go:197: unable to setup cluster: unable to run master script: Process exited with status 1" L47: "harness.go:621: Found systemd dependency unit failed to start (?[0;1;39msystemd-fsck????[0mle System Check on /dev/mapper/usr. ) on machine 85cd9367-3bc8-459b-ad89-634627c63327 console_" L48: " " ```                 Diagnostic output for qemu, run 1 ``` L1: " Error: _cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.37.1" L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.37.1" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.37.1" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.37.1" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.14.6" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.2" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.7.0-0" L8: "cluster.go:125: [init] Using Kubernetes version: v1.37.1" L9: "cluster.go:125: [preflight] Running pre-flight checks" L10: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L11: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L12: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L13: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L14: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L15: "cluster.go:125: [certs] Generating __ca__ certificate and key" L16: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L17: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local localhost] and IPs [10.96.0.1 10.0.0.1?6]" L18: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L19: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L20: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L21: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L22: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L23: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L24: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L25: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L26: "cluster.go:125: [certs] Generating __sa__ key and public key" L27: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L28: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L29: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L30: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L31: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L32: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L33: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L34: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L35: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L36: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L37: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L38: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__" L39: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__" L40: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L41: "cluster.go:125: [kubelet-start] Starting the kubelet" L42: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__" L43: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s" L44: "cluster.go:125: [kubelet-check] The kubelet is healthy after 1.208391ms" L45: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s" L46: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.16:6443/livez" L47: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz" L48: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez" L49: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 13.534717ms" L50: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 20.213731ms" L51: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 3.009736283s" L52: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace" L53: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster" L54: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs" L55: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]" L56: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]" L57: "cluster.go:125: [bootstrap-token] Using token: 3pwfo2.yokdhvt1cnisiv2n" L58: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles" L59: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes" L60: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials" L61: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token" L62: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster" L63: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the API server kubelet client certificate to access the kubelet API" L64: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace" L65: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key" L66: "cluster.go:125: [addons] Applied essential addon: CoreDNS" L67: "cluster.go:125: [addons] Applied essential addon: kube-proxy" L68: "cluster.go:125: " L69: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!" L70: "cluster.go:125: " L71: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:" L72: "cluster.go:125: " L73: "cluster.go:125: mkdir -p $HOME/.kube" L74: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config" L75: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config" L76: "cluster.go:125: " L77: "cluster.go:125: Alternatively, if you are the root user, you can run:" L78: "cluster.go:125: " L79: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf" L80: "cluster.go:125: " L81: "cluster.go:125: You should now deploy a pod network to the cluster." L82: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:" L83: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/" L84: "cluster.go:125: " L85: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:" L86: "cluster.go:125: " L87: "cluster.go:125: kubeadm join 10.0.0.16:6443 --token 3pwfo2.yokdhvt1cnisiv2n _" L88: "cluster.go:125: --discovery-token-ca-cert-hash sha256:73cfae7c5ad2cc85ff74cf43c708496162f40257e7847a617866f07bcea61b88 " L89: "cluster.go:125: i Using Cilium version 1.12.5" L90: "cluster.go:125: ? Auto-detected cluster name: kubernetes" L91: "cluster.go:125: ? Auto-detected datapath mode: tunnel" L92: "cluster.go:125: ? Auto-detected kube-proxy has been installed" L93: "cluster.go:125: i helm template --namespace kube-system cilium cilium/cilium --version 1.12.5 --set cluster.id=0,cluster.name=kubernetes,encryption.nodeEncryption=false,extraConfig.cluster-pool-ipv4-?cidr=192.168.0.0/17,extraConfig.enable-endpoint-routes=true,kubeProxyReplacement=disabled,operator.replicas=1,serviceAccounts.cilium.name=cilium,serviceAccounts.operator.name=cilium-operator,tunnel=vx?lan" L94: "cluster.go:125: i Storing helm values file in kube-system/cilium-cli-helm-values Secret" L95: "cluster.go:125: ? Created CA in secret cilium-ca" L96: "cluster.go:125: ? Generating certificates for Hubble..." L97: "cluster.go:125: ? Creating Service accounts..." L98: "cluster.go:125: ? Creating Cluster roles..." L99: "cluster.go:125: ? Creating ConfigMap for Cilium version 1.12.5..." L100: "cluster.go:125: i Manual overwrite in ConfigMap: enable-endpoint-routes=true" L101: "cluster.go:125: i Manual overwrite in ConfigMap: cluster-pool-ipv4-cidr=192.168.0.0/17" L102: "cluster.go:125: ? Creating Agent DaemonSet..." L103: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/mount-cgroup]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L104: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/apply-sysctl-overwrites]: deprecated since v1.30; use the ___appArmorProfile___ fi?eld instead__ subsys=klog" L105: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/clean-cilium-state]: deprecated since v1.30; use the ___appArmorProfile___ field i?nstead__ subsys=klog" L106: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/cilium-agent]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L107: "cluster.go:125: ? Creating Operator Deployment..." L108: "cluster.go:125: ? Waiting for Cilium to be installed and ready..." L109: "cluster.go:125: ? Cilium was successfully installed! Run _cilium status_ to view installation health" L110: "cluster.go:125: ?[33m /??_" L111: "cluster.go:125: ?[36m /???[33m___/?[32m??_?[0m Cilium: ?[32mOK?[0m" L112: "cluster.go:125: ?[36m ___?[31m/??_?[32m__/?[0m Operator: ?[32mOK?[0m" L113: "cluster.go:125: ?[32m /???[31m___/?[35m??_?[0m Hubble: ?[36mdisabled?[0m" L114: "cluster.go:125: ?[32m ___?[34m/??_?[35m__/?[0m ClusterMesh: ?[36mdisabled?[0m" L115: "cluster.go:125: ?[34m ___/" L116: "cluster.go:125: ?[0m" L117: "cluster.go:125: DaemonSet cilium Desired: 1, Ready: ?[32m1/1?[0m, Available: ?[32m1/1?[0m" L118: "cluster.go:125: Deployment cilium-operator Desired: 1, Ready: ?[32m1/1?[0m, Available: ?[32m1/1?[0m" L119: "cluster.go:125: Containers: cilium Running: ?[32m1?[0m" L120: "cluster.go:125: cilium-operator Running: ?[32m1?[0m" L121: "cluster.go:125: Cluster Pods: 2/2 managed by Cilium" L122: "cluster.go:125: Image versions cilium quay.io/cilium/cilium:v1.12.5@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5: 1" L123: "cluster.go:125: cilium-operator quay.io/cilium/operator-generic:v1.12.5@sha256:b296eb7f0f7656a5cc19724f40a8a7121b7fd725278b7d61dc91fe0b7ffd7c0e: 1" L124: "cluster.go:125: W1021 07:48:49.847004 1585 joinconfiguration.go:112] [config] WARNING: Ignored configuration document with GroupVersionKind kubelet.config.k8s.io/v1beta1, Kind=KubeletConfiguration" L125: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L126: "--- FAIL: kubeadm.v1.37.0.cilium.base/IPSec_encryption (99.11s)" L127: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/mount-cgroup]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L128: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/apply-sysctl-overwrites]: deprecated since v1.30; use the ___appArmorProfile___ fi?eld instead__ subsys=klog" L129: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/clean-cilium-state]: deprecated since v1.30; use the ___appArmorProfile___ field i?nstead__ subsys=klog" L130: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/cilium-agent]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L131: "cluster.go:125: Error: Unable to determine status: timeout while waiting for status to become successful: context deadline exceeded" L132: "cluster.go:145: __/opt/bin/cilium status --wait --wait-duration 1m__ failed: output ?[33m /????_" L133: "?[36m /?????[33m___/?[32m????_?[0m Cilium: ?[31m2 errors?[0m" L134: "?[36m ___?[31m/????_?[32m__/?[0m Operator: ?[32mOK?[0m" L135: "?[32m /?????[31m___/?[35m????_?[0m Hubble: ?[36mdisabled?[0m" L136: "?[32m ___?[34m/????_?[35m__/?[0m ClusterMesh: ?[36mdisabled?[0m" L137: "?[34m ___/" L138: "?[0m" L139: "DaemonSet cilium Desired: 2, Ready: ?[33m1/2?[0m, Available: ?[33m1/2?[0m, Unavailable: ?[31m1/2?[0m" L140: "Deployment cilium-operator Desired: 1, Ready: ?[32m1/1?[0m, Available: ?[32m1/1?[0m" L141: "Containers: cilium-operator Running: ?[32m1?[0m" L142: "cilium Running: ?[32m2?[0m" L143: "Cluster Pods: 5/5 managed by Cilium" L144: "Image versions cilium quay.io/cilium/cilium:v1.12.5@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5: 2" L145: "cilium-operator quay.io/cilium/operator-generic:v1.12.5@sha256:b296eb7f0f7656a5cc19724f40a8a7121b7fd725278b7d61dc91fe0b7ffd7c0e: 1" L146: "Errors: cilium cilium 1 pods of DaemonSet cilium are not ready" L147: "cilium cilium-ctzpr unable to retrieve cilium status: command terminated with exit code 1, status Process exited with status 1_" L148: " " ```
❌ not ok **kubeadm.v1.37.0.flannel.base**; Failed: qemu (1, 2, 3, 4, 5)
                Diagnostic output for qemu, run 5 ``` L1: " Error: _cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.37.1" L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.37.1" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.37.1" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.37.1" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.14.6" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.2" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.7.0-0" L8: "cluster.go:125: [init] Using Kubernetes version: v1.37.1" L9: "cluster.go:125: [preflight] Running pre-flight checks" L10: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L11: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L12: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L13: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L14: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L15: "cluster.go:125: [certs] Generating __ca__ certificate and key" L16: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L17: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local localhost] and IPs [10.96.0.1 10.0.0.5?]" L18: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L19: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L20: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L21: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L22: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L23: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L24: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L25: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L26: "cluster.go:125: [certs] Generating __sa__ key and public key" L27: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L28: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L29: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L30: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L31: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L32: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L33: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L34: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L35: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L36: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L37: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L38: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__" L39: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__" L40: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L41: "cluster.go:125: [kubelet-start] Starting the kubelet" L42: "cluster.go:125: error: error execution phase wait-control-plane: cannot obtain client without bootstrap: could not bootstrap the admin user in file admin.conf: unable to create ClusterRoleBinding: Pos?t __https://10.0.0.5:6443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings?timeout=10s__: context deadline exceeded" L43: "cluster.go:125: To see the stack trace of this error execute with --v=5 or higher" L44: "kubeadm.go:197: unable to setup cluster: unable to run master script: Process exited with status 1_" L45: " " ```                 Diagnostic output for qemu, run 4 ``` L1: " Error: _cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.37.1" L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.37.1" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.37.1" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.37.1" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.14.6" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.2" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.7.0-0" L8: "cluster.go:125: [init] Using Kubernetes version: v1.37.1" L9: "cluster.go:125: [preflight] Running pre-flight checks" L10: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L11: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L12: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L13: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L14: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L15: "cluster.go:125: [certs] Generating __ca__ certificate and key" L16: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L17: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local localhost] and IPs [10.96.0.1 10.0.0.8?]" L18: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L19: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L20: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L21: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L22: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L23: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L24: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L25: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L26: "cluster.go:125: [certs] Generating __sa__ key and public key" L27: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L28: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L29: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L30: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L31: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L32: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L33: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L34: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L35: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L36: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L37: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L38: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__" L39: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__" L40: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L41: "cluster.go:125: [kubelet-start] Starting the kubelet" L42: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__" L43: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s" L44: "cluster.go:125: [kubelet-check] The kubelet is healthy after 6.795801ms" L45: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s" L46: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.8:6443/livez" L47: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz" L48: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez" L49: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 74.599709ms" L50: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 80.363713ms" L51: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 1m9.014480179s" L52: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace" L53: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster" L54: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs" L55: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]" L56: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]" L57: "cluster.go:125: [bootstrap-token] Using token: ahostt.0zxqtdb5ess7g7k7" L58: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles" L59: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes" L60: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials" L61: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token" L62: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster" L63: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the API server kubelet client certificate to access the kubelet API" L64: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace" L65: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key" L66: "cluster.go:125: [addons] Applied essential addon: CoreDNS" L67: "cluster.go:125: [addons] Applied essential addon: kube-proxy" L68: "cluster.go:125: " L69: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!" L70: "cluster.go:125: " L71: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:" L72: "cluster.go:125: " L73: "cluster.go:125: mkdir -p $HOME/.kube" L74: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config" L75: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config" L76: "cluster.go:125: " L77: "cluster.go:125: Alternatively, if you are the root user, you can run:" L78: "cluster.go:125: " L79: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf" L80: "cluster.go:125: " L81: "cluster.go:125: You should now deploy a pod network to the cluster." L82: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:" L83: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/" L84: "cluster.go:125: " L85: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:" L86: "cluster.go:125: " L87: "cluster.go:125: kubeadm join 10.0.0.8:6443 --token ahostt.0zxqtdb5ess7g7k7 _" L88: "cluster.go:125: --discovery-token-ca-cert-hash sha256:5cec6148503a8ce1cae67a5cad7e64a21b07357db9c3950b0837199e0b74e633 " L89: "cluster.go:125: namespace/kube-flannel created" L90: "cluster.go:125: clusterrole.rbac.authorization.k8s.io/flannel created" L91: "cluster.go:125: clusterrolebinding.rbac.authorization.k8s.io/flannel created" L92: "cluster.go:125: serviceaccount/flannel created" L93: "cluster.go:125: configmap/kube-flannel-cfg created" L94: "cluster.go:125: daemonset.apps/kube-flannel-ds created" L95: "cluster.go:125: W1021 14:24:45.016922 1500 joinconfiguration.go:112] [config] WARNING: Ignored configuration document with GroupVersionKind kubelet.config.k8s.io/v1beta1, Kind=KubeletConfiguration" L96: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L97: "cluster.go:125: jq: error (at                 Diagnostic output for qemu, run 3 ``` L1: " Error: _cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.37.1" L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.37.1" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.37.1" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.37.1" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.14.6" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.2" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.7.0-0" L8: "cluster.go:125: [init] Using Kubernetes version: v1.37.1" L9: "cluster.go:125: [preflight] Running pre-flight checks" L10: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L11: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L12: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L13: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L14: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L15: "cluster.go:125: [certs] Generating __ca__ certificate and key" L16: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L17: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local localhost] and IPs [10.96.0.1 10.0.0.1?7]" L18: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L19: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L20: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L21: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L22: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L23: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L24: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L25: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L26: "cluster.go:125: [certs] Generating __sa__ key and public key" L27: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L28: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L29: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L30: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L31: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L32: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L33: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L34: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L35: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L36: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L37: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L38: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__" L39: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__" L40: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L41: "cluster.go:125: [kubelet-start] Starting the kubelet" L42: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__" L43: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s" L44: "cluster.go:125: [kubelet-check] The kubelet is healthy after 1.385662ms" L45: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s" L46: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.17:6443/livez" L47: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz" L48: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez" L49: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 34.186948ms" L50: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 42.615367ms" L51: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 13.038616844s" L52: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace" L53: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster" L54: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs" L55: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]" L56: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]" L57: "cluster.go:125: [bootstrap-token] Using token: db2mqk.2jnfplbi0229ad2f" L58: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles" L59: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes" L60: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials" L61: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token" L62: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster" L63: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the API server kubelet client certificate to access the kubelet API" L64: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace" L65: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key" L66: "cluster.go:125: [addons] Applied essential addon: CoreDNS" L67: "cluster.go:125: [addons] Applied essential addon: kube-proxy" L68: "cluster.go:125: " L69: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!" L70: "cluster.go:125: " L71: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:" L72: "cluster.go:125: " L73: "cluster.go:125: mkdir -p $HOME/.kube" L74: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config" L75: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config" L76: "cluster.go:125: " L77: "cluster.go:125: Alternatively, if you are the root user, you can run:" L78: "cluster.go:125: " L79: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf" L80: "cluster.go:125: " L81: "cluster.go:125: You should now deploy a pod network to the cluster." L82: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:" L83: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/" L84: "cluster.go:125: " L85: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:" L86: "cluster.go:125: " L87: "cluster.go:125: kubeadm join 10.0.0.17:6443 --token db2mqk.2jnfplbi0229ad2f _" L88: "cluster.go:125: --discovery-token-ca-cert-hash sha256:039a0bbebf623c495e5d217d0c9dfbc3b2014f8719fb06246f285ed1fd4d6c57 " L89: "cluster.go:125: namespace/kube-flannel created" L90: "cluster.go:125: clusterrole.rbac.authorization.k8s.io/flannel created" L91: "cluster.go:125: clusterrolebinding.rbac.authorization.k8s.io/flannel created" L92: "cluster.go:125: serviceaccount/flannel created" L93: "cluster.go:125: configmap/kube-flannel-cfg created" L94: "cluster.go:125: daemonset.apps/kube-flannel-ds created" L95: "cluster.go:125: W1021 14:02:54.101542 1526 joinconfiguration.go:112] [config] WARNING: Ignored configuration document with GroupVersionKind kubelet.config.k8s.io/v1beta1, Kind=KubeletConfiguration" L96: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L97: "cluster.go:125: jq: error (at                 Diagnostic output for qemu, run 2 ``` L1: " Error: _cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.37.1" L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.37.1" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.37.1" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.37.1" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.14.6" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.2" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.7.0-0" L8: "cluster.go:125: [init] Using Kubernetes version: v1.37.1" L9: "cluster.go:125: [preflight] Running pre-flight checks" L10: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L11: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L12: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L13: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L14: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L15: "cluster.go:125: [certs] Generating __ca__ certificate and key" L16: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L17: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local localhost] and IPs [10.96.0.1 10.0.0.1?1]" L18: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L19: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L20: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L21: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L22: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L23: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L24: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L25: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L26: "cluster.go:125: [certs] Generating __sa__ key and public key" L27: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L28: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L29: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L30: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L31: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L32: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L33: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L34: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L35: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L36: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L37: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L38: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__" L39: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__" L40: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L41: "cluster.go:125: [kubelet-start] Starting the kubelet" L42: "cluster.go:125: error: error execution phase wait-control-plane: cannot obtain client without bootstrap: could not bootstrap the admin user in file admin.conf: unable to create ClusterRoleBinding: Pos?t __https://10.0.0.11:6443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings?timeout=10s__: context deadline exceeded (Client.Timeout exceeded while awaiting headers)" L43: "cluster.go:125: To see the stack trace of this error execute with --v=5 or higher" L44: "kubeadm.go:197: unable to setup cluster: unable to run master script: Process exited with status 1_" L45: " " ```                 Diagnostic output for qemu, run 1 ``` L1: " Error: _kubeadm.go:197: unable to setup cluster: unable to create master node with large disk: machine __4ae5e781-bf34-4e2b-8099-22513a40c516__ failed to start: ssh journalctl failed: time limit excee?ded: dial tcp 10.0.0.140:22: connect: no route to host" L2: "harness.go:621: Found systemd dependency unit failed to start (systemd-fsck-usr.service - File System Check on /dev/mapper/usr.?[0m ) on machine 4ae5e781-bf34-4e2b-8099-22513a40c516 console_" L3: " " ```
🟢 ok **linux.nfs.v3**; Succeeded: qemu (1) 🟢 ok **linux.nfs.v4**; Succeeded: qemu (1) 🟢 ok **linux.ntp**; Succeeded: qemu (1) 🟢 ok **misc.fips**; Succeeded: qemu (1) 🟢 ok **packages**; Succeeded: qemu (1) 🟢 ok **sysext.custom-docker.sysext**; Succeeded: qemu (1) 🟢 ok **sysext.custom-oem**; Succeeded: qemu (1) 🟢 ok **sysext.disable-containerd**; Succeeded: qemu (1) 🟢 ok **sysext.disable-docker**; Succeeded: qemu (1) 🟢 ok **sysext.simple**; Succeeded: qemu (1) 🟢 ok **systemd.journal.remote**; Succeeded: qemu (1) 🟢 ok **systemd.journal.user**; Succeeded: qemu (1) 🟢 ok **systemd.sysusers.gshadow**; Succeeded: qemu (1)