### Test report for 4628.1.0+nightly-20260427-2100 / amd64 **Platforms tested** : qemu 🟢 ok **bpf.ig**; Succeeded: qemu (1) 🟢 ok **cl.basic**; Succeeded: qemu (1) 🟢 ok **cl.cloudinit.basic**; Succeeded: qemu (1) 🟢 ok **cl.cloudinit.multipart-mime**; Succeeded: qemu (1) 🟢 ok **cl.cloudinit.script**; Succeeded: qemu (1) 🟢 ok **cl.disk.raid0.data**; Succeeded: qemu (1) 🟢 ok **cl.disk.raid0.root**; Succeeded: qemu (1) 🟢 ok **cl.disk.raid1.data**; Succeeded: qemu (1) 🟢 ok **cl.disk.raid1.root**; Succeeded: qemu (1) 🟢 ok **cl.etcd-member.discovery**; Succeeded: qemu (1) 🟢 ok **cl.etcd-member.etcdctlv3**; Succeeded: qemu (1) 🟢 ok **cl.etcd-member.v2-backup-restore**; Succeeded: qemu (1) 🟢 ok **cl.filesystem**; Succeeded: qemu (1) 🟢 ok **cl.flannel.udp**; Succeeded: qemu (1) 🟢 ok **cl.flannel.vxlan**; Succeeded: qemu (1) 🟢 ok **cl.ignition.instantiated.enable-unit**; Succeeded: qemu (1) 🟢 ok **cl.ignition.kargs**; Succeeded: qemu (1) 🟢 ok **cl.ignition.luks**; Succeeded: qemu (1) 🟢 ok **cl.ignition.oem.indirect**; Succeeded: qemu (1) 🟢 ok **cl.ignition.oem.indirect.new**; Succeeded: qemu (1) 🟢 ok **cl.ignition.oem.regular**; Succeeded: qemu (1) 🟢 ok **cl.ignition.oem.regular.new**; Succeeded: qemu (1) 🟢 ok **cl.ignition.oem.reuse**; Succeeded: qemu (1) 🟢 ok **cl.ignition.oem.wipe**; Succeeded: qemu (1) 🟢 ok **cl.ignition.partition_on_boot_disk**; Succeeded: qemu (1) 🟢 ok **cl.ignition.symlink**; Succeeded: qemu (1) 🟢 ok **cl.ignition.translation**; Succeeded: qemu (1) 🟢 ok **cl.ignition.v1.btrfsroot**; Succeeded: qemu (1) 🟢 ok **cl.ignition.v1.ext4root**; Succeeded: qemu (1) 🟢 ok **cl.ignition.v1.groups**; Succeeded: qemu (1) 🟢 ok **cl.ignition.v1.once**; Succeeded: qemu (1) 🟢 ok **cl.ignition.v1.sethostname**; Succeeded: qemu (1) 🟢 ok **cl.ignition.v1.users**; Succeeded: qemu (1) 🟢 ok **cl.ignition.v1.xfsroot**; Succeeded: qemu (1) 🟢 ok **cl.ignition.v2.btrfsroot**; Succeeded: qemu (1) 🟢 ok **cl.ignition.v2.ext4root**; Succeeded: qemu (1) 🟢 ok **cl.ignition.v2.users**; Succeeded: qemu (1) 🟢 ok **cl.ignition.v2.xfsroot**; Succeeded: qemu (1) 🟢 ok **cl.ignition.v2_1.ext4checkexisting**; Succeeded: qemu (2); Failed: qemu (1)
                Diagnostic output for qemu, run 1 ``` L1: " Error: _harness.go:616: Found systemd dependency unit failed to start (?[0;1;39msystemd-fsck????[0mem Check on /dev/disk/by-label/OEM. ) on machine 60daedf4-a4be-4f26-befb-dab0b51d4eb2 console_" L2: " " ```
🟢 ok **cl.ignition.v2_1.swap**; Succeeded: qemu (1) 🟢 ok **cl.ignition.v2_1.vfat**; Succeeded: qemu (1) 🟢 ok **cl.install.cloudinit**; Succeeded: qemu (1) 🟢 ok **cl.internet**; Succeeded: qemu (1) 🟢 ok **cl.locksmith.cluster**; Succeeded: qemu (1) 🟢 ok **cl.network.initramfs.second-boot**; Succeeded: qemu (1) 🟢 ok **cl.network.iptables**; Succeeded: qemu (1) 🟢 ok **cl.network.listeners**; Succeeded: qemu (1) 🟢 ok **cl.network.nftables**; Succeeded: qemu (1) 🟢 ok **cl.network.wireguard**; Succeeded: qemu (1) 🟢 ok **cl.omaha.ping**; Succeeded: qemu (1) 🟢 ok **cl.osreset.ignition-rerun**; Succeeded: qemu (1) 🟢 ok **cl.overlay.cleanup**; Succeeded: qemu (1) 🟢 ok **cl.swap_activation**; Succeeded: qemu (1) 🟢 ok **cl.sysext.boot**; Succeeded: qemu (1) 🟢 ok **cl.sysext.fallbackdownload**; Succeeded: qemu (1) 🟢 ok **cl.tang.nonroot**; Succeeded: qemu (1) 🟢 ok **cl.tang.root**; Succeeded: qemu (1) 🟢 ok **cl.toolbox.dnf-install**; Succeeded: qemu (1) 🟢 ok **cl.tpm.eventlog**; Succeeded: qemu (1) 🟢 ok **cl.tpm.nonroot**; Succeeded: qemu (1) 🟢 ok **cl.tpm.root**; Succeeded: qemu (1) 🟢 ok **cl.tpm.root-cryptenroll**; Succeeded: qemu (1) 🟢 ok **cl.tpm.root-cryptenroll-pcr-noupdate**; Succeeded: qemu (1) 🟢 ok **cl.tpm.root-cryptenroll-pcr-withupdate**; Succeeded: qemu (1) 🟢 ok **cl.update.badverity**; Succeeded: qemu (1) 🟢 ok **cl.update.reboot**; Succeeded: qemu (1) 🟢 ok **cl.users.shells**; Succeeded: qemu (1) 🟢 ok **cl.verity**; Succeeded: qemu (1) 🟢 ok **confext.skiprefresh**; Succeeded: qemu (1) 🟢 ok **coreos.auth.verify**; Succeeded: qemu (1) 🟢 ok **coreos.ignition.groups**; Succeeded: qemu (1) 🟢 ok **coreos.ignition.once**; Succeeded: qemu (1) 🟢 ok **coreos.ignition.resource.local**; Succeeded: qemu (1) 🟢 ok **coreos.ignition.resource.remote**; Succeeded: qemu (1) 🟢 ok **coreos.ignition.resource.s3.versioned**; Succeeded: qemu (1) 🟢 ok **coreos.ignition.security.tls**; Succeeded: qemu (1) 🟢 ok **coreos.ignition.sethostname**; Succeeded: qemu (1) 🟢 ok **coreos.ignition.systemd.enable-service**; Succeeded: qemu (1) 🟢 ok **coreos.locksmith.reboot**; Succeeded: qemu (1) 🟢 ok **coreos.locksmith.tls**; Succeeded: qemu (1) 🟢 ok **coreos.selinux.boolean**; Succeeded: qemu (1) 🟢 ok **coreos.selinux.enforce**; Succeeded: qemu (1) 🟢 ok **coreos.tls.fetch-urls**; Succeeded: qemu (1) 🟢 ok **coreos.update.badusr**; Succeeded: qemu (1) 🟢 ok **devcontainer.docker**; Succeeded: qemu (1) 🟢 ok **devcontainer.systemd-nspawn**; Succeeded: qemu (1) 🟢 ok **docker.base**; Succeeded: qemu (1) 🟢 ok **docker.btrfs-storage**; Succeeded: qemu (1) 🟢 ok **docker.containerd-restart**; Succeeded: qemu (1) 🟢 ok **docker.enable-service.sysext**; Succeeded: qemu (1) 🟢 ok **docker.lib-coreos-dockerd-compat**; Succeeded: qemu (1) 🟢 ok **docker.network-openbsd-nc**; Succeeded: qemu (1) 🟢 ok **docker.selinux**; Succeeded: qemu (1) 🟢 ok **docker.userns**; Succeeded: qemu (1) 🟢 ok **kubeadm.v1.33.8.calico.base**; Succeeded: qemu (3); Failed: qemu (1, 2)
                Diagnostic output for qemu, run 2 ``` L1: " Error: _cluster.go:125: I0428 02:04:18.814938 2077 version.go:261] remote version is much newer: v1.36.0; falling back to: stable-1.33" L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.33.11" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.33.11" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.33.11" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.33.11" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.12.0" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10" L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.5.24-0" L9: "cluster.go:125: I0428 02:05:10.051763 2384 version.go:261] remote version is much newer: v1.36.0; falling back to: stable-1.33" L10: "cluster.go:125: [init] Using Kubernetes version: v1.33.11" L11: "cluster.go:125: [preflight] Running pre-flight checks" L12: "cluster.go:125: [WARNING Service-Kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L13: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L14: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L15: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L16: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L17: "cluster.go:125: [certs] Generating __ca__ certificate and key" L18: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L19: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local localhost] and IPs [10.96.0.1 10.0.0.6?]" L20: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L21: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L22: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L23: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L24: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L25: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L26: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L27: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L28: "cluster.go:125: [certs] Generating __sa__ key and public key" L29: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L30: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L31: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L32: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L33: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L34: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L35: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L36: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L37: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L38: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L39: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L40: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L41: "cluster.go:125: [kubelet-start] Starting the kubelet" L42: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__" L43: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s" L44: "cluster.go:125: [kubelet-check] The kubelet is healthy after 4.011199984s" L45: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s" L46: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.6:6443/livez" L47: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz" L48: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez" L49: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 5.079263832s" L50: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 11.408774966s" L51: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 28.520447593s" L52: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace" L53: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster" L54: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs" L55: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]" L56: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]" L57: "cluster.go:125: [bootstrap-token] Using token: 7ms7hc.4ttq5n4d20yegu6f" L58: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles" L59: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes" L60: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials" L61: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token" L62: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster" L63: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace" L64: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key" L65: "cluster.go:125: [addons] Applied essential addon: CoreDNS" L66: "cluster.go:125: [addons] Applied essential addon: kube-proxy" L67: "cluster.go:125: " L68: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!" L69: "cluster.go:125: " L70: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:" L71: "cluster.go:125: " L72: "cluster.go:125: mkdir -p $HOME/.kube" L73: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config" L74: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config" L75: "cluster.go:125: " L76: "cluster.go:125: Alternatively, if you are the root user, you can run:" L77: "cluster.go:125: " L78: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf" L79: "cluster.go:125: " L80: "cluster.go:125: You should now deploy a pod network to the cluster." L81: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:" L82: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/" L83: "cluster.go:125: " L84: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:" L85: "cluster.go:125: " L86: "cluster.go:125: kubeadm join 10.0.0.6:6443 --token 7ms7hc.4ttq5n4d20yegu6f _" L87: "cluster.go:125: --discovery-token-ca-cert-hash sha256:eecb843a4e76964da3676993326d31a54f2637cc831b6458c01d5b36fc6a901b " L88: "cluster.go:125: namespace/tigera-operator created" L89: "cluster.go:125: serviceaccount/tigera-operator created" L90: "cluster.go:125: clusterrole.rbac.authorization.k8s.io/tigera-operator-secrets created" L91: "cluster.go:125: clusterrole.rbac.authorization.k8s.io/tigera-operator created" L92: "cluster.go:125: clusterrolebinding.rbac.authorization.k8s.io/tigera-operator created" L93: "cluster.go:125: rolebinding.rbac.authorization.k8s.io/tigera-operator-secrets created" L94: "cluster.go:125: deployment.apps/tigera-operator created" L95: "cluster.go:125: customresourcedefinition.apiextensions.k8s.io/installations.operator.tigera.io condition met" L96: "cluster.go:125: error: .status.conditions accessor error:                 Diagnostic output for qemu, run 1 ``` L1: " Error: _cluster.go:125: I0428 00:50:59.468215 2043 version.go:261] remote version is much newer: v1.36.0; falling back to: stable-1.33" L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.33.11" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.33.11" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.33.11" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.33.11" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.12.0" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10" L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.5.24-0" L9: "cluster.go:125: I0428 00:51:17.263211 2279 version.go:261] remote version is much newer: v1.36.0; falling back to: stable-1.33" L10: "cluster.go:125: [init] Using Kubernetes version: v1.33.11" L11: "cluster.go:125: [preflight] Running pre-flight checks" L12: "cluster.go:125: [WARNING Service-Kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L13: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L14: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L15: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L16: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L17: "cluster.go:125: [certs] Generating __ca__ certificate and key" L18: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L19: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local localhost] and IPs [10.96.0.1 10.0.0.8?9]" L20: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L21: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L22: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L23: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L24: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L25: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L26: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L27: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L28: "cluster.go:125: [certs] Generating __sa__ key and public key" L29: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L30: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L31: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L32: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L33: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L34: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L35: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L36: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L37: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L38: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L39: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L40: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L41: "cluster.go:125: [kubelet-start] Starting the kubelet" L42: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__" L43: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s" L44: "cluster.go:125: [kubelet-check] The kubelet is healthy after 1.003357443s" L45: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s" L46: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.89:6443/livez" L47: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz" L48: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez" L49: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 4.048308705s" L50: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 8.689964655s" L51: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 19.008142789s" L52: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace" L53: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster" L54: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs" L55: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]" L56: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]" L57: "cluster.go:125: [bootstrap-token] Using token: 6utqdq.w21exbeho9ch4ngx" L58: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles" L59: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes" L60: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials" L61: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token" L62: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster" L63: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace" L64: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key" L65: "cluster.go:125: [addons] Applied essential addon: CoreDNS" L66: "cluster.go:125: [addons] Applied essential addon: kube-proxy" L67: "cluster.go:125: " L68: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!" L69: "cluster.go:125: " L70: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:" L71: "cluster.go:125: " L72: "cluster.go:125: mkdir -p $HOME/.kube" L73: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config" L74: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config" L75: "cluster.go:125: " L76: "cluster.go:125: Alternatively, if you are the root user, you can run:" L77: "cluster.go:125: " L78: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf" L79: "cluster.go:125: " L80: "cluster.go:125: You should now deploy a pod network to the cluster." L81: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:" L82: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/" L83: "cluster.go:125: " L84: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:" L85: "cluster.go:125: " L86: "cluster.go:125: kubeadm join 10.0.0.89:6443 --token 6utqdq.w21exbeho9ch4ngx _" L87: "cluster.go:125: --discovery-token-ca-cert-hash sha256:7f9f83b55c9734208c6f10badb1cf80dbccd397fa3e8b3bc85ac9b848a8f6825 " L88: "cluster.go:125: namespace/tigera-operator created" L89: "cluster.go:125: serviceaccount/tigera-operator created" L90: "cluster.go:125: clusterrole.rbac.authorization.k8s.io/tigera-operator-secrets created" L91: "cluster.go:125: clusterrole.rbac.authorization.k8s.io/tigera-operator created" L92: "cluster.go:125: clusterrolebinding.rbac.authorization.k8s.io/tigera-operator created" L93: "cluster.go:125: rolebinding.rbac.authorization.k8s.io/tigera-operator-secrets created" L94: "cluster.go:125: deployment.apps/tigera-operator created" L95: "cluster.go:125: customresourcedefinition.apiextensions.k8s.io/installations.operator.tigera.io condition met" L96: "cluster.go:125: error: .status.conditions accessor error: 🟢 ok **kubeadm.v1.33.8.cilium.base**; Succeeded: qemu (4); Failed: qemu (1, 2, 3)
                Diagnostic output for qemu, run 3 ``` L1: " Error: _cluster.go:125: I0428 02:31:46.256390 2033 version.go:261] remote version is much newer: v1.36.0; falling back to: stable-1.33" L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.33.11" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.33.11" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.33.11" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.33.11" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.12.0" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10" L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.5.24-0" L9: "cluster.go:125: I0428 02:32:04.825569 2269 version.go:261] remote version is much newer: v1.36.0; falling back to: stable-1.33" L10: "cluster.go:125: [init] Using Kubernetes version: v1.33.11" L11: "cluster.go:125: [preflight] Running pre-flight checks" L12: "cluster.go:125: [WARNING Service-Kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L13: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L14: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L15: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L16: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L17: "cluster.go:125: [certs] Generating __ca__ certificate and key" L18: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L19: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local localhost] and IPs [10.96.0.1 10.0.0.5?]" L20: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L21: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L22: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L23: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L24: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L25: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L26: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L27: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L28: "cluster.go:125: [certs] Generating __sa__ key and public key" L29: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L30: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L31: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L32: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L33: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L34: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L35: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L36: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L37: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L38: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L39: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L40: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L41: "cluster.go:125: [kubelet-start] Starting the kubelet" L42: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__" L43: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s" L44: "cluster.go:125: [kubelet-check] The kubelet is healthy after 1.502569003s" L45: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s" L46: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.5:6443/livez" L47: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz" L48: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez" L49: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 2.691000849s" L50: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 5.523471537s" L51: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 12.505138877s" L52: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace" L53: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster" L54: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs" L55: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]" L56: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]" L57: "cluster.go:125: [bootstrap-token] Using token: kp5wlp.nu9sdu900wn889b5" L58: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles" L59: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes" L60: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials" L61: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token" L62: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster" L63: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace" L64: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key" L65: "cluster.go:125: [addons] Applied essential addon: CoreDNS" L66: "cluster.go:125: [addons] Applied essential addon: kube-proxy" L67: "cluster.go:125: " L68: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!" L69: "cluster.go:125: " L70: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:" L71: "cluster.go:125: " L72: "cluster.go:125: mkdir -p $HOME/.kube" L73: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config" L74: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config" L75: "cluster.go:125: " L76: "cluster.go:125: Alternatively, if you are the root user, you can run:" L77: "cluster.go:125: " L78: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf" L79: "cluster.go:125: " L80: "cluster.go:125: You should now deploy a pod network to the cluster." L81: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:" L82: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/" L83: "cluster.go:125: " L84: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:" L85: "cluster.go:125: " L86: "cluster.go:125: kubeadm join 10.0.0.5:6443 --token kp5wlp.nu9sdu900wn889b5 _" L87: "cluster.go:125: --discovery-token-ca-cert-hash sha256:069e1d7109643aea77728896b872ce0e77924132c84a553a696e920c5303deea " L88: "cluster.go:125: i Using Cilium version 1.12.5" L89: "cluster.go:125: ? Auto-detected cluster name: kubernetes" L90: "cluster.go:125: ? Auto-detected datapath mode: tunnel" L91: "cluster.go:125: ? Auto-detected kube-proxy has been installed" L92: "cluster.go:125: i helm template --namespace kube-system cilium cilium/cilium --version 1.12.5 --set cluster.id=0,cluster.name=kubernetes,encryption.nodeEncryption=false,extraConfig.cluster-pool-ipv4-?cidr=192.168.0.0/17,extraConfig.enable-endpoint-routes=true,kubeProxyReplacement=disabled,operator.replicas=1,serviceAccounts.cilium.name=cilium,serviceAccounts.operator.name=cilium-operator,tunnel=vx?lan" L93: "cluster.go:125: i Storing helm values file in kube-system/cilium-cli-helm-values Secret" L94: "cluster.go:125: ? Created CA in secret cilium-ca" L95: "cluster.go:125: ? Generating certificates for Hubble..." L96: "cluster.go:125: ? Creating Service accounts..." L97: "cluster.go:125: ? Creating Cluster roles..." L98: "cluster.go:125: ? Creating ConfigMap for Cilium version 1.12.5..." L99: "cluster.go:125: i Manual overwrite in ConfigMap: enable-endpoint-routes=true" L100: "cluster.go:125: i Manual overwrite in ConfigMap: cluster-pool-ipv4-cidr=192.168.0.0/17" L101: "cluster.go:125: ? Creating Agent DaemonSet..." L102: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/mount-cgroup]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L103: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/apply-sysctl-overwrites]: deprecated since v1.30; use the ___appArmorProfile___ fi?eld instead__ subsys=klog" L104: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/clean-cilium-state]: deprecated since v1.30; use the ___appArmorProfile___ field i?nstead__ subsys=klog" L105: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/cilium-agent]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L106: "cluster.go:125: ? Creating Operator Deployment..." L107: "cluster.go:125: ? Waiting for Cilium to be installed and ready..." L108: "cluster.go:125: ? Cilium was successfully installed! Run _cilium status_ to view installation health" L109: "cluster.go:125: ?[33m /??_" L110: "cluster.go:125: ?[36m /???[33m___/?[32m??_?[0m Cilium: ?[32mOK?[0m" L111: "cluster.go:125: ?[36m ___?[31m/??_?[32m__/?[0m Operator: ?[32mOK?[0m" L112: "cluster.go:125: ?[32m /???[31m___/?[35m??_?[0m Hubble: ?[36mdisabled?[0m" L113: "cluster.go:125: ?[32m ___?[34m/??_?[35m__/?[0m ClusterMesh: ?[36mdisabled?[0m" L114: "cluster.go:125: ?[34m ___/" L115: "cluster.go:125: ?[0m" L116: "cluster.go:125: Deployment cilium-operator Desired: 1, Ready: ?[32m1/1?[0m, Available: ?[32m1/1?[0m" L117: "cluster.go:125: DaemonSet cilium Desired: 1, Ready: ?[32m1/1?[0m, Available: ?[32m1/1?[0m" L118: "cluster.go:125: Containers: cilium Running: ?[32m1?[0m" L119: "cluster.go:125: cilium-operator Running: ?[32m1?[0m" L120: "cluster.go:125: Cluster Pods: 2/2 managed by Cilium" L121: "cluster.go:125: Image versions cilium quay.io/cilium/cilium:v1.12.5@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5: 1" L122: "cluster.go:125: cilium-operator quay.io/cilium/operator-generic:v1.12.5@sha256:b296eb7f0f7656a5cc19724f40a8a7121b7fd725278b7d61dc91fe0b7ffd7c0e: 1" L123: "cluster.go:125: W0428 02:35:09.957855 1830 joinconfiguration.go:113] [config] WARNING: Ignored configuration document with GroupVersionKind kubelet.config.k8s.io/v1beta1, Kind=KubeletConfiguration" L124: "cluster.go:125: [WARNING Service-Kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L125: "--- FAIL: kubeadm.v1.33.8.cilium.base/nginx_deployment (262.44s)" L126: "kubeadm.go:232: nginx is not deployed: ready replicas should be equal to 1: null" L127: "--- FAIL: kubeadm.v1.33.8.cilium.base/IPSec_encryption (77.90s)" L128: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/mount-cgroup]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L129: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/apply-sysctl-overwrites]: deprecated since v1.30; use the ___appArmorProfile___ fi?eld instead__ subsys=klog" L130: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/clean-cilium-state]: deprecated since v1.30; use the ___appArmorProfile___ field i?nstead__ subsys=klog" L131: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/cilium-agent]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L132: "cluster.go:125: Error: Unable to determine status: timeout while waiting for status to become successful: context deadline exceeded" L133: "cluster.go:145: __/opt/bin/cilium status --wait --wait-duration 1m__ failed: output ?[33m /????_" L134: "?[36m /?????[33m___/?[32m????_?[0m Cilium: ?[31m1 errors?[0m" L135: "?[36m ___?[31m/????_?[32m__/?[0m Operator: ?[31m1 errors?[0m" L136: "?[32m /?????[31m___/?[35m????_?[0m Hubble: ?[33m1 warnings?[0m" L137: "?[32m ___?[34m/????_?[35m__/?[0m ClusterMesh: ?[33m1 warnings?[0m" L138: "?[34m ___/" L139: "?[0m" L140: "Cluster Pods: 0/0 managed by Cilium" L141: "Errors: cilium cilium client rate limiter Wait returned an error: context deadline exceeded" L142: "cilium-operator cilium-operator client rate limiter Wait returned an error: context deadline exceeded" L143: "Warnings: hubble-relay hubble-relay hubble relay is not deployed" L144: "clustermesh-apiserver clustermesh-apiserver clustermesh is not deployed" L145: "hubble-ui hubble-ui hubble ui is not deployed, status Process exited with status 1_" L146: " " ```                 Diagnostic output for qemu, run 2 ``` L1: " Error: _cluster.go:125: I0428 02:04:19.665410 2053 version.go:261] remote version is much newer: v1.36.0; falling back to: stable-1.33" L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.33.11" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.33.11" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.33.11" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.33.11" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.12.0" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10" L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.5.24-0" L9: "cluster.go:125: I0428 02:05:02.062162 2340 version.go:261] remote version is much newer: v1.36.0; falling back to: stable-1.33" L10: "cluster.go:125: [init] Using Kubernetes version: v1.33.11" L11: "cluster.go:125: [preflight] Running pre-flight checks" L12: "cluster.go:125: [WARNING Service-Kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L13: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L14: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L15: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L16: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L17: "cluster.go:125: [certs] Generating __ca__ certificate and key" L18: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L19: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local localhost] and IPs [10.96.0.1 10.0.0.7?]" L20: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L21: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L22: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L23: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L24: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L25: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L26: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L27: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L28: "cluster.go:125: [certs] Generating __sa__ key and public key" L29: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L30: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L31: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L32: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L33: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L34: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L35: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L36: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L37: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L38: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L39: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L40: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L41: "cluster.go:125: [kubelet-start] Starting the kubelet" L42: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__" L43: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s" L44: "cluster.go:125: [kubelet-check] The kubelet is healthy after 2.533980915s" L45: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s" L46: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.7:6443/livez" L47: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz" L48: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez" L49: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 5.266472382s" L50: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 14.957422072s" L51: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 37.527972711s" L52: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace" L53: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster" L54: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs" L55: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]" L56: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]" L57: "cluster.go:125: [bootstrap-token] Using token: h9y9rv.9vphlybalnsisvmp" L58: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles" L59: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes" L60: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials" L61: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token" L62: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster" L63: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace" L64: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key" L65: "cluster.go:125: [addons] Applied essential addon: CoreDNS" L66: "cluster.go:125: [addons] Applied essential addon: kube-proxy" L67: "cluster.go:125: " L68: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!" L69: "cluster.go:125: " L70: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:" L71: "cluster.go:125: " L72: "cluster.go:125: mkdir -p $HOME/.kube" L73: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config" L74: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config" L75: "cluster.go:125: " L76: "cluster.go:125: Alternatively, if you are the root user, you can run:" L77: "cluster.go:125: " L78: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf" L79: "cluster.go:125: " L80: "cluster.go:125: You should now deploy a pod network to the cluster." L81: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:" L82: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/" L83: "cluster.go:125: " L84: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:" L85: "cluster.go:125: " L86: "cluster.go:125: kubeadm join 10.0.0.7:6443 --token h9y9rv.9vphlybalnsisvmp _" L87: "cluster.go:125: --discovery-token-ca-cert-hash sha256:f3793fcc13d403ea95c46c0a3923dddd911b8b03ffd9eb8068a6dbc4b0c38547 " L88: "cluster.go:125: i Using Cilium version 1.12.5" L89: "cluster.go:125: ? Auto-detected cluster name: kubernetes" L90: "cluster.go:125: ? Auto-detected datapath mode: tunnel" L91: "cluster.go:125: ? Auto-detected kube-proxy has been installed" L92: "cluster.go:125: i helm template --namespace kube-system cilium cilium/cilium --version 1.12.5 --set cluster.id=0,cluster.name=kubernetes,encryption.nodeEncryption=false,extraConfig.cluster-pool-ipv4-?cidr=192.168.0.0/17,extraConfig.enable-endpoint-routes=true,kubeProxyReplacement=disabled,operator.replicas=1,serviceAccounts.cilium.name=cilium,serviceAccounts.operator.name=cilium-operator,tunnel=vx?lan" L93: "cluster.go:125: i Storing helm values file in kube-system/cilium-cli-helm-values Secret" L94: "cluster.go:125: ? Created CA in secret cilium-ca" L95: "cluster.go:125: ? Generating certificates for Hubble..." L96: "cluster.go:125: ? Creating Service accounts..." L97: "cluster.go:125: ? Creating Cluster roles..." L98: "cluster.go:125: ? Creating ConfigMap for Cilium version 1.12.5..." L99: "cluster.go:125: i Manual overwrite in ConfigMap: enable-endpoint-routes=true" L100: "cluster.go:125: i Manual overwrite in ConfigMap: cluster-pool-ipv4-cidr=192.168.0.0/17" L101: "cluster.go:125: ? Creating Agent DaemonSet..." L102: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/mount-cgroup]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L103: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/apply-sysctl-overwrites]: deprecated since v1.30; use the ___appArmorProfile___ fi?eld instead__ subsys=klog" L104: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/clean-cilium-state]: deprecated since v1.30; use the ___appArmorProfile___ field i?nstead__ subsys=klog" L105: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/cilium-agent]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L106: "cluster.go:125: ? Creating Operator Deployment..." L107: "cluster.go:125: ? Waiting for Cilium to be installed and ready..." L108: "cluster.go:125: ? Restarting unmanaged pods..." L109: "cluster.go:125: ? Restarted unmanaged pod kube-system/coredns-674b8bbfcf-b2tcm" L110: "cluster.go:125: ? Restarted unmanaged pod kube-system/coredns-674b8bbfcf-tt5t8" L111: "cluster.go:125: ? Cilium was successfully installed! Run _cilium status_ to view installation health" L112: "cluster.go:125: ?[33m /??_" L113: "cluster.go:125: ?[36m /???[33m___/?[32m??_?[0m Cilium: ?[32mOK?[0m" L114: "cluster.go:125: ?[36m ___?[31m/??_?[32m__/?[0m Operator: ?[32mOK?[0m" L115: "cluster.go:125: ?[32m /???[31m___/?[35m??_?[0m Hubble: ?[36mdisabled?[0m" L116: "cluster.go:125: ?[32m ___?[34m/??_?[35m__/?[0m ClusterMesh: ?[36mdisabled?[0m" L117: "cluster.go:125: ?[34m ___/" L118: "cluster.go:125: ?[0m" L119: "cluster.go:125: Deployment cilium-operator Desired: 1, Ready: ?[32m1/1?[0m, Available: ?[32m1/1?[0m" L120: "cluster.go:125: DaemonSet cilium Desired: 1, Ready: ?[32m1/1?[0m, Available: ?[32m1/1?[0m" L121: "cluster.go:125: Containers: cilium Running: ?[32m1?[0m" L122: "cluster.go:125: cilium-operator Running: ?[32m1?[0m" L123: "cluster.go:125: Cluster Pods: 2/2 managed by Cilium" L124: "cluster.go:125: Image versions cilium quay.io/cilium/cilium:v1.12.5@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5: 1" L125: "cluster.go:125: cilium-operator quay.io/cilium/operator-generic:v1.12.5@sha256:b296eb7f0f7656a5cc19724f40a8a7121b7fd725278b7d61dc91fe0b7ffd7c0e: 1" L126: "cluster.go:125: W0428 02:13:59.550439 1859 joinconfiguration.go:113] [config] WARNING: Ignored configuration document with GroupVersionKind kubelet.config.k8s.io/v1beta1, Kind=KubeletConfiguration" L127: "cluster.go:125: [WARNING Service-Kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L128: "--- FAIL: kubeadm.v1.33.8.cilium.base/nginx_deployment (313.50s)" L129: "kubeadm.go:232: nginx is not deployed: ready replicas should be equal to 1: null" L130: "--- FAIL: kubeadm.v1.33.8.cilium.base/IPSec_encryption (76.62s)" L131: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/mount-cgroup]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L132: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/apply-sysctl-overwrites]: deprecated since v1.30; use the ___appArmorProfile___ fi?eld instead__ subsys=klog" L133: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/clean-cilium-state]: deprecated since v1.30; use the ___appArmorProfile___ field i?nstead__ subsys=klog" L134: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/cilium-agent]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L135: "cluster.go:125: Error: Unable to determine status: timeout while waiting for status to become successful: context deadline exceeded" L136: "cluster.go:145: __/opt/bin/cilium status --wait --wait-duration 1m__ failed: output ?[33m /????_" L137: "?[36m /?????[33m___/?[32m????_?[0m Cilium: ?[31m2 errors?[0m" L138: "?[36m ___?[31m/????_?[32m__/?[0m Operator: ?[32mOK?[0m" L139: "?[32m /?????[31m___/?[35m????_?[0m Hubble: ?[36mdisabled?[0m" L140: "?[32m ___?[34m/????_?[35m__/?[0m ClusterMesh: ?[36mdisabled?[0m" L141: "?[34m ___/" L142: "?[0m" L143: "Deployment cilium-operator Desired: 1, Ready: ?[32m1/1?[0m, Available: ?[32m1/1?[0m" L144: "DaemonSet cilium Desired: 2, Ready: ?[33m1/2?[0m, Available: ?[33m1/2?[0m, Unavailable: ?[31m1/2?[0m" L145: "Containers: cilium Running: ?[32m2?[0m" L146: "cilium-operator Running: ?[32m1?[0m" L147: "Cluster Pods: 0/0 managed by Cilium" L148: "Image versions cilium quay.io/cilium/cilium:v1.12.5@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5: 2" L149: "cilium-operator quay.io/cilium/operator-generic:v1.12.5@sha256:b296eb7f0f7656a5cc19724f40a8a7121b7fd725278b7d61dc91fe0b7ffd7c0e: 1" L150: "Errors: cilium cilium 1 pods of DaemonSet cilium are not ready" L151: "cilium cilium-sbx9h unable to retrieve cilium status: command terminated with exit code 1, status Process exited with status 1_" L152: " " ```                 Diagnostic output for qemu, run 1 ``` L1: " Error: _cluster.go:125: I0428 01:31:06.802056 2093 version.go:261] remote version is much newer: v1.36.0; falling back to: stable-1.33" L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.33.11" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.33.11" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.33.11" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.33.11" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.12.0" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10" L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.5.24-0" L9: "cluster.go:125: I0428 01:31:37.792703 2345 version.go:261] remote version is much newer: v1.36.0; falling back to: stable-1.33" L10: "cluster.go:125: [init] Using Kubernetes version: v1.33.11" L11: "cluster.go:125: [preflight] Running pre-flight checks" L12: "cluster.go:125: [WARNING Service-Kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L13: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L14: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L15: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L16: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L17: "cluster.go:125: [certs] Generating __ca__ certificate and key" L18: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L19: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local localhost] and IPs [10.96.0.1 10.0.0.1?36]" L20: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L21: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L22: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L23: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L24: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L25: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L26: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L27: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L28: "cluster.go:125: [certs] Generating __sa__ key and public key" L29: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L30: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L31: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L32: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L33: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L34: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L35: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L36: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L37: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L38: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L39: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L40: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L41: "cluster.go:125: [kubelet-start] Starting the kubelet" L42: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__" L43: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s" L44: "cluster.go:125: [kubelet-check] The kubelet is healthy after 1.531754859s" L45: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s" L46: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.136:6443/livez" L47: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz" L48: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez" L49: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 5.021310312s" L50: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 10.709658846s" L51: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 28.038062086s" L52: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace" L53: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster" L54: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs" L55: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]" L56: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]" L57: "cluster.go:125: [bootstrap-token] Using token: v3okk4.9rzh69a22eeq9b52" L58: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles" L59: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes" L60: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials" L61: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token" L62: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster" L63: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace" L64: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key" L65: "cluster.go:125: [addons] Applied essential addon: CoreDNS" L66: "cluster.go:125: [addons] Applied essential addon: kube-proxy" L67: "cluster.go:125: " L68: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!" L69: "cluster.go:125: " L70: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:" L71: "cluster.go:125: " L72: "cluster.go:125: mkdir -p $HOME/.kube" L73: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config" L74: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config" L75: "cluster.go:125: " L76: "cluster.go:125: Alternatively, if you are the root user, you can run:" L77: "cluster.go:125: " L78: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf" L79: "cluster.go:125: " L80: "cluster.go:125: You should now deploy a pod network to the cluster." L81: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:" L82: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/" L83: "cluster.go:125: " L84: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:" L85: "cluster.go:125: " L86: "cluster.go:125: kubeadm join 10.0.0.136:6443 --token v3okk4.9rzh69a22eeq9b52 _" L87: "cluster.go:125: --discovery-token-ca-cert-hash sha256:310812873747e37e44ceb891dc5449340cc7b87591883977503d7e76d1f83284 " L88: "cluster.go:125: i Using Cilium version 1.12.5" L89: "cluster.go:125: ? Auto-detected cluster name: kubernetes" L90: "cluster.go:125: ? Auto-detected datapath mode: tunnel" L91: "cluster.go:125: ? Auto-detected kube-proxy has been installed" L92: "cluster.go:125: i helm template --namespace kube-system cilium cilium/cilium --version 1.12.5 --set cluster.id=0,cluster.name=kubernetes,encryption.nodeEncryption=false,extraConfig.cluster-pool-ipv4-?cidr=192.168.0.0/17,extraConfig.enable-endpoint-routes=true,kubeProxyReplacement=disabled,operator.replicas=1,serviceAccounts.cilium.name=cilium,serviceAccounts.operator.name=cilium-operator,tunnel=vx?lan" L93: "cluster.go:125: i Storing helm values file in kube-system/cilium-cli-helm-values Secret" L94: "cluster.go:125: ? Created CA in secret cilium-ca" L95: "cluster.go:125: ? Generating certificates for Hubble..." L96: "cluster.go:125: ? Creating Service accounts..." L97: "cluster.go:125: ? Creating Cluster roles..." L98: "cluster.go:125: ? Creating ConfigMap for Cilium version 1.12.5..." L99: "cluster.go:125: i Manual overwrite in ConfigMap: enable-endpoint-routes=true" L100: "cluster.go:125: i Manual overwrite in ConfigMap: cluster-pool-ipv4-cidr=192.168.0.0/17" L101: "cluster.go:125: ? Creating Agent DaemonSet..." L102: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/mount-cgroup]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L103: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/apply-sysctl-overwrites]: deprecated since v1.30; use the ___appArmorProfile___ fi?eld instead__ subsys=klog" L104: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/clean-cilium-state]: deprecated since v1.30; use the ___appArmorProfile___ field i?nstead__ subsys=klog" L105: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/cilium-agent]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L106: "cluster.go:125: ? Creating Operator Deployment..." L107: "cluster.go:125: ? Waiting for Cilium to be installed and ready..." L108: "cluster.go:125: ?[33m /??_" L109: "cluster.go:125: ?[36m /???[33m___/?[32m??_?[0m Cilium: ?[31m1 errors?[0m, ?[33m1 warnings?[0m" L110: "cluster.go:125: ?[36m ___?[31m/??_?[32m__/?[0m Operator: ?[31m1 errors?[0m, ?[33m1 warnings?[0m" L111: "cluster.go:125: ?[32m /???[31m___/?[35m??_?[0m Hubble: ?[36mdisabled?[0m" L112: "cluster.go:125: ?[32m ___?[34m/??_?[35m__/?[0m ClusterMesh: ?[36mdisabled?[0m" L113: "cluster.go:125: ?[34m ___/" L114: "cluster.go:125: ?[0m" L115: "cluster.go:125: DaemonSet cilium Desired: 1, Unavailable: ?[31m1/1?[0m" L116: "cluster.go:125: Deployment cilium-operator Desired: 1, Unavailable: ?[31m1/1?[0m" L117: "cluster.go:125: Containers: cilium Pending: ?[32m1?[0m" L118: "cluster.go:125: cilium-operator Pending: ?[32m1?[0m" L119: "cluster.go:125: Cluster Pods: 0/0 managed by Cilium" L120: "cluster.go:125: Image versions cilium quay.io/cilium/cilium:v1.12.5@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5: 1" L121: "cluster.go:125: cilium-operator quay.io/cilium/operator-generic:v1.12.5@sha256:b296eb7f0f7656a5cc19724f40a8a7121b7fd725278b7d61dc91fe0b7ffd7c0e: 1" L122: "cluster.go:125: Errors: cilium-operator cilium-operator 1 pods of Deployment cilium-operator are not ready" L123: "cluster.go:125: cilium cilium 1 pods of DaemonSet cilium are not ready" L124: "cluster.go:125: Warnings: cilium cilium-m2z98 pod is pending" L125: "cluster.go:125: cilium-operator cilium-operator-6c4d7847fc-jkrmz pod is pending" L126: "cluster.go:125: ? Rolling back installation..." L127: "cluster.go:125: " L128: "cluster.go:125: Error: Unable to install Cilium: timeout while waiting for status to become successful: context deadline exceeded" L129: "kubeadm.go:197: unable to setup cluster: unable to run master script: Process exited with status 1_" L130: " " ```
🟢 ok **kubeadm.v1.33.8.flannel.base**; Succeeded: qemu (1) 🟢 ok **kubeadm.v1.34.4.calico.base**; Succeeded: qemu (1) 🟢 ok **kubeadm.v1.34.4.cilium.base**; Succeeded: qemu (5); Failed: qemu (1, 2, 3, 4)
                Diagnostic output for qemu, run 4 ``` L1: " Error: _cluster.go:125: I0428 02:45:36.120415 2069 version.go:260] remote version is much newer: v1.36.0; falling back to: stable-1.34" L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.34.7" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.34.7" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.34.7" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.34.7" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.12.1" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.1" L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.5-0" L9: "cluster.go:125: I0428 02:46:22.745224 2355 version.go:260] remote version is much newer: v1.36.0; falling back to: stable-1.34" L10: "cluster.go:125: [init] Using Kubernetes version: v1.34.7" L11: "cluster.go:125: [preflight] Running pre-flight checks" L12: "cluster.go:125: [WARNING Service-Kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L13: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L14: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L15: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L16: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L17: "cluster.go:125: [certs] Generating __ca__ certificate and key" L18: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L19: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local localhost] and IPs [10.96.0.1 10.0.0.5?]" L20: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L21: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L22: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L23: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L24: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L25: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L26: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L27: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L28: "cluster.go:125: [certs] Generating __sa__ key and public key" L29: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L30: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L31: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L32: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L33: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L34: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L35: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L36: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L37: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L38: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L39: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L40: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__" L41: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__" L42: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L43: "cluster.go:125: [kubelet-start] Starting the kubelet" L44: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__" L45: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s" L46: "cluster.go:125: [kubelet-check] The kubelet is healthy after 1.032249169s" L47: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s" L48: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.5:6443/livez" L49: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz" L50: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez" L51: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 3.271813231s" L52: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 8.030575159s" L53: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 21.555677247s" L54: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace" L55: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster" L56: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs" L57: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]" L58: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]" L59: "cluster.go:125: [bootstrap-token] Using token: 29h182.xl4hfsph8me1kzgd" L60: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles" L61: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes" L62: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials" L63: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token" L64: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster" L65: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace" L66: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key" L67: "cluster.go:125: [addons] Applied essential addon: CoreDNS" L68: "cluster.go:125: [addons] Applied essential addon: kube-proxy" L69: "cluster.go:125: " L70: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!" L71: "cluster.go:125: " L72: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:" L73: "cluster.go:125: " L74: "cluster.go:125: mkdir -p $HOME/.kube" L75: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config" L76: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config" L77: "cluster.go:125: " L78: "cluster.go:125: Alternatively, if you are the root user, you can run:" L79: "cluster.go:125: " L80: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf" L81: "cluster.go:125: " L82: "cluster.go:125: You should now deploy a pod network to the cluster." L83: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:" L84: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/" L85: "cluster.go:125: " L86: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:" L87: "cluster.go:125: " L88: "cluster.go:125: kubeadm join 10.0.0.5:6443 --token 29h182.xl4hfsph8me1kzgd _" L89: "cluster.go:125: --discovery-token-ca-cert-hash sha256:a5cbb7eb680cf8773fcd16b2e80b68fec5046622ba611e7fe01c9c5707172552 " L90: "cluster.go:125: i Using Cilium version 1.12.5" L91: "cluster.go:125: ? Auto-detected cluster name: kubernetes" L92: "cluster.go:125: ? Auto-detected datapath mode: tunnel" L93: "cluster.go:125: ? Auto-detected kube-proxy has been installed" L94: "cluster.go:125: i helm template --namespace kube-system cilium cilium/cilium --version 1.12.5 --set cluster.id=0,cluster.name=kubernetes,encryption.nodeEncryption=false,extraConfig.cluster-pool-ipv4-?cidr=192.168.0.0/17,extraConfig.enable-endpoint-routes=true,kubeProxyReplacement=disabled,operator.replicas=1,serviceAccounts.cilium.name=cilium,serviceAccounts.operator.name=cilium-operator,tunnel=vx?lan" L95: "cluster.go:125: i Storing helm values file in kube-system/cilium-cli-helm-values Secret" L96: "cluster.go:125: ? Created CA in secret cilium-ca" L97: "cluster.go:125: ? Generating certificates for Hubble..." L98: "cluster.go:125: ? Creating Service accounts..." L99: "cluster.go:125: ? Creating Cluster roles..." L100: "cluster.go:125: ? Creating ConfigMap for Cilium version 1.12.5..." L101: "cluster.go:125: i Manual overwrite in ConfigMap: enable-endpoint-routes=true" L102: "cluster.go:125: i Manual overwrite in ConfigMap: cluster-pool-ipv4-cidr=192.168.0.0/17" L103: "cluster.go:125: ? Creating Agent DaemonSet..." L104: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/mount-cgroup]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L105: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/apply-sysctl-overwrites]: deprecated since v1.30; use the ___appArmorProfile___ fi?eld instead__ subsys=klog" L106: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/clean-cilium-state]: deprecated since v1.30; use the ___appArmorProfile___ field i?nstead__ subsys=klog" L107: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/cilium-agent]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L108: "cluster.go:125: ? Creating Operator Deployment..." L109: "cluster.go:125: ? Waiting for Cilium to be installed and ready..." L110: "cluster.go:125: ? Restarting unmanaged pods..." L111: "cluster.go:125: ? Restarted unmanaged pod kube-system/coredns-66bc5c9577-gfv6b" L112: "cluster.go:125: ? Restarted unmanaged pod kube-system/coredns-66bc5c9577-tzj79" L113: "cluster.go:125: ? Cilium was successfully installed! Run _cilium status_ to view installation health" L114: "cluster.go:125: ?[33m /??_" L115: "cluster.go:125: ?[36m /???[33m___/?[32m??_?[0m Cilium: ?[32mOK?[0m" L116: "cluster.go:125: ?[36m ___?[31m/??_?[32m__/?[0m Operator: ?[32mOK?[0m" L117: "cluster.go:125: ?[32m /???[31m___/?[35m??_?[0m Hubble: ?[36mdisabled?[0m" L118: "cluster.go:125: ?[32m ___?[34m/??_?[35m__/?[0m ClusterMesh: ?[36mdisabled?[0m" L119: "cluster.go:125: ?[34m ___/" L120: "cluster.go:125: ?[0m" L121: "cluster.go:125: DaemonSet cilium Desired: 1, Ready: ?[32m1/1?[0m, Available: ?[32m1/1?[0m" L122: "cluster.go:125: Deployment cilium-operator Desired: 1, Ready: ?[32m1/1?[0m, Available: ?[32m1/1?[0m" L123: "cluster.go:125: Containers: cilium Running: ?[32m1?[0m" L124: "cluster.go:125: cilium-operator Running: ?[32m1?[0m" L125: "cluster.go:125: Cluster Pods: 2/2 managed by Cilium" L126: "cluster.go:125: Image versions cilium quay.io/cilium/cilium:v1.12.5@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5: 1" L127: "cluster.go:125: cilium-operator quay.io/cilium/operator-generic:v1.12.5@sha256:b296eb7f0f7656a5cc19724f40a8a7121b7fd725278b7d61dc91fe0b7ffd7c0e: 1" L128: "cluster.go:125: W0428 02:49:47.792501 1808 joinconfiguration.go:112] [config] WARNING: Ignored configuration document with GroupVersionKind kubelet.config.k8s.io/v1beta1, Kind=KubeletConfiguration" L129: "cluster.go:125: [WARNING Service-Kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L130: "--- FAIL: kubeadm.v1.34.4.cilium.base/IPSec_encryption (174.63s)" L131: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/mount-cgroup]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L132: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/apply-sysctl-overwrites]: deprecated since v1.30; use the ___appArmorProfile___ fi?eld instead__ subsys=klog" L133: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/clean-cilium-state]: deprecated since v1.30; use the ___appArmorProfile___ field i?nstead__ subsys=klog" L134: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/cilium-agent]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L135: "cluster.go:125: Error: Unable to determine status: timeout while waiting for status to become successful: context deadline exceeded" L136: "cluster.go:145: __/opt/bin/cilium status --wait --wait-duration 1m__ failed: output ?[33m /????_" L137: "?[36m /?????[33m___/?[32m????_?[0m Cilium: ?[31m2 errors?[0m" L138: "?[36m ___?[31m/????_?[32m__/?[0m Operator: ?[32mOK?[0m" L139: "?[32m /?????[31m___/?[35m????_?[0m Hubble: ?[36mdisabled?[0m" L140: "?[32m ___?[34m/????_?[35m__/?[0m ClusterMesh: ?[36mdisabled?[0m" L141: "?[34m ___/" L142: "?[0m" L143: "Deployment cilium-operator Desired: 1, Ready: ?[32m1/1?[0m, Available: ?[32m1/1?[0m" L144: "DaemonSet cilium Desired: 2, Ready: ?[33m1/2?[0m, Available: ?[33m1/2?[0m, Unavailable: ?[31m1/2?[0m" L145: "Containers: cilium Running: ?[32m2?[0m" L146: "cilium-operator Running: ?[32m1?[0m" L147: "Cluster Pods: 5/5 managed by Cilium" L148: "Image versions cilium quay.io/cilium/cilium:v1.12.5@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5: 2" L149: "cilium-operator quay.io/cilium/operator-generic:v1.12.5@sha256:b296eb7f0f7656a5cc19724f40a8a7121b7fd725278b7d61dc91fe0b7ffd7c0e: 1" L150: "Errors: cilium cilium 1 pods of DaemonSet cilium are not ready" L151: "cilium cilium-jg5gj unable to retrieve cilium status: command terminated with exit code 1, status Process exited with status 1_" L152: " " ```                 Diagnostic output for qemu, run 3 ``` L1: " Error: _cluster.go:125: I0428 02:31:47.039294 2031 version.go:260] remote version is much newer: v1.36.0; falling back to: stable-1.34" L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.34.7" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.34.7" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.34.7" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.34.7" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.12.1" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.1" L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.5-0" L9: "cluster.go:125: I0428 02:32:05.004662 2268 version.go:260] remote version is much newer: v1.36.0; falling back to: stable-1.34" L10: "cluster.go:125: [init] Using Kubernetes version: v1.34.7" L11: "cluster.go:125: [preflight] Running pre-flight checks" L12: "cluster.go:125: [WARNING Service-Kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L13: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L14: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L15: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L16: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L17: "cluster.go:125: [certs] Generating __ca__ certificate and key" L18: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L19: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local localhost] and IPs [10.96.0.1 10.0.0.6?]" L20: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L21: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L22: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L23: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L24: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L25: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L26: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L27: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L28: "cluster.go:125: [certs] Generating __sa__ key and public key" L29: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L30: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L31: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L32: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L33: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L34: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L35: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L36: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L37: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L38: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L39: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L40: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__" L41: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__" L42: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L43: "cluster.go:125: [kubelet-start] Starting the kubelet" L44: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__" L45: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s" L46: "cluster.go:125: [kubelet-check] The kubelet is healthy after 501.754453ms" L47: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s" L48: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.6:6443/livez" L49: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz" L50: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez" L51: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 2.022580384s" L52: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 5.077241036s" L53: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 12.527473698s" L54: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace" L55: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster" L56: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs" L57: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]" L58: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]" L59: "cluster.go:125: [bootstrap-token] Using token: e6izxk.pmpvg1w2zi1v09xn" L60: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles" L61: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes" L62: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials" L63: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token" L64: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster" L65: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace" L66: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key" L67: "cluster.go:125: [addons] Applied essential addon: CoreDNS" L68: "cluster.go:125: [addons] Applied essential addon: kube-proxy" L69: "cluster.go:125: " L70: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!" L71: "cluster.go:125: " L72: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:" L73: "cluster.go:125: " L74: "cluster.go:125: mkdir -p $HOME/.kube" L75: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config" L76: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config" L77: "cluster.go:125: " L78: "cluster.go:125: Alternatively, if you are the root user, you can run:" L79: "cluster.go:125: " L80: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf" L81: "cluster.go:125: " L82: "cluster.go:125: You should now deploy a pod network to the cluster." L83: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:" L84: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/" L85: "cluster.go:125: " L86: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:" L87: "cluster.go:125: " L88: "cluster.go:125: kubeadm join 10.0.0.6:6443 --token e6izxk.pmpvg1w2zi1v09xn _" L89: "cluster.go:125: --discovery-token-ca-cert-hash sha256:432e05ac401a205226ce9647dd50e552301b39ea60675a78fd1e6402aecc6ab2 " L90: "cluster.go:125: i Using Cilium version 1.12.5" L91: "cluster.go:125: ? Auto-detected cluster name: kubernetes" L92: "cluster.go:125: ? Auto-detected datapath mode: tunnel" L93: "cluster.go:125: ? Auto-detected kube-proxy has been installed" L94: "cluster.go:125: i helm template --namespace kube-system cilium cilium/cilium --version 1.12.5 --set cluster.id=0,cluster.name=kubernetes,encryption.nodeEncryption=false,extraConfig.cluster-pool-ipv4-?cidr=192.168.0.0/17,extraConfig.enable-endpoint-routes=true,kubeProxyReplacement=disabled,operator.replicas=1,serviceAccounts.cilium.name=cilium,serviceAccounts.operator.name=cilium-operator,tunnel=vx?lan" L95: "cluster.go:125: i Storing helm values file in kube-system/cilium-cli-helm-values Secret" L96: "cluster.go:125: ? Created CA in secret cilium-ca" L97: "cluster.go:125: ? Generating certificates for Hubble..." L98: "cluster.go:125: ? Creating Service accounts..." L99: "cluster.go:125: ? Creating Cluster roles..." L100: "cluster.go:125: ? Creating ConfigMap for Cilium version 1.12.5..." L101: "cluster.go:125: i Manual overwrite in ConfigMap: enable-endpoint-routes=true" L102: "cluster.go:125: i Manual overwrite in ConfigMap: cluster-pool-ipv4-cidr=192.168.0.0/17" L103: "cluster.go:125: ? Creating Agent DaemonSet..." L104: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/mount-cgroup]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L105: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/apply-sysctl-overwrites]: deprecated since v1.30; use the ___appArmorProfile___ fi?eld instead__ subsys=klog" L106: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/clean-cilium-state]: deprecated since v1.30; use the ___appArmorProfile___ field i?nstead__ subsys=klog" L107: "cluster.go:125: ? Creating Operator Deployment..." L108: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/cilium-agent]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L109: "cluster.go:125: ? Waiting for Cilium to be installed and ready..." L110: "cluster.go:125: ? Cilium was successfully installed! Run _cilium status_ to view installation health" L111: "cluster.go:125: ?[33m /??_" L112: "cluster.go:125: ?[36m /???[33m___/?[32m??_?[0m Cilium: ?[32mOK?[0m" L113: "cluster.go:125: ?[36m ___?[31m/??_?[32m__/?[0m Operator: ?[32mOK?[0m" L114: "cluster.go:125: ?[32m /???[31m___/?[35m??_?[0m Hubble: ?[36mdisabled?[0m" L115: "cluster.go:125: ?[32m ___?[34m/??_?[35m__/?[0m ClusterMesh: ?[36mdisabled?[0m" L116: "cluster.go:125: ?[34m ___/" L117: "cluster.go:125: ?[0m" L118: "cluster.go:125: DaemonSet cilium Desired: 1, Ready: ?[32m1/1?[0m, Available: ?[32m1/1?[0m" L119: "cluster.go:125: Deployment cilium-operator Desired: 1, Ready: ?[32m1/1?[0m, Available: ?[32m1/1?[0m" L120: "cluster.go:125: Containers: cilium Running: ?[32m1?[0m" L121: "cluster.go:125: cilium-operator Running: ?[32m1?[0m" L122: "cluster.go:125: Cluster Pods: 2/2 managed by Cilium" L123: "cluster.go:125: Image versions cilium quay.io/cilium/cilium:v1.12.5@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5: 1" L124: "cluster.go:125: cilium-operator quay.io/cilium/operator-generic:v1.12.5@sha256:b296eb7f0f7656a5cc19724f40a8a7121b7fd725278b7d61dc91fe0b7ffd7c0e: 1" L125: "cluster.go:125: W0428 02:35:02.944895 1832 joinconfiguration.go:112] [config] WARNING: Ignored configuration document with GroupVersionKind kubelet.config.k8s.io/v1beta1, Kind=KubeletConfiguration" L126: "cluster.go:125: [WARNING Service-Kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L127: "--- FAIL: kubeadm.v1.34.4.cilium.base/nginx_deployment (251.93s)" L128: "kubeadm.go:232: nginx is not deployed: ready replicas should be equal to 1: null" L129: "--- FAIL: kubeadm.v1.34.4.cilium.base/IPSec_encryption (75.28s)" L130: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/mount-cgroup]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L131: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/apply-sysctl-overwrites]: deprecated since v1.30; use the ___appArmorProfile___ fi?eld instead__ subsys=klog" L132: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/clean-cilium-state]: deprecated since v1.30; use the ___appArmorProfile___ field i?nstead__ subsys=klog" L133: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/cilium-agent]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L134: "cluster.go:125: Error: Unable to determine status: timeout while waiting for status to become successful: context deadline exceeded" L135: "cluster.go:145: __/opt/bin/cilium status --wait --wait-duration 1m__ failed: output ?[33m /????_" L136: "?[36m /?????[33m___/?[32m????_?[0m Cilium: ?[33m1 warnings?[0m" L137: "?[36m ___?[31m/????_?[32m__/?[0m Operator: ?[32mOK?[0m" L138: "?[32m /?????[31m___/?[35m????_?[0m Hubble: ?[36mdisabled?[0m" L139: "?[32m ___?[34m/????_?[35m__/?[0m ClusterMesh: ?[36mdisabled?[0m" L140: "?[34m ___/" L141: "?[0m" L142: "DaemonSet cilium Desired: 2, Ready: ?[32m2/2?[0m, Available: ?[32m2/2?[0m" L143: "Deployment cilium-operator Desired: 1, Ready: ?[32m1/1?[0m, Available: ?[32m1/1?[0m" L144: "Containers: cilium Running: ?[32m2?[0m" L145: "cilium-operator Running: ?[32m1?[0m" L146: "Cluster Pods: 5/5 managed by Cilium" L147: "Image versions cilium quay.io/cilium/cilium:v1.12.5@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5: 2" L148: "cilium-operator quay.io/cilium/operator-generic:v1.12.5@sha256:b296eb7f0f7656a5cc19724f40a8a7121b7fd725278b7d61dc91fe0b7ffd7c0e: 1" L149: "Warnings: cilium cilium-h4jrj Hubble: Server not initialized, status Process exited with status 1_" L150: " " ```                 Diagnostic output for qemu, run 2 ``` L1: " Error: _cluster.go:125: I0428 02:03:53.853129 2031 version.go:260] remote version is much newer: v1.36.0; falling back to: stable-1.34" L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.34.7" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.34.7" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.34.7" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.34.7" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.12.1" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.1" L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.5-0" L9: "cluster.go:125: I0428 02:04:09.625889 2252 version.go:260] remote version is much newer: v1.36.0; falling back to: stable-1.34" L10: "cluster.go:125: [init] Using Kubernetes version: v1.34.7" L11: "cluster.go:125: [preflight] Running pre-flight checks" L12: "cluster.go:125: [WARNING Service-Kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L13: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L14: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L15: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L16: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L17: "cluster.go:125: [certs] Generating __ca__ certificate and key" L18: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L19: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local localhost] and IPs [10.96.0.1 10.0.0.5?]" L20: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L21: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L22: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L23: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L24: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L25: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L26: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L27: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L28: "cluster.go:125: [certs] Generating __sa__ key and public key" L29: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L30: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L31: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L32: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L33: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L34: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L35: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L36: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L37: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L38: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L39: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L40: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__" L41: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__" L42: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L43: "cluster.go:125: [kubelet-start] Starting the kubelet" L44: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__" L45: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s" L46: "cluster.go:125: [kubelet-check] The kubelet is healthy after 2.063581808s" L47: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s" L48: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.5:6443/livez" L49: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz" L50: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez" L51: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 4.775060808s" L52: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 14.912477345s" L53: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 34.532513716s" L54: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace" L55: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster" L56: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs" L57: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]" L58: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]" L59: "cluster.go:125: [bootstrap-token] Using token: dvs0p1.6fzruyurzdzqr9c3" L60: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles" L61: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes" L62: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials" L63: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token" L64: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster" L65: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace" L66: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key" L67: "cluster.go:125: [addons] Applied essential addon: CoreDNS" L68: "cluster.go:125: [addons] Applied essential addon: kube-proxy" L69: "cluster.go:125: " L70: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!" L71: "cluster.go:125: " L72: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:" L73: "cluster.go:125: " L74: "cluster.go:125: mkdir -p $HOME/.kube" L75: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config" L76: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config" L77: "cluster.go:125: " L78: "cluster.go:125: Alternatively, if you are the root user, you can run:" L79: "cluster.go:125: " L80: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf" L81: "cluster.go:125: " L82: "cluster.go:125: You should now deploy a pod network to the cluster." L83: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:" L84: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/" L85: "cluster.go:125: " L86: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:" L87: "cluster.go:125: " L88: "cluster.go:125: kubeadm join 10.0.0.5:6443 --token dvs0p1.6fzruyurzdzqr9c3 _" L89: "cluster.go:125: --discovery-token-ca-cert-hash sha256:9e1e63b94163fa30351c3c654834420e7b07cfdd8592117b09d3f52c5a238c9b " L90: "cluster.go:125: i Using Cilium version 1.12.5" L91: "cluster.go:125: ? Auto-detected cluster name: kubernetes" L92: "cluster.go:125: ? Auto-detected datapath mode: tunnel" L93: "cluster.go:125: ? Auto-detected kube-proxy has been installed" L94: "cluster.go:125: i helm template --namespace kube-system cilium cilium/cilium --version 1.12.5 --set cluster.id=0,cluster.name=kubernetes,encryption.nodeEncryption=false,extraConfig.cluster-pool-ipv4-?cidr=192.168.0.0/17,extraConfig.enable-endpoint-routes=true,kubeProxyReplacement=disabled,operator.replicas=1,serviceAccounts.cilium.name=cilium,serviceAccounts.operator.name=cilium-operator,tunnel=vx?lan" L95: "cluster.go:125: i Storing helm values file in kube-system/cilium-cli-helm-values Secret" L96: "cluster.go:125: ? Created CA in secret cilium-ca" L97: "cluster.go:125: ? Generating certificates for Hubble..." L98: "cluster.go:125: ? Creating Service accounts..." L99: "cluster.go:125: ? Creating Cluster roles..." L100: "cluster.go:125: ? Creating ConfigMap for Cilium version 1.12.5..." L101: "cluster.go:125: i Manual overwrite in ConfigMap: enable-endpoint-routes=true" L102: "cluster.go:125: i Manual overwrite in ConfigMap: cluster-pool-ipv4-cidr=192.168.0.0/17" L103: "cluster.go:125: ? Creating Agent DaemonSet..." L104: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/mount-cgroup]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L105: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/apply-sysctl-overwrites]: deprecated since v1.30; use the ___appArmorProfile___ fi?eld instead__ subsys=klog" L106: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/clean-cilium-state]: deprecated since v1.30; use the ___appArmorProfile___ field i?nstead__ subsys=klog" L107: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/cilium-agent]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L108: "cluster.go:125: ? Creating Operator Deployment..." L109: "cluster.go:125: ? Waiting for Cilium to be installed and ready..." L110: "cluster.go:125: ? Cilium was successfully installed! Run _cilium status_ to view installation health" L111: "cluster.go:125: ?[33m /??_" L112: "cluster.go:125: ?[36m /???[33m___/?[32m??_?[0m Cilium: ?[32mOK?[0m" L113: "cluster.go:125: ?[36m ___?[31m/??_?[32m__/?[0m Operator: ?[32mOK?[0m" L114: "cluster.go:125: ?[32m /???[31m___/?[35m??_?[0m Hubble: ?[36mdisabled?[0m" L115: "cluster.go:125: ?[32m ___?[34m/??_?[35m__/?[0m ClusterMesh: ?[36mdisabled?[0m" L116: "cluster.go:125: ?[34m ___/" L117: "cluster.go:125: ?[0m" L118: "cluster.go:125: Deployment cilium-operator Desired: 1, Ready: ?[32m1/1?[0m, Available: ?[32m1/1?[0m" L119: "cluster.go:125: DaemonSet cilium Desired: 1, Ready: ?[32m1/1?[0m, Available: ?[32m1/1?[0m" L120: "cluster.go:125: Containers: cilium Running: ?[32m1?[0m" L121: "cluster.go:125: cilium-operator Running: ?[32m1?[0m" L122: "cluster.go:125: Cluster Pods: 2/2 managed by Cilium" L123: "cluster.go:125: Image versions cilium quay.io/cilium/cilium:v1.12.5@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5: 1" L124: "cluster.go:125: cilium-operator quay.io/cilium/operator-generic:v1.12.5@sha256:b296eb7f0f7656a5cc19724f40a8a7121b7fd725278b7d61dc91fe0b7ffd7c0e: 1" L125: "cluster.go:125: W0428 02:10:33.162131 1872 joinconfiguration.go:112] [config] WARNING: Ignored configuration document with GroupVersionKind kubelet.config.k8s.io/v1beta1, Kind=KubeletConfiguration" L126: "cluster.go:125: [WARNING Service-Kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L127: "--- FAIL: kubeadm.v1.34.4.cilium.base/nginx_deployment (264.95s)" L128: "kubeadm.go:232: nginx is not deployed: ready replicas should be equal to 1: null" L129: "--- FAIL: kubeadm.v1.34.4.cilium.base/NFS_deployment (275.39s)" L130: "cluster.go:125: jq: error (at                 Diagnostic output for qemu, run 1 ``` L1: " Error: _cluster.go:125: I0428 00:50:44.608028 2066 version.go:260] remote version is much newer: v1.36.0; falling back to: stable-1.34" L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.34.7" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.34.7" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.34.7" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.34.7" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.12.1" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.1" L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.5-0" L9: "cluster.go:125: I0428 00:51:06.741689 2321 version.go:260] remote version is much newer: v1.36.0; falling back to: stable-1.34" L10: "cluster.go:125: [init] Using Kubernetes version: v1.34.7" L11: "cluster.go:125: [preflight] Running pre-flight checks" L12: "cluster.go:125: [WARNING Service-Kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L13: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L14: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L15: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L16: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L17: "cluster.go:125: [certs] Generating __ca__ certificate and key" L18: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L19: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local localhost] and IPs [10.96.0.1 10.0.0.8?8]" L20: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L21: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L22: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L23: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L24: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L25: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L26: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L27: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L28: "cluster.go:125: [certs] Generating __sa__ key and public key" L29: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L30: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L31: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L32: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L33: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L34: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L35: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L36: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L37: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L38: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L39: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L40: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__" L41: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__" L42: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L43: "cluster.go:125: [kubelet-start] Starting the kubelet" L44: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__" L45: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s" L46: "cluster.go:125: [kubelet-check] The kubelet is healthy after 1.00486148s" L47: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s" L48: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.88:6443/livez" L49: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz" L50: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez" L51: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 2.940315173s" L52: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 6.570401187s" L53: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 11.503866705s" L54: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace" L55: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster" L56: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs" L57: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]" L58: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]" L59: "cluster.go:125: [bootstrap-token] Using token: 4ugriw.ecdkrkxp45ys4cim" L60: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles" L61: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes" L62: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials" L63: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token" L64: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster" L65: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace" L66: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key" L67: "cluster.go:125: [addons] Applied essential addon: CoreDNS" L68: "cluster.go:125: [addons] Applied essential addon: kube-proxy" L69: "cluster.go:125: " L70: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!" L71: "cluster.go:125: " L72: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:" L73: "cluster.go:125: " L74: "cluster.go:125: mkdir -p $HOME/.kube" L75: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config" L76: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config" L77: "cluster.go:125: " L78: "cluster.go:125: Alternatively, if you are the root user, you can run:" L79: "cluster.go:125: " L80: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf" L81: "cluster.go:125: " L82: "cluster.go:125: You should now deploy a pod network to the cluster." L83: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:" L84: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/" L85: "cluster.go:125: " L86: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:" L87: "cluster.go:125: " L88: "cluster.go:125: kubeadm join 10.0.0.88:6443 --token 4ugriw.ecdkrkxp45ys4cim _" L89: "cluster.go:125: --discovery-token-ca-cert-hash sha256:8e6f7ef35574f9ecd8b71f81f437041ddf9edaa3a023c7c557124cc954a5aeba " L90: "cluster.go:125: i Using Cilium version 1.12.5" L91: "cluster.go:125: ? Auto-detected cluster name: kubernetes" L92: "cluster.go:125: ? Auto-detected datapath mode: tunnel" L93: "cluster.go:125: ? Auto-detected kube-proxy has been installed" L94: "cluster.go:125: i helm template --namespace kube-system cilium cilium/cilium --version 1.12.5 --set cluster.id=0,cluster.name=kubernetes,encryption.nodeEncryption=false,extraConfig.cluster-pool-ipv4-?cidr=192.168.0.0/17,extraConfig.enable-endpoint-routes=true,kubeProxyReplacement=disabled,operator.replicas=1,serviceAccounts.cilium.name=cilium,serviceAccounts.operator.name=cilium-operator,tunnel=vx?lan" L95: "cluster.go:125: i Storing helm values file in kube-system/cilium-cli-helm-values Secret" L96: "cluster.go:125: ? Created CA in secret cilium-ca" L97: "cluster.go:125: ? Generating certificates for Hubble..." L98: "cluster.go:125: ? Creating Service accounts..." L99: "cluster.go:125: ? Creating Cluster roles..." L100: "cluster.go:125: ? Creating ConfigMap for Cilium version 1.12.5..." L101: "cluster.go:125: i Manual overwrite in ConfigMap: enable-endpoint-routes=true" L102: "cluster.go:125: i Manual overwrite in ConfigMap: cluster-pool-ipv4-cidr=192.168.0.0/17" L103: "cluster.go:125: ? Creating Agent DaemonSet..." L104: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/mount-cgroup]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L105: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/apply-sysctl-overwrites]: deprecated since v1.30; use the ___appArmorProfile___ fi?eld instead__ subsys=klog" L106: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/clean-cilium-state]: deprecated since v1.30; use the ___appArmorProfile___ field i?nstead__ subsys=klog" L107: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/cilium-agent]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L108: "cluster.go:125: ? Creating Operator Deployment..." L109: "cluster.go:125: ? Waiting for Cilium to be installed and ready..." L110: "cluster.go:125: ? Cilium was successfully installed! Run _cilium status_ to view installation health" L111: "cluster.go:125: ?[33m /??_" L112: "cluster.go:125: ?[36m /???[33m___/?[32m??_?[0m Cilium: ?[32mOK?[0m" L113: "cluster.go:125: ?[36m ___?[31m/??_?[32m__/?[0m Operator: ?[32mOK?[0m" L114: "cluster.go:125: ?[32m /???[31m___/?[35m??_?[0m Hubble: ?[36mdisabled?[0m" L115: "cluster.go:125: ?[32m ___?[34m/??_?[35m__/?[0m ClusterMesh: ?[36mdisabled?[0m" L116: "cluster.go:125: ?[34m ___/" L117: "cluster.go:125: ?[0m" L118: "cluster.go:125: DaemonSet cilium Desired: 1, Ready: ?[32m1/1?[0m, Available: ?[32m1/1?[0m" L119: "cluster.go:125: Deployment cilium-operator Desired: 1, Ready: ?[32m1/1?[0m, Available: ?[32m1/1?[0m" L120: "cluster.go:125: Containers: cilium Running: ?[32m1?[0m" L121: "cluster.go:125: cilium-operator Running: ?[32m1?[0m" L122: "cluster.go:125: Cluster Pods: 2/2 managed by Cilium" L123: "cluster.go:125: Image versions cilium quay.io/cilium/cilium:v1.12.5@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5: 1" L124: "cluster.go:125: cilium-operator quay.io/cilium/operator-generic:v1.12.5@sha256:b296eb7f0f7656a5cc19724f40a8a7121b7fd725278b7d61dc91fe0b7ffd7c0e: 1" L125: "cluster.go:125: W0428 00:55:17.805361 1849 joinconfiguration.go:112] [config] WARNING: Ignored configuration document with GroupVersionKind kubelet.config.k8s.io/v1beta1, Kind=KubeletConfiguration" L126: "cluster.go:125: [WARNING Service-Kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L127: "--- FAIL: kubeadm.v1.34.4.cilium.base/IPSec_encryption (85.18s)" L128: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/mount-cgroup]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L129: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/apply-sysctl-overwrites]: deprecated since v1.30; use the ___appArmorProfile___ fi?eld instead__ subsys=klog" L130: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/clean-cilium-state]: deprecated since v1.30; use the ___appArmorProfile___ field i?nstead__ subsys=klog" L131: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/cilium-agent]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L132: "cluster.go:125: Error: Unable to determine status: timeout while waiting for status to become successful: context deadline exceeded" L133: "cluster.go:145: __/opt/bin/cilium status --wait --wait-duration 1m__ failed: output ?[33m /????_" L134: "?[36m /?????[33m___/?[32m????_?[0m Cilium: ?[31m1 errors?[0m, ?[33m2 warnings?[0m" L135: "?[36m ___?[31m/????_?[32m__/?[0m Operator: ?[32mOK?[0m" L136: "?[32m /?????[31m___/?[35m????_?[0m Hubble: ?[36mdisabled?[0m" L137: "?[32m ___?[34m/????_?[35m__/?[0m ClusterMesh: ?[36mdisabled?[0m" L138: "?[34m ___/" L139: "?[0m" L140: "Deployment cilium-operator Desired: 1, Ready: ?[32m1/1?[0m, Available: ?[32m1/1?[0m" L141: "DaemonSet cilium Desired: 2, Unavailable: ?[31m2/2?[0m" L142: "Containers: cilium Running: ?[32m2?[0m" L143: "cilium-operator Running: ?[32m1?[0m" L144: "Cluster Pods: 5/5 managed by Cilium" L145: "Image versions cilium-operator quay.io/cilium/operator-generic:v1.12.5@sha256:b296eb7f0f7656a5cc19724f40a8a7121b7fd725278b7d61dc91fe0b7ffd7c0e: 1" L146: "cilium quay.io/cilium/cilium:v1.12.5@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5: 2" L147: "Errors: cilium cilium 2 pods of DaemonSet cilium are not ready" L148: "Warnings: cilium cilium-bs4qb Hubble: Server not initialized" L149: "cilium cilium-sczqn Hubble: Server not initialized, status Process exited with status 1_" L150: " " ```
🟢 ok **kubeadm.v1.34.4.flannel.base**; Succeeded: qemu (1) 🟢 ok **kubeadm.v1.35.1.calico.base**; Succeeded: qemu (1) 🟢 ok **kubeadm.v1.35.1.cilium.base**; Succeeded: qemu (1) 🟢 ok **kubeadm.v1.35.1.flannel.base**; Succeeded: qemu (1) 🟢 ok **linux.nfs.v3**; Succeeded: qemu (1) 🟢 ok **linux.nfs.v4**; Succeeded: qemu (1) 🟢 ok **linux.ntp**; Succeeded: qemu (1) 🟢 ok **misc.fips**; Succeeded: qemu (1) 🟢 ok **packages**; Succeeded: qemu (1) 🟢 ok **sysext.custom-docker.sysext**; Succeeded: qemu (1) 🟢 ok **sysext.custom-oem**; Succeeded: qemu (1) 🟢 ok **sysext.disable-containerd**; Succeeded: qemu (1) 🟢 ok **sysext.disable-docker**; Succeeded: qemu (1) 🟢 ok **sysext.simple**; Succeeded: qemu (1) 🟢 ok **systemd.journal.remote**; Succeeded: qemu (1) 🟢 ok **systemd.journal.user**; Succeeded: qemu (1) 🟢 ok **systemd.sysusers.gshadow**; Succeeded: qemu (1)