### Test report for 9999.0.0+ignition-file-proto / amd64
**Platforms tested** : qemu
🟢 ok **bpf.ig**; Succeeded: qemu (1)
🟢 ok **cl.basic**; Succeeded: qemu (2); Failed: qemu (1)
Diagnostic output for qemu, run 1
```
L1: " Error: _harness.go:621: Found systemd dependency unit failed to start (?[0;1;39msystemd-fsck????[0mle System Check on /dev/mapper/usr. ) on machine 30e85366-54f2-44ec-951c-2b2467faefc4 console_"
L2: " "
```
🟢 ok **cl.cloudinit.basic**; Succeeded: qemu (1)
🟢 ok **cl.cloudinit.multipart-mime**; Succeeded: qemu (1)
🟢 ok **cl.cloudinit.script**; Succeeded: qemu (1)
🟢 ok **cl.disk.raid0.data**; Succeeded: qemu (1)
🟢 ok **cl.disk.raid0.root**; Succeeded: qemu (3); Failed: qemu (1, 2)
Diagnostic output for qemu, run 2
```
L1: " Error: _raid.go:223: machine __05d4781c-5e6c-4c0d-9f47-4ab656d32ec7__ failed to start: ssh journalctl failed: time limit exceeded: dial tcp 10.0.0.9:22: connect: connection refused"
L2: "harness.go:621: Found emergency shell on machine 05d4781c-5e6c-4c0d-9f47-4ab656d32ec7 console"
L3: "harness.go:621: Found systemd unit failed to start (?[0;1;39mignition-disks.service?[0m - Ignition (disks). ) on machine 05d4781c-5e6c-4c0d-9f47-4ab656d32ec7 console"
L4: "harness.go:621: Found systemd dependency unit failed to start (?[0;1;39msystemd-fsck????[0mm Check on /dev/disk/by-label/ROOT. ) on machine 05d4781c-5e6c-4c0d-9f47-4ab656d32ec7 console_"
L5: " "
```
Diagnostic output for qemu, run 1
```
L1: " Error: _raid.go:223: machine __05b295ee-7938-494f-b571-e1a557eb0b63__ failed to start: ssh journalctl failed: time limit exceeded: dial tcp 10.0.0.85:22: connect: connection refused"
L2: "harness.go:621: Found emergency shell on machine 05b295ee-7938-494f-b571-e1a557eb0b63 console"
L3: "harness.go:621: Found systemd unit failed to start (?[0;1;39mignition-disks.service?[0m - Ignition (disks). ) on machine 05b295ee-7938-494f-b571-e1a557eb0b63 console"
L4: "harness.go:621: Found systemd dependency unit failed to start (?[0;1;39msystemd-fsck????[0mm Check on /dev/disk/by-label/ROOT. ) on machine 05b295ee-7938-494f-b571-e1a557eb0b63 console_"
L5: " "
```
🟢 ok **cl.disk.raid1.data**; Succeeded: qemu (1)
🟢 ok **cl.disk.raid1.root**; Succeeded: qemu (2); Failed: qemu (1)
Diagnostic output for qemu, run 1
```
L1: " Error: _harness.go:621: Found systemd dependency unit failed to start (?[0;1;39msystemd-fsck????[0mle System Check on /dev/mapper/usr. ) on machine 9a81bc83-f143-4b5c-9d75-07018c653e86 console_"
L2: " "
```
🟢 ok **cl.etcd-member.discovery**; Succeeded: qemu (1)
🟢 ok **cl.etcd-member.etcdctlv3**; Succeeded: qemu (1)
🟢 ok **cl.etcd-member.v2-backup-restore**; Succeeded: qemu (1)
🟢 ok **cl.filesystem**; Succeeded: qemu (1)
🟢 ok **cl.flannel.udp**; Succeeded: qemu (1)
🟢 ok **cl.flannel.vxlan**; Succeeded: qemu (1)
🟢 ok **cl.ignition.instantiated.enable-unit**; Succeeded: qemu (1)
🟢 ok **cl.ignition.kargs**; Succeeded: qemu (1)
🟢 ok **cl.ignition.luks**; Succeeded: qemu (1)
🟢 ok **cl.ignition.oem.indirect**; Succeeded: qemu (1)
🟢 ok **cl.ignition.oem.indirect.new**; Succeeded: qemu (1)
🟢 ok **cl.ignition.oem.regular**; Succeeded: qemu (1)
🟢 ok **cl.ignition.oem.regular.new**; Succeeded: qemu (1)
🟢 ok **cl.ignition.oem.reuse**; Succeeded: qemu (1)
🟢 ok **cl.ignition.oem.wipe**; Succeeded: qemu (1)
🟢 ok **cl.ignition.partition_on_boot_disk**; Succeeded: qemu (1)
🟢 ok **cl.ignition.symlink**; Succeeded: qemu (1)
🟢 ok **cl.ignition.translation**; Succeeded: qemu (1)
🟢 ok **cl.ignition.v1.btrfsroot**; Succeeded: qemu (1)
🟢 ok **cl.ignition.v1.ext4root**; Succeeded: qemu (1)
🟢 ok **cl.ignition.v1.groups**; Succeeded: qemu (2); Failed: qemu (1)
Diagnostic output for qemu, run 1
```
L1: " Error: _harness.go:621: Found systemd dependency unit failed to start (?[0;1;39msystemd-fsck????[0mle System Check on /dev/mapper/usr. ) on machine fb93662f-2005-4faf-8c95-58a9c077e6e6 console_"
L2: " "
```
🟢 ok **cl.ignition.v1.once**; Succeeded: qemu (1)
🟢 ok **cl.ignition.v1.sethostname**; Succeeded: qemu (1)
🟢 ok **cl.ignition.v1.users**; Succeeded: qemu (1)
🟢 ok **cl.ignition.v1.xfsroot**; Succeeded: qemu (1)
🟢 ok **cl.ignition.v2.btrfsroot**; Succeeded: qemu (1)
🟢 ok **cl.ignition.v2.ext4root**; Succeeded: qemu (1)
🟢 ok **cl.ignition.v2.users**; Succeeded: qemu (1)
🟢 ok **cl.ignition.v2.xfsroot**; Succeeded: qemu (1)
🟢 ok **cl.ignition.v2_1.ext4checkexisting**; Succeeded: qemu (1)
🟢 ok **cl.ignition.v2_1.swap**; Succeeded: qemu (1)
🟢 ok **cl.ignition.v2_1.vfat**; Succeeded: qemu (1)
🟢 ok **cl.install.cloudinit**; Succeeded: qemu (1)
🟢 ok **cl.internet**; Succeeded: qemu (1)
🟢 ok **cl.locksmith.cluster**; Succeeded: qemu (1)
🟢 ok **cl.network.initramfs.second-boot**; Succeeded: qemu (1)
🟢 ok **cl.network.iptables**; Succeeded: qemu (1)
🟢 ok **cl.network.listeners**; Succeeded: qemu (1)
🟢 ok **cl.network.nftables**; Succeeded: qemu (1)
🟢 ok **cl.network.wireguard**; Succeeded: qemu (1)
🟢 ok **cl.omaha.ping**; Succeeded: qemu (1)
🟢 ok **cl.osreset.ignition-rerun**; Succeeded: qemu (1)
🟢 ok **cl.overlay.cleanup**; Succeeded: qemu (1)
🟢 ok **cl.swap_activation**; Succeeded: qemu (1)
🟢 ok **cl.sysext.boot**; Succeeded: qemu (1)
🟢 ok **cl.sysext.fallbackdownload**; Succeeded: qemu (1)
🟢 ok **cl.tang.nonroot**; Succeeded: qemu (1)
🟢 ok **cl.tang.root**; Succeeded: qemu (1)
🟢 ok **cl.toolbox.dnf-install**; Succeeded: qemu (1)
🟢 ok **cl.tpm.eventlog**; Succeeded: qemu (1)
🟢 ok **cl.tpm.nonroot**; Succeeded: qemu (1)
🟢 ok **cl.tpm.root**; Succeeded: qemu (1)
🟢 ok **cl.tpm.root-cryptenroll**; Succeeded: qemu (1)
🟢 ok **cl.tpm.root-cryptenroll-pcr-noupdate**; Succeeded: qemu (1)
🟢 ok **cl.tpm.root-cryptenroll-pcr-withupdate**; Succeeded: qemu (1)
🟢 ok **cl.update.badverity**; Succeeded: qemu (1)
🟢 ok **cl.update.reboot**; Succeeded: qemu (1)
🟢 ok **cl.users.shells**; Succeeded: qemu (1)
🟢 ok **cl.verity**; Succeeded: qemu (1)
🟢 ok **confext.skiprefresh**; Succeeded: qemu (1)
🟢 ok **coreos.auth.verify**; Succeeded: qemu (1)
🟢 ok **coreos.ignition.groups**; Succeeded: qemu (1)
🟢 ok **coreos.ignition.once**; Succeeded: qemu (1)
🟢 ok **coreos.ignition.resource.local**; Succeeded: qemu (1)
🟢 ok **coreos.ignition.resource.remote**; Succeeded: qemu (1)
🟢 ok **coreos.ignition.resource.s3.versioned**; Succeeded: qemu (1)
🟢 ok **coreos.ignition.security.tls**; Succeeded: qemu (1)
🟢 ok **coreos.ignition.sethostname**; Succeeded: qemu (1)
🟢 ok **coreos.ignition.systemd.enable-service**; Succeeded: qemu (1)
🟢 ok **coreos.locksmith.reboot**; Succeeded: qemu (1)
🟢 ok **coreos.locksmith.tls**; Succeeded: qemu (1)
🟢 ok **coreos.selinux.boolean**; Succeeded: qemu (1)
🟢 ok **coreos.selinux.enforce**; Succeeded: qemu (1)
🟢 ok **coreos.tls.fetch-urls**; Succeeded: qemu (1)
🟢 ok **coreos.update.badusr**; Succeeded: qemu (1)
🟢 ok **devcontainer.docker**; Succeeded: qemu (1)
🟢 ok **devcontainer.systemd-nspawn**; Succeeded: qemu (1)
🟢 ok **docker.base**; Succeeded: qemu (1)
🟢 ok **docker.btrfs-storage**; Succeeded: qemu (1)
🟢 ok **docker.containerd-restart**; Succeeded: qemu (1)
🟢 ok **docker.enable-service.sysext**; Succeeded: qemu (1)
🟢 ok **docker.lib-coreos-dockerd-compat**; Succeeded: qemu (1)
🟢 ok **docker.network-openbsd-nc**; Succeeded: qemu (1)
🟢 ok **docker.selinux**; Succeeded: qemu (1)
🟢 ok **docker.userns**; Succeeded: qemu (1)
🟢 ok **kubeadm.v1.34.4.calico.base**; Succeeded: qemu (1)
❌ not ok **kubeadm.v1.34.4.cilium.base**; Failed: qemu (1, 2, 3, 4, 5)
Diagnostic output for qemu, run 5
```
L1: " Error: _cluster.go:125: I0903 22:11:16.279037 2266 version.go:260] remote version is much newer: v1.37.0; falling back to: stable-1.34"
L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.34.11"
L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.34.11"
L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.34.11"
L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.34.11"
L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.12.1"
L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.1"
L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.5-0"
L9: "cluster.go:125: I0903 22:11:26.634132 2487 version.go:260] remote version is much newer: v1.37.0; falling back to: stable-1.34"
L10: "cluster.go:125: [init] Using Kubernetes version: v1.34.11"
L11: "cluster.go:125: [preflight] Running pre-flight checks"
L12: "cluster.go:125: [WARNING Service-Kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_"
L13: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster"
L14: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection"
L15: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_"
L16: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__"
L17: "cluster.go:125: [certs] Generating __ca__ certificate and key"
L18: "cluster.go:125: [certs] Generating __apiserver__ certificate and key"
L19: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local localhost] and IPs [10.96.0.1 10.0.0.3?]"
L20: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key"
L21: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key"
L22: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key"
L23: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation"
L24: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation"
L25: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation"
L26: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation"
L27: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation"
L28: "cluster.go:125: [certs] Generating __sa__ key and public key"
L29: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__"
L30: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file"
L31: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file"
L32: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file"
L33: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file"
L34: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file"
L35: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__"
L36: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__"
L37: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__"
L38: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__"
L39: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__"
L40: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__"
L41: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__"
L42: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__"
L43: "cluster.go:125: [kubelet-start] Starting the kubelet"
L44: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__"
L45: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s"
L46: "cluster.go:125: [kubelet-check] The kubelet is healthy after 1.00433777s"
L47: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s"
L48: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.3:6443/livez"
L49: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz"
L50: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez"
L51: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 3.394175731s"
L52: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 6.936122423s"
L53: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 17.03686182s"
L54: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace"
L55: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster"
L56: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs"
L57: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]"
L58: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]"
L59: "cluster.go:125: [bootstrap-token] Using token: g8e5fp.xbioz37o88p119z4"
L60: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles"
L61: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes"
L62: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials"
L63: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token"
L64: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster"
L65: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace"
L66: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key"
L67: "cluster.go:125: [addons] Applied essential addon: CoreDNS"
L68: "cluster.go:125: [addons] Applied essential addon: kube-proxy"
L69: "cluster.go:125: "
L70: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!"
L71: "cluster.go:125: "
L72: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:"
L73: "cluster.go:125: "
L74: "cluster.go:125: mkdir -p $HOME/.kube"
L75: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config"
L76: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config"
L77: "cluster.go:125: "
L78: "cluster.go:125: Alternatively, if you are the root user, you can run:"
L79: "cluster.go:125: "
L80: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf"
L81: "cluster.go:125: "
L82: "cluster.go:125: You should now deploy a pod network to the cluster."
L83: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:"
L84: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/"
L85: "cluster.go:125: "
L86: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:"
L87: "cluster.go:125: "
L88: "cluster.go:125: kubeadm join 10.0.0.3:6443 --token g8e5fp.xbioz37o88p119z4 _"
L89: "cluster.go:125: --discovery-token-ca-cert-hash sha256:17f408400ecb6e9b72f1cced3dc573923fce6d91ddce9e4921dc0be80e99a3e1 "
L90: "cluster.go:125: i Using Cilium version 1.12.5"
L91: "cluster.go:125: ? Auto-detected cluster name: kubernetes"
L92: "cluster.go:125: ? Auto-detected datapath mode: tunnel"
L93: "cluster.go:125: ? Auto-detected kube-proxy has been installed"
L94: "cluster.go:125: i helm template --namespace kube-system cilium cilium/cilium --version 1.12.5 --set cluster.id=0,cluster.name=kubernetes,encryption.nodeEncryption=false,extraConfig.cluster-pool-ipv4-?cidr=192.168.0.0/17,extraConfig.enable-endpoint-routes=true,kubeProxyReplacement=disabled,operator.replicas=1,serviceAccounts.cilium.name=cilium,serviceAccounts.operator.name=cilium-operator,tunnel=vx?lan"
L95: "cluster.go:125: i Storing helm values file in kube-system/cilium-cli-helm-values Secret"
L96: "cluster.go:125: ? Created CA in secret cilium-ca"
L97: "cluster.go:125: ? Generating certificates for Hubble..."
L98: "cluster.go:125: ? Creating Service accounts..."
L99: "cluster.go:125: ? Creating Cluster roles..."
L100: "cluster.go:125: ? Creating ConfigMap for Cilium version 1.12.5..."
L101: "cluster.go:125: i Manual overwrite in ConfigMap: enable-endpoint-routes=true"
L102: "cluster.go:125: i Manual overwrite in ConfigMap: cluster-pool-ipv4-cidr=192.168.0.0/17"
L103: "cluster.go:125: ? Creating Agent DaemonSet..."
L104: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/mount-cgroup]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog"
L105: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/apply-sysctl-overwrites]: deprecated since v1.30; use the ___appArmorProfile___ fi?eld instead__ subsys=klog"
L106: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/clean-cilium-state]: deprecated since v1.30; use the ___appArmorProfile___ field i?nstead__ subsys=klog"
L107: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/cilium-agent]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog"
L108: "cluster.go:125: ? Creating Operator Deployment..."
L109: "cluster.go:125: ? Waiting for Cilium to be installed and ready..."
L110: "cluster.go:125: ? Cilium was successfully installed! Run _cilium status_ to view installation health"
L111: "cluster.go:125: ?[33m /??_"
L112: "cluster.go:125: ?[36m /???[33m___/?[32m??_?[0m Cilium: ?[32mOK?[0m"
L113: "cluster.go:125: ?[36m ___?[31m/??_?[32m__/?[0m Operator: ?[32mOK?[0m"
L114: "cluster.go:125: ?[32m /???[31m___/?[35m??_?[0m Hubble: ?[36mdisabled?[0m"
L115: "cluster.go:125: ?[32m ___?[34m/??_?[35m__/?[0m ClusterMesh: ?[36mdisabled?[0m"
L116: "cluster.go:125: ?[34m ___/"
L117: "cluster.go:125: ?[0m"
L118: "cluster.go:125: Deployment cilium-operator "
L119: "cluster.go:125: DaemonSet cilium "
L120: "cluster.go:125: Containers: cilium-operator "
L121: "cluster.go:125: cilium "
L122: "cluster.go:125: Cluster Pods: 0/0 managed by Cilium"
L123: "cluster.go:125: W0903 22:16:22.666767 2114 joinconfiguration.go:112] [config] WARNING: Ignored configuration document with GroupVersionKind kubelet.config.k8s.io/v1beta1, Kind=KubeletConfiguration"
L124: "cluster.go:125: [WARNING Service-Kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_"
L125: "cluster.go:125: jq: error (at Diagnostic output for qemu, run 4
```
L1: " Error: _cluster.go:125: I0903 21:47:55.452773 2297 version.go:260] remote version is much newer: v1.37.0; falling back to: stable-1.34"
L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.34.11"
L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.34.11"
L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.34.11"
L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.34.11"
L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.12.1"
L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.1"
L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.5-0"
L9: "cluster.go:125: I0903 21:48:53.436684 2603 version.go:260] remote version is much newer: v1.37.0; falling back to: stable-1.34"
L10: "cluster.go:125: [init] Using Kubernetes version: v1.34.11"
L11: "cluster.go:125: [preflight] Running pre-flight checks"
L12: "cluster.go:125: [WARNING Service-Kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_"
L13: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster"
L14: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection"
L15: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_"
L16: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__"
L17: "cluster.go:125: [certs] Generating __ca__ certificate and key"
L18: "cluster.go:125: [certs] Generating __apiserver__ certificate and key"
L19: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local localhost] and IPs [10.96.0.1 10.0.0.3?]"
L20: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key"
L21: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key"
L22: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key"
L23: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation"
L24: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation"
L25: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation"
L26: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation"
L27: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation"
L28: "cluster.go:125: [certs] Generating __sa__ key and public key"
L29: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__"
L30: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file"
L31: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file"
L32: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file"
L33: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file"
L34: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file"
L35: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__"
L36: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__"
L37: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__"
L38: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__"
L39: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__"
L40: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__"
L41: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__"
L42: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__"
L43: "cluster.go:125: [kubelet-start] Starting the kubelet"
L44: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__"
L45: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s"
L46: "cluster.go:125: [kubelet-check] The kubelet is healthy after 4.023175259s"
L47: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s"
L48: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.3:6443/livez"
L49: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz"
L50: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez"
L51: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 13.224382693s"
L52: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 37.071340184s"
L53: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 1m47.604012526s"
L54: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace"
L55: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster"
L56: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs"
L57: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]"
L58: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]"
L59: "cluster.go:125: [bootstrap-token] Using token: b5b3u8.c9rft4vy0pv3nuej"
L60: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles"
L61: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes"
L62: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials"
L63: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token"
L64: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster"
L65: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace"
L66: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key"
L67: "cluster.go:125: [addons] Applied essential addon: CoreDNS"
L68: "cluster.go:125: [addons] Applied essential addon: kube-proxy"
L69: "cluster.go:125: "
L70: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!"
L71: "cluster.go:125: "
L72: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:"
L73: "cluster.go:125: "
L74: "cluster.go:125: mkdir -p $HOME/.kube"
L75: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config"
L76: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config"
L77: "cluster.go:125: "
L78: "cluster.go:125: Alternatively, if you are the root user, you can run:"
L79: "cluster.go:125: "
L80: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf"
L81: "cluster.go:125: "
L82: "cluster.go:125: You should now deploy a pod network to the cluster."
L83: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:"
L84: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/"
L85: "cluster.go:125: "
L86: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:"
L87: "cluster.go:125: "
L88: "cluster.go:125: kubeadm join 10.0.0.3:6443 --token b5b3u8.c9rft4vy0pv3nuej _"
L89: "cluster.go:125: --discovery-token-ca-cert-hash sha256:8336b98e0c1f247c2f01cc80bf376460ae6a4158ec9c8607d4117c002adf6ad0 "
L90: "cluster.go:125: i Using Cilium version 1.12.5"
L91: "cluster.go:125: ? Auto-detected cluster name: kubernetes"
L92: "cluster.go:125: ? Auto-detected datapath mode: tunnel"
L93: "cluster.go:125: ? Auto-detected kube-proxy has been installed"
L94: "cluster.go:125: i helm template --namespace kube-system cilium cilium/cilium --version 1.12.5 --set cluster.id=0,cluster.name=kubernetes,encryption.nodeEncryption=false,extraConfig.cluster-pool-ipv4-?cidr=192.168.0.0/17,extraConfig.enable-endpoint-routes=true,kubeProxyReplacement=disabled,operator.replicas=1,serviceAccounts.cilium.name=cilium,serviceAccounts.operator.name=cilium-operator,tunnel=vx?lan"
L95: "cluster.go:125: i Storing helm values file in kube-system/cilium-cli-helm-values Secret"
L96: "cluster.go:125: ? Created CA in secret cilium-ca"
L97: "cluster.go:125: ? Generating certificates for Hubble..."
L98: "cluster.go:125: ? Creating Service accounts..."
L99: "cluster.go:125: ? Creating Cluster roles..."
L100: "cluster.go:125: ? Creating ConfigMap for Cilium version 1.12.5..."
L101: "cluster.go:125: i Manual overwrite in ConfigMap: enable-endpoint-routes=true"
L102: "cluster.go:125: i Manual overwrite in ConfigMap: cluster-pool-ipv4-cidr=192.168.0.0/17"
L103: "cluster.go:125: ? Creating Agent DaemonSet..."
L104: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/mount-cgroup]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog"
L105: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/apply-sysctl-overwrites]: deprecated since v1.30; use the ___appArmorProfile___ fi?eld instead__ subsys=klog"
L106: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/clean-cilium-state]: deprecated since v1.30; use the ___appArmorProfile___ field i?nstead__ subsys=klog"
L107: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/cilium-agent]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog"
L108: "cluster.go:125: ? Creating Operator Deployment..."
L109: "cluster.go:125: ? Waiting for Cilium to be installed and ready..."
L110: "cluster.go:125: ? Cilium was successfully installed! Run _cilium status_ to view installation health"
L111: "cluster.go:125: ?[33m /??_"
L112: "cluster.go:125: ?[36m /???[33m___/?[32m??_?[0m Cilium: ?[32mOK?[0m"
L113: "cluster.go:125: ?[36m ___?[31m/??_?[32m__/?[0m Operator: ?[32mOK?[0m"
L114: "cluster.go:125: ?[32m /???[31m___/?[35m??_?[0m Hubble: ?[36mdisabled?[0m"
L115: "cluster.go:125: ?[32m ___?[34m/??_?[35m__/?[0m ClusterMesh: ?[36mdisabled?[0m"
L116: "cluster.go:125: ?[34m ___/"
L117: "cluster.go:125: ?[0m"
L118: "cluster.go:125: Deployment cilium-operator "
L119: "cluster.go:125: DaemonSet cilium "
L120: "cluster.go:125: Containers: cilium "
L121: "cluster.go:125: cilium-operator "
L122: "cluster.go:125: Cluster Pods: 0/0 managed by Cilium"
L123: "cluster.go:125: W0903 21:58:04.259596 2143 joinconfiguration.go:112] [config] WARNING: Ignored configuration document with GroupVersionKind kubelet.config.k8s.io/v1beta1, Kind=KubeletConfiguration"
L124: "cluster.go:125: [WARNING Service-Kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_"
L125: "cluster.go:125: jq: error (at Diagnostic output for qemu, run 3
```
L1: " Error: _cluster.go:125: I0903 21:16:39.306475 2271 version.go:260] remote version is much newer: v1.37.0; falling back to: stable-1.34"
L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.34.11"
L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.34.11"
L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.34.11"
L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.34.11"
L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.12.1"
L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.1"
L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.5-0"
L9: "cluster.go:125: I0903 21:16:48.827091 2491 version.go:260] remote version is much newer: v1.37.0; falling back to: stable-1.34"
L10: "cluster.go:125: [init] Using Kubernetes version: v1.34.11"
L11: "cluster.go:125: [preflight] Running pre-flight checks"
L12: "cluster.go:125: [WARNING Service-Kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_"
L13: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster"
L14: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection"
L15: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_"
L16: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__"
L17: "cluster.go:125: [certs] Generating __ca__ certificate and key"
L18: "cluster.go:125: [certs] Generating __apiserver__ certificate and key"
L19: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local localhost] and IPs [10.96.0.1 10.0.0.6?]"
L20: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key"
L21: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key"
L22: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key"
L23: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation"
L24: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation"
L25: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation"
L26: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation"
L27: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation"
L28: "cluster.go:125: [certs] Generating __sa__ key and public key"
L29: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__"
L30: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file"
L31: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file"
L32: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file"
L33: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file"
L34: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file"
L35: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__"
L36: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__"
L37: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__"
L38: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__"
L39: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__"
L40: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__"
L41: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__"
L42: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__"
L43: "cluster.go:125: [kubelet-start] Starting the kubelet"
L44: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__"
L45: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s"
L46: "cluster.go:125: [kubelet-check] The kubelet is healthy after 1.003918746s"
L47: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s"
L48: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.6:6443/livez"
L49: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz"
L50: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez"
L51: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 2.005883513s"
L52: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 2.503601683s"
L53: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 5.504672069s"
L54: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace"
L55: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster"
L56: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs"
L57: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]"
L58: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]"
L59: "cluster.go:125: [bootstrap-token] Using token: y34u6e.kx68rkx7fklmd3ka"
L60: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles"
L61: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes"
L62: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials"
L63: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token"
L64: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster"
L65: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace"
L66: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key"
L67: "cluster.go:125: [addons] Applied essential addon: CoreDNS"
L68: "cluster.go:125: [addons] Applied essential addon: kube-proxy"
L69: "cluster.go:125: "
L70: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!"
L71: "cluster.go:125: "
L72: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:"
L73: "cluster.go:125: "
L74: "cluster.go:125: mkdir -p $HOME/.kube"
L75: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config"
L76: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config"
L77: "cluster.go:125: "
L78: "cluster.go:125: Alternatively, if you are the root user, you can run:"
L79: "cluster.go:125: "
L80: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf"
L81: "cluster.go:125: "
L82: "cluster.go:125: You should now deploy a pod network to the cluster."
L83: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:"
L84: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/"
L85: "cluster.go:125: "
L86: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:"
L87: "cluster.go:125: "
L88: "cluster.go:125: kubeadm join 10.0.0.6:6443 --token y34u6e.kx68rkx7fklmd3ka _"
L89: "cluster.go:125: --discovery-token-ca-cert-hash sha256:48d6c28a8adadac4db855579bb9109d4d5aeb4ddaf3c45e4b1c3a4320ea65961 "
L90: "cluster.go:125: i Using Cilium version 1.12.5"
L91: "cluster.go:125: ? Auto-detected cluster name: kubernetes"
L92: "cluster.go:125: ? Auto-detected datapath mode: tunnel"
L93: "cluster.go:125: ? Auto-detected kube-proxy has been installed"
L94: "cluster.go:125: i helm template --namespace kube-system cilium cilium/cilium --version 1.12.5 --set cluster.id=0,cluster.name=kubernetes,encryption.nodeEncryption=false,extraConfig.cluster-pool-ipv4-?cidr=192.168.0.0/17,extraConfig.enable-endpoint-routes=true,kubeProxyReplacement=disabled,operator.replicas=1,serviceAccounts.cilium.name=cilium,serviceAccounts.operator.name=cilium-operator,tunnel=vx?lan"
L95: "cluster.go:125: i Storing helm values file in kube-system/cilium-cli-helm-values Secret"
L96: "cluster.go:125: ? Created CA in secret cilium-ca"
L97: "cluster.go:125: ? Generating certificates for Hubble..."
L98: "cluster.go:125: ? Creating Service accounts..."
L99: "cluster.go:125: ? Creating Cluster roles..."
L100: "cluster.go:125: ? Creating ConfigMap for Cilium version 1.12.5..."
L101: "cluster.go:125: i Manual overwrite in ConfigMap: enable-endpoint-routes=true"
L102: "cluster.go:125: i Manual overwrite in ConfigMap: cluster-pool-ipv4-cidr=192.168.0.0/17"
L103: "cluster.go:125: ? Creating Agent DaemonSet..."
L104: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/mount-cgroup]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog"
L105: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/apply-sysctl-overwrites]: deprecated since v1.30; use the ___appArmorProfile___ fi?eld instead__ subsys=klog"
L106: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/clean-cilium-state]: deprecated since v1.30; use the ___appArmorProfile___ field i?nstead__ subsys=klog"
L107: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/cilium-agent]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog"
L108: "cluster.go:125: ? Creating Operator Deployment..."
L109: "cluster.go:125: ? Waiting for Cilium to be installed and ready..."
L110: "cluster.go:125: ? Cilium was successfully installed! Run _cilium status_ to view installation health"
L111: "cluster.go:125: ?[33m /??_"
L112: "cluster.go:125: ?[36m /???[33m___/?[32m??_?[0m Cilium: ?[32mOK?[0m"
L113: "cluster.go:125: ?[36m ___?[31m/??_?[32m__/?[0m Operator: ?[32mOK?[0m"
L114: "cluster.go:125: ?[32m /???[31m___/?[35m??_?[0m Hubble: ?[36mdisabled?[0m"
L115: "cluster.go:125: ?[32m ___?[34m/??_?[35m__/?[0m ClusterMesh: ?[36mdisabled?[0m"
L116: "cluster.go:125: ?[34m ___/"
L117: "cluster.go:125: ?[0m"
L118: "cluster.go:125: DaemonSet cilium "
L119: "cluster.go:125: Deployment cilium-operator "
L120: "cluster.go:125: Containers: cilium "
L121: "cluster.go:125: cilium-operator "
L122: "cluster.go:125: Cluster Pods: 0/0 managed by Cilium"
L123: "cluster.go:125: W0903 21:18:45.446569 2073 joinconfiguration.go:112] [config] WARNING: Ignored configuration document with GroupVersionKind kubelet.config.k8s.io/v1beta1, Kind=KubeletConfiguration"
L124: "cluster.go:125: [WARNING Service-Kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_"
L125: "--- FAIL: kubeadm.v1.34.4.cilium.base/IPSec_encryption (82.83s)"
L126: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/mount-cgroup]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog"
L127: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/apply-sysctl-overwrites]: deprecated since v1.30; use the ___appArmorProfile___ fi?eld instead__ subsys=klog"
L128: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/clean-cilium-state]: deprecated since v1.30; use the ___appArmorProfile___ field i?nstead__ subsys=klog"
L129: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/cilium-agent]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog"
L130: "cluster.go:125: Error: Unable to determine status: timeout while waiting for status to become successful: context deadline exceeded"
L131: "cluster.go:145: __/opt/bin/cilium status --wait --wait-duration 1m__ failed: output ?[33m /????_"
L132: "?[36m /?????[33m___/?[32m????_?[0m Cilium: ?[31m2 errors?[0m"
L133: "?[36m ___?[31m/????_?[32m__/?[0m Operator: ?[32mOK?[0m"
L134: "?[32m /?????[31m___/?[35m????_?[0m Hubble: ?[36mdisabled?[0m"
L135: "?[32m ___?[34m/????_?[35m__/?[0m ClusterMesh: ?[36mdisabled?[0m"
L136: "?[34m ___/"
L137: "?[0m"
L138: "Deployment cilium-operator Desired: 1, Ready: ?[32m1/1?[0m, Available: ?[32m1/1?[0m"
L139: "DaemonSet cilium Desired: 2, Ready: ?[33m1/2?[0m, Available: ?[33m1/2?[0m, Unavailable: ?[31m1/2?[0m"
L140: "Containers: cilium Running: ?[32m2?[0m"
L141: "cilium-operator Running: ?[32m1?[0m"
L142: "Cluster Pods: 5/5 managed by Cilium"
L143: "Image versions cilium quay.io/cilium/cilium:v1.12.5@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5: 2"
L144: "cilium-operator quay.io/cilium/operator-generic:v1.12.5@sha256:b296eb7f0f7656a5cc19724f40a8a7121b7fd725278b7d61dc91fe0b7ffd7c0e: 1"
L145: "Errors: cilium cilium 1 pods of DaemonSet cilium are not ready"
L146: "cilium cilium-bbfpk unable to retrieve cilium status: command terminated with exit code 1, status Process exited with status 1_"
L147: " "
```
Diagnostic output for qemu, run 2
```
L1: " Error: _cluster.go:125: I0903 20:53:00.223324 2301 version.go:260] remote version is much newer: v1.37.0; falling back to: stable-1.34"
L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.34.11"
L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.34.11"
L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.34.11"
L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.34.11"
L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.12.1"
L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.1"
L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.5-0"
L9: "cluster.go:125: I0903 20:53:58.287054 2592 version.go:260] remote version is much newer: v1.37.0; falling back to: stable-1.34"
L10: "cluster.go:125: [init] Using Kubernetes version: v1.34.11"
L11: "cluster.go:125: [preflight] Running pre-flight checks"
L12: "cluster.go:125: [WARNING Service-Kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_"
L13: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster"
L14: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection"
L15: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_"
L16: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__"
L17: "cluster.go:125: [certs] Generating __ca__ certificate and key"
L18: "cluster.go:125: [certs] Generating __apiserver__ certificate and key"
L19: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local localhost] and IPs [10.96.0.1 10.0.0.8?]"
L20: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key"
L21: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key"
L22: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key"
L23: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation"
L24: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation"
L25: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation"
L26: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation"
L27: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation"
L28: "cluster.go:125: [certs] Generating __sa__ key and public key"
L29: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__"
L30: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file"
L31: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file"
L32: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file"
L33: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file"
L34: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file"
L35: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__"
L36: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__"
L37: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__"
L38: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__"
L39: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__"
L40: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__"
L41: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__"
L42: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__"
L43: "cluster.go:125: [kubelet-start] Starting the kubelet"
L44: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__"
L45: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s"
L46: "cluster.go:125: [kubelet-check] The kubelet is healthy after 5.050788679s"
L47: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s"
L48: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.8:6443/livez"
L49: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz"
L50: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez"
L51: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 18.201402413s"
L52: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 40.68711743s"
L53: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 2m21.200723461s"
L54: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace"
L55: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster"
L56: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs"
L57: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]"
L58: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]"
L59: "cluster.go:125: [bootstrap-token] Using token: y1yx0s.3awpmpu4x28o0wto"
L60: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles"
L61: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes"
L62: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials"
L63: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token"
L64: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster"
L65: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace"
L66: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key"
L67: "cluster.go:125: [addons] Applied essential addon: CoreDNS"
L68: "cluster.go:125: [addons] Applied essential addon: kube-proxy"
L69: "cluster.go:125: "
L70: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!"
L71: "cluster.go:125: "
L72: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:"
L73: "cluster.go:125: "
L74: "cluster.go:125: mkdir -p $HOME/.kube"
L75: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config"
L76: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config"
L77: "cluster.go:125: "
L78: "cluster.go:125: Alternatively, if you are the root user, you can run:"
L79: "cluster.go:125: "
L80: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf"
L81: "cluster.go:125: "
L82: "cluster.go:125: You should now deploy a pod network to the cluster."
L83: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:"
L84: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/"
L85: "cluster.go:125: "
L86: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:"
L87: "cluster.go:125: "
L88: "cluster.go:125: kubeadm join 10.0.0.8:6443 --token y1yx0s.3awpmpu4x28o0wto _"
L89: "cluster.go:125: --discovery-token-ca-cert-hash sha256:1dfb9fbbc7f87326a0b50dbc283065684c249e4f1fa802a441a39d4d095b82d4 "
L90: "cluster.go:125: i Using Cilium version 1.12.5"
L91: "cluster.go:125: ? Auto-detected cluster name: kubernetes"
L92: "cluster.go:125: ? Auto-detected datapath mode: tunnel"
L93: "cluster.go:125: ? Auto-detected kube-proxy has been installed"
L94: "cluster.go:125: i helm template --namespace kube-system cilium cilium/cilium --version 1.12.5 --set cluster.id=0,cluster.name=kubernetes,encryption.nodeEncryption=false,extraConfig.cluster-pool-ipv4-?cidr=192.168.0.0/17,extraConfig.enable-endpoint-routes=true,kubeProxyReplacement=disabled,operator.replicas=1,serviceAccounts.cilium.name=cilium,serviceAccounts.operator.name=cilium-operator,tunnel=vx?lan"
L95: "cluster.go:125: i Storing helm values file in kube-system/cilium-cli-helm-values Secret"
L96: "cluster.go:125: ? Created CA in secret cilium-ca"
L97: "cluster.go:125: ? Generating certificates for Hubble..."
L98: "cluster.go:125: ? Creating Service accounts..."
L99: "cluster.go:125: ? Creating Cluster roles..."
L100: "cluster.go:125: ? Creating ConfigMap for Cilium version 1.12.5..."
L101: "cluster.go:125: i Manual overwrite in ConfigMap: enable-endpoint-routes=true"
L102: "cluster.go:125: i Manual overwrite in ConfigMap: cluster-pool-ipv4-cidr=192.168.0.0/17"
L103: "cluster.go:125: ? Creating Agent DaemonSet..."
L104: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/mount-cgroup]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog"
L105: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/apply-sysctl-overwrites]: deprecated since v1.30; use the ___appArmorProfile___ fi?eld instead__ subsys=klog"
L106: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/clean-cilium-state]: deprecated since v1.30; use the ___appArmorProfile___ field i?nstead__ subsys=klog"
L107: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/cilium-agent]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog"
L108: "cluster.go:125: ? Creating Operator Deployment..."
L109: "cluster.go:125: ? Waiting for Cilium to be installed and ready..."
L110: "cluster.go:125: ? Cilium was successfully installed! Run _cilium status_ to view installation health"
L111: "cluster.go:125: ?[33m /??_"
L112: "cluster.go:125: ?[36m /???[33m___/?[32m??_?[0m Cilium: ?[32mOK?[0m"
L113: "cluster.go:125: ?[36m ___?[31m/??_?[32m__/?[0m Operator: ?[32mOK?[0m"
L114: "cluster.go:125: ?[32m /???[31m___/?[35m??_?[0m Hubble: ?[36mdisabled?[0m"
L115: "cluster.go:125: ?[32m ___?[34m/??_?[35m__/?[0m ClusterMesh: ?[36mdisabled?[0m"
L116: "cluster.go:125: ?[34m ___/"
L117: "cluster.go:125: ?[0m"
L118: "cluster.go:125: DaemonSet cilium "
L119: "cluster.go:125: Deployment cilium-operator "
L120: "cluster.go:125: Containers: cilium "
L121: "cluster.go:125: cilium-operator "
L122: "cluster.go:125: Cluster Pods: 0/0 managed by Cilium"
L123: "cluster.go:125: W0903 21:01:46.823515 2108 joinconfiguration.go:112] [config] WARNING: Ignored configuration document with GroupVersionKind kubelet.config.k8s.io/v1beta1, Kind=KubeletConfiguration"
L124: "cluster.go:125: [WARNING Service-Kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_"
L125: "--- FAIL: kubeadm.v1.34.4.cilium.base/IPSec_encryption (152.08s)"
L126: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/mount-cgroup]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog"
L127: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/apply-sysctl-overwrites]: deprecated since v1.30; use the ___appArmorProfile___ fi?eld instead__ subsys=klog"
L128: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/clean-cilium-state]: deprecated since v1.30; use the ___appArmorProfile___ field i?nstead__ subsys=klog"
L129: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/cilium-agent]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog"
L130: "cluster.go:125: Error: Unable to determine status: timeout while waiting for status to become successful: context deadline exceeded"
L131: "cluster.go:145: __/opt/bin/cilium status --wait --wait-duration 1m__ failed: output ?[33m /????_"
L132: "?[36m /?????[33m___/?[32m????_?[0m Cilium: ?[31m1 errors?[0m"
L133: "?[36m ___?[31m/????_?[32m__/?[0m Operator: ?[31m1 errors?[0m"
L134: "?[32m /?????[31m___/?[35m????_?[0m Hubble: ?[33m1 warnings?[0m"
L135: "?[32m ___?[34m/????_?[35m__/?[0m ClusterMesh: ?[33m1 warnings?[0m"
L136: "?[34m ___/"
L137: "?[0m"
L138: "Cluster Pods: 0/0 managed by Cilium"
L139: "Errors: cilium cilium client rate limiter Wait returned an error: context deadline exceeded"
L140: "cilium-operator cilium-operator client rate limiter Wait returned an error: context deadline exceeded"
L141: "Warnings: hubble-relay hubble-relay hubble relay is not deployed"
L142: "hubble-ui hubble-ui hubble ui is not deployed"
L143: "clustermesh-apiserver clustermesh-apiserver clustermesh is not deployed, status Process exited with status 1_"
L144: " "
```
Diagnostic output for qemu, run 1
```
L1: " Error: _cluster.go:125: I0903 18:57:43.657709 2268 version.go:260] remote version is much newer: v1.37.0; falling back to: stable-1.34"
L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.34.11"
L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.34.11"
L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.34.11"
L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.34.11"
L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.12.1"
L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.1"
L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.5-0"
L9: "cluster.go:125: I0903 18:58:38.073429 2557 version.go:260] remote version is much newer: v1.37.0; falling back to: stable-1.34"
L10: "cluster.go:125: [init] Using Kubernetes version: v1.34.11"
L11: "cluster.go:125: [preflight] Running pre-flight checks"
L12: "cluster.go:125: [WARNING Service-Kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_"
L13: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster"
L14: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection"
L15: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_"
L16: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__"
L17: "cluster.go:125: [certs] Generating __ca__ certificate and key"
L18: "cluster.go:125: [certs] Generating __apiserver__ certificate and key"
L19: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local localhost] and IPs [10.96.0.1 10.0.0.4?5]"
L20: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key"
L21: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key"
L22: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key"
L23: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation"
L24: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation"
L25: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation"
L26: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation"
L27: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation"
L28: "cluster.go:125: [certs] Generating __sa__ key and public key"
L29: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__"
L30: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file"
L31: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file"
L32: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file"
L33: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file"
L34: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file"
L35: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__"
L36: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__"
L37: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__"
L38: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__"
L39: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__"
L40: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__"
L41: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__"
L42: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__"
L43: "cluster.go:125: [kubelet-start] Starting the kubelet"
L44: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__"
L45: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s"
L46: "cluster.go:125: [kubelet-check] The kubelet is healthy after 6.51209289s"
L47: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s"
L48: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.45:6443/livez"
L49: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz"
L50: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez"
L51: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 14.40255717s"
L52: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 35.968991553s"
L53: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 1m50.108215028s"
L54: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace"
L55: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster"
L56: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs"
L57: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]"
L58: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]"
L59: "cluster.go:125: [bootstrap-token] Using token: 138h5b.72jh4mdaxinrsorb"
L60: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles"
L61: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes"
L62: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials"
L63: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token"
L64: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster"
L65: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace"
L66: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key"
L67: "cluster.go:125: [addons] Applied essential addon: CoreDNS"
L68: "cluster.go:125: [addons] Applied essential addon: kube-proxy"
L69: "cluster.go:125: "
L70: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!"
L71: "cluster.go:125: "
L72: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:"
L73: "cluster.go:125: "
L74: "cluster.go:125: mkdir -p $HOME/.kube"
L75: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config"
L76: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config"
L77: "cluster.go:125: "
L78: "cluster.go:125: Alternatively, if you are the root user, you can run:"
L79: "cluster.go:125: "
L80: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf"
L81: "cluster.go:125: "
L82: "cluster.go:125: You should now deploy a pod network to the cluster."
L83: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:"
L84: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/"
L85: "cluster.go:125: "
L86: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:"
L87: "cluster.go:125: "
L88: "cluster.go:125: kubeadm join 10.0.0.45:6443 --token 138h5b.72jh4mdaxinrsorb _"
L89: "cluster.go:125: --discovery-token-ca-cert-hash sha256:642f671efae14bce375ced7aaf1aeda8cc04437996f30a0cf8ae617564eb4665 "
L90: "cluster.go:125: i Using Cilium version 1.12.5"
L91: "cluster.go:125: ? Auto-detected cluster name: kubernetes"
L92: "cluster.go:125: ? Auto-detected datapath mode: tunnel"
L93: "cluster.go:125: ? Auto-detected kube-proxy has been installed"
L94: "cluster.go:125: i helm template --namespace kube-system cilium cilium/cilium --version 1.12.5 --set cluster.id=0,cluster.name=kubernetes,encryption.nodeEncryption=false,extraConfig.cluster-pool-ipv4-?cidr=192.168.0.0/17,extraConfig.enable-endpoint-routes=true,kubeProxyReplacement=disabled,operator.replicas=1,serviceAccounts.cilium.name=cilium,serviceAccounts.operator.name=cilium-operator,tunnel=vx?lan"
L95: "cluster.go:125: i Storing helm values file in kube-system/cilium-cli-helm-values Secret"
L96: "cluster.go:125: ? Created CA in secret cilium-ca"
L97: "cluster.go:125: ? Generating certificates for Hubble..."
L98: "cluster.go:125: ? Creating Service accounts..."
L99: "cluster.go:125: ? Creating Cluster roles..."
L100: "cluster.go:125: ? Creating ConfigMap for Cilium version 1.12.5..."
L101: "cluster.go:125: i Manual overwrite in ConfigMap: enable-endpoint-routes=true"
L102: "cluster.go:125: i Manual overwrite in ConfigMap: cluster-pool-ipv4-cidr=192.168.0.0/17"
L103: "cluster.go:125: ? Creating Agent DaemonSet..."
L104: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/mount-cgroup]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog"
L105: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/apply-sysctl-overwrites]: deprecated since v1.30; use the ___appArmorProfile___ fi?eld instead__ subsys=klog"
L106: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/clean-cilium-state]: deprecated since v1.30; use the ___appArmorProfile___ field i?nstead__ subsys=klog"
L107: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/cilium-agent]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog"
L108: "cluster.go:125: ? Creating Operator Deployment..."
L109: "cluster.go:125: ? Waiting for Cilium to be installed and ready..."
L110: "cluster.go:125: ? Cilium was successfully installed! Run _cilium status_ to view installation health"
L111: "cluster.go:125: ?[33m /??_"
L112: "cluster.go:125: ?[36m /???[33m___/?[32m??_?[0m Cilium: ?[32mOK?[0m"
L113: "cluster.go:125: ?[36m ___?[31m/??_?[32m__/?[0m Operator: ?[32mOK?[0m"
L114: "cluster.go:125: ?[32m /???[31m___/?[35m??_?[0m Hubble: ?[36mdisabled?[0m"
L115: "cluster.go:125: ?[32m ___?[34m/??_?[35m__/?[0m ClusterMesh: ?[36mdisabled?[0m"
L116: "cluster.go:125: ?[34m ___/"
L117: "cluster.go:125: ?[0m"
L118: "cluster.go:125: Deployment cilium-operator "
L119: "cluster.go:125: DaemonSet cilium "
L120: "cluster.go:125: Containers: cilium "
L121: "cluster.go:125: cilium-operator "
L122: "cluster.go:125: Cluster Pods: 0/0 managed by Cilium"
L123: "cluster.go:125: W0903 19:07:33.847027 2129 joinconfiguration.go:112] [config] WARNING: Ignored configuration document with GroupVersionKind kubelet.config.k8s.io/v1beta1, Kind=KubeletConfiguration"
L124: "cluster.go:125: [WARNING Service-Kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_"
L125: "--- FAIL: kubeadm.v1.34.4.cilium.base/nginx_deployment (370.33s)"
L126: "kubeadm.go:232: nginx is not deployed: ready replicas should be equal to 1: null"
L127: "--- FAIL: kubeadm.v1.34.4.cilium.base/IPSec_encryption (107.70s)"
L128: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/mount-cgroup]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog"
L129: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/apply-sysctl-overwrites]: deprecated since v1.30; use the ___appArmorProfile___ fi?eld instead__ subsys=klog"
L130: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/clean-cilium-state]: deprecated since v1.30; use the ___appArmorProfile___ field i?nstead__ subsys=klog"
L131: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/cilium-agent]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog"
L132: "cluster.go:125: Error: Unable to determine status: timeout while waiting for status to become successful: context deadline exceeded"
L133: "cluster.go:145: __/opt/bin/cilium status --wait --wait-duration 1m__ failed: output ?[33m /????_"
L134: "?[36m /?????[33m___/?[32m????_?[0m Cilium: ?[31m2 errors?[0m, ?[33m1 warnings?[0m"
L135: "?[36m ___?[31m/????_?[32m__/?[0m Operator: ?[32mOK?[0m"
L136: "?[32m /?????[31m___/?[35m????_?[0m Hubble: ?[36mdisabled?[0m"
L137: "?[32m ___?[34m/????_?[35m__/?[0m ClusterMesh: ?[36mdisabled?[0m"
L138: "?[34m ___/"
L139: "?[0m"
L140: "Deployment cilium-operator Desired: 1, Ready: ?[32m1/1?[0m, Available: ?[32m1/1?[0m"
L141: "DaemonSet cilium Desired: 2, Unavailable: ?[31m2/2?[0m"
L142: "Containers: cilium Running: ?[32m1?[0m, Pending: ?[32m1?[0m"
L143: "cilium-operator Running: ?[32m1?[0m"
L144: "Cluster Pods: 0/0 managed by Cilium"
L145: "Image versions cilium quay.io/cilium/cilium:v1.12.5@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5: 2"
L146: "cilium-operator quay.io/cilium/operator-generic:v1.12.5@sha256:b296eb7f0f7656a5cc19724f40a8a7121b7fd725278b7d61dc91fe0b7ffd7c0e: 1"
L147: "Errors: cilium cilium 2 pods of DaemonSet cilium are not ready"
L148: "cilium cilium-5kf6r unable to retrieve cilium status: command terminated with exit code 1"
L149: "Warnings: cilium cilium-mml9j pod is pending, status Process exited with status 1"
L150: "harness.go:621: Found systemd dependency unit failed to start (?[0;1;39msystemd-fsck????[0mle System Check on /dev/mapper/usr. ) on machine 319be798-97c6-4408-b2c2-9b1a439f1fc6 console_"
L151: " "
```
🟢 ok **kubeadm.v1.34.4.flannel.base**; Succeeded: qemu (1)
🟢 ok **kubeadm.v1.35.1.calico.base**; Succeeded: qemu (3); Failed: qemu (1, 2)
Diagnostic output for qemu, run 2
```
L1: " Error: _cluster.go:125: I0903 20:52:54.996281 2288 version.go:260] remote version is much newer: v1.37.0; falling back to: stable-1.35"
L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.35.8"
L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.35.8"
L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.35.8"
L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.35.8"
L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.13.1"
L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.1"
L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.6-0"
L9: "cluster.go:125: I0903 20:53:54.473131 2589 version.go:260] remote version is much newer: v1.37.0; falling back to: stable-1.35"
L10: "cluster.go:125: [init] Using Kubernetes version: v1.35.8"
L11: "cluster.go:125: [preflight] Running pre-flight checks"
L12: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_"
L13: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster"
L14: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection"
L15: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_"
L16: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__"
L17: "cluster.go:125: [certs] Generating __ca__ certificate and key"
L18: "cluster.go:125: [certs] Generating __apiserver__ certificate and key"
L19: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local localhost] and IPs [10.96.0.1 10.0.0.7?]"
L20: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key"
L21: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key"
L22: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key"
L23: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation"
L24: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation"
L25: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation"
L26: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation"
L27: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation"
L28: "cluster.go:125: [certs] Generating __sa__ key and public key"
L29: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__"
L30: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file"
L31: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file"
L32: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file"
L33: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file"
L34: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file"
L35: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__"
L36: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__"
L37: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__"
L38: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__"
L39: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__"
L40: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__"
L41: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__"
L42: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__"
L43: "cluster.go:125: [kubelet-start] Starting the kubelet"
L44: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__"
L45: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s"
L46: "cluster.go:125: [kubelet-check] The kubelet is healthy after 3.050865728s"
L47: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s"
L48: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.7:6443/livez"
L49: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz"
L50: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez"
L51: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 14.746680395s"
L52: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 34.995063228s"
L53: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 1m58.555404395s"
L54: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace"
L55: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster"
L56: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs"
L57: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]"
L58: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]"
L59: "cluster.go:125: [bootstrap-token] Using token: 6elz5j.fji4usra71sxa722"
L60: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles"
L61: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes"
L62: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials"
L63: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token"
L64: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster"
L65: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace"
L66: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key"
L67: "cluster.go:125: [addons] Applied essential addon: CoreDNS"
L68: "cluster.go:125: [addons] Applied essential addon: kube-proxy"
L69: "cluster.go:125: "
L70: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!"
L71: "cluster.go:125: "
L72: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:"
L73: "cluster.go:125: "
L74: "cluster.go:125: mkdir -p $HOME/.kube"
L75: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config"
L76: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config"
L77: "cluster.go:125: "
L78: "cluster.go:125: Alternatively, if you are the root user, you can run:"
L79: "cluster.go:125: "
L80: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf"
L81: "cluster.go:125: "
L82: "cluster.go:125: You should now deploy a pod network to the cluster."
L83: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:"
L84: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/"
L85: "cluster.go:125: "
L86: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:"
L87: "cluster.go:125: "
L88: "cluster.go:125: kubeadm join 10.0.0.7:6443 --token 6elz5j.fji4usra71sxa722 _"
L89: "cluster.go:125: --discovery-token-ca-cert-hash sha256:b18cab889e9a559ea98f2a84710d4d8b608946a0c015b47280c73515aba9a9f6 "
L90: "cluster.go:125: namespace/tigera-operator created"
L91: "cluster.go:125: serviceaccount/tigera-operator created"
L92: "cluster.go:125: clusterrole.rbac.authorization.k8s.io/tigera-operator-secrets created"
L93: "cluster.go:125: clusterrole.rbac.authorization.k8s.io/tigera-operator created"
L94: "cluster.go:125: clusterrolebinding.rbac.authorization.k8s.io/tigera-operator created"
L95: "cluster.go:125: rolebinding.rbac.authorization.k8s.io/tigera-operator-secrets created"
L96: "cluster.go:125: deployment.apps/tigera-operator created"
L97: "cluster.go:125: error: timed out waiting for the condition"
L98: "kubeadm.go:197: unable to setup cluster: unable to run master script: Process exited with status 1_"
L99: " "
```
Diagnostic output for qemu, run 1
```
L1: " Error: _cluster.go:125: I0903 18:49:05.357628 2353 version.go:260] remote version is much newer: v1.37.0; falling back to: stable-1.35"
L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.35.8"
L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.35.8"
L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.35.8"
L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.35.8"
L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.13.1"
L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.1"
L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.6-0"
L9: "cluster.go:125: I0903 18:51:04.401687 2680 version.go:260] remote version is much newer: v1.37.0; falling back to: stable-1.35"
L10: "cluster.go:125: [init] Using Kubernetes version: v1.35.8"
L11: "cluster.go:125: [preflight] Running pre-flight checks"
L12: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_"
L13: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster"
L14: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection"
L15: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_"
L16: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__"
L17: "cluster.go:125: [certs] Generating __ca__ certificate and key"
L18: "cluster.go:125: [certs] Generating __apiserver__ certificate and key"
L19: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local localhost] and IPs [10.96.0.1 10.0.0.3?2]"
L20: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key"
L21: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key"
L22: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key"
L23: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation"
L24: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation"
L25: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation"
L26: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation"
L27: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation"
L28: "cluster.go:125: [certs] Generating __sa__ key and public key"
L29: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__"
L30: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file"
L31: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file"
L32: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file"
L33: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file"
L34: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file"
L35: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__"
L36: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__"
L37: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__"
L38: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__"
L39: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__"
L40: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__"
L41: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__"
L42: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__"
L43: "cluster.go:125: [kubelet-start] Starting the kubelet"
L44: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__"
L45: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s"
L46: "cluster.go:125: [kubelet-check] The kubelet is healthy after 516.694303ms"
L47: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s"
L48: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.32:6443/livez"
L49: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz"
L50: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez"
L51: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 5.115084395s"
L52: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 18.9508376s"
L53: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 1m53.853462358s"
L54: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace"
L55: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster"
L56: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs"
L57: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]"
L58: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]"
L59: "cluster.go:125: [bootstrap-token] Using token: 9nmscb.daoj62q7gjdk705n"
L60: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles"
L61: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes"
L62: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials"
L63: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token"
L64: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster"
L65: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace"
L66: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key"
L67: "cluster.go:125: [addons] Applied essential addon: CoreDNS"
L68: "cluster.go:125: [addons] Applied essential addon: kube-proxy"
L69: "cluster.go:125: "
L70: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!"
L71: "cluster.go:125: "
L72: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:"
L73: "cluster.go:125: "
L74: "cluster.go:125: mkdir -p $HOME/.kube"
L75: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config"
L76: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config"
L77: "cluster.go:125: "
L78: "cluster.go:125: Alternatively, if you are the root user, you can run:"
L79: "cluster.go:125: "
L80: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf"
L81: "cluster.go:125: "
L82: "cluster.go:125: You should now deploy a pod network to the cluster."
L83: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:"
L84: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/"
L85: "cluster.go:125: "
L86: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:"
L87: "cluster.go:125: "
L88: "cluster.go:125: kubeadm join 10.0.0.32:6443 --token 9nmscb.daoj62q7gjdk705n _"
L89: "cluster.go:125: --discovery-token-ca-cert-hash sha256:becc9121f091508d7c78df1130de2a45db821b12d0518b0f67c4f33b4242b8f9 "
L90: "cluster.go:125: namespace/tigera-operator created"
L91: "cluster.go:125: serviceaccount/tigera-operator created"
L92: "cluster.go:125: clusterrole.rbac.authorization.k8s.io/tigera-operator-secrets created"
L93: "cluster.go:125: clusterrole.rbac.authorization.k8s.io/tigera-operator created"
L94: "cluster.go:125: clusterrolebinding.rbac.authorization.k8s.io/tigera-operator created"
L95: "cluster.go:125: rolebinding.rbac.authorization.k8s.io/tigera-operator-secrets created"
L96: "cluster.go:125: deployment.apps/tigera-operator created"
L97: "cluster.go:125: error: timed out waiting for the condition"
L98: "kubeadm.go:197: unable to setup cluster: unable to run master script: Process exited with status 1_"
L99: " "
```
🟢 ok **kubeadm.v1.35.1.cilium.base**; Succeeded: qemu (1)
🟢 ok **kubeadm.v1.35.1.flannel.base**; Succeeded: qemu (1)
🟢 ok **kubeadm.v1.36.1.calico.base**; Succeeded: qemu (1)
🟢 ok **kubeadm.v1.36.1.cilium.base**; Succeeded: qemu (3); Failed: qemu (1, 2)
Diagnostic output for qemu, run 2
```
L1: " Error: _cluster.go:125: I0903 21:03:51.671960 2393 version.go:260] remote version is much newer: v1.37.0; falling back to: stable-1.36"
L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.36.4"
L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.36.4"
L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.36.4"
L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.36.4"
L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.14.2"
L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.2"
L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.8-0"
L9: "cluster.go:125: I0903 21:05:19.489776 2721 version.go:260] remote version is much newer: v1.37.0; falling back to: stable-1.36"
L10: "cluster.go:125: [init] Using Kubernetes version: v1.36.4"
L11: "cluster.go:125: [preflight] Running pre-flight checks"
L12: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_"
L13: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster"
L14: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection"
L15: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_"
L16: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__"
L17: "cluster.go:125: [certs] Generating __ca__ certificate and key"
L18: "cluster.go:125: [certs] Generating __apiserver__ certificate and key"
L19: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local localhost] and IPs [10.96.0.1 10.0.0.1?2]"
L20: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key"
L21: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key"
L22: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key"
L23: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation"
L24: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation"
L25: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation"
L26: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation"
L27: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation"
L28: "cluster.go:125: [certs] Generating __sa__ key and public key"
L29: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__"
L30: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file"
L31: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file"
L32: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file"
L33: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file"
L34: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file"
L35: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__"
L36: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__"
L37: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__"
L38: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__"
L39: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__"
L40: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__"
L41: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__"
L42: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__"
L43: "cluster.go:125: [kubelet-start] Starting the kubelet"
L44: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__"
L45: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s"
L46: "cluster.go:125: [kubelet-check] The kubelet is healthy after 35.731129ms"
L47: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s"
L48: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.12:6443/livez"
L49: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz"
L50: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez"
L51: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 288.608928ms"
L52: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 364.365855ms"
L53: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 1m19.121897102s"
L54: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace"
L55: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster"
L56: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs"
L57: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]"
L58: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]"
L59: "cluster.go:125: [bootstrap-token] Using token: hivnvt.abr2te9cuix6htgj"
L60: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles"
L61: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes"
L62: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials"
L63: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token"
L64: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster"
L65: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the API server kubelet client certificate to access the kubelet API"
L66: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace"
L67: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key"
L68: "cluster.go:125: [addons] Applied essential addon: CoreDNS"
L69: "cluster.go:125: [addons] Applied essential addon: kube-proxy"
L70: "cluster.go:125: "
L71: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!"
L72: "cluster.go:125: "
L73: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:"
L74: "cluster.go:125: "
L75: "cluster.go:125: mkdir -p $HOME/.kube"
L76: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config"
L77: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config"
L78: "cluster.go:125: "
L79: "cluster.go:125: Alternatively, if you are the root user, you can run:"
L80: "cluster.go:125: "
L81: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf"
L82: "cluster.go:125: "
L83: "cluster.go:125: You should now deploy a pod network to the cluster."
L84: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:"
L85: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/"
L86: "cluster.go:125: "
L87: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:"
L88: "cluster.go:125: "
L89: "cluster.go:125: kubeadm join 10.0.0.12:6443 --token hivnvt.abr2te9cuix6htgj _"
L90: "cluster.go:125: --discovery-token-ca-cert-hash sha256:02741f37a30492ee44eda5c66c6172f2428677689bc9c895a1908854f7cab5bf "
L91: "cluster.go:125: i Using Cilium version 1.12.5"
L92: "cluster.go:125: ? Auto-detected cluster name: kubernetes"
L93: "cluster.go:125: ? Auto-detected datapath mode: tunnel"
L94: "cluster.go:125: ? Auto-detected kube-proxy has been installed"
L95: "cluster.go:125: i helm template --namespace kube-system cilium cilium/cilium --version 1.12.5 --set cluster.id=0,cluster.name=kubernetes,encryption.nodeEncryption=false,extraConfig.cluster-pool-ipv4-?cidr=192.168.0.0/17,extraConfig.enable-endpoint-routes=true,kubeProxyReplacement=disabled,operator.replicas=1,serviceAccounts.cilium.name=cilium,serviceAccounts.operator.name=cilium-operator,tunnel=vx?lan"
L96: "cluster.go:125: i Storing helm values file in kube-system/cilium-cli-helm-values Secret"
L97: "cluster.go:125: ? Created CA in secret cilium-ca"
L98: "cluster.go:125: ? Generating certificates for Hubble..."
L99: "cluster.go:125: ? Creating Service accounts..."
L100: "cluster.go:125: ? Creating Cluster roles..."
L101: "cluster.go:125: ? Creating ConfigMap for Cilium version 1.12.5..."
L102: "cluster.go:125: i Manual overwrite in ConfigMap: enable-endpoint-routes=true"
L103: "cluster.go:125: i Manual overwrite in ConfigMap: cluster-pool-ipv4-cidr=192.168.0.0/17"
L104: "cluster.go:125: ? Creating Agent DaemonSet..."
L105: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/mount-cgroup]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog"
L106: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/apply-sysctl-overwrites]: deprecated since v1.30; use the ___appArmorProfile___ fi?eld instead__ subsys=klog"
L107: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/clean-cilium-state]: deprecated since v1.30; use the ___appArmorProfile___ field i?nstead__ subsys=klog"
L108: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/cilium-agent]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog"
L109: "cluster.go:125: ? Creating Operator Deployment..."
L110: "cluster.go:125: ? Waiting for Cilium to be installed and ready..."
L111: "cluster.go:125: ? Cilium was successfully installed! Run _cilium status_ to view installation health"
L112: "cluster.go:125: ?[33m /??_"
L113: "cluster.go:125: ?[36m /???[33m___/?[32m??_?[0m Cilium: ?[32mOK?[0m"
L114: "cluster.go:125: ?[36m ___?[31m/??_?[32m__/?[0m Operator: ?[32mOK?[0m"
L115: "cluster.go:125: ?[32m /???[31m___/?[35m??_?[0m Hubble: ?[36mdisabled?[0m"
L116: "cluster.go:125: ?[32m ___?[34m/??_?[35m__/?[0m ClusterMesh: ?[36mdisabled?[0m"
L117: "cluster.go:125: ?[34m ___/"
L118: "cluster.go:125: ?[0m"
L119: "cluster.go:125: Deployment cilium-operator "
L120: "cluster.go:125: DaemonSet cilium "
L121: "cluster.go:125: Containers: cilium "
L122: "cluster.go:125: cilium-operator "
L123: "cluster.go:125: Cluster Pods: 0/0 managed by Cilium"
L124: "cluster.go:125: W0903 21:13:32.172385 2099 joinconfiguration.go:112] [config] WARNING: Ignored configuration document with GroupVersionKind kubelet.config.k8s.io/v1beta1, Kind=KubeletConfiguration"
L125: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_"
L126: "cluster.go:125: W0903 21:13:33.486372 2099 utils.go:69] The recommended value for __bindAddress__ in __KubeProxyConfiguration__ is: ::; the provided value is: 0.0.0.0"
L127: "cluster.go:125: jq: error (at Diagnostic output for qemu, run 1
```
L1: " Error: _cluster.go:125: I0903 19:58:08.338969 2305 version.go:260] remote version is much newer: v1.37.0; falling back to: stable-1.36"
L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.36.4"
L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.36.4"
L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.36.4"
L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.36.4"
L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.14.2"
L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.2"
L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.8-0"
L9: "cluster.go:125: I0903 19:59:34.251782 2664 version.go:260] remote version is much newer: v1.37.0; falling back to: stable-1.36"
L10: "cluster.go:125: [init] Using Kubernetes version: v1.36.4"
L11: "cluster.go:125: [preflight] Running pre-flight checks"
L12: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_"
L13: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster"
L14: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection"
L15: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_"
L16: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__"
L17: "cluster.go:125: [certs] Generating __ca__ certificate and key"
L18: "cluster.go:125: [certs] Generating __apiserver__ certificate and key"
L19: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local localhost] and IPs [10.96.0.1 10.0.0.9?7]"
L20: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key"
L21: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key"
L22: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key"
L23: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation"
L24: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation"
L25: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation"
L26: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation"
L27: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation"
L28: "cluster.go:125: [certs] Generating __sa__ key and public key"
L29: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__"
L30: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file"
L31: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file"
L32: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file"
L33: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file"
L34: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file"
L35: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__"
L36: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__"
L37: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__"
L38: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__"
L39: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__"
L40: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__"
L41: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__"
L42: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__"
L43: "cluster.go:125: [kubelet-start] Starting the kubelet"
L44: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__"
L45: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s"
L46: "cluster.go:125: [kubelet-check] The kubelet is healthy after 24.305369ms"
L47: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s"
L48: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.97:6443/livez"
L49: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz"
L50: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez"
L51: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 84.309354ms"
L52: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 245.060046ms"
L53: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 34.113261316s"
L54: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace"
L55: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster"
L56: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs"
L57: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]"
L58: "cluster.go:125: [mark-control-plane] Marking the node localhost as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]"
L59: "cluster.go:125: [bootstrap-token] Using token: coxiqm.6xb7cofj8dhyt327"
L60: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles"
L61: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes"
L62: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials"
L63: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token"
L64: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster"
L65: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the API server kubelet client certificate to access the kubelet API"
L66: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace"
L67: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key"
L68: "cluster.go:125: [addons] Applied essential addon: CoreDNS"
L69: "cluster.go:125: [addons] Applied essential addon: kube-proxy"
L70: "cluster.go:125: "
L71: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!"
L72: "cluster.go:125: "
L73: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:"
L74: "cluster.go:125: "
L75: "cluster.go:125: mkdir -p $HOME/.kube"
L76: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config"
L77: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config"
L78: "cluster.go:125: "
L79: "cluster.go:125: Alternatively, if you are the root user, you can run:"
L80: "cluster.go:125: "
L81: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf"
L82: "cluster.go:125: "
L83: "cluster.go:125: You should now deploy a pod network to the cluster."
L84: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:"
L85: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/"
L86: "cluster.go:125: "
L87: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:"
L88: "cluster.go:125: "
L89: "cluster.go:125: kubeadm join 10.0.0.97:6443 --token coxiqm.6xb7cofj8dhyt327 _"
L90: "cluster.go:125: --discovery-token-ca-cert-hash sha256:547e06416f69d673d17d541272ec684633937969975fdfaec28586996d89c3ed "
L91: "cluster.go:125: i Using Cilium version 1.12.5"
L92: "cluster.go:125: ? Auto-detected cluster name: kubernetes"
L93: "cluster.go:125: ? Auto-detected datapath mode: tunnel"
L94: "cluster.go:125: ? Auto-detected kube-proxy has been installed"
L95: "cluster.go:125: i helm template --namespace kube-system cilium cilium/cilium --version 1.12.5 --set cluster.id=0,cluster.name=kubernetes,encryption.nodeEncryption=false,extraConfig.cluster-pool-ipv4-?cidr=192.168.0.0/17,extraConfig.enable-endpoint-routes=true,kubeProxyReplacement=disabled,operator.replicas=1,serviceAccounts.cilium.name=cilium,serviceAccounts.operator.name=cilium-operator,tunnel=vx?lan"
L96: "cluster.go:125: i Storing helm values file in kube-system/cilium-cli-helm-values Secret"
L97: "cluster.go:125: ? Created CA in secret cilium-ca"
L98: "cluster.go:125: ? Generating certificates for Hubble..."
L99: "cluster.go:125: ? Creating Service accounts..."
L100: "cluster.go:125: ? Creating Cluster roles..."
L101: "cluster.go:125: ? Creating ConfigMap for Cilium version 1.12.5..."
L102: "cluster.go:125: i Manual overwrite in ConfigMap: enable-endpoint-routes=true"
L103: "cluster.go:125: i Manual overwrite in ConfigMap: cluster-pool-ipv4-cidr=192.168.0.0/17"
L104: "cluster.go:125: ? Creating Agent DaemonSet..."
L105: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/mount-cgroup]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog"
L106: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/apply-sysctl-overwrites]: deprecated since v1.30; use the ___appArmorProfile___ fi?eld instead__ subsys=klog"
L107: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/clean-cilium-state]: deprecated since v1.30; use the ___appArmorProfile___ field i?nstead__ subsys=klog"
L108: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/cilium-agent]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog"
L109: "cluster.go:125: ? Creating Operator Deployment..."
L110: "cluster.go:125: ? Waiting for Cilium to be installed and ready..."
L111: "cluster.go:125: ? Cilium was successfully installed! Run _cilium status_ to view installation health"
L112: "cluster.go:125: ?[33m /??_"
L113: "cluster.go:125: ?[36m /???[33m___/?[32m??_?[0m Cilium: ?[32mOK?[0m"
L114: "cluster.go:125: ?[36m ___?[31m/??_?[32m__/?[0m Operator: ?[32mOK?[0m"
L115: "cluster.go:125: ?[32m /???[31m___/?[35m??_?[0m Hubble: ?[36mdisabled?[0m"
L116: "cluster.go:125: ?[32m ___?[34m/??_?[35m__/?[0m ClusterMesh: ?[36mdisabled?[0m"
L117: "cluster.go:125: ?[34m ___/"
L118: "cluster.go:125: ?[0m"
L119: "cluster.go:125: Deployment cilium-operator "
L120: "cluster.go:125: DaemonSet cilium "
L121: "cluster.go:125: Containers: cilium "
L122: "cluster.go:125: cilium-operator "
L123: "cluster.go:125: Cluster Pods: 0/0 managed by Cilium"
L124: "cluster.go:125: W0903 20:07:35.822373 2120 joinconfiguration.go:112] [config] WARNING: Ignored configuration document with GroupVersionKind kubelet.config.k8s.io/v1beta1, Kind=KubeletConfiguration"
L125: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_"
L126: "cluster.go:125: W0903 20:07:42.100203 2120 utils.go:69] The recommended value for __bindAddress__ in __KubeProxyConfiguration__ is: ::; the provided value is: 0.0.0.0"
L127: "cluster.go:125: jq: error (at
🟢 ok **kubeadm.v1.36.1.flannel.base**; Succeeded: qemu (1)
🟢 ok **linux.nfs.v3**; Succeeded: qemu (1)
🟢 ok **linux.nfs.v4**; Succeeded: qemu (1)
🟢 ok **linux.ntp**; Succeeded: qemu (1)
🟢 ok **misc.fips**; Succeeded: qemu (1)
🟢 ok **packages**; Succeeded: qemu (1)
🟢 ok **sysext.custom-docker.sysext**; Succeeded: qemu (1)
🟢 ok **sysext.custom-oem**; Succeeded: qemu (1)
🟢 ok **sysext.disable-containerd**; Succeeded: qemu (1)
🟢 ok **sysext.disable-docker**; Succeeded: qemu (1)
🟢 ok **sysext.simple**; Succeeded: qemu (1)
🟢 ok **systemd.journal.remote**; Succeeded: qemu (1)
🟢 ok **systemd.journal.user**; Succeeded: qemu (1)
🟢 ok **systemd.sysusers.gshadow**; Succeeded: qemu (1)