### Test report for 4081.3.7 / arm64 **Platforms tested** : azure ❌ not ok **bpf.ig**; Failed: azure (1, 2, 3, 4, 5)
                Diagnostic output for azure, run 5 ``` L1: " _bpf.ig/ig (97.79s)" L2: "cluster.go:125: + sudo ig run trace_exec:v0.50.0 --help" L3: "cluster.go:125: time=__2026-04-21T11:22:55Z__ level=warning msg=__Failed to create container-collection__" L4: "cluster.go:125: + trap _kill %%_ ERR" L5: "cluster.go:125: + timeout 30 grep -F -m1 running..." L6: "cluster.go:125: + sudo ig run trace_exec:v0.50.0 --host --filter proc.comm=docker,args~ps --output json --verbose" L7: "cluster.go:125: ++ kill %%" L8: "cluster.go:125: bash: line 6: kill: %%: no such job" L9: "ig.go:79: ig run trace_exec did not behave as expected: Process exited with status 1_" L10: " " ```                 Diagnostic output for azure, run 4 ``` L1: " _bpf.ig/ig (127.83s)" L2: "cluster.go:125: + sudo ig run trace_exec:v0.50.0 --help" L3: "cluster.go:125: time=__2026-04-21T11:07:43Z__ level=warning msg=__Failed to create container-collection__" L4: "cluster.go:125: + trap _kill %%_ ERR" L5: "cluster.go:125: + timeout 30 grep -F -m1 running..." L6: "cluster.go:125: + sudo ig run trace_exec:v0.50.0 --host --filter proc.comm=docker,args~ps --output json --verbose" L7: "cluster.go:125: ++ kill %%" L8: "cluster.go:125: bash: line 6: kill: %%: no such job" L9: "ig.go:79: ig run trace_exec did not behave as expected: Process exited with status 1_" L10: " " ```                 Diagnostic output for azure, run 3 ``` L1: " _bpf.ig/ig (98.45s)" L2: "cluster.go:125: + sudo ig run trace_exec:v0.50.0 --help" L3: "cluster.go:125: time=__2026-04-21T10:51:31Z__ level=warning msg=__Failed to create container-collection__" L4: "cluster.go:125: + trap _kill %%_ ERR" L5: "cluster.go:125: + sudo ig run trace_exec:v0.50.0 --host --filter proc.comm=docker,args~ps --output json --verbose" L6: "cluster.go:125: + timeout 30 grep -F -m1 running..." L7: "cluster.go:125: ++ kill %%" L8: "ig.go:79: ig run trace_exec did not behave as expected: Process exited with status 1_" L9: " " ```                 Diagnostic output for azure, run 2 ``` L1: " _bpf.ig/ig (129.83s)" L2: "cluster.go:125: + sudo ig run trace_exec:v0.50.0 --help" L3: "cluster.go:125: time=__2026-04-21T10:29:19Z__ level=warning msg=__Failed to create container-collection__" L4: "cluster.go:125: + trap _kill %%_ ERR" L5: "cluster.go:125: + timeout 30 grep -F -m1 running..." L6: "cluster.go:125: + sudo ig run trace_exec:v0.50.0 --host --filter proc.comm=docker,args~ps --output json --verbose" L7: "cluster.go:125: ++ kill %%" L8: "cluster.go:125: bash: line 6: kill: %%: no such job" L9: "ig.go:79: ig run trace_exec did not behave as expected: Process exited with status 1_" L10: " " ```                 Diagnostic output for azure, run 1 ``` L1: " _bpf.ig/ig (131.44s)" L2: "cluster.go:125: + sudo ig run trace_exec:v0.50.0 --help" L3: "cluster.go:125: time=__2026-04-21T10:00:19Z__ level=warning msg=__Failed to create container-collection__" L4: "cluster.go:125: + trap _kill %%_ ERR" L5: "cluster.go:125: + timeout 30 grep -F -m1 running..." L6: "cluster.go:125: + sudo ig run trace_exec:v0.50.0 --host --filter proc.comm=docker,args~ps --output json --verbose" L7: "cluster.go:125: ++ kill %%" L8: "cluster.go:125: bash: line 6: kill: %%: no such job" L9: "ig.go:79: ig run trace_exec did not behave as expected: Process exited with status 1_" L10: " " ```
🟢 ok **cl.basic**; Succeeded: azure (1) 🟢 ok **cl.cloudinit.basic**; Succeeded: azure (1) 🟢 ok **cl.cloudinit.multipart-mime**; Succeeded: azure (1) 🟢 ok **cl.cloudinit.script**; Succeeded: azure (1) 🟢 ok **cl.etcd-member.discovery**; Succeeded: azure (1) 🟢 ok **cl.etcd-member.etcdctlv3**; Succeeded: azure (1) 🟢 ok **cl.etcd-member.v2-backup-restore**; Succeeded: azure (1) 🟢 ok **cl.flannel.vxlan**; Succeeded: azure (1) 🟢 ok **cl.ignition.kargs**; Succeeded: azure (1) 🟢 ok **cl.ignition.luks**; Succeeded: azure (1) 🟢 ok **cl.ignition.misc.empty**; Succeeded: azure (1) 🟢 ok **cl.ignition.symlink**; Succeeded: azure (1) 🟢 ok **cl.ignition.translation**; Succeeded: azure (1) 🟢 ok **cl.ignition.v1.btrfsroot**; Succeeded: azure (1) 🟢 ok **cl.ignition.v1.ext4root**; Succeeded: azure (1) 🟢 ok **cl.ignition.v1.groups**; Succeeded: azure (1) 🟢 ok **cl.ignition.v1.noop**; Succeeded: azure (1) 🟢 ok **cl.ignition.v1.once**; Succeeded: azure (1) 🟢 ok **cl.ignition.v1.users**; Succeeded: azure (1) 🟢 ok **cl.ignition.v1.xfsroot**; Succeeded: azure (1) 🟢 ok **cl.ignition.v2.btrfsroot**; Succeeded: azure (1) 🟢 ok **cl.ignition.v2.ext4root**; Succeeded: azure (1) 🟢 ok **cl.ignition.v2.noop**; Succeeded: azure (1) 🟢 ok **cl.ignition.v2.users**; Succeeded: azure (1) 🟢 ok **cl.ignition.v2.xfsroot**; Succeeded: azure (1) 🟢 ok **cl.ignition.v2_1.ext4checkexisting**; Succeeded: azure (1) 🟢 ok **cl.ignition.v2_1.swap**; Succeeded: azure (1) 🟢 ok **cl.ignition.v2_1.vfat**; Succeeded: azure (1) 🟢 ok **cl.internet**; Succeeded: azure (1) 🟢 ok **cl.locksmith.cluster**; Succeeded: azure (3); Failed: azure (1, 2)
                Diagnostic output for azure, run 2 ``` L1: " Error: _locksmith.go:184: [0] ssh unreachable or system not ready: context deadline exceeded [1] ssh unreachable or system not ready: context deadline exceeded [2] ssh unreachable or system not ready:? context deadline exceeded_" L2: " " ```                 Diagnostic output for azure, run 1 ``` L1: " Error: _harness.go:646: Cluster failed starting machines: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kola-cluster-image-f26acefb9c/providers/Mic?rosoft.Compute/virtualMachines/ci-4081.3.7-a-5675cfdaa4" L2: "--------------------------------------------------------------------------------" L3: "RESPONSE 409: 409 Conflict" L4: "ERROR CODE: OperationNotAllowed" L5: "--------------------------------------------------------------------------------" L6: "{" L7: "__error__: {" L8: "__code__: __OperationNotAllowed__," L9: "__message__: __Operation could not be completed as it results in exceeding approved standardDPLSv5Family Cores quota. Additional details - Deployment Model: Resource Manager, Location: westus2, Curren?t Limit: 65, Current Usage: 64, Additional Required: 2, (Minimum) New Limit Required: 66. Setup Alerts when Quota reaches threshold. Learn more at https://aka.ms/quotamonitoringalerting . Submit a req?uest for Quota increase at https://aka.ms/ProdportalCRP/#blade/Microsoft_Azure_Capacity/UsageAndQuota.ReactView/Parameters/%7B%22subscriptionId%22:%220e46bd28-a80f-4d3a-8200-d9eb8d80cb2e%22,%22command?%22:%22openQuotaApprovalBlade%22,%22quotas%22:[%7B%22location%22:%22westus2%22,%22providerId%22:%22Microsoft.Compute%22,%22resourceName%22:%22standardDPLSv5Family%22,%22quotaRequest%22:%7B%22propertie?s%22:%7B%22limit%22:66,%22unit%22:%22Count%22,%22name%22:%7B%22value%22:%22standardDPLSv5Family%22%7D%7D%7D%7D]%7D by specifying parameters listed in the ???Details??? section for deployment to succee?d. Please read more about quota limits at https://docs.microsoft.com/en-us/azure/azure-supportability/per-vm-quota-requests__" L10: "}" L11: "}" L12: "--------------------------------------------------------------------------------_" L13: " " ```
🟢 ok **cl.metadata.azure**; Succeeded: azure (1) 🟢 ok **cl.network.initramfs.second-boot**; Succeeded: azure (1) 🟢 ok **cl.network.iptables**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _harness.go:646: Cluster failed starting machines: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kola-cluster-image-f26acefb9c/providers/Mic?rosoft.Compute/virtualMachines/ci-4081.3.7-a-e4e0ed9eec" L2: "--------------------------------------------------------------------------------" L3: "RESPONSE 409: 409 Conflict" L4: "ERROR CODE: OperationNotAllowed" L5: "--------------------------------------------------------------------------------" L6: "{" L7: "__error__: {" L8: "__code__: __OperationNotAllowed__," L9: "__message__: __Operation could not be completed as it results in exceeding approved standardDPLSv5Family Cores quota. Additional details - Deployment Model: Resource Manager, Location: westus2, Curren?t Limit: 65, Current Usage: 64, Additional Required: 2, (Minimum) New Limit Required: 66. Setup Alerts when Quota reaches threshold. Learn more at https://aka.ms/quotamonitoringalerting . Submit a req?uest for Quota increase at https://aka.ms/ProdportalCRP/#blade/Microsoft_Azure_Capacity/UsageAndQuota.ReactView/Parameters/%7B%22subscriptionId%22:%220e46bd28-a80f-4d3a-8200-d9eb8d80cb2e%22,%22command?%22:%22openQuotaApprovalBlade%22,%22quotas%22:[%7B%22location%22:%22westus2%22,%22providerId%22:%22Microsoft.Compute%22,%22resourceName%22:%22standardDPLSv5Family%22,%22quotaRequest%22:%7B%22propertie?s%22:%7B%22limit%22:66,%22unit%22:%22Count%22,%22name%22:%7B%22value%22:%22standardDPLSv5Family%22%7D%7D%7D%7D]%7D by specifying parameters listed in the ???Details??? section for deployment to succee?d. Please read more about quota limits at https://docs.microsoft.com/en-us/azure/azure-supportability/per-vm-quota-requests__" L10: "}" L11: "}" L12: "--------------------------------------------------------------------------------_" L13: " " ```
🟢 ok **cl.network.wireguard**; Succeeded: azure (1) 🟢 ok **cl.osreset.ignition-rerun**; Succeeded: azure (1) 🟢 ok **cl.overlay.cleanup**; Succeeded: azure (1) 🟢 ok **cl.swap_activation**; Succeeded: azure (1) 🟢 ok **cl.toolbox.dnf-install**; Succeeded: azure (1) 🟢 ok **cl.update.badverity**; Succeeded: azure (1) 🟢 ok **cl.update.reboot**; Succeeded: azure (1) 🟢 ok **cl.users.shells**; Succeeded: azure (1) 🟢 ok **cl.verity**; Succeeded: azure (1) 🟢 ok **coreos.auth.verify**; Succeeded: azure (1) 🟢 ok **coreos.ignition.groups**; Succeeded: azure (1) 🟢 ok **coreos.ignition.once**; Succeeded: azure (1) 🟢 ok **coreos.ignition.resource.local**; Succeeded: azure (1) 🟢 ok **coreos.ignition.resource.remote**; Succeeded: azure (1) 🟢 ok **coreos.ignition.security.tls**; Succeeded: azure (1) ❌ not ok **coreos.ignition.ssh.key**; Failed: azure (1, 2, 3, 4, 5)
                Diagnostic output for azure, run 5 ``` L1: " Error: _harness.go:646: Cluster failed starting machines: machine __ci-4081.3.7-a-81fa7b9027__ failed to start: ssh journalctl failed: time limit exceeded: ssh: handshake failed: ssh: unable to authen?ticate, attempted methods [none publickey], no supported methods remain_" L2: " " ```                 Diagnostic output for azure, run 4 ``` L1: " Error: _harness.go:646: Cluster failed starting machines: machine __ci-4081.3.7-a-0ed4360aae__ failed to start: ssh journalctl failed: time limit exceeded: ssh: handshake failed: ssh: unable to authen?ticate, attempted methods [none publickey], no supported methods remain_" L2: " " ```                 Diagnostic output for azure, run 3 ``` L1: " Error: _harness.go:646: Cluster failed starting machines: machine __ci-4081.3.7-a-5c6ee7a7f2__ failed to start: ssh journalctl failed: time limit exceeded: ssh: handshake failed: ssh: unable to authen?ticate, attempted methods [none publickey], no supported methods remain_" L2: " " ```                 Diagnostic output for azure, run 2 ``` L1: " Error: _harness.go:646: Cluster failed starting machines: machine __ci-4081.3.7-a-4ebcada6b2__ failed to start: ssh journalctl failed: time limit exceeded: dial tcp 4.154.132.198:22: i/o timeout_" L2: " " ```                 Diagnostic output for azure, run 1 ``` L1: " Error: _harness.go:646: Cluster failed starting machines: machine __ci-4081.3.7-a-e1715bf599__ failed to start: ssh journalctl failed: time limit exceeded: ssh: handshake failed: ssh: unable to authen?ticate, attempted methods [none publickey], no supported methods remain_" L2: " " ```
🟢 ok **coreos.ignition.systemd.enable-service**; Succeeded: azure (1) 🟢 ok **coreos.locksmith.reboot**; Succeeded: azure (1) 🟢 ok **coreos.locksmith.tls**; Succeeded: azure (1) 🟢 ok **coreos.selinux.boolean**; Succeeded: azure (1) 🟢 ok **coreos.selinux.enforce**; Succeeded: azure (1) 🟢 ok **coreos.tls.fetch-urls**; Succeeded: azure (1) 🟢 ok **coreos.update.badusr**; Succeeded: azure (1) 🟢 ok **docker.base**; Succeeded: azure (1) 🟢 ok **docker.btrfs-storage**; Succeeded: azure (1) 🟢 ok **docker.containerd-restart**; Succeeded: azure (1) 🟢 ok **docker.enable-service.sysext**; Succeeded: azure (1) 🟢 ok **docker.lib-coreos-dockerd-compat**; Succeeded: azure (1) 🟢 ok **docker.network-openbsd-nc**; Succeeded: azure (1) 🟢 ok **docker.selinux**; Succeeded: azure (1) 🟢 ok **docker.userns**; Succeeded: azure (1) 🟢 ok **kubeadm.v1.33.8.calico.base**; Succeeded: azure (1) 🟢 ok **kubeadm.v1.33.8.calico.cgroupv1.base**; Succeeded: azure (1) 🟢 ok **kubeadm.v1.33.8.cilium.base**; Succeeded: azure (1) 🟢 ok **kubeadm.v1.33.8.cilium.cgroupv1.base**; Succeeded: azure (3); Failed: azure (1, 2)
                Diagnostic output for azure, run 2 ``` L1: " Error: _cluster.go:125: I0421 10:30:26.418744 2551 version.go:261] remote version is much newer: v1.35.4; falling back to: stable-1.33" L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.33.11" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.33.11" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.33.11" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.33.11" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.12.0" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10" L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.5.24-0" L9: "cluster.go:125: I0421 10:30:41.136500 2856 version.go:261] remote version is much newer: v1.35.4; falling back to: stable-1.33" L10: "cluster.go:125: [init] Using Kubernetes version: v1.33.11" L11: "cluster.go:125: [preflight] Running pre-flight checks" L12: "cluster.go:125: [WARNING SystemVerification]: cgroups v1 support is in maintenance mode, please migrate to cgroups v2" L13: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.7-a-a0f850f753__ could not be reached" L14: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.7-a-a0f850f753__: lookup ci-4081.3.7-a-a0f850f753 on 168.63.129.16:53: no such host" L15: "cluster.go:125: [WARNING Service-Kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L16: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L17: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L18: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L19: "cluster.go:125: W0421 10:30:41.278520 2856 checks.go:843] detected that the sandbox image __registry.k8s.io/pause:3.8__ of the container runtime is inconsistent with that used by kubeadm.It is reco?mmended to use __registry.k8s.io/pause:3.10__ as the CRI sandbox image." L20: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L21: "cluster.go:125: [certs] Generating __ca__ certificate and key" L22: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L23: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [ci-4081.3.7-a-a0f850f753 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local] and IPs [10.?96.0.1 10.0.0.15]" L24: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L25: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L26: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L27: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L28: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L29: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L30: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L31: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L32: "cluster.go:125: [certs] Generating __sa__ key and public key" L33: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L34: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L35: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L36: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L37: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L38: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L39: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L40: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L41: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L42: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L43: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L44: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L45: "cluster.go:125: [kubelet-start] Starting the kubelet" L46: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__" L47: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s" L48: "cluster.go:125: [kubelet-check] The kubelet is healthy after 4.501161818s" L49: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s" L50: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.15:6443/livez" L51: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz" L52: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez" L53: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 6.783476507s" L54: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 7.118734003s" L55: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 9.001071737s" L56: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace" L57: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster" L58: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs" L59: "cluster.go:125: [mark-control-plane] Marking the node ci-4081.3.7-a-a0f850f753 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-lo?ad-balancers]" L60: "cluster.go:125: [mark-control-plane] Marking the node ci-4081.3.7-a-a0f850f753 as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]" L61: "cluster.go:125: [bootstrap-token] Using token: gc8k1w.o93ficgw9qat93kf" L62: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles" L63: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes" L64: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials" L65: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token" L66: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster" L67: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace" L68: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key" L69: "cluster.go:125: [addons] Applied essential addon: CoreDNS" L70: "cluster.go:125: [addons] Applied essential addon: kube-proxy" L71: "cluster.go:125: " L72: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!" L73: "cluster.go:125: " L74: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:" L75: "cluster.go:125: " L76: "cluster.go:125: mkdir -p $HOME/.kube" L77: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config" L78: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config" L79: "cluster.go:125: " L80: "cluster.go:125: Alternatively, if you are the root user, you can run:" L81: "cluster.go:125: " L82: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf" L83: "cluster.go:125: " L84: "cluster.go:125: You should now deploy a pod network to the cluster." L85: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:" L86: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/" L87: "cluster.go:125: " L88: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:" L89: "cluster.go:125: " L90: "cluster.go:125: kubeadm join 10.0.0.15:6443 --token gc8k1w.o93ficgw9qat93kf _" L91: "cluster.go:125: --discovery-token-ca-cert-hash sha256:83b095c419c153f272819d385851a343ed628bf72fd635bc1bdcc1c29b0015e0 " L92: "cluster.go:125: i Using Cilium version 1.12.5" L93: "cluster.go:125: ? Auto-detected cluster name: kubernetes" L94: "cluster.go:125: ? Auto-detected datapath mode: tunnel" L95: "cluster.go:125: ? Auto-detected kube-proxy has been installed" L96: "cluster.go:125: i helm template --namespace kube-system cilium cilium/cilium --version 1.12.5 --set cluster.id=0,cluster.name=kubernetes,encryption.nodeEncryption=false,extraConfig.cluster-pool-ipv4-?cidr=192.168.0.0/17,extraConfig.enable-endpoint-routes=true,kubeProxyReplacement=disabled,operator.replicas=1,serviceAccounts.cilium.name=cilium,serviceAccounts.operator.name=cilium-operator,tunnel=vx?lan" L97: "cluster.go:125: i Storing helm values file in kube-system/cilium-cli-helm-values Secret" L98: "cluster.go:125: ? Created CA in secret cilium-ca" L99: "cluster.go:125: ? Generating certificates for Hubble..." L100: "cluster.go:125: ? Creating Service accounts..." L101: "cluster.go:125: ? Creating Cluster roles..." L102: "cluster.go:125: ? Creating ConfigMap for Cilium version 1.12.5..." L103: "cluster.go:125: i Manual overwrite in ConfigMap: enable-endpoint-routes=true" L104: "cluster.go:125: i Manual overwrite in ConfigMap: cluster-pool-ipv4-cidr=192.168.0.0/17" L105: "cluster.go:125: ? Creating Agent DaemonSet..." L106: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/mount-cgroup]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L107: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/apply-sysctl-overwrites]: deprecated since v1.30; use the ___appArmorProfile___ fi?eld instead__ subsys=klog" L108: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/clean-cilium-state]: deprecated since v1.30; use the ___appArmorProfile___ field i?nstead__ subsys=klog" L109: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/cilium-agent]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L110: "cluster.go:125: ? Creating Operator Deployment..." L111: "cluster.go:125: ? Waiting for Cilium to be installed and ready..." L112: "cluster.go:125: ? Cilium was successfully installed! Run _cilium status_ to view installation health" L113: "cluster.go:125: ?[33m /??_" L114: "cluster.go:125: ?[36m /???[33m___/?[32m??_?[0m Cilium: ?[32mOK?[0m" L115: "cluster.go:125: ?[36m ___?[31m/??_?[32m__/?[0m Operator: ?[32mOK?[0m" L116: "cluster.go:125: ?[32m /???[31m___/?[35m??_?[0m Hubble: ?[36mdisabled?[0m" L117: "cluster.go:125: ?[32m ___?[34m/??_?[35m__/?[0m ClusterMesh: ?[36mdisabled?[0m" L118: "cluster.go:125: ?[34m ___/" L119: "cluster.go:125: ?[0m" L120: "cluster.go:125: Deployment cilium-operator " L121: "cluster.go:125: DaemonSet cilium " L122: "cluster.go:125: Containers: cilium " L123: "cluster.go:125: cilium-operator " L124: "cluster.go:125: Cluster Pods: 0/0 managed by Cilium" L125: "kubeadm.go:197: unable to setup cluster: unable to create worker node: waiting for machine to become active: GET https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourc?eGroups/kola-cluster-image-00a505f19e/providers/Microsoft.Compute/virtualMachines/ci-4081.3.7-a-4899c8c428" L126: "--------------------------------------------------------------------------------" L127: "RESPONSE 404: 404 Not Found" L128: "ERROR CODE: NotFound" L129: "--------------------------------------------------------------------------------" L130: "{" L131: "__error__: {" L132: "__code__: __NotFound__," L133: "__message__: __The entity was not found in this Azure location.__" L134: "}" L135: "}" L136: "--------------------------------------------------------------------------------_" L137: " " ```                 Diagnostic output for azure, run 1 ``` L1: " Error: _kubeadm.go:197: unable to setup cluster: unable to create master node: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kola-cluster-image-f26?acefb9c/providers/Microsoft.Compute/virtualMachines/ci-4081.3.7-a-b17bce8688" L2: "--------------------------------------------------------------------------------" L3: "RESPONSE 409: 409 Conflict" L4: "ERROR CODE: OperationNotAllowed" L5: "--------------------------------------------------------------------------------" L6: "{" L7: "__error__: {" L8: "__code__: __OperationNotAllowed__," L9: "__message__: __Operation could not be completed as it results in exceeding approved standardDPLSv5Family Cores quota. Additional details - Deployment Model: Resource Manager, Location: westus2, Curren?t Limit: 65, Current Usage: 64, Additional Required: 2, (Minimum) New Limit Required: 66. Setup Alerts when Quota reaches threshold. Learn more at https://aka.ms/quotamonitoringalerting . Submit a req?uest for Quota increase at https://aka.ms/ProdportalCRP/#blade/Microsoft_Azure_Capacity/UsageAndQuota.ReactView/Parameters/%7B%22subscriptionId%22:%220e46bd28-a80f-4d3a-8200-d9eb8d80cb2e%22,%22command?%22:%22openQuotaApprovalBlade%22,%22quotas%22:[%7B%22location%22:%22westus2%22,%22providerId%22:%22Microsoft.Compute%22,%22resourceName%22:%22standardDPLSv5Family%22,%22quotaRequest%22:%7B%22propertie?s%22:%7B%22limit%22:66,%22unit%22:%22Count%22,%22name%22:%7B%22value%22:%22standardDPLSv5Family%22%7D%7D%7D%7D]%7D by specifying parameters listed in the ???Details??? section for deployment to succee?d. Please read more about quota limits at https://docs.microsoft.com/en-us/azure/azure-supportability/per-vm-quota-requests__" L10: "}" L11: "}" L12: "--------------------------------------------------------------------------------" L13: "harness.go:616: Found systemd unit failed to start (?[0;1;39metcd-member.servic????[0mtcd (System Application Container). ) on machine ci-4081.3.7-a-24d2aba098 console_" L14: " " ```
🟢 ok **kubeadm.v1.33.8.flannel.base**; Succeeded: azure (1) 🟢 ok **kubeadm.v1.33.8.flannel.cgroupv1.base**; Succeeded: azure (1) 🟢 ok **kubeadm.v1.34.4.calico.base**; Succeeded: azure (1) 🟢 ok **kubeadm.v1.34.4.cilium.base**; Succeeded: azure (3); Failed: azure (1, 2)
                Diagnostic output for azure, run 2 ``` L1: " Error: _cluster.go:125: I0421 10:30:28.062324 2381 version.go:260] remote version is much newer: v1.35.4; falling back to: stable-1.34" L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.34.7" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.34.7" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.34.7" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.34.7" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.12.1" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.1" L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.5-0" L9: "cluster.go:125: I0421 10:30:37.958038 2634 version.go:260] remote version is much newer: v1.35.4; falling back to: stable-1.34" L10: "cluster.go:125: [init] Using Kubernetes version: v1.34.7" L11: "cluster.go:125: [preflight] Running pre-flight checks" L12: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.7-a-6bc3d659b5__ could not be reached" L13: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.7-a-6bc3d659b5__: lookup ci-4081.3.7-a-6bc3d659b5 on 168.63.129.16:53: no such host" L14: "cluster.go:125: [WARNING Service-Kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L15: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L16: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L17: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L18: "cluster.go:125: W0421 10:30:38.097771 2634 checks.go:827] detected that the sandbox image __registry.k8s.io/pause:3.8__ of the container runtime is inconsistent with that used by kubeadm. It is rec?ommended to use __registry.k8s.io/pause:3.10.1__ as the CRI sandbox image." L19: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L20: "cluster.go:125: [certs] Generating __ca__ certificate and key" L21: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L22: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [ci-4081.3.7-a-6bc3d659b5 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local] and IPs [10.?96.0.1 10.0.0.17]" L23: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L24: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L25: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L26: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L27: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L28: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L29: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L30: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L31: "cluster.go:125: [certs] Generating __sa__ key and public key" L32: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L33: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L34: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L35: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L36: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L37: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L38: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L39: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L40: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L41: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L42: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L43: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__" L44: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__" L45: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L46: "cluster.go:125: [kubelet-start] Starting the kubelet" L47: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__" L48: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s" L49: "cluster.go:125: [kubelet-check] The kubelet is healthy after 1.001361414s" L50: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s" L51: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.17:6443/livez" L52: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz" L53: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez" L54: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 3.292166526s" L55: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 3.661507031s" L56: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 5.502078142s" L57: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace" L58: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster" L59: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs" L60: "cluster.go:125: [mark-control-plane] Marking the node ci-4081.3.7-a-6bc3d659b5 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-lo?ad-balancers]" L61: "cluster.go:125: [mark-control-plane] Marking the node ci-4081.3.7-a-6bc3d659b5 as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]" L62: "cluster.go:125: [bootstrap-token] Using token: hkt94d.3x19caqo4b22fk75" L63: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles" L64: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes" L65: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials" L66: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token" L67: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster" L68: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace" L69: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key" L70: "cluster.go:125: [addons] Applied essential addon: CoreDNS" L71: "cluster.go:125: [addons] Applied essential addon: kube-proxy" L72: "cluster.go:125: " L73: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!" L74: "cluster.go:125: " L75: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:" L76: "cluster.go:125: " L77: "cluster.go:125: mkdir -p $HOME/.kube" L78: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config" L79: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config" L80: "cluster.go:125: " L81: "cluster.go:125: Alternatively, if you are the root user, you can run:" L82: "cluster.go:125: " L83: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf" L84: "cluster.go:125: " L85: "cluster.go:125: You should now deploy a pod network to the cluster." L86: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:" L87: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/" L88: "cluster.go:125: " L89: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:" L90: "cluster.go:125: " L91: "cluster.go:125: kubeadm join 10.0.0.17:6443 --token hkt94d.3x19caqo4b22fk75 _" L92: "cluster.go:125: --discovery-token-ca-cert-hash sha256:a0a580a8d24502aa06c69d10c20a69f044f83b8aaae8e28a6c54f9f43bf6423c " L93: "cluster.go:125: i Using Cilium version 1.12.5" L94: "cluster.go:125: ? Auto-detected cluster name: kubernetes" L95: "cluster.go:125: ? Auto-detected datapath mode: tunnel" L96: "cluster.go:125: ? Auto-detected kube-proxy has been installed" L97: "cluster.go:125: i helm template --namespace kube-system cilium cilium/cilium --version 1.12.5 --set cluster.id=0,cluster.name=kubernetes,encryption.nodeEncryption=false,extraConfig.cluster-pool-ipv4-?cidr=192.168.0.0/17,extraConfig.enable-endpoint-routes=true,kubeProxyReplacement=disabled,operator.replicas=1,serviceAccounts.cilium.name=cilium,serviceAccounts.operator.name=cilium-operator,tunnel=vx?lan" L98: "cluster.go:125: i Storing helm values file in kube-system/cilium-cli-helm-values Secret" L99: "cluster.go:125: ? Created CA in secret cilium-ca" L100: "cluster.go:125: ? Generating certificates for Hubble..." L101: "cluster.go:125: ? Creating Service accounts..." L102: "cluster.go:125: ? Creating Cluster roles..." L103: "cluster.go:125: ? Creating ConfigMap for Cilium version 1.12.5..." L104: "cluster.go:125: i Manual overwrite in ConfigMap: enable-endpoint-routes=true" L105: "cluster.go:125: i Manual overwrite in ConfigMap: cluster-pool-ipv4-cidr=192.168.0.0/17" L106: "cluster.go:125: ? Creating Agent DaemonSet..." L107: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/mount-cgroup]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L108: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/apply-sysctl-overwrites]: deprecated since v1.30; use the ___appArmorProfile___ fi?eld instead__ subsys=klog" L109: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/clean-cilium-state]: deprecated since v1.30; use the ___appArmorProfile___ field i?nstead__ subsys=klog" L110: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/cilium-agent]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L111: "cluster.go:125: ? Creating Operator Deployment..." L112: "cluster.go:125: ? Waiting for Cilium to be installed and ready..." L113: "cluster.go:125: ? Cilium was successfully installed! Run _cilium status_ to view installation health" L114: "cluster.go:125: ?[33m /??_" L115: "cluster.go:125: ?[36m /???[33m___/?[32m??_?[0m Cilium: ?[32mOK?[0m" L116: "cluster.go:125: ?[36m ___?[31m/??_?[32m__/?[0m Operator: ?[32mOK?[0m" L117: "cluster.go:125: ?[32m /???[31m___/?[35m??_?[0m Hubble: ?[36mdisabled?[0m" L118: "cluster.go:125: ?[32m ___?[34m/??_?[35m__/?[0m ClusterMesh: ?[36mdisabled?[0m" L119: "cluster.go:125: ?[34m ___/" L120: "cluster.go:125: ?[0m" L121: "cluster.go:125: DaemonSet cilium " L122: "cluster.go:125: Deployment cilium-operator " L123: "cluster.go:125: Containers: cilium " L124: "cluster.go:125: cilium-operator " L125: "cluster.go:125: Cluster Pods: 0/0 managed by Cilium" L126: "cluster.go:125: W0421 10:32:30.750400 2251 joinconfiguration.go:112] [config] WARNING: Ignored configuration document with GroupVersionKind kubelet.config.k8s.io/v1beta1, Kind=KubeletConfiguration" L127: "cluster.go:125: [WARNING Service-Kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L128: "--- FAIL: kubeadm.v1.34.4.cilium.base/node_readiness (28.06s)" L129: "cluster.go:145: __kubectl get nodes | grep ___ Ready___| wc -l__ failed: output , status dial tcp 20.83.120.1:22: connect: connection refused" L130: "--- FAIL: kubeadm.v1.34.4.cilium.base/nginx_deployment (1.02s)" L131: "kubeadm.go:219: unable to deploy nginx: dial tcp 20.83.120.1:22: connect: connection refused" L132: "--- FAIL: kubeadm.v1.34.4.cilium.base/NFS_deployment (20.45s)" L133: "kubeadm.go:238: unable to add helm NFS repo: dial tcp 20.83.120.1:22: i/o timeout" L134: "--- FAIL: kubeadm.v1.34.4.cilium.base/IPSec_encryption (35.01s)" L135: "cluster.go:145: __/opt/bin/cilium uninstall__ failed: output , status dial tcp 20.83.120.1:22: i/o timeout_" L136: " " ```                 Diagnostic output for azure, run 1 ``` L1: " Error: _kubeadm.go:197: unable to setup cluster: unable to create master node: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kola-cluster-image-f26?acefb9c/providers/Microsoft.Compute/virtualMachines/ci-4081.3.7-a-0cd82d9df3" L2: "--------------------------------------------------------------------------------" L3: "RESPONSE 409: 409 Conflict" L4: "ERROR CODE: OperationNotAllowed" L5: "--------------------------------------------------------------------------------" L6: "{" L7: "__error__: {" L8: "__code__: __OperationNotAllowed__," L9: "__message__: __Operation could not be completed as it results in exceeding approved standardDPLSv5Family Cores quota. Additional details - Deployment Model: Resource Manager, Location: westus2, Curren?t Limit: 65, Current Usage: 64, Additional Required: 2, (Minimum) New Limit Required: 66. Setup Alerts when Quota reaches threshold. Learn more at https://aka.ms/quotamonitoringalerting . Submit a req?uest for Quota increase at https://aka.ms/ProdportalCRP/#blade/Microsoft_Azure_Capacity/UsageAndQuota.ReactView/Parameters/%7B%22subscriptionId%22:%220e46bd28-a80f-4d3a-8200-d9eb8d80cb2e%22,%22command?%22:%22openQuotaApprovalBlade%22,%22quotas%22:[%7B%22location%22:%22westus2%22,%22providerId%22:%22Microsoft.Compute%22,%22resourceName%22:%22standardDPLSv5Family%22,%22quotaRequest%22:%7B%22propertie?s%22:%7B%22limit%22:66,%22unit%22:%22Count%22,%22name%22:%7B%22value%22:%22standardDPLSv5Family%22%7D%7D%7D%7D]%7D by specifying parameters listed in the ???Details??? section for deployment to succee?d. Please read more about quota limits at https://docs.microsoft.com/en-us/azure/azure-supportability/per-vm-quota-requests__" L10: "}" L11: "}" L12: "--------------------------------------------------------------------------------_" L13: " " ```
🟢 ok **kubeadm.v1.34.4.flannel.base**; Succeeded: azure (3); Failed: azure (1, 2)
                Diagnostic output for azure, run 2 ``` L1: " Error: _cluster.go:125: I0421 10:30:21.572041 2344 version.go:260] remote version is much newer: v1.35.4; falling back to: stable-1.34" L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.34.7" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.34.7" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.34.7" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.34.7" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.12.1" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.1" L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.5-0" L9: "cluster.go:125: I0421 10:30:33.966045 2610 version.go:260] remote version is much newer: v1.35.4; falling back to: stable-1.34" L10: "cluster.go:125: [init] Using Kubernetes version: v1.34.7" L11: "cluster.go:125: [preflight] Running pre-flight checks" L12: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.7-a-702917e323__ could not be reached" L13: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.7-a-702917e323__: lookup ci-4081.3.7-a-702917e323 on 168.63.129.16:53: no such host" L14: "cluster.go:125: [WARNING Service-Kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L15: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L16: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L17: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L18: "cluster.go:125: W0421 10:30:34.127831 2610 checks.go:827] detected that the sandbox image __registry.k8s.io/pause:3.8__ of the container runtime is inconsistent with that used by kubeadm. It is rec?ommended to use __registry.k8s.io/pause:3.10.1__ as the CRI sandbox image." L19: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L20: "cluster.go:125: [certs] Generating __ca__ certificate and key" L21: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L22: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [ci-4081.3.7-a-702917e323 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local] and IPs [10.?96.0.1 10.0.0.14]" L23: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L24: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L25: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L26: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L27: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L28: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L29: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L30: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L31: "cluster.go:125: [certs] Generating __sa__ key and public key" L32: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L33: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L34: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L35: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L36: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L37: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L38: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L39: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L40: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L41: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L42: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L43: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__" L44: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__" L45: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L46: "cluster.go:125: [kubelet-start] Starting the kubelet" L47: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__" L48: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s" L49: "cluster.go:125: [kubelet-check] The kubelet is healthy after 4.002105529s" L50: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s" L51: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.14:6443/livez" L52: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz" L53: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez" L54: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 5.902758391s" L55: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 6.508020244s" L56: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 8.001835798s" L57: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace" L58: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster" L59: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs" L60: "cluster.go:125: [mark-control-plane] Marking the node ci-4081.3.7-a-702917e323 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-lo?ad-balancers]" L61: "cluster.go:125: [mark-control-plane] Marking the node ci-4081.3.7-a-702917e323 as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]" L62: "cluster.go:125: [bootstrap-token] Using token: vs0em8.dcpoq6s51hvdr7fs" L63: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles" L64: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes" L65: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials" L66: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token" L67: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster" L68: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace" L69: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key" L70: "cluster.go:125: [addons] Applied essential addon: CoreDNS" L71: "cluster.go:125: [addons] Applied essential addon: kube-proxy" L72: "cluster.go:125: " L73: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!" L74: "cluster.go:125: " L75: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:" L76: "cluster.go:125: " L77: "cluster.go:125: mkdir -p $HOME/.kube" L78: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config" L79: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config" L80: "cluster.go:125: " L81: "cluster.go:125: Alternatively, if you are the root user, you can run:" L82: "cluster.go:125: " L83: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf" L84: "cluster.go:125: " L85: "cluster.go:125: You should now deploy a pod network to the cluster." L86: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:" L87: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/" L88: "cluster.go:125: " L89: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:" L90: "cluster.go:125: " L91: "cluster.go:125: kubeadm join 10.0.0.14:6443 --token vs0em8.dcpoq6s51hvdr7fs _" L92: "cluster.go:125: --discovery-token-ca-cert-hash sha256:f442806428e9dbf932baab3dad41fa0d20240d8770a41c3aa58e1ec31d5899fc " L93: "cluster.go:125: namespace/kube-flannel created" L94: "cluster.go:125: clusterrole.rbac.authorization.k8s.io/flannel created" L95: "cluster.go:125: clusterrolebinding.rbac.authorization.k8s.io/flannel created" L96: "cluster.go:125: serviceaccount/flannel created" L97: "cluster.go:125: configmap/kube-flannel-cfg created" L98: "cluster.go:125: daemonset.apps/kube-flannel-ds created" L99: "cluster.go:125: W0421 10:32:29.778433 2205 joinconfiguration.go:112] [config] WARNING: Ignored configuration document with GroupVersionKind kubelet.config.k8s.io/v1beta1, Kind=KubeletConfiguration" L100: "cluster.go:125: [WARNING Service-Kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L101: "--- FAIL: kubeadm.v1.34.4.flannel.base/nginx_deployment (9.28s)" L102: "cluster.go:145: __kubectl get deployments -o json | jq _.items | .[] | .status.readyReplicas___ failed: output , status ssh: handshake failed: EOF" L103: "--- FAIL: kubeadm.v1.34.4.flannel.base/NFS_deployment (0.33s)" L104: "kubeadm.go:238: unable to add helm NFS repo: ssh: handshake failed: read tcp 10.200.1.6:54810-_20.125.24.66:22: read: connection reset by peer_" L105: " " ```                 Diagnostic output for azure, run 1 ``` L1: " Error: _cluster.go:125: I0421 10:12:12.401337 2410 version.go:260] remote version is much newer: v1.35.4; falling back to: stable-1.34" L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.34.7" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.34.7" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.34.7" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.34.7" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.12.1" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.1" L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.5-0" L9: "cluster.go:125: I0421 10:12:24.609906 2624 version.go:260] remote version is much newer: v1.35.4; falling back to: stable-1.34" L10: "cluster.go:125: [init] Using Kubernetes version: v1.34.7" L11: "cluster.go:125: [preflight] Running pre-flight checks" L12: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.7-a-f691389e45__ could not be reached" L13: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.7-a-f691389e45__: lookup ci-4081.3.7-a-f691389e45 on 168.63.129.16:53: no such host" L14: "cluster.go:125: [WARNING Service-Kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L15: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L16: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L17: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L18: "cluster.go:125: W0421 10:12:24.764371 2624 checks.go:827] detected that the sandbox image __registry.k8s.io/pause:3.8__ of the container runtime is inconsistent with that used by kubeadm. It is rec?ommended to use __registry.k8s.io/pause:3.10.1__ as the CRI sandbox image." L19: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L20: "cluster.go:125: [certs] Generating __ca__ certificate and key" L21: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L22: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [ci-4081.3.7-a-f691389e45 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local] and IPs [10.?96.0.1 10.0.0.32]" L23: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L24: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L25: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L26: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L27: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L28: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L29: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L30: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L31: "cluster.go:125: [certs] Generating __sa__ key and public key" L32: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L33: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L34: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L35: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L36: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L37: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L38: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L39: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L40: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L41: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L42: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L43: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__" L44: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__" L45: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L46: "cluster.go:125: [kubelet-start] Starting the kubelet" L47: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__" L48: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s" L49: "cluster.go:125: [kubelet-check] The kubelet is healthy after 2.000734933s" L50: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s" L51: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.32:6443/livez" L52: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz" L53: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez" L54: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 4.011516297s" L55: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 4.595130017s" L56: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 6.502033472s" L57: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace" L58: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster" L59: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs" L60: "cluster.go:125: [mark-control-plane] Marking the node ci-4081.3.7-a-f691389e45 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-lo?ad-balancers]" L61: "cluster.go:125: [mark-control-plane] Marking the node ci-4081.3.7-a-f691389e45 as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]" L62: "cluster.go:125: [bootstrap-token] Using token: iwtc81.cpndyldw2uihx9y4" L63: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles" L64: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes" L65: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials" L66: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token" L67: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster" L68: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace" L69: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key" L70: "cluster.go:125: [addons] Applied essential addon: CoreDNS" L71: "cluster.go:125: [addons] Applied essential addon: kube-proxy" L72: "cluster.go:125: " L73: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!" L74: "cluster.go:125: " L75: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:" L76: "cluster.go:125: " L77: "cluster.go:125: mkdir -p $HOME/.kube" L78: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config" L79: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config" L80: "cluster.go:125: " L81: "cluster.go:125: Alternatively, if you are the root user, you can run:" L82: "cluster.go:125: " L83: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf" L84: "cluster.go:125: " L85: "cluster.go:125: You should now deploy a pod network to the cluster." L86: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:" L87: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/" L88: "cluster.go:125: " L89: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:" L90: "cluster.go:125: " L91: "cluster.go:125: kubeadm join 10.0.0.32:6443 --token iwtc81.cpndyldw2uihx9y4 _" L92: "cluster.go:125: --discovery-token-ca-cert-hash sha256:a3a4224b3ad9616d2b0402926aeb55dbfa852cf640e0cdbbe2f3c9743d5eabdf " L93: "cluster.go:125: namespace/kube-flannel created" L94: "cluster.go:125: clusterrole.rbac.authorization.k8s.io/flannel created" L95: "cluster.go:125: clusterrolebinding.rbac.authorization.k8s.io/flannel created" L96: "cluster.go:125: serviceaccount/flannel created" L97: "cluster.go:125: configmap/kube-flannel-cfg created" L98: "cluster.go:125: daemonset.apps/kube-flannel-ds created" L99: "cluster.go:125: W0421 10:14:12.463431 2183 joinconfiguration.go:112] [config] WARNING: Ignored configuration document with GroupVersionKind kubelet.config.k8s.io/v1beta1, Kind=KubeletConfiguration" L100: "cluster.go:125: [WARNING Service-Kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L101: "cluster.go:125: jq: error (at 🟢 ok **kubeadm.v1.35.1.calico.base**; Succeeded: azure (1) 🟢 ok **kubeadm.v1.35.1.cilium.base**; Succeeded: azure (3); Failed: azure (1, 2)
                Diagnostic output for azure, run 2 ``` L1: " Error: _cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.35.4" L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.35.4" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.35.4" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.35.4" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.13.1" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.1" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.6-0" L8: "cluster.go:125: [init] Using Kubernetes version: v1.35.4" L9: "cluster.go:125: [preflight] Running pre-flight checks" L10: "cluster.go:125: [WARNING ContainerRuntimeVersion]: You must update your container runtime to a version that supports the CRI method RuntimeConfig. Falling back to using cgroupDriver from kubelet conf?ig will be removed in 1.36. For more information, see https://git.k8s.io/enhancements/keps/sig-node/4033-group-driver-detection-over-cri" L11: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.7-a-60a1f65c10__ could not be reached" L12: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.7-a-60a1f65c10__: lookup ci-4081.3.7-a-60a1f65c10 on 168.63.129.16:53: no such host" L13: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L14: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L15: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L16: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L17: "cluster.go:125: W0421 10:30:38.581875 2620 checks.go:906] detected that the sandbox image __registry.k8s.io/pause:3.8__ of the container runtime is inconsistent with that used by kubeadm. It is rec?ommended to use __registry.k8s.io/pause:3.10.1__ as the CRI sandbox image." L18: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L19: "cluster.go:125: [certs] Generating __ca__ certificate and key" L20: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L21: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [ci-4081.3.7-a-60a1f65c10 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local] and IPs [10.?96.0.1 10.0.0.16]" L22: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L23: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L24: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L25: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L26: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L27: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L28: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L29: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L30: "cluster.go:125: [certs] Generating __sa__ key and public key" L31: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L32: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L33: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L34: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L35: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L36: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L37: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L38: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L39: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L40: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L41: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L42: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__" L43: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__" L44: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L45: "cluster.go:125: [kubelet-start] Starting the kubelet" L46: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__" L47: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s" L48: "cluster.go:125: [kubelet-check] The kubelet is healthy after 1.002675992s" L49: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s" L50: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.16:6443/livez" L51: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz" L52: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez" L53: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 3.009026459s" L54: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 4.010607088s" L55: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 5.501824556s" L56: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace" L57: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster" L58: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs" L59: "cluster.go:125: [mark-control-plane] Marking the node ci-4081.3.7-a-60a1f65c10 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-lo?ad-balancers]" L60: "cluster.go:125: [mark-control-plane] Marking the node ci-4081.3.7-a-60a1f65c10 as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]" L61: "cluster.go:125: [bootstrap-token] Using token: um1emp.gdl39oo0i4u5g2th" L62: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles" L63: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes" L64: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials" L65: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token" L66: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster" L67: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace" L68: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key" L69: "cluster.go:125: [addons] Applied essential addon: CoreDNS" L70: "cluster.go:125: [addons] Applied essential addon: kube-proxy" L71: "cluster.go:125: " L72: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!" L73: "cluster.go:125: " L74: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:" L75: "cluster.go:125: " L76: "cluster.go:125: mkdir -p $HOME/.kube" L77: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config" L78: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config" L79: "cluster.go:125: " L80: "cluster.go:125: Alternatively, if you are the root user, you can run:" L81: "cluster.go:125: " L82: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf" L83: "cluster.go:125: " L84: "cluster.go:125: You should now deploy a pod network to the cluster." L85: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:" L86: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/" L87: "cluster.go:125: " L88: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:" L89: "cluster.go:125: " L90: "cluster.go:125: kubeadm join 10.0.0.16:6443 --token um1emp.gdl39oo0i4u5g2th _" L91: "cluster.go:125: --discovery-token-ca-cert-hash sha256:d05ab4ab826c447c938ce13a077b6bf3f94a8983c56c909fd8522c6d34780612 " L92: "cluster.go:125: i Using Cilium version 1.12.5" L93: "cluster.go:125: ? Auto-detected cluster name: kubernetes" L94: "cluster.go:125: ? Auto-detected datapath mode: tunnel" L95: "cluster.go:125: ? Auto-detected kube-proxy has been installed" L96: "cluster.go:125: i helm template --namespace kube-system cilium cilium/cilium --version 1.12.5 --set cluster.id=0,cluster.name=kubernetes,encryption.nodeEncryption=false,extraConfig.cluster-pool-ipv4-?cidr=192.168.0.0/17,extraConfig.enable-endpoint-routes=true,kubeProxyReplacement=disabled,operator.replicas=1,serviceAccounts.cilium.name=cilium,serviceAccounts.operator.name=cilium-operator,tunnel=vx?lan" L97: "cluster.go:125: i Storing helm values file in kube-system/cilium-cli-helm-values Secret" L98: "cluster.go:125: ? Created CA in secret cilium-ca" L99: "cluster.go:125: ? Generating certificates for Hubble..." L100: "cluster.go:125: ? Creating Service accounts..." L101: "cluster.go:125: ? Creating Cluster roles..." L102: "cluster.go:125: ? Creating ConfigMap for Cilium version 1.12.5..." L103: "cluster.go:125: i Manual overwrite in ConfigMap: enable-endpoint-routes=true" L104: "cluster.go:125: i Manual overwrite in ConfigMap: cluster-pool-ipv4-cidr=192.168.0.0/17" L105: "cluster.go:125: ? Creating Agent DaemonSet..." L106: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/mount-cgroup]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L107: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/apply-sysctl-overwrites]: deprecated since v1.30; use the ___appArmorProfile___ fi?eld instead__ subsys=klog" L108: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/clean-cilium-state]: deprecated since v1.30; use the ___appArmorProfile___ field i?nstead__ subsys=klog" L109: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/cilium-agent]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L110: "cluster.go:125: ? Creating Operator Deployment..." L111: "cluster.go:125: ? Waiting for Cilium to be installed and ready..." L112: "cluster.go:125: ? Cilium was successfully installed! Run _cilium status_ to view installation health" L113: "cluster.go:125: ?[33m /??_" L114: "cluster.go:125: ?[36m /???[33m___/?[32m??_?[0m Cilium: ?[32mOK?[0m" L115: "cluster.go:125: ?[36m ___?[31m/??_?[32m__/?[0m Operator: ?[32mOK?[0m" L116: "cluster.go:125: ?[32m /???[31m___/?[35m??_?[0m Hubble: ?[36mdisabled?[0m" L117: "cluster.go:125: ?[32m ___?[34m/??_?[35m__/?[0m ClusterMesh: ?[36mdisabled?[0m" L118: "cluster.go:125: ?[34m ___/" L119: "cluster.go:125: ?[0m" L120: "cluster.go:125: Deployment cilium-operator " L121: "cluster.go:125: DaemonSet cilium " L122: "cluster.go:125: Containers: cilium " L123: "cluster.go:125: cilium-operator " L124: "cluster.go:125: Cluster Pods: 0/0 managed by Cilium" L125: "cluster.go:125: W0421 10:32:27.053579 2199 joinconfiguration.go:112] [config] WARNING: Ignored configuration document with GroupVersionKind kubelet.config.k8s.io/v1beta1, Kind=KubeletConfiguration" L126: "cluster.go:125: [WARNING ContainerRuntimeVersion]: You must update your container runtime to a version that supports the CRI method RuntimeConfig. Falling back to using cgroupDriver from kubelet conf?ig will be removed in 1.36. For more information, see https://git.k8s.io/enhancements/keps/sig-node/4033-group-driver-detection-over-cri" L127: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L128: "--- FAIL: kubeadm.v1.35.1.cilium.base/nginx_deployment (9.56s)" L129: "cluster.go:145: __kubectl get deployments -o json | jq _.items | .[] | .status.readyReplicas___ failed: output , status dial tcp 20.98.103.56:22: connect: connection refused" L130: "--- FAIL: kubeadm.v1.35.1.cilium.base/NFS_deployment (1.04s)" L131: "kubeadm.go:238: unable to add helm NFS repo: dial tcp 20.98.103.56:22: connect: connection refused" L132: "--- FAIL: kubeadm.v1.35.1.cilium.base/IPSec_encryption (35.00s)" L133: "cluster.go:145: __/opt/bin/cilium uninstall__ failed: output , status dial tcp 20.98.103.56:22: i/o timeout_" L134: " " ```                 Diagnostic output for azure, run 1 ``` L1: " Error: _cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.35.4" L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.35.4" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.35.4" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.35.4" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.13.1" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.1" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.6-0" L8: "cluster.go:125: [init] Using Kubernetes version: v1.35.4" L9: "cluster.go:125: [preflight] Running pre-flight checks" L10: "cluster.go:125: [WARNING ContainerRuntimeVersion]: You must update your container runtime to a version that supports the CRI method RuntimeConfig. Falling back to using cgroupDriver from kubelet conf?ig will be removed in 1.36. For more information, see https://git.k8s.io/enhancements/keps/sig-node/4033-group-driver-detection-over-cri" L11: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.7-a-45a71c7f85__ could not be reached" L12: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.7-a-45a71c7f85__: lookup ci-4081.3.7-a-45a71c7f85 on 168.63.129.16:53: no such host" L13: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L14: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L15: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L16: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L17: "cluster.go:125: W0421 10:08:09.480589 2587 checks.go:906] detected that the sandbox image __registry.k8s.io/pause:3.8__ of the container runtime is inconsistent with that used by kubeadm. It is rec?ommended to use __registry.k8s.io/pause:3.10.1__ as the CRI sandbox image." L18: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L19: "cluster.go:125: [certs] Generating __ca__ certificate and key" L20: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L21: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [ci-4081.3.7-a-45a71c7f85 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local] and IPs [10.?96.0.1 10.0.0.28]" L22: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L23: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L24: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L25: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L26: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L27: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L28: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L29: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L30: "cluster.go:125: [certs] Generating __sa__ key and public key" L31: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L32: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L33: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L34: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L35: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L36: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L37: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L38: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L39: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L40: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L41: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L42: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__" L43: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__" L44: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L45: "cluster.go:125: [kubelet-start] Starting the kubelet" L46: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__" L47: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s" L48: "cluster.go:125: [kubelet-check] The kubelet is healthy after 502.745034ms" L49: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s" L50: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.28:6443/livez" L51: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz" L52: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez" L53: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 3.012923023s" L54: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 3.626784986s" L55: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 5.50154762s" L56: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace" L57: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster" L58: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs" L59: "cluster.go:125: [mark-control-plane] Marking the node ci-4081.3.7-a-45a71c7f85 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-lo?ad-balancers]" L60: "cluster.go:125: [mark-control-plane] Marking the node ci-4081.3.7-a-45a71c7f85 as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]" L61: "cluster.go:125: [bootstrap-token] Using token: d4bh6r.sr20cnyh39sdmukj" L62: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles" L63: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes" L64: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials" L65: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token" L66: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster" L67: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace" L68: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key" L69: "cluster.go:125: [addons] Applied essential addon: CoreDNS" L70: "cluster.go:125: [addons] Applied essential addon: kube-proxy" L71: "cluster.go:125: " L72: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!" L73: "cluster.go:125: " L74: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:" L75: "cluster.go:125: " L76: "cluster.go:125: mkdir -p $HOME/.kube" L77: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config" L78: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config" L79: "cluster.go:125: " L80: "cluster.go:125: Alternatively, if you are the root user, you can run:" L81: "cluster.go:125: " L82: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf" L83: "cluster.go:125: " L84: "cluster.go:125: You should now deploy a pod network to the cluster." L85: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:" L86: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/" L87: "cluster.go:125: " L88: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:" L89: "cluster.go:125: " L90: "cluster.go:125: kubeadm join 10.0.0.28:6443 --token d4bh6r.sr20cnyh39sdmukj _" L91: "cluster.go:125: --discovery-token-ca-cert-hash sha256:d113a78e674c49de97a73fb1fa082100246ccdda174f89b0bb72d08d81e23028 " L92: "cluster.go:125: i Using Cilium version 1.12.5" L93: "cluster.go:125: ? Auto-detected cluster name: kubernetes" L94: "cluster.go:125: ? Auto-detected datapath mode: tunnel" L95: "cluster.go:125: ? Auto-detected kube-proxy has been installed" L96: "cluster.go:125: i helm template --namespace kube-system cilium cilium/cilium --version 1.12.5 --set cluster.id=0,cluster.name=kubernetes,encryption.nodeEncryption=false,extraConfig.cluster-pool-ipv4-?cidr=192.168.0.0/17,extraConfig.enable-endpoint-routes=true,kubeProxyReplacement=disabled,operator.replicas=1,serviceAccounts.cilium.name=cilium,serviceAccounts.operator.name=cilium-operator,tunnel=vx?lan" L97: "cluster.go:125: i Storing helm values file in kube-system/cilium-cli-helm-values Secret" L98: "cluster.go:125: ? Created CA in secret cilium-ca" L99: "cluster.go:125: ? Generating certificates for Hubble..." L100: "cluster.go:125: ? Creating Service accounts..." L101: "cluster.go:125: ? Creating Cluster roles..." L102: "cluster.go:125: ? Creating ConfigMap for Cilium version 1.12.5..." L103: "cluster.go:125: i Manual overwrite in ConfigMap: cluster-pool-ipv4-cidr=192.168.0.0/17" L104: "cluster.go:125: i Manual overwrite in ConfigMap: enable-endpoint-routes=true" L105: "cluster.go:125: ? Creating Agent DaemonSet..." L106: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/mount-cgroup]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L107: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/apply-sysctl-overwrites]: deprecated since v1.30; use the ___appArmorProfile___ fi?eld instead__ subsys=klog" L108: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/clean-cilium-state]: deprecated since v1.30; use the ___appArmorProfile___ field i?nstead__ subsys=klog" L109: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/cilium-agent]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L110: "cluster.go:125: ? Creating Operator Deployment..." L111: "cluster.go:125: ? Waiting for Cilium to be installed and ready..." L112: "cluster.go:125: ? Cilium was successfully installed! Run _cilium status_ to view installation health" L113: "cluster.go:125: ?[33m /??_" L114: "cluster.go:125: ?[36m /???[33m___/?[32m??_?[0m Cilium: ?[32mOK?[0m" L115: "cluster.go:125: ?[36m ___?[31m/??_?[32m__/?[0m Operator: ?[32mOK?[0m" L116: "cluster.go:125: ?[32m /???[31m___/?[35m??_?[0m Hubble: ?[36mdisabled?[0m" L117: "cluster.go:125: ?[32m ___?[34m/??_?[35m__/?[0m ClusterMesh: ?[36mdisabled?[0m" L118: "cluster.go:125: ?[34m ___/" L119: "cluster.go:125: ?[0m" L120: "cluster.go:125: Deployment cilium-operator " L121: "cluster.go:125: DaemonSet cilium " L122: "cluster.go:125: Containers: cilium-operator " L123: "cluster.go:125: cilium " L124: "cluster.go:125: Cluster Pods: 0/0 managed by Cilium" L125: "kubeadm.go:197: unable to setup cluster: unable to create worker node: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kola-cluster-image-f26acefb9c/?providers/Microsoft.Compute/virtualMachines/ci-4081.3.7-a-cf6e14881a" L126: "--------------------------------------------------------------------------------" L127: "RESPONSE 409: 409 Conflict" L128: "ERROR CODE: OperationNotAllowed" L129: "--------------------------------------------------------------------------------" L130: "{" L131: "__error__: {" L132: "__code__: __OperationNotAllowed__," L133: "__message__: __Operation could not be completed as it results in exceeding approved standardDPLSv5Family Cores quota. Additional details - Deployment Model: Resource Manager, Location: westus2, Curren?t Limit: 65, Current Usage: 64, Additional Required: 2, (Minimum) New Limit Required: 66. Setup Alerts when Quota reaches threshold. Learn more at https://aka.ms/quotamonitoringalerting . Submit a req?uest for Quota increase at https://aka.ms/ProdportalCRP/#blade/Microsoft_Azure_Capacity/UsageAndQuota.ReactView/Parameters/%7B%22subscriptionId%22:%220e46bd28-a80f-4d3a-8200-d9eb8d80cb2e%22,%22command?%22:%22openQuotaApprovalBlade%22,%22quotas%22:[%7B%22location%22:%22westus2%22,%22providerId%22:%22Microsoft.Compute%22,%22resourceName%22:%22standardDPLSv5Family%22,%22quotaRequest%22:%7B%22propertie?s%22:%7B%22limit%22:66,%22unit%22:%22Count%22,%22name%22:%7B%22value%22:%22standardDPLSv5Family%22%7D%7D%7D%7D]%7D by specifying parameters listed in the ???Details??? section for deployment to succee?d. Please read more about quota limits at https://docs.microsoft.com/en-us/azure/azure-supportability/per-vm-quota-requests__" L134: "}" L135: "}" L136: "--------------------------------------------------------------------------------_" L137: " " ```
🟢 ok **kubeadm.v1.35.1.flannel.base**; Succeeded: azure (1) 🟢 ok **sysext.custom-docker.sysext**; Succeeded: azure (1) 🟢 ok **sysext.disable-containerd**; Succeeded: azure (1) 🟢 ok **sysext.disable-docker**; Succeeded: azure (1) 🟢 ok **sysext.simple**; Succeeded: azure (1) 🟢 ok **systemd.journal.user**; Succeeded: azure (1) 🟢 ok **systemd.sysusers.gshadow**; Succeeded: azure (1)