### Test report for 4081.3.10+nightly-20261022-2100 / arm64 **Platforms tested** : azure 🟢 ok **azure.nvme-friendly-naming # SKIP**; Succeeded: azure (1) 🟢 ok **cl.basic**; Succeeded: azure (1) 🟢 ok **cl.cloudinit.basic**; Succeeded: azure (1) 🟢 ok **cl.cloudinit.multipart-mime**; Succeeded: azure (1) 🟢 ok **cl.cloudinit.script**; Succeeded: azure (1) 🟢 ok **cl.etcd-member.discovery**; Succeeded: azure (1) 🟢 ok **cl.etcd-member.etcdctlv3**; Succeeded: azure (1) 🟢 ok **cl.etcd-member.v2-backup-restore**; Succeeded: azure (1) 🟢 ok **cl.flannel.vxlan**; Succeeded: azure (1) 🟢 ok **cl.ignition.kargs**; Succeeded: azure (1) 🟢 ok **cl.ignition.luks**; Succeeded: azure (1) 🟢 ok **cl.ignition.misc.empty**; Succeeded: azure (1) 🟢 ok **cl.ignition.symlink**; Succeeded: azure (1) 🟢 ok **cl.ignition.translation**; Succeeded: azure (1) 🟢 ok **cl.ignition.v1.btrfsroot**; Succeeded: azure (1) 🟢 ok **cl.ignition.v1.ext4root**; Succeeded: azure (1) 🟢 ok **cl.ignition.v1.groups**; Succeeded: azure (1) 🟢 ok **cl.ignition.v1.noop**; Succeeded: azure (1) 🟢 ok **cl.ignition.v1.once**; Succeeded: azure (1) 🟢 ok **cl.ignition.v1.users**; Succeeded: azure (1) 🟢 ok **cl.ignition.v1.xfsroot**; Succeeded: azure (1) 🟢 ok **cl.ignition.v2.btrfsroot**; Succeeded: azure (1) 🟢 ok **cl.ignition.v2.ext4root**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _harness.go:651: Cluster failed starting machines: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kola-cluster-image-d500de4e9d/providers/Mic?rosoft.Compute/virtualMachines/ci-4081.3.10--960309498f" L2: "--------------------------------------------------------------------------------" L3: "RESPONSE 409: 409 Conflict" L4: "ERROR CODE: OperationNotAllowed" L5: "--------------------------------------------------------------------------------" L6: "{" L7: "__error__: {" L8: "__code__: __OperationNotAllowed__," L9: "__message__: __Operation could not be completed as it results in exceeding approved standardDPLSv5Family Cores quota. Additional details - Deployment Model: Resource Manager, Location: westus2, Curren?t Limit: 65, Current Usage: 64, Additional Required: 2, (Minimum) New Limit Required: 66. Setup Alerts when Quota reaches threshold. Learn more at https://aka.ms/quotamonitoringalerting . Submit a req?uest for Quota increase at https://aka.ms/ProdportalCRP/#blade/Microsoft_Azure_Capacity/UsageAndQuota.ReactView/Parameters/%7B%22subscriptionId%22:%220e46bd28-a80f-4d3a-8200-d9eb8d80cb2e%22,%22command?%22:%22openQuotaApprovalBlade%22,%22quotas%22:[%7B%22location%22:%22westus2%22,%22providerId%22:%22Microsoft.Compute%22,%22resourceName%22:%22standardDPLSv5Family%22,%22quotaRequest%22:%7B%22propertie?s%22:%7B%22limit%22:66,%22unit%22:%22Count%22,%22name%22:%7B%22value%22:%22standardDPLSv5Family%22%7D%7D%7D%7D]%7D by specifying parameters listed in the ???Details??? section for deployment to succee?d. Please read more about quota limits at https://docs.microsoft.com/en-us/azure/azure-supportability/per-vm-quota-requests__" L10: "}" L11: "}" L12: "--------------------------------------------------------------------------------_" L13: " " ```
🟢 ok **cl.ignition.v2.noop**; Succeeded: azure (1) 🟢 ok **cl.ignition.v2.users**; Succeeded: azure (1) 🟢 ok **cl.ignition.v2.xfsroot**; Succeeded: azure (1) 🟢 ok **cl.ignition.v2_1.ext4checkexisting**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _filesystem.go:415: Couldn_t start machine: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kola-cluster-image-d500de4e9d/providers/Microsoft.?Compute/virtualMachines/ci-4081.3.10--4a2ea5f5a9" L2: "--------------------------------------------------------------------------------" L3: "RESPONSE 409: 409 Conflict" L4: "ERROR CODE: OperationNotAllowed" L5: "--------------------------------------------------------------------------------" L6: "{" L7: "__error__: {" L8: "__code__: __OperationNotAllowed__," L9: "__message__: __Operation could not be completed as it results in exceeding approved standardDPLSv5Family Cores quota. Additional details - Deployment Model: Resource Manager, Location: westus2, Curren?t Limit: 65, Current Usage: 64, Additional Required: 2, (Minimum) New Limit Required: 66. Setup Alerts when Quota reaches threshold. Learn more at https://aka.ms/quotamonitoringalerting . Submit a req?uest for Quota increase at https://aka.ms/ProdportalCRP/#blade/Microsoft_Azure_Capacity/UsageAndQuota.ReactView/Parameters/%7B%22subscriptionId%22:%220e46bd28-a80f-4d3a-8200-d9eb8d80cb2e%22,%22command?%22:%22openQuotaApprovalBlade%22,%22quotas%22:[%7B%22location%22:%22westus2%22,%22providerId%22:%22Microsoft.Compute%22,%22resourceName%22:%22standardDPLSv5Family%22,%22quotaRequest%22:%7B%22propertie?s%22:%7B%22limit%22:66,%22unit%22:%22Count%22,%22name%22:%7B%22value%22:%22standardDPLSv5Family%22%7D%7D%7D%7D]%7D by specifying parameters listed in the ???Details??? section for deployment to succee?d. Please read more about quota limits at https://docs.microsoft.com/en-us/azure/azure-supportability/per-vm-quota-requests__" L10: "}" L11: "}" L12: "--------------------------------------------------------------------------------_" L13: " " ```
🟢 ok **cl.ignition.v2_1.swap**; Succeeded: azure (1) 🟢 ok **cl.ignition.v2_1.vfat**; Succeeded: azure (1) 🟢 ok **cl.internet**; Succeeded: azure (1) 🟢 ok **cl.locksmith.cluster**; Succeeded: azure (1) 🟢 ok **cl.metadata.azure**; Succeeded: azure (1) 🟢 ok **cl.network.initramfs.second-boot**; Succeeded: azure (1) 🟢 ok **cl.network.iptables**; Succeeded: azure (1) 🟢 ok **cl.network.wireguard**; Succeeded: azure (1) 🟢 ok **cl.osreset.ignition-rerun**; Succeeded: azure (1) 🟢 ok **cl.overlay.cleanup**; Succeeded: azure (1) 🟢 ok **cl.swap_activation**; Succeeded: azure (1) 🟢 ok **cl.toolbox.dnf-install**; Succeeded: azure (1) 🟢 ok **cl.update.badverity**; Succeeded: azure (1) 🟢 ok **cl.update.reboot**; Succeeded: azure (1) 🟢 ok **cl.users.shells**; Succeeded: azure (1) 🟢 ok **cl.verity**; Succeeded: azure (1) 🟢 ok **coreos.auth.verify**; Succeeded: azure (1) 🟢 ok **coreos.ignition.groups**; Succeeded: azure (1) 🟢 ok **coreos.ignition.once**; Succeeded: azure (1) 🟢 ok **coreos.ignition.resource.local**; Succeeded: azure (1) 🟢 ok **coreos.ignition.resource.remote**; Succeeded: azure (1) 🟢 ok **coreos.ignition.security.tls**; Succeeded: azure (1) 🟢 ok **coreos.ignition.systemd.enable-service**; Succeeded: azure (1) 🟢 ok **coreos.locksmith.reboot**; Succeeded: azure (1) 🟢 ok **coreos.locksmith.tls**; Succeeded: azure (1) 🟢 ok **coreos.selinux.boolean**; Succeeded: azure (1) 🟢 ok **coreos.selinux.enforce**; Succeeded: azure (1) 🟢 ok **coreos.tls.fetch-urls**; Succeeded: azure (1) 🟢 ok **coreos.update.badusr**; Succeeded: azure (1) 🟢 ok **docker.base**; Succeeded: azure (1) 🟢 ok **docker.btrfs-storage**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _harness.go:651: Cluster failed starting machines: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kola-cluster-image-d500de4e9d/providers/Mic?rosoft.Compute/virtualMachines/ci-4081.3.10--aaa7b2a7d9" L2: "--------------------------------------------------------------------------------" L3: "RESPONSE 409: 409 Conflict" L4: "ERROR CODE: OperationNotAllowed" L5: "--------------------------------------------------------------------------------" L6: "{" L7: "__error__: {" L8: "__code__: __OperationNotAllowed__," L9: "__message__: __Operation could not be completed as it results in exceeding approved standardDPLSv5Family Cores quota. Additional details - Deployment Model: Resource Manager, Location: westus2, Curren?t Limit: 65, Current Usage: 64, Additional Required: 2, (Minimum) New Limit Required: 66. Setup Alerts when Quota reaches threshold. Learn more at https://aka.ms/quotamonitoringalerting . Submit a req?uest for Quota increase at https://aka.ms/ProdportalCRP/#blade/Microsoft_Azure_Capacity/UsageAndQuota.ReactView/Parameters/%7B%22subscriptionId%22:%220e46bd28-a80f-4d3a-8200-d9eb8d80cb2e%22,%22command?%22:%22openQuotaApprovalBlade%22,%22quotas%22:[%7B%22location%22:%22westus2%22,%22providerId%22:%22Microsoft.Compute%22,%22resourceName%22:%22standardDPLSv5Family%22,%22quotaRequest%22:%7B%22propertie?s%22:%7B%22limit%22:66,%22unit%22:%22Count%22,%22name%22:%7B%22value%22:%22standardDPLSv5Family%22%7D%7D%7D%7D]%7D by specifying parameters listed in the ???Details??? section for deployment to succee?d. Please read more about quota limits at https://docs.microsoft.com/en-us/azure/azure-supportability/per-vm-quota-requests__" L10: "}" L11: "}" L12: "--------------------------------------------------------------------------------_" L13: " " ```
🟢 ok **docker.containerd-restart**; Succeeded: azure (1) 🟢 ok **docker.enable-service.sysext**; Succeeded: azure (1) 🟢 ok **docker.lib-coreos-dockerd-compat**; Succeeded: azure (1) 🟢 ok **docker.network-openbsd-nc**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _harness.go:651: Cluster failed starting machines: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kola-cluster-image-d500de4e9d/providers/Mic?rosoft.Compute/virtualMachines/ci-4081.3.10--3251b44e70" L2: "--------------------------------------------------------------------------------" L3: "RESPONSE 409: 409 Conflict" L4: "ERROR CODE: OperationNotAllowed" L5: "--------------------------------------------------------------------------------" L6: "{" L7: "__error__: {" L8: "__code__: __OperationNotAllowed__," L9: "__message__: __Operation could not be completed as it results in exceeding approved standardDPLSv5Family Cores quota. Additional details - Deployment Model: Resource Manager, Location: westus2, Curren?t Limit: 65, Current Usage: 64, Additional Required: 2, (Minimum) New Limit Required: 66. Setup Alerts when Quota reaches threshold. Learn more at https://aka.ms/quotamonitoringalerting . Submit a req?uest for Quota increase at https://aka.ms/ProdportalCRP/#blade/Microsoft_Azure_Capacity/UsageAndQuota.ReactView/Parameters/%7B%22subscriptionId%22:%220e46bd28-a80f-4d3a-8200-d9eb8d80cb2e%22,%22command?%22:%22openQuotaApprovalBlade%22,%22quotas%22:[%7B%22location%22:%22westus2%22,%22providerId%22:%22Microsoft.Compute%22,%22resourceName%22:%22standardDPLSv5Family%22,%22quotaRequest%22:%7B%22propertie?s%22:%7B%22limit%22:66,%22unit%22:%22Count%22,%22name%22:%7B%22value%22:%22standardDPLSv5Family%22%7D%7D%7D%7D]%7D by specifying parameters listed in the ???Details??? section for deployment to succee?d. Please read more about quota limits at https://docs.microsoft.com/en-us/azure/azure-supportability/per-vm-quota-requests__" L10: "}" L11: "}" L12: "--------------------------------------------------------------------------------_" L13: " " ```
🟢 ok **docker.selinux**; Succeeded: azure (1) 🟢 ok **docker.userns**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _harness.go:651: Cluster failed starting machines: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kola-cluster-image-d500de4e9d/providers/Mic?rosoft.Compute/virtualMachines/ci-4081.3.10--c65d1baf49" L2: "--------------------------------------------------------------------------------" L3: "RESPONSE 409: 409 Conflict" L4: "ERROR CODE: OperationNotAllowed" L5: "--------------------------------------------------------------------------------" L6: "{" L7: "__error__: {" L8: "__code__: __OperationNotAllowed__," L9: "__message__: __Operation could not be completed as it results in exceeding approved standardDPLSv5Family Cores quota. Additional details - Deployment Model: Resource Manager, Location: westus2, Curren?t Limit: 65, Current Usage: 64, Additional Required: 2, (Minimum) New Limit Required: 66. Setup Alerts when Quota reaches threshold. Learn more at https://aka.ms/quotamonitoringalerting . Submit a req?uest for Quota increase at https://aka.ms/ProdportalCRP/#blade/Microsoft_Azure_Capacity/UsageAndQuota.ReactView/Parameters/%7B%22subscriptionId%22:%220e46bd28-a80f-4d3a-8200-d9eb8d80cb2e%22,%22command?%22:%22openQuotaApprovalBlade%22,%22quotas%22:[%7B%22location%22:%22westus2%22,%22providerId%22:%22Microsoft.Compute%22,%22resourceName%22:%22standardDPLSv5Family%22,%22quotaRequest%22:%7B%22propertie?s%22:%7B%22limit%22:66,%22unit%22:%22Count%22,%22name%22:%7B%22value%22:%22standardDPLSv5Family%22%7D%7D%7D%7D]%7D by specifying parameters listed in the ???Details??? section for deployment to succee?d. Please read more about quota limits at https://docs.microsoft.com/en-us/azure/azure-supportability/per-vm-quota-requests__" L10: "}" L11: "}" L12: "--------------------------------------------------------------------------------_" L13: " " ```
🟢 ok **kubeadm.v1.35.1.calico.base**; Succeeded: azure (1) 🟢 ok **kubeadm.v1.35.1.calico.cgroupv1.base**; Succeeded: azure (3); Failed: azure (1, 2)
                Diagnostic output for azure, run 2 ``` L1: " Error: _cluster.go:125: I1022 23:54:06.561192 2543 version.go:260] remote version is much newer: v1.37.1; falling back to: stable-1.35" L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.35.9" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.35.9" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.35.9" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.35.9" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.13.1" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.1" L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.6-0" L9: "cluster.go:125: I1022 23:54:15.662865 2825 version.go:260] remote version is much newer: v1.37.1; falling back to: stable-1.35" L10: "cluster.go:125: [init] Using Kubernetes version: v1.35.9" L11: "cluster.go:125: [preflight] Running pre-flight checks" L12: "cluster.go:125: [WARNING ContainerRuntimeVersion]: You must update your container runtime to a version that supports the CRI method RuntimeConfig. Falling back to using cgroupDriver from kubelet conf?ig will be removed in 1.36. For more information, see https://git.k8s.io/enhancements/keps/sig-node/4033-group-driver-detection-over-cri" L13: "cluster.go:125: [preflight] The system verification failed. Printing the output from the verification:" L14: "cluster.go:125: ?[0;37mKERNEL_VERSION?[0m: ?[0;32m6.6.159-flatcar?[0m" L15: "cluster.go:125: ?[0;37mCONFIG_NAMESPACES?[0m: ?[0;32menabled?[0m" L16: "cluster.go:125: ?[0;37mCONFIG_NET_NS?[0m: ?[0;32menabled?[0m" L17: "cluster.go:125: ?[0;37mCONFIG_PID_NS?[0m: ?[0;32menabled?[0m" L18: "cluster.go:125: ?[0;37mCONFIG_IPC_NS?[0m: ?[0;32menabled?[0m" L19: "cluster.go:125: ?[0;37mCONFIG_UTS_NS?[0m: ?[0;32menabled?[0m" L20: "cluster.go:125: ?[0;37mCONFIG_CPUSETS?[0m: ?[0;32menabled?[0m" L21: "cluster.go:125: ?[0;37mCONFIG_MEMCG?[0m: ?[0;32menabled?[0m" L22: "cluster.go:125: ?[0;37mCONFIG_INET?[0m: ?[0;32menabled?[0m" L23: "cluster.go:125: ?[0;37mCONFIG_EXT4_FS?[0m: ?[0;32menabled (as module)?[0m" L24: "cluster.go:125: ?[0;37mCONFIG_PROC_FS?[0m: ?[0;32menabled?[0m" L25: "cluster.go:125: ?[0;37mCONFIG_NETFILTER_XT_TARGET_REDIRECT?[0m: ?[0;32menabled (as module)?[0m" L26: "cluster.go:125: ?[0;37mCONFIG_NETFILTER_XT_MATCH_COMMENT?[0m: ?[0;32menabled (as module)?[0m" L27: "cluster.go:125: ?[0;37mCONFIG_FAIR_GROUP_SCHED?[0m: ?[0;32menabled?[0m" L28: "cluster.go:125: ?[0;37mCONFIG_CGROUPS?[0m: ?[0;32menabled?[0m" L29: "cluster.go:125: ?[0;37mCONFIG_CGROUP_CPUACCT?[0m: ?[0;32menabled?[0m" L30: "cluster.go:125: ?[0;37mCONFIG_CGROUP_DEVICE?[0m: ?[0;32menabled?[0m" L31: "cluster.go:125: ?[0;37mCONFIG_CGROUP_FREEZER?[0m: ?[0;32menabled?[0m" L32: "cluster.go:125: ?[0;37mCONFIG_CGROUP_PIDS?[0m: ?[0;32menabled?[0m" L33: "cluster.go:125: ?[0;37mCONFIG_CGROUP_SCHED?[0m: ?[0;32menabled?[0m" L34: "cluster.go:125: ?[0;37mCONFIG_OVERLAY_FS?[0m: ?[0;32menabled (as module)?[0m" L35: "cluster.go:125: ?[0;37mCONFIG_AUFS_FS?[0m: ?[0;33mnot set - Required for aufs.?[0m" L36: "cluster.go:125: ?[0;37mCONFIG_BLK_DEV_DM?[0m: ?[0;32menabled (as module)?[0m" L37: "cluster.go:125: ?[0;37mCONFIG_CFS_BANDWIDTH?[0m: ?[0;32menabled?[0m" L38: "cluster.go:125: ?[0;37mCONFIG_SECCOMP?[0m: ?[0;32menabled?[0m" L39: "cluster.go:125: ?[0;37mCONFIG_SECCOMP_FILTER?[0m: ?[0;32menabled?[0m" L40: "cluster.go:125: ?[0;37mOS?[0m: ?[0;32mLinux?[0m" L41: "cluster.go:125: ?[0;37mCGROUPS_CPU?[0m: ?[0;32menabled?[0m" L42: "cluster.go:125: ?[0;37mCGROUPS_CPUACCT?[0m: ?[0;32menabled?[0m" L43: "cluster.go:125: ?[0;37mCGROUPS_CPUSET?[0m: ?[0;32menabled?[0m" L44: "cluster.go:125: ?[0;37mCGROUPS_DEVICES?[0m: ?[0;32menabled?[0m" L45: "cluster.go:125: ?[0;37mCGROUPS_FREEZER?[0m: ?[0;32menabled?[0m" L46: "cluster.go:125: ?[0;37mCGROUPS_MEMORY?[0m: ?[0;32menabled?[0m" L47: "cluster.go:125: ?[0;37mCGROUPS_PIDS?[0m: ?[0;32menabled?[0m" L48: "cluster.go:125: ?[0;37mCGROUPS_HUGETLB?[0m: ?[0;32menabled?[0m" L49: "cluster.go:125: ?[0;37mCGROUPS_BLKIO?[0m: ?[0;32menabled?[0m" L50: "cluster.go:125: [WARNING SystemVerification]: cgroups v1 support is deprecated and will be removed in a future release. Please migrate to cgroups v2. To explicitly enable cgroups v1 support for kubel?et v1.35 or newer, you must set the kubelet configuration option _FailCgroupV1_ to _false_. You must also explicitly skip this validation. For more information, see https://git.k8s.io/enhancements/kep?s/sig-node/5573-remove-cgroup-v1" L51: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.10--dcf8379d57__ could not be reached" L52: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.10--dcf8379d57__: lookup ci-4081.3.10--dcf8379d57 on 168.63.129.16:53: no such host" L53: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L54: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L55: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L56: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L57: "cluster.go:125: W1022 23:54:15.838843 2825 checks.go:906] detected that the sandbox image __registry.k8s.io/pause:3.8__ of the container runtime is inconsistent with that used by kubeadm. It is rec?ommended to use __registry.k8s.io/pause:3.10.1__ as the CRI sandbox image." L58: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L59: "cluster.go:125: [certs] Generating __ca__ certificate and key" L60: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L61: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [ci-4081.3.10--dcf8379d57 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local] and IPs [10.?96.0.1 10.0.0.16]" L62: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L63: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L64: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L65: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L66: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L67: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L68: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L69: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L70: "cluster.go:125: [certs] Generating __sa__ key and public key" L71: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L72: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L73: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L74: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L75: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L76: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L77: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L78: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L79: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L80: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L81: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L82: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__" L83: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__" L84: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L85: "cluster.go:125: [kubelet-start] Starting the kubelet" L86: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__" L87: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s" L88: "cluster.go:125: [kubelet-check] The kubelet is healthy after 2.001319492s" L89: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s" L90: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.16:6443/livez" L91: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz" L92: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez" L93: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 3.016890292s" L94: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 3.174186277s" L95: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 5.001242227s" L96: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace" L97: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster" L98: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs" L99: "cluster.go:125: [mark-control-plane] Marking the node ci-4081.3.10--dcf8379d57 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-lo?ad-balancers]" L100: "cluster.go:125: [mark-control-plane] Marking the node ci-4081.3.10--dcf8379d57 as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]" L101: "cluster.go:125: [bootstrap-token] Using token: q2mnlf.xu4lvvv6hhnq4j85" L102: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles" L103: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes" L104: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials" L105: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token" L106: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster" L107: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace" L108: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key" L109: "cluster.go:125: [addons] Applied essential addon: CoreDNS" L110: "cluster.go:125: [addons] Applied essential addon: kube-proxy" L111: "cluster.go:125: " L112: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!" L113: "cluster.go:125: " L114: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:" L115: "cluster.go:125: " L116: "cluster.go:125: mkdir -p $HOME/.kube" L117: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config" L118: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config" L119: "cluster.go:125: " L120: "cluster.go:125: Alternatively, if you are the root user, you can run:" L121: "cluster.go:125: " L122: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf" L123: "cluster.go:125: " L124: "cluster.go:125: You should now deploy a pod network to the cluster." L125: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:" L126: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/" L127: "cluster.go:125: " L128: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:" L129: "cluster.go:125: " L130: "cluster.go:125: kubeadm join 10.0.0.16:6443 --token q2mnlf.xu4lvvv6hhnq4j85 _" L131: "cluster.go:125: --discovery-token-ca-cert-hash sha256:3c218ffdb5183451181d301fd1692165df25596bea44267cb655f2e10afec9cb " L132: "cluster.go:125: namespace/tigera-operator created" L133: "cluster.go:125: serviceaccount/tigera-operator created" L134: "cluster.go:125: clusterrole.rbac.authorization.k8s.io/tigera-operator-secrets created" L135: "cluster.go:125: clusterrole.rbac.authorization.k8s.io/tigera-operator created" L136: "cluster.go:125: clusterrolebinding.rbac.authorization.k8s.io/tigera-operator created" L137: "cluster.go:125: rolebinding.rbac.authorization.k8s.io/tigera-operator-secrets created" L138: "cluster.go:125: deployment.apps/tigera-operator created" L139: "cluster.go:125: customresourcedefinition.apiextensions.k8s.io/installations.operator.tigera.io condition met" L140: "cluster.go:125: customresourcedefinition.apiextensions.k8s.io/installations.operator.tigera.io condition met" L141: "cluster.go:125: customresourcedefinition.apiextensions.k8s.io/apiservers.operator.tigera.io condition met" L142: "cluster.go:125: customresourcedefinition.apiextensions.k8s.io/apiservers.operator.tigera.io condition met" L143: "cluster.go:125: installation.operator.tigera.io/default created" L144: "cluster.go:125: apiserver.operator.tigera.io/default created" L145: "cluster.go:125: goldmane.operator.tigera.io/default created" L146: "cluster.go:125: whisker.operator.tigera.io/default created" L147: "kubeadm.go:197: unable to setup cluster: unable to create worker node: PollUntilDone(ci-4081.3.10--4d1b99031a): GET https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/prov?iders/Microsoft.Compute/locations/westus2/operations/7e772ef0-0b42-4adc-873a-da5517446267" L148: "--------------------------------------------------------------------------------" L149: "RESPONSE 200: 200 OK" L150: "ERROR CODE: OperationPreempted" L151: "--------------------------------------------------------------------------------" L152: "{" L153: "__startTime__: __2026-10-22T23:54:46.8958596+00:00__," L154: "__endTime__: __2026-10-22T23:55:41.3859181+00:00__," L155: "__status__: __Canceled__," L156: "__error__: {" L157: "__code__: __OperationPreempted__," L158: "__message__: __Operation execution has been preempted by a more recent operation.__" L159: "}," L160: "__name__: __7e772ef0-0b42-4adc-873a-da5517446267__" L161: "}" L162: "--------------------------------------------------------------------------------_" L163: " " ```                 Diagnostic output for azure, run 1 ``` L1: " Error: _cluster.go:125: I1022 23:36:53.156640 2527 version.go:260] remote version is much newer: v1.37.1; falling back to: stable-1.35" L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.35.9" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.35.9" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.35.9" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.35.9" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.13.1" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.1" L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.6-0" L9: "cluster.go:125: I1022 23:37:03.069855 2742 version.go:260] remote version is much newer: v1.37.1; falling back to: stable-1.35" L10: "cluster.go:125: [init] Using Kubernetes version: v1.35.9" L11: "cluster.go:125: [preflight] Running pre-flight checks" L12: "cluster.go:125: [WARNING ContainerRuntimeVersion]: You must update your container runtime to a version that supports the CRI method RuntimeConfig. Falling back to using cgroupDriver from kubelet conf?ig will be removed in 1.36. For more information, see https://git.k8s.io/enhancements/keps/sig-node/4033-group-driver-detection-over-cri" L13: "cluster.go:125: [preflight] The system verification failed. Printing the output from the verification:" L14: "cluster.go:125: ?[0;37mKERNEL_VERSION?[0m: ?[0;32m6.6.159-flatcar?[0m" L15: "cluster.go:125: ?[0;37mCONFIG_NAMESPACES?[0m: ?[0;32menabled?[0m" L16: "cluster.go:125: ?[0;37mCONFIG_NET_NS?[0m: ?[0;32menabled?[0m" L17: "cluster.go:125: ?[0;37mCONFIG_PID_NS?[0m: ?[0;32menabled?[0m" L18: "cluster.go:125: ?[0;37mCONFIG_IPC_NS?[0m: ?[0;32menabled?[0m" L19: "cluster.go:125: ?[0;37mCONFIG_UTS_NS?[0m: ?[0;32menabled?[0m" L20: "cluster.go:125: ?[0;37mCONFIG_CPUSETS?[0m: ?[0;32menabled?[0m" L21: "cluster.go:125: ?[0;37mCONFIG_MEMCG?[0m: ?[0;32menabled?[0m" L22: "cluster.go:125: ?[0;37mCONFIG_INET?[0m: ?[0;32menabled?[0m" L23: "cluster.go:125: ?[0;37mCONFIG_EXT4_FS?[0m: ?[0;32menabled (as module)?[0m" L24: "cluster.go:125: ?[0;37mCONFIG_PROC_FS?[0m: ?[0;32menabled?[0m" L25: "cluster.go:125: ?[0;37mCONFIG_NETFILTER_XT_TARGET_REDIRECT?[0m: ?[0;32menabled (as module)?[0m" L26: "cluster.go:125: ?[0;37mCONFIG_NETFILTER_XT_MATCH_COMMENT?[0m: ?[0;32menabled (as module)?[0m" L27: "cluster.go:125: ?[0;37mCONFIG_FAIR_GROUP_SCHED?[0m: ?[0;32menabled?[0m" L28: "cluster.go:125: ?[0;37mCONFIG_CGROUPS?[0m: ?[0;32menabled?[0m" L29: "cluster.go:125: ?[0;37mCONFIG_CGROUP_CPUACCT?[0m: ?[0;32menabled?[0m" L30: "cluster.go:125: ?[0;37mCONFIG_CGROUP_DEVICE?[0m: ?[0;32menabled?[0m" L31: "cluster.go:125: ?[0;37mCONFIG_CGROUP_FREEZER?[0m: ?[0;32menabled?[0m" L32: "cluster.go:125: ?[0;37mCONFIG_CGROUP_PIDS?[0m: ?[0;32menabled?[0m" L33: "cluster.go:125: ?[0;37mCONFIG_CGROUP_SCHED?[0m: ?[0;32menabled?[0m" L34: "cluster.go:125: ?[0;37mCONFIG_OVERLAY_FS?[0m: ?[0;32menabled (as module)?[0m" L35: "cluster.go:125: ?[0;37mCONFIG_AUFS_FS?[0m: ?[0;33mnot set - Required for aufs.?[0m" L36: "cluster.go:125: ?[0;37mCONFIG_BLK_DEV_DM?[0m: ?[0;32menabled (as module)?[0m" L37: "cluster.go:125: ?[0;37mCONFIG_CFS_BANDWIDTH?[0m: ?[0;32menabled?[0m" L38: "cluster.go:125: ?[0;37mCONFIG_SECCOMP?[0m: ?[0;32menabled?[0m" L39: "cluster.go:125: ?[0;37mCONFIG_SECCOMP_FILTER?[0m: ?[0;32menabled?[0m" L40: "cluster.go:125: ?[0;37mOS?[0m: ?[0;32mLinux?[0m" L41: "cluster.go:125: ?[0;37mCGROUPS_CPU?[0m: ?[0;32menabled?[0m" L42: "cluster.go:125: ?[0;37mCGROUPS_CPUACCT?[0m: ?[0;32menabled?[0m" L43: "cluster.go:125: ?[0;37mCGROUPS_CPUSET?[0m: ?[0;32menabled?[0m" L44: "cluster.go:125: ?[0;37mCGROUPS_DEVICES?[0m: ?[0;32menabled?[0m" L45: "cluster.go:125: ?[0;37mCGROUPS_FREEZER?[0m: ?[0;32menabled?[0m" L46: "cluster.go:125: ?[0;37mCGROUPS_MEMORY?[0m: ?[0;32menabled?[0m" L47: "cluster.go:125: ?[0;37mCGROUPS_PIDS?[0m: ?[0;32menabled?[0m" L48: "cluster.go:125: ?[0;37mCGROUPS_HUGETLB?[0m: ?[0;32menabled?[0m" L49: "cluster.go:125: ?[0;37mCGROUPS_BLKIO?[0m: ?[0;32menabled?[0m" L50: "cluster.go:125: [WARNING SystemVerification]: cgroups v1 support is deprecated and will be removed in a future release. Please migrate to cgroups v2. To explicitly enable cgroups v1 support for kubel?et v1.35 or newer, you must set the kubelet configuration option _FailCgroupV1_ to _false_. You must also explicitly skip this validation. For more information, see https://git.k8s.io/enhancements/kep?s/sig-node/5573-remove-cgroup-v1" L51: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.10--ffffb13b64__ could not be reached" L52: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.10--ffffb13b64__: lookup ci-4081.3.10--ffffb13b64 on 168.63.129.16:53: no such host" L53: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L54: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L55: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L56: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L57: "cluster.go:125: W1022 23:37:03.265310 2742 checks.go:906] detected that the sandbox image __registry.k8s.io/pause:3.8__ of the container runtime is inconsistent with that used by kubeadm. It is rec?ommended to use __registry.k8s.io/pause:3.10.1__ as the CRI sandbox image." L58: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L59: "cluster.go:125: [certs] Generating __ca__ certificate and key" L60: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L61: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [ci-4081.3.10--ffffb13b64 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local] and IPs [10.?96.0.1 10.0.0.5]" L62: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L63: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L64: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L65: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L66: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L67: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L68: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L69: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L70: "cluster.go:125: [certs] Generating __sa__ key and public key" L71: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L72: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L73: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L74: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L75: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L76: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L77: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L78: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L79: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L80: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L81: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L82: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__" L83: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__" L84: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L85: "cluster.go:125: [kubelet-start] Starting the kubelet" L86: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__" L87: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s" L88: "cluster.go:125: [kubelet-check] The kubelet is healthy after 1.001708926s" L89: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s" L90: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.5:6443/livez" L91: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz" L92: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez" L93: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 3.515540407s" L94: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 4.031363833s" L95: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 6.002069451s" L96: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace" L97: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster" L98: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs" L99: "cluster.go:125: [mark-control-plane] Marking the node ci-4081.3.10--ffffb13b64 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-lo?ad-balancers]" L100: "cluster.go:125: [mark-control-plane] Marking the node ci-4081.3.10--ffffb13b64 as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]" L101: "cluster.go:125: [bootstrap-token] Using token: uqojlg.lz8dqw8s5mqom4ou" L102: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles" L103: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes" L104: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials" L105: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token" L106: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster" L107: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace" L108: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key" L109: "cluster.go:125: [addons] Applied essential addon: CoreDNS" L110: "cluster.go:125: [addons] Applied essential addon: kube-proxy" L111: "cluster.go:125: " L112: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!" L113: "cluster.go:125: " L114: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:" L115: "cluster.go:125: " L116: "cluster.go:125: mkdir -p $HOME/.kube" L117: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config" L118: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config" L119: "cluster.go:125: " L120: "cluster.go:125: Alternatively, if you are the root user, you can run:" L121: "cluster.go:125: " L122: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf" L123: "cluster.go:125: " L124: "cluster.go:125: You should now deploy a pod network to the cluster." L125: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:" L126: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/" L127: "cluster.go:125: " L128: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:" L129: "cluster.go:125: " L130: "cluster.go:125: kubeadm join 10.0.0.5:6443 --token uqojlg.lz8dqw8s5mqom4ou _" L131: "cluster.go:125: --discovery-token-ca-cert-hash sha256:7fc42b81bba5c97bda016bde0a4f3f321f67d7ef63b1b471e992f611d439eb40 " L132: "cluster.go:125: namespace/tigera-operator created" L133: "cluster.go:125: serviceaccount/tigera-operator created" L134: "cluster.go:125: clusterrole.rbac.authorization.k8s.io/tigera-operator-secrets created" L135: "cluster.go:125: clusterrole.rbac.authorization.k8s.io/tigera-operator created" L136: "cluster.go:125: clusterrolebinding.rbac.authorization.k8s.io/tigera-operator created" L137: "cluster.go:125: rolebinding.rbac.authorization.k8s.io/tigera-operator-secrets created" L138: "cluster.go:125: deployment.apps/tigera-operator created" L139: "cluster.go:125: customresourcedefinition.apiextensions.k8s.io/installations.operator.tigera.io condition met" L140: "cluster.go:125: customresourcedefinition.apiextensions.k8s.io/installations.operator.tigera.io condition met" L141: "cluster.go:125: customresourcedefinition.apiextensions.k8s.io/apiservers.operator.tigera.io condition met" L142: "cluster.go:125: customresourcedefinition.apiextensions.k8s.io/apiservers.operator.tigera.io condition met" L143: "cluster.go:125: installation.operator.tigera.io/default created" L144: "cluster.go:125: apiserver.operator.tigera.io/default created" L145: "cluster.go:125: goldmane.operator.tigera.io/default created" L146: "cluster.go:125: whisker.operator.tigera.io/default created" L147: "kubeadm.go:197: unable to setup cluster: unable to create worker node: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kola-cluster-image-d500de4e9d/?providers/Microsoft.Compute/virtualMachines/ci-4081.3.10--41b3f8d9f2" L148: "--------------------------------------------------------------------------------" L149: "RESPONSE 409: 409 Conflict" L150: "ERROR CODE: OperationNotAllowed" L151: "--------------------------------------------------------------------------------" L152: "{" L153: "__error__: {" L154: "__code__: __OperationNotAllowed__," L155: "__message__: __Operation could not be completed as it results in exceeding approved standardDPLSv5Family Cores quota. Additional details - Deployment Model: Resource Manager, Location: westus2, Curren?t Limit: 65, Current Usage: 64, Additional Required: 2, (Minimum) New Limit Required: 66. Setup Alerts when Quota reaches threshold. Learn more at https://aka.ms/quotamonitoringalerting . Submit a req?uest for Quota increase at https://aka.ms/ProdportalCRP/#blade/Microsoft_Azure_Capacity/UsageAndQuota.ReactView/Parameters/%7B%22subscriptionId%22:%220e46bd28-a80f-4d3a-8200-d9eb8d80cb2e%22,%22command?%22:%22openQuotaApprovalBlade%22,%22quotas%22:[%7B%22location%22:%22westus2%22,%22providerId%22:%22Microsoft.Compute%22,%22resourceName%22:%22standardDPLSv5Family%22,%22quotaRequest%22:%7B%22propertie?s%22:%7B%22limit%22:66,%22unit%22:%22Count%22,%22name%22:%7B%22value%22:%22standardDPLSv5Family%22%7D%7D%7D%7D]%7D by specifying parameters listed in the ???Details??? section for deployment to succee?d. Please read more about quota limits at https://docs.microsoft.com/en-us/azure/azure-supportability/per-vm-quota-requests__" L156: "}" L157: "}" L158: "--------------------------------------------------------------------------------_" L159: " " ```
🟢 ok **kubeadm.v1.35.1.cilium.base**; Succeeded: azure (4); Failed: azure (1, 2, 3)
                Diagnostic output for azure, run 3 ``` L1: " Error: _cluster.go:125: I1023 00:03:52.319842 2371 version.go:260] remote version is much newer: v1.37.1; falling back to: stable-1.35" L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.35.9" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.35.9" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.35.9" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.35.9" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.13.1" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.1" L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.6-0" L9: "cluster.go:125: I1023 00:04:02.313863 2581 version.go:260] remote version is much newer: v1.37.1; falling back to: stable-1.35" L10: "cluster.go:125: [init] Using Kubernetes version: v1.35.9" L11: "cluster.go:125: [preflight] Running pre-flight checks" L12: "cluster.go:125: [WARNING ContainerRuntimeVersion]: You must update your container runtime to a version that supports the CRI method RuntimeConfig. Falling back to using cgroupDriver from kubelet conf?ig will be removed in 1.36. For more information, see https://git.k8s.io/enhancements/keps/sig-node/4033-group-driver-detection-over-cri" L13: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.10--2b0f918ddd__ could not be reached" L14: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.10--2b0f918ddd__: lookup ci-4081.3.10--2b0f918ddd on 168.63.129.16:53: no such host" L15: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L16: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L17: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L18: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L19: "cluster.go:125: W1023 00:04:02.558572 2581 checks.go:906] detected that the sandbox image __registry.k8s.io/pause:3.8__ of the container runtime is inconsistent with that used by kubeadm. It is rec?ommended to use __registry.k8s.io/pause:3.10.1__ as the CRI sandbox image." L20: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L21: "cluster.go:125: [certs] Generating __ca__ certificate and key" L22: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L23: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [ci-4081.3.10--2b0f918ddd kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local] and IPs [10.?96.0.1 10.0.0.10]" L24: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L25: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L26: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L27: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L28: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L29: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L30: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L31: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L32: "cluster.go:125: [certs] Generating __sa__ key and public key" L33: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L34: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L35: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L36: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L37: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L38: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L39: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L40: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L41: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L42: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L43: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L44: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__" L45: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__" L46: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L47: "cluster.go:125: [kubelet-start] Starting the kubelet" L48: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__" L49: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s" L50: "cluster.go:125: [kubelet-check] The kubelet is healthy after 1.001066127s" L51: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s" L52: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.10:6443/livez" L53: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz" L54: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez" L55: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 2.508533199s" L56: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 3.197133151s" L57: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 5.001661222s" L58: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace" L59: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster" L60: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs" L61: "cluster.go:125: [mark-control-plane] Marking the node ci-4081.3.10--2b0f918ddd as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-lo?ad-balancers]" L62: "cluster.go:125: [mark-control-plane] Marking the node ci-4081.3.10--2b0f918ddd as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]" L63: "cluster.go:125: [bootstrap-token] Using token: qhgmg7.oe1evffkuq2v9qyi" L64: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles" L65: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes" L66: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials" L67: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token" L68: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster" L69: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace" L70: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key" L71: "cluster.go:125: [addons] Applied essential addon: CoreDNS" L72: "cluster.go:125: [addons] Applied essential addon: kube-proxy" L73: "cluster.go:125: " L74: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!" L75: "cluster.go:125: " L76: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:" L77: "cluster.go:125: " L78: "cluster.go:125: mkdir -p $HOME/.kube" L79: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config" L80: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config" L81: "cluster.go:125: " L82: "cluster.go:125: Alternatively, if you are the root user, you can run:" L83: "cluster.go:125: " L84: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf" L85: "cluster.go:125: " L86: "cluster.go:125: You should now deploy a pod network to the cluster." L87: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:" L88: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/" L89: "cluster.go:125: " L90: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:" L91: "cluster.go:125: " L92: "cluster.go:125: kubeadm join 10.0.0.10:6443 --token qhgmg7.oe1evffkuq2v9qyi _" L93: "cluster.go:125: --discovery-token-ca-cert-hash sha256:1e80787b842a133d1cfebfab43429a07b9d8473237b90f71d203f25639d23c03 " L94: "cluster.go:125: i Using Cilium version 1.12.5" L95: "cluster.go:125: ? Auto-detected cluster name: kubernetes" L96: "cluster.go:125: ? Auto-detected datapath mode: tunnel" L97: "cluster.go:125: ? Auto-detected kube-proxy has been installed" L98: "cluster.go:125: i helm template --namespace kube-system cilium cilium/cilium --version 1.12.5 --set cluster.id=0,cluster.name=kubernetes,encryption.nodeEncryption=false,extraConfig.cluster-pool-ipv4-?cidr=192.168.0.0/17,extraConfig.enable-endpoint-routes=true,kubeProxyReplacement=disabled,operator.replicas=1,serviceAccounts.cilium.name=cilium,serviceAccounts.operator.name=cilium-operator,tunnel=vx?lan" L99: "cluster.go:125: i Storing helm values file in kube-system/cilium-cli-helm-values Secret" L100: "cluster.go:125: ? Created CA in secret cilium-ca" L101: "cluster.go:125: ? Generating certificates for Hubble..." L102: "cluster.go:125: ? Creating Service accounts..." L103: "cluster.go:125: ? Creating Cluster roles..." L104: "cluster.go:125: ? Creating ConfigMap for Cilium version 1.12.5..." L105: "cluster.go:125: i Manual overwrite in ConfigMap: enable-endpoint-routes=true" L106: "cluster.go:125: i Manual overwrite in ConfigMap: cluster-pool-ipv4-cidr=192.168.0.0/17" L107: "cluster.go:125: ? Creating Agent DaemonSet..." L108: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/mount-cgroup]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L109: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/apply-sysctl-overwrites]: deprecated since v1.30; use the ___appArmorProfile___ fi?eld instead__ subsys=klog" L110: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/clean-cilium-state]: deprecated since v1.30; use the ___appArmorProfile___ field i?nstead__ subsys=klog" L111: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/cilium-agent]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L112: "cluster.go:125: ? Creating Operator Deployment..." L113: "cluster.go:125: ? Waiting for Cilium to be installed and ready..." L114: "cluster.go:125: ? Cilium was successfully installed! Run _cilium status_ to view installation health" L115: "cluster.go:125: ?[33m /??_" L116: "cluster.go:125: ?[36m /???[33m___/?[32m??_?[0m Cilium: ?[32mOK?[0m" L117: "cluster.go:125: ?[36m ___?[31m/??_?[32m__/?[0m Operator: ?[32mOK?[0m" L118: "cluster.go:125: ?[32m /???[31m___/?[35m??_?[0m Hubble: ?[36mdisabled?[0m" L119: "cluster.go:125: ?[32m ___?[34m/??_?[35m__/?[0m ClusterMesh: ?[36mdisabled?[0m" L120: "cluster.go:125: ?[34m ___/" L121: "cluster.go:125: ?[0m" L122: "cluster.go:125: Deployment cilium-operator " L123: "cluster.go:125: DaemonSet cilium " L124: "cluster.go:125: Containers: cilium " L125: "cluster.go:125: cilium-operator " L126: "cluster.go:125: Cluster Pods: 0/0 managed by Cilium" L127: "cluster.go:125: W1023 00:05:48.551130 2244 joinconfiguration.go:112] [config] WARNING: Ignored configuration document with GroupVersionKind kubelet.config.k8s.io/v1beta1, Kind=KubeletConfiguration" L128: "cluster.go:125: [WARNING ContainerRuntimeVersion]: You must update your container runtime to a version that supports the CRI method RuntimeConfig. Falling back to using cgroupDriver from kubelet conf?ig will be removed in 1.36. For more information, see https://git.k8s.io/enhancements/keps/sig-node/4033-group-driver-detection-over-cri" L129: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L130: "cluster.go:125: jq: error (at                 Diagnostic output for azure, run 2 ``` L1: " Error: _cluster.go:125: I1022 23:54:06.901656 2399 version.go:260] remote version is much newer: v1.37.1; falling back to: stable-1.35" L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.35.9" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.35.9" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.35.9" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.35.9" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.13.1" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.1" L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.6-0" L9: "cluster.go:125: I1022 23:54:16.728158 2609 version.go:260] remote version is much newer: v1.37.1; falling back to: stable-1.35" L10: "cluster.go:125: [init] Using Kubernetes version: v1.35.9" L11: "cluster.go:125: [preflight] Running pre-flight checks" L12: "cluster.go:125: [WARNING ContainerRuntimeVersion]: You must update your container runtime to a version that supports the CRI method RuntimeConfig. Falling back to using cgroupDriver from kubelet conf?ig will be removed in 1.36. For more information, see https://git.k8s.io/enhancements/keps/sig-node/4033-group-driver-detection-over-cri" L13: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.10--7379cd3de2__ could not be reached" L14: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.10--7379cd3de2__: lookup ci-4081.3.10--7379cd3de2 on 168.63.129.16:53: no such host" L15: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L16: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L17: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L18: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L19: "cluster.go:125: W1022 23:54:16.915008 2609 checks.go:906] detected that the sandbox image __registry.k8s.io/pause:3.8__ of the container runtime is inconsistent with that used by kubeadm. It is rec?ommended to use __registry.k8s.io/pause:3.10.1__ as the CRI sandbox image." L20: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L21: "cluster.go:125: [certs] Generating __ca__ certificate and key" L22: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L23: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [ci-4081.3.10--7379cd3de2 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local] and IPs [10.?96.0.1 10.0.0.19]" L24: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L25: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L26: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L27: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L28: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L29: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L30: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L31: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L32: "cluster.go:125: [certs] Generating __sa__ key and public key" L33: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L34: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L35: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L36: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L37: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L38: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L39: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L40: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L41: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L42: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L43: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L44: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__" L45: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__" L46: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L47: "cluster.go:125: [kubelet-start] Starting the kubelet" L48: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__" L49: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s" L50: "cluster.go:125: [kubelet-check] The kubelet is healthy after 504.472128ms" L51: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s" L52: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.19:6443/livez" L53: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz" L54: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez" L55: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 3.011052951s" L56: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 3.457710708s" L57: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 5.501170579s" L58: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace" L59: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster" L60: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs" L61: "cluster.go:125: [mark-control-plane] Marking the node ci-4081.3.10--7379cd3de2 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-lo?ad-balancers]" L62: "cluster.go:125: [mark-control-plane] Marking the node ci-4081.3.10--7379cd3de2 as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]" L63: "cluster.go:125: [bootstrap-token] Using token: 9xqr0z.hk8v8vp3xsl4n60p" L64: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles" L65: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes" L66: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials" L67: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token" L68: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster" L69: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace" L70: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key" L71: "cluster.go:125: [addons] Applied essential addon: CoreDNS" L72: "cluster.go:125: [addons] Applied essential addon: kube-proxy" L73: "cluster.go:125: " L74: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!" L75: "cluster.go:125: " L76: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:" L77: "cluster.go:125: " L78: "cluster.go:125: mkdir -p $HOME/.kube" L79: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config" L80: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config" L81: "cluster.go:125: " L82: "cluster.go:125: Alternatively, if you are the root user, you can run:" L83: "cluster.go:125: " L84: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf" L85: "cluster.go:125: " L86: "cluster.go:125: You should now deploy a pod network to the cluster." L87: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:" L88: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/" L89: "cluster.go:125: " L90: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:" L91: "cluster.go:125: " L92: "cluster.go:125: kubeadm join 10.0.0.19:6443 --token 9xqr0z.hk8v8vp3xsl4n60p _" L93: "cluster.go:125: --discovery-token-ca-cert-hash sha256:376e6c64233a780602d47081bdadccb50c7c431e7a12344e272da4a7f41dfc72 " L94: "cluster.go:125: i Using Cilium version 1.12.5" L95: "cluster.go:125: ? Auto-detected cluster name: kubernetes" L96: "cluster.go:125: ? Auto-detected datapath mode: tunnel" L97: "cluster.go:125: ? Auto-detected kube-proxy has been installed" L98: "cluster.go:125: i helm template --namespace kube-system cilium cilium/cilium --version 1.12.5 --set cluster.id=0,cluster.name=kubernetes,encryption.nodeEncryption=false,extraConfig.cluster-pool-ipv4-?cidr=192.168.0.0/17,extraConfig.enable-endpoint-routes=true,kubeProxyReplacement=disabled,operator.replicas=1,serviceAccounts.cilium.name=cilium,serviceAccounts.operator.name=cilium-operator,tunnel=vx?lan" L99: "cluster.go:125: i Storing helm values file in kube-system/cilium-cli-helm-values Secret" L100: "cluster.go:125: ? Created CA in secret cilium-ca" L101: "cluster.go:125: ? Generating certificates for Hubble..." L102: "cluster.go:125: ? Creating Service accounts..." L103: "cluster.go:125: ? Creating Cluster roles..." L104: "cluster.go:125: ? Creating ConfigMap for Cilium version 1.12.5..." L105: "cluster.go:125: i Manual overwrite in ConfigMap: enable-endpoint-routes=true" L106: "cluster.go:125: i Manual overwrite in ConfigMap: cluster-pool-ipv4-cidr=192.168.0.0/17" L107: "cluster.go:125: ? Creating Agent DaemonSet..." L108: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/mount-cgroup]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L109: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/apply-sysctl-overwrites]: deprecated since v1.30; use the ___appArmorProfile___ fi?eld instead__ subsys=klog" L110: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/clean-cilium-state]: deprecated since v1.30; use the ___appArmorProfile___ field i?nstead__ subsys=klog" L111: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/cilium-agent]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L112: "cluster.go:125: ? Creating Operator Deployment..." L113: "cluster.go:125: ? Waiting for Cilium to be installed and ready..." L114: "cluster.go:125: ? Cilium was successfully installed! Run _cilium status_ to view installation health" L115: "cluster.go:125: ?[33m /??_" L116: "cluster.go:125: ?[36m /???[33m___/?[32m??_?[0m Cilium: ?[32mOK?[0m" L117: "cluster.go:125: ?[36m ___?[31m/??_?[32m__/?[0m Operator: ?[32mOK?[0m" L118: "cluster.go:125: ?[32m /???[31m___/?[35m??_?[0m Hubble: ?[36mdisabled?[0m" L119: "cluster.go:125: ?[32m ___?[34m/??_?[35m__/?[0m ClusterMesh: ?[36mdisabled?[0m" L120: "cluster.go:125: ?[34m ___/" L121: "cluster.go:125: ?[0m" L122: "cluster.go:125: Deployment cilium-operator " L123: "cluster.go:125: DaemonSet cilium " L124: "cluster.go:125: Containers: cilium " L125: "cluster.go:125: cilium-operator " L126: "cluster.go:125: Cluster Pods: 0/0 managed by Cilium" L127: "kubeadm.go:197: unable to setup cluster: unable to create worker node: PollUntilDone(ci-4081.3.10--8a5042f1c1): GET https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/prov?iders/Microsoft.Compute/locations/westus2/operations/7bb363ac-9a8a-4354-8711-c817c8e0703a" L128: "--------------------------------------------------------------------------------" L129: "RESPONSE 200: 200 OK" L130: "ERROR CODE: OperationPreempted" L131: "--------------------------------------------------------------------------------" L132: "{" L133: "__startTime__: __2026-10-22T23:54:32.4818237+00:00__," L134: "__endTime__: __2026-10-22T23:55:41.3859181+00:00__," L135: "__status__: __Canceled__," L136: "__error__: {" L137: "__code__: __OperationPreempted__," L138: "__message__: __Operation execution has been preempted by a more recent operation.__" L139: "}," L140: "__name__: __7bb363ac-9a8a-4354-8711-c817c8e0703a__" L141: "}" L142: "--------------------------------------------------------------------------------_" L143: " " ```                 Diagnostic output for azure, run 1 ``` L1: " Error: _kubeadm.go:197: unable to setup cluster: unable to create master node: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kola-cluster-image-d50?0de4e9d/providers/Microsoft.Compute/virtualMachines/ci-4081.3.10--43b3b1bb70" L2: "--------------------------------------------------------------------------------" L3: "RESPONSE 409: 409 Conflict" L4: "ERROR CODE: OperationNotAllowed" L5: "--------------------------------------------------------------------------------" L6: "{" L7: "__error__: {" L8: "__code__: __OperationNotAllowed__," L9: "__message__: __Operation could not be completed as it results in exceeding approved standardDPLSv5Family Cores quota. Additional details - Deployment Model: Resource Manager, Location: westus2, Curren?t Limit: 65, Current Usage: 64, Additional Required: 2, (Minimum) New Limit Required: 66. Setup Alerts when Quota reaches threshold. Learn more at https://aka.ms/quotamonitoringalerting . Submit a req?uest for Quota increase at https://aka.ms/ProdportalCRP/#blade/Microsoft_Azure_Capacity/UsageAndQuota.ReactView/Parameters/%7B%22subscriptionId%22:%220e46bd28-a80f-4d3a-8200-d9eb8d80cb2e%22,%22command?%22:%22openQuotaApprovalBlade%22,%22quotas%22:[%7B%22location%22:%22westus2%22,%22providerId%22:%22Microsoft.Compute%22,%22resourceName%22:%22standardDPLSv5Family%22,%22quotaRequest%22:%7B%22propertie?s%22:%7B%22limit%22:66,%22unit%22:%22Count%22,%22name%22:%7B%22value%22:%22standardDPLSv5Family%22%7D%7D%7D%7D]%7D by specifying parameters listed in the ???Details??? section for deployment to succee?d. Please read more about quota limits at https://docs.microsoft.com/en-us/azure/azure-supportability/per-vm-quota-requests__" L10: "}" L11: "}" L12: "--------------------------------------------------------------------------------_" L13: " " ```
🟢 ok **kubeadm.v1.35.1.cilium.cgroupv1.base**; Succeeded: azure (1) 🟢 ok **kubeadm.v1.35.1.flannel.base**; Succeeded: azure (1) 🟢 ok **kubeadm.v1.35.1.flannel.cgroupv1.base**; Succeeded: azure (1) 🟢 ok **kubeadm.v1.36.1.calico.base**; Succeeded: azure (3); Failed: azure (1, 2)
                Diagnostic output for azure, run 2 ``` L1: " Error: _cluster.go:125: I1022 23:54:06.773197 2391 version.go:260] remote version is much newer: v1.37.1; falling back to: stable-1.36" L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.36.5" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.36.5" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.36.5" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.36.5" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.14.2" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.2" L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.8-0" L9: "cluster.go:125: I1022 23:54:16.937103 2688 version.go:260] remote version is much newer: v1.37.1; falling back to: stable-1.36" L10: "cluster.go:125: [init] Using Kubernetes version: v1.36.5" L11: "cluster.go:125: [preflight] Running pre-flight checks" L12: "cluster.go:125: E1022 23:54:16.989429 2688 remote_runtime.go:1177] __RuntimeConfig from runtime service failed__ err=__rpc error: code = Unimplemented desc = unknown method RuntimeConfig for servic?e runtime.v1.RuntimeService__" L13: "cluster.go:125: [WARNING ContainerRuntimeVersion]: You must update your container runtime to a version that supports the CRI method RuntimeConfig. Falling back to using cgroupDriver from kubelet conf?ig will be removed in 1.37. For more information, see https://git.k8s.io/enhancements/keps/sig-node/4033-group-driver-detection-over-cri" L14: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.10--3e80436509__ could not be reached" L15: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.10--3e80436509__: lookup ci-4081.3.10--3e80436509 on 168.63.129.16:53: no such host" L16: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L17: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L18: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L19: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L20: "cluster.go:125: W1022 23:54:17.116151 2688 checks.go:907] detected that the sandbox image __registry.k8s.io/pause:3.8__ of the container runtime is inconsistent with that used by kubeadm. It is rec?ommended to use __registry.k8s.io/pause:3.10.2__ as the CRI sandbox image." L21: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L22: "cluster.go:125: [certs] Generating __ca__ certificate and key" L23: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L24: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [ci-4081.3.10--3e80436509 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local] and IPs [10.?96.0.1 10.0.0.20]" L25: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L26: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L27: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L28: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L29: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L30: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L31: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L32: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L33: "cluster.go:125: [certs] Generating __sa__ key and public key" L34: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L35: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L36: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L37: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L38: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L39: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L40: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L41: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L42: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L43: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L44: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L45: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__" L46: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__" L47: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L48: "cluster.go:125: [kubelet-start] Starting the kubelet" L49: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__" L50: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s" L51: "cluster.go:125: [kubelet-check] The kubelet is healthy after 561.481??s" L52: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s" L53: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.20:6443/livez" L54: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz" L55: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez" L56: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 14.168331ms" L57: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 19.269135ms" L58: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 2.003296983s" L59: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace" L60: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster" L61: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs" L62: "cluster.go:125: [mark-control-plane] Marking the node ci-4081.3.10--3e80436509 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-lo?ad-balancers]" L63: "cluster.go:125: [mark-control-plane] Marking the node ci-4081.3.10--3e80436509 as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]" L64: "cluster.go:125: [bootstrap-token] Using token: 1yl2fj.jsdsz4lp26yvr4hf" L65: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles" L66: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes" L67: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials" L68: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token" L69: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster" L70: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the API server kubelet client certificate to access the kubelet API" L71: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace" L72: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key" L73: "cluster.go:125: [addons] Applied essential addon: CoreDNS" L74: "cluster.go:125: [addons] Applied essential addon: kube-proxy" L75: "cluster.go:125: " L76: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!" L77: "cluster.go:125: " L78: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:" L79: "cluster.go:125: " L80: "cluster.go:125: mkdir -p $HOME/.kube" L81: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config" L82: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config" L83: "cluster.go:125: " L84: "cluster.go:125: Alternatively, if you are the root user, you can run:" L85: "cluster.go:125: " L86: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf" L87: "cluster.go:125: " L88: "cluster.go:125: You should now deploy a pod network to the cluster." L89: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:" L90: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/" L91: "cluster.go:125: " L92: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:" L93: "cluster.go:125: " L94: "cluster.go:125: kubeadm join 10.0.0.20:6443 --token 1yl2fj.jsdsz4lp26yvr4hf _" L95: "cluster.go:125: --discovery-token-ca-cert-hash sha256:18f043291a84708aaf39d2e6be1de5d62f7cd0a95a913f237ddb8115b099d393 " L96: "cluster.go:125: namespace/tigera-operator created" L97: "cluster.go:125: serviceaccount/tigera-operator created" L98: "cluster.go:125: clusterrole.rbac.authorization.k8s.io/tigera-operator-secrets created" L99: "cluster.go:125: clusterrole.rbac.authorization.k8s.io/tigera-operator created" L100: "cluster.go:125: clusterrolebinding.rbac.authorization.k8s.io/tigera-operator created" L101: "cluster.go:125: rolebinding.rbac.authorization.k8s.io/tigera-operator-secrets created" L102: "cluster.go:125: deployment.apps/tigera-operator created" L103: "cluster.go:125: customresourcedefinition.apiextensions.k8s.io/installations.operator.tigera.io condition met" L104: "cluster.go:125: customresourcedefinition.apiextensions.k8s.io/installations.operator.tigera.io condition met" L105: "cluster.go:125: customresourcedefinition.apiextensions.k8s.io/apiservers.operator.tigera.io condition met" L106: "cluster.go:125: customresourcedefinition.apiextensions.k8s.io/apiservers.operator.tigera.io condition met" L107: "cluster.go:125: installation.operator.tigera.io/default created" L108: "cluster.go:125: apiserver.operator.tigera.io/default created" L109: "cluster.go:125: goldmane.operator.tigera.io/default created" L110: "cluster.go:125: whisker.operator.tigera.io/default created" L111: "kubeadm.go:197: unable to setup cluster: unable to create worker node: PollUntilDone(ci-4081.3.10--cea1aff52c): GET https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/prov?iders/Microsoft.Compute/locations/westus2/operations/10751385-fd24-426b-923c-1fa6a4038157" L112: "--------------------------------------------------------------------------------" L113: "RESPONSE 200: 200 OK" L114: "ERROR CODE: OperationPreempted" L115: "--------------------------------------------------------------------------------" L116: "{" L117: "__startTime__: __2026-10-22T23:54:48.2859363+00:00__," L118: "__endTime__: __2026-10-22T23:55:41.2775469+00:00__," L119: "__status__: __Canceled__," L120: "__error__: {" L121: "__code__: __OperationPreempted__," L122: "__message__: __Operation execution has been preempted by a more recent operation.__" L123: "}," L124: "__name__: __10751385-fd24-426b-923c-1fa6a4038157__" L125: "}" L126: "--------------------------------------------------------------------------------_" L127: " " ```                 Diagnostic output for azure, run 1 ``` L1: " Error: _cluster.go:125: I1022 23:39:00.956643 2371 version.go:260] remote version is much newer: v1.37.1; falling back to: stable-1.36" L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.36.5" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.36.5" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.36.5" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.36.5" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.14.2" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.2" L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.8-0" L9: "cluster.go:125: I1022 23:39:10.579094 2602 version.go:260] remote version is much newer: v1.37.1; falling back to: stable-1.36" L10: "cluster.go:125: [init] Using Kubernetes version: v1.36.5" L11: "cluster.go:125: [preflight] Running pre-flight checks" L12: "cluster.go:125: E1022 23:39:10.625442 2602 remote_runtime.go:1177] __RuntimeConfig from runtime service failed__ err=__rpc error: code = Unimplemented desc = unknown method RuntimeConfig for servic?e runtime.v1.RuntimeService__" L13: "cluster.go:125: [WARNING ContainerRuntimeVersion]: You must update your container runtime to a version that supports the CRI method RuntimeConfig. Falling back to using cgroupDriver from kubelet conf?ig will be removed in 1.37. For more information, see https://git.k8s.io/enhancements/keps/sig-node/4033-group-driver-detection-over-cri" L14: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.10--9db7075790__ could not be reached" L15: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.10--9db7075790__: lookup ci-4081.3.10--9db7075790 on 168.63.129.16:53: no such host" L16: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L17: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L18: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L19: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L20: "cluster.go:125: W1022 23:39:10.823792 2602 checks.go:907] detected that the sandbox image __registry.k8s.io/pause:3.8__ of the container runtime is inconsistent with that used by kubeadm. It is rec?ommended to use __registry.k8s.io/pause:3.10.2__ as the CRI sandbox image." L21: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L22: "cluster.go:125: [certs] Generating __ca__ certificate and key" L23: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L24: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [ci-4081.3.10--9db7075790 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local] and IPs [10.?96.0.1 10.0.0.32]" L25: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L26: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L27: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L28: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L29: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L30: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L31: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L32: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L33: "cluster.go:125: [certs] Generating __sa__ key and public key" L34: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L35: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L36: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L37: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L38: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L39: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L40: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L41: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L42: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L43: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L44: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L45: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__" L46: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__" L47: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L48: "cluster.go:125: [kubelet-start] Starting the kubelet" L49: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__" L50: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s" L51: "cluster.go:125: [kubelet-check] The kubelet is healthy after 2.085679ms" L52: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s" L53: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.32:6443/livez" L54: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz" L55: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez" L56: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 11.06292ms" L57: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 17.987879ms" L58: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 2.0017437s" L59: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace" L60: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster" L61: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs" L62: "cluster.go:125: [mark-control-plane] Marking the node ci-4081.3.10--9db7075790 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-lo?ad-balancers]" L63: "cluster.go:125: [mark-control-plane] Marking the node ci-4081.3.10--9db7075790 as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]" L64: "cluster.go:125: [bootstrap-token] Using token: 6ldi3z.ptvn9vt6t0755jlc" L65: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles" L66: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes" L67: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials" L68: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token" L69: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster" L70: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the API server kubelet client certificate to access the kubelet API" L71: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace" L72: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key" L73: "cluster.go:125: [addons] Applied essential addon: CoreDNS" L74: "cluster.go:125: [addons] Applied essential addon: kube-proxy" L75: "cluster.go:125: " L76: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!" L77: "cluster.go:125: " L78: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:" L79: "cluster.go:125: " L80: "cluster.go:125: mkdir -p $HOME/.kube" L81: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config" L82: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config" L83: "cluster.go:125: " L84: "cluster.go:125: Alternatively, if you are the root user, you can run:" L85: "cluster.go:125: " L86: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf" L87: "cluster.go:125: " L88: "cluster.go:125: You should now deploy a pod network to the cluster." L89: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:" L90: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/" L91: "cluster.go:125: " L92: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:" L93: "cluster.go:125: " L94: "cluster.go:125: kubeadm join 10.0.0.32:6443 --token 6ldi3z.ptvn9vt6t0755jlc _" L95: "cluster.go:125: --discovery-token-ca-cert-hash sha256:d8022a9a7b56b8860d32b4a91a99c1a2015b3d798e7f1ca5a1aab83a9bb305cd " L96: "cluster.go:125: namespace/tigera-operator created" L97: "cluster.go:125: serviceaccount/tigera-operator created" L98: "cluster.go:125: clusterrole.rbac.authorization.k8s.io/tigera-operator-secrets created" L99: "cluster.go:125: clusterrole.rbac.authorization.k8s.io/tigera-operator created" L100: "cluster.go:125: clusterrolebinding.rbac.authorization.k8s.io/tigera-operator created" L101: "cluster.go:125: rolebinding.rbac.authorization.k8s.io/tigera-operator-secrets created" L102: "cluster.go:125: deployment.apps/tigera-operator created" L103: "cluster.go:125: customresourcedefinition.apiextensions.k8s.io/installations.operator.tigera.io condition met" L104: "cluster.go:125: customresourcedefinition.apiextensions.k8s.io/installations.operator.tigera.io condition met" L105: "cluster.go:125: customresourcedefinition.apiextensions.k8s.io/apiservers.operator.tigera.io condition met" L106: "cluster.go:125: customresourcedefinition.apiextensions.k8s.io/apiservers.operator.tigera.io condition met" L107: "cluster.go:125: installation.operator.tigera.io/default created" L108: "cluster.go:125: apiserver.operator.tigera.io/default created" L109: "cluster.go:125: goldmane.operator.tigera.io/default created" L110: "cluster.go:125: whisker.operator.tigera.io/default created" L111: "cluster.go:125: W1022 23:41:12.123030 2254 joinconfiguration.go:112] [config] WARNING: Ignored configuration document with GroupVersionKind kubelet.config.k8s.io/v1beta1, Kind=KubeletConfiguration" L112: "cluster.go:125: E1022 23:41:12.131406 2254 remote_runtime.go:1177] __RuntimeConfig from runtime service failed__ err=__rpc error: code = Unimplemented desc = unknown method RuntimeConfig for servic?e runtime.v1.RuntimeService__" L113: "cluster.go:125: [WARNING ContainerRuntimeVersion]: You must update your container runtime to a version that supports the CRI method RuntimeConfig. Falling back to using cgroupDriver from kubelet conf?ig will be removed in 1.37. For more information, see https://git.k8s.io/enhancements/keps/sig-node/4033-group-driver-detection-over-cri" L114: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L115: "cluster.go:125: W1022 23:41:12.282750 2254 utils.go:69] The recommended value for __bindAddress__ in __KubeProxyConfiguration__ is: ::; the provided value is: 0.0.0.0" L116: "cluster.go:125: jq: error (at 🟢 ok **kubeadm.v1.36.1.cilium.base**; Succeeded: azure (1) 🟢 ok **kubeadm.v1.36.1.flannel.base**; Succeeded: azure (3); Failed: azure (1, 2)
                Diagnostic output for azure, run 2 ``` L1: " Error: _cluster.go:125: I1022 23:54:00.410703 2358 version.go:260] remote version is much newer: v1.37.1; falling back to: stable-1.36" L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.36.5" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.36.5" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.36.5" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.36.5" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.14.2" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.2" L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.8-0" L9: "cluster.go:125: I1022 23:54:10.649440 2590 version.go:260] remote version is much newer: v1.37.1; falling back to: stable-1.36" L10: "cluster.go:125: [init] Using Kubernetes version: v1.36.5" L11: "cluster.go:125: [preflight] Running pre-flight checks" L12: "cluster.go:125: E1022 23:54:10.693891 2590 remote_runtime.go:1177] __RuntimeConfig from runtime service failed__ err=__rpc error: code = Unimplemented desc = unknown method RuntimeConfig for servic?e runtime.v1.RuntimeService__" L13: "cluster.go:125: [WARNING ContainerRuntimeVersion]: You must update your container runtime to a version that supports the CRI method RuntimeConfig. Falling back to using cgroupDriver from kubelet conf?ig will be removed in 1.37. For more information, see https://git.k8s.io/enhancements/keps/sig-node/4033-group-driver-detection-over-cri" L14: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.10--39c2ab6095__ could not be reached" L15: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.10--39c2ab6095__: lookup ci-4081.3.10--39c2ab6095 on 168.63.129.16:53: no such host" L16: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L17: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L18: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L19: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L20: "cluster.go:125: W1022 23:54:10.995060 2590 checks.go:907] detected that the sandbox image __registry.k8s.io/pause:3.8__ of the container runtime is inconsistent with that used by kubeadm. It is rec?ommended to use __registry.k8s.io/pause:3.10.2__ as the CRI sandbox image." L21: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L22: "cluster.go:125: [certs] Generating __ca__ certificate and key" L23: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L24: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [ci-4081.3.10--39c2ab6095 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local] and IPs [10.?96.0.1 10.0.0.15]" L25: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L26: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L27: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L28: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L29: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L30: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L31: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L32: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L33: "cluster.go:125: [certs] Generating __sa__ key and public key" L34: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L35: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L36: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L37: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L38: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L39: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L40: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L41: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L42: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L43: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L44: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L45: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__" L46: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__" L47: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L48: "cluster.go:125: [kubelet-start] Starting the kubelet" L49: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__" L50: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s" L51: "cluster.go:125: [kubelet-check] The kubelet is healthy after 517.962??s" L52: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s" L53: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.15:6443/livez" L54: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz" L55: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez" L56: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 12.888115ms" L57: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 13.321036ms" L58: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 1.501071081s" L59: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace" L60: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster" L61: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs" L62: "cluster.go:125: [mark-control-plane] Marking the node ci-4081.3.10--39c2ab6095 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-lo?ad-balancers]" L63: "cluster.go:125: [mark-control-plane] Marking the node ci-4081.3.10--39c2ab6095 as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]" L64: "cluster.go:125: [bootstrap-token] Using token: i77dsk.tv011wc9ne8p9j3c" L65: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles" L66: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes" L67: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials" L68: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token" L69: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster" L70: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the API server kubelet client certificate to access the kubelet API" L71: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace" L72: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key" L73: "cluster.go:125: [addons] Applied essential addon: CoreDNS" L74: "cluster.go:125: [addons] Applied essential addon: kube-proxy" L75: "cluster.go:125: " L76: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!" L77: "cluster.go:125: " L78: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:" L79: "cluster.go:125: " L80: "cluster.go:125: mkdir -p $HOME/.kube" L81: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config" L82: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config" L83: "cluster.go:125: " L84: "cluster.go:125: Alternatively, if you are the root user, you can run:" L85: "cluster.go:125: " L86: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf" L87: "cluster.go:125: " L88: "cluster.go:125: You should now deploy a pod network to the cluster." L89: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:" L90: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/" L91: "cluster.go:125: " L92: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:" L93: "cluster.go:125: " L94: "cluster.go:125: kubeadm join 10.0.0.15:6443 --token i77dsk.tv011wc9ne8p9j3c _" L95: "cluster.go:125: --discovery-token-ca-cert-hash sha256:b7c1bbc44e8bd2da44cf9ba7b013bcdb9702d330e12fbcd45e49492d1b42ee09 " L96: "cluster.go:125: namespace/kube-flannel created" L97: "cluster.go:125: clusterrole.rbac.authorization.k8s.io/flannel created" L98: "cluster.go:125: clusterrolebinding.rbac.authorization.k8s.io/flannel created" L99: "cluster.go:125: serviceaccount/flannel created" L100: "cluster.go:125: configmap/kube-flannel-cfg created" L101: "cluster.go:125: daemonset.apps/kube-flannel-ds created" L102: "kubeadm.go:197: unable to setup cluster: unable to create worker node: PollUntilDone(ci-4081.3.10--237517c9e3): GET https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/prov?iders/Microsoft.Compute/locations/westus2/operations/5689cf72-99a9-4656-bcb3-e0ae4cdc07af" L103: "--------------------------------------------------------------------------------" L104: "RESPONSE 200: 200 OK" L105: "ERROR CODE: OperationPreempted" L106: "--------------------------------------------------------------------------------" L107: "{" L108: "__startTime__: __2026-10-22T23:54:26.3891753+00:00__," L109: "__endTime__: __2026-10-22T23:55:48.269939+00:00__," L110: "__status__: __Canceled__," L111: "__error__: {" L112: "__code__: __OperationPreempted__," L113: "__message__: __Operation execution has been preempted by a more recent operation.__" L114: "}," L115: "__name__: __5689cf72-99a9-4656-bcb3-e0ae4cdc07af__" L116: "}" L117: "--------------------------------------------------------------------------------_" L118: " " ```                 Diagnostic output for azure, run 1 ``` L1: " Error: _kubeadm.go:197: unable to setup cluster: unable to create etcd node: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kola-cluster-image-d500d?e4e9d/providers/Microsoft.Compute/virtualMachines/ci-4081.3.10--b94b93818c" L2: "--------------------------------------------------------------------------------" L3: "RESPONSE 409: 409 Conflict" L4: "ERROR CODE: OperationNotAllowed" L5: "--------------------------------------------------------------------------------" L6: "{" L7: "__error__: {" L8: "__code__: __OperationNotAllowed__," L9: "__message__: __Operation could not be completed as it results in exceeding approved standardDPLSv5Family Cores quota. Additional details - Deployment Model: Resource Manager, Location: westus2, Curren?t Limit: 65, Current Usage: 64, Additional Required: 2, (Minimum) New Limit Required: 66. Setup Alerts when Quota reaches threshold. Learn more at https://aka.ms/quotamonitoringalerting . Submit a req?uest for Quota increase at https://aka.ms/ProdportalCRP/#blade/Microsoft_Azure_Capacity/UsageAndQuota.ReactView/Parameters/%7B%22subscriptionId%22:%220e46bd28-a80f-4d3a-8200-d9eb8d80cb2e%22,%22command?%22:%22openQuotaApprovalBlade%22,%22quotas%22:[%7B%22location%22:%22westus2%22,%22providerId%22:%22Microsoft.Compute%22,%22resourceName%22:%22standardDPLSv5Family%22,%22quotaRequest%22:%7B%22propertie?s%22:%7B%22limit%22:66,%22unit%22:%22Count%22,%22name%22:%7B%22value%22:%22standardDPLSv5Family%22%7D%7D%7D%7D]%7D by specifying parameters listed in the ???Details??? section for deployment to succee?d. Please read more about quota limits at https://docs.microsoft.com/en-us/azure/azure-supportability/per-vm-quota-requests__" L10: "}" L11: "}" L12: "--------------------------------------------------------------------------------_" L13: " " ```
🟢 ok **kubeadm.v1.37.0.calico.base**; Succeeded: azure (1) 🟢 ok **kubeadm.v1.37.0.cilium.base**; Succeeded: azure (3); Failed: azure (1, 2)
                Diagnostic output for azure, run 2 ``` L1: " Error: _cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.37.1" L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.37.1" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.37.1" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.37.1" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.14.6" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.2" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.7.0-0" L8: "cluster.go:125: [init] Using Kubernetes version: v1.37.1" L9: "cluster.go:125: [preflight] Running pre-flight checks" L10: "cluster.go:125: E1022 23:54:16.847769 2578 remote_runtime.go:1359] __RuntimeConfig from runtime service failed__ err=__rpc error: code = Unimplemented desc = unknown method RuntimeConfig for servic?e runtime.v1.RuntimeService__" L11: "cluster.go:125: [WARNING ContainerRuntimeVersion]: You must update your container runtime to a version that supports the CRI method RuntimeConfig. Falling back to using cgroupDriver from kubelet conf?ig will be removed in 1.38. For more information, see https://git.k8s.io/enhancements/keps/sig-node/4033-group-driver-detection-over-cri" L12: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.10--bb30aa5af5__ could not be reached" L13: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.10--bb30aa5af5__: lookup ci-4081.3.10--bb30aa5af5 on 168.63.129.16:53: no such host" L14: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L15: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L16: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L17: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L18: "cluster.go:125: W1022 23:54:16.965500 2578 checks.go:920] detected that the sandbox image __registry.k8s.io/pause:3.8__ of the container runtime is inconsistent with that used by kubeadm. It is rec?ommended to use __registry.k8s.io/pause:3.10.2__ as the CRI sandbox image." L19: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L20: "cluster.go:125: [certs] Generating __ca__ certificate and key" L21: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L22: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [ci-4081.3.10--bb30aa5af5 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local] and IPs [10.?96.0.1 10.0.0.17]" L23: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L24: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L25: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L26: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L27: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L28: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L29: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L30: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L31: "cluster.go:125: [certs] Generating __sa__ key and public key" L32: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L33: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L34: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L35: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L36: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L37: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L38: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L39: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L40: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L41: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L42: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L43: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__" L44: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__" L45: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L46: "cluster.go:125: [kubelet-start] Starting the kubelet" L47: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__" L48: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s" L49: "cluster.go:125: [kubelet-check] The kubelet is healthy after 602.84??s" L50: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s" L51: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.17:6443/livez" L52: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz" L53: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez" L54: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 8.435799ms" L55: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 10.246119ms" L56: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 2.003119326s" L57: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace" L58: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster" L59: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs" L60: "cluster.go:125: [mark-control-plane] Marking the node ci-4081.3.10--bb30aa5af5 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-lo?ad-balancers]" L61: "cluster.go:125: [mark-control-plane] Marking the node ci-4081.3.10--bb30aa5af5 as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]" L62: "cluster.go:125: [bootstrap-token] Using token: zxxvpg.a1i6osp8kofl2630" L63: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles" L64: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes" L65: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials" L66: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token" L67: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster" L68: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the API server kubelet client certificate to access the kubelet API" L69: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace" L70: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key" L71: "cluster.go:125: [addons] Applied essential addon: CoreDNS" L72: "cluster.go:125: [addons] Applied essential addon: kube-proxy" L73: "cluster.go:125: " L74: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!" L75: "cluster.go:125: " L76: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:" L77: "cluster.go:125: " L78: "cluster.go:125: mkdir -p $HOME/.kube" L79: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config" L80: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config" L81: "cluster.go:125: " L82: "cluster.go:125: Alternatively, if you are the root user, you can run:" L83: "cluster.go:125: " L84: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf" L85: "cluster.go:125: " L86: "cluster.go:125: You should now deploy a pod network to the cluster." L87: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:" L88: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/" L89: "cluster.go:125: " L90: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:" L91: "cluster.go:125: " L92: "cluster.go:125: kubeadm join 10.0.0.17:6443 --token zxxvpg.a1i6osp8kofl2630 _" L93: "cluster.go:125: --discovery-token-ca-cert-hash sha256:7130d0e3fbb58a175e6360be03144a6b149f9b9cf2eaddc43ab0e245f52ce8ef " L94: "cluster.go:125: i Using Cilium version 1.12.5" L95: "cluster.go:125: ? Auto-detected cluster name: kubernetes" L96: "cluster.go:125: ? Auto-detected datapath mode: tunnel" L97: "cluster.go:125: ? Auto-detected kube-proxy has been installed" L98: "cluster.go:125: i helm template --namespace kube-system cilium cilium/cilium --version 1.12.5 --set cluster.id=0,cluster.name=kubernetes,encryption.nodeEncryption=false,extraConfig.cluster-pool-ipv4-?cidr=192.168.0.0/17,extraConfig.enable-endpoint-routes=true,kubeProxyReplacement=disabled,operator.replicas=1,serviceAccounts.cilium.name=cilium,serviceAccounts.operator.name=cilium-operator,tunnel=vx?lan" L99: "cluster.go:125: i Storing helm values file in kube-system/cilium-cli-helm-values Secret" L100: "cluster.go:125: ? Created CA in secret cilium-ca" L101: "cluster.go:125: ? Generating certificates for Hubble..." L102: "cluster.go:125: ? Creating Service accounts..." L103: "cluster.go:125: ? Creating Cluster roles..." L104: "cluster.go:125: ? Creating ConfigMap for Cilium version 1.12.5..." L105: "cluster.go:125: i Manual overwrite in ConfigMap: enable-endpoint-routes=true" L106: "cluster.go:125: i Manual overwrite in ConfigMap: cluster-pool-ipv4-cidr=192.168.0.0/17" L107: "cluster.go:125: ? Creating Agent DaemonSet..." L108: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/mount-cgroup]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L109: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/apply-sysctl-overwrites]: deprecated since v1.30; use the ___appArmorProfile___ fi?eld instead__ subsys=klog" L110: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/clean-cilium-state]: deprecated since v1.30; use the ___appArmorProfile___ field i?nstead__ subsys=klog" L111: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/cilium-agent]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L112: "cluster.go:125: ? Creating Operator Deployment..." L113: "cluster.go:125: ? Waiting for Cilium to be installed and ready..." L114: "cluster.go:125: ? Cilium was successfully installed! Run _cilium status_ to view installation health" L115: "cluster.go:125: ?[33m /??_" L116: "cluster.go:125: ?[36m /???[33m___/?[32m??_?[0m Cilium: ?[32mOK?[0m" L117: "cluster.go:125: ?[36m ___?[31m/??_?[32m__/?[0m Operator: ?[32mOK?[0m" L118: "cluster.go:125: ?[32m /???[31m___/?[35m??_?[0m Hubble: ?[36mdisabled?[0m" L119: "cluster.go:125: ?[32m ___?[34m/??_?[35m__/?[0m ClusterMesh: ?[36mdisabled?[0m" L120: "cluster.go:125: ?[34m ___/" L121: "cluster.go:125: ?[0m" L122: "cluster.go:125: Deployment cilium-operator " L123: "cluster.go:125: DaemonSet cilium " L124: "cluster.go:125: Containers: cilium " L125: "cluster.go:125: cilium-operator " L126: "cluster.go:125: Cluster Pods: 0/0 managed by Cilium" L127: "kubeadm.go:197: unable to setup cluster: unable to create worker node: PollUntilDone(ci-4081.3.10--04cb796d19): GET https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/prov?iders/Microsoft.Compute/locations/westus2/operations/5aaf96e0-1254-439a-a8ef-82ae17fd7388" L128: "--------------------------------------------------------------------------------" L129: "RESPONSE 200: 200 OK" L130: "ERROR CODE: OperationPreempted" L131: "--------------------------------------------------------------------------------" L132: "{" L133: "__startTime__: __2026-10-22T23:54:32.4556346+00:00__," L134: "__endTime__: __2026-10-22T23:55:41.4990907+00:00__," L135: "__status__: __Canceled__," L136: "__error__: {" L137: "__code__: __OperationPreempted__," L138: "__message__: __Operation execution has been preempted by a more recent operation.__" L139: "}," L140: "__name__: __5aaf96e0-1254-439a-a8ef-82ae17fd7388__" L141: "}" L142: "--------------------------------------------------------------------------------_" L143: " " ```                 Diagnostic output for azure, run 1 ``` L1: " Error: _cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.37.1" L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.37.1" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.37.1" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.37.1" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.14.6" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.2" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.7.0-0" L8: "cluster.go:125: [init] Using Kubernetes version: v1.37.1" L9: "cluster.go:125: [preflight] Running pre-flight checks" L10: "cluster.go:125: E1022 23:35:24.873222 2614 remote_runtime.go:1359] __RuntimeConfig from runtime service failed__ err=__rpc error: code = Unimplemented desc = unknown method RuntimeConfig for servic?e runtime.v1.RuntimeService__" L11: "cluster.go:125: [WARNING ContainerRuntimeVersion]: You must update your container runtime to a version that supports the CRI method RuntimeConfig. Falling back to using cgroupDriver from kubelet conf?ig will be removed in 1.38. For more information, see https://git.k8s.io/enhancements/keps/sig-node/4033-group-driver-detection-over-cri" L12: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.10--3bef8bc484__ could not be reached" L13: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.10--3bef8bc484__: lookup ci-4081.3.10--3bef8bc484 on 168.63.129.16:53: no such host" L14: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L15: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L16: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L17: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L18: "cluster.go:125: W1022 23:35:25.082887 2614 checks.go:920] detected that the sandbox image __registry.k8s.io/pause:3.8__ of the container runtime is inconsistent with that used by kubeadm. It is rec?ommended to use __registry.k8s.io/pause:3.10.2__ as the CRI sandbox image." L19: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L20: "cluster.go:125: [certs] Generating __ca__ certificate and key" L21: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L22: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [ci-4081.3.10--3bef8bc484 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local] and IPs [10.?96.0.1 10.0.0.27]" L23: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L24: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L25: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L26: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L27: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L28: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L29: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L30: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L31: "cluster.go:125: [certs] Generating __sa__ key and public key" L32: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L33: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L34: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L35: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L36: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L37: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L38: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L39: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L40: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L41: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L42: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L43: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__" L44: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__" L45: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L46: "cluster.go:125: [kubelet-start] Starting the kubelet" L47: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__" L48: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s" L49: "cluster.go:125: [kubelet-check] The kubelet is healthy after 660.042??s" L50: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s" L51: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.27:6443/livez" L52: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz" L53: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez" L54: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 13.723036ms" L55: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 18.588328ms" L56: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 2.00199053s" L57: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace" L58: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster" L59: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs" L60: "cluster.go:125: [mark-control-plane] Marking the node ci-4081.3.10--3bef8bc484 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-lo?ad-balancers]" L61: "cluster.go:125: [mark-control-plane] Marking the node ci-4081.3.10--3bef8bc484 as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]" L62: "cluster.go:125: [bootstrap-token] Using token: ef3uhe.hnk3oiv1lr8is4s2" L63: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles" L64: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes" L65: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials" L66: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token" L67: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster" L68: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the API server kubelet client certificate to access the kubelet API" L69: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace" L70: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key" L71: "cluster.go:125: [addons] Applied essential addon: CoreDNS" L72: "cluster.go:125: [addons] Applied essential addon: kube-proxy" L73: "cluster.go:125: " L74: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!" L75: "cluster.go:125: " L76: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:" L77: "cluster.go:125: " L78: "cluster.go:125: mkdir -p $HOME/.kube" L79: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config" L80: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config" L81: "cluster.go:125: " L82: "cluster.go:125: Alternatively, if you are the root user, you can run:" L83: "cluster.go:125: " L84: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf" L85: "cluster.go:125: " L86: "cluster.go:125: You should now deploy a pod network to the cluster." L87: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:" L88: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/" L89: "cluster.go:125: " L90: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:" L91: "cluster.go:125: " L92: "cluster.go:125: kubeadm join 10.0.0.27:6443 --token ef3uhe.hnk3oiv1lr8is4s2 _" L93: "cluster.go:125: --discovery-token-ca-cert-hash sha256:867e7ab4cee7dbdacea1a67be2b394a979ca9372cbd1c7ee695d0b329318ac06 " L94: "cluster.go:125: i Using Cilium version 1.12.5" L95: "cluster.go:125: ? Auto-detected cluster name: kubernetes" L96: "cluster.go:125: ? Auto-detected datapath mode: tunnel" L97: "cluster.go:125: ? Auto-detected kube-proxy has been installed" L98: "cluster.go:125: i helm template --namespace kube-system cilium cilium/cilium --version 1.12.5 --set cluster.id=0,cluster.name=kubernetes,encryption.nodeEncryption=false,extraConfig.cluster-pool-ipv4-?cidr=192.168.0.0/17,extraConfig.enable-endpoint-routes=true,kubeProxyReplacement=disabled,operator.replicas=1,serviceAccounts.cilium.name=cilium,serviceAccounts.operator.name=cilium-operator,tunnel=vx?lan" L99: "cluster.go:125: i Storing helm values file in kube-system/cilium-cli-helm-values Secret" L100: "cluster.go:125: ? Created CA in secret cilium-ca" L101: "cluster.go:125: ? Generating certificates for Hubble..." L102: "cluster.go:125: ? Creating Service accounts..." L103: "cluster.go:125: ? Creating Cluster roles..." L104: "cluster.go:125: ? Creating ConfigMap for Cilium version 1.12.5..." L105: "cluster.go:125: i Manual overwrite in ConfigMap: enable-endpoint-routes=true" L106: "cluster.go:125: i Manual overwrite in ConfigMap: cluster-pool-ipv4-cidr=192.168.0.0/17" L107: "cluster.go:125: ? Creating Agent DaemonSet..." L108: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/mount-cgroup]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L109: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/apply-sysctl-overwrites]: deprecated since v1.30; use the ___appArmorProfile___ fi?eld instead__ subsys=klog" L110: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/clean-cilium-state]: deprecated since v1.30; use the ___appArmorProfile___ field i?nstead__ subsys=klog" L111: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/cilium-agent]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L112: "cluster.go:125: ? Creating Operator Deployment..." L113: "cluster.go:125: ? Waiting for Cilium to be installed and ready..." L114: "cluster.go:125: ? Cilium was successfully installed! Run _cilium status_ to view installation health" L115: "cluster.go:125: ?[33m /??_" L116: "cluster.go:125: ?[36m /???[33m___/?[32m??_?[0m Cilium: ?[32mOK?[0m" L117: "cluster.go:125: ?[36m ___?[31m/??_?[32m__/?[0m Operator: ?[32mOK?[0m" L118: "cluster.go:125: ?[32m /???[31m___/?[35m??_?[0m Hubble: ?[36mdisabled?[0m" L119: "cluster.go:125: ?[32m ___?[34m/??_?[35m__/?[0m ClusterMesh: ?[36mdisabled?[0m" L120: "cluster.go:125: ?[34m ___/" L121: "cluster.go:125: ?[0m" L122: "cluster.go:125: DaemonSet cilium " L123: "cluster.go:125: Deployment cilium-operator " L124: "cluster.go:125: Containers: cilium-operator " L125: "cluster.go:125: cilium " L126: "cluster.go:125: Cluster Pods: 0/0 managed by Cilium" L127: "cluster.go:125: W1022 23:37:12.790753 2221 joinconfiguration.go:112] [config] WARNING: Ignored configuration document with GroupVersionKind kubelet.config.k8s.io/v1beta1, Kind=KubeletConfiguration" L128: "cluster.go:125: E1022 23:37:12.804181 2221 remote_runtime.go:1359] __RuntimeConfig from runtime service failed__ err=__rpc error: code = Unimplemented desc = unknown method RuntimeConfig for servic?e runtime.v1.RuntimeService__" L129: "cluster.go:125: [WARNING ContainerRuntimeVersion]: You must update your container runtime to a version that supports the CRI method RuntimeConfig. Falling back to using cgroupDriver from kubelet conf?ig will be removed in 1.38. For more information, see https://git.k8s.io/enhancements/keps/sig-node/4033-group-driver-detection-over-cri" L130: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L131: "cluster.go:125: jq: error (at 🟢 ok **kubeadm.v1.37.0.flannel.base**; Succeeded: azure (1) 🟢 ok **sysext.custom-docker.sysext**; Succeeded: azure (1) 🟢 ok **sysext.disable-containerd**; Succeeded: azure (1) 🟢 ok **sysext.disable-docker**; Succeeded: azure (1) 🟢 ok **sysext.simple**; Succeeded: azure (1) 🟢 ok **systemd.journal.user**; Succeeded: azure (1) 🟢 ok **systemd.sysusers.gshadow**; Succeeded: azure (1)