### Test report for 4081.3.10+nightly-20260907-2100 / arm64
**Platforms tested** : azure
🟢 ok **azure.nvme-friendly-naming # SKIP**; Succeeded: azure (1)
🟢 ok **cl.basic**; Succeeded: azure (1)
🟢 ok **cl.cloudinit.basic**; Succeeded: azure (1)
🟢 ok **cl.cloudinit.multipart-mime**; Succeeded: azure (1)
🟢 ok **cl.cloudinit.script**; Succeeded: azure (1)
🟢 ok **cl.etcd-member.discovery**; Succeeded: azure (1)
🟢 ok **cl.etcd-member.etcdctlv3**; Succeeded: azure (1)
🟢 ok **cl.etcd-member.v2-backup-restore**; Succeeded: azure (1)
🟢 ok **cl.flannel.vxlan**; Succeeded: azure (2); Failed: azure (1)
Diagnostic output for azure, run 1
```
L1: " Error: _harness.go:651: Cluster failed starting machines: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kola-cluster-image-65b14e6dec/providers/Mic?rosoft.Compute/virtualMachines/ci-4081.3.10--55fae5e34d"
L2: "--------------------------------------------------------------------------------"
L3: "RESPONSE 409: 409 Conflict"
L4: "ERROR CODE: OperationNotAllowed"
L5: "--------------------------------------------------------------------------------"
L6: "{"
L7: "__error__: {"
L8: "__code__: __OperationNotAllowed__,"
L9: "__message__: __Operation could not be completed as it results in exceeding approved standardDPLSv5Family Cores quota. Additional details - Deployment Model: Resource Manager, Location: westus2, Curren?t Limit: 65, Current Usage: 64, Additional Required: 2, (Minimum) New Limit Required: 66. Setup Alerts when Quota reaches threshold. Learn more at https://aka.ms/quotamonitoringalerting . Submit a req?uest for Quota increase at https://aka.ms/ProdportalCRP/#blade/Microsoft_Azure_Capacity/UsageAndQuota.ReactView/Parameters/%7B%22subscriptionId%22:%220e46bd28-a80f-4d3a-8200-d9eb8d80cb2e%22,%22command?%22:%22openQuotaApprovalBlade%22,%22quotas%22:[%7B%22location%22:%22westus2%22,%22providerId%22:%22Microsoft.Compute%22,%22resourceName%22:%22standardDPLSv5Family%22,%22quotaRequest%22:%7B%22propertie?s%22:%7B%22limit%22:66,%22unit%22:%22Count%22,%22name%22:%7B%22value%22:%22standardDPLSv5Family%22%7D%7D%7D%7D]%7D by specifying parameters listed in the ???Details??? section for deployment to succee?d. Please read more about quota limits at https://docs.microsoft.com/en-us/azure/azure-supportability/per-vm-quota-requests__"
L10: "}"
L11: "}"
L12: "--------------------------------------------------------------------------------_"
L13: " "
```
🟢 ok **cl.ignition.kargs**; Succeeded: azure (1)
🟢 ok **cl.ignition.luks**; Succeeded: azure (1)
🟢 ok **cl.ignition.misc.empty**; Succeeded: azure (1)
🟢 ok **cl.ignition.symlink**; Succeeded: azure (1)
🟢 ok **cl.ignition.translation**; Succeeded: azure (1)
🟢 ok **cl.ignition.v1.btrfsroot**; Succeeded: azure (1)
🟢 ok **cl.ignition.v1.ext4root**; Succeeded: azure (1)
🟢 ok **cl.ignition.v1.groups**; Succeeded: azure (1)
🟢 ok **cl.ignition.v1.noop**; Succeeded: azure (1)
🟢 ok **cl.ignition.v1.once**; Succeeded: azure (1)
🟢 ok **cl.ignition.v1.users**; Succeeded: azure (1)
🟢 ok **cl.ignition.v1.xfsroot**; Succeeded: azure (1)
🟢 ok **cl.ignition.v2.btrfsroot**; Succeeded: azure (1)
🟢 ok **cl.ignition.v2.ext4root**; Succeeded: azure (1)
🟢 ok **cl.ignition.v2.noop**; Succeeded: azure (1)
🟢 ok **cl.ignition.v2.users**; Succeeded: azure (1)
🟢 ok **cl.ignition.v2.xfsroot**; Succeeded: azure (1)
🟢 ok **cl.ignition.v2_1.ext4checkexisting**; Succeeded: azure (1)
🟢 ok **cl.ignition.v2_1.swap**; Succeeded: azure (1)
🟢 ok **cl.ignition.v2_1.vfat**; Succeeded: azure (1)
🟢 ok **cl.internet**; Succeeded: azure (1)
🟢 ok **cl.locksmith.cluster**; Succeeded: azure (1)
🟢 ok **cl.metadata.azure**; Succeeded: azure (1)
🟢 ok **cl.network.initramfs.second-boot**; Succeeded: azure (1)
🟢 ok **cl.network.iptables**; Succeeded: azure (1)
🟢 ok **cl.network.wireguard**; Succeeded: azure (1)
🟢 ok **cl.osreset.ignition-rerun**; Succeeded: azure (1)
🟢 ok **cl.overlay.cleanup**; Succeeded: azure (1)
🟢 ok **cl.swap_activation**; Succeeded: azure (1)
🟢 ok **cl.toolbox.dnf-install**; Succeeded: azure (1)
🟢 ok **cl.update.badverity**; Succeeded: azure (1)
🟢 ok **cl.update.reboot**; Succeeded: azure (1)
🟢 ok **cl.users.shells**; Succeeded: azure (1)
🟢 ok **cl.verity**; Succeeded: azure (1)
🟢 ok **coreos.auth.verify**; Succeeded: azure (1)
🟢 ok **coreos.ignition.groups**; Succeeded: azure (1)
🟢 ok **coreos.ignition.once**; Succeeded: azure (1)
🟢 ok **coreos.ignition.resource.local**; Succeeded: azure (1)
🟢 ok **coreos.ignition.resource.remote**; Succeeded: azure (1)
🟢 ok **coreos.ignition.security.tls**; Succeeded: azure (1)
🟢 ok **coreos.ignition.systemd.enable-service**; Succeeded: azure (1)
🟢 ok **coreos.locksmith.reboot**; Succeeded: azure (1)
🟢 ok **coreos.locksmith.tls**; Succeeded: azure (1)
🟢 ok **coreos.selinux.boolean**; Succeeded: azure (1)
🟢 ok **coreos.selinux.enforce**; Succeeded: azure (1)
🟢 ok **coreos.tls.fetch-urls**; Succeeded: azure (1)
🟢 ok **coreos.update.badusr**; Succeeded: azure (1)
🟢 ok **docker.base**; Succeeded: azure (1)
🟢 ok **docker.btrfs-storage**; Succeeded: azure (1)
🟢 ok **docker.containerd-restart**; Succeeded: azure (1)
🟢 ok **docker.enable-service.sysext**; Succeeded: azure (1)
🟢 ok **docker.lib-coreos-dockerd-compat**; Succeeded: azure (1)
🟢 ok **docker.network-openbsd-nc**; Succeeded: azure (1)
🟢 ok **docker.selinux**; Succeeded: azure (1)
🟢 ok **docker.userns**; Succeeded: azure (1)
🟢 ok **kubeadm.v1.35.1.calico.base**; Succeeded: azure (2); Failed: azure (1)
Diagnostic output for azure, run 1
```
L1: " Error: _cluster.go:125: I0908 02:01:45.245876 2375 version.go:260] remote version is much newer: v1.37.0; falling back to: stable-1.35"
L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.35.8"
L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.35.8"
L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.35.8"
L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.35.8"
L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.13.1"
L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.1"
L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.6-0"
L9: "cluster.go:125: I0908 02:01:55.413504 2625 version.go:260] remote version is much newer: v1.37.0; falling back to: stable-1.35"
L10: "cluster.go:125: [init] Using Kubernetes version: v1.35.8"
L11: "cluster.go:125: [preflight] Running pre-flight checks"
L12: "cluster.go:125: [WARNING ContainerRuntimeVersion]: You must update your container runtime to a version that supports the CRI method RuntimeConfig. Falling back to using cgroupDriver from kubelet conf?ig will be removed in 1.36. For more information, see https://git.k8s.io/enhancements/keps/sig-node/4033-group-driver-detection-over-cri"
L13: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.10--f3356519d5__ could not be reached"
L14: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.10--f3356519d5__: lookup ci-4081.3.10--f3356519d5 on 168.63.129.16:53: no such host"
L15: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_"
L16: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster"
L17: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection"
L18: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_"
L19: "cluster.go:125: W0908 02:01:55.676890 2625 checks.go:906] detected that the sandbox image __registry.k8s.io/pause:3.8__ of the container runtime is inconsistent with that used by kubeadm. It is rec?ommended to use __registry.k8s.io/pause:3.10.1__ as the CRI sandbox image."
L20: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__"
L21: "cluster.go:125: [certs] Generating __ca__ certificate and key"
L22: "cluster.go:125: [certs] Generating __apiserver__ certificate and key"
L23: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [ci-4081.3.10--f3356519d5 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local] and IPs [10.?96.0.1 10.0.0.9]"
L24: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key"
L25: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key"
L26: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key"
L27: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation"
L28: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation"
L29: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation"
L30: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation"
L31: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation"
L32: "cluster.go:125: [certs] Generating __sa__ key and public key"
L33: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__"
L34: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file"
L35: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file"
L36: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file"
L37: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file"
L38: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file"
L39: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__"
L40: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__"
L41: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__"
L42: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__"
L43: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__"
L44: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__"
L45: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__"
L46: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__"
L47: "cluster.go:125: [kubelet-start] Starting the kubelet"
L48: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__"
L49: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s"
L50: "cluster.go:125: [kubelet-check] The kubelet is healthy after 1.00153613s"
L51: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s"
L52: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.9:6443/livez"
L53: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz"
L54: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez"
L55: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 2.508391799s"
L56: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 3.011646981s"
L57: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 5.001675856s"
L58: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace"
L59: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster"
L60: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs"
L61: "cluster.go:125: [mark-control-plane] Marking the node ci-4081.3.10--f3356519d5 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-lo?ad-balancers]"
L62: "cluster.go:125: [mark-control-plane] Marking the node ci-4081.3.10--f3356519d5 as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]"
L63: "cluster.go:125: [bootstrap-token] Using token: 4kgopb.rwu1xttilapzr1o8"
L64: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles"
L65: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes"
L66: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials"
L67: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token"
L68: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster"
L69: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace"
L70: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key"
L71: "cluster.go:125: [addons] Applied essential addon: CoreDNS"
L72: "cluster.go:125: [addons] Applied essential addon: kube-proxy"
L73: "cluster.go:125: "
L74: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!"
L75: "cluster.go:125: "
L76: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:"
L77: "cluster.go:125: "
L78: "cluster.go:125: mkdir -p $HOME/.kube"
L79: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config"
L80: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config"
L81: "cluster.go:125: "
L82: "cluster.go:125: Alternatively, if you are the root user, you can run:"
L83: "cluster.go:125: "
L84: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf"
L85: "cluster.go:125: "
L86: "cluster.go:125: You should now deploy a pod network to the cluster."
L87: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:"
L88: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/"
L89: "cluster.go:125: "
L90: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:"
L91: "cluster.go:125: "
L92: "cluster.go:125: kubeadm join 10.0.0.9:6443 --token 4kgopb.rwu1xttilapzr1o8 _"
L93: "cluster.go:125: --discovery-token-ca-cert-hash sha256:d4df115d21231497aecb25be19fb3343914fb87c81ecf5b0aa892428de9d7d11 "
L94: "cluster.go:125: namespace/tigera-operator created"
L95: "cluster.go:125: serviceaccount/tigera-operator created"
L96: "cluster.go:125: clusterrole.rbac.authorization.k8s.io/tigera-operator-secrets created"
L97: "cluster.go:125: clusterrole.rbac.authorization.k8s.io/tigera-operator created"
L98: "cluster.go:125: clusterrolebinding.rbac.authorization.k8s.io/tigera-operator created"
L99: "cluster.go:125: rolebinding.rbac.authorization.k8s.io/tigera-operator-secrets created"
L100: "cluster.go:125: deployment.apps/tigera-operator created"
L101: "cluster.go:125: customresourcedefinition.apiextensions.k8s.io/installations.operator.tigera.io condition met"
L102: "cluster.go:125: customresourcedefinition.apiextensions.k8s.io/installations.operator.tigera.io condition met"
L103: "cluster.go:125: customresourcedefinition.apiextensions.k8s.io/apiservers.operator.tigera.io condition met"
L104: "cluster.go:125: customresourcedefinition.apiextensions.k8s.io/apiservers.operator.tigera.io condition met"
L105: "cluster.go:125: installation.operator.tigera.io/default created"
L106: "cluster.go:125: apiserver.operator.tigera.io/default created"
L107: "cluster.go:125: goldmane.operator.tigera.io/default created"
L108: "cluster.go:125: whisker.operator.tigera.io/default created"
L109: "kubeadm.go:197: unable to setup cluster: unable to create worker node: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kola-cluster-image-65b14e6dec/?providers/Microsoft.Compute/virtualMachines/ci-4081.3.10--be53dffa26"
L110: "--------------------------------------------------------------------------------"
L111: "RESPONSE 409: 409 Conflict"
L112: "ERROR CODE: OperationNotAllowed"
L113: "--------------------------------------------------------------------------------"
L114: "{"
L115: "__error__: {"
L116: "__code__: __OperationNotAllowed__,"
L117: "__message__: __Operation could not be completed as it results in exceeding approved standardDPLSv5Family Cores quota. Additional details - Deployment Model: Resource Manager, Location: westus2, Curren?t Limit: 65, Current Usage: 64, Additional Required: 2, (Minimum) New Limit Required: 66. Setup Alerts when Quota reaches threshold. Learn more at https://aka.ms/quotamonitoringalerting . Submit a req?uest for Quota increase at https://aka.ms/ProdportalCRP/#blade/Microsoft_Azure_Capacity/UsageAndQuota.ReactView/Parameters/%7B%22subscriptionId%22:%220e46bd28-a80f-4d3a-8200-d9eb8d80cb2e%22,%22command?%22:%22openQuotaApprovalBlade%22,%22quotas%22:[%7B%22location%22:%22westus2%22,%22providerId%22:%22Microsoft.Compute%22,%22resourceName%22:%22standardDPLSv5Family%22,%22quotaRequest%22:%7B%22propertie?s%22:%7B%22limit%22:66,%22unit%22:%22Count%22,%22name%22:%7B%22value%22:%22standardDPLSv5Family%22%7D%7D%7D%7D]%7D by specifying parameters listed in the ???Details??? section for deployment to succee?d. Please read more about quota limits at https://docs.microsoft.com/en-us/azure/azure-supportability/per-vm-quota-requests__"
L118: "}"
L119: "}"
L120: "--------------------------------------------------------------------------------_"
L121: " "
```
❌ not ok **kubeadm.v1.35.1.calico.cgroupv1.base**; Failed: azure (1, 2, 3, 4, 5)
Diagnostic output for azure, run 5
```
L1: " Error: _kubeadm.go:197: unable to setup cluster: unable to create master node: creating public ip: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/ko?la-cluster-image-ec9a7228a9/providers/Microsoft.Network/publicIPAddresses/ip-546e139f7c"
L2: "--------------------------------------------------------------------------------"
L3: "RESPONSE 409: 409 Conflict"
L4: "ERROR CODE: ResourceGroupBeingDeleted"
L5: "--------------------------------------------------------------------------------"
L6: "{"
L7: "__error__: {"
L8: "__code__: __ResourceGroupBeingDeleted__,"
L9: "__message__: __The resource group _kola-cluster-image-ec9a7228a9_ is in deprovisioning state and cannot perform this operation.__"
L10: "}"
L11: "}"
L12: "--------------------------------------------------------------------------------_"
L13: " "
```
Diagnostic output for azure, run 4
```
L1: " Error: _cluster.go:125: I0908 02:43:55.489074 2550 version.go:260] remote version is much newer: v1.37.0; falling back to: stable-1.35"
L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.35.8"
L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.35.8"
L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.35.8"
L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.35.8"
L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.13.1"
L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.1"
L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.6-0"
L9: "cluster.go:125: I0908 02:44:05.009013 2830 version.go:260] remote version is much newer: v1.37.0; falling back to: stable-1.35"
L10: "cluster.go:125: [init] Using Kubernetes version: v1.35.8"
L11: "cluster.go:125: [preflight] Running pre-flight checks"
L12: "cluster.go:125: [WARNING ContainerRuntimeVersion]: You must update your container runtime to a version that supports the CRI method RuntimeConfig. Falling back to using cgroupDriver from kubelet conf?ig will be removed in 1.36. For more information, see https://git.k8s.io/enhancements/keps/sig-node/4033-group-driver-detection-over-cri"
L13: "cluster.go:125: [preflight] The system verification failed. Printing the output from the verification:"
L14: "cluster.go:125: ?[0;37mKERNEL_VERSION?[0m: ?[0;32m6.6.156-flatcar?[0m"
L15: "cluster.go:125: ?[0;37mCONFIG_NAMESPACES?[0m: ?[0;32menabled?[0m"
L16: "cluster.go:125: ?[0;37mCONFIG_NET_NS?[0m: ?[0;32menabled?[0m"
L17: "cluster.go:125: ?[0;37mCONFIG_PID_NS?[0m: ?[0;32menabled?[0m"
L18: "cluster.go:125: ?[0;37mCONFIG_IPC_NS?[0m: ?[0;32menabled?[0m"
L19: "cluster.go:125: ?[0;37mCONFIG_UTS_NS?[0m: ?[0;32menabled?[0m"
L20: "cluster.go:125: ?[0;37mCONFIG_CPUSETS?[0m: ?[0;32menabled?[0m"
L21: "cluster.go:125: ?[0;37mCONFIG_MEMCG?[0m: ?[0;32menabled?[0m"
L22: "cluster.go:125: ?[0;37mCONFIG_INET?[0m: ?[0;32menabled?[0m"
L23: "cluster.go:125: ?[0;37mCONFIG_EXT4_FS?[0m: ?[0;32menabled (as module)?[0m"
L24: "cluster.go:125: ?[0;37mCONFIG_PROC_FS?[0m: ?[0;32menabled?[0m"
L25: "cluster.go:125: ?[0;37mCONFIG_NETFILTER_XT_TARGET_REDIRECT?[0m: ?[0;32menabled (as module)?[0m"
L26: "cluster.go:125: ?[0;37mCONFIG_NETFILTER_XT_MATCH_COMMENT?[0m: ?[0;32menabled (as module)?[0m"
L27: "cluster.go:125: ?[0;37mCONFIG_FAIR_GROUP_SCHED?[0m: ?[0;32menabled?[0m"
L28: "cluster.go:125: ?[0;37mCONFIG_CGROUPS?[0m: ?[0;32menabled?[0m"
L29: "cluster.go:125: ?[0;37mCONFIG_CGROUP_CPUACCT?[0m: ?[0;32menabled?[0m"
L30: "cluster.go:125: ?[0;37mCONFIG_CGROUP_DEVICE?[0m: ?[0;32menabled?[0m"
L31: "cluster.go:125: ?[0;37mCONFIG_CGROUP_FREEZER?[0m: ?[0;32menabled?[0m"
L32: "cluster.go:125: ?[0;37mCONFIG_CGROUP_PIDS?[0m: ?[0;32menabled?[0m"
L33: "cluster.go:125: ?[0;37mCONFIG_CGROUP_SCHED?[0m: ?[0;32menabled?[0m"
L34: "cluster.go:125: ?[0;37mCONFIG_OVERLAY_FS?[0m: ?[0;32menabled (as module)?[0m"
L35: "cluster.go:125: ?[0;37mCONFIG_AUFS_FS?[0m: ?[0;33mnot set - Required for aufs.?[0m"
L36: "cluster.go:125: ?[0;37mCONFIG_BLK_DEV_DM?[0m: ?[0;32menabled (as module)?[0m"
L37: "cluster.go:125: ?[0;37mCONFIG_CFS_BANDWIDTH?[0m: ?[0;32menabled?[0m"
L38: "cluster.go:125: ?[0;37mCONFIG_SECCOMP?[0m: ?[0;32menabled?[0m"
L39: "cluster.go:125: ?[0;37mCONFIG_SECCOMP_FILTER?[0m: ?[0;32menabled?[0m"
L40: "cluster.go:125: ?[0;37mOS?[0m: ?[0;32mLinux?[0m"
L41: "cluster.go:125: ?[0;37mCGROUPS_CPU?[0m: ?[0;32menabled?[0m"
L42: "cluster.go:125: ?[0;37mCGROUPS_CPUACCT?[0m: ?[0;32menabled?[0m"
L43: "cluster.go:125: ?[0;37mCGROUPS_CPUSET?[0m: ?[0;32menabled?[0m"
L44: "cluster.go:125: ?[0;37mCGROUPS_DEVICES?[0m: ?[0;32menabled?[0m"
L45: "cluster.go:125: ?[0;37mCGROUPS_FREEZER?[0m: ?[0;32menabled?[0m"
L46: "cluster.go:125: ?[0;37mCGROUPS_MEMORY?[0m: ?[0;32menabled?[0m"
L47: "cluster.go:125: ?[0;37mCGROUPS_PIDS?[0m: ?[0;32menabled?[0m"
L48: "cluster.go:125: ?[0;37mCGROUPS_HUGETLB?[0m: ?[0;32menabled?[0m"
L49: "cluster.go:125: ?[0;37mCGROUPS_BLKIO?[0m: ?[0;32menabled?[0m"
L50: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.10--c992da356c__ could not be reached"
L51: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.10--c992da356c__: lookup ci-4081.3.10--c992da356c on 168.63.129.16:53: no such host"
L52: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_"
L53: "cluster.go:125: [preflight] Some fatal errors occurred:"
L54: "cluster.go:125: [ERROR SystemVerification]: cgroups v1 support is deprecated and will be removed in a future release. Please migrate to cgroups v2. To explicitly enable cgroups v1 support for kubelet? v1.35 or newer, you must set the kubelet configuration option _FailCgroupV1_ to _false_. You must also explicitly skip this validation. For more information, see https://git.k8s.io/enhancements/keps/?sig-node/5573-remove-cgroup-v1"
L55: "cluster.go:125: [preflight] If you know what you are doing, you can make a check non-fatal with `--ignore-preflight-errors=...`"
L56: "cluster.go:125: error: error execution phase preflight: preflight checks failed"
L57: "cluster.go:125: To see the stack trace of this error execute with --v=5 or higher"
L58: "kubeadm.go:197: unable to setup cluster: unable to run master script: Process exited with status 1_"
L59: " "
```
Diagnostic output for azure, run 3
```
L1: " Error: _cluster.go:125: I0908 02:36:38.340413 2546 version.go:260] remote version is much newer: v1.37.0; falling back to: stable-1.35"
L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.35.8"
L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.35.8"
L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.35.8"
L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.35.8"
L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.13.1"
L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.1"
L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.6-0"
L9: "cluster.go:125: I0908 02:36:47.856225 2761 version.go:260] remote version is much newer: v1.37.0; falling back to: stable-1.35"
L10: "cluster.go:125: [init] Using Kubernetes version: v1.35.8"
L11: "cluster.go:125: [preflight] Running pre-flight checks"
L12: "cluster.go:125: [WARNING ContainerRuntimeVersion]: You must update your container runtime to a version that supports the CRI method RuntimeConfig. Falling back to using cgroupDriver from kubelet conf?ig will be removed in 1.36. For more information, see https://git.k8s.io/enhancements/keps/sig-node/4033-group-driver-detection-over-cri"
L13: "cluster.go:125: [preflight] The system verification failed. Printing the output from the verification:"
L14: "cluster.go:125: ?[0;37mKERNEL_VERSION?[0m: ?[0;32m6.6.156-flatcar?[0m"
L15: "cluster.go:125: ?[0;37mCONFIG_NAMESPACES?[0m: ?[0;32menabled?[0m"
L16: "cluster.go:125: ?[0;37mCONFIG_NET_NS?[0m: ?[0;32menabled?[0m"
L17: "cluster.go:125: ?[0;37mCONFIG_PID_NS?[0m: ?[0;32menabled?[0m"
L18: "cluster.go:125: ?[0;37mCONFIG_IPC_NS?[0m: ?[0;32menabled?[0m"
L19: "cluster.go:125: ?[0;37mCONFIG_UTS_NS?[0m: ?[0;32menabled?[0m"
L20: "cluster.go:125: ?[0;37mCONFIG_CPUSETS?[0m: ?[0;32menabled?[0m"
L21: "cluster.go:125: ?[0;37mCONFIG_MEMCG?[0m: ?[0;32menabled?[0m"
L22: "cluster.go:125: ?[0;37mCONFIG_INET?[0m: ?[0;32menabled?[0m"
L23: "cluster.go:125: ?[0;37mCONFIG_EXT4_FS?[0m: ?[0;32menabled (as module)?[0m"
L24: "cluster.go:125: ?[0;37mCONFIG_PROC_FS?[0m: ?[0;32menabled?[0m"
L25: "cluster.go:125: ?[0;37mCONFIG_NETFILTER_XT_TARGET_REDIRECT?[0m: ?[0;32menabled (as module)?[0m"
L26: "cluster.go:125: ?[0;37mCONFIG_NETFILTER_XT_MATCH_COMMENT?[0m: ?[0;32menabled (as module)?[0m"
L27: "cluster.go:125: ?[0;37mCONFIG_FAIR_GROUP_SCHED?[0m: ?[0;32menabled?[0m"
L28: "cluster.go:125: ?[0;37mCONFIG_CGROUPS?[0m: ?[0;32menabled?[0m"
L29: "cluster.go:125: ?[0;37mCONFIG_CGROUP_CPUACCT?[0m: ?[0;32menabled?[0m"
L30: "cluster.go:125: ?[0;37mCONFIG_CGROUP_DEVICE?[0m: ?[0;32menabled?[0m"
L31: "cluster.go:125: ?[0;37mCONFIG_CGROUP_FREEZER?[0m: ?[0;32menabled?[0m"
L32: "cluster.go:125: ?[0;37mCONFIG_CGROUP_PIDS?[0m: ?[0;32menabled?[0m"
L33: "cluster.go:125: ?[0;37mCONFIG_CGROUP_SCHED?[0m: ?[0;32menabled?[0m"
L34: "cluster.go:125: ?[0;37mCONFIG_OVERLAY_FS?[0m: ?[0;32menabled (as module)?[0m"
L35: "cluster.go:125: ?[0;37mCONFIG_AUFS_FS?[0m: ?[0;33mnot set - Required for aufs.?[0m"
L36: "cluster.go:125: ?[0;37mCONFIG_BLK_DEV_DM?[0m: ?[0;32menabled (as module)?[0m"
L37: "cluster.go:125: ?[0;37mCONFIG_CFS_BANDWIDTH?[0m: ?[0;32menabled?[0m"
L38: "cluster.go:125: ?[0;37mCONFIG_SECCOMP?[0m: ?[0;32menabled?[0m"
L39: "cluster.go:125: ?[0;37mCONFIG_SECCOMP_FILTER?[0m: ?[0;32menabled?[0m"
L40: "cluster.go:125: ?[0;37mOS?[0m: ?[0;32mLinux?[0m"
L41: "cluster.go:125: ?[0;37mCGROUPS_CPU?[0m: ?[0;32menabled?[0m"
L42: "cluster.go:125: ?[0;37mCGROUPS_CPUACCT?[0m: ?[0;32menabled?[0m"
L43: "cluster.go:125: ?[0;37mCGROUPS_CPUSET?[0m: ?[0;32menabled?[0m"
L44: "cluster.go:125: ?[0;37mCGROUPS_DEVICES?[0m: ?[0;32menabled?[0m"
L45: "cluster.go:125: ?[0;37mCGROUPS_FREEZER?[0m: ?[0;32menabled?[0m"
L46: "cluster.go:125: ?[0;37mCGROUPS_MEMORY?[0m: ?[0;32menabled?[0m"
L47: "cluster.go:125: ?[0;37mCGROUPS_PIDS?[0m: ?[0;32menabled?[0m"
L48: "cluster.go:125: ?[0;37mCGROUPS_HUGETLB?[0m: ?[0;32menabled?[0m"
L49: "cluster.go:125: ?[0;37mCGROUPS_BLKIO?[0m: ?[0;32menabled?[0m"
L50: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.10--638563e9eb__ could not be reached"
L51: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.10--638563e9eb__: lookup ci-4081.3.10--638563e9eb on 168.63.129.16:53: no such host"
L52: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_"
L53: "cluster.go:125: [preflight] Some fatal errors occurred:"
L54: "cluster.go:125: [ERROR SystemVerification]: cgroups v1 support is deprecated and will be removed in a future release. Please migrate to cgroups v2. To explicitly enable cgroups v1 support for kubelet? v1.35 or newer, you must set the kubelet configuration option _FailCgroupV1_ to _false_. You must also explicitly skip this validation. For more information, see https://git.k8s.io/enhancements/keps/?sig-node/5573-remove-cgroup-v1"
L55: "cluster.go:125: [preflight] If you know what you are doing, you can make a check non-fatal with `--ignore-preflight-errors=...`"
L56: "cluster.go:125: error: error execution phase preflight: preflight checks failed"
L57: "cluster.go:125: To see the stack trace of this error execute with --v=5 or higher"
L58: "kubeadm.go:197: unable to setup cluster: unable to run master script: Process exited with status 1_"
L59: " "
```
Diagnostic output for azure, run 2
```
L1: " Error: _cluster.go:125: I0908 02:24:10.006597 2517 version.go:260] remote version is much newer: v1.37.0; falling back to: stable-1.35"
L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.35.8"
L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.35.8"
L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.35.8"
L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.35.8"
L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.13.1"
L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.1"
L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.6-0"
L9: "cluster.go:125: I0908 02:24:18.940810 2800 version.go:260] remote version is much newer: v1.37.0; falling back to: stable-1.35"
L10: "cluster.go:125: [init] Using Kubernetes version: v1.35.8"
L11: "cluster.go:125: [preflight] Running pre-flight checks"
L12: "cluster.go:125: [WARNING ContainerRuntimeVersion]: You must update your container runtime to a version that supports the CRI method RuntimeConfig. Falling back to using cgroupDriver from kubelet conf?ig will be removed in 1.36. For more information, see https://git.k8s.io/enhancements/keps/sig-node/4033-group-driver-detection-over-cri"
L13: "cluster.go:125: [preflight] The system verification failed. Printing the output from the verification:"
L14: "cluster.go:125: ?[0;37mKERNEL_VERSION?[0m: ?[0;32m6.6.156-flatcar?[0m"
L15: "cluster.go:125: ?[0;37mCONFIG_NAMESPACES?[0m: ?[0;32menabled?[0m"
L16: "cluster.go:125: ?[0;37mCONFIG_NET_NS?[0m: ?[0;32menabled?[0m"
L17: "cluster.go:125: ?[0;37mCONFIG_PID_NS?[0m: ?[0;32menabled?[0m"
L18: "cluster.go:125: ?[0;37mCONFIG_IPC_NS?[0m: ?[0;32menabled?[0m"
L19: "cluster.go:125: ?[0;37mCONFIG_UTS_NS?[0m: ?[0;32menabled?[0m"
L20: "cluster.go:125: ?[0;37mCONFIG_CPUSETS?[0m: ?[0;32menabled?[0m"
L21: "cluster.go:125: ?[0;37mCONFIG_MEMCG?[0m: ?[0;32menabled?[0m"
L22: "cluster.go:125: ?[0;37mCONFIG_INET?[0m: ?[0;32menabled?[0m"
L23: "cluster.go:125: ?[0;37mCONFIG_EXT4_FS?[0m: ?[0;32menabled (as module)?[0m"
L24: "cluster.go:125: ?[0;37mCONFIG_PROC_FS?[0m: ?[0;32menabled?[0m"
L25: "cluster.go:125: ?[0;37mCONFIG_NETFILTER_XT_TARGET_REDIRECT?[0m: ?[0;32menabled (as module)?[0m"
L26: "cluster.go:125: ?[0;37mCONFIG_NETFILTER_XT_MATCH_COMMENT?[0m: ?[0;32menabled (as module)?[0m"
L27: "cluster.go:125: ?[0;37mCONFIG_FAIR_GROUP_SCHED?[0m: ?[0;32menabled?[0m"
L28: "cluster.go:125: ?[0;37mCONFIG_CGROUPS?[0m: ?[0;32menabled?[0m"
L29: "cluster.go:125: ?[0;37mCONFIG_CGROUP_CPUACCT?[0m: ?[0;32menabled?[0m"
L30: "cluster.go:125: ?[0;37mCONFIG_CGROUP_DEVICE?[0m: ?[0;32menabled?[0m"
L31: "cluster.go:125: ?[0;37mCONFIG_CGROUP_FREEZER?[0m: ?[0;32menabled?[0m"
L32: "cluster.go:125: ?[0;37mCONFIG_CGROUP_PIDS?[0m: ?[0;32menabled?[0m"
L33: "cluster.go:125: ?[0;37mCONFIG_CGROUP_SCHED?[0m: ?[0;32menabled?[0m"
L34: "cluster.go:125: ?[0;37mCONFIG_OVERLAY_FS?[0m: ?[0;32menabled (as module)?[0m"
L35: "cluster.go:125: ?[0;37mCONFIG_AUFS_FS?[0m: ?[0;33mnot set - Required for aufs.?[0m"
L36: "cluster.go:125: ?[0;37mCONFIG_BLK_DEV_DM?[0m: ?[0;32menabled (as module)?[0m"
L37: "cluster.go:125: ?[0;37mCONFIG_CFS_BANDWIDTH?[0m: ?[0;32menabled?[0m"
L38: "cluster.go:125: ?[0;37mCONFIG_SECCOMP?[0m: ?[0;32menabled?[0m"
L39: "cluster.go:125: ?[0;37mCONFIG_SECCOMP_FILTER?[0m: ?[0;32menabled?[0m"
L40: "cluster.go:125: ?[0;37mOS?[0m: ?[0;32mLinux?[0m"
L41: "cluster.go:125: ?[0;37mCGROUPS_CPU?[0m: ?[0;32menabled?[0m"
L42: "cluster.go:125: ?[0;37mCGROUPS_CPUACCT?[0m: ?[0;32menabled?[0m"
L43: "cluster.go:125: ?[0;37mCGROUPS_CPUSET?[0m: ?[0;32menabled?[0m"
L44: "cluster.go:125: ?[0;37mCGROUPS_DEVICES?[0m: ?[0;32menabled?[0m"
L45: "cluster.go:125: ?[0;37mCGROUPS_FREEZER?[0m: ?[0;32menabled?[0m"
L46: "cluster.go:125: ?[0;37mCGROUPS_MEMORY?[0m: ?[0;32menabled?[0m"
L47: "cluster.go:125: ?[0;37mCGROUPS_PIDS?[0m: ?[0;32menabled?[0m"
L48: "cluster.go:125: ?[0;37mCGROUPS_HUGETLB?[0m: ?[0;32menabled?[0m"
L49: "cluster.go:125: ?[0;37mCGROUPS_BLKIO?[0m: ?[0;32menabled?[0m"
L50: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.10--c66695d2ff__ could not be reached"
L51: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.10--c66695d2ff__: lookup ci-4081.3.10--c66695d2ff on 168.63.129.16:53: no such host"
L52: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_"
L53: "cluster.go:125: [preflight] Some fatal errors occurred:"
L54: "cluster.go:125: [ERROR SystemVerification]: cgroups v1 support is deprecated and will be removed in a future release. Please migrate to cgroups v2. To explicitly enable cgroups v1 support for kubelet? v1.35 or newer, you must set the kubelet configuration option _FailCgroupV1_ to _false_. You must also explicitly skip this validation. For more information, see https://git.k8s.io/enhancements/keps/?sig-node/5573-remove-cgroup-v1"
L55: "cluster.go:125: [preflight] If you know what you are doing, you can make a check non-fatal with `--ignore-preflight-errors=...`"
L56: "cluster.go:125: error: error execution phase preflight: preflight checks failed"
L57: "cluster.go:125: To see the stack trace of this error execute with --v=5 or higher"
L58: "kubeadm.go:197: unable to setup cluster: unable to run master script: Process exited with status 1_"
L59: " "
```
Diagnostic output for azure, run 1
```
L1: " Error: _cluster.go:125: I0908 02:08:02.695393 2550 version.go:260] remote version is much newer: v1.37.0; falling back to: stable-1.35"
L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.35.8"
L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.35.8"
L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.35.8"
L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.35.8"
L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.13.1"
L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.1"
L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.6-0"
L9: "cluster.go:125: I0908 02:08:11.828777 2798 version.go:260] remote version is much newer: v1.37.0; falling back to: stable-1.35"
L10: "cluster.go:125: [init] Using Kubernetes version: v1.35.8"
L11: "cluster.go:125: [preflight] Running pre-flight checks"
L12: "cluster.go:125: [WARNING ContainerRuntimeVersion]: You must update your container runtime to a version that supports the CRI method RuntimeConfig. Falling back to using cgroupDriver from kubelet conf?ig will be removed in 1.36. For more information, see https://git.k8s.io/enhancements/keps/sig-node/4033-group-driver-detection-over-cri"
L13: "cluster.go:125: [preflight] The system verification failed. Printing the output from the verification:"
L14: "cluster.go:125: ?[0;37mKERNEL_VERSION?[0m: ?[0;32m6.6.156-flatcar?[0m"
L15: "cluster.go:125: ?[0;37mCONFIG_NAMESPACES?[0m: ?[0;32menabled?[0m"
L16: "cluster.go:125: ?[0;37mCONFIG_NET_NS?[0m: ?[0;32menabled?[0m"
L17: "cluster.go:125: ?[0;37mCONFIG_PID_NS?[0m: ?[0;32menabled?[0m"
L18: "cluster.go:125: ?[0;37mCONFIG_IPC_NS?[0m: ?[0;32menabled?[0m"
L19: "cluster.go:125: ?[0;37mCONFIG_UTS_NS?[0m: ?[0;32menabled?[0m"
L20: "cluster.go:125: ?[0;37mCONFIG_CPUSETS?[0m: ?[0;32menabled?[0m"
L21: "cluster.go:125: ?[0;37mCONFIG_MEMCG?[0m: ?[0;32menabled?[0m"
L22: "cluster.go:125: ?[0;37mCONFIG_INET?[0m: ?[0;32menabled?[0m"
L23: "cluster.go:125: ?[0;37mCONFIG_EXT4_FS?[0m: ?[0;32menabled (as module)?[0m"
L24: "cluster.go:125: ?[0;37mCONFIG_PROC_FS?[0m: ?[0;32menabled?[0m"
L25: "cluster.go:125: ?[0;37mCONFIG_NETFILTER_XT_TARGET_REDIRECT?[0m: ?[0;32menabled (as module)?[0m"
L26: "cluster.go:125: ?[0;37mCONFIG_NETFILTER_XT_MATCH_COMMENT?[0m: ?[0;32menabled (as module)?[0m"
L27: "cluster.go:125: ?[0;37mCONFIG_FAIR_GROUP_SCHED?[0m: ?[0;32menabled?[0m"
L28: "cluster.go:125: ?[0;37mCONFIG_CGROUPS?[0m: ?[0;32menabled?[0m"
L29: "cluster.go:125: ?[0;37mCONFIG_CGROUP_CPUACCT?[0m: ?[0;32menabled?[0m"
L30: "cluster.go:125: ?[0;37mCONFIG_CGROUP_DEVICE?[0m: ?[0;32menabled?[0m"
L31: "cluster.go:125: ?[0;37mCONFIG_CGROUP_FREEZER?[0m: ?[0;32menabled?[0m"
L32: "cluster.go:125: ?[0;37mCONFIG_CGROUP_PIDS?[0m: ?[0;32menabled?[0m"
L33: "cluster.go:125: ?[0;37mCONFIG_CGROUP_SCHED?[0m: ?[0;32menabled?[0m"
L34: "cluster.go:125: ?[0;37mCONFIG_OVERLAY_FS?[0m: ?[0;32menabled (as module)?[0m"
L35: "cluster.go:125: ?[0;37mCONFIG_AUFS_FS?[0m: ?[0;33mnot set - Required for aufs.?[0m"
L36: "cluster.go:125: ?[0;37mCONFIG_BLK_DEV_DM?[0m: ?[0;32menabled (as module)?[0m"
L37: "cluster.go:125: ?[0;37mCONFIG_CFS_BANDWIDTH?[0m: ?[0;32menabled?[0m"
L38: "cluster.go:125: ?[0;37mCONFIG_SECCOMP?[0m: ?[0;32menabled?[0m"
L39: "cluster.go:125: ?[0;37mCONFIG_SECCOMP_FILTER?[0m: ?[0;32menabled?[0m"
L40: "cluster.go:125: ?[0;37mOS?[0m: ?[0;32mLinux?[0m"
L41: "cluster.go:125: ?[0;37mCGROUPS_CPU?[0m: ?[0;32menabled?[0m"
L42: "cluster.go:125: ?[0;37mCGROUPS_CPUACCT?[0m: ?[0;32menabled?[0m"
L43: "cluster.go:125: ?[0;37mCGROUPS_CPUSET?[0m: ?[0;32menabled?[0m"
L44: "cluster.go:125: ?[0;37mCGROUPS_DEVICES?[0m: ?[0;32menabled?[0m"
L45: "cluster.go:125: ?[0;37mCGROUPS_FREEZER?[0m: ?[0;32menabled?[0m"
L46: "cluster.go:125: ?[0;37mCGROUPS_MEMORY?[0m: ?[0;32menabled?[0m"
L47: "cluster.go:125: ?[0;37mCGROUPS_PIDS?[0m: ?[0;32menabled?[0m"
L48: "cluster.go:125: ?[0;37mCGROUPS_HUGETLB?[0m: ?[0;32menabled?[0m"
L49: "cluster.go:125: ?[0;37mCGROUPS_BLKIO?[0m: ?[0;32menabled?[0m"
L50: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.10--42fe9b3216__ could not be reached"
L51: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.10--42fe9b3216__: lookup ci-4081.3.10--42fe9b3216 on 168.63.129.16:53: no such host"
L52: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_"
L53: "cluster.go:125: [preflight] Some fatal errors occurred:"
L54: "cluster.go:125: [ERROR SystemVerification]: cgroups v1 support is deprecated and will be removed in a future release. Please migrate to cgroups v2. To explicitly enable cgroups v1 support for kubelet? v1.35 or newer, you must set the kubelet configuration option _FailCgroupV1_ to _false_. You must also explicitly skip this validation. For more information, see https://git.k8s.io/enhancements/keps/?sig-node/5573-remove-cgroup-v1"
L55: "cluster.go:125: [preflight] If you know what you are doing, you can make a check non-fatal with `--ignore-preflight-errors=...`"
L56: "cluster.go:125: error: error execution phase preflight: preflight checks failed"
L57: "cluster.go:125: To see the stack trace of this error execute with --v=5 or higher"
L58: "kubeadm.go:197: unable to setup cluster: unable to run master script: Process exited with status 1_"
L59: " "
```
🟢 ok **kubeadm.v1.35.1.cilium.base**; Succeeded: azure (1)
❌ not ok **kubeadm.v1.35.1.cilium.cgroupv1.base**; Failed: azure (1, 2, 3, 4, 5)
Diagnostic output for azure, run 5
```
L1: " Error: _kubeadm.go:197: unable to setup cluster: unable to create master node: creating public ip: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/ko?la-cluster-image-ec9a7228a9/providers/Microsoft.Network/publicIPAddresses/ip-80270a7ea4"
L2: "--------------------------------------------------------------------------------"
L3: "RESPONSE 409: 409 Conflict"
L4: "ERROR CODE: ResourceGroupBeingDeleted"
L5: "--------------------------------------------------------------------------------"
L6: "{"
L7: "__error__: {"
L8: "__code__: __ResourceGroupBeingDeleted__,"
L9: "__message__: __The resource group _kola-cluster-image-ec9a7228a9_ is in deprovisioning state and cannot perform this operation.__"
L10: "}"
L11: "}"
L12: "--------------------------------------------------------------------------------_"
L13: " "
```
Diagnostic output for azure, run 4
```
L1: " Error: _cluster.go:125: I0908 02:43:54.071256 2540 version.go:260] remote version is much newer: v1.37.0; falling back to: stable-1.35"
L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.35.8"
L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.35.8"
L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.35.8"
L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.35.8"
L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.13.1"
L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.1"
L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.6-0"
L9: "cluster.go:125: I0908 02:44:03.004646 2794 version.go:260] remote version is much newer: v1.37.0; falling back to: stable-1.35"
L10: "cluster.go:125: [init] Using Kubernetes version: v1.35.8"
L11: "cluster.go:125: [preflight] Running pre-flight checks"
L12: "cluster.go:125: [WARNING ContainerRuntimeVersion]: You must update your container runtime to a version that supports the CRI method RuntimeConfig. Falling back to using cgroupDriver from kubelet conf?ig will be removed in 1.36. For more information, see https://git.k8s.io/enhancements/keps/sig-node/4033-group-driver-detection-over-cri"
L13: "cluster.go:125: [preflight] The system verification failed. Printing the output from the verification:"
L14: "cluster.go:125: ?[0;37mKERNEL_VERSION?[0m: ?[0;32m6.6.156-flatcar?[0m"
L15: "cluster.go:125: ?[0;37mCONFIG_NAMESPACES?[0m: ?[0;32menabled?[0m"
L16: "cluster.go:125: ?[0;37mCONFIG_NET_NS?[0m: ?[0;32menabled?[0m"
L17: "cluster.go:125: ?[0;37mCONFIG_PID_NS?[0m: ?[0;32menabled?[0m"
L18: "cluster.go:125: ?[0;37mCONFIG_IPC_NS?[0m: ?[0;32menabled?[0m"
L19: "cluster.go:125: ?[0;37mCONFIG_UTS_NS?[0m: ?[0;32menabled?[0m"
L20: "cluster.go:125: ?[0;37mCONFIG_CPUSETS?[0m: ?[0;32menabled?[0m"
L21: "cluster.go:125: ?[0;37mCONFIG_MEMCG?[0m: ?[0;32menabled?[0m"
L22: "cluster.go:125: ?[0;37mCONFIG_INET?[0m: ?[0;32menabled?[0m"
L23: "cluster.go:125: ?[0;37mCONFIG_EXT4_FS?[0m: ?[0;32menabled (as module)?[0m"
L24: "cluster.go:125: ?[0;37mCONFIG_PROC_FS?[0m: ?[0;32menabled?[0m"
L25: "cluster.go:125: ?[0;37mCONFIG_NETFILTER_XT_TARGET_REDIRECT?[0m: ?[0;32menabled (as module)?[0m"
L26: "cluster.go:125: ?[0;37mCONFIG_NETFILTER_XT_MATCH_COMMENT?[0m: ?[0;32menabled (as module)?[0m"
L27: "cluster.go:125: ?[0;37mCONFIG_FAIR_GROUP_SCHED?[0m: ?[0;32menabled?[0m"
L28: "cluster.go:125: ?[0;37mCONFIG_CGROUPS?[0m: ?[0;32menabled?[0m"
L29: "cluster.go:125: ?[0;37mCONFIG_CGROUP_CPUACCT?[0m: ?[0;32menabled?[0m"
L30: "cluster.go:125: ?[0;37mCONFIG_CGROUP_DEVICE?[0m: ?[0;32menabled?[0m"
L31: "cluster.go:125: ?[0;37mCONFIG_CGROUP_FREEZER?[0m: ?[0;32menabled?[0m"
L32: "cluster.go:125: ?[0;37mCONFIG_CGROUP_PIDS?[0m: ?[0;32menabled?[0m"
L33: "cluster.go:125: ?[0;37mCONFIG_CGROUP_SCHED?[0m: ?[0;32menabled?[0m"
L34: "cluster.go:125: ?[0;37mCONFIG_OVERLAY_FS?[0m: ?[0;32menabled (as module)?[0m"
L35: "cluster.go:125: ?[0;37mCONFIG_AUFS_FS?[0m: ?[0;33mnot set - Required for aufs.?[0m"
L36: "cluster.go:125: ?[0;37mCONFIG_BLK_DEV_DM?[0m: ?[0;32menabled (as module)?[0m"
L37: "cluster.go:125: ?[0;37mCONFIG_CFS_BANDWIDTH?[0m: ?[0;32menabled?[0m"
L38: "cluster.go:125: ?[0;37mCONFIG_SECCOMP?[0m: ?[0;32menabled?[0m"
L39: "cluster.go:125: ?[0;37mCONFIG_SECCOMP_FILTER?[0m: ?[0;32menabled?[0m"
L40: "cluster.go:125: ?[0;37mOS?[0m: ?[0;32mLinux?[0m"
L41: "cluster.go:125: ?[0;37mCGROUPS_CPU?[0m: ?[0;32menabled?[0m"
L42: "cluster.go:125: ?[0;37mCGROUPS_CPUACCT?[0m: ?[0;32menabled?[0m"
L43: "cluster.go:125: ?[0;37mCGROUPS_CPUSET?[0m: ?[0;32menabled?[0m"
L44: "cluster.go:125: ?[0;37mCGROUPS_DEVICES?[0m: ?[0;32menabled?[0m"
L45: "cluster.go:125: ?[0;37mCGROUPS_FREEZER?[0m: ?[0;32menabled?[0m"
L46: "cluster.go:125: ?[0;37mCGROUPS_MEMORY?[0m: ?[0;32menabled?[0m"
L47: "cluster.go:125: ?[0;37mCGROUPS_PIDS?[0m: ?[0;32menabled?[0m"
L48: "cluster.go:125: ?[0;37mCGROUPS_HUGETLB?[0m: ?[0;32menabled?[0m"
L49: "cluster.go:125: ?[0;37mCGROUPS_BLKIO?[0m: ?[0;32menabled?[0m"
L50: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.10--2c4f7e4eb4__ could not be reached"
L51: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.10--2c4f7e4eb4__: lookup ci-4081.3.10--2c4f7e4eb4 on 168.63.129.16:53: no such host"
L52: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_"
L53: "cluster.go:125: [preflight] Some fatal errors occurred:"
L54: "cluster.go:125: [ERROR SystemVerification]: cgroups v1 support is deprecated and will be removed in a future release. Please migrate to cgroups v2. To explicitly enable cgroups v1 support for kubelet? v1.35 or newer, you must set the kubelet configuration option _FailCgroupV1_ to _false_. You must also explicitly skip this validation. For more information, see https://git.k8s.io/enhancements/keps/?sig-node/5573-remove-cgroup-v1"
L55: "cluster.go:125: [preflight] If you know what you are doing, you can make a check non-fatal with `--ignore-preflight-errors=...`"
L56: "cluster.go:125: error: error execution phase preflight: preflight checks failed"
L57: "cluster.go:125: To see the stack trace of this error execute with --v=5 or higher"
L58: "kubeadm.go:197: unable to setup cluster: unable to run master script: Process exited with status 1_"
L59: " "
```
Diagnostic output for azure, run 3
```
L1: " Error: _cluster.go:125: I0908 02:36:37.347576 2551 version.go:260] remote version is much newer: v1.37.0; falling back to: stable-1.35"
L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.35.8"
L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.35.8"
L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.35.8"
L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.35.8"
L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.13.1"
L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.1"
L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.6-0"
L9: "cluster.go:125: I0908 02:36:47.144321 2766 version.go:260] remote version is much newer: v1.37.0; falling back to: stable-1.35"
L10: "cluster.go:125: [init] Using Kubernetes version: v1.35.8"
L11: "cluster.go:125: [preflight] Running pre-flight checks"
L12: "cluster.go:125: [WARNING ContainerRuntimeVersion]: You must update your container runtime to a version that supports the CRI method RuntimeConfig. Falling back to using cgroupDriver from kubelet conf?ig will be removed in 1.36. For more information, see https://git.k8s.io/enhancements/keps/sig-node/4033-group-driver-detection-over-cri"
L13: "cluster.go:125: [preflight] The system verification failed. Printing the output from the verification:"
L14: "cluster.go:125: ?[0;37mKERNEL_VERSION?[0m: ?[0;32m6.6.156-flatcar?[0m"
L15: "cluster.go:125: ?[0;37mCONFIG_NAMESPACES?[0m: ?[0;32menabled?[0m"
L16: "cluster.go:125: ?[0;37mCONFIG_NET_NS?[0m: ?[0;32menabled?[0m"
L17: "cluster.go:125: ?[0;37mCONFIG_PID_NS?[0m: ?[0;32menabled?[0m"
L18: "cluster.go:125: ?[0;37mCONFIG_IPC_NS?[0m: ?[0;32menabled?[0m"
L19: "cluster.go:125: ?[0;37mCONFIG_UTS_NS?[0m: ?[0;32menabled?[0m"
L20: "cluster.go:125: ?[0;37mCONFIG_CPUSETS?[0m: ?[0;32menabled?[0m"
L21: "cluster.go:125: ?[0;37mCONFIG_MEMCG?[0m: ?[0;32menabled?[0m"
L22: "cluster.go:125: ?[0;37mCONFIG_INET?[0m: ?[0;32menabled?[0m"
L23: "cluster.go:125: ?[0;37mCONFIG_EXT4_FS?[0m: ?[0;32menabled (as module)?[0m"
L24: "cluster.go:125: ?[0;37mCONFIG_PROC_FS?[0m: ?[0;32menabled?[0m"
L25: "cluster.go:125: ?[0;37mCONFIG_NETFILTER_XT_TARGET_REDIRECT?[0m: ?[0;32menabled (as module)?[0m"
L26: "cluster.go:125: ?[0;37mCONFIG_NETFILTER_XT_MATCH_COMMENT?[0m: ?[0;32menabled (as module)?[0m"
L27: "cluster.go:125: ?[0;37mCONFIG_FAIR_GROUP_SCHED?[0m: ?[0;32menabled?[0m"
L28: "cluster.go:125: ?[0;37mCONFIG_CGROUPS?[0m: ?[0;32menabled?[0m"
L29: "cluster.go:125: ?[0;37mCONFIG_CGROUP_CPUACCT?[0m: ?[0;32menabled?[0m"
L30: "cluster.go:125: ?[0;37mCONFIG_CGROUP_DEVICE?[0m: ?[0;32menabled?[0m"
L31: "cluster.go:125: ?[0;37mCONFIG_CGROUP_FREEZER?[0m: ?[0;32menabled?[0m"
L32: "cluster.go:125: ?[0;37mCONFIG_CGROUP_PIDS?[0m: ?[0;32menabled?[0m"
L33: "cluster.go:125: ?[0;37mCONFIG_CGROUP_SCHED?[0m: ?[0;32menabled?[0m"
L34: "cluster.go:125: ?[0;37mCONFIG_OVERLAY_FS?[0m: ?[0;32menabled (as module)?[0m"
L35: "cluster.go:125: ?[0;37mCONFIG_AUFS_FS?[0m: ?[0;33mnot set - Required for aufs.?[0m"
L36: "cluster.go:125: ?[0;37mCONFIG_BLK_DEV_DM?[0m: ?[0;32menabled (as module)?[0m"
L37: "cluster.go:125: ?[0;37mCONFIG_CFS_BANDWIDTH?[0m: ?[0;32menabled?[0m"
L38: "cluster.go:125: ?[0;37mCONFIG_SECCOMP?[0m: ?[0;32menabled?[0m"
L39: "cluster.go:125: ?[0;37mCONFIG_SECCOMP_FILTER?[0m: ?[0;32menabled?[0m"
L40: "cluster.go:125: ?[0;37mOS?[0m: ?[0;32mLinux?[0m"
L41: "cluster.go:125: ?[0;37mCGROUPS_CPU?[0m: ?[0;32menabled?[0m"
L42: "cluster.go:125: ?[0;37mCGROUPS_CPUACCT?[0m: ?[0;32menabled?[0m"
L43: "cluster.go:125: ?[0;37mCGROUPS_CPUSET?[0m: ?[0;32menabled?[0m"
L44: "cluster.go:125: ?[0;37mCGROUPS_DEVICES?[0m: ?[0;32menabled?[0m"
L45: "cluster.go:125: ?[0;37mCGROUPS_FREEZER?[0m: ?[0;32menabled?[0m"
L46: "cluster.go:125: ?[0;37mCGROUPS_MEMORY?[0m: ?[0;32menabled?[0m"
L47: "cluster.go:125: ?[0;37mCGROUPS_PIDS?[0m: ?[0;32menabled?[0m"
L48: "cluster.go:125: ?[0;37mCGROUPS_HUGETLB?[0m: ?[0;32menabled?[0m"
L49: "cluster.go:125: ?[0;37mCGROUPS_BLKIO?[0m: ?[0;32menabled?[0m"
L50: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.10--ddf9377ca0__ could not be reached"
L51: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.10--ddf9377ca0__: lookup ci-4081.3.10--ddf9377ca0 on 168.63.129.16:53: no such host"
L52: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_"
L53: "cluster.go:125: [preflight] Some fatal errors occurred:"
L54: "cluster.go:125: [ERROR SystemVerification]: cgroups v1 support is deprecated and will be removed in a future release. Please migrate to cgroups v2. To explicitly enable cgroups v1 support for kubelet? v1.35 or newer, you must set the kubelet configuration option _FailCgroupV1_ to _false_. You must also explicitly skip this validation. For more information, see https://git.k8s.io/enhancements/keps/?sig-node/5573-remove-cgroup-v1"
L55: "cluster.go:125: [preflight] If you know what you are doing, you can make a check non-fatal with `--ignore-preflight-errors=...`"
L56: "cluster.go:125: error: error execution phase preflight: preflight checks failed"
L57: "cluster.go:125: To see the stack trace of this error execute with --v=5 or higher"
L58: "kubeadm.go:197: unable to setup cluster: unable to run master script: Process exited with status 1_"
L59: " "
```
Diagnostic output for azure, run 2
```
L1: " Error: _cluster.go:125: I0908 02:24:19.421300 2548 version.go:260] remote version is much newer: v1.37.0; falling back to: stable-1.35"
L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.35.8"
L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.35.8"
L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.35.8"
L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.35.8"
L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.13.1"
L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.1"
L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.6-0"
L9: "cluster.go:125: I0908 02:24:32.951871 2872 version.go:260] remote version is much newer: v1.37.0; falling back to: stable-1.35"
L10: "cluster.go:125: [init] Using Kubernetes version: v1.35.8"
L11: "cluster.go:125: [preflight] Running pre-flight checks"
L12: "cluster.go:125: [WARNING ContainerRuntimeVersion]: You must update your container runtime to a version that supports the CRI method RuntimeConfig. Falling back to using cgroupDriver from kubelet conf?ig will be removed in 1.36. For more information, see https://git.k8s.io/enhancements/keps/sig-node/4033-group-driver-detection-over-cri"
L13: "cluster.go:125: [preflight] The system verification failed. Printing the output from the verification:"
L14: "cluster.go:125: ?[0;37mKERNEL_VERSION?[0m: ?[0;32m6.6.156-flatcar?[0m"
L15: "cluster.go:125: ?[0;37mCONFIG_NAMESPACES?[0m: ?[0;32menabled?[0m"
L16: "cluster.go:125: ?[0;37mCONFIG_NET_NS?[0m: ?[0;32menabled?[0m"
L17: "cluster.go:125: ?[0;37mCONFIG_PID_NS?[0m: ?[0;32menabled?[0m"
L18: "cluster.go:125: ?[0;37mCONFIG_IPC_NS?[0m: ?[0;32menabled?[0m"
L19: "cluster.go:125: ?[0;37mCONFIG_UTS_NS?[0m: ?[0;32menabled?[0m"
L20: "cluster.go:125: ?[0;37mCONFIG_CPUSETS?[0m: ?[0;32menabled?[0m"
L21: "cluster.go:125: ?[0;37mCONFIG_MEMCG?[0m: ?[0;32menabled?[0m"
L22: "cluster.go:125: ?[0;37mCONFIG_INET?[0m: ?[0;32menabled?[0m"
L23: "cluster.go:125: ?[0;37mCONFIG_EXT4_FS?[0m: ?[0;32menabled (as module)?[0m"
L24: "cluster.go:125: ?[0;37mCONFIG_PROC_FS?[0m: ?[0;32menabled?[0m"
L25: "cluster.go:125: ?[0;37mCONFIG_NETFILTER_XT_TARGET_REDIRECT?[0m: ?[0;32menabled (as module)?[0m"
L26: "cluster.go:125: ?[0;37mCONFIG_NETFILTER_XT_MATCH_COMMENT?[0m: ?[0;32menabled (as module)?[0m"
L27: "cluster.go:125: ?[0;37mCONFIG_FAIR_GROUP_SCHED?[0m: ?[0;32menabled?[0m"
L28: "cluster.go:125: ?[0;37mCONFIG_CGROUPS?[0m: ?[0;32menabled?[0m"
L29: "cluster.go:125: ?[0;37mCONFIG_CGROUP_CPUACCT?[0m: ?[0;32menabled?[0m"
L30: "cluster.go:125: ?[0;37mCONFIG_CGROUP_DEVICE?[0m: ?[0;32menabled?[0m"
L31: "cluster.go:125: ?[0;37mCONFIG_CGROUP_FREEZER?[0m: ?[0;32menabled?[0m"
L32: "cluster.go:125: ?[0;37mCONFIG_CGROUP_PIDS?[0m: ?[0;32menabled?[0m"
L33: "cluster.go:125: ?[0;37mCONFIG_CGROUP_SCHED?[0m: ?[0;32menabled?[0m"
L34: "cluster.go:125: ?[0;37mCONFIG_OVERLAY_FS?[0m: ?[0;32menabled (as module)?[0m"
L35: "cluster.go:125: ?[0;37mCONFIG_AUFS_FS?[0m: ?[0;33mnot set - Required for aufs.?[0m"
L36: "cluster.go:125: ?[0;37mCONFIG_BLK_DEV_DM?[0m: ?[0;32menabled (as module)?[0m"
L37: "cluster.go:125: ?[0;37mCONFIG_CFS_BANDWIDTH?[0m: ?[0;32menabled?[0m"
L38: "cluster.go:125: ?[0;37mCONFIG_SECCOMP?[0m: ?[0;32menabled?[0m"
L39: "cluster.go:125: ?[0;37mCONFIG_SECCOMP_FILTER?[0m: ?[0;32menabled?[0m"
L40: "cluster.go:125: ?[0;37mOS?[0m: ?[0;32mLinux?[0m"
L41: "cluster.go:125: ?[0;37mCGROUPS_CPU?[0m: ?[0;32menabled?[0m"
L42: "cluster.go:125: ?[0;37mCGROUPS_CPUACCT?[0m: ?[0;32menabled?[0m"
L43: "cluster.go:125: ?[0;37mCGROUPS_CPUSET?[0m: ?[0;32menabled?[0m"
L44: "cluster.go:125: ?[0;37mCGROUPS_DEVICES?[0m: ?[0;32menabled?[0m"
L45: "cluster.go:125: ?[0;37mCGROUPS_FREEZER?[0m: ?[0;32menabled?[0m"
L46: "cluster.go:125: ?[0;37mCGROUPS_MEMORY?[0m: ?[0;32menabled?[0m"
L47: "cluster.go:125: ?[0;37mCGROUPS_PIDS?[0m: ?[0;32menabled?[0m"
L48: "cluster.go:125: ?[0;37mCGROUPS_HUGETLB?[0m: ?[0;32menabled?[0m"
L49: "cluster.go:125: ?[0;37mCGROUPS_BLKIO?[0m: ?[0;32menabled?[0m"
L50: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.10--b36f5f2726__ could not be reached"
L51: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.10--b36f5f2726__: lookup ci-4081.3.10--b36f5f2726 on 168.63.129.16:53: no such host"
L52: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_"
L53: "cluster.go:125: [preflight] Some fatal errors occurred:"
L54: "cluster.go:125: [ERROR SystemVerification]: cgroups v1 support is deprecated and will be removed in a future release. Please migrate to cgroups v2. To explicitly enable cgroups v1 support for kubelet? v1.35 or newer, you must set the kubelet configuration option _FailCgroupV1_ to _false_. You must also explicitly skip this validation. For more information, see https://git.k8s.io/enhancements/keps/?sig-node/5573-remove-cgroup-v1"
L55: "cluster.go:125: [preflight] If you know what you are doing, you can make a check non-fatal with `--ignore-preflight-errors=...`"
L56: "cluster.go:125: error: error execution phase preflight: preflight checks failed"
L57: "cluster.go:125: To see the stack trace of this error execute with --v=5 or higher"
L58: "kubeadm.go:197: unable to setup cluster: unable to run master script: Process exited with status 1_"
L59: " "
```
Diagnostic output for azure, run 1
```
L1: " Error: _cluster.go:125: I0908 02:04:58.005359 2535 version.go:260] remote version is much newer: v1.37.0; falling back to: stable-1.35"
L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.35.8"
L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.35.8"
L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.35.8"
L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.35.8"
L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.13.1"
L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.1"
L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.6-0"
L9: "cluster.go:125: I0908 02:05:07.468741 2789 version.go:260] remote version is much newer: v1.37.0; falling back to: stable-1.35"
L10: "cluster.go:125: [init] Using Kubernetes version: v1.35.8"
L11: "cluster.go:125: [preflight] Running pre-flight checks"
L12: "cluster.go:125: [WARNING ContainerRuntimeVersion]: You must update your container runtime to a version that supports the CRI method RuntimeConfig. Falling back to using cgroupDriver from kubelet conf?ig will be removed in 1.36. For more information, see https://git.k8s.io/enhancements/keps/sig-node/4033-group-driver-detection-over-cri"
L13: "cluster.go:125: [preflight] The system verification failed. Printing the output from the verification:"
L14: "cluster.go:125: ?[0;37mKERNEL_VERSION?[0m: ?[0;32m6.6.156-flatcar?[0m"
L15: "cluster.go:125: ?[0;37mCONFIG_NAMESPACES?[0m: ?[0;32menabled?[0m"
L16: "cluster.go:125: ?[0;37mCONFIG_NET_NS?[0m: ?[0;32menabled?[0m"
L17: "cluster.go:125: ?[0;37mCONFIG_PID_NS?[0m: ?[0;32menabled?[0m"
L18: "cluster.go:125: ?[0;37mCONFIG_IPC_NS?[0m: ?[0;32menabled?[0m"
L19: "cluster.go:125: ?[0;37mCONFIG_UTS_NS?[0m: ?[0;32menabled?[0m"
L20: "cluster.go:125: ?[0;37mCONFIG_CPUSETS?[0m: ?[0;32menabled?[0m"
L21: "cluster.go:125: ?[0;37mCONFIG_MEMCG?[0m: ?[0;32menabled?[0m"
L22: "cluster.go:125: ?[0;37mCONFIG_INET?[0m: ?[0;32menabled?[0m"
L23: "cluster.go:125: ?[0;37mCONFIG_EXT4_FS?[0m: ?[0;32menabled (as module)?[0m"
L24: "cluster.go:125: ?[0;37mCONFIG_PROC_FS?[0m: ?[0;32menabled?[0m"
L25: "cluster.go:125: ?[0;37mCONFIG_NETFILTER_XT_TARGET_REDIRECT?[0m: ?[0;32menabled (as module)?[0m"
L26: "cluster.go:125: ?[0;37mCONFIG_NETFILTER_XT_MATCH_COMMENT?[0m: ?[0;32menabled (as module)?[0m"
L27: "cluster.go:125: ?[0;37mCONFIG_FAIR_GROUP_SCHED?[0m: ?[0;32menabled?[0m"
L28: "cluster.go:125: ?[0;37mCONFIG_CGROUPS?[0m: ?[0;32menabled?[0m"
L29: "cluster.go:125: ?[0;37mCONFIG_CGROUP_CPUACCT?[0m: ?[0;32menabled?[0m"
L30: "cluster.go:125: ?[0;37mCONFIG_CGROUP_DEVICE?[0m: ?[0;32menabled?[0m"
L31: "cluster.go:125: ?[0;37mCONFIG_CGROUP_FREEZER?[0m: ?[0;32menabled?[0m"
L32: "cluster.go:125: ?[0;37mCONFIG_CGROUP_PIDS?[0m: ?[0;32menabled?[0m"
L33: "cluster.go:125: ?[0;37mCONFIG_CGROUP_SCHED?[0m: ?[0;32menabled?[0m"
L34: "cluster.go:125: ?[0;37mCONFIG_OVERLAY_FS?[0m: ?[0;32menabled (as module)?[0m"
L35: "cluster.go:125: ?[0;37mCONFIG_AUFS_FS?[0m: ?[0;33mnot set - Required for aufs.?[0m"
L36: "cluster.go:125: ?[0;37mCONFIG_BLK_DEV_DM?[0m: ?[0;32menabled (as module)?[0m"
L37: "cluster.go:125: ?[0;37mCONFIG_CFS_BANDWIDTH?[0m: ?[0;32menabled?[0m"
L38: "cluster.go:125: ?[0;37mCONFIG_SECCOMP?[0m: ?[0;32menabled?[0m"
L39: "cluster.go:125: ?[0;37mCONFIG_SECCOMP_FILTER?[0m: ?[0;32menabled?[0m"
L40: "cluster.go:125: ?[0;37mOS?[0m: ?[0;32mLinux?[0m"
L41: "cluster.go:125: ?[0;37mCGROUPS_CPU?[0m: ?[0;32menabled?[0m"
L42: "cluster.go:125: ?[0;37mCGROUPS_CPUACCT?[0m: ?[0;32menabled?[0m"
L43: "cluster.go:125: ?[0;37mCGROUPS_CPUSET?[0m: ?[0;32menabled?[0m"
L44: "cluster.go:125: ?[0;37mCGROUPS_DEVICES?[0m: ?[0;32menabled?[0m"
L45: "cluster.go:125: ?[0;37mCGROUPS_FREEZER?[0m: ?[0;32menabled?[0m"
L46: "cluster.go:125: ?[0;37mCGROUPS_MEMORY?[0m: ?[0;32menabled?[0m"
L47: "cluster.go:125: ?[0;37mCGROUPS_PIDS?[0m: ?[0;32menabled?[0m"
L48: "cluster.go:125: ?[0;37mCGROUPS_HUGETLB?[0m: ?[0;32menabled?[0m"
L49: "cluster.go:125: ?[0;37mCGROUPS_BLKIO?[0m: ?[0;32menabled?[0m"
L50: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.10--178bf02a7b__ could not be reached"
L51: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.10--178bf02a7b__: lookup ci-4081.3.10--178bf02a7b on 168.63.129.16:53: no such host"
L52: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_"
L53: "cluster.go:125: [preflight] Some fatal errors occurred:"
L54: "cluster.go:125: [ERROR SystemVerification]: cgroups v1 support is deprecated and will be removed in a future release. Please migrate to cgroups v2. To explicitly enable cgroups v1 support for kubelet? v1.35 or newer, you must set the kubelet configuration option _FailCgroupV1_ to _false_. You must also explicitly skip this validation. For more information, see https://git.k8s.io/enhancements/keps/?sig-node/5573-remove-cgroup-v1"
L55: "cluster.go:125: [preflight] If you know what you are doing, you can make a check non-fatal with `--ignore-preflight-errors=...`"
L56: "cluster.go:125: error: error execution phase preflight: preflight checks failed"
L57: "cluster.go:125: To see the stack trace of this error execute with --v=5 or higher"
L58: "kubeadm.go:197: unable to setup cluster: unable to run master script: Process exited with status 1_"
L59: " "
```
🟢 ok **kubeadm.v1.35.1.flannel.base**; Succeeded: azure (1)
❌ not ok **kubeadm.v1.35.1.flannel.cgroupv1.base**; Failed: azure (1, 2, 3, 4, 5)
Diagnostic output for azure, run 5
```
L1: " Error: _kubeadm.go:197: unable to setup cluster: unable to create master node: creating nic: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kola-clu?ster-image-ec9a7228a9/providers/Microsoft.Network/networkInterfaces/nic-6132228339"
L2: "--------------------------------------------------------------------------------"
L3: "RESPONSE 409: 409 Conflict"
L4: "ERROR CODE: ResourceGroupBeingDeleted"
L5: "--------------------------------------------------------------------------------"
L6: "{"
L7: "__error__: {"
L8: "__code__: __ResourceGroupBeingDeleted__,"
L9: "__message__: __The resource group _kola-cluster-image-ec9a7228a9_ is in deprovisioning state and cannot perform this operation.__"
L10: "}"
L11: "}"
L12: "--------------------------------------------------------------------------------_"
L13: " "
```
Diagnostic output for azure, run 4
```
L1: " Error: _cluster.go:125: I0908 02:43:48.422904 2513 version.go:260] remote version is much newer: v1.37.0; falling back to: stable-1.35"
L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.35.8"
L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.35.8"
L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.35.8"
L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.35.8"
L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.13.1"
L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.1"
L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.6-0"
L9: "cluster.go:125: I0908 02:43:57.329762 2767 version.go:260] remote version is much newer: v1.37.0; falling back to: stable-1.35"
L10: "cluster.go:125: [init] Using Kubernetes version: v1.35.8"
L11: "cluster.go:125: [preflight] Running pre-flight checks"
L12: "cluster.go:125: [WARNING ContainerRuntimeVersion]: You must update your container runtime to a version that supports the CRI method RuntimeConfig. Falling back to using cgroupDriver from kubelet conf?ig will be removed in 1.36. For more information, see https://git.k8s.io/enhancements/keps/sig-node/4033-group-driver-detection-over-cri"
L13: "cluster.go:125: [preflight] The system verification failed. Printing the output from the verification:"
L14: "cluster.go:125: ?[0;37mKERNEL_VERSION?[0m: ?[0;32m6.6.156-flatcar?[0m"
L15: "cluster.go:125: ?[0;37mCONFIG_NAMESPACES?[0m: ?[0;32menabled?[0m"
L16: "cluster.go:125: ?[0;37mCONFIG_NET_NS?[0m: ?[0;32menabled?[0m"
L17: "cluster.go:125: ?[0;37mCONFIG_PID_NS?[0m: ?[0;32menabled?[0m"
L18: "cluster.go:125: ?[0;37mCONFIG_IPC_NS?[0m: ?[0;32menabled?[0m"
L19: "cluster.go:125: ?[0;37mCONFIG_UTS_NS?[0m: ?[0;32menabled?[0m"
L20: "cluster.go:125: ?[0;37mCONFIG_CPUSETS?[0m: ?[0;32menabled?[0m"
L21: "cluster.go:125: ?[0;37mCONFIG_MEMCG?[0m: ?[0;32menabled?[0m"
L22: "cluster.go:125: ?[0;37mCONFIG_INET?[0m: ?[0;32menabled?[0m"
L23: "cluster.go:125: ?[0;37mCONFIG_EXT4_FS?[0m: ?[0;32menabled (as module)?[0m"
L24: "cluster.go:125: ?[0;37mCONFIG_PROC_FS?[0m: ?[0;32menabled?[0m"
L25: "cluster.go:125: ?[0;37mCONFIG_NETFILTER_XT_TARGET_REDIRECT?[0m: ?[0;32menabled (as module)?[0m"
L26: "cluster.go:125: ?[0;37mCONFIG_NETFILTER_XT_MATCH_COMMENT?[0m: ?[0;32menabled (as module)?[0m"
L27: "cluster.go:125: ?[0;37mCONFIG_FAIR_GROUP_SCHED?[0m: ?[0;32menabled?[0m"
L28: "cluster.go:125: ?[0;37mCONFIG_CGROUPS?[0m: ?[0;32menabled?[0m"
L29: "cluster.go:125: ?[0;37mCONFIG_CGROUP_CPUACCT?[0m: ?[0;32menabled?[0m"
L30: "cluster.go:125: ?[0;37mCONFIG_CGROUP_DEVICE?[0m: ?[0;32menabled?[0m"
L31: "cluster.go:125: ?[0;37mCONFIG_CGROUP_FREEZER?[0m: ?[0;32menabled?[0m"
L32: "cluster.go:125: ?[0;37mCONFIG_CGROUP_PIDS?[0m: ?[0;32menabled?[0m"
L33: "cluster.go:125: ?[0;37mCONFIG_CGROUP_SCHED?[0m: ?[0;32menabled?[0m"
L34: "cluster.go:125: ?[0;37mCONFIG_OVERLAY_FS?[0m: ?[0;32menabled (as module)?[0m"
L35: "cluster.go:125: ?[0;37mCONFIG_AUFS_FS?[0m: ?[0;33mnot set - Required for aufs.?[0m"
L36: "cluster.go:125: ?[0;37mCONFIG_BLK_DEV_DM?[0m: ?[0;32menabled (as module)?[0m"
L37: "cluster.go:125: ?[0;37mCONFIG_CFS_BANDWIDTH?[0m: ?[0;32menabled?[0m"
L38: "cluster.go:125: ?[0;37mCONFIG_SECCOMP?[0m: ?[0;32menabled?[0m"
L39: "cluster.go:125: ?[0;37mCONFIG_SECCOMP_FILTER?[0m: ?[0;32menabled?[0m"
L40: "cluster.go:125: ?[0;37mOS?[0m: ?[0;32mLinux?[0m"
L41: "cluster.go:125: ?[0;37mCGROUPS_CPU?[0m: ?[0;32menabled?[0m"
L42: "cluster.go:125: ?[0;37mCGROUPS_CPUACCT?[0m: ?[0;32menabled?[0m"
L43: "cluster.go:125: ?[0;37mCGROUPS_CPUSET?[0m: ?[0;32menabled?[0m"
L44: "cluster.go:125: ?[0;37mCGROUPS_DEVICES?[0m: ?[0;32menabled?[0m"
L45: "cluster.go:125: ?[0;37mCGROUPS_FREEZER?[0m: ?[0;32menabled?[0m"
L46: "cluster.go:125: ?[0;37mCGROUPS_MEMORY?[0m: ?[0;32menabled?[0m"
L47: "cluster.go:125: ?[0;37mCGROUPS_PIDS?[0m: ?[0;32menabled?[0m"
L48: "cluster.go:125: ?[0;37mCGROUPS_HUGETLB?[0m: ?[0;32menabled?[0m"
L49: "cluster.go:125: ?[0;37mCGROUPS_BLKIO?[0m: ?[0;32menabled?[0m"
L50: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.10--b103603b01__ could not be reached"
L51: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.10--b103603b01__: lookup ci-4081.3.10--b103603b01 on 168.63.129.16:53: no such host"
L52: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_"
L53: "cluster.go:125: [preflight] Some fatal errors occurred:"
L54: "cluster.go:125: [ERROR SystemVerification]: cgroups v1 support is deprecated and will be removed in a future release. Please migrate to cgroups v2. To explicitly enable cgroups v1 support for kubelet? v1.35 or newer, you must set the kubelet configuration option _FailCgroupV1_ to _false_. You must also explicitly skip this validation. For more information, see https://git.k8s.io/enhancements/keps/?sig-node/5573-remove-cgroup-v1"
L55: "cluster.go:125: [preflight] If you know what you are doing, you can make a check non-fatal with `--ignore-preflight-errors=...`"
L56: "cluster.go:125: error: error execution phase preflight: preflight checks failed"
L57: "cluster.go:125: To see the stack trace of this error execute with --v=5 or higher"
L58: "kubeadm.go:197: unable to setup cluster: unable to run master script: Process exited with status 1_"
L59: " "
```
Diagnostic output for azure, run 3
```
L1: " Error: _cluster.go:125: I0908 02:36:31.116821 2491 version.go:260] remote version is much newer: v1.37.0; falling back to: stable-1.35"
L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.35.8"
L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.35.8"
L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.35.8"
L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.35.8"
L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.13.1"
L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.1"
L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.6-0"
L9: "cluster.go:125: I0908 02:36:39.519134 2686 version.go:260] remote version is much newer: v1.37.0; falling back to: stable-1.35"
L10: "cluster.go:125: [init] Using Kubernetes version: v1.35.8"
L11: "cluster.go:125: [preflight] Running pre-flight checks"
L12: "cluster.go:125: [WARNING ContainerRuntimeVersion]: You must update your container runtime to a version that supports the CRI method RuntimeConfig. Falling back to using cgroupDriver from kubelet conf?ig will be removed in 1.36. For more information, see https://git.k8s.io/enhancements/keps/sig-node/4033-group-driver-detection-over-cri"
L13: "cluster.go:125: [preflight] The system verification failed. Printing the output from the verification:"
L14: "cluster.go:125: ?[0;37mKERNEL_VERSION?[0m: ?[0;32m6.6.156-flatcar?[0m"
L15: "cluster.go:125: ?[0;37mCONFIG_NAMESPACES?[0m: ?[0;32menabled?[0m"
L16: "cluster.go:125: ?[0;37mCONFIG_NET_NS?[0m: ?[0;32menabled?[0m"
L17: "cluster.go:125: ?[0;37mCONFIG_PID_NS?[0m: ?[0;32menabled?[0m"
L18: "cluster.go:125: ?[0;37mCONFIG_IPC_NS?[0m: ?[0;32menabled?[0m"
L19: "cluster.go:125: ?[0;37mCONFIG_UTS_NS?[0m: ?[0;32menabled?[0m"
L20: "cluster.go:125: ?[0;37mCONFIG_CPUSETS?[0m: ?[0;32menabled?[0m"
L21: "cluster.go:125: ?[0;37mCONFIG_MEMCG?[0m: ?[0;32menabled?[0m"
L22: "cluster.go:125: ?[0;37mCONFIG_INET?[0m: ?[0;32menabled?[0m"
L23: "cluster.go:125: ?[0;37mCONFIG_EXT4_FS?[0m: ?[0;32menabled (as module)?[0m"
L24: "cluster.go:125: ?[0;37mCONFIG_PROC_FS?[0m: ?[0;32menabled?[0m"
L25: "cluster.go:125: ?[0;37mCONFIG_NETFILTER_XT_TARGET_REDIRECT?[0m: ?[0;32menabled (as module)?[0m"
L26: "cluster.go:125: ?[0;37mCONFIG_NETFILTER_XT_MATCH_COMMENT?[0m: ?[0;32menabled (as module)?[0m"
L27: "cluster.go:125: ?[0;37mCONFIG_FAIR_GROUP_SCHED?[0m: ?[0;32menabled?[0m"
L28: "cluster.go:125: ?[0;37mCONFIG_CGROUPS?[0m: ?[0;32menabled?[0m"
L29: "cluster.go:125: ?[0;37mCONFIG_CGROUP_CPUACCT?[0m: ?[0;32menabled?[0m"
L30: "cluster.go:125: ?[0;37mCONFIG_CGROUP_DEVICE?[0m: ?[0;32menabled?[0m"
L31: "cluster.go:125: ?[0;37mCONFIG_CGROUP_FREEZER?[0m: ?[0;32menabled?[0m"
L32: "cluster.go:125: ?[0;37mCONFIG_CGROUP_PIDS?[0m: ?[0;32menabled?[0m"
L33: "cluster.go:125: ?[0;37mCONFIG_CGROUP_SCHED?[0m: ?[0;32menabled?[0m"
L34: "cluster.go:125: ?[0;37mCONFIG_OVERLAY_FS?[0m: ?[0;32menabled (as module)?[0m"
L35: "cluster.go:125: ?[0;37mCONFIG_AUFS_FS?[0m: ?[0;33mnot set - Required for aufs.?[0m"
L36: "cluster.go:125: ?[0;37mCONFIG_BLK_DEV_DM?[0m: ?[0;32menabled (as module)?[0m"
L37: "cluster.go:125: ?[0;37mCONFIG_CFS_BANDWIDTH?[0m: ?[0;32menabled?[0m"
L38: "cluster.go:125: ?[0;37mCONFIG_SECCOMP?[0m: ?[0;32menabled?[0m"
L39: "cluster.go:125: ?[0;37mCONFIG_SECCOMP_FILTER?[0m: ?[0;32menabled?[0m"
L40: "cluster.go:125: ?[0;37mOS?[0m: ?[0;32mLinux?[0m"
L41: "cluster.go:125: ?[0;37mCGROUPS_CPU?[0m: ?[0;32menabled?[0m"
L42: "cluster.go:125: ?[0;37mCGROUPS_CPUACCT?[0m: ?[0;32menabled?[0m"
L43: "cluster.go:125: ?[0;37mCGROUPS_CPUSET?[0m: ?[0;32menabled?[0m"
L44: "cluster.go:125: ?[0;37mCGROUPS_DEVICES?[0m: ?[0;32menabled?[0m"
L45: "cluster.go:125: ?[0;37mCGROUPS_FREEZER?[0m: ?[0;32menabled?[0m"
L46: "cluster.go:125: ?[0;37mCGROUPS_MEMORY?[0m: ?[0;32menabled?[0m"
L47: "cluster.go:125: ?[0;37mCGROUPS_PIDS?[0m: ?[0;32menabled?[0m"
L48: "cluster.go:125: ?[0;37mCGROUPS_HUGETLB?[0m: ?[0;32menabled?[0m"
L49: "cluster.go:125: ?[0;37mCGROUPS_BLKIO?[0m: ?[0;32menabled?[0m"
L50: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.10--79381a99d9__ could not be reached"
L51: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.10--79381a99d9__: lookup ci-4081.3.10--79381a99d9 on 168.63.129.16:53: no such host"
L52: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_"
L53: "cluster.go:125: [preflight] Some fatal errors occurred:"
L54: "cluster.go:125: [ERROR SystemVerification]: cgroups v1 support is deprecated and will be removed in a future release. Please migrate to cgroups v2. To explicitly enable cgroups v1 support for kubelet? v1.35 or newer, you must set the kubelet configuration option _FailCgroupV1_ to _false_. You must also explicitly skip this validation. For more information, see https://git.k8s.io/enhancements/keps/?sig-node/5573-remove-cgroup-v1"
L55: "cluster.go:125: [preflight] If you know what you are doing, you can make a check non-fatal with `--ignore-preflight-errors=...`"
L56: "cluster.go:125: error: error execution phase preflight: preflight checks failed"
L57: "cluster.go:125: To see the stack trace of this error execute with --v=5 or higher"
L58: "kubeadm.go:197: unable to setup cluster: unable to run master script: Process exited with status 1_"
L59: " "
```
Diagnostic output for azure, run 2
```
L1: " Error: _cluster.go:125: I0908 02:24:33.808024 2505 version.go:260] remote version is much newer: v1.37.0; falling back to: stable-1.35"
L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.35.8"
L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.35.8"
L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.35.8"
L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.35.8"
L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.13.1"
L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.1"
L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.6-0"
L9: "cluster.go:125: I0908 02:24:43.643050 2764 version.go:260] remote version is much newer: v1.37.0; falling back to: stable-1.35"
L10: "cluster.go:125: [init] Using Kubernetes version: v1.35.8"
L11: "cluster.go:125: [preflight] Running pre-flight checks"
L12: "cluster.go:125: [WARNING ContainerRuntimeVersion]: You must update your container runtime to a version that supports the CRI method RuntimeConfig. Falling back to using cgroupDriver from kubelet conf?ig will be removed in 1.36. For more information, see https://git.k8s.io/enhancements/keps/sig-node/4033-group-driver-detection-over-cri"
L13: "cluster.go:125: [preflight] The system verification failed. Printing the output from the verification:"
L14: "cluster.go:125: ?[0;37mKERNEL_VERSION?[0m: ?[0;32m6.6.156-flatcar?[0m"
L15: "cluster.go:125: ?[0;37mCONFIG_NAMESPACES?[0m: ?[0;32menabled?[0m"
L16: "cluster.go:125: ?[0;37mCONFIG_NET_NS?[0m: ?[0;32menabled?[0m"
L17: "cluster.go:125: ?[0;37mCONFIG_PID_NS?[0m: ?[0;32menabled?[0m"
L18: "cluster.go:125: ?[0;37mCONFIG_IPC_NS?[0m: ?[0;32menabled?[0m"
L19: "cluster.go:125: ?[0;37mCONFIG_UTS_NS?[0m: ?[0;32menabled?[0m"
L20: "cluster.go:125: ?[0;37mCONFIG_CPUSETS?[0m: ?[0;32menabled?[0m"
L21: "cluster.go:125: ?[0;37mCONFIG_MEMCG?[0m: ?[0;32menabled?[0m"
L22: "cluster.go:125: ?[0;37mCONFIG_INET?[0m: ?[0;32menabled?[0m"
L23: "cluster.go:125: ?[0;37mCONFIG_EXT4_FS?[0m: ?[0;32menabled (as module)?[0m"
L24: "cluster.go:125: ?[0;37mCONFIG_PROC_FS?[0m: ?[0;32menabled?[0m"
L25: "cluster.go:125: ?[0;37mCONFIG_NETFILTER_XT_TARGET_REDIRECT?[0m: ?[0;32menabled (as module)?[0m"
L26: "cluster.go:125: ?[0;37mCONFIG_NETFILTER_XT_MATCH_COMMENT?[0m: ?[0;32menabled (as module)?[0m"
L27: "cluster.go:125: ?[0;37mCONFIG_FAIR_GROUP_SCHED?[0m: ?[0;32menabled?[0m"
L28: "cluster.go:125: ?[0;37mCONFIG_CGROUPS?[0m: ?[0;32menabled?[0m"
L29: "cluster.go:125: ?[0;37mCONFIG_CGROUP_CPUACCT?[0m: ?[0;32menabled?[0m"
L30: "cluster.go:125: ?[0;37mCONFIG_CGROUP_DEVICE?[0m: ?[0;32menabled?[0m"
L31: "cluster.go:125: ?[0;37mCONFIG_CGROUP_FREEZER?[0m: ?[0;32menabled?[0m"
L32: "cluster.go:125: ?[0;37mCONFIG_CGROUP_PIDS?[0m: ?[0;32menabled?[0m"
L33: "cluster.go:125: ?[0;37mCONFIG_CGROUP_SCHED?[0m: ?[0;32menabled?[0m"
L34: "cluster.go:125: ?[0;37mCONFIG_OVERLAY_FS?[0m: ?[0;32menabled (as module)?[0m"
L35: "cluster.go:125: ?[0;37mCONFIG_AUFS_FS?[0m: ?[0;33mnot set - Required for aufs.?[0m"
L36: "cluster.go:125: ?[0;37mCONFIG_BLK_DEV_DM?[0m: ?[0;32menabled (as module)?[0m"
L37: "cluster.go:125: ?[0;37mCONFIG_CFS_BANDWIDTH?[0m: ?[0;32menabled?[0m"
L38: "cluster.go:125: ?[0;37mCONFIG_SECCOMP?[0m: ?[0;32menabled?[0m"
L39: "cluster.go:125: ?[0;37mCONFIG_SECCOMP_FILTER?[0m: ?[0;32menabled?[0m"
L40: "cluster.go:125: ?[0;37mOS?[0m: ?[0;32mLinux?[0m"
L41: "cluster.go:125: ?[0;37mCGROUPS_CPU?[0m: ?[0;32menabled?[0m"
L42: "cluster.go:125: ?[0;37mCGROUPS_CPUACCT?[0m: ?[0;32menabled?[0m"
L43: "cluster.go:125: ?[0;37mCGROUPS_CPUSET?[0m: ?[0;32menabled?[0m"
L44: "cluster.go:125: ?[0;37mCGROUPS_DEVICES?[0m: ?[0;32menabled?[0m"
L45: "cluster.go:125: ?[0;37mCGROUPS_FREEZER?[0m: ?[0;32menabled?[0m"
L46: "cluster.go:125: ?[0;37mCGROUPS_MEMORY?[0m: ?[0;32menabled?[0m"
L47: "cluster.go:125: ?[0;37mCGROUPS_PIDS?[0m: ?[0;32menabled?[0m"
L48: "cluster.go:125: ?[0;37mCGROUPS_HUGETLB?[0m: ?[0;32menabled?[0m"
L49: "cluster.go:125: ?[0;37mCGROUPS_BLKIO?[0m: ?[0;32menabled?[0m"
L50: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.10--5d3b21bc8f__ could not be reached"
L51: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.10--5d3b21bc8f__: lookup ci-4081.3.10--5d3b21bc8f on 168.63.129.16:53: no such host"
L52: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_"
L53: "cluster.go:125: [preflight] Some fatal errors occurred:"
L54: "cluster.go:125: [ERROR SystemVerification]: cgroups v1 support is deprecated and will be removed in a future release. Please migrate to cgroups v2. To explicitly enable cgroups v1 support for kubelet? v1.35 or newer, you must set the kubelet configuration option _FailCgroupV1_ to _false_. You must also explicitly skip this validation. For more information, see https://git.k8s.io/enhancements/keps/?sig-node/5573-remove-cgroup-v1"
L55: "cluster.go:125: [preflight] If you know what you are doing, you can make a check non-fatal with `--ignore-preflight-errors=...`"
L56: "cluster.go:125: error: error execution phase preflight: preflight checks failed"
L57: "cluster.go:125: To see the stack trace of this error execute with --v=5 or higher"
L58: "kubeadm.go:197: unable to setup cluster: unable to run master script: Process exited with status 1_"
L59: " "
```
Diagnostic output for azure, run 1
```
L1: " Error: _cluster.go:125: I0908 02:00:03.064542 2497 version.go:260] remote version is much newer: v1.37.0; falling back to: stable-1.35"
L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.35.8"
L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.35.8"
L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.35.8"
L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.35.8"
L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.13.1"
L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.1"
L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.6-0"
L9: "cluster.go:125: I0908 02:00:44.286907 2820 version.go:260] remote version is much newer: v1.37.0; falling back to: stable-1.35"
L10: "cluster.go:125: [init] Using Kubernetes version: v1.35.8"
L11: "cluster.go:125: [preflight] Running pre-flight checks"
L12: "cluster.go:125: [WARNING ContainerRuntimeVersion]: You must update your container runtime to a version that supports the CRI method RuntimeConfig. Falling back to using cgroupDriver from kubelet conf?ig will be removed in 1.36. For more information, see https://git.k8s.io/enhancements/keps/sig-node/4033-group-driver-detection-over-cri"
L13: "cluster.go:125: [preflight] The system verification failed. Printing the output from the verification:"
L14: "cluster.go:125: ?[0;37mKERNEL_VERSION?[0m: ?[0;32m6.6.156-flatcar?[0m"
L15: "cluster.go:125: ?[0;37mCONFIG_NAMESPACES?[0m: ?[0;32menabled?[0m"
L16: "cluster.go:125: ?[0;37mCONFIG_NET_NS?[0m: ?[0;32menabled?[0m"
L17: "cluster.go:125: ?[0;37mCONFIG_PID_NS?[0m: ?[0;32menabled?[0m"
L18: "cluster.go:125: ?[0;37mCONFIG_IPC_NS?[0m: ?[0;32menabled?[0m"
L19: "cluster.go:125: ?[0;37mCONFIG_UTS_NS?[0m: ?[0;32menabled?[0m"
L20: "cluster.go:125: ?[0;37mCONFIG_CPUSETS?[0m: ?[0;32menabled?[0m"
L21: "cluster.go:125: ?[0;37mCONFIG_MEMCG?[0m: ?[0;32menabled?[0m"
L22: "cluster.go:125: ?[0;37mCONFIG_INET?[0m: ?[0;32menabled?[0m"
L23: "cluster.go:125: ?[0;37mCONFIG_EXT4_FS?[0m: ?[0;32menabled (as module)?[0m"
L24: "cluster.go:125: ?[0;37mCONFIG_PROC_FS?[0m: ?[0;32menabled?[0m"
L25: "cluster.go:125: ?[0;37mCONFIG_NETFILTER_XT_TARGET_REDIRECT?[0m: ?[0;32menabled (as module)?[0m"
L26: "cluster.go:125: ?[0;37mCONFIG_NETFILTER_XT_MATCH_COMMENT?[0m: ?[0;32menabled (as module)?[0m"
L27: "cluster.go:125: ?[0;37mCONFIG_FAIR_GROUP_SCHED?[0m: ?[0;32menabled?[0m"
L28: "cluster.go:125: ?[0;37mCONFIG_CGROUPS?[0m: ?[0;32menabled?[0m"
L29: "cluster.go:125: ?[0;37mCONFIG_CGROUP_CPUACCT?[0m: ?[0;32menabled?[0m"
L30: "cluster.go:125: ?[0;37mCONFIG_CGROUP_DEVICE?[0m: ?[0;32menabled?[0m"
L31: "cluster.go:125: ?[0;37mCONFIG_CGROUP_FREEZER?[0m: ?[0;32menabled?[0m"
L32: "cluster.go:125: ?[0;37mCONFIG_CGROUP_PIDS?[0m: ?[0;32menabled?[0m"
L33: "cluster.go:125: ?[0;37mCONFIG_CGROUP_SCHED?[0m: ?[0;32menabled?[0m"
L34: "cluster.go:125: ?[0;37mCONFIG_OVERLAY_FS?[0m: ?[0;32menabled (as module)?[0m"
L35: "cluster.go:125: ?[0;37mCONFIG_AUFS_FS?[0m: ?[0;33mnot set - Required for aufs.?[0m"
L36: "cluster.go:125: ?[0;37mCONFIG_BLK_DEV_DM?[0m: ?[0;32menabled (as module)?[0m"
L37: "cluster.go:125: ?[0;37mCONFIG_CFS_BANDWIDTH?[0m: ?[0;32menabled?[0m"
L38: "cluster.go:125: ?[0;37mCONFIG_SECCOMP?[0m: ?[0;32menabled?[0m"
L39: "cluster.go:125: ?[0;37mCONFIG_SECCOMP_FILTER?[0m: ?[0;32menabled?[0m"
L40: "cluster.go:125: ?[0;37mOS?[0m: ?[0;32mLinux?[0m"
L41: "cluster.go:125: ?[0;37mCGROUPS_CPU?[0m: ?[0;32menabled?[0m"
L42: "cluster.go:125: ?[0;37mCGROUPS_CPUACCT?[0m: ?[0;32menabled?[0m"
L43: "cluster.go:125: ?[0;37mCGROUPS_CPUSET?[0m: ?[0;32menabled?[0m"
L44: "cluster.go:125: ?[0;37mCGROUPS_DEVICES?[0m: ?[0;32menabled?[0m"
L45: "cluster.go:125: ?[0;37mCGROUPS_FREEZER?[0m: ?[0;32menabled?[0m"
L46: "cluster.go:125: ?[0;37mCGROUPS_MEMORY?[0m: ?[0;32menabled?[0m"
L47: "cluster.go:125: ?[0;37mCGROUPS_PIDS?[0m: ?[0;32menabled?[0m"
L48: "cluster.go:125: ?[0;37mCGROUPS_HUGETLB?[0m: ?[0;32menabled?[0m"
L49: "cluster.go:125: ?[0;37mCGROUPS_BLKIO?[0m: ?[0;32menabled?[0m"
L50: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.10--b030343d20__ could not be reached"
L51: "cluster.go:125: [WARNING Hostname]: hostname __ci-4081.3.10--b030343d20__: lookup ci-4081.3.10--b030343d20 on 168.63.129.16:53: no such host"
L52: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_"
L53: "cluster.go:125: [preflight] Some fatal errors occurred:"
L54: "cluster.go:125: [ERROR SystemVerification]: cgroups v1 support is deprecated and will be removed in a future release. Please migrate to cgroups v2. To explicitly enable cgroups v1 support for kubelet? v1.35 or newer, you must set the kubelet configuration option _FailCgroupV1_ to _false_. You must also explicitly skip this validation. For more information, see https://git.k8s.io/enhancements/keps/?sig-node/5573-remove-cgroup-v1"
L55: "cluster.go:125: [preflight] If you know what you are doing, you can make a check non-fatal with `--ignore-preflight-errors=...`"
L56: "cluster.go:125: error: error execution phase preflight: preflight checks failed"
L57: "cluster.go:125: To see the stack trace of this error execute with --v=5 or higher"
L58: "kubeadm.go:197: unable to setup cluster: unable to run master script: Process exited with status 1_"
L59: " "
```
🟢 ok **kubeadm.v1.36.1.calico.base**; Succeeded: azure (1)
🟢 ok **kubeadm.v1.36.1.cilium.base**; Succeeded: azure (1)
🟢 ok **kubeadm.v1.36.1.flannel.base**; Succeeded: azure (1)
🟢 ok **kubeadm.v1.37.0.calico.base**; Succeeded: azure (1)
🟢 ok **kubeadm.v1.37.0.cilium.base**; Succeeded: azure (1)
🟢 ok **kubeadm.v1.37.0.flannel.base**; Succeeded: azure (1)
🟢 ok **sysext.custom-docker.sysext**; Succeeded: azure (1)
🟢 ok **sysext.disable-containerd**; Succeeded: azure (2); Failed: azure (1)
Diagnostic output for azure, run 1
```
L1: " Error: _harness.go:651: Cluster failed starting machines: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kola-cluster-image-65b14e6dec/providers/Mic?rosoft.Compute/virtualMachines/ci-4081.3.10--4bbba5b52e"
L2: "--------------------------------------------------------------------------------"
L3: "RESPONSE 409: 409 Conflict"
L4: "ERROR CODE: OperationNotAllowed"
L5: "--------------------------------------------------------------------------------"
L6: "{"
L7: "__error__: {"
L8: "__code__: __OperationNotAllowed__,"
L9: "__message__: __Operation could not be completed as it results in exceeding approved standardDPLSv5Family Cores quota. Additional details - Deployment Model: Resource Manager, Location: westus2, Curren?t Limit: 65, Current Usage: 64, Additional Required: 2, (Minimum) New Limit Required: 66. Setup Alerts when Quota reaches threshold. Learn more at https://aka.ms/quotamonitoringalerting . Submit a req?uest for Quota increase at https://aka.ms/ProdportalCRP/#blade/Microsoft_Azure_Capacity/UsageAndQuota.ReactView/Parameters/%7B%22subscriptionId%22:%220e46bd28-a80f-4d3a-8200-d9eb8d80cb2e%22,%22command?%22:%22openQuotaApprovalBlade%22,%22quotas%22:[%7B%22location%22:%22westus2%22,%22providerId%22:%22Microsoft.Compute%22,%22resourceName%22:%22standardDPLSv5Family%22,%22quotaRequest%22:%7B%22propertie?s%22:%7B%22limit%22:66,%22unit%22:%22Count%22,%22name%22:%7B%22value%22:%22standardDPLSv5Family%22%7D%7D%7D%7D]%7D by specifying parameters listed in the ???Details??? section for deployment to succee?d. Please read more about quota limits at https://docs.microsoft.com/en-us/azure/azure-supportability/per-vm-quota-requests__"
L10: "}"
L11: "}"
L12: "--------------------------------------------------------------------------------_"
L13: " "
```
🟢 ok **sysext.disable-docker**; Succeeded: azure (1)
🟢 ok **sysext.simple**; Succeeded: azure (1)
🟢 ok **systemd.journal.user**; Succeeded: azure (1)
🟢 ok **systemd.sysusers.gshadow**; Succeeded: azure (1)