### Test report for 4628.1.2+nightly-20260603-2100 / amd64 **Platforms tested** : azure 🟢 ok **bpf.ig**; Succeeded: azure (1) 🟢 ok **cl.basic**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _harness.go:646: Cluster failed starting machines: creating public ip: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kola-cluster-image-6e3c?f9d480/providers/Microsoft.Network/publicIPAddresses/ip-12eede8b45" L2: "--------------------------------------------------------------------------------" L3: "RESPONSE 409: 409 Conflict" L4: "ERROR CODE: ResourceGroupBeingDeleted" L5: "--------------------------------------------------------------------------------" L6: "{" L7: "__error__: {" L8: "__code__: __ResourceGroupBeingDeleted__," L9: "__message__: __The resource group _kola-cluster-image-6e3cf9d480_ is in deprovisioning state and cannot perform this operation.__" L10: "}" L11: "}" L12: "--------------------------------------------------------------------------------_" L13: " " ```
🟢 ok **cl.cloudinit.basic**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _harness.go:646: Cluster failed starting machines: PollUntilDone(ci-4628.1.2-n-7530349322): GET https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/providers/Microso?ft.Compute/locations/northeurope/operations/aacb3b51-4500-4933-8aad-1e88fc504ab7" L2: "--------------------------------------------------------------------------------" L3: "RESPONSE 200: 200 OK" L4: "ERROR CODE: OperationPreempted" L5: "--------------------------------------------------------------------------------" L6: "{" L7: "__startTime__: __2026-06-04T00:37:49.7293537+00:00__," L8: "__endTime__: __2026-06-04T00:38:33.8751037+00:00__," L9: "__status__: __Canceled__," L10: "__error__: {" L11: "__code__: __OperationPreempted__," L12: "__message__: __Operation execution has been preempted by a more recent operation.__" L13: "}," L14: "__name__: __aacb3b51-4500-4933-8aad-1e88fc504ab7__" L15: "}" L16: "--------------------------------------------------------------------------------_" L17: " " ```
🟢 ok **cl.cloudinit.multipart-mime**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _harness.go:646: Cluster failed starting machines: PollUntilDone(ci-4628.1.2-n-bd06611f12): GET https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/providers/Microso?ft.Compute/locations/northeurope/operations/e7cfadef-dae1-4421-b02a-248a6f75a89b" L2: "--------------------------------------------------------------------------------" L3: "RESPONSE 200: 200 OK" L4: "ERROR CODE: OperationPreempted" L5: "--------------------------------------------------------------------------------" L6: "{" L7: "__startTime__: __2026-06-04T00:37:56.1370769+00:00__," L8: "__endTime__: __2026-06-04T00:38:33.8751037+00:00__," L9: "__status__: __Canceled__," L10: "__error__: {" L11: "__code__: __OperationPreempted__," L12: "__message__: __Operation execution has been preempted by a more recent operation.__" L13: "}," L14: "__name__: __e7cfadef-dae1-4421-b02a-248a6f75a89b__" L15: "}" L16: "--------------------------------------------------------------------------------_" L17: " " ```
🟢 ok **cl.cloudinit.script**; Succeeded: azure (1) 🟢 ok **cl.etcd-member.discovery # SKIP**; Succeeded: azure (1) 🟢 ok **cl.etcd-member.etcdctlv3**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _harness.go:646: Cluster failed starting machines: creating public ip: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kola-cluster-image-6e3c?f9d480/providers/Microsoft.Network/publicIPAddresses/ip-899042f83e" L2: "--------------------------------------------------------------------------------" L3: "RESPONSE 409: 409 Conflict" L4: "ERROR CODE: ResourceGroupBeingDeleted" L5: "--------------------------------------------------------------------------------" L6: "{" L7: "__error__: {" L8: "__code__: __ResourceGroupBeingDeleted__," L9: "__message__: __The resource group _kola-cluster-image-6e3cf9d480_ is in deprovisioning state and cannot perform this operation.__" L10: "}" L11: "}" L12: "--------------------------------------------------------------------------------_" L13: " " ```
🟢 ok **cl.etcd-member.v2-backup-restore # SKIP**; Succeeded: azure (1) 🟢 ok **cl.flannel.udp # SKIP**; Succeeded: azure (1) 🟢 ok **cl.flannel.vxlan # SKIP**; Succeeded: azure (1) 🟢 ok **cl.ignition.kargs**; Succeeded: azure (1) 🟢 ok **cl.ignition.luks**; Succeeded: azure (1) 🟢 ok **cl.ignition.misc.empty**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _harness.go:646: Cluster failed starting machines: creating public ip: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kola-cluster-image-6e3c?f9d480/providers/Microsoft.Network/publicIPAddresses/ip-18f5096d61" L2: "--------------------------------------------------------------------------------" L3: "RESPONSE 409: 409 Conflict" L4: "ERROR CODE: ResourceGroupBeingDeleted" L5: "--------------------------------------------------------------------------------" L6: "{" L7: "__error__: {" L8: "__code__: __ResourceGroupBeingDeleted__," L9: "__message__: __The resource group _kola-cluster-image-6e3cf9d480_ is in deprovisioning state and cannot perform this operation.__" L10: "}" L11: "}" L12: "--------------------------------------------------------------------------------_" L13: " " ```
🟢 ok **cl.ignition.symlink**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _harness.go:646: Cluster failed starting machines: creating public ip: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kola-cluster-image-6e3c?f9d480/providers/Microsoft.Network/publicIPAddresses/ip-cd71ef21d5" L2: "--------------------------------------------------------------------------------" L3: "RESPONSE 409: 409 Conflict" L4: "ERROR CODE: ResourceGroupBeingDeleted" L5: "--------------------------------------------------------------------------------" L6: "{" L7: "__error__: {" L8: "__code__: __ResourceGroupBeingDeleted__," L9: "__message__: __The resource group _kola-cluster-image-6e3cf9d480_ is in deprovisioning state and cannot perform this operation.__" L10: "}" L11: "}" L12: "--------------------------------------------------------------------------------_" L13: " " ```
🟢 ok **cl.ignition.translation**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _harness.go:646: Cluster failed starting machines: creating public ip: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kola-cluster-image-6e3c?f9d480/providers/Microsoft.Network/publicIPAddresses/ip-949779bf2b" L2: "--------------------------------------------------------------------------------" L3: "RESPONSE 409: 409 Conflict" L4: "ERROR CODE: ResourceGroupBeingDeleted" L5: "--------------------------------------------------------------------------------" L6: "{" L7: "__error__: {" L8: "__code__: __ResourceGroupBeingDeleted__," L9: "__message__: __The resource group _kola-cluster-image-6e3cf9d480_ is in deprovisioning state and cannot perform this operation.__" L10: "}" L11: "}" L12: "--------------------------------------------------------------------------------_" L13: " " ```
🟢 ok **cl.ignition.v1.btrfsroot**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _harness.go:646: Cluster failed starting machines: PollUntilDone(ci-4628.1.2-n-1e154809ff): GET https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/providers/Microso?ft.Compute/locations/northeurope/operations/3dfd359b-14d6-44a9-a74e-e66d955c1757" L2: "--------------------------------------------------------------------------------" L3: "RESPONSE 200: 200 OK" L4: "ERROR CODE: OperationPreempted" L5: "--------------------------------------------------------------------------------" L6: "{" L7: "__startTime__: __2026-06-04T00:38:11.3619544+00:00__," L8: "__endTime__: __2026-06-04T00:38:40.7028725+00:00__," L9: "__status__: __Canceled__," L10: "__error__: {" L11: "__code__: __OperationPreempted__," L12: "__message__: __Operation execution has been preempted by a more recent operation.__" L13: "}," L14: "__name__: __3dfd359b-14d6-44a9-a74e-e66d955c1757__" L15: "}" L16: "--------------------------------------------------------------------------------_" L17: " " ```
🟢 ok **cl.ignition.v1.ext4root**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _harness.go:646: Cluster failed starting machines: creating public ip: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kola-cluster-image-6e3c?f9d480/providers/Microsoft.Network/publicIPAddresses/ip-7b8df5fd2d" L2: "--------------------------------------------------------------------------------" L3: "RESPONSE 409: 409 Conflict" L4: "ERROR CODE: ResourceGroupBeingDeleted" L5: "--------------------------------------------------------------------------------" L6: "{" L7: "__error__: {" L8: "__code__: __ResourceGroupBeingDeleted__," L9: "__message__: __The resource group _kola-cluster-image-6e3cf9d480_ is in deprovisioning state and cannot perform this operation.__" L10: "}" L11: "}" L12: "--------------------------------------------------------------------------------_" L13: " " ```
🟢 ok **cl.ignition.v1.groups**; Succeeded: azure (1) 🟢 ok **cl.ignition.v1.noop**; Succeeded: azure (1) 🟢 ok **cl.ignition.v1.once**; Succeeded: azure (1) 🟢 ok **cl.ignition.v1.users**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _harness.go:646: Cluster failed starting machines: creating public ip: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kola-cluster-image-6e3c?f9d480/providers/Microsoft.Network/publicIPAddresses/ip-7da0ce403c" L2: "--------------------------------------------------------------------------------" L3: "RESPONSE 409: 409 Conflict" L4: "ERROR CODE: ResourceGroupBeingDeleted" L5: "--------------------------------------------------------------------------------" L6: "{" L7: "__error__: {" L8: "__code__: __ResourceGroupBeingDeleted__," L9: "__message__: __The resource group _kola-cluster-image-6e3cf9d480_ is in deprovisioning state and cannot perform this operation.__" L10: "}" L11: "}" L12: "--------------------------------------------------------------------------------_" L13: " " ```
🟢 ok **cl.ignition.v1.xfsroot**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _harness.go:646: Cluster failed starting machines: creating public ip: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kola-cluster-image-6e3c?f9d480/providers/Microsoft.Network/publicIPAddresses/ip-fc9f5d469b" L2: "--------------------------------------------------------------------------------" L3: "RESPONSE 409: 409 Conflict" L4: "ERROR CODE: ResourceGroupBeingDeleted" L5: "--------------------------------------------------------------------------------" L6: "{" L7: "__error__: {" L8: "__code__: __ResourceGroupBeingDeleted__," L9: "__message__: __The resource group _kola-cluster-image-6e3cf9d480_ is in deprovisioning state and cannot perform this operation.__" L10: "}" L11: "}" L12: "--------------------------------------------------------------------------------_" L13: " " ```
🟢 ok **cl.ignition.v2.btrfsroot**; Succeeded: azure (1) 🟢 ok **cl.ignition.v2.ext4root**; Succeeded: azure (1) 🟢 ok **cl.ignition.v2.noop**; Succeeded: azure (1) 🟢 ok **cl.ignition.v2.users**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _harness.go:646: Cluster failed starting machines: creating public ip: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kola-cluster-image-6e3c?f9d480/providers/Microsoft.Network/publicIPAddresses/ip-56f3bfec2c" L2: "--------------------------------------------------------------------------------" L3: "RESPONSE 409: 409 Conflict" L4: "ERROR CODE: ResourceGroupBeingDeleted" L5: "--------------------------------------------------------------------------------" L6: "{" L7: "__error__: {" L8: "__code__: __ResourceGroupBeingDeleted__," L9: "__message__: __The resource group _kola-cluster-image-6e3cf9d480_ is in deprovisioning state and cannot perform this operation.__" L10: "}" L11: "}" L12: "--------------------------------------------------------------------------------_" L13: " " ```
🟢 ok **cl.ignition.v2.xfsroot**; Succeeded: azure (1) 🟢 ok **cl.ignition.v2_1.ext4checkexisting**; Succeeded: azure (1) 🟢 ok **cl.ignition.v2_1.swap**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _harness.go:646: Cluster failed starting machines: creating public ip: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kola-cluster-image-6e3c?f9d480/providers/Microsoft.Network/publicIPAddresses/ip-c643fbf61f" L2: "--------------------------------------------------------------------------------" L3: "RESPONSE 409: 409 Conflict" L4: "ERROR CODE: ResourceGroupBeingDeleted" L5: "--------------------------------------------------------------------------------" L6: "{" L7: "__error__: {" L8: "__code__: __ResourceGroupBeingDeleted__," L9: "__message__: __The resource group _kola-cluster-image-6e3cf9d480_ is in deprovisioning state and cannot perform this operation.__" L10: "}" L11: "}" L12: "--------------------------------------------------------------------------------_" L13: " " ```
🟢 ok **cl.ignition.v2_1.vfat**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _harness.go:646: Cluster failed starting machines: creating public ip: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kola-cluster-image-6e3c?f9d480/providers/Microsoft.Network/publicIPAddresses/ip-a820ccce9d" L2: "--------------------------------------------------------------------------------" L3: "RESPONSE 409: 409 Conflict" L4: "ERROR CODE: ResourceGroupBeingDeleted" L5: "--------------------------------------------------------------------------------" L6: "{" L7: "__error__: {" L8: "__code__: __ResourceGroupBeingDeleted__," L9: "__message__: __The resource group _kola-cluster-image-6e3cf9d480_ is in deprovisioning state and cannot perform this operation.__" L10: "}" L11: "}" L12: "--------------------------------------------------------------------------------_" L13: " " ```
🟢 ok **cl.internet**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _harness.go:646: Cluster failed starting machines: creating public ip: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kola-cluster-image-6e3c?f9d480/providers/Microsoft.Network/publicIPAddresses/ip-acb82eea41" L2: "--------------------------------------------------------------------------------" L3: "RESPONSE 409: 409 Conflict" L4: "ERROR CODE: ResourceGroupBeingDeleted" L5: "--------------------------------------------------------------------------------" L6: "{" L7: "__error__: {" L8: "__code__: __ResourceGroupBeingDeleted__," L9: "__message__: __The resource group _kola-cluster-image-6e3cf9d480_ is in deprovisioning state and cannot perform this operation.__" L10: "}" L11: "}" L12: "--------------------------------------------------------------------------------_" L13: " " ```
🟢 ok **cl.locksmith.cluster # SKIP**; Succeeded: azure (1) 🟢 ok **cl.metadata.azure**; Succeeded: azure (1) 🟢 ok **cl.network.initramfs.second-boot**; Succeeded: azure (1) 🟢 ok **cl.network.iptables**; Succeeded: azure (1) 🟢 ok **cl.network.nftables**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _harness.go:646: Cluster failed starting machines: waiting for machine to become active: GET https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kola-?cluster-image-6e3cf9d480/providers/Microsoft.Compute/virtualMachines/ci-4628.1.2-n-59ba633209" L2: "--------------------------------------------------------------------------------" L3: "RESPONSE 404: 404 Not Found" L4: "ERROR CODE: NotFound" L5: "--------------------------------------------------------------------------------" L6: "{" L7: "__error__: {" L8: "__code__: __NotFound__," L9: "__message__: __The entity was not found in this Azure location.__" L10: "}" L11: "}" L12: "--------------------------------------------------------------------------------_" L13: " " ```
🟢 ok **cl.network.wireguard**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _harness.go:646: Cluster failed starting machines: creating public ip: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kola-cluster-image-6e3c?f9d480/providers/Microsoft.Network/publicIPAddresses/ip-d774c950e3" L2: "--------------------------------------------------------------------------------" L3: "RESPONSE 409: 409 Conflict" L4: "ERROR CODE: ResourceGroupBeingDeleted" L5: "--------------------------------------------------------------------------------" L6: "{" L7: "__error__: {" L8: "__code__: __ResourceGroupBeingDeleted__," L9: "__message__: __The resource group _kola-cluster-image-6e3cf9d480_ is in deprovisioning state and cannot perform this operation.__" L10: "}" L11: "}" L12: "--------------------------------------------------------------------------------_" L13: " " ```
🟢 ok **cl.osreset.ignition-rerun**; Succeeded: azure (1) 🟢 ok **cl.overlay.cleanup**; Succeeded: azure (1) 🟢 ok **cl.swap_activation**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _harness.go:646: Cluster failed starting machines: creating public ip: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kola-cluster-image-6e3c?f9d480/providers/Microsoft.Network/publicIPAddresses/ip-d0e23655f8" L2: "--------------------------------------------------------------------------------" L3: "RESPONSE 409: 409 Conflict" L4: "ERROR CODE: ResourceGroupBeingDeleted" L5: "--------------------------------------------------------------------------------" L6: "{" L7: "__error__: {" L8: "__code__: __ResourceGroupBeingDeleted__," L9: "__message__: __The resource group _kola-cluster-image-6e3cf9d480_ is in deprovisioning state and cannot perform this operation.__" L10: "}" L11: "}" L12: "--------------------------------------------------------------------------------_" L13: " " ```
🟢 ok **cl.toolbox.dnf-install**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _harness.go:646: Cluster failed starting machines: creating public ip: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kola-cluster-image-6e3c?f9d480/providers/Microsoft.Network/publicIPAddresses/ip-868b7bff36" L2: "--------------------------------------------------------------------------------" L3: "RESPONSE 409: 409 Conflict" L4: "ERROR CODE: ResourceGroupBeingDeleted" L5: "--------------------------------------------------------------------------------" L6: "{" L7: "__error__: {" L8: "__code__: __ResourceGroupBeingDeleted__," L9: "__message__: __The resource group _kola-cluster-image-6e3cf9d480_ is in deprovisioning state and cannot perform this operation.__" L10: "}" L11: "}" L12: "--------------------------------------------------------------------------------_" L13: " " ```
🟢 ok **cl.update.badverity**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _cluster.go:145: __sudo dd if=/dev/disk/by-partlabel/USR-A of=/dev/disk/by-partlabel/USR-B bs=10M status=none__ failed: output , status wait: remote command exited without exit status or exit s?ignal_" L2: " " ```
🟢 ok **cl.update.reboot**; Succeeded: azure (1) 🟢 ok **cl.users.shells**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _harness.go:646: Cluster failed starting machines: creating public ip: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kola-cluster-image-6e3c?f9d480/providers/Microsoft.Network/publicIPAddresses/ip-bab3ce6363" L2: "--------------------------------------------------------------------------------" L3: "RESPONSE 409: 409 Conflict" L4: "ERROR CODE: ResourceGroupBeingDeleted" L5: "--------------------------------------------------------------------------------" L6: "{" L7: "__error__: {" L8: "__code__: __ResourceGroupBeingDeleted__," L9: "__message__: __The resource group _kola-cluster-image-6e3cf9d480_ is in deprovisioning state and cannot perform this operation.__" L10: "}" L11: "}" L12: "--------------------------------------------------------------------------------_" L13: " " ```
🟢 ok **cl.verity**; Succeeded: azure (1) 🟢 ok **coreos.auth.verify**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _harness.go:646: Cluster failed starting machines: creating public ip: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kola-cluster-image-6e3c?f9d480/providers/Microsoft.Network/publicIPAddresses/ip-26b0c44bb2" L2: "--------------------------------------------------------------------------------" L3: "RESPONSE 409: 409 Conflict" L4: "ERROR CODE: ResourceGroupBeingDeleted" L5: "--------------------------------------------------------------------------------" L6: "{" L7: "__error__: {" L8: "__code__: __ResourceGroupBeingDeleted__," L9: "__message__: __The resource group _kola-cluster-image-6e3cf9d480_ is in deprovisioning state and cannot perform this operation.__" L10: "}" L11: "}" L12: "--------------------------------------------------------------------------------_" L13: " " ```
🟢 ok **coreos.ignition.groups**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _harness.go:646: Cluster failed starting machines: creating public ip: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kola-cluster-image-6e3c?f9d480/providers/Microsoft.Network/publicIPAddresses/ip-ca7569aea7" L2: "--------------------------------------------------------------------------------" L3: "RESPONSE 409: 409 Conflict" L4: "ERROR CODE: ResourceGroupBeingDeleted" L5: "--------------------------------------------------------------------------------" L6: "{" L7: "__error__: {" L8: "__code__: __ResourceGroupBeingDeleted__," L9: "__message__: __The resource group _kola-cluster-image-6e3cf9d480_ is in deprovisioning state and cannot perform this operation.__" L10: "}" L11: "}" L12: "--------------------------------------------------------------------------------_" L13: " " ```
🟢 ok **coreos.ignition.once**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _harness.go:646: Cluster failed starting machines: creating public ip: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kola-cluster-image-6e3c?f9d480/providers/Microsoft.Network/publicIPAddresses/ip-b761fcf45b" L2: "--------------------------------------------------------------------------------" L3: "RESPONSE 409: 409 Conflict" L4: "ERROR CODE: ResourceGroupBeingDeleted" L5: "--------------------------------------------------------------------------------" L6: "{" L7: "__error__: {" L8: "__code__: __ResourceGroupBeingDeleted__," L9: "__message__: __The resource group _kola-cluster-image-6e3cf9d480_ is in deprovisioning state and cannot perform this operation.__" L10: "}" L11: "}" L12: "--------------------------------------------------------------------------------_" L13: " " ```
🟢 ok **coreos.ignition.resource.local**; Succeeded: azure (1) 🟢 ok **coreos.ignition.resource.remote**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _harness.go:646: Cluster failed starting machines: waiting for machine to become active: GET https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kola-?cluster-image-6e3cf9d480/providers/Microsoft.Compute/virtualMachines/ci-4628.1.2-n-0d5bdcb9d6" L2: "--------------------------------------------------------------------------------" L3: "RESPONSE 404: 404 Not Found" L4: "ERROR CODE: NotFound" L5: "--------------------------------------------------------------------------------" L6: "{" L7: "__error__: {" L8: "__code__: __NotFound__," L9: "__message__: __The entity was not found in this Azure location.__" L10: "}" L11: "}" L12: "--------------------------------------------------------------------------------_" L13: " " ```
🟢 ok **coreos.ignition.security.tls**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _harness.go:646: Cluster failed starting machines: creating public ip: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kola-cluster-image-6e3c?f9d480/providers/Microsoft.Network/publicIPAddresses/ip-82ba185531" L2: "--------------------------------------------------------------------------------" L3: "RESPONSE 409: 409 Conflict" L4: "ERROR CODE: ResourceGroupBeingDeleted" L5: "--------------------------------------------------------------------------------" L6: "{" L7: "__error__: {" L8: "__code__: __ResourceGroupBeingDeleted__," L9: "__message__: __The resource group _kola-cluster-image-6e3cf9d480_ is in deprovisioning state and cannot perform this operation.__" L10: "}" L11: "}" L12: "--------------------------------------------------------------------------------_" L13: " " ```
🟢 ok **coreos.ignition.ssh.key**; Succeeded: azure (1) 🟢 ok **coreos.ignition.systemd.enable-service**; Succeeded: azure (1) 🟢 ok **coreos.locksmith.reboot**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _locksmith.go:141: failed to check rebooted machine: ssh unreachable or system not ready: context deadline exceeded_" L2: " " ```
🟢 ok **coreos.locksmith.tls**; Succeeded: azure (1) 🟢 ok **coreos.selinux.boolean**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _harness.go:646: Cluster failed starting machines: creating public ip: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kola-cluster-image-6e3c?f9d480/providers/Microsoft.Network/publicIPAddresses/ip-db7fd83e8a" L2: "--------------------------------------------------------------------------------" L3: "RESPONSE 409: 409 Conflict" L4: "ERROR CODE: ResourceGroupBeingDeleted" L5: "--------------------------------------------------------------------------------" L6: "{" L7: "__error__: {" L8: "__code__: __ResourceGroupBeingDeleted__," L9: "__message__: __The resource group _kola-cluster-image-6e3cf9d480_ is in deprovisioning state and cannot perform this operation.__" L10: "}" L11: "}" L12: "--------------------------------------------------------------------------------_" L13: " " ```
🟢 ok **coreos.selinux.enforce**; Succeeded: azure (1) 🟢 ok **coreos.tls.fetch-urls**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _harness.go:646: Cluster failed starting machines: creating public ip: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kola-cluster-image-6e3c?f9d480/providers/Microsoft.Network/publicIPAddresses/ip-379b7b8bb9" L2: "--------------------------------------------------------------------------------" L3: "RESPONSE 409: 409 Conflict" L4: "ERROR CODE: ResourceGroupBeingDeleted" L5: "--------------------------------------------------------------------------------" L6: "{" L7: "__error__: {" L8: "__code__: __ResourceGroupBeingDeleted__," L9: "__message__: __The resource group _kola-cluster-image-6e3cf9d480_ is in deprovisioning state and cannot perform this operation.__" L10: "}" L11: "}" L12: "--------------------------------------------------------------------------------_" L13: " " ```
🟢 ok **coreos.update.badusr**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _update.go:168: ssh unreachable or system not ready: failure checking if machine is running: systemctl is-system-running returned stdout: ____, stderr: ____, err: dial tcp 168.63.71.162:22: i/o? timeout, systemctl list-jobs returned stdout: ____, stderr: ____, err: dial tcp 168.63.71.162:22: i/o timeout_" L2: " " ```
🟢 ok **docker.base**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _harness.go:646: Cluster failed starting machines: creating public ip: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kola-cluster-image-6e3c?f9d480/providers/Microsoft.Network/publicIPAddresses/ip-abbac37960" L2: "--------------------------------------------------------------------------------" L3: "RESPONSE 409: 409 Conflict" L4: "ERROR CODE: ResourceGroupBeingDeleted" L5: "--------------------------------------------------------------------------------" L6: "{" L7: "__error__: {" L8: "__code__: __ResourceGroupBeingDeleted__," L9: "__message__: __The resource group _kola-cluster-image-6e3cf9d480_ is in deprovisioning state and cannot perform this operation.__" L10: "}" L11: "}" L12: "--------------------------------------------------------------------------------_" L13: " " ```
🟢 ok **docker.btrfs-storage**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _harness.go:646: Cluster failed starting machines: creating public ip: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kola-cluster-image-6e3c?f9d480/providers/Microsoft.Network/publicIPAddresses/ip-881b6d591a" L2: "--------------------------------------------------------------------------------" L3: "RESPONSE 409: 409 Conflict" L4: "ERROR CODE: ResourceGroupBeingDeleted" L5: "--------------------------------------------------------------------------------" L6: "{" L7: "__error__: {" L8: "__code__: __ResourceGroupBeingDeleted__," L9: "__message__: __The resource group _kola-cluster-image-6e3cf9d480_ is in deprovisioning state and cannot perform this operation.__" L10: "}" L11: "}" L12: "--------------------------------------------------------------------------------_" L13: " " ```
🟢 ok **docker.containerd-restart**; Succeeded: azure (1) 🟢 ok **docker.enable-service.sysext**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _harness.go:646: Cluster failed starting machines: creating public ip: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kola-cluster-image-6e3c?f9d480/providers/Microsoft.Network/publicIPAddresses/ip-f3330552f0" L2: "--------------------------------------------------------------------------------" L3: "RESPONSE 409: 409 Conflict" L4: "ERROR CODE: ResourceGroupBeingDeleted" L5: "--------------------------------------------------------------------------------" L6: "{" L7: "__error__: {" L8: "__code__: __ResourceGroupBeingDeleted__," L9: "__message__: __The resource group _kola-cluster-image-6e3cf9d480_ is in deprovisioning state and cannot perform this operation.__" L10: "}" L11: "}" L12: "--------------------------------------------------------------------------------_" L13: " " ```
🟢 ok **docker.lib-coreos-dockerd-compat**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " _docker.lib-coreos-dockerd-compat/networks-reliably (80.61s)" L2: "cluster.go:125: #0 building with __default__ instance using docker driver" L3: "cluster.go:125: " L4: "cluster.go:125: #1 [internal] load build definition from Dockerfile" L5: "cluster.go:125: #1 transferring dockerfile: 108B done" L6: "cluster.go:125: #1 DONE 0.0s" L7: "cluster.go:125: " L8: "cluster.go:125: #2 [internal] load .dockerignore" L9: "cluster.go:125: #2 transferring context: 2B done" L10: "cluster.go:125: #2 DONE 0.0s" L11: "cluster.go:125: " L12: "cluster.go:125: #3 [internal] load build context" L13: "cluster.go:125: #3 transferring context: 5.34MB 0.0s done" L14: "cluster.go:125: #3 DONE 0.1s" L15: "cluster.go:125: " L16: "cluster.go:125: #4 [1/1] COPY . /" L17: "cluster.go:125: #4 DONE 0.1s" L18: "cluster.go:125: " L19: "cluster.go:125: #5 exporting to image" L20: "cluster.go:125: #5 exporting layers 0.1s done" L21: "cluster.go:125: #5 writing image sha256:560f0ff9dffe585264478d1626e32617338fd329498e6d2841ef44f6925744b5 done" L22: "cluster.go:125: #5 naming to docker.io/library/ping done" L23: "cluster.go:125: #5 DONE 0.1s" L24: "cluster.go:145: __for i in $(seq 1 100); do_n_t_techo -n ___$i: ____n_t_tdocker run --rm ping sh -c _ping -i 0.2 172.17.0.1 -w 1 _/dev/null && echo PASS || echo FAIL__n_tdone__ failed: output 1: PASS" L25: "2: PASS" L26: "3: PASS" L27: "4: PASS" L28: "5: PASS" L29: "6: PASS" L30: "7: PASS" L31: "8: PASS" L32: "9: PASS" L33: "10: PASS" L34: "11: PASS" L35: "12: PASS" L36: "13: PASS" L37: "14: PASS" L38: "15: PASS" L39: "16: PASS" L40: "17: PASS" L41: "18: PASS" L42: "19: PASS" L43: "20: PASS" L44: "21: PASS" L45: "22: PASS" L46: "23: PASS" L47: "24: PASS" L48: "25: PASS" L49: "26: PASS" L50: "27: PASS" L51: "28: PASS" L52: "29: PASS" L53: "30: PASS" L54: "31: PASS" L55: "32: PASS" L56: "33: PASS" L57: "34: PASS" L58: "35: PASS" L59: "36: PASS" L60: "37: PASS" L61: "38: PASS" L62: "39: PASS" L63: "40: PASS" L64: "41: PASS" L65: "42: PASS" L66: "43: PASS" L67: "44: PASS" L68: "45: PASS" L69: "46: PASS" L70: "47: PASS" L71: "48: PASS" L72: "49: PASS" L73: "50: PASS" L74: "51: PASS" L75: "52: PASS" L76: "53: PASS" L77: "54:, status wait: remote command exited without exit status or exit signal" L78: "--- FAIL: docker.lib-coreos-dockerd-compat/user-no-caps (0.04s)" L79: "cluster.go:145: __tmpdir=$(mktemp -d); cd $tmpdir; echo -e ___FROM scratch__nCOPY . /___ _ Dockerfile;_n_t b=$(which capsh sh grep cat ls); libs=$(sudo ldd $b | grep -o /lib_[^ ]*_ | sort -u);_?n_t sudo rsync -av --relative --copy-links $b $libs ./;_n_t sudo docker build -t captest .__ failed: output , status ssh: handshake failed: read tcp 10.200.1.6:36926-_20.234.14.178:22: r?ead: connection reset by peer" L80: "--- FAIL: docker.lib-coreos-dockerd-compat/ownership (0.04s)" L81: "cluster.go:145: __docker run --name ownership ghcr.io/flatcar/nginx stat -c ___%u/%g___ /etc/shadow__ failed: output , status ssh: handshake failed: read tcp 10.200.1.6:36932-_20.234.14.178:22: read: ?connection reset by peer_" L82: " " ```
🟢 ok **docker.network-openbsd-nc**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _harness.go:646: Cluster failed starting machines: PollUntilDone(ci-4628.1.2-n-dabb906193): GET https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/providers/Microso?ft.Compute/locations/northeurope/operations/c0345b6a-872d-449e-bbf2-897aec573e54" L2: "--------------------------------------------------------------------------------" L3: "RESPONSE 200: 200 OK" L4: "ERROR CODE: OperationPreempted" L5: "--------------------------------------------------------------------------------" L6: "{" L7: "__startTime__: __2026-06-04T00:37:50.827971+00:00__," L8: "__endTime__: __2026-06-04T00:38:33.9853644+00:00__," L9: "__status__: __Canceled__," L10: "__error__: {" L11: "__code__: __OperationPreempted__," L12: "__message__: __Operation execution has been preempted by a more recent operation.__" L13: "}," L14: "__name__: __c0345b6a-872d-449e-bbf2-897aec573e54__" L15: "}" L16: "--------------------------------------------------------------------------------_" L17: " " ```
🟢 ok **docker.selinux**; Succeeded: azure (1) 🟢 ok **docker.userns**; Succeeded: azure (1) 🟢 ok **extra-test.[V1].cl.internet**; Succeeded: azure (1) 🟢 ok **kubeadm.v1.34.4.calico.base**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _cluster.go:125: I0604 00:36:40.948985 3198 version.go:260] remote version is much newer: v1.36.1; falling back to: stable-1.34" L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.34.8" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.34.8" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.34.8" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.34.8" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.12.1" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.1" L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.5-0" L9: "cluster.go:125: I0604 00:36:52.581023 3448 version.go:260] remote version is much newer: v1.36.1; falling back to: stable-1.34" L10: "cluster.go:125: [init] Using Kubernetes version: v1.34.8" L11: "cluster.go:125: [preflight] Running pre-flight checks" L12: "cluster.go:125: [WARNING Hostname]: hostname __ci-4628.1.2-n-9363945c0f__ could not be reached" L13: "cluster.go:125: [WARNING Hostname]: hostname __ci-4628.1.2-n-9363945c0f__: lookup ci-4628.1.2-n-9363945c0f on 168.63.129.16:53: no such host" L14: "cluster.go:125: [WARNING Service-Kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L15: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L16: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L17: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L18: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L19: "cluster.go:125: [certs] Generating __ca__ certificate and key" L20: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L21: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [ci-4628.1.2-n-9363945c0f kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local] and IPs [10.?96.0.1 10.0.0.26]" L22: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L23: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L24: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L25: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L26: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L27: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L28: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L29: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L30: "cluster.go:125: [certs] Generating __sa__ key and public key" L31: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L32: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L33: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L34: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L35: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L36: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L37: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L38: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L39: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L40: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L41: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L42: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__" L43: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__" L44: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L45: "cluster.go:125: [kubelet-start] Starting the kubelet" L46: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__" L47: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s" L48: "cluster.go:125: [kubelet-check] The kubelet is healthy after 502.147784ms" L49: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s" L50: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.26:6443/livez" L51: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz" L52: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez" L53: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 1.70105863s" L54: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 2.436039914s" L55: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 4.501753346s" L56: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace" L57: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster" L58: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs" L59: "cluster.go:125: [mark-control-plane] Marking the node ci-4628.1.2-n-9363945c0f as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-lo?ad-balancers]" L60: "cluster.go:125: [mark-control-plane] Marking the node ci-4628.1.2-n-9363945c0f as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]" L61: "cluster.go:125: [bootstrap-token] Using token: dktp0p.h2oim5a4t65a47hd" L62: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles" L63: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes" L64: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials" L65: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token" L66: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster" L67: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace" L68: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key" L69: "cluster.go:125: [addons] Applied essential addon: CoreDNS" L70: "cluster.go:125: [addons] Applied essential addon: kube-proxy" L71: "cluster.go:125: " L72: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!" L73: "cluster.go:125: " L74: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:" L75: "cluster.go:125: " L76: "cluster.go:125: mkdir -p $HOME/.kube" L77: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config" L78: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config" L79: "cluster.go:125: " L80: "cluster.go:125: Alternatively, if you are the root user, you can run:" L81: "cluster.go:125: " L82: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf" L83: "cluster.go:125: " L84: "cluster.go:125: You should now deploy a pod network to the cluster." L85: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:" L86: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/" L87: "cluster.go:125: " L88: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:" L89: "cluster.go:125: " L90: "cluster.go:125: kubeadm join 10.0.0.26:6443 --token dktp0p.h2oim5a4t65a47hd _" L91: "cluster.go:125: --discovery-token-ca-cert-hash sha256:3b524cb1b5f339754ff54af23e31085c62ffaafeb52cab402ce519d90dcdfc6c " L92: "cluster.go:125: namespace/tigera-operator created" L93: "cluster.go:125: serviceaccount/tigera-operator created" L94: "cluster.go:125: clusterrole.rbac.authorization.k8s.io/tigera-operator-secrets created" L95: "cluster.go:125: clusterrole.rbac.authorization.k8s.io/tigera-operator created" L96: "cluster.go:125: clusterrolebinding.rbac.authorization.k8s.io/tigera-operator created" L97: "cluster.go:125: rolebinding.rbac.authorization.k8s.io/tigera-operator-secrets created" L98: "cluster.go:125: deployment.apps/tigera-operator created" L99: "cluster.go:125: customresourcedefinition.apiextensions.k8s.io/installations.operator.tigera.io condition met" L100: "cluster.go:125: customresourcedefinition.apiextensions.k8s.io/installations.operator.tigera.io condition met" L101: "cluster.go:125: customresourcedefinition.apiextensions.k8s.io/apiservers.operator.tigera.io condition met" L102: "cluster.go:125: customresourcedefinition.apiextensions.k8s.io/apiservers.operator.tigera.io condition met" L103: "cluster.go:125: installation.operator.tigera.io/default created" L104: "cluster.go:125: apiserver.operator.tigera.io/default created" L105: "cluster.go:125: goldmane.operator.tigera.io/default created" L106: "cluster.go:125: whisker.operator.tigera.io/default created" L107: "kubeadm.go:197: unable to setup cluster: unable to create worker node: PollUntilDone(ci-4628.1.2-n-9c85b8c522): GET https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/reso?urceGroups/kola-cluster-image-6e3cf9d480/providers/Microsoft.Compute/virtualMachines/ci-4628.1.2-n-9c85b8c522" L108: "--------------------------------------------------------------------------------" L109: "RESPONSE 404: 404 Not Found" L110: "ERROR CODE: NotFound" L111: "--------------------------------------------------------------------------------" L112: "{" L113: "__error__: {" L114: "__code__: __NotFound__," L115: "__message__: __The entity was not found in this Azure location.__" L116: "}" L117: "}" L118: "--------------------------------------------------------------------------------_" L119: " " ```
🟢 ok **kubeadm.v1.34.4.cilium.base**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _cluster.go:125: I0604 00:36:46.634087 3150 version.go:260] remote version is much newer: v1.36.1; falling back to: stable-1.34" L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.34.8" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.34.8" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.34.8" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.34.8" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.12.1" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.1" L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.5-0" L9: "cluster.go:125: I0604 00:36:57.033665 3365 version.go:260] remote version is much newer: v1.36.1; falling back to: stable-1.34" L10: "cluster.go:125: [init] Using Kubernetes version: v1.34.8" L11: "cluster.go:125: [preflight] Running pre-flight checks" L12: "cluster.go:125: [WARNING Hostname]: hostname __ci-4628.1.2-n-17ba9a8cf9__ could not be reached" L13: "cluster.go:125: [WARNING Hostname]: hostname __ci-4628.1.2-n-17ba9a8cf9__: lookup ci-4628.1.2-n-17ba9a8cf9 on 168.63.129.16:53: no such host" L14: "cluster.go:125: [WARNING Service-Kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L15: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L16: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L17: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L18: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L19: "cluster.go:125: [certs] Generating __ca__ certificate and key" L20: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L21: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [ci-4628.1.2-n-17ba9a8cf9 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local] and IPs [10.?96.0.1 10.0.0.24]" L22: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L23: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L24: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L25: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L26: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L27: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L28: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L29: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L30: "cluster.go:125: [certs] Generating __sa__ key and public key" L31: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L32: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L33: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L34: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L35: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L36: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L37: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L38: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L39: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L40: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L41: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L42: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__" L43: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__" L44: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L45: "cluster.go:125: [kubelet-start] Starting the kubelet" L46: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__" L47: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s" L48: "cluster.go:125: [kubelet-check] The kubelet is healthy after 501.45424ms" L49: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s" L50: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.24:6443/livez" L51: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz" L52: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez" L53: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 1.66931506s" L54: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 2.091304855s" L55: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 4.001582513s" L56: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace" L57: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster" L58: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs" L59: "cluster.go:125: [mark-control-plane] Marking the node ci-4628.1.2-n-17ba9a8cf9 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-lo?ad-balancers]" L60: "cluster.go:125: [mark-control-plane] Marking the node ci-4628.1.2-n-17ba9a8cf9 as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]" L61: "cluster.go:125: [bootstrap-token] Using token: y71u25.vkegwym90w5w7lpz" L62: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles" L63: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes" L64: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials" L65: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token" L66: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster" L67: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace" L68: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key" L69: "cluster.go:125: [addons] Applied essential addon: CoreDNS" L70: "cluster.go:125: [addons] Applied essential addon: kube-proxy" L71: "cluster.go:125: " L72: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!" L73: "cluster.go:125: " L74: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:" L75: "cluster.go:125: " L76: "cluster.go:125: mkdir -p $HOME/.kube" L77: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config" L78: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config" L79: "cluster.go:125: " L80: "cluster.go:125: Alternatively, if you are the root user, you can run:" L81: "cluster.go:125: " L82: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf" L83: "cluster.go:125: " L84: "cluster.go:125: You should now deploy a pod network to the cluster." L85: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:" L86: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/" L87: "cluster.go:125: " L88: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:" L89: "cluster.go:125: " L90: "cluster.go:125: kubeadm join 10.0.0.24:6443 --token y71u25.vkegwym90w5w7lpz _" L91: "cluster.go:125: --discovery-token-ca-cert-hash sha256:b80a01e527225f76b33ff316ee06771e5ba48ddb8a1795204e6f178522f35819 " L92: "cluster.go:125: i Using Cilium version 1.12.5" L93: "cluster.go:125: ? Auto-detected cluster name: kubernetes" L94: "cluster.go:125: ? Auto-detected datapath mode: tunnel" L95: "cluster.go:125: ? Auto-detected kube-proxy has been installed" L96: "cluster.go:125: i helm template --namespace kube-system cilium cilium/cilium --version 1.12.5 --set cluster.id=0,cluster.name=kubernetes,encryption.nodeEncryption=false,extraConfig.cluster-pool-ipv4-?cidr=192.168.0.0/17,extraConfig.enable-endpoint-routes=true,kubeProxyReplacement=disabled,operator.replicas=1,serviceAccounts.cilium.name=cilium,serviceAccounts.operator.name=cilium-operator,tunnel=vx?lan" L97: "cluster.go:125: i Storing helm values file in kube-system/cilium-cli-helm-values Secret" L98: "cluster.go:125: ? Created CA in secret cilium-ca" L99: "cluster.go:125: ? Generating certificates for Hubble..." L100: "cluster.go:125: ? Creating Service accounts..." L101: "cluster.go:125: ? Creating Cluster roles..." L102: "cluster.go:125: ? Creating ConfigMap for Cilium version 1.12.5..." L103: "cluster.go:125: i Manual overwrite in ConfigMap: cluster-pool-ipv4-cidr=192.168.0.0/17" L104: "cluster.go:125: i Manual overwrite in ConfigMap: enable-endpoint-routes=true" L105: "cluster.go:125: ? Creating Agent DaemonSet..." L106: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/mount-cgroup]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L107: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/apply-sysctl-overwrites]: deprecated since v1.30; use the ___appArmorProfile___ fi?eld instead__ subsys=klog" L108: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/clean-cilium-state]: deprecated since v1.30; use the ___appArmorProfile___ field i?nstead__ subsys=klog" L109: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/cilium-agent]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L110: "cluster.go:125: ? Creating Operator Deployment..." L111: "cluster.go:125: ? Waiting for Cilium to be installed and ready..." L112: "cluster.go:125: ? Cilium was successfully installed! Run _cilium status_ to view installation health" L113: "cluster.go:125: ?[33m /??_" L114: "cluster.go:125: ?[36m /???[33m___/?[32m??_?[0m Cilium: ?[32mOK?[0m" L115: "cluster.go:125: ?[36m ___?[31m/??_?[32m__/?[0m Operator: ?[32mOK?[0m" L116: "cluster.go:125: ?[32m /???[31m___/?[35m??_?[0m Hubble: ?[36mdisabled?[0m" L117: "cluster.go:125: ?[32m ___?[34m/??_?[35m__/?[0m ClusterMesh: ?[36mdisabled?[0m" L118: "cluster.go:125: ?[34m ___/" L119: "cluster.go:125: ?[0m" L120: "cluster.go:125: DaemonSet cilium " L121: "cluster.go:125: Deployment cilium-operator " L122: "cluster.go:125: Containers: cilium-operator " L123: "cluster.go:125: cilium " L124: "cluster.go:125: Cluster Pods: 0/0 managed by Cilium" L125: "kubeadm.go:197: unable to setup cluster: unable to create worker node: waiting for machine to become active: GET https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourc?eGroups/kola-cluster-image-6e3cf9d480/providers/Microsoft.Compute/virtualMachines/ci-4628.1.2-n-48740a7130" L126: "--------------------------------------------------------------------------------" L127: "RESPONSE 404: 404 Not Found" L128: "ERROR CODE: NotFound" L129: "--------------------------------------------------------------------------------" L130: "{" L131: "__error__: {" L132: "__code__: __NotFound__," L133: "__message__: __The entity was not found in this Azure location.__" L134: "}" L135: "}" L136: "--------------------------------------------------------------------------------_" L137: " " ```
🟢 ok **kubeadm.v1.34.4.flannel.base**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _kubeadm.go:197: unable to setup cluster: unable to create etcd node: creating public ip: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kola?-cluster-image-6e3cf9d480/providers/Microsoft.Network/publicIPAddresses/ip-2812990824" L2: "--------------------------------------------------------------------------------" L3: "RESPONSE 409: 409 Conflict" L4: "ERROR CODE: ResourceGroupBeingDeleted" L5: "--------------------------------------------------------------------------------" L6: "{" L7: "__error__: {" L8: "__code__: __ResourceGroupBeingDeleted__," L9: "__message__: __The resource group _kola-cluster-image-6e3cf9d480_ is in deprovisioning state and cannot perform this operation.__" L10: "}" L11: "}" L12: "--------------------------------------------------------------------------------_" L13: " " ```
🟢 ok **kubeadm.v1.35.1.calico.base**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _cluster.go:125: I0604 00:36:53.687538 3243 version.go:260] remote version is much newer: v1.36.1; falling back to: stable-1.35" L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.35.5" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.35.5" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.35.5" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.35.5" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.13.1" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.1" L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.6-0" L9: "cluster.go:125: I0604 00:37:04.774462 3489 version.go:260] remote version is much newer: v1.36.1; falling back to: stable-1.35" L10: "cluster.go:125: [init] Using Kubernetes version: v1.35.5" L11: "cluster.go:125: [preflight] Running pre-flight checks" L12: "cluster.go:125: [WARNING Hostname]: hostname __ci-4628.1.2-n-da3a135f39__ could not be reached" L13: "cluster.go:125: [WARNING Hostname]: hostname __ci-4628.1.2-n-da3a135f39__: lookup ci-4628.1.2-n-da3a135f39 on 168.63.129.16:53: no such host" L14: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L15: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L16: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L17: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L18: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L19: "cluster.go:125: [certs] Generating __ca__ certificate and key" L20: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L21: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [ci-4628.1.2-n-da3a135f39 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local] and IPs [10.?96.0.1 10.0.0.6]" L22: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L23: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L24: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L25: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L26: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L27: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L28: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L29: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L30: "cluster.go:125: [certs] Generating __sa__ key and public key" L31: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L32: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L33: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L34: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L35: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L36: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L37: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L38: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L39: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L40: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L41: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L42: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__" L43: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__" L44: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L45: "cluster.go:125: [kubelet-start] Starting the kubelet" L46: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__" L47: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s" L48: "cluster.go:125: [kubelet-check] The kubelet is healthy after 501.042604ms" L49: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s" L50: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.6:6443/livez" L51: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz" L52: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez" L53: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 1.00717886s" L54: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 1.417553936s" L55: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 3.001550676s" L56: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace" L57: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster" L58: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs" L59: "cluster.go:125: [mark-control-plane] Marking the node ci-4628.1.2-n-da3a135f39 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-lo?ad-balancers]" L60: "cluster.go:125: [mark-control-plane] Marking the node ci-4628.1.2-n-da3a135f39 as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]" L61: "cluster.go:125: [bootstrap-token] Using token: 4j6y37.ac8rrv7jt9p5tczg" L62: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles" L63: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes" L64: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials" L65: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token" L66: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster" L67: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace" L68: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key" L69: "cluster.go:125: [addons] Applied essential addon: CoreDNS" L70: "cluster.go:125: [addons] Applied essential addon: kube-proxy" L71: "cluster.go:125: " L72: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!" L73: "cluster.go:125: " L74: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:" L75: "cluster.go:125: " L76: "cluster.go:125: mkdir -p $HOME/.kube" L77: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config" L78: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config" L79: "cluster.go:125: " L80: "cluster.go:125: Alternatively, if you are the root user, you can run:" L81: "cluster.go:125: " L82: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf" L83: "cluster.go:125: " L84: "cluster.go:125: You should now deploy a pod network to the cluster." L85: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:" L86: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/" L87: "cluster.go:125: " L88: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:" L89: "cluster.go:125: " L90: "cluster.go:125: kubeadm join 10.0.0.6:6443 --token 4j6y37.ac8rrv7jt9p5tczg _" L91: "cluster.go:125: --discovery-token-ca-cert-hash sha256:66ae4fd06c1791ec04b8228ac477f7d668f51da31e158dd99f9033f3d9ae1fcc " L92: "cluster.go:125: namespace/tigera-operator created" L93: "cluster.go:125: serviceaccount/tigera-operator created" L94: "cluster.go:125: clusterrole.rbac.authorization.k8s.io/tigera-operator-secrets created" L95: "cluster.go:125: clusterrole.rbac.authorization.k8s.io/tigera-operator created" L96: "cluster.go:125: clusterrolebinding.rbac.authorization.k8s.io/tigera-operator created" L97: "cluster.go:125: rolebinding.rbac.authorization.k8s.io/tigera-operator-secrets created" L98: "cluster.go:125: deployment.apps/tigera-operator created" L99: "cluster.go:125: customresourcedefinition.apiextensions.k8s.io/installations.operator.tigera.io condition met" L100: "cluster.go:125: customresourcedefinition.apiextensions.k8s.io/installations.operator.tigera.io condition met" L101: "cluster.go:125: customresourcedefinition.apiextensions.k8s.io/apiservers.operator.tigera.io condition met" L102: "cluster.go:125: customresourcedefinition.apiextensions.k8s.io/apiservers.operator.tigera.io condition met" L103: "cluster.go:125: installation.operator.tigera.io/default created" L104: "cluster.go:125: apiserver.operator.tigera.io/default created" L105: "cluster.go:125: goldmane.operator.tigera.io/default created" L106: "cluster.go:125: whisker.operator.tigera.io/default created" L107: "kubeadm.go:197: unable to setup cluster: unable to create worker node: PollUntilDone(ci-4628.1.2-n-de8ab9b757): GET https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/prov?iders/Microsoft.Compute/locations/northeurope/operations/0e6aa850-67e5-456b-bf82-4776c0cb3a0d" L108: "--------------------------------------------------------------------------------" L109: "RESPONSE 200: 200 OK" L110: "ERROR CODE: OperationPreempted" L111: "--------------------------------------------------------------------------------" L112: "{" L113: "__startTime__: __2026-06-04T00:37:29.1822568+00:00__," L114: "__endTime__: __2026-06-04T00:38:34.1096579+00:00__," L115: "__status__: __Canceled__," L116: "__error__: {" L117: "__code__: __OperationPreempted__," L118: "__message__: __Operation execution has been preempted by a more recent operation.__" L119: "}," L120: "__name__: __0e6aa850-67e5-456b-bf82-4776c0cb3a0d__" L121: "}" L122: "--------------------------------------------------------------------------------_" L123: " " ```
🟢 ok **kubeadm.v1.35.1.cilium.base**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _cluster.go:125: I0604 00:38:03.602513 3310 version.go:260] remote version is much newer: v1.36.1; falling back to: stable-1.35" L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.35.5" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.35.5" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.35.5" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.35.5" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.13.1" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.1" L8: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.6-0" L9: "cluster.go:125: I0604 00:38:14.028481 3522 version.go:260] remote version is much newer: v1.36.1; falling back to: stable-1.35" L10: "cluster.go:125: [init] Using Kubernetes version: v1.35.5" L11: "cluster.go:125: [preflight] Running pre-flight checks" L12: "cluster.go:125: [WARNING Hostname]: hostname __ci-4628.1.2-n-e8d59efef8__ could not be reached" L13: "cluster.go:125: [WARNING Hostname]: hostname __ci-4628.1.2-n-e8d59efef8__: lookup ci-4628.1.2-n-e8d59efef8 on 168.63.129.16:53: no such host" L14: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L15: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L16: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L17: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L18: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L19: "cluster.go:125: [certs] Generating __ca__ certificate and key" L20: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L21: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [ci-4628.1.2-n-e8d59efef8 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local] and IPs [10.?96.0.1 10.0.0.13]" L22: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L23: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L24: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L25: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L26: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L27: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L28: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L29: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L30: "cluster.go:125: [certs] Generating __sa__ key and public key" L31: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L32: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L33: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L34: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L35: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L36: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L37: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L38: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L39: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L40: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L41: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L42: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__" L43: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__" L44: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L45: "cluster.go:125: [kubelet-start] Starting the kubelet" L46: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__" L47: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s" L48: "cluster.go:125: [kubelet-check] The kubelet is healthy after 501.636858ms" L49: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s" L50: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.13:6443/livez" L51: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz" L52: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez" L53: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 1.004841384s" L54: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 1.567550486s" L55: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 3.501596487s" L56: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace" L57: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster" L58: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs" L59: "cluster.go:125: [mark-control-plane] Marking the node ci-4628.1.2-n-e8d59efef8 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-lo?ad-balancers]" L60: "cluster.go:125: [mark-control-plane] Marking the node ci-4628.1.2-n-e8d59efef8 as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]" L61: "cluster.go:125: [bootstrap-token] Using token: ddl79m.kbdu83dz0f610o5p" L62: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles" L63: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes" L64: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials" L65: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token" L66: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster" L67: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace" L68: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key" L69: "cluster.go:125: [addons] Applied essential addon: CoreDNS" L70: "cluster.go:125: [addons] Applied essential addon: kube-proxy" L71: "cluster.go:125: " L72: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!" L73: "cluster.go:125: " L74: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:" L75: "cluster.go:125: " L76: "cluster.go:125: mkdir -p $HOME/.kube" L77: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config" L78: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config" L79: "cluster.go:125: " L80: "cluster.go:125: Alternatively, if you are the root user, you can run:" L81: "cluster.go:125: " L82: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf" L83: "cluster.go:125: " L84: "cluster.go:125: You should now deploy a pod network to the cluster." L85: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:" L86: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/" L87: "cluster.go:125: " L88: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:" L89: "cluster.go:125: " L90: "cluster.go:125: kubeadm join 10.0.0.13:6443 --token ddl79m.kbdu83dz0f610o5p _" L91: "cluster.go:125: --discovery-token-ca-cert-hash sha256:4dffb795aca5330404131fe353e6ff497c887c8fc3fd98513d11fd5b5e041ba2 " L92: "cluster.go:125: i Using Cilium version 1.12.5" L93: "cluster.go:125: ? Auto-detected cluster name: kubernetes" L94: "cluster.go:125: ? Auto-detected datapath mode: tunnel" L95: "cluster.go:125: ? Auto-detected kube-proxy has been installed" L96: "cluster.go:125: i helm template --namespace kube-system cilium cilium/cilium --version 1.12.5 --set cluster.id=0,cluster.name=kubernetes,encryption.nodeEncryption=false,extraConfig.cluster-pool-ipv4-?cidr=192.168.0.0/17,extraConfig.enable-endpoint-routes=true,kubeProxyReplacement=disabled,operator.replicas=1,serviceAccounts.cilium.name=cilium,serviceAccounts.operator.name=cilium-operator,tunnel=vx?lan" L97: "cluster.go:125: i Storing helm values file in kube-system/cilium-cli-helm-values Secret" L98: "cluster.go:125: ? Created CA in secret cilium-ca" L99: "cluster.go:125: ? Generating certificates for Hubble..." L100: "cluster.go:125: ? Creating Service accounts..." L101: "cluster.go:125: ? Creating Cluster roles..." L102: "cluster.go:125: ? Creating ConfigMap for Cilium version 1.12.5..." L103: "cluster.go:125: i Manual overwrite in ConfigMap: enable-endpoint-routes=true" L104: "cluster.go:125: i Manual overwrite in ConfigMap: cluster-pool-ipv4-cidr=192.168.0.0/17" L105: "cluster.go:125: ? Creating Agent DaemonSet..." L106: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/mount-cgroup]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L107: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/apply-sysctl-overwrites]: deprecated since v1.30; use the ___appArmorProfile___ fi?eld instead__ subsys=klog" L108: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/clean-cilium-state]: deprecated since v1.30; use the ___appArmorProfile___ field i?nstead__ subsys=klog" L109: "cluster.go:125: level=warning msg=__spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/cilium-agent]: deprecated since v1.30; use the ___appArmorProfile___ field instead?__ subsys=klog" L110: "cluster.go:125: ? Creating Operator Deployment..." L111: "cluster.go:125: ? Waiting for Cilium to be installed and ready..." L112: "cluster.go:125: ? Cilium was successfully installed! Run _cilium status_ to view installation health" L113: "kubeadm.go:197: unable to setup cluster: unable to run master script: wait: remote command exited without exit status or exit signal_" L114: " " ```
🟢 ok **kubeadm.v1.35.1.flannel.base**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _kubeadm.go:197: unable to setup cluster: unable to create etcd node: PollUntilDone(ci-4628.1.2-n-912ac7c7f2): GET https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2?e/providers/Microsoft.Compute/locations/northeurope/operations/01acdf60-6f07-40bc-ab4d-9562edcb57dd" L2: "--------------------------------------------------------------------------------" L3: "RESPONSE 200: 200 OK" L4: "ERROR CODE: OperationPreempted" L5: "--------------------------------------------------------------------------------" L6: "{" L7: "__startTime__: __2026-06-04T00:37:50.0554264+00:00__," L8: "__endTime__: __2026-06-04T00:38:34.2332608+00:00__," L9: "__status__: __Canceled__," L10: "__error__: {" L11: "__code__: __OperationPreempted__," L12: "__message__: __Operation execution has been preempted by a more recent operation.__" L13: "}," L14: "__name__: __01acdf60-6f07-40bc-ab4d-9562edcb57dd__" L15: "}" L16: "--------------------------------------------------------------------------------_" L17: " " ```
🟢 ok **kubeadm.v1.36.1.calico.base**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.36.1" L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.36.1" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.36.1" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.36.1" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.14.2" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.2" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.8-0" L8: "cluster.go:125: [init] Using Kubernetes version: v1.36.1" L9: "cluster.go:125: [preflight] Running pre-flight checks" L10: "cluster.go:125: [WARNING Hostname]: hostname __ci-4628.1.2-n-eb965506b7__ could not be reached" L11: "cluster.go:125: [WARNING Hostname]: hostname __ci-4628.1.2-n-eb965506b7__: lookup ci-4628.1.2-n-eb965506b7 on 168.63.129.16:53: no such host" L12: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L13: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L14: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L15: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L16: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L17: "cluster.go:125: [certs] Generating __ca__ certificate and key" L18: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L19: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [ci-4628.1.2-n-eb965506b7 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local] and IPs [10.?96.0.1 10.0.0.25]" L20: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L21: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L22: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L23: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L24: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L25: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L26: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L27: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L28: "cluster.go:125: [certs] Generating __sa__ key and public key" L29: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L30: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L31: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L32: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L33: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L34: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L35: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L36: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L37: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L38: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L39: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L40: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__" L41: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__" L42: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L43: "cluster.go:125: [kubelet-start] Starting the kubelet" L44: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__" L45: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s" L46: "cluster.go:125: [kubelet-check] The kubelet is healthy after 966.808??s" L47: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s" L48: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.25:6443/livez" L49: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz" L50: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez" L51: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 4.679056ms" L52: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 4.456286ms" L53: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 1.500823085s" L54: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace" L55: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster" L56: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs" L57: "cluster.go:125: [mark-control-plane] Marking the node ci-4628.1.2-n-eb965506b7 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-lo?ad-balancers]" L58: "cluster.go:125: [mark-control-plane] Marking the node ci-4628.1.2-n-eb965506b7 as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]" L59: "cluster.go:125: [bootstrap-token] Using token: 7bfovn.x0l2k23e3yic1ra9" L60: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles" L61: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes" L62: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials" L63: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token" L64: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster" L65: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the API server kubelet client certificate to access the kubelet API" L66: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace" L67: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key" L68: "cluster.go:125: [addons] Applied essential addon: CoreDNS" L69: "cluster.go:125: [addons] Applied essential addon: kube-proxy" L70: "cluster.go:125: " L71: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!" L72: "cluster.go:125: " L73: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:" L74: "cluster.go:125: " L75: "cluster.go:125: mkdir -p $HOME/.kube" L76: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config" L77: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config" L78: "cluster.go:125: " L79: "cluster.go:125: Alternatively, if you are the root user, you can run:" L80: "cluster.go:125: " L81: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf" L82: "cluster.go:125: " L83: "cluster.go:125: You should now deploy a pod network to the cluster." L84: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:" L85: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/" L86: "cluster.go:125: " L87: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:" L88: "cluster.go:125: " L89: "cluster.go:125: kubeadm join 10.0.0.25:6443 --token 7bfovn.x0l2k23e3yic1ra9 _" L90: "cluster.go:125: --discovery-token-ca-cert-hash sha256:ce0db1dfd9c0933241e0f8ac70c01258469861ff5fd633fa3de3ada46aa44b9d " L91: "cluster.go:125: namespace/tigera-operator created" L92: "cluster.go:125: serviceaccount/tigera-operator created" L93: "cluster.go:125: clusterrole.rbac.authorization.k8s.io/tigera-operator-secrets created" L94: "cluster.go:125: clusterrole.rbac.authorization.k8s.io/tigera-operator created" L95: "cluster.go:125: clusterrolebinding.rbac.authorization.k8s.io/tigera-operator created" L96: "cluster.go:125: rolebinding.rbac.authorization.k8s.io/tigera-operator-secrets created" L97: "cluster.go:125: deployment.apps/tigera-operator created" L98: "cluster.go:125: customresourcedefinition.apiextensions.k8s.io/installations.operator.tigera.io condition met" L99: "cluster.go:125: customresourcedefinition.apiextensions.k8s.io/installations.operator.tigera.io condition met" L100: "cluster.go:125: customresourcedefinition.apiextensions.k8s.io/apiservers.operator.tigera.io condition met" L101: "cluster.go:125: customresourcedefinition.apiextensions.k8s.io/apiservers.operator.tigera.io condition met" L102: "cluster.go:125: installation.operator.tigera.io/default created" L103: "cluster.go:125: apiserver.operator.tigera.io/default created" L104: "cluster.go:125: goldmane.operator.tigera.io/default created" L105: "cluster.go:125: whisker.operator.tigera.io/default created" L106: "kubeadm.go:197: unable to setup cluster: unable to create worker node: PollUntilDone(ci-4628.1.2-n-2e1f45291b): GET https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/reso?urceGroups/kola-cluster-image-6e3cf9d480/providers/Microsoft.Compute/virtualMachines/ci-4628.1.2-n-2e1f45291b" L107: "--------------------------------------------------------------------------------" L108: "RESPONSE 404: 404 Not Found" L109: "ERROR CODE: NotFound" L110: "--------------------------------------------------------------------------------" L111: "{" L112: "__error__: {" L113: "__code__: __NotFound__," L114: "__message__: __The entity was not found in this Azure location.__" L115: "}" L116: "}" L117: "--------------------------------------------------------------------------------_" L118: " " ```
🟢 ok **kubeadm.v1.36.1.cilium.base**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _kubeadm.go:197: unable to setup cluster: unable to create etcd node: PollUntilDone(ci-4628.1.2-n-92d50e4ffe): GET https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2?e/providers/Microsoft.Compute/locations/northeurope/operations/c73c62cc-bcfc-4d9a-86f2-5103c1ff64fd" L2: "--------------------------------------------------------------------------------" L3: "RESPONSE 200: 200 OK" L4: "ERROR CODE: OperationPreempted" L5: "--------------------------------------------------------------------------------" L6: "{" L7: "__startTime__: __2026-06-04T00:37:42.136114+00:00__," L8: "__endTime__: __2026-06-04T00:38:34.4715102+00:00__," L9: "__status__: __Canceled__," L10: "__error__: {" L11: "__code__: __OperationPreempted__," L12: "__message__: __Operation execution has been preempted by a more recent operation.__" L13: "}," L14: "__name__: __c73c62cc-bcfc-4d9a-86f2-5103c1ff64fd__" L15: "}" L16: "--------------------------------------------------------------------------------_" L17: " " ```
🟢 ok **kubeadm.v1.36.1.flannel.base**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _cluster.go:125: [config/images] Pulled registry.k8s.io/kube-apiserver:v1.36.1" L2: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-controller-manager:v1.36.1" L3: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-scheduler:v1.36.1" L4: "cluster.go:125: [config/images] Pulled registry.k8s.io/kube-proxy:v1.36.1" L5: "cluster.go:125: [config/images] Pulled registry.k8s.io/coredns/coredns:v1.14.2" L6: "cluster.go:125: [config/images] Pulled registry.k8s.io/pause:3.10.2" L7: "cluster.go:125: [config/images] Pulled registry.k8s.io/etcd:3.6.8-0" L8: "cluster.go:125: [init] Using Kubernetes version: v1.36.1" L9: "cluster.go:125: [preflight] Running pre-flight checks" L10: "cluster.go:125: [WARNING Hostname]: hostname __ci-4628.1.2-n-1b1ac94928__ could not be reached" L11: "cluster.go:125: [WARNING Hostname]: hostname __ci-4628.1.2-n-1b1ac94928__: lookup ci-4628.1.2-n-1b1ac94928 on 168.63.129.16:53: no such host" L12: "cluster.go:125: [WARNING Service-kubelet]: kubelet service is not enabled, please run _systemctl enable kubelet.service_" L13: "cluster.go:125: [preflight] Pulling images required for setting up a Kubernetes cluster" L14: "cluster.go:125: [preflight] This might take a minute or two, depending on the speed of your internet connection" L15: "cluster.go:125: [preflight] You can also perform this action beforehand using _kubeadm config images pull_" L16: "cluster.go:125: [certs] Using certificateDir folder __/etc/kubernetes/pki__" L17: "cluster.go:125: [certs] Generating __ca__ certificate and key" L18: "cluster.go:125: [certs] Generating __apiserver__ certificate and key" L19: "cluster.go:125: [certs] apiserver serving cert is signed for DNS names [ci-4628.1.2-n-1b1ac94928 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local] and IPs [10.?96.0.1 10.0.0.19]" L20: "cluster.go:125: [certs] Generating __apiserver-kubelet-client__ certificate and key" L21: "cluster.go:125: [certs] Generating __front-proxy-ca__ certificate and key" L22: "cluster.go:125: [certs] Generating __front-proxy-client__ certificate and key" L23: "cluster.go:125: [certs] External etcd mode: Skipping etcd/ca certificate authority generation" L24: "cluster.go:125: [certs] External etcd mode: Skipping etcd/server certificate generation" L25: "cluster.go:125: [certs] External etcd mode: Skipping etcd/peer certificate generation" L26: "cluster.go:125: [certs] External etcd mode: Skipping etcd/healthcheck-client certificate generation" L27: "cluster.go:125: [certs] External etcd mode: Skipping apiserver-etcd-client certificate generation" L28: "cluster.go:125: [certs] Generating __sa__ key and public key" L29: "cluster.go:125: [kubeconfig] Using kubeconfig folder __/etc/kubernetes__" L30: "cluster.go:125: [kubeconfig] Writing __admin.conf__ kubeconfig file" L31: "cluster.go:125: [kubeconfig] Writing __super-admin.conf__ kubeconfig file" L32: "cluster.go:125: [kubeconfig] Writing __kubelet.conf__ kubeconfig file" L33: "cluster.go:125: [kubeconfig] Writing __controller-manager.conf__ kubeconfig file" L34: "cluster.go:125: [kubeconfig] Writing __scheduler.conf__ kubeconfig file" L35: "cluster.go:125: [control-plane] Using manifest folder __/etc/kubernetes/manifests__" L36: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-apiserver__" L37: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-controller-manager__" L38: "cluster.go:125: [control-plane] Creating static Pod manifest for __kube-scheduler__" L39: "cluster.go:125: [kubelet-start] Writing kubelet environment file with flags to file __/var/lib/kubelet/kubeadm-flags.env__" L40: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/instance-config.yaml__" L41: "cluster.go:125: [patches] Applied patch of type __application/strategic-merge-patch+json__ to target __kubeletconfiguration__" L42: "cluster.go:125: [kubelet-start] Writing kubelet configuration to file __/var/lib/kubelet/config.yaml__" L43: "cluster.go:125: [kubelet-start] Starting the kubelet" L44: "cluster.go:125: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory __/etc/kubernetes/manifests__" L45: "cluster.go:125: [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s" L46: "cluster.go:125: [kubelet-check] The kubelet is healthy after 1.507055ms" L47: "cluster.go:125: [control-plane-check] Waiting for healthy control plane components. This can take up to 30m0s" L48: "cluster.go:125: [control-plane-check] Checking kube-apiserver at https://10.0.0.19:6443/livez" L49: "cluster.go:125: [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz" L50: "cluster.go:125: [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez" L51: "cluster.go:125: [control-plane-check] kube-controller-manager is healthy after 5.205209ms" L52: "cluster.go:125: [control-plane-check] kube-scheduler is healthy after 7.442472ms" L53: "cluster.go:125: [control-plane-check] kube-apiserver is healthy after 2.003551463s" L54: "cluster.go:125: [upload-config] Storing the configuration used in ConfigMap __kubeadm-config__ in the __kube-system__ Namespace" L55: "cluster.go:125: [kubelet] Creating a ConfigMap __kubelet-config__ in namespace kube-system with the configuration for the kubelets in the cluster" L56: "cluster.go:125: [upload-certs] Skipping phase. Please see --upload-certs" L57: "cluster.go:125: [mark-control-plane] Marking the node ci-4628.1.2-n-1b1ac94928 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-lo?ad-balancers]" L58: "cluster.go:125: [mark-control-plane] Marking the node ci-4628.1.2-n-1b1ac94928 as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]" L59: "cluster.go:125: [bootstrap-token] Using token: p07833.1lzbnx02rh376lbt" L60: "cluster.go:125: [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles" L61: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes" L62: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials" L63: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token" L64: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster" L65: "cluster.go:125: [bootstrap-token] Configured RBAC rules to allow the API server kubelet client certificate to access the kubelet API" L66: "cluster.go:125: [bootstrap-token] Creating the __cluster-info__ ConfigMap in the __kube-public__ namespace" L67: "cluster.go:125: [kubelet-finalize] Updating __/etc/kubernetes/kubelet.conf__ to point to a rotatable kubelet client certificate and key" L68: "cluster.go:125: [addons] Applied essential addon: CoreDNS" L69: "cluster.go:125: [addons] Applied essential addon: kube-proxy" L70: "cluster.go:125: " L71: "cluster.go:125: Your Kubernetes control-plane has initialized successfully!" L72: "cluster.go:125: " L73: "cluster.go:125: To start using your cluster, you need to run the following as a regular user:" L74: "cluster.go:125: " L75: "cluster.go:125: mkdir -p $HOME/.kube" L76: "cluster.go:125: sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config" L77: "cluster.go:125: sudo chown $(id -u):$(id -g) $HOME/.kube/config" L78: "cluster.go:125: " L79: "cluster.go:125: Alternatively, if you are the root user, you can run:" L80: "cluster.go:125: " L81: "cluster.go:125: export KUBECONFIG=/etc/kubernetes/admin.conf" L82: "cluster.go:125: " L83: "cluster.go:125: You should now deploy a pod network to the cluster." L84: "cluster.go:125: Run __kubectl apply -f [podnetwork].yaml__ with one of the options listed at:" L85: "cluster.go:125: https://kubernetes.io/docs/concepts/cluster-administration/addons/" L86: "cluster.go:125: " L87: "cluster.go:125: Then you can join any number of worker nodes by running the following on each as root:" L88: "cluster.go:125: " L89: "cluster.go:125: kubeadm join 10.0.0.19:6443 --token p07833.1lzbnx02rh376lbt _" L90: "cluster.go:125: --discovery-token-ca-cert-hash sha256:44aec93ccdd77b5416563c2884b6fe7904a45c0a19091740e376dfc2ecacd653 " L91: "cluster.go:125: namespace/kube-flannel created" L92: "cluster.go:125: clusterrole.rbac.authorization.k8s.io/flannel created" L93: "cluster.go:125: clusterrolebinding.rbac.authorization.k8s.io/flannel created" L94: "cluster.go:125: serviceaccount/flannel created" L95: "cluster.go:125: configmap/kube-flannel-cfg created" L96: "cluster.go:125: daemonset.apps/kube-flannel-ds created" L97: "kubeadm.go:197: unable to setup cluster: unable to create worker node: waiting for machine to become active: GET https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourc?eGroups/kola-cluster-image-6e3cf9d480/providers/Microsoft.Compute/virtualMachines/ci-4628.1.2-n-373189fa7d" L98: "--------------------------------------------------------------------------------" L99: "RESPONSE 404: 404 Not Found" L100: "ERROR CODE: NotFound" L101: "--------------------------------------------------------------------------------" L102: "{" L103: "__error__: {" L104: "__code__: __NotFound__," L105: "__message__: __The entity was not found in this Azure location.__" L106: "}" L107: "}" L108: "--------------------------------------------------------------------------------_" L109: " " ```
🟢 ok **sysext.custom-docker.sysext**; Succeeded: azure (1) 🟢 ok **sysext.disable-containerd**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _harness.go:646: Cluster failed starting machines: creating public ip: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kola-cluster-image-6e3c?f9d480/providers/Microsoft.Network/publicIPAddresses/ip-c27d4e7622" L2: "--------------------------------------------------------------------------------" L3: "RESPONSE 409: 409 Conflict" L4: "ERROR CODE: ResourceGroupBeingDeleted" L5: "--------------------------------------------------------------------------------" L6: "{" L7: "__error__: {" L8: "__code__: __ResourceGroupBeingDeleted__," L9: "__message__: __The resource group _kola-cluster-image-6e3cf9d480_ is in deprovisioning state and cannot perform this operation.__" L10: "}" L11: "}" L12: "--------------------------------------------------------------------------------_" L13: " " ```
🟢 ok **sysext.disable-docker**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _harness.go:646: Cluster failed starting machines: creating public ip: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kola-cluster-image-6e3c?f9d480/providers/Microsoft.Network/publicIPAddresses/ip-a25386e806" L2: "--------------------------------------------------------------------------------" L3: "RESPONSE 409: 409 Conflict" L4: "ERROR CODE: ResourceGroupBeingDeleted" L5: "--------------------------------------------------------------------------------" L6: "{" L7: "__error__: {" L8: "__code__: __ResourceGroupBeingDeleted__," L9: "__message__: __The resource group _kola-cluster-image-6e3cf9d480_ is in deprovisioning state and cannot perform this operation.__" L10: "}" L11: "}" L12: "--------------------------------------------------------------------------------_" L13: " " ```
🟢 ok **sysext.simple**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _harness.go:646: Cluster failed starting machines: creating public ip: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kola-cluster-image-6e3c?f9d480/providers/Microsoft.Network/publicIPAddresses/ip-05207d2ac4" L2: "--------------------------------------------------------------------------------" L3: "RESPONSE 409: 409 Conflict" L4: "ERROR CODE: ResourceGroupBeingDeleted" L5: "--------------------------------------------------------------------------------" L6: "{" L7: "__error__: {" L8: "__code__: __ResourceGroupBeingDeleted__," L9: "__message__: __The resource group _kola-cluster-image-6e3cf9d480_ is in deprovisioning state and cannot perform this operation.__" L10: "}" L11: "}" L12: "--------------------------------------------------------------------------------_" L13: " " ```
🟢 ok **systemd.journal.user**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _harness.go:646: Cluster failed starting machines: creating public ip: PUT https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/resourceGroups/kola-cluster-image-6e3c?f9d480/providers/Microsoft.Network/publicIPAddresses/ip-d96e025eba" L2: "--------------------------------------------------------------------------------" L3: "RESPONSE 409: 409 Conflict" L4: "ERROR CODE: ResourceGroupBeingDeleted" L5: "--------------------------------------------------------------------------------" L6: "{" L7: "__error__: {" L8: "__code__: __ResourceGroupBeingDeleted__," L9: "__message__: __The resource group _kola-cluster-image-6e3cf9d480_ is in deprovisioning state and cannot perform this operation.__" L10: "}" L11: "}" L12: "--------------------------------------------------------------------------------_" L13: " " ```
🟢 ok **systemd.sysusers.gshadow**; Succeeded: azure (2); Failed: azure (1)
                Diagnostic output for azure, run 1 ``` L1: " Error: _harness.go:646: Cluster failed starting machines: PollUntilDone(ci-4628.1.2-n-d0b00ad73a): GET https://management.azure.com/subscriptions/0e46bd28-a80f-4d3a-8200-d9eb8d80cb2e/providers/Microso?ft.Compute/locations/northeurope/operations/9f7481c6-3f75-4669-beda-590faaa43ae2" L2: "--------------------------------------------------------------------------------" L3: "RESPONSE 200: 200 OK" L4: "ERROR CODE: OperationPreempted" L5: "--------------------------------------------------------------------------------" L6: "{" L7: "__startTime__: __2026-06-04T00:38:08.9247689+00:00__," L8: "__endTime__: __2026-06-04T00:38:41.0020935+00:00__," L9: "__status__: __Canceled__," L10: "__error__: {" L11: "__code__: __OperationPreempted__," L12: "__message__: __Operation execution has been preempted by a more recent operation.__" L13: "}," L14: "__name__: __9f7481c6-3f75-4669-beda-590faaa43ae2__" L15: "}" L16: "--------------------------------------------------------------------------------_" L17: " " ```