Nov 8 00:04:54.283512 kernel: Booting Linux on physical CPU 0x0000000000 [0x410fd083] Nov 8 00:04:54.283564 kernel: Linux version 6.6.113-flatcar (build@pony-truck.infra.kinvolk.io) (aarch64-cros-linux-gnu-gcc (Gentoo Hardened 13.3.1_p20240614 p17) 13.3.1 20240614, GNU ld (Gentoo 2.42 p3) 2.42.0) #1 SMP PREEMPT Fri Nov 7 22:41:39 -00 2025 Nov 8 00:04:54.283592 kernel: KASLR disabled due to lack of seed Nov 8 00:04:54.283610 kernel: efi: EFI v2.7 by EDK II Nov 8 00:04:54.283627 kernel: efi: SMBIOS=0x7bed0000 SMBIOS 3.0=0x7beb0000 ACPI=0x786e0000 ACPI 2.0=0x786e0014 MEMATTR=0x7affea98 MEMRESERVE=0x7852ee18 Nov 8 00:04:54.283643 kernel: ACPI: Early table checksum verification disabled Nov 8 00:04:54.283662 kernel: ACPI: RSDP 0x00000000786E0014 000024 (v02 AMAZON) Nov 8 00:04:54.283678 kernel: ACPI: XSDT 0x00000000786D00E8 000064 (v01 AMAZON AMZNFACP 00000001 01000013) Nov 8 00:04:54.283695 kernel: ACPI: FACP 0x00000000786B0000 000114 (v06 AMAZON AMZNFACP 00000001 AMZN 00000001) Nov 8 00:04:54.283712 kernel: ACPI: DSDT 0x0000000078640000 00159D (v02 AMAZON AMZNDSDT 00000001 INTL 20160527) Nov 8 00:04:54.283735 kernel: ACPI: APIC 0x00000000786C0000 000108 (v04 AMAZON AMZNAPIC 00000001 AMZN 00000001) Nov 8 00:04:54.283751 kernel: ACPI: SPCR 0x00000000786A0000 000050 (v02 AMAZON AMZNSPCR 00000001 AMZN 00000001) Nov 8 00:04:54.283768 kernel: ACPI: GTDT 0x0000000078690000 000060 (v02 AMAZON AMZNGTDT 00000001 AMZN 00000001) Nov 8 00:04:54.283785 kernel: ACPI: MCFG 0x0000000078680000 00003C (v02 AMAZON AMZNMCFG 00000001 AMZN 00000001) Nov 8 00:04:54.283805 kernel: ACPI: SLIT 0x0000000078670000 00002D (v01 AMAZON AMZNSLIT 00000001 AMZN 00000001) Nov 8 00:04:54.283828 kernel: ACPI: IORT 0x0000000078660000 000078 (v01 AMAZON AMZNIORT 00000001 AMZN 00000001) Nov 8 00:04:54.283847 kernel: ACPI: PPTT 0x0000000078650000 0000EC (v01 AMAZON AMZNPPTT 00000001 AMZN 00000001) Nov 8 00:04:54.283864 kernel: ACPI: SPCR: console: uart,mmio,0x90a0000,115200 Nov 8 00:04:54.283882 kernel: earlycon: uart0 at MMIO 0x00000000090a0000 (options '115200') Nov 8 00:04:54.283899 kernel: printk: bootconsole [uart0] enabled Nov 8 00:04:54.283916 kernel: NUMA: Failed to initialise from firmware Nov 8 00:04:54.283934 kernel: NUMA: Faking a node at [mem 0x0000000040000000-0x00000004b5ffffff] Nov 8 00:04:54.283952 kernel: NUMA: NODE_DATA [mem 0x4b583f800-0x4b5844fff] Nov 8 00:04:54.283969 kernel: Zone ranges: Nov 8 00:04:54.283987 kernel: DMA [mem 0x0000000040000000-0x00000000ffffffff] Nov 8 00:04:54.284005 kernel: DMA32 empty Nov 8 00:04:54.284029 kernel: Normal [mem 0x0000000100000000-0x00000004b5ffffff] Nov 8 00:04:54.284048 kernel: Movable zone start for each node Nov 8 00:04:54.284065 kernel: Early memory node ranges Nov 8 00:04:54.284082 kernel: node 0: [mem 0x0000000040000000-0x000000007862ffff] Nov 8 00:04:54.284100 kernel: node 0: [mem 0x0000000078630000-0x000000007863ffff] Nov 8 00:04:54.284118 kernel: node 0: [mem 0x0000000078640000-0x00000000786effff] Nov 8 00:04:54.284135 kernel: node 0: [mem 0x00000000786f0000-0x000000007872ffff] Nov 8 00:04:54.284194 kernel: node 0: [mem 0x0000000078730000-0x000000007bbfffff] Nov 8 00:04:54.284218 kernel: node 0: [mem 0x000000007bc00000-0x000000007bfdffff] Nov 8 00:04:54.284236 kernel: node 0: [mem 0x000000007bfe0000-0x000000007fffffff] Nov 8 00:04:54.284254 kernel: node 0: [mem 0x0000000400000000-0x00000004b5ffffff] Nov 8 00:04:54.284313 kernel: Initmem setup node 0 [mem 0x0000000040000000-0x00000004b5ffffff] Nov 8 00:04:54.284344 kernel: On node 0, zone Normal: 8192 pages in unavailable ranges Nov 8 00:04:54.284362 kernel: psci: probing for conduit method from ACPI. Nov 8 00:04:54.284387 kernel: psci: PSCIv1.0 detected in firmware. Nov 8 00:04:54.284406 kernel: psci: Using standard PSCI v0.2 function IDs Nov 8 00:04:54.284424 kernel: psci: Trusted OS migration not required Nov 8 00:04:54.284447 kernel: psci: SMC Calling Convention v1.1 Nov 8 00:04:54.284466 kernel: smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000001) Nov 8 00:04:54.284484 kernel: percpu: Embedded 31 pages/cpu s86120 r8192 d32664 u126976 Nov 8 00:04:54.284502 kernel: pcpu-alloc: s86120 r8192 d32664 u126976 alloc=31*4096 Nov 8 00:04:54.284521 kernel: pcpu-alloc: [0] 0 [0] 1 Nov 8 00:04:54.284539 kernel: Detected PIPT I-cache on CPU0 Nov 8 00:04:54.284558 kernel: CPU features: detected: GIC system register CPU interface Nov 8 00:04:54.284576 kernel: CPU features: detected: Spectre-v2 Nov 8 00:04:54.284593 kernel: CPU features: detected: Spectre-v3a Nov 8 00:04:54.284612 kernel: CPU features: detected: Spectre-BHB Nov 8 00:04:54.284631 kernel: CPU features: detected: ARM erratum 1742098 Nov 8 00:04:54.284658 kernel: CPU features: detected: ARM errata 1165522, 1319367, or 1530923 Nov 8 00:04:54.284677 kernel: alternatives: applying boot alternatives Nov 8 00:04:54.284698 kernel: Kernel command line: BOOT_IMAGE=/flatcar/vmlinuz-a mount.usr=/dev/mapper/usr verity.usr=PARTUUID=7130c94a-213a-4e5a-8e26-6cce9662f132 rootflags=rw mount.usrflags=ro consoleblank=0 root=LABEL=ROOT console=tty1 console=ttyS0,115200n8 earlycon flatcar.first_boot=detected acpi=force flatcar.oem.id=ec2 modprobe.blacklist=xen_fbfront net.ifnames=0 nvme_core.io_timeout=4294967295 verity.usrhash=653fdcb8a67e255793a721f32d76976d3ed6223b235b7c618cf75e5edffbdb68 Nov 8 00:04:54.284718 kernel: Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) Nov 8 00:04:54.284736 kernel: Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) Nov 8 00:04:54.284755 kernel: Fallback order for Node 0: 0 Nov 8 00:04:54.284773 kernel: Built 1 zonelists, mobility grouping on. Total pages: 991872 Nov 8 00:04:54.284791 kernel: Policy zone: Normal Nov 8 00:04:54.284809 kernel: mem auto-init: stack:off, heap alloc:off, heap free:off Nov 8 00:04:54.284828 kernel: software IO TLB: area num 2. Nov 8 00:04:54.284846 kernel: software IO TLB: mapped [mem 0x000000007c000000-0x0000000080000000] (64MB) Nov 8 00:04:54.284875 kernel: Memory: 3820088K/4030464K available (10304K kernel code, 2180K rwdata, 8112K rodata, 39424K init, 897K bss, 210376K reserved, 0K cma-reserved) Nov 8 00:04:54.284895 kernel: SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=2, Nodes=1 Nov 8 00:04:54.284913 kernel: rcu: Preemptible hierarchical RCU implementation. Nov 8 00:04:54.284933 kernel: rcu: RCU event tracing is enabled. Nov 8 00:04:54.284952 kernel: rcu: RCU restricting CPUs from NR_CPUS=512 to nr_cpu_ids=2. Nov 8 00:04:54.284971 kernel: Trampoline variant of Tasks RCU enabled. Nov 8 00:04:54.284989 kernel: Tracing variant of Tasks RCU enabled. Nov 8 00:04:54.285007 kernel: rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. Nov 8 00:04:54.285025 kernel: rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=2 Nov 8 00:04:54.285043 kernel: NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 Nov 8 00:04:54.285060 kernel: GICv3: 96 SPIs implemented Nov 8 00:04:54.285085 kernel: GICv3: 0 Extended SPIs implemented Nov 8 00:04:54.285103 kernel: Root IRQ handler: gic_handle_irq Nov 8 00:04:54.285120 kernel: GICv3: GICv3 features: 16 PPIs Nov 8 00:04:54.285138 kernel: GICv3: CPU0: found redistributor 0 region 0:0x0000000010200000 Nov 8 00:04:54.285225 kernel: ITS [mem 0x10080000-0x1009ffff] Nov 8 00:04:54.285248 kernel: ITS@0x0000000010080000: allocated 8192 Devices @4000b0000 (indirect, esz 8, psz 64K, shr 1) Nov 8 00:04:54.285267 kernel: ITS@0x0000000010080000: allocated 8192 Interrupt Collections @4000c0000 (flat, esz 8, psz 64K, shr 1) Nov 8 00:04:54.285285 kernel: GICv3: using LPI property table @0x00000004000d0000 Nov 8 00:04:54.285303 kernel: ITS: Using hypervisor restricted LPI range [128] Nov 8 00:04:54.285320 kernel: GICv3: CPU0: using allocated LPI pending table @0x00000004000e0000 Nov 8 00:04:54.285338 kernel: rcu: srcu_init: Setting srcu_struct sizes based on contention. Nov 8 00:04:54.285355 kernel: arch_timer: cp15 timer(s) running at 83.33MHz (virt). Nov 8 00:04:54.285381 kernel: clocksource: arch_sys_counter: mask: 0x1ffffffffffffff max_cycles: 0x13381ebeec, max_idle_ns: 440795203145 ns Nov 8 00:04:54.285399 kernel: sched_clock: 57 bits at 83MHz, resolution 12ns, wraps every 4398046511100ns Nov 8 00:04:54.285418 kernel: Console: colour dummy device 80x25 Nov 8 00:04:54.285436 kernel: printk: console [tty1] enabled Nov 8 00:04:54.285454 kernel: ACPI: Core revision 20230628 Nov 8 00:04:54.285472 kernel: Calibrating delay loop (skipped), value calculated using timer frequency.. 166.66 BogoMIPS (lpj=83333) Nov 8 00:04:54.285511 kernel: pid_max: default: 32768 minimum: 301 Nov 8 00:04:54.285560 kernel: LSM: initializing lsm=lockdown,capability,landlock,selinux,integrity Nov 8 00:04:54.285584 kernel: landlock: Up and running. Nov 8 00:04:54.285609 kernel: SELinux: Initializing. Nov 8 00:04:54.285628 kernel: Mount-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) Nov 8 00:04:54.285646 kernel: Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) Nov 8 00:04:54.285664 kernel: RCU Tasks: Setting shift to 1 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=2. Nov 8 00:04:54.285682 kernel: RCU Tasks Trace: Setting shift to 1 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=2. Nov 8 00:04:54.285701 kernel: rcu: Hierarchical SRCU implementation. Nov 8 00:04:54.285719 kernel: rcu: Max phase no-delay instances is 400. Nov 8 00:04:54.285737 kernel: Platform MSI: ITS@0x10080000 domain created Nov 8 00:04:54.285756 kernel: PCI/MSI: ITS@0x10080000 domain created Nov 8 00:04:54.285778 kernel: Remapping and enabling EFI services. Nov 8 00:04:54.285796 kernel: smp: Bringing up secondary CPUs ... Nov 8 00:04:54.285814 kernel: Detected PIPT I-cache on CPU1 Nov 8 00:04:54.285832 kernel: GICv3: CPU1: found redistributor 1 region 0:0x0000000010220000 Nov 8 00:04:54.285851 kernel: GICv3: CPU1: using allocated LPI pending table @0x00000004000f0000 Nov 8 00:04:54.285869 kernel: CPU1: Booted secondary processor 0x0000000001 [0x410fd083] Nov 8 00:04:54.285887 kernel: smp: Brought up 1 node, 2 CPUs Nov 8 00:04:54.285904 kernel: SMP: Total of 2 processors activated. Nov 8 00:04:54.285923 kernel: CPU features: detected: 32-bit EL0 Support Nov 8 00:04:54.285946 kernel: CPU features: detected: 32-bit EL1 Support Nov 8 00:04:54.285964 kernel: CPU features: detected: CRC32 instructions Nov 8 00:04:54.285982 kernel: CPU: All CPU(s) started at EL1 Nov 8 00:04:54.286013 kernel: alternatives: applying system-wide alternatives Nov 8 00:04:54.286036 kernel: devtmpfs: initialized Nov 8 00:04:54.286055 kernel: clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns Nov 8 00:04:54.286075 kernel: futex hash table entries: 512 (order: 3, 32768 bytes, linear) Nov 8 00:04:54.286093 kernel: pinctrl core: initialized pinctrl subsystem Nov 8 00:04:54.286112 kernel: SMBIOS 3.0.0 present. Nov 8 00:04:54.286135 kernel: DMI: Amazon EC2 a1.large/, BIOS 1.0 11/1/2018 Nov 8 00:04:54.286202 kernel: NET: Registered PF_NETLINK/PF_ROUTE protocol family Nov 8 00:04:54.286227 kernel: DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations Nov 8 00:04:54.286247 kernel: DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations Nov 8 00:04:54.286266 kernel: DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations Nov 8 00:04:54.286285 kernel: audit: initializing netlink subsys (disabled) Nov 8 00:04:54.286304 kernel: audit: type=2000 audit(0.297:1): state=initialized audit_enabled=0 res=1 Nov 8 00:04:54.286323 kernel: thermal_sys: Registered thermal governor 'step_wise' Nov 8 00:04:54.286349 kernel: cpuidle: using governor menu Nov 8 00:04:54.286368 kernel: hw-breakpoint: found 6 breakpoint and 4 watchpoint registers. Nov 8 00:04:54.286387 kernel: ASID allocator initialised with 65536 entries Nov 8 00:04:54.286406 kernel: acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 Nov 8 00:04:54.286425 kernel: Serial: AMBA PL011 UART driver Nov 8 00:04:54.287242 kernel: Modules: 17488 pages in range for non-PLT usage Nov 8 00:04:54.287274 kernel: Modules: 509008 pages in range for PLT usage Nov 8 00:04:54.287294 kernel: HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages Nov 8 00:04:54.287315 kernel: HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page Nov 8 00:04:54.287346 kernel: HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages Nov 8 00:04:54.287365 kernel: HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page Nov 8 00:04:54.287385 kernel: HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages Nov 8 00:04:54.287404 kernel: HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page Nov 8 00:04:54.287423 kernel: HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages Nov 8 00:04:54.287442 kernel: HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page Nov 8 00:04:54.287461 kernel: ACPI: Added _OSI(Module Device) Nov 8 00:04:54.287480 kernel: ACPI: Added _OSI(Processor Device) Nov 8 00:04:54.287499 kernel: ACPI: Added _OSI(Processor Aggregator Device) Nov 8 00:04:54.287523 kernel: ACPI: 1 ACPI AML tables successfully acquired and loaded Nov 8 00:04:54.287542 kernel: ACPI: Interpreter enabled Nov 8 00:04:54.287561 kernel: ACPI: Using GIC for interrupt routing Nov 8 00:04:54.287581 kernel: ACPI: MCFG table detected, 1 entries Nov 8 00:04:54.287600 kernel: ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-0f]) Nov 8 00:04:54.287937 kernel: acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] Nov 8 00:04:54.290293 kernel: acpi PNP0A08:00: _OSC: platform does not support [LTR] Nov 8 00:04:54.290628 kernel: acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME AER PCIeCapability] Nov 8 00:04:54.290916 kernel: acpi PNP0A08:00: ECAM area [mem 0x20000000-0x20ffffff] reserved by PNP0C02:00 Nov 8 00:04:54.293350 kernel: acpi PNP0A08:00: ECAM at [mem 0x20000000-0x20ffffff] for [bus 00-0f] Nov 8 00:04:54.293403 kernel: ACPI: Remapped I/O 0x000000001fff0000 to [io 0x0000-0xffff window] Nov 8 00:04:54.293424 kernel: acpiphp: Slot [1] registered Nov 8 00:04:54.293444 kernel: acpiphp: Slot [2] registered Nov 8 00:04:54.293463 kernel: acpiphp: Slot [3] registered Nov 8 00:04:54.293483 kernel: acpiphp: Slot [4] registered Nov 8 00:04:54.293502 kernel: acpiphp: Slot [5] registered Nov 8 00:04:54.293532 kernel: acpiphp: Slot [6] registered Nov 8 00:04:54.293552 kernel: acpiphp: Slot [7] registered Nov 8 00:04:54.293571 kernel: acpiphp: Slot [8] registered Nov 8 00:04:54.293590 kernel: acpiphp: Slot [9] registered Nov 8 00:04:54.293609 kernel: acpiphp: Slot [10] registered Nov 8 00:04:54.293628 kernel: acpiphp: Slot [11] registered Nov 8 00:04:54.293647 kernel: acpiphp: Slot [12] registered Nov 8 00:04:54.293665 kernel: acpiphp: Slot [13] registered Nov 8 00:04:54.293684 kernel: acpiphp: Slot [14] registered Nov 8 00:04:54.293703 kernel: acpiphp: Slot [15] registered Nov 8 00:04:54.293727 kernel: acpiphp: Slot [16] registered Nov 8 00:04:54.293746 kernel: acpiphp: Slot [17] registered Nov 8 00:04:54.293765 kernel: acpiphp: Slot [18] registered Nov 8 00:04:54.293784 kernel: acpiphp: Slot [19] registered Nov 8 00:04:54.293804 kernel: acpiphp: Slot [20] registered Nov 8 00:04:54.293822 kernel: acpiphp: Slot [21] registered Nov 8 00:04:54.293841 kernel: acpiphp: Slot [22] registered Nov 8 00:04:54.293860 kernel: acpiphp: Slot [23] registered Nov 8 00:04:54.293880 kernel: acpiphp: Slot [24] registered Nov 8 00:04:54.293905 kernel: acpiphp: Slot [25] registered Nov 8 00:04:54.293924 kernel: acpiphp: Slot [26] registered Nov 8 00:04:54.293942 kernel: acpiphp: Slot [27] registered Nov 8 00:04:54.293961 kernel: acpiphp: Slot [28] registered Nov 8 00:04:54.293980 kernel: acpiphp: Slot [29] registered Nov 8 00:04:54.293999 kernel: acpiphp: Slot [30] registered Nov 8 00:04:54.294018 kernel: acpiphp: Slot [31] registered Nov 8 00:04:54.294037 kernel: PCI host bridge to bus 0000:00 Nov 8 00:04:54.297116 kernel: pci_bus 0000:00: root bus resource [mem 0x80000000-0xffffffff window] Nov 8 00:04:54.297424 kernel: pci_bus 0000:00: root bus resource [io 0x0000-0xffff window] Nov 8 00:04:54.297636 kernel: pci_bus 0000:00: root bus resource [mem 0x400000000000-0x407fffffffff window] Nov 8 00:04:54.297837 kernel: pci_bus 0000:00: root bus resource [bus 00-0f] Nov 8 00:04:54.298087 kernel: pci 0000:00:00.0: [1d0f:0200] type 00 class 0x060000 Nov 8 00:04:54.300527 kernel: pci 0000:00:01.0: [1d0f:8250] type 00 class 0x070003 Nov 8 00:04:54.300804 kernel: pci 0000:00:01.0: reg 0x10: [mem 0x80118000-0x80118fff] Nov 8 00:04:54.301126 kernel: pci 0000:00:04.0: [1d0f:8061] type 00 class 0x010802 Nov 8 00:04:54.301459 kernel: pci 0000:00:04.0: reg 0x10: [mem 0x80114000-0x80117fff] Nov 8 00:04:54.301699 kernel: pci 0000:00:04.0: PME# supported from D0 D1 D2 D3hot D3cold Nov 8 00:04:54.301940 kernel: pci 0000:00:05.0: [1d0f:ec20] type 00 class 0x020000 Nov 8 00:04:54.306301 kernel: pci 0000:00:05.0: reg 0x10: [mem 0x80110000-0x80113fff] Nov 8 00:04:54.306615 kernel: pci 0000:00:05.0: reg 0x18: [mem 0x80000000-0x800fffff pref] Nov 8 00:04:54.306856 kernel: pci 0000:00:05.0: reg 0x20: [mem 0x80100000-0x8010ffff] Nov 8 00:04:54.307305 kernel: pci 0000:00:05.0: PME# supported from D0 D1 D2 D3hot D3cold Nov 8 00:04:54.307648 kernel: pci 0000:00:05.0: BAR 2: assigned [mem 0x80000000-0x800fffff pref] Nov 8 00:04:54.307972 kernel: pci 0000:00:05.0: BAR 4: assigned [mem 0x80100000-0x8010ffff] Nov 8 00:04:54.309209 kernel: pci 0000:00:04.0: BAR 0: assigned [mem 0x80110000-0x80113fff] Nov 8 00:04:54.309463 kernel: pci 0000:00:05.0: BAR 0: assigned [mem 0x80114000-0x80117fff] Nov 8 00:04:54.309689 kernel: pci 0000:00:01.0: BAR 0: assigned [mem 0x80118000-0x80118fff] Nov 8 00:04:54.309904 kernel: pci_bus 0000:00: resource 4 [mem 0x80000000-0xffffffff window] Nov 8 00:04:54.310114 kernel: pci_bus 0000:00: resource 5 [io 0x0000-0xffff window] Nov 8 00:04:54.310388 kernel: pci_bus 0000:00: resource 6 [mem 0x400000000000-0x407fffffffff window] Nov 8 00:04:54.310426 kernel: ACPI: PCI: Interrupt link GSI0 configured for IRQ 35 Nov 8 00:04:54.310448 kernel: ACPI: PCI: Interrupt link GSI1 configured for IRQ 36 Nov 8 00:04:54.310469 kernel: ACPI: PCI: Interrupt link GSI2 configured for IRQ 37 Nov 8 00:04:54.310489 kernel: ACPI: PCI: Interrupt link GSI3 configured for IRQ 38 Nov 8 00:04:54.310509 kernel: iommu: Default domain type: Translated Nov 8 00:04:54.310529 kernel: iommu: DMA domain TLB invalidation policy: strict mode Nov 8 00:04:54.310565 kernel: efivars: Registered efivars operations Nov 8 00:04:54.310585 kernel: vgaarb: loaded Nov 8 00:04:54.310606 kernel: clocksource: Switched to clocksource arch_sys_counter Nov 8 00:04:54.310625 kernel: VFS: Disk quotas dquot_6.6.0 Nov 8 00:04:54.310646 kernel: VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) Nov 8 00:04:54.310666 kernel: pnp: PnP ACPI init Nov 8 00:04:54.310998 kernel: system 00:00: [mem 0x20000000-0x2fffffff] could not be reserved Nov 8 00:04:54.311044 kernel: pnp: PnP ACPI: found 1 devices Nov 8 00:04:54.311065 kernel: NET: Registered PF_INET protocol family Nov 8 00:04:54.311097 kernel: IP idents hash table entries: 65536 (order: 7, 524288 bytes, linear) Nov 8 00:04:54.311118 kernel: tcp_listen_portaddr_hash hash table entries: 2048 (order: 3, 32768 bytes, linear) Nov 8 00:04:54.311139 kernel: Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) Nov 8 00:04:54.313255 kernel: TCP established hash table entries: 32768 (order: 6, 262144 bytes, linear) Nov 8 00:04:54.313283 kernel: TCP bind hash table entries: 32768 (order: 8, 1048576 bytes, linear) Nov 8 00:04:54.313306 kernel: TCP: Hash tables configured (established 32768 bind 32768) Nov 8 00:04:54.313327 kernel: UDP hash table entries: 2048 (order: 4, 65536 bytes, linear) Nov 8 00:04:54.313346 kernel: UDP-Lite hash table entries: 2048 (order: 4, 65536 bytes, linear) Nov 8 00:04:54.313367 kernel: NET: Registered PF_UNIX/PF_LOCAL protocol family Nov 8 00:04:54.313401 kernel: PCI: CLS 0 bytes, default 64 Nov 8 00:04:54.313421 kernel: kvm [1]: HYP mode not available Nov 8 00:04:54.313440 kernel: Initialise system trusted keyrings Nov 8 00:04:54.313460 kernel: workingset: timestamp_bits=39 max_order=20 bucket_order=0 Nov 8 00:04:54.313479 kernel: Key type asymmetric registered Nov 8 00:04:54.313498 kernel: Asymmetric key parser 'x509' registered Nov 8 00:04:54.313517 kernel: Block layer SCSI generic (bsg) driver version 0.4 loaded (major 250) Nov 8 00:04:54.313537 kernel: io scheduler mq-deadline registered Nov 8 00:04:54.313555 kernel: io scheduler kyber registered Nov 8 00:04:54.313582 kernel: io scheduler bfq registered Nov 8 00:04:54.313887 kernel: pl061_gpio ARMH0061:00: PL061 GPIO chip registered Nov 8 00:04:54.313918 kernel: input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 Nov 8 00:04:54.313938 kernel: ACPI: button: Power Button [PWRB] Nov 8 00:04:54.313958 kernel: input: Sleep Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0E:00/input/input1 Nov 8 00:04:54.313978 kernel: ACPI: button: Sleep Button [SLPB] Nov 8 00:04:54.313997 kernel: Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled Nov 8 00:04:54.314018 kernel: ACPI: \_SB_.PCI0.GSI2: Enabled at IRQ 37 Nov 8 00:04:54.314340 kernel: serial 0000:00:01.0: enabling device (0010 -> 0012) Nov 8 00:04:54.314380 kernel: printk: console [ttyS0] disabled Nov 8 00:04:54.314401 kernel: 0000:00:01.0: ttyS0 at MMIO 0x80118000 (irq = 14, base_baud = 115200) is a 16550A Nov 8 00:04:54.314420 kernel: printk: console [ttyS0] enabled Nov 8 00:04:54.314440 kernel: printk: bootconsole [uart0] disabled Nov 8 00:04:54.314459 kernel: thunder_xcv, ver 1.0 Nov 8 00:04:54.314478 kernel: thunder_bgx, ver 1.0 Nov 8 00:04:54.314496 kernel: nicpf, ver 1.0 Nov 8 00:04:54.314515 kernel: nicvf, ver 1.0 Nov 8 00:04:54.314799 kernel: rtc-efi rtc-efi.0: registered as rtc0 Nov 8 00:04:54.315076 kernel: rtc-efi rtc-efi.0: setting system clock to 2025-11-08T00:04:53 UTC (1762560293) Nov 8 00:04:54.315110 kernel: hid: raw HID events driver (C) Jiri Kosina Nov 8 00:04:54.315130 kernel: hw perfevents: enabled with armv8_pmuv3_0 PMU driver, 3 counters available Nov 8 00:04:54.318257 kernel: watchdog: Delayed init of the lockup detector failed: -19 Nov 8 00:04:54.318304 kernel: watchdog: Hard watchdog permanently disabled Nov 8 00:04:54.318325 kernel: NET: Registered PF_INET6 protocol family Nov 8 00:04:54.318346 kernel: Segment Routing with IPv6 Nov 8 00:04:54.318382 kernel: In-situ OAM (IOAM) with IPv6 Nov 8 00:04:54.318403 kernel: NET: Registered PF_PACKET protocol family Nov 8 00:04:54.318422 kernel: Key type dns_resolver registered Nov 8 00:04:54.318442 kernel: registered taskstats version 1 Nov 8 00:04:54.318461 kernel: Loading compiled-in X.509 certificates Nov 8 00:04:54.318480 kernel: Loaded X.509 cert 'Kinvolk GmbH: Module signing key for 6.6.113-flatcar: e35af6a719ba4c60f9d6788b11f5e5836ebf73b5' Nov 8 00:04:54.318499 kernel: Key type .fscrypt registered Nov 8 00:04:54.318518 kernel: Key type fscrypt-provisioning registered Nov 8 00:04:54.318536 kernel: ima: No TPM chip found, activating TPM-bypass! Nov 8 00:04:54.318562 kernel: ima: Allocated hash algorithm: sha1 Nov 8 00:04:54.318582 kernel: ima: No architecture policies found Nov 8 00:04:54.318601 kernel: alg: No test for fips(ansi_cprng) (fips_ansi_cprng) Nov 8 00:04:54.318620 kernel: clk: Disabling unused clocks Nov 8 00:04:54.318639 kernel: Freeing unused kernel memory: 39424K Nov 8 00:04:54.318657 kernel: Run /init as init process Nov 8 00:04:54.318676 kernel: with arguments: Nov 8 00:04:54.318695 kernel: /init Nov 8 00:04:54.318715 kernel: with environment: Nov 8 00:04:54.318734 kernel: HOME=/ Nov 8 00:04:54.318761 kernel: TERM=linux Nov 8 00:04:54.318787 systemd[1]: systemd 255 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL -ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY -P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK -XKBCOMMON +UTMP -SYSVINIT default-hierarchy=unified) Nov 8 00:04:54.318814 systemd[1]: Detected virtualization amazon. Nov 8 00:04:54.318836 systemd[1]: Detected architecture arm64. Nov 8 00:04:54.318857 systemd[1]: Running in initrd. Nov 8 00:04:54.318877 systemd[1]: No hostname configured, using default hostname. Nov 8 00:04:54.318921 systemd[1]: Hostname set to . Nov 8 00:04:54.318953 systemd[1]: Initializing machine ID from VM UUID. Nov 8 00:04:54.318974 systemd[1]: Queued start job for default target initrd.target. Nov 8 00:04:54.318995 systemd[1]: Started clevis-luks-askpass.path - Forward Password Requests to Clevis Directory Watch. Nov 8 00:04:54.319015 systemd[1]: Started systemd-ask-password-console.path - Dispatch Password Requests to Console Directory Watch. Nov 8 00:04:54.319037 systemd[1]: Expecting device dev-disk-by\x2dlabel-EFI\x2dSYSTEM.device - /dev/disk/by-label/EFI-SYSTEM... Nov 8 00:04:54.319058 systemd[1]: Expecting device dev-disk-by\x2dlabel-OEM.device - /dev/disk/by-label/OEM... Nov 8 00:04:54.319079 systemd[1]: Expecting device dev-disk-by\x2dlabel-ROOT.device - /dev/disk/by-label/ROOT... Nov 8 00:04:54.319100 systemd[1]: Expecting device dev-disk-by\x2dpartlabel-USR\x2dA.device - /dev/disk/by-partlabel/USR-A... Nov 8 00:04:54.319129 systemd[1]: Expecting device dev-disk-by\x2dpartuuid-7130c94a\x2d213a\x2d4e5a\x2d8e26\x2d6cce9662f132.device - /dev/disk/by-partuuid/7130c94a-213a-4e5a-8e26-6cce9662f132... Nov 8 00:04:54.319177 systemd[1]: Expecting device dev-mapper-usr.device - /dev/mapper/usr... Nov 8 00:04:54.319204 systemd[1]: Reached target cryptsetup-pre.target - Local Encrypted Volumes (Pre). Nov 8 00:04:54.319225 systemd[1]: Reached target cryptsetup.target - Local Encrypted Volumes. Nov 8 00:04:54.319246 systemd[1]: Reached target paths.target - Path Units. Nov 8 00:04:54.319267 systemd[1]: Reached target slices.target - Slice Units. Nov 8 00:04:54.319287 systemd[1]: Reached target swap.target - Swaps. Nov 8 00:04:54.319315 systemd[1]: Reached target timers.target - Timer Units. Nov 8 00:04:54.319336 systemd[1]: Listening on iscsid.socket - Open-iSCSI iscsid Socket. Nov 8 00:04:54.319357 systemd[1]: Listening on iscsiuio.socket - Open-iSCSI iscsiuio Socket. Nov 8 00:04:54.319378 systemd[1]: Listening on systemd-journald-dev-log.socket - Journal Socket (/dev/log). Nov 8 00:04:54.319398 systemd[1]: Listening on systemd-journald.socket - Journal Socket. Nov 8 00:04:54.319419 systemd[1]: Listening on systemd-networkd.socket - Network Service Netlink Socket. Nov 8 00:04:54.319439 systemd[1]: Listening on systemd-udevd-control.socket - udev Control Socket. Nov 8 00:04:54.319460 systemd[1]: Listening on systemd-udevd-kernel.socket - udev Kernel Socket. Nov 8 00:04:54.319485 systemd[1]: Reached target sockets.target - Socket Units. Nov 8 00:04:54.319506 systemd[1]: Starting ignition-setup-pre.service - Ignition env setup... Nov 8 00:04:54.319527 systemd[1]: Starting kmod-static-nodes.service - Create List of Static Device Nodes... Nov 8 00:04:54.319547 systemd[1]: Finished network-cleanup.service - Network Cleanup. Nov 8 00:04:54.319568 systemd[1]: Starting systemd-fsck-usr.service... Nov 8 00:04:54.319589 systemd[1]: Starting systemd-journald.service - Journal Service... Nov 8 00:04:54.319610 systemd[1]: Starting systemd-modules-load.service - Load Kernel Modules... Nov 8 00:04:54.319630 systemd[1]: Starting systemd-vconsole-setup.service - Virtual Console Setup... Nov 8 00:04:54.319651 systemd[1]: Finished ignition-setup-pre.service - Ignition env setup. Nov 8 00:04:54.319677 systemd[1]: Finished kmod-static-nodes.service - Create List of Static Device Nodes. Nov 8 00:04:54.319753 systemd-journald[251]: Collecting audit messages is disabled. Nov 8 00:04:54.319800 systemd[1]: Finished systemd-fsck-usr.service. Nov 8 00:04:54.319828 systemd[1]: Starting systemd-tmpfiles-setup-dev-early.service - Create Static Device Nodes in /dev gracefully... Nov 8 00:04:54.319850 kernel: bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this. Nov 8 00:04:54.319870 kernel: Bridge firewalling registered Nov 8 00:04:54.319890 systemd[1]: Finished systemd-modules-load.service - Load Kernel Modules. Nov 8 00:04:54.319911 systemd-journald[251]: Journal started Nov 8 00:04:54.319954 systemd-journald[251]: Runtime Journal (/run/log/journal/ec2f79f1503f8cdec3ab8993f66244d1) is 8.0M, max 75.3M, 67.3M free. Nov 8 00:04:54.274488 systemd-modules-load[252]: Inserted module 'overlay' Nov 8 00:04:54.317261 systemd-modules-load[252]: Inserted module 'br_netfilter' Nov 8 00:04:54.338177 systemd[1]: Started systemd-journald.service - Journal Service. Nov 8 00:04:54.344082 systemd[1]: Finished systemd-vconsole-setup.service - Virtual Console Setup. Nov 8 00:04:54.355732 systemd[1]: Finished systemd-tmpfiles-setup-dev-early.service - Create Static Device Nodes in /dev gracefully. Nov 8 00:04:54.370684 systemd[1]: Starting dracut-cmdline-ask.service - dracut ask for additional cmdline parameters... Nov 8 00:04:54.376549 systemd[1]: Starting systemd-sysctl.service - Apply Kernel Variables... Nov 8 00:04:54.392128 systemd[1]: Starting systemd-tmpfiles-setup-dev.service - Create Static Device Nodes in /dev... Nov 8 00:04:54.422734 systemd[1]: Starting systemd-tmpfiles-setup.service - Create System Files and Directories... Nov 8 00:04:54.436323 systemd[1]: Finished systemd-sysctl.service - Apply Kernel Variables. Nov 8 00:04:54.440255 systemd[1]: Finished dracut-cmdline-ask.service - dracut ask for additional cmdline parameters. Nov 8 00:04:54.444478 systemd[1]: Starting dracut-cmdline.service - dracut cmdline hook... Nov 8 00:04:54.482064 systemd[1]: Finished systemd-tmpfiles-setup-dev.service - Create Static Device Nodes in /dev. Nov 8 00:04:54.496428 dracut-cmdline[284]: dracut-dracut-053 Nov 8 00:04:54.506798 dracut-cmdline[284]: Using kernel command line parameters: rd.driver.pre=btrfs BOOT_IMAGE=/flatcar/vmlinuz-a mount.usr=/dev/mapper/usr verity.usr=PARTUUID=7130c94a-213a-4e5a-8e26-6cce9662f132 rootflags=rw mount.usrflags=ro consoleblank=0 root=LABEL=ROOT console=tty1 console=ttyS0,115200n8 earlycon flatcar.first_boot=detected acpi=force flatcar.oem.id=ec2 modprobe.blacklist=xen_fbfront net.ifnames=0 nvme_core.io_timeout=4294967295 verity.usrhash=653fdcb8a67e255793a721f32d76976d3ed6223b235b7c618cf75e5edffbdb68 Nov 8 00:04:54.517128 systemd[1]: Finished systemd-tmpfiles-setup.service - Create System Files and Directories. Nov 8 00:04:54.547455 systemd[1]: Starting systemd-resolved.service - Network Name Resolution... Nov 8 00:04:54.622066 systemd-resolved[306]: Positive Trust Anchors: Nov 8 00:04:54.622111 systemd-resolved[306]: . IN DS 20326 8 2 e06d44b80b8f1d39a95c0b0d7c65d08458e880409bbc683457104237c7f8ec8d Nov 8 00:04:54.622219 systemd-resolved[306]: Negative trust anchors: home.arpa 10.in-addr.arpa 16.172.in-addr.arpa 17.172.in-addr.arpa 18.172.in-addr.arpa 19.172.in-addr.arpa 20.172.in-addr.arpa 21.172.in-addr.arpa 22.172.in-addr.arpa 23.172.in-addr.arpa 24.172.in-addr.arpa 25.172.in-addr.arpa 26.172.in-addr.arpa 27.172.in-addr.arpa 28.172.in-addr.arpa 29.172.in-addr.arpa 30.172.in-addr.arpa 31.172.in-addr.arpa 170.0.0.192.in-addr.arpa 171.0.0.192.in-addr.arpa 168.192.in-addr.arpa d.f.ip6.arpa ipv4only.arpa resolver.arpa corp home internal intranet lan local private test Nov 8 00:04:54.726193 kernel: SCSI subsystem initialized Nov 8 00:04:54.736190 kernel: Loading iSCSI transport class v2.0-870. Nov 8 00:04:54.749206 kernel: iscsi: registered transport (tcp) Nov 8 00:04:54.772803 kernel: iscsi: registered transport (qla4xxx) Nov 8 00:04:54.772881 kernel: QLogic iSCSI HBA Driver Nov 8 00:04:54.855307 kernel: random: crng init done Nov 8 00:04:54.855614 systemd-resolved[306]: Defaulting to hostname 'linux'. Nov 8 00:04:54.858271 systemd[1]: Started systemd-resolved.service - Network Name Resolution. Nov 8 00:04:54.864297 systemd[1]: Reached target nss-lookup.target - Host and Network Name Lookups. Nov 8 00:04:54.897867 systemd[1]: Finished dracut-cmdline.service - dracut cmdline hook. Nov 8 00:04:54.910533 systemd[1]: Starting dracut-pre-udev.service - dracut pre-udev hook... Nov 8 00:04:54.956136 kernel: device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. Nov 8 00:04:54.956248 kernel: device-mapper: uevent: version 1.0.3 Nov 8 00:04:54.956292 kernel: device-mapper: ioctl: 4.48.0-ioctl (2023-03-01) initialised: dm-devel@redhat.com Nov 8 00:04:55.030224 kernel: raid6: neonx8 gen() 6619 MB/s Nov 8 00:04:55.047232 kernel: raid6: neonx4 gen() 6379 MB/s Nov 8 00:04:55.064216 kernel: raid6: neonx2 gen() 5308 MB/s Nov 8 00:04:55.081226 kernel: raid6: neonx1 gen() 3878 MB/s Nov 8 00:04:55.098216 kernel: raid6: int64x8 gen() 3744 MB/s Nov 8 00:04:55.115220 kernel: raid6: int64x4 gen() 3638 MB/s Nov 8 00:04:55.132216 kernel: raid6: int64x2 gen() 3521 MB/s Nov 8 00:04:55.150322 kernel: raid6: int64x1 gen() 2717 MB/s Nov 8 00:04:55.150396 kernel: raid6: using algorithm neonx8 gen() 6619 MB/s Nov 8 00:04:55.169319 kernel: raid6: .... xor() 4829 MB/s, rmw enabled Nov 8 00:04:55.169420 kernel: raid6: using neon recovery algorithm Nov 8 00:04:55.178219 kernel: xor: measuring software checksum speed Nov 8 00:04:55.180757 kernel: 8regs : 10119 MB/sec Nov 8 00:04:55.180837 kernel: 32regs : 11907 MB/sec Nov 8 00:04:55.182089 kernel: arm64_neon : 9520 MB/sec Nov 8 00:04:55.182181 kernel: xor: using function: 32regs (11907 MB/sec) Nov 8 00:04:55.273219 kernel: Btrfs loaded, zoned=no, fsverity=no Nov 8 00:04:55.296827 systemd[1]: Finished dracut-pre-udev.service - dracut pre-udev hook. Nov 8 00:04:55.309509 systemd[1]: Starting systemd-udevd.service - Rule-based Manager for Device Events and Files... Nov 8 00:04:55.355567 systemd-udevd[471]: Using default interface naming scheme 'v255'. Nov 8 00:04:55.364908 systemd[1]: Started systemd-udevd.service - Rule-based Manager for Device Events and Files. Nov 8 00:04:55.386274 systemd[1]: Starting dracut-pre-trigger.service - dracut pre-trigger hook... Nov 8 00:04:55.426369 dracut-pre-trigger[476]: rd.md=0: removing MD RAID activation Nov 8 00:04:55.495268 systemd[1]: Finished dracut-pre-trigger.service - dracut pre-trigger hook. Nov 8 00:04:55.507497 systemd[1]: Starting systemd-udev-trigger.service - Coldplug All udev Devices... Nov 8 00:04:55.641986 systemd[1]: Finished systemd-udev-trigger.service - Coldplug All udev Devices. Nov 8 00:04:55.655478 systemd[1]: Starting dracut-initqueue.service - dracut initqueue hook... Nov 8 00:04:55.709284 systemd[1]: Finished dracut-initqueue.service - dracut initqueue hook. Nov 8 00:04:55.715872 systemd[1]: Reached target remote-fs-pre.target - Preparation for Remote File Systems. Nov 8 00:04:55.723087 systemd[1]: Reached target remote-cryptsetup.target - Remote Encrypted Volumes. Nov 8 00:04:55.726125 systemd[1]: Reached target remote-fs.target - Remote File Systems. Nov 8 00:04:55.741437 systemd[1]: Starting dracut-pre-mount.service - dracut pre-mount hook... Nov 8 00:04:55.796418 systemd[1]: Finished dracut-pre-mount.service - dracut pre-mount hook. Nov 8 00:04:55.889820 kernel: ACPI: \_SB_.PCI0.GSI1: Enabled at IRQ 36 Nov 8 00:04:55.889914 kernel: ena 0000:00:05.0: enabling device (0010 -> 0012) Nov 8 00:04:55.898807 systemd[1]: dracut-cmdline-ask.service: Deactivated successfully. Nov 8 00:04:55.907174 systemd[1]: Stopped dracut-cmdline-ask.service - dracut ask for additional cmdline parameters. Nov 8 00:04:55.923057 kernel: ena 0000:00:05.0: ENA device version: 0.10 Nov 8 00:04:55.923418 kernel: ena 0000:00:05.0: ENA controller version: 0.0.1 implementation version 1 Nov 8 00:04:55.923722 kernel: ena 0000:00:05.0: Elastic Network Adapter (ENA) found at mem 80114000, mac addr 06:7a:f8:85:3f:6d Nov 8 00:04:55.928084 kernel: ACPI: \_SB_.PCI0.GSI0: Enabled at IRQ 35 Nov 8 00:04:55.928209 kernel: nvme nvme0: pci function 0000:00:04.0 Nov 8 00:04:55.927141 (udev-worker)[543]: Network interface NamePolicy= disabled on kernel command line. Nov 8 00:04:55.928283 systemd[1]: Stopping dracut-cmdline-ask.service - dracut ask for additional cmdline parameters... Nov 8 00:04:55.932722 systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. Nov 8 00:04:55.941354 systemd[1]: Stopped systemd-vconsole-setup.service - Virtual Console Setup. Nov 8 00:04:55.947528 systemd[1]: Stopping systemd-vconsole-setup.service - Virtual Console Setup... Nov 8 00:04:55.960227 kernel: nvme nvme0: 2/0/0 default/read/poll queues Nov 8 00:04:55.963689 systemd[1]: Starting systemd-vconsole-setup.service - Virtual Console Setup... Nov 8 00:04:55.978299 kernel: GPT:Primary header thinks Alt. header is not at the end of the disk. Nov 8 00:04:55.978373 kernel: GPT:9289727 != 33554431 Nov 8 00:04:55.978401 kernel: GPT:Alternate GPT header not at the end of the disk. Nov 8 00:04:55.978428 kernel: GPT:9289727 != 33554431 Nov 8 00:04:55.980223 kernel: GPT: Use GNU Parted to correct GPT errors. Nov 8 00:04:55.980328 kernel: nvme0n1: p1 p2 p3 p4 p6 p7 p9 Nov 8 00:04:56.000811 systemd[1]: Finished systemd-vconsole-setup.service - Virtual Console Setup. Nov 8 00:04:56.011521 systemd[1]: Starting dracut-cmdline-ask.service - dracut ask for additional cmdline parameters... Nov 8 00:04:56.065366 systemd[1]: Finished dracut-cmdline-ask.service - dracut ask for additional cmdline parameters. Nov 8 00:04:56.127192 kernel: BTRFS: device label OEM devid 1 transid 9 /dev/nvme0n1p6 scanned by (udev-worker) (542) Nov 8 00:04:56.143235 kernel: BTRFS: device fsid 55a292e1-3824-4229-a9ae-952140d2698c devid 1 transid 37 /dev/nvme0n1p3 scanned by (udev-worker) (517) Nov 8 00:04:56.211478 systemd[1]: Found device dev-disk-by\x2dlabel-EFI\x2dSYSTEM.device - Amazon Elastic Block Store EFI-SYSTEM. Nov 8 00:04:56.248803 systemd[1]: Found device dev-disk-by\x2dlabel-ROOT.device - Amazon Elastic Block Store ROOT. Nov 8 00:04:56.265552 systemd[1]: Found device dev-disk-by\x2dpartuuid-7130c94a\x2d213a\x2d4e5a\x2d8e26\x2d6cce9662f132.device - Amazon Elastic Block Store USR-A. Nov 8 00:04:56.268567 systemd[1]: Found device dev-disk-by\x2dpartlabel-USR\x2dA.device - Amazon Elastic Block Store USR-A. Nov 8 00:04:56.288024 systemd[1]: Found device dev-disk-by\x2dlabel-OEM.device - Amazon Elastic Block Store OEM. Nov 8 00:04:56.299435 systemd[1]: Starting disk-uuid.service - Generate new UUID for disk GPT if necessary... Nov 8 00:04:56.315448 disk-uuid[661]: Primary Header is updated. Nov 8 00:04:56.315448 disk-uuid[661]: Secondary Entries is updated. Nov 8 00:04:56.315448 disk-uuid[661]: Secondary Header is updated. Nov 8 00:04:56.331195 kernel: nvme0n1: p1 p2 p3 p4 p6 p7 p9 Nov 8 00:04:56.341258 kernel: nvme0n1: p1 p2 p3 p4 p6 p7 p9 Nov 8 00:04:56.352203 kernel: nvme0n1: p1 p2 p3 p4 p6 p7 p9 Nov 8 00:04:57.353178 kernel: nvme0n1: p1 p2 p3 p4 p6 p7 p9 Nov 8 00:04:57.354814 disk-uuid[662]: The operation has completed successfully. Nov 8 00:04:57.538340 systemd[1]: disk-uuid.service: Deactivated successfully. Nov 8 00:04:57.540741 systemd[1]: Finished disk-uuid.service - Generate new UUID for disk GPT if necessary. Nov 8 00:04:57.613465 systemd[1]: Starting verity-setup.service - Verity Setup for /dev/mapper/usr... Nov 8 00:04:57.637237 sh[1005]: Success Nov 8 00:04:57.661196 kernel: device-mapper: verity: sha256 using implementation "sha256-ce" Nov 8 00:04:57.763301 systemd[1]: Found device dev-mapper-usr.device - /dev/mapper/usr. Nov 8 00:04:57.782489 systemd[1]: Mounting sysusr-usr.mount - /sysusr/usr... Nov 8 00:04:57.794792 systemd[1]: Finished verity-setup.service - Verity Setup for /dev/mapper/usr. Nov 8 00:04:57.827220 kernel: BTRFS info (device dm-0): first mount of filesystem 55a292e1-3824-4229-a9ae-952140d2698c Nov 8 00:04:57.827300 kernel: BTRFS info (device dm-0): using crc32c (crc32c-generic) checksum algorithm Nov 8 00:04:57.827327 kernel: BTRFS warning (device dm-0): 'nologreplay' is deprecated, use 'rescue=nologreplay' instead Nov 8 00:04:57.829786 kernel: BTRFS info (device dm-0): disabling log replay at mount time Nov 8 00:04:57.829866 kernel: BTRFS info (device dm-0): using free space tree Nov 8 00:04:57.931202 kernel: BTRFS info (device dm-0): enabling ssd optimizations Nov 8 00:04:57.954504 systemd[1]: Mounted sysusr-usr.mount - /sysusr/usr. Nov 8 00:04:57.959665 systemd[1]: afterburn-network-kargs.service - Afterburn Initrd Setup Network Kernel Arguments was skipped because no trigger condition checks were met. Nov 8 00:04:57.971501 systemd[1]: Starting ignition-setup.service - Ignition (setup)... Nov 8 00:04:57.977546 systemd[1]: Starting parse-ip-for-networkd.service - Write systemd-networkd units from cmdline... Nov 8 00:04:58.009703 kernel: BTRFS info (device nvme0n1p6): first mount of filesystem 7afafbf9-edbd-49b5-ac90-6fc331f667e9 Nov 8 00:04:58.009777 kernel: BTRFS info (device nvme0n1p6): using crc32c (crc32c-generic) checksum algorithm Nov 8 00:04:58.009804 kernel: BTRFS info (device nvme0n1p6): using free space tree Nov 8 00:04:58.026207 kernel: BTRFS info (device nvme0n1p6): enabling ssd optimizations Nov 8 00:04:58.047417 systemd[1]: mnt-oem.mount: Deactivated successfully. Nov 8 00:04:58.052525 kernel: BTRFS info (device nvme0n1p6): last unmount of filesystem 7afafbf9-edbd-49b5-ac90-6fc331f667e9 Nov 8 00:04:58.064091 systemd[1]: Finished ignition-setup.service - Ignition (setup). Nov 8 00:04:58.075557 systemd[1]: Starting ignition-fetch-offline.service - Ignition (fetch-offline)... Nov 8 00:04:58.223281 systemd[1]: Finished parse-ip-for-networkd.service - Write systemd-networkd units from cmdline. Nov 8 00:04:58.244639 systemd[1]: Starting systemd-networkd.service - Network Configuration... Nov 8 00:04:58.306215 systemd-networkd[1197]: lo: Link UP Nov 8 00:04:58.306240 systemd-networkd[1197]: lo: Gained carrier Nov 8 00:04:58.309133 systemd-networkd[1197]: Enumeration completed Nov 8 00:04:58.309363 systemd[1]: Started systemd-networkd.service - Network Configuration. Nov 8 00:04:58.310399 systemd-networkd[1197]: eth0: found matching network '/usr/lib/systemd/network/zz-default.network', based on potentially unpredictable interface name. Nov 8 00:04:58.310407 systemd-networkd[1197]: eth0: Configuring with /usr/lib/systemd/network/zz-default.network. Nov 8 00:04:58.319210 systemd-networkd[1197]: eth0: Link UP Nov 8 00:04:58.319218 systemd-networkd[1197]: eth0: Gained carrier Nov 8 00:04:58.319238 systemd-networkd[1197]: eth0: found matching network '/usr/lib/systemd/network/zz-default.network', based on potentially unpredictable interface name. Nov 8 00:04:58.339093 systemd[1]: Reached target network.target - Network. Nov 8 00:04:58.352318 systemd-networkd[1197]: eth0: DHCPv4 address 172.31.23.87/20, gateway 172.31.16.1 acquired from 172.31.16.1 Nov 8 00:04:58.497873 ignition[1102]: Ignition 2.19.0 Nov 8 00:04:58.498514 ignition[1102]: Stage: fetch-offline Nov 8 00:04:58.500280 ignition[1102]: no configs at "/usr/lib/ignition/base.d" Nov 8 00:04:58.500307 ignition[1102]: no config dir at "/usr/lib/ignition/base.platform.d/aws" Nov 8 00:04:58.500968 ignition[1102]: Ignition finished successfully Nov 8 00:04:58.512374 systemd[1]: Finished ignition-fetch-offline.service - Ignition (fetch-offline). Nov 8 00:04:58.522513 systemd[1]: Starting ignition-fetch.service - Ignition (fetch)... Nov 8 00:04:58.550918 ignition[1208]: Ignition 2.19.0 Nov 8 00:04:58.550947 ignition[1208]: Stage: fetch Nov 8 00:04:58.551680 ignition[1208]: no configs at "/usr/lib/ignition/base.d" Nov 8 00:04:58.551715 ignition[1208]: no config dir at "/usr/lib/ignition/base.platform.d/aws" Nov 8 00:04:58.551896 ignition[1208]: PUT http://169.254.169.254/latest/api/token: attempt #1 Nov 8 00:04:58.572982 ignition[1208]: PUT result: OK Nov 8 00:04:58.580342 ignition[1208]: parsed url from cmdline: "" Nov 8 00:04:58.580369 ignition[1208]: no config URL provided Nov 8 00:04:58.580387 ignition[1208]: reading system config file "/usr/lib/ignition/user.ign" Nov 8 00:04:58.580417 ignition[1208]: no config at "/usr/lib/ignition/user.ign" Nov 8 00:04:58.580455 ignition[1208]: PUT http://169.254.169.254/latest/api/token: attempt #1 Nov 8 00:04:58.594001 ignition[1208]: PUT result: OK Nov 8 00:04:58.594105 ignition[1208]: GET http://169.254.169.254/2019-10-01/user-data: attempt #1 Nov 8 00:04:58.599037 ignition[1208]: GET result: OK Nov 8 00:04:58.599349 ignition[1208]: parsing config with SHA512: 0289d680f1bd4a85910f721f5da77d80954e0c1eda2a9e9bfbc74e37c73a056f861a1b0d95f1eb4e7723754206b71b52e3e361e63e5034297778f89d22aed3fd Nov 8 00:04:58.609035 unknown[1208]: fetched base config from "system" Nov 8 00:04:58.609785 ignition[1208]: fetch: fetch complete Nov 8 00:04:58.609060 unknown[1208]: fetched base config from "system" Nov 8 00:04:58.609799 ignition[1208]: fetch: fetch passed Nov 8 00:04:58.609075 unknown[1208]: fetched user config from "aws" Nov 8 00:04:58.609910 ignition[1208]: Ignition finished successfully Nov 8 00:04:58.622243 systemd[1]: Finished ignition-fetch.service - Ignition (fetch). Nov 8 00:04:58.632677 systemd[1]: Starting ignition-kargs.service - Ignition (kargs)... Nov 8 00:04:58.668836 ignition[1215]: Ignition 2.19.0 Nov 8 00:04:58.668867 ignition[1215]: Stage: kargs Nov 8 00:04:58.669620 ignition[1215]: no configs at "/usr/lib/ignition/base.d" Nov 8 00:04:58.669650 ignition[1215]: no config dir at "/usr/lib/ignition/base.platform.d/aws" Nov 8 00:04:58.669825 ignition[1215]: PUT http://169.254.169.254/latest/api/token: attempt #1 Nov 8 00:04:58.675939 ignition[1215]: PUT result: OK Nov 8 00:04:58.692643 ignition[1215]: kargs: kargs passed Nov 8 00:04:58.692951 ignition[1215]: Ignition finished successfully Nov 8 00:04:58.700215 systemd[1]: Finished ignition-kargs.service - Ignition (kargs). Nov 8 00:04:58.709613 systemd[1]: Starting ignition-disks.service - Ignition (disks)... Nov 8 00:04:58.739071 ignition[1221]: Ignition 2.19.0 Nov 8 00:04:58.739675 ignition[1221]: Stage: disks Nov 8 00:04:58.740932 ignition[1221]: no configs at "/usr/lib/ignition/base.d" Nov 8 00:04:58.740965 ignition[1221]: no config dir at "/usr/lib/ignition/base.platform.d/aws" Nov 8 00:04:58.741140 ignition[1221]: PUT http://169.254.169.254/latest/api/token: attempt #1 Nov 8 00:04:58.747857 ignition[1221]: PUT result: OK Nov 8 00:04:58.757755 ignition[1221]: disks: disks passed Nov 8 00:04:58.758104 ignition[1221]: Ignition finished successfully Nov 8 00:04:58.765751 systemd[1]: Finished ignition-disks.service - Ignition (disks). Nov 8 00:04:58.768750 systemd[1]: Reached target initrd-root-device.target - Initrd Root Device. Nov 8 00:04:58.777358 systemd[1]: Reached target local-fs-pre.target - Preparation for Local File Systems. Nov 8 00:04:58.780481 systemd[1]: Reached target local-fs.target - Local File Systems. Nov 8 00:04:58.782937 systemd[1]: Reached target sysinit.target - System Initialization. Nov 8 00:04:58.788052 systemd[1]: Reached target basic.target - Basic System. Nov 8 00:04:58.800535 systemd[1]: Starting systemd-fsck-root.service - File System Check on /dev/disk/by-label/ROOT... Nov 8 00:04:58.855544 systemd-fsck[1229]: ROOT: clean, 14/553520 files, 52654/553472 blocks Nov 8 00:04:58.863591 systemd[1]: Finished systemd-fsck-root.service - File System Check on /dev/disk/by-label/ROOT. Nov 8 00:04:58.876440 systemd[1]: Mounting sysroot.mount - /sysroot... Nov 8 00:04:58.976197 kernel: EXT4-fs (nvme0n1p9): mounted filesystem ba97f76e-2e9b-450a-8320-3c4b94a19632 r/w with ordered data mode. Quota mode: none. Nov 8 00:04:58.977969 systemd[1]: Mounted sysroot.mount - /sysroot. Nov 8 00:04:58.982686 systemd[1]: Reached target initrd-root-fs.target - Initrd Root File System. Nov 8 00:04:58.998350 systemd[1]: Mounting sysroot-oem.mount - /sysroot/oem... Nov 8 00:04:59.004347 systemd[1]: Mounting sysroot-usr.mount - /sysroot/usr... Nov 8 00:04:59.014854 systemd[1]: flatcar-metadata-hostname.service - Flatcar Metadata Hostname Agent was skipped because no trigger condition checks were met. Nov 8 00:04:59.014986 systemd[1]: ignition-remount-sysroot.service - Remount /sysroot read-write for Ignition was skipped because of an unmet condition check (ConditionPathIsReadWrite=!/sysroot). Nov 8 00:04:59.040271 kernel: BTRFS: device label OEM devid 1 transid 10 /dev/nvme0n1p6 scanned by mount (1248) Nov 8 00:04:59.015043 systemd[1]: Reached target ignition-diskful.target - Ignition Boot Disk Setup. Nov 8 00:04:59.051423 kernel: BTRFS info (device nvme0n1p6): first mount of filesystem 7afafbf9-edbd-49b5-ac90-6fc331f667e9 Nov 8 00:04:59.051466 kernel: BTRFS info (device nvme0n1p6): using crc32c (crc32c-generic) checksum algorithm Nov 8 00:04:59.051492 kernel: BTRFS info (device nvme0n1p6): using free space tree Nov 8 00:04:59.060717 systemd[1]: Mounted sysroot-usr.mount - /sysroot/usr. Nov 8 00:04:59.069797 kernel: BTRFS info (device nvme0n1p6): enabling ssd optimizations Nov 8 00:04:59.072486 systemd[1]: Starting initrd-setup-root.service - Root filesystem setup... Nov 8 00:04:59.085692 systemd[1]: Mounted sysroot-oem.mount - /sysroot/oem. Nov 8 00:04:59.445777 initrd-setup-root[1272]: cut: /sysroot/etc/passwd: No such file or directory Nov 8 00:04:59.466173 initrd-setup-root[1279]: cut: /sysroot/etc/group: No such file or directory Nov 8 00:04:59.487856 initrd-setup-root[1286]: cut: /sysroot/etc/shadow: No such file or directory Nov 8 00:04:59.497843 initrd-setup-root[1293]: cut: /sysroot/etc/gshadow: No such file or directory Nov 8 00:04:59.800344 systemd[1]: Finished initrd-setup-root.service - Root filesystem setup. Nov 8 00:04:59.810550 systemd[1]: Starting ignition-mount.service - Ignition (mount)... Nov 8 00:04:59.820468 systemd[1]: Starting sysroot-boot.service - /sysroot/boot... Nov 8 00:04:59.841808 systemd[1]: sysroot-oem.mount: Deactivated successfully. Nov 8 00:04:59.845456 kernel: BTRFS info (device nvme0n1p6): last unmount of filesystem 7afafbf9-edbd-49b5-ac90-6fc331f667e9 Nov 8 00:04:59.883237 systemd[1]: Finished sysroot-boot.service - /sysroot/boot. Nov 8 00:04:59.894566 ignition[1361]: INFO : Ignition 2.19.0 Nov 8 00:04:59.894566 ignition[1361]: INFO : Stage: mount Nov 8 00:04:59.903056 ignition[1361]: INFO : no configs at "/usr/lib/ignition/base.d" Nov 8 00:04:59.903056 ignition[1361]: INFO : no config dir at "/usr/lib/ignition/base.platform.d/aws" Nov 8 00:04:59.903056 ignition[1361]: INFO : PUT http://169.254.169.254/latest/api/token: attempt #1 Nov 8 00:04:59.903056 ignition[1361]: INFO : PUT result: OK Nov 8 00:04:59.918248 ignition[1361]: INFO : mount: mount passed Nov 8 00:04:59.918248 ignition[1361]: INFO : Ignition finished successfully Nov 8 00:04:59.921746 systemd[1]: Finished ignition-mount.service - Ignition (mount). Nov 8 00:04:59.933358 systemd[1]: Starting ignition-files.service - Ignition (files)... Nov 8 00:04:59.988967 systemd[1]: Mounting sysroot-oem.mount - /sysroot/oem... Nov 8 00:05:00.012102 kernel: BTRFS: device label OEM devid 1 transid 11 /dev/nvme0n1p6 scanned by mount (1373) Nov 8 00:05:00.012195 kernel: BTRFS info (device nvme0n1p6): first mount of filesystem 7afafbf9-edbd-49b5-ac90-6fc331f667e9 Nov 8 00:05:00.014291 kernel: BTRFS info (device nvme0n1p6): using crc32c (crc32c-generic) checksum algorithm Nov 8 00:05:00.014337 kernel: BTRFS info (device nvme0n1p6): using free space tree Nov 8 00:05:00.021195 kernel: BTRFS info (device nvme0n1p6): enabling ssd optimizations Nov 8 00:05:00.024254 systemd[1]: Mounted sysroot-oem.mount - /sysroot/oem. Nov 8 00:05:00.059657 ignition[1390]: INFO : Ignition 2.19.0 Nov 8 00:05:00.059657 ignition[1390]: INFO : Stage: files Nov 8 00:05:00.063461 ignition[1390]: INFO : no configs at "/usr/lib/ignition/base.d" Nov 8 00:05:00.063461 ignition[1390]: INFO : no config dir at "/usr/lib/ignition/base.platform.d/aws" Nov 8 00:05:00.063461 ignition[1390]: INFO : PUT http://169.254.169.254/latest/api/token: attempt #1 Nov 8 00:05:00.072124 ignition[1390]: INFO : PUT result: OK Nov 8 00:05:00.082114 ignition[1390]: DEBUG : files: compiled without relabeling support, skipping Nov 8 00:05:00.094070 ignition[1390]: INFO : files: ensureUsers: op(1): [started] creating or modifying user "core" Nov 8 00:05:00.094070 ignition[1390]: DEBUG : files: ensureUsers: op(1): executing: "usermod" "--root" "/sysroot" "core" Nov 8 00:05:00.142032 ignition[1390]: INFO : files: ensureUsers: op(1): [finished] creating or modifying user "core" Nov 8 00:05:00.147107 ignition[1390]: INFO : files: ensureUsers: op(2): [started] adding ssh keys to user "core" Nov 8 00:05:00.151465 unknown[1390]: wrote ssh authorized keys file for user: core Nov 8 00:05:00.153940 ignition[1390]: INFO : files: ensureUsers: op(2): [finished] adding ssh keys to user "core" Nov 8 00:05:00.170950 ignition[1390]: INFO : files: createFilesystemsFiles: createFiles: op(3): [started] writing file "/sysroot/opt/helm-v3.17.0-linux-arm64.tar.gz" Nov 8 00:05:00.170950 ignition[1390]: INFO : files: createFilesystemsFiles: createFiles: op(3): GET https://get.helm.sh/helm-v3.17.0-linux-arm64.tar.gz: attempt #1 Nov 8 00:05:00.237354 systemd-networkd[1197]: eth0: Gained IPv6LL Nov 8 00:05:00.253560 ignition[1390]: INFO : files: createFilesystemsFiles: createFiles: op(3): GET result: OK Nov 8 00:05:00.540607 ignition[1390]: INFO : files: createFilesystemsFiles: createFiles: op(3): [finished] writing file "/sysroot/opt/helm-v3.17.0-linux-arm64.tar.gz" Nov 8 00:05:00.540607 ignition[1390]: INFO : files: createFilesystemsFiles: createFiles: op(4): [started] writing file "/sysroot/home/core/install.sh" Nov 8 00:05:00.552075 ignition[1390]: INFO : files: createFilesystemsFiles: createFiles: op(4): [finished] writing file "/sysroot/home/core/install.sh" Nov 8 00:05:00.552075 ignition[1390]: INFO : files: createFilesystemsFiles: createFiles: op(5): [started] writing file "/sysroot/home/core/nginx.yaml" Nov 8 00:05:00.552075 ignition[1390]: INFO : files: createFilesystemsFiles: createFiles: op(5): [finished] writing file "/sysroot/home/core/nginx.yaml" Nov 8 00:05:00.552075 ignition[1390]: INFO : files: createFilesystemsFiles: createFiles: op(6): [started] writing file "/sysroot/home/core/nfs-pod.yaml" Nov 8 00:05:00.552075 ignition[1390]: INFO : files: createFilesystemsFiles: createFiles: op(6): [finished] writing file "/sysroot/home/core/nfs-pod.yaml" Nov 8 00:05:00.552075 ignition[1390]: INFO : files: createFilesystemsFiles: createFiles: op(7): [started] writing file "/sysroot/home/core/nfs-pvc.yaml" Nov 8 00:05:00.552075 ignition[1390]: INFO : files: createFilesystemsFiles: createFiles: op(7): [finished] writing file "/sysroot/home/core/nfs-pvc.yaml" Nov 8 00:05:00.552075 ignition[1390]: INFO : files: createFilesystemsFiles: createFiles: op(8): [started] writing file "/sysroot/etc/flatcar/update.conf" Nov 8 00:05:00.552075 ignition[1390]: INFO : files: createFilesystemsFiles: createFiles: op(8): [finished] writing file "/sysroot/etc/flatcar/update.conf" Nov 8 00:05:00.552075 ignition[1390]: INFO : files: createFilesystemsFiles: createFiles: op(9): [started] writing link "/sysroot/etc/extensions/kubernetes.raw" -> "/opt/extensions/kubernetes/kubernetes-v1.32.4-arm64.raw" Nov 8 00:05:00.552075 ignition[1390]: INFO : files: createFilesystemsFiles: createFiles: op(9): [finished] writing link "/sysroot/etc/extensions/kubernetes.raw" -> "/opt/extensions/kubernetes/kubernetes-v1.32.4-arm64.raw" Nov 8 00:05:00.552075 ignition[1390]: INFO : files: createFilesystemsFiles: createFiles: op(a): [started] writing file "/sysroot/opt/extensions/kubernetes/kubernetes-v1.32.4-arm64.raw" Nov 8 00:05:00.552075 ignition[1390]: INFO : files: createFilesystemsFiles: createFiles: op(a): GET https://extensions.flatcar.org/extensions/kubernetes-v1.32.4-arm64.raw: attempt #1 Nov 8 00:05:00.889017 ignition[1390]: INFO : files: createFilesystemsFiles: createFiles: op(a): GET result: OK Nov 8 00:05:01.265058 ignition[1390]: INFO : files: createFilesystemsFiles: createFiles: op(a): [finished] writing file "/sysroot/opt/extensions/kubernetes/kubernetes-v1.32.4-arm64.raw" Nov 8 00:05:01.265058 ignition[1390]: INFO : files: op(b): [started] processing unit "prepare-helm.service" Nov 8 00:05:01.275325 ignition[1390]: INFO : files: op(b): op(c): [started] writing unit "prepare-helm.service" at "/sysroot/etc/systemd/system/prepare-helm.service" Nov 8 00:05:01.275325 ignition[1390]: INFO : files: op(b): op(c): [finished] writing unit "prepare-helm.service" at "/sysroot/etc/systemd/system/prepare-helm.service" Nov 8 00:05:01.275325 ignition[1390]: INFO : files: op(b): [finished] processing unit "prepare-helm.service" Nov 8 00:05:01.275325 ignition[1390]: INFO : files: op(d): [started] setting preset to enabled for "prepare-helm.service" Nov 8 00:05:01.275325 ignition[1390]: INFO : files: op(d): [finished] setting preset to enabled for "prepare-helm.service" Nov 8 00:05:01.275325 ignition[1390]: INFO : files: createResultFile: createFiles: op(e): [started] writing file "/sysroot/etc/.ignition-result.json" Nov 8 00:05:01.275325 ignition[1390]: INFO : files: createResultFile: createFiles: op(e): [finished] writing file "/sysroot/etc/.ignition-result.json" Nov 8 00:05:01.275325 ignition[1390]: INFO : files: files passed Nov 8 00:05:01.275325 ignition[1390]: INFO : Ignition finished successfully Nov 8 00:05:01.308283 systemd[1]: Finished ignition-files.service - Ignition (files). Nov 8 00:05:01.318430 systemd[1]: Starting ignition-quench.service - Ignition (record completion)... Nov 8 00:05:01.334492 systemd[1]: Starting initrd-setup-root-after-ignition.service - Root filesystem completion... Nov 8 00:05:01.341115 systemd[1]: ignition-quench.service: Deactivated successfully. Nov 8 00:05:01.344389 systemd[1]: Finished ignition-quench.service - Ignition (record completion). Nov 8 00:05:01.391265 initrd-setup-root-after-ignition[1418]: grep: /sysroot/etc/flatcar/enabled-sysext.conf: No such file or directory Nov 8 00:05:01.391265 initrd-setup-root-after-ignition[1418]: grep: /sysroot/usr/share/flatcar/enabled-sysext.conf: No such file or directory Nov 8 00:05:01.401255 initrd-setup-root-after-ignition[1422]: grep: /sysroot/etc/flatcar/enabled-sysext.conf: No such file or directory Nov 8 00:05:01.407358 systemd[1]: Finished initrd-setup-root-after-ignition.service - Root filesystem completion. Nov 8 00:05:01.414394 systemd[1]: Reached target ignition-complete.target - Ignition Complete. Nov 8 00:05:01.428479 systemd[1]: Starting initrd-parse-etc.service - Mountpoints Configured in the Real Root... Nov 8 00:05:01.490340 systemd[1]: initrd-parse-etc.service: Deactivated successfully. Nov 8 00:05:01.490904 systemd[1]: Finished initrd-parse-etc.service - Mountpoints Configured in the Real Root. Nov 8 00:05:01.499371 systemd[1]: Reached target initrd-fs.target - Initrd File Systems. Nov 8 00:05:01.502178 systemd[1]: Reached target initrd.target - Initrd Default Target. Nov 8 00:05:01.509423 systemd[1]: dracut-mount.service - dracut mount hook was skipped because no trigger condition checks were met. Nov 8 00:05:01.522490 systemd[1]: Starting dracut-pre-pivot.service - dracut pre-pivot and cleanup hook... Nov 8 00:05:01.554362 systemd[1]: Finished dracut-pre-pivot.service - dracut pre-pivot and cleanup hook. Nov 8 00:05:01.567721 systemd[1]: Starting initrd-cleanup.service - Cleaning Up and Shutting Down Daemons... Nov 8 00:05:01.596042 systemd[1]: Stopped target nss-lookup.target - Host and Network Name Lookups. Nov 8 00:05:01.602031 systemd[1]: Stopped target remote-cryptsetup.target - Remote Encrypted Volumes. Nov 8 00:05:01.605685 systemd[1]: Stopped target timers.target - Timer Units. Nov 8 00:05:01.610414 systemd[1]: dracut-pre-pivot.service: Deactivated successfully. Nov 8 00:05:01.610681 systemd[1]: Stopped dracut-pre-pivot.service - dracut pre-pivot and cleanup hook. Nov 8 00:05:01.611872 systemd[1]: Stopped target initrd.target - Initrd Default Target. Nov 8 00:05:01.612315 systemd[1]: Stopped target basic.target - Basic System. Nov 8 00:05:01.612654 systemd[1]: Stopped target ignition-complete.target - Ignition Complete. Nov 8 00:05:01.613038 systemd[1]: Stopped target ignition-diskful.target - Ignition Boot Disk Setup. Nov 8 00:05:01.613828 systemd[1]: Stopped target initrd-root-device.target - Initrd Root Device. Nov 8 00:05:01.614291 systemd[1]: Stopped target remote-fs.target - Remote File Systems. Nov 8 00:05:01.614612 systemd[1]: Stopped target remote-fs-pre.target - Preparation for Remote File Systems. Nov 8 00:05:01.619121 systemd[1]: Stopped target sysinit.target - System Initialization. Nov 8 00:05:01.622527 systemd[1]: Stopped target local-fs.target - Local File Systems. Nov 8 00:05:01.624388 systemd[1]: Stopped target swap.target - Swaps. Nov 8 00:05:01.624603 systemd[1]: dracut-pre-mount.service: Deactivated successfully. Nov 8 00:05:01.624854 systemd[1]: Stopped dracut-pre-mount.service - dracut pre-mount hook. Nov 8 00:05:01.626250 systemd[1]: Stopped target cryptsetup.target - Local Encrypted Volumes. Nov 8 00:05:01.626625 systemd[1]: Stopped target cryptsetup-pre.target - Local Encrypted Volumes (Pre). Nov 8 00:05:01.628059 systemd[1]: clevis-luks-askpass.path: Deactivated successfully. Nov 8 00:05:01.644269 systemd[1]: Stopped clevis-luks-askpass.path - Forward Password Requests to Clevis Directory Watch. Nov 8 00:05:01.644547 systemd[1]: dracut-initqueue.service: Deactivated successfully. Nov 8 00:05:01.644829 systemd[1]: Stopped dracut-initqueue.service - dracut initqueue hook. Nov 8 00:05:01.650983 systemd[1]: initrd-setup-root-after-ignition.service: Deactivated successfully. Nov 8 00:05:01.651302 systemd[1]: Stopped initrd-setup-root-after-ignition.service - Root filesystem completion. Nov 8 00:05:01.654765 systemd[1]: ignition-files.service: Deactivated successfully. Nov 8 00:05:01.655100 systemd[1]: Stopped ignition-files.service - Ignition (files). Nov 8 00:05:01.673572 systemd[1]: Stopping ignition-mount.service - Ignition (mount)... Nov 8 00:05:01.682544 systemd[1]: kmod-static-nodes.service: Deactivated successfully. Nov 8 00:05:01.682909 systemd[1]: Stopped kmod-static-nodes.service - Create List of Static Device Nodes. Nov 8 00:05:01.702945 systemd[1]: Stopping sysroot-boot.service - /sysroot/boot... Nov 8 00:05:01.721009 systemd[1]: systemd-udev-trigger.service: Deactivated successfully. Nov 8 00:05:01.721380 systemd[1]: Stopped systemd-udev-trigger.service - Coldplug All udev Devices. Nov 8 00:05:01.726959 systemd[1]: dracut-pre-trigger.service: Deactivated successfully. Nov 8 00:05:01.727613 systemd[1]: Stopped dracut-pre-trigger.service - dracut pre-trigger hook. Nov 8 00:05:01.774704 systemd[1]: initrd-cleanup.service: Deactivated successfully. Nov 8 00:05:01.777042 systemd[1]: Finished initrd-cleanup.service - Cleaning Up and Shutting Down Daemons. Nov 8 00:05:01.789326 systemd[1]: sysroot-boot.mount: Deactivated successfully. Nov 8 00:05:01.795399 systemd[1]: sysroot-boot.service: Deactivated successfully. Nov 8 00:05:01.797641 systemd[1]: Stopped sysroot-boot.service - /sysroot/boot. Nov 8 00:05:01.814044 ignition[1442]: INFO : Ignition 2.19.0 Nov 8 00:05:01.816338 ignition[1442]: INFO : Stage: umount Nov 8 00:05:01.816338 ignition[1442]: INFO : no configs at "/usr/lib/ignition/base.d" Nov 8 00:05:01.816338 ignition[1442]: INFO : no config dir at "/usr/lib/ignition/base.platform.d/aws" Nov 8 00:05:01.816338 ignition[1442]: INFO : PUT http://169.254.169.254/latest/api/token: attempt #1 Nov 8 00:05:01.826700 ignition[1442]: INFO : PUT result: OK Nov 8 00:05:01.832230 ignition[1442]: INFO : umount: umount passed Nov 8 00:05:01.835844 ignition[1442]: INFO : Ignition finished successfully Nov 8 00:05:01.838873 systemd[1]: ignition-mount.service: Deactivated successfully. Nov 8 00:05:01.842235 systemd[1]: Stopped ignition-mount.service - Ignition (mount). Nov 8 00:05:01.849586 systemd[1]: ignition-disks.service: Deactivated successfully. Nov 8 00:05:01.849684 systemd[1]: Stopped ignition-disks.service - Ignition (disks). Nov 8 00:05:01.852045 systemd[1]: ignition-kargs.service: Deactivated successfully. Nov 8 00:05:01.852127 systemd[1]: Stopped ignition-kargs.service - Ignition (kargs). Nov 8 00:05:01.854445 systemd[1]: ignition-fetch.service: Deactivated successfully. Nov 8 00:05:01.854528 systemd[1]: Stopped ignition-fetch.service - Ignition (fetch). Nov 8 00:05:01.857924 systemd[1]: Stopped target network.target - Network. Nov 8 00:05:01.871072 systemd[1]: ignition-fetch-offline.service: Deactivated successfully. Nov 8 00:05:01.871348 systemd[1]: Stopped ignition-fetch-offline.service - Ignition (fetch-offline). Nov 8 00:05:01.883404 systemd[1]: Stopped target paths.target - Path Units. Nov 8 00:05:01.883617 systemd[1]: systemd-ask-password-console.path: Deactivated successfully. Nov 8 00:05:01.887276 systemd[1]: Stopped systemd-ask-password-console.path - Dispatch Password Requests to Console Directory Watch. Nov 8 00:05:01.890477 systemd[1]: Stopped target slices.target - Slice Units. Nov 8 00:05:01.893174 systemd[1]: Stopped target sockets.target - Socket Units. Nov 8 00:05:01.897837 systemd[1]: iscsid.socket: Deactivated successfully. Nov 8 00:05:01.897926 systemd[1]: Closed iscsid.socket - Open-iSCSI iscsid Socket. Nov 8 00:05:01.900312 systemd[1]: iscsiuio.socket: Deactivated successfully. Nov 8 00:05:01.900387 systemd[1]: Closed iscsiuio.socket - Open-iSCSI iscsiuio Socket. Nov 8 00:05:01.902783 systemd[1]: ignition-setup.service: Deactivated successfully. Nov 8 00:05:01.902887 systemd[1]: Stopped ignition-setup.service - Ignition (setup). Nov 8 00:05:01.905298 systemd[1]: ignition-setup-pre.service: Deactivated successfully. Nov 8 00:05:01.905382 systemd[1]: Stopped ignition-setup-pre.service - Ignition env setup. Nov 8 00:05:01.907837 systemd[1]: initrd-setup-root.service: Deactivated successfully. Nov 8 00:05:01.907925 systemd[1]: Stopped initrd-setup-root.service - Root filesystem setup. Nov 8 00:05:01.910696 systemd[1]: Stopping systemd-networkd.service - Network Configuration... Nov 8 00:05:01.913131 systemd[1]: Stopping systemd-resolved.service - Network Name Resolution... Nov 8 00:05:01.950235 systemd-networkd[1197]: eth0: DHCPv6 lease lost Nov 8 00:05:01.955745 systemd[1]: systemd-resolved.service: Deactivated successfully. Nov 8 00:05:01.956502 systemd[1]: Stopped systemd-resolved.service - Network Name Resolution. Nov 8 00:05:01.967582 systemd[1]: systemd-networkd.service: Deactivated successfully. Nov 8 00:05:01.968444 systemd[1]: Stopped systemd-networkd.service - Network Configuration. Nov 8 00:05:01.972338 systemd[1]: systemd-networkd.socket: Deactivated successfully. Nov 8 00:05:01.972429 systemd[1]: Closed systemd-networkd.socket - Network Service Netlink Socket. Nov 8 00:05:01.990491 systemd[1]: Stopping network-cleanup.service - Network Cleanup... Nov 8 00:05:01.992651 systemd[1]: parse-ip-for-networkd.service: Deactivated successfully. Nov 8 00:05:01.992766 systemd[1]: Stopped parse-ip-for-networkd.service - Write systemd-networkd units from cmdline. Nov 8 00:05:01.996654 systemd[1]: systemd-sysctl.service: Deactivated successfully. Nov 8 00:05:01.996775 systemd[1]: Stopped systemd-sysctl.service - Apply Kernel Variables. Nov 8 00:05:01.999692 systemd[1]: systemd-modules-load.service: Deactivated successfully. Nov 8 00:05:01.999798 systemd[1]: Stopped systemd-modules-load.service - Load Kernel Modules. Nov 8 00:05:02.002698 systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. Nov 8 00:05:02.002783 systemd[1]: Stopped systemd-tmpfiles-setup.service - Create System Files and Directories. Nov 8 00:05:02.007708 systemd[1]: Stopping systemd-udevd.service - Rule-based Manager for Device Events and Files... Nov 8 00:05:02.053263 systemd[1]: systemd-udevd.service: Deactivated successfully. Nov 8 00:05:02.053690 systemd[1]: Stopped systemd-udevd.service - Rule-based Manager for Device Events and Files. Nov 8 00:05:02.065918 systemd[1]: systemd-udevd-control.socket: Deactivated successfully. Nov 8 00:05:02.066052 systemd[1]: Closed systemd-udevd-control.socket - udev Control Socket. Nov 8 00:05:02.073494 systemd[1]: systemd-udevd-kernel.socket: Deactivated successfully. Nov 8 00:05:02.073595 systemd[1]: Closed systemd-udevd-kernel.socket - udev Kernel Socket. Nov 8 00:05:02.083644 systemd[1]: dracut-pre-udev.service: Deactivated successfully. Nov 8 00:05:02.083764 systemd[1]: Stopped dracut-pre-udev.service - dracut pre-udev hook. Nov 8 00:05:02.086758 systemd[1]: dracut-cmdline.service: Deactivated successfully. Nov 8 00:05:02.086860 systemd[1]: Stopped dracut-cmdline.service - dracut cmdline hook. Nov 8 00:05:02.097079 systemd[1]: dracut-cmdline-ask.service: Deactivated successfully. Nov 8 00:05:02.097221 systemd[1]: Stopped dracut-cmdline-ask.service - dracut ask for additional cmdline parameters. Nov 8 00:05:02.121454 systemd[1]: Starting initrd-udevadm-cleanup-db.service - Cleanup udev Database... Nov 8 00:05:02.124399 systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. Nov 8 00:05:02.124516 systemd[1]: Stopped systemd-tmpfiles-setup-dev.service - Create Static Device Nodes in /dev. Nov 8 00:05:02.135451 systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. Nov 8 00:05:02.135567 systemd[1]: Stopped systemd-vconsole-setup.service - Virtual Console Setup. Nov 8 00:05:02.139125 systemd[1]: network-cleanup.service: Deactivated successfully. Nov 8 00:05:02.142242 systemd[1]: Stopped network-cleanup.service - Network Cleanup. Nov 8 00:05:02.151427 systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. Nov 8 00:05:02.153249 systemd[1]: Finished initrd-udevadm-cleanup-db.service - Cleanup udev Database. Nov 8 00:05:02.160937 systemd[1]: Reached target initrd-switch-root.target - Switch Root. Nov 8 00:05:02.175463 systemd[1]: Starting initrd-switch-root.service - Switch Root... Nov 8 00:05:02.195466 systemd[1]: Switching root. Nov 8 00:05:02.240087 systemd-journald[251]: Journal stopped Nov 8 00:05:04.860933 systemd-journald[251]: Received SIGTERM from PID 1 (systemd). Nov 8 00:05:04.861077 kernel: SELinux: policy capability network_peer_controls=1 Nov 8 00:05:04.861126 kernel: SELinux: policy capability open_perms=1 Nov 8 00:05:04.861188 kernel: SELinux: policy capability extended_socket_class=1 Nov 8 00:05:04.861271 kernel: SELinux: policy capability always_check_network=0 Nov 8 00:05:04.861311 kernel: SELinux: policy capability cgroup_seclabel=1 Nov 8 00:05:04.861344 kernel: SELinux: policy capability nnp_nosuid_transition=1 Nov 8 00:05:04.861386 kernel: SELinux: policy capability genfs_seclabel_symlinks=0 Nov 8 00:05:04.861417 kernel: SELinux: policy capability ioctl_skip_cloexec=0 Nov 8 00:05:04.861450 kernel: audit: type=1403 audit(1762560302.777:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 Nov 8 00:05:04.861493 systemd[1]: Successfully loaded SELinux policy in 73.319ms. Nov 8 00:05:04.861539 systemd[1]: Relabeled /dev, /dev/shm, /run, /sys/fs/cgroup in 24.143ms. Nov 8 00:05:04.861585 systemd[1]: systemd 255 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL -ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY -P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK -XKBCOMMON +UTMP -SYSVINIT default-hierarchy=unified) Nov 8 00:05:04.861620 systemd[1]: Detected virtualization amazon. Nov 8 00:05:04.861650 systemd[1]: Detected architecture arm64. Nov 8 00:05:04.861687 systemd[1]: Detected first boot. Nov 8 00:05:04.861720 systemd[1]: Initializing machine ID from VM UUID. Nov 8 00:05:04.861754 zram_generator::config[1485]: No configuration found. Nov 8 00:05:04.861791 systemd[1]: Populated /etc with preset unit settings. Nov 8 00:05:04.861824 systemd[1]: initrd-switch-root.service: Deactivated successfully. Nov 8 00:05:04.861858 systemd[1]: Stopped initrd-switch-root.service - Switch Root. Nov 8 00:05:04.861890 systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. Nov 8 00:05:04.861928 systemd[1]: Created slice system-addon\x2dconfig.slice - Slice /system/addon-config. Nov 8 00:05:04.861966 systemd[1]: Created slice system-addon\x2drun.slice - Slice /system/addon-run. Nov 8 00:05:04.862004 systemd[1]: Created slice system-getty.slice - Slice /system/getty. Nov 8 00:05:04.862035 systemd[1]: Created slice system-modprobe.slice - Slice /system/modprobe. Nov 8 00:05:04.862068 systemd[1]: Created slice system-serial\x2dgetty.slice - Slice /system/serial-getty. Nov 8 00:05:04.862103 systemd[1]: Created slice system-system\x2dcloudinit.slice - Slice /system/system-cloudinit. Nov 8 00:05:04.862135 systemd[1]: Created slice system-systemd\x2dfsck.slice - Slice /system/systemd-fsck. Nov 8 00:05:04.862199 systemd[1]: Created slice user.slice - User and Session Slice. Nov 8 00:05:04.862238 systemd[1]: Started clevis-luks-askpass.path - Forward Password Requests to Clevis Directory Watch. Nov 8 00:05:04.862269 systemd[1]: Started systemd-ask-password-console.path - Dispatch Password Requests to Console Directory Watch. Nov 8 00:05:04.862302 systemd[1]: Started systemd-ask-password-wall.path - Forward Password Requests to Wall Directory Watch. Nov 8 00:05:04.862342 systemd[1]: Set up automount boot.automount - Boot partition Automount Point. Nov 8 00:05:04.862374 systemd[1]: Set up automount proc-sys-fs-binfmt_misc.automount - Arbitrary Executable File Formats File System Automount Point. Nov 8 00:05:04.862407 systemd[1]: Expecting device dev-disk-by\x2dlabel-OEM.device - /dev/disk/by-label/OEM... Nov 8 00:05:04.862437 systemd[1]: Expecting device dev-ttyS0.device - /dev/ttyS0... Nov 8 00:05:04.862471 systemd[1]: Reached target cryptsetup-pre.target - Local Encrypted Volumes (Pre). Nov 8 00:05:04.862503 systemd[1]: Stopped target initrd-switch-root.target - Switch Root. Nov 8 00:05:04.862535 systemd[1]: Stopped target initrd-fs.target - Initrd File Systems. Nov 8 00:05:04.862571 systemd[1]: Stopped target initrd-root-fs.target - Initrd Root File System. Nov 8 00:05:04.862612 systemd[1]: Reached target integritysetup.target - Local Integrity Protected Volumes. Nov 8 00:05:04.862645 systemd[1]: Reached target remote-cryptsetup.target - Remote Encrypted Volumes. Nov 8 00:05:04.862685 systemd[1]: Reached target remote-fs.target - Remote File Systems. Nov 8 00:05:04.862718 systemd[1]: Reached target slices.target - Slice Units. Nov 8 00:05:04.862752 systemd[1]: Reached target swap.target - Swaps. Nov 8 00:05:04.862786 systemd[1]: Reached target veritysetup.target - Local Verity Protected Volumes. Nov 8 00:05:04.862819 systemd[1]: Listening on systemd-coredump.socket - Process Core Dump Socket. Nov 8 00:05:04.862852 systemd[1]: Listening on systemd-networkd.socket - Network Service Netlink Socket. Nov 8 00:05:04.862912 systemd[1]: Listening on systemd-udevd-control.socket - udev Control Socket. Nov 8 00:05:04.862951 systemd[1]: Listening on systemd-udevd-kernel.socket - udev Kernel Socket. Nov 8 00:05:04.862982 systemd[1]: Listening on systemd-userdbd.socket - User Database Manager Socket. Nov 8 00:05:04.863018 systemd[1]: Mounting dev-hugepages.mount - Huge Pages File System... Nov 8 00:05:04.863051 systemd[1]: Mounting dev-mqueue.mount - POSIX Message Queue File System... Nov 8 00:05:04.863085 systemd[1]: Mounting media.mount - External Media Directory... Nov 8 00:05:04.863117 systemd[1]: Mounting sys-kernel-debug.mount - Kernel Debug File System... Nov 8 00:05:04.863260 systemd[1]: Mounting sys-kernel-tracing.mount - Kernel Trace File System... Nov 8 00:05:04.863305 systemd[1]: Mounting tmp.mount - Temporary Directory /tmp... Nov 8 00:05:04.863346 systemd[1]: var-lib-machines.mount - Virtual Machine and Container Storage (Compatibility) was skipped because of an unmet condition check (ConditionPathExists=/var/lib/machines.raw). Nov 8 00:05:04.863380 systemd[1]: Reached target machines.target - Containers. Nov 8 00:05:04.863410 systemd[1]: Starting flatcar-tmpfiles.service - Create missing system files... Nov 8 00:05:04.863441 systemd[1]: ignition-delete-config.service - Ignition (delete config) was skipped because no trigger condition checks were met. Nov 8 00:05:04.863472 systemd[1]: Starting kmod-static-nodes.service - Create List of Static Device Nodes... Nov 8 00:05:04.863508 systemd[1]: Starting modprobe@configfs.service - Load Kernel Module configfs... Nov 8 00:05:04.863544 systemd[1]: Starting modprobe@dm_mod.service - Load Kernel Module dm_mod... Nov 8 00:05:04.863578 systemd[1]: Starting modprobe@drm.service - Load Kernel Module drm... Nov 8 00:05:04.863613 systemd[1]: Starting modprobe@efi_pstore.service - Load Kernel Module efi_pstore... Nov 8 00:05:04.863646 systemd[1]: Starting modprobe@fuse.service - Load Kernel Module fuse... Nov 8 00:05:04.863676 systemd[1]: Starting modprobe@loop.service - Load Kernel Module loop... Nov 8 00:05:04.863707 systemd[1]: setup-nsswitch.service - Create /etc/nsswitch.conf was skipped because of an unmet condition check (ConditionPathExists=!/etc/nsswitch.conf). Nov 8 00:05:04.863740 systemd[1]: systemd-fsck-root.service: Deactivated successfully. Nov 8 00:05:04.863774 systemd[1]: Stopped systemd-fsck-root.service - File System Check on Root Device. Nov 8 00:05:04.863806 systemd[1]: systemd-fsck-usr.service: Deactivated successfully. Nov 8 00:05:04.863836 systemd[1]: Stopped systemd-fsck-usr.service. Nov 8 00:05:04.863870 systemd[1]: Starting systemd-journald.service - Journal Service... Nov 8 00:05:04.863907 systemd[1]: Starting systemd-modules-load.service - Load Kernel Modules... Nov 8 00:05:04.863939 kernel: fuse: init (API version 7.39) Nov 8 00:05:04.863971 systemd[1]: Starting systemd-network-generator.service - Generate network units from Kernel command line... Nov 8 00:05:04.864002 systemd[1]: Starting systemd-remount-fs.service - Remount Root and Kernel File Systems... Nov 8 00:05:04.864034 systemd[1]: Starting systemd-udev-trigger.service - Coldplug All udev Devices... Nov 8 00:05:04.864067 systemd[1]: verity-setup.service: Deactivated successfully. Nov 8 00:05:04.864098 systemd[1]: Stopped verity-setup.service. Nov 8 00:05:04.864128 systemd[1]: Mounted dev-hugepages.mount - Huge Pages File System. Nov 8 00:05:04.864191 systemd[1]: Mounted dev-mqueue.mount - POSIX Message Queue File System. Nov 8 00:05:04.864236 systemd[1]: Mounted media.mount - External Media Directory. Nov 8 00:05:04.864267 systemd[1]: Mounted sys-kernel-debug.mount - Kernel Debug File System. Nov 8 00:05:04.864297 kernel: loop: module loaded Nov 8 00:05:04.864329 systemd[1]: Mounted sys-kernel-tracing.mount - Kernel Trace File System. Nov 8 00:05:04.864363 systemd[1]: Mounted tmp.mount - Temporary Directory /tmp. Nov 8 00:05:04.864398 systemd[1]: Finished kmod-static-nodes.service - Create List of Static Device Nodes. Nov 8 00:05:04.864429 systemd[1]: modprobe@configfs.service: Deactivated successfully. Nov 8 00:05:04.864461 systemd[1]: Finished modprobe@configfs.service - Load Kernel Module configfs. Nov 8 00:05:04.864491 systemd[1]: modprobe@dm_mod.service: Deactivated successfully. Nov 8 00:05:04.864521 systemd[1]: Finished modprobe@dm_mod.service - Load Kernel Module dm_mod. Nov 8 00:05:04.864552 systemd[1]: modprobe@efi_pstore.service: Deactivated successfully. Nov 8 00:05:04.864582 systemd[1]: Finished modprobe@efi_pstore.service - Load Kernel Module efi_pstore. Nov 8 00:05:04.864668 systemd-journald[1567]: Collecting audit messages is disabled. Nov 8 00:05:04.864746 systemd[1]: Finished flatcar-tmpfiles.service - Create missing system files. Nov 8 00:05:04.864777 systemd-journald[1567]: Journal started Nov 8 00:05:04.864827 systemd-journald[1567]: Runtime Journal (/run/log/journal/ec2f79f1503f8cdec3ab8993f66244d1) is 8.0M, max 75.3M, 67.3M free. Nov 8 00:05:04.102518 systemd[1]: Queued start job for default target multi-user.target. Nov 8 00:05:04.871023 systemd[1]: Started systemd-journald.service - Journal Service. Nov 8 00:05:04.205645 systemd[1]: Unnecessary job was removed for dev-nvme0n1p6.device - /dev/nvme0n1p6. Nov 8 00:05:04.206762 systemd[1]: systemd-journald.service: Deactivated successfully. Nov 8 00:05:04.879809 systemd[1]: modprobe@fuse.service: Deactivated successfully. Nov 8 00:05:04.880132 systemd[1]: Finished modprobe@fuse.service - Load Kernel Module fuse. Nov 8 00:05:04.886311 systemd[1]: modprobe@loop.service: Deactivated successfully. Nov 8 00:05:04.886643 systemd[1]: Finished modprobe@loop.service - Load Kernel Module loop. Nov 8 00:05:04.892735 systemd[1]: Finished systemd-modules-load.service - Load Kernel Modules. Nov 8 00:05:04.905797 kernel: ACPI: bus type drm_connector registered Nov 8 00:05:04.898246 systemd[1]: Finished systemd-network-generator.service - Generate network units from Kernel command line. Nov 8 00:05:04.907414 systemd[1]: modprobe@drm.service: Deactivated successfully. Nov 8 00:05:04.907858 systemd[1]: Finished modprobe@drm.service - Load Kernel Module drm. Nov 8 00:05:04.912279 systemd[1]: Finished systemd-remount-fs.service - Remount Root and Kernel File Systems. Nov 8 00:05:04.940946 systemd[1]: Reached target network-pre.target - Preparation for Network. Nov 8 00:05:04.951459 systemd[1]: Mounting sys-fs-fuse-connections.mount - FUSE Control File System... Nov 8 00:05:04.969487 systemd[1]: Mounting sys-kernel-config.mount - Kernel Configuration File System... Nov 8 00:05:04.975598 systemd[1]: remount-root.service - Remount Root File System was skipped because of an unmet condition check (ConditionPathIsReadWrite=!/). Nov 8 00:05:04.975661 systemd[1]: Reached target local-fs.target - Local File Systems. Nov 8 00:05:04.982502 systemd[1]: Listening on systemd-sysext.socket - System Extension Image Management (Varlink). Nov 8 00:05:04.999522 systemd[1]: Starting dracut-shutdown.service - Restore /run/initramfs on shutdown... Nov 8 00:05:05.009544 systemd[1]: Starting ldconfig.service - Rebuild Dynamic Linker Cache... Nov 8 00:05:05.014525 systemd[1]: systemd-binfmt.service - Set Up Additional Binary Formats was skipped because no trigger condition checks were met. Nov 8 00:05:05.022203 systemd[1]: Starting systemd-hwdb-update.service - Rebuild Hardware Database... Nov 8 00:05:05.027200 systemd[1]: Starting systemd-journal-flush.service - Flush Journal to Persistent Storage... Nov 8 00:05:05.031106 systemd[1]: systemd-pstore.service - Platform Persistent Storage Archival was skipped because of an unmet condition check (ConditionDirectoryNotEmpty=/sys/fs/pstore). Nov 8 00:05:05.038452 systemd[1]: Starting systemd-random-seed.service - Load/Save OS Random Seed... Nov 8 00:05:05.042055 systemd[1]: systemd-repart.service - Repartition Root Disk was skipped because no trigger condition checks were met. Nov 8 00:05:05.051454 systemd[1]: Starting systemd-sysctl.service - Apply Kernel Variables... Nov 8 00:05:05.060536 systemd[1]: Starting systemd-sysext.service - Merge System Extension Images into /usr/ and /opt/... Nov 8 00:05:05.070519 systemd[1]: Starting systemd-sysusers.service - Create System Users... Nov 8 00:05:05.078485 systemd[1]: Mounted sys-fs-fuse-connections.mount - FUSE Control File System. Nov 8 00:05:05.091253 systemd[1]: Mounted sys-kernel-config.mount - Kernel Configuration File System. Nov 8 00:05:05.094566 systemd[1]: Finished dracut-shutdown.service - Restore /run/initramfs on shutdown. Nov 8 00:05:05.125662 systemd-journald[1567]: Time spent on flushing to /var/log/journal/ec2f79f1503f8cdec3ab8993f66244d1 is 128.029ms for 904 entries. Nov 8 00:05:05.125662 systemd-journald[1567]: System Journal (/var/log/journal/ec2f79f1503f8cdec3ab8993f66244d1) is 8.0M, max 195.6M, 187.6M free. Nov 8 00:05:05.270680 systemd-journald[1567]: Received client request to flush runtime journal. Nov 8 00:05:05.270783 kernel: loop0: detected capacity change from 0 to 114432 Nov 8 00:05:05.142433 systemd[1]: Finished systemd-random-seed.service - Load/Save OS Random Seed. Nov 8 00:05:05.145579 systemd[1]: Reached target first-boot-complete.target - First Boot Complete. Nov 8 00:05:05.156624 systemd[1]: Starting systemd-machine-id-commit.service - Commit a transient machine-id on disk... Nov 8 00:05:05.226955 systemd[1]: Finished systemd-sysctl.service - Apply Kernel Variables. Nov 8 00:05:05.297825 systemd[1]: etc-machine\x2did.mount: Deactivated successfully. Nov 8 00:05:05.300491 systemd[1]: Finished systemd-udev-trigger.service - Coldplug All udev Devices. Nov 8 00:05:05.304060 systemd[1]: Finished systemd-journal-flush.service - Flush Journal to Persistent Storage. Nov 8 00:05:05.312865 systemd[1]: Finished systemd-machine-id-commit.service - Commit a transient machine-id on disk. Nov 8 00:05:05.335615 systemd[1]: Starting systemd-udev-settle.service - Wait for udev To Complete Device Initialization... Nov 8 00:05:05.344826 systemd[1]: Finished systemd-sysusers.service - Create System Users. Nov 8 00:05:05.364345 systemd[1]: Starting systemd-tmpfiles-setup-dev.service - Create Static Device Nodes in /dev... Nov 8 00:05:05.378225 kernel: squashfs: version 4.0 (2009/01/31) Phillip Lougher Nov 8 00:05:05.386735 udevadm[1629]: systemd-udev-settle.service is deprecated. Please fix lvm2-activation.service, lvm2-activation-early.service not to pull it in. Nov 8 00:05:05.414200 kernel: loop1: detected capacity change from 0 to 114328 Nov 8 00:05:05.434776 systemd-tmpfiles[1631]: ACLs are not supported, ignoring. Nov 8 00:05:05.434819 systemd-tmpfiles[1631]: ACLs are not supported, ignoring. Nov 8 00:05:05.447277 systemd[1]: Finished systemd-tmpfiles-setup-dev.service - Create Static Device Nodes in /dev. Nov 8 00:05:05.539206 kernel: loop2: detected capacity change from 0 to 207008 Nov 8 00:05:05.654195 kernel: loop3: detected capacity change from 0 to 52536 Nov 8 00:05:05.709209 kernel: loop4: detected capacity change from 0 to 114432 Nov 8 00:05:05.733559 kernel: loop5: detected capacity change from 0 to 114328 Nov 8 00:05:05.750201 kernel: loop6: detected capacity change from 0 to 207008 Nov 8 00:05:05.776205 kernel: loop7: detected capacity change from 0 to 52536 Nov 8 00:05:05.791390 (sd-merge)[1639]: Using extensions 'containerd-flatcar', 'docker-flatcar', 'kubernetes', 'oem-ami'. Nov 8 00:05:05.792927 (sd-merge)[1639]: Merged extensions into '/usr'. Nov 8 00:05:05.807099 systemd[1]: Reloading requested from client PID 1614 ('systemd-sysext') (unit systemd-sysext.service)... Nov 8 00:05:05.807706 systemd[1]: Reloading... Nov 8 00:05:05.965195 zram_generator::config[1665]: No configuration found. Nov 8 00:05:06.383074 systemd[1]: /usr/lib/systemd/system/docker.socket:6: ListenStream= references a path below legacy directory /var/run/, updating /var/run/docker.sock → /run/docker.sock; please update the unit file accordingly. Nov 8 00:05:06.497431 systemd[1]: Reloading finished in 688 ms. Nov 8 00:05:06.543229 systemd[1]: Finished systemd-hwdb-update.service - Rebuild Hardware Database. Nov 8 00:05:06.547002 systemd[1]: Finished systemd-sysext.service - Merge System Extension Images into /usr/ and /opt/. Nov 8 00:05:06.563515 systemd[1]: Starting ensure-sysext.service... Nov 8 00:05:06.572325 systemd[1]: Starting systemd-tmpfiles-setup.service - Create System Files and Directories... Nov 8 00:05:06.584592 systemd[1]: Starting systemd-udevd.service - Rule-based Manager for Device Events and Files... Nov 8 00:05:06.606405 systemd[1]: Reloading requested from client PID 1717 ('systemctl') (unit ensure-sysext.service)... Nov 8 00:05:06.606436 systemd[1]: Reloading... Nov 8 00:05:06.679411 systemd-tmpfiles[1718]: /usr/lib/tmpfiles.d/provision.conf:20: Duplicate line for path "/root", ignoring. Nov 8 00:05:06.681654 systemd-udevd[1719]: Using default interface naming scheme 'v255'. Nov 8 00:05:06.682397 systemd-tmpfiles[1718]: /usr/lib/tmpfiles.d/systemd-flatcar.conf:6: Duplicate line for path "/var/log/journal", ignoring. Nov 8 00:05:06.684475 systemd-tmpfiles[1718]: /usr/lib/tmpfiles.d/systemd.conf:29: Duplicate line for path "/var/lib/systemd", ignoring. Nov 8 00:05:06.687977 systemd-tmpfiles[1718]: ACLs are not supported, ignoring. Nov 8 00:05:06.688189 systemd-tmpfiles[1718]: ACLs are not supported, ignoring. Nov 8 00:05:06.704814 systemd-tmpfiles[1718]: Detected autofs mount point /boot during canonicalization of boot. Nov 8 00:05:06.704843 systemd-tmpfiles[1718]: Skipping /boot Nov 8 00:05:06.735182 ldconfig[1609]: /sbin/ldconfig: /lib/ld.so.conf is not an ELF file - it has the wrong magic bytes at the start. Nov 8 00:05:06.772390 systemd-tmpfiles[1718]: Detected autofs mount point /boot during canonicalization of boot. Nov 8 00:05:06.773071 systemd-tmpfiles[1718]: Skipping /boot Nov 8 00:05:06.820209 zram_generator::config[1753]: No configuration found. Nov 8 00:05:07.004776 (udev-worker)[1756]: Network interface NamePolicy= disabled on kernel command line. Nov 8 00:05:07.187204 kernel: BTRFS warning: duplicate device /dev/nvme0n1p3 devid 1 generation 37 scanned by (udev-worker) (1763) Nov 8 00:05:07.254326 systemd[1]: /usr/lib/systemd/system/docker.socket:6: ListenStream= references a path below legacy directory /var/run/, updating /var/run/docker.sock → /run/docker.sock; please update the unit file accordingly. Nov 8 00:05:07.404940 systemd[1]: Condition check resulted in dev-ttyS0.device - /dev/ttyS0 being skipped. Nov 8 00:05:07.406627 systemd[1]: Reloading finished in 799 ms. Nov 8 00:05:07.465675 systemd[1]: Started systemd-udevd.service - Rule-based Manager for Device Events and Files. Nov 8 00:05:07.471290 systemd[1]: Finished ldconfig.service - Rebuild Dynamic Linker Cache. Nov 8 00:05:07.475967 systemd[1]: Finished systemd-tmpfiles-setup.service - Create System Files and Directories. Nov 8 00:05:07.585601 systemd[1]: Found device dev-disk-by\x2dlabel-OEM.device - Amazon Elastic Block Store OEM. Nov 8 00:05:07.593207 systemd[1]: Finished systemd-udev-settle.service - Wait for udev To Complete Device Initialization. Nov 8 00:05:07.626433 systemd[1]: Finished ensure-sysext.service. Nov 8 00:05:07.643545 systemd[1]: Starting audit-rules.service - Load Security Auditing Rules... Nov 8 00:05:07.656485 systemd[1]: Starting clean-ca-certificates.service - Clean up broken links in /etc/ssl/certs... Nov 8 00:05:07.659490 systemd[1]: ignition-delete-config.service - Ignition (delete config) was skipped because no trigger condition checks were met. Nov 8 00:05:07.662612 systemd[1]: Starting lvm2-activation-early.service - Activation of LVM2 logical volumes... Nov 8 00:05:07.670556 systemd[1]: Starting modprobe@dm_mod.service - Load Kernel Module dm_mod... Nov 8 00:05:07.677714 systemd[1]: Starting modprobe@drm.service - Load Kernel Module drm... Nov 8 00:05:07.697658 systemd[1]: Starting modprobe@efi_pstore.service - Load Kernel Module efi_pstore... Nov 8 00:05:07.705366 systemd[1]: Starting modprobe@loop.service - Load Kernel Module loop... Nov 8 00:05:07.708387 systemd[1]: systemd-binfmt.service - Set Up Additional Binary Formats was skipped because no trigger condition checks were met. Nov 8 00:05:07.713492 systemd[1]: Starting systemd-fsck@dev-disk-by\x2dlabel-OEM.service - File System Check on /dev/disk/by-label/OEM... Nov 8 00:05:07.721528 systemd[1]: Starting systemd-journal-catalog-update.service - Rebuild Journal Catalog... Nov 8 00:05:07.734303 systemd[1]: Starting systemd-networkd.service - Network Configuration... Nov 8 00:05:07.745483 systemd[1]: Starting systemd-resolved.service - Network Name Resolution... Nov 8 00:05:07.748323 systemd[1]: Reached target time-set.target - System Time Set. Nov 8 00:05:07.759475 systemd[1]: Starting systemd-update-utmp.service - Record System Boot/Shutdown in UTMP... Nov 8 00:05:07.769276 systemd[1]: Starting systemd-vconsole-setup.service - Virtual Console Setup... Nov 8 00:05:07.774503 systemd[1]: modprobe@dm_mod.service: Deactivated successfully. Nov 8 00:05:07.777271 systemd[1]: Finished modprobe@dm_mod.service - Load Kernel Module dm_mod. Nov 8 00:05:07.780977 systemd[1]: modprobe@drm.service: Deactivated successfully. Nov 8 00:05:07.782368 systemd[1]: Finished modprobe@drm.service - Load Kernel Module drm. Nov 8 00:05:07.802909 systemd[1]: modprobe@loop.service: Deactivated successfully. Nov 8 00:05:07.803244 systemd[1]: Finished modprobe@loop.service - Load Kernel Module loop. Nov 8 00:05:07.811999 systemd[1]: systemd-repart.service - Repartition Root Disk was skipped because no trigger condition checks were met. Nov 8 00:05:07.816886 systemd[1]: modprobe@efi_pstore.service: Deactivated successfully. Nov 8 00:05:07.817270 systemd[1]: Finished modprobe@efi_pstore.service - Load Kernel Module efi_pstore. Nov 8 00:05:07.820796 systemd[1]: systemd-pstore.service - Platform Persistent Storage Archival was skipped because of an unmet condition check (ConditionDirectoryNotEmpty=/sys/fs/pstore). Nov 8 00:05:07.881944 lvm[1918]: WARNING: Failed to connect to lvmetad. Falling back to device scanning. Nov 8 00:05:07.887619 systemd[1]: Starting systemd-userdbd.service - User Database Manager... Nov 8 00:05:07.890212 systemd[1]: Finished systemd-update-utmp.service - Record System Boot/Shutdown in UTMP. Nov 8 00:05:07.914281 systemd[1]: Finished systemd-fsck@dev-disk-by\x2dlabel-OEM.service - File System Check on /dev/disk/by-label/OEM. Nov 8 00:05:07.941002 systemd[1]: Finished clean-ca-certificates.service - Clean up broken links in /etc/ssl/certs. Nov 8 00:05:07.942412 systemd[1]: update-ca-certificates.service - Update CA bundle at /etc/ssl/certs/ca-certificates.crt was skipped because of an unmet condition check (ConditionPathIsSymbolicLink=!/etc/ssl/certs/ca-certificates.crt). Nov 8 00:05:07.972294 systemd[1]: Finished systemd-journal-catalog-update.service - Rebuild Journal Catalog. Nov 8 00:05:07.990634 systemd[1]: Starting systemd-update-done.service - Update is Completed... Nov 8 00:05:07.991454 systemd[1]: Finished lvm2-activation-early.service - Activation of LVM2 logical volumes. Nov 8 00:05:07.994024 systemd[1]: Reached target cryptsetup.target - Local Encrypted Volumes. Nov 8 00:05:08.002532 systemd[1]: Starting lvm2-activation.service - Activation of LVM2 logical volumes... Nov 8 00:05:08.009119 augenrules[1956]: No rules Nov 8 00:05:08.014319 systemd[1]: Finished audit-rules.service - Load Security Auditing Rules. Nov 8 00:05:08.050420 lvm[1959]: WARNING: Failed to connect to lvmetad. Falling back to device scanning. Nov 8 00:05:08.051473 systemd[1]: Finished systemd-update-done.service - Update is Completed. Nov 8 00:05:08.082007 systemd[1]: Finished systemd-vconsole-setup.service - Virtual Console Setup. Nov 8 00:05:08.088292 systemd[1]: Started systemd-userdbd.service - User Database Manager. Nov 8 00:05:08.106286 systemd[1]: Finished lvm2-activation.service - Activation of LVM2 logical volumes. Nov 8 00:05:08.218436 systemd-networkd[1929]: lo: Link UP Nov 8 00:05:08.219106 systemd-networkd[1929]: lo: Gained carrier Nov 8 00:05:08.222429 systemd-networkd[1929]: Enumeration completed Nov 8 00:05:08.222841 systemd[1]: Started systemd-networkd.service - Network Configuration. Nov 8 00:05:08.227588 systemd-resolved[1932]: Positive Trust Anchors: Nov 8 00:05:08.227615 systemd-resolved[1932]: . IN DS 20326 8 2 e06d44b80b8f1d39a95c0b0d7c65d08458e880409bbc683457104237c7f8ec8d Nov 8 00:05:08.227679 systemd-resolved[1932]: Negative trust anchors: home.arpa 10.in-addr.arpa 16.172.in-addr.arpa 17.172.in-addr.arpa 18.172.in-addr.arpa 19.172.in-addr.arpa 20.172.in-addr.arpa 21.172.in-addr.arpa 22.172.in-addr.arpa 23.172.in-addr.arpa 24.172.in-addr.arpa 25.172.in-addr.arpa 26.172.in-addr.arpa 27.172.in-addr.arpa 28.172.in-addr.arpa 29.172.in-addr.arpa 30.172.in-addr.arpa 31.172.in-addr.arpa 170.0.0.192.in-addr.arpa 171.0.0.192.in-addr.arpa 168.192.in-addr.arpa d.f.ip6.arpa ipv4only.arpa resolver.arpa corp home internal intranet lan local private test Nov 8 00:05:08.229018 systemd-networkd[1929]: eth0: found matching network '/usr/lib/systemd/network/zz-default.network', based on potentially unpredictable interface name. Nov 8 00:05:08.229027 systemd-networkd[1929]: eth0: Configuring with /usr/lib/systemd/network/zz-default.network. Nov 8 00:05:08.232563 systemd-networkd[1929]: eth0: Link UP Nov 8 00:05:08.233050 systemd-networkd[1929]: eth0: Gained carrier Nov 8 00:05:08.233090 systemd-networkd[1929]: eth0: found matching network '/usr/lib/systemd/network/zz-default.network', based on potentially unpredictable interface name. Nov 8 00:05:08.235527 systemd[1]: Starting systemd-networkd-wait-online.service - Wait for Network to be Configured... Nov 8 00:05:08.256279 systemd-networkd[1929]: eth0: DHCPv4 address 172.31.23.87/20, gateway 172.31.16.1 acquired from 172.31.16.1 Nov 8 00:05:08.258318 systemd-resolved[1932]: Defaulting to hostname 'linux'. Nov 8 00:05:08.261975 systemd[1]: Started systemd-resolved.service - Network Name Resolution. Nov 8 00:05:08.264802 systemd[1]: Reached target network.target - Network. Nov 8 00:05:08.267080 systemd[1]: Reached target nss-lookup.target - Host and Network Name Lookups. Nov 8 00:05:08.270061 systemd[1]: Reached target sysinit.target - System Initialization. Nov 8 00:05:08.272705 systemd[1]: Started motdgen.path - Watch for update engine configuration changes. Nov 8 00:05:08.275680 systemd[1]: Started user-cloudinit@var-lib-flatcar\x2dinstall-user_data.path - Watch for a cloud-config at /var/lib/flatcar-install/user_data. Nov 8 00:05:08.279258 systemd[1]: Started logrotate.timer - Daily rotation of log files. Nov 8 00:05:08.281972 systemd[1]: Started mdadm.timer - Weekly check for MD array's redundancy information.. Nov 8 00:05:08.284887 systemd[1]: Started systemd-tmpfiles-clean.timer - Daily Cleanup of Temporary Directories. Nov 8 00:05:08.287930 systemd[1]: update-engine-stub.timer - Update Engine Stub Timer was skipped because of an unmet condition check (ConditionPathExists=/usr/.noupdate). Nov 8 00:05:08.287985 systemd[1]: Reached target paths.target - Path Units. Nov 8 00:05:08.290182 systemd[1]: Reached target timers.target - Timer Units. Nov 8 00:05:08.293771 systemd[1]: Listening on dbus.socket - D-Bus System Message Bus Socket. Nov 8 00:05:08.299564 systemd[1]: Starting docker.socket - Docker Socket for the API... Nov 8 00:05:08.308617 systemd[1]: Listening on sshd.socket - OpenSSH Server Socket. Nov 8 00:05:08.312288 systemd[1]: Listening on docker.socket - Docker Socket for the API. Nov 8 00:05:08.315089 systemd[1]: Reached target sockets.target - Socket Units. Nov 8 00:05:08.317470 systemd[1]: Reached target basic.target - Basic System. Nov 8 00:05:08.320332 systemd[1]: addon-config@oem.service - Configure Addon /oem was skipped because no trigger condition checks were met. Nov 8 00:05:08.320524 systemd[1]: addon-run@oem.service - Run Addon /oem was skipped because no trigger condition checks were met. Nov 8 00:05:08.322951 systemd[1]: Starting containerd.service - containerd container runtime... Nov 8 00:05:08.333547 systemd[1]: Starting coreos-metadata.service - Flatcar Metadata Agent... Nov 8 00:05:08.340771 systemd[1]: Starting dbus.service - D-Bus System Message Bus... Nov 8 00:05:08.351400 systemd[1]: Starting enable-oem-cloudinit.service - Enable cloudinit... Nov 8 00:05:08.357573 systemd[1]: Starting extend-filesystems.service - Extend Filesystems... Nov 8 00:05:08.363884 systemd[1]: flatcar-setup-environment.service - Modifies /etc/environment for CoreOS was skipped because of an unmet condition check (ConditionPathExists=/oem/bin/flatcar-setup-environment). Nov 8 00:05:08.368920 systemd[1]: Starting motdgen.service - Generate /run/flatcar/motd... Nov 8 00:05:08.377614 systemd[1]: Started ntpd.service - Network Time Service. Nov 8 00:05:08.386588 systemd[1]: Starting prepare-helm.service - Unpack helm to /opt/bin... Nov 8 00:05:08.400198 jq[1983]: false Nov 8 00:05:08.396428 systemd[1]: Starting setup-oem.service - Setup OEM... Nov 8 00:05:08.401552 systemd[1]: Starting ssh-key-proc-cmdline.service - Install an ssh key from /proc/cmdline... Nov 8 00:05:08.414606 systemd[1]: Starting sshd-keygen.service - Generate sshd host keys... Nov 8 00:05:08.427540 systemd[1]: Starting systemd-logind.service - User Login Management... Nov 8 00:05:08.437308 systemd[1]: tcsd.service - TCG Core Services Daemon was skipped because of an unmet condition check (ConditionPathExists=/dev/tpm0). Nov 8 00:05:08.438298 systemd[1]: cgroup compatibility translation between legacy and unified hierarchy settings activated. See cgroup-compat debug messages for details. Nov 8 00:05:08.452493 systemd[1]: Starting update-engine.service - Update Engine... Nov 8 00:05:08.463397 systemd[1]: Starting update-ssh-keys-after-ignition.service - Run update-ssh-keys once after Ignition... Nov 8 00:05:08.474911 systemd[1]: enable-oem-cloudinit.service: Skipped due to 'exec-condition'. Nov 8 00:05:08.475338 systemd[1]: Condition check resulted in enable-oem-cloudinit.service - Enable cloudinit being skipped. Nov 8 00:05:08.494353 dbus-daemon[1982]: [system] SELinux support is enabled Nov 8 00:05:08.497308 systemd[1]: Started dbus.service - D-Bus System Message Bus. Nov 8 00:05:08.500076 dbus-daemon[1982]: [system] Activating systemd to hand-off: service name='org.freedesktop.hostname1' unit='dbus-org.freedesktop.hostname1.service' requested by ':1.0' (uid=244 pid=1929 comm="/usr/lib/systemd/systemd-networkd" label="system_u:system_r:kernel_t:s0") Nov 8 00:05:08.504563 dbus-daemon[1982]: [system] Successfully activated service 'org.freedesktop.systemd1' Nov 8 00:05:08.505297 systemd[1]: system-cloudinit@usr-share-oem-cloud\x2dconfig.yml.service - Load cloud-config from /usr/share/oem/cloud-config.yml was skipped because of an unmet condition check (ConditionFileNotEmpty=/usr/share/oem/cloud-config.yml). Nov 8 00:05:08.505374 systemd[1]: Reached target system-config.target - Load system-provided cloud configs. Nov 8 00:05:08.512321 systemd[1]: user-cloudinit-proc-cmdline.service - Load cloud-config from url defined in /proc/cmdline was skipped because of an unmet condition check (ConditionKernelCommandLine=cloud-config-url). Nov 8 00:05:08.512388 systemd[1]: Reached target user-config.target - Load user-provided cloud configs. Nov 8 00:05:08.528356 systemd[1]: Starting systemd-hostnamed.service - Hostname Service... Nov 8 00:05:08.647839 systemd[1]: ssh-key-proc-cmdline.service: Deactivated successfully. Nov 8 00:05:08.648309 systemd[1]: Finished ssh-key-proc-cmdline.service - Install an ssh key from /proc/cmdline. Nov 8 00:05:08.665276 jq[1994]: true Nov 8 00:05:08.684984 (ntainerd)[2009]: containerd.service: Referenced but unset environment variable evaluates to an empty string: TORCX_IMAGEDIR, TORCX_UNPACKDIR Nov 8 00:05:08.690290 systemd[1]: motdgen.service: Deactivated successfully. Nov 8 00:05:08.690722 systemd[1]: Finished motdgen.service - Generate /run/flatcar/motd. Nov 8 00:05:08.708367 systemd[1]: Finished setup-oem.service - Setup OEM. Nov 8 00:05:08.713320 extend-filesystems[1984]: Found loop4 Nov 8 00:05:08.715972 extend-filesystems[1984]: Found loop5 Nov 8 00:05:08.715972 extend-filesystems[1984]: Found loop6 Nov 8 00:05:08.715972 extend-filesystems[1984]: Found loop7 Nov 8 00:05:08.715972 extend-filesystems[1984]: Found nvme0n1 Nov 8 00:05:08.715972 extend-filesystems[1984]: Found nvme0n1p1 Nov 8 00:05:08.715972 extend-filesystems[1984]: Found nvme0n1p2 Nov 8 00:05:08.715972 extend-filesystems[1984]: Found nvme0n1p3 Nov 8 00:05:08.744099 update_engine[1992]: I20251108 00:05:08.717783 1992 main.cc:92] Flatcar Update Engine starting Nov 8 00:05:08.744519 jq[2021]: true Nov 8 00:05:08.748711 extend-filesystems[1984]: Found usr Nov 8 00:05:08.748711 extend-filesystems[1984]: Found nvme0n1p4 Nov 8 00:05:08.748711 extend-filesystems[1984]: Found nvme0n1p6 Nov 8 00:05:08.748711 extend-filesystems[1984]: Found nvme0n1p7 Nov 8 00:05:08.748711 extend-filesystems[1984]: Found nvme0n1p9 Nov 8 00:05:08.771350 update_engine[1992]: I20251108 00:05:08.745983 1992 update_check_scheduler.cc:74] Next update check in 4m34s Nov 8 00:05:08.745755 systemd[1]: Started update-engine.service - Update Engine. Nov 8 00:05:08.774262 extend-filesystems[1984]: Checking size of /dev/nvme0n1p9 Nov 8 00:05:08.771538 systemd[1]: Started locksmithd.service - Cluster reboot manager. Nov 8 00:05:08.784912 ntpd[1986]: ntpd 4.2.8p17@1.4004-o Fri Nov 7 22:04:46 UTC 2025 (1): Starting Nov 8 00:05:08.791320 tar[2006]: linux-arm64/LICENSE Nov 8 00:05:08.791320 tar[2006]: linux-arm64/helm Nov 8 00:05:08.791719 ntpd[1986]: 8 Nov 00:05:08 ntpd[1986]: ntpd 4.2.8p17@1.4004-o Fri Nov 7 22:04:46 UTC 2025 (1): Starting Nov 8 00:05:08.791719 ntpd[1986]: 8 Nov 00:05:08 ntpd[1986]: Command line: /usr/sbin/ntpd -g -n -u ntp:ntp Nov 8 00:05:08.791719 ntpd[1986]: 8 Nov 00:05:08 ntpd[1986]: ---------------------------------------------------- Nov 8 00:05:08.791719 ntpd[1986]: 8 Nov 00:05:08 ntpd[1986]: ntp-4 is maintained by Network Time Foundation, Nov 8 00:05:08.791719 ntpd[1986]: 8 Nov 00:05:08 ntpd[1986]: Inc. (NTF), a non-profit 501(c)(3) public-benefit Nov 8 00:05:08.791719 ntpd[1986]: 8 Nov 00:05:08 ntpd[1986]: corporation. Support and training for ntp-4 are Nov 8 00:05:08.791719 ntpd[1986]: 8 Nov 00:05:08 ntpd[1986]: available at https://www.nwtime.org/support Nov 8 00:05:08.791719 ntpd[1986]: 8 Nov 00:05:08 ntpd[1986]: ---------------------------------------------------- Nov 8 00:05:08.784967 ntpd[1986]: Command line: /usr/sbin/ntpd -g -n -u ntp:ntp Nov 8 00:05:08.784987 ntpd[1986]: ---------------------------------------------------- Nov 8 00:05:08.785006 ntpd[1986]: ntp-4 is maintained by Network Time Foundation, Nov 8 00:05:08.785025 ntpd[1986]: Inc. (NTF), a non-profit 501(c)(3) public-benefit Nov 8 00:05:08.785044 ntpd[1986]: corporation. Support and training for ntp-4 are Nov 8 00:05:08.785062 ntpd[1986]: available at https://www.nwtime.org/support Nov 8 00:05:08.785085 ntpd[1986]: ---------------------------------------------------- Nov 8 00:05:08.797819 ntpd[1986]: proto: precision = 0.108 usec (-23) Nov 8 00:05:08.804860 ntpd[1986]: 8 Nov 00:05:08 ntpd[1986]: proto: precision = 0.108 usec (-23) Nov 8 00:05:08.804860 ntpd[1986]: 8 Nov 00:05:08 ntpd[1986]: basedate set to 2025-10-26 Nov 8 00:05:08.804860 ntpd[1986]: 8 Nov 00:05:08 ntpd[1986]: gps base set to 2025-10-26 (week 2390) Nov 8 00:05:08.802928 ntpd[1986]: basedate set to 2025-10-26 Nov 8 00:05:08.802965 ntpd[1986]: gps base set to 2025-10-26 (week 2390) Nov 8 00:05:08.820758 ntpd[1986]: Listen and drop on 0 v6wildcard [::]:123 Nov 8 00:05:08.823615 ntpd[1986]: 8 Nov 00:05:08 ntpd[1986]: Listen and drop on 0 v6wildcard [::]:123 Nov 8 00:05:08.823615 ntpd[1986]: 8 Nov 00:05:08 ntpd[1986]: Listen and drop on 1 v4wildcard 0.0.0.0:123 Nov 8 00:05:08.823615 ntpd[1986]: 8 Nov 00:05:08 ntpd[1986]: Listen normally on 2 lo 127.0.0.1:123 Nov 8 00:05:08.823615 ntpd[1986]: 8 Nov 00:05:08 ntpd[1986]: Listen normally on 3 eth0 172.31.23.87:123 Nov 8 00:05:08.823615 ntpd[1986]: 8 Nov 00:05:08 ntpd[1986]: Listen normally on 4 lo [::1]:123 Nov 8 00:05:08.823615 ntpd[1986]: 8 Nov 00:05:08 ntpd[1986]: bind(21) AF_INET6 fe80::47a:f8ff:fe85:3f6d%2#123 flags 0x11 failed: Cannot assign requested address Nov 8 00:05:08.823615 ntpd[1986]: 8 Nov 00:05:08 ntpd[1986]: unable to create socket on eth0 (5) for fe80::47a:f8ff:fe85:3f6d%2#123 Nov 8 00:05:08.823615 ntpd[1986]: 8 Nov 00:05:08 ntpd[1986]: failed to init interface for address fe80::47a:f8ff:fe85:3f6d%2 Nov 8 00:05:08.823615 ntpd[1986]: 8 Nov 00:05:08 ntpd[1986]: Listening on routing socket on fd #21 for interface updates Nov 8 00:05:08.820846 ntpd[1986]: Listen and drop on 1 v4wildcard 0.0.0.0:123 Nov 8 00:05:08.821111 ntpd[1986]: Listen normally on 2 lo 127.0.0.1:123 Nov 8 00:05:08.821341 ntpd[1986]: Listen normally on 3 eth0 172.31.23.87:123 Nov 8 00:05:08.821417 ntpd[1986]: Listen normally on 4 lo [::1]:123 Nov 8 00:05:08.821501 ntpd[1986]: bind(21) AF_INET6 fe80::47a:f8ff:fe85:3f6d%2#123 flags 0x11 failed: Cannot assign requested address Nov 8 00:05:08.821540 ntpd[1986]: unable to create socket on eth0 (5) for fe80::47a:f8ff:fe85:3f6d%2#123 Nov 8 00:05:08.821568 ntpd[1986]: failed to init interface for address fe80::47a:f8ff:fe85:3f6d%2 Nov 8 00:05:08.821622 ntpd[1986]: Listening on routing socket on fd #21 for interface updates Nov 8 00:05:08.861841 ntpd[1986]: kernel reports TIME_ERROR: 0x41: Clock Unsynchronized Nov 8 00:05:08.862643 ntpd[1986]: 8 Nov 00:05:08 ntpd[1986]: kernel reports TIME_ERROR: 0x41: Clock Unsynchronized Nov 8 00:05:08.862643 ntpd[1986]: 8 Nov 00:05:08 ntpd[1986]: kernel reports TIME_ERROR: 0x41: Clock Unsynchronized Nov 8 00:05:08.861902 ntpd[1986]: kernel reports TIME_ERROR: 0x41: Clock Unsynchronized Nov 8 00:05:08.871546 extend-filesystems[1984]: Resized partition /dev/nvme0n1p9 Nov 8 00:05:08.893634 extend-filesystems[2037]: resize2fs 1.47.1 (20-May-2024) Nov 8 00:05:08.928916 kernel: EXT4-fs (nvme0n1p9): resizing filesystem from 553472 to 3587067 blocks Nov 8 00:05:08.955722 systemd-logind[1991]: Watching system buttons on /dev/input/event0 (Power Button) Nov 8 00:05:08.955769 systemd-logind[1991]: Watching system buttons on /dev/input/event1 (Sleep Button) Nov 8 00:05:08.960966 systemd-logind[1991]: New seat seat0. Nov 8 00:05:08.970610 systemd[1]: Started systemd-logind.service - User Login Management. Nov 8 00:05:09.032765 coreos-metadata[1981]: Nov 08 00:05:09.032 INFO Putting http://169.254.169.254/latest/api/token: Attempt #1 Nov 8 00:05:09.040528 coreos-metadata[1981]: Nov 08 00:05:09.038 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/instance-id: Attempt #1 Nov 8 00:05:09.041225 coreos-metadata[1981]: Nov 08 00:05:09.041 INFO Fetch successful Nov 8 00:05:09.041225 coreos-metadata[1981]: Nov 08 00:05:09.041 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/instance-type: Attempt #1 Nov 8 00:05:09.045408 coreos-metadata[1981]: Nov 08 00:05:09.045 INFO Fetch successful Nov 8 00:05:09.045408 coreos-metadata[1981]: Nov 08 00:05:09.045 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/local-ipv4: Attempt #1 Nov 8 00:05:09.051118 coreos-metadata[1981]: Nov 08 00:05:09.047 INFO Fetch successful Nov 8 00:05:09.051118 coreos-metadata[1981]: Nov 08 00:05:09.047 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/public-ipv4: Attempt #1 Nov 8 00:05:09.058849 coreos-metadata[1981]: Nov 08 00:05:09.055 INFO Fetch successful Nov 8 00:05:09.058849 coreos-metadata[1981]: Nov 08 00:05:09.055 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/ipv6: Attempt #1 Nov 8 00:05:09.058849 coreos-metadata[1981]: Nov 08 00:05:09.058 INFO Fetch failed with 404: resource not found Nov 8 00:05:09.058849 coreos-metadata[1981]: Nov 08 00:05:09.058 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/placement/availability-zone: Attempt #1 Nov 8 00:05:09.061676 coreos-metadata[1981]: Nov 08 00:05:09.059 INFO Fetch successful Nov 8 00:05:09.061676 coreos-metadata[1981]: Nov 08 00:05:09.061 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/placement/availability-zone-id: Attempt #1 Nov 8 00:05:09.065066 coreos-metadata[1981]: Nov 08 00:05:09.064 INFO Fetch successful Nov 8 00:05:09.065066 coreos-metadata[1981]: Nov 08 00:05:09.064 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/hostname: Attempt #1 Nov 8 00:05:09.065837 coreos-metadata[1981]: Nov 08 00:05:09.065 INFO Fetch successful Nov 8 00:05:09.065837 coreos-metadata[1981]: Nov 08 00:05:09.065 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/public-hostname: Attempt #1 Nov 8 00:05:09.065837 coreos-metadata[1981]: Nov 08 00:05:09.066 INFO Fetch successful Nov 8 00:05:09.065837 coreos-metadata[1981]: Nov 08 00:05:09.066 INFO Fetching http://169.254.169.254/2021-01-03/dynamic/instance-identity/document: Attempt #1 Nov 8 00:05:09.073073 coreos-metadata[1981]: Nov 08 00:05:09.072 INFO Fetch successful Nov 8 00:05:09.089202 kernel: EXT4-fs (nvme0n1p9): resized filesystem to 3587067 Nov 8 00:05:09.106979 extend-filesystems[2037]: Filesystem at /dev/nvme0n1p9 is mounted on /; on-line resizing required Nov 8 00:05:09.106979 extend-filesystems[2037]: old_desc_blocks = 1, new_desc_blocks = 2 Nov 8 00:05:09.106979 extend-filesystems[2037]: The filesystem on /dev/nvme0n1p9 is now 3587067 (4k) blocks long. Nov 8 00:05:09.117502 extend-filesystems[1984]: Resized filesystem in /dev/nvme0n1p9 Nov 8 00:05:09.124087 bash[2061]: Updated "/home/core/.ssh/authorized_keys" Nov 8 00:05:09.125184 kernel: BTRFS warning: duplicate device /dev/nvme0n1p3 devid 1 generation 37 scanned by (udev-worker) (1763) Nov 8 00:05:09.136825 systemd[1]: extend-filesystems.service: Deactivated successfully. Nov 8 00:05:09.139270 systemd[1]: Finished extend-filesystems.service - Extend Filesystems. Nov 8 00:05:09.143043 systemd[1]: Finished update-ssh-keys-after-ignition.service - Run update-ssh-keys once after Ignition. Nov 8 00:05:09.167194 systemd[1]: Created slice system-sshd.slice - Slice /system/sshd. Nov 8 00:05:09.183206 systemd[1]: Starting sshkeys.service... Nov 8 00:05:09.189260 systemd[1]: Finished coreos-metadata.service - Flatcar Metadata Agent. Nov 8 00:05:09.195462 systemd[1]: packet-phone-home.service - Report Success to Packet was skipped because no trigger condition checks were met. Nov 8 00:05:09.225059 systemd[1]: Created slice system-coreos\x2dmetadata\x2dsshkeys.slice - Slice /system/coreos-metadata-sshkeys. Nov 8 00:05:09.231776 systemd[1]: Starting coreos-metadata-sshkeys@core.service - Flatcar Metadata Agent (SSH Keys)... Nov 8 00:05:09.232815 dbus-daemon[1982]: [system] Successfully activated service 'org.freedesktop.hostname1' Nov 8 00:05:09.236313 systemd[1]: Started systemd-hostnamed.service - Hostname Service. Nov 8 00:05:09.243826 dbus-daemon[1982]: [system] Activating via systemd: service name='org.freedesktop.PolicyKit1' unit='polkit.service' requested by ':1.5' (uid=0 pid=2002 comm="/usr/lib/systemd/systemd-hostnamed" label="system_u:system_r:kernel_t:s0") Nov 8 00:05:09.254725 systemd[1]: Starting polkit.service - Authorization Manager... Nov 8 00:05:09.331120 polkitd[2091]: Started polkitd version 121 Nov 8 00:05:09.387978 polkitd[2091]: Loading rules from directory /etc/polkit-1/rules.d Nov 8 00:05:09.388111 polkitd[2091]: Loading rules from directory /usr/share/polkit-1/rules.d Nov 8 00:05:09.396050 polkitd[2091]: Finished loading, compiling and executing 2 rules Nov 8 00:05:09.400518 dbus-daemon[1982]: [system] Successfully activated service 'org.freedesktop.PolicyKit1' Nov 8 00:05:09.401370 systemd[1]: Started polkit.service - Authorization Manager. Nov 8 00:05:09.408690 polkitd[2091]: Acquired the name org.freedesktop.PolicyKit1 on the system bus Nov 8 00:05:09.466554 systemd-hostnamed[2002]: Hostname set to (transient) Nov 8 00:05:09.466715 systemd-resolved[1932]: System hostname changed to 'ip-172-31-23-87'. Nov 8 00:05:09.575172 coreos-metadata[2090]: Nov 08 00:05:09.574 INFO Putting http://169.254.169.254/latest/api/token: Attempt #1 Nov 8 00:05:09.578715 coreos-metadata[2090]: Nov 08 00:05:09.577 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/public-keys: Attempt #1 Nov 8 00:05:09.579279 coreos-metadata[2090]: Nov 08 00:05:09.579 INFO Fetch successful Nov 8 00:05:09.579279 coreos-metadata[2090]: Nov 08 00:05:09.579 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/public-keys/0/openssh-key: Attempt #1 Nov 8 00:05:09.583177 coreos-metadata[2090]: Nov 08 00:05:09.581 INFO Fetch successful Nov 8 00:05:09.589187 unknown[2090]: wrote ssh authorized keys file for user: core Nov 8 00:05:09.630196 containerd[2009]: time="2025-11-08T00:05:09.626919972Z" level=info msg="starting containerd" revision=174e0d1785eeda18dc2beba45e1d5a188771636b version=v1.7.21 Nov 8 00:05:09.661402 update-ssh-keys[2139]: Updated "/home/core/.ssh/authorized_keys" Nov 8 00:05:09.666257 systemd[1]: Finished coreos-metadata-sshkeys@core.service - Flatcar Metadata Agent (SSH Keys). Nov 8 00:05:09.678293 systemd[1]: Finished sshkeys.service. Nov 8 00:05:09.785989 ntpd[1986]: bind(24) AF_INET6 fe80::47a:f8ff:fe85:3f6d%2#123 flags 0x11 failed: Cannot assign requested address Nov 8 00:05:09.786741 ntpd[1986]: 8 Nov 00:05:09 ntpd[1986]: bind(24) AF_INET6 fe80::47a:f8ff:fe85:3f6d%2#123 flags 0x11 failed: Cannot assign requested address Nov 8 00:05:09.786741 ntpd[1986]: 8 Nov 00:05:09 ntpd[1986]: unable to create socket on eth0 (6) for fe80::47a:f8ff:fe85:3f6d%2#123 Nov 8 00:05:09.786741 ntpd[1986]: 8 Nov 00:05:09 ntpd[1986]: failed to init interface for address fe80::47a:f8ff:fe85:3f6d%2 Nov 8 00:05:09.786060 ntpd[1986]: unable to create socket on eth0 (6) for fe80::47a:f8ff:fe85:3f6d%2#123 Nov 8 00:05:09.786089 ntpd[1986]: failed to init interface for address fe80::47a:f8ff:fe85:3f6d%2 Nov 8 00:05:09.827975 containerd[2009]: time="2025-11-08T00:05:09.823057213Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.aufs\"..." type=io.containerd.snapshotter.v1 Nov 8 00:05:09.838533 containerd[2009]: time="2025-11-08T00:05:09.838352737Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.aufs\"..." error="aufs is not supported (modprobe aufs failed: exit status 1 \"modprobe: FATAL: Module aufs not found in directory /lib/modules/6.6.113-flatcar\\n\"): skip plugin" type=io.containerd.snapshotter.v1 Nov 8 00:05:09.838533 containerd[2009]: time="2025-11-08T00:05:09.838433005Z" level=info msg="loading plugin \"io.containerd.event.v1.exchange\"..." type=io.containerd.event.v1 Nov 8 00:05:09.838533 containerd[2009]: time="2025-11-08T00:05:09.838469797Z" level=info msg="loading plugin \"io.containerd.internal.v1.opt\"..." type=io.containerd.internal.v1 Nov 8 00:05:09.838834 containerd[2009]: time="2025-11-08T00:05:09.838772317Z" level=info msg="loading plugin \"io.containerd.warning.v1.deprecations\"..." type=io.containerd.warning.v1 Nov 8 00:05:09.838971 containerd[2009]: time="2025-11-08T00:05:09.838825681Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.blockfile\"..." type=io.containerd.snapshotter.v1 Nov 8 00:05:09.839070 containerd[2009]: time="2025-11-08T00:05:09.839008081Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.blockfile\"..." error="no scratch file generator: skip plugin" type=io.containerd.snapshotter.v1 Nov 8 00:05:09.839070 containerd[2009]: time="2025-11-08T00:05:09.839057209Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.btrfs\"..." type=io.containerd.snapshotter.v1 Nov 8 00:05:09.839497 containerd[2009]: time="2025-11-08T00:05:09.839433361Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.btrfs\"..." error="path /var/lib/containerd/io.containerd.snapshotter.v1.btrfs (ext4) must be a btrfs filesystem to be used with the btrfs snapshotter: skip plugin" type=io.containerd.snapshotter.v1 Nov 8 00:05:09.839573 containerd[2009]: time="2025-11-08T00:05:09.839491477Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.devmapper\"..." type=io.containerd.snapshotter.v1 Nov 8 00:05:09.839573 containerd[2009]: time="2025-11-08T00:05:09.839526025Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.devmapper\"..." error="devmapper not configured: skip plugin" type=io.containerd.snapshotter.v1 Nov 8 00:05:09.839573 containerd[2009]: time="2025-11-08T00:05:09.839557741Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.native\"..." type=io.containerd.snapshotter.v1 Nov 8 00:05:09.843175 containerd[2009]: time="2025-11-08T00:05:09.839738557Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.overlayfs\"..." type=io.containerd.snapshotter.v1 Nov 8 00:05:09.848690 containerd[2009]: time="2025-11-08T00:05:09.848598445Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.zfs\"..." type=io.containerd.snapshotter.v1 Nov 8 00:05:09.849528 containerd[2009]: time="2025-11-08T00:05:09.848960017Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.zfs\"..." error="path /var/lib/containerd/io.containerd.snapshotter.v1.zfs must be a zfs filesystem to be used with the zfs snapshotter: skip plugin" type=io.containerd.snapshotter.v1 Nov 8 00:05:09.849528 containerd[2009]: time="2025-11-08T00:05:09.849019261Z" level=info msg="loading plugin \"io.containerd.content.v1.content\"..." type=io.containerd.content.v1 Nov 8 00:05:09.849528 containerd[2009]: time="2025-11-08T00:05:09.849261457Z" level=info msg="loading plugin \"io.containerd.metadata.v1.bolt\"..." type=io.containerd.metadata.v1 Nov 8 00:05:09.849528 containerd[2009]: time="2025-11-08T00:05:09.849370285Z" level=info msg="metadata content store policy set" policy=shared Nov 8 00:05:09.862266 containerd[2009]: time="2025-11-08T00:05:09.857740861Z" level=info msg="loading plugin \"io.containerd.gc.v1.scheduler\"..." type=io.containerd.gc.v1 Nov 8 00:05:09.862266 containerd[2009]: time="2025-11-08T00:05:09.857857069Z" level=info msg="loading plugin \"io.containerd.differ.v1.walking\"..." type=io.containerd.differ.v1 Nov 8 00:05:09.862266 containerd[2009]: time="2025-11-08T00:05:09.857897053Z" level=info msg="loading plugin \"io.containerd.lease.v1.manager\"..." type=io.containerd.lease.v1 Nov 8 00:05:09.862266 containerd[2009]: time="2025-11-08T00:05:09.857932477Z" level=info msg="loading plugin \"io.containerd.streaming.v1.manager\"..." type=io.containerd.streaming.v1 Nov 8 00:05:09.862266 containerd[2009]: time="2025-11-08T00:05:09.857969329Z" level=info msg="loading plugin \"io.containerd.runtime.v1.linux\"..." type=io.containerd.runtime.v1 Nov 8 00:05:09.862266 containerd[2009]: time="2025-11-08T00:05:09.858317929Z" level=info msg="loading plugin \"io.containerd.monitor.v1.cgroups\"..." type=io.containerd.monitor.v1 Nov 8 00:05:09.862266 containerd[2009]: time="2025-11-08T00:05:09.859068817Z" level=info msg="loading plugin \"io.containerd.runtime.v2.task\"..." type=io.containerd.runtime.v2 Nov 8 00:05:09.862266 containerd[2009]: time="2025-11-08T00:05:09.859406245Z" level=info msg="loading plugin \"io.containerd.runtime.v2.shim\"..." type=io.containerd.runtime.v2 Nov 8 00:05:09.862266 containerd[2009]: time="2025-11-08T00:05:09.859450885Z" level=info msg="loading plugin \"io.containerd.sandbox.store.v1.local\"..." type=io.containerd.sandbox.store.v1 Nov 8 00:05:09.862266 containerd[2009]: time="2025-11-08T00:05:09.859481425Z" level=info msg="loading plugin \"io.containerd.sandbox.controller.v1.local\"..." type=io.containerd.sandbox.controller.v1 Nov 8 00:05:09.862266 containerd[2009]: time="2025-11-08T00:05:09.859530541Z" level=info msg="loading plugin \"io.containerd.service.v1.containers-service\"..." type=io.containerd.service.v1 Nov 8 00:05:09.862266 containerd[2009]: time="2025-11-08T00:05:09.859563445Z" level=info msg="loading plugin \"io.containerd.service.v1.content-service\"..." type=io.containerd.service.v1 Nov 8 00:05:09.862266 containerd[2009]: time="2025-11-08T00:05:09.859594537Z" level=info msg="loading plugin \"io.containerd.service.v1.diff-service\"..." type=io.containerd.service.v1 Nov 8 00:05:09.862266 containerd[2009]: time="2025-11-08T00:05:09.859627033Z" level=info msg="loading plugin \"io.containerd.service.v1.images-service\"..." type=io.containerd.service.v1 Nov 8 00:05:09.862966 containerd[2009]: time="2025-11-08T00:05:09.859663345Z" level=info msg="loading plugin \"io.containerd.service.v1.introspection-service\"..." type=io.containerd.service.v1 Nov 8 00:05:09.862966 containerd[2009]: time="2025-11-08T00:05:09.859694929Z" level=info msg="loading plugin \"io.containerd.service.v1.namespaces-service\"..." type=io.containerd.service.v1 Nov 8 00:05:09.862966 containerd[2009]: time="2025-11-08T00:05:09.859723477Z" level=info msg="loading plugin \"io.containerd.service.v1.snapshots-service\"..." type=io.containerd.service.v1 Nov 8 00:05:09.862966 containerd[2009]: time="2025-11-08T00:05:09.859751077Z" level=info msg="loading plugin \"io.containerd.service.v1.tasks-service\"..." type=io.containerd.service.v1 Nov 8 00:05:09.862966 containerd[2009]: time="2025-11-08T00:05:09.859792165Z" level=info msg="loading plugin \"io.containerd.grpc.v1.containers\"..." type=io.containerd.grpc.v1 Nov 8 00:05:09.862966 containerd[2009]: time="2025-11-08T00:05:09.859825681Z" level=info msg="loading plugin \"io.containerd.grpc.v1.content\"..." type=io.containerd.grpc.v1 Nov 8 00:05:09.862966 containerd[2009]: time="2025-11-08T00:05:09.859855621Z" level=info msg="loading plugin \"io.containerd.grpc.v1.diff\"..." type=io.containerd.grpc.v1 Nov 8 00:05:09.862966 containerd[2009]: time="2025-11-08T00:05:09.859887721Z" level=info msg="loading plugin \"io.containerd.grpc.v1.events\"..." type=io.containerd.grpc.v1 Nov 8 00:05:09.862966 containerd[2009]: time="2025-11-08T00:05:09.859918081Z" level=info msg="loading plugin \"io.containerd.grpc.v1.images\"..." type=io.containerd.grpc.v1 Nov 8 00:05:09.862966 containerd[2009]: time="2025-11-08T00:05:09.859949053Z" level=info msg="loading plugin \"io.containerd.grpc.v1.introspection\"..." type=io.containerd.grpc.v1 Nov 8 00:05:09.862966 containerd[2009]: time="2025-11-08T00:05:09.859979737Z" level=info msg="loading plugin \"io.containerd.grpc.v1.leases\"..." type=io.containerd.grpc.v1 Nov 8 00:05:09.862966 containerd[2009]: time="2025-11-08T00:05:09.860010313Z" level=info msg="loading plugin \"io.containerd.grpc.v1.namespaces\"..." type=io.containerd.grpc.v1 Nov 8 00:05:09.862966 containerd[2009]: time="2025-11-08T00:05:09.860040505Z" level=info msg="loading plugin \"io.containerd.grpc.v1.sandbox-controllers\"..." type=io.containerd.grpc.v1 Nov 8 00:05:09.862966 containerd[2009]: time="2025-11-08T00:05:09.860090857Z" level=info msg="loading plugin \"io.containerd.grpc.v1.sandboxes\"..." type=io.containerd.grpc.v1 Nov 8 00:05:09.863658 containerd[2009]: time="2025-11-08T00:05:09.860120749Z" level=info msg="loading plugin \"io.containerd.grpc.v1.snapshots\"..." type=io.containerd.grpc.v1 Nov 8 00:05:09.863658 containerd[2009]: time="2025-11-08T00:05:09.860190397Z" level=info msg="loading plugin \"io.containerd.grpc.v1.streaming\"..." type=io.containerd.grpc.v1 Nov 8 00:05:09.863658 containerd[2009]: time="2025-11-08T00:05:09.860233393Z" level=info msg="loading plugin \"io.containerd.grpc.v1.tasks\"..." type=io.containerd.grpc.v1 Nov 8 00:05:09.863658 containerd[2009]: time="2025-11-08T00:05:09.860284285Z" level=info msg="loading plugin \"io.containerd.transfer.v1.local\"..." type=io.containerd.transfer.v1 Nov 8 00:05:09.863658 containerd[2009]: time="2025-11-08T00:05:09.860339737Z" level=info msg="loading plugin \"io.containerd.grpc.v1.transfer\"..." type=io.containerd.grpc.v1 Nov 8 00:05:09.863658 containerd[2009]: time="2025-11-08T00:05:09.860371537Z" level=info msg="loading plugin \"io.containerd.grpc.v1.version\"..." type=io.containerd.grpc.v1 Nov 8 00:05:09.863658 containerd[2009]: time="2025-11-08T00:05:09.860398909Z" level=info msg="loading plugin \"io.containerd.internal.v1.restart\"..." type=io.containerd.internal.v1 Nov 8 00:05:09.863658 containerd[2009]: time="2025-11-08T00:05:09.860634925Z" level=info msg="loading plugin \"io.containerd.tracing.processor.v1.otlp\"..." type=io.containerd.tracing.processor.v1 Nov 8 00:05:09.863658 containerd[2009]: time="2025-11-08T00:05:09.860673829Z" level=info msg="skip loading plugin \"io.containerd.tracing.processor.v1.otlp\"..." error="skip plugin: tracing endpoint not configured" type=io.containerd.tracing.processor.v1 Nov 8 00:05:09.863658 containerd[2009]: time="2025-11-08T00:05:09.860700793Z" level=info msg="loading plugin \"io.containerd.internal.v1.tracing\"..." type=io.containerd.internal.v1 Nov 8 00:05:09.863658 containerd[2009]: time="2025-11-08T00:05:09.860730973Z" level=info msg="skip loading plugin \"io.containerd.internal.v1.tracing\"..." error="skip plugin: tracing endpoint not configured" type=io.containerd.internal.v1 Nov 8 00:05:09.863658 containerd[2009]: time="2025-11-08T00:05:09.860759041Z" level=info msg="loading plugin \"io.containerd.grpc.v1.healthcheck\"..." type=io.containerd.grpc.v1 Nov 8 00:05:09.863658 containerd[2009]: time="2025-11-08T00:05:09.860788741Z" level=info msg="loading plugin \"io.containerd.nri.v1.nri\"..." type=io.containerd.nri.v1 Nov 8 00:05:09.863658 containerd[2009]: time="2025-11-08T00:05:09.860816077Z" level=info msg="NRI interface is disabled by configuration." Nov 8 00:05:09.866240 containerd[2009]: time="2025-11-08T00:05:09.860844565Z" level=info msg="loading plugin \"io.containerd.grpc.v1.cri\"..." type=io.containerd.grpc.v1 Nov 8 00:05:09.871297 containerd[2009]: time="2025-11-08T00:05:09.870177793Z" level=info msg="Start cri plugin with config {PluginConfig:{ContainerdConfig:{Snapshotter:overlayfs DefaultRuntimeName:runc DefaultRuntime:{Type: Path: Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:map[] PrivilegedWithoutHostDevices:false PrivilegedWithoutHostDevicesAllDevicesAllowed:false BaseRuntimeSpec: NetworkPluginConfDir: NetworkPluginMaxConfNum:0 Snapshotter: SandboxMode:} UntrustedWorkloadRuntime:{Type: Path: Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:map[] PrivilegedWithoutHostDevices:false PrivilegedWithoutHostDevicesAllDevicesAllowed:false BaseRuntimeSpec: NetworkPluginConfDir: NetworkPluginMaxConfNum:0 Snapshotter: SandboxMode:} Runtimes:map[runc:{Type:io.containerd.runc.v2 Path: Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:map[SystemdCgroup:true] PrivilegedWithoutHostDevices:false PrivilegedWithoutHostDevicesAllDevicesAllowed:false BaseRuntimeSpec: NetworkPluginConfDir: NetworkPluginMaxConfNum:0 Snapshotter: SandboxMode:podsandbox}] NoPivot:false DisableSnapshotAnnotations:true DiscardUnpackedLayers:false IgnoreBlockIONotEnabledErrors:false IgnoreRdtNotEnabledErrors:false} CniConfig:{NetworkPluginBinDir:/opt/cni/bin NetworkPluginConfDir:/etc/cni/net.d NetworkPluginMaxConfNum:1 NetworkPluginSetupSerially:false NetworkPluginConfTemplate: IPPreference:} Registry:{ConfigPath: Mirrors:map[] Configs:map[] Auths:map[] Headers:map[]} ImageDecryption:{KeyModel:node} DisableTCPService:true StreamServerAddress:127.0.0.1 StreamServerPort:0 StreamIdleTimeout:4h0m0s EnableSelinux:true SelinuxCategoryRange:1024 SandboxImage:registry.k8s.io/pause:3.8 StatsCollectPeriod:10 SystemdCgroup:false EnableTLSStreaming:false X509KeyPairStreaming:{TLSCertFile: TLSKeyFile:} MaxContainerLogLineSize:16384 DisableCgroup:false DisableApparmor:false RestrictOOMScoreAdj:false MaxConcurrentDownloads:3 DisableProcMount:false UnsetSeccompProfile: TolerateMissingHugetlbController:true DisableHugetlbController:true DeviceOwnershipFromSecurityContext:false IgnoreImageDefinedVolumes:false NetNSMountsUnderStateDir:false EnableUnprivilegedPorts:false EnableUnprivilegedICMP:false EnableCDI:false CDISpecDirs:[/etc/cdi /var/run/cdi] ImagePullProgressTimeout:5m0s DrainExecSyncIOTimeout:0s ImagePullWithSyncFs:false IgnoreDeprecationWarnings:[]} ContainerdRootDir:/var/lib/containerd ContainerdEndpoint:/run/containerd/containerd.sock RootDir:/var/lib/containerd/io.containerd.grpc.v1.cri StateDir:/run/containerd/io.containerd.grpc.v1.cri}" Nov 8 00:05:09.871297 containerd[2009]: time="2025-11-08T00:05:09.870315913Z" level=info msg="Connect containerd service" Nov 8 00:05:09.871297 containerd[2009]: time="2025-11-08T00:05:09.870381445Z" level=info msg="using legacy CRI server" Nov 8 00:05:09.871297 containerd[2009]: time="2025-11-08T00:05:09.870399409Z" level=info msg="using experimental NRI integration - disable nri plugin to prevent this" Nov 8 00:05:09.871297 containerd[2009]: time="2025-11-08T00:05:09.870552733Z" level=info msg="Get image filesystem path \"/var/lib/containerd/io.containerd.snapshotter.v1.overlayfs\"" Nov 8 00:05:09.878308 containerd[2009]: time="2025-11-08T00:05:09.875921845Z" level=error msg="failed to load cni during init, please check CRI plugin status before setting up network for pods" error="cni config load failed: no network config found in /etc/cni/net.d: cni plugin not initialized: failed to load cni config" Nov 8 00:05:09.878308 containerd[2009]: time="2025-11-08T00:05:09.876283621Z" level=info msg="Start subscribing containerd event" Nov 8 00:05:09.878308 containerd[2009]: time="2025-11-08T00:05:09.876367477Z" level=info msg="Start recovering state" Nov 8 00:05:09.878308 containerd[2009]: time="2025-11-08T00:05:09.876496933Z" level=info msg="Start event monitor" Nov 8 00:05:09.878308 containerd[2009]: time="2025-11-08T00:05:09.876523705Z" level=info msg="Start snapshots syncer" Nov 8 00:05:09.878308 containerd[2009]: time="2025-11-08T00:05:09.876547897Z" level=info msg="Start cni network conf syncer for default" Nov 8 00:05:09.878308 containerd[2009]: time="2025-11-08T00:05:09.876567193Z" level=info msg="Start streaming server" Nov 8 00:05:09.878308 containerd[2009]: time="2025-11-08T00:05:09.876963457Z" level=info msg=serving... address=/run/containerd/containerd.sock.ttrpc Nov 8 00:05:09.878308 containerd[2009]: time="2025-11-08T00:05:09.877123381Z" level=info msg=serving... address=/run/containerd/containerd.sock Nov 8 00:05:09.884543 containerd[2009]: time="2025-11-08T00:05:09.883740865Z" level=info msg="containerd successfully booted in 0.263360s" Nov 8 00:05:09.883895 systemd[1]: Started containerd.service - containerd container runtime. Nov 8 00:05:09.901384 systemd-networkd[1929]: eth0: Gained IPv6LL Nov 8 00:05:09.915096 systemd[1]: Finished systemd-networkd-wait-online.service - Wait for Network to be Configured. Nov 8 00:05:09.938231 systemd[1]: Reached target network-online.target - Network is Online. Nov 8 00:05:09.952834 systemd[1]: Started amazon-ssm-agent.service - amazon-ssm-agent. Nov 8 00:05:09.964558 systemd[1]: Starting kubelet.service - kubelet: The Kubernetes Node Agent... Nov 8 00:05:09.975732 systemd[1]: Starting nvidia.service - NVIDIA Configure Service... Nov 8 00:05:10.143275 systemd[1]: Finished nvidia.service - NVIDIA Configure Service. Nov 8 00:05:10.166405 locksmithd[2029]: locksmithd starting currentOperation="UPDATE_STATUS_IDLE" strategy="reboot" Nov 8 00:05:10.208926 sshd_keygen[2022]: ssh-keygen: generating new host keys: RSA ECDSA ED25519 Nov 8 00:05:10.214568 amazon-ssm-agent[2175]: Initializing new seelog logger Nov 8 00:05:10.218219 amazon-ssm-agent[2175]: New Seelog Logger Creation Complete Nov 8 00:05:10.218219 amazon-ssm-agent[2175]: 2025/11/08 00:05:10 Found config file at /etc/amazon/ssm/amazon-ssm-agent.json. Nov 8 00:05:10.218219 amazon-ssm-agent[2175]: Applying config override from /etc/amazon/ssm/amazon-ssm-agent.json. Nov 8 00:05:10.218219 amazon-ssm-agent[2175]: 2025/11/08 00:05:10 processing appconfig overrides Nov 8 00:05:10.219676 amazon-ssm-agent[2175]: 2025/11/08 00:05:10 Found config file at /etc/amazon/ssm/amazon-ssm-agent.json. Nov 8 00:05:10.219844 amazon-ssm-agent[2175]: Applying config override from /etc/amazon/ssm/amazon-ssm-agent.json. Nov 8 00:05:10.220074 amazon-ssm-agent[2175]: 2025/11/08 00:05:10 processing appconfig overrides Nov 8 00:05:10.220645 amazon-ssm-agent[2175]: 2025-11-08 00:05:10 INFO Proxy environment variables: Nov 8 00:05:10.221028 amazon-ssm-agent[2175]: 2025/11/08 00:05:10 Found config file at /etc/amazon/ssm/amazon-ssm-agent.json. Nov 8 00:05:10.221169 amazon-ssm-agent[2175]: Applying config override from /etc/amazon/ssm/amazon-ssm-agent.json. Nov 8 00:05:10.221395 amazon-ssm-agent[2175]: 2025/11/08 00:05:10 processing appconfig overrides Nov 8 00:05:10.230192 amazon-ssm-agent[2175]: 2025/11/08 00:05:10 Found config file at /etc/amazon/ssm/amazon-ssm-agent.json. Nov 8 00:05:10.230192 amazon-ssm-agent[2175]: Applying config override from /etc/amazon/ssm/amazon-ssm-agent.json. Nov 8 00:05:10.230192 amazon-ssm-agent[2175]: 2025/11/08 00:05:10 processing appconfig overrides Nov 8 00:05:10.294833 systemd[1]: Finished sshd-keygen.service - Generate sshd host keys. Nov 8 00:05:10.313680 systemd[1]: Starting issuegen.service - Generate /run/issue... Nov 8 00:05:10.321860 amazon-ssm-agent[2175]: 2025-11-08 00:05:10 INFO https_proxy: Nov 8 00:05:10.327014 systemd[1]: Started sshd@0-172.31.23.87:22-139.178.89.65:40720.service - OpenSSH per-connection server daemon (139.178.89.65:40720). Nov 8 00:05:10.370045 systemd[1]: issuegen.service: Deactivated successfully. Nov 8 00:05:10.371629 systemd[1]: Finished issuegen.service - Generate /run/issue. Nov 8 00:05:10.385964 systemd[1]: Starting systemd-user-sessions.service - Permit User Sessions... Nov 8 00:05:10.426331 amazon-ssm-agent[2175]: 2025-11-08 00:05:10 INFO http_proxy: Nov 8 00:05:10.455514 systemd[1]: Finished systemd-user-sessions.service - Permit User Sessions. Nov 8 00:05:10.470085 systemd[1]: Started getty@tty1.service - Getty on tty1. Nov 8 00:05:10.484897 systemd[1]: Started serial-getty@ttyS0.service - Serial Getty on ttyS0. Nov 8 00:05:10.488601 systemd[1]: Reached target getty.target - Login Prompts. Nov 8 00:05:10.524631 amazon-ssm-agent[2175]: 2025-11-08 00:05:10 INFO no_proxy: Nov 8 00:05:10.623796 amazon-ssm-agent[2175]: 2025-11-08 00:05:10 INFO Checking if agent identity type OnPrem can be assumed Nov 8 00:05:10.628630 sshd[2211]: Accepted publickey for core from 139.178.89.65 port 40720 ssh2: RSA SHA256:tnEXpnDY8gLTej7GJ+T99WI4otIwvlI9IcMNDF42aqw Nov 8 00:05:10.634063 sshd[2211]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 8 00:05:10.662031 systemd[1]: Created slice user-500.slice - User Slice of UID 500. Nov 8 00:05:10.676434 systemd[1]: Starting user-runtime-dir@500.service - User Runtime Directory /run/user/500... Nov 8 00:05:10.691373 systemd-logind[1991]: New session 1 of user core. Nov 8 00:05:10.722402 amazon-ssm-agent[2175]: 2025-11-08 00:05:10 INFO Checking if agent identity type EC2 can be assumed Nov 8 00:05:10.733268 systemd[1]: Finished user-runtime-dir@500.service - User Runtime Directory /run/user/500. Nov 8 00:05:10.751743 systemd[1]: Starting user@500.service - User Manager for UID 500... Nov 8 00:05:10.768672 (systemd)[2223]: pam_unix(systemd-user:session): session opened for user core(uid=500) by (uid=0) Nov 8 00:05:10.834930 amazon-ssm-agent[2175]: 2025-11-08 00:05:10 INFO Agent will take identity from EC2 Nov 8 00:05:10.933106 amazon-ssm-agent[2175]: 2025-11-08 00:05:10 INFO [amazon-ssm-agent] using named pipe channel for IPC Nov 8 00:05:10.938761 amazon-ssm-agent[2175]: 2025-11-08 00:05:10 INFO [amazon-ssm-agent] using named pipe channel for IPC Nov 8 00:05:10.938761 amazon-ssm-agent[2175]: 2025-11-08 00:05:10 INFO [amazon-ssm-agent] using named pipe channel for IPC Nov 8 00:05:10.938761 amazon-ssm-agent[2175]: 2025-11-08 00:05:10 INFO [amazon-ssm-agent] amazon-ssm-agent - v3.2.0.0 Nov 8 00:05:10.939244 amazon-ssm-agent[2175]: 2025-11-08 00:05:10 INFO [amazon-ssm-agent] OS: linux, Arch: arm64 Nov 8 00:05:10.939244 amazon-ssm-agent[2175]: 2025-11-08 00:05:10 INFO [amazon-ssm-agent] Starting Core Agent Nov 8 00:05:10.939244 amazon-ssm-agent[2175]: 2025-11-08 00:05:10 INFO [amazon-ssm-agent] registrar detected. Attempting registration Nov 8 00:05:10.939244 amazon-ssm-agent[2175]: 2025-11-08 00:05:10 INFO [Registrar] Starting registrar module Nov 8 00:05:10.939244 amazon-ssm-agent[2175]: 2025-11-08 00:05:10 INFO [EC2Identity] no registration info found for ec2 instance, attempting registration Nov 8 00:05:10.939244 amazon-ssm-agent[2175]: 2025-11-08 00:05:10 INFO [EC2Identity] EC2 registration was successful. Nov 8 00:05:10.939244 amazon-ssm-agent[2175]: 2025-11-08 00:05:10 INFO [CredentialRefresher] credentialRefresher has started Nov 8 00:05:10.939244 amazon-ssm-agent[2175]: 2025-11-08 00:05:10 INFO [CredentialRefresher] Starting credentials refresher loop Nov 8 00:05:10.939244 amazon-ssm-agent[2175]: 2025-11-08 00:05:10 INFO EC2RoleProvider Successfully connected with instance profile role credentials Nov 8 00:05:11.013364 systemd[2223]: Queued start job for default target default.target. Nov 8 00:05:11.019679 systemd[2223]: Created slice app.slice - User Application Slice. Nov 8 00:05:11.022247 tar[2006]: linux-arm64/README.md Nov 8 00:05:11.019750 systemd[2223]: Reached target paths.target - Paths. Nov 8 00:05:11.019785 systemd[2223]: Reached target timers.target - Timers. Nov 8 00:05:11.026405 systemd[2223]: Starting dbus.socket - D-Bus User Message Bus Socket... Nov 8 00:05:11.032443 amazon-ssm-agent[2175]: 2025-11-08 00:05:10 INFO [CredentialRefresher] Next credential rotation will be in 31.4749883054 minutes Nov 8 00:05:11.052284 systemd[1]: Finished prepare-helm.service - Unpack helm to /opt/bin. Nov 8 00:05:11.058089 systemd[2223]: Listening on dbus.socket - D-Bus User Message Bus Socket. Nov 8 00:05:11.058367 systemd[2223]: Reached target sockets.target - Sockets. Nov 8 00:05:11.058401 systemd[2223]: Reached target basic.target - Basic System. Nov 8 00:05:11.058483 systemd[2223]: Reached target default.target - Main User Target. Nov 8 00:05:11.058546 systemd[2223]: Startup finished in 276ms. Nov 8 00:05:11.059802 systemd[1]: Started user@500.service - User Manager for UID 500. Nov 8 00:05:11.076501 systemd[1]: Started session-1.scope - Session 1 of User core. Nov 8 00:05:11.237701 systemd[1]: Started sshd@1-172.31.23.87:22-139.178.89.65:40728.service - OpenSSH per-connection server daemon (139.178.89.65:40728). Nov 8 00:05:11.436079 sshd[2238]: Accepted publickey for core from 139.178.89.65 port 40728 ssh2: RSA SHA256:tnEXpnDY8gLTej7GJ+T99WI4otIwvlI9IcMNDF42aqw Nov 8 00:05:11.439456 sshd[2238]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 8 00:05:11.453266 systemd-logind[1991]: New session 2 of user core. Nov 8 00:05:11.464495 systemd[1]: Started session-2.scope - Session 2 of User core. Nov 8 00:05:11.599416 sshd[2238]: pam_unix(sshd:session): session closed for user core Nov 8 00:05:11.606856 systemd[1]: sshd@1-172.31.23.87:22-139.178.89.65:40728.service: Deactivated successfully. Nov 8 00:05:11.610030 systemd[1]: session-2.scope: Deactivated successfully. Nov 8 00:05:11.614274 systemd-logind[1991]: Session 2 logged out. Waiting for processes to exit. Nov 8 00:05:11.617066 systemd-logind[1991]: Removed session 2. Nov 8 00:05:11.635355 systemd[1]: Started sshd@2-172.31.23.87:22-139.178.89.65:40744.service - OpenSSH per-connection server daemon (139.178.89.65:40744). Nov 8 00:05:11.824512 sshd[2245]: Accepted publickey for core from 139.178.89.65 port 40744 ssh2: RSA SHA256:tnEXpnDY8gLTej7GJ+T99WI4otIwvlI9IcMNDF42aqw Nov 8 00:05:11.827833 sshd[2245]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 8 00:05:11.836903 systemd-logind[1991]: New session 3 of user core. Nov 8 00:05:11.850469 systemd[1]: Started session-3.scope - Session 3 of User core. Nov 8 00:05:11.992454 amazon-ssm-agent[2175]: 2025-11-08 00:05:11 INFO [amazon-ssm-agent] [LongRunningWorkerContainer] [WorkerProvider] Worker ssm-agent-worker is not running, starting worker process Nov 8 00:05:11.993353 sshd[2245]: pam_unix(sshd:session): session closed for user core Nov 8 00:05:12.003755 systemd[1]: sshd@2-172.31.23.87:22-139.178.89.65:40744.service: Deactivated successfully. Nov 8 00:05:12.010198 systemd[1]: session-3.scope: Deactivated successfully. Nov 8 00:05:12.016247 systemd-logind[1991]: Session 3 logged out. Waiting for processes to exit. Nov 8 00:05:12.019327 systemd-logind[1991]: Removed session 3. Nov 8 00:05:12.096598 amazon-ssm-agent[2175]: 2025-11-08 00:05:11 INFO [amazon-ssm-agent] [LongRunningWorkerContainer] [WorkerProvider] Worker ssm-agent-worker (pid:2250) started Nov 8 00:05:12.198223 amazon-ssm-agent[2175]: 2025-11-08 00:05:11 INFO [amazon-ssm-agent] [LongRunningWorkerContainer] Monitor long running worker health every 60 seconds Nov 8 00:05:12.547493 systemd[1]: Started kubelet.service - kubelet: The Kubernetes Node Agent. Nov 8 00:05:12.552931 systemd[1]: Reached target multi-user.target - Multi-User System. Nov 8 00:05:12.559072 systemd[1]: Startup finished in 1.244s (kernel) + 8.933s (initrd) + 9.854s (userspace) = 20.032s. Nov 8 00:05:12.561812 (kubelet)[2266]: kubelet.service: Referenced but unset environment variable evaluates to an empty string: KUBELET_EXTRA_ARGS, KUBELET_KUBEADM_ARGS Nov 8 00:05:12.786028 ntpd[1986]: Listen normally on 7 eth0 [fe80::47a:f8ff:fe85:3f6d%2]:123 Nov 8 00:05:12.786548 ntpd[1986]: 8 Nov 00:05:12 ntpd[1986]: Listen normally on 7 eth0 [fe80::47a:f8ff:fe85:3f6d%2]:123 Nov 8 00:05:13.720628 kubelet[2266]: E1108 00:05:13.720519 2266 run.go:72] "command failed" err="failed to load kubelet config file, path: /var/lib/kubelet/config.yaml, error: failed to load Kubelet config file /var/lib/kubelet/config.yaml, error failed to read kubelet config file \"/var/lib/kubelet/config.yaml\", error: open /var/lib/kubelet/config.yaml: no such file or directory" Nov 8 00:05:13.725565 systemd[1]: kubelet.service: Main process exited, code=exited, status=1/FAILURE Nov 8 00:05:13.725975 systemd[1]: kubelet.service: Failed with result 'exit-code'. Nov 8 00:05:13.728328 systemd[1]: kubelet.service: Consumed 1.418s CPU time. Nov 8 00:05:15.925481 systemd-resolved[1932]: Clock change detected. Flushing caches. Nov 8 00:05:22.171850 systemd[1]: Started sshd@3-172.31.23.87:22-139.178.89.65:37608.service - OpenSSH per-connection server daemon (139.178.89.65:37608). Nov 8 00:05:22.360577 sshd[2279]: Accepted publickey for core from 139.178.89.65 port 37608 ssh2: RSA SHA256:tnEXpnDY8gLTej7GJ+T99WI4otIwvlI9IcMNDF42aqw Nov 8 00:05:22.363495 sshd[2279]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 8 00:05:22.373693 systemd-logind[1991]: New session 4 of user core. Nov 8 00:05:22.383616 systemd[1]: Started session-4.scope - Session 4 of User core. Nov 8 00:05:22.517537 sshd[2279]: pam_unix(sshd:session): session closed for user core Nov 8 00:05:22.523037 systemd-logind[1991]: Session 4 logged out. Waiting for processes to exit. Nov 8 00:05:22.524173 systemd[1]: sshd@3-172.31.23.87:22-139.178.89.65:37608.service: Deactivated successfully. Nov 8 00:05:22.528060 systemd[1]: session-4.scope: Deactivated successfully. Nov 8 00:05:22.532335 systemd-logind[1991]: Removed session 4. Nov 8 00:05:22.562772 systemd[1]: Started sshd@4-172.31.23.87:22-139.178.89.65:37622.service - OpenSSH per-connection server daemon (139.178.89.65:37622). Nov 8 00:05:22.737961 sshd[2286]: Accepted publickey for core from 139.178.89.65 port 37622 ssh2: RSA SHA256:tnEXpnDY8gLTej7GJ+T99WI4otIwvlI9IcMNDF42aqw Nov 8 00:05:22.741098 sshd[2286]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 8 00:05:22.751602 systemd-logind[1991]: New session 5 of user core. Nov 8 00:05:22.758631 systemd[1]: Started session-5.scope - Session 5 of User core. Nov 8 00:05:22.882032 sshd[2286]: pam_unix(sshd:session): session closed for user core Nov 8 00:05:22.887628 systemd[1]: session-5.scope: Deactivated successfully. Nov 8 00:05:22.888992 systemd[1]: sshd@4-172.31.23.87:22-139.178.89.65:37622.service: Deactivated successfully. Nov 8 00:05:22.894980 systemd-logind[1991]: Session 5 logged out. Waiting for processes to exit. Nov 8 00:05:22.897223 systemd-logind[1991]: Removed session 5. Nov 8 00:05:22.922820 systemd[1]: Started sshd@5-172.31.23.87:22-139.178.89.65:37624.service - OpenSSH per-connection server daemon (139.178.89.65:37624). Nov 8 00:05:23.108002 sshd[2293]: Accepted publickey for core from 139.178.89.65 port 37624 ssh2: RSA SHA256:tnEXpnDY8gLTej7GJ+T99WI4otIwvlI9IcMNDF42aqw Nov 8 00:05:23.110984 sshd[2293]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 8 00:05:23.121132 systemd-logind[1991]: New session 6 of user core. Nov 8 00:05:23.132638 systemd[1]: Started session-6.scope - Session 6 of User core. Nov 8 00:05:23.265573 sshd[2293]: pam_unix(sshd:session): session closed for user core Nov 8 00:05:23.273076 systemd[1]: sshd@5-172.31.23.87:22-139.178.89.65:37624.service: Deactivated successfully. Nov 8 00:05:23.277026 systemd[1]: session-6.scope: Deactivated successfully. Nov 8 00:05:23.278536 systemd-logind[1991]: Session 6 logged out. Waiting for processes to exit. Nov 8 00:05:23.280748 systemd-logind[1991]: Removed session 6. Nov 8 00:05:23.301881 systemd[1]: Started sshd@6-172.31.23.87:22-139.178.89.65:37628.service - OpenSSH per-connection server daemon (139.178.89.65:37628). Nov 8 00:05:23.489935 sshd[2300]: Accepted publickey for core from 139.178.89.65 port 37628 ssh2: RSA SHA256:tnEXpnDY8gLTej7GJ+T99WI4otIwvlI9IcMNDF42aqw Nov 8 00:05:23.492857 sshd[2300]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 8 00:05:23.501874 systemd-logind[1991]: New session 7 of user core. Nov 8 00:05:23.511650 systemd[1]: Started session-7.scope - Session 7 of User core. Nov 8 00:05:23.657991 sudo[2303]: core : PWD=/home/core ; USER=root ; COMMAND=/usr/sbin/setenforce 1 Nov 8 00:05:23.658823 sudo[2303]: pam_unix(sudo:session): session opened for user root(uid=0) by core(uid=500) Nov 8 00:05:23.676708 sudo[2303]: pam_unix(sudo:session): session closed for user root Nov 8 00:05:23.702096 sshd[2300]: pam_unix(sshd:session): session closed for user core Nov 8 00:05:23.710682 systemd[1]: sshd@6-172.31.23.87:22-139.178.89.65:37628.service: Deactivated successfully. Nov 8 00:05:23.714459 systemd[1]: session-7.scope: Deactivated successfully. Nov 8 00:05:23.716879 systemd-logind[1991]: Session 7 logged out. Waiting for processes to exit. Nov 8 00:05:23.719399 systemd-logind[1991]: Removed session 7. Nov 8 00:05:23.743881 systemd[1]: Started sshd@7-172.31.23.87:22-139.178.89.65:37636.service - OpenSSH per-connection server daemon (139.178.89.65:37636). Nov 8 00:05:23.897068 systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 1. Nov 8 00:05:23.909686 systemd[1]: Starting kubelet.service - kubelet: The Kubernetes Node Agent... Nov 8 00:05:23.933601 sshd[2308]: Accepted publickey for core from 139.178.89.65 port 37636 ssh2: RSA SHA256:tnEXpnDY8gLTej7GJ+T99WI4otIwvlI9IcMNDF42aqw Nov 8 00:05:23.935874 sshd[2308]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 8 00:05:23.947500 systemd-logind[1991]: New session 8 of user core. Nov 8 00:05:23.957808 systemd[1]: Started session-8.scope - Session 8 of User core. Nov 8 00:05:24.072643 sudo[2315]: core : PWD=/home/core ; USER=root ; COMMAND=/usr/bin/rm -rf /etc/audit/rules.d/80-selinux.rules /etc/audit/rules.d/99-default.rules Nov 8 00:05:24.073684 sudo[2315]: pam_unix(sudo:session): session opened for user root(uid=0) by core(uid=500) Nov 8 00:05:24.085765 sudo[2315]: pam_unix(sudo:session): session closed for user root Nov 8 00:05:24.099225 sudo[2314]: core : PWD=/home/core ; USER=root ; COMMAND=/usr/bin/systemctl restart audit-rules Nov 8 00:05:24.100207 sudo[2314]: pam_unix(sudo:session): session opened for user root(uid=0) by core(uid=500) Nov 8 00:05:24.141101 systemd[1]: Stopping audit-rules.service - Load Security Auditing Rules... Nov 8 00:05:24.156764 auditctl[2318]: No rules Nov 8 00:05:24.159440 systemd[1]: audit-rules.service: Deactivated successfully. Nov 8 00:05:24.159967 systemd[1]: Stopped audit-rules.service - Load Security Auditing Rules. Nov 8 00:05:24.179757 systemd[1]: Starting audit-rules.service - Load Security Auditing Rules... Nov 8 00:05:24.255693 augenrules[2336]: No rules Nov 8 00:05:24.260237 systemd[1]: Finished audit-rules.service - Load Security Auditing Rules. Nov 8 00:05:24.265083 sudo[2314]: pam_unix(sudo:session): session closed for user root Nov 8 00:05:24.291596 sshd[2308]: pam_unix(sshd:session): session closed for user core Nov 8 00:05:24.299489 systemd[1]: sshd@7-172.31.23.87:22-139.178.89.65:37636.service: Deactivated successfully. Nov 8 00:05:24.308460 systemd[1]: session-8.scope: Deactivated successfully. Nov 8 00:05:24.310635 systemd-logind[1991]: Session 8 logged out. Waiting for processes to exit. Nov 8 00:05:24.328643 systemd[1]: Started kubelet.service - kubelet: The Kubernetes Node Agent. Nov 8 00:05:24.340028 systemd[1]: Started sshd@8-172.31.23.87:22-139.178.89.65:37646.service - OpenSSH per-connection server daemon (139.178.89.65:37646). Nov 8 00:05:24.342538 (kubelet)[2348]: kubelet.service: Referenced but unset environment variable evaluates to an empty string: KUBELET_EXTRA_ARGS, KUBELET_KUBEADM_ARGS Nov 8 00:05:24.344810 systemd-logind[1991]: Removed session 8. Nov 8 00:05:24.434816 kubelet[2348]: E1108 00:05:24.433789 2348 run.go:72] "command failed" err="failed to load kubelet config file, path: /var/lib/kubelet/config.yaml, error: failed to load Kubelet config file /var/lib/kubelet/config.yaml, error failed to read kubelet config file \"/var/lib/kubelet/config.yaml\", error: open /var/lib/kubelet/config.yaml: no such file or directory" Nov 8 00:05:24.442548 systemd[1]: kubelet.service: Main process exited, code=exited, status=1/FAILURE Nov 8 00:05:24.442939 systemd[1]: kubelet.service: Failed with result 'exit-code'. Nov 8 00:05:24.538730 sshd[2350]: Accepted publickey for core from 139.178.89.65 port 37646 ssh2: RSA SHA256:tnEXpnDY8gLTej7GJ+T99WI4otIwvlI9IcMNDF42aqw Nov 8 00:05:24.541743 sshd[2350]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 8 00:05:24.551403 systemd-logind[1991]: New session 9 of user core. Nov 8 00:05:24.561632 systemd[1]: Started session-9.scope - Session 9 of User core. Nov 8 00:05:24.670572 sudo[2359]: core : PWD=/home/core ; USER=root ; COMMAND=/home/core/install.sh Nov 8 00:05:24.671339 sudo[2359]: pam_unix(sudo:session): session opened for user root(uid=0) by core(uid=500) Nov 8 00:05:25.321793 systemd[1]: Starting docker.service - Docker Application Container Engine... Nov 8 00:05:25.324191 (dockerd)[2375]: docker.service: Referenced but unset environment variable evaluates to an empty string: DOCKER_CGROUPS, DOCKER_OPTS, DOCKER_OPT_BIP, DOCKER_OPT_IPMASQ, DOCKER_OPT_MTU Nov 8 00:05:25.853465 dockerd[2375]: time="2025-11-08T00:05:25.853357053Z" level=info msg="Starting up" Nov 8 00:05:26.080835 dockerd[2375]: time="2025-11-08T00:05:26.080148510Z" level=info msg="Loading containers: start." Nov 8 00:05:26.343319 kernel: Initializing XFRM netlink socket Nov 8 00:05:26.410832 (udev-worker)[2397]: Network interface NamePolicy= disabled on kernel command line. Nov 8 00:05:26.499331 systemd-networkd[1929]: docker0: Link UP Nov 8 00:05:26.533336 dockerd[2375]: time="2025-11-08T00:05:26.533247188Z" level=info msg="Loading containers: done." Nov 8 00:05:26.562542 systemd[1]: var-lib-docker-overlay2-opaque\x2dbug\x2dcheck2101802407-merged.mount: Deactivated successfully. Nov 8 00:05:26.572989 dockerd[2375]: time="2025-11-08T00:05:26.572865824Z" level=warning msg="Not using native diff for overlay2, this may cause degraded performance for building images: kernel has CONFIG_OVERLAY_FS_REDIRECT_DIR enabled" storage-driver=overlay2 Nov 8 00:05:26.573189 dockerd[2375]: time="2025-11-08T00:05:26.573067004Z" level=info msg="Docker daemon" commit=061aa95809be396a6b5542618d8a34b02a21ff77 containerd-snapshotter=false storage-driver=overlay2 version=26.1.0 Nov 8 00:05:26.573438 dockerd[2375]: time="2025-11-08T00:05:26.573352916Z" level=info msg="Daemon has completed initialization" Nov 8 00:05:26.660818 dockerd[2375]: time="2025-11-08T00:05:26.658697109Z" level=info msg="API listen on /run/docker.sock" Nov 8 00:05:26.661106 systemd[1]: Started docker.service - Docker Application Container Engine. Nov 8 00:05:27.961342 containerd[2009]: time="2025-11-08T00:05:27.960773711Z" level=info msg="PullImage \"registry.k8s.io/kube-apiserver:v1.32.9\"" Nov 8 00:05:28.680161 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount2371314494.mount: Deactivated successfully. Nov 8 00:05:30.393259 containerd[2009]: time="2025-11-08T00:05:30.393148919Z" level=info msg="ImageCreate event name:\"registry.k8s.io/kube-apiserver:v1.32.9\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 8 00:05:30.395780 containerd[2009]: time="2025-11-08T00:05:30.395683415Z" level=info msg="stop pulling image registry.k8s.io/kube-apiserver:v1.32.9: active requests=0, bytes read=26363685" Nov 8 00:05:30.397920 containerd[2009]: time="2025-11-08T00:05:30.397777283Z" level=info msg="ImageCreate event name:\"sha256:02ea53851f07db91ed471dab1ab11541f5c294802371cd8f0cfd423cd5c71002\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 8 00:05:30.407329 containerd[2009]: time="2025-11-08T00:05:30.405230507Z" level=info msg="ImageCreate event name:\"registry.k8s.io/kube-apiserver@sha256:6df11cc2ad9679b1117be34d3a0230add88bc0a08fd7a3ebc26b680575e8de97\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 8 00:05:30.408544 containerd[2009]: time="2025-11-08T00:05:30.408008855Z" level=info msg="Pulled image \"registry.k8s.io/kube-apiserver:v1.32.9\" with image id \"sha256:02ea53851f07db91ed471dab1ab11541f5c294802371cd8f0cfd423cd5c71002\", repo tag \"registry.k8s.io/kube-apiserver:v1.32.9\", repo digest \"registry.k8s.io/kube-apiserver@sha256:6df11cc2ad9679b1117be34d3a0230add88bc0a08fd7a3ebc26b680575e8de97\", size \"26360284\" in 2.447159352s" Nov 8 00:05:30.408544 containerd[2009]: time="2025-11-08T00:05:30.408087347Z" level=info msg="PullImage \"registry.k8s.io/kube-apiserver:v1.32.9\" returns image reference \"sha256:02ea53851f07db91ed471dab1ab11541f5c294802371cd8f0cfd423cd5c71002\"" Nov 8 00:05:30.409253 containerd[2009]: time="2025-11-08T00:05:30.409191707Z" level=info msg="PullImage \"registry.k8s.io/kube-controller-manager:v1.32.9\"" Nov 8 00:05:31.924307 containerd[2009]: time="2025-11-08T00:05:31.922719867Z" level=info msg="ImageCreate event name:\"registry.k8s.io/kube-controller-manager:v1.32.9\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 8 00:05:31.925119 containerd[2009]: time="2025-11-08T00:05:31.925037979Z" level=info msg="stop pulling image registry.k8s.io/kube-controller-manager:v1.32.9: active requests=0, bytes read=22531200" Nov 8 00:05:31.926047 containerd[2009]: time="2025-11-08T00:05:31.925987083Z" level=info msg="ImageCreate event name:\"sha256:f0bcbad5082c944520b370596a2384affda710b9d7daf84e8a48352699af8e4b\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 8 00:05:31.938379 containerd[2009]: time="2025-11-08T00:05:31.938314467Z" level=info msg="ImageCreate event name:\"registry.k8s.io/kube-controller-manager@sha256:243c4b8e3bce271fcb1b78008ab996ab6976b1a20096deac08338fcd17979922\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 8 00:05:31.942889 containerd[2009]: time="2025-11-08T00:05:31.942786255Z" level=info msg="Pulled image \"registry.k8s.io/kube-controller-manager:v1.32.9\" with image id \"sha256:f0bcbad5082c944520b370596a2384affda710b9d7daf84e8a48352699af8e4b\", repo tag \"registry.k8s.io/kube-controller-manager:v1.32.9\", repo digest \"registry.k8s.io/kube-controller-manager@sha256:243c4b8e3bce271fcb1b78008ab996ab6976b1a20096deac08338fcd17979922\", size \"24099975\" in 1.533519356s" Nov 8 00:05:31.942889 containerd[2009]: time="2025-11-08T00:05:31.942866187Z" level=info msg="PullImage \"registry.k8s.io/kube-controller-manager:v1.32.9\" returns image reference \"sha256:f0bcbad5082c944520b370596a2384affda710b9d7daf84e8a48352699af8e4b\"" Nov 8 00:05:31.943890 containerd[2009]: time="2025-11-08T00:05:31.943580211Z" level=info msg="PullImage \"registry.k8s.io/kube-scheduler:v1.32.9\"" Nov 8 00:05:33.165108 containerd[2009]: time="2025-11-08T00:05:33.165032437Z" level=info msg="ImageCreate event name:\"registry.k8s.io/kube-scheduler:v1.32.9\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 8 00:05:33.168317 containerd[2009]: time="2025-11-08T00:05:33.167303161Z" level=info msg="stop pulling image registry.k8s.io/kube-scheduler:v1.32.9: active requests=0, bytes read=17484324" Nov 8 00:05:33.168317 containerd[2009]: time="2025-11-08T00:05:33.167558689Z" level=info msg="ImageCreate event name:\"sha256:1d625baf81b59592006d97a6741bc947698ed222b612ac10efa57b7aa96d2a27\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 8 00:05:33.173990 containerd[2009]: time="2025-11-08T00:05:33.173887849Z" level=info msg="ImageCreate event name:\"registry.k8s.io/kube-scheduler@sha256:50c49520dbd0e8b4076b6a5c77d8014df09ea3d59a73e8bafd2678d51ebb92d5\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 8 00:05:33.176665 containerd[2009]: time="2025-11-08T00:05:33.176590393Z" level=info msg="Pulled image \"registry.k8s.io/kube-scheduler:v1.32.9\" with image id \"sha256:1d625baf81b59592006d97a6741bc947698ed222b612ac10efa57b7aa96d2a27\", repo tag \"registry.k8s.io/kube-scheduler:v1.32.9\", repo digest \"registry.k8s.io/kube-scheduler@sha256:50c49520dbd0e8b4076b6a5c77d8014df09ea3d59a73e8bafd2678d51ebb92d5\", size \"19053117\" in 1.232946234s" Nov 8 00:05:33.177077 containerd[2009]: time="2025-11-08T00:05:33.176869885Z" level=info msg="PullImage \"registry.k8s.io/kube-scheduler:v1.32.9\" returns image reference \"sha256:1d625baf81b59592006d97a6741bc947698ed222b612ac10efa57b7aa96d2a27\"" Nov 8 00:05:33.178062 containerd[2009]: time="2025-11-08T00:05:33.177746677Z" level=info msg="PullImage \"registry.k8s.io/kube-proxy:v1.32.9\"" Nov 8 00:05:34.468214 systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 2. Nov 8 00:05:34.477677 systemd[1]: Starting kubelet.service - kubelet: The Kubernetes Node Agent... Nov 8 00:05:34.680681 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount2235865100.mount: Deactivated successfully. Nov 8 00:05:34.948810 systemd[1]: Started kubelet.service - kubelet: The Kubernetes Node Agent. Nov 8 00:05:34.966064 (kubelet)[2597]: kubelet.service: Referenced but unset environment variable evaluates to an empty string: KUBELET_EXTRA_ARGS, KUBELET_KUBEADM_ARGS Nov 8 00:05:35.069325 kubelet[2597]: E1108 00:05:35.068581 2597 run.go:72] "command failed" err="failed to load kubelet config file, path: /var/lib/kubelet/config.yaml, error: failed to load Kubelet config file /var/lib/kubelet/config.yaml, error failed to read kubelet config file \"/var/lib/kubelet/config.yaml\", error: open /var/lib/kubelet/config.yaml: no such file or directory" Nov 8 00:05:35.074691 systemd[1]: kubelet.service: Main process exited, code=exited, status=1/FAILURE Nov 8 00:05:35.075287 systemd[1]: kubelet.service: Failed with result 'exit-code'. Nov 8 00:05:35.484751 containerd[2009]: time="2025-11-08T00:05:35.484660397Z" level=info msg="ImageCreate event name:\"registry.k8s.io/kube-proxy:v1.32.9\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 8 00:05:35.487229 containerd[2009]: time="2025-11-08T00:05:35.487143437Z" level=info msg="stop pulling image registry.k8s.io/kube-proxy:v1.32.9: active requests=0, bytes read=27417817" Nov 8 00:05:35.489133 containerd[2009]: time="2025-11-08T00:05:35.489026897Z" level=info msg="ImageCreate event name:\"sha256:72b57ec14d31e8422925ef4c3eff44822cdc04a11fd30d13824f1897d83a16d4\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 8 00:05:35.493173 containerd[2009]: time="2025-11-08T00:05:35.493101353Z" level=info msg="ImageCreate event name:\"registry.k8s.io/kube-proxy@sha256:886af02535dc34886e4618b902f8c140d89af57233a245621d29642224516064\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 8 00:05:35.494992 containerd[2009]: time="2025-11-08T00:05:35.494770121Z" level=info msg="Pulled image \"registry.k8s.io/kube-proxy:v1.32.9\" with image id \"sha256:72b57ec14d31e8422925ef4c3eff44822cdc04a11fd30d13824f1897d83a16d4\", repo tag \"registry.k8s.io/kube-proxy:v1.32.9\", repo digest \"registry.k8s.io/kube-proxy@sha256:886af02535dc34886e4618b902f8c140d89af57233a245621d29642224516064\", size \"27416836\" in 2.3169624s" Nov 8 00:05:35.494992 containerd[2009]: time="2025-11-08T00:05:35.494841773Z" level=info msg="PullImage \"registry.k8s.io/kube-proxy:v1.32.9\" returns image reference \"sha256:72b57ec14d31e8422925ef4c3eff44822cdc04a11fd30d13824f1897d83a16d4\"" Nov 8 00:05:35.496517 containerd[2009]: time="2025-11-08T00:05:35.496458605Z" level=info msg="PullImage \"registry.k8s.io/coredns/coredns:v1.11.3\"" Nov 8 00:05:36.038313 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount194411798.mount: Deactivated successfully. Nov 8 00:05:37.329505 containerd[2009]: time="2025-11-08T00:05:37.329407926Z" level=info msg="ImageCreate event name:\"registry.k8s.io/coredns/coredns:v1.11.3\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 8 00:05:37.331921 containerd[2009]: time="2025-11-08T00:05:37.331773222Z" level=info msg="stop pulling image registry.k8s.io/coredns/coredns:v1.11.3: active requests=0, bytes read=16951622" Nov 8 00:05:37.332836 containerd[2009]: time="2025-11-08T00:05:37.332726562Z" level=info msg="ImageCreate event name:\"sha256:2f6c962e7b8311337352d9fdea917da2184d9919f4da7695bc2a6517cf392fe4\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 8 00:05:37.340311 containerd[2009]: time="2025-11-08T00:05:37.339996450Z" level=info msg="ImageCreate event name:\"registry.k8s.io/coredns/coredns@sha256:9caabbf6238b189a65d0d6e6ac138de60d6a1c419e5a341fbbb7c78382559c6e\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 8 00:05:37.343568 containerd[2009]: time="2025-11-08T00:05:37.343242534Z" level=info msg="Pulled image \"registry.k8s.io/coredns/coredns:v1.11.3\" with image id \"sha256:2f6c962e7b8311337352d9fdea917da2184d9919f4da7695bc2a6517cf392fe4\", repo tag \"registry.k8s.io/coredns/coredns:v1.11.3\", repo digest \"registry.k8s.io/coredns/coredns@sha256:9caabbf6238b189a65d0d6e6ac138de60d6a1c419e5a341fbbb7c78382559c6e\", size \"16948420\" in 1.846713741s" Nov 8 00:05:37.343568 containerd[2009]: time="2025-11-08T00:05:37.343347630Z" level=info msg="PullImage \"registry.k8s.io/coredns/coredns:v1.11.3\" returns image reference \"sha256:2f6c962e7b8311337352d9fdea917da2184d9919f4da7695bc2a6517cf392fe4\"" Nov 8 00:05:37.344074 containerd[2009]: time="2025-11-08T00:05:37.344043642Z" level=info msg="PullImage \"registry.k8s.io/pause:3.10\"" Nov 8 00:05:37.833504 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount479222715.mount: Deactivated successfully. Nov 8 00:05:37.842452 containerd[2009]: time="2025-11-08T00:05:37.842372300Z" level=info msg="ImageCreate event name:\"registry.k8s.io/pause:3.10\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 8 00:05:37.844104 containerd[2009]: time="2025-11-08T00:05:37.844039976Z" level=info msg="stop pulling image registry.k8s.io/pause:3.10: active requests=0, bytes read=268703" Nov 8 00:05:37.845326 containerd[2009]: time="2025-11-08T00:05:37.844680092Z" level=info msg="ImageCreate event name:\"sha256:afb61768ce381961ca0beff95337601f29dc70ff3ed14e5e4b3e5699057e6aa8\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 8 00:05:37.850879 containerd[2009]: time="2025-11-08T00:05:37.850816304Z" level=info msg="ImageCreate event name:\"registry.k8s.io/pause@sha256:ee6521f290b2168b6e0935a181d4cff9be1ac3f505666ef0e3c98fae8199917a\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 8 00:05:37.852854 containerd[2009]: time="2025-11-08T00:05:37.852767792Z" level=info msg="Pulled image \"registry.k8s.io/pause:3.10\" with image id \"sha256:afb61768ce381961ca0beff95337601f29dc70ff3ed14e5e4b3e5699057e6aa8\", repo tag \"registry.k8s.io/pause:3.10\", repo digest \"registry.k8s.io/pause@sha256:ee6521f290b2168b6e0935a181d4cff9be1ac3f505666ef0e3c98fae8199917a\", size \"267933\" in 508.668182ms" Nov 8 00:05:37.852854 containerd[2009]: time="2025-11-08T00:05:37.852841388Z" level=info msg="PullImage \"registry.k8s.io/pause:3.10\" returns image reference \"sha256:afb61768ce381961ca0beff95337601f29dc70ff3ed14e5e4b3e5699057e6aa8\"" Nov 8 00:05:37.854851 containerd[2009]: time="2025-11-08T00:05:37.854545832Z" level=info msg="PullImage \"registry.k8s.io/etcd:3.5.16-0\"" Nov 8 00:05:38.459841 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount3381778969.mount: Deactivated successfully. Nov 8 00:05:39.612052 systemd[1]: systemd-hostnamed.service: Deactivated successfully. Nov 8 00:05:41.042294 containerd[2009]: time="2025-11-08T00:05:41.040392524Z" level=info msg="ImageCreate event name:\"registry.k8s.io/etcd:3.5.16-0\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 8 00:05:41.042833 containerd[2009]: time="2025-11-08T00:05:41.042795608Z" level=info msg="stop pulling image registry.k8s.io/etcd:3.5.16-0: active requests=0, bytes read=67943165" Nov 8 00:05:41.043509 containerd[2009]: time="2025-11-08T00:05:41.043465256Z" level=info msg="ImageCreate event name:\"sha256:7fc9d4aa817aa6a3e549f3cd49d1f7b496407be979fc36dd5f356d59ce8c3a82\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 8 00:05:41.051411 containerd[2009]: time="2025-11-08T00:05:41.051326000Z" level=info msg="ImageCreate event name:\"registry.k8s.io/etcd@sha256:c6a9d11cc5c04b114ccdef39a9265eeef818e3d02f5359be035ae784097fdec5\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 8 00:05:41.061220 containerd[2009]: time="2025-11-08T00:05:41.061119824Z" level=info msg="Pulled image \"registry.k8s.io/etcd:3.5.16-0\" with image id \"sha256:7fc9d4aa817aa6a3e549f3cd49d1f7b496407be979fc36dd5f356d59ce8c3a82\", repo tag \"registry.k8s.io/etcd:3.5.16-0\", repo digest \"registry.k8s.io/etcd@sha256:c6a9d11cc5c04b114ccdef39a9265eeef818e3d02f5359be035ae784097fdec5\", size \"67941650\" in 3.206510872s" Nov 8 00:05:41.061220 containerd[2009]: time="2025-11-08T00:05:41.061207220Z" level=info msg="PullImage \"registry.k8s.io/etcd:3.5.16-0\" returns image reference \"sha256:7fc9d4aa817aa6a3e549f3cd49d1f7b496407be979fc36dd5f356d59ce8c3a82\"" Nov 8 00:05:45.217238 systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 3. Nov 8 00:05:45.223752 systemd[1]: Starting kubelet.service - kubelet: The Kubernetes Node Agent... Nov 8 00:05:45.572559 systemd[1]: Started kubelet.service - kubelet: The Kubernetes Node Agent. Nov 8 00:05:45.585754 (kubelet)[2744]: kubelet.service: Referenced but unset environment variable evaluates to an empty string: KUBELET_EXTRA_ARGS, KUBELET_KUBEADM_ARGS Nov 8 00:05:45.658304 kubelet[2744]: E1108 00:05:45.655165 2744 run.go:72] "command failed" err="failed to load kubelet config file, path: /var/lib/kubelet/config.yaml, error: failed to load Kubelet config file /var/lib/kubelet/config.yaml, error failed to read kubelet config file \"/var/lib/kubelet/config.yaml\", error: open /var/lib/kubelet/config.yaml: no such file or directory" Nov 8 00:05:45.659864 systemd[1]: kubelet.service: Main process exited, code=exited, status=1/FAILURE Nov 8 00:05:45.660190 systemd[1]: kubelet.service: Failed with result 'exit-code'. Nov 8 00:05:49.652639 systemd[1]: Stopped kubelet.service - kubelet: The Kubernetes Node Agent. Nov 8 00:05:49.662865 systemd[1]: Starting kubelet.service - kubelet: The Kubernetes Node Agent... Nov 8 00:05:49.736540 systemd[1]: Reloading requested from client PID 2759 ('systemctl') (unit session-9.scope)... Nov 8 00:05:49.736577 systemd[1]: Reloading... Nov 8 00:05:50.007319 zram_generator::config[2811]: No configuration found. Nov 8 00:05:50.214568 systemd[1]: /usr/lib/systemd/system/docker.socket:6: ListenStream= references a path below legacy directory /var/run/, updating /var/run/docker.sock → /run/docker.sock; please update the unit file accordingly. Nov 8 00:05:50.391120 systemd[1]: Reloading finished in 653 ms. Nov 8 00:05:50.502721 systemd[1]: Stopping kubelet.service - kubelet: The Kubernetes Node Agent... Nov 8 00:05:50.506451 systemd[1]: kubelet.service: Deactivated successfully. Nov 8 00:05:50.506857 systemd[1]: Stopped kubelet.service - kubelet: The Kubernetes Node Agent. Nov 8 00:05:50.515924 systemd[1]: Starting kubelet.service - kubelet: The Kubernetes Node Agent... Nov 8 00:05:50.845320 systemd[1]: Started kubelet.service - kubelet: The Kubernetes Node Agent. Nov 8 00:05:50.865894 (kubelet)[2864]: kubelet.service: Referenced but unset environment variable evaluates to an empty string: KUBELET_EXTRA_ARGS Nov 8 00:05:50.941684 kubelet[2864]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 8 00:05:50.941684 kubelet[2864]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Nov 8 00:05:50.941684 kubelet[2864]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 8 00:05:50.942244 kubelet[2864]: I1108 00:05:50.941790 2864 server.go:215] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Nov 8 00:05:51.625603 kubelet[2864]: I1108 00:05:51.625535 2864 server.go:520] "Kubelet version" kubeletVersion="v1.32.4" Nov 8 00:05:51.625603 kubelet[2864]: I1108 00:05:51.625587 2864 server.go:522] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Nov 8 00:05:51.626081 kubelet[2864]: I1108 00:05:51.626034 2864 server.go:954] "Client rotation is on, will bootstrap in background" Nov 8 00:05:51.673694 kubelet[2864]: E1108 00:05:51.673633 2864 certificate_manager.go:562] "Unhandled Error" err="kubernetes.io/kube-apiserver-client-kubelet: Failed while requesting a signed certificate from the control plane: cannot create certificate signing request: Post \"https://172.31.23.87:6443/apis/certificates.k8s.io/v1/certificatesigningrequests\": dial tcp 172.31.23.87:6443: connect: connection refused" logger="UnhandledError" Nov 8 00:05:51.677892 kubelet[2864]: I1108 00:05:51.677428 2864 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" Nov 8 00:05:51.689726 kubelet[2864]: E1108 00:05:51.689655 2864 log.go:32] "RuntimeConfig from runtime service failed" err="rpc error: code = Unimplemented desc = unknown method RuntimeConfig for service runtime.v1.RuntimeService" Nov 8 00:05:51.689726 kubelet[2864]: I1108 00:05:51.689714 2864 server.go:1421] "CRI implementation should be updated to support RuntimeConfig when KubeletCgroupDriverFromCRI feature gate has been enabled. Falling back to using cgroupDriver from kubelet config." Nov 8 00:05:51.695478 kubelet[2864]: I1108 00:05:51.695383 2864 server.go:772] "--cgroups-per-qos enabled, but --cgroup-root was not specified. defaulting to /" Nov 8 00:05:51.697084 kubelet[2864]: I1108 00:05:51.696965 2864 container_manager_linux.go:268] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Nov 8 00:05:51.697455 kubelet[2864]: I1108 00:05:51.697062 2864 container_manager_linux.go:273] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-172-31-23-87","RuntimeCgroupsName":"","SystemCgroupsName":"","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":false,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":null,"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"ExperimentalMemoryManagerPolicy":"None","ExperimentalMemoryManagerReservedMemory":null,"PodPidsLimit":-1,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Nov 8 00:05:51.697657 kubelet[2864]: I1108 00:05:51.697602 2864 topology_manager.go:138] "Creating topology manager with none policy" Nov 8 00:05:51.697657 kubelet[2864]: I1108 00:05:51.697633 2864 container_manager_linux.go:304] "Creating device plugin manager" Nov 8 00:05:51.698040 kubelet[2864]: I1108 00:05:51.697993 2864 state_mem.go:36] "Initialized new in-memory state store" Nov 8 00:05:51.703952 kubelet[2864]: I1108 00:05:51.703868 2864 kubelet.go:446] "Attempting to sync node with API server" Nov 8 00:05:51.704231 kubelet[2864]: I1108 00:05:51.704167 2864 kubelet.go:341] "Adding static pod path" path="/etc/kubernetes/manifests" Nov 8 00:05:51.704231 kubelet[2864]: I1108 00:05:51.704234 2864 kubelet.go:352] "Adding apiserver pod source" Nov 8 00:05:51.704453 kubelet[2864]: I1108 00:05:51.704260 2864 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Nov 8 00:05:51.717242 kubelet[2864]: W1108 00:05:51.716401 2864 reflector.go:569] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: Get "https://172.31.23.87:6443/api/v1/nodes?fieldSelector=metadata.name%3Dip-172-31-23-87&limit=500&resourceVersion=0": dial tcp 172.31.23.87:6443: connect: connection refused Nov 8 00:05:51.717242 kubelet[2864]: E1108 00:05:51.716524 2864 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: Get \"https://172.31.23.87:6443/api/v1/nodes?fieldSelector=metadata.name%3Dip-172-31-23-87&limit=500&resourceVersion=0\": dial tcp 172.31.23.87:6443: connect: connection refused" logger="UnhandledError" Nov 8 00:05:51.717472 kubelet[2864]: I1108 00:05:51.717341 2864 kuberuntime_manager.go:269] "Container runtime initialized" containerRuntime="containerd" version="v1.7.21" apiVersion="v1" Nov 8 00:05:51.718426 kubelet[2864]: I1108 00:05:51.718380 2864 kubelet.go:890] "Not starting ClusterTrustBundle informer because we are in static kubelet mode" Nov 8 00:05:51.718692 kubelet[2864]: W1108 00:05:51.718616 2864 probe.go:272] Flexvolume plugin directory at /opt/libexec/kubernetes/kubelet-plugins/volume/exec/ does not exist. Recreating. Nov 8 00:05:51.722341 kubelet[2864]: I1108 00:05:51.722091 2864 watchdog_linux.go:99] "Systemd watchdog is not enabled" Nov 8 00:05:51.722341 kubelet[2864]: I1108 00:05:51.722163 2864 server.go:1287] "Started kubelet" Nov 8 00:05:51.731350 kubelet[2864]: W1108 00:05:51.730353 2864 reflector.go:569] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: Get "https://172.31.23.87:6443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&limit=500&resourceVersion=0": dial tcp 172.31.23.87:6443: connect: connection refused Nov 8 00:05:51.731350 kubelet[2864]: E1108 00:05:51.730761 2864 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: Get \"https://172.31.23.87:6443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&limit=500&resourceVersion=0\": dial tcp 172.31.23.87:6443: connect: connection refused" logger="UnhandledError" Nov 8 00:05:51.731350 kubelet[2864]: I1108 00:05:51.730864 2864 server.go:169] "Starting to listen" address="0.0.0.0" port=10250 Nov 8 00:05:51.732991 kubelet[2864]: E1108 00:05:51.732454 2864 event.go:368] "Unable to write event (may retry after sleeping)" err="Post \"https://172.31.23.87:6443/api/v1/namespaces/default/events\": dial tcp 172.31.23.87:6443: connect: connection refused" event="&Event{ObjectMeta:{ip-172-31-23-87.1875df4d2b95be7d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-172-31-23-87,UID:ip-172-31-23-87,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-172-31-23-87,},FirstTimestamp:2025-11-08 00:05:51.722126973 +0000 UTC m=+0.850302905,LastTimestamp:2025-11-08 00:05:51.722126973 +0000 UTC m=+0.850302905,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-172-31-23-87,}" Nov 8 00:05:51.734091 kubelet[2864]: I1108 00:05:51.733900 2864 server.go:479] "Adding debug handlers to kubelet server" Nov 8 00:05:51.736491 kubelet[2864]: I1108 00:05:51.736451 2864 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Nov 8 00:05:51.740301 kubelet[2864]: I1108 00:05:51.739884 2864 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Nov 8 00:05:51.740424 kubelet[2864]: I1108 00:05:51.740384 2864 server.go:243] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Nov 8 00:05:51.744982 kubelet[2864]: I1108 00:05:51.744461 2864 dynamic_serving_content.go:135] "Starting controller" name="kubelet-server-cert-files::/var/lib/kubelet/pki/kubelet.crt::/var/lib/kubelet/pki/kubelet.key" Nov 8 00:05:51.747430 kubelet[2864]: I1108 00:05:51.747395 2864 volume_manager.go:297] "Starting Kubelet Volume Manager" Nov 8 00:05:51.748875 kubelet[2864]: E1108 00:05:51.748121 2864 kubelet_node_status.go:466] "Error getting the current node from lister" err="node \"ip-172-31-23-87\" not found" Nov 8 00:05:51.750463 kubelet[2864]: E1108 00:05:51.749761 2864 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://172.31.23.87:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-172-31-23-87?timeout=10s\": dial tcp 172.31.23.87:6443: connect: connection refused" interval="200ms" Nov 8 00:05:51.750463 kubelet[2864]: I1108 00:05:51.749828 2864 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Nov 8 00:05:51.751077 kubelet[2864]: W1108 00:05:51.750982 2864 reflector.go:569] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: Get "https://172.31.23.87:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": dial tcp 172.31.23.87:6443: connect: connection refused Nov 8 00:05:51.751195 kubelet[2864]: E1108 00:05:51.751091 2864 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: Get \"https://172.31.23.87:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0\": dial tcp 172.31.23.87:6443: connect: connection refused" logger="UnhandledError" Nov 8 00:05:51.751655 kubelet[2864]: I1108 00:05:51.751601 2864 factory.go:219] Registration of the crio container factory failed: Get "http://%2Fvar%2Frun%2Fcrio%2Fcrio.sock/info": dial unix /var/run/crio/crio.sock: connect: no such file or directory Nov 8 00:05:51.754623 kubelet[2864]: E1108 00:05:51.754204 2864 kubelet.go:1555] "Image garbage collection failed once. Stats initialization may not have completed yet" err="invalid capacity 0 on image filesystem" Nov 8 00:05:51.754623 kubelet[2864]: I1108 00:05:51.754526 2864 reconciler.go:26] "Reconciler: start to sync state" Nov 8 00:05:51.754838 kubelet[2864]: I1108 00:05:51.754699 2864 factory.go:221] Registration of the containerd container factory successfully Nov 8 00:05:51.754838 kubelet[2864]: I1108 00:05:51.754721 2864 factory.go:221] Registration of the systemd container factory successfully Nov 8 00:05:51.784249 kubelet[2864]: I1108 00:05:51.784159 2864 kubelet_network_linux.go:50] "Initialized iptables rules." protocol="IPv4" Nov 8 00:05:51.790087 kubelet[2864]: I1108 00:05:51.790029 2864 kubelet_network_linux.go:50] "Initialized iptables rules." protocol="IPv6" Nov 8 00:05:51.790087 kubelet[2864]: I1108 00:05:51.790079 2864 status_manager.go:227] "Starting to sync pod status with apiserver" Nov 8 00:05:51.790354 kubelet[2864]: I1108 00:05:51.790133 2864 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Nov 8 00:05:51.790354 kubelet[2864]: I1108 00:05:51.790148 2864 kubelet.go:2382] "Starting kubelet main sync loop" Nov 8 00:05:51.790354 kubelet[2864]: E1108 00:05:51.790214 2864 kubelet.go:2406] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Nov 8 00:05:51.795111 kubelet[2864]: W1108 00:05:51.795050 2864 reflector.go:569] k8s.io/client-go/informers/factory.go:160: failed to list *v1.RuntimeClass: Get "https://172.31.23.87:6443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0": dial tcp 172.31.23.87:6443: connect: connection refused Nov 8 00:05:51.795788 kubelet[2864]: E1108 00:05:51.795137 2864 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.RuntimeClass: failed to list *v1.RuntimeClass: Get \"https://172.31.23.87:6443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0\": dial tcp 172.31.23.87:6443: connect: connection refused" logger="UnhandledError" Nov 8 00:05:51.807235 kubelet[2864]: I1108 00:05:51.807187 2864 cpu_manager.go:221] "Starting CPU manager" policy="none" Nov 8 00:05:51.807431 kubelet[2864]: I1108 00:05:51.807227 2864 cpu_manager.go:222] "Reconciling" reconcilePeriod="10s" Nov 8 00:05:51.807431 kubelet[2864]: I1108 00:05:51.807317 2864 state_mem.go:36] "Initialized new in-memory state store" Nov 8 00:05:51.812354 kubelet[2864]: I1108 00:05:51.812309 2864 policy_none.go:49] "None policy: Start" Nov 8 00:05:51.812354 kubelet[2864]: I1108 00:05:51.812355 2864 memory_manager.go:186] "Starting memorymanager" policy="None" Nov 8 00:05:51.812575 kubelet[2864]: I1108 00:05:51.812402 2864 state_mem.go:35] "Initializing new in-memory state store" Nov 8 00:05:51.825038 systemd[1]: Created slice kubepods.slice - libcontainer container kubepods.slice. Nov 8 00:05:51.845073 systemd[1]: Created slice kubepods-burstable.slice - libcontainer container kubepods-burstable.slice. Nov 8 00:05:51.848583 kubelet[2864]: E1108 00:05:51.848514 2864 kubelet_node_status.go:466] "Error getting the current node from lister" err="node \"ip-172-31-23-87\" not found" Nov 8 00:05:51.854281 systemd[1]: Created slice kubepods-besteffort.slice - libcontainer container kubepods-besteffort.slice. Nov 8 00:05:51.867196 kubelet[2864]: I1108 00:05:51.867157 2864 manager.go:519] "Failed to read data from checkpoint" checkpoint="kubelet_internal_checkpoint" err="checkpoint is not found" Nov 8 00:05:51.868243 kubelet[2864]: I1108 00:05:51.867652 2864 eviction_manager.go:189] "Eviction manager: starting control loop" Nov 8 00:05:51.868243 kubelet[2864]: I1108 00:05:51.867677 2864 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Nov 8 00:05:51.868243 kubelet[2864]: I1108 00:05:51.868092 2864 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Nov 8 00:05:51.870705 kubelet[2864]: E1108 00:05:51.870669 2864 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="no imagefs label for configured runtime" Nov 8 00:05:51.870955 kubelet[2864]: E1108 00:05:51.870926 2864 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-172-31-23-87\" not found" Nov 8 00:05:51.909903 systemd[1]: Created slice kubepods-burstable-pod04e19e51e0f6a8ff54c4d23c23f1fe34.slice - libcontainer container kubepods-burstable-pod04e19e51e0f6a8ff54c4d23c23f1fe34.slice. Nov 8 00:05:51.932858 kubelet[2864]: E1108 00:05:51.932811 2864 kubelet.go:3190] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-172-31-23-87\" not found" node="ip-172-31-23-87" Nov 8 00:05:51.941094 systemd[1]: Created slice kubepods-burstable-pod3c99959cc6545159218ce79725ba7605.slice - libcontainer container kubepods-burstable-pod3c99959cc6545159218ce79725ba7605.slice. Nov 8 00:05:51.945976 kubelet[2864]: E1108 00:05:51.945938 2864 kubelet.go:3190] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-172-31-23-87\" not found" node="ip-172-31-23-87" Nov 8 00:05:51.951564 kubelet[2864]: E1108 00:05:51.951478 2864 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://172.31.23.87:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-172-31-23-87?timeout=10s\": dial tcp 172.31.23.87:6443: connect: connection refused" interval="400ms" Nov 8 00:05:51.955849 kubelet[2864]: I1108 00:05:51.955775 2864 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-certs\" (UniqueName: \"kubernetes.io/host-path/04e19e51e0f6a8ff54c4d23c23f1fe34-ca-certs\") pod \"kube-apiserver-ip-172-31-23-87\" (UID: \"04e19e51e0f6a8ff54c4d23c23f1fe34\") " pod="kube-system/kube-apiserver-ip-172-31-23-87" Nov 8 00:05:51.955994 kubelet[2864]: I1108 00:05:51.955860 2864 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-share-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/04e19e51e0f6a8ff54c4d23c23f1fe34-usr-share-ca-certificates\") pod \"kube-apiserver-ip-172-31-23-87\" (UID: \"04e19e51e0f6a8ff54c4d23c23f1fe34\") " pod="kube-system/kube-apiserver-ip-172-31-23-87" Nov 8 00:05:51.955994 kubelet[2864]: I1108 00:05:51.955908 2864 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeconfig\" (UniqueName: \"kubernetes.io/host-path/3c99959cc6545159218ce79725ba7605-kubeconfig\") pod \"kube-controller-manager-ip-172-31-23-87\" (UID: \"3c99959cc6545159218ce79725ba7605\") " pod="kube-system/kube-controller-manager-ip-172-31-23-87" Nov 8 00:05:51.955994 kubelet[2864]: I1108 00:05:51.955950 2864 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"k8s-certs\" (UniqueName: \"kubernetes.io/host-path/04e19e51e0f6a8ff54c4d23c23f1fe34-k8s-certs\") pod \"kube-apiserver-ip-172-31-23-87\" (UID: \"04e19e51e0f6a8ff54c4d23c23f1fe34\") " pod="kube-system/kube-apiserver-ip-172-31-23-87" Nov 8 00:05:51.955994 kubelet[2864]: I1108 00:05:51.955986 2864 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-certs\" (UniqueName: \"kubernetes.io/host-path/3c99959cc6545159218ce79725ba7605-ca-certs\") pod \"kube-controller-manager-ip-172-31-23-87\" (UID: \"3c99959cc6545159218ce79725ba7605\") " pod="kube-system/kube-controller-manager-ip-172-31-23-87" Nov 8 00:05:51.956403 kubelet[2864]: I1108 00:05:51.956026 2864 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"flexvolume-dir\" (UniqueName: \"kubernetes.io/host-path/3c99959cc6545159218ce79725ba7605-flexvolume-dir\") pod \"kube-controller-manager-ip-172-31-23-87\" (UID: \"3c99959cc6545159218ce79725ba7605\") " pod="kube-system/kube-controller-manager-ip-172-31-23-87" Nov 8 00:05:51.956403 kubelet[2864]: I1108 00:05:51.956064 2864 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"k8s-certs\" (UniqueName: \"kubernetes.io/host-path/3c99959cc6545159218ce79725ba7605-k8s-certs\") pod \"kube-controller-manager-ip-172-31-23-87\" (UID: \"3c99959cc6545159218ce79725ba7605\") " pod="kube-system/kube-controller-manager-ip-172-31-23-87" Nov 8 00:05:51.956403 kubelet[2864]: I1108 00:05:51.956100 2864 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-share-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/3c99959cc6545159218ce79725ba7605-usr-share-ca-certificates\") pod \"kube-controller-manager-ip-172-31-23-87\" (UID: \"3c99959cc6545159218ce79725ba7605\") " pod="kube-system/kube-controller-manager-ip-172-31-23-87" Nov 8 00:05:51.956403 kubelet[2864]: I1108 00:05:51.956142 2864 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeconfig\" (UniqueName: \"kubernetes.io/host-path/16543b13325f32fc2e4982b25aa473c4-kubeconfig\") pod \"kube-scheduler-ip-172-31-23-87\" (UID: \"16543b13325f32fc2e4982b25aa473c4\") " pod="kube-system/kube-scheduler-ip-172-31-23-87" Nov 8 00:05:51.957583 systemd[1]: Created slice kubepods-burstable-pod16543b13325f32fc2e4982b25aa473c4.slice - libcontainer container kubepods-burstable-pod16543b13325f32fc2e4982b25aa473c4.slice. Nov 8 00:05:51.962744 kubelet[2864]: E1108 00:05:51.962376 2864 kubelet.go:3190] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-172-31-23-87\" not found" node="ip-172-31-23-87" Nov 8 00:05:51.970236 kubelet[2864]: I1108 00:05:51.970201 2864 kubelet_node_status.go:75] "Attempting to register node" node="ip-172-31-23-87" Nov 8 00:05:51.971085 kubelet[2864]: E1108 00:05:51.971034 2864 kubelet_node_status.go:107] "Unable to register node with API server" err="Post \"https://172.31.23.87:6443/api/v1/nodes\": dial tcp 172.31.23.87:6443: connect: connection refused" node="ip-172-31-23-87" Nov 8 00:05:52.173921 kubelet[2864]: I1108 00:05:52.173752 2864 kubelet_node_status.go:75] "Attempting to register node" node="ip-172-31-23-87" Nov 8 00:05:52.174877 kubelet[2864]: E1108 00:05:52.174312 2864 kubelet_node_status.go:107] "Unable to register node with API server" err="Post \"https://172.31.23.87:6443/api/v1/nodes\": dial tcp 172.31.23.87:6443: connect: connection refused" node="ip-172-31-23-87" Nov 8 00:05:52.234946 containerd[2009]: time="2025-11-08T00:05:52.234849440Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-apiserver-ip-172-31-23-87,Uid:04e19e51e0f6a8ff54c4d23c23f1fe34,Namespace:kube-system,Attempt:0,}" Nov 8 00:05:52.248539 containerd[2009]: time="2025-11-08T00:05:52.248399072Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-controller-manager-ip-172-31-23-87,Uid:3c99959cc6545159218ce79725ba7605,Namespace:kube-system,Attempt:0,}" Nov 8 00:05:52.263857 containerd[2009]: time="2025-11-08T00:05:52.263796068Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-scheduler-ip-172-31-23-87,Uid:16543b13325f32fc2e4982b25aa473c4,Namespace:kube-system,Attempt:0,}" Nov 8 00:05:52.353406 kubelet[2864]: E1108 00:05:52.353332 2864 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://172.31.23.87:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-172-31-23-87?timeout=10s\": dial tcp 172.31.23.87:6443: connect: connection refused" interval="800ms" Nov 8 00:05:52.577858 kubelet[2864]: I1108 00:05:52.577160 2864 kubelet_node_status.go:75] "Attempting to register node" node="ip-172-31-23-87" Nov 8 00:05:52.577858 kubelet[2864]: E1108 00:05:52.577769 2864 kubelet_node_status.go:107] "Unable to register node with API server" err="Post \"https://172.31.23.87:6443/api/v1/nodes\": dial tcp 172.31.23.87:6443: connect: connection refused" node="ip-172-31-23-87" Nov 8 00:05:52.733972 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount97117726.mount: Deactivated successfully. Nov 8 00:05:52.751361 containerd[2009]: time="2025-11-08T00:05:52.751222078Z" level=info msg="ImageCreate event name:\"registry.k8s.io/pause:3.8\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"} labels:{key:\"io.cri-containerd.pinned\" value:\"pinned\"}" Nov 8 00:05:52.753567 containerd[2009]: time="2025-11-08T00:05:52.753490234Z" level=info msg="ImageUpdate event name:\"registry.k8s.io/pause:3.8\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"} labels:{key:\"io.cri-containerd.pinned\" value:\"pinned\"}" Nov 8 00:05:52.755667 containerd[2009]: time="2025-11-08T00:05:52.755565442Z" level=info msg="stop pulling image registry.k8s.io/pause:3.8: active requests=0, bytes read=269173" Nov 8 00:05:52.757818 containerd[2009]: time="2025-11-08T00:05:52.757696318Z" level=info msg="stop pulling image registry.k8s.io/pause:3.8: active requests=0, bytes read=0" Nov 8 00:05:52.769091 containerd[2009]: time="2025-11-08T00:05:52.767661406Z" level=info msg="stop pulling image registry.k8s.io/pause:3.8: active requests=0, bytes read=0" Nov 8 00:05:52.769091 containerd[2009]: time="2025-11-08T00:05:52.768983363Z" level=info msg="ImageUpdate event name:\"registry.k8s.io/pause:3.8\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"} labels:{key:\"io.cri-containerd.pinned\" value:\"pinned\"}" Nov 8 00:05:52.775644 containerd[2009]: time="2025-11-08T00:05:52.775546811Z" level=info msg="ImageCreate event name:\"sha256:4e42fb3c9d90ed7895bc04a9d96fe3102a65b521f485cc5a4f3dd818afef9cef\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"} labels:{key:\"io.cri-containerd.pinned\" value:\"pinned\"}" Nov 8 00:05:52.777761 containerd[2009]: time="2025-11-08T00:05:52.777466475Z" level=info msg="Pulled image \"registry.k8s.io/pause:3.8\" with image id \"sha256:4e42fb3c9d90ed7895bc04a9d96fe3102a65b521f485cc5a4f3dd818afef9cef\", repo tag \"registry.k8s.io/pause:3.8\", repo digest \"registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d\", size \"268403\" in 513.551679ms" Nov 8 00:05:52.781653 containerd[2009]: time="2025-11-08T00:05:52.781587035Z" level=info msg="ImageCreate event name:\"registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"} labels:{key:\"io.cri-containerd.pinned\" value:\"pinned\"}" Nov 8 00:05:52.785081 containerd[2009]: time="2025-11-08T00:05:52.784995455Z" level=info msg="Pulled image \"registry.k8s.io/pause:3.8\" with image id \"sha256:4e42fb3c9d90ed7895bc04a9d96fe3102a65b521f485cc5a4f3dd818afef9cef\", repo tag \"registry.k8s.io/pause:3.8\", repo digest \"registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d\", size \"268403\" in 536.486475ms" Nov 8 00:05:52.795471 containerd[2009]: time="2025-11-08T00:05:52.795408491Z" level=info msg="Pulled image \"registry.k8s.io/pause:3.8\" with image id \"sha256:4e42fb3c9d90ed7895bc04a9d96fe3102a65b521f485cc5a4f3dd818afef9cef\", repo tag \"registry.k8s.io/pause:3.8\", repo digest \"registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d\", size \"268403\" in 560.440251ms" Nov 8 00:05:52.816323 kubelet[2864]: W1108 00:05:52.815436 2864 reflector.go:569] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: Get "https://172.31.23.87:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": dial tcp 172.31.23.87:6443: connect: connection refused Nov 8 00:05:52.816323 kubelet[2864]: E1108 00:05:52.815506 2864 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: Get \"https://172.31.23.87:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0\": dial tcp 172.31.23.87:6443: connect: connection refused" logger="UnhandledError" Nov 8 00:05:53.085888 containerd[2009]: time="2025-11-08T00:05:53.082153964Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1 Nov 8 00:05:53.085888 containerd[2009]: time="2025-11-08T00:05:53.083373740Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1 Nov 8 00:05:53.085888 containerd[2009]: time="2025-11-08T00:05:53.083403488Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Nov 8 00:05:53.085888 containerd[2009]: time="2025-11-08T00:05:53.083745200Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Nov 8 00:05:53.090159 containerd[2009]: time="2025-11-08T00:05:53.089640068Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1 Nov 8 00:05:53.090159 containerd[2009]: time="2025-11-08T00:05:53.089771624Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1 Nov 8 00:05:53.090159 containerd[2009]: time="2025-11-08T00:05:53.089811596Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Nov 8 00:05:53.090159 containerd[2009]: time="2025-11-08T00:05:53.089996108Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Nov 8 00:05:53.096770 containerd[2009]: time="2025-11-08T00:05:53.096620684Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1 Nov 8 00:05:53.096934 containerd[2009]: time="2025-11-08T00:05:53.096739844Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1 Nov 8 00:05:53.096934 containerd[2009]: time="2025-11-08T00:05:53.096779624Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Nov 8 00:05:53.097107 containerd[2009]: time="2025-11-08T00:05:53.096961988Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Nov 8 00:05:53.136244 systemd[1]: Started cri-containerd-a1e798e67d89381e5dfd8bb8632e9d45087555f70e44d2b88aa7016d193a7645.scope - libcontainer container a1e798e67d89381e5dfd8bb8632e9d45087555f70e44d2b88aa7016d193a7645. Nov 8 00:05:53.154661 kubelet[2864]: E1108 00:05:53.154516 2864 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://172.31.23.87:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-172-31-23-87?timeout=10s\": dial tcp 172.31.23.87:6443: connect: connection refused" interval="1.6s" Nov 8 00:05:53.154735 systemd[1]: Started cri-containerd-9a81a9be5deff120f3a0676587d694883728eeeb68c7d26a97af3f4fc1d821e2.scope - libcontainer container 9a81a9be5deff120f3a0676587d694883728eeeb68c7d26a97af3f4fc1d821e2. Nov 8 00:05:53.180312 systemd[1]: Started cri-containerd-422e8499c35a693de13ea3629ab4a100917d2fe2321e1a4c30c2d8c135ad67d2.scope - libcontainer container 422e8499c35a693de13ea3629ab4a100917d2fe2321e1a4c30c2d8c135ad67d2. Nov 8 00:05:53.187776 kubelet[2864]: W1108 00:05:53.187677 2864 reflector.go:569] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: Get "https://172.31.23.87:6443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&limit=500&resourceVersion=0": dial tcp 172.31.23.87:6443: connect: connection refused Nov 8 00:05:53.187911 kubelet[2864]: E1108 00:05:53.187799 2864 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: Get \"https://172.31.23.87:6443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&limit=500&resourceVersion=0\": dial tcp 172.31.23.87:6443: connect: connection refused" logger="UnhandledError" Nov 8 00:05:53.280063 kubelet[2864]: W1108 00:05:53.273225 2864 reflector.go:569] k8s.io/client-go/informers/factory.go:160: failed to list *v1.RuntimeClass: Get "https://172.31.23.87:6443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0": dial tcp 172.31.23.87:6443: connect: connection refused Nov 8 00:05:53.280063 kubelet[2864]: E1108 00:05:53.277252 2864 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.RuntimeClass: failed to list *v1.RuntimeClass: Get \"https://172.31.23.87:6443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0\": dial tcp 172.31.23.87:6443: connect: connection refused" logger="UnhandledError" Nov 8 00:05:53.284976 containerd[2009]: time="2025-11-08T00:05:53.284303145Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-scheduler-ip-172-31-23-87,Uid:16543b13325f32fc2e4982b25aa473c4,Namespace:kube-system,Attempt:0,} returns sandbox id \"9a81a9be5deff120f3a0676587d694883728eeeb68c7d26a97af3f4fc1d821e2\"" Nov 8 00:05:53.293867 containerd[2009]: time="2025-11-08T00:05:53.293813421Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-controller-manager-ip-172-31-23-87,Uid:3c99959cc6545159218ce79725ba7605,Namespace:kube-system,Attempt:0,} returns sandbox id \"a1e798e67d89381e5dfd8bb8632e9d45087555f70e44d2b88aa7016d193a7645\"" Nov 8 00:05:53.301901 containerd[2009]: time="2025-11-08T00:05:53.301068993Z" level=info msg="CreateContainer within sandbox \"9a81a9be5deff120f3a0676587d694883728eeeb68c7d26a97af3f4fc1d821e2\" for container &ContainerMetadata{Name:kube-scheduler,Attempt:0,}" Nov 8 00:05:53.303007 containerd[2009]: time="2025-11-08T00:05:53.302956665Z" level=info msg="CreateContainer within sandbox \"a1e798e67d89381e5dfd8bb8632e9d45087555f70e44d2b88aa7016d193a7645\" for container &ContainerMetadata{Name:kube-controller-manager,Attempt:0,}" Nov 8 00:05:53.309183 kubelet[2864]: W1108 00:05:53.309087 2864 reflector.go:569] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: Get "https://172.31.23.87:6443/api/v1/nodes?fieldSelector=metadata.name%3Dip-172-31-23-87&limit=500&resourceVersion=0": dial tcp 172.31.23.87:6443: connect: connection refused Nov 8 00:05:53.309356 kubelet[2864]: E1108 00:05:53.309198 2864 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: Get \"https://172.31.23.87:6443/api/v1/nodes?fieldSelector=metadata.name%3Dip-172-31-23-87&limit=500&resourceVersion=0\": dial tcp 172.31.23.87:6443: connect: connection refused" logger="UnhandledError" Nov 8 00:05:53.330205 containerd[2009]: time="2025-11-08T00:05:53.330048429Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-apiserver-ip-172-31-23-87,Uid:04e19e51e0f6a8ff54c4d23c23f1fe34,Namespace:kube-system,Attempt:0,} returns sandbox id \"422e8499c35a693de13ea3629ab4a100917d2fe2321e1a4c30c2d8c135ad67d2\"" Nov 8 00:05:53.335138 containerd[2009]: time="2025-11-08T00:05:53.334702305Z" level=info msg="CreateContainer within sandbox \"422e8499c35a693de13ea3629ab4a100917d2fe2321e1a4c30c2d8c135ad67d2\" for container &ContainerMetadata{Name:kube-apiserver,Attempt:0,}" Nov 8 00:05:53.343637 containerd[2009]: time="2025-11-08T00:05:53.343411161Z" level=info msg="CreateContainer within sandbox \"9a81a9be5deff120f3a0676587d694883728eeeb68c7d26a97af3f4fc1d821e2\" for &ContainerMetadata{Name:kube-scheduler,Attempt:0,} returns container id \"69ff106255d4b6c604a0a08b2a9dc83d10e091778e4c2e6e8ff753defc0cf853\"" Nov 8 00:05:53.345003 containerd[2009]: time="2025-11-08T00:05:53.344656221Z" level=info msg="StartContainer for \"69ff106255d4b6c604a0a08b2a9dc83d10e091778e4c2e6e8ff753defc0cf853\"" Nov 8 00:05:53.366858 containerd[2009]: time="2025-11-08T00:05:53.366521037Z" level=info msg="CreateContainer within sandbox \"a1e798e67d89381e5dfd8bb8632e9d45087555f70e44d2b88aa7016d193a7645\" for &ContainerMetadata{Name:kube-controller-manager,Attempt:0,} returns container id \"049c1e19def49391699667c035afadb137255eb0ae2341f6ddf11fe385d74f00\"" Nov 8 00:05:53.368293 containerd[2009]: time="2025-11-08T00:05:53.367761369Z" level=info msg="StartContainer for \"049c1e19def49391699667c035afadb137255eb0ae2341f6ddf11fe385d74f00\"" Nov 8 00:05:53.376220 containerd[2009]: time="2025-11-08T00:05:53.376143394Z" level=info msg="CreateContainer within sandbox \"422e8499c35a693de13ea3629ab4a100917d2fe2321e1a4c30c2d8c135ad67d2\" for &ContainerMetadata{Name:kube-apiserver,Attempt:0,} returns container id \"57ab23b8e3dd4e4cacb01fea884b65da167aff2ed9736120e28b5ca0b29feb5b\"" Nov 8 00:05:53.377840 containerd[2009]: time="2025-11-08T00:05:53.377787982Z" level=info msg="StartContainer for \"57ab23b8e3dd4e4cacb01fea884b65da167aff2ed9736120e28b5ca0b29feb5b\"" Nov 8 00:05:53.380599 kubelet[2864]: I1108 00:05:53.380548 2864 kubelet_node_status.go:75] "Attempting to register node" node="ip-172-31-23-87" Nov 8 00:05:53.381131 kubelet[2864]: E1108 00:05:53.381062 2864 kubelet_node_status.go:107] "Unable to register node with API server" err="Post \"https://172.31.23.87:6443/api/v1/nodes\": dial tcp 172.31.23.87:6443: connect: connection refused" node="ip-172-31-23-87" Nov 8 00:05:53.416942 systemd[1]: Started cri-containerd-69ff106255d4b6c604a0a08b2a9dc83d10e091778e4c2e6e8ff753defc0cf853.scope - libcontainer container 69ff106255d4b6c604a0a08b2a9dc83d10e091778e4c2e6e8ff753defc0cf853. Nov 8 00:05:53.454625 systemd[1]: Started cri-containerd-049c1e19def49391699667c035afadb137255eb0ae2341f6ddf11fe385d74f00.scope - libcontainer container 049c1e19def49391699667c035afadb137255eb0ae2341f6ddf11fe385d74f00. Nov 8 00:05:53.474852 systemd[1]: Started cri-containerd-57ab23b8e3dd4e4cacb01fea884b65da167aff2ed9736120e28b5ca0b29feb5b.scope - libcontainer container 57ab23b8e3dd4e4cacb01fea884b65da167aff2ed9736120e28b5ca0b29feb5b. Nov 8 00:05:53.557414 containerd[2009]: time="2025-11-08T00:05:53.557329954Z" level=info msg="StartContainer for \"69ff106255d4b6c604a0a08b2a9dc83d10e091778e4c2e6e8ff753defc0cf853\" returns successfully" Nov 8 00:05:53.621079 containerd[2009]: time="2025-11-08T00:05:53.620882531Z" level=info msg="StartContainer for \"049c1e19def49391699667c035afadb137255eb0ae2341f6ddf11fe385d74f00\" returns successfully" Nov 8 00:05:53.637600 containerd[2009]: time="2025-11-08T00:05:53.637095707Z" level=info msg="StartContainer for \"57ab23b8e3dd4e4cacb01fea884b65da167aff2ed9736120e28b5ca0b29feb5b\" returns successfully" Nov 8 00:05:53.667312 update_engine[1992]: I20251108 00:05:53.664523 1992 update_attempter.cc:509] Updating boot flags... Nov 8 00:05:53.822069 kubelet[2864]: E1108 00:05:53.821868 2864 kubelet.go:3190] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-172-31-23-87\" not found" node="ip-172-31-23-87" Nov 8 00:05:53.844864 kubelet[2864]: E1108 00:05:53.841872 2864 kubelet.go:3190] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-172-31-23-87\" not found" node="ip-172-31-23-87" Nov 8 00:05:53.844864 kubelet[2864]: E1108 00:05:53.844027 2864 certificate_manager.go:562] "Unhandled Error" err="kubernetes.io/kube-apiserver-client-kubelet: Failed while requesting a signed certificate from the control plane: cannot create certificate signing request: Post \"https://172.31.23.87:6443/apis/certificates.k8s.io/v1/certificatesigningrequests\": dial tcp 172.31.23.87:6443: connect: connection refused" logger="UnhandledError" Nov 8 00:05:53.856217 kubelet[2864]: E1108 00:05:53.856160 2864 kubelet.go:3190] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-172-31-23-87\" not found" node="ip-172-31-23-87" Nov 8 00:05:53.872329 kernel: BTRFS warning: duplicate device /dev/nvme0n1p3 devid 1 generation 37 scanned by (udev-worker) (3150) Nov 8 00:05:54.854316 kubelet[2864]: E1108 00:05:54.854246 2864 kubelet.go:3190] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-172-31-23-87\" not found" node="ip-172-31-23-87" Nov 8 00:05:54.854860 kubelet[2864]: E1108 00:05:54.854833 2864 kubelet.go:3190] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-172-31-23-87\" not found" node="ip-172-31-23-87" Nov 8 00:05:54.983634 kubelet[2864]: I1108 00:05:54.983586 2864 kubelet_node_status.go:75] "Attempting to register node" node="ip-172-31-23-87" Nov 8 00:05:55.855212 kubelet[2864]: E1108 00:05:55.855157 2864 kubelet.go:3190] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-172-31-23-87\" not found" node="ip-172-31-23-87" Nov 8 00:05:56.179871 kubelet[2864]: E1108 00:05:56.179739 2864 kubelet.go:3190] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-172-31-23-87\" not found" node="ip-172-31-23-87" Nov 8 00:05:58.105249 kubelet[2864]: E1108 00:05:58.105188 2864 kubelet.go:3190] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-172-31-23-87\" not found" node="ip-172-31-23-87" Nov 8 00:05:58.167421 kubelet[2864]: E1108 00:05:58.167355 2864 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-172-31-23-87\" not found" node="ip-172-31-23-87" Nov 8 00:05:58.171332 kubelet[2864]: I1108 00:05:58.171029 2864 kubelet_node_status.go:78] "Successfully registered node" node="ip-172-31-23-87" Nov 8 00:05:58.200253 kubelet[2864]: E1108 00:05:58.200099 2864 event.go:359] "Server rejected event (will not retry!)" err="namespaces \"default\" not found" event="&Event{ObjectMeta:{ip-172-31-23-87.1875df4d2b95be7d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-172-31-23-87,UID:ip-172-31-23-87,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-172-31-23-87,},FirstTimestamp:2025-11-08 00:05:51.722126973 +0000 UTC m=+0.850302905,LastTimestamp:2025-11-08 00:05:51.722126973 +0000 UTC m=+0.850302905,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-172-31-23-87,}" Nov 8 00:05:58.249214 kubelet[2864]: I1108 00:05:58.248716 2864 kubelet.go:3194] "Creating a mirror pod for static pod" pod="kube-system/kube-scheduler-ip-172-31-23-87" Nov 8 00:05:58.278240 kubelet[2864]: E1108 00:05:58.278188 2864 kubelet.go:3196] "Failed creating a mirror pod" err="pods \"kube-scheduler-ip-172-31-23-87\" is forbidden: no PriorityClass with name system-node-critical was found" pod="kube-system/kube-scheduler-ip-172-31-23-87" Nov 8 00:05:58.279927 kubelet[2864]: I1108 00:05:58.278506 2864 kubelet.go:3194] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-ip-172-31-23-87" Nov 8 00:05:58.291713 kubelet[2864]: E1108 00:05:58.291611 2864 kubelet.go:3196] "Failed creating a mirror pod" err="pods \"kube-apiserver-ip-172-31-23-87\" is forbidden: no PriorityClass with name system-node-critical was found" pod="kube-system/kube-apiserver-ip-172-31-23-87" Nov 8 00:05:58.291713 kubelet[2864]: I1108 00:05:58.291666 2864 kubelet.go:3194] "Creating a mirror pod for static pod" pod="kube-system/kube-controller-manager-ip-172-31-23-87" Nov 8 00:05:58.307226 kubelet[2864]: E1108 00:05:58.307159 2864 kubelet.go:3196] "Failed creating a mirror pod" err="pods \"kube-controller-manager-ip-172-31-23-87\" is forbidden: no PriorityClass with name system-node-critical was found" pod="kube-system/kube-controller-manager-ip-172-31-23-87" Nov 8 00:05:58.722328 kubelet[2864]: I1108 00:05:58.721908 2864 apiserver.go:52] "Watching apiserver" Nov 8 00:05:58.750332 kubelet[2864]: I1108 00:05:58.750251 2864 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Nov 8 00:06:00.342165 systemd[1]: Reloading requested from client PID 3241 ('systemctl') (unit session-9.scope)... Nov 8 00:06:00.342197 systemd[1]: Reloading... Nov 8 00:06:00.536311 zram_generator::config[3284]: No configuration found. Nov 8 00:06:00.788525 systemd[1]: /usr/lib/systemd/system/docker.socket:6: ListenStream= references a path below legacy directory /var/run/, updating /var/run/docker.sock → /run/docker.sock; please update the unit file accordingly. Nov 8 00:06:01.004889 systemd[1]: Reloading finished in 661 ms. Nov 8 00:06:01.086850 systemd[1]: Stopping kubelet.service - kubelet: The Kubernetes Node Agent... Nov 8 00:06:01.110197 systemd[1]: kubelet.service: Deactivated successfully. Nov 8 00:06:01.111400 systemd[1]: Stopped kubelet.service - kubelet: The Kubernetes Node Agent. Nov 8 00:06:01.111499 systemd[1]: kubelet.service: Consumed 1.654s CPU time, 129.9M memory peak, 0B memory swap peak. Nov 8 00:06:01.118824 systemd[1]: Starting kubelet.service - kubelet: The Kubernetes Node Agent... Nov 8 00:06:01.449324 systemd[1]: Started kubelet.service - kubelet: The Kubernetes Node Agent. Nov 8 00:06:01.471214 (kubelet)[3341]: kubelet.service: Referenced but unset environment variable evaluates to an empty string: KUBELET_EXTRA_ARGS Nov 8 00:06:01.565881 kubelet[3341]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 8 00:06:01.565881 kubelet[3341]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Nov 8 00:06:01.565881 kubelet[3341]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 8 00:06:01.566473 kubelet[3341]: I1108 00:06:01.566037 3341 server.go:215] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Nov 8 00:06:01.580850 kubelet[3341]: I1108 00:06:01.580768 3341 server.go:520] "Kubelet version" kubeletVersion="v1.32.4" Nov 8 00:06:01.580850 kubelet[3341]: I1108 00:06:01.580823 3341 server.go:522] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Nov 8 00:06:01.582899 kubelet[3341]: I1108 00:06:01.581435 3341 server.go:954] "Client rotation is on, will bootstrap in background" Nov 8 00:06:01.583954 kubelet[3341]: I1108 00:06:01.583912 3341 certificate_store.go:130] Loading cert/key pair from "/var/lib/kubelet/pki/kubelet-client-current.pem". Nov 8 00:06:01.593230 kubelet[3341]: I1108 00:06:01.592796 3341 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" Nov 8 00:06:01.605453 kubelet[3341]: E1108 00:06:01.605332 3341 log.go:32] "RuntimeConfig from runtime service failed" err="rpc error: code = Unimplemented desc = unknown method RuntimeConfig for service runtime.v1.RuntimeService" Nov 8 00:06:01.605453 kubelet[3341]: I1108 00:06:01.605427 3341 server.go:1421] "CRI implementation should be updated to support RuntimeConfig when KubeletCgroupDriverFromCRI feature gate has been enabled. Falling back to using cgroupDriver from kubelet config." Nov 8 00:06:01.610609 kubelet[3341]: I1108 00:06:01.610559 3341 server.go:772] "--cgroups-per-qos enabled, but --cgroup-root was not specified. defaulting to /" Nov 8 00:06:01.611019 kubelet[3341]: I1108 00:06:01.610956 3341 container_manager_linux.go:268] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Nov 8 00:06:01.611340 kubelet[3341]: I1108 00:06:01.611015 3341 container_manager_linux.go:273] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-172-31-23-87","RuntimeCgroupsName":"","SystemCgroupsName":"","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":false,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":null,"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"ExperimentalMemoryManagerPolicy":"None","ExperimentalMemoryManagerReservedMemory":null,"PodPidsLimit":-1,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Nov 8 00:06:01.611500 kubelet[3341]: I1108 00:06:01.611356 3341 topology_manager.go:138] "Creating topology manager with none policy" Nov 8 00:06:01.611500 kubelet[3341]: I1108 00:06:01.611378 3341 container_manager_linux.go:304] "Creating device plugin manager" Nov 8 00:06:01.611500 kubelet[3341]: I1108 00:06:01.611455 3341 state_mem.go:36] "Initialized new in-memory state store" Nov 8 00:06:01.616293 kubelet[3341]: I1108 00:06:01.611671 3341 kubelet.go:446] "Attempting to sync node with API server" Nov 8 00:06:01.616293 kubelet[3341]: I1108 00:06:01.611708 3341 kubelet.go:341] "Adding static pod path" path="/etc/kubernetes/manifests" Nov 8 00:06:01.616293 kubelet[3341]: I1108 00:06:01.611740 3341 kubelet.go:352] "Adding apiserver pod source" Nov 8 00:06:01.616293 kubelet[3341]: I1108 00:06:01.611760 3341 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Nov 8 00:06:01.616293 kubelet[3341]: I1108 00:06:01.614228 3341 kuberuntime_manager.go:269] "Container runtime initialized" containerRuntime="containerd" version="v1.7.21" apiVersion="v1" Nov 8 00:06:01.616293 kubelet[3341]: I1108 00:06:01.615481 3341 kubelet.go:890] "Not starting ClusterTrustBundle informer because we are in static kubelet mode" Nov 8 00:06:01.622308 kubelet[3341]: I1108 00:06:01.616698 3341 watchdog_linux.go:99] "Systemd watchdog is not enabled" Nov 8 00:06:01.622308 kubelet[3341]: I1108 00:06:01.616760 3341 server.go:1287] "Started kubelet" Nov 8 00:06:01.622308 kubelet[3341]: I1108 00:06:01.621165 3341 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Nov 8 00:06:01.633565 kubelet[3341]: I1108 00:06:01.633206 3341 server.go:169] "Starting to listen" address="0.0.0.0" port=10250 Nov 8 00:06:01.635005 kubelet[3341]: I1108 00:06:01.634949 3341 server.go:479] "Adding debug handlers to kubelet server" Nov 8 00:06:01.637366 kubelet[3341]: I1108 00:06:01.636709 3341 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Nov 8 00:06:01.637366 kubelet[3341]: I1108 00:06:01.637059 3341 server.go:243] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Nov 8 00:06:01.637563 kubelet[3341]: I1108 00:06:01.637446 3341 dynamic_serving_content.go:135] "Starting controller" name="kubelet-server-cert-files::/var/lib/kubelet/pki/kubelet.crt::/var/lib/kubelet/pki/kubelet.key" Nov 8 00:06:01.641807 kubelet[3341]: I1108 00:06:01.640478 3341 volume_manager.go:297] "Starting Kubelet Volume Manager" Nov 8 00:06:01.641807 kubelet[3341]: E1108 00:06:01.640827 3341 kubelet_node_status.go:466] "Error getting the current node from lister" err="node \"ip-172-31-23-87\" not found" Nov 8 00:06:01.647147 kubelet[3341]: I1108 00:06:01.644065 3341 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Nov 8 00:06:01.647147 kubelet[3341]: I1108 00:06:01.644358 3341 reconciler.go:26] "Reconciler: start to sync state" Nov 8 00:06:01.647857 kubelet[3341]: I1108 00:06:01.647766 3341 kubelet_network_linux.go:50] "Initialized iptables rules." protocol="IPv4" Nov 8 00:06:01.654419 kubelet[3341]: I1108 00:06:01.649967 3341 kubelet_network_linux.go:50] "Initialized iptables rules." protocol="IPv6" Nov 8 00:06:01.654419 kubelet[3341]: I1108 00:06:01.650017 3341 status_manager.go:227] "Starting to sync pod status with apiserver" Nov 8 00:06:01.654419 kubelet[3341]: I1108 00:06:01.650048 3341 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Nov 8 00:06:01.654419 kubelet[3341]: I1108 00:06:01.650063 3341 kubelet.go:2382] "Starting kubelet main sync loop" Nov 8 00:06:01.654419 kubelet[3341]: E1108 00:06:01.650137 3341 kubelet.go:2406] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Nov 8 00:06:01.691153 kubelet[3341]: I1108 00:06:01.690705 3341 factory.go:221] Registration of the systemd container factory successfully Nov 8 00:06:01.691153 kubelet[3341]: I1108 00:06:01.690900 3341 factory.go:219] Registration of the crio container factory failed: Get "http://%2Fvar%2Frun%2Fcrio%2Fcrio.sock/info": dial unix /var/run/crio/crio.sock: connect: no such file or directory Nov 8 00:06:01.710362 kubelet[3341]: I1108 00:06:01.707012 3341 factory.go:221] Registration of the containerd container factory successfully Nov 8 00:06:01.737243 kubelet[3341]: E1108 00:06:01.737203 3341 kubelet.go:1555] "Image garbage collection failed once. Stats initialization may not have completed yet" err="invalid capacity 0 on image filesystem" Nov 8 00:06:01.756659 kubelet[3341]: E1108 00:06:01.756605 3341 kubelet.go:2406] "Skipping pod synchronization" err="container runtime status check may not have completed yet" Nov 8 00:06:01.769344 kubelet[3341]: E1108 00:06:01.768932 3341 kubelet_node_status.go:466] "Error getting the current node from lister" err="node \"ip-172-31-23-87\" not found" Nov 8 00:06:01.856208 kubelet[3341]: I1108 00:06:01.856173 3341 cpu_manager.go:221] "Starting CPU manager" policy="none" Nov 8 00:06:01.856436 kubelet[3341]: I1108 00:06:01.856416 3341 cpu_manager.go:222] "Reconciling" reconcilePeriod="10s" Nov 8 00:06:01.856542 kubelet[3341]: I1108 00:06:01.856525 3341 state_mem.go:36] "Initialized new in-memory state store" Nov 8 00:06:01.856914 kubelet[3341]: I1108 00:06:01.856890 3341 state_mem.go:88] "Updated default CPUSet" cpuSet="" Nov 8 00:06:01.857112 kubelet[3341]: I1108 00:06:01.857071 3341 state_mem.go:96] "Updated CPUSet assignments" assignments={} Nov 8 00:06:01.857232 kubelet[3341]: I1108 00:06:01.857212 3341 policy_none.go:49] "None policy: Start" Nov 8 00:06:01.857708 kubelet[3341]: I1108 00:06:01.857354 3341 memory_manager.go:186] "Starting memorymanager" policy="None" Nov 8 00:06:01.857708 kubelet[3341]: I1108 00:06:01.857382 3341 state_mem.go:35] "Initializing new in-memory state store" Nov 8 00:06:01.857708 kubelet[3341]: I1108 00:06:01.857582 3341 state_mem.go:75] "Updated machine memory state" Nov 8 00:06:01.873230 kubelet[3341]: I1108 00:06:01.872176 3341 manager.go:519] "Failed to read data from checkpoint" checkpoint="kubelet_internal_checkpoint" err="checkpoint is not found" Nov 8 00:06:01.873230 kubelet[3341]: I1108 00:06:01.872528 3341 eviction_manager.go:189] "Eviction manager: starting control loop" Nov 8 00:06:01.873230 kubelet[3341]: I1108 00:06:01.872550 3341 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Nov 8 00:06:01.873230 kubelet[3341]: I1108 00:06:01.872953 3341 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Nov 8 00:06:01.880864 kubelet[3341]: E1108 00:06:01.880624 3341 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="no imagefs label for configured runtime" Nov 8 00:06:01.968874 kubelet[3341]: I1108 00:06:01.968806 3341 kubelet.go:3194] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-ip-172-31-23-87" Nov 8 00:06:01.971926 kubelet[3341]: I1108 00:06:01.969961 3341 kubelet.go:3194] "Creating a mirror pod for static pod" pod="kube-system/kube-scheduler-ip-172-31-23-87" Nov 8 00:06:01.971926 kubelet[3341]: I1108 00:06:01.970110 3341 kubelet.go:3194] "Creating a mirror pod for static pod" pod="kube-system/kube-controller-manager-ip-172-31-23-87" Nov 8 00:06:02.001189 kubelet[3341]: I1108 00:06:02.000887 3341 kubelet_node_status.go:75] "Attempting to register node" node="ip-172-31-23-87" Nov 8 00:06:02.018439 kubelet[3341]: I1108 00:06:02.016176 3341 kubelet_node_status.go:124] "Node was previously registered" node="ip-172-31-23-87" Nov 8 00:06:02.018439 kubelet[3341]: I1108 00:06:02.016330 3341 kubelet_node_status.go:78] "Successfully registered node" node="ip-172-31-23-87" Nov 8 00:06:02.071076 kubelet[3341]: I1108 00:06:02.071008 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-certs\" (UniqueName: \"kubernetes.io/host-path/04e19e51e0f6a8ff54c4d23c23f1fe34-ca-certs\") pod \"kube-apiserver-ip-172-31-23-87\" (UID: \"04e19e51e0f6a8ff54c4d23c23f1fe34\") " pod="kube-system/kube-apiserver-ip-172-31-23-87" Nov 8 00:06:02.071436 kubelet[3341]: I1108 00:06:02.071089 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"k8s-certs\" (UniqueName: \"kubernetes.io/host-path/04e19e51e0f6a8ff54c4d23c23f1fe34-k8s-certs\") pod \"kube-apiserver-ip-172-31-23-87\" (UID: \"04e19e51e0f6a8ff54c4d23c23f1fe34\") " pod="kube-system/kube-apiserver-ip-172-31-23-87" Nov 8 00:06:02.071436 kubelet[3341]: I1108 00:06:02.071141 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-share-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/04e19e51e0f6a8ff54c4d23c23f1fe34-usr-share-ca-certificates\") pod \"kube-apiserver-ip-172-31-23-87\" (UID: \"04e19e51e0f6a8ff54c4d23c23f1fe34\") " pod="kube-system/kube-apiserver-ip-172-31-23-87" Nov 8 00:06:02.071436 kubelet[3341]: I1108 00:06:02.071184 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-certs\" (UniqueName: \"kubernetes.io/host-path/3c99959cc6545159218ce79725ba7605-ca-certs\") pod \"kube-controller-manager-ip-172-31-23-87\" (UID: \"3c99959cc6545159218ce79725ba7605\") " pod="kube-system/kube-controller-manager-ip-172-31-23-87" Nov 8 00:06:02.071436 kubelet[3341]: I1108 00:06:02.071223 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"flexvolume-dir\" (UniqueName: \"kubernetes.io/host-path/3c99959cc6545159218ce79725ba7605-flexvolume-dir\") pod \"kube-controller-manager-ip-172-31-23-87\" (UID: \"3c99959cc6545159218ce79725ba7605\") " pod="kube-system/kube-controller-manager-ip-172-31-23-87" Nov 8 00:06:02.071436 kubelet[3341]: I1108 00:06:02.071260 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"k8s-certs\" (UniqueName: \"kubernetes.io/host-path/3c99959cc6545159218ce79725ba7605-k8s-certs\") pod \"kube-controller-manager-ip-172-31-23-87\" (UID: \"3c99959cc6545159218ce79725ba7605\") " pod="kube-system/kube-controller-manager-ip-172-31-23-87" Nov 8 00:06:02.071726 kubelet[3341]: I1108 00:06:02.071406 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeconfig\" (UniqueName: \"kubernetes.io/host-path/3c99959cc6545159218ce79725ba7605-kubeconfig\") pod \"kube-controller-manager-ip-172-31-23-87\" (UID: \"3c99959cc6545159218ce79725ba7605\") " pod="kube-system/kube-controller-manager-ip-172-31-23-87" Nov 8 00:06:02.071726 kubelet[3341]: I1108 00:06:02.071449 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-share-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/3c99959cc6545159218ce79725ba7605-usr-share-ca-certificates\") pod \"kube-controller-manager-ip-172-31-23-87\" (UID: \"3c99959cc6545159218ce79725ba7605\") " pod="kube-system/kube-controller-manager-ip-172-31-23-87" Nov 8 00:06:02.071726 kubelet[3341]: I1108 00:06:02.071491 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeconfig\" (UniqueName: \"kubernetes.io/host-path/16543b13325f32fc2e4982b25aa473c4-kubeconfig\") pod \"kube-scheduler-ip-172-31-23-87\" (UID: \"16543b13325f32fc2e4982b25aa473c4\") " pod="kube-system/kube-scheduler-ip-172-31-23-87" Nov 8 00:06:02.624968 kubelet[3341]: I1108 00:06:02.624579 3341 apiserver.go:52] "Watching apiserver" Nov 8 00:06:02.647425 kubelet[3341]: I1108 00:06:02.647359 3341 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Nov 8 00:06:02.738727 kubelet[3341]: I1108 00:06:02.738376 3341 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-controller-manager-ip-172-31-23-87" podStartSLOduration=1.738352424 podStartE2EDuration="1.738352424s" podCreationTimestamp="2025-11-08 00:06:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-08 00:06:02.7330481 +0000 UTC m=+1.249887679" watchObservedRunningTime="2025-11-08 00:06:02.738352424 +0000 UTC m=+1.255191967" Nov 8 00:06:02.738727 kubelet[3341]: I1108 00:06:02.738547 3341 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-scheduler-ip-172-31-23-87" podStartSLOduration=1.738538568 podStartE2EDuration="1.738538568s" podCreationTimestamp="2025-11-08 00:06:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-08 00:06:02.705787916 +0000 UTC m=+1.222627843" watchObservedRunningTime="2025-11-08 00:06:02.738538568 +0000 UTC m=+1.255378111" Nov 8 00:06:02.770994 kubelet[3341]: I1108 00:06:02.770677 3341 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-ip-172-31-23-87" podStartSLOduration=1.770651876 podStartE2EDuration="1.770651876s" podCreationTimestamp="2025-11-08 00:06:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-08 00:06:02.754476512 +0000 UTC m=+1.271316079" watchObservedRunningTime="2025-11-08 00:06:02.770651876 +0000 UTC m=+1.287491419" Nov 8 00:06:02.809779 kubelet[3341]: I1108 00:06:02.809742 3341 kubelet.go:3194] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-ip-172-31-23-87" Nov 8 00:06:02.812022 kubelet[3341]: I1108 00:06:02.811808 3341 kubelet.go:3194] "Creating a mirror pod for static pod" pod="kube-system/kube-scheduler-ip-172-31-23-87" Nov 8 00:06:02.834855 kubelet[3341]: E1108 00:06:02.834073 3341 kubelet.go:3196] "Failed creating a mirror pod" err="pods \"kube-apiserver-ip-172-31-23-87\" already exists" pod="kube-system/kube-apiserver-ip-172-31-23-87" Nov 8 00:06:02.836563 kubelet[3341]: E1108 00:06:02.835942 3341 kubelet.go:3196] "Failed creating a mirror pod" err="pods \"kube-scheduler-ip-172-31-23-87\" already exists" pod="kube-system/kube-scheduler-ip-172-31-23-87" Nov 8 00:06:06.740516 kubelet[3341]: I1108 00:06:06.740458 3341 kuberuntime_manager.go:1702] "Updating runtime config through cri with podcidr" CIDR="192.168.0.0/24" Nov 8 00:06:06.743932 kubelet[3341]: I1108 00:06:06.742608 3341 kubelet_network.go:61] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="192.168.0.0/24" Nov 8 00:06:06.744025 containerd[2009]: time="2025-11-08T00:06:06.741320568Z" level=info msg="No cni config template is specified, wait for other system components to drop the config." Nov 8 00:06:07.104896 systemd[1]: Created slice kubepods-besteffort-pod3ac41a79_6f3a_45e2_9031_d6f46483a59e.slice - libcontainer container kubepods-besteffort-pod3ac41a79_6f3a_45e2_9031_d6f46483a59e.slice. Nov 8 00:06:07.201431 kubelet[3341]: I1108 00:06:07.201355 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-proxy\" (UniqueName: \"kubernetes.io/configmap/3ac41a79-6f3a-45e2-9031-d6f46483a59e-kube-proxy\") pod \"kube-proxy-pprb7\" (UID: \"3ac41a79-6f3a-45e2-9031-d6f46483a59e\") " pod="kube-system/kube-proxy-pprb7" Nov 8 00:06:07.201431 kubelet[3341]: I1108 00:06:07.201419 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3ac41a79-6f3a-45e2-9031-d6f46483a59e-lib-modules\") pod \"kube-proxy-pprb7\" (UID: \"3ac41a79-6f3a-45e2-9031-d6f46483a59e\") " pod="kube-system/kube-proxy-pprb7" Nov 8 00:06:07.201645 kubelet[3341]: I1108 00:06:07.201468 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smsvk\" (UniqueName: \"kubernetes.io/projected/3ac41a79-6f3a-45e2-9031-d6f46483a59e-kube-api-access-smsvk\") pod \"kube-proxy-pprb7\" (UID: \"3ac41a79-6f3a-45e2-9031-d6f46483a59e\") " pod="kube-system/kube-proxy-pprb7" Nov 8 00:06:07.201645 kubelet[3341]: I1108 00:06:07.201521 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/3ac41a79-6f3a-45e2-9031-d6f46483a59e-xtables-lock\") pod \"kube-proxy-pprb7\" (UID: \"3ac41a79-6f3a-45e2-9031-d6f46483a59e\") " pod="kube-system/kube-proxy-pprb7" Nov 8 00:06:07.313311 kubelet[3341]: E1108 00:06:07.312976 3341 projected.go:288] Couldn't get configMap kube-system/kube-root-ca.crt: configmap "kube-root-ca.crt" not found Nov 8 00:06:07.313311 kubelet[3341]: E1108 00:06:07.313024 3341 projected.go:194] Error preparing data for projected volume kube-api-access-smsvk for pod kube-system/kube-proxy-pprb7: configmap "kube-root-ca.crt" not found Nov 8 00:06:07.313311 kubelet[3341]: E1108 00:06:07.313153 3341 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ac41a79-6f3a-45e2-9031-d6f46483a59e-kube-api-access-smsvk podName:3ac41a79-6f3a-45e2-9031-d6f46483a59e nodeName:}" failed. No retries permitted until 2025-11-08 00:06:07.813116155 +0000 UTC m=+6.329955698 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-smsvk" (UniqueName: "kubernetes.io/projected/3ac41a79-6f3a-45e2-9031-d6f46483a59e-kube-api-access-smsvk") pod "kube-proxy-pprb7" (UID: "3ac41a79-6f3a-45e2-9031-d6f46483a59e") : configmap "kube-root-ca.crt" not found Nov 8 00:06:07.902219 kubelet[3341]: I1108 00:06:07.902142 3341 status_manager.go:890] "Failed to get status for pod" podUID="131b5a1e-bd2c-4b09-a735-feb68f8d5010" pod="tigera-operator/tigera-operator-7dcd859c48-mgbdf" err="pods \"tigera-operator-7dcd859c48-mgbdf\" is forbidden: User \"system:node:ip-172-31-23-87\" cannot get resource \"pods\" in API group \"\" in the namespace \"tigera-operator\": no relationship found between node 'ip-172-31-23-87' and this object" Nov 8 00:06:07.912534 systemd[1]: Created slice kubepods-besteffort-pod131b5a1e_bd2c_4b09_a735_feb68f8d5010.slice - libcontainer container kubepods-besteffort-pod131b5a1e_bd2c_4b09_a735_feb68f8d5010.slice. Nov 8 00:06:08.007196 kubelet[3341]: I1108 00:06:08.007140 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-calico\" (UniqueName: \"kubernetes.io/host-path/131b5a1e-bd2c-4b09-a735-feb68f8d5010-var-lib-calico\") pod \"tigera-operator-7dcd859c48-mgbdf\" (UID: \"131b5a1e-bd2c-4b09-a735-feb68f8d5010\") " pod="tigera-operator/tigera-operator-7dcd859c48-mgbdf" Nov 8 00:06:08.007538 kubelet[3341]: I1108 00:06:08.007510 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sjcl\" (UniqueName: \"kubernetes.io/projected/131b5a1e-bd2c-4b09-a735-feb68f8d5010-kube-api-access-5sjcl\") pod \"tigera-operator-7dcd859c48-mgbdf\" (UID: \"131b5a1e-bd2c-4b09-a735-feb68f8d5010\") " pod="tigera-operator/tigera-operator-7dcd859c48-mgbdf" Nov 8 00:06:08.019310 containerd[2009]: time="2025-11-08T00:06:08.018643930Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-proxy-pprb7,Uid:3ac41a79-6f3a-45e2-9031-d6f46483a59e,Namespace:kube-system,Attempt:0,}" Nov 8 00:06:08.069489 containerd[2009]: time="2025-11-08T00:06:08.068697587Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1 Nov 8 00:06:08.069489 containerd[2009]: time="2025-11-08T00:06:08.068856083Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1 Nov 8 00:06:08.069489 containerd[2009]: time="2025-11-08T00:06:08.068960579Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Nov 8 00:06:08.069489 containerd[2009]: time="2025-11-08T00:06:08.069189083Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Nov 8 00:06:08.117622 systemd[1]: Started cri-containerd-83f5c390a54bdf236a4c9fb76a4a8a50e5f3a30333f2ed0ea302ffe5df838133.scope - libcontainer container 83f5c390a54bdf236a4c9fb76a4a8a50e5f3a30333f2ed0ea302ffe5df838133. Nov 8 00:06:08.190385 containerd[2009]: time="2025-11-08T00:06:08.190008995Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-proxy-pprb7,Uid:3ac41a79-6f3a-45e2-9031-d6f46483a59e,Namespace:kube-system,Attempt:0,} returns sandbox id \"83f5c390a54bdf236a4c9fb76a4a8a50e5f3a30333f2ed0ea302ffe5df838133\"" Nov 8 00:06:08.199290 containerd[2009]: time="2025-11-08T00:06:08.198956327Z" level=info msg="CreateContainer within sandbox \"83f5c390a54bdf236a4c9fb76a4a8a50e5f3a30333f2ed0ea302ffe5df838133\" for container &ContainerMetadata{Name:kube-proxy,Attempt:0,}" Nov 8 00:06:08.225797 containerd[2009]: time="2025-11-08T00:06:08.225658751Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:tigera-operator-7dcd859c48-mgbdf,Uid:131b5a1e-bd2c-4b09-a735-feb68f8d5010,Namespace:tigera-operator,Attempt:0,}" Nov 8 00:06:08.236647 containerd[2009]: time="2025-11-08T00:06:08.236442371Z" level=info msg="CreateContainer within sandbox \"83f5c390a54bdf236a4c9fb76a4a8a50e5f3a30333f2ed0ea302ffe5df838133\" for &ContainerMetadata{Name:kube-proxy,Attempt:0,} returns container id \"faf5f938445f06e92220d6200117cfa82f6d3ff01c851caeca57cc41cb9a3e7a\"" Nov 8 00:06:08.238014 containerd[2009]: time="2025-11-08T00:06:08.237934523Z" level=info msg="StartContainer for \"faf5f938445f06e92220d6200117cfa82f6d3ff01c851caeca57cc41cb9a3e7a\"" Nov 8 00:06:08.304395 systemd[1]: Started cri-containerd-faf5f938445f06e92220d6200117cfa82f6d3ff01c851caeca57cc41cb9a3e7a.scope - libcontainer container faf5f938445f06e92220d6200117cfa82f6d3ff01c851caeca57cc41cb9a3e7a. Nov 8 00:06:08.306785 containerd[2009]: time="2025-11-08T00:06:08.305210124Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1 Nov 8 00:06:08.306785 containerd[2009]: time="2025-11-08T00:06:08.305354856Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1 Nov 8 00:06:08.306785 containerd[2009]: time="2025-11-08T00:06:08.305381256Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Nov 8 00:06:08.307921 containerd[2009]: time="2025-11-08T00:06:08.307716636Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Nov 8 00:06:08.358609 systemd[1]: Started cri-containerd-8cf29354dfb7547e6970712c07d29dd964cfb60fc0cf4aa2fedf62d9bfda2cb4.scope - libcontainer container 8cf29354dfb7547e6970712c07d29dd964cfb60fc0cf4aa2fedf62d9bfda2cb4. Nov 8 00:06:08.385927 containerd[2009]: time="2025-11-08T00:06:08.385064724Z" level=info msg="StartContainer for \"faf5f938445f06e92220d6200117cfa82f6d3ff01c851caeca57cc41cb9a3e7a\" returns successfully" Nov 8 00:06:08.455017 containerd[2009]: time="2025-11-08T00:06:08.454612824Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:tigera-operator-7dcd859c48-mgbdf,Uid:131b5a1e-bd2c-4b09-a735-feb68f8d5010,Namespace:tigera-operator,Attempt:0,} returns sandbox id \"8cf29354dfb7547e6970712c07d29dd964cfb60fc0cf4aa2fedf62d9bfda2cb4\"" Nov 8 00:06:08.461315 containerd[2009]: time="2025-11-08T00:06:08.460491756Z" level=info msg="PullImage \"quay.io/tigera/operator:v1.38.7\"" Nov 8 00:06:08.853988 kubelet[3341]: I1108 00:06:08.853898 3341 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-proxy-pprb7" podStartSLOduration=1.853873538 podStartE2EDuration="1.853873538s" podCreationTimestamp="2025-11-08 00:06:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-08 00:06:08.853640222 +0000 UTC m=+7.370479789" watchObservedRunningTime="2025-11-08 00:06:08.853873538 +0000 UTC m=+7.370713117" Nov 8 00:06:09.951826 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount2856128800.mount: Deactivated successfully. Nov 8 00:06:10.719817 containerd[2009]: time="2025-11-08T00:06:10.719736004Z" level=info msg="ImageCreate event name:\"quay.io/tigera/operator:v1.38.7\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 8 00:06:10.721714 containerd[2009]: time="2025-11-08T00:06:10.721632856Z" level=info msg="stop pulling image quay.io/tigera/operator:v1.38.7: active requests=0, bytes read=22152004" Nov 8 00:06:10.724303 containerd[2009]: time="2025-11-08T00:06:10.724198204Z" level=info msg="ImageCreate event name:\"sha256:19f52e4b7ea471a91d4186e9701288b905145dc20d4928cbbf2eac8d9dfce54b\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 8 00:06:10.729869 containerd[2009]: time="2025-11-08T00:06:10.729774160Z" level=info msg="ImageCreate event name:\"quay.io/tigera/operator@sha256:1b629a1403f5b6d7243f7dd523d04b8a50352a33c1d4d6970b6002a8733acf2e\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 8 00:06:10.731562 containerd[2009]: time="2025-11-08T00:06:10.731359744Z" level=info msg="Pulled image \"quay.io/tigera/operator:v1.38.7\" with image id \"sha256:19f52e4b7ea471a91d4186e9701288b905145dc20d4928cbbf2eac8d9dfce54b\", repo tag \"quay.io/tigera/operator:v1.38.7\", repo digest \"quay.io/tigera/operator@sha256:1b629a1403f5b6d7243f7dd523d04b8a50352a33c1d4d6970b6002a8733acf2e\", size \"22147999\" in 2.270808468s" Nov 8 00:06:10.731562 containerd[2009]: time="2025-11-08T00:06:10.731420176Z" level=info msg="PullImage \"quay.io/tigera/operator:v1.38.7\" returns image reference \"sha256:19f52e4b7ea471a91d4186e9701288b905145dc20d4928cbbf2eac8d9dfce54b\"" Nov 8 00:06:10.739415 containerd[2009]: time="2025-11-08T00:06:10.739335832Z" level=info msg="CreateContainer within sandbox \"8cf29354dfb7547e6970712c07d29dd964cfb60fc0cf4aa2fedf62d9bfda2cb4\" for container &ContainerMetadata{Name:tigera-operator,Attempt:0,}" Nov 8 00:06:10.765049 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount3611159497.mount: Deactivated successfully. Nov 8 00:06:10.775540 containerd[2009]: time="2025-11-08T00:06:10.775458352Z" level=info msg="CreateContainer within sandbox \"8cf29354dfb7547e6970712c07d29dd964cfb60fc0cf4aa2fedf62d9bfda2cb4\" for &ContainerMetadata{Name:tigera-operator,Attempt:0,} returns container id \"fdced88e2c26a58b82b0f0e3d741843118b2e2952995d15a51957b5a3d490e67\"" Nov 8 00:06:10.776751 containerd[2009]: time="2025-11-08T00:06:10.776679172Z" level=info msg="StartContainer for \"fdced88e2c26a58b82b0f0e3d741843118b2e2952995d15a51957b5a3d490e67\"" Nov 8 00:06:10.837577 systemd[1]: Started cri-containerd-fdced88e2c26a58b82b0f0e3d741843118b2e2952995d15a51957b5a3d490e67.scope - libcontainer container fdced88e2c26a58b82b0f0e3d741843118b2e2952995d15a51957b5a3d490e67. Nov 8 00:06:10.892992 containerd[2009]: time="2025-11-08T00:06:10.892802729Z" level=info msg="StartContainer for \"fdced88e2c26a58b82b0f0e3d741843118b2e2952995d15a51957b5a3d490e67\" returns successfully" Nov 8 00:06:10.954041 systemd[1]: run-containerd-runc-k8s.io-fdced88e2c26a58b82b0f0e3d741843118b2e2952995d15a51957b5a3d490e67-runc.NU13fZ.mount: Deactivated successfully. Nov 8 00:06:19.703021 sudo[2359]: pam_unix(sudo:session): session closed for user root Nov 8 00:06:19.728868 sshd[2350]: pam_unix(sshd:session): session closed for user core Nov 8 00:06:19.738185 systemd[1]: session-9.scope: Deactivated successfully. Nov 8 00:06:19.738588 systemd[1]: session-9.scope: Consumed 12.206s CPU time, 149.6M memory peak, 0B memory swap peak. Nov 8 00:06:19.744763 systemd[1]: sshd@8-172.31.23.87:22-139.178.89.65:37646.service: Deactivated successfully. Nov 8 00:06:19.755615 systemd-logind[1991]: Session 9 logged out. Waiting for processes to exit. Nov 8 00:06:19.759945 systemd-logind[1991]: Removed session 9. Nov 8 00:06:43.085339 kubelet[3341]: I1108 00:06:43.082699 3341 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="tigera-operator/tigera-operator-7dcd859c48-mgbdf" podStartSLOduration=33.807712652 podStartE2EDuration="36.082646504s" podCreationTimestamp="2025-11-08 00:06:07 +0000 UTC" firstStartedPulling="2025-11-08 00:06:08.458204988 +0000 UTC m=+6.975044519" lastFinishedPulling="2025-11-08 00:06:10.733138828 +0000 UTC m=+9.249978371" observedRunningTime="2025-11-08 00:06:11.882988205 +0000 UTC m=+10.399827772" watchObservedRunningTime="2025-11-08 00:06:43.082646504 +0000 UTC m=+41.599486047" Nov 8 00:06:43.110565 systemd[1]: Created slice kubepods-besteffort-pod52fbe16c_7845_4439_808e_ac949e036983.slice - libcontainer container kubepods-besteffort-pod52fbe16c_7845_4439_808e_ac949e036983.slice. Nov 8 00:06:43.157345 kubelet[3341]: I1108 00:06:43.157216 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tigera-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52fbe16c-7845-4439-808e-ac949e036983-tigera-ca-bundle\") pod \"calico-typha-548b6fc7d4-mht5m\" (UID: \"52fbe16c-7845-4439-808e-ac949e036983\") " pod="calico-system/calico-typha-548b6fc7d4-mht5m" Nov 8 00:06:43.159906 kubelet[3341]: I1108 00:06:43.159447 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"typha-certs\" (UniqueName: \"kubernetes.io/secret/52fbe16c-7845-4439-808e-ac949e036983-typha-certs\") pod \"calico-typha-548b6fc7d4-mht5m\" (UID: \"52fbe16c-7845-4439-808e-ac949e036983\") " pod="calico-system/calico-typha-548b6fc7d4-mht5m" Nov 8 00:06:43.159906 kubelet[3341]: I1108 00:06:43.159625 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsszx\" (UniqueName: \"kubernetes.io/projected/52fbe16c-7845-4439-808e-ac949e036983-kube-api-access-wsszx\") pod \"calico-typha-548b6fc7d4-mht5m\" (UID: \"52fbe16c-7845-4439-808e-ac949e036983\") " pod="calico-system/calico-typha-548b6fc7d4-mht5m" Nov 8 00:06:43.296590 systemd[1]: Created slice kubepods-besteffort-pode3b816b1_4a5c_4819_85de_f1312d27289b.slice - libcontainer container kubepods-besteffort-pode3b816b1_4a5c_4819_85de_f1312d27289b.slice. Nov 8 00:06:43.361489 kubelet[3341]: I1108 00:06:43.360656 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-net-dir\" (UniqueName: \"kubernetes.io/host-path/e3b816b1-4a5c-4819-85de-f1312d27289b-cni-net-dir\") pod \"calico-node-4gw4n\" (UID: \"e3b816b1-4a5c-4819-85de-f1312d27289b\") " pod="calico-system/calico-node-4gw4n" Nov 8 00:06:43.361489 kubelet[3341]: I1108 00:06:43.360724 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"policysync\" (UniqueName: \"kubernetes.io/host-path/e3b816b1-4a5c-4819-85de-f1312d27289b-policysync\") pod \"calico-node-4gw4n\" (UID: \"e3b816b1-4a5c-4819-85de-f1312d27289b\") " pod="calico-system/calico-node-4gw4n" Nov 8 00:06:43.361489 kubelet[3341]: I1108 00:06:43.360770 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-bin-dir\" (UniqueName: \"kubernetes.io/host-path/e3b816b1-4a5c-4819-85de-f1312d27289b-cni-bin-dir\") pod \"calico-node-4gw4n\" (UID: \"e3b816b1-4a5c-4819-85de-f1312d27289b\") " pod="calico-system/calico-node-4gw4n" Nov 8 00:06:43.361489 kubelet[3341]: I1108 00:06:43.360807 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-run-calico\" (UniqueName: \"kubernetes.io/host-path/e3b816b1-4a5c-4819-85de-f1312d27289b-var-run-calico\") pod \"calico-node-4gw4n\" (UID: \"e3b816b1-4a5c-4819-85de-f1312d27289b\") " pod="calico-system/calico-node-4gw4n" Nov 8 00:06:43.361489 kubelet[3341]: I1108 00:06:43.360846 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/e3b816b1-4a5c-4819-85de-f1312d27289b-xtables-lock\") pod \"calico-node-4gw4n\" (UID: \"e3b816b1-4a5c-4819-85de-f1312d27289b\") " pod="calico-system/calico-node-4gw4n" Nov 8 00:06:43.361870 kubelet[3341]: I1108 00:06:43.360908 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-certs\" (UniqueName: \"kubernetes.io/secret/e3b816b1-4a5c-4819-85de-f1312d27289b-node-certs\") pod \"calico-node-4gw4n\" (UID: \"e3b816b1-4a5c-4819-85de-f1312d27289b\") " pod="calico-system/calico-node-4gw4n" Nov 8 00:06:43.361870 kubelet[3341]: I1108 00:06:43.360970 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9k92\" (UniqueName: \"kubernetes.io/projected/e3b816b1-4a5c-4819-85de-f1312d27289b-kube-api-access-q9k92\") pod \"calico-node-4gw4n\" (UID: \"e3b816b1-4a5c-4819-85de-f1312d27289b\") " pod="calico-system/calico-node-4gw4n" Nov 8 00:06:43.361870 kubelet[3341]: I1108 00:06:43.361014 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"flexvol-driver-host\" (UniqueName: \"kubernetes.io/host-path/e3b816b1-4a5c-4819-85de-f1312d27289b-flexvol-driver-host\") pod \"calico-node-4gw4n\" (UID: \"e3b816b1-4a5c-4819-85de-f1312d27289b\") " pod="calico-system/calico-node-4gw4n" Nov 8 00:06:43.361870 kubelet[3341]: I1108 00:06:43.361052 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-calico\" (UniqueName: \"kubernetes.io/host-path/e3b816b1-4a5c-4819-85de-f1312d27289b-var-lib-calico\") pod \"calico-node-4gw4n\" (UID: \"e3b816b1-4a5c-4819-85de-f1312d27289b\") " pod="calico-system/calico-node-4gw4n" Nov 8 00:06:43.361870 kubelet[3341]: I1108 00:06:43.361091 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-log-dir\" (UniqueName: \"kubernetes.io/host-path/e3b816b1-4a5c-4819-85de-f1312d27289b-cni-log-dir\") pod \"calico-node-4gw4n\" (UID: \"e3b816b1-4a5c-4819-85de-f1312d27289b\") " pod="calico-system/calico-node-4gw4n" Nov 8 00:06:43.362134 kubelet[3341]: I1108 00:06:43.361132 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e3b816b1-4a5c-4819-85de-f1312d27289b-lib-modules\") pod \"calico-node-4gw4n\" (UID: \"e3b816b1-4a5c-4819-85de-f1312d27289b\") " pod="calico-system/calico-node-4gw4n" Nov 8 00:06:43.362134 kubelet[3341]: I1108 00:06:43.361166 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tigera-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3b816b1-4a5c-4819-85de-f1312d27289b-tigera-ca-bundle\") pod \"calico-node-4gw4n\" (UID: \"e3b816b1-4a5c-4819-85de-f1312d27289b\") " pod="calico-system/calico-node-4gw4n" Nov 8 00:06:43.389173 kubelet[3341]: E1108 00:06:43.389067 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized" pod="calico-system/csi-node-driver-8rk2x" podUID="0fc7336a-4c45-40ec-b634-101ce08e1be1" Nov 8 00:06:43.465324 kubelet[3341]: I1108 00:06:43.462131 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0fc7336a-4c45-40ec-b634-101ce08e1be1-registration-dir\") pod \"csi-node-driver-8rk2x\" (UID: \"0fc7336a-4c45-40ec-b634-101ce08e1be1\") " pod="calico-system/csi-node-driver-8rk2x" Nov 8 00:06:43.465324 kubelet[3341]: I1108 00:06:43.462204 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmvgp\" (UniqueName: \"kubernetes.io/projected/0fc7336a-4c45-40ec-b634-101ce08e1be1-kube-api-access-cmvgp\") pod \"csi-node-driver-8rk2x\" (UID: \"0fc7336a-4c45-40ec-b634-101ce08e1be1\") " pod="calico-system/csi-node-driver-8rk2x" Nov 8 00:06:43.465324 kubelet[3341]: I1108 00:06:43.463958 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0fc7336a-4c45-40ec-b634-101ce08e1be1-socket-dir\") pod \"csi-node-driver-8rk2x\" (UID: \"0fc7336a-4c45-40ec-b634-101ce08e1be1\") " pod="calico-system/csi-node-driver-8rk2x" Nov 8 00:06:43.465725 containerd[2009]: time="2025-11-08T00:06:43.462676186Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-typha-548b6fc7d4-mht5m,Uid:52fbe16c-7845-4439-808e-ac949e036983,Namespace:calico-system,Attempt:0,}" Nov 8 00:06:43.466411 kubelet[3341]: I1108 00:06:43.466114 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0fc7336a-4c45-40ec-b634-101ce08e1be1-kubelet-dir\") pod \"csi-node-driver-8rk2x\" (UID: \"0fc7336a-4c45-40ec-b634-101ce08e1be1\") " pod="calico-system/csi-node-driver-8rk2x" Nov 8 00:06:43.466411 kubelet[3341]: I1108 00:06:43.466173 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"varrun\" (UniqueName: \"kubernetes.io/host-path/0fc7336a-4c45-40ec-b634-101ce08e1be1-varrun\") pod \"csi-node-driver-8rk2x\" (UID: \"0fc7336a-4c45-40ec-b634-101ce08e1be1\") " pod="calico-system/csi-node-driver-8rk2x" Nov 8 00:06:43.469869 kubelet[3341]: E1108 00:06:43.469808 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:43.470000 kubelet[3341]: W1108 00:06:43.469854 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:43.470099 kubelet[3341]: E1108 00:06:43.470020 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:43.481671 kubelet[3341]: E1108 00:06:43.481518 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:43.481671 kubelet[3341]: W1108 00:06:43.481556 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:43.481671 kubelet[3341]: E1108 00:06:43.481591 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:43.545697 kubelet[3341]: E1108 00:06:43.545646 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:43.545697 kubelet[3341]: W1108 00:06:43.545691 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:43.545960 kubelet[3341]: E1108 00:06:43.545752 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:43.549819 containerd[2009]: time="2025-11-08T00:06:43.549548051Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1 Nov 8 00:06:43.549977 containerd[2009]: time="2025-11-08T00:06:43.549907163Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1 Nov 8 00:06:43.550040 containerd[2009]: time="2025-11-08T00:06:43.549992039Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Nov 8 00:06:43.550795 containerd[2009]: time="2025-11-08T00:06:43.550258811Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Nov 8 00:06:43.567390 kubelet[3341]: E1108 00:06:43.567337 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:43.567633 kubelet[3341]: W1108 00:06:43.567561 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:43.567805 kubelet[3341]: E1108 00:06:43.567607 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:43.568895 kubelet[3341]: E1108 00:06:43.568848 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:43.569358 kubelet[3341]: W1108 00:06:43.569131 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:43.569358 kubelet[3341]: E1108 00:06:43.569209 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:43.571285 kubelet[3341]: E1108 00:06:43.570603 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:43.571285 kubelet[3341]: W1108 00:06:43.570645 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:43.571285 kubelet[3341]: E1108 00:06:43.570691 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:43.571285 kubelet[3341]: E1108 00:06:43.571169 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:43.571285 kubelet[3341]: W1108 00:06:43.571191 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:43.576391 kubelet[3341]: E1108 00:06:43.571565 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:43.576391 kubelet[3341]: E1108 00:06:43.571595 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:43.576391 kubelet[3341]: W1108 00:06:43.571612 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:43.576391 kubelet[3341]: E1108 00:06:43.571834 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:43.576391 kubelet[3341]: E1108 00:06:43.571919 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:43.576391 kubelet[3341]: W1108 00:06:43.571934 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:43.576391 kubelet[3341]: E1108 00:06:43.572224 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:43.576391 kubelet[3341]: W1108 00:06:43.572241 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:43.576391 kubelet[3341]: E1108 00:06:43.572318 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:43.576391 kubelet[3341]: E1108 00:06:43.573563 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:43.576923 kubelet[3341]: W1108 00:06:43.573595 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:43.576923 kubelet[3341]: E1108 00:06:43.573629 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:43.576923 kubelet[3341]: E1108 00:06:43.574006 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:43.576923 kubelet[3341]: E1108 00:06:43.574494 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:43.576923 kubelet[3341]: W1108 00:06:43.574518 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:43.576923 kubelet[3341]: E1108 00:06:43.574545 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:43.576923 kubelet[3341]: E1108 00:06:43.574852 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:43.576923 kubelet[3341]: W1108 00:06:43.574876 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:43.576923 kubelet[3341]: E1108 00:06:43.574900 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:43.576923 kubelet[3341]: E1108 00:06:43.576427 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:43.580077 kubelet[3341]: W1108 00:06:43.576454 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:43.580077 kubelet[3341]: E1108 00:06:43.576491 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:43.580077 kubelet[3341]: E1108 00:06:43.577433 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:43.580077 kubelet[3341]: W1108 00:06:43.577455 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:43.580077 kubelet[3341]: E1108 00:06:43.577480 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:43.580077 kubelet[3341]: E1108 00:06:43.577921 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:43.580077 kubelet[3341]: W1108 00:06:43.577944 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:43.580077 kubelet[3341]: E1108 00:06:43.577970 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:43.580077 kubelet[3341]: E1108 00:06:43.578367 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:43.580077 kubelet[3341]: W1108 00:06:43.578388 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:43.585464 kubelet[3341]: E1108 00:06:43.578412 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:43.585464 kubelet[3341]: E1108 00:06:43.579102 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:43.585464 kubelet[3341]: W1108 00:06:43.579125 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:43.585464 kubelet[3341]: E1108 00:06:43.579153 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:43.585464 kubelet[3341]: E1108 00:06:43.581595 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:43.585464 kubelet[3341]: W1108 00:06:43.581633 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:43.585464 kubelet[3341]: E1108 00:06:43.581688 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:43.585464 kubelet[3341]: E1108 00:06:43.582413 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:43.585464 kubelet[3341]: W1108 00:06:43.582436 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:43.585464 kubelet[3341]: E1108 00:06:43.582867 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:43.594511 kubelet[3341]: E1108 00:06:43.583382 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:43.594511 kubelet[3341]: W1108 00:06:43.583405 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:43.594511 kubelet[3341]: E1108 00:06:43.583498 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:43.594511 kubelet[3341]: E1108 00:06:43.583838 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:43.594511 kubelet[3341]: W1108 00:06:43.583856 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:43.594511 kubelet[3341]: E1108 00:06:43.583887 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:43.594511 kubelet[3341]: E1108 00:06:43.584583 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:43.594511 kubelet[3341]: W1108 00:06:43.584604 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:43.594511 kubelet[3341]: E1108 00:06:43.584642 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:43.594511 kubelet[3341]: E1108 00:06:43.586658 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:43.595024 kubelet[3341]: W1108 00:06:43.586715 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:43.595024 kubelet[3341]: E1108 00:06:43.586970 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:43.595024 kubelet[3341]: E1108 00:06:43.587365 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:43.595024 kubelet[3341]: W1108 00:06:43.587383 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:43.595024 kubelet[3341]: E1108 00:06:43.587438 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:43.595024 kubelet[3341]: E1108 00:06:43.587917 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:43.595024 kubelet[3341]: W1108 00:06:43.587962 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:43.595024 kubelet[3341]: E1108 00:06:43.588003 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:43.595024 kubelet[3341]: E1108 00:06:43.588555 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:43.595024 kubelet[3341]: W1108 00:06:43.588576 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:43.595506 kubelet[3341]: E1108 00:06:43.588630 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:43.595506 kubelet[3341]: E1108 00:06:43.589586 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:43.595506 kubelet[3341]: W1108 00:06:43.589608 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:43.595506 kubelet[3341]: E1108 00:06:43.589659 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:43.600673 systemd[1]: Started cri-containerd-8418bbd0a5102dc78d813de6ba9511fdc0885f074c21da46d48594dab5002fec.scope - libcontainer container 8418bbd0a5102dc78d813de6ba9511fdc0885f074c21da46d48594dab5002fec. Nov 8 00:06:43.609248 containerd[2009]: time="2025-11-08T00:06:43.608481035Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-node-4gw4n,Uid:e3b816b1-4a5c-4819-85de-f1312d27289b,Namespace:calico-system,Attempt:0,}" Nov 8 00:06:43.610879 kubelet[3341]: E1108 00:06:43.610753 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:43.610879 kubelet[3341]: W1108 00:06:43.610786 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:43.610879 kubelet[3341]: E1108 00:06:43.610818 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:43.676305 containerd[2009]: time="2025-11-08T00:06:43.673915571Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1 Nov 8 00:06:43.676898 containerd[2009]: time="2025-11-08T00:06:43.676715591Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1 Nov 8 00:06:43.676898 containerd[2009]: time="2025-11-08T00:06:43.676830227Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Nov 8 00:06:43.678119 containerd[2009]: time="2025-11-08T00:06:43.677492051Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Nov 8 00:06:43.716821 containerd[2009]: time="2025-11-08T00:06:43.716769036Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-typha-548b6fc7d4-mht5m,Uid:52fbe16c-7845-4439-808e-ac949e036983,Namespace:calico-system,Attempt:0,} returns sandbox id \"8418bbd0a5102dc78d813de6ba9511fdc0885f074c21da46d48594dab5002fec\"" Nov 8 00:06:43.724762 containerd[2009]: time="2025-11-08T00:06:43.724212132Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/typha:v3.30.4\"" Nov 8 00:06:43.726231 systemd[1]: Started cri-containerd-08de0cee3ef35a1264f3ea05f8cbc3bf005081d57016397503fcbb099f3e6a12.scope - libcontainer container 08de0cee3ef35a1264f3ea05f8cbc3bf005081d57016397503fcbb099f3e6a12. Nov 8 00:06:43.801476 containerd[2009]: time="2025-11-08T00:06:43.801396672Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-node-4gw4n,Uid:e3b816b1-4a5c-4819-85de-f1312d27289b,Namespace:calico-system,Attempt:0,} returns sandbox id \"08de0cee3ef35a1264f3ea05f8cbc3bf005081d57016397503fcbb099f3e6a12\"" Nov 8 00:06:44.651121 kubelet[3341]: E1108 00:06:44.651049 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized" pod="calico-system/csi-node-driver-8rk2x" podUID="0fc7336a-4c45-40ec-b634-101ce08e1be1" Nov 8 00:06:45.073069 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount3119185285.mount: Deactivated successfully. Nov 8 00:06:45.845074 containerd[2009]: time="2025-11-08T00:06:45.843655634Z" level=info msg="ImageCreate event name:\"ghcr.io/flatcar/calico/typha:v3.30.4\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 8 00:06:45.845892 containerd[2009]: time="2025-11-08T00:06:45.845842430Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/typha:v3.30.4: active requests=0, bytes read=33090687" Nov 8 00:06:45.848047 containerd[2009]: time="2025-11-08T00:06:45.847958726Z" level=info msg="ImageCreate event name:\"sha256:5fe38d12a54098df5aaf5ec7228dc2f976f60cb4f434d7256f03126b004fdc5b\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 8 00:06:45.855106 containerd[2009]: time="2025-11-08T00:06:45.855016994Z" level=info msg="ImageCreate event name:\"ghcr.io/flatcar/calico/typha@sha256:6f437220b5b3c627fb4a0fc8dc323363101f3c22a8f337612c2a1ddfb73b810c\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 8 00:06:45.856833 containerd[2009]: time="2025-11-08T00:06:45.856764794Z" level=info msg="Pulled image \"ghcr.io/flatcar/calico/typha:v3.30.4\" with image id \"sha256:5fe38d12a54098df5aaf5ec7228dc2f976f60cb4f434d7256f03126b004fdc5b\", repo tag \"ghcr.io/flatcar/calico/typha:v3.30.4\", repo digest \"ghcr.io/flatcar/calico/typha@sha256:6f437220b5b3c627fb4a0fc8dc323363101f3c22a8f337612c2a1ddfb73b810c\", size \"33090541\" in 2.13204319s" Nov 8 00:06:45.856833 containerd[2009]: time="2025-11-08T00:06:45.856829114Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/typha:v3.30.4\" returns image reference \"sha256:5fe38d12a54098df5aaf5ec7228dc2f976f60cb4f434d7256f03126b004fdc5b\"" Nov 8 00:06:45.862400 containerd[2009]: time="2025-11-08T00:06:45.862225658Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/pod2daemon-flexvol:v3.30.4\"" Nov 8 00:06:45.891571 containerd[2009]: time="2025-11-08T00:06:45.891482510Z" level=info msg="CreateContainer within sandbox \"8418bbd0a5102dc78d813de6ba9511fdc0885f074c21da46d48594dab5002fec\" for container &ContainerMetadata{Name:calico-typha,Attempt:0,}" Nov 8 00:06:45.923158 containerd[2009]: time="2025-11-08T00:06:45.922983699Z" level=info msg="CreateContainer within sandbox \"8418bbd0a5102dc78d813de6ba9511fdc0885f074c21da46d48594dab5002fec\" for &ContainerMetadata{Name:calico-typha,Attempt:0,} returns container id \"b1b88c7713b4bb86bee08726232213f5f032f7d9dd2c6548d2ccad8f3c50bee1\"" Nov 8 00:06:45.925633 containerd[2009]: time="2025-11-08T00:06:45.925385031Z" level=info msg="StartContainer for \"b1b88c7713b4bb86bee08726232213f5f032f7d9dd2c6548d2ccad8f3c50bee1\"" Nov 8 00:06:46.002592 systemd[1]: Started cri-containerd-b1b88c7713b4bb86bee08726232213f5f032f7d9dd2c6548d2ccad8f3c50bee1.scope - libcontainer container b1b88c7713b4bb86bee08726232213f5f032f7d9dd2c6548d2ccad8f3c50bee1. Nov 8 00:06:46.072609 containerd[2009]: time="2025-11-08T00:06:46.072546599Z" level=info msg="StartContainer for \"b1b88c7713b4bb86bee08726232213f5f032f7d9dd2c6548d2ccad8f3c50bee1\" returns successfully" Nov 8 00:06:46.651372 kubelet[3341]: E1108 00:06:46.651301 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized" pod="calico-system/csi-node-driver-8rk2x" podUID="0fc7336a-4c45-40ec-b634-101ce08e1be1" Nov 8 00:06:47.021305 kubelet[3341]: I1108 00:06:47.021179 3341 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="calico-system/calico-typha-548b6fc7d4-mht5m" podStartSLOduration=1.885060878 podStartE2EDuration="4.021149172s" podCreationTimestamp="2025-11-08 00:06:43 +0000 UTC" firstStartedPulling="2025-11-08 00:06:43.723133656 +0000 UTC m=+42.239973199" lastFinishedPulling="2025-11-08 00:06:45.85922195 +0000 UTC m=+44.376061493" observedRunningTime="2025-11-08 00:06:47.017918208 +0000 UTC m=+45.534757763" watchObservedRunningTime="2025-11-08 00:06:47.021149172 +0000 UTC m=+45.537988799" Nov 8 00:06:47.056307 kubelet[3341]: E1108 00:06:47.056046 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:47.056307 kubelet[3341]: W1108 00:06:47.056091 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:47.056307 kubelet[3341]: E1108 00:06:47.056245 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:47.058886 kubelet[3341]: E1108 00:06:47.058841 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:47.059158 kubelet[3341]: W1108 00:06:47.058880 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:47.059158 kubelet[3341]: E1108 00:06:47.058964 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:47.061074 kubelet[3341]: E1108 00:06:47.061023 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:47.061074 kubelet[3341]: W1108 00:06:47.061064 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:47.061688 kubelet[3341]: E1108 00:06:47.061099 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:47.062203 kubelet[3341]: E1108 00:06:47.062079 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:47.062203 kubelet[3341]: W1108 00:06:47.062117 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:47.062203 kubelet[3341]: E1108 00:06:47.062150 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:47.069327 kubelet[3341]: E1108 00:06:47.069245 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:47.069327 kubelet[3341]: W1108 00:06:47.069316 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:47.069854 kubelet[3341]: E1108 00:06:47.069356 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:47.070552 kubelet[3341]: E1108 00:06:47.070512 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:47.070552 kubelet[3341]: W1108 00:06:47.070550 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:47.070862 kubelet[3341]: E1108 00:06:47.070584 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:47.072629 kubelet[3341]: E1108 00:06:47.072569 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:47.073697 kubelet[3341]: W1108 00:06:47.073345 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:47.073697 kubelet[3341]: E1108 00:06:47.073407 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:47.075452 kubelet[3341]: E1108 00:06:47.075125 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:47.075452 kubelet[3341]: W1108 00:06:47.075165 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:47.075452 kubelet[3341]: E1108 00:06:47.075201 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:47.076970 kubelet[3341]: E1108 00:06:47.076728 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:47.076970 kubelet[3341]: W1108 00:06:47.076767 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:47.078427 kubelet[3341]: E1108 00:06:47.077826 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:47.078717 kubelet[3341]: E1108 00:06:47.078676 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:47.078802 kubelet[3341]: W1108 00:06:47.078713 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:47.078802 kubelet[3341]: E1108 00:06:47.078744 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:47.079990 kubelet[3341]: E1108 00:06:47.079946 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:47.079990 kubelet[3341]: W1108 00:06:47.079985 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:47.080145 kubelet[3341]: E1108 00:06:47.080020 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:47.083621 kubelet[3341]: E1108 00:06:47.083571 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:47.083621 kubelet[3341]: W1108 00:06:47.083615 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:47.083867 kubelet[3341]: E1108 00:06:47.083653 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:47.086050 kubelet[3341]: E1108 00:06:47.085636 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:47.086050 kubelet[3341]: W1108 00:06:47.085679 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:47.086050 kubelet[3341]: E1108 00:06:47.085713 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:47.088489 kubelet[3341]: E1108 00:06:47.088437 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:47.088489 kubelet[3341]: W1108 00:06:47.088479 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:47.088782 kubelet[3341]: E1108 00:06:47.088514 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:47.091737 kubelet[3341]: E1108 00:06:47.091668 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:47.091737 kubelet[3341]: W1108 00:06:47.091712 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:47.091737 kubelet[3341]: E1108 00:06:47.091750 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:47.109027 kubelet[3341]: E1108 00:06:47.108977 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:47.109027 kubelet[3341]: W1108 00:06:47.109022 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:47.109504 kubelet[3341]: E1108 00:06:47.109060 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:47.111930 kubelet[3341]: E1108 00:06:47.111477 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:47.111930 kubelet[3341]: W1108 00:06:47.111521 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:47.111930 kubelet[3341]: E1108 00:06:47.111628 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:47.112703 kubelet[3341]: E1108 00:06:47.112548 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:47.112703 kubelet[3341]: W1108 00:06:47.112583 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:47.113710 kubelet[3341]: E1108 00:06:47.113655 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:47.116551 kubelet[3341]: E1108 00:06:47.116500 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:47.116551 kubelet[3341]: W1108 00:06:47.116542 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:47.119887 kubelet[3341]: E1108 00:06:47.119723 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:47.119887 kubelet[3341]: W1108 00:06:47.119763 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:47.122034 kubelet[3341]: E1108 00:06:47.121721 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:47.122034 kubelet[3341]: W1108 00:06:47.121760 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:47.122034 kubelet[3341]: E1108 00:06:47.121795 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:47.123765 kubelet[3341]: E1108 00:06:47.123654 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:47.123970 kubelet[3341]: E1108 00:06:47.123849 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:47.123970 kubelet[3341]: E1108 00:06:47.123916 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:47.123970 kubelet[3341]: W1108 00:06:47.123936 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:47.125066 kubelet[3341]: E1108 00:06:47.123962 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:47.127003 kubelet[3341]: E1108 00:06:47.126474 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:47.127003 kubelet[3341]: W1108 00:06:47.126513 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:47.127003 kubelet[3341]: E1108 00:06:47.126549 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:47.128872 kubelet[3341]: E1108 00:06:47.128785 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:47.129318 kubelet[3341]: W1108 00:06:47.129023 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:47.129318 kubelet[3341]: E1108 00:06:47.129129 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:47.131304 kubelet[3341]: E1108 00:06:47.131209 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:47.131304 kubelet[3341]: W1108 00:06:47.131253 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:47.131836 kubelet[3341]: E1108 00:06:47.131752 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:47.134649 kubelet[3341]: E1108 00:06:47.132925 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:47.134649 kubelet[3341]: W1108 00:06:47.134357 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:47.134649 kubelet[3341]: E1108 00:06:47.134436 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:47.136104 kubelet[3341]: E1108 00:06:47.135729 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:47.136104 kubelet[3341]: W1108 00:06:47.135768 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:47.136104 kubelet[3341]: E1108 00:06:47.135903 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:47.138299 kubelet[3341]: E1108 00:06:47.137365 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:47.138299 kubelet[3341]: W1108 00:06:47.137403 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:47.138299 kubelet[3341]: E1108 00:06:47.137638 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:47.139443 kubelet[3341]: E1108 00:06:47.139397 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:47.139443 kubelet[3341]: W1108 00:06:47.139435 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:47.140600 kubelet[3341]: E1108 00:06:47.140209 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:47.141902 kubelet[3341]: E1108 00:06:47.141605 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:47.141902 kubelet[3341]: W1108 00:06:47.141646 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:47.141902 kubelet[3341]: E1108 00:06:47.141806 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:47.143806 kubelet[3341]: E1108 00:06:47.143683 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:47.143806 kubelet[3341]: W1108 00:06:47.143723 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:47.144316 kubelet[3341]: E1108 00:06:47.144091 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:47.146662 kubelet[3341]: E1108 00:06:47.146448 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:47.146662 kubelet[3341]: W1108 00:06:47.146489 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:47.146662 kubelet[3341]: E1108 00:06:47.146524 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:47.149998 kubelet[3341]: E1108 00:06:47.149852 3341 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 8 00:06:47.149998 kubelet[3341]: W1108 00:06:47.149894 3341 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 8 00:06:47.149998 kubelet[3341]: E1108 00:06:47.149928 3341 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 8 00:06:47.205709 containerd[2009]: time="2025-11-08T00:06:47.205628701Z" level=info msg="ImageCreate event name:\"ghcr.io/flatcar/calico/pod2daemon-flexvol:v3.30.4\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 8 00:06:47.207616 containerd[2009]: time="2025-11-08T00:06:47.207557809Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/pod2daemon-flexvol:v3.30.4: active requests=0, bytes read=4266741" Nov 8 00:06:47.210159 containerd[2009]: time="2025-11-08T00:06:47.210032029Z" level=info msg="ImageCreate event name:\"sha256:90ff755393144dc5a3c05f95ffe1a3ecd2f89b98ecf36d9e4721471b80af4640\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 8 00:06:47.216386 containerd[2009]: time="2025-11-08T00:06:47.215044357Z" level=info msg="ImageCreate event name:\"ghcr.io/flatcar/calico/pod2daemon-flexvol@sha256:50bdfe370b7308fa9957ed1eaccd094aa4f27f9a4f1dfcfef2f8a7696a1551e1\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 8 00:06:47.217102 containerd[2009]: time="2025-11-08T00:06:47.217028233Z" level=info msg="Pulled image \"ghcr.io/flatcar/calico/pod2daemon-flexvol:v3.30.4\" with image id \"sha256:90ff755393144dc5a3c05f95ffe1a3ecd2f89b98ecf36d9e4721471b80af4640\", repo tag \"ghcr.io/flatcar/calico/pod2daemon-flexvol:v3.30.4\", repo digest \"ghcr.io/flatcar/calico/pod2daemon-flexvol@sha256:50bdfe370b7308fa9957ed1eaccd094aa4f27f9a4f1dfcfef2f8a7696a1551e1\", size \"5636392\" in 1.354699483s" Nov 8 00:06:47.217312 containerd[2009]: time="2025-11-08T00:06:47.217247941Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/pod2daemon-flexvol:v3.30.4\" returns image reference \"sha256:90ff755393144dc5a3c05f95ffe1a3ecd2f89b98ecf36d9e4721471b80af4640\"" Nov 8 00:06:47.225679 containerd[2009]: time="2025-11-08T00:06:47.225592129Z" level=info msg="CreateContainer within sandbox \"08de0cee3ef35a1264f3ea05f8cbc3bf005081d57016397503fcbb099f3e6a12\" for container &ContainerMetadata{Name:flexvol-driver,Attempt:0,}" Nov 8 00:06:47.267861 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount3882618198.mount: Deactivated successfully. Nov 8 00:06:47.269685 containerd[2009]: time="2025-11-08T00:06:47.268804033Z" level=info msg="CreateContainer within sandbox \"08de0cee3ef35a1264f3ea05f8cbc3bf005081d57016397503fcbb099f3e6a12\" for &ContainerMetadata{Name:flexvol-driver,Attempt:0,} returns container id \"2578f5bced4a67c9b0dd56044aa154bfaba3bc683df3fb108128a5c891ba4a03\"" Nov 8 00:06:47.272536 containerd[2009]: time="2025-11-08T00:06:47.271002181Z" level=info msg="StartContainer for \"2578f5bced4a67c9b0dd56044aa154bfaba3bc683df3fb108128a5c891ba4a03\"" Nov 8 00:06:47.336582 systemd[1]: Started cri-containerd-2578f5bced4a67c9b0dd56044aa154bfaba3bc683df3fb108128a5c891ba4a03.scope - libcontainer container 2578f5bced4a67c9b0dd56044aa154bfaba3bc683df3fb108128a5c891ba4a03. Nov 8 00:06:47.398575 containerd[2009]: time="2025-11-08T00:06:47.398396882Z" level=info msg="StartContainer for \"2578f5bced4a67c9b0dd56044aa154bfaba3bc683df3fb108128a5c891ba4a03\" returns successfully" Nov 8 00:06:47.434654 systemd[1]: cri-containerd-2578f5bced4a67c9b0dd56044aa154bfaba3bc683df3fb108128a5c891ba4a03.scope: Deactivated successfully. Nov 8 00:06:47.485643 systemd[1]: run-containerd-io.containerd.runtime.v2.task-k8s.io-2578f5bced4a67c9b0dd56044aa154bfaba3bc683df3fb108128a5c891ba4a03-rootfs.mount: Deactivated successfully. Nov 8 00:06:47.617475 containerd[2009]: time="2025-11-08T00:06:47.617299743Z" level=info msg="shim disconnected" id=2578f5bced4a67c9b0dd56044aa154bfaba3bc683df3fb108128a5c891ba4a03 namespace=k8s.io Nov 8 00:06:47.617475 containerd[2009]: time="2025-11-08T00:06:47.617376999Z" level=warning msg="cleaning up after shim disconnected" id=2578f5bced4a67c9b0dd56044aa154bfaba3bc683df3fb108128a5c891ba4a03 namespace=k8s.io Nov 8 00:06:47.617475 containerd[2009]: time="2025-11-08T00:06:47.617404995Z" level=info msg="cleaning up dead shim" namespace=k8s.io Nov 8 00:06:47.992607 containerd[2009]: time="2025-11-08T00:06:47.992485421Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/cni:v3.30.4\"" Nov 8 00:06:48.651785 kubelet[3341]: E1108 00:06:48.651722 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized" pod="calico-system/csi-node-driver-8rk2x" podUID="0fc7336a-4c45-40ec-b634-101ce08e1be1" Nov 8 00:06:50.652222 kubelet[3341]: E1108 00:06:50.651786 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized" pod="calico-system/csi-node-driver-8rk2x" podUID="0fc7336a-4c45-40ec-b634-101ce08e1be1" Nov 8 00:06:51.097161 containerd[2009]: time="2025-11-08T00:06:51.096329284Z" level=info msg="ImageCreate event name:\"ghcr.io/flatcar/calico/cni:v3.30.4\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 8 00:06:51.099196 containerd[2009]: time="2025-11-08T00:06:51.099090436Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/cni:v3.30.4: active requests=0, bytes read=65925816" Nov 8 00:06:51.101015 containerd[2009]: time="2025-11-08T00:06:51.100945756Z" level=info msg="ImageCreate event name:\"sha256:e60d442b6496497355efdf45eaa3ea72f5a2b28a5187aeab33442933f3c735d2\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 8 00:06:51.108355 containerd[2009]: time="2025-11-08T00:06:51.108233224Z" level=info msg="ImageCreate event name:\"ghcr.io/flatcar/calico/cni@sha256:273501a9cfbd848ade2b6a8452dfafdd3adb4f9bf9aec45c398a5d19b8026627\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 8 00:06:51.111200 containerd[2009]: time="2025-11-08T00:06:51.110015548Z" level=info msg="Pulled image \"ghcr.io/flatcar/calico/cni:v3.30.4\" with image id \"sha256:e60d442b6496497355efdf45eaa3ea72f5a2b28a5187aeab33442933f3c735d2\", repo tag \"ghcr.io/flatcar/calico/cni:v3.30.4\", repo digest \"ghcr.io/flatcar/calico/cni@sha256:273501a9cfbd848ade2b6a8452dfafdd3adb4f9bf9aec45c398a5d19b8026627\", size \"67295507\" in 3.117457479s" Nov 8 00:06:51.111200 containerd[2009]: time="2025-11-08T00:06:51.110095864Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/cni:v3.30.4\" returns image reference \"sha256:e60d442b6496497355efdf45eaa3ea72f5a2b28a5187aeab33442933f3c735d2\"" Nov 8 00:06:51.117142 containerd[2009]: time="2025-11-08T00:06:51.116713804Z" level=info msg="CreateContainer within sandbox \"08de0cee3ef35a1264f3ea05f8cbc3bf005081d57016397503fcbb099f3e6a12\" for container &ContainerMetadata{Name:install-cni,Attempt:0,}" Nov 8 00:06:51.151767 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount3713058263.mount: Deactivated successfully. Nov 8 00:06:51.155679 containerd[2009]: time="2025-11-08T00:06:51.155585765Z" level=info msg="CreateContainer within sandbox \"08de0cee3ef35a1264f3ea05f8cbc3bf005081d57016397503fcbb099f3e6a12\" for &ContainerMetadata{Name:install-cni,Attempt:0,} returns container id \"3776aab105c852b88546f5c47c958b16b717cef1b027a57c434eada704c5ca7a\"" Nov 8 00:06:51.157855 containerd[2009]: time="2025-11-08T00:06:51.157782593Z" level=info msg="StartContainer for \"3776aab105c852b88546f5c47c958b16b717cef1b027a57c434eada704c5ca7a\"" Nov 8 00:06:51.223921 systemd[1]: Started cri-containerd-3776aab105c852b88546f5c47c958b16b717cef1b027a57c434eada704c5ca7a.scope - libcontainer container 3776aab105c852b88546f5c47c958b16b717cef1b027a57c434eada704c5ca7a. Nov 8 00:06:51.287049 containerd[2009]: time="2025-11-08T00:06:51.286983701Z" level=info msg="StartContainer for \"3776aab105c852b88546f5c47c958b16b717cef1b027a57c434eada704c5ca7a\" returns successfully" Nov 8 00:06:52.355923 containerd[2009]: time="2025-11-08T00:06:52.355831710Z" level=error msg="failed to reload cni configuration after receiving fs change event(WRITE \"/etc/cni/net.d/calico-kubeconfig\")" error="cni config load failed: no network config found in /etc/cni/net.d: cni plugin not initialized: failed to load cni config" Nov 8 00:06:52.363453 systemd[1]: cri-containerd-3776aab105c852b88546f5c47c958b16b717cef1b027a57c434eada704c5ca7a.scope: Deactivated successfully. Nov 8 00:06:52.366165 systemd[1]: cri-containerd-3776aab105c852b88546f5c47c958b16b717cef1b027a57c434eada704c5ca7a.scope: Consumed 1.003s CPU time. Nov 8 00:06:52.399136 kubelet[3341]: I1108 00:06:52.397666 3341 kubelet_node_status.go:501] "Fast updating node status as it just became ready" Nov 8 00:06:52.422102 systemd[1]: run-containerd-io.containerd.runtime.v2.task-k8s.io-3776aab105c852b88546f5c47c958b16b717cef1b027a57c434eada704c5ca7a-rootfs.mount: Deactivated successfully. Nov 8 00:06:52.492928 systemd[1]: Created slice kubepods-burstable-poddd9a1fb2_7bfc_4968_86fa_9fc28ad38b94.slice - libcontainer container kubepods-burstable-poddd9a1fb2_7bfc_4968_86fa_9fc28ad38b94.slice. Nov 8 00:06:52.520138 kubelet[3341]: W1108 00:06:52.520071 3341 reflector.go:569] object-"calico-apiserver"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:ip-172-31-23-87" cannot list resource "configmaps" in API group "" in the namespace "calico-apiserver": no relationship found between node 'ip-172-31-23-87' and this object Nov 8 00:06:52.520386 kubelet[3341]: E1108 00:06:52.520147 3341 reflector.go:166] "Unhandled Error" err="object-\"calico-apiserver\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-172-31-23-87\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"calico-apiserver\": no relationship found between node 'ip-172-31-23-87' and this object" logger="UnhandledError" Nov 8 00:06:52.546380 systemd[1]: Created slice kubepods-burstable-podfa5174bf_24f6_40b6_a1a8_03b883265a37.slice - libcontainer container kubepods-burstable-podfa5174bf_24f6_40b6_a1a8_03b883265a37.slice. Nov 8 00:06:52.559185 kubelet[3341]: I1108 00:06:52.556100 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dd9a1fb2-7bfc-4968-86fa-9fc28ad38b94-config-volume\") pod \"coredns-668d6bf9bc-54b9r\" (UID: \"dd9a1fb2-7bfc-4968-86fa-9fc28ad38b94\") " pod="kube-system/coredns-668d6bf9bc-54b9r" Nov 8 00:06:52.559185 kubelet[3341]: I1108 00:06:52.556205 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb487\" (UniqueName: \"kubernetes.io/projected/dd9a1fb2-7bfc-4968-86fa-9fc28ad38b94-kube-api-access-qb487\") pod \"coredns-668d6bf9bc-54b9r\" (UID: \"dd9a1fb2-7bfc-4968-86fa-9fc28ad38b94\") " pod="kube-system/coredns-668d6bf9bc-54b9r" Nov 8 00:06:52.563669 kubelet[3341]: I1108 00:06:52.559740 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9cdj\" (UniqueName: \"kubernetes.io/projected/fa5174bf-24f6-40b6-a1a8-03b883265a37-kube-api-access-b9cdj\") pod \"coredns-668d6bf9bc-zwgsx\" (UID: \"fa5174bf-24f6-40b6-a1a8-03b883265a37\") " pod="kube-system/coredns-668d6bf9bc-zwgsx" Nov 8 00:06:52.563669 kubelet[3341]: I1108 00:06:52.559913 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt2d5\" (UniqueName: \"kubernetes.io/projected/52f757de-0e18-4b03-af0a-9737e167b914-kube-api-access-bt2d5\") pod \"calico-kube-controllers-7cc5d59f7b-q89cg\" (UID: \"52f757de-0e18-4b03-af0a-9737e167b914\") " pod="calico-system/calico-kube-controllers-7cc5d59f7b-q89cg" Nov 8 00:06:52.563669 kubelet[3341]: I1108 00:06:52.559979 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whisker-backend-key-pair\" (UniqueName: \"kubernetes.io/secret/5ebb8d68-1333-4451-8b95-9db2a7195b1f-whisker-backend-key-pair\") pod \"whisker-df89f8cd5-r2bdg\" (UID: \"5ebb8d68-1333-4451-8b95-9db2a7195b1f\") " pod="calico-system/whisker-df89f8cd5-r2bdg" Nov 8 00:06:52.563669 kubelet[3341]: I1108 00:06:52.560059 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whisker-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ebb8d68-1333-4451-8b95-9db2a7195b1f-whisker-ca-bundle\") pod \"whisker-df89f8cd5-r2bdg\" (UID: \"5ebb8d68-1333-4451-8b95-9db2a7195b1f\") " pod="calico-system/whisker-df89f8cd5-r2bdg" Nov 8 00:06:52.563669 kubelet[3341]: I1108 00:06:52.560100 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"calico-apiserver-certs\" (UniqueName: \"kubernetes.io/secret/68debac0-90fa-43fc-b6a2-614e4954f14e-calico-apiserver-certs\") pod \"calico-apiserver-66cbb68f69-hrrjm\" (UID: \"68debac0-90fa-43fc-b6a2-614e4954f14e\") " pod="calico-apiserver/calico-apiserver-66cbb68f69-hrrjm" Nov 8 00:06:52.563971 kubelet[3341]: I1108 00:06:52.560169 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fa5174bf-24f6-40b6-a1a8-03b883265a37-config-volume\") pod \"coredns-668d6bf9bc-zwgsx\" (UID: \"fa5174bf-24f6-40b6-a1a8-03b883265a37\") " pod="kube-system/coredns-668d6bf9bc-zwgsx" Nov 8 00:06:52.563971 kubelet[3341]: I1108 00:06:52.561404 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxmxx\" (UniqueName: \"kubernetes.io/projected/68debac0-90fa-43fc-b6a2-614e4954f14e-kube-api-access-dxmxx\") pod \"calico-apiserver-66cbb68f69-hrrjm\" (UID: \"68debac0-90fa-43fc-b6a2-614e4954f14e\") " pod="calico-apiserver/calico-apiserver-66cbb68f69-hrrjm" Nov 8 00:06:52.563971 kubelet[3341]: I1108 00:06:52.561533 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tigera-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52f757de-0e18-4b03-af0a-9737e167b914-tigera-ca-bundle\") pod \"calico-kube-controllers-7cc5d59f7b-q89cg\" (UID: \"52f757de-0e18-4b03-af0a-9737e167b914\") " pod="calico-system/calico-kube-controllers-7cc5d59f7b-q89cg" Nov 8 00:06:52.563971 kubelet[3341]: I1108 00:06:52.561576 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2tbr\" (UniqueName: \"kubernetes.io/projected/5ebb8d68-1333-4451-8b95-9db2a7195b1f-kube-api-access-b2tbr\") pod \"whisker-df89f8cd5-r2bdg\" (UID: \"5ebb8d68-1333-4451-8b95-9db2a7195b1f\") " pod="calico-system/whisker-df89f8cd5-r2bdg" Nov 8 00:06:52.563971 kubelet[3341]: I1108 00:06:52.561653 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"calico-apiserver-certs\" (UniqueName: \"kubernetes.io/secret/58f37ea9-b0c8-456a-8651-ebf3793b8679-calico-apiserver-certs\") pod \"calico-apiserver-7cbbf6b44f-hrhmg\" (UID: \"58f37ea9-b0c8-456a-8651-ebf3793b8679\") " pod="calico-apiserver/calico-apiserver-7cbbf6b44f-hrhmg" Nov 8 00:06:52.564246 kubelet[3341]: I1108 00:06:52.561721 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kzbv\" (UniqueName: \"kubernetes.io/projected/58f37ea9-b0c8-456a-8651-ebf3793b8679-kube-api-access-4kzbv\") pod \"calico-apiserver-7cbbf6b44f-hrhmg\" (UID: \"58f37ea9-b0c8-456a-8651-ebf3793b8679\") " pod="calico-apiserver/calico-apiserver-7cbbf6b44f-hrhmg" Nov 8 00:06:52.591988 systemd[1]: Created slice kubepods-besteffort-pod58f37ea9_b0c8_456a_8651_ebf3793b8679.slice - libcontainer container kubepods-besteffort-pod58f37ea9_b0c8_456a_8651_ebf3793b8679.slice. Nov 8 00:06:52.622236 systemd[1]: Created slice kubepods-besteffort-pod52f757de_0e18_4b03_af0a_9737e167b914.slice - libcontainer container kubepods-besteffort-pod52f757de_0e18_4b03_af0a_9737e167b914.slice. Nov 8 00:06:52.642032 systemd[1]: Created slice kubepods-besteffort-pod5ebb8d68_1333_4451_8b95_9db2a7195b1f.slice - libcontainer container kubepods-besteffort-pod5ebb8d68_1333_4451_8b95_9db2a7195b1f.slice. Nov 8 00:06:52.665313 kubelet[3341]: I1108 00:06:52.663334 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jv6zv\" (UniqueName: \"kubernetes.io/projected/ac78d516-6696-4a76-a1b8-01b7e90766d4-kube-api-access-jv6zv\") pod \"goldmane-666569f655-qlmhx\" (UID: \"ac78d516-6696-4a76-a1b8-01b7e90766d4\") " pod="calico-system/goldmane-666569f655-qlmhx" Nov 8 00:06:52.665923 kubelet[3341]: I1108 00:06:52.665667 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"goldmane-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac78d516-6696-4a76-a1b8-01b7e90766d4-goldmane-ca-bundle\") pod \"goldmane-666569f655-qlmhx\" (UID: \"ac78d516-6696-4a76-a1b8-01b7e90766d4\") " pod="calico-system/goldmane-666569f655-qlmhx" Nov 8 00:06:52.665923 kubelet[3341]: I1108 00:06:52.665847 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ac78d516-6696-4a76-a1b8-01b7e90766d4-config\") pod \"goldmane-666569f655-qlmhx\" (UID: \"ac78d516-6696-4a76-a1b8-01b7e90766d4\") " pod="calico-system/goldmane-666569f655-qlmhx" Nov 8 00:06:52.666189 kubelet[3341]: I1108 00:06:52.665896 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"goldmane-key-pair\" (UniqueName: \"kubernetes.io/secret/ac78d516-6696-4a76-a1b8-01b7e90766d4-goldmane-key-pair\") pod \"goldmane-666569f655-qlmhx\" (UID: \"ac78d516-6696-4a76-a1b8-01b7e90766d4\") " pod="calico-system/goldmane-666569f655-qlmhx" Nov 8 00:06:52.666487 kubelet[3341]: I1108 00:06:52.666377 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk46f\" (UniqueName: \"kubernetes.io/projected/886783b3-53d5-4894-8799-c2c145d125ce-kube-api-access-lk46f\") pod \"calico-apiserver-7cbbf6b44f-pntg9\" (UID: \"886783b3-53d5-4894-8799-c2c145d125ce\") " pod="calico-apiserver/calico-apiserver-7cbbf6b44f-pntg9" Nov 8 00:06:52.666704 kubelet[3341]: I1108 00:06:52.666462 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"calico-apiserver-certs\" (UniqueName: \"kubernetes.io/secret/886783b3-53d5-4894-8799-c2c145d125ce-calico-apiserver-certs\") pod \"calico-apiserver-7cbbf6b44f-pntg9\" (UID: \"886783b3-53d5-4894-8799-c2c145d125ce\") " pod="calico-apiserver/calico-apiserver-7cbbf6b44f-pntg9" Nov 8 00:06:52.671838 systemd[1]: Created slice kubepods-besteffort-pod68debac0_90fa_43fc_b6a2_614e4954f14e.slice - libcontainer container kubepods-besteffort-pod68debac0_90fa_43fc_b6a2_614e4954f14e.slice. Nov 8 00:06:52.778923 systemd[1]: Created slice kubepods-besteffort-pod886783b3_53d5_4894_8799_c2c145d125ce.slice - libcontainer container kubepods-besteffort-pod886783b3_53d5_4894_8799_c2c145d125ce.slice. Nov 8 00:06:52.840134 systemd[1]: Created slice kubepods-besteffort-podac78d516_6696_4a76_a1b8_01b7e90766d4.slice - libcontainer container kubepods-besteffort-podac78d516_6696_4a76_a1b8_01b7e90766d4.slice. Nov 8 00:06:52.864496 containerd[2009]: time="2025-11-08T00:06:52.863686173Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-668d6bf9bc-zwgsx,Uid:fa5174bf-24f6-40b6-a1a8-03b883265a37,Namespace:kube-system,Attempt:0,}" Nov 8 00:06:52.885741 systemd[1]: Created slice kubepods-besteffort-pod0fc7336a_4c45_40ec_b634_101ce08e1be1.slice - libcontainer container kubepods-besteffort-pod0fc7336a_4c45_40ec_b634_101ce08e1be1.slice. Nov 8 00:06:52.899326 containerd[2009]: time="2025-11-08T00:06:52.899207049Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:csi-node-driver-8rk2x,Uid:0fc7336a-4c45-40ec-b634-101ce08e1be1,Namespace:calico-system,Attempt:0,}" Nov 8 00:06:52.936443 containerd[2009]: time="2025-11-08T00:06:52.936114117Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-kube-controllers-7cc5d59f7b-q89cg,Uid:52f757de-0e18-4b03-af0a-9737e167b914,Namespace:calico-system,Attempt:0,}" Nov 8 00:06:52.946719 containerd[2009]: time="2025-11-08T00:06:52.946602825Z" level=info msg="shim disconnected" id=3776aab105c852b88546f5c47c958b16b717cef1b027a57c434eada704c5ca7a namespace=k8s.io Nov 8 00:06:52.948319 containerd[2009]: time="2025-11-08T00:06:52.948227625Z" level=warning msg="cleaning up after shim disconnected" id=3776aab105c852b88546f5c47c958b16b717cef1b027a57c434eada704c5ca7a namespace=k8s.io Nov 8 00:06:52.948998 containerd[2009]: time="2025-11-08T00:06:52.948426561Z" level=info msg="cleaning up dead shim" namespace=k8s.io Nov 8 00:06:52.957513 containerd[2009]: time="2025-11-08T00:06:52.957153621Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:whisker-df89f8cd5-r2bdg,Uid:5ebb8d68-1333-4451-8b95-9db2a7195b1f,Namespace:calico-system,Attempt:0,}" Nov 8 00:06:53.034303 containerd[2009]: time="2025-11-08T00:06:53.030897066Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/node:v3.30.4\"" Nov 8 00:06:53.126176 containerd[2009]: time="2025-11-08T00:06:53.126111558Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-668d6bf9bc-54b9r,Uid:dd9a1fb2-7bfc-4968-86fa-9fc28ad38b94,Namespace:kube-system,Attempt:0,}" Nov 8 00:06:53.157891 containerd[2009]: time="2025-11-08T00:06:53.157714242Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:goldmane-666569f655-qlmhx,Uid:ac78d516-6696-4a76-a1b8-01b7e90766d4,Namespace:calico-system,Attempt:0,}" Nov 8 00:06:53.375036 containerd[2009]: time="2025-11-08T00:06:53.374965604Z" level=error msg="Failed to destroy network for sandbox \"f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 8 00:06:53.376690 containerd[2009]: time="2025-11-08T00:06:53.376399832Z" level=error msg="encountered an error cleaning up failed sandbox \"f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 8 00:06:53.376690 containerd[2009]: time="2025-11-08T00:06:53.376520720Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:whisker-df89f8cd5-r2bdg,Uid:5ebb8d68-1333-4451-8b95-9db2a7195b1f,Namespace:calico-system,Attempt:0,} failed, error" error="failed to setup network for sandbox \"f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 8 00:06:53.377400 kubelet[3341]: E1108 00:06:53.376834 3341 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 8 00:06:53.377400 kubelet[3341]: E1108 00:06:53.376957 3341 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/whisker-df89f8cd5-r2bdg" Nov 8 00:06:53.377400 kubelet[3341]: E1108 00:06:53.376995 3341 kuberuntime_manager.go:1237] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/whisker-df89f8cd5-r2bdg" Nov 8 00:06:53.377578 kubelet[3341]: E1108 00:06:53.377079 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"whisker-df89f8cd5-r2bdg_calico-system(5ebb8d68-1333-4451-8b95-9db2a7195b1f)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"whisker-df89f8cd5-r2bdg_calico-system(5ebb8d68-1333-4451-8b95-9db2a7195b1f)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-system/whisker-df89f8cd5-r2bdg" podUID="5ebb8d68-1333-4451-8b95-9db2a7195b1f" Nov 8 00:06:53.388107 containerd[2009]: time="2025-11-08T00:06:53.386985692Z" level=error msg="Failed to destroy network for sandbox \"aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 8 00:06:53.390617 containerd[2009]: time="2025-11-08T00:06:53.390405788Z" level=error msg="Failed to destroy network for sandbox \"d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 8 00:06:53.394690 containerd[2009]: time="2025-11-08T00:06:53.394514312Z" level=error msg="encountered an error cleaning up failed sandbox \"aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 8 00:06:53.396164 containerd[2009]: time="2025-11-08T00:06:53.394626572Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-668d6bf9bc-zwgsx,Uid:fa5174bf-24f6-40b6-a1a8-03b883265a37,Namespace:kube-system,Attempt:0,} failed, error" error="failed to setup network for sandbox \"aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 8 00:06:53.396904 containerd[2009]: time="2025-11-08T00:06:53.396526028Z" level=error msg="encountered an error cleaning up failed sandbox \"d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 8 00:06:53.396904 containerd[2009]: time="2025-11-08T00:06:53.396643268Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:csi-node-driver-8rk2x,Uid:0fc7336a-4c45-40ec-b634-101ce08e1be1,Namespace:calico-system,Attempt:0,} failed, error" error="failed to setup network for sandbox \"d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 8 00:06:53.397516 kubelet[3341]: E1108 00:06:53.397313 3341 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 8 00:06:53.397516 kubelet[3341]: E1108 00:06:53.397413 3341 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/csi-node-driver-8rk2x" Nov 8 00:06:53.397516 kubelet[3341]: E1108 00:06:53.397452 3341 kuberuntime_manager.go:1237] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/csi-node-driver-8rk2x" Nov 8 00:06:53.399674 kubelet[3341]: E1108 00:06:53.399405 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"csi-node-driver-8rk2x_calico-system(0fc7336a-4c45-40ec-b634-101ce08e1be1)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"csi-node-driver-8rk2x_calico-system(0fc7336a-4c45-40ec-b634-101ce08e1be1)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-system/csi-node-driver-8rk2x" podUID="0fc7336a-4c45-40ec-b634-101ce08e1be1" Nov 8 00:06:53.403010 kubelet[3341]: E1108 00:06:53.399808 3341 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 8 00:06:53.403010 kubelet[3341]: E1108 00:06:53.399898 3341 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-668d6bf9bc-zwgsx" Nov 8 00:06:53.403010 kubelet[3341]: E1108 00:06:53.399941 3341 kuberuntime_manager.go:1237] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-668d6bf9bc-zwgsx" Nov 8 00:06:53.403256 kubelet[3341]: E1108 00:06:53.400005 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-668d6bf9bc-zwgsx_kube-system(fa5174bf-24f6-40b6-a1a8-03b883265a37)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-668d6bf9bc-zwgsx_kube-system(fa5174bf-24f6-40b6-a1a8-03b883265a37)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="kube-system/coredns-668d6bf9bc-zwgsx" podUID="fa5174bf-24f6-40b6-a1a8-03b883265a37" Nov 8 00:06:53.416832 containerd[2009]: time="2025-11-08T00:06:53.415785236Z" level=error msg="Failed to destroy network for sandbox \"b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 8 00:06:53.417350 containerd[2009]: time="2025-11-08T00:06:53.417024812Z" level=error msg="encountered an error cleaning up failed sandbox \"b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 8 00:06:53.417350 containerd[2009]: time="2025-11-08T00:06:53.417160508Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-kube-controllers-7cc5d59f7b-q89cg,Uid:52f757de-0e18-4b03-af0a-9737e167b914,Namespace:calico-system,Attempt:0,} failed, error" error="failed to setup network for sandbox \"b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 8 00:06:53.418261 kubelet[3341]: E1108 00:06:53.417972 3341 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 8 00:06:53.418261 kubelet[3341]: E1108 00:06:53.418063 3341 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/calico-kube-controllers-7cc5d59f7b-q89cg" Nov 8 00:06:53.418261 kubelet[3341]: E1108 00:06:53.418098 3341 kuberuntime_manager.go:1237] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/calico-kube-controllers-7cc5d59f7b-q89cg" Nov 8 00:06:53.418618 kubelet[3341]: E1108 00:06:53.418171 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"calico-kube-controllers-7cc5d59f7b-q89cg_calico-system(52f757de-0e18-4b03-af0a-9737e167b914)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"calico-kube-controllers-7cc5d59f7b-q89cg_calico-system(52f757de-0e18-4b03-af0a-9737e167b914)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-system/calico-kube-controllers-7cc5d59f7b-q89cg" podUID="52f757de-0e18-4b03-af0a-9737e167b914" Nov 8 00:06:53.510691 containerd[2009]: time="2025-11-08T00:06:53.510598424Z" level=error msg="Failed to destroy network for sandbox \"9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 8 00:06:53.513307 containerd[2009]: time="2025-11-08T00:06:53.511569140Z" level=error msg="encountered an error cleaning up failed sandbox \"9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 8 00:06:53.513675 containerd[2009]: time="2025-11-08T00:06:53.513610784Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-668d6bf9bc-54b9r,Uid:dd9a1fb2-7bfc-4968-86fa-9fc28ad38b94,Namespace:kube-system,Attempt:0,} failed, error" error="failed to setup network for sandbox \"9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 8 00:06:53.518213 kubelet[3341]: E1108 00:06:53.517461 3341 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 8 00:06:53.518213 kubelet[3341]: E1108 00:06:53.517547 3341 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-668d6bf9bc-54b9r" Nov 8 00:06:53.518213 kubelet[3341]: E1108 00:06:53.517580 3341 kuberuntime_manager.go:1237] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-668d6bf9bc-54b9r" Nov 8 00:06:53.518858 kubelet[3341]: E1108 00:06:53.517646 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-668d6bf9bc-54b9r_kube-system(dd9a1fb2-7bfc-4968-86fa-9fc28ad38b94)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-668d6bf9bc-54b9r_kube-system(dd9a1fb2-7bfc-4968-86fa-9fc28ad38b94)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="kube-system/coredns-668d6bf9bc-54b9r" podUID="dd9a1fb2-7bfc-4968-86fa-9fc28ad38b94" Nov 8 00:06:53.519406 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584-shm.mount: Deactivated successfully. Nov 8 00:06:53.547213 containerd[2009]: time="2025-11-08T00:06:53.547128572Z" level=error msg="Failed to destroy network for sandbox \"f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 8 00:06:53.550384 containerd[2009]: time="2025-11-08T00:06:53.548716184Z" level=error msg="encountered an error cleaning up failed sandbox \"f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 8 00:06:53.550384 containerd[2009]: time="2025-11-08T00:06:53.548829260Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:goldmane-666569f655-qlmhx,Uid:ac78d516-6696-4a76-a1b8-01b7e90766d4,Namespace:calico-system,Attempt:0,} failed, error" error="failed to setup network for sandbox \"f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 8 00:06:53.550647 kubelet[3341]: E1108 00:06:53.549527 3341 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 8 00:06:53.550647 kubelet[3341]: E1108 00:06:53.549600 3341 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/goldmane-666569f655-qlmhx" Nov 8 00:06:53.550647 kubelet[3341]: E1108 00:06:53.549633 3341 kuberuntime_manager.go:1237] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/goldmane-666569f655-qlmhx" Nov 8 00:06:53.550836 kubelet[3341]: E1108 00:06:53.549721 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"goldmane-666569f655-qlmhx_calico-system(ac78d516-6696-4a76-a1b8-01b7e90766d4)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"goldmane-666569f655-qlmhx_calico-system(ac78d516-6696-4a76-a1b8-01b7e90766d4)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-system/goldmane-666569f655-qlmhx" podUID="ac78d516-6696-4a76-a1b8-01b7e90766d4" Nov 8 00:06:53.555116 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687-shm.mount: Deactivated successfully. Nov 8 00:06:53.729084 containerd[2009]: time="2025-11-08T00:06:53.729008217Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-7cbbf6b44f-pntg9,Uid:886783b3-53d5-4894-8799-c2c145d125ce,Namespace:calico-apiserver,Attempt:0,}" Nov 8 00:06:53.818093 containerd[2009]: time="2025-11-08T00:06:53.817524430Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-7cbbf6b44f-hrhmg,Uid:58f37ea9-b0c8-456a-8651-ebf3793b8679,Namespace:calico-apiserver,Attempt:0,}" Nov 8 00:06:53.844461 containerd[2009]: time="2025-11-08T00:06:53.844393042Z" level=error msg="Failed to destroy network for sandbox \"915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 8 00:06:53.845212 containerd[2009]: time="2025-11-08T00:06:53.845162794Z" level=error msg="encountered an error cleaning up failed sandbox \"915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 8 00:06:53.845438 containerd[2009]: time="2025-11-08T00:06:53.845396518Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-7cbbf6b44f-pntg9,Uid:886783b3-53d5-4894-8799-c2c145d125ce,Namespace:calico-apiserver,Attempt:0,} failed, error" error="failed to setup network for sandbox \"915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 8 00:06:53.846424 kubelet[3341]: E1108 00:06:53.845823 3341 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 8 00:06:53.846424 kubelet[3341]: E1108 00:06:53.845901 3341 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-7cbbf6b44f-pntg9" Nov 8 00:06:53.846424 kubelet[3341]: E1108 00:06:53.845935 3341 kuberuntime_manager.go:1237] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-7cbbf6b44f-pntg9" Nov 8 00:06:53.846804 kubelet[3341]: E1108 00:06:53.846001 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"calico-apiserver-7cbbf6b44f-pntg9_calico-apiserver(886783b3-53d5-4894-8799-c2c145d125ce)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"calico-apiserver-7cbbf6b44f-pntg9_calico-apiserver(886783b3-53d5-4894-8799-c2c145d125ce)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-apiserver/calico-apiserver-7cbbf6b44f-pntg9" podUID="886783b3-53d5-4894-8799-c2c145d125ce" Nov 8 00:06:53.932983 containerd[2009]: time="2025-11-08T00:06:53.932741038Z" level=error msg="Failed to destroy network for sandbox \"e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 8 00:06:53.933999 containerd[2009]: time="2025-11-08T00:06:53.933640222Z" level=error msg="encountered an error cleaning up failed sandbox \"e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 8 00:06:53.933999 containerd[2009]: time="2025-11-08T00:06:53.933875794Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-7cbbf6b44f-hrhmg,Uid:58f37ea9-b0c8-456a-8651-ebf3793b8679,Namespace:calico-apiserver,Attempt:0,} failed, error" error="failed to setup network for sandbox \"e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 8 00:06:53.935391 kubelet[3341]: E1108 00:06:53.934310 3341 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 8 00:06:53.935391 kubelet[3341]: E1108 00:06:53.934391 3341 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-7cbbf6b44f-hrhmg" Nov 8 00:06:53.935391 kubelet[3341]: E1108 00:06:53.934426 3341 kuberuntime_manager.go:1237] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-7cbbf6b44f-hrhmg" Nov 8 00:06:53.935589 kubelet[3341]: E1108 00:06:53.934492 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"calico-apiserver-7cbbf6b44f-hrhmg_calico-apiserver(58f37ea9-b0c8-456a-8651-ebf3793b8679)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"calico-apiserver-7cbbf6b44f-hrhmg_calico-apiserver(58f37ea9-b0c8-456a-8651-ebf3793b8679)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-apiserver/calico-apiserver-7cbbf6b44f-hrhmg" podUID="58f37ea9-b0c8-456a-8651-ebf3793b8679" Nov 8 00:06:53.969874 containerd[2009]: time="2025-11-08T00:06:53.969248878Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-66cbb68f69-hrrjm,Uid:68debac0-90fa-43fc-b6a2-614e4954f14e,Namespace:calico-apiserver,Attempt:0,}" Nov 8 00:06:54.035873 kubelet[3341]: I1108 00:06:54.035613 3341 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36" Nov 8 00:06:54.040422 containerd[2009]: time="2025-11-08T00:06:54.039623107Z" level=info msg="StopPodSandbox for \"e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36\"" Nov 8 00:06:54.040422 containerd[2009]: time="2025-11-08T00:06:54.040018519Z" level=info msg="Ensure that sandbox e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36 in task-service has been cleanup successfully" Nov 8 00:06:54.044117 kubelet[3341]: I1108 00:06:54.044063 3341 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584" Nov 8 00:06:54.050642 containerd[2009]: time="2025-11-08T00:06:54.050565031Z" level=info msg="StopPodSandbox for \"9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584\"" Nov 8 00:06:54.050971 containerd[2009]: time="2025-11-08T00:06:54.050931151Z" level=info msg="Ensure that sandbox 9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584 in task-service has been cleanup successfully" Nov 8 00:06:54.078846 kubelet[3341]: I1108 00:06:54.078676 3341 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62" Nov 8 00:06:54.083121 containerd[2009]: time="2025-11-08T00:06:54.082810231Z" level=info msg="StopPodSandbox for \"b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62\"" Nov 8 00:06:54.084241 containerd[2009]: time="2025-11-08T00:06:54.084067111Z" level=info msg="Ensure that sandbox b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62 in task-service has been cleanup successfully" Nov 8 00:06:54.089498 kubelet[3341]: I1108 00:06:54.089435 3341 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e" Nov 8 00:06:54.093436 containerd[2009]: time="2025-11-08T00:06:54.092984419Z" level=info msg="StopPodSandbox for \"915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e\"" Nov 8 00:06:54.097822 kubelet[3341]: I1108 00:06:54.097752 3341 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9" Nov 8 00:06:54.100626 containerd[2009]: time="2025-11-08T00:06:54.100082119Z" level=info msg="StopPodSandbox for \"aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9\"" Nov 8 00:06:54.102522 containerd[2009]: time="2025-11-08T00:06:54.100794271Z" level=info msg="Ensure that sandbox 915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e in task-service has been cleanup successfully" Nov 8 00:06:54.103082 containerd[2009]: time="2025-11-08T00:06:54.102744871Z" level=info msg="Ensure that sandbox aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9 in task-service has been cleanup successfully" Nov 8 00:06:54.111409 kubelet[3341]: I1108 00:06:54.111309 3341 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687" Nov 8 00:06:54.116076 containerd[2009]: time="2025-11-08T00:06:54.115217959Z" level=info msg="StopPodSandbox for \"f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687\"" Nov 8 00:06:54.117443 containerd[2009]: time="2025-11-08T00:06:54.117372487Z" level=info msg="Ensure that sandbox f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687 in task-service has been cleanup successfully" Nov 8 00:06:54.128797 kubelet[3341]: I1108 00:06:54.128757 3341 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f" Nov 8 00:06:54.131757 containerd[2009]: time="2025-11-08T00:06:54.131159719Z" level=info msg="StopPodSandbox for \"f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f\"" Nov 8 00:06:54.136112 containerd[2009]: time="2025-11-08T00:06:54.135661723Z" level=info msg="Ensure that sandbox f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f in task-service has been cleanup successfully" Nov 8 00:06:54.157944 kubelet[3341]: I1108 00:06:54.157890 3341 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de" Nov 8 00:06:54.162339 containerd[2009]: time="2025-11-08T00:06:54.161869795Z" level=info msg="StopPodSandbox for \"d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de\"" Nov 8 00:06:54.166060 containerd[2009]: time="2025-11-08T00:06:54.165988219Z" level=info msg="Ensure that sandbox d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de in task-service has been cleanup successfully" Nov 8 00:06:54.286309 containerd[2009]: time="2025-11-08T00:06:54.285510356Z" level=error msg="StopPodSandbox for \"e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36\" failed" error="failed to destroy network for sandbox \"e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36\": plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 8 00:06:54.289850 containerd[2009]: time="2025-11-08T00:06:54.289008992Z" level=error msg="Failed to destroy network for sandbox \"ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 8 00:06:54.290284 kubelet[3341]: E1108 00:06:54.289832 3341 log.go:32] "StopPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to destroy network for sandbox \"e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36\": plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" podSandboxID="e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36" Nov 8 00:06:54.290284 kubelet[3341]: E1108 00:06:54.289924 3341 kuberuntime_manager.go:1546] "Failed to stop sandbox" podSandboxID={"Type":"containerd","ID":"e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36"} Nov 8 00:06:54.290284 kubelet[3341]: E1108 00:06:54.290019 3341 kuberuntime_manager.go:1146] "killPodWithSyncResult failed" err="failed to \"KillPodSandbox\" for \"58f37ea9-b0c8-456a-8651-ebf3793b8679\" with KillPodSandboxError: \"rpc error: code = Unknown desc = failed to destroy network for sandbox \\\"e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36\\\": plugin type=\\\"calico\\\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" Nov 8 00:06:54.290284 kubelet[3341]: E1108 00:06:54.290065 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"KillPodSandbox\" for \"58f37ea9-b0c8-456a-8651-ebf3793b8679\" with KillPodSandboxError: \"rpc error: code = Unknown desc = failed to destroy network for sandbox \\\"e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36\\\": plugin type=\\\"calico\\\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-apiserver/calico-apiserver-7cbbf6b44f-hrhmg" podUID="58f37ea9-b0c8-456a-8651-ebf3793b8679" Nov 8 00:06:54.292174 containerd[2009]: time="2025-11-08T00:06:54.291872660Z" level=error msg="encountered an error cleaning up failed sandbox \"ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 8 00:06:54.292174 containerd[2009]: time="2025-11-08T00:06:54.291996392Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-66cbb68f69-hrrjm,Uid:68debac0-90fa-43fc-b6a2-614e4954f14e,Namespace:calico-apiserver,Attempt:0,} failed, error" error="failed to setup network for sandbox \"ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 8 00:06:54.293724 kubelet[3341]: E1108 00:06:54.292454 3341 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 8 00:06:54.293724 kubelet[3341]: E1108 00:06:54.292536 3341 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-66cbb68f69-hrrjm" Nov 8 00:06:54.293724 kubelet[3341]: E1108 00:06:54.292580 3341 kuberuntime_manager.go:1237] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-66cbb68f69-hrrjm" Nov 8 00:06:54.294526 kubelet[3341]: E1108 00:06:54.292663 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"calico-apiserver-66cbb68f69-hrrjm_calico-apiserver(68debac0-90fa-43fc-b6a2-614e4954f14e)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"calico-apiserver-66cbb68f69-hrrjm_calico-apiserver(68debac0-90fa-43fc-b6a2-614e4954f14e)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-apiserver/calico-apiserver-66cbb68f69-hrrjm" podUID="68debac0-90fa-43fc-b6a2-614e4954f14e" Nov 8 00:06:54.322938 containerd[2009]: time="2025-11-08T00:06:54.322855352Z" level=error msg="StopPodSandbox for \"b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62\" failed" error="failed to destroy network for sandbox \"b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62\": plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 8 00:06:54.323410 kubelet[3341]: E1108 00:06:54.323192 3341 log.go:32] "StopPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to destroy network for sandbox \"b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62\": plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" podSandboxID="b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62" Nov 8 00:06:54.324211 kubelet[3341]: E1108 00:06:54.323939 3341 kuberuntime_manager.go:1546] "Failed to stop sandbox" podSandboxID={"Type":"containerd","ID":"b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62"} Nov 8 00:06:54.325160 kubelet[3341]: E1108 00:06:54.324082 3341 kuberuntime_manager.go:1146] "killPodWithSyncResult failed" err="failed to \"KillPodSandbox\" for \"52f757de-0e18-4b03-af0a-9737e167b914\" with KillPodSandboxError: \"rpc error: code = Unknown desc = failed to destroy network for sandbox \\\"b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62\\\": plugin type=\\\"calico\\\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" Nov 8 00:06:54.325160 kubelet[3341]: E1108 00:06:54.324838 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"KillPodSandbox\" for \"52f757de-0e18-4b03-af0a-9737e167b914\" with KillPodSandboxError: \"rpc error: code = Unknown desc = failed to destroy network for sandbox \\\"b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62\\\": plugin type=\\\"calico\\\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-system/calico-kube-controllers-7cc5d59f7b-q89cg" podUID="52f757de-0e18-4b03-af0a-9737e167b914" Nov 8 00:06:54.341987 containerd[2009]: time="2025-11-08T00:06:54.341603504Z" level=error msg="StopPodSandbox for \"9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584\" failed" error="failed to destroy network for sandbox \"9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584\": plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 8 00:06:54.342159 kubelet[3341]: E1108 00:06:54.341971 3341 log.go:32] "StopPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to destroy network for sandbox \"9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584\": plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" podSandboxID="9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584" Nov 8 00:06:54.342159 kubelet[3341]: E1108 00:06:54.342049 3341 kuberuntime_manager.go:1546] "Failed to stop sandbox" podSandboxID={"Type":"containerd","ID":"9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584"} Nov 8 00:06:54.342159 kubelet[3341]: E1108 00:06:54.342113 3341 kuberuntime_manager.go:1146] "killPodWithSyncResult failed" err="failed to \"KillPodSandbox\" for \"dd9a1fb2-7bfc-4968-86fa-9fc28ad38b94\" with KillPodSandboxError: \"rpc error: code = Unknown desc = failed to destroy network for sandbox \\\"9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584\\\": plugin type=\\\"calico\\\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" Nov 8 00:06:54.342503 kubelet[3341]: E1108 00:06:54.342155 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"KillPodSandbox\" for \"dd9a1fb2-7bfc-4968-86fa-9fc28ad38b94\" with KillPodSandboxError: \"rpc error: code = Unknown desc = failed to destroy network for sandbox \\\"9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584\\\": plugin type=\\\"calico\\\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="kube-system/coredns-668d6bf9bc-54b9r" podUID="dd9a1fb2-7bfc-4968-86fa-9fc28ad38b94" Nov 8 00:06:54.353064 containerd[2009]: time="2025-11-08T00:06:54.351681692Z" level=error msg="StopPodSandbox for \"d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de\" failed" error="failed to destroy network for sandbox \"d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de\": plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 8 00:06:54.353253 kubelet[3341]: E1108 00:06:54.352521 3341 log.go:32] "StopPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to destroy network for sandbox \"d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de\": plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" podSandboxID="d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de" Nov 8 00:06:54.353253 kubelet[3341]: E1108 00:06:54.352594 3341 kuberuntime_manager.go:1546] "Failed to stop sandbox" podSandboxID={"Type":"containerd","ID":"d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de"} Nov 8 00:06:54.353253 kubelet[3341]: E1108 00:06:54.352648 3341 kuberuntime_manager.go:1146] "killPodWithSyncResult failed" err="failed to \"KillPodSandbox\" for \"0fc7336a-4c45-40ec-b634-101ce08e1be1\" with KillPodSandboxError: \"rpc error: code = Unknown desc = failed to destroy network for sandbox \\\"d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de\\\": plugin type=\\\"calico\\\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" Nov 8 00:06:54.353253 kubelet[3341]: E1108 00:06:54.352690 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"KillPodSandbox\" for \"0fc7336a-4c45-40ec-b634-101ce08e1be1\" with KillPodSandboxError: \"rpc error: code = Unknown desc = failed to destroy network for sandbox \\\"d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de\\\": plugin type=\\\"calico\\\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-system/csi-node-driver-8rk2x" podUID="0fc7336a-4c45-40ec-b634-101ce08e1be1" Nov 8 00:06:54.385808 containerd[2009]: time="2025-11-08T00:06:54.384034389Z" level=error msg="StopPodSandbox for \"aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9\" failed" error="failed to destroy network for sandbox \"aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9\": plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 8 00:06:54.386446 kubelet[3341]: E1108 00:06:54.385500 3341 log.go:32] "StopPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to destroy network for sandbox \"aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9\": plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" podSandboxID="aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9" Nov 8 00:06:54.386446 kubelet[3341]: E1108 00:06:54.385600 3341 kuberuntime_manager.go:1546] "Failed to stop sandbox" podSandboxID={"Type":"containerd","ID":"aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9"} Nov 8 00:06:54.386446 kubelet[3341]: E1108 00:06:54.385680 3341 kuberuntime_manager.go:1146] "killPodWithSyncResult failed" err="failed to \"KillPodSandbox\" for \"fa5174bf-24f6-40b6-a1a8-03b883265a37\" with KillPodSandboxError: \"rpc error: code = Unknown desc = failed to destroy network for sandbox \\\"aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9\\\": plugin type=\\\"calico\\\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" Nov 8 00:06:54.386446 kubelet[3341]: E1108 00:06:54.385725 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"KillPodSandbox\" for \"fa5174bf-24f6-40b6-a1a8-03b883265a37\" with KillPodSandboxError: \"rpc error: code = Unknown desc = failed to destroy network for sandbox \\\"aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9\\\": plugin type=\\\"calico\\\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="kube-system/coredns-668d6bf9bc-zwgsx" podUID="fa5174bf-24f6-40b6-a1a8-03b883265a37" Nov 8 00:06:54.397088 containerd[2009]: time="2025-11-08T00:06:54.396998361Z" level=error msg="StopPodSandbox for \"f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687\" failed" error="failed to destroy network for sandbox \"f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687\": plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 8 00:06:54.398075 kubelet[3341]: E1108 00:06:54.397661 3341 log.go:32] "StopPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to destroy network for sandbox \"f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687\": plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" podSandboxID="f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687" Nov 8 00:06:54.398075 kubelet[3341]: E1108 00:06:54.397764 3341 kuberuntime_manager.go:1546] "Failed to stop sandbox" podSandboxID={"Type":"containerd","ID":"f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687"} Nov 8 00:06:54.398075 kubelet[3341]: E1108 00:06:54.397829 3341 kuberuntime_manager.go:1146] "killPodWithSyncResult failed" err="failed to \"KillPodSandbox\" for \"ac78d516-6696-4a76-a1b8-01b7e90766d4\" with KillPodSandboxError: \"rpc error: code = Unknown desc = failed to destroy network for sandbox \\\"f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687\\\": plugin type=\\\"calico\\\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" Nov 8 00:06:54.398075 kubelet[3341]: E1108 00:06:54.397872 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"KillPodSandbox\" for \"ac78d516-6696-4a76-a1b8-01b7e90766d4\" with KillPodSandboxError: \"rpc error: code = Unknown desc = failed to destroy network for sandbox \\\"f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687\\\": plugin type=\\\"calico\\\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-system/goldmane-666569f655-qlmhx" podUID="ac78d516-6696-4a76-a1b8-01b7e90766d4" Nov 8 00:06:54.404651 containerd[2009]: time="2025-11-08T00:06:54.404556693Z" level=error msg="StopPodSandbox for \"915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e\" failed" error="failed to destroy network for sandbox \"915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e\": plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 8 00:06:54.405641 kubelet[3341]: E1108 00:06:54.405214 3341 log.go:32] "StopPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to destroy network for sandbox \"915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e\": plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" podSandboxID="915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e" Nov 8 00:06:54.405641 kubelet[3341]: E1108 00:06:54.405320 3341 kuberuntime_manager.go:1546] "Failed to stop sandbox" podSandboxID={"Type":"containerd","ID":"915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e"} Nov 8 00:06:54.406782 kubelet[3341]: E1108 00:06:54.405819 3341 kuberuntime_manager.go:1146] "killPodWithSyncResult failed" err="failed to \"KillPodSandbox\" for \"886783b3-53d5-4894-8799-c2c145d125ce\" with KillPodSandboxError: \"rpc error: code = Unknown desc = failed to destroy network for sandbox \\\"915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e\\\": plugin type=\\\"calico\\\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" Nov 8 00:06:54.406782 kubelet[3341]: E1108 00:06:54.405888 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"KillPodSandbox\" for \"886783b3-53d5-4894-8799-c2c145d125ce\" with KillPodSandboxError: \"rpc error: code = Unknown desc = failed to destroy network for sandbox \\\"915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e\\\": plugin type=\\\"calico\\\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-apiserver/calico-apiserver-7cbbf6b44f-pntg9" podUID="886783b3-53d5-4894-8799-c2c145d125ce" Nov 8 00:06:54.413517 containerd[2009]: time="2025-11-08T00:06:54.413314989Z" level=error msg="StopPodSandbox for \"f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f\" failed" error="failed to destroy network for sandbox \"f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f\": plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 8 00:06:54.413919 kubelet[3341]: E1108 00:06:54.413842 3341 log.go:32] "StopPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to destroy network for sandbox \"f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f\": plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" podSandboxID="f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f" Nov 8 00:06:54.414399 kubelet[3341]: E1108 00:06:54.414168 3341 kuberuntime_manager.go:1546] "Failed to stop sandbox" podSandboxID={"Type":"containerd","ID":"f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f"} Nov 8 00:06:54.414399 kubelet[3341]: E1108 00:06:54.414233 3341 kuberuntime_manager.go:1146] "killPodWithSyncResult failed" err="failed to \"KillPodSandbox\" for \"5ebb8d68-1333-4451-8b95-9db2a7195b1f\" with KillPodSandboxError: \"rpc error: code = Unknown desc = failed to destroy network for sandbox \\\"f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f\\\": plugin type=\\\"calico\\\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" Nov 8 00:06:54.414399 kubelet[3341]: E1108 00:06:54.414336 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"KillPodSandbox\" for \"5ebb8d68-1333-4451-8b95-9db2a7195b1f\" with KillPodSandboxError: \"rpc error: code = Unknown desc = failed to destroy network for sandbox \\\"f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f\\\": plugin type=\\\"calico\\\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-system/whisker-df89f8cd5-r2bdg" podUID="5ebb8d68-1333-4451-8b95-9db2a7195b1f" Nov 8 00:06:55.163404 kubelet[3341]: I1108 00:06:55.163325 3341 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c" Nov 8 00:06:55.168976 containerd[2009]: time="2025-11-08T00:06:55.168172400Z" level=info msg="StopPodSandbox for \"ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c\"" Nov 8 00:06:55.168976 containerd[2009]: time="2025-11-08T00:06:55.168485576Z" level=info msg="Ensure that sandbox ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c in task-service has been cleanup successfully" Nov 8 00:06:55.217873 containerd[2009]: time="2025-11-08T00:06:55.217807053Z" level=error msg="StopPodSandbox for \"ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c\" failed" error="failed to destroy network for sandbox \"ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c\": plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 8 00:06:55.218517 kubelet[3341]: E1108 00:06:55.218471 3341 log.go:32] "StopPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to destroy network for sandbox \"ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c\": plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" podSandboxID="ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c" Nov 8 00:06:55.218749 kubelet[3341]: E1108 00:06:55.218715 3341 kuberuntime_manager.go:1546] "Failed to stop sandbox" podSandboxID={"Type":"containerd","ID":"ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c"} Nov 8 00:06:55.218909 kubelet[3341]: E1108 00:06:55.218882 3341 kuberuntime_manager.go:1146] "killPodWithSyncResult failed" err="failed to \"KillPodSandbox\" for \"68debac0-90fa-43fc-b6a2-614e4954f14e\" with KillPodSandboxError: \"rpc error: code = Unknown desc = failed to destroy network for sandbox \\\"ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c\\\": plugin type=\\\"calico\\\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" Nov 8 00:06:55.219155 kubelet[3341]: E1108 00:06:55.219076 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"KillPodSandbox\" for \"68debac0-90fa-43fc-b6a2-614e4954f14e\" with KillPodSandboxError: \"rpc error: code = Unknown desc = failed to destroy network for sandbox \\\"ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c\\\": plugin type=\\\"calico\\\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-apiserver/calico-apiserver-66cbb68f69-hrrjm" podUID="68debac0-90fa-43fc-b6a2-614e4954f14e" Nov 8 00:07:00.403539 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount3235005709.mount: Deactivated successfully. Nov 8 00:07:00.466716 containerd[2009]: time="2025-11-08T00:07:00.466559631Z" level=info msg="ImageCreate event name:\"ghcr.io/flatcar/calico/node:v3.30.4\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 8 00:07:00.470960 containerd[2009]: time="2025-11-08T00:07:00.470871459Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/node:v3.30.4: active requests=0, bytes read=150934562" Nov 8 00:07:00.475853 containerd[2009]: time="2025-11-08T00:07:00.475764375Z" level=info msg="ImageCreate event name:\"sha256:43a5290057a103af76996c108856f92ed902f34573d7a864f55f15b8aaf4683b\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 8 00:07:00.483891 containerd[2009]: time="2025-11-08T00:07:00.483695727Z" level=info msg="ImageCreate event name:\"ghcr.io/flatcar/calico/node@sha256:e92cca333202c87d07bf57f38182fd68f0779f912ef55305eda1fccc9f33667c\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 8 00:07:00.486194 containerd[2009]: time="2025-11-08T00:07:00.485403663Z" level=info msg="Pulled image \"ghcr.io/flatcar/calico/node:v3.30.4\" with image id \"sha256:43a5290057a103af76996c108856f92ed902f34573d7a864f55f15b8aaf4683b\", repo tag \"ghcr.io/flatcar/calico/node:v3.30.4\", repo digest \"ghcr.io/flatcar/calico/node@sha256:e92cca333202c87d07bf57f38182fd68f0779f912ef55305eda1fccc9f33667c\", size \"150934424\" in 7.454402677s" Nov 8 00:07:00.486194 containerd[2009]: time="2025-11-08T00:07:00.485527587Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/node:v3.30.4\" returns image reference \"sha256:43a5290057a103af76996c108856f92ed902f34573d7a864f55f15b8aaf4683b\"" Nov 8 00:07:00.526767 containerd[2009]: time="2025-11-08T00:07:00.526699587Z" level=info msg="CreateContainer within sandbox \"08de0cee3ef35a1264f3ea05f8cbc3bf005081d57016397503fcbb099f3e6a12\" for container &ContainerMetadata{Name:calico-node,Attempt:0,}" Nov 8 00:07:00.569051 containerd[2009]: time="2025-11-08T00:07:00.568931007Z" level=info msg="CreateContainer within sandbox \"08de0cee3ef35a1264f3ea05f8cbc3bf005081d57016397503fcbb099f3e6a12\" for &ContainerMetadata{Name:calico-node,Attempt:0,} returns container id \"028c6fee0213e2b3121c28f2881abc48cf00b0e456282eb495caf12269bf26d1\"" Nov 8 00:07:00.570487 containerd[2009]: time="2025-11-08T00:07:00.570414267Z" level=info msg="StartContainer for \"028c6fee0213e2b3121c28f2881abc48cf00b0e456282eb495caf12269bf26d1\"" Nov 8 00:07:00.631633 systemd[1]: Started cri-containerd-028c6fee0213e2b3121c28f2881abc48cf00b0e456282eb495caf12269bf26d1.scope - libcontainer container 028c6fee0213e2b3121c28f2881abc48cf00b0e456282eb495caf12269bf26d1. Nov 8 00:07:00.711478 containerd[2009]: time="2025-11-08T00:07:00.710911756Z" level=info msg="StartContainer for \"028c6fee0213e2b3121c28f2881abc48cf00b0e456282eb495caf12269bf26d1\" returns successfully" Nov 8 00:07:00.986366 kernel: wireguard: WireGuard 1.0.0 loaded. See www.wireguard.com for information. Nov 8 00:07:00.986556 kernel: wireguard: Copyright (C) 2015-2019 Jason A. Donenfeld . All Rights Reserved. Nov 8 00:07:01.336441 kubelet[3341]: I1108 00:07:01.336087 3341 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="calico-system/calico-node-4gw4n" podStartSLOduration=1.65324634 podStartE2EDuration="18.336049407s" podCreationTimestamp="2025-11-08 00:06:43 +0000 UTC" firstStartedPulling="2025-11-08 00:06:43.804553908 +0000 UTC m=+42.321393463" lastFinishedPulling="2025-11-08 00:07:00.487356999 +0000 UTC m=+59.004196530" observedRunningTime="2025-11-08 00:07:01.263196003 +0000 UTC m=+59.780035822" watchObservedRunningTime="2025-11-08 00:07:01.336049407 +0000 UTC m=+59.852888950" Nov 8 00:07:01.341314 containerd[2009]: time="2025-11-08T00:07:01.339246363Z" level=info msg="StopPodSandbox for \"f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f\"" Nov 8 00:07:01.752380 containerd[2009]: 2025-11-08 00:07:01.551 [INFO][4558] cni-plugin/k8s.go 640: Cleaning up netns ContainerID="f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f" Nov 8 00:07:01.752380 containerd[2009]: 2025-11-08 00:07:01.555 [INFO][4558] cni-plugin/dataplane_linux.go 559: Deleting workload's device in netns. ContainerID="f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f" iface="eth0" netns="/var/run/netns/cni-0b71021f-844b-e8b2-c172-d1d586ca204b" Nov 8 00:07:01.752380 containerd[2009]: 2025-11-08 00:07:01.555 [INFO][4558] cni-plugin/dataplane_linux.go 570: Entered netns, deleting veth. ContainerID="f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f" iface="eth0" netns="/var/run/netns/cni-0b71021f-844b-e8b2-c172-d1d586ca204b" Nov 8 00:07:01.752380 containerd[2009]: 2025-11-08 00:07:01.558 [INFO][4558] cni-plugin/dataplane_linux.go 597: Workload's veth was already gone. Nothing to do. ContainerID="f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f" iface="eth0" netns="/var/run/netns/cni-0b71021f-844b-e8b2-c172-d1d586ca204b" Nov 8 00:07:01.752380 containerd[2009]: 2025-11-08 00:07:01.559 [INFO][4558] cni-plugin/k8s.go 647: Releasing IP address(es) ContainerID="f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f" Nov 8 00:07:01.752380 containerd[2009]: 2025-11-08 00:07:01.559 [INFO][4558] cni-plugin/utils.go 188: Calico CNI releasing IP address ContainerID="f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f" Nov 8 00:07:01.752380 containerd[2009]: 2025-11-08 00:07:01.703 [INFO][4569] ipam/ipam_plugin.go 436: Releasing address using handleID ContainerID="f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f" HandleID="k8s-pod-network.f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f" Workload="ip--172--31--23--87-k8s-whisker--df89f8cd5--r2bdg-eth0" Nov 8 00:07:01.752380 containerd[2009]: 2025-11-08 00:07:01.705 [INFO][4569] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 8 00:07:01.752380 containerd[2009]: 2025-11-08 00:07:01.705 [INFO][4569] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 8 00:07:01.752380 containerd[2009]: 2025-11-08 00:07:01.736 [WARNING][4569] ipam/ipam_plugin.go 453: Asked to release address but it doesn't exist. Ignoring ContainerID="f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f" HandleID="k8s-pod-network.f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f" Workload="ip--172--31--23--87-k8s-whisker--df89f8cd5--r2bdg-eth0" Nov 8 00:07:01.752380 containerd[2009]: 2025-11-08 00:07:01.736 [INFO][4569] ipam/ipam_plugin.go 464: Releasing address using workloadID ContainerID="f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f" HandleID="k8s-pod-network.f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f" Workload="ip--172--31--23--87-k8s-whisker--df89f8cd5--r2bdg-eth0" Nov 8 00:07:01.752380 containerd[2009]: 2025-11-08 00:07:01.741 [INFO][4569] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 8 00:07:01.752380 containerd[2009]: 2025-11-08 00:07:01.747 [INFO][4558] cni-plugin/k8s.go 653: Teardown processing complete. ContainerID="f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f" Nov 8 00:07:01.759637 systemd[1]: run-netns-cni\x2d0b71021f\x2d844b\x2de8b2\x2dc172\x2dd1d586ca204b.mount: Deactivated successfully. Nov 8 00:07:01.764317 containerd[2009]: time="2025-11-08T00:07:01.763990577Z" level=info msg="TearDown network for sandbox \"f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f\" successfully" Nov 8 00:07:01.764317 containerd[2009]: time="2025-11-08T00:07:01.764055461Z" level=info msg="StopPodSandbox for \"f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f\" returns successfully" Nov 8 00:07:01.855851 kubelet[3341]: I1108 00:07:01.854670 3341 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"whisker-backend-key-pair\" (UniqueName: \"kubernetes.io/secret/5ebb8d68-1333-4451-8b95-9db2a7195b1f-whisker-backend-key-pair\") pod \"5ebb8d68-1333-4451-8b95-9db2a7195b1f\" (UID: \"5ebb8d68-1333-4451-8b95-9db2a7195b1f\") " Nov 8 00:07:01.855851 kubelet[3341]: I1108 00:07:01.854790 3341 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"whisker-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ebb8d68-1333-4451-8b95-9db2a7195b1f-whisker-ca-bundle\") pod \"5ebb8d68-1333-4451-8b95-9db2a7195b1f\" (UID: \"5ebb8d68-1333-4451-8b95-9db2a7195b1f\") " Nov 8 00:07:01.855851 kubelet[3341]: I1108 00:07:01.854862 3341 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2tbr\" (UniqueName: \"kubernetes.io/projected/5ebb8d68-1333-4451-8b95-9db2a7195b1f-kube-api-access-b2tbr\") pod \"5ebb8d68-1333-4451-8b95-9db2a7195b1f\" (UID: \"5ebb8d68-1333-4451-8b95-9db2a7195b1f\") " Nov 8 00:07:01.871327 kubelet[3341]: I1108 00:07:01.868868 3341 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ebb8d68-1333-4451-8b95-9db2a7195b1f-kube-api-access-b2tbr" (OuterVolumeSpecName: "kube-api-access-b2tbr") pod "5ebb8d68-1333-4451-8b95-9db2a7195b1f" (UID: "5ebb8d68-1333-4451-8b95-9db2a7195b1f"). InnerVolumeSpecName "kube-api-access-b2tbr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 8 00:07:01.871327 kubelet[3341]: I1108 00:07:01.869660 3341 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ebb8d68-1333-4451-8b95-9db2a7195b1f-whisker-ca-bundle" (OuterVolumeSpecName: "whisker-ca-bundle") pod "5ebb8d68-1333-4451-8b95-9db2a7195b1f" (UID: "5ebb8d68-1333-4451-8b95-9db2a7195b1f"). InnerVolumeSpecName "whisker-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 8 00:07:01.875126 systemd[1]: var-lib-kubelet-pods-5ebb8d68\x2d1333\x2d4451\x2d8b95\x2d9db2a7195b1f-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2db2tbr.mount: Deactivated successfully. Nov 8 00:07:01.894102 systemd[1]: var-lib-kubelet-pods-5ebb8d68\x2d1333\x2d4451\x2d8b95\x2d9db2a7195b1f-volumes-kubernetes.io\x7esecret-whisker\x2dbackend\x2dkey\x2dpair.mount: Deactivated successfully. Nov 8 00:07:01.902791 kubelet[3341]: I1108 00:07:01.901680 3341 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ebb8d68-1333-4451-8b95-9db2a7195b1f-whisker-backend-key-pair" (OuterVolumeSpecName: "whisker-backend-key-pair") pod "5ebb8d68-1333-4451-8b95-9db2a7195b1f" (UID: "5ebb8d68-1333-4451-8b95-9db2a7195b1f"). InnerVolumeSpecName "whisker-backend-key-pair". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 8 00:07:01.956087 kubelet[3341]: I1108 00:07:01.955848 3341 reconciler_common.go:299] "Volume detached for volume \"whisker-backend-key-pair\" (UniqueName: \"kubernetes.io/secret/5ebb8d68-1333-4451-8b95-9db2a7195b1f-whisker-backend-key-pair\") on node \"ip-172-31-23-87\" DevicePath \"\"" Nov 8 00:07:01.957347 kubelet[3341]: I1108 00:07:01.957016 3341 reconciler_common.go:299] "Volume detached for volume \"whisker-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ebb8d68-1333-4451-8b95-9db2a7195b1f-whisker-ca-bundle\") on node \"ip-172-31-23-87\" DevicePath \"\"" Nov 8 00:07:01.957677 kubelet[3341]: I1108 00:07:01.957636 3341 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2tbr\" (UniqueName: \"kubernetes.io/projected/5ebb8d68-1333-4451-8b95-9db2a7195b1f-kube-api-access-b2tbr\") on node \"ip-172-31-23-87\" DevicePath \"\"" Nov 8 00:07:02.226111 systemd[1]: Removed slice kubepods-besteffort-pod5ebb8d68_1333_4451_8b95_9db2a7195b1f.slice - libcontainer container kubepods-besteffort-pod5ebb8d68_1333_4451_8b95_9db2a7195b1f.slice. Nov 8 00:07:02.411811 systemd[1]: run-containerd-runc-k8s.io-028c6fee0213e2b3121c28f2881abc48cf00b0e456282eb495caf12269bf26d1-runc.HMO6Zs.mount: Deactivated successfully. Nov 8 00:07:02.433752 systemd[1]: Created slice kubepods-besteffort-pod97a993f1_d70c_4bf6_ba46_4f0456d70b2e.slice - libcontainer container kubepods-besteffort-pod97a993f1_d70c_4bf6_ba46_4f0456d70b2e.slice. Nov 8 00:07:02.463381 kubelet[3341]: I1108 00:07:02.463248 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whisker-backend-key-pair\" (UniqueName: \"kubernetes.io/secret/97a993f1-d70c-4bf6-ba46-4f0456d70b2e-whisker-backend-key-pair\") pod \"whisker-54bc667d85-4nldg\" (UID: \"97a993f1-d70c-4bf6-ba46-4f0456d70b2e\") " pod="calico-system/whisker-54bc667d85-4nldg" Nov 8 00:07:02.464036 kubelet[3341]: I1108 00:07:02.463413 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79s7l\" (UniqueName: \"kubernetes.io/projected/97a993f1-d70c-4bf6-ba46-4f0456d70b2e-kube-api-access-79s7l\") pod \"whisker-54bc667d85-4nldg\" (UID: \"97a993f1-d70c-4bf6-ba46-4f0456d70b2e\") " pod="calico-system/whisker-54bc667d85-4nldg" Nov 8 00:07:02.464036 kubelet[3341]: I1108 00:07:02.463472 3341 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whisker-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97a993f1-d70c-4bf6-ba46-4f0456d70b2e-whisker-ca-bundle\") pod \"whisker-54bc667d85-4nldg\" (UID: \"97a993f1-d70c-4bf6-ba46-4f0456d70b2e\") " pod="calico-system/whisker-54bc667d85-4nldg" Nov 8 00:07:02.743350 containerd[2009]: time="2025-11-08T00:07:02.743095626Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:whisker-54bc667d85-4nldg,Uid:97a993f1-d70c-4bf6-ba46-4f0456d70b2e,Namespace:calico-system,Attempt:0,}" Nov 8 00:07:03.002792 (udev-worker)[4519]: Network interface NamePolicy= disabled on kernel command line. Nov 8 00:07:03.008414 systemd-networkd[1929]: cali3508d852d6a: Link UP Nov 8 00:07:03.012072 systemd-networkd[1929]: cali3508d852d6a: Gained carrier Nov 8 00:07:03.053952 containerd[2009]: 2025-11-08 00:07:02.833 [INFO][4618] cni-plugin/utils.go 100: File /var/lib/calico/mtu does not exist Nov 8 00:07:03.053952 containerd[2009]: 2025-11-08 00:07:02.860 [INFO][4618] cni-plugin/plugin.go 340: Calico CNI found existing endpoint: &{{WorkloadEndpoint projectcalico.org/v3} {ip--172--31--23--87-k8s-whisker--54bc667d85--4nldg-eth0 whisker-54bc667d85- calico-system 97a993f1-d70c-4bf6-ba46-4f0456d70b2e 975 0 2025-11-08 00:07:02 +0000 UTC map[app.kubernetes.io/name:whisker k8s-app:whisker pod-template-hash:54bc667d85 projectcalico.org/namespace:calico-system projectcalico.org/orchestrator:k8s projectcalico.org/serviceaccount:whisker] map[] [] [] []} {k8s ip-172-31-23-87 whisker-54bc667d85-4nldg eth0 whisker [] [] [kns.calico-system ksa.calico-system.whisker] cali3508d852d6a [] [] }} ContainerID="3952d41fb528d14b16decf1ced71077928e55f2a395ee8ddb448a1b3e06b5357" Namespace="calico-system" Pod="whisker-54bc667d85-4nldg" WorkloadEndpoint="ip--172--31--23--87-k8s-whisker--54bc667d85--4nldg-" Nov 8 00:07:03.053952 containerd[2009]: 2025-11-08 00:07:02.861 [INFO][4618] cni-plugin/k8s.go 74: Extracted identifiers for CmdAddK8s ContainerID="3952d41fb528d14b16decf1ced71077928e55f2a395ee8ddb448a1b3e06b5357" Namespace="calico-system" Pod="whisker-54bc667d85-4nldg" WorkloadEndpoint="ip--172--31--23--87-k8s-whisker--54bc667d85--4nldg-eth0" Nov 8 00:07:03.053952 containerd[2009]: 2025-11-08 00:07:02.912 [INFO][4630] ipam/ipam_plugin.go 227: Calico CNI IPAM request count IPv4=1 IPv6=0 ContainerID="3952d41fb528d14b16decf1ced71077928e55f2a395ee8ddb448a1b3e06b5357" HandleID="k8s-pod-network.3952d41fb528d14b16decf1ced71077928e55f2a395ee8ddb448a1b3e06b5357" Workload="ip--172--31--23--87-k8s-whisker--54bc667d85--4nldg-eth0" Nov 8 00:07:03.053952 containerd[2009]: 2025-11-08 00:07:02.912 [INFO][4630] ipam/ipam_plugin.go 275: Auto assigning IP ContainerID="3952d41fb528d14b16decf1ced71077928e55f2a395ee8ddb448a1b3e06b5357" HandleID="k8s-pod-network.3952d41fb528d14b16decf1ced71077928e55f2a395ee8ddb448a1b3e06b5357" Workload="ip--172--31--23--87-k8s-whisker--54bc667d85--4nldg-eth0" assignArgs=ipam.AutoAssignArgs{Num4:1, Num6:0, HandleID:(*string)(0x400024b590), Attrs:map[string]string{"namespace":"calico-system", "node":"ip-172-31-23-87", "pod":"whisker-54bc667d85-4nldg", "timestamp":"2025-11-08 00:07:02.912116935 +0000 UTC"}, Hostname:"ip-172-31-23-87", IPv4Pools:[]net.IPNet{}, IPv6Pools:[]net.IPNet{}, MaxBlocksPerHost:0, HostReservedAttrIPv4s:(*ipam.HostReservedAttr)(nil), HostReservedAttrIPv6s:(*ipam.HostReservedAttr)(nil), IntendedUse:"Workload"} Nov 8 00:07:03.053952 containerd[2009]: 2025-11-08 00:07:02.912 [INFO][4630] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 8 00:07:03.053952 containerd[2009]: 2025-11-08 00:07:02.912 [INFO][4630] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 8 00:07:03.053952 containerd[2009]: 2025-11-08 00:07:02.912 [INFO][4630] ipam/ipam.go 110: Auto-assign 1 ipv4, 0 ipv6 addrs for host 'ip-172-31-23-87' Nov 8 00:07:03.053952 containerd[2009]: 2025-11-08 00:07:02.930 [INFO][4630] ipam/ipam.go 691: Looking up existing affinities for host handle="k8s-pod-network.3952d41fb528d14b16decf1ced71077928e55f2a395ee8ddb448a1b3e06b5357" host="ip-172-31-23-87" Nov 8 00:07:03.053952 containerd[2009]: 2025-11-08 00:07:02.940 [INFO][4630] ipam/ipam.go 394: Looking up existing affinities for host host="ip-172-31-23-87" Nov 8 00:07:03.053952 containerd[2009]: 2025-11-08 00:07:02.950 [INFO][4630] ipam/ipam.go 511: Trying affinity for 192.168.100.64/26 host="ip-172-31-23-87" Nov 8 00:07:03.053952 containerd[2009]: 2025-11-08 00:07:02.955 [INFO][4630] ipam/ipam.go 158: Attempting to load block cidr=192.168.100.64/26 host="ip-172-31-23-87" Nov 8 00:07:03.053952 containerd[2009]: 2025-11-08 00:07:02.959 [INFO][4630] ipam/ipam.go 235: Affinity is confirmed and block has been loaded cidr=192.168.100.64/26 host="ip-172-31-23-87" Nov 8 00:07:03.053952 containerd[2009]: 2025-11-08 00:07:02.959 [INFO][4630] ipam/ipam.go 1219: Attempting to assign 1 addresses from block block=192.168.100.64/26 handle="k8s-pod-network.3952d41fb528d14b16decf1ced71077928e55f2a395ee8ddb448a1b3e06b5357" host="ip-172-31-23-87" Nov 8 00:07:03.053952 containerd[2009]: 2025-11-08 00:07:02.963 [INFO][4630] ipam/ipam.go 1780: Creating new handle: k8s-pod-network.3952d41fb528d14b16decf1ced71077928e55f2a395ee8ddb448a1b3e06b5357 Nov 8 00:07:03.053952 containerd[2009]: 2025-11-08 00:07:02.973 [INFO][4630] ipam/ipam.go 1246: Writing block in order to claim IPs block=192.168.100.64/26 handle="k8s-pod-network.3952d41fb528d14b16decf1ced71077928e55f2a395ee8ddb448a1b3e06b5357" host="ip-172-31-23-87" Nov 8 00:07:03.053952 containerd[2009]: 2025-11-08 00:07:02.985 [INFO][4630] ipam/ipam.go 1262: Successfully claimed IPs: [192.168.100.65/26] block=192.168.100.64/26 handle="k8s-pod-network.3952d41fb528d14b16decf1ced71077928e55f2a395ee8ddb448a1b3e06b5357" host="ip-172-31-23-87" Nov 8 00:07:03.053952 containerd[2009]: 2025-11-08 00:07:02.985 [INFO][4630] ipam/ipam.go 878: Auto-assigned 1 out of 1 IPv4s: [192.168.100.65/26] handle="k8s-pod-network.3952d41fb528d14b16decf1ced71077928e55f2a395ee8ddb448a1b3e06b5357" host="ip-172-31-23-87" Nov 8 00:07:03.053952 containerd[2009]: 2025-11-08 00:07:02.985 [INFO][4630] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 8 00:07:03.053952 containerd[2009]: 2025-11-08 00:07:02.985 [INFO][4630] ipam/ipam_plugin.go 299: Calico CNI IPAM assigned addresses IPv4=[192.168.100.65/26] IPv6=[] ContainerID="3952d41fb528d14b16decf1ced71077928e55f2a395ee8ddb448a1b3e06b5357" HandleID="k8s-pod-network.3952d41fb528d14b16decf1ced71077928e55f2a395ee8ddb448a1b3e06b5357" Workload="ip--172--31--23--87-k8s-whisker--54bc667d85--4nldg-eth0" Nov 8 00:07:03.057180 containerd[2009]: 2025-11-08 00:07:02.988 [INFO][4618] cni-plugin/k8s.go 418: Populated endpoint ContainerID="3952d41fb528d14b16decf1ced71077928e55f2a395ee8ddb448a1b3e06b5357" Namespace="calico-system" Pod="whisker-54bc667d85-4nldg" WorkloadEndpoint="ip--172--31--23--87-k8s-whisker--54bc667d85--4nldg-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--23--87-k8s-whisker--54bc667d85--4nldg-eth0", GenerateName:"whisker-54bc667d85-", Namespace:"calico-system", SelfLink:"", UID:"97a993f1-d70c-4bf6-ba46-4f0456d70b2e", ResourceVersion:"975", Generation:0, CreationTimestamp:time.Date(2025, time.November, 8, 0, 7, 2, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app.kubernetes.io/name":"whisker", "k8s-app":"whisker", "pod-template-hash":"54bc667d85", "projectcalico.org/namespace":"calico-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"whisker"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-23-87", ContainerID:"", Pod:"whisker-54bc667d85-4nldg", Endpoint:"eth0", ServiceAccountName:"whisker", IPNetworks:[]string{"192.168.100.65/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-system", "ksa.calico-system.whisker"}, InterfaceName:"cali3508d852d6a", MAC:"", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 8 00:07:03.057180 containerd[2009]: 2025-11-08 00:07:02.989 [INFO][4618] cni-plugin/k8s.go 419: Calico CNI using IPs: [192.168.100.65/32] ContainerID="3952d41fb528d14b16decf1ced71077928e55f2a395ee8ddb448a1b3e06b5357" Namespace="calico-system" Pod="whisker-54bc667d85-4nldg" WorkloadEndpoint="ip--172--31--23--87-k8s-whisker--54bc667d85--4nldg-eth0" Nov 8 00:07:03.057180 containerd[2009]: 2025-11-08 00:07:02.989 [INFO][4618] cni-plugin/dataplane_linux.go 69: Setting the host side veth name to cali3508d852d6a ContainerID="3952d41fb528d14b16decf1ced71077928e55f2a395ee8ddb448a1b3e06b5357" Namespace="calico-system" Pod="whisker-54bc667d85-4nldg" WorkloadEndpoint="ip--172--31--23--87-k8s-whisker--54bc667d85--4nldg-eth0" Nov 8 00:07:03.057180 containerd[2009]: 2025-11-08 00:07:03.019 [INFO][4618] cni-plugin/dataplane_linux.go 508: Disabling IPv4 forwarding ContainerID="3952d41fb528d14b16decf1ced71077928e55f2a395ee8ddb448a1b3e06b5357" Namespace="calico-system" Pod="whisker-54bc667d85-4nldg" WorkloadEndpoint="ip--172--31--23--87-k8s-whisker--54bc667d85--4nldg-eth0" Nov 8 00:07:03.057180 containerd[2009]: 2025-11-08 00:07:03.020 [INFO][4618] cni-plugin/k8s.go 446: Added Mac, interface name, and active container ID to endpoint ContainerID="3952d41fb528d14b16decf1ced71077928e55f2a395ee8ddb448a1b3e06b5357" Namespace="calico-system" Pod="whisker-54bc667d85-4nldg" WorkloadEndpoint="ip--172--31--23--87-k8s-whisker--54bc667d85--4nldg-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--23--87-k8s-whisker--54bc667d85--4nldg-eth0", GenerateName:"whisker-54bc667d85-", Namespace:"calico-system", SelfLink:"", UID:"97a993f1-d70c-4bf6-ba46-4f0456d70b2e", ResourceVersion:"975", Generation:0, CreationTimestamp:time.Date(2025, time.November, 8, 0, 7, 2, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app.kubernetes.io/name":"whisker", "k8s-app":"whisker", "pod-template-hash":"54bc667d85", "projectcalico.org/namespace":"calico-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"whisker"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-23-87", ContainerID:"3952d41fb528d14b16decf1ced71077928e55f2a395ee8ddb448a1b3e06b5357", Pod:"whisker-54bc667d85-4nldg", Endpoint:"eth0", ServiceAccountName:"whisker", IPNetworks:[]string{"192.168.100.65/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-system", "ksa.calico-system.whisker"}, InterfaceName:"cali3508d852d6a", MAC:"06:4d:22:80:64:ce", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 8 00:07:03.057180 containerd[2009]: 2025-11-08 00:07:03.047 [INFO][4618] cni-plugin/k8s.go 532: Wrote updated endpoint to datastore ContainerID="3952d41fb528d14b16decf1ced71077928e55f2a395ee8ddb448a1b3e06b5357" Namespace="calico-system" Pod="whisker-54bc667d85-4nldg" WorkloadEndpoint="ip--172--31--23--87-k8s-whisker--54bc667d85--4nldg-eth0" Nov 8 00:07:03.088896 containerd[2009]: time="2025-11-08T00:07:03.087909004Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1 Nov 8 00:07:03.088896 containerd[2009]: time="2025-11-08T00:07:03.088213132Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1 Nov 8 00:07:03.088896 containerd[2009]: time="2025-11-08T00:07:03.088760860Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Nov 8 00:07:03.089609 containerd[2009]: time="2025-11-08T00:07:03.089468992Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Nov 8 00:07:03.128650 systemd[1]: Started cri-containerd-3952d41fb528d14b16decf1ced71077928e55f2a395ee8ddb448a1b3e06b5357.scope - libcontainer container 3952d41fb528d14b16decf1ced71077928e55f2a395ee8ddb448a1b3e06b5357. Nov 8 00:07:03.202624 containerd[2009]: time="2025-11-08T00:07:03.202556092Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:whisker-54bc667d85-4nldg,Uid:97a993f1-d70c-4bf6-ba46-4f0456d70b2e,Namespace:calico-system,Attempt:0,} returns sandbox id \"3952d41fb528d14b16decf1ced71077928e55f2a395ee8ddb448a1b3e06b5357\"" Nov 8 00:07:03.207874 containerd[2009]: time="2025-11-08T00:07:03.207801628Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/whisker:v3.30.4\"" Nov 8 00:07:03.657184 kubelet[3341]: I1108 00:07:03.657083 3341 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ebb8d68-1333-4451-8b95-9db2a7195b1f" path="/var/lib/kubelet/pods/5ebb8d68-1333-4451-8b95-9db2a7195b1f/volumes" Nov 8 00:07:03.723536 containerd[2009]: time="2025-11-08T00:07:03.723244663Z" level=info msg="trying next host - response was http.StatusNotFound" host=ghcr.io Nov 8 00:07:03.726765 containerd[2009]: time="2025-11-08T00:07:03.726607771Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/whisker:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" Nov 8 00:07:03.726765 containerd[2009]: time="2025-11-08T00:07:03.726699595Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/whisker:v3.30.4: active requests=0, bytes read=73" Nov 8 00:07:03.727599 kubelet[3341]: E1108 00:07:03.727193 3341 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker:v3.30.4" Nov 8 00:07:03.727599 kubelet[3341]: E1108 00:07:03.727283 3341 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker:v3.30.4" Nov 8 00:07:03.733752 kubelet[3341]: E1108 00:07:03.732684 3341 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:whisker,Image:ghcr.io/flatcar/calico/whisker:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:INFO,ValueFrom:nil,},EnvVar{Name:CALICO_VERSION,Value:v3.30.4,ValueFrom:nil,},EnvVar{Name:CLUSTER_ID,Value:80bed0a1b6164782a39b475807edb893,ValueFrom:nil,},EnvVar{Name:CLUSTER_TYPE,Value:typha,kdd,k8s,operator,bgp,kubeadm,ValueFrom:nil,},EnvVar{Name:NOTIFICATIONS,Value:Enabled,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-79s7l,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod whisker-54bc667d85-4nldg_calico-system(97a993f1-d70c-4bf6-ba46-4f0456d70b2e): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" logger="UnhandledError" Nov 8 00:07:03.736012 containerd[2009]: time="2025-11-08T00:07:03.735663955Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\"" Nov 8 00:07:04.039935 containerd[2009]: time="2025-11-08T00:07:04.039706637Z" level=info msg="trying next host - response was http.StatusNotFound" host=ghcr.io Nov 8 00:07:04.042434 containerd[2009]: time="2025-11-08T00:07:04.042112325Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" Nov 8 00:07:04.042434 containerd[2009]: time="2025-11-08T00:07:04.042346241Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/whisker-backend:v3.30.4: active requests=0, bytes read=85" Nov 8 00:07:04.042799 kubelet[3341]: E1108 00:07:04.042680 3341 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker-backend:v3.30.4" Nov 8 00:07:04.042972 kubelet[3341]: E1108 00:07:04.042850 3341 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker-backend:v3.30.4" Nov 8 00:07:04.044974 kubelet[3341]: E1108 00:07:04.043655 3341 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:whisker-backend,Image:ghcr.io/flatcar/calico/whisker-backend:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:INFO,ValueFrom:nil,},EnvVar{Name:PORT,Value:3002,ValueFrom:nil,},EnvVar{Name:GOLDMANE_HOST,Value:goldmane.calico-system.svc.cluster.local:7443,ValueFrom:nil,},EnvVar{Name:TLS_CERT_PATH,Value:/whisker-backend-key-pair/tls.crt,ValueFrom:nil,},EnvVar{Name:TLS_KEY_PATH,Value:/whisker-backend-key-pair/tls.key,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:whisker-backend-key-pair,ReadOnly:true,MountPath:/whisker-backend-key-pair,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:whisker-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-79s7l,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod whisker-54bc667d85-4nldg_calico-system(97a993f1-d70c-4bf6-ba46-4f0456d70b2e): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" logger="UnhandledError" Nov 8 00:07:04.045514 kubelet[3341]: E1108 00:07:04.045406 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"whisker\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found\", failed to \"StartContainer\" for \"whisker-backend\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found\"]" pod="calico-system/whisker-54bc667d85-4nldg" podUID="97a993f1-d70c-4bf6-ba46-4f0456d70b2e" Nov 8 00:07:04.229406 kubelet[3341]: E1108 00:07:04.228622 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"whisker\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found\", failed to \"StartContainer\" for \"whisker-backend\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found\"]" pod="calico-system/whisker-54bc667d85-4nldg" podUID="97a993f1-d70c-4bf6-ba46-4f0456d70b2e" Nov 8 00:07:04.659855 containerd[2009]: time="2025-11-08T00:07:04.659695100Z" level=info msg="StopPodSandbox for \"aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9\"" Nov 8 00:07:04.662304 containerd[2009]: time="2025-11-08T00:07:04.661663868Z" level=info msg="StopPodSandbox for \"d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de\"" Nov 8 00:07:04.857305 systemd-networkd[1929]: cali3508d852d6a: Gained IPv6LL Nov 8 00:07:05.078496 containerd[2009]: 2025-11-08 00:07:04.851 [INFO][4830] cni-plugin/k8s.go 640: Cleaning up netns ContainerID="d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de" Nov 8 00:07:05.078496 containerd[2009]: 2025-11-08 00:07:04.851 [INFO][4830] cni-plugin/dataplane_linux.go 559: Deleting workload's device in netns. ContainerID="d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de" iface="eth0" netns="/var/run/netns/cni-78641123-7229-f9e1-8034-a7f50d883d38" Nov 8 00:07:05.078496 containerd[2009]: 2025-11-08 00:07:04.852 [INFO][4830] cni-plugin/dataplane_linux.go 570: Entered netns, deleting veth. ContainerID="d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de" iface="eth0" netns="/var/run/netns/cni-78641123-7229-f9e1-8034-a7f50d883d38" Nov 8 00:07:05.078496 containerd[2009]: 2025-11-08 00:07:04.853 [INFO][4830] cni-plugin/dataplane_linux.go 597: Workload's veth was already gone. Nothing to do. ContainerID="d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de" iface="eth0" netns="/var/run/netns/cni-78641123-7229-f9e1-8034-a7f50d883d38" Nov 8 00:07:05.078496 containerd[2009]: 2025-11-08 00:07:04.856 [INFO][4830] cni-plugin/k8s.go 647: Releasing IP address(es) ContainerID="d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de" Nov 8 00:07:05.078496 containerd[2009]: 2025-11-08 00:07:04.856 [INFO][4830] cni-plugin/utils.go 188: Calico CNI releasing IP address ContainerID="d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de" Nov 8 00:07:05.078496 containerd[2009]: 2025-11-08 00:07:04.962 [INFO][4847] ipam/ipam_plugin.go 436: Releasing address using handleID ContainerID="d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de" HandleID="k8s-pod-network.d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de" Workload="ip--172--31--23--87-k8s-csi--node--driver--8rk2x-eth0" Nov 8 00:07:05.078496 containerd[2009]: 2025-11-08 00:07:04.963 [INFO][4847] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 8 00:07:05.078496 containerd[2009]: 2025-11-08 00:07:04.963 [INFO][4847] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 8 00:07:05.078496 containerd[2009]: 2025-11-08 00:07:05.026 [WARNING][4847] ipam/ipam_plugin.go 453: Asked to release address but it doesn't exist. Ignoring ContainerID="d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de" HandleID="k8s-pod-network.d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de" Workload="ip--172--31--23--87-k8s-csi--node--driver--8rk2x-eth0" Nov 8 00:07:05.078496 containerd[2009]: 2025-11-08 00:07:05.027 [INFO][4847] ipam/ipam_plugin.go 464: Releasing address using workloadID ContainerID="d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de" HandleID="k8s-pod-network.d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de" Workload="ip--172--31--23--87-k8s-csi--node--driver--8rk2x-eth0" Nov 8 00:07:05.078496 containerd[2009]: 2025-11-08 00:07:05.054 [INFO][4847] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 8 00:07:05.078496 containerd[2009]: 2025-11-08 00:07:05.067 [INFO][4830] cni-plugin/k8s.go 653: Teardown processing complete. ContainerID="d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de" Nov 8 00:07:05.088369 systemd[1]: run-netns-cni\x2d78641123\x2d7229\x2df9e1\x2d8034\x2da7f50d883d38.mount: Deactivated successfully. Nov 8 00:07:05.116836 containerd[2009]: 2025-11-08 00:07:04.883 [INFO][4829] cni-plugin/k8s.go 640: Cleaning up netns ContainerID="aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9" Nov 8 00:07:05.116836 containerd[2009]: 2025-11-08 00:07:04.884 [INFO][4829] cni-plugin/dataplane_linux.go 559: Deleting workload's device in netns. ContainerID="aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9" iface="eth0" netns="/var/run/netns/cni-03004aaf-21c1-5201-aaf2-6aef61d66ccc" Nov 8 00:07:05.116836 containerd[2009]: 2025-11-08 00:07:04.886 [INFO][4829] cni-plugin/dataplane_linux.go 570: Entered netns, deleting veth. ContainerID="aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9" iface="eth0" netns="/var/run/netns/cni-03004aaf-21c1-5201-aaf2-6aef61d66ccc" Nov 8 00:07:05.116836 containerd[2009]: 2025-11-08 00:07:04.888 [INFO][4829] cni-plugin/dataplane_linux.go 597: Workload's veth was already gone. Nothing to do. ContainerID="aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9" iface="eth0" netns="/var/run/netns/cni-03004aaf-21c1-5201-aaf2-6aef61d66ccc" Nov 8 00:07:05.116836 containerd[2009]: 2025-11-08 00:07:04.888 [INFO][4829] cni-plugin/k8s.go 647: Releasing IP address(es) ContainerID="aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9" Nov 8 00:07:05.116836 containerd[2009]: 2025-11-08 00:07:04.888 [INFO][4829] cni-plugin/utils.go 188: Calico CNI releasing IP address ContainerID="aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9" Nov 8 00:07:05.116836 containerd[2009]: 2025-11-08 00:07:05.033 [INFO][4855] ipam/ipam_plugin.go 436: Releasing address using handleID ContainerID="aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9" HandleID="k8s-pod-network.aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9" Workload="ip--172--31--23--87-k8s-coredns--668d6bf9bc--zwgsx-eth0" Nov 8 00:07:05.116836 containerd[2009]: 2025-11-08 00:07:05.033 [INFO][4855] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 8 00:07:05.116836 containerd[2009]: 2025-11-08 00:07:05.054 [INFO][4855] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 8 00:07:05.116836 containerd[2009]: 2025-11-08 00:07:05.096 [WARNING][4855] ipam/ipam_plugin.go 453: Asked to release address but it doesn't exist. Ignoring ContainerID="aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9" HandleID="k8s-pod-network.aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9" Workload="ip--172--31--23--87-k8s-coredns--668d6bf9bc--zwgsx-eth0" Nov 8 00:07:05.116836 containerd[2009]: 2025-11-08 00:07:05.096 [INFO][4855] ipam/ipam_plugin.go 464: Releasing address using workloadID ContainerID="aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9" HandleID="k8s-pod-network.aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9" Workload="ip--172--31--23--87-k8s-coredns--668d6bf9bc--zwgsx-eth0" Nov 8 00:07:05.116836 containerd[2009]: 2025-11-08 00:07:05.106 [INFO][4855] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 8 00:07:05.116836 containerd[2009]: 2025-11-08 00:07:05.110 [INFO][4829] cni-plugin/k8s.go 653: Teardown processing complete. ContainerID="aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9" Nov 8 00:07:05.123594 systemd[1]: run-netns-cni\x2d03004aaf\x2d21c1\x2d5201\x2daaf2\x2d6aef61d66ccc.mount: Deactivated successfully. Nov 8 00:07:05.134822 containerd[2009]: time="2025-11-08T00:07:05.133610910Z" level=info msg="TearDown network for sandbox \"d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de\" successfully" Nov 8 00:07:05.134822 containerd[2009]: time="2025-11-08T00:07:05.133689810Z" level=info msg="StopPodSandbox for \"d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de\" returns successfully" Nov 8 00:07:05.134822 containerd[2009]: time="2025-11-08T00:07:05.133619154Z" level=info msg="TearDown network for sandbox \"aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9\" successfully" Nov 8 00:07:05.134822 containerd[2009]: time="2025-11-08T00:07:05.133817010Z" level=info msg="StopPodSandbox for \"aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9\" returns successfully" Nov 8 00:07:05.136132 containerd[2009]: time="2025-11-08T00:07:05.135798342Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:csi-node-driver-8rk2x,Uid:0fc7336a-4c45-40ec-b634-101ce08e1be1,Namespace:calico-system,Attempt:1,}" Nov 8 00:07:05.137197 containerd[2009]: time="2025-11-08T00:07:05.136798950Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-668d6bf9bc-zwgsx,Uid:fa5174bf-24f6-40b6-a1a8-03b883265a37,Namespace:kube-system,Attempt:1,}" Nov 8 00:07:05.294430 kernel: bpftool[4898]: memfd_create() called without MFD_EXEC or MFD_NOEXEC_SEAL set Nov 8 00:07:05.438992 systemd[1]: Started sshd@9-172.31.23.87:22-139.178.89.65:47516.service - OpenSSH per-connection server daemon (139.178.89.65:47516). Nov 8 00:07:05.613772 (udev-worker)[4521]: Network interface NamePolicy= disabled on kernel command line. Nov 8 00:07:05.615608 systemd-networkd[1929]: cali39e176a42dc: Link UP Nov 8 00:07:05.622929 systemd-networkd[1929]: cali39e176a42dc: Gained carrier Nov 8 00:07:05.668375 containerd[2009]: time="2025-11-08T00:07:05.666764769Z" level=info msg="StopPodSandbox for \"ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c\"" Nov 8 00:07:05.675946 sshd[4915]: Accepted publickey for core from 139.178.89.65 port 47516 ssh2: RSA SHA256:tnEXpnDY8gLTej7GJ+T99WI4otIwvlI9IcMNDF42aqw Nov 8 00:07:05.685725 sshd[4915]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 8 00:07:05.701540 containerd[2009]: 2025-11-08 00:07:05.349 [INFO][4874] cni-plugin/plugin.go 340: Calico CNI found existing endpoint: &{{WorkloadEndpoint projectcalico.org/v3} {ip--172--31--23--87-k8s-csi--node--driver--8rk2x-eth0 csi-node-driver- calico-system 0fc7336a-4c45-40ec-b634-101ce08e1be1 1012 0 2025-11-08 00:06:43 +0000 UTC map[app.kubernetes.io/name:csi-node-driver controller-revision-hash:857b56db8f k8s-app:csi-node-driver name:csi-node-driver pod-template-generation:1 projectcalico.org/namespace:calico-system projectcalico.org/orchestrator:k8s projectcalico.org/serviceaccount:csi-node-driver] map[] [] [] []} {k8s ip-172-31-23-87 csi-node-driver-8rk2x eth0 csi-node-driver [] [] [kns.calico-system ksa.calico-system.csi-node-driver] cali39e176a42dc [] [] }} ContainerID="e151133aaab94f5f99fe70265cd45b9c31389ada8426216d662f2523a4a3ecb6" Namespace="calico-system" Pod="csi-node-driver-8rk2x" WorkloadEndpoint="ip--172--31--23--87-k8s-csi--node--driver--8rk2x-" Nov 8 00:07:05.701540 containerd[2009]: 2025-11-08 00:07:05.349 [INFO][4874] cni-plugin/k8s.go 74: Extracted identifiers for CmdAddK8s ContainerID="e151133aaab94f5f99fe70265cd45b9c31389ada8426216d662f2523a4a3ecb6" Namespace="calico-system" Pod="csi-node-driver-8rk2x" WorkloadEndpoint="ip--172--31--23--87-k8s-csi--node--driver--8rk2x-eth0" Nov 8 00:07:05.701540 containerd[2009]: 2025-11-08 00:07:05.474 [INFO][4904] ipam/ipam_plugin.go 227: Calico CNI IPAM request count IPv4=1 IPv6=0 ContainerID="e151133aaab94f5f99fe70265cd45b9c31389ada8426216d662f2523a4a3ecb6" HandleID="k8s-pod-network.e151133aaab94f5f99fe70265cd45b9c31389ada8426216d662f2523a4a3ecb6" Workload="ip--172--31--23--87-k8s-csi--node--driver--8rk2x-eth0" Nov 8 00:07:05.701540 containerd[2009]: 2025-11-08 00:07:05.474 [INFO][4904] ipam/ipam_plugin.go 275: Auto assigning IP ContainerID="e151133aaab94f5f99fe70265cd45b9c31389ada8426216d662f2523a4a3ecb6" HandleID="k8s-pod-network.e151133aaab94f5f99fe70265cd45b9c31389ada8426216d662f2523a4a3ecb6" Workload="ip--172--31--23--87-k8s-csi--node--driver--8rk2x-eth0" assignArgs=ipam.AutoAssignArgs{Num4:1, Num6:0, HandleID:(*string)(0x4000330640), Attrs:map[string]string{"namespace":"calico-system", "node":"ip-172-31-23-87", "pod":"csi-node-driver-8rk2x", "timestamp":"2025-11-08 00:07:05.474388604 +0000 UTC"}, Hostname:"ip-172-31-23-87", IPv4Pools:[]net.IPNet{}, IPv6Pools:[]net.IPNet{}, MaxBlocksPerHost:0, HostReservedAttrIPv4s:(*ipam.HostReservedAttr)(nil), HostReservedAttrIPv6s:(*ipam.HostReservedAttr)(nil), IntendedUse:"Workload"} Nov 8 00:07:05.701540 containerd[2009]: 2025-11-08 00:07:05.474 [INFO][4904] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 8 00:07:05.701540 containerd[2009]: 2025-11-08 00:07:05.475 [INFO][4904] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 8 00:07:05.701540 containerd[2009]: 2025-11-08 00:07:05.475 [INFO][4904] ipam/ipam.go 110: Auto-assign 1 ipv4, 0 ipv6 addrs for host 'ip-172-31-23-87' Nov 8 00:07:05.701540 containerd[2009]: 2025-11-08 00:07:05.499 [INFO][4904] ipam/ipam.go 691: Looking up existing affinities for host handle="k8s-pod-network.e151133aaab94f5f99fe70265cd45b9c31389ada8426216d662f2523a4a3ecb6" host="ip-172-31-23-87" Nov 8 00:07:05.701540 containerd[2009]: 2025-11-08 00:07:05.511 [INFO][4904] ipam/ipam.go 394: Looking up existing affinities for host host="ip-172-31-23-87" Nov 8 00:07:05.701540 containerd[2009]: 2025-11-08 00:07:05.525 [INFO][4904] ipam/ipam.go 511: Trying affinity for 192.168.100.64/26 host="ip-172-31-23-87" Nov 8 00:07:05.701540 containerd[2009]: 2025-11-08 00:07:05.530 [INFO][4904] ipam/ipam.go 158: Attempting to load block cidr=192.168.100.64/26 host="ip-172-31-23-87" Nov 8 00:07:05.701540 containerd[2009]: 2025-11-08 00:07:05.538 [INFO][4904] ipam/ipam.go 235: Affinity is confirmed and block has been loaded cidr=192.168.100.64/26 host="ip-172-31-23-87" Nov 8 00:07:05.701540 containerd[2009]: 2025-11-08 00:07:05.538 [INFO][4904] ipam/ipam.go 1219: Attempting to assign 1 addresses from block block=192.168.100.64/26 handle="k8s-pod-network.e151133aaab94f5f99fe70265cd45b9c31389ada8426216d662f2523a4a3ecb6" host="ip-172-31-23-87" Nov 8 00:07:05.701540 containerd[2009]: 2025-11-08 00:07:05.544 [INFO][4904] ipam/ipam.go 1780: Creating new handle: k8s-pod-network.e151133aaab94f5f99fe70265cd45b9c31389ada8426216d662f2523a4a3ecb6 Nov 8 00:07:05.701540 containerd[2009]: 2025-11-08 00:07:05.557 [INFO][4904] ipam/ipam.go 1246: Writing block in order to claim IPs block=192.168.100.64/26 handle="k8s-pod-network.e151133aaab94f5f99fe70265cd45b9c31389ada8426216d662f2523a4a3ecb6" host="ip-172-31-23-87" Nov 8 00:07:05.701540 containerd[2009]: 2025-11-08 00:07:05.575 [INFO][4904] ipam/ipam.go 1262: Successfully claimed IPs: [192.168.100.66/26] block=192.168.100.64/26 handle="k8s-pod-network.e151133aaab94f5f99fe70265cd45b9c31389ada8426216d662f2523a4a3ecb6" host="ip-172-31-23-87" Nov 8 00:07:05.701540 containerd[2009]: 2025-11-08 00:07:05.575 [INFO][4904] ipam/ipam.go 878: Auto-assigned 1 out of 1 IPv4s: [192.168.100.66/26] handle="k8s-pod-network.e151133aaab94f5f99fe70265cd45b9c31389ada8426216d662f2523a4a3ecb6" host="ip-172-31-23-87" Nov 8 00:07:05.701540 containerd[2009]: 2025-11-08 00:07:05.575 [INFO][4904] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 8 00:07:05.701540 containerd[2009]: 2025-11-08 00:07:05.575 [INFO][4904] ipam/ipam_plugin.go 299: Calico CNI IPAM assigned addresses IPv4=[192.168.100.66/26] IPv6=[] ContainerID="e151133aaab94f5f99fe70265cd45b9c31389ada8426216d662f2523a4a3ecb6" HandleID="k8s-pod-network.e151133aaab94f5f99fe70265cd45b9c31389ada8426216d662f2523a4a3ecb6" Workload="ip--172--31--23--87-k8s-csi--node--driver--8rk2x-eth0" Nov 8 00:07:05.707925 containerd[2009]: 2025-11-08 00:07:05.591 [INFO][4874] cni-plugin/k8s.go 418: Populated endpoint ContainerID="e151133aaab94f5f99fe70265cd45b9c31389ada8426216d662f2523a4a3ecb6" Namespace="calico-system" Pod="csi-node-driver-8rk2x" WorkloadEndpoint="ip--172--31--23--87-k8s-csi--node--driver--8rk2x-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--23--87-k8s-csi--node--driver--8rk2x-eth0", GenerateName:"csi-node-driver-", Namespace:"calico-system", SelfLink:"", UID:"0fc7336a-4c45-40ec-b634-101ce08e1be1", ResourceVersion:"1012", Generation:0, CreationTimestamp:time.Date(2025, time.November, 8, 0, 6, 43, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app.kubernetes.io/name":"csi-node-driver", "controller-revision-hash":"857b56db8f", "k8s-app":"csi-node-driver", "name":"csi-node-driver", "pod-template-generation":"1", "projectcalico.org/namespace":"calico-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"csi-node-driver"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-23-87", ContainerID:"", Pod:"csi-node-driver-8rk2x", Endpoint:"eth0", ServiceAccountName:"csi-node-driver", IPNetworks:[]string{"192.168.100.66/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-system", "ksa.calico-system.csi-node-driver"}, InterfaceName:"cali39e176a42dc", MAC:"", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 8 00:07:05.707925 containerd[2009]: 2025-11-08 00:07:05.593 [INFO][4874] cni-plugin/k8s.go 419: Calico CNI using IPs: [192.168.100.66/32] ContainerID="e151133aaab94f5f99fe70265cd45b9c31389ada8426216d662f2523a4a3ecb6" Namespace="calico-system" Pod="csi-node-driver-8rk2x" WorkloadEndpoint="ip--172--31--23--87-k8s-csi--node--driver--8rk2x-eth0" Nov 8 00:07:05.707925 containerd[2009]: 2025-11-08 00:07:05.593 [INFO][4874] cni-plugin/dataplane_linux.go 69: Setting the host side veth name to cali39e176a42dc ContainerID="e151133aaab94f5f99fe70265cd45b9c31389ada8426216d662f2523a4a3ecb6" Namespace="calico-system" Pod="csi-node-driver-8rk2x" WorkloadEndpoint="ip--172--31--23--87-k8s-csi--node--driver--8rk2x-eth0" Nov 8 00:07:05.707925 containerd[2009]: 2025-11-08 00:07:05.626 [INFO][4874] cni-plugin/dataplane_linux.go 508: Disabling IPv4 forwarding ContainerID="e151133aaab94f5f99fe70265cd45b9c31389ada8426216d662f2523a4a3ecb6" Namespace="calico-system" Pod="csi-node-driver-8rk2x" WorkloadEndpoint="ip--172--31--23--87-k8s-csi--node--driver--8rk2x-eth0" Nov 8 00:07:05.707925 containerd[2009]: 2025-11-08 00:07:05.628 [INFO][4874] cni-plugin/k8s.go 446: Added Mac, interface name, and active container ID to endpoint ContainerID="e151133aaab94f5f99fe70265cd45b9c31389ada8426216d662f2523a4a3ecb6" Namespace="calico-system" Pod="csi-node-driver-8rk2x" WorkloadEndpoint="ip--172--31--23--87-k8s-csi--node--driver--8rk2x-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--23--87-k8s-csi--node--driver--8rk2x-eth0", GenerateName:"csi-node-driver-", Namespace:"calico-system", SelfLink:"", UID:"0fc7336a-4c45-40ec-b634-101ce08e1be1", ResourceVersion:"1012", Generation:0, CreationTimestamp:time.Date(2025, time.November, 8, 0, 6, 43, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app.kubernetes.io/name":"csi-node-driver", "controller-revision-hash":"857b56db8f", "k8s-app":"csi-node-driver", "name":"csi-node-driver", "pod-template-generation":"1", "projectcalico.org/namespace":"calico-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"csi-node-driver"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-23-87", ContainerID:"e151133aaab94f5f99fe70265cd45b9c31389ada8426216d662f2523a4a3ecb6", Pod:"csi-node-driver-8rk2x", Endpoint:"eth0", ServiceAccountName:"csi-node-driver", IPNetworks:[]string{"192.168.100.66/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-system", "ksa.calico-system.csi-node-driver"}, InterfaceName:"cali39e176a42dc", MAC:"96:75:b8:06:24:7d", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 8 00:07:05.707925 containerd[2009]: 2025-11-08 00:07:05.671 [INFO][4874] cni-plugin/k8s.go 532: Wrote updated endpoint to datastore ContainerID="e151133aaab94f5f99fe70265cd45b9c31389ada8426216d662f2523a4a3ecb6" Namespace="calico-system" Pod="csi-node-driver-8rk2x" WorkloadEndpoint="ip--172--31--23--87-k8s-csi--node--driver--8rk2x-eth0" Nov 8 00:07:05.706617 systemd-logind[1991]: New session 10 of user core. Nov 8 00:07:05.710616 systemd[1]: Started session-10.scope - Session 10 of User core. Nov 8 00:07:05.840587 systemd-networkd[1929]: calibca3b76f5bd: Link UP Nov 8 00:07:05.850358 systemd-networkd[1929]: calibca3b76f5bd: Gained carrier Nov 8 00:07:05.877295 containerd[2009]: time="2025-11-08T00:07:05.876964786Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1 Nov 8 00:07:05.881822 containerd[2009]: time="2025-11-08T00:07:05.881402494Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1 Nov 8 00:07:05.881822 containerd[2009]: time="2025-11-08T00:07:05.881552758Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Nov 8 00:07:05.882143 containerd[2009]: time="2025-11-08T00:07:05.881782354Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Nov 8 00:07:05.999971 systemd[1]: Started cri-containerd-e151133aaab94f5f99fe70265cd45b9c31389ada8426216d662f2523a4a3ecb6.scope - libcontainer container e151133aaab94f5f99fe70265cd45b9c31389ada8426216d662f2523a4a3ecb6. Nov 8 00:07:06.024418 containerd[2009]: 2025-11-08 00:07:05.357 [INFO][4872] cni-plugin/plugin.go 340: Calico CNI found existing endpoint: &{{WorkloadEndpoint projectcalico.org/v3} {ip--172--31--23--87-k8s-coredns--668d6bf9bc--zwgsx-eth0 coredns-668d6bf9bc- kube-system fa5174bf-24f6-40b6-a1a8-03b883265a37 1013 0 2025-11-08 00:06:07 +0000 UTC map[k8s-app:kube-dns pod-template-hash:668d6bf9bc projectcalico.org/namespace:kube-system projectcalico.org/orchestrator:k8s projectcalico.org/serviceaccount:coredns] map[] [] [] []} {k8s ip-172-31-23-87 coredns-668d6bf9bc-zwgsx eth0 coredns [] [] [kns.kube-system ksa.kube-system.coredns] calibca3b76f5bd [{dns UDP 53 0 } {dns-tcp TCP 53 0 } {metrics TCP 9153 0 }] [] }} ContainerID="cd1f1ee3125b98b96075edbdc8a8f90593b4e48bd20cdb31b75204c77de0c4ff" Namespace="kube-system" Pod="coredns-668d6bf9bc-zwgsx" WorkloadEndpoint="ip--172--31--23--87-k8s-coredns--668d6bf9bc--zwgsx-" Nov 8 00:07:06.024418 containerd[2009]: 2025-11-08 00:07:05.357 [INFO][4872] cni-plugin/k8s.go 74: Extracted identifiers for CmdAddK8s ContainerID="cd1f1ee3125b98b96075edbdc8a8f90593b4e48bd20cdb31b75204c77de0c4ff" Namespace="kube-system" Pod="coredns-668d6bf9bc-zwgsx" WorkloadEndpoint="ip--172--31--23--87-k8s-coredns--668d6bf9bc--zwgsx-eth0" Nov 8 00:07:06.024418 containerd[2009]: 2025-11-08 00:07:05.512 [INFO][4909] ipam/ipam_plugin.go 227: Calico CNI IPAM request count IPv4=1 IPv6=0 ContainerID="cd1f1ee3125b98b96075edbdc8a8f90593b4e48bd20cdb31b75204c77de0c4ff" HandleID="k8s-pod-network.cd1f1ee3125b98b96075edbdc8a8f90593b4e48bd20cdb31b75204c77de0c4ff" Workload="ip--172--31--23--87-k8s-coredns--668d6bf9bc--zwgsx-eth0" Nov 8 00:07:06.024418 containerd[2009]: 2025-11-08 00:07:05.513 [INFO][4909] ipam/ipam_plugin.go 275: Auto assigning IP ContainerID="cd1f1ee3125b98b96075edbdc8a8f90593b4e48bd20cdb31b75204c77de0c4ff" HandleID="k8s-pod-network.cd1f1ee3125b98b96075edbdc8a8f90593b4e48bd20cdb31b75204c77de0c4ff" Workload="ip--172--31--23--87-k8s-coredns--668d6bf9bc--zwgsx-eth0" assignArgs=ipam.AutoAssignArgs{Num4:1, Num6:0, HandleID:(*string)(0x4000121310), Attrs:map[string]string{"namespace":"kube-system", "node":"ip-172-31-23-87", "pod":"coredns-668d6bf9bc-zwgsx", "timestamp":"2025-11-08 00:07:05.512330096 +0000 UTC"}, Hostname:"ip-172-31-23-87", IPv4Pools:[]net.IPNet{}, IPv6Pools:[]net.IPNet{}, MaxBlocksPerHost:0, HostReservedAttrIPv4s:(*ipam.HostReservedAttr)(nil), HostReservedAttrIPv6s:(*ipam.HostReservedAttr)(nil), IntendedUse:"Workload"} Nov 8 00:07:06.024418 containerd[2009]: 2025-11-08 00:07:05.513 [INFO][4909] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 8 00:07:06.024418 containerd[2009]: 2025-11-08 00:07:05.576 [INFO][4909] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 8 00:07:06.024418 containerd[2009]: 2025-11-08 00:07:05.576 [INFO][4909] ipam/ipam.go 110: Auto-assign 1 ipv4, 0 ipv6 addrs for host 'ip-172-31-23-87' Nov 8 00:07:06.024418 containerd[2009]: 2025-11-08 00:07:05.627 [INFO][4909] ipam/ipam.go 691: Looking up existing affinities for host handle="k8s-pod-network.cd1f1ee3125b98b96075edbdc8a8f90593b4e48bd20cdb31b75204c77de0c4ff" host="ip-172-31-23-87" Nov 8 00:07:06.024418 containerd[2009]: 2025-11-08 00:07:05.663 [INFO][4909] ipam/ipam.go 394: Looking up existing affinities for host host="ip-172-31-23-87" Nov 8 00:07:06.024418 containerd[2009]: 2025-11-08 00:07:05.728 [INFO][4909] ipam/ipam.go 511: Trying affinity for 192.168.100.64/26 host="ip-172-31-23-87" Nov 8 00:07:06.024418 containerd[2009]: 2025-11-08 00:07:05.733 [INFO][4909] ipam/ipam.go 158: Attempting to load block cidr=192.168.100.64/26 host="ip-172-31-23-87" Nov 8 00:07:06.024418 containerd[2009]: 2025-11-08 00:07:05.744 [INFO][4909] ipam/ipam.go 235: Affinity is confirmed and block has been loaded cidr=192.168.100.64/26 host="ip-172-31-23-87" Nov 8 00:07:06.024418 containerd[2009]: 2025-11-08 00:07:05.744 [INFO][4909] ipam/ipam.go 1219: Attempting to assign 1 addresses from block block=192.168.100.64/26 handle="k8s-pod-network.cd1f1ee3125b98b96075edbdc8a8f90593b4e48bd20cdb31b75204c77de0c4ff" host="ip-172-31-23-87" Nov 8 00:07:06.024418 containerd[2009]: 2025-11-08 00:07:05.747 [INFO][4909] ipam/ipam.go 1780: Creating new handle: k8s-pod-network.cd1f1ee3125b98b96075edbdc8a8f90593b4e48bd20cdb31b75204c77de0c4ff Nov 8 00:07:06.024418 containerd[2009]: 2025-11-08 00:07:05.763 [INFO][4909] ipam/ipam.go 1246: Writing block in order to claim IPs block=192.168.100.64/26 handle="k8s-pod-network.cd1f1ee3125b98b96075edbdc8a8f90593b4e48bd20cdb31b75204c77de0c4ff" host="ip-172-31-23-87" Nov 8 00:07:06.024418 containerd[2009]: 2025-11-08 00:07:05.792 [INFO][4909] ipam/ipam.go 1262: Successfully claimed IPs: [192.168.100.67/26] block=192.168.100.64/26 handle="k8s-pod-network.cd1f1ee3125b98b96075edbdc8a8f90593b4e48bd20cdb31b75204c77de0c4ff" host="ip-172-31-23-87" Nov 8 00:07:06.024418 containerd[2009]: 2025-11-08 00:07:05.794 [INFO][4909] ipam/ipam.go 878: Auto-assigned 1 out of 1 IPv4s: [192.168.100.67/26] handle="k8s-pod-network.cd1f1ee3125b98b96075edbdc8a8f90593b4e48bd20cdb31b75204c77de0c4ff" host="ip-172-31-23-87" Nov 8 00:07:06.024418 containerd[2009]: 2025-11-08 00:07:05.794 [INFO][4909] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 8 00:07:06.024418 containerd[2009]: 2025-11-08 00:07:05.794 [INFO][4909] ipam/ipam_plugin.go 299: Calico CNI IPAM assigned addresses IPv4=[192.168.100.67/26] IPv6=[] ContainerID="cd1f1ee3125b98b96075edbdc8a8f90593b4e48bd20cdb31b75204c77de0c4ff" HandleID="k8s-pod-network.cd1f1ee3125b98b96075edbdc8a8f90593b4e48bd20cdb31b75204c77de0c4ff" Workload="ip--172--31--23--87-k8s-coredns--668d6bf9bc--zwgsx-eth0" Nov 8 00:07:06.026608 containerd[2009]: 2025-11-08 00:07:05.809 [INFO][4872] cni-plugin/k8s.go 418: Populated endpoint ContainerID="cd1f1ee3125b98b96075edbdc8a8f90593b4e48bd20cdb31b75204c77de0c4ff" Namespace="kube-system" Pod="coredns-668d6bf9bc-zwgsx" WorkloadEndpoint="ip--172--31--23--87-k8s-coredns--668d6bf9bc--zwgsx-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--23--87-k8s-coredns--668d6bf9bc--zwgsx-eth0", GenerateName:"coredns-668d6bf9bc-", Namespace:"kube-system", SelfLink:"", UID:"fa5174bf-24f6-40b6-a1a8-03b883265a37", ResourceVersion:"1013", Generation:0, CreationTimestamp:time.Date(2025, time.November, 8, 0, 6, 7, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-dns", "pod-template-hash":"668d6bf9bc", "projectcalico.org/namespace":"kube-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"coredns"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-23-87", ContainerID:"", Pod:"coredns-668d6bf9bc-zwgsx", Endpoint:"eth0", ServiceAccountName:"coredns", IPNetworks:[]string{"192.168.100.67/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.kube-system", "ksa.kube-system.coredns"}, InterfaceName:"calibca3b76f5bd", MAC:"", Ports:[]v3.WorkloadEndpointPort{v3.WorkloadEndpointPort{Name:"dns", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"UDP"}, Port:0x35, HostPort:0x0, HostIP:""}, v3.WorkloadEndpointPort{Name:"dns-tcp", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"TCP"}, Port:0x35, HostPort:0x0, HostIP:""}, v3.WorkloadEndpointPort{Name:"metrics", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"TCP"}, Port:0x23c1, HostPort:0x0, HostIP:""}}, AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 8 00:07:06.026608 containerd[2009]: 2025-11-08 00:07:05.810 [INFO][4872] cni-plugin/k8s.go 419: Calico CNI using IPs: [192.168.100.67/32] ContainerID="cd1f1ee3125b98b96075edbdc8a8f90593b4e48bd20cdb31b75204c77de0c4ff" Namespace="kube-system" Pod="coredns-668d6bf9bc-zwgsx" WorkloadEndpoint="ip--172--31--23--87-k8s-coredns--668d6bf9bc--zwgsx-eth0" Nov 8 00:07:06.026608 containerd[2009]: 2025-11-08 00:07:05.813 [INFO][4872] cni-plugin/dataplane_linux.go 69: Setting the host side veth name to calibca3b76f5bd ContainerID="cd1f1ee3125b98b96075edbdc8a8f90593b4e48bd20cdb31b75204c77de0c4ff" Namespace="kube-system" Pod="coredns-668d6bf9bc-zwgsx" WorkloadEndpoint="ip--172--31--23--87-k8s-coredns--668d6bf9bc--zwgsx-eth0" Nov 8 00:07:06.026608 containerd[2009]: 2025-11-08 00:07:05.849 [INFO][4872] cni-plugin/dataplane_linux.go 508: Disabling IPv4 forwarding ContainerID="cd1f1ee3125b98b96075edbdc8a8f90593b4e48bd20cdb31b75204c77de0c4ff" Namespace="kube-system" Pod="coredns-668d6bf9bc-zwgsx" WorkloadEndpoint="ip--172--31--23--87-k8s-coredns--668d6bf9bc--zwgsx-eth0" Nov 8 00:07:06.026608 containerd[2009]: 2025-11-08 00:07:05.850 [INFO][4872] cni-plugin/k8s.go 446: Added Mac, interface name, and active container ID to endpoint ContainerID="cd1f1ee3125b98b96075edbdc8a8f90593b4e48bd20cdb31b75204c77de0c4ff" Namespace="kube-system" Pod="coredns-668d6bf9bc-zwgsx" WorkloadEndpoint="ip--172--31--23--87-k8s-coredns--668d6bf9bc--zwgsx-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--23--87-k8s-coredns--668d6bf9bc--zwgsx-eth0", GenerateName:"coredns-668d6bf9bc-", Namespace:"kube-system", SelfLink:"", UID:"fa5174bf-24f6-40b6-a1a8-03b883265a37", ResourceVersion:"1013", Generation:0, CreationTimestamp:time.Date(2025, time.November, 8, 0, 6, 7, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-dns", "pod-template-hash":"668d6bf9bc", "projectcalico.org/namespace":"kube-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"coredns"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-23-87", ContainerID:"cd1f1ee3125b98b96075edbdc8a8f90593b4e48bd20cdb31b75204c77de0c4ff", Pod:"coredns-668d6bf9bc-zwgsx", Endpoint:"eth0", ServiceAccountName:"coredns", IPNetworks:[]string{"192.168.100.67/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.kube-system", "ksa.kube-system.coredns"}, InterfaceName:"calibca3b76f5bd", MAC:"7a:1d:37:bc:5d:59", Ports:[]v3.WorkloadEndpointPort{v3.WorkloadEndpointPort{Name:"dns", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"UDP"}, Port:0x35, HostPort:0x0, HostIP:""}, v3.WorkloadEndpointPort{Name:"dns-tcp", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"TCP"}, Port:0x35, HostPort:0x0, HostIP:""}, v3.WorkloadEndpointPort{Name:"metrics", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"TCP"}, Port:0x23c1, HostPort:0x0, HostIP:""}}, AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 8 00:07:06.026608 containerd[2009]: 2025-11-08 00:07:06.005 [INFO][4872] cni-plugin/k8s.go 532: Wrote updated endpoint to datastore ContainerID="cd1f1ee3125b98b96075edbdc8a8f90593b4e48bd20cdb31b75204c77de0c4ff" Namespace="kube-system" Pod="coredns-668d6bf9bc-zwgsx" WorkloadEndpoint="ip--172--31--23--87-k8s-coredns--668d6bf9bc--zwgsx-eth0" Nov 8 00:07:06.111855 containerd[2009]: time="2025-11-08T00:07:06.110557171Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1 Nov 8 00:07:06.115452 containerd[2009]: time="2025-11-08T00:07:06.113529007Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1 Nov 8 00:07:06.115452 containerd[2009]: time="2025-11-08T00:07:06.113621059Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Nov 8 00:07:06.115452 containerd[2009]: time="2025-11-08T00:07:06.113985715Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Nov 8 00:07:06.229667 systemd[1]: Started cri-containerd-cd1f1ee3125b98b96075edbdc8a8f90593b4e48bd20cdb31b75204c77de0c4ff.scope - libcontainer container cd1f1ee3125b98b96075edbdc8a8f90593b4e48bd20cdb31b75204c77de0c4ff. Nov 8 00:07:06.287626 sshd[4915]: pam_unix(sshd:session): session closed for user core Nov 8 00:07:06.307088 systemd[1]: sshd@9-172.31.23.87:22-139.178.89.65:47516.service: Deactivated successfully. Nov 8 00:07:06.317520 systemd[1]: session-10.scope: Deactivated successfully. Nov 8 00:07:06.327414 systemd-logind[1991]: Session 10 logged out. Waiting for processes to exit. Nov 8 00:07:06.331895 systemd-logind[1991]: Removed session 10. Nov 8 00:07:06.371803 containerd[2009]: 2025-11-08 00:07:06.154 [INFO][4936] cni-plugin/k8s.go 640: Cleaning up netns ContainerID="ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c" Nov 8 00:07:06.371803 containerd[2009]: 2025-11-08 00:07:06.154 [INFO][4936] cni-plugin/dataplane_linux.go 559: Deleting workload's device in netns. ContainerID="ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c" iface="eth0" netns="/var/run/netns/cni-d248abb7-12f6-bd97-0da8-37fcf7fa6272" Nov 8 00:07:06.371803 containerd[2009]: 2025-11-08 00:07:06.156 [INFO][4936] cni-plugin/dataplane_linux.go 570: Entered netns, deleting veth. ContainerID="ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c" iface="eth0" netns="/var/run/netns/cni-d248abb7-12f6-bd97-0da8-37fcf7fa6272" Nov 8 00:07:06.371803 containerd[2009]: 2025-11-08 00:07:06.158 [INFO][4936] cni-plugin/dataplane_linux.go 597: Workload's veth was already gone. Nothing to do. ContainerID="ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c" iface="eth0" netns="/var/run/netns/cni-d248abb7-12f6-bd97-0da8-37fcf7fa6272" Nov 8 00:07:06.371803 containerd[2009]: 2025-11-08 00:07:06.159 [INFO][4936] cni-plugin/k8s.go 647: Releasing IP address(es) ContainerID="ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c" Nov 8 00:07:06.371803 containerd[2009]: 2025-11-08 00:07:06.160 [INFO][4936] cni-plugin/utils.go 188: Calico CNI releasing IP address ContainerID="ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c" Nov 8 00:07:06.371803 containerd[2009]: 2025-11-08 00:07:06.329 [INFO][5015] ipam/ipam_plugin.go 436: Releasing address using handleID ContainerID="ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c" HandleID="k8s-pod-network.ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c" Workload="ip--172--31--23--87-k8s-calico--apiserver--66cbb68f69--hrrjm-eth0" Nov 8 00:07:06.371803 containerd[2009]: 2025-11-08 00:07:06.334 [INFO][5015] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 8 00:07:06.371803 containerd[2009]: 2025-11-08 00:07:06.334 [INFO][5015] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 8 00:07:06.371803 containerd[2009]: 2025-11-08 00:07:06.354 [WARNING][5015] ipam/ipam_plugin.go 453: Asked to release address but it doesn't exist. Ignoring ContainerID="ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c" HandleID="k8s-pod-network.ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c" Workload="ip--172--31--23--87-k8s-calico--apiserver--66cbb68f69--hrrjm-eth0" Nov 8 00:07:06.371803 containerd[2009]: 2025-11-08 00:07:06.354 [INFO][5015] ipam/ipam_plugin.go 464: Releasing address using workloadID ContainerID="ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c" HandleID="k8s-pod-network.ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c" Workload="ip--172--31--23--87-k8s-calico--apiserver--66cbb68f69--hrrjm-eth0" Nov 8 00:07:06.371803 containerd[2009]: 2025-11-08 00:07:06.358 [INFO][5015] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 8 00:07:06.371803 containerd[2009]: 2025-11-08 00:07:06.365 [INFO][4936] cni-plugin/k8s.go 653: Teardown processing complete. ContainerID="ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c" Nov 8 00:07:06.381354 systemd[1]: run-netns-cni\x2dd248abb7\x2d12f6\x2dbd97\x2d0da8\x2d37fcf7fa6272.mount: Deactivated successfully. Nov 8 00:07:06.398863 containerd[2009]: time="2025-11-08T00:07:06.398798564Z" level=info msg="TearDown network for sandbox \"ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c\" successfully" Nov 8 00:07:06.399365 containerd[2009]: time="2025-11-08T00:07:06.399077180Z" level=info msg="StopPodSandbox for \"ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c\" returns successfully" Nov 8 00:07:06.401746 containerd[2009]: time="2025-11-08T00:07:06.400989092Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-66cbb68f69-hrrjm,Uid:68debac0-90fa-43fc-b6a2-614e4954f14e,Namespace:calico-apiserver,Attempt:1,}" Nov 8 00:07:06.503711 containerd[2009]: time="2025-11-08T00:07:06.503654805Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-668d6bf9bc-zwgsx,Uid:fa5174bf-24f6-40b6-a1a8-03b883265a37,Namespace:kube-system,Attempt:1,} returns sandbox id \"cd1f1ee3125b98b96075edbdc8a8f90593b4e48bd20cdb31b75204c77de0c4ff\"" Nov 8 00:07:06.514443 containerd[2009]: time="2025-11-08T00:07:06.514387185Z" level=info msg="CreateContainer within sandbox \"cd1f1ee3125b98b96075edbdc8a8f90593b4e48bd20cdb31b75204c77de0c4ff\" for container &ContainerMetadata{Name:coredns,Attempt:0,}" Nov 8 00:07:06.611684 containerd[2009]: time="2025-11-08T00:07:06.610906401Z" level=info msg="CreateContainer within sandbox \"cd1f1ee3125b98b96075edbdc8a8f90593b4e48bd20cdb31b75204c77de0c4ff\" for &ContainerMetadata{Name:coredns,Attempt:0,} returns container id \"47e2d8bd19e4049a6f85f0979084bf9983f15482953b49f465f870e2ee7155e2\"" Nov 8 00:07:06.619321 containerd[2009]: time="2025-11-08T00:07:06.618437901Z" level=info msg="StartContainer for \"47e2d8bd19e4049a6f85f0979084bf9983f15482953b49f465f870e2ee7155e2\"" Nov 8 00:07:06.658801 containerd[2009]: time="2025-11-08T00:07:06.657911782Z" level=info msg="StopPodSandbox for \"b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62\"" Nov 8 00:07:06.673249 containerd[2009]: time="2025-11-08T00:07:06.673134742Z" level=info msg="StopPodSandbox for \"915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e\"" Nov 8 00:07:06.715512 containerd[2009]: time="2025-11-08T00:07:06.713537182Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:csi-node-driver-8rk2x,Uid:0fc7336a-4c45-40ec-b634-101ce08e1be1,Namespace:calico-system,Attempt:1,} returns sandbox id \"e151133aaab94f5f99fe70265cd45b9c31389ada8426216d662f2523a4a3ecb6\"" Nov 8 00:07:06.727469 containerd[2009]: time="2025-11-08T00:07:06.725014282Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/csi:v3.30.4\"" Nov 8 00:07:06.868936 systemd[1]: Started cri-containerd-47e2d8bd19e4049a6f85f0979084bf9983f15482953b49f465f870e2ee7155e2.scope - libcontainer container 47e2d8bd19e4049a6f85f0979084bf9983f15482953b49f465f870e2ee7155e2. Nov 8 00:07:06.970472 systemd-networkd[1929]: cali39e176a42dc: Gained IPv6LL Nov 8 00:07:06.971634 systemd-networkd[1929]: calibca3b76f5bd: Gained IPv6LL Nov 8 00:07:07.052742 containerd[2009]: time="2025-11-08T00:07:07.052168183Z" level=info msg="trying next host - response was http.StatusNotFound" host=ghcr.io Nov 8 00:07:07.058322 containerd[2009]: time="2025-11-08T00:07:07.057198847Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/csi:v3.30.4: active requests=0, bytes read=69" Nov 8 00:07:07.058745 containerd[2009]: time="2025-11-08T00:07:07.058553996Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/csi:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" Nov 8 00:07:07.060398 kubelet[3341]: E1108 00:07:07.058911 3341 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" image="ghcr.io/flatcar/calico/csi:v3.30.4" Nov 8 00:07:07.060398 kubelet[3341]: E1108 00:07:07.058986 3341 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" image="ghcr.io/flatcar/calico/csi:v3.30.4" Nov 8 00:07:07.068940 kubelet[3341]: E1108 00:07:07.068124 3341 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:calico-csi,Image:ghcr.io/flatcar/calico/csi:v3.30.4,Command:[],Args:[--nodeid=$(KUBE_NODE_NAME) --loglevel=$(LOG_LEVEL)],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:warn,ValueFrom:nil,},EnvVar{Name:KUBE_NODE_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:spec.nodeName,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kubelet-dir,ReadOnly:false,MountPath:/var/lib/kubelet,SubPath:,MountPropagation:*Bidirectional,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:socket-dir,ReadOnly:false,MountPath:/csi,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:varrun,ReadOnly:false,MountPath:/var/run,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-cmvgp,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*true,SELinuxOptions:nil,RunAsUser:*0,RunAsNonRoot:*false,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*true,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod csi-node-driver-8rk2x_calico-system(0fc7336a-4c45-40ec-b634-101ce08e1be1): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" logger="UnhandledError" Nov 8 00:07:07.075782 containerd[2009]: time="2025-11-08T00:07:07.074631584Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\"" Nov 8 00:07:07.138324 containerd[2009]: time="2025-11-08T00:07:07.137941424Z" level=info msg="StartContainer for \"47e2d8bd19e4049a6f85f0979084bf9983f15482953b49f465f870e2ee7155e2\" returns successfully" Nov 8 00:07:07.302360 systemd-networkd[1929]: cali6c23a06d65d: Link UP Nov 8 00:07:07.303592 systemd-networkd[1929]: cali6c23a06d65d: Gained carrier Nov 8 00:07:07.377981 containerd[2009]: 2025-11-08 00:07:06.742 [INFO][5051] cni-plugin/plugin.go 340: Calico CNI found existing endpoint: &{{WorkloadEndpoint projectcalico.org/v3} {ip--172--31--23--87-k8s-calico--apiserver--66cbb68f69--hrrjm-eth0 calico-apiserver-66cbb68f69- calico-apiserver 68debac0-90fa-43fc-b6a2-614e4954f14e 1050 0 2025-11-08 00:06:34 +0000 UTC map[apiserver:true app.kubernetes.io/name:calico-apiserver k8s-app:calico-apiserver pod-template-hash:66cbb68f69 projectcalico.org/namespace:calico-apiserver projectcalico.org/orchestrator:k8s projectcalico.org/serviceaccount:calico-apiserver] map[] [] [] []} {k8s ip-172-31-23-87 calico-apiserver-66cbb68f69-hrrjm eth0 calico-apiserver [] [] [kns.calico-apiserver ksa.calico-apiserver.calico-apiserver] cali6c23a06d65d [] [] }} ContainerID="d285a3477da596cd29022982bf7f75dbea016f04079d31c7b5a2b7094d9c103e" Namespace="calico-apiserver" Pod="calico-apiserver-66cbb68f69-hrrjm" WorkloadEndpoint="ip--172--31--23--87-k8s-calico--apiserver--66cbb68f69--hrrjm-" Nov 8 00:07:07.377981 containerd[2009]: 2025-11-08 00:07:06.744 [INFO][5051] cni-plugin/k8s.go 74: Extracted identifiers for CmdAddK8s ContainerID="d285a3477da596cd29022982bf7f75dbea016f04079d31c7b5a2b7094d9c103e" Namespace="calico-apiserver" Pod="calico-apiserver-66cbb68f69-hrrjm" WorkloadEndpoint="ip--172--31--23--87-k8s-calico--apiserver--66cbb68f69--hrrjm-eth0" Nov 8 00:07:07.377981 containerd[2009]: 2025-11-08 00:07:07.047 [INFO][5127] ipam/ipam_plugin.go 227: Calico CNI IPAM request count IPv4=1 IPv6=0 ContainerID="d285a3477da596cd29022982bf7f75dbea016f04079d31c7b5a2b7094d9c103e" HandleID="k8s-pod-network.d285a3477da596cd29022982bf7f75dbea016f04079d31c7b5a2b7094d9c103e" Workload="ip--172--31--23--87-k8s-calico--apiserver--66cbb68f69--hrrjm-eth0" Nov 8 00:07:07.377981 containerd[2009]: 2025-11-08 00:07:07.050 [INFO][5127] ipam/ipam_plugin.go 275: Auto assigning IP ContainerID="d285a3477da596cd29022982bf7f75dbea016f04079d31c7b5a2b7094d9c103e" HandleID="k8s-pod-network.d285a3477da596cd29022982bf7f75dbea016f04079d31c7b5a2b7094d9c103e" Workload="ip--172--31--23--87-k8s-calico--apiserver--66cbb68f69--hrrjm-eth0" assignArgs=ipam.AutoAssignArgs{Num4:1, Num6:0, HandleID:(*string)(0x40003ba890), Attrs:map[string]string{"namespace":"calico-apiserver", "node":"ip-172-31-23-87", "pod":"calico-apiserver-66cbb68f69-hrrjm", "timestamp":"2025-11-08 00:07:07.047863903 +0000 UTC"}, Hostname:"ip-172-31-23-87", IPv4Pools:[]net.IPNet{}, IPv6Pools:[]net.IPNet{}, MaxBlocksPerHost:0, HostReservedAttrIPv4s:(*ipam.HostReservedAttr)(nil), HostReservedAttrIPv6s:(*ipam.HostReservedAttr)(nil), IntendedUse:"Workload"} Nov 8 00:07:07.377981 containerd[2009]: 2025-11-08 00:07:07.050 [INFO][5127] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 8 00:07:07.377981 containerd[2009]: 2025-11-08 00:07:07.051 [INFO][5127] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 8 00:07:07.377981 containerd[2009]: 2025-11-08 00:07:07.052 [INFO][5127] ipam/ipam.go 110: Auto-assign 1 ipv4, 0 ipv6 addrs for host 'ip-172-31-23-87' Nov 8 00:07:07.377981 containerd[2009]: 2025-11-08 00:07:07.146 [INFO][5127] ipam/ipam.go 691: Looking up existing affinities for host handle="k8s-pod-network.d285a3477da596cd29022982bf7f75dbea016f04079d31c7b5a2b7094d9c103e" host="ip-172-31-23-87" Nov 8 00:07:07.377981 containerd[2009]: 2025-11-08 00:07:07.176 [INFO][5127] ipam/ipam.go 394: Looking up existing affinities for host host="ip-172-31-23-87" Nov 8 00:07:07.377981 containerd[2009]: 2025-11-08 00:07:07.206 [INFO][5127] ipam/ipam.go 511: Trying affinity for 192.168.100.64/26 host="ip-172-31-23-87" Nov 8 00:07:07.377981 containerd[2009]: 2025-11-08 00:07:07.216 [INFO][5127] ipam/ipam.go 158: Attempting to load block cidr=192.168.100.64/26 host="ip-172-31-23-87" Nov 8 00:07:07.377981 containerd[2009]: 2025-11-08 00:07:07.225 [INFO][5127] ipam/ipam.go 235: Affinity is confirmed and block has been loaded cidr=192.168.100.64/26 host="ip-172-31-23-87" Nov 8 00:07:07.377981 containerd[2009]: 2025-11-08 00:07:07.225 [INFO][5127] ipam/ipam.go 1219: Attempting to assign 1 addresses from block block=192.168.100.64/26 handle="k8s-pod-network.d285a3477da596cd29022982bf7f75dbea016f04079d31c7b5a2b7094d9c103e" host="ip-172-31-23-87" Nov 8 00:07:07.377981 containerd[2009]: 2025-11-08 00:07:07.233 [INFO][5127] ipam/ipam.go 1780: Creating new handle: k8s-pod-network.d285a3477da596cd29022982bf7f75dbea016f04079d31c7b5a2b7094d9c103e Nov 8 00:07:07.377981 containerd[2009]: 2025-11-08 00:07:07.256 [INFO][5127] ipam/ipam.go 1246: Writing block in order to claim IPs block=192.168.100.64/26 handle="k8s-pod-network.d285a3477da596cd29022982bf7f75dbea016f04079d31c7b5a2b7094d9c103e" host="ip-172-31-23-87" Nov 8 00:07:07.377981 containerd[2009]: 2025-11-08 00:07:07.278 [INFO][5127] ipam/ipam.go 1262: Successfully claimed IPs: [192.168.100.68/26] block=192.168.100.64/26 handle="k8s-pod-network.d285a3477da596cd29022982bf7f75dbea016f04079d31c7b5a2b7094d9c103e" host="ip-172-31-23-87" Nov 8 00:07:07.377981 containerd[2009]: 2025-11-08 00:07:07.278 [INFO][5127] ipam/ipam.go 878: Auto-assigned 1 out of 1 IPv4s: [192.168.100.68/26] handle="k8s-pod-network.d285a3477da596cd29022982bf7f75dbea016f04079d31c7b5a2b7094d9c103e" host="ip-172-31-23-87" Nov 8 00:07:07.377981 containerd[2009]: 2025-11-08 00:07:07.279 [INFO][5127] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 8 00:07:07.377981 containerd[2009]: 2025-11-08 00:07:07.280 [INFO][5127] ipam/ipam_plugin.go 299: Calico CNI IPAM assigned addresses IPv4=[192.168.100.68/26] IPv6=[] ContainerID="d285a3477da596cd29022982bf7f75dbea016f04079d31c7b5a2b7094d9c103e" HandleID="k8s-pod-network.d285a3477da596cd29022982bf7f75dbea016f04079d31c7b5a2b7094d9c103e" Workload="ip--172--31--23--87-k8s-calico--apiserver--66cbb68f69--hrrjm-eth0" Nov 8 00:07:07.381885 containerd[2009]: 2025-11-08 00:07:07.290 [INFO][5051] cni-plugin/k8s.go 418: Populated endpoint ContainerID="d285a3477da596cd29022982bf7f75dbea016f04079d31c7b5a2b7094d9c103e" Namespace="calico-apiserver" Pod="calico-apiserver-66cbb68f69-hrrjm" WorkloadEndpoint="ip--172--31--23--87-k8s-calico--apiserver--66cbb68f69--hrrjm-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--23--87-k8s-calico--apiserver--66cbb68f69--hrrjm-eth0", GenerateName:"calico-apiserver-66cbb68f69-", Namespace:"calico-apiserver", SelfLink:"", UID:"68debac0-90fa-43fc-b6a2-614e4954f14e", ResourceVersion:"1050", Generation:0, CreationTimestamp:time.Date(2025, time.November, 8, 0, 6, 34, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"apiserver":"true", "app.kubernetes.io/name":"calico-apiserver", "k8s-app":"calico-apiserver", "pod-template-hash":"66cbb68f69", "projectcalico.org/namespace":"calico-apiserver", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"calico-apiserver"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-23-87", ContainerID:"", Pod:"calico-apiserver-66cbb68f69-hrrjm", Endpoint:"eth0", ServiceAccountName:"calico-apiserver", IPNetworks:[]string{"192.168.100.68/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-apiserver", "ksa.calico-apiserver.calico-apiserver"}, InterfaceName:"cali6c23a06d65d", MAC:"", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 8 00:07:07.381885 containerd[2009]: 2025-11-08 00:07:07.291 [INFO][5051] cni-plugin/k8s.go 419: Calico CNI using IPs: [192.168.100.68/32] ContainerID="d285a3477da596cd29022982bf7f75dbea016f04079d31c7b5a2b7094d9c103e" Namespace="calico-apiserver" Pod="calico-apiserver-66cbb68f69-hrrjm" WorkloadEndpoint="ip--172--31--23--87-k8s-calico--apiserver--66cbb68f69--hrrjm-eth0" Nov 8 00:07:07.381885 containerd[2009]: 2025-11-08 00:07:07.291 [INFO][5051] cni-plugin/dataplane_linux.go 69: Setting the host side veth name to cali6c23a06d65d ContainerID="d285a3477da596cd29022982bf7f75dbea016f04079d31c7b5a2b7094d9c103e" Namespace="calico-apiserver" Pod="calico-apiserver-66cbb68f69-hrrjm" WorkloadEndpoint="ip--172--31--23--87-k8s-calico--apiserver--66cbb68f69--hrrjm-eth0" Nov 8 00:07:07.381885 containerd[2009]: 2025-11-08 00:07:07.298 [INFO][5051] cni-plugin/dataplane_linux.go 508: Disabling IPv4 forwarding ContainerID="d285a3477da596cd29022982bf7f75dbea016f04079d31c7b5a2b7094d9c103e" Namespace="calico-apiserver" Pod="calico-apiserver-66cbb68f69-hrrjm" WorkloadEndpoint="ip--172--31--23--87-k8s-calico--apiserver--66cbb68f69--hrrjm-eth0" Nov 8 00:07:07.381885 containerd[2009]: 2025-11-08 00:07:07.299 [INFO][5051] cni-plugin/k8s.go 446: Added Mac, interface name, and active container ID to endpoint ContainerID="d285a3477da596cd29022982bf7f75dbea016f04079d31c7b5a2b7094d9c103e" Namespace="calico-apiserver" Pod="calico-apiserver-66cbb68f69-hrrjm" WorkloadEndpoint="ip--172--31--23--87-k8s-calico--apiserver--66cbb68f69--hrrjm-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--23--87-k8s-calico--apiserver--66cbb68f69--hrrjm-eth0", GenerateName:"calico-apiserver-66cbb68f69-", Namespace:"calico-apiserver", SelfLink:"", UID:"68debac0-90fa-43fc-b6a2-614e4954f14e", ResourceVersion:"1050", Generation:0, CreationTimestamp:time.Date(2025, time.November, 8, 0, 6, 34, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"apiserver":"true", "app.kubernetes.io/name":"calico-apiserver", "k8s-app":"calico-apiserver", "pod-template-hash":"66cbb68f69", "projectcalico.org/namespace":"calico-apiserver", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"calico-apiserver"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-23-87", ContainerID:"d285a3477da596cd29022982bf7f75dbea016f04079d31c7b5a2b7094d9c103e", Pod:"calico-apiserver-66cbb68f69-hrrjm", Endpoint:"eth0", ServiceAccountName:"calico-apiserver", IPNetworks:[]string{"192.168.100.68/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-apiserver", "ksa.calico-apiserver.calico-apiserver"}, InterfaceName:"cali6c23a06d65d", MAC:"2e:d5:e9:dd:27:0d", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 8 00:07:07.381885 containerd[2009]: 2025-11-08 00:07:07.360 [INFO][5051] cni-plugin/k8s.go 532: Wrote updated endpoint to datastore ContainerID="d285a3477da596cd29022982bf7f75dbea016f04079d31c7b5a2b7094d9c103e" Namespace="calico-apiserver" Pod="calico-apiserver-66cbb68f69-hrrjm" WorkloadEndpoint="ip--172--31--23--87-k8s-calico--apiserver--66cbb68f69--hrrjm-eth0" Nov 8 00:07:07.401914 containerd[2009]: 2025-11-08 00:07:07.017 [INFO][5105] cni-plugin/k8s.go 640: Cleaning up netns ContainerID="915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e" Nov 8 00:07:07.401914 containerd[2009]: 2025-11-08 00:07:07.035 [INFO][5105] cni-plugin/dataplane_linux.go 559: Deleting workload's device in netns. ContainerID="915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e" iface="eth0" netns="/var/run/netns/cni-5978dd09-f05c-804b-e1ec-386d1243eca2" Nov 8 00:07:07.401914 containerd[2009]: 2025-11-08 00:07:07.038 [INFO][5105] cni-plugin/dataplane_linux.go 570: Entered netns, deleting veth. ContainerID="915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e" iface="eth0" netns="/var/run/netns/cni-5978dd09-f05c-804b-e1ec-386d1243eca2" Nov 8 00:07:07.401914 containerd[2009]: 2025-11-08 00:07:07.039 [INFO][5105] cni-plugin/dataplane_linux.go 597: Workload's veth was already gone. Nothing to do. ContainerID="915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e" iface="eth0" netns="/var/run/netns/cni-5978dd09-f05c-804b-e1ec-386d1243eca2" Nov 8 00:07:07.401914 containerd[2009]: 2025-11-08 00:07:07.039 [INFO][5105] cni-plugin/k8s.go 647: Releasing IP address(es) ContainerID="915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e" Nov 8 00:07:07.401914 containerd[2009]: 2025-11-08 00:07:07.039 [INFO][5105] cni-plugin/utils.go 188: Calico CNI releasing IP address ContainerID="915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e" Nov 8 00:07:07.401914 containerd[2009]: 2025-11-08 00:07:07.221 [INFO][5147] ipam/ipam_plugin.go 436: Releasing address using handleID ContainerID="915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e" HandleID="k8s-pod-network.915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e" Workload="ip--172--31--23--87-k8s-calico--apiserver--7cbbf6b44f--pntg9-eth0" Nov 8 00:07:07.401914 containerd[2009]: 2025-11-08 00:07:07.223 [INFO][5147] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 8 00:07:07.401914 containerd[2009]: 2025-11-08 00:07:07.279 [INFO][5147] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 8 00:07:07.401914 containerd[2009]: 2025-11-08 00:07:07.363 [WARNING][5147] ipam/ipam_plugin.go 453: Asked to release address but it doesn't exist. Ignoring ContainerID="915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e" HandleID="k8s-pod-network.915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e" Workload="ip--172--31--23--87-k8s-calico--apiserver--7cbbf6b44f--pntg9-eth0" Nov 8 00:07:07.401914 containerd[2009]: 2025-11-08 00:07:07.363 [INFO][5147] ipam/ipam_plugin.go 464: Releasing address using workloadID ContainerID="915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e" HandleID="k8s-pod-network.915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e" Workload="ip--172--31--23--87-k8s-calico--apiserver--7cbbf6b44f--pntg9-eth0" Nov 8 00:07:07.401914 containerd[2009]: 2025-11-08 00:07:07.390 [INFO][5147] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 8 00:07:07.401914 containerd[2009]: 2025-11-08 00:07:07.394 [INFO][5105] cni-plugin/k8s.go 653: Teardown processing complete. ContainerID="915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e" Nov 8 00:07:07.415478 systemd[1]: run-netns-cni\x2d5978dd09\x2df05c\x2d804b\x2de1ec\x2d386d1243eca2.mount: Deactivated successfully. Nov 8 00:07:07.419822 containerd[2009]: time="2025-11-08T00:07:07.418442601Z" level=info msg="trying next host - response was http.StatusNotFound" host=ghcr.io Nov 8 00:07:07.422040 containerd[2009]: time="2025-11-08T00:07:07.421034421Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" Nov 8 00:07:07.422040 containerd[2009]: time="2025-11-08T00:07:07.421223721Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: active requests=0, bytes read=93" Nov 8 00:07:07.424306 kubelet[3341]: E1108 00:07:07.422596 3341 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" image="ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4" Nov 8 00:07:07.424306 kubelet[3341]: E1108 00:07:07.423064 3341 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" image="ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4" Nov 8 00:07:07.424969 kubelet[3341]: E1108 00:07:07.423249 3341 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:csi-node-driver-registrar,Image:ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4,Command:[],Args:[--v=5 --csi-address=$(ADDRESS) --kubelet-registration-path=$(DRIVER_REG_SOCK_PATH)],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:ADDRESS,Value:/csi/csi.sock,ValueFrom:nil,},EnvVar{Name:DRIVER_REG_SOCK_PATH,Value:/var/lib/kubelet/plugins/csi.tigera.io/csi.sock,ValueFrom:nil,},EnvVar{Name:KUBE_NODE_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:spec.nodeName,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:registration-dir,ReadOnly:false,MountPath:/registration,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:socket-dir,ReadOnly:false,MountPath:/csi,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-cmvgp,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*true,SELinuxOptions:nil,RunAsUser:*0,RunAsNonRoot:*false,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*true,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod csi-node-driver-8rk2x_calico-system(0fc7336a-4c45-40ec-b634-101ce08e1be1): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" logger="UnhandledError" Nov 8 00:07:07.426178 kubelet[3341]: E1108 00:07:07.425853 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"calico-csi\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ghcr.io/flatcar/calico/csi:v3.30.4: not found\", failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found\"]" pod="calico-system/csi-node-driver-8rk2x" podUID="0fc7336a-4c45-40ec-b634-101ce08e1be1" Nov 8 00:07:07.441297 containerd[2009]: time="2025-11-08T00:07:07.441215145Z" level=info msg="TearDown network for sandbox \"915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e\" successfully" Nov 8 00:07:07.441564 containerd[2009]: time="2025-11-08T00:07:07.441497841Z" level=info msg="StopPodSandbox for \"915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e\" returns successfully" Nov 8 00:07:07.447878 containerd[2009]: time="2025-11-08T00:07:07.446870037Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-7cbbf6b44f-pntg9,Uid:886783b3-53d5-4894-8799-c2c145d125ce,Namespace:calico-apiserver,Attempt:1,}" Nov 8 00:07:07.474465 containerd[2009]: 2025-11-08 00:07:07.020 [INFO][5106] cni-plugin/k8s.go 640: Cleaning up netns ContainerID="b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62" Nov 8 00:07:07.474465 containerd[2009]: 2025-11-08 00:07:07.020 [INFO][5106] cni-plugin/dataplane_linux.go 559: Deleting workload's device in netns. ContainerID="b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62" iface="eth0" netns="/var/run/netns/cni-43989779-445f-37c1-500c-ba8cf2934348" Nov 8 00:07:07.474465 containerd[2009]: 2025-11-08 00:07:07.024 [INFO][5106] cni-plugin/dataplane_linux.go 570: Entered netns, deleting veth. ContainerID="b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62" iface="eth0" netns="/var/run/netns/cni-43989779-445f-37c1-500c-ba8cf2934348" Nov 8 00:07:07.474465 containerd[2009]: 2025-11-08 00:07:07.034 [INFO][5106] cni-plugin/dataplane_linux.go 597: Workload's veth was already gone. Nothing to do. ContainerID="b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62" iface="eth0" netns="/var/run/netns/cni-43989779-445f-37c1-500c-ba8cf2934348" Nov 8 00:07:07.474465 containerd[2009]: 2025-11-08 00:07:07.035 [INFO][5106] cni-plugin/k8s.go 647: Releasing IP address(es) ContainerID="b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62" Nov 8 00:07:07.474465 containerd[2009]: 2025-11-08 00:07:07.035 [INFO][5106] cni-plugin/utils.go 188: Calico CNI releasing IP address ContainerID="b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62" Nov 8 00:07:07.474465 containerd[2009]: 2025-11-08 00:07:07.228 [INFO][5145] ipam/ipam_plugin.go 436: Releasing address using handleID ContainerID="b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62" HandleID="k8s-pod-network.b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62" Workload="ip--172--31--23--87-k8s-calico--kube--controllers--7cc5d59f7b--q89cg-eth0" Nov 8 00:07:07.474465 containerd[2009]: 2025-11-08 00:07:07.230 [INFO][5145] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 8 00:07:07.474465 containerd[2009]: 2025-11-08 00:07:07.390 [INFO][5145] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 8 00:07:07.474465 containerd[2009]: 2025-11-08 00:07:07.442 [WARNING][5145] ipam/ipam_plugin.go 453: Asked to release address but it doesn't exist. Ignoring ContainerID="b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62" HandleID="k8s-pod-network.b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62" Workload="ip--172--31--23--87-k8s-calico--kube--controllers--7cc5d59f7b--q89cg-eth0" Nov 8 00:07:07.474465 containerd[2009]: 2025-11-08 00:07:07.446 [INFO][5145] ipam/ipam_plugin.go 464: Releasing address using workloadID ContainerID="b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62" HandleID="k8s-pod-network.b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62" Workload="ip--172--31--23--87-k8s-calico--kube--controllers--7cc5d59f7b--q89cg-eth0" Nov 8 00:07:07.474465 containerd[2009]: 2025-11-08 00:07:07.454 [INFO][5145] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 8 00:07:07.474465 containerd[2009]: 2025-11-08 00:07:07.463 [INFO][5106] cni-plugin/k8s.go 653: Teardown processing complete. ContainerID="b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62" Nov 8 00:07:07.477515 containerd[2009]: time="2025-11-08T00:07:07.477457054Z" level=info msg="TearDown network for sandbox \"b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62\" successfully" Nov 8 00:07:07.477693 containerd[2009]: time="2025-11-08T00:07:07.477662530Z" level=info msg="StopPodSandbox for \"b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62\" returns successfully" Nov 8 00:07:07.483238 containerd[2009]: time="2025-11-08T00:07:07.481656202Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-kube-controllers-7cc5d59f7b-q89cg,Uid:52f757de-0e18-4b03-af0a-9737e167b914,Namespace:calico-system,Attempt:1,}" Nov 8 00:07:07.491942 systemd[1]: run-netns-cni\x2d43989779\x2d445f\x2d37c1\x2d500c\x2dba8cf2934348.mount: Deactivated successfully. Nov 8 00:07:07.515074 containerd[2009]: time="2025-11-08T00:07:07.513516250Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1 Nov 8 00:07:07.515074 containerd[2009]: time="2025-11-08T00:07:07.513942070Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1 Nov 8 00:07:07.515074 containerd[2009]: time="2025-11-08T00:07:07.513983950Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Nov 8 00:07:07.517331 containerd[2009]: time="2025-11-08T00:07:07.515868886Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Nov 8 00:07:07.646604 systemd[1]: Started cri-containerd-d285a3477da596cd29022982bf7f75dbea016f04079d31c7b5a2b7094d9c103e.scope - libcontainer container d285a3477da596cd29022982bf7f75dbea016f04079d31c7b5a2b7094d9c103e. Nov 8 00:07:07.667943 containerd[2009]: time="2025-11-08T00:07:07.667710275Z" level=info msg="StopPodSandbox for \"9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584\"" Nov 8 00:07:07.942240 kubelet[3341]: I1108 00:07:07.941981 3341 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/coredns-668d6bf9bc-zwgsx" podStartSLOduration=60.941951484 podStartE2EDuration="1m0.941951484s" podCreationTimestamp="2025-11-08 00:06:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-08 00:07:07.377784921 +0000 UTC m=+65.894624764" watchObservedRunningTime="2025-11-08 00:07:07.941951484 +0000 UTC m=+66.458791027" Nov 8 00:07:08.177730 systemd-networkd[1929]: vxlan.calico: Link UP Nov 8 00:07:08.177751 systemd-networkd[1929]: vxlan.calico: Gained carrier Nov 8 00:07:08.194680 systemd-networkd[1929]: caliac986209725: Link UP Nov 8 00:07:08.197701 systemd-networkd[1929]: caliac986209725: Gained carrier Nov 8 00:07:08.254928 containerd[2009]: 2025-11-08 00:07:07.797 [INFO][5207] cni-plugin/plugin.go 340: Calico CNI found existing endpoint: &{{WorkloadEndpoint projectcalico.org/v3} {ip--172--31--23--87-k8s-calico--kube--controllers--7cc5d59f7b--q89cg-eth0 calico-kube-controllers-7cc5d59f7b- calico-system 52f757de-0e18-4b03-af0a-9737e167b914 1064 0 2025-11-08 00:06:43 +0000 UTC map[app.kubernetes.io/name:calico-kube-controllers k8s-app:calico-kube-controllers pod-template-hash:7cc5d59f7b projectcalico.org/namespace:calico-system projectcalico.org/orchestrator:k8s projectcalico.org/serviceaccount:calico-kube-controllers] map[] [] [] []} {k8s ip-172-31-23-87 calico-kube-controllers-7cc5d59f7b-q89cg eth0 calico-kube-controllers [] [] [kns.calico-system ksa.calico-system.calico-kube-controllers] caliac986209725 [] [] }} ContainerID="842cfc773166718f3421e73107fe9b7ea33b0da8e8d45da5f07a361451df68f6" Namespace="calico-system" Pod="calico-kube-controllers-7cc5d59f7b-q89cg" WorkloadEndpoint="ip--172--31--23--87-k8s-calico--kube--controllers--7cc5d59f7b--q89cg-" Nov 8 00:07:08.254928 containerd[2009]: 2025-11-08 00:07:07.798 [INFO][5207] cni-plugin/k8s.go 74: Extracted identifiers for CmdAddK8s ContainerID="842cfc773166718f3421e73107fe9b7ea33b0da8e8d45da5f07a361451df68f6" Namespace="calico-system" Pod="calico-kube-controllers-7cc5d59f7b-q89cg" WorkloadEndpoint="ip--172--31--23--87-k8s-calico--kube--controllers--7cc5d59f7b--q89cg-eth0" Nov 8 00:07:08.254928 containerd[2009]: 2025-11-08 00:07:07.982 [INFO][5246] ipam/ipam_plugin.go 227: Calico CNI IPAM request count IPv4=1 IPv6=0 ContainerID="842cfc773166718f3421e73107fe9b7ea33b0da8e8d45da5f07a361451df68f6" HandleID="k8s-pod-network.842cfc773166718f3421e73107fe9b7ea33b0da8e8d45da5f07a361451df68f6" Workload="ip--172--31--23--87-k8s-calico--kube--controllers--7cc5d59f7b--q89cg-eth0" Nov 8 00:07:08.254928 containerd[2009]: 2025-11-08 00:07:07.982 [INFO][5246] ipam/ipam_plugin.go 275: Auto assigning IP ContainerID="842cfc773166718f3421e73107fe9b7ea33b0da8e8d45da5f07a361451df68f6" HandleID="k8s-pod-network.842cfc773166718f3421e73107fe9b7ea33b0da8e8d45da5f07a361451df68f6" Workload="ip--172--31--23--87-k8s-calico--kube--controllers--7cc5d59f7b--q89cg-eth0" assignArgs=ipam.AutoAssignArgs{Num4:1, Num6:0, HandleID:(*string)(0x40002b1a60), Attrs:map[string]string{"namespace":"calico-system", "node":"ip-172-31-23-87", "pod":"calico-kube-controllers-7cc5d59f7b-q89cg", "timestamp":"2025-11-08 00:07:07.982053132 +0000 UTC"}, Hostname:"ip-172-31-23-87", IPv4Pools:[]net.IPNet{}, IPv6Pools:[]net.IPNet{}, MaxBlocksPerHost:0, HostReservedAttrIPv4s:(*ipam.HostReservedAttr)(nil), HostReservedAttrIPv6s:(*ipam.HostReservedAttr)(nil), IntendedUse:"Workload"} Nov 8 00:07:08.254928 containerd[2009]: 2025-11-08 00:07:07.982 [INFO][5246] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 8 00:07:08.254928 containerd[2009]: 2025-11-08 00:07:07.982 [INFO][5246] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 8 00:07:08.254928 containerd[2009]: 2025-11-08 00:07:07.982 [INFO][5246] ipam/ipam.go 110: Auto-assign 1 ipv4, 0 ipv6 addrs for host 'ip-172-31-23-87' Nov 8 00:07:08.254928 containerd[2009]: 2025-11-08 00:07:08.015 [INFO][5246] ipam/ipam.go 691: Looking up existing affinities for host handle="k8s-pod-network.842cfc773166718f3421e73107fe9b7ea33b0da8e8d45da5f07a361451df68f6" host="ip-172-31-23-87" Nov 8 00:07:08.254928 containerd[2009]: 2025-11-08 00:07:08.030 [INFO][5246] ipam/ipam.go 394: Looking up existing affinities for host host="ip-172-31-23-87" Nov 8 00:07:08.254928 containerd[2009]: 2025-11-08 00:07:08.043 [INFO][5246] ipam/ipam.go 511: Trying affinity for 192.168.100.64/26 host="ip-172-31-23-87" Nov 8 00:07:08.254928 containerd[2009]: 2025-11-08 00:07:08.057 [INFO][5246] ipam/ipam.go 158: Attempting to load block cidr=192.168.100.64/26 host="ip-172-31-23-87" Nov 8 00:07:08.254928 containerd[2009]: 2025-11-08 00:07:08.066 [INFO][5246] ipam/ipam.go 235: Affinity is confirmed and block has been loaded cidr=192.168.100.64/26 host="ip-172-31-23-87" Nov 8 00:07:08.254928 containerd[2009]: 2025-11-08 00:07:08.066 [INFO][5246] ipam/ipam.go 1219: Attempting to assign 1 addresses from block block=192.168.100.64/26 handle="k8s-pod-network.842cfc773166718f3421e73107fe9b7ea33b0da8e8d45da5f07a361451df68f6" host="ip-172-31-23-87" Nov 8 00:07:08.254928 containerd[2009]: 2025-11-08 00:07:08.072 [INFO][5246] ipam/ipam.go 1780: Creating new handle: k8s-pod-network.842cfc773166718f3421e73107fe9b7ea33b0da8e8d45da5f07a361451df68f6 Nov 8 00:07:08.254928 containerd[2009]: 2025-11-08 00:07:08.150 [INFO][5246] ipam/ipam.go 1246: Writing block in order to claim IPs block=192.168.100.64/26 handle="k8s-pod-network.842cfc773166718f3421e73107fe9b7ea33b0da8e8d45da5f07a361451df68f6" host="ip-172-31-23-87" Nov 8 00:07:08.254928 containerd[2009]: 2025-11-08 00:07:08.168 [INFO][5246] ipam/ipam.go 1262: Successfully claimed IPs: [192.168.100.69/26] block=192.168.100.64/26 handle="k8s-pod-network.842cfc773166718f3421e73107fe9b7ea33b0da8e8d45da5f07a361451df68f6" host="ip-172-31-23-87" Nov 8 00:07:08.254928 containerd[2009]: 2025-11-08 00:07:08.168 [INFO][5246] ipam/ipam.go 878: Auto-assigned 1 out of 1 IPv4s: [192.168.100.69/26] handle="k8s-pod-network.842cfc773166718f3421e73107fe9b7ea33b0da8e8d45da5f07a361451df68f6" host="ip-172-31-23-87" Nov 8 00:07:08.254928 containerd[2009]: 2025-11-08 00:07:08.168 [INFO][5246] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 8 00:07:08.254928 containerd[2009]: 2025-11-08 00:07:08.168 [INFO][5246] ipam/ipam_plugin.go 299: Calico CNI IPAM assigned addresses IPv4=[192.168.100.69/26] IPv6=[] ContainerID="842cfc773166718f3421e73107fe9b7ea33b0da8e8d45da5f07a361451df68f6" HandleID="k8s-pod-network.842cfc773166718f3421e73107fe9b7ea33b0da8e8d45da5f07a361451df68f6" Workload="ip--172--31--23--87-k8s-calico--kube--controllers--7cc5d59f7b--q89cg-eth0" Nov 8 00:07:08.260876 containerd[2009]: 2025-11-08 00:07:08.185 [INFO][5207] cni-plugin/k8s.go 418: Populated endpoint ContainerID="842cfc773166718f3421e73107fe9b7ea33b0da8e8d45da5f07a361451df68f6" Namespace="calico-system" Pod="calico-kube-controllers-7cc5d59f7b-q89cg" WorkloadEndpoint="ip--172--31--23--87-k8s-calico--kube--controllers--7cc5d59f7b--q89cg-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--23--87-k8s-calico--kube--controllers--7cc5d59f7b--q89cg-eth0", GenerateName:"calico-kube-controllers-7cc5d59f7b-", Namespace:"calico-system", SelfLink:"", UID:"52f757de-0e18-4b03-af0a-9737e167b914", ResourceVersion:"1064", Generation:0, CreationTimestamp:time.Date(2025, time.November, 8, 0, 6, 43, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app.kubernetes.io/name":"calico-kube-controllers", "k8s-app":"calico-kube-controllers", "pod-template-hash":"7cc5d59f7b", "projectcalico.org/namespace":"calico-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"calico-kube-controllers"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-23-87", ContainerID:"", Pod:"calico-kube-controllers-7cc5d59f7b-q89cg", Endpoint:"eth0", ServiceAccountName:"calico-kube-controllers", IPNetworks:[]string{"192.168.100.69/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-system", "ksa.calico-system.calico-kube-controllers"}, InterfaceName:"caliac986209725", MAC:"", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 8 00:07:08.260876 containerd[2009]: 2025-11-08 00:07:08.185 [INFO][5207] cni-plugin/k8s.go 419: Calico CNI using IPs: [192.168.100.69/32] ContainerID="842cfc773166718f3421e73107fe9b7ea33b0da8e8d45da5f07a361451df68f6" Namespace="calico-system" Pod="calico-kube-controllers-7cc5d59f7b-q89cg" WorkloadEndpoint="ip--172--31--23--87-k8s-calico--kube--controllers--7cc5d59f7b--q89cg-eth0" Nov 8 00:07:08.260876 containerd[2009]: 2025-11-08 00:07:08.186 [INFO][5207] cni-plugin/dataplane_linux.go 69: Setting the host side veth name to caliac986209725 ContainerID="842cfc773166718f3421e73107fe9b7ea33b0da8e8d45da5f07a361451df68f6" Namespace="calico-system" Pod="calico-kube-controllers-7cc5d59f7b-q89cg" WorkloadEndpoint="ip--172--31--23--87-k8s-calico--kube--controllers--7cc5d59f7b--q89cg-eth0" Nov 8 00:07:08.260876 containerd[2009]: 2025-11-08 00:07:08.202 [INFO][5207] cni-plugin/dataplane_linux.go 508: Disabling IPv4 forwarding ContainerID="842cfc773166718f3421e73107fe9b7ea33b0da8e8d45da5f07a361451df68f6" Namespace="calico-system" Pod="calico-kube-controllers-7cc5d59f7b-q89cg" WorkloadEndpoint="ip--172--31--23--87-k8s-calico--kube--controllers--7cc5d59f7b--q89cg-eth0" Nov 8 00:07:08.260876 containerd[2009]: 2025-11-08 00:07:08.204 [INFO][5207] cni-plugin/k8s.go 446: Added Mac, interface name, and active container ID to endpoint ContainerID="842cfc773166718f3421e73107fe9b7ea33b0da8e8d45da5f07a361451df68f6" Namespace="calico-system" Pod="calico-kube-controllers-7cc5d59f7b-q89cg" WorkloadEndpoint="ip--172--31--23--87-k8s-calico--kube--controllers--7cc5d59f7b--q89cg-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--23--87-k8s-calico--kube--controllers--7cc5d59f7b--q89cg-eth0", GenerateName:"calico-kube-controllers-7cc5d59f7b-", Namespace:"calico-system", SelfLink:"", UID:"52f757de-0e18-4b03-af0a-9737e167b914", ResourceVersion:"1064", Generation:0, CreationTimestamp:time.Date(2025, time.November, 8, 0, 6, 43, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app.kubernetes.io/name":"calico-kube-controllers", "k8s-app":"calico-kube-controllers", "pod-template-hash":"7cc5d59f7b", "projectcalico.org/namespace":"calico-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"calico-kube-controllers"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-23-87", ContainerID:"842cfc773166718f3421e73107fe9b7ea33b0da8e8d45da5f07a361451df68f6", Pod:"calico-kube-controllers-7cc5d59f7b-q89cg", Endpoint:"eth0", ServiceAccountName:"calico-kube-controllers", IPNetworks:[]string{"192.168.100.69/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-system", "ksa.calico-system.calico-kube-controllers"}, InterfaceName:"caliac986209725", MAC:"5a:44:65:4b:12:d2", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 8 00:07:08.260876 containerd[2009]: 2025-11-08 00:07:08.245 [INFO][5207] cni-plugin/k8s.go 532: Wrote updated endpoint to datastore ContainerID="842cfc773166718f3421e73107fe9b7ea33b0da8e8d45da5f07a361451df68f6" Namespace="calico-system" Pod="calico-kube-controllers-7cc5d59f7b-q89cg" WorkloadEndpoint="ip--172--31--23--87-k8s-calico--kube--controllers--7cc5d59f7b--q89cg-eth0" Nov 8 00:07:08.328206 kubelet[3341]: E1108 00:07:08.328086 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"calico-csi\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ghcr.io/flatcar/calico/csi:v3.30.4: not found\", failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found\"]" pod="calico-system/csi-node-driver-8rk2x" podUID="0fc7336a-4c45-40ec-b634-101ce08e1be1" Nov 8 00:07:08.378293 containerd[2009]: time="2025-11-08T00:07:08.378074938Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1 Nov 8 00:07:08.378768 containerd[2009]: time="2025-11-08T00:07:08.378195898Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1 Nov 8 00:07:08.378768 containerd[2009]: time="2025-11-08T00:07:08.378604246Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Nov 8 00:07:08.381377 containerd[2009]: time="2025-11-08T00:07:08.380209246Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Nov 8 00:07:08.452457 systemd-networkd[1929]: cali06a7791c2eb: Link UP Nov 8 00:07:08.460495 systemd-networkd[1929]: cali06a7791c2eb: Gained carrier Nov 8 00:07:08.477533 containerd[2009]: time="2025-11-08T00:07:08.475773311Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-66cbb68f69-hrrjm,Uid:68debac0-90fa-43fc-b6a2-614e4954f14e,Namespace:calico-apiserver,Attempt:1,} returns sandbox id \"d285a3477da596cd29022982bf7f75dbea016f04079d31c7b5a2b7094d9c103e\"" Nov 8 00:07:08.497343 containerd[2009]: time="2025-11-08T00:07:08.496045787Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\"" Nov 8 00:07:08.521976 containerd[2009]: 2025-11-08 00:07:07.943 [INFO][5234] cni-plugin/k8s.go 640: Cleaning up netns ContainerID="9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584" Nov 8 00:07:08.521976 containerd[2009]: 2025-11-08 00:07:07.944 [INFO][5234] cni-plugin/dataplane_linux.go 559: Deleting workload's device in netns. ContainerID="9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584" iface="eth0" netns="/var/run/netns/cni-fadeb5b3-f97a-f22f-2c1e-205bc5907265" Nov 8 00:07:08.521976 containerd[2009]: 2025-11-08 00:07:07.946 [INFO][5234] cni-plugin/dataplane_linux.go 570: Entered netns, deleting veth. ContainerID="9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584" iface="eth0" netns="/var/run/netns/cni-fadeb5b3-f97a-f22f-2c1e-205bc5907265" Nov 8 00:07:08.521976 containerd[2009]: 2025-11-08 00:07:07.947 [INFO][5234] cni-plugin/dataplane_linux.go 597: Workload's veth was already gone. Nothing to do. ContainerID="9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584" iface="eth0" netns="/var/run/netns/cni-fadeb5b3-f97a-f22f-2c1e-205bc5907265" Nov 8 00:07:08.521976 containerd[2009]: 2025-11-08 00:07:07.947 [INFO][5234] cni-plugin/k8s.go 647: Releasing IP address(es) ContainerID="9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584" Nov 8 00:07:08.521976 containerd[2009]: 2025-11-08 00:07:07.947 [INFO][5234] cni-plugin/utils.go 188: Calico CNI releasing IP address ContainerID="9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584" Nov 8 00:07:08.521976 containerd[2009]: 2025-11-08 00:07:08.111 [INFO][5264] ipam/ipam_plugin.go 436: Releasing address using handleID ContainerID="9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584" HandleID="k8s-pod-network.9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584" Workload="ip--172--31--23--87-k8s-coredns--668d6bf9bc--54b9r-eth0" Nov 8 00:07:08.521976 containerd[2009]: 2025-11-08 00:07:08.111 [INFO][5264] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 8 00:07:08.521976 containerd[2009]: 2025-11-08 00:07:08.391 [INFO][5264] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 8 00:07:08.521976 containerd[2009]: 2025-11-08 00:07:08.477 [WARNING][5264] ipam/ipam_plugin.go 453: Asked to release address but it doesn't exist. Ignoring ContainerID="9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584" HandleID="k8s-pod-network.9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584" Workload="ip--172--31--23--87-k8s-coredns--668d6bf9bc--54b9r-eth0" Nov 8 00:07:08.521976 containerd[2009]: 2025-11-08 00:07:08.477 [INFO][5264] ipam/ipam_plugin.go 464: Releasing address using workloadID ContainerID="9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584" HandleID="k8s-pod-network.9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584" Workload="ip--172--31--23--87-k8s-coredns--668d6bf9bc--54b9r-eth0" Nov 8 00:07:08.521976 containerd[2009]: 2025-11-08 00:07:08.488 [INFO][5264] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 8 00:07:08.521976 containerd[2009]: 2025-11-08 00:07:08.513 [INFO][5234] cni-plugin/k8s.go 653: Teardown processing complete. ContainerID="9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584" Nov 8 00:07:08.528954 containerd[2009]: time="2025-11-08T00:07:08.527580635Z" level=info msg="TearDown network for sandbox \"9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584\" successfully" Nov 8 00:07:08.528954 containerd[2009]: time="2025-11-08T00:07:08.527648423Z" level=info msg="StopPodSandbox for \"9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584\" returns successfully" Nov 8 00:07:08.530835 containerd[2009]: time="2025-11-08T00:07:08.530660327Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-668d6bf9bc-54b9r,Uid:dd9a1fb2-7bfc-4968-86fa-9fc28ad38b94,Namespace:kube-system,Attempt:1,}" Nov 8 00:07:08.536607 systemd[1]: run-netns-cni\x2dfadeb5b3\x2df97a\x2df22f\x2d2c1e\x2d205bc5907265.mount: Deactivated successfully. Nov 8 00:07:08.643661 systemd[1]: Started cri-containerd-842cfc773166718f3421e73107fe9b7ea33b0da8e8d45da5f07a361451df68f6.scope - libcontainer container 842cfc773166718f3421e73107fe9b7ea33b0da8e8d45da5f07a361451df68f6. Nov 8 00:07:08.658775 containerd[2009]: time="2025-11-08T00:07:08.658448279Z" level=info msg="StopPodSandbox for \"e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36\"" Nov 8 00:07:08.663574 containerd[2009]: 2025-11-08 00:07:07.792 [INFO][5192] cni-plugin/plugin.go 340: Calico CNI found existing endpoint: &{{WorkloadEndpoint projectcalico.org/v3} {ip--172--31--23--87-k8s-calico--apiserver--7cbbf6b44f--pntg9-eth0 calico-apiserver-7cbbf6b44f- calico-apiserver 886783b3-53d5-4894-8799-c2c145d125ce 1063 0 2025-11-08 00:06:24 +0000 UTC map[apiserver:true app.kubernetes.io/name:calico-apiserver k8s-app:calico-apiserver pod-template-hash:7cbbf6b44f projectcalico.org/namespace:calico-apiserver projectcalico.org/orchestrator:k8s projectcalico.org/serviceaccount:calico-apiserver] map[] [] [] []} {k8s ip-172-31-23-87 calico-apiserver-7cbbf6b44f-pntg9 eth0 calico-apiserver [] [] [kns.calico-apiserver ksa.calico-apiserver.calico-apiserver] cali06a7791c2eb [] [] }} ContainerID="ed0535b0c92fce55fb7ea3b605c72b93bd7e051f2a56ff73a33359bd349a5f4f" Namespace="calico-apiserver" Pod="calico-apiserver-7cbbf6b44f-pntg9" WorkloadEndpoint="ip--172--31--23--87-k8s-calico--apiserver--7cbbf6b44f--pntg9-" Nov 8 00:07:08.663574 containerd[2009]: 2025-11-08 00:07:07.793 [INFO][5192] cni-plugin/k8s.go 74: Extracted identifiers for CmdAddK8s ContainerID="ed0535b0c92fce55fb7ea3b605c72b93bd7e051f2a56ff73a33359bd349a5f4f" Namespace="calico-apiserver" Pod="calico-apiserver-7cbbf6b44f-pntg9" WorkloadEndpoint="ip--172--31--23--87-k8s-calico--apiserver--7cbbf6b44f--pntg9-eth0" Nov 8 00:07:08.663574 containerd[2009]: 2025-11-08 00:07:08.020 [INFO][5248] ipam/ipam_plugin.go 227: Calico CNI IPAM request count IPv4=1 IPv6=0 ContainerID="ed0535b0c92fce55fb7ea3b605c72b93bd7e051f2a56ff73a33359bd349a5f4f" HandleID="k8s-pod-network.ed0535b0c92fce55fb7ea3b605c72b93bd7e051f2a56ff73a33359bd349a5f4f" Workload="ip--172--31--23--87-k8s-calico--apiserver--7cbbf6b44f--pntg9-eth0" Nov 8 00:07:08.663574 containerd[2009]: 2025-11-08 00:07:08.022 [INFO][5248] ipam/ipam_plugin.go 275: Auto assigning IP ContainerID="ed0535b0c92fce55fb7ea3b605c72b93bd7e051f2a56ff73a33359bd349a5f4f" HandleID="k8s-pod-network.ed0535b0c92fce55fb7ea3b605c72b93bd7e051f2a56ff73a33359bd349a5f4f" Workload="ip--172--31--23--87-k8s-calico--apiserver--7cbbf6b44f--pntg9-eth0" assignArgs=ipam.AutoAssignArgs{Num4:1, Num6:0, HandleID:(*string)(0x40002ff2b0), Attrs:map[string]string{"namespace":"calico-apiserver", "node":"ip-172-31-23-87", "pod":"calico-apiserver-7cbbf6b44f-pntg9", "timestamp":"2025-11-08 00:07:08.02078228 +0000 UTC"}, Hostname:"ip-172-31-23-87", IPv4Pools:[]net.IPNet{}, IPv6Pools:[]net.IPNet{}, MaxBlocksPerHost:0, HostReservedAttrIPv4s:(*ipam.HostReservedAttr)(nil), HostReservedAttrIPv6s:(*ipam.HostReservedAttr)(nil), IntendedUse:"Workload"} Nov 8 00:07:08.663574 containerd[2009]: 2025-11-08 00:07:08.022 [INFO][5248] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 8 00:07:08.663574 containerd[2009]: 2025-11-08 00:07:08.170 [INFO][5248] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 8 00:07:08.663574 containerd[2009]: 2025-11-08 00:07:08.171 [INFO][5248] ipam/ipam.go 110: Auto-assign 1 ipv4, 0 ipv6 addrs for host 'ip-172-31-23-87' Nov 8 00:07:08.663574 containerd[2009]: 2025-11-08 00:07:08.220 [INFO][5248] ipam/ipam.go 691: Looking up existing affinities for host handle="k8s-pod-network.ed0535b0c92fce55fb7ea3b605c72b93bd7e051f2a56ff73a33359bd349a5f4f" host="ip-172-31-23-87" Nov 8 00:07:08.663574 containerd[2009]: 2025-11-08 00:07:08.245 [INFO][5248] ipam/ipam.go 394: Looking up existing affinities for host host="ip-172-31-23-87" Nov 8 00:07:08.663574 containerd[2009]: 2025-11-08 00:07:08.266 [INFO][5248] ipam/ipam.go 511: Trying affinity for 192.168.100.64/26 host="ip-172-31-23-87" Nov 8 00:07:08.663574 containerd[2009]: 2025-11-08 00:07:08.274 [INFO][5248] ipam/ipam.go 158: Attempting to load block cidr=192.168.100.64/26 host="ip-172-31-23-87" Nov 8 00:07:08.663574 containerd[2009]: 2025-11-08 00:07:08.288 [INFO][5248] ipam/ipam.go 235: Affinity is confirmed and block has been loaded cidr=192.168.100.64/26 host="ip-172-31-23-87" Nov 8 00:07:08.663574 containerd[2009]: 2025-11-08 00:07:08.288 [INFO][5248] ipam/ipam.go 1219: Attempting to assign 1 addresses from block block=192.168.100.64/26 handle="k8s-pod-network.ed0535b0c92fce55fb7ea3b605c72b93bd7e051f2a56ff73a33359bd349a5f4f" host="ip-172-31-23-87" Nov 8 00:07:08.663574 containerd[2009]: 2025-11-08 00:07:08.298 [INFO][5248] ipam/ipam.go 1780: Creating new handle: k8s-pod-network.ed0535b0c92fce55fb7ea3b605c72b93bd7e051f2a56ff73a33359bd349a5f4f Nov 8 00:07:08.663574 containerd[2009]: 2025-11-08 00:07:08.318 [INFO][5248] ipam/ipam.go 1246: Writing block in order to claim IPs block=192.168.100.64/26 handle="k8s-pod-network.ed0535b0c92fce55fb7ea3b605c72b93bd7e051f2a56ff73a33359bd349a5f4f" host="ip-172-31-23-87" Nov 8 00:07:08.663574 containerd[2009]: 2025-11-08 00:07:08.383 [INFO][5248] ipam/ipam.go 1262: Successfully claimed IPs: [192.168.100.70/26] block=192.168.100.64/26 handle="k8s-pod-network.ed0535b0c92fce55fb7ea3b605c72b93bd7e051f2a56ff73a33359bd349a5f4f" host="ip-172-31-23-87" Nov 8 00:07:08.663574 containerd[2009]: 2025-11-08 00:07:08.383 [INFO][5248] ipam/ipam.go 878: Auto-assigned 1 out of 1 IPv4s: [192.168.100.70/26] handle="k8s-pod-network.ed0535b0c92fce55fb7ea3b605c72b93bd7e051f2a56ff73a33359bd349a5f4f" host="ip-172-31-23-87" Nov 8 00:07:08.663574 containerd[2009]: 2025-11-08 00:07:08.383 [INFO][5248] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 8 00:07:08.663574 containerd[2009]: 2025-11-08 00:07:08.383 [INFO][5248] ipam/ipam_plugin.go 299: Calico CNI IPAM assigned addresses IPv4=[192.168.100.70/26] IPv6=[] ContainerID="ed0535b0c92fce55fb7ea3b605c72b93bd7e051f2a56ff73a33359bd349a5f4f" HandleID="k8s-pod-network.ed0535b0c92fce55fb7ea3b605c72b93bd7e051f2a56ff73a33359bd349a5f4f" Workload="ip--172--31--23--87-k8s-calico--apiserver--7cbbf6b44f--pntg9-eth0" Nov 8 00:07:08.667872 containerd[2009]: 2025-11-08 00:07:08.400 [INFO][5192] cni-plugin/k8s.go 418: Populated endpoint ContainerID="ed0535b0c92fce55fb7ea3b605c72b93bd7e051f2a56ff73a33359bd349a5f4f" Namespace="calico-apiserver" Pod="calico-apiserver-7cbbf6b44f-pntg9" WorkloadEndpoint="ip--172--31--23--87-k8s-calico--apiserver--7cbbf6b44f--pntg9-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--23--87-k8s-calico--apiserver--7cbbf6b44f--pntg9-eth0", GenerateName:"calico-apiserver-7cbbf6b44f-", Namespace:"calico-apiserver", SelfLink:"", UID:"886783b3-53d5-4894-8799-c2c145d125ce", ResourceVersion:"1063", Generation:0, CreationTimestamp:time.Date(2025, time.November, 8, 0, 6, 24, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"apiserver":"true", "app.kubernetes.io/name":"calico-apiserver", "k8s-app":"calico-apiserver", "pod-template-hash":"7cbbf6b44f", "projectcalico.org/namespace":"calico-apiserver", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"calico-apiserver"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-23-87", ContainerID:"", Pod:"calico-apiserver-7cbbf6b44f-pntg9", Endpoint:"eth0", ServiceAccountName:"calico-apiserver", IPNetworks:[]string{"192.168.100.70/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-apiserver", "ksa.calico-apiserver.calico-apiserver"}, InterfaceName:"cali06a7791c2eb", MAC:"", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 8 00:07:08.667872 containerd[2009]: 2025-11-08 00:07:08.402 [INFO][5192] cni-plugin/k8s.go 419: Calico CNI using IPs: [192.168.100.70/32] ContainerID="ed0535b0c92fce55fb7ea3b605c72b93bd7e051f2a56ff73a33359bd349a5f4f" Namespace="calico-apiserver" Pod="calico-apiserver-7cbbf6b44f-pntg9" WorkloadEndpoint="ip--172--31--23--87-k8s-calico--apiserver--7cbbf6b44f--pntg9-eth0" Nov 8 00:07:08.667872 containerd[2009]: 2025-11-08 00:07:08.402 [INFO][5192] cni-plugin/dataplane_linux.go 69: Setting the host side veth name to cali06a7791c2eb ContainerID="ed0535b0c92fce55fb7ea3b605c72b93bd7e051f2a56ff73a33359bd349a5f4f" Namespace="calico-apiserver" Pod="calico-apiserver-7cbbf6b44f-pntg9" WorkloadEndpoint="ip--172--31--23--87-k8s-calico--apiserver--7cbbf6b44f--pntg9-eth0" Nov 8 00:07:08.667872 containerd[2009]: 2025-11-08 00:07:08.469 [INFO][5192] cni-plugin/dataplane_linux.go 508: Disabling IPv4 forwarding ContainerID="ed0535b0c92fce55fb7ea3b605c72b93bd7e051f2a56ff73a33359bd349a5f4f" Namespace="calico-apiserver" Pod="calico-apiserver-7cbbf6b44f-pntg9" WorkloadEndpoint="ip--172--31--23--87-k8s-calico--apiserver--7cbbf6b44f--pntg9-eth0" Nov 8 00:07:08.667872 containerd[2009]: 2025-11-08 00:07:08.489 [INFO][5192] cni-plugin/k8s.go 446: Added Mac, interface name, and active container ID to endpoint ContainerID="ed0535b0c92fce55fb7ea3b605c72b93bd7e051f2a56ff73a33359bd349a5f4f" Namespace="calico-apiserver" Pod="calico-apiserver-7cbbf6b44f-pntg9" WorkloadEndpoint="ip--172--31--23--87-k8s-calico--apiserver--7cbbf6b44f--pntg9-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--23--87-k8s-calico--apiserver--7cbbf6b44f--pntg9-eth0", GenerateName:"calico-apiserver-7cbbf6b44f-", Namespace:"calico-apiserver", SelfLink:"", UID:"886783b3-53d5-4894-8799-c2c145d125ce", ResourceVersion:"1063", Generation:0, CreationTimestamp:time.Date(2025, time.November, 8, 0, 6, 24, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"apiserver":"true", "app.kubernetes.io/name":"calico-apiserver", "k8s-app":"calico-apiserver", "pod-template-hash":"7cbbf6b44f", "projectcalico.org/namespace":"calico-apiserver", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"calico-apiserver"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-23-87", ContainerID:"ed0535b0c92fce55fb7ea3b605c72b93bd7e051f2a56ff73a33359bd349a5f4f", Pod:"calico-apiserver-7cbbf6b44f-pntg9", Endpoint:"eth0", ServiceAccountName:"calico-apiserver", IPNetworks:[]string{"192.168.100.70/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-apiserver", "ksa.calico-apiserver.calico-apiserver"}, InterfaceName:"cali06a7791c2eb", MAC:"26:30:0b:6d:48:ee", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 8 00:07:08.667872 containerd[2009]: 2025-11-08 00:07:08.604 [INFO][5192] cni-plugin/k8s.go 532: Wrote updated endpoint to datastore ContainerID="ed0535b0c92fce55fb7ea3b605c72b93bd7e051f2a56ff73a33359bd349a5f4f" Namespace="calico-apiserver" Pod="calico-apiserver-7cbbf6b44f-pntg9" WorkloadEndpoint="ip--172--31--23--87-k8s-calico--apiserver--7cbbf6b44f--pntg9-eth0" Nov 8 00:07:08.803530 containerd[2009]: time="2025-11-08T00:07:08.802730736Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1 Nov 8 00:07:08.803530 containerd[2009]: time="2025-11-08T00:07:08.802867752Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1 Nov 8 00:07:08.803530 containerd[2009]: time="2025-11-08T00:07:08.802950696Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Nov 8 00:07:08.803530 containerd[2009]: time="2025-11-08T00:07:08.803172420Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Nov 8 00:07:08.824239 containerd[2009]: time="2025-11-08T00:07:08.823832160Z" level=info msg="trying next host - response was http.StatusNotFound" host=ghcr.io Nov 8 00:07:08.827837 containerd[2009]: time="2025-11-08T00:07:08.826605492Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" Nov 8 00:07:08.827837 containerd[2009]: time="2025-11-08T00:07:08.826789668Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/apiserver:v3.30.4: active requests=0, bytes read=77" Nov 8 00:07:08.828074 kubelet[3341]: E1108 00:07:08.827337 3341 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 8 00:07:08.828074 kubelet[3341]: E1108 00:07:08.827431 3341 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 8 00:07:08.861975 kubelet[3341]: E1108 00:07:08.858690 3341 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:calico-apiserver,Image:ghcr.io/flatcar/calico/apiserver:v3.30.4,Command:[],Args:[--secure-port=5443 --tls-private-key-file=/calico-apiserver-certs/tls.key --tls-cert-file=/calico-apiserver-certs/tls.crt],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:LOG_LEVEL,Value:info,ValueFrom:nil,},EnvVar{Name:MULTI_INTERFACE_MODE,Value:none,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:calico-apiserver-certs,ReadOnly:true,MountPath:/calico-apiserver-certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-dxmxx,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 5443 },Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-apiserver-66cbb68f69-hrrjm_calico-apiserver(68debac0-90fa-43fc-b6a2-614e4954f14e): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" logger="UnhandledError" Nov 8 00:07:08.861975 kubelet[3341]: E1108 00:07:08.860919 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-66cbb68f69-hrrjm" podUID="68debac0-90fa-43fc-b6a2-614e4954f14e" Nov 8 00:07:09.032047 systemd[1]: Started cri-containerd-ed0535b0c92fce55fb7ea3b605c72b93bd7e051f2a56ff73a33359bd349a5f4f.scope - libcontainer container ed0535b0c92fce55fb7ea3b605c72b93bd7e051f2a56ff73a33359bd349a5f4f. Nov 8 00:07:09.143764 systemd-networkd[1929]: cali6c23a06d65d: Gained IPv6LL Nov 8 00:07:09.284972 containerd[2009]: time="2025-11-08T00:07:09.284488811Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-kube-controllers-7cc5d59f7b-q89cg,Uid:52f757de-0e18-4b03-af0a-9737e167b914,Namespace:calico-system,Attempt:1,} returns sandbox id \"842cfc773166718f3421e73107fe9b7ea33b0da8e8d45da5f07a361451df68f6\"" Nov 8 00:07:09.292538 containerd[2009]: time="2025-11-08T00:07:09.291668219Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\"" Nov 8 00:07:09.306045 (udev-worker)[5405]: Network interface NamePolicy= disabled on kernel command line. Nov 8 00:07:09.312750 systemd-networkd[1929]: calie8e25f97186: Link UP Nov 8 00:07:09.313184 systemd-networkd[1929]: calie8e25f97186: Gained carrier Nov 8 00:07:09.354373 kubelet[3341]: E1108 00:07:09.353183 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-66cbb68f69-hrrjm" podUID="68debac0-90fa-43fc-b6a2-614e4954f14e" Nov 8 00:07:09.365716 containerd[2009]: 2025-11-08 00:07:09.055 [INFO][5349] cni-plugin/k8s.go 640: Cleaning up netns ContainerID="e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36" Nov 8 00:07:09.365716 containerd[2009]: 2025-11-08 00:07:09.055 [INFO][5349] cni-plugin/dataplane_linux.go 559: Deleting workload's device in netns. ContainerID="e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36" iface="eth0" netns="/var/run/netns/cni-f7c905cf-b405-1dd4-83e0-169afb05c51a" Nov 8 00:07:09.365716 containerd[2009]: 2025-11-08 00:07:09.055 [INFO][5349] cni-plugin/dataplane_linux.go 570: Entered netns, deleting veth. ContainerID="e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36" iface="eth0" netns="/var/run/netns/cni-f7c905cf-b405-1dd4-83e0-169afb05c51a" Nov 8 00:07:09.365716 containerd[2009]: 2025-11-08 00:07:09.056 [INFO][5349] cni-plugin/dataplane_linux.go 597: Workload's veth was already gone. Nothing to do. ContainerID="e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36" iface="eth0" netns="/var/run/netns/cni-f7c905cf-b405-1dd4-83e0-169afb05c51a" Nov 8 00:07:09.365716 containerd[2009]: 2025-11-08 00:07:09.056 [INFO][5349] cni-plugin/k8s.go 647: Releasing IP address(es) ContainerID="e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36" Nov 8 00:07:09.365716 containerd[2009]: 2025-11-08 00:07:09.056 [INFO][5349] cni-plugin/utils.go 188: Calico CNI releasing IP address ContainerID="e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36" Nov 8 00:07:09.365716 containerd[2009]: 2025-11-08 00:07:09.189 [INFO][5420] ipam/ipam_plugin.go 436: Releasing address using handleID ContainerID="e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36" HandleID="k8s-pod-network.e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36" Workload="ip--172--31--23--87-k8s-calico--apiserver--7cbbf6b44f--hrhmg-eth0" Nov 8 00:07:09.365716 containerd[2009]: 2025-11-08 00:07:09.192 [INFO][5420] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 8 00:07:09.365716 containerd[2009]: 2025-11-08 00:07:09.293 [INFO][5420] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 8 00:07:09.365716 containerd[2009]: 2025-11-08 00:07:09.328 [WARNING][5420] ipam/ipam_plugin.go 453: Asked to release address but it doesn't exist. Ignoring ContainerID="e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36" HandleID="k8s-pod-network.e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36" Workload="ip--172--31--23--87-k8s-calico--apiserver--7cbbf6b44f--hrhmg-eth0" Nov 8 00:07:09.365716 containerd[2009]: 2025-11-08 00:07:09.328 [INFO][5420] ipam/ipam_plugin.go 464: Releasing address using workloadID ContainerID="e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36" HandleID="k8s-pod-network.e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36" Workload="ip--172--31--23--87-k8s-calico--apiserver--7cbbf6b44f--hrhmg-eth0" Nov 8 00:07:09.365716 containerd[2009]: 2025-11-08 00:07:09.339 [INFO][5420] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 8 00:07:09.365716 containerd[2009]: 2025-11-08 00:07:09.352 [INFO][5349] cni-plugin/k8s.go 653: Teardown processing complete. ContainerID="e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36" Nov 8 00:07:09.377397 containerd[2009]: time="2025-11-08T00:07:09.376716875Z" level=info msg="TearDown network for sandbox \"e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36\" successfully" Nov 8 00:07:09.377203 systemd[1]: run-netns-cni\x2df7c905cf\x2db405\x2d1dd4\x2d83e0\x2d169afb05c51a.mount: Deactivated successfully. Nov 8 00:07:09.379529 containerd[2009]: time="2025-11-08T00:07:09.379461551Z" level=info msg="StopPodSandbox for \"e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36\" returns successfully" Nov 8 00:07:09.382443 containerd[2009]: 2025-11-08 00:07:08.953 [INFO][5325] cni-plugin/plugin.go 340: Calico CNI found existing endpoint: &{{WorkloadEndpoint projectcalico.org/v3} {ip--172--31--23--87-k8s-coredns--668d6bf9bc--54b9r-eth0 coredns-668d6bf9bc- kube-system dd9a1fb2-7bfc-4968-86fa-9fc28ad38b94 1083 0 2025-11-08 00:06:07 +0000 UTC map[k8s-app:kube-dns pod-template-hash:668d6bf9bc projectcalico.org/namespace:kube-system projectcalico.org/orchestrator:k8s projectcalico.org/serviceaccount:coredns] map[] [] [] []} {k8s ip-172-31-23-87 coredns-668d6bf9bc-54b9r eth0 coredns [] [] [kns.kube-system ksa.kube-system.coredns] calie8e25f97186 [{dns UDP 53 0 } {dns-tcp TCP 53 0 } {metrics TCP 9153 0 }] [] }} ContainerID="f43c80104d65f0484c99b5161a6503d4000cd8beef2427dfe253c9a31e5662a5" Namespace="kube-system" Pod="coredns-668d6bf9bc-54b9r" WorkloadEndpoint="ip--172--31--23--87-k8s-coredns--668d6bf9bc--54b9r-" Nov 8 00:07:09.382443 containerd[2009]: 2025-11-08 00:07:08.953 [INFO][5325] cni-plugin/k8s.go 74: Extracted identifiers for CmdAddK8s ContainerID="f43c80104d65f0484c99b5161a6503d4000cd8beef2427dfe253c9a31e5662a5" Namespace="kube-system" Pod="coredns-668d6bf9bc-54b9r" WorkloadEndpoint="ip--172--31--23--87-k8s-coredns--668d6bf9bc--54b9r-eth0" Nov 8 00:07:09.382443 containerd[2009]: 2025-11-08 00:07:09.141 [INFO][5411] ipam/ipam_plugin.go 227: Calico CNI IPAM request count IPv4=1 IPv6=0 ContainerID="f43c80104d65f0484c99b5161a6503d4000cd8beef2427dfe253c9a31e5662a5" HandleID="k8s-pod-network.f43c80104d65f0484c99b5161a6503d4000cd8beef2427dfe253c9a31e5662a5" Workload="ip--172--31--23--87-k8s-coredns--668d6bf9bc--54b9r-eth0" Nov 8 00:07:09.382443 containerd[2009]: 2025-11-08 00:07:09.141 [INFO][5411] ipam/ipam_plugin.go 275: Auto assigning IP ContainerID="f43c80104d65f0484c99b5161a6503d4000cd8beef2427dfe253c9a31e5662a5" HandleID="k8s-pod-network.f43c80104d65f0484c99b5161a6503d4000cd8beef2427dfe253c9a31e5662a5" Workload="ip--172--31--23--87-k8s-coredns--668d6bf9bc--54b9r-eth0" assignArgs=ipam.AutoAssignArgs{Num4:1, Num6:0, HandleID:(*string)(0x4000308950), Attrs:map[string]string{"namespace":"kube-system", "node":"ip-172-31-23-87", "pod":"coredns-668d6bf9bc-54b9r", "timestamp":"2025-11-08 00:07:09.140784598 +0000 UTC"}, Hostname:"ip-172-31-23-87", IPv4Pools:[]net.IPNet{}, IPv6Pools:[]net.IPNet{}, MaxBlocksPerHost:0, HostReservedAttrIPv4s:(*ipam.HostReservedAttr)(nil), HostReservedAttrIPv6s:(*ipam.HostReservedAttr)(nil), IntendedUse:"Workload"} Nov 8 00:07:09.382443 containerd[2009]: 2025-11-08 00:07:09.141 [INFO][5411] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 8 00:07:09.382443 containerd[2009]: 2025-11-08 00:07:09.141 [INFO][5411] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 8 00:07:09.382443 containerd[2009]: 2025-11-08 00:07:09.149 [INFO][5411] ipam/ipam.go 110: Auto-assign 1 ipv4, 0 ipv6 addrs for host 'ip-172-31-23-87' Nov 8 00:07:09.382443 containerd[2009]: 2025-11-08 00:07:09.181 [INFO][5411] ipam/ipam.go 691: Looking up existing affinities for host handle="k8s-pod-network.f43c80104d65f0484c99b5161a6503d4000cd8beef2427dfe253c9a31e5662a5" host="ip-172-31-23-87" Nov 8 00:07:09.382443 containerd[2009]: 2025-11-08 00:07:09.195 [INFO][5411] ipam/ipam.go 394: Looking up existing affinities for host host="ip-172-31-23-87" Nov 8 00:07:09.382443 containerd[2009]: 2025-11-08 00:07:09.208 [INFO][5411] ipam/ipam.go 511: Trying affinity for 192.168.100.64/26 host="ip-172-31-23-87" Nov 8 00:07:09.382443 containerd[2009]: 2025-11-08 00:07:09.224 [INFO][5411] ipam/ipam.go 158: Attempting to load block cidr=192.168.100.64/26 host="ip-172-31-23-87" Nov 8 00:07:09.382443 containerd[2009]: 2025-11-08 00:07:09.242 [INFO][5411] ipam/ipam.go 235: Affinity is confirmed and block has been loaded cidr=192.168.100.64/26 host="ip-172-31-23-87" Nov 8 00:07:09.382443 containerd[2009]: 2025-11-08 00:07:09.243 [INFO][5411] ipam/ipam.go 1219: Attempting to assign 1 addresses from block block=192.168.100.64/26 handle="k8s-pod-network.f43c80104d65f0484c99b5161a6503d4000cd8beef2427dfe253c9a31e5662a5" host="ip-172-31-23-87" Nov 8 00:07:09.382443 containerd[2009]: 2025-11-08 00:07:09.251 [INFO][5411] ipam/ipam.go 1780: Creating new handle: k8s-pod-network.f43c80104d65f0484c99b5161a6503d4000cd8beef2427dfe253c9a31e5662a5 Nov 8 00:07:09.382443 containerd[2009]: 2025-11-08 00:07:09.262 [INFO][5411] ipam/ipam.go 1246: Writing block in order to claim IPs block=192.168.100.64/26 handle="k8s-pod-network.f43c80104d65f0484c99b5161a6503d4000cd8beef2427dfe253c9a31e5662a5" host="ip-172-31-23-87" Nov 8 00:07:09.382443 containerd[2009]: 2025-11-08 00:07:09.293 [INFO][5411] ipam/ipam.go 1262: Successfully claimed IPs: [192.168.100.71/26] block=192.168.100.64/26 handle="k8s-pod-network.f43c80104d65f0484c99b5161a6503d4000cd8beef2427dfe253c9a31e5662a5" host="ip-172-31-23-87" Nov 8 00:07:09.382443 containerd[2009]: 2025-11-08 00:07:09.293 [INFO][5411] ipam/ipam.go 878: Auto-assigned 1 out of 1 IPv4s: [192.168.100.71/26] handle="k8s-pod-network.f43c80104d65f0484c99b5161a6503d4000cd8beef2427dfe253c9a31e5662a5" host="ip-172-31-23-87" Nov 8 00:07:09.382443 containerd[2009]: 2025-11-08 00:07:09.293 [INFO][5411] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 8 00:07:09.382443 containerd[2009]: 2025-11-08 00:07:09.293 [INFO][5411] ipam/ipam_plugin.go 299: Calico CNI IPAM assigned addresses IPv4=[192.168.100.71/26] IPv6=[] ContainerID="f43c80104d65f0484c99b5161a6503d4000cd8beef2427dfe253c9a31e5662a5" HandleID="k8s-pod-network.f43c80104d65f0484c99b5161a6503d4000cd8beef2427dfe253c9a31e5662a5" Workload="ip--172--31--23--87-k8s-coredns--668d6bf9bc--54b9r-eth0" Nov 8 00:07:09.384800 containerd[2009]: 2025-11-08 00:07:09.301 [INFO][5325] cni-plugin/k8s.go 418: Populated endpoint ContainerID="f43c80104d65f0484c99b5161a6503d4000cd8beef2427dfe253c9a31e5662a5" Namespace="kube-system" Pod="coredns-668d6bf9bc-54b9r" WorkloadEndpoint="ip--172--31--23--87-k8s-coredns--668d6bf9bc--54b9r-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--23--87-k8s-coredns--668d6bf9bc--54b9r-eth0", GenerateName:"coredns-668d6bf9bc-", Namespace:"kube-system", SelfLink:"", UID:"dd9a1fb2-7bfc-4968-86fa-9fc28ad38b94", ResourceVersion:"1083", Generation:0, CreationTimestamp:time.Date(2025, time.November, 8, 0, 6, 7, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-dns", "pod-template-hash":"668d6bf9bc", "projectcalico.org/namespace":"kube-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"coredns"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-23-87", ContainerID:"", Pod:"coredns-668d6bf9bc-54b9r", Endpoint:"eth0", ServiceAccountName:"coredns", IPNetworks:[]string{"192.168.100.71/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.kube-system", "ksa.kube-system.coredns"}, InterfaceName:"calie8e25f97186", MAC:"", Ports:[]v3.WorkloadEndpointPort{v3.WorkloadEndpointPort{Name:"dns", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"UDP"}, Port:0x35, HostPort:0x0, HostIP:""}, v3.WorkloadEndpointPort{Name:"dns-tcp", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"TCP"}, Port:0x35, HostPort:0x0, HostIP:""}, v3.WorkloadEndpointPort{Name:"metrics", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"TCP"}, Port:0x23c1, HostPort:0x0, HostIP:""}}, AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 8 00:07:09.384800 containerd[2009]: 2025-11-08 00:07:09.301 [INFO][5325] cni-plugin/k8s.go 419: Calico CNI using IPs: [192.168.100.71/32] ContainerID="f43c80104d65f0484c99b5161a6503d4000cd8beef2427dfe253c9a31e5662a5" Namespace="kube-system" Pod="coredns-668d6bf9bc-54b9r" WorkloadEndpoint="ip--172--31--23--87-k8s-coredns--668d6bf9bc--54b9r-eth0" Nov 8 00:07:09.384800 containerd[2009]: 2025-11-08 00:07:09.301 [INFO][5325] cni-plugin/dataplane_linux.go 69: Setting the host side veth name to calie8e25f97186 ContainerID="f43c80104d65f0484c99b5161a6503d4000cd8beef2427dfe253c9a31e5662a5" Namespace="kube-system" Pod="coredns-668d6bf9bc-54b9r" WorkloadEndpoint="ip--172--31--23--87-k8s-coredns--668d6bf9bc--54b9r-eth0" Nov 8 00:07:09.384800 containerd[2009]: 2025-11-08 00:07:09.315 [INFO][5325] cni-plugin/dataplane_linux.go 508: Disabling IPv4 forwarding ContainerID="f43c80104d65f0484c99b5161a6503d4000cd8beef2427dfe253c9a31e5662a5" Namespace="kube-system" Pod="coredns-668d6bf9bc-54b9r" WorkloadEndpoint="ip--172--31--23--87-k8s-coredns--668d6bf9bc--54b9r-eth0" Nov 8 00:07:09.384800 containerd[2009]: 2025-11-08 00:07:09.319 [INFO][5325] cni-plugin/k8s.go 446: Added Mac, interface name, and active container ID to endpoint ContainerID="f43c80104d65f0484c99b5161a6503d4000cd8beef2427dfe253c9a31e5662a5" Namespace="kube-system" Pod="coredns-668d6bf9bc-54b9r" WorkloadEndpoint="ip--172--31--23--87-k8s-coredns--668d6bf9bc--54b9r-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--23--87-k8s-coredns--668d6bf9bc--54b9r-eth0", GenerateName:"coredns-668d6bf9bc-", Namespace:"kube-system", SelfLink:"", UID:"dd9a1fb2-7bfc-4968-86fa-9fc28ad38b94", ResourceVersion:"1083", Generation:0, CreationTimestamp:time.Date(2025, time.November, 8, 0, 6, 7, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-dns", "pod-template-hash":"668d6bf9bc", "projectcalico.org/namespace":"kube-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"coredns"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-23-87", ContainerID:"f43c80104d65f0484c99b5161a6503d4000cd8beef2427dfe253c9a31e5662a5", Pod:"coredns-668d6bf9bc-54b9r", Endpoint:"eth0", ServiceAccountName:"coredns", IPNetworks:[]string{"192.168.100.71/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.kube-system", "ksa.kube-system.coredns"}, InterfaceName:"calie8e25f97186", MAC:"96:dd:56:27:ca:83", Ports:[]v3.WorkloadEndpointPort{v3.WorkloadEndpointPort{Name:"dns", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"UDP"}, Port:0x35, HostPort:0x0, HostIP:""}, v3.WorkloadEndpointPort{Name:"dns-tcp", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"TCP"}, Port:0x35, HostPort:0x0, HostIP:""}, v3.WorkloadEndpointPort{Name:"metrics", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"TCP"}, Port:0x23c1, HostPort:0x0, HostIP:""}}, AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 8 00:07:09.384800 containerd[2009]: 2025-11-08 00:07:09.357 [INFO][5325] cni-plugin/k8s.go 532: Wrote updated endpoint to datastore ContainerID="f43c80104d65f0484c99b5161a6503d4000cd8beef2427dfe253c9a31e5662a5" Namespace="kube-system" Pod="coredns-668d6bf9bc-54b9r" WorkloadEndpoint="ip--172--31--23--87-k8s-coredns--668d6bf9bc--54b9r-eth0" Nov 8 00:07:09.387502 containerd[2009]: time="2025-11-08T00:07:09.386685683Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-7cbbf6b44f-hrhmg,Uid:58f37ea9-b0c8-456a-8651-ebf3793b8679,Namespace:calico-apiserver,Attempt:1,}" Nov 8 00:07:09.514321 containerd[2009]: time="2025-11-08T00:07:09.512388624Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1 Nov 8 00:07:09.514321 containerd[2009]: time="2025-11-08T00:07:09.512507904Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1 Nov 8 00:07:09.514321 containerd[2009]: time="2025-11-08T00:07:09.512565132Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Nov 8 00:07:09.514321 containerd[2009]: time="2025-11-08T00:07:09.512781828Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Nov 8 00:07:09.590909 containerd[2009]: time="2025-11-08T00:07:09.590729976Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-7cbbf6b44f-pntg9,Uid:886783b3-53d5-4894-8799-c2c145d125ce,Namespace:calico-apiserver,Attempt:1,} returns sandbox id \"ed0535b0c92fce55fb7ea3b605c72b93bd7e051f2a56ff73a33359bd349a5f4f\"" Nov 8 00:07:09.622029 systemd[1]: Started cri-containerd-f43c80104d65f0484c99b5161a6503d4000cd8beef2427dfe253c9a31e5662a5.scope - libcontainer container f43c80104d65f0484c99b5161a6503d4000cd8beef2427dfe253c9a31e5662a5. Nov 8 00:07:09.638855 containerd[2009]: time="2025-11-08T00:07:09.638329956Z" level=info msg="trying next host - response was http.StatusNotFound" host=ghcr.io Nov 8 00:07:09.642717 containerd[2009]: time="2025-11-08T00:07:09.642453756Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" Nov 8 00:07:09.643466 containerd[2009]: time="2025-11-08T00:07:09.642648216Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/kube-controllers:v3.30.4: active requests=0, bytes read=85" Nov 8 00:07:09.648016 kubelet[3341]: E1108 00:07:09.647162 3341 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" image="ghcr.io/flatcar/calico/kube-controllers:v3.30.4" Nov 8 00:07:09.648016 kubelet[3341]: E1108 00:07:09.647244 3341 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" image="ghcr.io/flatcar/calico/kube-controllers:v3.30.4" Nov 8 00:07:09.648016 kubelet[3341]: E1108 00:07:09.647610 3341 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:calico-kube-controllers,Image:ghcr.io/flatcar/calico/kube-controllers:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:KUBE_CONTROLLERS_CONFIG_NAME,Value:default,ValueFrom:nil,},EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:ENABLED_CONTROLLERS,Value:node,loadbalancer,ValueFrom:nil,},EnvVar{Name:DISABLE_KUBE_CONTROLLERS_CONFIG_API,Value:false,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:CA_CRT_PATH,Value:/etc/pki/tls/certs/tigera-ca-bundle.crt,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:tigera-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:tigera-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/cert.pem,SubPath:ca-bundle.crt,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-bt2d5,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/usr/bin/check-status -l],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:10,TimeoutSeconds:10,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:6,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/usr/bin/check-status -r],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:10,PeriodSeconds:30,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*999,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-kube-controllers-7cc5d59f7b-q89cg_calico-system(52f757de-0e18-4b03-af0a-9737e167b914): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" logger="UnhandledError" Nov 8 00:07:09.650031 containerd[2009]: time="2025-11-08T00:07:09.648744024Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\"" Nov 8 00:07:09.650200 kubelet[3341]: E1108 00:07:09.649222 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-kube-controllers\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found\"" pod="calico-system/calico-kube-controllers-7cc5d59f7b-q89cg" podUID="52f757de-0e18-4b03-af0a-9737e167b914" Nov 8 00:07:09.656414 systemd-networkd[1929]: caliac986209725: Gained IPv6LL Nov 8 00:07:09.662041 containerd[2009]: time="2025-11-08T00:07:09.661971816Z" level=info msg="StopPodSandbox for \"f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687\"" Nov 8 00:07:09.879507 containerd[2009]: time="2025-11-08T00:07:09.879097826Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-668d6bf9bc-54b9r,Uid:dd9a1fb2-7bfc-4968-86fa-9fc28ad38b94,Namespace:kube-system,Attempt:1,} returns sandbox id \"f43c80104d65f0484c99b5161a6503d4000cd8beef2427dfe253c9a31e5662a5\"" Nov 8 00:07:09.916567 containerd[2009]: time="2025-11-08T00:07:09.916360034Z" level=info msg="CreateContainer within sandbox \"f43c80104d65f0484c99b5161a6503d4000cd8beef2427dfe253c9a31e5662a5\" for container &ContainerMetadata{Name:coredns,Attempt:0,}" Nov 8 00:07:09.970441 containerd[2009]: time="2025-11-08T00:07:09.969599702Z" level=info msg="CreateContainer within sandbox \"f43c80104d65f0484c99b5161a6503d4000cd8beef2427dfe253c9a31e5662a5\" for &ContainerMetadata{Name:coredns,Attempt:0,} returns container id \"2db0c6539197ad6267b8913b0eba2037997f5be7658fa22e2b3fb742c18bd484\"" Nov 8 00:07:09.970928 containerd[2009]: time="2025-11-08T00:07:09.970872686Z" level=info msg="StartContainer for \"2db0c6539197ad6267b8913b0eba2037997f5be7658fa22e2b3fb742c18bd484\"" Nov 8 00:07:10.028840 containerd[2009]: time="2025-11-08T00:07:10.027637378Z" level=info msg="trying next host - response was http.StatusNotFound" host=ghcr.io Nov 8 00:07:10.032318 containerd[2009]: time="2025-11-08T00:07:10.030747298Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" Nov 8 00:07:10.032318 containerd[2009]: time="2025-11-08T00:07:10.030847222Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/apiserver:v3.30.4: active requests=0, bytes read=77" Nov 8 00:07:10.032547 kubelet[3341]: E1108 00:07:10.031021 3341 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 8 00:07:10.032547 kubelet[3341]: E1108 00:07:10.031092 3341 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 8 00:07:10.032547 kubelet[3341]: E1108 00:07:10.031317 3341 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:calico-apiserver,Image:ghcr.io/flatcar/calico/apiserver:v3.30.4,Command:[],Args:[--secure-port=5443 --tls-private-key-file=/calico-apiserver-certs/tls.key --tls-cert-file=/calico-apiserver-certs/tls.crt],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:LOG_LEVEL,Value:info,ValueFrom:nil,},EnvVar{Name:MULTI_INTERFACE_MODE,Value:none,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:calico-apiserver-certs,ReadOnly:true,MountPath:/calico-apiserver-certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-lk46f,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 5443 },Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-apiserver-7cbbf6b44f-pntg9_calico-apiserver(886783b3-53d5-4894-8799-c2c145d125ce): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" logger="UnhandledError" Nov 8 00:07:10.034552 kubelet[3341]: E1108 00:07:10.033181 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-7cbbf6b44f-pntg9" podUID="886783b3-53d5-4894-8799-c2c145d125ce" Nov 8 00:07:10.040088 systemd-networkd[1929]: vxlan.calico: Gained IPv6LL Nov 8 00:07:10.136712 systemd[1]: Started cri-containerd-2db0c6539197ad6267b8913b0eba2037997f5be7658fa22e2b3fb742c18bd484.scope - libcontainer container 2db0c6539197ad6267b8913b0eba2037997f5be7658fa22e2b3fb742c18bd484. Nov 8 00:07:10.173476 systemd-networkd[1929]: cali973c4614f4d: Link UP Nov 8 00:07:10.184538 systemd-networkd[1929]: cali973c4614f4d: Gained carrier Nov 8 00:07:10.237757 containerd[2009]: 2025-11-08 00:07:09.737 [INFO][5448] cni-plugin/plugin.go 340: Calico CNI found existing endpoint: &{{WorkloadEndpoint projectcalico.org/v3} {ip--172--31--23--87-k8s-calico--apiserver--7cbbf6b44f--hrhmg-eth0 calico-apiserver-7cbbf6b44f- calico-apiserver 58f37ea9-b0c8-456a-8651-ebf3793b8679 1108 0 2025-11-08 00:06:24 +0000 UTC map[apiserver:true app.kubernetes.io/name:calico-apiserver k8s-app:calico-apiserver pod-template-hash:7cbbf6b44f projectcalico.org/namespace:calico-apiserver projectcalico.org/orchestrator:k8s projectcalico.org/serviceaccount:calico-apiserver] map[] [] [] []} {k8s ip-172-31-23-87 calico-apiserver-7cbbf6b44f-hrhmg eth0 calico-apiserver [] [] [kns.calico-apiserver ksa.calico-apiserver.calico-apiserver] cali973c4614f4d [] [] }} ContainerID="b495b8c272bdecc62a84e705a3b5df475b0dde6e1f7630ebb2973b43b31a92f0" Namespace="calico-apiserver" Pod="calico-apiserver-7cbbf6b44f-hrhmg" WorkloadEndpoint="ip--172--31--23--87-k8s-calico--apiserver--7cbbf6b44f--hrhmg-" Nov 8 00:07:10.237757 containerd[2009]: 2025-11-08 00:07:09.737 [INFO][5448] cni-plugin/k8s.go 74: Extracted identifiers for CmdAddK8s ContainerID="b495b8c272bdecc62a84e705a3b5df475b0dde6e1f7630ebb2973b43b31a92f0" Namespace="calico-apiserver" Pod="calico-apiserver-7cbbf6b44f-hrhmg" WorkloadEndpoint="ip--172--31--23--87-k8s-calico--apiserver--7cbbf6b44f--hrhmg-eth0" Nov 8 00:07:10.237757 containerd[2009]: 2025-11-08 00:07:09.947 [INFO][5509] ipam/ipam_plugin.go 227: Calico CNI IPAM request count IPv4=1 IPv6=0 ContainerID="b495b8c272bdecc62a84e705a3b5df475b0dde6e1f7630ebb2973b43b31a92f0" HandleID="k8s-pod-network.b495b8c272bdecc62a84e705a3b5df475b0dde6e1f7630ebb2973b43b31a92f0" Workload="ip--172--31--23--87-k8s-calico--apiserver--7cbbf6b44f--hrhmg-eth0" Nov 8 00:07:10.237757 containerd[2009]: 2025-11-08 00:07:09.952 [INFO][5509] ipam/ipam_plugin.go 275: Auto assigning IP ContainerID="b495b8c272bdecc62a84e705a3b5df475b0dde6e1f7630ebb2973b43b31a92f0" HandleID="k8s-pod-network.b495b8c272bdecc62a84e705a3b5df475b0dde6e1f7630ebb2973b43b31a92f0" Workload="ip--172--31--23--87-k8s-calico--apiserver--7cbbf6b44f--hrhmg-eth0" assignArgs=ipam.AutoAssignArgs{Num4:1, Num6:0, HandleID:(*string)(0x40002fbd60), Attrs:map[string]string{"namespace":"calico-apiserver", "node":"ip-172-31-23-87", "pod":"calico-apiserver-7cbbf6b44f-hrhmg", "timestamp":"2025-11-08 00:07:09.947007902 +0000 UTC"}, Hostname:"ip-172-31-23-87", IPv4Pools:[]net.IPNet{}, IPv6Pools:[]net.IPNet{}, MaxBlocksPerHost:0, HostReservedAttrIPv4s:(*ipam.HostReservedAttr)(nil), HostReservedAttrIPv6s:(*ipam.HostReservedAttr)(nil), IntendedUse:"Workload"} Nov 8 00:07:10.237757 containerd[2009]: 2025-11-08 00:07:09.952 [INFO][5509] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 8 00:07:10.237757 containerd[2009]: 2025-11-08 00:07:09.952 [INFO][5509] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 8 00:07:10.237757 containerd[2009]: 2025-11-08 00:07:09.953 [INFO][5509] ipam/ipam.go 110: Auto-assign 1 ipv4, 0 ipv6 addrs for host 'ip-172-31-23-87' Nov 8 00:07:10.237757 containerd[2009]: 2025-11-08 00:07:09.989 [INFO][5509] ipam/ipam.go 691: Looking up existing affinities for host handle="k8s-pod-network.b495b8c272bdecc62a84e705a3b5df475b0dde6e1f7630ebb2973b43b31a92f0" host="ip-172-31-23-87" Nov 8 00:07:10.237757 containerd[2009]: 2025-11-08 00:07:10.011 [INFO][5509] ipam/ipam.go 394: Looking up existing affinities for host host="ip-172-31-23-87" Nov 8 00:07:10.237757 containerd[2009]: 2025-11-08 00:07:10.028 [INFO][5509] ipam/ipam.go 511: Trying affinity for 192.168.100.64/26 host="ip-172-31-23-87" Nov 8 00:07:10.237757 containerd[2009]: 2025-11-08 00:07:10.041 [INFO][5509] ipam/ipam.go 158: Attempting to load block cidr=192.168.100.64/26 host="ip-172-31-23-87" Nov 8 00:07:10.237757 containerd[2009]: 2025-11-08 00:07:10.055 [INFO][5509] ipam/ipam.go 235: Affinity is confirmed and block has been loaded cidr=192.168.100.64/26 host="ip-172-31-23-87" Nov 8 00:07:10.237757 containerd[2009]: 2025-11-08 00:07:10.055 [INFO][5509] ipam/ipam.go 1219: Attempting to assign 1 addresses from block block=192.168.100.64/26 handle="k8s-pod-network.b495b8c272bdecc62a84e705a3b5df475b0dde6e1f7630ebb2973b43b31a92f0" host="ip-172-31-23-87" Nov 8 00:07:10.237757 containerd[2009]: 2025-11-08 00:07:10.062 [INFO][5509] ipam/ipam.go 1780: Creating new handle: k8s-pod-network.b495b8c272bdecc62a84e705a3b5df475b0dde6e1f7630ebb2973b43b31a92f0 Nov 8 00:07:10.237757 containerd[2009]: 2025-11-08 00:07:10.077 [INFO][5509] ipam/ipam.go 1246: Writing block in order to claim IPs block=192.168.100.64/26 handle="k8s-pod-network.b495b8c272bdecc62a84e705a3b5df475b0dde6e1f7630ebb2973b43b31a92f0" host="ip-172-31-23-87" Nov 8 00:07:10.237757 containerd[2009]: 2025-11-08 00:07:10.113 [INFO][5509] ipam/ipam.go 1262: Successfully claimed IPs: [192.168.100.72/26] block=192.168.100.64/26 handle="k8s-pod-network.b495b8c272bdecc62a84e705a3b5df475b0dde6e1f7630ebb2973b43b31a92f0" host="ip-172-31-23-87" Nov 8 00:07:10.237757 containerd[2009]: 2025-11-08 00:07:10.113 [INFO][5509] ipam/ipam.go 878: Auto-assigned 1 out of 1 IPv4s: [192.168.100.72/26] handle="k8s-pod-network.b495b8c272bdecc62a84e705a3b5df475b0dde6e1f7630ebb2973b43b31a92f0" host="ip-172-31-23-87" Nov 8 00:07:10.237757 containerd[2009]: 2025-11-08 00:07:10.114 [INFO][5509] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 8 00:07:10.237757 containerd[2009]: 2025-11-08 00:07:10.114 [INFO][5509] ipam/ipam_plugin.go 299: Calico CNI IPAM assigned addresses IPv4=[192.168.100.72/26] IPv6=[] ContainerID="b495b8c272bdecc62a84e705a3b5df475b0dde6e1f7630ebb2973b43b31a92f0" HandleID="k8s-pod-network.b495b8c272bdecc62a84e705a3b5df475b0dde6e1f7630ebb2973b43b31a92f0" Workload="ip--172--31--23--87-k8s-calico--apiserver--7cbbf6b44f--hrhmg-eth0" Nov 8 00:07:10.243000 containerd[2009]: 2025-11-08 00:07:10.135 [INFO][5448] cni-plugin/k8s.go 418: Populated endpoint ContainerID="b495b8c272bdecc62a84e705a3b5df475b0dde6e1f7630ebb2973b43b31a92f0" Namespace="calico-apiserver" Pod="calico-apiserver-7cbbf6b44f-hrhmg" WorkloadEndpoint="ip--172--31--23--87-k8s-calico--apiserver--7cbbf6b44f--hrhmg-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--23--87-k8s-calico--apiserver--7cbbf6b44f--hrhmg-eth0", GenerateName:"calico-apiserver-7cbbf6b44f-", Namespace:"calico-apiserver", SelfLink:"", UID:"58f37ea9-b0c8-456a-8651-ebf3793b8679", ResourceVersion:"1108", Generation:0, CreationTimestamp:time.Date(2025, time.November, 8, 0, 6, 24, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"apiserver":"true", "app.kubernetes.io/name":"calico-apiserver", "k8s-app":"calico-apiserver", "pod-template-hash":"7cbbf6b44f", "projectcalico.org/namespace":"calico-apiserver", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"calico-apiserver"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-23-87", ContainerID:"", Pod:"calico-apiserver-7cbbf6b44f-hrhmg", Endpoint:"eth0", ServiceAccountName:"calico-apiserver", IPNetworks:[]string{"192.168.100.72/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-apiserver", "ksa.calico-apiserver.calico-apiserver"}, InterfaceName:"cali973c4614f4d", MAC:"", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 8 00:07:10.243000 containerd[2009]: 2025-11-08 00:07:10.148 [INFO][5448] cni-plugin/k8s.go 419: Calico CNI using IPs: [192.168.100.72/32] ContainerID="b495b8c272bdecc62a84e705a3b5df475b0dde6e1f7630ebb2973b43b31a92f0" Namespace="calico-apiserver" Pod="calico-apiserver-7cbbf6b44f-hrhmg" WorkloadEndpoint="ip--172--31--23--87-k8s-calico--apiserver--7cbbf6b44f--hrhmg-eth0" Nov 8 00:07:10.243000 containerd[2009]: 2025-11-08 00:07:10.152 [INFO][5448] cni-plugin/dataplane_linux.go 69: Setting the host side veth name to cali973c4614f4d ContainerID="b495b8c272bdecc62a84e705a3b5df475b0dde6e1f7630ebb2973b43b31a92f0" Namespace="calico-apiserver" Pod="calico-apiserver-7cbbf6b44f-hrhmg" WorkloadEndpoint="ip--172--31--23--87-k8s-calico--apiserver--7cbbf6b44f--hrhmg-eth0" Nov 8 00:07:10.243000 containerd[2009]: 2025-11-08 00:07:10.189 [INFO][5448] cni-plugin/dataplane_linux.go 508: Disabling IPv4 forwarding ContainerID="b495b8c272bdecc62a84e705a3b5df475b0dde6e1f7630ebb2973b43b31a92f0" Namespace="calico-apiserver" Pod="calico-apiserver-7cbbf6b44f-hrhmg" WorkloadEndpoint="ip--172--31--23--87-k8s-calico--apiserver--7cbbf6b44f--hrhmg-eth0" Nov 8 00:07:10.243000 containerd[2009]: 2025-11-08 00:07:10.198 [INFO][5448] cni-plugin/k8s.go 446: Added Mac, interface name, and active container ID to endpoint ContainerID="b495b8c272bdecc62a84e705a3b5df475b0dde6e1f7630ebb2973b43b31a92f0" Namespace="calico-apiserver" Pod="calico-apiserver-7cbbf6b44f-hrhmg" WorkloadEndpoint="ip--172--31--23--87-k8s-calico--apiserver--7cbbf6b44f--hrhmg-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--23--87-k8s-calico--apiserver--7cbbf6b44f--hrhmg-eth0", GenerateName:"calico-apiserver-7cbbf6b44f-", Namespace:"calico-apiserver", SelfLink:"", UID:"58f37ea9-b0c8-456a-8651-ebf3793b8679", ResourceVersion:"1108", Generation:0, CreationTimestamp:time.Date(2025, time.November, 8, 0, 6, 24, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"apiserver":"true", "app.kubernetes.io/name":"calico-apiserver", "k8s-app":"calico-apiserver", "pod-template-hash":"7cbbf6b44f", "projectcalico.org/namespace":"calico-apiserver", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"calico-apiserver"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-23-87", ContainerID:"b495b8c272bdecc62a84e705a3b5df475b0dde6e1f7630ebb2973b43b31a92f0", Pod:"calico-apiserver-7cbbf6b44f-hrhmg", Endpoint:"eth0", ServiceAccountName:"calico-apiserver", IPNetworks:[]string{"192.168.100.72/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-apiserver", "ksa.calico-apiserver.calico-apiserver"}, InterfaceName:"cali973c4614f4d", MAC:"5a:6c:44:ed:bf:22", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 8 00:07:10.243000 containerd[2009]: 2025-11-08 00:07:10.228 [INFO][5448] cni-plugin/k8s.go 532: Wrote updated endpoint to datastore ContainerID="b495b8c272bdecc62a84e705a3b5df475b0dde6e1f7630ebb2973b43b31a92f0" Namespace="calico-apiserver" Pod="calico-apiserver-7cbbf6b44f-hrhmg" WorkloadEndpoint="ip--172--31--23--87-k8s-calico--apiserver--7cbbf6b44f--hrhmg-eth0" Nov 8 00:07:10.280162 containerd[2009]: 2025-11-08 00:07:09.950 [INFO][5508] cni-plugin/k8s.go 640: Cleaning up netns ContainerID="f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687" Nov 8 00:07:10.280162 containerd[2009]: 2025-11-08 00:07:09.956 [INFO][5508] cni-plugin/dataplane_linux.go 559: Deleting workload's device in netns. ContainerID="f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687" iface="eth0" netns="/var/run/netns/cni-c31bd504-211a-387d-dd1b-aa2a9e591ef7" Nov 8 00:07:10.280162 containerd[2009]: 2025-11-08 00:07:09.956 [INFO][5508] cni-plugin/dataplane_linux.go 570: Entered netns, deleting veth. ContainerID="f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687" iface="eth0" netns="/var/run/netns/cni-c31bd504-211a-387d-dd1b-aa2a9e591ef7" Nov 8 00:07:10.280162 containerd[2009]: 2025-11-08 00:07:09.957 [INFO][5508] cni-plugin/dataplane_linux.go 597: Workload's veth was already gone. Nothing to do. ContainerID="f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687" iface="eth0" netns="/var/run/netns/cni-c31bd504-211a-387d-dd1b-aa2a9e591ef7" Nov 8 00:07:10.280162 containerd[2009]: 2025-11-08 00:07:09.957 [INFO][5508] cni-plugin/k8s.go 647: Releasing IP address(es) ContainerID="f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687" Nov 8 00:07:10.280162 containerd[2009]: 2025-11-08 00:07:09.958 [INFO][5508] cni-plugin/utils.go 188: Calico CNI releasing IP address ContainerID="f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687" Nov 8 00:07:10.280162 containerd[2009]: 2025-11-08 00:07:10.189 [INFO][5530] ipam/ipam_plugin.go 436: Releasing address using handleID ContainerID="f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687" HandleID="k8s-pod-network.f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687" Workload="ip--172--31--23--87-k8s-goldmane--666569f655--qlmhx-eth0" Nov 8 00:07:10.280162 containerd[2009]: 2025-11-08 00:07:10.194 [INFO][5530] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 8 00:07:10.280162 containerd[2009]: 2025-11-08 00:07:10.196 [INFO][5530] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 8 00:07:10.280162 containerd[2009]: 2025-11-08 00:07:10.222 [WARNING][5530] ipam/ipam_plugin.go 453: Asked to release address but it doesn't exist. Ignoring ContainerID="f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687" HandleID="k8s-pod-network.f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687" Workload="ip--172--31--23--87-k8s-goldmane--666569f655--qlmhx-eth0" Nov 8 00:07:10.280162 containerd[2009]: 2025-11-08 00:07:10.224 [INFO][5530] ipam/ipam_plugin.go 464: Releasing address using workloadID ContainerID="f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687" HandleID="k8s-pod-network.f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687" Workload="ip--172--31--23--87-k8s-goldmane--666569f655--qlmhx-eth0" Nov 8 00:07:10.280162 containerd[2009]: 2025-11-08 00:07:10.249 [INFO][5530] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 8 00:07:10.280162 containerd[2009]: 2025-11-08 00:07:10.262 [INFO][5508] cni-plugin/k8s.go 653: Teardown processing complete. ContainerID="f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687" Nov 8 00:07:10.280162 containerd[2009]: time="2025-11-08T00:07:10.278982384Z" level=info msg="TearDown network for sandbox \"f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687\" successfully" Nov 8 00:07:10.280162 containerd[2009]: time="2025-11-08T00:07:10.279030264Z" level=info msg="StopPodSandbox for \"f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687\" returns successfully" Nov 8 00:07:10.287961 containerd[2009]: time="2025-11-08T00:07:10.281687580Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:goldmane-666569f655-qlmhx,Uid:ac78d516-6696-4a76-a1b8-01b7e90766d4,Namespace:calico-system,Attempt:1,}" Nov 8 00:07:10.291199 systemd[1]: run-netns-cni\x2dc31bd504\x2d211a\x2d387d\x2ddd1b\x2daa2a9e591ef7.mount: Deactivated successfully. Nov 8 00:07:10.350659 containerd[2009]: time="2025-11-08T00:07:10.348391368Z" level=info msg="StartContainer for \"2db0c6539197ad6267b8913b0eba2037997f5be7658fa22e2b3fb742c18bd484\" returns successfully" Nov 8 00:07:10.359473 systemd-networkd[1929]: cali06a7791c2eb: Gained IPv6LL Nov 8 00:07:10.372079 containerd[2009]: time="2025-11-08T00:07:10.365642844Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1 Nov 8 00:07:10.372079 containerd[2009]: time="2025-11-08T00:07:10.365730456Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1 Nov 8 00:07:10.372079 containerd[2009]: time="2025-11-08T00:07:10.365755692Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Nov 8 00:07:10.377482 containerd[2009]: time="2025-11-08T00:07:10.376843656Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Nov 8 00:07:10.402686 kubelet[3341]: E1108 00:07:10.402387 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-7cbbf6b44f-pntg9" podUID="886783b3-53d5-4894-8799-c2c145d125ce" Nov 8 00:07:10.429638 kubelet[3341]: E1108 00:07:10.428155 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-kube-controllers\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found\"" pod="calico-system/calico-kube-controllers-7cc5d59f7b-q89cg" podUID="52f757de-0e18-4b03-af0a-9737e167b914" Nov 8 00:07:10.430445 kubelet[3341]: E1108 00:07:10.430321 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-66cbb68f69-hrrjm" podUID="68debac0-90fa-43fc-b6a2-614e4954f14e" Nov 8 00:07:10.540970 systemd[1]: Started cri-containerd-b495b8c272bdecc62a84e705a3b5df475b0dde6e1f7630ebb2973b43b31a92f0.scope - libcontainer container b495b8c272bdecc62a84e705a3b5df475b0dde6e1f7630ebb2973b43b31a92f0. Nov 8 00:07:10.630480 kubelet[3341]: I1108 00:07:10.629537 3341 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/coredns-668d6bf9bc-54b9r" podStartSLOduration=63.629511481 podStartE2EDuration="1m3.629511481s" podCreationTimestamp="2025-11-08 00:06:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-08 00:07:10.629356489 +0000 UTC m=+69.146196056" watchObservedRunningTime="2025-11-08 00:07:10.629511481 +0000 UTC m=+69.146351036" Nov 8 00:07:10.841784 systemd-networkd[1929]: calic7a84a49f46: Link UP Nov 8 00:07:10.876023 systemd-networkd[1929]: calic7a84a49f46: Gained carrier Nov 8 00:07:10.907853 containerd[2009]: 2025-11-08 00:07:10.607 [INFO][5593] cni-plugin/plugin.go 340: Calico CNI found existing endpoint: &{{WorkloadEndpoint projectcalico.org/v3} {ip--172--31--23--87-k8s-goldmane--666569f655--qlmhx-eth0 goldmane-666569f655- calico-system ac78d516-6696-4a76-a1b8-01b7e90766d4 1127 0 2025-11-08 00:06:39 +0000 UTC map[app.kubernetes.io/name:goldmane k8s-app:goldmane pod-template-hash:666569f655 projectcalico.org/namespace:calico-system projectcalico.org/orchestrator:k8s projectcalico.org/serviceaccount:goldmane] map[] [] [] []} {k8s ip-172-31-23-87 goldmane-666569f655-qlmhx eth0 goldmane [] [] [kns.calico-system ksa.calico-system.goldmane] calic7a84a49f46 [] [] }} ContainerID="2256333f4f50475537ac6d67681d7d927670b8b13ade11a95f7c1dd1d1010379" Namespace="calico-system" Pod="goldmane-666569f655-qlmhx" WorkloadEndpoint="ip--172--31--23--87-k8s-goldmane--666569f655--qlmhx-" Nov 8 00:07:10.907853 containerd[2009]: 2025-11-08 00:07:10.608 [INFO][5593] cni-plugin/k8s.go 74: Extracted identifiers for CmdAddK8s ContainerID="2256333f4f50475537ac6d67681d7d927670b8b13ade11a95f7c1dd1d1010379" Namespace="calico-system" Pod="goldmane-666569f655-qlmhx" WorkloadEndpoint="ip--172--31--23--87-k8s-goldmane--666569f655--qlmhx-eth0" Nov 8 00:07:10.907853 containerd[2009]: 2025-11-08 00:07:10.724 [INFO][5619] ipam/ipam_plugin.go 227: Calico CNI IPAM request count IPv4=1 IPv6=0 ContainerID="2256333f4f50475537ac6d67681d7d927670b8b13ade11a95f7c1dd1d1010379" HandleID="k8s-pod-network.2256333f4f50475537ac6d67681d7d927670b8b13ade11a95f7c1dd1d1010379" Workload="ip--172--31--23--87-k8s-goldmane--666569f655--qlmhx-eth0" Nov 8 00:07:10.907853 containerd[2009]: 2025-11-08 00:07:10.725 [INFO][5619] ipam/ipam_plugin.go 275: Auto assigning IP ContainerID="2256333f4f50475537ac6d67681d7d927670b8b13ade11a95f7c1dd1d1010379" HandleID="k8s-pod-network.2256333f4f50475537ac6d67681d7d927670b8b13ade11a95f7c1dd1d1010379" Workload="ip--172--31--23--87-k8s-goldmane--666569f655--qlmhx-eth0" assignArgs=ipam.AutoAssignArgs{Num4:1, Num6:0, HandleID:(*string)(0x40002d3030), Attrs:map[string]string{"namespace":"calico-system", "node":"ip-172-31-23-87", "pod":"goldmane-666569f655-qlmhx", "timestamp":"2025-11-08 00:07:10.724888934 +0000 UTC"}, Hostname:"ip-172-31-23-87", IPv4Pools:[]net.IPNet{}, IPv6Pools:[]net.IPNet{}, MaxBlocksPerHost:0, HostReservedAttrIPv4s:(*ipam.HostReservedAttr)(nil), HostReservedAttrIPv6s:(*ipam.HostReservedAttr)(nil), IntendedUse:"Workload"} Nov 8 00:07:10.907853 containerd[2009]: 2025-11-08 00:07:10.725 [INFO][5619] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 8 00:07:10.907853 containerd[2009]: 2025-11-08 00:07:10.725 [INFO][5619] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 8 00:07:10.907853 containerd[2009]: 2025-11-08 00:07:10.726 [INFO][5619] ipam/ipam.go 110: Auto-assign 1 ipv4, 0 ipv6 addrs for host 'ip-172-31-23-87' Nov 8 00:07:10.907853 containerd[2009]: 2025-11-08 00:07:10.742 [INFO][5619] ipam/ipam.go 691: Looking up existing affinities for host handle="k8s-pod-network.2256333f4f50475537ac6d67681d7d927670b8b13ade11a95f7c1dd1d1010379" host="ip-172-31-23-87" Nov 8 00:07:10.907853 containerd[2009]: 2025-11-08 00:07:10.754 [INFO][5619] ipam/ipam.go 394: Looking up existing affinities for host host="ip-172-31-23-87" Nov 8 00:07:10.907853 containerd[2009]: 2025-11-08 00:07:10.773 [INFO][5619] ipam/ipam.go 511: Trying affinity for 192.168.100.64/26 host="ip-172-31-23-87" Nov 8 00:07:10.907853 containerd[2009]: 2025-11-08 00:07:10.782 [INFO][5619] ipam/ipam.go 158: Attempting to load block cidr=192.168.100.64/26 host="ip-172-31-23-87" Nov 8 00:07:10.907853 containerd[2009]: 2025-11-08 00:07:10.789 [INFO][5619] ipam/ipam.go 235: Affinity is confirmed and block has been loaded cidr=192.168.100.64/26 host="ip-172-31-23-87" Nov 8 00:07:10.907853 containerd[2009]: 2025-11-08 00:07:10.789 [INFO][5619] ipam/ipam.go 1219: Attempting to assign 1 addresses from block block=192.168.100.64/26 handle="k8s-pod-network.2256333f4f50475537ac6d67681d7d927670b8b13ade11a95f7c1dd1d1010379" host="ip-172-31-23-87" Nov 8 00:07:10.907853 containerd[2009]: 2025-11-08 00:07:10.793 [INFO][5619] ipam/ipam.go 1780: Creating new handle: k8s-pod-network.2256333f4f50475537ac6d67681d7d927670b8b13ade11a95f7c1dd1d1010379 Nov 8 00:07:10.907853 containerd[2009]: 2025-11-08 00:07:10.808 [INFO][5619] ipam/ipam.go 1246: Writing block in order to claim IPs block=192.168.100.64/26 handle="k8s-pod-network.2256333f4f50475537ac6d67681d7d927670b8b13ade11a95f7c1dd1d1010379" host="ip-172-31-23-87" Nov 8 00:07:10.907853 containerd[2009]: 2025-11-08 00:07:10.825 [INFO][5619] ipam/ipam.go 1262: Successfully claimed IPs: [192.168.100.73/26] block=192.168.100.64/26 handle="k8s-pod-network.2256333f4f50475537ac6d67681d7d927670b8b13ade11a95f7c1dd1d1010379" host="ip-172-31-23-87" Nov 8 00:07:10.907853 containerd[2009]: 2025-11-08 00:07:10.825 [INFO][5619] ipam/ipam.go 878: Auto-assigned 1 out of 1 IPv4s: [192.168.100.73/26] handle="k8s-pod-network.2256333f4f50475537ac6d67681d7d927670b8b13ade11a95f7c1dd1d1010379" host="ip-172-31-23-87" Nov 8 00:07:10.907853 containerd[2009]: 2025-11-08 00:07:10.825 [INFO][5619] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 8 00:07:10.907853 containerd[2009]: 2025-11-08 00:07:10.825 [INFO][5619] ipam/ipam_plugin.go 299: Calico CNI IPAM assigned addresses IPv4=[192.168.100.73/26] IPv6=[] ContainerID="2256333f4f50475537ac6d67681d7d927670b8b13ade11a95f7c1dd1d1010379" HandleID="k8s-pod-network.2256333f4f50475537ac6d67681d7d927670b8b13ade11a95f7c1dd1d1010379" Workload="ip--172--31--23--87-k8s-goldmane--666569f655--qlmhx-eth0" Nov 8 00:07:10.912178 containerd[2009]: 2025-11-08 00:07:10.832 [INFO][5593] cni-plugin/k8s.go 418: Populated endpoint ContainerID="2256333f4f50475537ac6d67681d7d927670b8b13ade11a95f7c1dd1d1010379" Namespace="calico-system" Pod="goldmane-666569f655-qlmhx" WorkloadEndpoint="ip--172--31--23--87-k8s-goldmane--666569f655--qlmhx-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--23--87-k8s-goldmane--666569f655--qlmhx-eth0", GenerateName:"goldmane-666569f655-", Namespace:"calico-system", SelfLink:"", UID:"ac78d516-6696-4a76-a1b8-01b7e90766d4", ResourceVersion:"1127", Generation:0, CreationTimestamp:time.Date(2025, time.November, 8, 0, 6, 39, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app.kubernetes.io/name":"goldmane", "k8s-app":"goldmane", "pod-template-hash":"666569f655", "projectcalico.org/namespace":"calico-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"goldmane"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-23-87", ContainerID:"", Pod:"goldmane-666569f655-qlmhx", Endpoint:"eth0", ServiceAccountName:"goldmane", IPNetworks:[]string{"192.168.100.73/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-system", "ksa.calico-system.goldmane"}, InterfaceName:"calic7a84a49f46", MAC:"", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 8 00:07:10.912178 containerd[2009]: 2025-11-08 00:07:10.834 [INFO][5593] cni-plugin/k8s.go 419: Calico CNI using IPs: [192.168.100.73/32] ContainerID="2256333f4f50475537ac6d67681d7d927670b8b13ade11a95f7c1dd1d1010379" Namespace="calico-system" Pod="goldmane-666569f655-qlmhx" WorkloadEndpoint="ip--172--31--23--87-k8s-goldmane--666569f655--qlmhx-eth0" Nov 8 00:07:10.912178 containerd[2009]: 2025-11-08 00:07:10.834 [INFO][5593] cni-plugin/dataplane_linux.go 69: Setting the host side veth name to calic7a84a49f46 ContainerID="2256333f4f50475537ac6d67681d7d927670b8b13ade11a95f7c1dd1d1010379" Namespace="calico-system" Pod="goldmane-666569f655-qlmhx" WorkloadEndpoint="ip--172--31--23--87-k8s-goldmane--666569f655--qlmhx-eth0" Nov 8 00:07:10.912178 containerd[2009]: 2025-11-08 00:07:10.846 [INFO][5593] cni-plugin/dataplane_linux.go 508: Disabling IPv4 forwarding ContainerID="2256333f4f50475537ac6d67681d7d927670b8b13ade11a95f7c1dd1d1010379" Namespace="calico-system" Pod="goldmane-666569f655-qlmhx" WorkloadEndpoint="ip--172--31--23--87-k8s-goldmane--666569f655--qlmhx-eth0" Nov 8 00:07:10.912178 containerd[2009]: 2025-11-08 00:07:10.849 [INFO][5593] cni-plugin/k8s.go 446: Added Mac, interface name, and active container ID to endpoint ContainerID="2256333f4f50475537ac6d67681d7d927670b8b13ade11a95f7c1dd1d1010379" Namespace="calico-system" Pod="goldmane-666569f655-qlmhx" WorkloadEndpoint="ip--172--31--23--87-k8s-goldmane--666569f655--qlmhx-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--23--87-k8s-goldmane--666569f655--qlmhx-eth0", GenerateName:"goldmane-666569f655-", Namespace:"calico-system", SelfLink:"", UID:"ac78d516-6696-4a76-a1b8-01b7e90766d4", ResourceVersion:"1127", Generation:0, CreationTimestamp:time.Date(2025, time.November, 8, 0, 6, 39, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app.kubernetes.io/name":"goldmane", "k8s-app":"goldmane", "pod-template-hash":"666569f655", "projectcalico.org/namespace":"calico-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"goldmane"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-23-87", ContainerID:"2256333f4f50475537ac6d67681d7d927670b8b13ade11a95f7c1dd1d1010379", Pod:"goldmane-666569f655-qlmhx", Endpoint:"eth0", ServiceAccountName:"goldmane", IPNetworks:[]string{"192.168.100.73/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-system", "ksa.calico-system.goldmane"}, InterfaceName:"calic7a84a49f46", MAC:"b2:d9:78:bf:e5:7f", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 8 00:07:10.912178 containerd[2009]: 2025-11-08 00:07:10.901 [INFO][5593] cni-plugin/k8s.go 532: Wrote updated endpoint to datastore ContainerID="2256333f4f50475537ac6d67681d7d927670b8b13ade11a95f7c1dd1d1010379" Namespace="calico-system" Pod="goldmane-666569f655-qlmhx" WorkloadEndpoint="ip--172--31--23--87-k8s-goldmane--666569f655--qlmhx-eth0" Nov 8 00:07:10.999408 containerd[2009]: time="2025-11-08T00:07:10.994591239Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1 Nov 8 00:07:10.999408 containerd[2009]: time="2025-11-08T00:07:10.994691895Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1 Nov 8 00:07:10.999408 containerd[2009]: time="2025-11-08T00:07:10.994729143Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Nov 8 00:07:10.999408 containerd[2009]: time="2025-11-08T00:07:10.994886535Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Nov 8 00:07:10.999715 systemd-networkd[1929]: calie8e25f97186: Gained IPv6LL Nov 8 00:07:11.072316 systemd[1]: Started cri-containerd-2256333f4f50475537ac6d67681d7d927670b8b13ade11a95f7c1dd1d1010379.scope - libcontainer container 2256333f4f50475537ac6d67681d7d927670b8b13ade11a95f7c1dd1d1010379. Nov 8 00:07:11.083714 containerd[2009]: time="2025-11-08T00:07:11.082719047Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-7cbbf6b44f-hrhmg,Uid:58f37ea9-b0c8-456a-8651-ebf3793b8679,Namespace:calico-apiserver,Attempt:1,} returns sandbox id \"b495b8c272bdecc62a84e705a3b5df475b0dde6e1f7630ebb2973b43b31a92f0\"" Nov 8 00:07:11.091946 containerd[2009]: time="2025-11-08T00:07:11.091675428Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\"" Nov 8 00:07:11.208397 containerd[2009]: time="2025-11-08T00:07:11.206482752Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:goldmane-666569f655-qlmhx,Uid:ac78d516-6696-4a76-a1b8-01b7e90766d4,Namespace:calico-system,Attempt:1,} returns sandbox id \"2256333f4f50475537ac6d67681d7d927670b8b13ade11a95f7c1dd1d1010379\"" Nov 8 00:07:11.328778 systemd[1]: Started sshd@10-172.31.23.87:22-139.178.89.65:42836.service - OpenSSH per-connection server daemon (139.178.89.65:42836). Nov 8 00:07:11.413118 containerd[2009]: time="2025-11-08T00:07:11.412848289Z" level=info msg="trying next host - response was http.StatusNotFound" host=ghcr.io Nov 8 00:07:11.415466 containerd[2009]: time="2025-11-08T00:07:11.415181893Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" Nov 8 00:07:11.415466 containerd[2009]: time="2025-11-08T00:07:11.415299529Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/apiserver:v3.30.4: active requests=0, bytes read=77" Nov 8 00:07:11.416432 kubelet[3341]: E1108 00:07:11.415853 3341 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 8 00:07:11.416432 kubelet[3341]: E1108 00:07:11.415925 3341 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 8 00:07:11.418256 containerd[2009]: time="2025-11-08T00:07:11.417320725Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/goldmane:v3.30.4\"" Nov 8 00:07:11.429567 kubelet[3341]: E1108 00:07:11.428986 3341 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:calico-apiserver,Image:ghcr.io/flatcar/calico/apiserver:v3.30.4,Command:[],Args:[--secure-port=5443 --tls-private-key-file=/calico-apiserver-certs/tls.key --tls-cert-file=/calico-apiserver-certs/tls.crt],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:LOG_LEVEL,Value:info,ValueFrom:nil,},EnvVar{Name:MULTI_INTERFACE_MODE,Value:none,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:calico-apiserver-certs,ReadOnly:true,MountPath:/calico-apiserver-certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-4kzbv,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 5443 },Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-apiserver-7cbbf6b44f-hrhmg_calico-apiserver(58f37ea9-b0c8-456a-8651-ebf3793b8679): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" logger="UnhandledError" Nov 8 00:07:11.430377 kubelet[3341]: E1108 00:07:11.430202 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-7cbbf6b44f-hrhmg" podUID="58f37ea9-b0c8-456a-8651-ebf3793b8679" Nov 8 00:07:11.457729 kubelet[3341]: E1108 00:07:11.457672 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-7cbbf6b44f-pntg9" podUID="886783b3-53d5-4894-8799-c2c145d125ce" Nov 8 00:07:11.564525 sshd[5730]: Accepted publickey for core from 139.178.89.65 port 42836 ssh2: RSA SHA256:tnEXpnDY8gLTej7GJ+T99WI4otIwvlI9IcMNDF42aqw Nov 8 00:07:11.571438 sshd[5730]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 8 00:07:11.587245 systemd-logind[1991]: New session 11 of user core. Nov 8 00:07:11.595646 systemd[1]: Started session-11.scope - Session 11 of User core. Nov 8 00:07:11.717144 containerd[2009]: time="2025-11-08T00:07:11.716859999Z" level=info msg="trying next host - response was http.StatusNotFound" host=ghcr.io Nov 8 00:07:11.719414 containerd[2009]: time="2025-11-08T00:07:11.719158623Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/goldmane:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" Nov 8 00:07:11.719414 containerd[2009]: time="2025-11-08T00:07:11.719346663Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/goldmane:v3.30.4: active requests=0, bytes read=77" Nov 8 00:07:11.719652 kubelet[3341]: E1108 00:07:11.719566 3341 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" image="ghcr.io/flatcar/calico/goldmane:v3.30.4" Nov 8 00:07:11.719652 kubelet[3341]: E1108 00:07:11.719631 3341 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" image="ghcr.io/flatcar/calico/goldmane:v3.30.4" Nov 8 00:07:11.719936 kubelet[3341]: E1108 00:07:11.719819 3341 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:goldmane,Image:ghcr.io/flatcar/calico/goldmane:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:INFO,ValueFrom:nil,},EnvVar{Name:PORT,Value:7443,ValueFrom:nil,},EnvVar{Name:SERVER_CERT_PATH,Value:/goldmane-key-pair/tls.crt,ValueFrom:nil,},EnvVar{Name:SERVER_KEY_PATH,Value:/goldmane-key-pair/tls.key,ValueFrom:nil,},EnvVar{Name:CA_CERT_PATH,Value:/etc/pki/tls/certs/tigera-ca-bundle.crt,ValueFrom:nil,},EnvVar{Name:PUSH_URL,Value:https://guardian.calico-system.svc.cluster.local:443/api/v1/flows/bulk,ValueFrom:nil,},EnvVar{Name:FILE_CONFIG_PATH,Value:/config/config.json,ValueFrom:nil,},EnvVar{Name:HEALTH_ENABLED,Value:true,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:config,ReadOnly:true,MountPath:/config,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:goldmane-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:goldmane-key-pair,ReadOnly:true,MountPath:/goldmane-key-pair,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-jv6zv,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/health -live],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/health -ready],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:30,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod goldmane-666569f655-qlmhx_calico-system(ac78d516-6696-4a76-a1b8-01b7e90766d4): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" logger="UnhandledError" Nov 8 00:07:11.722071 kubelet[3341]: E1108 00:07:11.721501 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"goldmane\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found\"" pod="calico-system/goldmane-666569f655-qlmhx" podUID="ac78d516-6696-4a76-a1b8-01b7e90766d4" Nov 8 00:07:11.832538 systemd-networkd[1929]: cali973c4614f4d: Gained IPv6LL Nov 8 00:07:11.916832 sshd[5730]: pam_unix(sshd:session): session closed for user core Nov 8 00:07:11.928778 systemd[1]: sshd@10-172.31.23.87:22-139.178.89.65:42836.service: Deactivated successfully. Nov 8 00:07:11.934652 systemd[1]: session-11.scope: Deactivated successfully. Nov 8 00:07:11.939508 systemd-logind[1991]: Session 11 logged out. Waiting for processes to exit. Nov 8 00:07:11.942313 systemd-logind[1991]: Removed session 11. Nov 8 00:07:12.088520 systemd-networkd[1929]: calic7a84a49f46: Gained IPv6LL Nov 8 00:07:12.452042 kubelet[3341]: E1108 00:07:12.451635 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"goldmane\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found\"" pod="calico-system/goldmane-666569f655-qlmhx" podUID="ac78d516-6696-4a76-a1b8-01b7e90766d4" Nov 8 00:07:12.452042 kubelet[3341]: E1108 00:07:12.451750 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-7cbbf6b44f-hrhmg" podUID="58f37ea9-b0c8-456a-8651-ebf3793b8679" Nov 8 00:07:13.454391 kubelet[3341]: E1108 00:07:13.453343 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-7cbbf6b44f-hrhmg" podUID="58f37ea9-b0c8-456a-8651-ebf3793b8679" Nov 8 00:07:14.924202 ntpd[1986]: Listen normally on 8 vxlan.calico 192.168.100.64:123 Nov 8 00:07:14.924900 ntpd[1986]: 8 Nov 00:07:14 ntpd[1986]: Listen normally on 8 vxlan.calico 192.168.100.64:123 Nov 8 00:07:14.924900 ntpd[1986]: 8 Nov 00:07:14 ntpd[1986]: Listen normally on 9 cali3508d852d6a [fe80::ecee:eeff:feee:eeee%4]:123 Nov 8 00:07:14.924900 ntpd[1986]: 8 Nov 00:07:14 ntpd[1986]: Listen normally on 10 cali39e176a42dc [fe80::ecee:eeff:feee:eeee%5]:123 Nov 8 00:07:14.924900 ntpd[1986]: 8 Nov 00:07:14 ntpd[1986]: Listen normally on 11 calibca3b76f5bd [fe80::ecee:eeff:feee:eeee%6]:123 Nov 8 00:07:14.924900 ntpd[1986]: 8 Nov 00:07:14 ntpd[1986]: Listen normally on 12 cali6c23a06d65d [fe80::ecee:eeff:feee:eeee%7]:123 Nov 8 00:07:14.924900 ntpd[1986]: 8 Nov 00:07:14 ntpd[1986]: Listen normally on 13 vxlan.calico [fe80::64f7:ecff:fe53:490e%8]:123 Nov 8 00:07:14.924900 ntpd[1986]: 8 Nov 00:07:14 ntpd[1986]: Listen normally on 14 caliac986209725 [fe80::ecee:eeff:feee:eeee%9]:123 Nov 8 00:07:14.924449 ntpd[1986]: Listen normally on 9 cali3508d852d6a [fe80::ecee:eeff:feee:eeee%4]:123 Nov 8 00:07:14.925365 ntpd[1986]: 8 Nov 00:07:14 ntpd[1986]: Listen normally on 15 cali06a7791c2eb [fe80::ecee:eeff:feee:eeee%10]:123 Nov 8 00:07:14.925365 ntpd[1986]: 8 Nov 00:07:14 ntpd[1986]: Listen normally on 16 calie8e25f97186 [fe80::ecee:eeff:feee:eeee%13]:123 Nov 8 00:07:14.925365 ntpd[1986]: 8 Nov 00:07:14 ntpd[1986]: Listen normally on 17 cali973c4614f4d [fe80::ecee:eeff:feee:eeee%14]:123 Nov 8 00:07:14.925365 ntpd[1986]: 8 Nov 00:07:14 ntpd[1986]: Listen normally on 18 calic7a84a49f46 [fe80::ecee:eeff:feee:eeee%15]:123 Nov 8 00:07:14.924538 ntpd[1986]: Listen normally on 10 cali39e176a42dc [fe80::ecee:eeff:feee:eeee%5]:123 Nov 8 00:07:14.924609 ntpd[1986]: Listen normally on 11 calibca3b76f5bd [fe80::ecee:eeff:feee:eeee%6]:123 Nov 8 00:07:14.924682 ntpd[1986]: Listen normally on 12 cali6c23a06d65d [fe80::ecee:eeff:feee:eeee%7]:123 Nov 8 00:07:14.924751 ntpd[1986]: Listen normally on 13 vxlan.calico [fe80::64f7:ecff:fe53:490e%8]:123 Nov 8 00:07:14.924839 ntpd[1986]: Listen normally on 14 caliac986209725 [fe80::ecee:eeff:feee:eeee%9]:123 Nov 8 00:07:14.924914 ntpd[1986]: Listen normally on 15 cali06a7791c2eb [fe80::ecee:eeff:feee:eeee%10]:123 Nov 8 00:07:14.924987 ntpd[1986]: Listen normally on 16 calie8e25f97186 [fe80::ecee:eeff:feee:eeee%13]:123 Nov 8 00:07:14.925060 ntpd[1986]: Listen normally on 17 cali973c4614f4d [fe80::ecee:eeff:feee:eeee%14]:123 Nov 8 00:07:14.925130 ntpd[1986]: Listen normally on 18 calic7a84a49f46 [fe80::ecee:eeff:feee:eeee%15]:123 Nov 8 00:07:16.960714 systemd[1]: Started sshd@11-172.31.23.87:22-139.178.89.65:51968.service - OpenSSH per-connection server daemon (139.178.89.65:51968). Nov 8 00:07:17.146304 sshd[5768]: Accepted publickey for core from 139.178.89.65 port 51968 ssh2: RSA SHA256:tnEXpnDY8gLTej7GJ+T99WI4otIwvlI9IcMNDF42aqw Nov 8 00:07:17.151032 sshd[5768]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 8 00:07:17.162497 systemd-logind[1991]: New session 12 of user core. Nov 8 00:07:17.173603 systemd[1]: Started session-12.scope - Session 12 of User core. Nov 8 00:07:17.481938 sshd[5768]: pam_unix(sshd:session): session closed for user core Nov 8 00:07:17.493040 systemd[1]: sshd@11-172.31.23.87:22-139.178.89.65:51968.service: Deactivated successfully. Nov 8 00:07:17.493755 systemd-logind[1991]: Session 12 logged out. Waiting for processes to exit. Nov 8 00:07:17.501503 systemd[1]: session-12.scope: Deactivated successfully. Nov 8 00:07:17.523897 systemd-logind[1991]: Removed session 12. Nov 8 00:07:17.538704 systemd[1]: Started sshd@12-172.31.23.87:22-139.178.89.65:51972.service - OpenSSH per-connection server daemon (139.178.89.65:51972). Nov 8 00:07:17.734141 sshd[5784]: Accepted publickey for core from 139.178.89.65 port 51972 ssh2: RSA SHA256:tnEXpnDY8gLTej7GJ+T99WI4otIwvlI9IcMNDF42aqw Nov 8 00:07:17.736690 sshd[5784]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 8 00:07:17.745738 systemd-logind[1991]: New session 13 of user core. Nov 8 00:07:17.753578 systemd[1]: Started session-13.scope - Session 13 of User core. Nov 8 00:07:18.087256 sshd[5784]: pam_unix(sshd:session): session closed for user core Nov 8 00:07:18.100634 systemd-logind[1991]: Session 13 logged out. Waiting for processes to exit. Nov 8 00:07:18.102823 systemd[1]: sshd@12-172.31.23.87:22-139.178.89.65:51972.service: Deactivated successfully. Nov 8 00:07:18.113228 systemd[1]: session-13.scope: Deactivated successfully. Nov 8 00:07:18.140816 systemd[1]: Started sshd@13-172.31.23.87:22-139.178.89.65:51982.service - OpenSSH per-connection server daemon (139.178.89.65:51982). Nov 8 00:07:18.143899 systemd-logind[1991]: Removed session 13. Nov 8 00:07:18.328744 sshd[5795]: Accepted publickey for core from 139.178.89.65 port 51982 ssh2: RSA SHA256:tnEXpnDY8gLTej7GJ+T99WI4otIwvlI9IcMNDF42aqw Nov 8 00:07:18.331458 sshd[5795]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 8 00:07:18.340047 systemd-logind[1991]: New session 14 of user core. Nov 8 00:07:18.346548 systemd[1]: Started session-14.scope - Session 14 of User core. Nov 8 00:07:18.616620 sshd[5795]: pam_unix(sshd:session): session closed for user core Nov 8 00:07:18.625180 systemd[1]: sshd@13-172.31.23.87:22-139.178.89.65:51982.service: Deactivated successfully. Nov 8 00:07:18.631086 systemd[1]: session-14.scope: Deactivated successfully. Nov 8 00:07:18.635423 systemd-logind[1991]: Session 14 logged out. Waiting for processes to exit. Nov 8 00:07:18.638303 systemd-logind[1991]: Removed session 14. Nov 8 00:07:18.653714 containerd[2009]: time="2025-11-08T00:07:18.653599029Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/whisker:v3.30.4\"" Nov 8 00:07:18.925341 containerd[2009]: time="2025-11-08T00:07:18.925013278Z" level=info msg="trying next host - response was http.StatusNotFound" host=ghcr.io Nov 8 00:07:18.927701 containerd[2009]: time="2025-11-08T00:07:18.927555502Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/whisker:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" Nov 8 00:07:18.927701 containerd[2009]: time="2025-11-08T00:07:18.927644782Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/whisker:v3.30.4: active requests=0, bytes read=73" Nov 8 00:07:18.927956 kubelet[3341]: E1108 00:07:18.927880 3341 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker:v3.30.4" Nov 8 00:07:18.928587 kubelet[3341]: E1108 00:07:18.927952 3341 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker:v3.30.4" Nov 8 00:07:18.928587 kubelet[3341]: E1108 00:07:18.928117 3341 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:whisker,Image:ghcr.io/flatcar/calico/whisker:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:INFO,ValueFrom:nil,},EnvVar{Name:CALICO_VERSION,Value:v3.30.4,ValueFrom:nil,},EnvVar{Name:CLUSTER_ID,Value:80bed0a1b6164782a39b475807edb893,ValueFrom:nil,},EnvVar{Name:CLUSTER_TYPE,Value:typha,kdd,k8s,operator,bgp,kubeadm,ValueFrom:nil,},EnvVar{Name:NOTIFICATIONS,Value:Enabled,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-79s7l,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod whisker-54bc667d85-4nldg_calico-system(97a993f1-d70c-4bf6-ba46-4f0456d70b2e): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" logger="UnhandledError" Nov 8 00:07:18.932501 containerd[2009]: time="2025-11-08T00:07:18.931831378Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\"" Nov 8 00:07:19.231927 containerd[2009]: time="2025-11-08T00:07:19.231852560Z" level=info msg="trying next host - response was http.StatusNotFound" host=ghcr.io Nov 8 00:07:19.234321 containerd[2009]: time="2025-11-08T00:07:19.234173060Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" Nov 8 00:07:19.234321 containerd[2009]: time="2025-11-08T00:07:19.234203540Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/whisker-backend:v3.30.4: active requests=0, bytes read=85" Nov 8 00:07:19.234557 kubelet[3341]: E1108 00:07:19.234467 3341 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker-backend:v3.30.4" Nov 8 00:07:19.234557 kubelet[3341]: E1108 00:07:19.234527 3341 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker-backend:v3.30.4" Nov 8 00:07:19.234752 kubelet[3341]: E1108 00:07:19.234677 3341 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:whisker-backend,Image:ghcr.io/flatcar/calico/whisker-backend:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:INFO,ValueFrom:nil,},EnvVar{Name:PORT,Value:3002,ValueFrom:nil,},EnvVar{Name:GOLDMANE_HOST,Value:goldmane.calico-system.svc.cluster.local:7443,ValueFrom:nil,},EnvVar{Name:TLS_CERT_PATH,Value:/whisker-backend-key-pair/tls.crt,ValueFrom:nil,},EnvVar{Name:TLS_KEY_PATH,Value:/whisker-backend-key-pair/tls.key,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:whisker-backend-key-pair,ReadOnly:true,MountPath:/whisker-backend-key-pair,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:whisker-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-79s7l,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod whisker-54bc667d85-4nldg_calico-system(97a993f1-d70c-4bf6-ba46-4f0456d70b2e): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" logger="UnhandledError" Nov 8 00:07:19.236782 kubelet[3341]: E1108 00:07:19.236684 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"whisker\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found\", failed to \"StartContainer\" for \"whisker-backend\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found\"]" pod="calico-system/whisker-54bc667d85-4nldg" podUID="97a993f1-d70c-4bf6-ba46-4f0456d70b2e" Nov 8 00:07:20.654781 containerd[2009]: time="2025-11-08T00:07:20.654447203Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/csi:v3.30.4\"" Nov 8 00:07:20.947095 containerd[2009]: time="2025-11-08T00:07:20.946908780Z" level=info msg="trying next host - response was http.StatusNotFound" host=ghcr.io Nov 8 00:07:20.948764 containerd[2009]: time="2025-11-08T00:07:20.948694656Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/csi:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" Nov 8 00:07:20.949516 containerd[2009]: time="2025-11-08T00:07:20.948879145Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/csi:v3.30.4: active requests=0, bytes read=69" Nov 8 00:07:20.949596 kubelet[3341]: E1108 00:07:20.949047 3341 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" image="ghcr.io/flatcar/calico/csi:v3.30.4" Nov 8 00:07:20.949596 kubelet[3341]: E1108 00:07:20.949124 3341 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" image="ghcr.io/flatcar/calico/csi:v3.30.4" Nov 8 00:07:20.949596 kubelet[3341]: E1108 00:07:20.949329 3341 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:calico-csi,Image:ghcr.io/flatcar/calico/csi:v3.30.4,Command:[],Args:[--nodeid=$(KUBE_NODE_NAME) --loglevel=$(LOG_LEVEL)],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:warn,ValueFrom:nil,},EnvVar{Name:KUBE_NODE_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:spec.nodeName,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kubelet-dir,ReadOnly:false,MountPath:/var/lib/kubelet,SubPath:,MountPropagation:*Bidirectional,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:socket-dir,ReadOnly:false,MountPath:/csi,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:varrun,ReadOnly:false,MountPath:/var/run,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-cmvgp,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*true,SELinuxOptions:nil,RunAsUser:*0,RunAsNonRoot:*false,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*true,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod csi-node-driver-8rk2x_calico-system(0fc7336a-4c45-40ec-b634-101ce08e1be1): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" logger="UnhandledError" Nov 8 00:07:20.952454 containerd[2009]: time="2025-11-08T00:07:20.952094605Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\"" Nov 8 00:07:21.248386 containerd[2009]: time="2025-11-08T00:07:21.248297398Z" level=info msg="trying next host - response was http.StatusNotFound" host=ghcr.io Nov 8 00:07:21.250554 containerd[2009]: time="2025-11-08T00:07:21.250490974Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" Nov 8 00:07:21.251309 containerd[2009]: time="2025-11-08T00:07:21.250812298Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: active requests=0, bytes read=93" Nov 8 00:07:21.251425 kubelet[3341]: E1108 00:07:21.250788 3341 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" image="ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4" Nov 8 00:07:21.251425 kubelet[3341]: E1108 00:07:21.250855 3341 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" image="ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4" Nov 8 00:07:21.251425 kubelet[3341]: E1108 00:07:21.251028 3341 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:csi-node-driver-registrar,Image:ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4,Command:[],Args:[--v=5 --csi-address=$(ADDRESS) --kubelet-registration-path=$(DRIVER_REG_SOCK_PATH)],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:ADDRESS,Value:/csi/csi.sock,ValueFrom:nil,},EnvVar{Name:DRIVER_REG_SOCK_PATH,Value:/var/lib/kubelet/plugins/csi.tigera.io/csi.sock,ValueFrom:nil,},EnvVar{Name:KUBE_NODE_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:spec.nodeName,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:registration-dir,ReadOnly:false,MountPath:/registration,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:socket-dir,ReadOnly:false,MountPath:/csi,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-cmvgp,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*true,SELinuxOptions:nil,RunAsUser:*0,RunAsNonRoot:*false,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*true,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod csi-node-driver-8rk2x_calico-system(0fc7336a-4c45-40ec-b634-101ce08e1be1): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" logger="UnhandledError" Nov 8 00:07:21.252512 kubelet[3341]: E1108 00:07:21.252438 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"calico-csi\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ghcr.io/flatcar/calico/csi:v3.30.4: not found\", failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found\"]" pod="calico-system/csi-node-driver-8rk2x" podUID="0fc7336a-4c45-40ec-b634-101ce08e1be1" Nov 8 00:07:22.652570 containerd[2009]: time="2025-11-08T00:07:22.652464001Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\"" Nov 8 00:07:22.927148 containerd[2009]: time="2025-11-08T00:07:22.926948774Z" level=info msg="trying next host - response was http.StatusNotFound" host=ghcr.io Nov 8 00:07:22.929290 containerd[2009]: time="2025-11-08T00:07:22.929190614Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" Nov 8 00:07:22.929436 containerd[2009]: time="2025-11-08T00:07:22.929352086Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/apiserver:v3.30.4: active requests=0, bytes read=77" Nov 8 00:07:22.929696 kubelet[3341]: E1108 00:07:22.929602 3341 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 8 00:07:22.929696 kubelet[3341]: E1108 00:07:22.929676 3341 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 8 00:07:22.930377 containerd[2009]: time="2025-11-08T00:07:22.930102674Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\"" Nov 8 00:07:22.932144 kubelet[3341]: E1108 00:07:22.930628 3341 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:calico-apiserver,Image:ghcr.io/flatcar/calico/apiserver:v3.30.4,Command:[],Args:[--secure-port=5443 --tls-private-key-file=/calico-apiserver-certs/tls.key --tls-cert-file=/calico-apiserver-certs/tls.crt],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:LOG_LEVEL,Value:info,ValueFrom:nil,},EnvVar{Name:MULTI_INTERFACE_MODE,Value:none,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:calico-apiserver-certs,ReadOnly:true,MountPath:/calico-apiserver-certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-dxmxx,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 5443 },Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-apiserver-66cbb68f69-hrrjm_calico-apiserver(68debac0-90fa-43fc-b6a2-614e4954f14e): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" logger="UnhandledError" Nov 8 00:07:22.932921 kubelet[3341]: E1108 00:07:22.932105 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-66cbb68f69-hrrjm" podUID="68debac0-90fa-43fc-b6a2-614e4954f14e" Nov 8 00:07:23.220645 containerd[2009]: time="2025-11-08T00:07:23.220551288Z" level=info msg="trying next host - response was http.StatusNotFound" host=ghcr.io Nov 8 00:07:23.222885 containerd[2009]: time="2025-11-08T00:07:23.222816936Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" Nov 8 00:07:23.223011 containerd[2009]: time="2025-11-08T00:07:23.222949212Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/apiserver:v3.30.4: active requests=0, bytes read=77" Nov 8 00:07:23.223344 kubelet[3341]: E1108 00:07:23.223260 3341 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 8 00:07:23.223454 kubelet[3341]: E1108 00:07:23.223358 3341 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 8 00:07:23.223629 kubelet[3341]: E1108 00:07:23.223537 3341 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:calico-apiserver,Image:ghcr.io/flatcar/calico/apiserver:v3.30.4,Command:[],Args:[--secure-port=5443 --tls-private-key-file=/calico-apiserver-certs/tls.key --tls-cert-file=/calico-apiserver-certs/tls.crt],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:LOG_LEVEL,Value:info,ValueFrom:nil,},EnvVar{Name:MULTI_INTERFACE_MODE,Value:none,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:calico-apiserver-certs,ReadOnly:true,MountPath:/calico-apiserver-certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-lk46f,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 5443 },Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-apiserver-7cbbf6b44f-pntg9_calico-apiserver(886783b3-53d5-4894-8799-c2c145d125ce): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" logger="UnhandledError" Nov 8 00:07:23.225412 kubelet[3341]: E1108 00:07:23.225221 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-7cbbf6b44f-pntg9" podUID="886783b3-53d5-4894-8799-c2c145d125ce" Nov 8 00:07:23.657737 containerd[2009]: time="2025-11-08T00:07:23.656377286Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\"" Nov 8 00:07:23.668328 systemd[1]: Started sshd@14-172.31.23.87:22-139.178.89.65:51994.service - OpenSSH per-connection server daemon (139.178.89.65:51994). Nov 8 00:07:23.868400 sshd[5818]: Accepted publickey for core from 139.178.89.65 port 51994 ssh2: RSA SHA256:tnEXpnDY8gLTej7GJ+T99WI4otIwvlI9IcMNDF42aqw Nov 8 00:07:23.871148 sshd[5818]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 8 00:07:23.881347 systemd-logind[1991]: New session 15 of user core. Nov 8 00:07:23.890578 systemd[1]: Started session-15.scope - Session 15 of User core. Nov 8 00:07:23.972903 containerd[2009]: time="2025-11-08T00:07:23.972631888Z" level=info msg="trying next host - response was http.StatusNotFound" host=ghcr.io Nov 8 00:07:23.974945 containerd[2009]: time="2025-11-08T00:07:23.974813020Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" Nov 8 00:07:23.974945 containerd[2009]: time="2025-11-08T00:07:23.974904088Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/kube-controllers:v3.30.4: active requests=0, bytes read=85" Nov 8 00:07:23.975331 kubelet[3341]: E1108 00:07:23.975242 3341 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" image="ghcr.io/flatcar/calico/kube-controllers:v3.30.4" Nov 8 00:07:23.976685 kubelet[3341]: E1108 00:07:23.975340 3341 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" image="ghcr.io/flatcar/calico/kube-controllers:v3.30.4" Nov 8 00:07:23.976685 kubelet[3341]: E1108 00:07:23.975529 3341 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:calico-kube-controllers,Image:ghcr.io/flatcar/calico/kube-controllers:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:KUBE_CONTROLLERS_CONFIG_NAME,Value:default,ValueFrom:nil,},EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:ENABLED_CONTROLLERS,Value:node,loadbalancer,ValueFrom:nil,},EnvVar{Name:DISABLE_KUBE_CONTROLLERS_CONFIG_API,Value:false,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:CA_CRT_PATH,Value:/etc/pki/tls/certs/tigera-ca-bundle.crt,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:tigera-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:tigera-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/cert.pem,SubPath:ca-bundle.crt,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-bt2d5,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/usr/bin/check-status -l],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:10,TimeoutSeconds:10,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:6,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/usr/bin/check-status -r],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:10,PeriodSeconds:30,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*999,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-kube-controllers-7cc5d59f7b-q89cg_calico-system(52f757de-0e18-4b03-af0a-9737e167b914): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" logger="UnhandledError" Nov 8 00:07:23.977433 kubelet[3341]: E1108 00:07:23.977067 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-kube-controllers\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found\"" pod="calico-system/calico-kube-controllers-7cc5d59f7b-q89cg" podUID="52f757de-0e18-4b03-af0a-9737e167b914" Nov 8 00:07:24.158040 sshd[5818]: pam_unix(sshd:session): session closed for user core Nov 8 00:07:24.163574 systemd[1]: sshd@14-172.31.23.87:22-139.178.89.65:51994.service: Deactivated successfully. Nov 8 00:07:24.168388 systemd[1]: session-15.scope: Deactivated successfully. Nov 8 00:07:24.171825 systemd-logind[1991]: Session 15 logged out. Waiting for processes to exit. Nov 8 00:07:24.174767 systemd-logind[1991]: Removed session 15. Nov 8 00:07:24.654482 containerd[2009]: time="2025-11-08T00:07:24.653185791Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\"" Nov 8 00:07:24.954031 containerd[2009]: time="2025-11-08T00:07:24.953833456Z" level=info msg="trying next host - response was http.StatusNotFound" host=ghcr.io Nov 8 00:07:24.956131 containerd[2009]: time="2025-11-08T00:07:24.956064808Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" Nov 8 00:07:24.956239 containerd[2009]: time="2025-11-08T00:07:24.956207584Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/apiserver:v3.30.4: active requests=0, bytes read=77" Nov 8 00:07:24.956478 kubelet[3341]: E1108 00:07:24.956422 3341 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 8 00:07:24.956729 kubelet[3341]: E1108 00:07:24.956494 3341 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 8 00:07:24.956729 kubelet[3341]: E1108 00:07:24.956661 3341 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:calico-apiserver,Image:ghcr.io/flatcar/calico/apiserver:v3.30.4,Command:[],Args:[--secure-port=5443 --tls-private-key-file=/calico-apiserver-certs/tls.key --tls-cert-file=/calico-apiserver-certs/tls.crt],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:LOG_LEVEL,Value:info,ValueFrom:nil,},EnvVar{Name:MULTI_INTERFACE_MODE,Value:none,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:calico-apiserver-certs,ReadOnly:true,MountPath:/calico-apiserver-certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-4kzbv,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 5443 },Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-apiserver-7cbbf6b44f-hrhmg_calico-apiserver(58f37ea9-b0c8-456a-8651-ebf3793b8679): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" logger="UnhandledError" Nov 8 00:07:24.958543 kubelet[3341]: E1108 00:07:24.958347 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-7cbbf6b44f-hrhmg" podUID="58f37ea9-b0c8-456a-8651-ebf3793b8679" Nov 8 00:07:25.654574 containerd[2009]: time="2025-11-08T00:07:25.653924656Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/goldmane:v3.30.4\"" Nov 8 00:07:25.985589 containerd[2009]: time="2025-11-08T00:07:25.985509678Z" level=info msg="trying next host - response was http.StatusNotFound" host=ghcr.io Nov 8 00:07:25.987779 containerd[2009]: time="2025-11-08T00:07:25.987699150Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/goldmane:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" Nov 8 00:07:25.987976 containerd[2009]: time="2025-11-08T00:07:25.987917130Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/goldmane:v3.30.4: active requests=0, bytes read=77" Nov 8 00:07:25.988326 kubelet[3341]: E1108 00:07:25.988217 3341 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" image="ghcr.io/flatcar/calico/goldmane:v3.30.4" Nov 8 00:07:25.989039 kubelet[3341]: E1108 00:07:25.988341 3341 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" image="ghcr.io/flatcar/calico/goldmane:v3.30.4" Nov 8 00:07:25.989039 kubelet[3341]: E1108 00:07:25.988608 3341 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:goldmane,Image:ghcr.io/flatcar/calico/goldmane:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:INFO,ValueFrom:nil,},EnvVar{Name:PORT,Value:7443,ValueFrom:nil,},EnvVar{Name:SERVER_CERT_PATH,Value:/goldmane-key-pair/tls.crt,ValueFrom:nil,},EnvVar{Name:SERVER_KEY_PATH,Value:/goldmane-key-pair/tls.key,ValueFrom:nil,},EnvVar{Name:CA_CERT_PATH,Value:/etc/pki/tls/certs/tigera-ca-bundle.crt,ValueFrom:nil,},EnvVar{Name:PUSH_URL,Value:https://guardian.calico-system.svc.cluster.local:443/api/v1/flows/bulk,ValueFrom:nil,},EnvVar{Name:FILE_CONFIG_PATH,Value:/config/config.json,ValueFrom:nil,},EnvVar{Name:HEALTH_ENABLED,Value:true,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:config,ReadOnly:true,MountPath:/config,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:goldmane-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:goldmane-key-pair,ReadOnly:true,MountPath:/goldmane-key-pair,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-jv6zv,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/health -live],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/health -ready],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:30,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod goldmane-666569f655-qlmhx_calico-system(ac78d516-6696-4a76-a1b8-01b7e90766d4): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" logger="UnhandledError" Nov 8 00:07:25.989932 kubelet[3341]: E1108 00:07:25.989858 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"goldmane\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found\"" pod="calico-system/goldmane-666569f655-qlmhx" podUID="ac78d516-6696-4a76-a1b8-01b7e90766d4" Nov 8 00:07:29.203826 systemd[1]: Started sshd@15-172.31.23.87:22-139.178.89.65:40180.service - OpenSSH per-connection server daemon (139.178.89.65:40180). Nov 8 00:07:29.402632 sshd[5836]: Accepted publickey for core from 139.178.89.65 port 40180 ssh2: RSA SHA256:tnEXpnDY8gLTej7GJ+T99WI4otIwvlI9IcMNDF42aqw Nov 8 00:07:29.406401 sshd[5836]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 8 00:07:29.418686 systemd-logind[1991]: New session 16 of user core. Nov 8 00:07:29.425620 systemd[1]: Started session-16.scope - Session 16 of User core. Nov 8 00:07:29.716167 sshd[5836]: pam_unix(sshd:session): session closed for user core Nov 8 00:07:29.724613 systemd-logind[1991]: Session 16 logged out. Waiting for processes to exit. Nov 8 00:07:29.725074 systemd[1]: sshd@15-172.31.23.87:22-139.178.89.65:40180.service: Deactivated successfully. Nov 8 00:07:29.730337 systemd[1]: session-16.scope: Deactivated successfully. Nov 8 00:07:29.734660 systemd-logind[1991]: Removed session 16. Nov 8 00:07:33.661309 kubelet[3341]: E1108 00:07:33.661227 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"whisker\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found\", failed to \"StartContainer\" for \"whisker-backend\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found\"]" pod="calico-system/whisker-54bc667d85-4nldg" podUID="97a993f1-d70c-4bf6-ba46-4f0456d70b2e" Nov 8 00:07:34.757816 systemd[1]: Started sshd@16-172.31.23.87:22-139.178.89.65:40182.service - OpenSSH per-connection server daemon (139.178.89.65:40182). Nov 8 00:07:34.947418 sshd[5878]: Accepted publickey for core from 139.178.89.65 port 40182 ssh2: RSA SHA256:tnEXpnDY8gLTej7GJ+T99WI4otIwvlI9IcMNDF42aqw Nov 8 00:07:34.949429 sshd[5878]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 8 00:07:34.967122 systemd-logind[1991]: New session 17 of user core. Nov 8 00:07:34.980013 systemd[1]: Started session-17.scope - Session 17 of User core. Nov 8 00:07:35.244932 sshd[5878]: pam_unix(sshd:session): session closed for user core Nov 8 00:07:35.251529 systemd[1]: sshd@16-172.31.23.87:22-139.178.89.65:40182.service: Deactivated successfully. Nov 8 00:07:35.258247 systemd[1]: session-17.scope: Deactivated successfully. Nov 8 00:07:35.259605 systemd-logind[1991]: Session 17 logged out. Waiting for processes to exit. Nov 8 00:07:35.261907 systemd-logind[1991]: Removed session 17. Nov 8 00:07:35.659795 kubelet[3341]: E1108 00:07:35.658574 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-66cbb68f69-hrrjm" podUID="68debac0-90fa-43fc-b6a2-614e4954f14e" Nov 8 00:07:35.659795 kubelet[3341]: E1108 00:07:35.658602 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-kube-controllers\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found\"" pod="calico-system/calico-kube-controllers-7cc5d59f7b-q89cg" podUID="52f757de-0e18-4b03-af0a-9737e167b914" Nov 8 00:07:35.659795 kubelet[3341]: E1108 00:07:35.658680 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"calico-csi\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ghcr.io/flatcar/calico/csi:v3.30.4: not found\", failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found\"]" pod="calico-system/csi-node-driver-8rk2x" podUID="0fc7336a-4c45-40ec-b634-101ce08e1be1" Nov 8 00:07:36.652636 kubelet[3341]: E1108 00:07:36.652563 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"goldmane\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found\"" pod="calico-system/goldmane-666569f655-qlmhx" podUID="ac78d516-6696-4a76-a1b8-01b7e90766d4" Nov 8 00:07:38.654073 kubelet[3341]: E1108 00:07:38.654006 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-7cbbf6b44f-pntg9" podUID="886783b3-53d5-4894-8799-c2c145d125ce" Nov 8 00:07:39.654304 kubelet[3341]: E1108 00:07:39.653044 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-7cbbf6b44f-hrhmg" podUID="58f37ea9-b0c8-456a-8651-ebf3793b8679" Nov 8 00:07:40.285783 systemd[1]: Started sshd@17-172.31.23.87:22-139.178.89.65:50436.service - OpenSSH per-connection server daemon (139.178.89.65:50436). Nov 8 00:07:40.478133 sshd[5895]: Accepted publickey for core from 139.178.89.65 port 50436 ssh2: RSA SHA256:tnEXpnDY8gLTej7GJ+T99WI4otIwvlI9IcMNDF42aqw Nov 8 00:07:40.481174 sshd[5895]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 8 00:07:40.489734 systemd-logind[1991]: New session 18 of user core. Nov 8 00:07:40.496538 systemd[1]: Started session-18.scope - Session 18 of User core. Nov 8 00:07:40.759531 sshd[5895]: pam_unix(sshd:session): session closed for user core Nov 8 00:07:40.766715 systemd[1]: sshd@17-172.31.23.87:22-139.178.89.65:50436.service: Deactivated successfully. Nov 8 00:07:40.770662 systemd[1]: session-18.scope: Deactivated successfully. Nov 8 00:07:40.772668 systemd-logind[1991]: Session 18 logged out. Waiting for processes to exit. Nov 8 00:07:40.774669 systemd-logind[1991]: Removed session 18. Nov 8 00:07:44.669897 containerd[2009]: time="2025-11-08T00:07:44.669455686Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/whisker:v3.30.4\"" Nov 8 00:07:44.951006 containerd[2009]: time="2025-11-08T00:07:44.950731416Z" level=info msg="trying next host - response was http.StatusNotFound" host=ghcr.io Nov 8 00:07:44.953740 containerd[2009]: time="2025-11-08T00:07:44.953351328Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/whisker:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" Nov 8 00:07:44.953740 containerd[2009]: time="2025-11-08T00:07:44.953433396Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/whisker:v3.30.4: active requests=0, bytes read=73" Nov 8 00:07:44.953949 kubelet[3341]: E1108 00:07:44.953732 3341 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker:v3.30.4" Nov 8 00:07:44.953949 kubelet[3341]: E1108 00:07:44.953795 3341 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker:v3.30.4" Nov 8 00:07:44.962292 kubelet[3341]: E1108 00:07:44.961344 3341 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:whisker,Image:ghcr.io/flatcar/calico/whisker:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:INFO,ValueFrom:nil,},EnvVar{Name:CALICO_VERSION,Value:v3.30.4,ValueFrom:nil,},EnvVar{Name:CLUSTER_ID,Value:80bed0a1b6164782a39b475807edb893,ValueFrom:nil,},EnvVar{Name:CLUSTER_TYPE,Value:typha,kdd,k8s,operator,bgp,kubeadm,ValueFrom:nil,},EnvVar{Name:NOTIFICATIONS,Value:Enabled,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-79s7l,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod whisker-54bc667d85-4nldg_calico-system(97a993f1-d70c-4bf6-ba46-4f0456d70b2e): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" logger="UnhandledError" Nov 8 00:07:44.965358 containerd[2009]: time="2025-11-08T00:07:44.964502328Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\"" Nov 8 00:07:45.264700 containerd[2009]: time="2025-11-08T00:07:45.264475173Z" level=info msg="trying next host - response was http.StatusNotFound" host=ghcr.io Nov 8 00:07:45.267138 containerd[2009]: time="2025-11-08T00:07:45.266934513Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" Nov 8 00:07:45.267138 containerd[2009]: time="2025-11-08T00:07:45.267082797Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/whisker-backend:v3.30.4: active requests=0, bytes read=85" Nov 8 00:07:45.268342 kubelet[3341]: E1108 00:07:45.267538 3341 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker-backend:v3.30.4" Nov 8 00:07:45.268342 kubelet[3341]: E1108 00:07:45.267603 3341 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker-backend:v3.30.4" Nov 8 00:07:45.268342 kubelet[3341]: E1108 00:07:45.267753 3341 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:whisker-backend,Image:ghcr.io/flatcar/calico/whisker-backend:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:INFO,ValueFrom:nil,},EnvVar{Name:PORT,Value:3002,ValueFrom:nil,},EnvVar{Name:GOLDMANE_HOST,Value:goldmane.calico-system.svc.cluster.local:7443,ValueFrom:nil,},EnvVar{Name:TLS_CERT_PATH,Value:/whisker-backend-key-pair/tls.crt,ValueFrom:nil,},EnvVar{Name:TLS_KEY_PATH,Value:/whisker-backend-key-pair/tls.key,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:whisker-backend-key-pair,ReadOnly:true,MountPath:/whisker-backend-key-pair,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:whisker-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-79s7l,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod whisker-54bc667d85-4nldg_calico-system(97a993f1-d70c-4bf6-ba46-4f0456d70b2e): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" logger="UnhandledError" Nov 8 00:07:45.269525 kubelet[3341]: E1108 00:07:45.269447 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"whisker\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found\", failed to \"StartContainer\" for \"whisker-backend\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found\"]" pod="calico-system/whisker-54bc667d85-4nldg" podUID="97a993f1-d70c-4bf6-ba46-4f0456d70b2e" Nov 8 00:07:45.802845 systemd[1]: Started sshd@18-172.31.23.87:22-139.178.89.65:50450.service - OpenSSH per-connection server daemon (139.178.89.65:50450). Nov 8 00:07:45.987309 sshd[5909]: Accepted publickey for core from 139.178.89.65 port 50450 ssh2: RSA SHA256:tnEXpnDY8gLTej7GJ+T99WI4otIwvlI9IcMNDF42aqw Nov 8 00:07:45.989656 sshd[5909]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 8 00:07:45.998653 systemd-logind[1991]: New session 19 of user core. Nov 8 00:07:46.005539 systemd[1]: Started session-19.scope - Session 19 of User core. Nov 8 00:07:46.261884 sshd[5909]: pam_unix(sshd:session): session closed for user core Nov 8 00:07:46.268937 systemd[1]: sshd@18-172.31.23.87:22-139.178.89.65:50450.service: Deactivated successfully. Nov 8 00:07:46.274408 systemd[1]: session-19.scope: Deactivated successfully. Nov 8 00:07:46.275981 systemd-logind[1991]: Session 19 logged out. Waiting for processes to exit. Nov 8 00:07:46.279595 systemd-logind[1991]: Removed session 19. Nov 8 00:07:46.309008 systemd[1]: Started sshd@19-172.31.23.87:22-139.178.89.65:44620.service - OpenSSH per-connection server daemon (139.178.89.65:44620). Nov 8 00:07:46.480984 sshd[5922]: Accepted publickey for core from 139.178.89.65 port 44620 ssh2: RSA SHA256:tnEXpnDY8gLTej7GJ+T99WI4otIwvlI9IcMNDF42aqw Nov 8 00:07:46.483681 sshd[5922]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 8 00:07:46.493057 systemd-logind[1991]: New session 20 of user core. Nov 8 00:07:46.500562 systemd[1]: Started session-20.scope - Session 20 of User core. Nov 8 00:07:46.994233 sshd[5922]: pam_unix(sshd:session): session closed for user core Nov 8 00:07:47.000475 systemd[1]: sshd@19-172.31.23.87:22-139.178.89.65:44620.service: Deactivated successfully. Nov 8 00:07:47.004653 systemd[1]: session-20.scope: Deactivated successfully. Nov 8 00:07:47.007641 systemd-logind[1991]: Session 20 logged out. Waiting for processes to exit. Nov 8 00:07:47.010584 systemd-logind[1991]: Removed session 20. Nov 8 00:07:47.033055 systemd[1]: Started sshd@20-172.31.23.87:22-139.178.89.65:44622.service - OpenSSH per-connection server daemon (139.178.89.65:44622). Nov 8 00:07:47.220178 sshd[5933]: Accepted publickey for core from 139.178.89.65 port 44622 ssh2: RSA SHA256:tnEXpnDY8gLTej7GJ+T99WI4otIwvlI9IcMNDF42aqw Nov 8 00:07:47.223221 sshd[5933]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 8 00:07:47.232586 systemd-logind[1991]: New session 21 of user core. Nov 8 00:07:47.240538 systemd[1]: Started session-21.scope - Session 21 of User core. Nov 8 00:07:48.273682 sshd[5933]: pam_unix(sshd:session): session closed for user core Nov 8 00:07:48.307206 systemd[1]: sshd@20-172.31.23.87:22-139.178.89.65:44622.service: Deactivated successfully. Nov 8 00:07:48.315229 systemd[1]: session-21.scope: Deactivated successfully. Nov 8 00:07:48.325546 systemd-logind[1991]: Session 21 logged out. Waiting for processes to exit. Nov 8 00:07:48.335806 systemd[1]: Started sshd@21-172.31.23.87:22-139.178.89.65:44628.service - OpenSSH per-connection server daemon (139.178.89.65:44628). Nov 8 00:07:48.340120 systemd-logind[1991]: Removed session 21. Nov 8 00:07:48.554026 sshd[5952]: Accepted publickey for core from 139.178.89.65 port 44628 ssh2: RSA SHA256:tnEXpnDY8gLTej7GJ+T99WI4otIwvlI9IcMNDF42aqw Nov 8 00:07:48.556585 sshd[5952]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 8 00:07:48.566775 systemd-logind[1991]: New session 22 of user core. Nov 8 00:07:48.574573 systemd[1]: Started session-22.scope - Session 22 of User core. Nov 8 00:07:48.670048 containerd[2009]: time="2025-11-08T00:07:48.669629630Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\"" Nov 8 00:07:48.982643 containerd[2009]: time="2025-11-08T00:07:48.982541776Z" level=info msg="trying next host - response was http.StatusNotFound" host=ghcr.io Nov 8 00:07:48.985109 containerd[2009]: time="2025-11-08T00:07:48.985017076Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" Nov 8 00:07:48.985302 containerd[2009]: time="2025-11-08T00:07:48.985178596Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/apiserver:v3.30.4: active requests=0, bytes read=77" Nov 8 00:07:48.986058 kubelet[3341]: E1108 00:07:48.985524 3341 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 8 00:07:48.986058 kubelet[3341]: E1108 00:07:48.985601 3341 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 8 00:07:48.986058 kubelet[3341]: E1108 00:07:48.985935 3341 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:calico-apiserver,Image:ghcr.io/flatcar/calico/apiserver:v3.30.4,Command:[],Args:[--secure-port=5443 --tls-private-key-file=/calico-apiserver-certs/tls.key --tls-cert-file=/calico-apiserver-certs/tls.crt],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:LOG_LEVEL,Value:info,ValueFrom:nil,},EnvVar{Name:MULTI_INTERFACE_MODE,Value:none,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:calico-apiserver-certs,ReadOnly:true,MountPath:/calico-apiserver-certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-dxmxx,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 5443 },Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-apiserver-66cbb68f69-hrrjm_calico-apiserver(68debac0-90fa-43fc-b6a2-614e4954f14e): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" logger="UnhandledError" Nov 8 00:07:48.986947 containerd[2009]: time="2025-11-08T00:07:48.986587960Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\"" Nov 8 00:07:48.989445 kubelet[3341]: E1108 00:07:48.987210 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-66cbb68f69-hrrjm" podUID="68debac0-90fa-43fc-b6a2-614e4954f14e" Nov 8 00:07:49.155477 sshd[5952]: pam_unix(sshd:session): session closed for user core Nov 8 00:07:49.164163 systemd[1]: sshd@21-172.31.23.87:22-139.178.89.65:44628.service: Deactivated successfully. Nov 8 00:07:49.171425 systemd[1]: session-22.scope: Deactivated successfully. Nov 8 00:07:49.173449 systemd-logind[1991]: Session 22 logged out. Waiting for processes to exit. Nov 8 00:07:49.176298 systemd-logind[1991]: Removed session 22. Nov 8 00:07:49.192953 systemd[1]: Started sshd@22-172.31.23.87:22-139.178.89.65:44632.service - OpenSSH per-connection server daemon (139.178.89.65:44632). Nov 8 00:07:49.290304 containerd[2009]: time="2025-11-08T00:07:49.290117461Z" level=info msg="trying next host - response was http.StatusNotFound" host=ghcr.io Nov 8 00:07:49.292397 containerd[2009]: time="2025-11-08T00:07:49.292317301Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" Nov 8 00:07:49.292554 containerd[2009]: time="2025-11-08T00:07:49.292464445Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/kube-controllers:v3.30.4: active requests=0, bytes read=85" Nov 8 00:07:49.292736 kubelet[3341]: E1108 00:07:49.292681 3341 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" image="ghcr.io/flatcar/calico/kube-controllers:v3.30.4" Nov 8 00:07:49.292901 kubelet[3341]: E1108 00:07:49.292749 3341 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" image="ghcr.io/flatcar/calico/kube-controllers:v3.30.4" Nov 8 00:07:49.293163 kubelet[3341]: E1108 00:07:49.293066 3341 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:calico-kube-controllers,Image:ghcr.io/flatcar/calico/kube-controllers:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:KUBE_CONTROLLERS_CONFIG_NAME,Value:default,ValueFrom:nil,},EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:ENABLED_CONTROLLERS,Value:node,loadbalancer,ValueFrom:nil,},EnvVar{Name:DISABLE_KUBE_CONTROLLERS_CONFIG_API,Value:false,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:CA_CRT_PATH,Value:/etc/pki/tls/certs/tigera-ca-bundle.crt,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:tigera-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:tigera-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/cert.pem,SubPath:ca-bundle.crt,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-bt2d5,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/usr/bin/check-status -l],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:10,TimeoutSeconds:10,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:6,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/usr/bin/check-status -r],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:10,PeriodSeconds:30,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*999,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-kube-controllers-7cc5d59f7b-q89cg_calico-system(52f757de-0e18-4b03-af0a-9737e167b914): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" logger="UnhandledError" Nov 8 00:07:49.294131 containerd[2009]: time="2025-11-08T00:07:49.293979841Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/goldmane:v3.30.4\"" Nov 8 00:07:49.295353 kubelet[3341]: E1108 00:07:49.295203 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-kube-controllers\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found\"" pod="calico-system/calico-kube-controllers-7cc5d59f7b-q89cg" podUID="52f757de-0e18-4b03-af0a-9737e167b914" Nov 8 00:07:49.379591 sshd[5964]: Accepted publickey for core from 139.178.89.65 port 44632 ssh2: RSA SHA256:tnEXpnDY8gLTej7GJ+T99WI4otIwvlI9IcMNDF42aqw Nov 8 00:07:49.383132 sshd[5964]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 8 00:07:49.399387 systemd-logind[1991]: New session 23 of user core. Nov 8 00:07:49.407597 systemd[1]: Started session-23.scope - Session 23 of User core. Nov 8 00:07:49.580691 containerd[2009]: time="2025-11-08T00:07:49.579831135Z" level=info msg="trying next host - response was http.StatusNotFound" host=ghcr.io Nov 8 00:07:49.582240 containerd[2009]: time="2025-11-08T00:07:49.582156435Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/goldmane:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" Nov 8 00:07:49.582572 containerd[2009]: time="2025-11-08T00:07:49.582339987Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/goldmane:v3.30.4: active requests=0, bytes read=77" Nov 8 00:07:49.583141 kubelet[3341]: E1108 00:07:49.582763 3341 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" image="ghcr.io/flatcar/calico/goldmane:v3.30.4" Nov 8 00:07:49.583141 kubelet[3341]: E1108 00:07:49.582834 3341 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" image="ghcr.io/flatcar/calico/goldmane:v3.30.4" Nov 8 00:07:49.583141 kubelet[3341]: E1108 00:07:49.583045 3341 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:goldmane,Image:ghcr.io/flatcar/calico/goldmane:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:INFO,ValueFrom:nil,},EnvVar{Name:PORT,Value:7443,ValueFrom:nil,},EnvVar{Name:SERVER_CERT_PATH,Value:/goldmane-key-pair/tls.crt,ValueFrom:nil,},EnvVar{Name:SERVER_KEY_PATH,Value:/goldmane-key-pair/tls.key,ValueFrom:nil,},EnvVar{Name:CA_CERT_PATH,Value:/etc/pki/tls/certs/tigera-ca-bundle.crt,ValueFrom:nil,},EnvVar{Name:PUSH_URL,Value:https://guardian.calico-system.svc.cluster.local:443/api/v1/flows/bulk,ValueFrom:nil,},EnvVar{Name:FILE_CONFIG_PATH,Value:/config/config.json,ValueFrom:nil,},EnvVar{Name:HEALTH_ENABLED,Value:true,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:config,ReadOnly:true,MountPath:/config,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:goldmane-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:goldmane-key-pair,ReadOnly:true,MountPath:/goldmane-key-pair,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-jv6zv,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/health -live],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/health -ready],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:30,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod goldmane-666569f655-qlmhx_calico-system(ac78d516-6696-4a76-a1b8-01b7e90766d4): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" logger="UnhandledError" Nov 8 00:07:49.585366 kubelet[3341]: E1108 00:07:49.585253 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"goldmane\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found\"" pod="calico-system/goldmane-666569f655-qlmhx" podUID="ac78d516-6696-4a76-a1b8-01b7e90766d4" Nov 8 00:07:49.657657 containerd[2009]: time="2025-11-08T00:07:49.657491931Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/csi:v3.30.4\"" Nov 8 00:07:49.675175 sshd[5964]: pam_unix(sshd:session): session closed for user core Nov 8 00:07:49.693175 systemd[1]: sshd@22-172.31.23.87:22-139.178.89.65:44632.service: Deactivated successfully. Nov 8 00:07:49.702627 systemd[1]: session-23.scope: Deactivated successfully. Nov 8 00:07:49.706918 systemd-logind[1991]: Session 23 logged out. Waiting for processes to exit. Nov 8 00:07:49.711476 systemd-logind[1991]: Removed session 23. Nov 8 00:07:49.989650 containerd[2009]: time="2025-11-08T00:07:49.989564093Z" level=info msg="trying next host - response was http.StatusNotFound" host=ghcr.io Nov 8 00:07:49.991762 containerd[2009]: time="2025-11-08T00:07:49.991687025Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/csi:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" Nov 8 00:07:49.991897 containerd[2009]: time="2025-11-08T00:07:49.991851485Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/csi:v3.30.4: active requests=0, bytes read=69" Nov 8 00:07:49.992182 kubelet[3341]: E1108 00:07:49.992112 3341 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" image="ghcr.io/flatcar/calico/csi:v3.30.4" Nov 8 00:07:49.992796 kubelet[3341]: E1108 00:07:49.992184 3341 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" image="ghcr.io/flatcar/calico/csi:v3.30.4" Nov 8 00:07:49.992796 kubelet[3341]: E1108 00:07:49.992542 3341 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:calico-csi,Image:ghcr.io/flatcar/calico/csi:v3.30.4,Command:[],Args:[--nodeid=$(KUBE_NODE_NAME) --loglevel=$(LOG_LEVEL)],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:warn,ValueFrom:nil,},EnvVar{Name:KUBE_NODE_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:spec.nodeName,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kubelet-dir,ReadOnly:false,MountPath:/var/lib/kubelet,SubPath:,MountPropagation:*Bidirectional,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:socket-dir,ReadOnly:false,MountPath:/csi,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:varrun,ReadOnly:false,MountPath:/var/run,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-cmvgp,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*true,SELinuxOptions:nil,RunAsUser:*0,RunAsNonRoot:*false,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*true,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod csi-node-driver-8rk2x_calico-system(0fc7336a-4c45-40ec-b634-101ce08e1be1): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" logger="UnhandledError" Nov 8 00:07:49.994243 containerd[2009]: time="2025-11-08T00:07:49.994151693Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\"" Nov 8 00:07:50.277697 containerd[2009]: time="2025-11-08T00:07:50.277526630Z" level=info msg="trying next host - response was http.StatusNotFound" host=ghcr.io Nov 8 00:07:50.279876 containerd[2009]: time="2025-11-08T00:07:50.279734414Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" Nov 8 00:07:50.279876 containerd[2009]: time="2025-11-08T00:07:50.279818342Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/apiserver:v3.30.4: active requests=0, bytes read=77" Nov 8 00:07:50.280925 containerd[2009]: time="2025-11-08T00:07:50.280502030Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\"" Nov 8 00:07:50.281084 kubelet[3341]: E1108 00:07:50.280015 3341 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 8 00:07:50.281084 kubelet[3341]: E1108 00:07:50.280081 3341 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 8 00:07:50.281084 kubelet[3341]: E1108 00:07:50.280430 3341 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:calico-apiserver,Image:ghcr.io/flatcar/calico/apiserver:v3.30.4,Command:[],Args:[--secure-port=5443 --tls-private-key-file=/calico-apiserver-certs/tls.key --tls-cert-file=/calico-apiserver-certs/tls.crt],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:LOG_LEVEL,Value:info,ValueFrom:nil,},EnvVar{Name:MULTI_INTERFACE_MODE,Value:none,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:calico-apiserver-certs,ReadOnly:true,MountPath:/calico-apiserver-certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-lk46f,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 5443 },Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-apiserver-7cbbf6b44f-pntg9_calico-apiserver(886783b3-53d5-4894-8799-c2c145d125ce): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" logger="UnhandledError" Nov 8 00:07:50.282521 kubelet[3341]: E1108 00:07:50.282186 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-7cbbf6b44f-pntg9" podUID="886783b3-53d5-4894-8799-c2c145d125ce" Nov 8 00:07:50.679415 containerd[2009]: time="2025-11-08T00:07:50.678641296Z" level=info msg="trying next host - response was http.StatusNotFound" host=ghcr.io Nov 8 00:07:50.681198 containerd[2009]: time="2025-11-08T00:07:50.681097288Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" Nov 8 00:07:50.681371 containerd[2009]: time="2025-11-08T00:07:50.681166696Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: active requests=0, bytes read=93" Nov 8 00:07:50.682322 kubelet[3341]: E1108 00:07:50.681644 3341 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" image="ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4" Nov 8 00:07:50.682322 kubelet[3341]: E1108 00:07:50.681708 3341 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" image="ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4" Nov 8 00:07:50.682322 kubelet[3341]: E1108 00:07:50.681867 3341 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:csi-node-driver-registrar,Image:ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4,Command:[],Args:[--v=5 --csi-address=$(ADDRESS) --kubelet-registration-path=$(DRIVER_REG_SOCK_PATH)],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:ADDRESS,Value:/csi/csi.sock,ValueFrom:nil,},EnvVar{Name:DRIVER_REG_SOCK_PATH,Value:/var/lib/kubelet/plugins/csi.tigera.io/csi.sock,ValueFrom:nil,},EnvVar{Name:KUBE_NODE_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:spec.nodeName,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:registration-dir,ReadOnly:false,MountPath:/registration,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:socket-dir,ReadOnly:false,MountPath:/csi,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-cmvgp,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*true,SELinuxOptions:nil,RunAsUser:*0,RunAsNonRoot:*false,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*true,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod csi-node-driver-8rk2x_calico-system(0fc7336a-4c45-40ec-b634-101ce08e1be1): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" logger="UnhandledError" Nov 8 00:07:50.683702 kubelet[3341]: E1108 00:07:50.683598 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"calico-csi\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ghcr.io/flatcar/calico/csi:v3.30.4: not found\", failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found\"]" pod="calico-system/csi-node-driver-8rk2x" podUID="0fc7336a-4c45-40ec-b634-101ce08e1be1" Nov 8 00:07:54.655093 containerd[2009]: time="2025-11-08T00:07:54.654772892Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\"" Nov 8 00:07:54.721685 systemd[1]: Started sshd@23-172.31.23.87:22-139.178.89.65:44642.service - OpenSSH per-connection server daemon (139.178.89.65:44642). Nov 8 00:07:54.910406 sshd[5985]: Accepted publickey for core from 139.178.89.65 port 44642 ssh2: RSA SHA256:tnEXpnDY8gLTej7GJ+T99WI4otIwvlI9IcMNDF42aqw Nov 8 00:07:54.913112 sshd[5985]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 8 00:07:54.921082 systemd-logind[1991]: New session 24 of user core. Nov 8 00:07:54.933587 systemd[1]: Started session-24.scope - Session 24 of User core. Nov 8 00:07:55.134362 containerd[2009]: time="2025-11-08T00:07:55.134245158Z" level=info msg="trying next host - response was http.StatusNotFound" host=ghcr.io Nov 8 00:07:55.136714 containerd[2009]: time="2025-11-08T00:07:55.136569174Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" Nov 8 00:07:55.136714 containerd[2009]: time="2025-11-08T00:07:55.136639146Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/apiserver:v3.30.4: active requests=0, bytes read=77" Nov 8 00:07:55.137072 kubelet[3341]: E1108 00:07:55.136863 3341 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 8 00:07:55.137072 kubelet[3341]: E1108 00:07:55.136930 3341 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 8 00:07:55.138039 kubelet[3341]: E1108 00:07:55.137113 3341 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:calico-apiserver,Image:ghcr.io/flatcar/calico/apiserver:v3.30.4,Command:[],Args:[--secure-port=5443 --tls-private-key-file=/calico-apiserver-certs/tls.key --tls-cert-file=/calico-apiserver-certs/tls.crt],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:LOG_LEVEL,Value:info,ValueFrom:nil,},EnvVar{Name:MULTI_INTERFACE_MODE,Value:none,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:calico-apiserver-certs,ReadOnly:true,MountPath:/calico-apiserver-certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-4kzbv,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 5443 },Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-apiserver-7cbbf6b44f-hrhmg_calico-apiserver(58f37ea9-b0c8-456a-8651-ebf3793b8679): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" logger="UnhandledError" Nov 8 00:07:55.138573 kubelet[3341]: E1108 00:07:55.138396 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-7cbbf6b44f-hrhmg" podUID="58f37ea9-b0c8-456a-8651-ebf3793b8679" Nov 8 00:07:55.182123 sshd[5985]: pam_unix(sshd:session): session closed for user core Nov 8 00:07:55.189360 systemd[1]: sshd@23-172.31.23.87:22-139.178.89.65:44642.service: Deactivated successfully. Nov 8 00:07:55.194005 systemd[1]: session-24.scope: Deactivated successfully. Nov 8 00:07:55.195685 systemd-logind[1991]: Session 24 logged out. Waiting for processes to exit. Nov 8 00:07:55.200071 systemd-logind[1991]: Removed session 24. Nov 8 00:07:57.655781 kubelet[3341]: E1108 00:07:57.655356 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"whisker\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found\", failed to \"StartContainer\" for \"whisker-backend\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found\"]" pod="calico-system/whisker-54bc667d85-4nldg" podUID="97a993f1-d70c-4bf6-ba46-4f0456d70b2e" Nov 8 00:08:00.223832 systemd[1]: Started sshd@24-172.31.23.87:22-139.178.89.65:41110.service - OpenSSH per-connection server daemon (139.178.89.65:41110). Nov 8 00:08:00.400768 sshd[6000]: Accepted publickey for core from 139.178.89.65 port 41110 ssh2: RSA SHA256:tnEXpnDY8gLTej7GJ+T99WI4otIwvlI9IcMNDF42aqw Nov 8 00:08:00.403776 sshd[6000]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 8 00:08:00.412949 systemd-logind[1991]: New session 25 of user core. Nov 8 00:08:00.418593 systemd[1]: Started session-25.scope - Session 25 of User core. Nov 8 00:08:00.654485 kubelet[3341]: E1108 00:08:00.653445 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-66cbb68f69-hrrjm" podUID="68debac0-90fa-43fc-b6a2-614e4954f14e" Nov 8 00:08:00.655165 kubelet[3341]: E1108 00:08:00.654963 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-kube-controllers\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found\"" pod="calico-system/calico-kube-controllers-7cc5d59f7b-q89cg" podUID="52f757de-0e18-4b03-af0a-9737e167b914" Nov 8 00:08:00.663809 sshd[6000]: pam_unix(sshd:session): session closed for user core Nov 8 00:08:00.672487 systemd[1]: sshd@24-172.31.23.87:22-139.178.89.65:41110.service: Deactivated successfully. Nov 8 00:08:00.680909 systemd[1]: session-25.scope: Deactivated successfully. Nov 8 00:08:00.690191 systemd-logind[1991]: Session 25 logged out. Waiting for processes to exit. Nov 8 00:08:00.695642 systemd-logind[1991]: Removed session 25. Nov 8 00:08:01.657911 kubelet[3341]: E1108 00:08:01.657812 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"calico-csi\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ghcr.io/flatcar/calico/csi:v3.30.4: not found\", failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found\"]" pod="calico-system/csi-node-driver-8rk2x" podUID="0fc7336a-4c45-40ec-b634-101ce08e1be1" Nov 8 00:08:01.729289 containerd[2009]: time="2025-11-08T00:08:01.727995399Z" level=info msg="StopPodSandbox for \"e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36\"" Nov 8 00:08:01.994287 containerd[2009]: 2025-11-08 00:08:01.899 [WARNING][6022] cni-plugin/k8s.go 604: CNI_CONTAINERID does not match WorkloadEndpoint ContainerID, don't delete WEP. ContainerID="e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36" WorkloadEndpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--23--87-k8s-calico--apiserver--7cbbf6b44f--hrhmg-eth0", GenerateName:"calico-apiserver-7cbbf6b44f-", Namespace:"calico-apiserver", SelfLink:"", UID:"58f37ea9-b0c8-456a-8651-ebf3793b8679", ResourceVersion:"1499", Generation:0, CreationTimestamp:time.Date(2025, time.November, 8, 0, 6, 24, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"apiserver":"true", "app.kubernetes.io/name":"calico-apiserver", "k8s-app":"calico-apiserver", "pod-template-hash":"7cbbf6b44f", "projectcalico.org/namespace":"calico-apiserver", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"calico-apiserver"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-23-87", ContainerID:"b495b8c272bdecc62a84e705a3b5df475b0dde6e1f7630ebb2973b43b31a92f0", Pod:"calico-apiserver-7cbbf6b44f-hrhmg", Endpoint:"eth0", ServiceAccountName:"calico-apiserver", IPNetworks:[]string{"192.168.100.72/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-apiserver", "ksa.calico-apiserver.calico-apiserver"}, InterfaceName:"cali973c4614f4d", MAC:"", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 8 00:08:01.994287 containerd[2009]: 2025-11-08 00:08:01.900 [INFO][6022] cni-plugin/k8s.go 640: Cleaning up netns ContainerID="e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36" Nov 8 00:08:01.994287 containerd[2009]: 2025-11-08 00:08:01.900 [INFO][6022] cni-plugin/dataplane_linux.go 555: CleanUpNamespace called with no netns name, ignoring. ContainerID="e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36" iface="eth0" netns="" Nov 8 00:08:01.994287 containerd[2009]: 2025-11-08 00:08:01.900 [INFO][6022] cni-plugin/k8s.go 647: Releasing IP address(es) ContainerID="e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36" Nov 8 00:08:01.994287 containerd[2009]: 2025-11-08 00:08:01.900 [INFO][6022] cni-plugin/utils.go 188: Calico CNI releasing IP address ContainerID="e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36" Nov 8 00:08:01.994287 containerd[2009]: 2025-11-08 00:08:01.965 [INFO][6029] ipam/ipam_plugin.go 436: Releasing address using handleID ContainerID="e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36" HandleID="k8s-pod-network.e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36" Workload="ip--172--31--23--87-k8s-calico--apiserver--7cbbf6b44f--hrhmg-eth0" Nov 8 00:08:01.994287 containerd[2009]: 2025-11-08 00:08:01.965 [INFO][6029] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 8 00:08:01.994287 containerd[2009]: 2025-11-08 00:08:01.965 [INFO][6029] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 8 00:08:01.994287 containerd[2009]: 2025-11-08 00:08:01.981 [WARNING][6029] ipam/ipam_plugin.go 453: Asked to release address but it doesn't exist. Ignoring ContainerID="e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36" HandleID="k8s-pod-network.e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36" Workload="ip--172--31--23--87-k8s-calico--apiserver--7cbbf6b44f--hrhmg-eth0" Nov 8 00:08:01.994287 containerd[2009]: 2025-11-08 00:08:01.981 [INFO][6029] ipam/ipam_plugin.go 464: Releasing address using workloadID ContainerID="e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36" HandleID="k8s-pod-network.e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36" Workload="ip--172--31--23--87-k8s-calico--apiserver--7cbbf6b44f--hrhmg-eth0" Nov 8 00:08:01.994287 containerd[2009]: 2025-11-08 00:08:01.985 [INFO][6029] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 8 00:08:01.994287 containerd[2009]: 2025-11-08 00:08:01.991 [INFO][6022] cni-plugin/k8s.go 653: Teardown processing complete. ContainerID="e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36" Nov 8 00:08:01.996016 containerd[2009]: time="2025-11-08T00:08:01.995147776Z" level=info msg="TearDown network for sandbox \"e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36\" successfully" Nov 8 00:08:01.996016 containerd[2009]: time="2025-11-08T00:08:01.995323840Z" level=info msg="StopPodSandbox for \"e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36\" returns successfully" Nov 8 00:08:01.996476 containerd[2009]: time="2025-11-08T00:08:01.996245032Z" level=info msg="RemovePodSandbox for \"e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36\"" Nov 8 00:08:01.996476 containerd[2009]: time="2025-11-08T00:08:01.996346168Z" level=info msg="Forcibly stopping sandbox \"e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36\"" Nov 8 00:08:02.268910 containerd[2009]: 2025-11-08 00:08:02.128 [WARNING][6043] cni-plugin/k8s.go 604: CNI_CONTAINERID does not match WorkloadEndpoint ContainerID, don't delete WEP. ContainerID="e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36" WorkloadEndpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--23--87-k8s-calico--apiserver--7cbbf6b44f--hrhmg-eth0", GenerateName:"calico-apiserver-7cbbf6b44f-", Namespace:"calico-apiserver", SelfLink:"", UID:"58f37ea9-b0c8-456a-8651-ebf3793b8679", ResourceVersion:"1499", Generation:0, CreationTimestamp:time.Date(2025, time.November, 8, 0, 6, 24, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"apiserver":"true", "app.kubernetes.io/name":"calico-apiserver", "k8s-app":"calico-apiserver", "pod-template-hash":"7cbbf6b44f", "projectcalico.org/namespace":"calico-apiserver", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"calico-apiserver"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-23-87", ContainerID:"b495b8c272bdecc62a84e705a3b5df475b0dde6e1f7630ebb2973b43b31a92f0", Pod:"calico-apiserver-7cbbf6b44f-hrhmg", Endpoint:"eth0", ServiceAccountName:"calico-apiserver", IPNetworks:[]string{"192.168.100.72/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-apiserver", "ksa.calico-apiserver.calico-apiserver"}, InterfaceName:"cali973c4614f4d", MAC:"", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 8 00:08:02.268910 containerd[2009]: 2025-11-08 00:08:02.129 [INFO][6043] cni-plugin/k8s.go 640: Cleaning up netns ContainerID="e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36" Nov 8 00:08:02.268910 containerd[2009]: 2025-11-08 00:08:02.129 [INFO][6043] cni-plugin/dataplane_linux.go 555: CleanUpNamespace called with no netns name, ignoring. ContainerID="e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36" iface="eth0" netns="" Nov 8 00:08:02.268910 containerd[2009]: 2025-11-08 00:08:02.129 [INFO][6043] cni-plugin/k8s.go 647: Releasing IP address(es) ContainerID="e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36" Nov 8 00:08:02.268910 containerd[2009]: 2025-11-08 00:08:02.129 [INFO][6043] cni-plugin/utils.go 188: Calico CNI releasing IP address ContainerID="e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36" Nov 8 00:08:02.268910 containerd[2009]: 2025-11-08 00:08:02.203 [INFO][6050] ipam/ipam_plugin.go 436: Releasing address using handleID ContainerID="e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36" HandleID="k8s-pod-network.e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36" Workload="ip--172--31--23--87-k8s-calico--apiserver--7cbbf6b44f--hrhmg-eth0" Nov 8 00:08:02.268910 containerd[2009]: 2025-11-08 00:08:02.205 [INFO][6050] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 8 00:08:02.268910 containerd[2009]: 2025-11-08 00:08:02.206 [INFO][6050] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 8 00:08:02.268910 containerd[2009]: 2025-11-08 00:08:02.238 [WARNING][6050] ipam/ipam_plugin.go 453: Asked to release address but it doesn't exist. Ignoring ContainerID="e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36" HandleID="k8s-pod-network.e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36" Workload="ip--172--31--23--87-k8s-calico--apiserver--7cbbf6b44f--hrhmg-eth0" Nov 8 00:08:02.268910 containerd[2009]: 2025-11-08 00:08:02.238 [INFO][6050] ipam/ipam_plugin.go 464: Releasing address using workloadID ContainerID="e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36" HandleID="k8s-pod-network.e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36" Workload="ip--172--31--23--87-k8s-calico--apiserver--7cbbf6b44f--hrhmg-eth0" Nov 8 00:08:02.268910 containerd[2009]: 2025-11-08 00:08:02.260 [INFO][6050] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 8 00:08:02.268910 containerd[2009]: 2025-11-08 00:08:02.265 [INFO][6043] cni-plugin/k8s.go 653: Teardown processing complete. ContainerID="e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36" Nov 8 00:08:02.268910 containerd[2009]: time="2025-11-08T00:08:02.268858514Z" level=info msg="TearDown network for sandbox \"e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36\" successfully" Nov 8 00:08:02.279014 containerd[2009]: time="2025-11-08T00:08:02.278906174Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Nov 8 00:08:02.279014 containerd[2009]: time="2025-11-08T00:08:02.279012710Z" level=info msg="RemovePodSandbox \"e223a8e6560a184e883cbccb32519a2ec14802a29625fa97f1615b28a4e5cd36\" returns successfully" Nov 8 00:08:02.280122 containerd[2009]: time="2025-11-08T00:08:02.279958106Z" level=info msg="StopPodSandbox for \"915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e\"" Nov 8 00:08:02.494770 containerd[2009]: 2025-11-08 00:08:02.410 [WARNING][6064] cni-plugin/k8s.go 604: CNI_CONTAINERID does not match WorkloadEndpoint ContainerID, don't delete WEP. ContainerID="915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e" WorkloadEndpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--23--87-k8s-calico--apiserver--7cbbf6b44f--pntg9-eth0", GenerateName:"calico-apiserver-7cbbf6b44f-", Namespace:"calico-apiserver", SelfLink:"", UID:"886783b3-53d5-4894-8799-c2c145d125ce", ResourceVersion:"1475", Generation:0, CreationTimestamp:time.Date(2025, time.November, 8, 0, 6, 24, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"apiserver":"true", "app.kubernetes.io/name":"calico-apiserver", "k8s-app":"calico-apiserver", "pod-template-hash":"7cbbf6b44f", "projectcalico.org/namespace":"calico-apiserver", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"calico-apiserver"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-23-87", ContainerID:"ed0535b0c92fce55fb7ea3b605c72b93bd7e051f2a56ff73a33359bd349a5f4f", Pod:"calico-apiserver-7cbbf6b44f-pntg9", Endpoint:"eth0", ServiceAccountName:"calico-apiserver", IPNetworks:[]string{"192.168.100.70/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-apiserver", "ksa.calico-apiserver.calico-apiserver"}, InterfaceName:"cali06a7791c2eb", MAC:"", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 8 00:08:02.494770 containerd[2009]: 2025-11-08 00:08:02.411 [INFO][6064] cni-plugin/k8s.go 640: Cleaning up netns ContainerID="915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e" Nov 8 00:08:02.494770 containerd[2009]: 2025-11-08 00:08:02.411 [INFO][6064] cni-plugin/dataplane_linux.go 555: CleanUpNamespace called with no netns name, ignoring. ContainerID="915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e" iface="eth0" netns="" Nov 8 00:08:02.494770 containerd[2009]: 2025-11-08 00:08:02.411 [INFO][6064] cni-plugin/k8s.go 647: Releasing IP address(es) ContainerID="915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e" Nov 8 00:08:02.494770 containerd[2009]: 2025-11-08 00:08:02.411 [INFO][6064] cni-plugin/utils.go 188: Calico CNI releasing IP address ContainerID="915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e" Nov 8 00:08:02.494770 containerd[2009]: 2025-11-08 00:08:02.461 [INFO][6071] ipam/ipam_plugin.go 436: Releasing address using handleID ContainerID="915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e" HandleID="k8s-pod-network.915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e" Workload="ip--172--31--23--87-k8s-calico--apiserver--7cbbf6b44f--pntg9-eth0" Nov 8 00:08:02.494770 containerd[2009]: 2025-11-08 00:08:02.461 [INFO][6071] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 8 00:08:02.494770 containerd[2009]: 2025-11-08 00:08:02.461 [INFO][6071] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 8 00:08:02.494770 containerd[2009]: 2025-11-08 00:08:02.484 [WARNING][6071] ipam/ipam_plugin.go 453: Asked to release address but it doesn't exist. Ignoring ContainerID="915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e" HandleID="k8s-pod-network.915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e" Workload="ip--172--31--23--87-k8s-calico--apiserver--7cbbf6b44f--pntg9-eth0" Nov 8 00:08:02.494770 containerd[2009]: 2025-11-08 00:08:02.484 [INFO][6071] ipam/ipam_plugin.go 464: Releasing address using workloadID ContainerID="915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e" HandleID="k8s-pod-network.915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e" Workload="ip--172--31--23--87-k8s-calico--apiserver--7cbbf6b44f--pntg9-eth0" Nov 8 00:08:02.494770 containerd[2009]: 2025-11-08 00:08:02.486 [INFO][6071] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 8 00:08:02.494770 containerd[2009]: 2025-11-08 00:08:02.489 [INFO][6064] cni-plugin/k8s.go 653: Teardown processing complete. ContainerID="915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e" Nov 8 00:08:02.494770 containerd[2009]: time="2025-11-08T00:08:02.494597319Z" level=info msg="TearDown network for sandbox \"915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e\" successfully" Nov 8 00:08:02.494770 containerd[2009]: time="2025-11-08T00:08:02.494641251Z" level=info msg="StopPodSandbox for \"915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e\" returns successfully" Nov 8 00:08:02.499601 containerd[2009]: time="2025-11-08T00:08:02.497949087Z" level=info msg="RemovePodSandbox for \"915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e\"" Nov 8 00:08:02.499601 containerd[2009]: time="2025-11-08T00:08:02.498843279Z" level=info msg="Forcibly stopping sandbox \"915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e\"" Nov 8 00:08:02.750501 containerd[2009]: 2025-11-08 00:08:02.656 [WARNING][6085] cni-plugin/k8s.go 604: CNI_CONTAINERID does not match WorkloadEndpoint ContainerID, don't delete WEP. ContainerID="915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e" WorkloadEndpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--23--87-k8s-calico--apiserver--7cbbf6b44f--pntg9-eth0", GenerateName:"calico-apiserver-7cbbf6b44f-", Namespace:"calico-apiserver", SelfLink:"", UID:"886783b3-53d5-4894-8799-c2c145d125ce", ResourceVersion:"1475", Generation:0, CreationTimestamp:time.Date(2025, time.November, 8, 0, 6, 24, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"apiserver":"true", "app.kubernetes.io/name":"calico-apiserver", "k8s-app":"calico-apiserver", "pod-template-hash":"7cbbf6b44f", "projectcalico.org/namespace":"calico-apiserver", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"calico-apiserver"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-23-87", ContainerID:"ed0535b0c92fce55fb7ea3b605c72b93bd7e051f2a56ff73a33359bd349a5f4f", Pod:"calico-apiserver-7cbbf6b44f-pntg9", Endpoint:"eth0", ServiceAccountName:"calico-apiserver", IPNetworks:[]string{"192.168.100.70/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-apiserver", "ksa.calico-apiserver.calico-apiserver"}, InterfaceName:"cali06a7791c2eb", MAC:"", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 8 00:08:02.750501 containerd[2009]: 2025-11-08 00:08:02.657 [INFO][6085] cni-plugin/k8s.go 640: Cleaning up netns ContainerID="915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e" Nov 8 00:08:02.750501 containerd[2009]: 2025-11-08 00:08:02.657 [INFO][6085] cni-plugin/dataplane_linux.go 555: CleanUpNamespace called with no netns name, ignoring. ContainerID="915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e" iface="eth0" netns="" Nov 8 00:08:02.750501 containerd[2009]: 2025-11-08 00:08:02.657 [INFO][6085] cni-plugin/k8s.go 647: Releasing IP address(es) ContainerID="915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e" Nov 8 00:08:02.750501 containerd[2009]: 2025-11-08 00:08:02.657 [INFO][6085] cni-plugin/utils.go 188: Calico CNI releasing IP address ContainerID="915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e" Nov 8 00:08:02.750501 containerd[2009]: 2025-11-08 00:08:02.717 [INFO][6092] ipam/ipam_plugin.go 436: Releasing address using handleID ContainerID="915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e" HandleID="k8s-pod-network.915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e" Workload="ip--172--31--23--87-k8s-calico--apiserver--7cbbf6b44f--pntg9-eth0" Nov 8 00:08:02.750501 containerd[2009]: 2025-11-08 00:08:02.718 [INFO][6092] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 8 00:08:02.750501 containerd[2009]: 2025-11-08 00:08:02.718 [INFO][6092] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 8 00:08:02.750501 containerd[2009]: 2025-11-08 00:08:02.738 [WARNING][6092] ipam/ipam_plugin.go 453: Asked to release address but it doesn't exist. Ignoring ContainerID="915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e" HandleID="k8s-pod-network.915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e" Workload="ip--172--31--23--87-k8s-calico--apiserver--7cbbf6b44f--pntg9-eth0" Nov 8 00:08:02.750501 containerd[2009]: 2025-11-08 00:08:02.739 [INFO][6092] ipam/ipam_plugin.go 464: Releasing address using workloadID ContainerID="915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e" HandleID="k8s-pod-network.915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e" Workload="ip--172--31--23--87-k8s-calico--apiserver--7cbbf6b44f--pntg9-eth0" Nov 8 00:08:02.750501 containerd[2009]: 2025-11-08 00:08:02.743 [INFO][6092] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 8 00:08:02.750501 containerd[2009]: 2025-11-08 00:08:02.747 [INFO][6085] cni-plugin/k8s.go 653: Teardown processing complete. ContainerID="915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e" Nov 8 00:08:02.751998 containerd[2009]: time="2025-11-08T00:08:02.751450252Z" level=info msg="TearDown network for sandbox \"915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e\" successfully" Nov 8 00:08:02.762005 containerd[2009]: time="2025-11-08T00:08:02.761184748Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Nov 8 00:08:02.762005 containerd[2009]: time="2025-11-08T00:08:02.761369728Z" level=info msg="RemovePodSandbox \"915d8e02c0783b05c681625c3669170577c9c565e23bdc4dba464f5bdc432f7e\" returns successfully" Nov 8 00:08:02.762005 containerd[2009]: time="2025-11-08T00:08:02.761974492Z" level=info msg="StopPodSandbox for \"f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687\"" Nov 8 00:08:02.959963 containerd[2009]: 2025-11-08 00:08:02.840 [WARNING][6106] cni-plugin/k8s.go 604: CNI_CONTAINERID does not match WorkloadEndpoint ContainerID, don't delete WEP. ContainerID="f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687" WorkloadEndpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--23--87-k8s-goldmane--666569f655--qlmhx-eth0", GenerateName:"goldmane-666569f655-", Namespace:"calico-system", SelfLink:"", UID:"ac78d516-6696-4a76-a1b8-01b7e90766d4", ResourceVersion:"1455", Generation:0, CreationTimestamp:time.Date(2025, time.November, 8, 0, 6, 39, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app.kubernetes.io/name":"goldmane", "k8s-app":"goldmane", "pod-template-hash":"666569f655", "projectcalico.org/namespace":"calico-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"goldmane"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-23-87", ContainerID:"2256333f4f50475537ac6d67681d7d927670b8b13ade11a95f7c1dd1d1010379", Pod:"goldmane-666569f655-qlmhx", Endpoint:"eth0", ServiceAccountName:"goldmane", IPNetworks:[]string{"192.168.100.73/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-system", "ksa.calico-system.goldmane"}, InterfaceName:"calic7a84a49f46", MAC:"", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 8 00:08:02.959963 containerd[2009]: 2025-11-08 00:08:02.841 [INFO][6106] cni-plugin/k8s.go 640: Cleaning up netns ContainerID="f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687" Nov 8 00:08:02.959963 containerd[2009]: 2025-11-08 00:08:02.841 [INFO][6106] cni-plugin/dataplane_linux.go 555: CleanUpNamespace called with no netns name, ignoring. ContainerID="f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687" iface="eth0" netns="" Nov 8 00:08:02.959963 containerd[2009]: 2025-11-08 00:08:02.841 [INFO][6106] cni-plugin/k8s.go 647: Releasing IP address(es) ContainerID="f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687" Nov 8 00:08:02.959963 containerd[2009]: 2025-11-08 00:08:02.841 [INFO][6106] cni-plugin/utils.go 188: Calico CNI releasing IP address ContainerID="f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687" Nov 8 00:08:02.959963 containerd[2009]: 2025-11-08 00:08:02.914 [INFO][6113] ipam/ipam_plugin.go 436: Releasing address using handleID ContainerID="f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687" HandleID="k8s-pod-network.f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687" Workload="ip--172--31--23--87-k8s-goldmane--666569f655--qlmhx-eth0" Nov 8 00:08:02.959963 containerd[2009]: 2025-11-08 00:08:02.915 [INFO][6113] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 8 00:08:02.959963 containerd[2009]: 2025-11-08 00:08:02.915 [INFO][6113] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 8 00:08:02.959963 containerd[2009]: 2025-11-08 00:08:02.942 [WARNING][6113] ipam/ipam_plugin.go 453: Asked to release address but it doesn't exist. Ignoring ContainerID="f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687" HandleID="k8s-pod-network.f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687" Workload="ip--172--31--23--87-k8s-goldmane--666569f655--qlmhx-eth0" Nov 8 00:08:02.959963 containerd[2009]: 2025-11-08 00:08:02.943 [INFO][6113] ipam/ipam_plugin.go 464: Releasing address using workloadID ContainerID="f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687" HandleID="k8s-pod-network.f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687" Workload="ip--172--31--23--87-k8s-goldmane--666569f655--qlmhx-eth0" Nov 8 00:08:02.959963 containerd[2009]: 2025-11-08 00:08:02.949 [INFO][6113] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 8 00:08:02.959963 containerd[2009]: 2025-11-08 00:08:02.953 [INFO][6106] cni-plugin/k8s.go 653: Teardown processing complete. ContainerID="f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687" Nov 8 00:08:02.959963 containerd[2009]: time="2025-11-08T00:08:02.959728193Z" level=info msg="TearDown network for sandbox \"f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687\" successfully" Nov 8 00:08:02.959963 containerd[2009]: time="2025-11-08T00:08:02.959796677Z" level=info msg="StopPodSandbox for \"f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687\" returns successfully" Nov 8 00:08:02.963159 containerd[2009]: time="2025-11-08T00:08:02.961872749Z" level=info msg="RemovePodSandbox for \"f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687\"" Nov 8 00:08:02.963159 containerd[2009]: time="2025-11-08T00:08:02.961927109Z" level=info msg="Forcibly stopping sandbox \"f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687\"" Nov 8 00:08:03.176189 containerd[2009]: 2025-11-08 00:08:03.084 [WARNING][6127] cni-plugin/k8s.go 604: CNI_CONTAINERID does not match WorkloadEndpoint ContainerID, don't delete WEP. ContainerID="f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687" WorkloadEndpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--23--87-k8s-goldmane--666569f655--qlmhx-eth0", GenerateName:"goldmane-666569f655-", Namespace:"calico-system", SelfLink:"", UID:"ac78d516-6696-4a76-a1b8-01b7e90766d4", ResourceVersion:"1455", Generation:0, CreationTimestamp:time.Date(2025, time.November, 8, 0, 6, 39, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app.kubernetes.io/name":"goldmane", "k8s-app":"goldmane", "pod-template-hash":"666569f655", "projectcalico.org/namespace":"calico-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"goldmane"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-23-87", ContainerID:"2256333f4f50475537ac6d67681d7d927670b8b13ade11a95f7c1dd1d1010379", Pod:"goldmane-666569f655-qlmhx", Endpoint:"eth0", ServiceAccountName:"goldmane", IPNetworks:[]string{"192.168.100.73/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-system", "ksa.calico-system.goldmane"}, InterfaceName:"calic7a84a49f46", MAC:"", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 8 00:08:03.176189 containerd[2009]: 2025-11-08 00:08:03.085 [INFO][6127] cni-plugin/k8s.go 640: Cleaning up netns ContainerID="f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687" Nov 8 00:08:03.176189 containerd[2009]: 2025-11-08 00:08:03.085 [INFO][6127] cni-plugin/dataplane_linux.go 555: CleanUpNamespace called with no netns name, ignoring. ContainerID="f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687" iface="eth0" netns="" Nov 8 00:08:03.176189 containerd[2009]: 2025-11-08 00:08:03.085 [INFO][6127] cni-plugin/k8s.go 647: Releasing IP address(es) ContainerID="f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687" Nov 8 00:08:03.176189 containerd[2009]: 2025-11-08 00:08:03.085 [INFO][6127] cni-plugin/utils.go 188: Calico CNI releasing IP address ContainerID="f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687" Nov 8 00:08:03.176189 containerd[2009]: 2025-11-08 00:08:03.150 [INFO][6134] ipam/ipam_plugin.go 436: Releasing address using handleID ContainerID="f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687" HandleID="k8s-pod-network.f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687" Workload="ip--172--31--23--87-k8s-goldmane--666569f655--qlmhx-eth0" Nov 8 00:08:03.176189 containerd[2009]: 2025-11-08 00:08:03.150 [INFO][6134] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 8 00:08:03.176189 containerd[2009]: 2025-11-08 00:08:03.150 [INFO][6134] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 8 00:08:03.176189 containerd[2009]: 2025-11-08 00:08:03.165 [WARNING][6134] ipam/ipam_plugin.go 453: Asked to release address but it doesn't exist. Ignoring ContainerID="f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687" HandleID="k8s-pod-network.f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687" Workload="ip--172--31--23--87-k8s-goldmane--666569f655--qlmhx-eth0" Nov 8 00:08:03.176189 containerd[2009]: 2025-11-08 00:08:03.166 [INFO][6134] ipam/ipam_plugin.go 464: Releasing address using workloadID ContainerID="f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687" HandleID="k8s-pod-network.f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687" Workload="ip--172--31--23--87-k8s-goldmane--666569f655--qlmhx-eth0" Nov 8 00:08:03.176189 containerd[2009]: 2025-11-08 00:08:03.169 [INFO][6134] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 8 00:08:03.176189 containerd[2009]: 2025-11-08 00:08:03.173 [INFO][6127] cni-plugin/k8s.go 653: Teardown processing complete. ContainerID="f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687" Nov 8 00:08:03.176967 containerd[2009]: time="2025-11-08T00:08:03.176188286Z" level=info msg="TearDown network for sandbox \"f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687\" successfully" Nov 8 00:08:03.186107 containerd[2009]: time="2025-11-08T00:08:03.186012218Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Nov 8 00:08:03.187068 containerd[2009]: time="2025-11-08T00:08:03.186124298Z" level=info msg="RemovePodSandbox \"f69ccf203c50b1cea8ecf594af60406259aff76049396ca387ae73a147399687\" returns successfully" Nov 8 00:08:03.187068 containerd[2009]: time="2025-11-08T00:08:03.186748622Z" level=info msg="StopPodSandbox for \"ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c\"" Nov 8 00:08:03.444682 containerd[2009]: 2025-11-08 00:08:03.332 [WARNING][6148] cni-plugin/k8s.go 604: CNI_CONTAINERID does not match WorkloadEndpoint ContainerID, don't delete WEP. ContainerID="ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c" WorkloadEndpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--23--87-k8s-calico--apiserver--66cbb68f69--hrrjm-eth0", GenerateName:"calico-apiserver-66cbb68f69-", Namespace:"calico-apiserver", SelfLink:"", UID:"68debac0-90fa-43fc-b6a2-614e4954f14e", ResourceVersion:"1530", Generation:0, CreationTimestamp:time.Date(2025, time.November, 8, 0, 6, 34, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"apiserver":"true", "app.kubernetes.io/name":"calico-apiserver", "k8s-app":"calico-apiserver", "pod-template-hash":"66cbb68f69", "projectcalico.org/namespace":"calico-apiserver", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"calico-apiserver"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-23-87", ContainerID:"d285a3477da596cd29022982bf7f75dbea016f04079d31c7b5a2b7094d9c103e", Pod:"calico-apiserver-66cbb68f69-hrrjm", Endpoint:"eth0", ServiceAccountName:"calico-apiserver", IPNetworks:[]string{"192.168.100.68/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-apiserver", "ksa.calico-apiserver.calico-apiserver"}, InterfaceName:"cali6c23a06d65d", MAC:"", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 8 00:08:03.444682 containerd[2009]: 2025-11-08 00:08:03.334 [INFO][6148] cni-plugin/k8s.go 640: Cleaning up netns ContainerID="ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c" Nov 8 00:08:03.444682 containerd[2009]: 2025-11-08 00:08:03.334 [INFO][6148] cni-plugin/dataplane_linux.go 555: CleanUpNamespace called with no netns name, ignoring. ContainerID="ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c" iface="eth0" netns="" Nov 8 00:08:03.444682 containerd[2009]: 2025-11-08 00:08:03.334 [INFO][6148] cni-plugin/k8s.go 647: Releasing IP address(es) ContainerID="ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c" Nov 8 00:08:03.444682 containerd[2009]: 2025-11-08 00:08:03.334 [INFO][6148] cni-plugin/utils.go 188: Calico CNI releasing IP address ContainerID="ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c" Nov 8 00:08:03.444682 containerd[2009]: 2025-11-08 00:08:03.413 [INFO][6173] ipam/ipam_plugin.go 436: Releasing address using handleID ContainerID="ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c" HandleID="k8s-pod-network.ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c" Workload="ip--172--31--23--87-k8s-calico--apiserver--66cbb68f69--hrrjm-eth0" Nov 8 00:08:03.444682 containerd[2009]: 2025-11-08 00:08:03.414 [INFO][6173] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 8 00:08:03.444682 containerd[2009]: 2025-11-08 00:08:03.414 [INFO][6173] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 8 00:08:03.444682 containerd[2009]: 2025-11-08 00:08:03.430 [WARNING][6173] ipam/ipam_plugin.go 453: Asked to release address but it doesn't exist. Ignoring ContainerID="ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c" HandleID="k8s-pod-network.ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c" Workload="ip--172--31--23--87-k8s-calico--apiserver--66cbb68f69--hrrjm-eth0" Nov 8 00:08:03.444682 containerd[2009]: 2025-11-08 00:08:03.431 [INFO][6173] ipam/ipam_plugin.go 464: Releasing address using workloadID ContainerID="ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c" HandleID="k8s-pod-network.ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c" Workload="ip--172--31--23--87-k8s-calico--apiserver--66cbb68f69--hrrjm-eth0" Nov 8 00:08:03.444682 containerd[2009]: 2025-11-08 00:08:03.437 [INFO][6173] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 8 00:08:03.444682 containerd[2009]: 2025-11-08 00:08:03.440 [INFO][6148] cni-plugin/k8s.go 653: Teardown processing complete. ContainerID="ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c" Nov 8 00:08:03.449880 containerd[2009]: time="2025-11-08T00:08:03.444796456Z" level=info msg="TearDown network for sandbox \"ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c\" successfully" Nov 8 00:08:03.449880 containerd[2009]: time="2025-11-08T00:08:03.444861124Z" level=info msg="StopPodSandbox for \"ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c\" returns successfully" Nov 8 00:08:03.449880 containerd[2009]: time="2025-11-08T00:08:03.446082796Z" level=info msg="RemovePodSandbox for \"ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c\"" Nov 8 00:08:03.449880 containerd[2009]: time="2025-11-08T00:08:03.446133088Z" level=info msg="Forcibly stopping sandbox \"ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c\"" Nov 8 00:08:03.629425 containerd[2009]: 2025-11-08 00:08:03.541 [WARNING][6192] cni-plugin/k8s.go 604: CNI_CONTAINERID does not match WorkloadEndpoint ContainerID, don't delete WEP. ContainerID="ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c" WorkloadEndpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--23--87-k8s-calico--apiserver--66cbb68f69--hrrjm-eth0", GenerateName:"calico-apiserver-66cbb68f69-", Namespace:"calico-apiserver", SelfLink:"", UID:"68debac0-90fa-43fc-b6a2-614e4954f14e", ResourceVersion:"1530", Generation:0, CreationTimestamp:time.Date(2025, time.November, 8, 0, 6, 34, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"apiserver":"true", "app.kubernetes.io/name":"calico-apiserver", "k8s-app":"calico-apiserver", "pod-template-hash":"66cbb68f69", "projectcalico.org/namespace":"calico-apiserver", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"calico-apiserver"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-23-87", ContainerID:"d285a3477da596cd29022982bf7f75dbea016f04079d31c7b5a2b7094d9c103e", Pod:"calico-apiserver-66cbb68f69-hrrjm", Endpoint:"eth0", ServiceAccountName:"calico-apiserver", IPNetworks:[]string{"192.168.100.68/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-apiserver", "ksa.calico-apiserver.calico-apiserver"}, InterfaceName:"cali6c23a06d65d", MAC:"", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 8 00:08:03.629425 containerd[2009]: 2025-11-08 00:08:03.541 [INFO][6192] cni-plugin/k8s.go 640: Cleaning up netns ContainerID="ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c" Nov 8 00:08:03.629425 containerd[2009]: 2025-11-08 00:08:03.542 [INFO][6192] cni-plugin/dataplane_linux.go 555: CleanUpNamespace called with no netns name, ignoring. ContainerID="ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c" iface="eth0" netns="" Nov 8 00:08:03.629425 containerd[2009]: 2025-11-08 00:08:03.542 [INFO][6192] cni-plugin/k8s.go 647: Releasing IP address(es) ContainerID="ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c" Nov 8 00:08:03.629425 containerd[2009]: 2025-11-08 00:08:03.542 [INFO][6192] cni-plugin/utils.go 188: Calico CNI releasing IP address ContainerID="ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c" Nov 8 00:08:03.629425 containerd[2009]: 2025-11-08 00:08:03.596 [INFO][6201] ipam/ipam_plugin.go 436: Releasing address using handleID ContainerID="ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c" HandleID="k8s-pod-network.ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c" Workload="ip--172--31--23--87-k8s-calico--apiserver--66cbb68f69--hrrjm-eth0" Nov 8 00:08:03.629425 containerd[2009]: 2025-11-08 00:08:03.596 [INFO][6201] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 8 00:08:03.629425 containerd[2009]: 2025-11-08 00:08:03.597 [INFO][6201] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 8 00:08:03.629425 containerd[2009]: 2025-11-08 00:08:03.618 [WARNING][6201] ipam/ipam_plugin.go 453: Asked to release address but it doesn't exist. Ignoring ContainerID="ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c" HandleID="k8s-pod-network.ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c" Workload="ip--172--31--23--87-k8s-calico--apiserver--66cbb68f69--hrrjm-eth0" Nov 8 00:08:03.629425 containerd[2009]: 2025-11-08 00:08:03.618 [INFO][6201] ipam/ipam_plugin.go 464: Releasing address using workloadID ContainerID="ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c" HandleID="k8s-pod-network.ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c" Workload="ip--172--31--23--87-k8s-calico--apiserver--66cbb68f69--hrrjm-eth0" Nov 8 00:08:03.629425 containerd[2009]: 2025-11-08 00:08:03.621 [INFO][6201] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 8 00:08:03.629425 containerd[2009]: 2025-11-08 00:08:03.624 [INFO][6192] cni-plugin/k8s.go 653: Teardown processing complete. ContainerID="ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c" Nov 8 00:08:03.632660 containerd[2009]: time="2025-11-08T00:08:03.629484652Z" level=info msg="TearDown network for sandbox \"ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c\" successfully" Nov 8 00:08:03.641578 containerd[2009]: time="2025-11-08T00:08:03.641338385Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Nov 8 00:08:03.641745 containerd[2009]: time="2025-11-08T00:08:03.641605373Z" level=info msg="RemovePodSandbox \"ce9f60f95a0d95b486cedfad45b102a27de11d112d02c4728b655c95dc46400c\" returns successfully" Nov 8 00:08:03.642671 containerd[2009]: time="2025-11-08T00:08:03.642609497Z" level=info msg="StopPodSandbox for \"b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62\"" Nov 8 00:08:03.668616 kubelet[3341]: E1108 00:08:03.666961 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-7cbbf6b44f-pntg9" podUID="886783b3-53d5-4894-8799-c2c145d125ce" Nov 8 00:08:03.837367 containerd[2009]: 2025-11-08 00:08:03.751 [WARNING][6216] cni-plugin/k8s.go 604: CNI_CONTAINERID does not match WorkloadEndpoint ContainerID, don't delete WEP. ContainerID="b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62" WorkloadEndpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--23--87-k8s-calico--kube--controllers--7cc5d59f7b--q89cg-eth0", GenerateName:"calico-kube-controllers-7cc5d59f7b-", Namespace:"calico-system", SelfLink:"", UID:"52f757de-0e18-4b03-af0a-9737e167b914", ResourceVersion:"1533", Generation:0, CreationTimestamp:time.Date(2025, time.November, 8, 0, 6, 43, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app.kubernetes.io/name":"calico-kube-controllers", "k8s-app":"calico-kube-controllers", "pod-template-hash":"7cc5d59f7b", "projectcalico.org/namespace":"calico-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"calico-kube-controllers"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-23-87", ContainerID:"842cfc773166718f3421e73107fe9b7ea33b0da8e8d45da5f07a361451df68f6", Pod:"calico-kube-controllers-7cc5d59f7b-q89cg", Endpoint:"eth0", ServiceAccountName:"calico-kube-controllers", IPNetworks:[]string{"192.168.100.69/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-system", "ksa.calico-system.calico-kube-controllers"}, InterfaceName:"caliac986209725", MAC:"", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 8 00:08:03.837367 containerd[2009]: 2025-11-08 00:08:03.751 [INFO][6216] cni-plugin/k8s.go 640: Cleaning up netns ContainerID="b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62" Nov 8 00:08:03.837367 containerd[2009]: 2025-11-08 00:08:03.751 [INFO][6216] cni-plugin/dataplane_linux.go 555: CleanUpNamespace called with no netns name, ignoring. ContainerID="b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62" iface="eth0" netns="" Nov 8 00:08:03.837367 containerd[2009]: 2025-11-08 00:08:03.751 [INFO][6216] cni-plugin/k8s.go 647: Releasing IP address(es) ContainerID="b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62" Nov 8 00:08:03.837367 containerd[2009]: 2025-11-08 00:08:03.751 [INFO][6216] cni-plugin/utils.go 188: Calico CNI releasing IP address ContainerID="b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62" Nov 8 00:08:03.837367 containerd[2009]: 2025-11-08 00:08:03.808 [INFO][6223] ipam/ipam_plugin.go 436: Releasing address using handleID ContainerID="b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62" HandleID="k8s-pod-network.b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62" Workload="ip--172--31--23--87-k8s-calico--kube--controllers--7cc5d59f7b--q89cg-eth0" Nov 8 00:08:03.837367 containerd[2009]: 2025-11-08 00:08:03.809 [INFO][6223] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 8 00:08:03.837367 containerd[2009]: 2025-11-08 00:08:03.809 [INFO][6223] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 8 00:08:03.837367 containerd[2009]: 2025-11-08 00:08:03.828 [WARNING][6223] ipam/ipam_plugin.go 453: Asked to release address but it doesn't exist. Ignoring ContainerID="b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62" HandleID="k8s-pod-network.b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62" Workload="ip--172--31--23--87-k8s-calico--kube--controllers--7cc5d59f7b--q89cg-eth0" Nov 8 00:08:03.837367 containerd[2009]: 2025-11-08 00:08:03.828 [INFO][6223] ipam/ipam_plugin.go 464: Releasing address using workloadID ContainerID="b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62" HandleID="k8s-pod-network.b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62" Workload="ip--172--31--23--87-k8s-calico--kube--controllers--7cc5d59f7b--q89cg-eth0" Nov 8 00:08:03.837367 containerd[2009]: 2025-11-08 00:08:03.831 [INFO][6223] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 8 00:08:03.837367 containerd[2009]: 2025-11-08 00:08:03.834 [INFO][6216] cni-plugin/k8s.go 653: Teardown processing complete. ContainerID="b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62" Nov 8 00:08:03.838905 containerd[2009]: time="2025-11-08T00:08:03.837418986Z" level=info msg="TearDown network for sandbox \"b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62\" successfully" Nov 8 00:08:03.838905 containerd[2009]: time="2025-11-08T00:08:03.837456606Z" level=info msg="StopPodSandbox for \"b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62\" returns successfully" Nov 8 00:08:03.840057 containerd[2009]: time="2025-11-08T00:08:03.839560062Z" level=info msg="RemovePodSandbox for \"b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62\"" Nov 8 00:08:03.840057 containerd[2009]: time="2025-11-08T00:08:03.839620362Z" level=info msg="Forcibly stopping sandbox \"b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62\"" Nov 8 00:08:03.985256 containerd[2009]: 2025-11-08 00:08:03.914 [WARNING][6238] cni-plugin/k8s.go 604: CNI_CONTAINERID does not match WorkloadEndpoint ContainerID, don't delete WEP. ContainerID="b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62" WorkloadEndpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--23--87-k8s-calico--kube--controllers--7cc5d59f7b--q89cg-eth0", GenerateName:"calico-kube-controllers-7cc5d59f7b-", Namespace:"calico-system", SelfLink:"", UID:"52f757de-0e18-4b03-af0a-9737e167b914", ResourceVersion:"1533", Generation:0, CreationTimestamp:time.Date(2025, time.November, 8, 0, 6, 43, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app.kubernetes.io/name":"calico-kube-controllers", "k8s-app":"calico-kube-controllers", "pod-template-hash":"7cc5d59f7b", "projectcalico.org/namespace":"calico-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"calico-kube-controllers"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-23-87", ContainerID:"842cfc773166718f3421e73107fe9b7ea33b0da8e8d45da5f07a361451df68f6", Pod:"calico-kube-controllers-7cc5d59f7b-q89cg", Endpoint:"eth0", ServiceAccountName:"calico-kube-controllers", IPNetworks:[]string{"192.168.100.69/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-system", "ksa.calico-system.calico-kube-controllers"}, InterfaceName:"caliac986209725", MAC:"", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 8 00:08:03.985256 containerd[2009]: 2025-11-08 00:08:03.915 [INFO][6238] cni-plugin/k8s.go 640: Cleaning up netns ContainerID="b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62" Nov 8 00:08:03.985256 containerd[2009]: 2025-11-08 00:08:03.915 [INFO][6238] cni-plugin/dataplane_linux.go 555: CleanUpNamespace called with no netns name, ignoring. ContainerID="b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62" iface="eth0" netns="" Nov 8 00:08:03.985256 containerd[2009]: 2025-11-08 00:08:03.915 [INFO][6238] cni-plugin/k8s.go 647: Releasing IP address(es) ContainerID="b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62" Nov 8 00:08:03.985256 containerd[2009]: 2025-11-08 00:08:03.915 [INFO][6238] cni-plugin/utils.go 188: Calico CNI releasing IP address ContainerID="b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62" Nov 8 00:08:03.985256 containerd[2009]: 2025-11-08 00:08:03.960 [INFO][6246] ipam/ipam_plugin.go 436: Releasing address using handleID ContainerID="b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62" HandleID="k8s-pod-network.b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62" Workload="ip--172--31--23--87-k8s-calico--kube--controllers--7cc5d59f7b--q89cg-eth0" Nov 8 00:08:03.985256 containerd[2009]: 2025-11-08 00:08:03.961 [INFO][6246] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 8 00:08:03.985256 containerd[2009]: 2025-11-08 00:08:03.961 [INFO][6246] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 8 00:08:03.985256 containerd[2009]: 2025-11-08 00:08:03.975 [WARNING][6246] ipam/ipam_plugin.go 453: Asked to release address but it doesn't exist. Ignoring ContainerID="b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62" HandleID="k8s-pod-network.b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62" Workload="ip--172--31--23--87-k8s-calico--kube--controllers--7cc5d59f7b--q89cg-eth0" Nov 8 00:08:03.985256 containerd[2009]: 2025-11-08 00:08:03.975 [INFO][6246] ipam/ipam_plugin.go 464: Releasing address using workloadID ContainerID="b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62" HandleID="k8s-pod-network.b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62" Workload="ip--172--31--23--87-k8s-calico--kube--controllers--7cc5d59f7b--q89cg-eth0" Nov 8 00:08:03.985256 containerd[2009]: 2025-11-08 00:08:03.978 [INFO][6246] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 8 00:08:03.985256 containerd[2009]: 2025-11-08 00:08:03.981 [INFO][6238] cni-plugin/k8s.go 653: Teardown processing complete. ContainerID="b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62" Nov 8 00:08:03.985256 containerd[2009]: time="2025-11-08T00:08:03.985129746Z" level=info msg="TearDown network for sandbox \"b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62\" successfully" Nov 8 00:08:03.993576 containerd[2009]: time="2025-11-08T00:08:03.992924574Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Nov 8 00:08:03.993576 containerd[2009]: time="2025-11-08T00:08:03.993071682Z" level=info msg="RemovePodSandbox \"b7631b249ed24d8f9596a79f4b7d6694ee912bac71e71b778d317008fda03e62\" returns successfully" Nov 8 00:08:03.994355 containerd[2009]: time="2025-11-08T00:08:03.994115658Z" level=info msg="StopPodSandbox for \"aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9\"" Nov 8 00:08:04.232395 containerd[2009]: 2025-11-08 00:08:04.115 [WARNING][6260] cni-plugin/k8s.go 604: CNI_CONTAINERID does not match WorkloadEndpoint ContainerID, don't delete WEP. ContainerID="aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9" WorkloadEndpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--23--87-k8s-coredns--668d6bf9bc--zwgsx-eth0", GenerateName:"coredns-668d6bf9bc-", Namespace:"kube-system", SelfLink:"", UID:"fa5174bf-24f6-40b6-a1a8-03b883265a37", ResourceVersion:"1099", Generation:0, CreationTimestamp:time.Date(2025, time.November, 8, 0, 6, 7, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-dns", "pod-template-hash":"668d6bf9bc", "projectcalico.org/namespace":"kube-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"coredns"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-23-87", ContainerID:"cd1f1ee3125b98b96075edbdc8a8f90593b4e48bd20cdb31b75204c77de0c4ff", Pod:"coredns-668d6bf9bc-zwgsx", Endpoint:"eth0", ServiceAccountName:"coredns", IPNetworks:[]string{"192.168.100.67/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.kube-system", "ksa.kube-system.coredns"}, InterfaceName:"calibca3b76f5bd", MAC:"", Ports:[]v3.WorkloadEndpointPort{v3.WorkloadEndpointPort{Name:"dns", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"UDP"}, Port:0x35, HostPort:0x0, HostIP:""}, v3.WorkloadEndpointPort{Name:"dns-tcp", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"TCP"}, Port:0x35, HostPort:0x0, HostIP:""}, v3.WorkloadEndpointPort{Name:"metrics", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"TCP"}, Port:0x23c1, HostPort:0x0, HostIP:""}}, AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 8 00:08:04.232395 containerd[2009]: 2025-11-08 00:08:04.115 [INFO][6260] cni-plugin/k8s.go 640: Cleaning up netns ContainerID="aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9" Nov 8 00:08:04.232395 containerd[2009]: 2025-11-08 00:08:04.116 [INFO][6260] cni-plugin/dataplane_linux.go 555: CleanUpNamespace called with no netns name, ignoring. ContainerID="aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9" iface="eth0" netns="" Nov 8 00:08:04.232395 containerd[2009]: 2025-11-08 00:08:04.116 [INFO][6260] cni-plugin/k8s.go 647: Releasing IP address(es) ContainerID="aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9" Nov 8 00:08:04.232395 containerd[2009]: 2025-11-08 00:08:04.116 [INFO][6260] cni-plugin/utils.go 188: Calico CNI releasing IP address ContainerID="aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9" Nov 8 00:08:04.232395 containerd[2009]: 2025-11-08 00:08:04.187 [INFO][6267] ipam/ipam_plugin.go 436: Releasing address using handleID ContainerID="aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9" HandleID="k8s-pod-network.aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9" Workload="ip--172--31--23--87-k8s-coredns--668d6bf9bc--zwgsx-eth0" Nov 8 00:08:04.232395 containerd[2009]: 2025-11-08 00:08:04.187 [INFO][6267] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 8 00:08:04.232395 containerd[2009]: 2025-11-08 00:08:04.187 [INFO][6267] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 8 00:08:04.232395 containerd[2009]: 2025-11-08 00:08:04.215 [WARNING][6267] ipam/ipam_plugin.go 453: Asked to release address but it doesn't exist. Ignoring ContainerID="aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9" HandleID="k8s-pod-network.aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9" Workload="ip--172--31--23--87-k8s-coredns--668d6bf9bc--zwgsx-eth0" Nov 8 00:08:04.232395 containerd[2009]: 2025-11-08 00:08:04.215 [INFO][6267] ipam/ipam_plugin.go 464: Releasing address using workloadID ContainerID="aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9" HandleID="k8s-pod-network.aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9" Workload="ip--172--31--23--87-k8s-coredns--668d6bf9bc--zwgsx-eth0" Nov 8 00:08:04.232395 containerd[2009]: 2025-11-08 00:08:04.220 [INFO][6267] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 8 00:08:04.232395 containerd[2009]: 2025-11-08 00:08:04.223 [INFO][6260] cni-plugin/k8s.go 653: Teardown processing complete. ContainerID="aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9" Nov 8 00:08:04.236031 containerd[2009]: time="2025-11-08T00:08:04.232434051Z" level=info msg="TearDown network for sandbox \"aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9\" successfully" Nov 8 00:08:04.236031 containerd[2009]: time="2025-11-08T00:08:04.232473795Z" level=info msg="StopPodSandbox for \"aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9\" returns successfully" Nov 8 00:08:04.243514 containerd[2009]: time="2025-11-08T00:08:04.242091256Z" level=info msg="RemovePodSandbox for \"aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9\"" Nov 8 00:08:04.243514 containerd[2009]: time="2025-11-08T00:08:04.242190952Z" level=info msg="Forcibly stopping sandbox \"aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9\"" Nov 8 00:08:04.403625 containerd[2009]: 2025-11-08 00:08:04.332 [WARNING][6281] cni-plugin/k8s.go 604: CNI_CONTAINERID does not match WorkloadEndpoint ContainerID, don't delete WEP. ContainerID="aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9" WorkloadEndpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--23--87-k8s-coredns--668d6bf9bc--zwgsx-eth0", GenerateName:"coredns-668d6bf9bc-", Namespace:"kube-system", SelfLink:"", UID:"fa5174bf-24f6-40b6-a1a8-03b883265a37", ResourceVersion:"1099", Generation:0, CreationTimestamp:time.Date(2025, time.November, 8, 0, 6, 7, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-dns", "pod-template-hash":"668d6bf9bc", "projectcalico.org/namespace":"kube-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"coredns"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-23-87", ContainerID:"cd1f1ee3125b98b96075edbdc8a8f90593b4e48bd20cdb31b75204c77de0c4ff", Pod:"coredns-668d6bf9bc-zwgsx", Endpoint:"eth0", ServiceAccountName:"coredns", IPNetworks:[]string{"192.168.100.67/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.kube-system", "ksa.kube-system.coredns"}, InterfaceName:"calibca3b76f5bd", MAC:"", Ports:[]v3.WorkloadEndpointPort{v3.WorkloadEndpointPort{Name:"dns", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"UDP"}, Port:0x35, HostPort:0x0, HostIP:""}, v3.WorkloadEndpointPort{Name:"dns-tcp", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"TCP"}, Port:0x35, HostPort:0x0, HostIP:""}, v3.WorkloadEndpointPort{Name:"metrics", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"TCP"}, Port:0x23c1, HostPort:0x0, HostIP:""}}, AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 8 00:08:04.403625 containerd[2009]: 2025-11-08 00:08:04.332 [INFO][6281] cni-plugin/k8s.go 640: Cleaning up netns ContainerID="aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9" Nov 8 00:08:04.403625 containerd[2009]: 2025-11-08 00:08:04.333 [INFO][6281] cni-plugin/dataplane_linux.go 555: CleanUpNamespace called with no netns name, ignoring. ContainerID="aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9" iface="eth0" netns="" Nov 8 00:08:04.403625 containerd[2009]: 2025-11-08 00:08:04.333 [INFO][6281] cni-plugin/k8s.go 647: Releasing IP address(es) ContainerID="aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9" Nov 8 00:08:04.403625 containerd[2009]: 2025-11-08 00:08:04.333 [INFO][6281] cni-plugin/utils.go 188: Calico CNI releasing IP address ContainerID="aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9" Nov 8 00:08:04.403625 containerd[2009]: 2025-11-08 00:08:04.379 [INFO][6288] ipam/ipam_plugin.go 436: Releasing address using handleID ContainerID="aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9" HandleID="k8s-pod-network.aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9" Workload="ip--172--31--23--87-k8s-coredns--668d6bf9bc--zwgsx-eth0" Nov 8 00:08:04.403625 containerd[2009]: 2025-11-08 00:08:04.380 [INFO][6288] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 8 00:08:04.403625 containerd[2009]: 2025-11-08 00:08:04.380 [INFO][6288] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 8 00:08:04.403625 containerd[2009]: 2025-11-08 00:08:04.394 [WARNING][6288] ipam/ipam_plugin.go 453: Asked to release address but it doesn't exist. Ignoring ContainerID="aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9" HandleID="k8s-pod-network.aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9" Workload="ip--172--31--23--87-k8s-coredns--668d6bf9bc--zwgsx-eth0" Nov 8 00:08:04.403625 containerd[2009]: 2025-11-08 00:08:04.394 [INFO][6288] ipam/ipam_plugin.go 464: Releasing address using workloadID ContainerID="aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9" HandleID="k8s-pod-network.aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9" Workload="ip--172--31--23--87-k8s-coredns--668d6bf9bc--zwgsx-eth0" Nov 8 00:08:04.403625 containerd[2009]: 2025-11-08 00:08:04.397 [INFO][6288] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 8 00:08:04.403625 containerd[2009]: 2025-11-08 00:08:04.400 [INFO][6281] cni-plugin/k8s.go 653: Teardown processing complete. ContainerID="aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9" Nov 8 00:08:04.405489 containerd[2009]: time="2025-11-08T00:08:04.404649868Z" level=info msg="TearDown network for sandbox \"aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9\" successfully" Nov 8 00:08:04.413480 containerd[2009]: time="2025-11-08T00:08:04.413417332Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Nov 8 00:08:04.413856 containerd[2009]: time="2025-11-08T00:08:04.413695408Z" level=info msg="RemovePodSandbox \"aeabe156136e3a36f5804335e7efaad6e466e784ba8ea59439da58b2281ebfd9\" returns successfully" Nov 8 00:08:04.415539 containerd[2009]: time="2025-11-08T00:08:04.415434856Z" level=info msg="StopPodSandbox for \"d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de\"" Nov 8 00:08:04.578685 containerd[2009]: 2025-11-08 00:08:04.494 [WARNING][6303] cni-plugin/k8s.go 604: CNI_CONTAINERID does not match WorkloadEndpoint ContainerID, don't delete WEP. ContainerID="d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de" WorkloadEndpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--23--87-k8s-csi--node--driver--8rk2x-eth0", GenerateName:"csi-node-driver-", Namespace:"calico-system", SelfLink:"", UID:"0fc7336a-4c45-40ec-b634-101ce08e1be1", ResourceVersion:"1540", Generation:0, CreationTimestamp:time.Date(2025, time.November, 8, 0, 6, 43, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app.kubernetes.io/name":"csi-node-driver", "controller-revision-hash":"857b56db8f", "k8s-app":"csi-node-driver", "name":"csi-node-driver", "pod-template-generation":"1", "projectcalico.org/namespace":"calico-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"csi-node-driver"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-23-87", ContainerID:"e151133aaab94f5f99fe70265cd45b9c31389ada8426216d662f2523a4a3ecb6", Pod:"csi-node-driver-8rk2x", Endpoint:"eth0", ServiceAccountName:"csi-node-driver", IPNetworks:[]string{"192.168.100.66/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-system", "ksa.calico-system.csi-node-driver"}, InterfaceName:"cali39e176a42dc", MAC:"", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 8 00:08:04.578685 containerd[2009]: 2025-11-08 00:08:04.496 [INFO][6303] cni-plugin/k8s.go 640: Cleaning up netns ContainerID="d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de" Nov 8 00:08:04.578685 containerd[2009]: 2025-11-08 00:08:04.496 [INFO][6303] cni-plugin/dataplane_linux.go 555: CleanUpNamespace called with no netns name, ignoring. ContainerID="d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de" iface="eth0" netns="" Nov 8 00:08:04.578685 containerd[2009]: 2025-11-08 00:08:04.496 [INFO][6303] cni-plugin/k8s.go 647: Releasing IP address(es) ContainerID="d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de" Nov 8 00:08:04.578685 containerd[2009]: 2025-11-08 00:08:04.496 [INFO][6303] cni-plugin/utils.go 188: Calico CNI releasing IP address ContainerID="d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de" Nov 8 00:08:04.578685 containerd[2009]: 2025-11-08 00:08:04.549 [INFO][6311] ipam/ipam_plugin.go 436: Releasing address using handleID ContainerID="d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de" HandleID="k8s-pod-network.d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de" Workload="ip--172--31--23--87-k8s-csi--node--driver--8rk2x-eth0" Nov 8 00:08:04.578685 containerd[2009]: 2025-11-08 00:08:04.549 [INFO][6311] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 8 00:08:04.578685 containerd[2009]: 2025-11-08 00:08:04.549 [INFO][6311] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 8 00:08:04.578685 containerd[2009]: 2025-11-08 00:08:04.566 [WARNING][6311] ipam/ipam_plugin.go 453: Asked to release address but it doesn't exist. Ignoring ContainerID="d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de" HandleID="k8s-pod-network.d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de" Workload="ip--172--31--23--87-k8s-csi--node--driver--8rk2x-eth0" Nov 8 00:08:04.578685 containerd[2009]: 2025-11-08 00:08:04.566 [INFO][6311] ipam/ipam_plugin.go 464: Releasing address using workloadID ContainerID="d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de" HandleID="k8s-pod-network.d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de" Workload="ip--172--31--23--87-k8s-csi--node--driver--8rk2x-eth0" Nov 8 00:08:04.578685 containerd[2009]: 2025-11-08 00:08:04.569 [INFO][6311] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 8 00:08:04.578685 containerd[2009]: 2025-11-08 00:08:04.574 [INFO][6303] cni-plugin/k8s.go 653: Teardown processing complete. ContainerID="d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de" Nov 8 00:08:04.578685 containerd[2009]: time="2025-11-08T00:08:04.578616029Z" level=info msg="TearDown network for sandbox \"d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de\" successfully" Nov 8 00:08:04.585438 containerd[2009]: time="2025-11-08T00:08:04.578655329Z" level=info msg="StopPodSandbox for \"d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de\" returns successfully" Nov 8 00:08:04.585438 containerd[2009]: time="2025-11-08T00:08:04.581177117Z" level=info msg="RemovePodSandbox for \"d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de\"" Nov 8 00:08:04.585438 containerd[2009]: time="2025-11-08T00:08:04.581228141Z" level=info msg="Forcibly stopping sandbox \"d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de\"" Nov 8 00:08:04.655662 kubelet[3341]: E1108 00:08:04.655407 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"goldmane\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found\"" pod="calico-system/goldmane-666569f655-qlmhx" podUID="ac78d516-6696-4a76-a1b8-01b7e90766d4" Nov 8 00:08:04.794384 containerd[2009]: 2025-11-08 00:08:04.692 [WARNING][6325] cni-plugin/k8s.go 604: CNI_CONTAINERID does not match WorkloadEndpoint ContainerID, don't delete WEP. ContainerID="d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de" WorkloadEndpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--23--87-k8s-csi--node--driver--8rk2x-eth0", GenerateName:"csi-node-driver-", Namespace:"calico-system", SelfLink:"", UID:"0fc7336a-4c45-40ec-b634-101ce08e1be1", ResourceVersion:"1540", Generation:0, CreationTimestamp:time.Date(2025, time.November, 8, 0, 6, 43, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app.kubernetes.io/name":"csi-node-driver", "controller-revision-hash":"857b56db8f", "k8s-app":"csi-node-driver", "name":"csi-node-driver", "pod-template-generation":"1", "projectcalico.org/namespace":"calico-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"csi-node-driver"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-23-87", ContainerID:"e151133aaab94f5f99fe70265cd45b9c31389ada8426216d662f2523a4a3ecb6", Pod:"csi-node-driver-8rk2x", Endpoint:"eth0", ServiceAccountName:"csi-node-driver", IPNetworks:[]string{"192.168.100.66/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-system", "ksa.calico-system.csi-node-driver"}, InterfaceName:"cali39e176a42dc", MAC:"", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 8 00:08:04.794384 containerd[2009]: 2025-11-08 00:08:04.694 [INFO][6325] cni-plugin/k8s.go 640: Cleaning up netns ContainerID="d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de" Nov 8 00:08:04.794384 containerd[2009]: 2025-11-08 00:08:04.694 [INFO][6325] cni-plugin/dataplane_linux.go 555: CleanUpNamespace called with no netns name, ignoring. ContainerID="d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de" iface="eth0" netns="" Nov 8 00:08:04.794384 containerd[2009]: 2025-11-08 00:08:04.694 [INFO][6325] cni-plugin/k8s.go 647: Releasing IP address(es) ContainerID="d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de" Nov 8 00:08:04.794384 containerd[2009]: 2025-11-08 00:08:04.694 [INFO][6325] cni-plugin/utils.go 188: Calico CNI releasing IP address ContainerID="d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de" Nov 8 00:08:04.794384 containerd[2009]: 2025-11-08 00:08:04.752 [INFO][6332] ipam/ipam_plugin.go 436: Releasing address using handleID ContainerID="d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de" HandleID="k8s-pod-network.d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de" Workload="ip--172--31--23--87-k8s-csi--node--driver--8rk2x-eth0" Nov 8 00:08:04.794384 containerd[2009]: 2025-11-08 00:08:04.752 [INFO][6332] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 8 00:08:04.794384 containerd[2009]: 2025-11-08 00:08:04.752 [INFO][6332] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 8 00:08:04.794384 containerd[2009]: 2025-11-08 00:08:04.780 [WARNING][6332] ipam/ipam_plugin.go 453: Asked to release address but it doesn't exist. Ignoring ContainerID="d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de" HandleID="k8s-pod-network.d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de" Workload="ip--172--31--23--87-k8s-csi--node--driver--8rk2x-eth0" Nov 8 00:08:04.794384 containerd[2009]: 2025-11-08 00:08:04.780 [INFO][6332] ipam/ipam_plugin.go 464: Releasing address using workloadID ContainerID="d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de" HandleID="k8s-pod-network.d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de" Workload="ip--172--31--23--87-k8s-csi--node--driver--8rk2x-eth0" Nov 8 00:08:04.794384 containerd[2009]: 2025-11-08 00:08:04.784 [INFO][6332] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 8 00:08:04.794384 containerd[2009]: 2025-11-08 00:08:04.789 [INFO][6325] cni-plugin/k8s.go 653: Teardown processing complete. ContainerID="d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de" Nov 8 00:08:04.794384 containerd[2009]: time="2025-11-08T00:08:04.793376226Z" level=info msg="TearDown network for sandbox \"d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de\" successfully" Nov 8 00:08:04.804791 containerd[2009]: time="2025-11-08T00:08:04.803285754Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Nov 8 00:08:04.804791 containerd[2009]: time="2025-11-08T00:08:04.803390946Z" level=info msg="RemovePodSandbox \"d1f568750872de5562e0f31ee6d02c4afc34385de501a51c8daa8b90343714de\" returns successfully" Nov 8 00:08:04.805718 containerd[2009]: time="2025-11-08T00:08:04.805364370Z" level=info msg="StopPodSandbox for \"f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f\"" Nov 8 00:08:04.967218 containerd[2009]: 2025-11-08 00:08:04.888 [WARNING][6346] cni-plugin/k8s.go 598: WorkloadEndpoint does not exist in the datastore, moving forward with the clean up ContainerID="f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f" WorkloadEndpoint="ip--172--31--23--87-k8s-whisker--df89f8cd5--r2bdg-eth0" Nov 8 00:08:04.967218 containerd[2009]: 2025-11-08 00:08:04.888 [INFO][6346] cni-plugin/k8s.go 640: Cleaning up netns ContainerID="f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f" Nov 8 00:08:04.967218 containerd[2009]: 2025-11-08 00:08:04.888 [INFO][6346] cni-plugin/dataplane_linux.go 555: CleanUpNamespace called with no netns name, ignoring. ContainerID="f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f" iface="eth0" netns="" Nov 8 00:08:04.967218 containerd[2009]: 2025-11-08 00:08:04.888 [INFO][6346] cni-plugin/k8s.go 647: Releasing IP address(es) ContainerID="f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f" Nov 8 00:08:04.967218 containerd[2009]: 2025-11-08 00:08:04.888 [INFO][6346] cni-plugin/utils.go 188: Calico CNI releasing IP address ContainerID="f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f" Nov 8 00:08:04.967218 containerd[2009]: 2025-11-08 00:08:04.940 [INFO][6353] ipam/ipam_plugin.go 436: Releasing address using handleID ContainerID="f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f" HandleID="k8s-pod-network.f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f" Workload="ip--172--31--23--87-k8s-whisker--df89f8cd5--r2bdg-eth0" Nov 8 00:08:04.967218 containerd[2009]: 2025-11-08 00:08:04.940 [INFO][6353] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 8 00:08:04.967218 containerd[2009]: 2025-11-08 00:08:04.940 [INFO][6353] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 8 00:08:04.967218 containerd[2009]: 2025-11-08 00:08:04.956 [WARNING][6353] ipam/ipam_plugin.go 453: Asked to release address but it doesn't exist. Ignoring ContainerID="f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f" HandleID="k8s-pod-network.f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f" Workload="ip--172--31--23--87-k8s-whisker--df89f8cd5--r2bdg-eth0" Nov 8 00:08:04.967218 containerd[2009]: 2025-11-08 00:08:04.956 [INFO][6353] ipam/ipam_plugin.go 464: Releasing address using workloadID ContainerID="f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f" HandleID="k8s-pod-network.f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f" Workload="ip--172--31--23--87-k8s-whisker--df89f8cd5--r2bdg-eth0" Nov 8 00:08:04.967218 containerd[2009]: 2025-11-08 00:08:04.960 [INFO][6353] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 8 00:08:04.967218 containerd[2009]: 2025-11-08 00:08:04.963 [INFO][6346] cni-plugin/k8s.go 653: Teardown processing complete. ContainerID="f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f" Nov 8 00:08:04.974388 containerd[2009]: time="2025-11-08T00:08:04.970717195Z" level=info msg="TearDown network for sandbox \"f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f\" successfully" Nov 8 00:08:04.974388 containerd[2009]: time="2025-11-08T00:08:04.970788739Z" level=info msg="StopPodSandbox for \"f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f\" returns successfully" Nov 8 00:08:04.974388 containerd[2009]: time="2025-11-08T00:08:04.973164931Z" level=info msg="RemovePodSandbox for \"f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f\"" Nov 8 00:08:04.974388 containerd[2009]: time="2025-11-08T00:08:04.973217143Z" level=info msg="Forcibly stopping sandbox \"f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f\"" Nov 8 00:08:05.137577 containerd[2009]: 2025-11-08 00:08:05.061 [WARNING][6368] cni-plugin/k8s.go 598: WorkloadEndpoint does not exist in the datastore, moving forward with the clean up ContainerID="f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f" WorkloadEndpoint="ip--172--31--23--87-k8s-whisker--df89f8cd5--r2bdg-eth0" Nov 8 00:08:05.137577 containerd[2009]: 2025-11-08 00:08:05.061 [INFO][6368] cni-plugin/k8s.go 640: Cleaning up netns ContainerID="f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f" Nov 8 00:08:05.137577 containerd[2009]: 2025-11-08 00:08:05.061 [INFO][6368] cni-plugin/dataplane_linux.go 555: CleanUpNamespace called with no netns name, ignoring. ContainerID="f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f" iface="eth0" netns="" Nov 8 00:08:05.137577 containerd[2009]: 2025-11-08 00:08:05.062 [INFO][6368] cni-plugin/k8s.go 647: Releasing IP address(es) ContainerID="f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f" Nov 8 00:08:05.137577 containerd[2009]: 2025-11-08 00:08:05.062 [INFO][6368] cni-plugin/utils.go 188: Calico CNI releasing IP address ContainerID="f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f" Nov 8 00:08:05.137577 containerd[2009]: 2025-11-08 00:08:05.109 [INFO][6375] ipam/ipam_plugin.go 436: Releasing address using handleID ContainerID="f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f" HandleID="k8s-pod-network.f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f" Workload="ip--172--31--23--87-k8s-whisker--df89f8cd5--r2bdg-eth0" Nov 8 00:08:05.137577 containerd[2009]: 2025-11-08 00:08:05.110 [INFO][6375] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 8 00:08:05.137577 containerd[2009]: 2025-11-08 00:08:05.110 [INFO][6375] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 8 00:08:05.137577 containerd[2009]: 2025-11-08 00:08:05.127 [WARNING][6375] ipam/ipam_plugin.go 453: Asked to release address but it doesn't exist. Ignoring ContainerID="f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f" HandleID="k8s-pod-network.f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f" Workload="ip--172--31--23--87-k8s-whisker--df89f8cd5--r2bdg-eth0" Nov 8 00:08:05.137577 containerd[2009]: 2025-11-08 00:08:05.127 [INFO][6375] ipam/ipam_plugin.go 464: Releasing address using workloadID ContainerID="f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f" HandleID="k8s-pod-network.f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f" Workload="ip--172--31--23--87-k8s-whisker--df89f8cd5--r2bdg-eth0" Nov 8 00:08:05.137577 containerd[2009]: 2025-11-08 00:08:05.129 [INFO][6375] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 8 00:08:05.137577 containerd[2009]: 2025-11-08 00:08:05.134 [INFO][6368] cni-plugin/k8s.go 653: Teardown processing complete. ContainerID="f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f" Nov 8 00:08:05.139339 containerd[2009]: time="2025-11-08T00:08:05.137543416Z" level=info msg="TearDown network for sandbox \"f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f\" successfully" Nov 8 00:08:05.146305 containerd[2009]: time="2025-11-08T00:08:05.146205964Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Nov 8 00:08:05.146646 containerd[2009]: time="2025-11-08T00:08:05.146610124Z" level=info msg="RemovePodSandbox \"f10f556df790556523db44cd6305a95c7af57a8de5f052e4f491457a14abaa8f\" returns successfully" Nov 8 00:08:05.148098 containerd[2009]: time="2025-11-08T00:08:05.147593236Z" level=info msg="StopPodSandbox for \"9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584\"" Nov 8 00:08:05.344686 containerd[2009]: 2025-11-08 00:08:05.229 [WARNING][6390] cni-plugin/k8s.go 604: CNI_CONTAINERID does not match WorkloadEndpoint ContainerID, don't delete WEP. ContainerID="9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584" WorkloadEndpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--23--87-k8s-coredns--668d6bf9bc--54b9r-eth0", GenerateName:"coredns-668d6bf9bc-", Namespace:"kube-system", SelfLink:"", UID:"dd9a1fb2-7bfc-4968-86fa-9fc28ad38b94", ResourceVersion:"1169", Generation:0, CreationTimestamp:time.Date(2025, time.November, 8, 0, 6, 7, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-dns", "pod-template-hash":"668d6bf9bc", "projectcalico.org/namespace":"kube-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"coredns"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-23-87", ContainerID:"f43c80104d65f0484c99b5161a6503d4000cd8beef2427dfe253c9a31e5662a5", Pod:"coredns-668d6bf9bc-54b9r", Endpoint:"eth0", ServiceAccountName:"coredns", IPNetworks:[]string{"192.168.100.71/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.kube-system", "ksa.kube-system.coredns"}, InterfaceName:"calie8e25f97186", MAC:"", Ports:[]v3.WorkloadEndpointPort{v3.WorkloadEndpointPort{Name:"dns", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"UDP"}, Port:0x35, HostPort:0x0, HostIP:""}, v3.WorkloadEndpointPort{Name:"dns-tcp", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"TCP"}, Port:0x35, HostPort:0x0, HostIP:""}, v3.WorkloadEndpointPort{Name:"metrics", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"TCP"}, Port:0x23c1, HostPort:0x0, HostIP:""}}, AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 8 00:08:05.344686 containerd[2009]: 2025-11-08 00:08:05.229 [INFO][6390] cni-plugin/k8s.go 640: Cleaning up netns ContainerID="9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584" Nov 8 00:08:05.344686 containerd[2009]: 2025-11-08 00:08:05.229 [INFO][6390] cni-plugin/dataplane_linux.go 555: CleanUpNamespace called with no netns name, ignoring. ContainerID="9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584" iface="eth0" netns="" Nov 8 00:08:05.344686 containerd[2009]: 2025-11-08 00:08:05.229 [INFO][6390] cni-plugin/k8s.go 647: Releasing IP address(es) ContainerID="9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584" Nov 8 00:08:05.344686 containerd[2009]: 2025-11-08 00:08:05.229 [INFO][6390] cni-plugin/utils.go 188: Calico CNI releasing IP address ContainerID="9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584" Nov 8 00:08:05.344686 containerd[2009]: 2025-11-08 00:08:05.284 [INFO][6397] ipam/ipam_plugin.go 436: Releasing address using handleID ContainerID="9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584" HandleID="k8s-pod-network.9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584" Workload="ip--172--31--23--87-k8s-coredns--668d6bf9bc--54b9r-eth0" Nov 8 00:08:05.344686 containerd[2009]: 2025-11-08 00:08:05.284 [INFO][6397] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 8 00:08:05.344686 containerd[2009]: 2025-11-08 00:08:05.284 [INFO][6397] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 8 00:08:05.344686 containerd[2009]: 2025-11-08 00:08:05.326 [WARNING][6397] ipam/ipam_plugin.go 453: Asked to release address but it doesn't exist. Ignoring ContainerID="9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584" HandleID="k8s-pod-network.9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584" Workload="ip--172--31--23--87-k8s-coredns--668d6bf9bc--54b9r-eth0" Nov 8 00:08:05.344686 containerd[2009]: 2025-11-08 00:08:05.326 [INFO][6397] ipam/ipam_plugin.go 464: Releasing address using workloadID ContainerID="9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584" HandleID="k8s-pod-network.9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584" Workload="ip--172--31--23--87-k8s-coredns--668d6bf9bc--54b9r-eth0" Nov 8 00:08:05.344686 containerd[2009]: 2025-11-08 00:08:05.336 [INFO][6397] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 8 00:08:05.344686 containerd[2009]: 2025-11-08 00:08:05.338 [INFO][6390] cni-plugin/k8s.go 653: Teardown processing complete. ContainerID="9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584" Nov 8 00:08:05.347174 containerd[2009]: time="2025-11-08T00:08:05.345346877Z" level=info msg="TearDown network for sandbox \"9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584\" successfully" Nov 8 00:08:05.347174 containerd[2009]: time="2025-11-08T00:08:05.345427109Z" level=info msg="StopPodSandbox for \"9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584\" returns successfully" Nov 8 00:08:05.348953 containerd[2009]: time="2025-11-08T00:08:05.348584057Z" level=info msg="RemovePodSandbox for \"9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584\"" Nov 8 00:08:05.348953 containerd[2009]: time="2025-11-08T00:08:05.348670973Z" level=info msg="Forcibly stopping sandbox \"9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584\"" Nov 8 00:08:05.569570 containerd[2009]: 2025-11-08 00:08:05.458 [WARNING][6411] cni-plugin/k8s.go 604: CNI_CONTAINERID does not match WorkloadEndpoint ContainerID, don't delete WEP. ContainerID="9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584" WorkloadEndpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--23--87-k8s-coredns--668d6bf9bc--54b9r-eth0", GenerateName:"coredns-668d6bf9bc-", Namespace:"kube-system", SelfLink:"", UID:"dd9a1fb2-7bfc-4968-86fa-9fc28ad38b94", ResourceVersion:"1169", Generation:0, CreationTimestamp:time.Date(2025, time.November, 8, 0, 6, 7, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-dns", "pod-template-hash":"668d6bf9bc", "projectcalico.org/namespace":"kube-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"coredns"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-23-87", ContainerID:"f43c80104d65f0484c99b5161a6503d4000cd8beef2427dfe253c9a31e5662a5", Pod:"coredns-668d6bf9bc-54b9r", Endpoint:"eth0", ServiceAccountName:"coredns", IPNetworks:[]string{"192.168.100.71/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.kube-system", "ksa.kube-system.coredns"}, InterfaceName:"calie8e25f97186", MAC:"", Ports:[]v3.WorkloadEndpointPort{v3.WorkloadEndpointPort{Name:"dns", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"UDP"}, Port:0x35, HostPort:0x0, HostIP:""}, v3.WorkloadEndpointPort{Name:"dns-tcp", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"TCP"}, Port:0x35, HostPort:0x0, HostIP:""}, v3.WorkloadEndpointPort{Name:"metrics", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"TCP"}, Port:0x23c1, HostPort:0x0, HostIP:""}}, AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 8 00:08:05.569570 containerd[2009]: 2025-11-08 00:08:05.459 [INFO][6411] cni-plugin/k8s.go 640: Cleaning up netns ContainerID="9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584" Nov 8 00:08:05.569570 containerd[2009]: 2025-11-08 00:08:05.459 [INFO][6411] cni-plugin/dataplane_linux.go 555: CleanUpNamespace called with no netns name, ignoring. ContainerID="9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584" iface="eth0" netns="" Nov 8 00:08:05.569570 containerd[2009]: 2025-11-08 00:08:05.459 [INFO][6411] cni-plugin/k8s.go 647: Releasing IP address(es) ContainerID="9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584" Nov 8 00:08:05.569570 containerd[2009]: 2025-11-08 00:08:05.459 [INFO][6411] cni-plugin/utils.go 188: Calico CNI releasing IP address ContainerID="9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584" Nov 8 00:08:05.569570 containerd[2009]: 2025-11-08 00:08:05.533 [INFO][6418] ipam/ipam_plugin.go 436: Releasing address using handleID ContainerID="9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584" HandleID="k8s-pod-network.9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584" Workload="ip--172--31--23--87-k8s-coredns--668d6bf9bc--54b9r-eth0" Nov 8 00:08:05.569570 containerd[2009]: 2025-11-08 00:08:05.533 [INFO][6418] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 8 00:08:05.569570 containerd[2009]: 2025-11-08 00:08:05.533 [INFO][6418] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 8 00:08:05.569570 containerd[2009]: 2025-11-08 00:08:05.558 [WARNING][6418] ipam/ipam_plugin.go 453: Asked to release address but it doesn't exist. Ignoring ContainerID="9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584" HandleID="k8s-pod-network.9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584" Workload="ip--172--31--23--87-k8s-coredns--668d6bf9bc--54b9r-eth0" Nov 8 00:08:05.569570 containerd[2009]: 2025-11-08 00:08:05.558 [INFO][6418] ipam/ipam_plugin.go 464: Releasing address using workloadID ContainerID="9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584" HandleID="k8s-pod-network.9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584" Workload="ip--172--31--23--87-k8s-coredns--668d6bf9bc--54b9r-eth0" Nov 8 00:08:05.569570 containerd[2009]: 2025-11-08 00:08:05.561 [INFO][6418] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 8 00:08:05.569570 containerd[2009]: 2025-11-08 00:08:05.566 [INFO][6411] cni-plugin/k8s.go 653: Teardown processing complete. ContainerID="9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584" Nov 8 00:08:05.569570 containerd[2009]: time="2025-11-08T00:08:05.569389626Z" level=info msg="TearDown network for sandbox \"9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584\" successfully" Nov 8 00:08:05.580962 containerd[2009]: time="2025-11-08T00:08:05.580488246Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Nov 8 00:08:05.580962 containerd[2009]: time="2025-11-08T00:08:05.580584162Z" level=info msg="RemovePodSandbox \"9f055336c8601da02a72cfa4aaf6358344fe0a8bae54efc299da95ee016e1584\" returns successfully" Nov 8 00:08:05.714717 systemd[1]: Started sshd@25-172.31.23.87:22-139.178.89.65:41116.service - OpenSSH per-connection server daemon (139.178.89.65:41116). Nov 8 00:08:05.909881 sshd[6425]: Accepted publickey for core from 139.178.89.65 port 41116 ssh2: RSA SHA256:tnEXpnDY8gLTej7GJ+T99WI4otIwvlI9IcMNDF42aqw Nov 8 00:08:05.913526 sshd[6425]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 8 00:08:05.921829 systemd-logind[1991]: New session 26 of user core. Nov 8 00:08:05.932259 systemd[1]: Started session-26.scope - Session 26 of User core. Nov 8 00:08:06.227735 sshd[6425]: pam_unix(sshd:session): session closed for user core Nov 8 00:08:06.235914 systemd-logind[1991]: Session 26 logged out. Waiting for processes to exit. Nov 8 00:08:06.238717 systemd[1]: sshd@25-172.31.23.87:22-139.178.89.65:41116.service: Deactivated successfully. Nov 8 00:08:06.247940 systemd[1]: session-26.scope: Deactivated successfully. Nov 8 00:08:06.252632 systemd-logind[1991]: Removed session 26. Nov 8 00:08:08.657121 kubelet[3341]: E1108 00:08:08.657012 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"whisker\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found\", failed to \"StartContainer\" for \"whisker-backend\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found\"]" pod="calico-system/whisker-54bc667d85-4nldg" podUID="97a993f1-d70c-4bf6-ba46-4f0456d70b2e" Nov 8 00:08:09.653376 kubelet[3341]: E1108 00:08:09.653302 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-7cbbf6b44f-hrhmg" podUID="58f37ea9-b0c8-456a-8651-ebf3793b8679" Nov 8 00:08:11.274752 systemd[1]: Started sshd@26-172.31.23.87:22-139.178.89.65:48560.service - OpenSSH per-connection server daemon (139.178.89.65:48560). Nov 8 00:08:11.459352 sshd[6441]: Accepted publickey for core from 139.178.89.65 port 48560 ssh2: RSA SHA256:tnEXpnDY8gLTej7GJ+T99WI4otIwvlI9IcMNDF42aqw Nov 8 00:08:11.464962 sshd[6441]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 8 00:08:11.475890 systemd-logind[1991]: New session 27 of user core. Nov 8 00:08:11.484602 systemd[1]: Started session-27.scope - Session 27 of User core. Nov 8 00:08:11.659977 kubelet[3341]: E1108 00:08:11.658645 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-66cbb68f69-hrrjm" podUID="68debac0-90fa-43fc-b6a2-614e4954f14e" Nov 8 00:08:11.659977 kubelet[3341]: E1108 00:08:11.659219 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-kube-controllers\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found\"" pod="calico-system/calico-kube-controllers-7cc5d59f7b-q89cg" podUID="52f757de-0e18-4b03-af0a-9737e167b914" Nov 8 00:08:11.811446 sshd[6441]: pam_unix(sshd:session): session closed for user core Nov 8 00:08:11.821249 systemd[1]: sshd@26-172.31.23.87:22-139.178.89.65:48560.service: Deactivated successfully. Nov 8 00:08:11.828517 systemd[1]: session-27.scope: Deactivated successfully. Nov 8 00:08:11.834474 systemd-logind[1991]: Session 27 logged out. Waiting for processes to exit. Nov 8 00:08:11.838854 systemd-logind[1991]: Removed session 27. Nov 8 00:08:12.656587 kubelet[3341]: E1108 00:08:12.656498 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"calico-csi\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ghcr.io/flatcar/calico/csi:v3.30.4: not found\", failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found\"]" pod="calico-system/csi-node-driver-8rk2x" podUID="0fc7336a-4c45-40ec-b634-101ce08e1be1" Nov 8 00:08:16.851907 systemd[1]: Started sshd@27-172.31.23.87:22-139.178.89.65:47818.service - OpenSSH per-connection server daemon (139.178.89.65:47818). Nov 8 00:08:17.036160 sshd[6457]: Accepted publickey for core from 139.178.89.65 port 47818 ssh2: RSA SHA256:tnEXpnDY8gLTej7GJ+T99WI4otIwvlI9IcMNDF42aqw Nov 8 00:08:17.041421 sshd[6457]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 8 00:08:17.053397 systemd-logind[1991]: New session 28 of user core. Nov 8 00:08:17.059607 systemd[1]: Started session-28.scope - Session 28 of User core. Nov 8 00:08:17.343793 sshd[6457]: pam_unix(sshd:session): session closed for user core Nov 8 00:08:17.354439 systemd[1]: sshd@27-172.31.23.87:22-139.178.89.65:47818.service: Deactivated successfully. Nov 8 00:08:17.361588 systemd[1]: session-28.scope: Deactivated successfully. Nov 8 00:08:17.364237 systemd-logind[1991]: Session 28 logged out. Waiting for processes to exit. Nov 8 00:08:17.366420 systemd-logind[1991]: Removed session 28. Nov 8 00:08:17.656102 kubelet[3341]: E1108 00:08:17.655378 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-7cbbf6b44f-pntg9" podUID="886783b3-53d5-4894-8799-c2c145d125ce" Nov 8 00:08:19.652471 kubelet[3341]: E1108 00:08:19.651819 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"goldmane\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found\"" pod="calico-system/goldmane-666569f655-qlmhx" podUID="ac78d516-6696-4a76-a1b8-01b7e90766d4" Nov 8 00:08:20.656749 kubelet[3341]: E1108 00:08:20.656661 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"whisker\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found\", failed to \"StartContainer\" for \"whisker-backend\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found\"]" pod="calico-system/whisker-54bc667d85-4nldg" podUID="97a993f1-d70c-4bf6-ba46-4f0456d70b2e" Nov 8 00:08:22.385778 systemd[1]: Started sshd@28-172.31.23.87:22-139.178.89.65:47824.service - OpenSSH per-connection server daemon (139.178.89.65:47824). Nov 8 00:08:22.579790 sshd[6471]: Accepted publickey for core from 139.178.89.65 port 47824 ssh2: RSA SHA256:tnEXpnDY8gLTej7GJ+T99WI4otIwvlI9IcMNDF42aqw Nov 8 00:08:22.582881 sshd[6471]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 8 00:08:22.593760 systemd-logind[1991]: New session 29 of user core. Nov 8 00:08:22.605849 systemd[1]: Started session-29.scope - Session 29 of User core. Nov 8 00:08:22.942630 sshd[6471]: pam_unix(sshd:session): session closed for user core Nov 8 00:08:22.949979 systemd[1]: sshd@28-172.31.23.87:22-139.178.89.65:47824.service: Deactivated successfully. Nov 8 00:08:22.950416 systemd-logind[1991]: Session 29 logged out. Waiting for processes to exit. Nov 8 00:08:22.958982 systemd[1]: session-29.scope: Deactivated successfully. Nov 8 00:08:22.965622 systemd-logind[1991]: Removed session 29. Nov 8 00:08:23.654296 kubelet[3341]: E1108 00:08:23.654197 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-7cbbf6b44f-hrhmg" podUID="58f37ea9-b0c8-456a-8651-ebf3793b8679" Nov 8 00:08:24.653898 kubelet[3341]: E1108 00:08:24.653687 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-kube-controllers\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found\"" pod="calico-system/calico-kube-controllers-7cc5d59f7b-q89cg" podUID="52f757de-0e18-4b03-af0a-9737e167b914" Nov 8 00:08:24.655246 kubelet[3341]: E1108 00:08:24.654941 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"calico-csi\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ghcr.io/flatcar/calico/csi:v3.30.4: not found\", failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found\"]" pod="calico-system/csi-node-driver-8rk2x" podUID="0fc7336a-4c45-40ec-b634-101ce08e1be1" Nov 8 00:08:25.661754 kubelet[3341]: E1108 00:08:25.661669 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-66cbb68f69-hrrjm" podUID="68debac0-90fa-43fc-b6a2-614e4954f14e" Nov 8 00:08:27.998478 systemd[1]: Started sshd@29-172.31.23.87:22-139.178.89.65:42086.service - OpenSSH per-connection server daemon (139.178.89.65:42086). Nov 8 00:08:28.183973 sshd[6484]: Accepted publickey for core from 139.178.89.65 port 42086 ssh2: RSA SHA256:tnEXpnDY8gLTej7GJ+T99WI4otIwvlI9IcMNDF42aqw Nov 8 00:08:28.186051 sshd[6484]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 8 00:08:28.197670 systemd-logind[1991]: New session 30 of user core. Nov 8 00:08:28.206589 systemd[1]: Started session-30.scope - Session 30 of User core. Nov 8 00:08:28.498719 sshd[6484]: pam_unix(sshd:session): session closed for user core Nov 8 00:08:28.507147 systemd[1]: session-30.scope: Deactivated successfully. Nov 8 00:08:28.509669 systemd[1]: sshd@29-172.31.23.87:22-139.178.89.65:42086.service: Deactivated successfully. Nov 8 00:08:28.518757 systemd-logind[1991]: Session 30 logged out. Waiting for processes to exit. Nov 8 00:08:28.523206 systemd-logind[1991]: Removed session 30. Nov 8 00:08:30.653757 containerd[2009]: time="2025-11-08T00:08:30.653688931Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/goldmane:v3.30.4\"" Nov 8 00:08:30.960372 containerd[2009]: time="2025-11-08T00:08:30.960187292Z" level=info msg="trying next host - response was http.StatusNotFound" host=ghcr.io Nov 8 00:08:30.962596 containerd[2009]: time="2025-11-08T00:08:30.962515160Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/goldmane:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" Nov 8 00:08:30.962760 containerd[2009]: time="2025-11-08T00:08:30.962666324Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/goldmane:v3.30.4: active requests=0, bytes read=77" Nov 8 00:08:30.963611 kubelet[3341]: E1108 00:08:30.963164 3341 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" image="ghcr.io/flatcar/calico/goldmane:v3.30.4" Nov 8 00:08:30.963611 kubelet[3341]: E1108 00:08:30.963235 3341 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" image="ghcr.io/flatcar/calico/goldmane:v3.30.4" Nov 8 00:08:30.966229 kubelet[3341]: E1108 00:08:30.965473 3341 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:goldmane,Image:ghcr.io/flatcar/calico/goldmane:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:INFO,ValueFrom:nil,},EnvVar{Name:PORT,Value:7443,ValueFrom:nil,},EnvVar{Name:SERVER_CERT_PATH,Value:/goldmane-key-pair/tls.crt,ValueFrom:nil,},EnvVar{Name:SERVER_KEY_PATH,Value:/goldmane-key-pair/tls.key,ValueFrom:nil,},EnvVar{Name:CA_CERT_PATH,Value:/etc/pki/tls/certs/tigera-ca-bundle.crt,ValueFrom:nil,},EnvVar{Name:PUSH_URL,Value:https://guardian.calico-system.svc.cluster.local:443/api/v1/flows/bulk,ValueFrom:nil,},EnvVar{Name:FILE_CONFIG_PATH,Value:/config/config.json,ValueFrom:nil,},EnvVar{Name:HEALTH_ENABLED,Value:true,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:config,ReadOnly:true,MountPath:/config,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:goldmane-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:goldmane-key-pair,ReadOnly:true,MountPath:/goldmane-key-pair,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-jv6zv,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/health -live],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/health -ready],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:30,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod goldmane-666569f655-qlmhx_calico-system(ac78d516-6696-4a76-a1b8-01b7e90766d4): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" logger="UnhandledError" Nov 8 00:08:30.967639 kubelet[3341]: E1108 00:08:30.967410 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"goldmane\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found\"" pod="calico-system/goldmane-666569f655-qlmhx" podUID="ac78d516-6696-4a76-a1b8-01b7e90766d4" Nov 8 00:08:31.655993 containerd[2009]: time="2025-11-08T00:08:31.655577156Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\"" Nov 8 00:08:31.948965 containerd[2009]: time="2025-11-08T00:08:31.948809025Z" level=info msg="trying next host - response was http.StatusNotFound" host=ghcr.io Nov 8 00:08:31.951417 containerd[2009]: time="2025-11-08T00:08:31.951343869Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" Nov 8 00:08:31.951668 containerd[2009]: time="2025-11-08T00:08:31.951477933Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/apiserver:v3.30.4: active requests=0, bytes read=77" Nov 8 00:08:31.951745 kubelet[3341]: E1108 00:08:31.951680 3341 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 8 00:08:31.951823 kubelet[3341]: E1108 00:08:31.951738 3341 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 8 00:08:31.951990 kubelet[3341]: E1108 00:08:31.951907 3341 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:calico-apiserver,Image:ghcr.io/flatcar/calico/apiserver:v3.30.4,Command:[],Args:[--secure-port=5443 --tls-private-key-file=/calico-apiserver-certs/tls.key --tls-cert-file=/calico-apiserver-certs/tls.crt],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:LOG_LEVEL,Value:info,ValueFrom:nil,},EnvVar{Name:MULTI_INTERFACE_MODE,Value:none,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:calico-apiserver-certs,ReadOnly:true,MountPath:/calico-apiserver-certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-lk46f,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 5443 },Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-apiserver-7cbbf6b44f-pntg9_calico-apiserver(886783b3-53d5-4894-8799-c2c145d125ce): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" logger="UnhandledError" Nov 8 00:08:31.953711 kubelet[3341]: E1108 00:08:31.953641 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-7cbbf6b44f-pntg9" podUID="886783b3-53d5-4894-8799-c2c145d125ce" Nov 8 00:08:33.654634 containerd[2009]: time="2025-11-08T00:08:33.654373330Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/whisker:v3.30.4\"" Nov 8 00:08:33.971349 containerd[2009]: time="2025-11-08T00:08:33.971289143Z" level=info msg="trying next host - response was http.StatusNotFound" host=ghcr.io Nov 8 00:08:33.973588 containerd[2009]: time="2025-11-08T00:08:33.973442351Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/whisker:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" Nov 8 00:08:33.973588 containerd[2009]: time="2025-11-08T00:08:33.973541051Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/whisker:v3.30.4: active requests=0, bytes read=73" Nov 8 00:08:33.973836 kubelet[3341]: E1108 00:08:33.973751 3341 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker:v3.30.4" Nov 8 00:08:33.973836 kubelet[3341]: E1108 00:08:33.973811 3341 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker:v3.30.4" Nov 8 00:08:33.974435 kubelet[3341]: E1108 00:08:33.973961 3341 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:whisker,Image:ghcr.io/flatcar/calico/whisker:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:INFO,ValueFrom:nil,},EnvVar{Name:CALICO_VERSION,Value:v3.30.4,ValueFrom:nil,},EnvVar{Name:CLUSTER_ID,Value:80bed0a1b6164782a39b475807edb893,ValueFrom:nil,},EnvVar{Name:CLUSTER_TYPE,Value:typha,kdd,k8s,operator,bgp,kubeadm,ValueFrom:nil,},EnvVar{Name:NOTIFICATIONS,Value:Enabled,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-79s7l,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod whisker-54bc667d85-4nldg_calico-system(97a993f1-d70c-4bf6-ba46-4f0456d70b2e): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" logger="UnhandledError" Nov 8 00:08:33.976927 containerd[2009]: time="2025-11-08T00:08:33.976378271Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\"" Nov 8 00:08:34.249857 containerd[2009]: time="2025-11-08T00:08:34.249651141Z" level=info msg="trying next host - response was http.StatusNotFound" host=ghcr.io Nov 8 00:08:34.252463 containerd[2009]: time="2025-11-08T00:08:34.252292653Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" Nov 8 00:08:34.252463 containerd[2009]: time="2025-11-08T00:08:34.252317301Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/whisker-backend:v3.30.4: active requests=0, bytes read=85" Nov 8 00:08:34.252763 kubelet[3341]: E1108 00:08:34.252616 3341 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker-backend:v3.30.4" Nov 8 00:08:34.252763 kubelet[3341]: E1108 00:08:34.252680 3341 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker-backend:v3.30.4" Nov 8 00:08:34.252990 kubelet[3341]: E1108 00:08:34.252917 3341 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:whisker-backend,Image:ghcr.io/flatcar/calico/whisker-backend:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:INFO,ValueFrom:nil,},EnvVar{Name:PORT,Value:3002,ValueFrom:nil,},EnvVar{Name:GOLDMANE_HOST,Value:goldmane.calico-system.svc.cluster.local:7443,ValueFrom:nil,},EnvVar{Name:TLS_CERT_PATH,Value:/whisker-backend-key-pair/tls.crt,ValueFrom:nil,},EnvVar{Name:TLS_KEY_PATH,Value:/whisker-backend-key-pair/tls.key,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:whisker-backend-key-pair,ReadOnly:true,MountPath:/whisker-backend-key-pair,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:whisker-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-79s7l,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod whisker-54bc667d85-4nldg_calico-system(97a993f1-d70c-4bf6-ba46-4f0456d70b2e): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" logger="UnhandledError" Nov 8 00:08:34.254254 kubelet[3341]: E1108 00:08:34.254170 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"whisker\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found\", failed to \"StartContainer\" for \"whisker-backend\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found\"]" pod="calico-system/whisker-54bc667d85-4nldg" podUID="97a993f1-d70c-4bf6-ba46-4f0456d70b2e" Nov 8 00:08:34.654077 kubelet[3341]: E1108 00:08:34.653928 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-7cbbf6b44f-hrhmg" podUID="58f37ea9-b0c8-456a-8651-ebf3793b8679" Nov 8 00:08:36.652784 containerd[2009]: time="2025-11-08T00:08:36.652670617Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\"" Nov 8 00:08:36.979439 containerd[2009]: time="2025-11-08T00:08:36.979378970Z" level=info msg="trying next host - response was http.StatusNotFound" host=ghcr.io Nov 8 00:08:36.981599 containerd[2009]: time="2025-11-08T00:08:36.981528038Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" Nov 8 00:08:36.981720 containerd[2009]: time="2025-11-08T00:08:36.981665174Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/apiserver:v3.30.4: active requests=0, bytes read=77" Nov 8 00:08:36.981918 kubelet[3341]: E1108 00:08:36.981864 3341 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 8 00:08:36.983132 kubelet[3341]: E1108 00:08:36.981933 3341 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 8 00:08:36.983132 kubelet[3341]: E1108 00:08:36.982225 3341 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:calico-apiserver,Image:ghcr.io/flatcar/calico/apiserver:v3.30.4,Command:[],Args:[--secure-port=5443 --tls-private-key-file=/calico-apiserver-certs/tls.key --tls-cert-file=/calico-apiserver-certs/tls.crt],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:LOG_LEVEL,Value:info,ValueFrom:nil,},EnvVar{Name:MULTI_INTERFACE_MODE,Value:none,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:calico-apiserver-certs,ReadOnly:true,MountPath:/calico-apiserver-certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-dxmxx,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 5443 },Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-apiserver-66cbb68f69-hrrjm_calico-apiserver(68debac0-90fa-43fc-b6a2-614e4954f14e): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" logger="UnhandledError" Nov 8 00:08:36.983563 containerd[2009]: time="2025-11-08T00:08:36.982633226Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/csi:v3.30.4\"" Nov 8 00:08:36.984018 kubelet[3341]: E1108 00:08:36.983943 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-66cbb68f69-hrrjm" podUID="68debac0-90fa-43fc-b6a2-614e4954f14e" Nov 8 00:08:37.276420 containerd[2009]: time="2025-11-08T00:08:37.276053664Z" level=info msg="trying next host - response was http.StatusNotFound" host=ghcr.io Nov 8 00:08:37.278667 containerd[2009]: time="2025-11-08T00:08:37.278600340Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/csi:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" Nov 8 00:08:37.279057 containerd[2009]: time="2025-11-08T00:08:37.278763300Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/csi:v3.30.4: active requests=0, bytes read=69" Nov 8 00:08:37.279233 kubelet[3341]: E1108 00:08:37.278963 3341 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" image="ghcr.io/flatcar/calico/csi:v3.30.4" Nov 8 00:08:37.279443 kubelet[3341]: E1108 00:08:37.279330 3341 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" image="ghcr.io/flatcar/calico/csi:v3.30.4" Nov 8 00:08:37.279701 kubelet[3341]: E1108 00:08:37.279627 3341 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:calico-csi,Image:ghcr.io/flatcar/calico/csi:v3.30.4,Command:[],Args:[--nodeid=$(KUBE_NODE_NAME) --loglevel=$(LOG_LEVEL)],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:warn,ValueFrom:nil,},EnvVar{Name:KUBE_NODE_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:spec.nodeName,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kubelet-dir,ReadOnly:false,MountPath:/var/lib/kubelet,SubPath:,MountPropagation:*Bidirectional,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:socket-dir,ReadOnly:false,MountPath:/csi,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:varrun,ReadOnly:false,MountPath:/var/run,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-cmvgp,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*true,SELinuxOptions:nil,RunAsUser:*0,RunAsNonRoot:*false,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*true,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod csi-node-driver-8rk2x_calico-system(0fc7336a-4c45-40ec-b634-101ce08e1be1): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" logger="UnhandledError" Nov 8 00:08:37.282797 containerd[2009]: time="2025-11-08T00:08:37.282737808Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\"" Nov 8 00:08:37.557120 containerd[2009]: time="2025-11-08T00:08:37.556946161Z" level=info msg="trying next host - response was http.StatusNotFound" host=ghcr.io Nov 8 00:08:37.559257 containerd[2009]: time="2025-11-08T00:08:37.559151569Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" Nov 8 00:08:37.559257 containerd[2009]: time="2025-11-08T00:08:37.559198573Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: active requests=0, bytes read=93" Nov 8 00:08:37.559710 kubelet[3341]: E1108 00:08:37.559542 3341 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" image="ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4" Nov 8 00:08:37.559710 kubelet[3341]: E1108 00:08:37.559604 3341 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" image="ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4" Nov 8 00:08:37.559998 kubelet[3341]: E1108 00:08:37.559769 3341 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:csi-node-driver-registrar,Image:ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4,Command:[],Args:[--v=5 --csi-address=$(ADDRESS) --kubelet-registration-path=$(DRIVER_REG_SOCK_PATH)],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:ADDRESS,Value:/csi/csi.sock,ValueFrom:nil,},EnvVar{Name:DRIVER_REG_SOCK_PATH,Value:/var/lib/kubelet/plugins/csi.tigera.io/csi.sock,ValueFrom:nil,},EnvVar{Name:KUBE_NODE_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:spec.nodeName,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:registration-dir,ReadOnly:false,MountPath:/registration,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:socket-dir,ReadOnly:false,MountPath:/csi,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-cmvgp,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*true,SELinuxOptions:nil,RunAsUser:*0,RunAsNonRoot:*false,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*true,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod csi-node-driver-8rk2x_calico-system(0fc7336a-4c45-40ec-b634-101ce08e1be1): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" logger="UnhandledError" Nov 8 00:08:37.561074 kubelet[3341]: E1108 00:08:37.561002 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"calico-csi\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ghcr.io/flatcar/calico/csi:v3.30.4: not found\", failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found\"]" pod="calico-system/csi-node-driver-8rk2x" podUID="0fc7336a-4c45-40ec-b634-101ce08e1be1" Nov 8 00:08:38.652538 containerd[2009]: time="2025-11-08T00:08:38.652199006Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\"" Nov 8 00:08:38.926857 containerd[2009]: time="2025-11-08T00:08:38.926480668Z" level=info msg="trying next host - response was http.StatusNotFound" host=ghcr.io Nov 8 00:08:38.928767 containerd[2009]: time="2025-11-08T00:08:38.928683784Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" Nov 8 00:08:38.928903 containerd[2009]: time="2025-11-08T00:08:38.928847104Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/kube-controllers:v3.30.4: active requests=0, bytes read=85" Nov 8 00:08:38.929098 kubelet[3341]: E1108 00:08:38.929045 3341 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" image="ghcr.io/flatcar/calico/kube-controllers:v3.30.4" Nov 8 00:08:38.929673 kubelet[3341]: E1108 00:08:38.929193 3341 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" image="ghcr.io/flatcar/calico/kube-controllers:v3.30.4" Nov 8 00:08:38.929673 kubelet[3341]: E1108 00:08:38.929503 3341 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:calico-kube-controllers,Image:ghcr.io/flatcar/calico/kube-controllers:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:KUBE_CONTROLLERS_CONFIG_NAME,Value:default,ValueFrom:nil,},EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:ENABLED_CONTROLLERS,Value:node,loadbalancer,ValueFrom:nil,},EnvVar{Name:DISABLE_KUBE_CONTROLLERS_CONFIG_API,Value:false,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:CA_CRT_PATH,Value:/etc/pki/tls/certs/tigera-ca-bundle.crt,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:tigera-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:tigera-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/cert.pem,SubPath:ca-bundle.crt,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-bt2d5,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/usr/bin/check-status -l],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:10,TimeoutSeconds:10,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:6,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/usr/bin/check-status -r],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:10,PeriodSeconds:30,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*999,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-kube-controllers-7cc5d59f7b-q89cg_calico-system(52f757de-0e18-4b03-af0a-9737e167b914): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" logger="UnhandledError" Nov 8 00:08:38.930812 kubelet[3341]: E1108 00:08:38.930740 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-kube-controllers\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found\"" pod="calico-system/calico-kube-controllers-7cc5d59f7b-q89cg" podUID="52f757de-0e18-4b03-af0a-9737e167b914" Nov 8 00:08:41.654742 kubelet[3341]: E1108 00:08:41.654676 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"goldmane\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found\"" pod="calico-system/goldmane-666569f655-qlmhx" podUID="ac78d516-6696-4a76-a1b8-01b7e90766d4" Nov 8 00:08:42.491058 systemd[1]: cri-containerd-fdced88e2c26a58b82b0f0e3d741843118b2e2952995d15a51957b5a3d490e67.scope: Deactivated successfully. Nov 8 00:08:42.491552 systemd[1]: cri-containerd-fdced88e2c26a58b82b0f0e3d741843118b2e2952995d15a51957b5a3d490e67.scope: Consumed 36.931s CPU time. Nov 8 00:08:42.533535 systemd[1]: run-containerd-io.containerd.runtime.v2.task-k8s.io-fdced88e2c26a58b82b0f0e3d741843118b2e2952995d15a51957b5a3d490e67-rootfs.mount: Deactivated successfully. Nov 8 00:08:42.554308 containerd[2009]: time="2025-11-08T00:08:42.554153694Z" level=info msg="shim disconnected" id=fdced88e2c26a58b82b0f0e3d741843118b2e2952995d15a51957b5a3d490e67 namespace=k8s.io Nov 8 00:08:42.554966 containerd[2009]: time="2025-11-08T00:08:42.554328762Z" level=warning msg="cleaning up after shim disconnected" id=fdced88e2c26a58b82b0f0e3d741843118b2e2952995d15a51957b5a3d490e67 namespace=k8s.io Nov 8 00:08:42.554966 containerd[2009]: time="2025-11-08T00:08:42.554352978Z" level=info msg="cleaning up dead shim" namespace=k8s.io Nov 8 00:08:42.854145 kubelet[3341]: I1108 00:08:42.853203 3341 scope.go:117] "RemoveContainer" containerID="fdced88e2c26a58b82b0f0e3d741843118b2e2952995d15a51957b5a3d490e67" Nov 8 00:08:42.858454 containerd[2009]: time="2025-11-08T00:08:42.858373843Z" level=info msg="CreateContainer within sandbox \"8cf29354dfb7547e6970712c07d29dd964cfb60fc0cf4aa2fedf62d9bfda2cb4\" for container &ContainerMetadata{Name:tigera-operator,Attempt:1,}" Nov 8 00:08:42.895222 containerd[2009]: time="2025-11-08T00:08:42.893367296Z" level=info msg="CreateContainer within sandbox \"8cf29354dfb7547e6970712c07d29dd964cfb60fc0cf4aa2fedf62d9bfda2cb4\" for &ContainerMetadata{Name:tigera-operator,Attempt:1,} returns container id \"c2a1f9ad578981fb9e0d3fae02d459e74bd746bc3a3f8060088f6c692547bbf8\"" Nov 8 00:08:42.896401 containerd[2009]: time="2025-11-08T00:08:42.896329916Z" level=info msg="StartContainer for \"c2a1f9ad578981fb9e0d3fae02d459e74bd746bc3a3f8060088f6c692547bbf8\"" Nov 8 00:08:42.956734 systemd[1]: cri-containerd-049c1e19def49391699667c035afadb137255eb0ae2341f6ddf11fe385d74f00.scope: Deactivated successfully. Nov 8 00:08:42.957247 systemd[1]: cri-containerd-049c1e19def49391699667c035afadb137255eb0ae2341f6ddf11fe385d74f00.scope: Consumed 5.709s CPU time, 19.7M memory peak, 0B memory swap peak. Nov 8 00:08:42.988603 systemd[1]: Started cri-containerd-c2a1f9ad578981fb9e0d3fae02d459e74bd746bc3a3f8060088f6c692547bbf8.scope - libcontainer container c2a1f9ad578981fb9e0d3fae02d459e74bd746bc3a3f8060088f6c692547bbf8. Nov 8 00:08:43.048447 containerd[2009]: time="2025-11-08T00:08:43.048359956Z" level=info msg="shim disconnected" id=049c1e19def49391699667c035afadb137255eb0ae2341f6ddf11fe385d74f00 namespace=k8s.io Nov 8 00:08:43.048447 containerd[2009]: time="2025-11-08T00:08:43.048439936Z" level=warning msg="cleaning up after shim disconnected" id=049c1e19def49391699667c035afadb137255eb0ae2341f6ddf11fe385d74f00 namespace=k8s.io Nov 8 00:08:43.048857 containerd[2009]: time="2025-11-08T00:08:43.048462952Z" level=info msg="cleaning up dead shim" namespace=k8s.io Nov 8 00:08:43.063394 containerd[2009]: time="2025-11-08T00:08:43.062249848Z" level=info msg="StartContainer for \"c2a1f9ad578981fb9e0d3fae02d459e74bd746bc3a3f8060088f6c692547bbf8\" returns successfully" Nov 8 00:08:43.532820 systemd[1]: run-containerd-io.containerd.runtime.v2.task-k8s.io-049c1e19def49391699667c035afadb137255eb0ae2341f6ddf11fe385d74f00-rootfs.mount: Deactivated successfully. Nov 8 00:08:43.862616 kubelet[3341]: I1108 00:08:43.862468 3341 scope.go:117] "RemoveContainer" containerID="049c1e19def49391699667c035afadb137255eb0ae2341f6ddf11fe385d74f00" Nov 8 00:08:43.866595 containerd[2009]: time="2025-11-08T00:08:43.866535332Z" level=info msg="CreateContainer within sandbox \"a1e798e67d89381e5dfd8bb8632e9d45087555f70e44d2b88aa7016d193a7645\" for container &ContainerMetadata{Name:kube-controller-manager,Attempt:1,}" Nov 8 00:08:43.891972 containerd[2009]: time="2025-11-08T00:08:43.891883364Z" level=info msg="CreateContainer within sandbox \"a1e798e67d89381e5dfd8bb8632e9d45087555f70e44d2b88aa7016d193a7645\" for &ContainerMetadata{Name:kube-controller-manager,Attempt:1,} returns container id \"37117749ff92cdc2f0eb9117a8f7992a7b45daddec4a1cbc5d3e3bbd949b4470\"" Nov 8 00:08:43.893975 containerd[2009]: time="2025-11-08T00:08:43.893429684Z" level=info msg="StartContainer for \"37117749ff92cdc2f0eb9117a8f7992a7b45daddec4a1cbc5d3e3bbd949b4470\"" Nov 8 00:08:43.954597 systemd[1]: Started cri-containerd-37117749ff92cdc2f0eb9117a8f7992a7b45daddec4a1cbc5d3e3bbd949b4470.scope - libcontainer container 37117749ff92cdc2f0eb9117a8f7992a7b45daddec4a1cbc5d3e3bbd949b4470. Nov 8 00:08:44.023337 containerd[2009]: time="2025-11-08T00:08:44.023259833Z" level=info msg="StartContainer for \"37117749ff92cdc2f0eb9117a8f7992a7b45daddec4a1cbc5d3e3bbd949b4470\" returns successfully" Nov 8 00:08:44.652134 kubelet[3341]: E1108 00:08:44.652069 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-7cbbf6b44f-pntg9" podUID="886783b3-53d5-4894-8799-c2c145d125ce" Nov 8 00:08:44.717882 kubelet[3341]: E1108 00:08:44.717238 3341 controller.go:195] "Failed to update lease" err="Put \"https://172.31.23.87:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-172-31-23-87?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 8 00:08:45.653550 containerd[2009]: time="2025-11-08T00:08:45.653162133Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\"" Nov 8 00:08:45.931838 containerd[2009]: time="2025-11-08T00:08:45.930995639Z" level=info msg="trying next host - response was http.StatusNotFound" host=ghcr.io Nov 8 00:08:45.934117 containerd[2009]: time="2025-11-08T00:08:45.933366839Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" Nov 8 00:08:45.934117 containerd[2009]: time="2025-11-08T00:08:45.933526799Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/apiserver:v3.30.4: active requests=0, bytes read=77" Nov 8 00:08:45.934495 kubelet[3341]: E1108 00:08:45.933857 3341 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 8 00:08:45.934495 kubelet[3341]: E1108 00:08:45.933918 3341 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 8 00:08:45.935635 kubelet[3341]: E1108 00:08:45.935476 3341 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:calico-apiserver,Image:ghcr.io/flatcar/calico/apiserver:v3.30.4,Command:[],Args:[--secure-port=5443 --tls-private-key-file=/calico-apiserver-certs/tls.key --tls-cert-file=/calico-apiserver-certs/tls.crt],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:LOG_LEVEL,Value:info,ValueFrom:nil,},EnvVar{Name:MULTI_INTERFACE_MODE,Value:none,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:calico-apiserver-certs,ReadOnly:true,MountPath:/calico-apiserver-certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-4kzbv,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 5443 },Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-apiserver-7cbbf6b44f-hrhmg_calico-apiserver(58f37ea9-b0c8-456a-8651-ebf3793b8679): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" logger="UnhandledError" Nov 8 00:08:45.936825 kubelet[3341]: E1108 00:08:45.936734 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-7cbbf6b44f-hrhmg" podUID="58f37ea9-b0c8-456a-8651-ebf3793b8679" Nov 8 00:08:47.657582 kubelet[3341]: E1108 00:08:47.657499 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"whisker\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found\", failed to \"StartContainer\" for \"whisker-backend\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found\"]" pod="calico-system/whisker-54bc667d85-4nldg" podUID="97a993f1-d70c-4bf6-ba46-4f0456d70b2e" Nov 8 00:08:48.455790 systemd[1]: cri-containerd-69ff106255d4b6c604a0a08b2a9dc83d10e091778e4c2e6e8ff753defc0cf853.scope: Deactivated successfully. Nov 8 00:08:48.457392 systemd[1]: cri-containerd-69ff106255d4b6c604a0a08b2a9dc83d10e091778e4c2e6e8ff753defc0cf853.scope: Consumed 4.534s CPU time, 16.4M memory peak, 0B memory swap peak. Nov 8 00:08:48.499432 systemd[1]: run-containerd-io.containerd.runtime.v2.task-k8s.io-69ff106255d4b6c604a0a08b2a9dc83d10e091778e4c2e6e8ff753defc0cf853-rootfs.mount: Deactivated successfully. Nov 8 00:08:48.515007 containerd[2009]: time="2025-11-08T00:08:48.514595627Z" level=info msg="shim disconnected" id=69ff106255d4b6c604a0a08b2a9dc83d10e091778e4c2e6e8ff753defc0cf853 namespace=k8s.io Nov 8 00:08:48.515007 containerd[2009]: time="2025-11-08T00:08:48.514838207Z" level=warning msg="cleaning up after shim disconnected" id=69ff106255d4b6c604a0a08b2a9dc83d10e091778e4c2e6e8ff753defc0cf853 namespace=k8s.io Nov 8 00:08:48.515007 containerd[2009]: time="2025-11-08T00:08:48.514863275Z" level=info msg="cleaning up dead shim" namespace=k8s.io Nov 8 00:08:48.653590 kubelet[3341]: E1108 00:08:48.653174 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"calico-csi\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ghcr.io/flatcar/calico/csi:v3.30.4: not found\", failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found\"]" pod="calico-system/csi-node-driver-8rk2x" podUID="0fc7336a-4c45-40ec-b634-101ce08e1be1" Nov 8 00:08:48.883225 kubelet[3341]: I1108 00:08:48.883178 3341 scope.go:117] "RemoveContainer" containerID="69ff106255d4b6c604a0a08b2a9dc83d10e091778e4c2e6e8ff753defc0cf853" Nov 8 00:08:48.887230 containerd[2009]: time="2025-11-08T00:08:48.887022301Z" level=info msg="CreateContainer within sandbox \"9a81a9be5deff120f3a0676587d694883728eeeb68c7d26a97af3f4fc1d821e2\" for container &ContainerMetadata{Name:kube-scheduler,Attempt:1,}" Nov 8 00:08:48.916160 containerd[2009]: time="2025-11-08T00:08:48.915991405Z" level=info msg="CreateContainer within sandbox \"9a81a9be5deff120f3a0676587d694883728eeeb68c7d26a97af3f4fc1d821e2\" for &ContainerMetadata{Name:kube-scheduler,Attempt:1,} returns container id \"9dc0add3f5592adf4d9ea7bccfaea0c13985d54cf2f97f3d4d822a289952271c\"" Nov 8 00:08:48.918294 containerd[2009]: time="2025-11-08T00:08:48.917024473Z" level=info msg="StartContainer for \"9dc0add3f5592adf4d9ea7bccfaea0c13985d54cf2f97f3d4d822a289952271c\"" Nov 8 00:08:48.981596 systemd[1]: Started cri-containerd-9dc0add3f5592adf4d9ea7bccfaea0c13985d54cf2f97f3d4d822a289952271c.scope - libcontainer container 9dc0add3f5592adf4d9ea7bccfaea0c13985d54cf2f97f3d4d822a289952271c. Nov 8 00:08:49.050930 containerd[2009]: time="2025-11-08T00:08:49.050858230Z" level=info msg="StartContainer for \"9dc0add3f5592adf4d9ea7bccfaea0c13985d54cf2f97f3d4d822a289952271c\" returns successfully" Nov 8 00:08:50.652569 kubelet[3341]: E1108 00:08:50.652395 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-kube-controllers\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found\"" pod="calico-system/calico-kube-controllers-7cc5d59f7b-q89cg" podUID="52f757de-0e18-4b03-af0a-9737e167b914" Nov 8 00:08:52.652071 kubelet[3341]: E1108 00:08:52.651997 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-66cbb68f69-hrrjm" podUID="68debac0-90fa-43fc-b6a2-614e4954f14e" Nov 8 00:08:53.657329 kubelet[3341]: E1108 00:08:53.657225 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"goldmane\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found\"" pod="calico-system/goldmane-666569f655-qlmhx" podUID="ac78d516-6696-4a76-a1b8-01b7e90766d4" Nov 8 00:08:54.542706 systemd[1]: cri-containerd-c2a1f9ad578981fb9e0d3fae02d459e74bd746bc3a3f8060088f6c692547bbf8.scope: Deactivated successfully. Nov 8 00:08:54.589693 systemd[1]: run-containerd-io.containerd.runtime.v2.task-k8s.io-c2a1f9ad578981fb9e0d3fae02d459e74bd746bc3a3f8060088f6c692547bbf8-rootfs.mount: Deactivated successfully. Nov 8 00:08:54.602300 containerd[2009]: time="2025-11-08T00:08:54.601944066Z" level=info msg="shim disconnected" id=c2a1f9ad578981fb9e0d3fae02d459e74bd746bc3a3f8060088f6c692547bbf8 namespace=k8s.io Nov 8 00:08:54.602300 containerd[2009]: time="2025-11-08T00:08:54.602021358Z" level=warning msg="cleaning up after shim disconnected" id=c2a1f9ad578981fb9e0d3fae02d459e74bd746bc3a3f8060088f6c692547bbf8 namespace=k8s.io Nov 8 00:08:54.602300 containerd[2009]: time="2025-11-08T00:08:54.602041398Z" level=info msg="cleaning up dead shim" namespace=k8s.io Nov 8 00:08:54.718485 kubelet[3341]: E1108 00:08:54.718394 3341 controller.go:195] "Failed to update lease" err="Put \"https://172.31.23.87:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-172-31-23-87?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 8 00:08:54.905429 kubelet[3341]: I1108 00:08:54.904905 3341 scope.go:117] "RemoveContainer" containerID="fdced88e2c26a58b82b0f0e3d741843118b2e2952995d15a51957b5a3d490e67" Nov 8 00:08:54.905963 kubelet[3341]: I1108 00:08:54.905898 3341 scope.go:117] "RemoveContainer" containerID="c2a1f9ad578981fb9e0d3fae02d459e74bd746bc3a3f8060088f6c692547bbf8" Nov 8 00:08:54.906303 kubelet[3341]: E1108 00:08:54.906217 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"tigera-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=tigera-operator pod=tigera-operator-7dcd859c48-mgbdf_tigera-operator(131b5a1e-bd2c-4b09-a735-feb68f8d5010)\"" pod="tigera-operator/tigera-operator-7dcd859c48-mgbdf" podUID="131b5a1e-bd2c-4b09-a735-feb68f8d5010" Nov 8 00:08:54.908596 containerd[2009]: time="2025-11-08T00:08:54.908549239Z" level=info msg="RemoveContainer for \"fdced88e2c26a58b82b0f0e3d741843118b2e2952995d15a51957b5a3d490e67\"" Nov 8 00:08:54.916326 containerd[2009]: time="2025-11-08T00:08:54.915830683Z" level=info msg="RemoveContainer for \"fdced88e2c26a58b82b0f0e3d741843118b2e2952995d15a51957b5a3d490e67\" returns successfully" Nov 8 00:08:56.652378 kubelet[3341]: E1108 00:08:56.652314 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-7cbbf6b44f-pntg9" podUID="886783b3-53d5-4894-8799-c2c145d125ce" Nov 8 00:08:59.652712 kubelet[3341]: E1108 00:08:59.652377 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-7cbbf6b44f-hrhmg" podUID="58f37ea9-b0c8-456a-8651-ebf3793b8679" Nov 8 00:09:00.652834 kubelet[3341]: E1108 00:09:00.652734 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"whisker\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found\", failed to \"StartContainer\" for \"whisker-backend\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found\"]" pod="calico-system/whisker-54bc667d85-4nldg" podUID="97a993f1-d70c-4bf6-ba46-4f0456d70b2e" Nov 8 00:09:01.652618 kubelet[3341]: E1108 00:09:01.652529 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-kube-controllers\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found\"" pod="calico-system/calico-kube-controllers-7cc5d59f7b-q89cg" podUID="52f757de-0e18-4b03-af0a-9737e167b914" Nov 8 00:09:03.653996 kubelet[3341]: E1108 00:09:03.653749 3341 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"calico-csi\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ghcr.io/flatcar/calico/csi:v3.30.4: not found\", failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found\"]" pod="calico-system/csi-node-driver-8rk2x" podUID="0fc7336a-4c45-40ec-b634-101ce08e1be1"