Nov 4 23:20:08.241117 kernel: Booting Linux on physical CPU 0x0000000000 [0x410fd083] Nov 4 23:20:08.241219 kernel: Linux version 6.12.54-flatcar (build@pony-truck.infra.kinvolk.io) (aarch64-cros-linux-gnu-gcc (Gentoo Hardened 14.3.1_p20250801 p4) 14.3.1 20250801, GNU ld (Gentoo 2.45 p3) 2.45.0) #1 SMP PREEMPT Tue Nov 4 22:00:29 -00 2025 Nov 4 23:20:08.241249 kernel: KASLR disabled due to lack of seed Nov 4 23:20:08.241273 kernel: efi: EFI v2.7 by EDK II Nov 4 23:20:08.241292 kernel: efi: SMBIOS=0x7bed0000 SMBIOS 3.0=0x7beb0000 ACPI=0x786e0000 ACPI 2.0=0x786e0014 MEMATTR=0x7a731a98 MEMRESERVE=0x78557598 Nov 4 23:20:08.241309 kernel: secureboot: Secure boot disabled Nov 4 23:20:08.241328 kernel: ACPI: Early table checksum verification disabled Nov 4 23:20:08.241345 kernel: ACPI: RSDP 0x00000000786E0014 000024 (v02 AMAZON) Nov 4 23:20:08.241363 kernel: ACPI: XSDT 0x00000000786D00E8 000064 (v01 AMAZON AMZNFACP 00000001 01000013) Nov 4 23:20:08.241386 kernel: ACPI: FACP 0x00000000786B0000 000114 (v06 AMAZON AMZNFACP 00000001 AMZN 00000001) Nov 4 23:20:08.241404 kernel: ACPI: DSDT 0x0000000078640000 00159D (v02 AMAZON AMZNDSDT 00000001 INTL 20160527) Nov 4 23:20:08.241420 kernel: ACPI: FACS 0x0000000078630000 000040 Nov 4 23:20:08.241437 kernel: ACPI: APIC 0x00000000786C0000 000108 (v04 AMAZON AMZNAPIC 00000001 AMZN 00000001) Nov 4 23:20:08.241454 kernel: ACPI: SPCR 0x00000000786A0000 000050 (v02 AMAZON AMZNSPCR 00000001 AMZN 00000001) Nov 4 23:20:08.241478 kernel: ACPI: GTDT 0x0000000078690000 000060 (v02 AMAZON AMZNGTDT 00000001 AMZN 00000001) Nov 4 23:20:08.241495 kernel: ACPI: MCFG 0x0000000078680000 00003C (v02 AMAZON AMZNMCFG 00000001 AMZN 00000001) Nov 4 23:20:08.241513 kernel: ACPI: SLIT 0x0000000078670000 00002D (v01 AMAZON AMZNSLIT 00000001 AMZN 00000001) Nov 4 23:20:08.241530 kernel: ACPI: IORT 0x0000000078660000 000078 (v01 AMAZON AMZNIORT 00000001 AMZN 00000001) Nov 4 23:20:08.241547 kernel: ACPI: PPTT 0x0000000078650000 0000EC (v01 AMAZON AMZNPPTT 00000001 AMZN 00000001) Nov 4 23:20:08.241564 kernel: ACPI: SPCR: console: uart,mmio,0x90a0000,115200 Nov 4 23:20:08.241581 kernel: earlycon: uart0 at MMIO 0x00000000090a0000 (options '115200') Nov 4 23:20:08.241598 kernel: printk: legacy bootconsole [uart0] enabled Nov 4 23:20:08.241615 kernel: ACPI: Use ACPI SPCR as default console: No Nov 4 23:20:08.241632 kernel: NUMA: Faking a node at [mem 0x0000000040000000-0x00000004b5ffffff] Nov 4 23:20:08.241654 kernel: NODE_DATA(0) allocated [mem 0x4b584da00-0x4b5854fff] Nov 4 23:20:08.241671 kernel: Zone ranges: Nov 4 23:20:08.241688 kernel: DMA [mem 0x0000000040000000-0x00000000ffffffff] Nov 4 23:20:08.241705 kernel: DMA32 empty Nov 4 23:20:08.241722 kernel: Normal [mem 0x0000000100000000-0x00000004b5ffffff] Nov 4 23:20:08.241739 kernel: Device empty Nov 4 23:20:08.241755 kernel: Movable zone start for each node Nov 4 23:20:08.241772 kernel: Early memory node ranges Nov 4 23:20:08.241789 kernel: node 0: [mem 0x0000000040000000-0x000000007862ffff] Nov 4 23:20:08.241805 kernel: node 0: [mem 0x0000000078630000-0x000000007863ffff] Nov 4 23:20:08.241822 kernel: node 0: [mem 0x0000000078640000-0x00000000786effff] Nov 4 23:20:08.241838 kernel: node 0: [mem 0x00000000786f0000-0x000000007872ffff] Nov 4 23:20:08.241862 kernel: node 0: [mem 0x0000000078730000-0x000000007bbfffff] Nov 4 23:20:08.241878 kernel: node 0: [mem 0x000000007bc00000-0x000000007bfdffff] Nov 4 23:20:08.241895 kernel: node 0: [mem 0x000000007bfe0000-0x000000007fffffff] Nov 4 23:20:08.241912 kernel: node 0: [mem 0x0000000400000000-0x00000004b5ffffff] Nov 4 23:20:08.241936 kernel: Initmem setup node 0 [mem 0x0000000040000000-0x00000004b5ffffff] Nov 4 23:20:08.241958 kernel: On node 0, zone Normal: 8192 pages in unavailable ranges Nov 4 23:20:08.241976 kernel: cma: Reserved 16 MiB at 0x000000007f000000 on node -1 Nov 4 23:20:08.241994 kernel: psci: probing for conduit method from ACPI. Nov 4 23:20:08.242012 kernel: psci: PSCIv1.0 detected in firmware. Nov 4 23:20:08.242029 kernel: psci: Using standard PSCI v0.2 function IDs Nov 4 23:20:08.242047 kernel: psci: Trusted OS migration not required Nov 4 23:20:08.242064 kernel: psci: SMC Calling Convention v1.1 Nov 4 23:20:08.242083 kernel: smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000001) Nov 4 23:20:08.242101 kernel: percpu: Embedded 33 pages/cpu s98200 r8192 d28776 u135168 Nov 4 23:20:08.242124 kernel: pcpu-alloc: s98200 r8192 d28776 u135168 alloc=33*4096 Nov 4 23:20:08.242142 kernel: pcpu-alloc: [0] 0 [0] 1 Nov 4 23:20:08.242219 kernel: Detected PIPT I-cache on CPU0 Nov 4 23:20:08.242240 kernel: CPU features: detected: GIC system register CPU interface Nov 4 23:20:08.242258 kernel: CPU features: detected: Spectre-v2 Nov 4 23:20:08.242276 kernel: CPU features: detected: Spectre-v3a Nov 4 23:20:08.242294 kernel: CPU features: detected: Spectre-BHB Nov 4 23:20:08.242312 kernel: CPU features: detected: ARM erratum 1742098 Nov 4 23:20:08.242330 kernel: CPU features: detected: ARM errata 1165522, 1319367, or 1530923 Nov 4 23:20:08.242348 kernel: alternatives: applying boot alternatives Nov 4 23:20:08.242368 kernel: Kernel command line: BOOT_IMAGE=/flatcar/vmlinuz-a mount.usr=/dev/mapper/usr verity.usr=PARTUUID=7130c94a-213a-4e5a-8e26-6cce9662f132 rootflags=rw mount.usrflags=ro consoleblank=0 root=LABEL=ROOT console=tty1 console=ttyS0,115200n8 earlycon flatcar.first_boot=detected acpi=force flatcar.oem.id=ec2 modprobe.blacklist=xen_fbfront net.ifnames=0 nvme_core.io_timeout=4294967295 verity.usrhash=f5fad2f14ba33eafa636a02c130b28d1e2865e3fd8b50e1d7ad0f6eb8ba09fec Nov 4 23:20:08.242398 kernel: Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) Nov 4 23:20:08.242416 kernel: Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) Nov 4 23:20:08.242434 kernel: Fallback order for Node 0: 0 Nov 4 23:20:08.242452 kernel: Built 1 zonelists, mobility grouping on. Total pages: 1007616 Nov 4 23:20:08.242470 kernel: Policy zone: Normal Nov 4 23:20:08.242487 kernel: mem auto-init: stack:off, heap alloc:off, heap free:off Nov 4 23:20:08.242505 kernel: software IO TLB: area num 2. Nov 4 23:20:08.242524 kernel: software IO TLB: mapped [mem 0x000000006f800000-0x0000000073800000] (64MB) Nov 4 23:20:08.242542 kernel: SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=2, Nodes=1 Nov 4 23:20:08.242559 kernel: rcu: Preemptible hierarchical RCU implementation. Nov 4 23:20:08.242584 kernel: rcu: RCU event tracing is enabled. Nov 4 23:20:08.242603 kernel: rcu: RCU restricting CPUs from NR_CPUS=512 to nr_cpu_ids=2. Nov 4 23:20:08.242621 kernel: Trampoline variant of Tasks RCU enabled. Nov 4 23:20:08.242639 kernel: Tracing variant of Tasks RCU enabled. Nov 4 23:20:08.242657 kernel: rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. Nov 4 23:20:08.242675 kernel: rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=2 Nov 4 23:20:08.242693 kernel: RCU Tasks: Setting shift to 1 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=2. Nov 4 23:20:08.242711 kernel: RCU Tasks Trace: Setting shift to 1 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=2. Nov 4 23:20:08.242729 kernel: NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 Nov 4 23:20:08.242747 kernel: GICv3: 96 SPIs implemented Nov 4 23:20:08.242764 kernel: GICv3: 0 Extended SPIs implemented Nov 4 23:20:08.242787 kernel: Root IRQ handler: gic_handle_irq Nov 4 23:20:08.242804 kernel: GICv3: GICv3 features: 16 PPIs Nov 4 23:20:08.242821 kernel: GICv3: GICD_CTRL.DS=1, SCR_EL3.FIQ=0 Nov 4 23:20:08.242838 kernel: GICv3: CPU0: found redistributor 0 region 0:0x0000000010200000 Nov 4 23:20:08.242856 kernel: ITS [mem 0x10080000-0x1009ffff] Nov 4 23:20:08.242874 kernel: ITS@0x0000000010080000: allocated 8192 Devices @4000f0000 (indirect, esz 8, psz 64K, shr 1) Nov 4 23:20:08.242892 kernel: ITS@0x0000000010080000: allocated 8192 Interrupt Collections @400100000 (flat, esz 8, psz 64K, shr 1) Nov 4 23:20:08.242909 kernel: GICv3: using LPI property table @0x0000000400110000 Nov 4 23:20:08.242927 kernel: ITS: Using hypervisor restricted LPI range [128] Nov 4 23:20:08.242945 kernel: GICv3: CPU0: using allocated LPI pending table @0x0000000400120000 Nov 4 23:20:08.242963 kernel: rcu: srcu_init: Setting srcu_struct sizes based on contention. Nov 4 23:20:08.242988 kernel: arch_timer: cp15 timer(s) running at 83.33MHz (virt). Nov 4 23:20:08.243006 kernel: clocksource: arch_sys_counter: mask: 0x1ffffffffffffff max_cycles: 0x13381ebeec, max_idle_ns: 440795203145 ns Nov 4 23:20:08.243024 kernel: sched_clock: 57 bits at 83MHz, resolution 12ns, wraps every 4398046511100ns Nov 4 23:20:08.243042 kernel: Console: colour dummy device 80x25 Nov 4 23:20:08.243061 kernel: printk: legacy console [tty1] enabled Nov 4 23:20:08.243080 kernel: ACPI: Core revision 20240827 Nov 4 23:20:08.243099 kernel: Calibrating delay loop (skipped), value calculated using timer frequency.. 166.66 BogoMIPS (lpj=83333) Nov 4 23:20:08.243117 kernel: pid_max: default: 32768 minimum: 301 Nov 4 23:20:08.243141 kernel: LSM: initializing lsm=lockdown,capability,landlock,selinux,ima Nov 4 23:20:08.243200 kernel: landlock: Up and running. Nov 4 23:20:08.243220 kernel: SELinux: Initializing. Nov 4 23:20:08.243239 kernel: Mount-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) Nov 4 23:20:08.243258 kernel: Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) Nov 4 23:20:08.243276 kernel: rcu: Hierarchical SRCU implementation. Nov 4 23:20:08.243296 kernel: rcu: Max phase no-delay instances is 400. Nov 4 23:20:08.243314 kernel: Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level Nov 4 23:20:08.243342 kernel: Remapping and enabling EFI services. Nov 4 23:20:08.243361 kernel: smp: Bringing up secondary CPUs ... Nov 4 23:20:08.243379 kernel: Detected PIPT I-cache on CPU1 Nov 4 23:20:08.243397 kernel: GICv3: CPU1: found redistributor 1 region 0:0x0000000010220000 Nov 4 23:20:08.243416 kernel: GICv3: CPU1: using allocated LPI pending table @0x0000000400130000 Nov 4 23:20:08.243434 kernel: CPU1: Booted secondary processor 0x0000000001 [0x410fd083] Nov 4 23:20:08.243452 kernel: smp: Brought up 1 node, 2 CPUs Nov 4 23:20:08.243476 kernel: SMP: Total of 2 processors activated. Nov 4 23:20:08.243494 kernel: CPU: All CPU(s) started at EL1 Nov 4 23:20:08.243524 kernel: CPU features: detected: 32-bit EL0 Support Nov 4 23:20:08.243547 kernel: CPU features: detected: 32-bit EL1 Support Nov 4 23:20:08.243566 kernel: CPU features: detected: CRC32 instructions Nov 4 23:20:08.243585 kernel: alternatives: applying system-wide alternatives Nov 4 23:20:08.243606 kernel: Memory: 3822892K/4030464K available (11136K kernel code, 2456K rwdata, 9084K rodata, 13056K init, 1038K bss, 186228K reserved, 16384K cma-reserved) Nov 4 23:20:08.243626 kernel: devtmpfs: initialized Nov 4 23:20:08.243651 kernel: clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns Nov 4 23:20:08.243670 kernel: futex hash table entries: 512 (order: 3, 32768 bytes, linear) Nov 4 23:20:08.243690 kernel: 23520 pages in range for non-PLT usage Nov 4 23:20:08.243709 kernel: 515040 pages in range for PLT usage Nov 4 23:20:08.243728 kernel: pinctrl core: initialized pinctrl subsystem Nov 4 23:20:08.243751 kernel: SMBIOS 3.0.0 present. Nov 4 23:20:08.243771 kernel: DMI: Amazon EC2 a1.large/, BIOS 1.0 11/1/2018 Nov 4 23:20:08.243790 kernel: DMI: Memory slots populated: 0/0 Nov 4 23:20:08.243809 kernel: NET: Registered PF_NETLINK/PF_ROUTE protocol family Nov 4 23:20:08.243828 kernel: DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations Nov 4 23:20:08.243847 kernel: DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations Nov 4 23:20:08.243867 kernel: DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations Nov 4 23:20:08.243891 kernel: audit: initializing netlink subsys (disabled) Nov 4 23:20:08.243911 kernel: audit: type=2000 audit(0.225:1): state=initialized audit_enabled=0 res=1 Nov 4 23:20:08.243930 kernel: thermal_sys: Registered thermal governor 'step_wise' Nov 4 23:20:08.243948 kernel: cpuidle: using governor menu Nov 4 23:20:08.243968 kernel: hw-breakpoint: found 6 breakpoint and 4 watchpoint registers. Nov 4 23:20:08.243988 kernel: ASID allocator initialised with 65536 entries Nov 4 23:20:08.244009 kernel: acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 Nov 4 23:20:08.244033 kernel: Serial: AMBA PL011 UART driver Nov 4 23:20:08.244052 kernel: HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages Nov 4 23:20:08.244071 kernel: HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page Nov 4 23:20:08.244092 kernel: HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages Nov 4 23:20:08.244111 kernel: HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page Nov 4 23:20:08.244130 kernel: HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages Nov 4 23:20:08.244179 kernel: HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page Nov 4 23:20:08.244217 kernel: HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages Nov 4 23:20:08.244239 kernel: HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page Nov 4 23:20:08.244258 kernel: ACPI: Added _OSI(Module Device) Nov 4 23:20:08.244277 kernel: ACPI: Added _OSI(Processor Device) Nov 4 23:20:08.244297 kernel: ACPI: Added _OSI(Processor Aggregator Device) Nov 4 23:20:08.244316 kernel: ACPI: 1 ACPI AML tables successfully acquired and loaded Nov 4 23:20:08.244335 kernel: ACPI: Interpreter enabled Nov 4 23:20:08.244359 kernel: ACPI: Using GIC for interrupt routing Nov 4 23:20:08.244378 kernel: ACPI: MCFG table detected, 1 entries Nov 4 23:20:08.244397 kernel: ACPI: CPU0 has been hot-added Nov 4 23:20:08.244416 kernel: ACPI: CPU1 has been hot-added Nov 4 23:20:08.244435 kernel: ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-0f]) Nov 4 23:20:08.244892 kernel: acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] Nov 4 23:20:08.245242 kernel: acpi PNP0A08:00: _OSC: platform does not support [LTR] Nov 4 23:20:08.245566 kernel: acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME AER PCIeCapability] Nov 4 23:20:08.245855 kernel: acpi PNP0A08:00: ECAM area [mem 0x20000000-0x20ffffff] reserved by PNP0C02:00 Nov 4 23:20:08.246136 kernel: acpi PNP0A08:00: ECAM at [mem 0x20000000-0x20ffffff] for [bus 00-0f] Nov 4 23:20:08.246201 kernel: ACPI: Remapped I/O 0x000000001fff0000 to [io 0x0000-0xffff window] Nov 4 23:20:08.246224 kernel: acpiphp: Slot [1] registered Nov 4 23:20:08.246244 kernel: acpiphp: Slot [2] registered Nov 4 23:20:08.246276 kernel: acpiphp: Slot [3] registered Nov 4 23:20:08.246296 kernel: acpiphp: Slot [4] registered Nov 4 23:20:08.246316 kernel: acpiphp: Slot [5] registered Nov 4 23:20:08.246335 kernel: acpiphp: Slot [6] registered Nov 4 23:20:08.246354 kernel: acpiphp: Slot [7] registered Nov 4 23:20:08.246373 kernel: acpiphp: Slot [8] registered Nov 4 23:20:08.246393 kernel: acpiphp: Slot [9] registered Nov 4 23:20:08.246412 kernel: acpiphp: Slot [10] registered Nov 4 23:20:08.246437 kernel: acpiphp: Slot [11] registered Nov 4 23:20:08.246456 kernel: acpiphp: Slot [12] registered Nov 4 23:20:08.246475 kernel: acpiphp: Slot [13] registered Nov 4 23:20:08.246494 kernel: acpiphp: Slot [14] registered Nov 4 23:20:08.246513 kernel: acpiphp: Slot [15] registered Nov 4 23:20:08.246532 kernel: acpiphp: Slot [16] registered Nov 4 23:20:08.246551 kernel: acpiphp: Slot [17] registered Nov 4 23:20:08.246574 kernel: acpiphp: Slot [18] registered Nov 4 23:20:08.246593 kernel: acpiphp: Slot [19] registered Nov 4 23:20:08.246612 kernel: acpiphp: Slot [20] registered Nov 4 23:20:08.246631 kernel: acpiphp: Slot [21] registered Nov 4 23:20:08.246651 kernel: acpiphp: Slot [22] registered Nov 4 23:20:08.246670 kernel: acpiphp: Slot [23] registered Nov 4 23:20:08.246689 kernel: acpiphp: Slot [24] registered Nov 4 23:20:08.246712 kernel: acpiphp: Slot [25] registered Nov 4 23:20:08.246731 kernel: acpiphp: Slot [26] registered Nov 4 23:20:08.246750 kernel: acpiphp: Slot [27] registered Nov 4 23:20:08.246769 kernel: acpiphp: Slot [28] registered Nov 4 23:20:08.246788 kernel: acpiphp: Slot [29] registered Nov 4 23:20:08.246806 kernel: acpiphp: Slot [30] registered Nov 4 23:20:08.246825 kernel: acpiphp: Slot [31] registered Nov 4 23:20:08.246844 kernel: PCI host bridge to bus 0000:00 Nov 4 23:20:08.247252 kernel: pci_bus 0000:00: root bus resource [mem 0x80000000-0xffffffff window] Nov 4 23:20:08.247537 kernel: pci_bus 0000:00: root bus resource [io 0x0000-0xffff window] Nov 4 23:20:08.247785 kernel: pci_bus 0000:00: root bus resource [mem 0x400000000000-0x407fffffffff window] Nov 4 23:20:08.248033 kernel: pci_bus 0000:00: root bus resource [bus 00-0f] Nov 4 23:20:08.248405 kernel: pci 0000:00:00.0: [1d0f:0200] type 00 class 0x060000 conventional PCI endpoint Nov 4 23:20:08.248784 kernel: pci 0000:00:01.0: [1d0f:8250] type 00 class 0x070003 conventional PCI endpoint Nov 4 23:20:08.249084 kernel: pci 0000:00:01.0: BAR 0 [mem 0x80118000-0x80118fff] Nov 4 23:20:08.249441 kernel: pci 0000:00:04.0: [1d0f:8061] type 00 class 0x010802 PCIe Root Complex Integrated Endpoint Nov 4 23:20:08.249762 kernel: pci 0000:00:04.0: BAR 0 [mem 0x80114000-0x80117fff] Nov 4 23:20:08.250055 kernel: pci 0000:00:04.0: PME# supported from D0 D1 D2 D3hot D3cold Nov 4 23:20:08.250403 kernel: pci 0000:00:05.0: [1d0f:ec20] type 00 class 0x020000 PCIe Root Complex Integrated Endpoint Nov 4 23:20:08.250692 kernel: pci 0000:00:05.0: BAR 0 [mem 0x80110000-0x80113fff] Nov 4 23:20:08.250979 kernel: pci 0000:00:05.0: BAR 2 [mem 0x80000000-0x800fffff pref] Nov 4 23:20:08.251331 kernel: pci 0000:00:05.0: BAR 4 [mem 0x80100000-0x8010ffff] Nov 4 23:20:08.251643 kernel: pci 0000:00:05.0: PME# supported from D0 D1 D2 D3hot D3cold Nov 4 23:20:08.251942 kernel: pci 0000:00:05.0: BAR 2 [mem 0x80000000-0x800fffff pref]: assigned Nov 4 23:20:08.252292 kernel: pci 0000:00:05.0: BAR 4 [mem 0x80100000-0x8010ffff]: assigned Nov 4 23:20:08.252628 kernel: pci 0000:00:04.0: BAR 0 [mem 0x80110000-0x80113fff]: assigned Nov 4 23:20:08.252936 kernel: pci 0000:00:05.0: BAR 0 [mem 0x80114000-0x80117fff]: assigned Nov 4 23:20:08.253320 kernel: pci 0000:00:01.0: BAR 0 [mem 0x80118000-0x80118fff]: assigned Nov 4 23:20:08.253589 kernel: pci_bus 0000:00: resource 4 [mem 0x80000000-0xffffffff window] Nov 4 23:20:08.253842 kernel: pci_bus 0000:00: resource 5 [io 0x0000-0xffff window] Nov 4 23:20:08.254124 kernel: pci_bus 0000:00: resource 6 [mem 0x400000000000-0x407fffffffff window] Nov 4 23:20:08.254212 kernel: ACPI: PCI: Interrupt link GSI0 configured for IRQ 35 Nov 4 23:20:08.254237 kernel: ACPI: PCI: Interrupt link GSI1 configured for IRQ 36 Nov 4 23:20:08.254258 kernel: ACPI: PCI: Interrupt link GSI2 configured for IRQ 37 Nov 4 23:20:08.254278 kernel: ACPI: PCI: Interrupt link GSI3 configured for IRQ 38 Nov 4 23:20:08.254299 kernel: iommu: Default domain type: Translated Nov 4 23:20:08.254319 kernel: iommu: DMA domain TLB invalidation policy: strict mode Nov 4 23:20:08.254351 kernel: efivars: Registered efivars operations Nov 4 23:20:08.254372 kernel: vgaarb: loaded Nov 4 23:20:08.254392 kernel: clocksource: Switched to clocksource arch_sys_counter Nov 4 23:20:08.254412 kernel: VFS: Disk quotas dquot_6.6.0 Nov 4 23:20:08.254432 kernel: VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) Nov 4 23:20:08.254451 kernel: pnp: PnP ACPI init Nov 4 23:20:08.254797 kernel: system 00:00: [mem 0x20000000-0x2fffffff] could not be reserved Nov 4 23:20:08.254846 kernel: pnp: PnP ACPI: found 1 devices Nov 4 23:20:08.254867 kernel: NET: Registered PF_INET protocol family Nov 4 23:20:08.254888 kernel: IP idents hash table entries: 65536 (order: 7, 524288 bytes, linear) Nov 4 23:20:08.254910 kernel: tcp_listen_portaddr_hash hash table entries: 2048 (order: 3, 32768 bytes, linear) Nov 4 23:20:08.254930 kernel: Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) Nov 4 23:20:08.254950 kernel: TCP established hash table entries: 32768 (order: 6, 262144 bytes, linear) Nov 4 23:20:08.254970 kernel: TCP bind hash table entries: 32768 (order: 8, 1048576 bytes, linear) Nov 4 23:20:08.254994 kernel: TCP: Hash tables configured (established 32768 bind 32768) Nov 4 23:20:08.255013 kernel: UDP hash table entries: 2048 (order: 4, 65536 bytes, linear) Nov 4 23:20:08.255034 kernel: UDP-Lite hash table entries: 2048 (order: 4, 65536 bytes, linear) Nov 4 23:20:08.255055 kernel: NET: Registered PF_UNIX/PF_LOCAL protocol family Nov 4 23:20:08.255078 kernel: PCI: CLS 0 bytes, default 64 Nov 4 23:20:08.255099 kernel: kvm [1]: HYP mode not available Nov 4 23:20:08.255119 kernel: Initialise system trusted keyrings Nov 4 23:20:08.255144 kernel: workingset: timestamp_bits=39 max_order=20 bucket_order=0 Nov 4 23:20:08.255212 kernel: Key type asymmetric registered Nov 4 23:20:08.255234 kernel: Asymmetric key parser 'x509' registered Nov 4 23:20:08.255255 kernel: Block layer SCSI generic (bsg) driver version 0.4 loaded (major 249) Nov 4 23:20:08.255275 kernel: io scheduler mq-deadline registered Nov 4 23:20:08.255295 kernel: io scheduler kyber registered Nov 4 23:20:08.255314 kernel: io scheduler bfq registered Nov 4 23:20:08.255677 kernel: pl061_gpio ARMH0061:00: PL061 GPIO chip registered Nov 4 23:20:08.255715 kernel: input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 Nov 4 23:20:08.255736 kernel: ACPI: button: Power Button [PWRB] Nov 4 23:20:08.255757 kernel: input: Sleep Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0E:00/input/input1 Nov 4 23:20:08.255777 kernel: ACPI: button: Sleep Button [SLPB] Nov 4 23:20:08.255797 kernel: Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled Nov 4 23:20:08.255828 kernel: ACPI: \_SB_.PCI0.GSI2: Enabled at IRQ 37 Nov 4 23:20:08.256130 kernel: serial 0000:00:01.0: enabling device (0010 -> 0012) Nov 4 23:20:08.256215 kernel: printk: legacy console [ttyS0] disabled Nov 4 23:20:08.256238 kernel: 0000:00:01.0: ttyS0 at MMIO 0x80118000 (irq = 14, base_baud = 115200) is a 16550A Nov 4 23:20:08.256258 kernel: printk: legacy console [ttyS0] enabled Nov 4 23:20:08.256277 kernel: printk: legacy bootconsole [uart0] disabled Nov 4 23:20:08.256296 kernel: thunder_xcv, ver 1.0 Nov 4 23:20:08.256328 kernel: thunder_bgx, ver 1.0 Nov 4 23:20:08.256348 kernel: nicpf, ver 1.0 Nov 4 23:20:08.256367 kernel: nicvf, ver 1.0 Nov 4 23:20:08.256735 kernel: rtc-efi rtc-efi.0: registered as rtc0 Nov 4 23:20:08.257026 kernel: rtc-efi rtc-efi.0: setting system clock to 2025-11-04T23:20:04 UTC (1762298404) Nov 4 23:20:08.257058 kernel: hid: raw HID events driver (C) Jiri Kosina Nov 4 23:20:08.257079 kernel: hw perfevents: enabled with armv8_pmuv3_0 PMU driver, 3 (0,80000003) counters available Nov 4 23:20:08.257111 kernel: NET: Registered PF_INET6 protocol family Nov 4 23:20:08.257131 kernel: watchdog: NMI not fully supported Nov 4 23:20:08.257189 kernel: watchdog: Hard watchdog permanently disabled Nov 4 23:20:08.257215 kernel: Segment Routing with IPv6 Nov 4 23:20:08.257235 kernel: In-situ OAM (IOAM) with IPv6 Nov 4 23:20:08.257255 kernel: NET: Registered PF_PACKET protocol family Nov 4 23:20:08.257274 kernel: Key type dns_resolver registered Nov 4 23:20:08.257304 kernel: registered taskstats version 1 Nov 4 23:20:08.257324 kernel: Loading compiled-in X.509 certificates Nov 4 23:20:08.257343 kernel: Loaded X.509 cert 'Kinvolk GmbH: Module signing key for 6.12.54-flatcar: b9a783989f22a1b93da669ffd1529a2a9e0c2420' Nov 4 23:20:08.257363 kernel: Demotion targets for Node 0: null Nov 4 23:20:08.257382 kernel: Key type .fscrypt registered Nov 4 23:20:08.257401 kernel: Key type fscrypt-provisioning registered Nov 4 23:20:08.257420 kernel: ima: No TPM chip found, activating TPM-bypass! Nov 4 23:20:08.257445 kernel: ima: Allocated hash algorithm: sha1 Nov 4 23:20:08.257465 kernel: ima: No architecture policies found Nov 4 23:20:08.257484 kernel: alg: No test for fips(ansi_cprng) (fips_ansi_cprng) Nov 4 23:20:08.257503 kernel: clk: Disabling unused clocks Nov 4 23:20:08.257522 kernel: PM: genpd: Disabling unused power domains Nov 4 23:20:08.257541 kernel: Freeing unused kernel memory: 13056K Nov 4 23:20:08.257560 kernel: Run /init as init process Nov 4 23:20:08.257583 kernel: with arguments: Nov 4 23:20:08.257603 kernel: /init Nov 4 23:20:08.257621 kernel: with environment: Nov 4 23:20:08.257640 kernel: HOME=/ Nov 4 23:20:08.257659 kernel: TERM=linux Nov 4 23:20:08.257679 kernel: ACPI: \_SB_.PCI0.GSI0: Enabled at IRQ 35 Nov 4 23:20:08.258012 kernel: nvme nvme0: pci function 0000:00:04.0 Nov 4 23:20:08.258325 kernel: nvme nvme0: 2/0/0 default/read/poll queues Nov 4 23:20:08.258365 kernel: GPT:Primary header thinks Alt. header is not at the end of the disk. Nov 4 23:20:08.258385 kernel: GPT:25804799 != 33554431 Nov 4 23:20:08.258404 kernel: GPT:Alternate GPT header not at the end of the disk. Nov 4 23:20:08.258424 kernel: GPT:25804799 != 33554431 Nov 4 23:20:08.258443 kernel: GPT: Use GNU Parted to correct GPT errors. Nov 4 23:20:08.258462 kernel: nvme0n1: p1 p2 p3 p4 p6 p7 p9 Nov 4 23:20:08.258492 kernel: SCSI subsystem initialized Nov 4 23:20:08.258512 kernel: device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. Nov 4 23:20:08.258532 kernel: device-mapper: uevent: version 1.0.3 Nov 4 23:20:08.258552 kernel: device-mapper: ioctl: 4.48.0-ioctl (2023-03-01) initialised: dm-devel@lists.linux.dev Nov 4 23:20:08.258572 kernel: device-mapper: verity: sha256 using shash "sha256-ce" Nov 4 23:20:08.258592 kernel: raid6: neonx8 gen() 6603 MB/s Nov 4 23:20:08.258611 kernel: raid6: neonx4 gen() 6534 MB/s Nov 4 23:20:08.258636 kernel: raid6: neonx2 gen() 5374 MB/s Nov 4 23:20:08.258656 kernel: raid6: neonx1 gen() 3933 MB/s Nov 4 23:20:08.258675 kernel: raid6: int64x8 gen() 3676 MB/s Nov 4 23:20:08.258694 kernel: raid6: int64x4 gen() 3692 MB/s Nov 4 23:20:08.258714 kernel: raid6: int64x2 gen() 3577 MB/s Nov 4 23:20:08.258734 kernel: raid6: int64x1 gen() 2753 MB/s Nov 4 23:20:08.258753 kernel: raid6: using algorithm neonx8 gen() 6603 MB/s Nov 4 23:20:08.258779 kernel: raid6: .... xor() 4732 MB/s, rmw enabled Nov 4 23:20:08.258798 kernel: raid6: using neon recovery algorithm Nov 4 23:20:08.258818 kernel: xor: measuring software checksum speed Nov 4 23:20:08.258838 kernel: 8regs : 12368 MB/sec Nov 4 23:20:08.258858 kernel: 32regs : 12325 MB/sec Nov 4 23:20:08.258877 kernel: arm64_neon : 9070 MB/sec Nov 4 23:20:08.258898 kernel: xor: using function: 8regs (12368 MB/sec) Nov 4 23:20:08.258925 kernel: Btrfs loaded, zoned=no, fsverity=no Nov 4 23:20:08.258945 kernel: BTRFS: device fsid 3945a319-ac24-4f41-92d0-9c29c05b835d devid 1 transid 36 /dev/mapper/usr (254:0) scanned by mount (221) Nov 4 23:20:08.258965 kernel: BTRFS info (device dm-0): first mount of filesystem 3945a319-ac24-4f41-92d0-9c29c05b835d Nov 4 23:20:08.258985 kernel: BTRFS info (device dm-0): using crc32c (crc32c-generic) checksum algorithm Nov 4 23:20:08.259004 kernel: BTRFS info (device dm-0): enabling ssd optimizations Nov 4 23:20:08.259024 kernel: BTRFS info (device dm-0): disabling log replay at mount time Nov 4 23:20:08.259043 kernel: BTRFS info (device dm-0): enabling free space tree Nov 4 23:20:08.259068 kernel: loop: module loaded Nov 4 23:20:08.259088 kernel: loop0: detected capacity change from 0 to 91464 Nov 4 23:20:08.259107 kernel: squashfs: version 4.0 (2009/01/31) Phillip Lougher Nov 4 23:20:08.259129 systemd[1]: Successfully made /usr/ read-only. Nov 4 23:20:08.259200 systemd[1]: systemd 257.7 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +IPE +SMACK +SECCOMP -GCRYPT -GNUTLS +OPENSSL -ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 -PWQUALITY -P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP -SYSVINIT +LIBARCHIVE) Nov 4 23:20:08.259228 systemd[1]: Detected virtualization amazon. Nov 4 23:20:08.259258 systemd[1]: Detected architecture arm64. Nov 4 23:20:08.259281 systemd[1]: Running in initrd. Nov 4 23:20:08.259302 systemd[1]: No hostname configured, using default hostname. Nov 4 23:20:08.259323 systemd[1]: Hostname set to . Nov 4 23:20:08.259344 systemd[1]: Initializing machine ID from SMBIOS/DMI UUID. Nov 4 23:20:08.259365 systemd[1]: Queued start job for default target initrd.target. Nov 4 23:20:08.259403 systemd[1]: Unnecessary job was removed for dev-mapper-usr.device - /dev/mapper/usr. Nov 4 23:20:08.259430 systemd[1]: Started clevis-luks-askpass.path - Forward Password Requests to Clevis Directory Watch. Nov 4 23:20:08.259452 systemd[1]: Started systemd-ask-password-console.path - Dispatch Password Requests to Console Directory Watch. Nov 4 23:20:08.259476 systemd[1]: Expecting device dev-disk-by\x2dlabel-EFI\x2dSYSTEM.device - /dev/disk/by-label/EFI-SYSTEM... Nov 4 23:20:08.259499 systemd[1]: Expecting device dev-disk-by\x2dlabel-OEM.device - /dev/disk/by-label/OEM... Nov 4 23:20:08.259526 systemd[1]: Expecting device dev-disk-by\x2dlabel-ROOT.device - /dev/disk/by-label/ROOT... Nov 4 23:20:08.259549 systemd[1]: Expecting device dev-disk-by\x2dpartlabel-USR\x2dA.device - /dev/disk/by-partlabel/USR-A... Nov 4 23:20:08.259572 systemd[1]: Reached target cryptsetup-pre.target - Local Encrypted Volumes (Pre). Nov 4 23:20:08.259594 systemd[1]: Reached target cryptsetup.target - Local Encrypted Volumes. Nov 4 23:20:08.259616 systemd[1]: Reached target initrd-usr-fs.target - Initrd /usr File System. Nov 4 23:20:08.259638 systemd[1]: Reached target paths.target - Path Units. Nov 4 23:20:08.259665 systemd[1]: Reached target slices.target - Slice Units. Nov 4 23:20:08.259687 systemd[1]: Reached target swap.target - Swaps. Nov 4 23:20:08.259709 systemd[1]: Reached target timers.target - Timer Units. Nov 4 23:20:08.259731 systemd[1]: Listening on iscsid.socket - Open-iSCSI iscsid Socket. Nov 4 23:20:08.259753 systemd[1]: Listening on iscsiuio.socket - Open-iSCSI iscsiuio Socket. Nov 4 23:20:08.259775 systemd[1]: Listening on systemd-journald-dev-log.socket - Journal Socket (/dev/log). Nov 4 23:20:08.259797 systemd[1]: Listening on systemd-journald.socket - Journal Sockets. Nov 4 23:20:08.259825 systemd[1]: Listening on systemd-networkd.socket - Network Service Netlink Socket. Nov 4 23:20:08.259847 systemd[1]: Listening on systemd-udevd-control.socket - udev Control Socket. Nov 4 23:20:08.259869 systemd[1]: Listening on systemd-udevd-kernel.socket - udev Kernel Socket. Nov 4 23:20:08.259890 systemd[1]: Reached target sockets.target - Socket Units. Nov 4 23:20:08.259914 systemd[1]: afterburn-network-kargs.service - Afterburn Initrd Setup Network Kernel Arguments was skipped because no trigger condition checks were met. Nov 4 23:20:08.259935 systemd[1]: Starting ignition-setup-pre.service - Ignition env setup... Nov 4 23:20:08.259958 systemd[1]: Starting kmod-static-nodes.service - Create List of Static Device Nodes... Nov 4 23:20:08.259984 systemd[1]: Finished network-cleanup.service - Network Cleanup. Nov 4 23:20:08.260007 systemd[1]: systemd-battery-check.service - Check battery level during early boot was skipped because of an unmet condition check (ConditionDirectoryNotEmpty=/sys/class/power_supply). Nov 4 23:20:08.260029 systemd[1]: Starting systemd-fsck-usr.service... Nov 4 23:20:08.260055 systemd[1]: Starting systemd-journald.service - Journal Service... Nov 4 23:20:08.260082 systemd[1]: Starting systemd-modules-load.service - Load Kernel Modules... Nov 4 23:20:08.260104 systemd[1]: Starting systemd-vconsole-setup.service - Virtual Console Setup... Nov 4 23:20:08.260127 systemd[1]: Finished ignition-setup-pre.service - Ignition env setup. Nov 4 23:20:08.260190 systemd[1]: Finished kmod-static-nodes.service - Create List of Static Device Nodes. Nov 4 23:20:08.260219 systemd[1]: Starting systemd-tmpfiles-setup-dev-early.service - Create Static Device Nodes in /dev gracefully... Nov 4 23:20:08.260242 systemd[1]: Finished systemd-fsck-usr.service. Nov 4 23:20:08.260264 kernel: bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this. Nov 4 23:20:08.260285 kernel: Bridge firewalling registered Nov 4 23:20:08.260383 systemd-journald[360]: Collecting audit messages is disabled. Nov 4 23:20:08.260440 systemd[1]: Finished systemd-tmpfiles-setup-dev-early.service - Create Static Device Nodes in /dev gracefully. Nov 4 23:20:08.260464 systemd[1]: Finished systemd-modules-load.service - Load Kernel Modules. Nov 4 23:20:08.260509 systemd-journald[360]: Journal started Nov 4 23:20:08.260552 systemd-journald[360]: Runtime Journal (/run/log/journal/ec260cb872ada63abbad8bd883682ff2) is 8M, max 75.3M, 67.3M free. Nov 4 23:20:08.234960 systemd-modules-load[362]: Inserted module 'br_netfilter' Nov 4 23:20:08.275512 systemd[1]: Started systemd-journald.service - Journal Service. Nov 4 23:20:08.282473 systemd[1]: Starting systemd-sysctl.service - Apply Kernel Variables... Nov 4 23:20:08.289060 systemd[1]: Starting systemd-tmpfiles-setup-dev.service - Create Static Device Nodes in /dev... Nov 4 23:20:08.296881 systemd[1]: Starting systemd-tmpfiles-setup.service - Create System Files and Directories... Nov 4 23:20:08.341586 systemd[1]: Finished systemd-sysctl.service - Apply Kernel Variables. Nov 4 23:20:08.346310 systemd-tmpfiles[379]: /usr/lib/tmpfiles.d/var.conf:14: Duplicate line for path "/var/log", ignoring. Nov 4 23:20:08.360450 systemd[1]: Finished systemd-vconsole-setup.service - Virtual Console Setup. Nov 4 23:20:08.370901 systemd[1]: Finished systemd-tmpfiles-setup-dev.service - Create Static Device Nodes in /dev. Nov 4 23:20:08.380400 systemd[1]: Finished systemd-tmpfiles-setup.service - Create System Files and Directories. Nov 4 23:20:08.388399 systemd[1]: Starting dracut-cmdline-ask.service - dracut ask for additional cmdline parameters... Nov 4 23:20:08.402531 systemd[1]: Starting systemd-resolved.service - Network Name Resolution... Nov 4 23:20:08.434547 systemd[1]: Finished dracut-cmdline-ask.service - dracut ask for additional cmdline parameters. Nov 4 23:20:08.444843 systemd[1]: Starting dracut-cmdline.service - dracut cmdline hook... Nov 4 23:20:08.492601 dracut-cmdline[402]: Using kernel command line parameters: rd.driver.pre=btrfs SYSTEMD_SULOGIN_FORCE=1 BOOT_IMAGE=/flatcar/vmlinuz-a mount.usr=/dev/mapper/usr verity.usr=PARTUUID=7130c94a-213a-4e5a-8e26-6cce9662f132 rootflags=rw mount.usrflags=ro consoleblank=0 root=LABEL=ROOT console=tty1 console=ttyS0,115200n8 earlycon flatcar.first_boot=detected acpi=force flatcar.oem.id=ec2 modprobe.blacklist=xen_fbfront net.ifnames=0 nvme_core.io_timeout=4294967295 verity.usrhash=f5fad2f14ba33eafa636a02c130b28d1e2865e3fd8b50e1d7ad0f6eb8ba09fec Nov 4 23:20:08.574288 systemd-resolved[390]: Positive Trust Anchors: Nov 4 23:20:08.574321 systemd-resolved[390]: . IN DS 20326 8 2 e06d44b80b8f1d39a95c0b0d7c65d08458e880409bbc683457104237c7f8ec8d Nov 4 23:20:08.574330 systemd-resolved[390]: . IN DS 38696 8 2 683d2d0acb8c9b712a1948b27f741219298d0a450d612c483af444a4c0fb2b16 Nov 4 23:20:08.574392 systemd-resolved[390]: Negative trust anchors: home.arpa 10.in-addr.arpa 16.172.in-addr.arpa 17.172.in-addr.arpa 18.172.in-addr.arpa 19.172.in-addr.arpa 20.172.in-addr.arpa 21.172.in-addr.arpa 22.172.in-addr.arpa 23.172.in-addr.arpa 24.172.in-addr.arpa 25.172.in-addr.arpa 26.172.in-addr.arpa 27.172.in-addr.arpa 28.172.in-addr.arpa 29.172.in-addr.arpa 30.172.in-addr.arpa 31.172.in-addr.arpa 170.0.0.192.in-addr.arpa 171.0.0.192.in-addr.arpa 168.192.in-addr.arpa d.f.ip6.arpa ipv4only.arpa resolver.arpa corp home internal intranet lan local private test Nov 4 23:20:08.776223 kernel: Loading iSCSI transport class v2.0-870. Nov 4 23:20:08.829213 kernel: iscsi: registered transport (tcp) Nov 4 23:20:08.862227 kernel: random: crng init done Nov 4 23:20:08.862508 systemd-resolved[390]: Defaulting to hostname 'linux'. Nov 4 23:20:08.881878 systemd[1]: Started systemd-resolved.service - Network Name Resolution. Nov 4 23:20:08.884670 systemd[1]: Reached target nss-lookup.target - Host and Network Name Lookups. Nov 4 23:20:08.905195 kernel: iscsi: registered transport (qla4xxx) Nov 4 23:20:08.905284 kernel: QLogic iSCSI HBA Driver Nov 4 23:20:08.945045 systemd[1]: Starting systemd-network-generator.service - Generate network units from Kernel command line... Nov 4 23:20:08.972978 systemd[1]: Finished systemd-network-generator.service - Generate network units from Kernel command line. Nov 4 23:20:08.980907 systemd[1]: Reached target network-pre.target - Preparation for Network. Nov 4 23:20:09.058618 systemd[1]: Finished dracut-cmdline.service - dracut cmdline hook. Nov 4 23:20:09.067309 systemd[1]: Starting dracut-pre-udev.service - dracut pre-udev hook... Nov 4 23:20:09.073510 systemd[1]: Starting parse-ip-for-networkd.service - Write systemd-networkd units from cmdline... Nov 4 23:20:09.141725 systemd[1]: Finished dracut-pre-udev.service - dracut pre-udev hook. Nov 4 23:20:09.155379 systemd[1]: Starting systemd-udevd.service - Rule-based Manager for Device Events and Files... Nov 4 23:20:09.226933 systemd-udevd[641]: Using default interface naming scheme 'v257'. Nov 4 23:20:09.250995 systemd[1]: Started systemd-udevd.service - Rule-based Manager for Device Events and Files. Nov 4 23:20:09.261537 systemd[1]: Starting dracut-pre-trigger.service - dracut pre-trigger hook... Nov 4 23:20:09.310876 systemd[1]: Finished parse-ip-for-networkd.service - Write systemd-networkd units from cmdline. Nov 4 23:20:09.319819 systemd[1]: Starting systemd-networkd.service - Network Configuration... Nov 4 23:20:09.328094 dracut-pre-trigger[714]: rd.md=0: removing MD RAID activation Nov 4 23:20:09.386270 systemd[1]: Finished dracut-pre-trigger.service - dracut pre-trigger hook. Nov 4 23:20:09.391994 systemd[1]: Starting systemd-udev-trigger.service - Coldplug All udev Devices... Nov 4 23:20:09.428277 systemd-networkd[748]: lo: Link UP Nov 4 23:20:09.428296 systemd-networkd[748]: lo: Gained carrier Nov 4 23:20:09.430611 systemd[1]: Started systemd-networkd.service - Network Configuration. Nov 4 23:20:09.439715 systemd[1]: Reached target network.target - Network. Nov 4 23:20:09.540846 systemd[1]: Finished systemd-udev-trigger.service - Coldplug All udev Devices. Nov 4 23:20:09.553509 systemd[1]: Starting dracut-initqueue.service - dracut initqueue hook... Nov 4 23:20:09.755793 systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. Nov 4 23:20:09.758390 systemd[1]: Stopped systemd-vconsole-setup.service - Virtual Console Setup. Nov 4 23:20:09.763273 systemd[1]: Stopping systemd-vconsole-setup.service - Virtual Console Setup... Nov 4 23:20:09.779069 systemd[1]: Starting systemd-vconsole-setup.service - Virtual Console Setup... Nov 4 23:20:09.798097 kernel: ACPI: \_SB_.PCI0.GSI1: Enabled at IRQ 36 Nov 4 23:20:09.798208 kernel: ena 0000:00:05.0: enabling device (0010 -> 0012) Nov 4 23:20:09.807263 kernel: ena 0000:00:05.0: ENA device version: 0.10 Nov 4 23:20:09.808765 kernel: ena 0000:00:05.0: ENA controller version: 0.0.1 implementation version 1 Nov 4 23:20:09.818194 kernel: ena 0000:00:05.0: Elastic Network Adapter (ENA) found at mem 80114000, mac addr 06:f1:17:65:11:61 Nov 4 23:20:09.818595 kernel: nvme nvme0: using unchecked data buffer Nov 4 23:20:09.821068 (udev-worker)[802]: Network interface NamePolicy= disabled on kernel command line. Nov 4 23:20:09.848430 systemd[1]: Finished systemd-vconsole-setup.service - Virtual Console Setup. Nov 4 23:20:09.858500 systemd-networkd[748]: eth0: Found matching .network file, based on potentially unpredictable interface name: /usr/lib/systemd/network/zz-default.network Nov 4 23:20:09.858514 systemd-networkd[748]: eth0: Configuring with /usr/lib/systemd/network/zz-default.network. Nov 4 23:20:09.869936 systemd-networkd[748]: eth0: Link UP Nov 4 23:20:09.870868 systemd-networkd[748]: eth0: Gained carrier Nov 4 23:20:09.870891 systemd-networkd[748]: eth0: Found matching .network file, based on potentially unpredictable interface name: /usr/lib/systemd/network/zz-default.network Nov 4 23:20:09.891284 systemd-networkd[748]: eth0: DHCPv4 address 172.31.21.124/20, gateway 172.31.16.1 acquired from 172.31.16.1 Nov 4 23:20:09.991291 systemd[1]: Found device dev-disk-by\x2dpartlabel-USR\x2dA.device - Amazon Elastic Block Store USR-A. Nov 4 23:20:10.005391 systemd[1]: Starting disk-uuid.service - Generate new UUID for disk GPT if necessary... Nov 4 23:20:10.039774 disk-uuid[874]: Primary Header is updated. Nov 4 23:20:10.039774 disk-uuid[874]: Secondary Entries is updated. Nov 4 23:20:10.039774 disk-uuid[874]: Secondary Header is updated. Nov 4 23:20:10.103997 systemd[1]: Found device dev-disk-by\x2dlabel-OEM.device - Amazon Elastic Block Store OEM. Nov 4 23:20:10.133608 systemd[1]: Found device dev-disk-by\x2dlabel-ROOT.device - Amazon Elastic Block Store ROOT. Nov 4 23:20:10.207026 systemd[1]: Found device dev-disk-by\x2dlabel-EFI\x2dSYSTEM.device - Amazon Elastic Block Store EFI-SYSTEM. Nov 4 23:20:10.531873 systemd[1]: Finished dracut-initqueue.service - dracut initqueue hook. Nov 4 23:20:10.547124 systemd[1]: Reached target remote-fs-pre.target - Preparation for Remote File Systems. Nov 4 23:20:10.552959 systemd[1]: Reached target remote-cryptsetup.target - Remote Encrypted Volumes. Nov 4 23:20:10.558168 systemd[1]: Reached target remote-fs.target - Remote File Systems. Nov 4 23:20:10.566326 systemd[1]: Starting dracut-pre-mount.service - dracut pre-mount hook... Nov 4 23:20:10.625290 systemd[1]: Finished dracut-pre-mount.service - dracut pre-mount hook. Nov 4 23:20:11.175397 disk-uuid[879]: Warning: The kernel is still using the old partition table. Nov 4 23:20:11.175397 disk-uuid[879]: The new table will be used at the next reboot or after you Nov 4 23:20:11.175397 disk-uuid[879]: run partprobe(8) or kpartx(8) Nov 4 23:20:11.175397 disk-uuid[879]: The operation has completed successfully. Nov 4 23:20:11.196622 systemd[1]: disk-uuid.service: Deactivated successfully. Nov 4 23:20:11.198780 systemd[1]: Finished disk-uuid.service - Generate new UUID for disk GPT if necessary. Nov 4 23:20:11.209070 systemd[1]: Starting ignition-setup.service - Ignition (setup)... Nov 4 23:20:11.266233 kernel: BTRFS: device label OEM devid 1 transid 11 /dev/nvme0n1p6 (259:5) scanned by mount (1095) Nov 4 23:20:11.270675 kernel: BTRFS info (device nvme0n1p6): first mount of filesystem 66d8fdd7-bb77-4ef3-9186-de6bf719805a Nov 4 23:20:11.270747 kernel: BTRFS info (device nvme0n1p6): using crc32c (crc32c-generic) checksum algorithm Nov 4 23:20:11.317095 kernel: BTRFS info (device nvme0n1p6): enabling ssd optimizations Nov 4 23:20:11.317221 kernel: BTRFS info (device nvme0n1p6): enabling free space tree Nov 4 23:20:11.327200 kernel: BTRFS info (device nvme0n1p6): last unmount of filesystem 66d8fdd7-bb77-4ef3-9186-de6bf719805a Nov 4 23:20:11.329493 systemd[1]: Finished ignition-setup.service - Ignition (setup). Nov 4 23:20:11.335695 systemd[1]: Starting ignition-fetch-offline.service - Ignition (fetch-offline)... Nov 4 23:20:11.665347 systemd-networkd[748]: eth0: Gained IPv6LL Nov 4 23:20:12.597002 ignition[1114]: Ignition 2.22.0 Nov 4 23:20:12.597033 ignition[1114]: Stage: fetch-offline Nov 4 23:20:12.600690 ignition[1114]: no configs at "/usr/lib/ignition/base.d" Nov 4 23:20:12.600732 ignition[1114]: no config dir at "/usr/lib/ignition/base.platform.d/aws" Nov 4 23:20:12.605517 ignition[1114]: Ignition finished successfully Nov 4 23:20:12.610082 systemd[1]: Finished ignition-fetch-offline.service - Ignition (fetch-offline). Nov 4 23:20:12.614899 systemd[1]: Starting ignition-fetch.service - Ignition (fetch)... Nov 4 23:20:12.673851 ignition[1123]: Ignition 2.22.0 Nov 4 23:20:12.673889 ignition[1123]: Stage: fetch Nov 4 23:20:12.674839 ignition[1123]: no configs at "/usr/lib/ignition/base.d" Nov 4 23:20:12.675252 ignition[1123]: no config dir at "/usr/lib/ignition/base.platform.d/aws" Nov 4 23:20:12.675699 ignition[1123]: PUT http://169.254.169.254/latest/api/token: attempt #1 Nov 4 23:20:12.693499 ignition[1123]: PUT result: OK Nov 4 23:20:12.697892 ignition[1123]: parsed url from cmdline: "" Nov 4 23:20:12.698059 ignition[1123]: no config URL provided Nov 4 23:20:12.699808 ignition[1123]: reading system config file "/usr/lib/ignition/user.ign" Nov 4 23:20:12.699847 ignition[1123]: no config at "/usr/lib/ignition/user.ign" Nov 4 23:20:12.699888 ignition[1123]: PUT http://169.254.169.254/latest/api/token: attempt #1 Nov 4 23:20:12.707327 ignition[1123]: PUT result: OK Nov 4 23:20:12.707481 ignition[1123]: GET http://169.254.169.254/2019-10-01/user-data: attempt #1 Nov 4 23:20:12.711515 ignition[1123]: GET result: OK Nov 4 23:20:12.711864 ignition[1123]: parsing config with SHA512: 4ead69f574755f8adb6612f1442613887d9cdaa2fab45c76d4ddedb9a06cf739bb51080b9fde81079becefe413e5368b9fa0825035a1d53ef558ce59a2458955 Nov 4 23:20:12.721746 unknown[1123]: fetched base config from "system" Nov 4 23:20:12.723840 unknown[1123]: fetched base config from "system" Nov 4 23:20:12.724911 ignition[1123]: fetch: fetch complete Nov 4 23:20:12.723878 unknown[1123]: fetched user config from "aws" Nov 4 23:20:12.724926 ignition[1123]: fetch: fetch passed Nov 4 23:20:12.725034 ignition[1123]: Ignition finished successfully Nov 4 23:20:12.736882 systemd[1]: Finished ignition-fetch.service - Ignition (fetch). Nov 4 23:20:12.743450 systemd[1]: Starting ignition-kargs.service - Ignition (kargs)... Nov 4 23:20:12.796722 ignition[1129]: Ignition 2.22.0 Nov 4 23:20:12.796749 ignition[1129]: Stage: kargs Nov 4 23:20:12.797857 ignition[1129]: no configs at "/usr/lib/ignition/base.d" Nov 4 23:20:12.797880 ignition[1129]: no config dir at "/usr/lib/ignition/base.platform.d/aws" Nov 4 23:20:12.798045 ignition[1129]: PUT http://169.254.169.254/latest/api/token: attempt #1 Nov 4 23:20:12.808713 ignition[1129]: PUT result: OK Nov 4 23:20:12.814784 ignition[1129]: kargs: kargs passed Nov 4 23:20:12.814919 ignition[1129]: Ignition finished successfully Nov 4 23:20:12.820990 systemd[1]: Finished ignition-kargs.service - Ignition (kargs). Nov 4 23:20:12.827467 systemd[1]: Starting ignition-disks.service - Ignition (disks)... Nov 4 23:20:12.872030 ignition[1135]: Ignition 2.22.0 Nov 4 23:20:12.872066 ignition[1135]: Stage: disks Nov 4 23:20:12.873633 ignition[1135]: no configs at "/usr/lib/ignition/base.d" Nov 4 23:20:12.873888 ignition[1135]: no config dir at "/usr/lib/ignition/base.platform.d/aws" Nov 4 23:20:12.874072 ignition[1135]: PUT http://169.254.169.254/latest/api/token: attempt #1 Nov 4 23:20:12.877813 ignition[1135]: PUT result: OK Nov 4 23:20:12.887110 ignition[1135]: disks: disks passed Nov 4 23:20:12.887257 ignition[1135]: Ignition finished successfully Nov 4 23:20:12.894231 systemd[1]: Finished ignition-disks.service - Ignition (disks). Nov 4 23:20:12.897328 systemd[1]: Reached target initrd-root-device.target - Initrd Root Device. Nov 4 23:20:12.904230 systemd[1]: Reached target local-fs-pre.target - Preparation for Local File Systems. Nov 4 23:20:12.909784 systemd[1]: Reached target local-fs.target - Local File Systems. Nov 4 23:20:12.912195 systemd[1]: Reached target sysinit.target - System Initialization. Nov 4 23:20:12.914376 systemd[1]: Reached target basic.target - Basic System. Nov 4 23:20:12.921698 systemd[1]: Starting systemd-fsck-root.service - File System Check on /dev/disk/by-label/ROOT... Nov 4 23:20:13.027473 systemd-fsck[1143]: ROOT: clean, 15/1631200 files, 112378/1617920 blocks Nov 4 23:20:13.031917 systemd[1]: Finished systemd-fsck-root.service - File System Check on /dev/disk/by-label/ROOT. Nov 4 23:20:13.039285 systemd[1]: Mounting sysroot.mount - /sysroot... Nov 4 23:20:13.301183 kernel: EXT4-fs (nvme0n1p9): mounted filesystem 7d7dd2f0-d1ff-4725-86c9-b3137e768051 r/w with ordered data mode. Quota mode: none. Nov 4 23:20:13.302087 systemd[1]: Mounted sysroot.mount - /sysroot. Nov 4 23:20:13.306395 systemd[1]: Reached target initrd-root-fs.target - Initrd Root File System. Nov 4 23:20:13.361782 systemd[1]: Mounting sysroot-oem.mount - /sysroot/oem... Nov 4 23:20:13.371419 systemd[1]: Mounting sysroot-usr.mount - /sysroot/usr... Nov 4 23:20:13.376717 systemd[1]: flatcar-metadata-hostname.service - Flatcar Metadata Hostname Agent was skipped because no trigger condition checks were met. Nov 4 23:20:13.376809 systemd[1]: ignition-remount-sysroot.service - Remount /sysroot read-write for Ignition was skipped because of an unmet condition check (ConditionPathIsReadWrite=!/sysroot). Nov 4 23:20:13.376863 systemd[1]: Reached target ignition-diskful.target - Ignition Boot Disk Setup. Nov 4 23:20:13.410885 systemd[1]: Mounted sysroot-usr.mount - /sysroot/usr. Nov 4 23:20:13.420872 systemd[1]: Starting initrd-setup-root.service - Root filesystem setup... Nov 4 23:20:13.428218 kernel: BTRFS: device label OEM devid 1 transid 11 /dev/nvme0n1p6 (259:5) scanned by mount (1162) Nov 4 23:20:13.434586 kernel: BTRFS info (device nvme0n1p6): first mount of filesystem 66d8fdd7-bb77-4ef3-9186-de6bf719805a Nov 4 23:20:13.434683 kernel: BTRFS info (device nvme0n1p6): using crc32c (crc32c-generic) checksum algorithm Nov 4 23:20:13.442200 kernel: BTRFS info (device nvme0n1p6): enabling ssd optimizations Nov 4 23:20:13.442280 kernel: BTRFS info (device nvme0n1p6): enabling free space tree Nov 4 23:20:13.446389 systemd[1]: Mounted sysroot-oem.mount - /sysroot/oem. Nov 4 23:20:14.881605 initrd-setup-root[1186]: cut: /sysroot/etc/passwd: No such file or directory Nov 4 23:20:14.982711 initrd-setup-root[1193]: cut: /sysroot/etc/group: No such file or directory Nov 4 23:20:14.991878 initrd-setup-root[1200]: cut: /sysroot/etc/shadow: No such file or directory Nov 4 23:20:15.000752 initrd-setup-root[1207]: cut: /sysroot/etc/gshadow: No such file or directory Nov 4 23:20:15.708997 systemd[1]: Finished initrd-setup-root.service - Root filesystem setup. Nov 4 23:20:15.717054 systemd[1]: Starting ignition-mount.service - Ignition (mount)... Nov 4 23:20:15.724960 systemd[1]: Starting sysroot-boot.service - /sysroot/boot... Nov 4 23:20:15.758881 systemd[1]: sysroot-oem.mount: Deactivated successfully. Nov 4 23:20:15.761731 kernel: BTRFS info (device nvme0n1p6): last unmount of filesystem 66d8fdd7-bb77-4ef3-9186-de6bf719805a Nov 4 23:20:15.796879 systemd[1]: Finished sysroot-boot.service - /sysroot/boot. Nov 4 23:20:15.820412 ignition[1275]: INFO : Ignition 2.22.0 Nov 4 23:20:15.820412 ignition[1275]: INFO : Stage: mount Nov 4 23:20:15.825329 ignition[1275]: INFO : no configs at "/usr/lib/ignition/base.d" Nov 4 23:20:15.825329 ignition[1275]: INFO : no config dir at "/usr/lib/ignition/base.platform.d/aws" Nov 4 23:20:15.825329 ignition[1275]: INFO : PUT http://169.254.169.254/latest/api/token: attempt #1 Nov 4 23:20:15.836721 ignition[1275]: INFO : PUT result: OK Nov 4 23:20:15.840505 ignition[1275]: INFO : mount: mount passed Nov 4 23:20:15.840505 ignition[1275]: INFO : Ignition finished successfully Nov 4 23:20:15.846297 systemd[1]: Finished ignition-mount.service - Ignition (mount). Nov 4 23:20:15.853613 systemd[1]: Starting ignition-files.service - Ignition (files)... Nov 4 23:20:15.885709 systemd[1]: Mounting sysroot-oem.mount - /sysroot/oem... Nov 4 23:20:15.931493 kernel: BTRFS: device label OEM devid 1 transid 11 /dev/nvme0n1p6 (259:5) scanned by mount (1287) Nov 4 23:20:15.931566 kernel: BTRFS info (device nvme0n1p6): first mount of filesystem 66d8fdd7-bb77-4ef3-9186-de6bf719805a Nov 4 23:20:15.931594 kernel: BTRFS info (device nvme0n1p6): using crc32c (crc32c-generic) checksum algorithm Nov 4 23:20:15.941686 kernel: BTRFS info (device nvme0n1p6): enabling ssd optimizations Nov 4 23:20:15.941807 kernel: BTRFS info (device nvme0n1p6): enabling free space tree Nov 4 23:20:15.944962 systemd[1]: Mounted sysroot-oem.mount - /sysroot/oem. Nov 4 23:20:15.999094 ignition[1304]: INFO : Ignition 2.22.0 Nov 4 23:20:16.001408 ignition[1304]: INFO : Stage: files Nov 4 23:20:16.001408 ignition[1304]: INFO : no configs at "/usr/lib/ignition/base.d" Nov 4 23:20:16.001408 ignition[1304]: INFO : no config dir at "/usr/lib/ignition/base.platform.d/aws" Nov 4 23:20:16.009367 ignition[1304]: INFO : PUT http://169.254.169.254/latest/api/token: attempt #1 Nov 4 23:20:16.012563 ignition[1304]: INFO : PUT result: OK Nov 4 23:20:16.020466 ignition[1304]: DEBUG : files: compiled without relabeling support, skipping Nov 4 23:20:16.025861 ignition[1304]: INFO : files: ensureUsers: op(1): [started] creating or modifying user "core" Nov 4 23:20:16.025861 ignition[1304]: DEBUG : files: ensureUsers: op(1): executing: "usermod" "--root" "/sysroot" "core" Nov 4 23:20:16.153734 ignition[1304]: INFO : files: ensureUsers: op(1): [finished] creating or modifying user "core" Nov 4 23:20:16.157562 ignition[1304]: INFO : files: ensureUsers: op(2): [started] adding ssh keys to user "core" Nov 4 23:20:16.161663 unknown[1304]: wrote ssh authorized keys file for user: core Nov 4 23:20:16.164322 ignition[1304]: INFO : files: ensureUsers: op(2): [finished] adding ssh keys to user "core" Nov 4 23:20:16.230676 ignition[1304]: INFO : files: createFilesystemsFiles: createFiles: op(3): [started] writing file "/sysroot/opt/helm-v3.17.0-linux-arm64.tar.gz" Nov 4 23:20:16.235574 ignition[1304]: INFO : files: createFilesystemsFiles: createFiles: op(3): GET https://get.helm.sh/helm-v3.17.0-linux-arm64.tar.gz: attempt #1 Nov 4 23:20:16.414515 ignition[1304]: INFO : files: createFilesystemsFiles: createFiles: op(3): GET result: OK Nov 4 23:20:16.737779 ignition[1304]: INFO : files: createFilesystemsFiles: createFiles: op(3): [finished] writing file "/sysroot/opt/helm-v3.17.0-linux-arm64.tar.gz" Nov 4 23:20:16.742182 ignition[1304]: INFO : files: createFilesystemsFiles: createFiles: op(4): [started] writing file "/sysroot/home/core/install.sh" Nov 4 23:20:16.746123 ignition[1304]: INFO : files: createFilesystemsFiles: createFiles: op(4): [finished] writing file "/sysroot/home/core/install.sh" Nov 4 23:20:16.750213 ignition[1304]: INFO : files: createFilesystemsFiles: createFiles: op(5): [started] writing file "/sysroot/home/core/nginx.yaml" Nov 4 23:20:16.754505 ignition[1304]: INFO : files: createFilesystemsFiles: createFiles: op(5): [finished] writing file "/sysroot/home/core/nginx.yaml" Nov 4 23:20:16.758672 ignition[1304]: INFO : files: createFilesystemsFiles: createFiles: op(6): [started] writing file "/sysroot/home/core/nfs-pod.yaml" Nov 4 23:20:16.763033 ignition[1304]: INFO : files: createFilesystemsFiles: createFiles: op(6): [finished] writing file "/sysroot/home/core/nfs-pod.yaml" Nov 4 23:20:16.767136 ignition[1304]: INFO : files: createFilesystemsFiles: createFiles: op(7): [started] writing file "/sysroot/home/core/nfs-pvc.yaml" Nov 4 23:20:16.771362 ignition[1304]: INFO : files: createFilesystemsFiles: createFiles: op(7): [finished] writing file "/sysroot/home/core/nfs-pvc.yaml" Nov 4 23:20:16.778741 ignition[1304]: INFO : files: createFilesystemsFiles: createFiles: op(8): [started] writing file "/sysroot/etc/flatcar/update.conf" Nov 4 23:20:16.783154 ignition[1304]: INFO : files: createFilesystemsFiles: createFiles: op(8): [finished] writing file "/sysroot/etc/flatcar/update.conf" Nov 4 23:20:16.787259 ignition[1304]: INFO : files: createFilesystemsFiles: createFiles: op(9): [started] writing link "/sysroot/etc/extensions/kubernetes.raw" -> "/opt/extensions/kubernetes/kubernetes-v1.32.4-arm64.raw" Nov 4 23:20:16.793626 ignition[1304]: INFO : files: createFilesystemsFiles: createFiles: op(9): [finished] writing link "/sysroot/etc/extensions/kubernetes.raw" -> "/opt/extensions/kubernetes/kubernetes-v1.32.4-arm64.raw" Nov 4 23:20:16.799334 ignition[1304]: INFO : files: createFilesystemsFiles: createFiles: op(a): [started] writing file "/sysroot/opt/extensions/kubernetes/kubernetes-v1.32.4-arm64.raw" Nov 4 23:20:16.804193 ignition[1304]: INFO : files: createFilesystemsFiles: createFiles: op(a): GET https://extensions.flatcar.org/extensions/kubernetes-v1.32.4-arm64.raw: attempt #1 Nov 4 23:20:17.290259 ignition[1304]: INFO : files: createFilesystemsFiles: createFiles: op(a): GET result: OK Nov 4 23:20:17.661778 ignition[1304]: INFO : files: createFilesystemsFiles: createFiles: op(a): [finished] writing file "/sysroot/opt/extensions/kubernetes/kubernetes-v1.32.4-arm64.raw" Nov 4 23:20:17.661778 ignition[1304]: INFO : files: op(b): [started] processing unit "prepare-helm.service" Nov 4 23:20:17.686826 ignition[1304]: INFO : files: op(b): op(c): [started] writing unit "prepare-helm.service" at "/sysroot/etc/systemd/system/prepare-helm.service" Nov 4 23:20:17.692345 ignition[1304]: INFO : files: op(b): op(c): [finished] writing unit "prepare-helm.service" at "/sysroot/etc/systemd/system/prepare-helm.service" Nov 4 23:20:17.692345 ignition[1304]: INFO : files: op(b): [finished] processing unit "prepare-helm.service" Nov 4 23:20:17.692345 ignition[1304]: INFO : files: op(d): [started] setting preset to enabled for "prepare-helm.service" Nov 4 23:20:17.692345 ignition[1304]: INFO : files: op(d): [finished] setting preset to enabled for "prepare-helm.service" Nov 4 23:20:17.692345 ignition[1304]: INFO : files: createResultFile: createFiles: op(e): [started] writing file "/sysroot/etc/.ignition-result.json" Nov 4 23:20:17.692345 ignition[1304]: INFO : files: createResultFile: createFiles: op(e): [finished] writing file "/sysroot/etc/.ignition-result.json" Nov 4 23:20:17.692345 ignition[1304]: INFO : files: files passed Nov 4 23:20:17.692345 ignition[1304]: INFO : Ignition finished successfully Nov 4 23:20:17.714532 systemd[1]: Finished ignition-files.service - Ignition (files). Nov 4 23:20:17.720730 systemd[1]: Starting ignition-quench.service - Ignition (record completion)... Nov 4 23:20:17.737411 systemd[1]: Starting initrd-setup-root-after-ignition.service - Root filesystem completion... Nov 4 23:20:17.748747 systemd[1]: ignition-quench.service: Deactivated successfully. Nov 4 23:20:17.750262 systemd[1]: Finished ignition-quench.service - Ignition (record completion). Nov 4 23:20:17.776836 initrd-setup-root-after-ignition[1337]: grep: /sysroot/etc/flatcar/enabled-sysext.conf: No such file or directory Nov 4 23:20:17.776836 initrd-setup-root-after-ignition[1337]: grep: /sysroot/usr/share/flatcar/enabled-sysext.conf: No such file or directory Nov 4 23:20:17.785489 initrd-setup-root-after-ignition[1341]: grep: /sysroot/etc/flatcar/enabled-sysext.conf: No such file or directory Nov 4 23:20:17.791554 systemd[1]: Finished initrd-setup-root-after-ignition.service - Root filesystem completion. Nov 4 23:20:17.792044 systemd[1]: Reached target ignition-complete.target - Ignition Complete. Nov 4 23:20:17.805365 systemd[1]: Starting initrd-parse-etc.service - Mountpoints Configured in the Real Root... Nov 4 23:20:17.883451 systemd[1]: initrd-parse-etc.service: Deactivated successfully. Nov 4 23:20:17.883702 systemd[1]: Finished initrd-parse-etc.service - Mountpoints Configured in the Real Root. Nov 4 23:20:17.888375 systemd[1]: Reached target initrd-fs.target - Initrd File Systems. Nov 4 23:20:17.888507 systemd[1]: Reached target initrd.target - Initrd Default Target. Nov 4 23:20:17.888992 systemd[1]: dracut-mount.service - dracut mount hook was skipped because no trigger condition checks were met. Nov 4 23:20:17.890447 systemd[1]: Starting dracut-pre-pivot.service - dracut pre-pivot and cleanup hook... Nov 4 23:20:17.952971 systemd[1]: Finished dracut-pre-pivot.service - dracut pre-pivot and cleanup hook. Nov 4 23:20:17.960706 systemd[1]: Starting initrd-cleanup.service - Cleaning Up and Shutting Down Daemons... Nov 4 23:20:17.998937 systemd[1]: Unnecessary job was removed for dev-mapper-usr.device - /dev/mapper/usr. Nov 4 23:20:17.999455 systemd[1]: Stopped target nss-lookup.target - Host and Network Name Lookups. Nov 4 23:20:18.007079 systemd[1]: Stopped target remote-cryptsetup.target - Remote Encrypted Volumes. Nov 4 23:20:18.009925 systemd[1]: Stopped target timers.target - Timer Units. Nov 4 23:20:18.014491 systemd[1]: dracut-pre-pivot.service: Deactivated successfully. Nov 4 23:20:18.014725 systemd[1]: Stopped dracut-pre-pivot.service - dracut pre-pivot and cleanup hook. Nov 4 23:20:18.022488 systemd[1]: Stopped target initrd.target - Initrd Default Target. Nov 4 23:20:18.029668 systemd[1]: Stopped target basic.target - Basic System. Nov 4 23:20:18.029958 systemd[1]: Stopped target ignition-complete.target - Ignition Complete. Nov 4 23:20:18.036533 systemd[1]: Stopped target ignition-diskful.target - Ignition Boot Disk Setup. Nov 4 23:20:18.044249 systemd[1]: Stopped target initrd-root-device.target - Initrd Root Device. Nov 4 23:20:18.047007 systemd[1]: Stopped target initrd-usr-fs.target - Initrd /usr File System. Nov 4 23:20:18.054559 systemd[1]: Stopped target remote-fs.target - Remote File Systems. Nov 4 23:20:18.057959 systemd[1]: Stopped target remote-fs-pre.target - Preparation for Remote File Systems. Nov 4 23:20:18.063119 systemd[1]: Stopped target sysinit.target - System Initialization. Nov 4 23:20:18.066119 systemd[1]: Stopped target local-fs.target - Local File Systems. Nov 4 23:20:18.066781 systemd[1]: Stopped target swap.target - Swaps. Nov 4 23:20:18.067092 systemd[1]: dracut-pre-mount.service: Deactivated successfully. Nov 4 23:20:18.067358 systemd[1]: Stopped dracut-pre-mount.service - dracut pre-mount hook. Nov 4 23:20:18.072694 systemd[1]: Stopped target cryptsetup.target - Local Encrypted Volumes. Nov 4 23:20:18.078004 systemd[1]: Stopped target cryptsetup-pre.target - Local Encrypted Volumes (Pre). Nov 4 23:20:18.084715 systemd[1]: clevis-luks-askpass.path: Deactivated successfully. Nov 4 23:20:18.089331 systemd[1]: Stopped clevis-luks-askpass.path - Forward Password Requests to Clevis Directory Watch. Nov 4 23:20:18.097518 systemd[1]: dracut-initqueue.service: Deactivated successfully. Nov 4 23:20:18.097823 systemd[1]: Stopped dracut-initqueue.service - dracut initqueue hook. Nov 4 23:20:18.110077 systemd[1]: initrd-setup-root-after-ignition.service: Deactivated successfully. Nov 4 23:20:18.110614 systemd[1]: Stopped initrd-setup-root-after-ignition.service - Root filesystem completion. Nov 4 23:20:18.118917 systemd[1]: ignition-files.service: Deactivated successfully. Nov 4 23:20:18.119371 systemd[1]: Stopped ignition-files.service - Ignition (files). Nov 4 23:20:18.128316 systemd[1]: Stopping ignition-mount.service - Ignition (mount)... Nov 4 23:20:18.133580 systemd[1]: kmod-static-nodes.service: Deactivated successfully. Nov 4 23:20:18.134089 systemd[1]: Stopped kmod-static-nodes.service - Create List of Static Device Nodes. Nov 4 23:20:18.163076 systemd[1]: Stopping sysroot-boot.service - /sysroot/boot... Nov 4 23:20:18.164263 systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. Nov 4 23:20:18.165640 systemd[1]: Stopped systemd-tmpfiles-setup.service - Create System Files and Directories. Nov 4 23:20:18.185653 systemd[1]: systemd-udev-trigger.service: Deactivated successfully. Nov 4 23:20:18.191338 systemd[1]: Stopped systemd-udev-trigger.service - Coldplug All udev Devices. Nov 4 23:20:18.193028 systemd[1]: dracut-pre-trigger.service: Deactivated successfully. Nov 4 23:20:18.193290 systemd[1]: Stopped dracut-pre-trigger.service - dracut pre-trigger hook. Nov 4 23:20:18.219114 systemd[1]: initrd-cleanup.service: Deactivated successfully. Nov 4 23:20:18.221744 systemd[1]: Finished initrd-cleanup.service - Cleaning Up and Shutting Down Daemons. Nov 4 23:20:18.239642 ignition[1361]: INFO : Ignition 2.22.0 Nov 4 23:20:18.245620 ignition[1361]: INFO : Stage: umount Nov 4 23:20:18.245620 ignition[1361]: INFO : no configs at "/usr/lib/ignition/base.d" Nov 4 23:20:18.245620 ignition[1361]: INFO : no config dir at "/usr/lib/ignition/base.platform.d/aws" Nov 4 23:20:18.245620 ignition[1361]: INFO : PUT http://169.254.169.254/latest/api/token: attempt #1 Nov 4 23:20:18.260692 ignition[1361]: INFO : PUT result: OK Nov 4 23:20:18.257617 systemd[1]: sysroot-boot.mount: Deactivated successfully. Nov 4 23:20:18.271946 ignition[1361]: INFO : umount: umount passed Nov 4 23:20:18.276611 ignition[1361]: INFO : Ignition finished successfully Nov 4 23:20:18.282631 systemd[1]: ignition-mount.service: Deactivated successfully. Nov 4 23:20:18.282885 systemd[1]: Stopped ignition-mount.service - Ignition (mount). Nov 4 23:20:18.286664 systemd[1]: ignition-disks.service: Deactivated successfully. Nov 4 23:20:18.286769 systemd[1]: Stopped ignition-disks.service - Ignition (disks). Nov 4 23:20:18.289749 systemd[1]: ignition-kargs.service: Deactivated successfully. Nov 4 23:20:18.290001 systemd[1]: Stopped ignition-kargs.service - Ignition (kargs). Nov 4 23:20:18.296585 systemd[1]: ignition-fetch.service: Deactivated successfully. Nov 4 23:20:18.296706 systemd[1]: Stopped ignition-fetch.service - Ignition (fetch). Nov 4 23:20:18.299290 systemd[1]: Stopped target network.target - Network. Nov 4 23:20:18.301460 systemd[1]: ignition-fetch-offline.service: Deactivated successfully. Nov 4 23:20:18.301548 systemd[1]: Stopped ignition-fetch-offline.service - Ignition (fetch-offline). Nov 4 23:20:18.311503 systemd[1]: Stopped target paths.target - Path Units. Nov 4 23:20:18.313828 systemd[1]: systemd-ask-password-console.path: Deactivated successfully. Nov 4 23:20:18.317809 systemd[1]: Stopped systemd-ask-password-console.path - Dispatch Password Requests to Console Directory Watch. Nov 4 23:20:18.320514 systemd[1]: Stopped target slices.target - Slice Units. Nov 4 23:20:18.323055 systemd[1]: Stopped target sockets.target - Socket Units. Nov 4 23:20:18.326889 systemd[1]: iscsid.socket: Deactivated successfully. Nov 4 23:20:18.326969 systemd[1]: Closed iscsid.socket - Open-iSCSI iscsid Socket. Nov 4 23:20:18.329830 systemd[1]: iscsiuio.socket: Deactivated successfully. Nov 4 23:20:18.329892 systemd[1]: Closed iscsiuio.socket - Open-iSCSI iscsiuio Socket. Nov 4 23:20:18.336567 systemd[1]: ignition-setup.service: Deactivated successfully. Nov 4 23:20:18.336670 systemd[1]: Stopped ignition-setup.service - Ignition (setup). Nov 4 23:20:18.339242 systemd[1]: ignition-setup-pre.service: Deactivated successfully. Nov 4 23:20:18.339322 systemd[1]: Stopped ignition-setup-pre.service - Ignition env setup. Nov 4 23:20:18.346048 systemd[1]: Stopping systemd-networkd.service - Network Configuration... Nov 4 23:20:18.348901 systemd[1]: Stopping systemd-resolved.service - Network Name Resolution... Nov 4 23:20:18.360816 systemd[1]: sysroot-boot.service: Deactivated successfully. Nov 4 23:20:18.361052 systemd[1]: Stopped sysroot-boot.service - /sysroot/boot. Nov 4 23:20:18.364212 systemd[1]: initrd-setup-root.service: Deactivated successfully. Nov 4 23:20:18.365300 systemd[1]: Stopped initrd-setup-root.service - Root filesystem setup. Nov 4 23:20:18.384615 systemd[1]: systemd-resolved.service: Deactivated successfully. Nov 4 23:20:18.384932 systemd[1]: Stopped systemd-resolved.service - Network Name Resolution. Nov 4 23:20:18.417720 systemd[1]: systemd-networkd.service: Deactivated successfully. Nov 4 23:20:18.420544 systemd[1]: Stopped systemd-networkd.service - Network Configuration. Nov 4 23:20:18.429750 systemd[1]: Stopped target network-pre.target - Preparation for Network. Nov 4 23:20:18.434902 systemd[1]: systemd-networkd.socket: Deactivated successfully. Nov 4 23:20:18.434990 systemd[1]: Closed systemd-networkd.socket - Network Service Netlink Socket. Nov 4 23:20:18.441210 systemd[1]: Stopping network-cleanup.service - Network Cleanup... Nov 4 23:20:18.448568 systemd[1]: parse-ip-for-networkd.service: Deactivated successfully. Nov 4 23:20:18.448700 systemd[1]: Stopped parse-ip-for-networkd.service - Write systemd-networkd units from cmdline. Nov 4 23:20:18.461485 systemd[1]: systemd-sysctl.service: Deactivated successfully. Nov 4 23:20:18.461604 systemd[1]: Stopped systemd-sysctl.service - Apply Kernel Variables. Nov 4 23:20:18.472433 systemd[1]: systemd-modules-load.service: Deactivated successfully. Nov 4 23:20:18.472544 systemd[1]: Stopped systemd-modules-load.service - Load Kernel Modules. Nov 4 23:20:18.475167 systemd[1]: Stopping systemd-udevd.service - Rule-based Manager for Device Events and Files... Nov 4 23:20:18.507538 systemd[1]: systemd-udevd.service: Deactivated successfully. Nov 4 23:20:18.508965 systemd[1]: Stopped systemd-udevd.service - Rule-based Manager for Device Events and Files. Nov 4 23:20:18.517525 systemd[1]: systemd-udevd-control.socket: Deactivated successfully. Nov 4 23:20:18.518592 systemd[1]: Closed systemd-udevd-control.socket - udev Control Socket. Nov 4 23:20:18.525370 systemd[1]: systemd-udevd-kernel.socket: Deactivated successfully. Nov 4 23:20:18.525476 systemd[1]: Closed systemd-udevd-kernel.socket - udev Kernel Socket. Nov 4 23:20:18.536486 systemd[1]: dracut-pre-udev.service: Deactivated successfully. Nov 4 23:20:18.536811 systemd[1]: Stopped dracut-pre-udev.service - dracut pre-udev hook. Nov 4 23:20:18.544021 systemd[1]: dracut-cmdline.service: Deactivated successfully. Nov 4 23:20:18.544171 systemd[1]: Stopped dracut-cmdline.service - dracut cmdline hook. Nov 4 23:20:18.549676 systemd[1]: dracut-cmdline-ask.service: Deactivated successfully. Nov 4 23:20:18.549798 systemd[1]: Stopped dracut-cmdline-ask.service - dracut ask for additional cmdline parameters. Nov 4 23:20:18.560349 systemd[1]: Starting initrd-udevadm-cleanup-db.service - Cleanup udev Database... Nov 4 23:20:18.566001 systemd[1]: systemd-network-generator.service: Deactivated successfully. Nov 4 23:20:18.566126 systemd[1]: Stopped systemd-network-generator.service - Generate network units from Kernel command line. Nov 4 23:20:18.569052 systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. Nov 4 23:20:18.569144 systemd[1]: Stopped systemd-tmpfiles-setup-dev.service - Create Static Device Nodes in /dev. Nov 4 23:20:18.573429 systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. Nov 4 23:20:18.573531 systemd[1]: Stopped systemd-vconsole-setup.service - Virtual Console Setup. Nov 4 23:20:18.582735 systemd[1]: network-cleanup.service: Deactivated successfully. Nov 4 23:20:18.584701 systemd[1]: Stopped network-cleanup.service - Network Cleanup. Nov 4 23:20:18.619435 systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. Nov 4 23:20:18.619636 systemd[1]: Finished initrd-udevadm-cleanup-db.service - Cleanup udev Database. Nov 4 23:20:18.623924 systemd[1]: Reached target initrd-switch-root.target - Switch Root. Nov 4 23:20:18.635723 systemd[1]: Starting initrd-switch-root.service - Switch Root... Nov 4 23:20:18.667870 systemd[1]: Switching root. Nov 4 23:20:18.746233 systemd-journald[360]: Journal stopped Nov 4 23:20:22.764380 systemd-journald[360]: Received SIGTERM from PID 1 (systemd). Nov 4 23:20:22.764534 kernel: SELinux: policy capability network_peer_controls=1 Nov 4 23:20:22.764580 kernel: SELinux: policy capability open_perms=1 Nov 4 23:20:22.764612 kernel: SELinux: policy capability extended_socket_class=1 Nov 4 23:20:22.764645 kernel: SELinux: policy capability always_check_network=0 Nov 4 23:20:22.764683 kernel: SELinux: policy capability cgroup_seclabel=1 Nov 4 23:20:22.764714 kernel: SELinux: policy capability nnp_nosuid_transition=1 Nov 4 23:20:22.764746 kernel: SELinux: policy capability genfs_seclabel_symlinks=0 Nov 4 23:20:22.764776 kernel: SELinux: policy capability ioctl_skip_cloexec=0 Nov 4 23:20:22.764808 kernel: SELinux: policy capability userspace_initial_context=0 Nov 4 23:20:22.764839 kernel: audit: type=1403 audit(1762298419.588:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 Nov 4 23:20:22.764874 systemd[1]: Successfully loaded SELinux policy in 224.955ms. Nov 4 23:20:22.764935 systemd[1]: Relabeled /dev/, /dev/shm/, /run/ in 17.075ms. Nov 4 23:20:22.764974 systemd[1]: systemd 257.7 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +IPE +SMACK +SECCOMP -GCRYPT -GNUTLS +OPENSSL -ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 -PWQUALITY -P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP -SYSVINIT +LIBARCHIVE) Nov 4 23:20:22.765008 systemd[1]: Detected virtualization amazon. Nov 4 23:20:22.765042 systemd[1]: Detected architecture arm64. Nov 4 23:20:22.765083 systemd[1]: Detected first boot. Nov 4 23:20:22.765117 systemd[1]: Initializing machine ID from SMBIOS/DMI UUID. Nov 4 23:20:22.777194 zram_generator::config[1405]: No configuration found. Nov 4 23:20:22.777293 kernel: NET: Registered PF_VSOCK protocol family Nov 4 23:20:22.777333 systemd[1]: Populated /etc with preset unit settings. Nov 4 23:20:22.777369 systemd[1]: initrd-switch-root.service: Deactivated successfully. Nov 4 23:20:22.777405 systemd[1]: Stopped initrd-switch-root.service - Switch Root. Nov 4 23:20:22.777437 systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. Nov 4 23:20:22.777471 systemd[1]: Created slice system-addon\x2dconfig.slice - Slice /system/addon-config. Nov 4 23:20:22.777506 systemd[1]: Created slice system-addon\x2drun.slice - Slice /system/addon-run. Nov 4 23:20:22.777616 systemd[1]: Created slice system-getty.slice - Slice /system/getty. Nov 4 23:20:22.777663 systemd[1]: Created slice system-modprobe.slice - Slice /system/modprobe. Nov 4 23:20:22.777701 systemd[1]: Created slice system-serial\x2dgetty.slice - Slice /system/serial-getty. Nov 4 23:20:22.777735 systemd[1]: Created slice system-system\x2dcloudinit.slice - Slice /system/system-cloudinit. Nov 4 23:20:22.784554 systemd[1]: Created slice system-systemd\x2dfsck.slice - Slice /system/systemd-fsck. Nov 4 23:20:22.784642 systemd[1]: Created slice user.slice - User and Session Slice. Nov 4 23:20:22.784689 systemd[1]: Started clevis-luks-askpass.path - Forward Password Requests to Clevis Directory Watch. Nov 4 23:20:22.784818 systemd[1]: Started systemd-ask-password-console.path - Dispatch Password Requests to Console Directory Watch. Nov 4 23:20:22.784858 systemd[1]: Started systemd-ask-password-wall.path - Forward Password Requests to Wall Directory Watch. Nov 4 23:20:22.784895 systemd[1]: Set up automount boot.automount - Boot partition Automount Point. Nov 4 23:20:22.784967 systemd[1]: Set up automount proc-sys-fs-binfmt_misc.automount - Arbitrary Executable File Formats File System Automount Point. Nov 4 23:20:22.785012 systemd[1]: Expecting device dev-disk-by\x2dlabel-OEM.device - /dev/disk/by-label/OEM... Nov 4 23:20:22.785046 systemd[1]: Expecting device dev-ttyS0.device - /dev/ttyS0... Nov 4 23:20:22.785078 systemd[1]: Reached target cryptsetup-pre.target - Local Encrypted Volumes (Pre). Nov 4 23:20:22.785119 systemd[1]: Reached target cryptsetup.target - Local Encrypted Volumes. Nov 4 23:20:22.788585 systemd[1]: Stopped target initrd-switch-root.target - Switch Root. Nov 4 23:20:22.788634 systemd[1]: Stopped target initrd-fs.target - Initrd File Systems. Nov 4 23:20:22.788668 systemd[1]: Stopped target initrd-root-fs.target - Initrd Root File System. Nov 4 23:20:22.788699 systemd[1]: Reached target integritysetup.target - Local Integrity Protected Volumes. Nov 4 23:20:22.788729 systemd[1]: Reached target remote-cryptsetup.target - Remote Encrypted Volumes. Nov 4 23:20:22.788777 systemd[1]: Reached target remote-fs.target - Remote File Systems. Nov 4 23:20:22.788809 systemd[1]: Reached target slices.target - Slice Units. Nov 4 23:20:22.788840 systemd[1]: Reached target swap.target - Swaps. Nov 4 23:20:22.788869 systemd[1]: Reached target veritysetup.target - Local Verity Protected Volumes. Nov 4 23:20:22.788898 systemd[1]: Listening on systemd-coredump.socket - Process Core Dump Socket. Nov 4 23:20:22.788933 systemd[1]: Listening on systemd-creds.socket - Credential Encryption/Decryption. Nov 4 23:20:22.788964 systemd[1]: Listening on systemd-networkd.socket - Network Service Netlink Socket. Nov 4 23:20:22.788999 systemd[1]: Listening on systemd-udevd-control.socket - udev Control Socket. Nov 4 23:20:22.789029 systemd[1]: Listening on systemd-udevd-kernel.socket - udev Kernel Socket. Nov 4 23:20:22.789059 systemd[1]: Listening on systemd-userdbd.socket - User Database Manager Socket. Nov 4 23:20:22.789088 systemd[1]: Mounting dev-hugepages.mount - Huge Pages File System... Nov 4 23:20:22.789120 systemd[1]: Mounting dev-mqueue.mount - POSIX Message Queue File System... Nov 4 23:20:22.792252 systemd[1]: Mounting media.mount - External Media Directory... Nov 4 23:20:22.792334 systemd[1]: Mounting sys-kernel-debug.mount - Kernel Debug File System... Nov 4 23:20:22.792378 systemd[1]: Mounting sys-kernel-tracing.mount - Kernel Trace File System... Nov 4 23:20:22.792433 systemd[1]: Mounting tmp.mount - Temporary Directory /tmp... Nov 4 23:20:22.792473 systemd[1]: var-lib-machines.mount - Virtual Machine and Container Storage (Compatibility) was skipped because of an unmet condition check (ConditionPathExists=/var/lib/machines.raw). Nov 4 23:20:22.792505 systemd[1]: Reached target machines.target - Containers. Nov 4 23:20:22.792540 systemd[1]: Starting flatcar-tmpfiles.service - Create missing system files... Nov 4 23:20:22.792573 systemd[1]: ignition-delete-config.service - Ignition (delete config) was skipped because no trigger condition checks were met. Nov 4 23:20:22.792603 systemd[1]: Starting kmod-static-nodes.service - Create List of Static Device Nodes... Nov 4 23:20:22.792639 systemd[1]: Starting modprobe@configfs.service - Load Kernel Module configfs... Nov 4 23:20:22.792676 systemd[1]: Starting modprobe@dm_mod.service - Load Kernel Module dm_mod... Nov 4 23:20:22.792711 systemd[1]: Starting modprobe@drm.service - Load Kernel Module drm... Nov 4 23:20:22.792746 systemd[1]: Starting modprobe@efi_pstore.service - Load Kernel Module efi_pstore... Nov 4 23:20:22.792777 systemd[1]: Starting modprobe@fuse.service - Load Kernel Module fuse... Nov 4 23:20:22.796517 systemd[1]: Starting modprobe@loop.service - Load Kernel Module loop... Nov 4 23:20:22.796561 systemd[1]: setup-nsswitch.service - Create /etc/nsswitch.conf was skipped because of an unmet condition check (ConditionPathExists=!/etc/nsswitch.conf). Nov 4 23:20:22.796601 systemd[1]: systemd-fsck-root.service: Deactivated successfully. Nov 4 23:20:22.796631 systemd[1]: Stopped systemd-fsck-root.service - File System Check on Root Device. Nov 4 23:20:22.796664 systemd[1]: systemd-fsck-usr.service: Deactivated successfully. Nov 4 23:20:22.796694 systemd[1]: Stopped systemd-fsck-usr.service. Nov 4 23:20:22.796725 systemd[1]: systemd-hibernate-clear.service - Clear Stale Hibernate Storage Info was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67). Nov 4 23:20:22.796756 systemd[1]: Starting systemd-journald.service - Journal Service... Nov 4 23:20:22.796790 systemd[1]: Starting systemd-modules-load.service - Load Kernel Modules... Nov 4 23:20:22.796823 systemd[1]: Starting systemd-network-generator.service - Generate network units from Kernel command line... Nov 4 23:20:22.796858 systemd[1]: Starting systemd-remount-fs.service - Remount Root and Kernel File Systems... Nov 4 23:20:22.796889 systemd[1]: Starting systemd-udev-load-credentials.service - Load udev Rules from Credentials... Nov 4 23:20:22.796919 systemd[1]: Starting systemd-udev-trigger.service - Coldplug All udev Devices... Nov 4 23:20:22.796954 systemd[1]: Mounted dev-hugepages.mount - Huge Pages File System. Nov 4 23:20:22.796985 systemd[1]: Mounted dev-mqueue.mount - POSIX Message Queue File System. Nov 4 23:20:22.797014 systemd[1]: Mounted media.mount - External Media Directory. Nov 4 23:20:22.797044 systemd[1]: Mounted sys-kernel-debug.mount - Kernel Debug File System. Nov 4 23:20:22.797075 systemd[1]: Mounted sys-kernel-tracing.mount - Kernel Trace File System. Nov 4 23:20:22.797107 systemd[1]: Mounted tmp.mount - Temporary Directory /tmp. Nov 4 23:20:22.797141 systemd[1]: Finished kmod-static-nodes.service - Create List of Static Device Nodes. Nov 4 23:20:22.804576 systemd[1]: modprobe@configfs.service: Deactivated successfully. Nov 4 23:20:22.804631 systemd[1]: Finished modprobe@configfs.service - Load Kernel Module configfs. Nov 4 23:20:22.810559 systemd[1]: modprobe@dm_mod.service: Deactivated successfully. Nov 4 23:20:22.810603 systemd[1]: Finished modprobe@dm_mod.service - Load Kernel Module dm_mod. Nov 4 23:20:22.810637 systemd[1]: modprobe@efi_pstore.service: Deactivated successfully. Nov 4 23:20:22.810670 systemd[1]: Finished modprobe@efi_pstore.service - Load Kernel Module efi_pstore. Nov 4 23:20:22.810707 systemd[1]: modprobe@loop.service: Deactivated successfully. Nov 4 23:20:22.810740 systemd[1]: Finished modprobe@loop.service - Load Kernel Module loop. Nov 4 23:20:22.810771 kernel: fuse: init (API version 7.41) Nov 4 23:20:22.810802 systemd[1]: Finished systemd-network-generator.service - Generate network units from Kernel command line. Nov 4 23:20:22.810834 systemd[1]: modprobe@fuse.service: Deactivated successfully. Nov 4 23:20:22.810864 systemd[1]: Finished modprobe@fuse.service - Load Kernel Module fuse. Nov 4 23:20:22.810893 systemd[1]: Finished systemd-remount-fs.service - Remount Root and Kernel File Systems. Nov 4 23:20:22.810927 systemd[1]: Reached target network-pre.target - Preparation for Network. Nov 4 23:20:22.810957 systemd[1]: Listening on systemd-importd.socket - Disk Image Download Service Socket. Nov 4 23:20:22.810989 systemd[1]: Mounting sys-fs-fuse-connections.mount - FUSE Control File System... Nov 4 23:20:22.811019 systemd[1]: Mounting sys-kernel-config.mount - Kernel Configuration File System... Nov 4 23:20:22.811049 systemd[1]: remount-root.service - Remount Root File System was skipped because of an unmet condition check (ConditionPathIsReadWrite=!/). Nov 4 23:20:22.811082 systemd[1]: Reached target local-fs.target - Local File Systems. Nov 4 23:20:22.811115 systemd[1]: Listening on systemd-sysext.socket - System Extension Image Management. Nov 4 23:20:22.811171 systemd[1]: systemd-binfmt.service - Set Up Additional Binary Formats was skipped because no trigger condition checks were met. Nov 4 23:20:22.811208 kernel: ACPI: bus type drm_connector registered Nov 4 23:20:22.811237 systemd[1]: Starting systemd-hwdb-update.service - Rebuild Hardware Database... Nov 4 23:20:22.811268 systemd[1]: systemd-pstore.service - Platform Persistent Storage Archival was skipped because of an unmet condition check (ConditionDirectoryNotEmpty=/sys/fs/pstore). Nov 4 23:20:22.811350 systemd-journald[1484]: Collecting audit messages is disabled. Nov 4 23:20:22.811403 systemd[1]: Starting systemd-random-seed.service - Load/Save OS Random Seed... Nov 4 23:20:22.811436 systemd[1]: systemd-repart.service - Repartition Root Disk was skipped because no trigger condition checks were met. Nov 4 23:20:22.811472 systemd[1]: Starting systemd-sysext.service - Merge System Extension Images into /usr/ and /opt/... Nov 4 23:20:22.811505 systemd[1]: Finished flatcar-tmpfiles.service - Create missing system files. Nov 4 23:20:22.811534 systemd[1]: modprobe@drm.service: Deactivated successfully. Nov 4 23:20:22.811564 systemd[1]: Finished modprobe@drm.service - Load Kernel Module drm. Nov 4 23:20:22.811594 systemd[1]: Finished systemd-modules-load.service - Load Kernel Modules. Nov 4 23:20:22.811624 systemd[1]: Finished systemd-udev-load-credentials.service - Load udev Rules from Credentials. Nov 4 23:20:22.811654 systemd[1]: Mounted sys-fs-fuse-connections.mount - FUSE Control File System. Nov 4 23:20:22.811690 systemd[1]: Mounted sys-kernel-config.mount - Kernel Configuration File System. Nov 4 23:20:22.811722 systemd-journald[1484]: Journal started Nov 4 23:20:22.811767 systemd-journald[1484]: Runtime Journal (/run/log/journal/ec260cb872ada63abbad8bd883682ff2) is 8M, max 75.3M, 67.3M free. Nov 4 23:20:21.978275 systemd[1]: Queued start job for default target multi-user.target. Nov 4 23:20:22.818109 systemd[1]: Starting systemd-sysctl.service - Apply Kernel Variables... Nov 4 23:20:21.992955 systemd[1]: Unnecessary job was removed for dev-nvme0n1p6.device - /dev/nvme0n1p6. Nov 4 23:20:21.994133 systemd[1]: systemd-journald.service: Deactivated successfully. Nov 4 23:20:22.836536 systemd[1]: Starting systemd-sysusers.service - Create System Users... Nov 4 23:20:22.836654 systemd[1]: Started systemd-journald.service - Journal Service. Nov 4 23:20:22.905013 systemd[1]: Starting systemd-journal-flush.service - Flush Journal to Persistent Storage... Nov 4 23:20:22.919293 systemd[1]: Finished systemd-random-seed.service - Load/Save OS Random Seed. Nov 4 23:20:22.922531 systemd[1]: Reached target first-boot-complete.target - First Boot Complete. Nov 4 23:20:22.934713 kernel: loop1: detected capacity change from 0 to 100624 Nov 4 23:20:22.931954 systemd[1]: Starting systemd-machine-id-commit.service - Save Transient machine-id to Disk... Nov 4 23:20:22.990633 systemd-journald[1484]: Time spent on flushing to /var/log/journal/ec260cb872ada63abbad8bd883682ff2 is 104.376ms for 916 entries. Nov 4 23:20:22.990633 systemd-journald[1484]: System Journal (/var/log/journal/ec260cb872ada63abbad8bd883682ff2) is 8M, max 588.1M, 580.1M free. Nov 4 23:20:23.151718 systemd-journald[1484]: Received client request to flush runtime journal. Nov 4 23:20:23.000145 systemd[1]: Finished systemd-sysctl.service - Apply Kernel Variables. Nov 4 23:20:23.019606 systemd[1]: Finished systemd-sysusers.service - Create System Users. Nov 4 23:20:23.032432 systemd[1]: Starting systemd-resolved.service - Network Name Resolution... Nov 4 23:20:23.041688 systemd[1]: Starting systemd-tmpfiles-setup-dev.service - Create Static Device Nodes in /dev... Nov 4 23:20:23.045865 systemd[1]: etc-machine\x2did.mount: Deactivated successfully. Nov 4 23:20:23.049299 systemd[1]: Finished systemd-machine-id-commit.service - Save Transient machine-id to Disk. Nov 4 23:20:23.118617 systemd[1]: Starting systemd-userdbd.service - User Database Manager... Nov 4 23:20:23.161356 systemd[1]: Finished systemd-journal-flush.service - Flush Journal to Persistent Storage. Nov 4 23:20:23.167622 systemd[1]: Finished systemd-udev-trigger.service - Coldplug All udev Devices. Nov 4 23:20:23.177565 systemd-tmpfiles[1552]: ACLs are not supported, ignoring. Nov 4 23:20:23.177598 systemd-tmpfiles[1552]: ACLs are not supported, ignoring. Nov 4 23:20:23.196709 systemd[1]: Finished systemd-tmpfiles-setup-dev.service - Create Static Device Nodes in /dev. Nov 4 23:20:23.250416 systemd[1]: Started systemd-userdbd.service - User Database Manager. Nov 4 23:20:23.316218 kernel: loop2: detected capacity change from 0 to 207008 Nov 4 23:20:23.444214 systemd-resolved[1551]: Positive Trust Anchors: Nov 4 23:20:23.444257 systemd-resolved[1551]: . IN DS 20326 8 2 e06d44b80b8f1d39a95c0b0d7c65d08458e880409bbc683457104237c7f8ec8d Nov 4 23:20:23.444267 systemd-resolved[1551]: . IN DS 38696 8 2 683d2d0acb8c9b712a1948b27f741219298d0a450d612c483af444a4c0fb2b16 Nov 4 23:20:23.444329 systemd-resolved[1551]: Negative trust anchors: home.arpa 10.in-addr.arpa 16.172.in-addr.arpa 17.172.in-addr.arpa 18.172.in-addr.arpa 19.172.in-addr.arpa 20.172.in-addr.arpa 21.172.in-addr.arpa 22.172.in-addr.arpa 23.172.in-addr.arpa 24.172.in-addr.arpa 25.172.in-addr.arpa 26.172.in-addr.arpa 27.172.in-addr.arpa 28.172.in-addr.arpa 29.172.in-addr.arpa 30.172.in-addr.arpa 31.172.in-addr.arpa 170.0.0.192.in-addr.arpa 171.0.0.192.in-addr.arpa 168.192.in-addr.arpa d.f.ip6.arpa ipv4only.arpa resolver.arpa corp home internal intranet lan local private test Nov 4 23:20:23.458720 systemd-resolved[1551]: Defaulting to hostname 'linux'. Nov 4 23:20:23.461775 systemd[1]: Started systemd-resolved.service - Network Name Resolution. Nov 4 23:20:23.464677 systemd[1]: Reached target nss-lookup.target - Host and Network Name Lookups. Nov 4 23:20:23.572272 kernel: loop3: detected capacity change from 0 to 61264 Nov 4 23:20:23.943259 systemd[1]: Finished systemd-hwdb-update.service - Rebuild Hardware Database. Nov 4 23:20:23.950141 systemd[1]: Starting systemd-udevd.service - Rule-based Manager for Device Events and Files... Nov 4 23:20:23.957200 kernel: loop4: detected capacity change from 0 to 119344 Nov 4 23:20:24.014967 systemd-udevd[1570]: Using default interface naming scheme 'v257'. Nov 4 23:20:24.162417 systemd[1]: Started systemd-udevd.service - Rule-based Manager for Device Events and Files. Nov 4 23:20:24.169951 systemd[1]: Starting systemd-networkd.service - Network Configuration... Nov 4 23:20:24.257200 kernel: loop5: detected capacity change from 0 to 100624 Nov 4 23:20:24.314139 (udev-worker)[1580]: Network interface NamePolicy= disabled on kernel command line. Nov 4 23:20:24.330203 kernel: loop6: detected capacity change from 0 to 207008 Nov 4 23:20:24.367203 kernel: loop7: detected capacity change from 0 to 61264 Nov 4 23:20:24.392250 systemd-networkd[1573]: lo: Link UP Nov 4 23:20:24.392271 systemd-networkd[1573]: lo: Gained carrier Nov 4 23:20:24.397212 systemd[1]: Started systemd-networkd.service - Network Configuration. Nov 4 23:20:24.400227 systemd[1]: Reached target network.target - Network. Nov 4 23:20:24.405026 kernel: loop1: detected capacity change from 0 to 119344 Nov 4 23:20:24.404826 systemd[1]: Starting systemd-networkd-persistent-storage.service - Enable Persistent Storage in systemd-networkd... Nov 4 23:20:24.410754 systemd-networkd[1573]: eth0: Found matching .network file, based on potentially unpredictable interface name: /usr/lib/systemd/network/zz-default.network Nov 4 23:20:24.410764 systemd-networkd[1573]: eth0: Configuring with /usr/lib/systemd/network/zz-default.network. Nov 4 23:20:24.411361 systemd[1]: Starting systemd-networkd-wait-online.service - Wait for Network to be Configured... Nov 4 23:20:24.424420 systemd-networkd[1573]: eth0: Link UP Nov 4 23:20:24.425836 systemd-networkd[1573]: eth0: Gained carrier Nov 4 23:20:24.426047 systemd-networkd[1573]: eth0: Found matching .network file, based on potentially unpredictable interface name: /usr/lib/systemd/network/zz-default.network Nov 4 23:20:24.430620 (sd-merge)[1592]: Using extensions 'containerd-flatcar.raw', 'docker-flatcar.raw', 'kubernetes.raw', 'oem-ami.raw'. Nov 4 23:20:24.439286 systemd-networkd[1573]: eth0: DHCPv4 address 172.31.21.124/20, gateway 172.31.16.1 acquired from 172.31.16.1 Nov 4 23:20:24.439523 (sd-merge)[1592]: Merged extensions into '/usr'. Nov 4 23:20:24.464566 systemd[1]: Reload requested from client PID 1520 ('systemd-sysext') (unit systemd-sysext.service)... Nov 4 23:20:24.464598 systemd[1]: Reloading... Nov 4 23:20:24.706585 zram_generator::config[1636]: No configuration found. Nov 4 23:20:25.348432 systemd[1]: Condition check resulted in dev-ttyS0.device - /dev/ttyS0 being skipped. Nov 4 23:20:25.348550 systemd[1]: Reloading finished in 883 ms. Nov 4 23:20:25.372480 systemd[1]: Finished systemd-sysext.service - Merge System Extension Images into /usr/ and /opt/. Nov 4 23:20:25.377213 systemd[1]: Finished systemd-networkd-persistent-storage.service - Enable Persistent Storage in systemd-networkd. Nov 4 23:20:25.440253 systemd[1]: Found device dev-disk-by\x2dlabel-OEM.device - Amazon Elastic Block Store OEM. Nov 4 23:20:25.463427 systemd[1]: Starting ensure-sysext.service... Nov 4 23:20:25.469450 systemd[1]: Starting systemd-fsck@dev-disk-by\x2dlabel-OEM.service - File System Check on /dev/disk/by-label/OEM... Nov 4 23:20:25.477549 systemd[1]: Starting systemd-tmpfiles-setup.service - Create System Files and Directories... Nov 4 23:20:25.484827 systemd[1]: Starting systemd-vconsole-setup.service - Virtual Console Setup... Nov 4 23:20:25.531614 systemd-tmpfiles[1790]: /usr/lib/tmpfiles.d/nfs-utils.conf:6: Duplicate line for path "/var/lib/nfs/sm", ignoring. Nov 4 23:20:25.531691 systemd-tmpfiles[1790]: /usr/lib/tmpfiles.d/nfs-utils.conf:7: Duplicate line for path "/var/lib/nfs/sm.bak", ignoring. Nov 4 23:20:25.532437 systemd[1]: Reload requested from client PID 1788 ('systemctl') (unit ensure-sysext.service)... Nov 4 23:20:25.532461 systemd[1]: Reloading... Nov 4 23:20:25.533874 systemd-tmpfiles[1790]: /usr/lib/tmpfiles.d/provision.conf:20: Duplicate line for path "/root", ignoring. Nov 4 23:20:25.534513 systemd-tmpfiles[1790]: /usr/lib/tmpfiles.d/systemd-flatcar.conf:6: Duplicate line for path "/var/log/journal", ignoring. Nov 4 23:20:25.536505 systemd-tmpfiles[1790]: /usr/lib/tmpfiles.d/systemd.conf:29: Duplicate line for path "/var/lib/systemd", ignoring. Nov 4 23:20:25.537079 systemd-tmpfiles[1790]: ACLs are not supported, ignoring. Nov 4 23:20:25.537451 systemd-tmpfiles[1790]: ACLs are not supported, ignoring. Nov 4 23:20:25.566648 systemd-tmpfiles[1790]: Detected autofs mount point /boot during canonicalization of boot. Nov 4 23:20:25.566667 systemd-tmpfiles[1790]: Skipping /boot Nov 4 23:20:25.587774 systemd-tmpfiles[1790]: Detected autofs mount point /boot during canonicalization of boot. Nov 4 23:20:25.587794 systemd-tmpfiles[1790]: Skipping /boot Nov 4 23:20:25.721406 zram_generator::config[1831]: No configuration found. Nov 4 23:20:25.873398 systemd-networkd[1573]: eth0: Gained IPv6LL Nov 4 23:20:26.153100 systemd[1]: Reloading finished in 620 ms. Nov 4 23:20:26.185313 systemd[1]: Finished systemd-networkd-wait-online.service - Wait for Network to be Configured. Nov 4 23:20:26.215248 systemd[1]: Finished systemd-fsck@dev-disk-by\x2dlabel-OEM.service - File System Check on /dev/disk/by-label/OEM. Nov 4 23:20:26.219142 systemd[1]: Finished systemd-tmpfiles-setup.service - Create System Files and Directories. Nov 4 23:20:26.225272 systemd[1]: Finished systemd-vconsole-setup.service - Virtual Console Setup. Nov 4 23:20:26.243753 systemd[1]: Reached target network-online.target - Network is Online. Nov 4 23:20:26.249271 systemd[1]: Starting audit-rules.service - Load Audit Rules... Nov 4 23:20:26.257684 systemd[1]: Starting clean-ca-certificates.service - Clean up broken links in /etc/ssl/certs... Nov 4 23:20:26.269134 systemd[1]: Starting ldconfig.service - Rebuild Dynamic Linker Cache... Nov 4 23:20:26.279743 systemd[1]: Starting systemd-journal-catalog-update.service - Rebuild Journal Catalog... Nov 4 23:20:26.291331 systemd[1]: Starting systemd-update-utmp.service - Record System Boot/Shutdown in UTMP... Nov 4 23:20:26.301763 systemd[1]: ignition-delete-config.service - Ignition (delete config) was skipped because no trigger condition checks were met. Nov 4 23:20:26.305176 systemd[1]: Starting modprobe@dm_mod.service - Load Kernel Module dm_mod... Nov 4 23:20:26.312526 systemd[1]: Starting modprobe@efi_pstore.service - Load Kernel Module efi_pstore... Nov 4 23:20:26.319220 systemd[1]: Starting modprobe@loop.service - Load Kernel Module loop... Nov 4 23:20:26.324819 systemd[1]: systemd-binfmt.service - Set Up Additional Binary Formats was skipped because no trigger condition checks were met. Nov 4 23:20:26.325074 systemd[1]: systemd-hibernate-clear.service - Clear Stale Hibernate Storage Info was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67). Nov 4 23:20:26.334488 systemd[1]: ignition-delete-config.service - Ignition (delete config) was skipped because no trigger condition checks were met. Nov 4 23:20:26.334825 systemd[1]: systemd-binfmt.service - Set Up Additional Binary Formats was skipped because no trigger condition checks were met. Nov 4 23:20:26.335007 systemd[1]: systemd-hibernate-clear.service - Clear Stale Hibernate Storage Info was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67). Nov 4 23:20:26.346081 systemd[1]: ignition-delete-config.service - Ignition (delete config) was skipped because no trigger condition checks were met. Nov 4 23:20:26.353314 systemd[1]: Starting modprobe@drm.service - Load Kernel Module drm... Nov 4 23:20:26.357553 systemd[1]: systemd-binfmt.service - Set Up Additional Binary Formats was skipped because no trigger condition checks were met. Nov 4 23:20:26.357816 systemd[1]: systemd-hibernate-clear.service - Clear Stale Hibernate Storage Info was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67). Nov 4 23:20:26.358112 systemd[1]: Reached target time-set.target - System Time Set. Nov 4 23:20:26.377351 systemd[1]: Finished systemd-journal-catalog-update.service - Rebuild Journal Catalog. Nov 4 23:20:26.382309 systemd[1]: Finished ensure-sysext.service. Nov 4 23:20:26.414776 systemd[1]: Finished systemd-update-utmp.service - Record System Boot/Shutdown in UTMP. Nov 4 23:20:26.456092 systemd[1]: modprobe@dm_mod.service: Deactivated successfully. Nov 4 23:20:26.456806 systemd[1]: Finished modprobe@dm_mod.service - Load Kernel Module dm_mod. Nov 4 23:20:26.465638 systemd[1]: modprobe@efi_pstore.service: Deactivated successfully. Nov 4 23:20:26.466026 systemd[1]: Finished modprobe@efi_pstore.service - Load Kernel Module efi_pstore. Nov 4 23:20:26.471145 systemd[1]: modprobe@loop.service: Deactivated successfully. Nov 4 23:20:26.471566 systemd[1]: Finished modprobe@loop.service - Load Kernel Module loop. Nov 4 23:20:26.475136 systemd[1]: modprobe@drm.service: Deactivated successfully. Nov 4 23:20:26.475861 systemd[1]: Finished modprobe@drm.service - Load Kernel Module drm. Nov 4 23:20:26.484895 systemd[1]: systemd-pstore.service - Platform Persistent Storage Archival was skipped because of an unmet condition check (ConditionDirectoryNotEmpty=/sys/fs/pstore). Nov 4 23:20:26.485059 systemd[1]: systemd-repart.service - Repartition Root Disk was skipped because no trigger condition checks were met. Nov 4 23:20:26.494453 augenrules[1922]: No rules Nov 4 23:20:26.497457 systemd[1]: audit-rules.service: Deactivated successfully. Nov 4 23:20:26.497968 systemd[1]: Finished audit-rules.service - Load Audit Rules. Nov 4 23:20:26.559888 systemd[1]: Finished clean-ca-certificates.service - Clean up broken links in /etc/ssl/certs. Nov 4 23:20:26.565010 systemd[1]: update-ca-certificates.service - Update CA bundle at /etc/ssl/certs/ca-certificates.crt was skipped because of an unmet condition check (ConditionPathIsSymbolicLink=!/etc/ssl/certs/ca-certificates.crt). Nov 4 23:20:29.172639 ldconfig[1888]: /sbin/ldconfig: /usr/lib/ld.so.conf is not an ELF file - it has the wrong magic bytes at the start. Nov 4 23:20:29.182379 systemd[1]: Finished ldconfig.service - Rebuild Dynamic Linker Cache. Nov 4 23:20:29.189507 systemd[1]: Starting systemd-update-done.service - Update is Completed... Nov 4 23:20:29.226368 systemd[1]: Finished systemd-update-done.service - Update is Completed. Nov 4 23:20:29.229452 systemd[1]: Reached target sysinit.target - System Initialization. Nov 4 23:20:29.232046 systemd[1]: Started motdgen.path - Watch for update engine configuration changes. Nov 4 23:20:29.235934 systemd[1]: Started user-cloudinit@var-lib-flatcar\x2dinstall-user_data.path - Watch for a cloud-config at /var/lib/flatcar-install/user_data. Nov 4 23:20:29.239377 systemd[1]: Started logrotate.timer - Daily rotation of log files. Nov 4 23:20:29.242729 systemd[1]: Started mdadm.timer - Weekly check for MD array's redundancy information.. Nov 4 23:20:29.245894 systemd[1]: Started systemd-tmpfiles-clean.timer - Daily Cleanup of Temporary Directories. Nov 4 23:20:29.248821 systemd[1]: update-engine-stub.timer - Update Engine Stub Timer was skipped because of an unmet condition check (ConditionPathExists=/usr/.noupdate). Nov 4 23:20:29.249096 systemd[1]: Reached target paths.target - Path Units. Nov 4 23:20:29.251374 systemd[1]: Reached target timers.target - Timer Units. Nov 4 23:20:29.255513 systemd[1]: Listening on dbus.socket - D-Bus System Message Bus Socket. Nov 4 23:20:29.260740 systemd[1]: Starting docker.socket - Docker Socket for the API... Nov 4 23:20:29.267243 systemd[1]: Listening on sshd-unix-local.socket - OpenSSH Server Socket (systemd-ssh-generator, AF_UNIX Local). Nov 4 23:20:29.270799 systemd[1]: Listening on sshd-vsock.socket - OpenSSH Server Socket (systemd-ssh-generator, AF_VSOCK). Nov 4 23:20:29.273779 systemd[1]: Reached target ssh-access.target - SSH Access Available. Nov 4 23:20:29.285615 systemd[1]: Listening on sshd.socket - OpenSSH Server Socket. Nov 4 23:20:29.289663 systemd[1]: Listening on systemd-hostnamed.socket - Hostname Service Socket. Nov 4 23:20:29.293667 systemd[1]: Listening on docker.socket - Docker Socket for the API. Nov 4 23:20:29.296622 systemd[1]: Reached target sockets.target - Socket Units. Nov 4 23:20:29.299022 systemd[1]: Reached target basic.target - Basic System. Nov 4 23:20:29.301406 systemd[1]: addon-config@oem.service - Configure Addon /oem was skipped because no trigger condition checks were met. Nov 4 23:20:29.301467 systemd[1]: addon-run@oem.service - Run Addon /oem was skipped because no trigger condition checks were met. Nov 4 23:20:29.303640 systemd[1]: Starting containerd.service - containerd container runtime... Nov 4 23:20:29.310448 systemd[1]: Starting coreos-metadata.service - Flatcar Metadata Agent... Nov 4 23:20:29.314901 systemd[1]: Starting dbus.service - D-Bus System Message Bus... Nov 4 23:20:29.322529 systemd[1]: Starting dracut-shutdown.service - Restore /run/initramfs on shutdown... Nov 4 23:20:29.330308 systemd[1]: Starting enable-oem-cloudinit.service - Enable cloudinit... Nov 4 23:20:29.345564 systemd[1]: Starting extend-filesystems.service - Extend Filesystems... Nov 4 23:20:29.352500 systemd[1]: flatcar-setup-environment.service - Modifies /etc/environment for CoreOS was skipped because of an unmet condition check (ConditionPathExists=/oem/bin/flatcar-setup-environment). Nov 4 23:20:29.357534 systemd[1]: Starting kubelet.service - kubelet: The Kubernetes Node Agent... Nov 4 23:20:29.363383 systemd[1]: Starting motdgen.service - Generate /run/flatcar/motd... Nov 4 23:20:29.366538 jq[1938]: false Nov 4 23:20:29.373575 systemd[1]: Started ntpd.service - Network Time Service. Nov 4 23:20:29.380691 systemd[1]: Starting nvidia.service - NVIDIA Configure Service... Nov 4 23:20:29.392524 systemd[1]: Starting prepare-helm.service - Unpack helm to /opt/bin... Nov 4 23:20:29.403971 systemd[1]: Starting setup-oem.service - Setup OEM... Nov 4 23:20:29.411662 systemd[1]: Starting ssh-key-proc-cmdline.service - Install an ssh key from /proc/cmdline... Nov 4 23:20:29.423280 systemd[1]: Starting sshd-keygen.service - Generate sshd host keys... Nov 4 23:20:29.435611 systemd[1]: Starting systemd-logind.service - User Login Management... Nov 4 23:20:29.438184 systemd[1]: tcsd.service - TCG Core Services Daemon was skipped because of an unmet condition check (ConditionPathExists=/dev/tpm0). Nov 4 23:20:29.439185 systemd[1]: cgroup compatibility translation between legacy and unified hierarchy settings activated. See cgroup-compat debug messages for details. Nov 4 23:20:29.444497 systemd[1]: Starting update-engine.service - Update Engine... Nov 4 23:20:29.462758 systemd[1]: Starting update-ssh-keys-after-ignition.service - Run update-ssh-keys once after Ignition... Nov 4 23:20:29.473349 systemd[1]: Finished dracut-shutdown.service - Restore /run/initramfs on shutdown. Nov 4 23:20:29.478384 systemd[1]: enable-oem-cloudinit.service: Skipped due to 'exec-condition'. Nov 4 23:20:29.478953 systemd[1]: Condition check resulted in enable-oem-cloudinit.service - Enable cloudinit being skipped. Nov 4 23:20:29.577550 systemd[1]: ssh-key-proc-cmdline.service: Deactivated successfully. Nov 4 23:20:29.581336 systemd[1]: Finished ssh-key-proc-cmdline.service - Install an ssh key from /proc/cmdline. Nov 4 23:20:29.592692 extend-filesystems[1939]: Found /dev/nvme0n1p6 Nov 4 23:20:29.621199 extend-filesystems[1939]: Found /dev/nvme0n1p9 Nov 4 23:20:29.626532 jq[1954]: true Nov 4 23:20:29.636624 systemd[1]: motdgen.service: Deactivated successfully. Nov 4 23:20:29.649864 extend-filesystems[1939]: Checking size of /dev/nvme0n1p9 Nov 4 23:20:29.640119 systemd[1]: Finished motdgen.service - Generate /run/flatcar/motd. Nov 4 23:20:29.665748 tar[1968]: linux-arm64/LICENSE Nov 4 23:20:29.665748 tar[1968]: linux-arm64/helm Nov 4 23:20:29.687012 ntpd[1942]: 4 Nov 23:20:29 ntpd[1942]: ntpd 4.2.8p18@1.4062-o Tue Nov 4 21:31:46 UTC 2025 (1): Starting Nov 4 23:20:29.687012 ntpd[1942]: 4 Nov 23:20:29 ntpd[1942]: Command line: /usr/sbin/ntpd -g -n -u ntp:ntp Nov 4 23:20:29.687012 ntpd[1942]: 4 Nov 23:20:29 ntpd[1942]: ---------------------------------------------------- Nov 4 23:20:29.687012 ntpd[1942]: 4 Nov 23:20:29 ntpd[1942]: ntp-4 is maintained by Network Time Foundation, Nov 4 23:20:29.687012 ntpd[1942]: 4 Nov 23:20:29 ntpd[1942]: Inc. (NTF), a non-profit 501(c)(3) public-benefit Nov 4 23:20:29.687012 ntpd[1942]: 4 Nov 23:20:29 ntpd[1942]: corporation. Support and training for ntp-4 are Nov 4 23:20:29.687012 ntpd[1942]: 4 Nov 23:20:29 ntpd[1942]: available at https://www.nwtime.org/support Nov 4 23:20:29.687012 ntpd[1942]: 4 Nov 23:20:29 ntpd[1942]: ---------------------------------------------------- Nov 4 23:20:29.683809 ntpd[1942]: ntpd 4.2.8p18@1.4062-o Tue Nov 4 21:31:46 UTC 2025 (1): Starting Nov 4 23:20:29.683926 ntpd[1942]: Command line: /usr/sbin/ntpd -g -n -u ntp:ntp Nov 4 23:20:29.709211 ntpd[1942]: 4 Nov 23:20:29 ntpd[1942]: proto: precision = 0.096 usec (-23) Nov 4 23:20:29.709211 ntpd[1942]: 4 Nov 23:20:29 ntpd[1942]: basedate set to 2025-10-23 Nov 4 23:20:29.709211 ntpd[1942]: 4 Nov 23:20:29 ntpd[1942]: gps base set to 2025-10-26 (week 2390) Nov 4 23:20:29.709211 ntpd[1942]: 4 Nov 23:20:29 ntpd[1942]: Listen and drop on 0 v6wildcard [::]:123 Nov 4 23:20:29.709211 ntpd[1942]: 4 Nov 23:20:29 ntpd[1942]: Listen and drop on 1 v4wildcard 0.0.0.0:123 Nov 4 23:20:29.709211 ntpd[1942]: 4 Nov 23:20:29 ntpd[1942]: Listen normally on 2 lo 127.0.0.1:123 Nov 4 23:20:29.709211 ntpd[1942]: 4 Nov 23:20:29 ntpd[1942]: Listen normally on 3 eth0 172.31.21.124:123 Nov 4 23:20:29.709211 ntpd[1942]: 4 Nov 23:20:29 ntpd[1942]: Listen normally on 4 lo [::1]:123 Nov 4 23:20:29.709211 ntpd[1942]: 4 Nov 23:20:29 ntpd[1942]: Listen normally on 5 eth0 [fe80::4f1:17ff:fe65:1161%2]:123 Nov 4 23:20:29.709211 ntpd[1942]: 4 Nov 23:20:29 ntpd[1942]: Listening on routing socket on fd #22 for interface updates Nov 4 23:20:29.692715 (ntainerd)[1977]: containerd.service: Referenced but unset environment variable evaluates to an empty string: TORCX_IMAGEDIR, TORCX_UNPACKDIR Nov 4 23:20:29.711650 jq[1990]: true Nov 4 23:20:29.683944 ntpd[1942]: ---------------------------------------------------- Nov 4 23:20:29.683960 ntpd[1942]: ntp-4 is maintained by Network Time Foundation, Nov 4 23:20:29.683977 ntpd[1942]: Inc. (NTF), a non-profit 501(c)(3) public-benefit Nov 4 23:20:29.683992 ntpd[1942]: corporation. Support and training for ntp-4 are Nov 4 23:20:29.684008 ntpd[1942]: available at https://www.nwtime.org/support Nov 4 23:20:29.684024 ntpd[1942]: ---------------------------------------------------- Nov 4 23:20:29.691547 ntpd[1942]: proto: precision = 0.096 usec (-23) Nov 4 23:20:29.694210 ntpd[1942]: basedate set to 2025-10-23 Nov 4 23:20:29.695453 ntpd[1942]: gps base set to 2025-10-26 (week 2390) Nov 4 23:20:29.695641 ntpd[1942]: Listen and drop on 0 v6wildcard [::]:123 Nov 4 23:20:29.695685 ntpd[1942]: Listen and drop on 1 v4wildcard 0.0.0.0:123 Nov 4 23:20:29.696029 ntpd[1942]: Listen normally on 2 lo 127.0.0.1:123 Nov 4 23:20:29.696072 ntpd[1942]: Listen normally on 3 eth0 172.31.21.124:123 Nov 4 23:20:29.696117 ntpd[1942]: Listen normally on 4 lo [::1]:123 Nov 4 23:20:29.696182 ntpd[1942]: Listen normally on 5 eth0 [fe80::4f1:17ff:fe65:1161%2]:123 Nov 4 23:20:29.696226 ntpd[1942]: Listening on routing socket on fd #22 for interface updates Nov 4 23:20:29.727821 ntpd[1942]: 4 Nov 23:20:29 ntpd[1942]: kernel reports TIME_ERROR: 0x41: Clock Unsynchronized Nov 4 23:20:29.727821 ntpd[1942]: 4 Nov 23:20:29 ntpd[1942]: kernel reports TIME_ERROR: 0x41: Clock Unsynchronized Nov 4 23:20:29.724674 ntpd[1942]: kernel reports TIME_ERROR: 0x41: Clock Unsynchronized Nov 4 23:20:29.724718 ntpd[1942]: kernel reports TIME_ERROR: 0x41: Clock Unsynchronized Nov 4 23:20:29.745385 dbus-daemon[1936]: [system] SELinux support is enabled Nov 4 23:20:29.746061 systemd[1]: Started dbus.service - D-Bus System Message Bus. Nov 4 23:20:29.764875 dbus-daemon[1936]: [system] Activating systemd to hand-off: service name='org.freedesktop.hostname1' unit='dbus-org.freedesktop.hostname1.service' requested by ':1.1' (uid=244 pid=1573 comm="/usr/lib/systemd/systemd-networkd" label="system_u:system_r:kernel_t:s0") Nov 4 23:20:29.772340 systemd[1]: Finished nvidia.service - NVIDIA Configure Service. Nov 4 23:20:29.779431 systemd[1]: system-cloudinit@usr-share-oem-cloud\x2dconfig.yml.service - Load cloud-config from /usr/share/oem/cloud-config.yml was skipped because of an unmet condition check (ConditionFileNotEmpty=/usr/share/oem/cloud-config.yml). Nov 4 23:20:29.779504 systemd[1]: Reached target system-config.target - Load system-provided cloud configs. Nov 4 23:20:29.792443 update_engine[1950]: I20251104 23:20:29.770010 1950 main.cc:92] Flatcar Update Engine starting Nov 4 23:20:29.792840 extend-filesystems[1939]: Resized partition /dev/nvme0n1p9 Nov 4 23:20:29.782666 systemd[1]: user-cloudinit-proc-cmdline.service - Load cloud-config from url defined in /proc/cmdline was skipped because of an unmet condition check (ConditionKernelCommandLine=cloud-config-url). Nov 4 23:20:29.782702 systemd[1]: Reached target user-config.target - Load user-provided cloud configs. Nov 4 23:20:29.810207 extend-filesystems[2010]: resize2fs 1.47.3 (8-Jul-2025) Nov 4 23:20:29.802504 dbus-daemon[1936]: [system] Successfully activated service 'org.freedesktop.systemd1' Nov 4 23:20:29.813031 systemd[1]: Starting systemd-hostnamed.service - Hostname Service... Nov 4 23:20:29.828123 systemd[1]: Started update-engine.service - Update Engine. Nov 4 23:20:29.835005 update_engine[1950]: I20251104 23:20:29.834582 1950 update_check_scheduler.cc:74] Next update check in 7m1s Nov 4 23:20:29.862713 kernel: EXT4-fs (nvme0n1p9): resizing filesystem from 1617920 to 2604027 blocks Nov 4 23:20:29.864855 coreos-metadata[1935]: Nov 04 23:20:29.864 INFO Putting http://169.254.169.254/latest/api/token: Attempt #1 Nov 4 23:20:29.866541 systemd[1]: Started locksmithd.service - Cluster reboot manager. Nov 4 23:20:29.870186 systemd[1]: Finished setup-oem.service - Setup OEM. Nov 4 23:20:29.878969 coreos-metadata[1935]: Nov 04 23:20:29.875 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/instance-id: Attempt #1 Nov 4 23:20:29.883483 coreos-metadata[1935]: Nov 04 23:20:29.883 INFO Fetch successful Nov 4 23:20:29.883483 coreos-metadata[1935]: Nov 04 23:20:29.883 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/instance-type: Attempt #1 Nov 4 23:20:29.883674 coreos-metadata[1935]: Nov 04 23:20:29.883 INFO Fetch successful Nov 4 23:20:29.883674 coreos-metadata[1935]: Nov 04 23:20:29.883 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/local-ipv4: Attempt #1 Nov 4 23:20:29.883674 coreos-metadata[1935]: Nov 04 23:20:29.883 INFO Fetch successful Nov 4 23:20:29.883674 coreos-metadata[1935]: Nov 04 23:20:29.883 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/public-ipv4: Attempt #1 Nov 4 23:20:29.884620 systemd[1]: Started amazon-ssm-agent.service - amazon-ssm-agent. Nov 4 23:20:29.889398 coreos-metadata[1935]: Nov 04 23:20:29.887 INFO Fetch successful Nov 4 23:20:29.889398 coreos-metadata[1935]: Nov 04 23:20:29.887 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/ipv6: Attempt #1 Nov 4 23:20:29.891460 coreos-metadata[1935]: Nov 04 23:20:29.891 INFO Fetch failed with 404: resource not found Nov 4 23:20:29.891460 coreos-metadata[1935]: Nov 04 23:20:29.891 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/placement/availability-zone: Attempt #1 Nov 4 23:20:29.894360 kernel: EXT4-fs (nvme0n1p9): resized filesystem to 2604027 Nov 4 23:20:29.894456 coreos-metadata[1935]: Nov 04 23:20:29.893 INFO Fetch successful Nov 4 23:20:29.894456 coreos-metadata[1935]: Nov 04 23:20:29.893 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/placement/availability-zone-id: Attempt #1 Nov 4 23:20:29.906029 coreos-metadata[1935]: Nov 04 23:20:29.895 INFO Fetch successful Nov 4 23:20:29.906029 coreos-metadata[1935]: Nov 04 23:20:29.895 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/hostname: Attempt #1 Nov 4 23:20:29.906029 coreos-metadata[1935]: Nov 04 23:20:29.897 INFO Fetch successful Nov 4 23:20:29.906029 coreos-metadata[1935]: Nov 04 23:20:29.897 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/public-hostname: Attempt #1 Nov 4 23:20:29.906029 coreos-metadata[1935]: Nov 04 23:20:29.897 INFO Fetch successful Nov 4 23:20:29.906029 coreos-metadata[1935]: Nov 04 23:20:29.897 INFO Fetching http://169.254.169.254/2021-01-03/dynamic/instance-identity/document: Attempt #1 Nov 4 23:20:29.906029 coreos-metadata[1935]: Nov 04 23:20:29.898 INFO Fetch successful Nov 4 23:20:29.915136 extend-filesystems[2010]: Filesystem at /dev/nvme0n1p9 is mounted on /; on-line resizing required Nov 4 23:20:29.915136 extend-filesystems[2010]: old_desc_blocks = 1, new_desc_blocks = 2 Nov 4 23:20:29.915136 extend-filesystems[2010]: The filesystem on /dev/nvme0n1p9 is now 2604027 (4k) blocks long. Nov 4 23:20:29.929711 extend-filesystems[1939]: Resized filesystem in /dev/nvme0n1p9 Nov 4 23:20:29.935071 systemd[1]: extend-filesystems.service: Deactivated successfully. Nov 4 23:20:29.935557 systemd[1]: Finished extend-filesystems.service - Extend Filesystems. Nov 4 23:20:30.074967 systemd[1]: Finished coreos-metadata.service - Flatcar Metadata Agent. Nov 4 23:20:30.080139 systemd[1]: packet-phone-home.service - Report Success to Packet was skipped because no trigger condition checks were met. Nov 4 23:20:30.083483 bash[2035]: Updated "/home/core/.ssh/authorized_keys" Nov 4 23:20:30.088449 systemd[1]: Finished update-ssh-keys-after-ignition.service - Run update-ssh-keys once after Ignition. Nov 4 23:20:30.104893 systemd[1]: Starting sshkeys.service... Nov 4 23:20:30.244774 systemd[1]: Created slice system-coreos\x2dmetadata\x2dsshkeys.slice - Slice /system/coreos-metadata-sshkeys. Nov 4 23:20:30.255329 systemd[1]: Starting coreos-metadata-sshkeys@core.service - Flatcar Metadata Agent (SSH Keys)... Nov 4 23:20:30.271009 systemd-logind[1949]: Watching system buttons on /dev/input/event0 (Power Button) Nov 4 23:20:30.271071 systemd-logind[1949]: Watching system buttons on /dev/input/event1 (Sleep Button) Nov 4 23:20:30.327084 systemd[1]: Started systemd-hostnamed.service - Hostname Service. Nov 4 23:20:30.327368 systemd-logind[1949]: New seat seat0. Nov 4 23:20:30.331478 dbus-daemon[1936]: [system] Successfully activated service 'org.freedesktop.hostname1' Nov 4 23:20:30.332433 dbus-daemon[1936]: [system] Activating via systemd: service name='org.freedesktop.PolicyKit1' unit='polkit.service' requested by ':1.4' (uid=0 pid=2011 comm="/usr/lib/systemd/systemd-hostnamed" label="system_u:system_r:kernel_t:s0") Nov 4 23:20:30.345855 systemd[1]: Starting polkit.service - Authorization Manager... Nov 4 23:20:30.348714 systemd[1]: Started systemd-logind.service - User Login Management. Nov 4 23:20:30.606747 sshd_keygen[1996]: ssh-keygen: generating new host keys: RSA ECDSA ED25519 Nov 4 23:20:30.636736 amazon-ssm-agent[2021]: Initializing new seelog logger Nov 4 23:20:30.639650 amazon-ssm-agent[2021]: New Seelog Logger Creation Complete Nov 4 23:20:30.645201 amazon-ssm-agent[2021]: 2025/11/04 23:20:30 Found config file at /etc/amazon/ssm/amazon-ssm-agent.json. Nov 4 23:20:30.645201 amazon-ssm-agent[2021]: Applying config override from /etc/amazon/ssm/amazon-ssm-agent.json. Nov 4 23:20:30.646233 amazon-ssm-agent[2021]: 2025/11/04 23:20:30 processing appconfig overrides Nov 4 23:20:30.653271 amazon-ssm-agent[2021]: 2025/11/04 23:20:30 Found config file at /etc/amazon/ssm/amazon-ssm-agent.json. Nov 4 23:20:30.657441 amazon-ssm-agent[2021]: Applying config override from /etc/amazon/ssm/amazon-ssm-agent.json. Nov 4 23:20:30.657441 amazon-ssm-agent[2021]: 2025/11/04 23:20:30 processing appconfig overrides Nov 4 23:20:30.657441 amazon-ssm-agent[2021]: 2025-11-04 23:20:30.6524 INFO Proxy environment variables: Nov 4 23:20:30.660416 amazon-ssm-agent[2021]: 2025/11/04 23:20:30 Found config file at /etc/amazon/ssm/amazon-ssm-agent.json. Nov 4 23:20:30.660416 amazon-ssm-agent[2021]: Applying config override from /etc/amazon/ssm/amazon-ssm-agent.json. Nov 4 23:20:30.666076 amazon-ssm-agent[2021]: 2025/11/04 23:20:30 processing appconfig overrides Nov 4 23:20:30.681220 amazon-ssm-agent[2021]: 2025/11/04 23:20:30 Found config file at /etc/amazon/ssm/amazon-ssm-agent.json. Nov 4 23:20:30.681220 amazon-ssm-agent[2021]: Applying config override from /etc/amazon/ssm/amazon-ssm-agent.json. Nov 4 23:20:30.681220 amazon-ssm-agent[2021]: 2025/11/04 23:20:30 processing appconfig overrides Nov 4 23:20:30.701455 coreos-metadata[2051]: Nov 04 23:20:30.701 INFO Putting http://169.254.169.254/latest/api/token: Attempt #1 Nov 4 23:20:30.715916 coreos-metadata[2051]: Nov 04 23:20:30.713 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/public-keys: Attempt #1 Nov 4 23:20:30.718241 coreos-metadata[2051]: Nov 04 23:20:30.718 INFO Fetch successful Nov 4 23:20:30.718407 coreos-metadata[2051]: Nov 04 23:20:30.718 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/public-keys/0/openssh-key: Attempt #1 Nov 4 23:20:30.724052 coreos-metadata[2051]: Nov 04 23:20:30.722 INFO Fetch successful Nov 4 23:20:30.729173 unknown[2051]: wrote ssh authorized keys file for user: core Nov 4 23:20:30.756484 amazon-ssm-agent[2021]: 2025-11-04 23:20:30.6525 INFO https_proxy: Nov 4 23:20:30.805687 update-ssh-keys[2129]: Updated "/home/core/.ssh/authorized_keys" Nov 4 23:20:30.810693 systemd[1]: Finished coreos-metadata-sshkeys@core.service - Flatcar Metadata Agent (SSH Keys). Nov 4 23:20:30.818991 systemd[1]: Finished sshkeys.service. Nov 4 23:20:30.857432 amazon-ssm-agent[2021]: 2025-11-04 23:20:30.6525 INFO http_proxy: Nov 4 23:20:30.870938 systemd[1]: Finished sshd-keygen.service - Generate sshd host keys. Nov 4 23:20:30.879526 systemd[1]: Starting issuegen.service - Generate /run/issue... Nov 4 23:20:30.985028 amazon-ssm-agent[2021]: 2025-11-04 23:20:30.6525 INFO no_proxy: Nov 4 23:20:30.987823 systemd[1]: issuegen.service: Deactivated successfully. Nov 4 23:20:30.988356 systemd[1]: Finished issuegen.service - Generate /run/issue. Nov 4 23:20:30.995456 systemd[1]: Starting systemd-user-sessions.service - Permit User Sessions... Nov 4 23:20:31.055836 systemd[1]: Finished systemd-user-sessions.service - Permit User Sessions. Nov 4 23:20:31.063419 systemd[1]: Started getty@tty1.service - Getty on tty1. Nov 4 23:20:31.071829 systemd[1]: Started serial-getty@ttyS0.service - Serial Getty on ttyS0. Nov 4 23:20:31.074808 systemd[1]: Reached target getty.target - Login Prompts. Nov 4 23:20:31.097526 amazon-ssm-agent[2021]: 2025-11-04 23:20:30.6565 INFO Checking if agent identity type OnPrem can be assumed Nov 4 23:20:31.165312 containerd[1977]: time="2025-11-04T23:20:31Z" level=warning msg="Ignoring unknown key in TOML" column=1 error="strict mode: fields in the document are missing in the target struct" file=/usr/share/containerd/config.toml key=subreaper row=8 Nov 4 23:20:31.174851 containerd[1977]: time="2025-11-04T23:20:31.168277160Z" level=info msg="starting containerd" revision=fb4c30d4ede3531652d86197bf3fc9515e5276d9 version=v2.0.5 Nov 4 23:20:31.176848 locksmithd[2012]: locksmithd starting currentOperation="UPDATE_STATUS_IDLE" strategy="reboot" Nov 4 23:20:31.201199 amazon-ssm-agent[2021]: 2025-11-04 23:20:30.6573 INFO Checking if agent identity type EC2 can be assumed Nov 4 23:20:31.246205 containerd[1977]: time="2025-11-04T23:20:31.243553424Z" level=warning msg="Configuration migrated from version 2, use `containerd config migrate` to avoid migration" t="14.736µs" Nov 4 23:20:31.246205 containerd[1977]: time="2025-11-04T23:20:31.243615392Z" level=info msg="loading plugin" id=io.containerd.image-verifier.v1.bindir type=io.containerd.image-verifier.v1 Nov 4 23:20:31.246205 containerd[1977]: time="2025-11-04T23:20:31.243651008Z" level=info msg="loading plugin" id=io.containerd.internal.v1.opt type=io.containerd.internal.v1 Nov 4 23:20:31.246205 containerd[1977]: time="2025-11-04T23:20:31.243944912Z" level=info msg="loading plugin" id=io.containerd.warning.v1.deprecations type=io.containerd.warning.v1 Nov 4 23:20:31.246205 containerd[1977]: time="2025-11-04T23:20:31.244750388Z" level=info msg="loading plugin" id=io.containerd.content.v1.content type=io.containerd.content.v1 Nov 4 23:20:31.246205 containerd[1977]: time="2025-11-04T23:20:31.245174876Z" level=info msg="loading plugin" id=io.containerd.snapshotter.v1.blockfile type=io.containerd.snapshotter.v1 Nov 4 23:20:31.246547 containerd[1977]: time="2025-11-04T23:20:31.246264440Z" level=info msg="skip loading plugin" error="no scratch file generator: skip plugin" id=io.containerd.snapshotter.v1.blockfile type=io.containerd.snapshotter.v1 Nov 4 23:20:31.246547 containerd[1977]: time="2025-11-04T23:20:31.246308036Z" level=info msg="loading plugin" id=io.containerd.snapshotter.v1.btrfs type=io.containerd.snapshotter.v1 Nov 4 23:20:31.247619 containerd[1977]: time="2025-11-04T23:20:31.246710420Z" level=info msg="skip loading plugin" error="path /var/lib/containerd/io.containerd.snapshotter.v1.btrfs (ext4) must be a btrfs filesystem to be used with the btrfs snapshotter: skip plugin" id=io.containerd.snapshotter.v1.btrfs type=io.containerd.snapshotter.v1 Nov 4 23:20:31.247619 containerd[1977]: time="2025-11-04T23:20:31.246770420Z" level=info msg="loading plugin" id=io.containerd.snapshotter.v1.devmapper type=io.containerd.snapshotter.v1 Nov 4 23:20:31.247619 containerd[1977]: time="2025-11-04T23:20:31.246803780Z" level=info msg="skip loading plugin" error="devmapper not configured: skip plugin" id=io.containerd.snapshotter.v1.devmapper type=io.containerd.snapshotter.v1 Nov 4 23:20:31.247619 containerd[1977]: time="2025-11-04T23:20:31.246824828Z" level=info msg="loading plugin" id=io.containerd.snapshotter.v1.native type=io.containerd.snapshotter.v1 Nov 4 23:20:31.247619 containerd[1977]: time="2025-11-04T23:20:31.247039052Z" level=info msg="loading plugin" id=io.containerd.snapshotter.v1.overlayfs type=io.containerd.snapshotter.v1 Nov 4 23:20:31.253781 containerd[1977]: time="2025-11-04T23:20:31.253710536Z" level=info msg="loading plugin" id=io.containerd.snapshotter.v1.zfs type=io.containerd.snapshotter.v1 Nov 4 23:20:31.254255 containerd[1977]: time="2025-11-04T23:20:31.253805156Z" level=info msg="skip loading plugin" error="lstat /var/lib/containerd/io.containerd.snapshotter.v1.zfs: no such file or directory: skip plugin" id=io.containerd.snapshotter.v1.zfs type=io.containerd.snapshotter.v1 Nov 4 23:20:31.254255 containerd[1977]: time="2025-11-04T23:20:31.253836380Z" level=info msg="loading plugin" id=io.containerd.event.v1.exchange type=io.containerd.event.v1 Nov 4 23:20:31.254255 containerd[1977]: time="2025-11-04T23:20:31.253913552Z" level=info msg="loading plugin" id=io.containerd.monitor.task.v1.cgroups type=io.containerd.monitor.task.v1 Nov 4 23:20:31.257630 containerd[1977]: time="2025-11-04T23:20:31.257569520Z" level=info msg="loading plugin" id=io.containerd.metadata.v1.bolt type=io.containerd.metadata.v1 Nov 4 23:20:31.259538 containerd[1977]: time="2025-11-04T23:20:31.257757368Z" level=info msg="metadata content store policy set" policy=shared Nov 4 23:20:31.271536 containerd[1977]: time="2025-11-04T23:20:31.271447916Z" level=info msg="loading plugin" id=io.containerd.gc.v1.scheduler type=io.containerd.gc.v1 Nov 4 23:20:31.271693 containerd[1977]: time="2025-11-04T23:20:31.271605524Z" level=info msg="loading plugin" id=io.containerd.differ.v1.walking type=io.containerd.differ.v1 Nov 4 23:20:31.271745 containerd[1977]: time="2025-11-04T23:20:31.271689644Z" level=info msg="loading plugin" id=io.containerd.lease.v1.manager type=io.containerd.lease.v1 Nov 4 23:20:31.271745 containerd[1977]: time="2025-11-04T23:20:31.271722380Z" level=info msg="loading plugin" id=io.containerd.service.v1.containers-service type=io.containerd.service.v1 Nov 4 23:20:31.271826 containerd[1977]: time="2025-11-04T23:20:31.271774916Z" level=info msg="loading plugin" id=io.containerd.service.v1.content-service type=io.containerd.service.v1 Nov 4 23:20:31.271826 containerd[1977]: time="2025-11-04T23:20:31.271808660Z" level=info msg="loading plugin" id=io.containerd.service.v1.diff-service type=io.containerd.service.v1 Nov 4 23:20:31.271912 containerd[1977]: time="2025-11-04T23:20:31.271861232Z" level=info msg="loading plugin" id=io.containerd.service.v1.images-service type=io.containerd.service.v1 Nov 4 23:20:31.271912 containerd[1977]: time="2025-11-04T23:20:31.271893308Z" level=info msg="loading plugin" id=io.containerd.service.v1.introspection-service type=io.containerd.service.v1 Nov 4 23:20:31.272005 containerd[1977]: time="2025-11-04T23:20:31.271946984Z" level=info msg="loading plugin" id=io.containerd.service.v1.namespaces-service type=io.containerd.service.v1 Nov 4 23:20:31.272005 containerd[1977]: time="2025-11-04T23:20:31.271977800Z" level=info msg="loading plugin" id=io.containerd.service.v1.snapshots-service type=io.containerd.service.v1 Nov 4 23:20:31.275206 containerd[1977]: time="2025-11-04T23:20:31.272002364Z" level=info msg="loading plugin" id=io.containerd.shim.v1.manager type=io.containerd.shim.v1 Nov 4 23:20:31.275206 containerd[1977]: time="2025-11-04T23:20:31.274343852Z" level=info msg="loading plugin" id=io.containerd.runtime.v2.task type=io.containerd.runtime.v2 Nov 4 23:20:31.275206 containerd[1977]: time="2025-11-04T23:20:31.274805252Z" level=info msg="loading plugin" id=io.containerd.service.v1.tasks-service type=io.containerd.service.v1 Nov 4 23:20:31.277198 containerd[1977]: time="2025-11-04T23:20:31.274925348Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.containers type=io.containerd.grpc.v1 Nov 4 23:20:31.277198 containerd[1977]: time="2025-11-04T23:20:31.276595221Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.content type=io.containerd.grpc.v1 Nov 4 23:20:31.277198 containerd[1977]: time="2025-11-04T23:20:31.276643665Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.diff type=io.containerd.grpc.v1 Nov 4 23:20:31.277198 containerd[1977]: time="2025-11-04T23:20:31.276676485Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.events type=io.containerd.grpc.v1 Nov 4 23:20:31.277198 containerd[1977]: time="2025-11-04T23:20:31.276707577Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.images type=io.containerd.grpc.v1 Nov 4 23:20:31.277198 containerd[1977]: time="2025-11-04T23:20:31.276736233Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.introspection type=io.containerd.grpc.v1 Nov 4 23:20:31.277198 containerd[1977]: time="2025-11-04T23:20:31.276762597Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.leases type=io.containerd.grpc.v1 Nov 4 23:20:31.277198 containerd[1977]: time="2025-11-04T23:20:31.276791085Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.namespaces type=io.containerd.grpc.v1 Nov 4 23:20:31.277198 containerd[1977]: time="2025-11-04T23:20:31.276818349Z" level=info msg="loading plugin" id=io.containerd.sandbox.store.v1.local type=io.containerd.sandbox.store.v1 Nov 4 23:20:31.277198 containerd[1977]: time="2025-11-04T23:20:31.276844773Z" level=info msg="loading plugin" id=io.containerd.cri.v1.images type=io.containerd.cri.v1 Nov 4 23:20:31.285626 containerd[1977]: time="2025-11-04T23:20:31.283232529Z" level=info msg="Get image filesystem path \"/var/lib/containerd/io.containerd.snapshotter.v1.overlayfs\" for snapshotter \"overlayfs\"" Nov 4 23:20:31.285626 containerd[1977]: time="2025-11-04T23:20:31.283371009Z" level=info msg="Start snapshots syncer" Nov 4 23:20:31.285626 containerd[1977]: time="2025-11-04T23:20:31.283461873Z" level=info msg="loading plugin" id=io.containerd.cri.v1.runtime type=io.containerd.cri.v1 Nov 4 23:20:31.289209 containerd[1977]: time="2025-11-04T23:20:31.286395033Z" level=info msg="starting cri plugin" config="{\"containerd\":{\"defaultRuntimeName\":\"runc\",\"runtimes\":{\"runc\":{\"runtimeType\":\"io.containerd.runc.v2\",\"runtimePath\":\"\",\"PodAnnotations\":null,\"ContainerAnnotations\":null,\"options\":{\"BinaryName\":\"\",\"CriuImagePath\":\"\",\"CriuWorkPath\":\"\",\"IoGid\":0,\"IoUid\":0,\"NoNewKeyring\":false,\"Root\":\"\",\"ShimCgroup\":\"\",\"SystemdCgroup\":true},\"privileged_without_host_devices\":false,\"privileged_without_host_devices_all_devices_allowed\":false,\"baseRuntimeSpec\":\"\",\"cniConfDir\":\"\",\"cniMaxConfNum\":0,\"snapshotter\":\"\",\"sandboxer\":\"podsandbox\",\"io_type\":\"\"}},\"ignoreBlockIONotEnabledErrors\":false,\"ignoreRdtNotEnabledErrors\":false},\"cni\":{\"binDir\":\"/opt/cni/bin\",\"confDir\":\"/etc/cni/net.d\",\"maxConfNum\":1,\"setupSerially\":false,\"confTemplate\":\"\",\"ipPref\":\"\",\"useInternalLoopback\":false},\"enableSelinux\":true,\"selinuxCategoryRange\":1024,\"maxContainerLogSize\":16384,\"disableApparmor\":false,\"restrictOOMScoreAdj\":false,\"disableProcMount\":false,\"unsetSeccompProfile\":\"\",\"tolerateMissingHugetlbController\":true,\"disableHugetlbController\":true,\"device_ownership_from_security_context\":false,\"ignoreImageDefinedVolumes\":false,\"netnsMountsUnderStateDir\":false,\"enableUnprivilegedPorts\":true,\"enableUnprivilegedICMP\":true,\"enableCDI\":true,\"cdiSpecDirs\":[\"/etc/cdi\",\"/var/run/cdi\"],\"drainExecSyncIOTimeout\":\"0s\",\"ignoreDeprecationWarnings\":null,\"containerdRootDir\":\"/var/lib/containerd\",\"containerdEndpoint\":\"/run/containerd/containerd.sock\",\"rootDir\":\"/var/lib/containerd/io.containerd.grpc.v1.cri\",\"stateDir\":\"/run/containerd/io.containerd.grpc.v1.cri\"}" Nov 4 23:20:31.292181 containerd[1977]: time="2025-11-04T23:20:31.288354705Z" level=info msg="loading plugin" id=io.containerd.podsandbox.controller.v1.podsandbox type=io.containerd.podsandbox.controller.v1 Nov 4 23:20:31.292181 containerd[1977]: time="2025-11-04T23:20:31.289732389Z" level=info msg="loading plugin" id=io.containerd.sandbox.controller.v1.shim type=io.containerd.sandbox.controller.v1 Nov 4 23:20:31.292181 containerd[1977]: time="2025-11-04T23:20:31.290013033Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.sandbox-controllers type=io.containerd.grpc.v1 Nov 4 23:20:31.292181 containerd[1977]: time="2025-11-04T23:20:31.290544777Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.sandboxes type=io.containerd.grpc.v1 Nov 4 23:20:31.292181 containerd[1977]: time="2025-11-04T23:20:31.290575617Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.snapshots type=io.containerd.grpc.v1 Nov 4 23:20:31.292181 containerd[1977]: time="2025-11-04T23:20:31.290607597Z" level=info msg="loading plugin" id=io.containerd.streaming.v1.manager type=io.containerd.streaming.v1 Nov 4 23:20:31.292181 containerd[1977]: time="2025-11-04T23:20:31.290636913Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.streaming type=io.containerd.grpc.v1 Nov 4 23:20:31.292181 containerd[1977]: time="2025-11-04T23:20:31.290662773Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.tasks type=io.containerd.grpc.v1 Nov 4 23:20:31.292181 containerd[1977]: time="2025-11-04T23:20:31.290689941Z" level=info msg="loading plugin" id=io.containerd.transfer.v1.local type=io.containerd.transfer.v1 Nov 4 23:20:31.292181 containerd[1977]: time="2025-11-04T23:20:31.290779569Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.transfer type=io.containerd.grpc.v1 Nov 4 23:20:31.292181 containerd[1977]: time="2025-11-04T23:20:31.290808285Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.version type=io.containerd.grpc.v1 Nov 4 23:20:31.292181 containerd[1977]: time="2025-11-04T23:20:31.290835321Z" level=info msg="loading plugin" id=io.containerd.monitor.container.v1.restart type=io.containerd.monitor.container.v1 Nov 4 23:20:31.293887 containerd[1977]: time="2025-11-04T23:20:31.293744241Z" level=info msg="loading plugin" id=io.containerd.tracing.processor.v1.otlp type=io.containerd.tracing.processor.v1 Nov 4 23:20:31.293887 containerd[1977]: time="2025-11-04T23:20:31.293814441Z" level=info msg="skip loading plugin" error="skip plugin: tracing endpoint not configured" id=io.containerd.tracing.processor.v1.otlp type=io.containerd.tracing.processor.v1 Nov 4 23:20:31.293887 containerd[1977]: time="2025-11-04T23:20:31.293838993Z" level=info msg="loading plugin" id=io.containerd.internal.v1.tracing type=io.containerd.internal.v1 Nov 4 23:20:31.293887 containerd[1977]: time="2025-11-04T23:20:31.293864397Z" level=info msg="skip loading plugin" error="skip plugin: tracing endpoint not configured" id=io.containerd.internal.v1.tracing type=io.containerd.internal.v1 Nov 4 23:20:31.293887 containerd[1977]: time="2025-11-04T23:20:31.293889693Z" level=info msg="loading plugin" id=io.containerd.ttrpc.v1.otelttrpc type=io.containerd.ttrpc.v1 Nov 4 23:20:31.294254 containerd[1977]: time="2025-11-04T23:20:31.293926557Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.healthcheck type=io.containerd.grpc.v1 Nov 4 23:20:31.294254 containerd[1977]: time="2025-11-04T23:20:31.293955141Z" level=info msg="loading plugin" id=io.containerd.nri.v1.nri type=io.containerd.nri.v1 Nov 4 23:20:31.294254 containerd[1977]: time="2025-11-04T23:20:31.294124641Z" level=info msg="runtime interface created" Nov 4 23:20:31.296175 containerd[1977]: time="2025-11-04T23:20:31.294142581Z" level=info msg="created NRI interface" Nov 4 23:20:31.296175 containerd[1977]: time="2025-11-04T23:20:31.294873417Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.cri type=io.containerd.grpc.v1 Nov 4 23:20:31.296175 containerd[1977]: time="2025-11-04T23:20:31.294964737Z" level=info msg="Connect containerd service" Nov 4 23:20:31.296175 containerd[1977]: time="2025-11-04T23:20:31.295845729Z" level=info msg="using experimental NRI integration - disable nri plugin to prevent this" Nov 4 23:20:31.300940 amazon-ssm-agent[2021]: 2025-11-04 23:20:31.0978 INFO Agent will take identity from EC2 Nov 4 23:20:31.301060 containerd[1977]: time="2025-11-04T23:20:31.300779577Z" level=error msg="failed to load cni during init, please check CRI plugin status before setting up network for pods" error="cni config load failed: no network config found in /etc/cni/net.d: cni plugin not initialized: failed to load cni config" Nov 4 23:20:31.312458 polkitd[2064]: Started polkitd version 126 Nov 4 23:20:31.350583 polkitd[2064]: Loading rules from directory /etc/polkit-1/rules.d Nov 4 23:20:31.351220 polkitd[2064]: Loading rules from directory /run/polkit-1/rules.d Nov 4 23:20:31.351299 polkitd[2064]: Error opening rules directory: Error opening directory “/run/polkit-1/rules.d”: No such file or directory (g-file-error-quark, 4) Nov 4 23:20:31.351925 polkitd[2064]: Loading rules from directory /usr/local/share/polkit-1/rules.d Nov 4 23:20:31.351972 polkitd[2064]: Error opening rules directory: Error opening directory “/usr/local/share/polkit-1/rules.d”: No such file or directory (g-file-error-quark, 4) Nov 4 23:20:31.352054 polkitd[2064]: Loading rules from directory /usr/share/polkit-1/rules.d Nov 4 23:20:31.358576 polkitd[2064]: Finished loading, compiling and executing 2 rules Nov 4 23:20:31.367123 systemd[1]: Started polkit.service - Authorization Manager. Nov 4 23:20:31.375137 dbus-daemon[1936]: [system] Successfully activated service 'org.freedesktop.PolicyKit1' Nov 4 23:20:31.376663 polkitd[2064]: Acquired the name org.freedesktop.PolicyKit1 on the system bus Nov 4 23:20:31.403541 amazon-ssm-agent[2021]: 2025-11-04 23:20:31.1400 INFO [amazon-ssm-agent] amazon-ssm-agent - v3.3.0.0 Nov 4 23:20:31.427546 systemd-hostnamed[2011]: Hostname set to (transient) Nov 4 23:20:31.427705 systemd-resolved[1551]: System hostname changed to 'ip-172-31-21-124'. Nov 4 23:20:31.503596 amazon-ssm-agent[2021]: 2025-11-04 23:20:31.1400 INFO [amazon-ssm-agent] OS: linux, Arch: arm64 Nov 4 23:20:31.603185 amazon-ssm-agent[2021]: 2025-11-04 23:20:31.1400 INFO [amazon-ssm-agent] Starting Core Agent Nov 4 23:20:31.705025 amazon-ssm-agent[2021]: 2025-11-04 23:20:31.1400 INFO [amazon-ssm-agent] Registrar detected. Attempting registration Nov 4 23:20:31.734180 tar[1968]: linux-arm64/README.md Nov 4 23:20:31.768402 systemd[1]: Finished prepare-helm.service - Unpack helm to /opt/bin. Nov 4 23:20:31.804173 amazon-ssm-agent[2021]: 2025-11-04 23:20:31.1400 INFO [Registrar] Starting registrar module Nov 4 23:20:31.819713 containerd[1977]: time="2025-11-04T23:20:31.819606527Z" level=info msg="Start subscribing containerd event" Nov 4 23:20:31.819713 containerd[1977]: time="2025-11-04T23:20:31.819711191Z" level=info msg="Start recovering state" Nov 4 23:20:31.819867 containerd[1977]: time="2025-11-04T23:20:31.819842819Z" level=info msg="Start event monitor" Nov 4 23:20:31.819913 containerd[1977]: time="2025-11-04T23:20:31.819865259Z" level=info msg="Start cni network conf syncer for default" Nov 4 23:20:31.819913 containerd[1977]: time="2025-11-04T23:20:31.819886019Z" level=info msg="Start streaming server" Nov 4 23:20:31.819913 containerd[1977]: time="2025-11-04T23:20:31.819905483Z" level=info msg="Registered namespace \"k8s.io\" with NRI" Nov 4 23:20:31.820068 containerd[1977]: time="2025-11-04T23:20:31.819922127Z" level=info msg="runtime interface starting up..." Nov 4 23:20:31.820068 containerd[1977]: time="2025-11-04T23:20:31.819936107Z" level=info msg="starting plugins..." Nov 4 23:20:31.820068 containerd[1977]: time="2025-11-04T23:20:31.819969779Z" level=info msg="Synchronizing NRI (plugin) with current runtime state" Nov 4 23:20:31.821372 containerd[1977]: time="2025-11-04T23:20:31.821320127Z" level=info msg=serving... address=/run/containerd/containerd.sock.ttrpc Nov 4 23:20:31.821597 containerd[1977]: time="2025-11-04T23:20:31.821536691Z" level=info msg=serving... address=/run/containerd/containerd.sock Nov 4 23:20:31.821839 containerd[1977]: time="2025-11-04T23:20:31.821797127Z" level=info msg="containerd successfully booted in 0.669714s" Nov 4 23:20:31.822024 systemd[1]: Started containerd.service - containerd container runtime. Nov 4 23:20:31.903695 amazon-ssm-agent[2021]: 2025-11-04 23:20:31.1443 INFO [EC2Identity] Checking disk for registration info Nov 4 23:20:32.004115 amazon-ssm-agent[2021]: 2025-11-04 23:20:31.1443 INFO [EC2Identity] No registration info found for ec2 instance, attempting registration Nov 4 23:20:32.104440 amazon-ssm-agent[2021]: 2025-11-04 23:20:31.1444 INFO [EC2Identity] Generating registration keypair Nov 4 23:20:32.689566 amazon-ssm-agent[2021]: 2025-11-04 23:20:32.6882 INFO [EC2Identity] Checking write access before registering Nov 4 23:20:32.746298 amazon-ssm-agent[2021]: 2025/11/04 23:20:32 Found config file at /etc/amazon/ssm/amazon-ssm-agent.json. Nov 4 23:20:32.746298 amazon-ssm-agent[2021]: Applying config override from /etc/amazon/ssm/amazon-ssm-agent.json. Nov 4 23:20:32.747054 amazon-ssm-agent[2021]: 2025/11/04 23:20:32 processing appconfig overrides Nov 4 23:20:32.778786 amazon-ssm-agent[2021]: 2025-11-04 23:20:32.6890 INFO [EC2Identity] Registering EC2 instance with Systems Manager Nov 4 23:20:32.778786 amazon-ssm-agent[2021]: 2025-11-04 23:20:32.7459 INFO [EC2Identity] EC2 registration was successful. Nov 4 23:20:32.778786 amazon-ssm-agent[2021]: 2025-11-04 23:20:32.7459 INFO [amazon-ssm-agent] Registration attempted. Resuming core agent startup. Nov 4 23:20:32.778996 amazon-ssm-agent[2021]: 2025-11-04 23:20:32.7460 INFO [CredentialRefresher] credentialRefresher has started Nov 4 23:20:32.778996 amazon-ssm-agent[2021]: 2025-11-04 23:20:32.7460 INFO [CredentialRefresher] Starting credentials refresher loop Nov 4 23:20:32.778996 amazon-ssm-agent[2021]: 2025-11-04 23:20:32.7784 INFO EC2RoleProvider Successfully connected with instance profile role credentials Nov 4 23:20:32.778996 amazon-ssm-agent[2021]: 2025-11-04 23:20:32.7787 INFO [CredentialRefresher] Credentials ready Nov 4 23:20:32.790264 amazon-ssm-agent[2021]: 2025-11-04 23:20:32.7788 INFO [CredentialRefresher] Next credential rotation will be in 29.9999922139 minutes Nov 4 23:20:33.846584 amazon-ssm-agent[2021]: 2025-11-04 23:20:33.8450 INFO [amazon-ssm-agent] [LongRunningWorkerContainer] [WorkerProvider] Worker ssm-agent-worker is not running, starting worker process Nov 4 23:20:33.947139 amazon-ssm-agent[2021]: 2025-11-04 23:20:33.8858 INFO [amazon-ssm-agent] [LongRunningWorkerContainer] [WorkerProvider] Worker ssm-agent-worker (pid:2215) started Nov 4 23:20:34.047743 amazon-ssm-agent[2021]: 2025-11-04 23:20:33.8858 INFO [amazon-ssm-agent] [LongRunningWorkerContainer] Monitor long running worker health every 60 seconds Nov 4 23:20:34.392042 systemd[1]: Started kubelet.service - kubelet: The Kubernetes Node Agent. Nov 4 23:20:34.396488 systemd[1]: Reached target multi-user.target - Multi-User System. Nov 4 23:20:34.404379 systemd[1]: Startup finished in 3.647s (kernel) + 12.400s (initrd) + 15.042s (userspace) = 31.090s. Nov 4 23:20:34.409183 (kubelet)[2232]: kubelet.service: Referenced but unset environment variable evaluates to an empty string: KUBELET_EXTRA_ARGS, KUBELET_KUBEADM_ARGS Nov 4 23:20:35.400906 systemd[1]: Created slice system-sshd.slice - Slice /system/sshd. Nov 4 23:20:35.403104 systemd[1]: Started sshd@0-172.31.21.124:22-139.178.89.65:43854.service - OpenSSH per-connection server daemon (139.178.89.65:43854). Nov 4 23:20:35.882437 sshd[2242]: Accepted publickey for core from 139.178.89.65 port 43854 ssh2: RSA SHA256:hDiwkCWvCQBqijfvK1jv0H0YtRR2s7jf/pLBmZjqWNg Nov 4 23:20:35.886605 sshd-session[2242]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 4 23:20:35.913303 systemd[1]: Created slice user-500.slice - User Slice of UID 500. Nov 4 23:20:35.916368 systemd[1]: Starting user-runtime-dir@500.service - User Runtime Directory /run/user/500... Nov 4 23:20:35.922689 systemd-logind[1949]: New session 1 of user core. Nov 4 23:20:35.962661 systemd[1]: Finished user-runtime-dir@500.service - User Runtime Directory /run/user/500. Nov 4 23:20:35.968123 systemd[1]: Starting user@500.service - User Manager for UID 500... Nov 4 23:20:35.989442 (systemd)[2248]: pam_unix(systemd-user:session): session opened for user core(uid=500) by (uid=0) Nov 4 23:20:35.994596 systemd-logind[1949]: New session c1 of user core. Nov 4 23:20:36.294741 systemd[2248]: Queued start job for default target default.target. Nov 4 23:20:36.303251 systemd[2248]: Created slice app.slice - User Application Slice. Nov 4 23:20:36.303316 systemd[2248]: Reached target paths.target - Paths. Nov 4 23:20:36.303403 systemd[2248]: Reached target timers.target - Timers. Nov 4 23:20:36.308416 systemd[2248]: Starting dbus.socket - D-Bus User Message Bus Socket... Nov 4 23:20:36.346533 systemd[2248]: Listening on dbus.socket - D-Bus User Message Bus Socket. Nov 4 23:20:36.346663 systemd[2248]: Reached target sockets.target - Sockets. Nov 4 23:20:36.346752 systemd[2248]: Reached target basic.target - Basic System. Nov 4 23:20:36.346839 systemd[2248]: Reached target default.target - Main User Target. Nov 4 23:20:36.346901 systemd[2248]: Startup finished in 338ms. Nov 4 23:20:36.347752 systemd[1]: Started user@500.service - User Manager for UID 500. Nov 4 23:20:36.357444 systemd[1]: Started session-1.scope - Session 1 of User core. Nov 4 23:20:36.415640 kubelet[2232]: E1104 23:20:36.415547 2232 run.go:72] "command failed" err="failed to load kubelet config file, path: /var/lib/kubelet/config.yaml, error: failed to load Kubelet config file /var/lib/kubelet/config.yaml, error failed to read kubelet config file \"/var/lib/kubelet/config.yaml\", error: open /var/lib/kubelet/config.yaml: no such file or directory" Nov 4 23:20:36.420253 systemd[1]: kubelet.service: Main process exited, code=exited, status=1/FAILURE Nov 4 23:20:36.420964 systemd[1]: kubelet.service: Failed with result 'exit-code'. Nov 4 23:20:36.421927 systemd[1]: kubelet.service: Consumed 1.424s CPU time, 257.6M memory peak. Nov 4 23:20:36.507468 systemd[1]: Started sshd@1-172.31.21.124:22-139.178.89.65:39128.service - OpenSSH per-connection server daemon (139.178.89.65:39128). Nov 4 23:20:36.938074 systemd-resolved[1551]: Clock change detected. Flushing caches. Nov 4 23:20:36.970421 sshd[2260]: Accepted publickey for core from 139.178.89.65 port 39128 ssh2: RSA SHA256:hDiwkCWvCQBqijfvK1jv0H0YtRR2s7jf/pLBmZjqWNg Nov 4 23:20:36.972641 sshd-session[2260]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 4 23:20:36.982304 systemd-logind[1949]: New session 2 of user core. Nov 4 23:20:36.991513 systemd[1]: Started session-2.scope - Session 2 of User core. Nov 4 23:20:37.116803 sshd[2263]: Connection closed by 139.178.89.65 port 39128 Nov 4 23:20:37.117624 sshd-session[2260]: pam_unix(sshd:session): session closed for user core Nov 4 23:20:37.124678 systemd-logind[1949]: Session 2 logged out. Waiting for processes to exit. Nov 4 23:20:37.126147 systemd[1]: sshd@1-172.31.21.124:22-139.178.89.65:39128.service: Deactivated successfully. Nov 4 23:20:37.130658 systemd[1]: session-2.scope: Deactivated successfully. Nov 4 23:20:37.134326 systemd-logind[1949]: Removed session 2. Nov 4 23:20:37.151632 systemd[1]: Started sshd@2-172.31.21.124:22-139.178.89.65:39144.service - OpenSSH per-connection server daemon (139.178.89.65:39144). Nov 4 23:20:37.347592 sshd[2269]: Accepted publickey for core from 139.178.89.65 port 39144 ssh2: RSA SHA256:hDiwkCWvCQBqijfvK1jv0H0YtRR2s7jf/pLBmZjqWNg Nov 4 23:20:37.349494 sshd-session[2269]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 4 23:20:37.358297 systemd-logind[1949]: New session 3 of user core. Nov 4 23:20:37.365532 systemd[1]: Started session-3.scope - Session 3 of User core. Nov 4 23:20:37.484956 sshd[2272]: Connection closed by 139.178.89.65 port 39144 Nov 4 23:20:37.485566 sshd-session[2269]: pam_unix(sshd:session): session closed for user core Nov 4 23:20:37.492960 systemd[1]: sshd@2-172.31.21.124:22-139.178.89.65:39144.service: Deactivated successfully. Nov 4 23:20:37.496099 systemd[1]: session-3.scope: Deactivated successfully. Nov 4 23:20:37.498797 systemd-logind[1949]: Session 3 logged out. Waiting for processes to exit. Nov 4 23:20:37.501740 systemd-logind[1949]: Removed session 3. Nov 4 23:20:37.525774 systemd[1]: Started sshd@3-172.31.21.124:22-139.178.89.65:39152.service - OpenSSH per-connection server daemon (139.178.89.65:39152). Nov 4 23:20:37.724499 sshd[2278]: Accepted publickey for core from 139.178.89.65 port 39152 ssh2: RSA SHA256:hDiwkCWvCQBqijfvK1jv0H0YtRR2s7jf/pLBmZjqWNg Nov 4 23:20:37.726972 sshd-session[2278]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 4 23:20:37.737239 systemd-logind[1949]: New session 4 of user core. Nov 4 23:20:37.744506 systemd[1]: Started session-4.scope - Session 4 of User core. Nov 4 23:20:37.872666 sshd[2281]: Connection closed by 139.178.89.65 port 39152 Nov 4 23:20:37.873639 sshd-session[2278]: pam_unix(sshd:session): session closed for user core Nov 4 23:20:37.882577 systemd[1]: sshd@3-172.31.21.124:22-139.178.89.65:39152.service: Deactivated successfully. Nov 4 23:20:37.887081 systemd[1]: session-4.scope: Deactivated successfully. Nov 4 23:20:37.889545 systemd-logind[1949]: Session 4 logged out. Waiting for processes to exit. Nov 4 23:20:37.892756 systemd-logind[1949]: Removed session 4. Nov 4 23:20:37.911554 systemd[1]: Started sshd@4-172.31.21.124:22-139.178.89.65:39166.service - OpenSSH per-connection server daemon (139.178.89.65:39166). Nov 4 23:20:38.126751 sshd[2287]: Accepted publickey for core from 139.178.89.65 port 39166 ssh2: RSA SHA256:hDiwkCWvCQBqijfvK1jv0H0YtRR2s7jf/pLBmZjqWNg Nov 4 23:20:38.129241 sshd-session[2287]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 4 23:20:38.139630 systemd-logind[1949]: New session 5 of user core. Nov 4 23:20:38.147540 systemd[1]: Started session-5.scope - Session 5 of User core. Nov 4 23:20:38.307879 sudo[2291]: core : PWD=/home/core ; USER=root ; COMMAND=/usr/sbin/setenforce 1 Nov 4 23:20:38.308548 sudo[2291]: pam_unix(sudo:session): session opened for user root(uid=0) by core(uid=500) Nov 4 23:20:38.323538 sudo[2291]: pam_unix(sudo:session): session closed for user root Nov 4 23:20:38.349239 sshd[2290]: Connection closed by 139.178.89.65 port 39166 Nov 4 23:20:38.349404 sshd-session[2287]: pam_unix(sshd:session): session closed for user core Nov 4 23:20:38.357183 systemd[1]: sshd@4-172.31.21.124:22-139.178.89.65:39166.service: Deactivated successfully. Nov 4 23:20:38.360529 systemd[1]: session-5.scope: Deactivated successfully. Nov 4 23:20:38.362409 systemd-logind[1949]: Session 5 logged out. Waiting for processes to exit. Nov 4 23:20:38.366366 systemd-logind[1949]: Removed session 5. Nov 4 23:20:38.387293 systemd[1]: Started sshd@5-172.31.21.124:22-139.178.89.65:39170.service - OpenSSH per-connection server daemon (139.178.89.65:39170). Nov 4 23:20:38.596026 sshd[2297]: Accepted publickey for core from 139.178.89.65 port 39170 ssh2: RSA SHA256:hDiwkCWvCQBqijfvK1jv0H0YtRR2s7jf/pLBmZjqWNg Nov 4 23:20:38.598343 sshd-session[2297]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 4 23:20:38.608307 systemd-logind[1949]: New session 6 of user core. Nov 4 23:20:38.617473 systemd[1]: Started session-6.scope - Session 6 of User core. Nov 4 23:20:38.724033 sudo[2302]: core : PWD=/home/core ; USER=root ; COMMAND=/usr/sbin/rm -rf /etc/audit/rules.d/80-selinux.rules /etc/audit/rules.d/99-default.rules Nov 4 23:20:38.725430 sudo[2302]: pam_unix(sudo:session): session opened for user root(uid=0) by core(uid=500) Nov 4 23:20:38.733806 sudo[2302]: pam_unix(sudo:session): session closed for user root Nov 4 23:20:38.746159 sudo[2301]: core : PWD=/home/core ; USER=root ; COMMAND=/usr/sbin/systemctl restart audit-rules Nov 4 23:20:38.747069 sudo[2301]: pam_unix(sudo:session): session opened for user root(uid=0) by core(uid=500) Nov 4 23:20:38.767896 systemd[1]: Starting audit-rules.service - Load Audit Rules... Nov 4 23:20:38.830269 augenrules[2324]: No rules Nov 4 23:20:38.832662 systemd[1]: audit-rules.service: Deactivated successfully. Nov 4 23:20:38.834301 systemd[1]: Finished audit-rules.service - Load Audit Rules. Nov 4 23:20:38.836590 sudo[2301]: pam_unix(sudo:session): session closed for user root Nov 4 23:20:38.860728 sshd[2300]: Connection closed by 139.178.89.65 port 39170 Nov 4 23:20:38.861575 sshd-session[2297]: pam_unix(sshd:session): session closed for user core Nov 4 23:20:38.869806 systemd-logind[1949]: Session 6 logged out. Waiting for processes to exit. Nov 4 23:20:38.870981 systemd[1]: sshd@5-172.31.21.124:22-139.178.89.65:39170.service: Deactivated successfully. Nov 4 23:20:38.874651 systemd[1]: session-6.scope: Deactivated successfully. Nov 4 23:20:38.881129 systemd-logind[1949]: Removed session 6. Nov 4 23:20:38.899979 systemd[1]: Started sshd@6-172.31.21.124:22-139.178.89.65:39180.service - OpenSSH per-connection server daemon (139.178.89.65:39180). Nov 4 23:20:39.105880 sshd[2333]: Accepted publickey for core from 139.178.89.65 port 39180 ssh2: RSA SHA256:hDiwkCWvCQBqijfvK1jv0H0YtRR2s7jf/pLBmZjqWNg Nov 4 23:20:39.108336 sshd-session[2333]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 4 23:20:39.117282 systemd-logind[1949]: New session 7 of user core. Nov 4 23:20:39.124466 systemd[1]: Started session-7.scope - Session 7 of User core. Nov 4 23:20:39.231480 sudo[2337]: core : PWD=/home/core ; USER=root ; COMMAND=/home/core/install.sh Nov 4 23:20:39.232050 sudo[2337]: pam_unix(sudo:session): session opened for user root(uid=0) by core(uid=500) Nov 4 23:20:40.547591 systemd[1]: Starting docker.service - Docker Application Container Engine... Nov 4 23:20:40.566741 (dockerd)[2354]: docker.service: Referenced but unset environment variable evaluates to an empty string: DOCKER_CGROUPS, DOCKER_OPTS, DOCKER_OPT_BIP, DOCKER_OPT_IPMASQ, DOCKER_OPT_MTU Nov 4 23:20:41.697578 dockerd[2354]: time="2025-11-04T23:20:41.697483275Z" level=info msg="Starting up" Nov 4 23:20:41.699361 dockerd[2354]: time="2025-11-04T23:20:41.699296775Z" level=info msg="OTEL tracing is not configured, using no-op tracer provider" Nov 4 23:20:41.721421 dockerd[2354]: time="2025-11-04T23:20:41.721353003Z" level=info msg="Creating a containerd client" address=/var/run/docker/libcontainerd/docker-containerd.sock timeout=1m0s Nov 4 23:20:41.796733 dockerd[2354]: time="2025-11-04T23:20:41.796660924Z" level=info msg="Loading containers: start." Nov 4 23:20:41.871431 kernel: Initializing XFRM netlink socket Nov 4 23:20:42.428882 (udev-worker)[2375]: Network interface NamePolicy= disabled on kernel command line. Nov 4 23:20:42.504564 systemd-networkd[1573]: docker0: Link UP Nov 4 23:20:42.516640 dockerd[2354]: time="2025-11-04T23:20:42.516573207Z" level=info msg="Loading containers: done." Nov 4 23:20:42.542659 systemd[1]: var-lib-docker-overlay2-opaque\x2dbug\x2dcheck2144309044-merged.mount: Deactivated successfully. Nov 4 23:20:42.551760 dockerd[2354]: time="2025-11-04T23:20:42.551624535Z" level=warning msg="Not using native diff for overlay2, this may cause degraded performance for building images: kernel has CONFIG_OVERLAY_FS_REDIRECT_DIR enabled" storage-driver=overlay2 Nov 4 23:20:42.551984 dockerd[2354]: time="2025-11-04T23:20:42.551816775Z" level=info msg="Docker daemon" commit=6430e49a55babd9b8f4d08e70ecb2b68900770fe containerd-snapshotter=false storage-driver=overlay2 version=28.0.4 Nov 4 23:20:42.552058 dockerd[2354]: time="2025-11-04T23:20:42.551981079Z" level=info msg="Initializing buildkit" Nov 4 23:20:42.605944 dockerd[2354]: time="2025-11-04T23:20:42.605527852Z" level=info msg="Completed buildkit initialization" Nov 4 23:20:42.624635 dockerd[2354]: time="2025-11-04T23:20:42.624549196Z" level=info msg="Daemon has completed initialization" Nov 4 23:20:42.624946 dockerd[2354]: time="2025-11-04T23:20:42.624655960Z" level=info msg="API listen on /run/docker.sock" Nov 4 23:20:42.625545 systemd[1]: Started docker.service - Docker Application Container Engine. Nov 4 23:20:44.437332 containerd[1977]: time="2025-11-04T23:20:44.437257313Z" level=info msg="PullImage \"registry.k8s.io/kube-apiserver:v1.32.9\"" Nov 4 23:20:45.151723 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount802525991.mount: Deactivated successfully. Nov 4 23:20:46.551245 containerd[1977]: time="2025-11-04T23:20:46.550373719Z" level=info msg="ImageCreate event name:\"registry.k8s.io/kube-apiserver:v1.32.9\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:20:46.553391 containerd[1977]: time="2025-11-04T23:20:46.553345963Z" level=info msg="stop pulling image registry.k8s.io/kube-apiserver:v1.32.9: active requests=0, bytes read=26363685" Nov 4 23:20:46.555934 containerd[1977]: time="2025-11-04T23:20:46.555888691Z" level=info msg="ImageCreate event name:\"sha256:02ea53851f07db91ed471dab1ab11541f5c294802371cd8f0cfd423cd5c71002\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:20:46.561335 containerd[1977]: time="2025-11-04T23:20:46.561284395Z" level=info msg="ImageCreate event name:\"registry.k8s.io/kube-apiserver@sha256:6df11cc2ad9679b1117be34d3a0230add88bc0a08fd7a3ebc26b680575e8de97\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:20:46.563527 containerd[1977]: time="2025-11-04T23:20:46.563130619Z" level=info msg="Pulled image \"registry.k8s.io/kube-apiserver:v1.32.9\" with image id \"sha256:02ea53851f07db91ed471dab1ab11541f5c294802371cd8f0cfd423cd5c71002\", repo tag \"registry.k8s.io/kube-apiserver:v1.32.9\", repo digest \"registry.k8s.io/kube-apiserver@sha256:6df11cc2ad9679b1117be34d3a0230add88bc0a08fd7a3ebc26b680575e8de97\", size \"26360284\" in 2.125793878s" Nov 4 23:20:46.563527 containerd[1977]: time="2025-11-04T23:20:46.563215375Z" level=info msg="PullImage \"registry.k8s.io/kube-apiserver:v1.32.9\" returns image reference \"sha256:02ea53851f07db91ed471dab1ab11541f5c294802371cd8f0cfd423cd5c71002\"" Nov 4 23:20:46.565500 containerd[1977]: time="2025-11-04T23:20:46.565180099Z" level=info msg="PullImage \"registry.k8s.io/kube-controller-manager:v1.32.9\"" Nov 4 23:20:46.923193 systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 1. Nov 4 23:20:46.926995 systemd[1]: Starting kubelet.service - kubelet: The Kubernetes Node Agent... Nov 4 23:20:47.364000 systemd[1]: Started kubelet.service - kubelet: The Kubernetes Node Agent. Nov 4 23:20:47.381829 (kubelet)[2634]: kubelet.service: Referenced but unset environment variable evaluates to an empty string: KUBELET_EXTRA_ARGS, KUBELET_KUBEADM_ARGS Nov 4 23:20:47.472622 kubelet[2634]: E1104 23:20:47.472554 2634 run.go:72] "command failed" err="failed to load kubelet config file, path: /var/lib/kubelet/config.yaml, error: failed to load Kubelet config file /var/lib/kubelet/config.yaml, error failed to read kubelet config file \"/var/lib/kubelet/config.yaml\", error: open /var/lib/kubelet/config.yaml: no such file or directory" Nov 4 23:20:47.482921 systemd[1]: kubelet.service: Main process exited, code=exited, status=1/FAILURE Nov 4 23:20:47.484880 systemd[1]: kubelet.service: Failed with result 'exit-code'. Nov 4 23:20:47.485963 systemd[1]: kubelet.service: Consumed 346ms CPU time, 107.6M memory peak. Nov 4 23:20:48.118760 containerd[1977]: time="2025-11-04T23:20:48.118688983Z" level=info msg="ImageCreate event name:\"registry.k8s.io/kube-controller-manager:v1.32.9\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:20:48.120663 containerd[1977]: time="2025-11-04T23:20:48.120593671Z" level=info msg="stop pulling image registry.k8s.io/kube-controller-manager:v1.32.9: active requests=0, bytes read=22531200" Nov 4 23:20:48.122534 containerd[1977]: time="2025-11-04T23:20:48.121510927Z" level=info msg="ImageCreate event name:\"sha256:f0bcbad5082c944520b370596a2384affda710b9d7daf84e8a48352699af8e4b\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:20:48.126833 containerd[1977]: time="2025-11-04T23:20:48.126772579Z" level=info msg="ImageCreate event name:\"registry.k8s.io/kube-controller-manager@sha256:243c4b8e3bce271fcb1b78008ab996ab6976b1a20096deac08338fcd17979922\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:20:48.129121 containerd[1977]: time="2025-11-04T23:20:48.129056623Z" level=info msg="Pulled image \"registry.k8s.io/kube-controller-manager:v1.32.9\" with image id \"sha256:f0bcbad5082c944520b370596a2384affda710b9d7daf84e8a48352699af8e4b\", repo tag \"registry.k8s.io/kube-controller-manager:v1.32.9\", repo digest \"registry.k8s.io/kube-controller-manager@sha256:243c4b8e3bce271fcb1b78008ab996ab6976b1a20096deac08338fcd17979922\", size \"24099975\" in 1.563800768s" Nov 4 23:20:48.129373 containerd[1977]: time="2025-11-04T23:20:48.129335407Z" level=info msg="PullImage \"registry.k8s.io/kube-controller-manager:v1.32.9\" returns image reference \"sha256:f0bcbad5082c944520b370596a2384affda710b9d7daf84e8a48352699af8e4b\"" Nov 4 23:20:48.130328 containerd[1977]: time="2025-11-04T23:20:48.130105603Z" level=info msg="PullImage \"registry.k8s.io/kube-scheduler:v1.32.9\"" Nov 4 23:20:49.311235 containerd[1977]: time="2025-11-04T23:20:49.310979193Z" level=info msg="ImageCreate event name:\"registry.k8s.io/kube-scheduler:v1.32.9\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:20:49.313230 containerd[1977]: time="2025-11-04T23:20:49.313076313Z" level=info msg="stop pulling image registry.k8s.io/kube-scheduler:v1.32.9: active requests=0, bytes read=17484324" Nov 4 23:20:49.315124 containerd[1977]: time="2025-11-04T23:20:49.314984865Z" level=info msg="ImageCreate event name:\"sha256:1d625baf81b59592006d97a6741bc947698ed222b612ac10efa57b7aa96d2a27\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:20:49.320959 containerd[1977]: time="2025-11-04T23:20:49.320855601Z" level=info msg="ImageCreate event name:\"registry.k8s.io/kube-scheduler@sha256:50c49520dbd0e8b4076b6a5c77d8014df09ea3d59a73e8bafd2678d51ebb92d5\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:20:49.323511 containerd[1977]: time="2025-11-04T23:20:49.323288673Z" level=info msg="Pulled image \"registry.k8s.io/kube-scheduler:v1.32.9\" with image id \"sha256:1d625baf81b59592006d97a6741bc947698ed222b612ac10efa57b7aa96d2a27\", repo tag \"registry.k8s.io/kube-scheduler:v1.32.9\", repo digest \"registry.k8s.io/kube-scheduler@sha256:50c49520dbd0e8b4076b6a5c77d8014df09ea3d59a73e8bafd2678d51ebb92d5\", size \"19053117\" in 1.19276127s" Nov 4 23:20:49.323511 containerd[1977]: time="2025-11-04T23:20:49.323356953Z" level=info msg="PullImage \"registry.k8s.io/kube-scheduler:v1.32.9\" returns image reference \"sha256:1d625baf81b59592006d97a6741bc947698ed222b612ac10efa57b7aa96d2a27\"" Nov 4 23:20:49.324683 containerd[1977]: time="2025-11-04T23:20:49.324369369Z" level=info msg="PullImage \"registry.k8s.io/kube-proxy:v1.32.9\"" Nov 4 23:20:50.684224 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount2588826472.mount: Deactivated successfully. Nov 4 23:20:51.268324 containerd[1977]: time="2025-11-04T23:20:51.268254395Z" level=info msg="ImageCreate event name:\"registry.k8s.io/kube-proxy:v1.32.9\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:20:51.269944 containerd[1977]: time="2025-11-04T23:20:51.269545031Z" level=info msg="stop pulling image registry.k8s.io/kube-proxy:v1.32.9: active requests=0, bytes read=27417817" Nov 4 23:20:51.271728 containerd[1977]: time="2025-11-04T23:20:51.271670207Z" level=info msg="ImageCreate event name:\"sha256:72b57ec14d31e8422925ef4c3eff44822cdc04a11fd30d13824f1897d83a16d4\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:20:51.275078 containerd[1977]: time="2025-11-04T23:20:51.275014955Z" level=info msg="ImageCreate event name:\"registry.k8s.io/kube-proxy@sha256:886af02535dc34886e4618b902f8c140d89af57233a245621d29642224516064\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:20:51.278900 containerd[1977]: time="2025-11-04T23:20:51.278822339Z" level=info msg="Pulled image \"registry.k8s.io/kube-proxy:v1.32.9\" with image id \"sha256:72b57ec14d31e8422925ef4c3eff44822cdc04a11fd30d13824f1897d83a16d4\", repo tag \"registry.k8s.io/kube-proxy:v1.32.9\", repo digest \"registry.k8s.io/kube-proxy@sha256:886af02535dc34886e4618b902f8c140d89af57233a245621d29642224516064\", size \"27416836\" in 1.954386502s" Nov 4 23:20:51.279049 containerd[1977]: time="2025-11-04T23:20:51.278903819Z" level=info msg="PullImage \"registry.k8s.io/kube-proxy:v1.32.9\" returns image reference \"sha256:72b57ec14d31e8422925ef4c3eff44822cdc04a11fd30d13824f1897d83a16d4\"" Nov 4 23:20:51.281457 containerd[1977]: time="2025-11-04T23:20:51.280630655Z" level=info msg="PullImage \"registry.k8s.io/coredns/coredns:v1.11.3\"" Nov 4 23:20:51.800499 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount1154525361.mount: Deactivated successfully. Nov 4 23:20:53.080916 containerd[1977]: time="2025-11-04T23:20:53.080845044Z" level=info msg="ImageCreate event name:\"registry.k8s.io/coredns/coredns:v1.11.3\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:20:53.087049 containerd[1977]: time="2025-11-04T23:20:53.086984220Z" level=info msg="stop pulling image registry.k8s.io/coredns/coredns:v1.11.3: active requests=0, bytes read=16951622" Nov 4 23:20:53.096567 containerd[1977]: time="2025-11-04T23:20:53.096476328Z" level=info msg="ImageCreate event name:\"sha256:2f6c962e7b8311337352d9fdea917da2184d9919f4da7695bc2a6517cf392fe4\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:20:53.110259 containerd[1977]: time="2025-11-04T23:20:53.109589148Z" level=info msg="ImageCreate event name:\"registry.k8s.io/coredns/coredns@sha256:9caabbf6238b189a65d0d6e6ac138de60d6a1c419e5a341fbbb7c78382559c6e\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:20:53.112358 containerd[1977]: time="2025-11-04T23:20:53.112256244Z" level=info msg="Pulled image \"registry.k8s.io/coredns/coredns:v1.11.3\" with image id \"sha256:2f6c962e7b8311337352d9fdea917da2184d9919f4da7695bc2a6517cf392fe4\", repo tag \"registry.k8s.io/coredns/coredns:v1.11.3\", repo digest \"registry.k8s.io/coredns/coredns@sha256:9caabbf6238b189a65d0d6e6ac138de60d6a1c419e5a341fbbb7c78382559c6e\", size \"16948420\" in 1.831553949s" Nov 4 23:20:53.112797 containerd[1977]: time="2025-11-04T23:20:53.112587804Z" level=info msg="PullImage \"registry.k8s.io/coredns/coredns:v1.11.3\" returns image reference \"sha256:2f6c962e7b8311337352d9fdea917da2184d9919f4da7695bc2a6517cf392fe4\"" Nov 4 23:20:53.114563 containerd[1977]: time="2025-11-04T23:20:53.114487464Z" level=info msg="PullImage \"registry.k8s.io/pause:3.10\"" Nov 4 23:20:53.577845 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount3500517959.mount: Deactivated successfully. Nov 4 23:20:53.586249 containerd[1977]: time="2025-11-04T23:20:53.584837414Z" level=info msg="ImageCreate event name:\"registry.k8s.io/pause:3.10\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"} labels:{key:\"io.cri-containerd.pinned\" value:\"pinned\"}" Nov 4 23:20:53.586529 containerd[1977]: time="2025-11-04T23:20:53.586483610Z" level=info msg="stop pulling image registry.k8s.io/pause:3.10: active requests=0, bytes read=268703" Nov 4 23:20:53.586951 containerd[1977]: time="2025-11-04T23:20:53.586899674Z" level=info msg="ImageCreate event name:\"sha256:afb61768ce381961ca0beff95337601f29dc70ff3ed14e5e4b3e5699057e6aa8\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"} labels:{key:\"io.cri-containerd.pinned\" value:\"pinned\"}" Nov 4 23:20:53.590856 containerd[1977]: time="2025-11-04T23:20:53.590769986Z" level=info msg="ImageCreate event name:\"registry.k8s.io/pause@sha256:ee6521f290b2168b6e0935a181d4cff9be1ac3f505666ef0e3c98fae8199917a\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"} labels:{key:\"io.cri-containerd.pinned\" value:\"pinned\"}" Nov 4 23:20:53.592630 containerd[1977]: time="2025-11-04T23:20:53.592566758Z" level=info msg="Pulled image \"registry.k8s.io/pause:3.10\" with image id \"sha256:afb61768ce381961ca0beff95337601f29dc70ff3ed14e5e4b3e5699057e6aa8\", repo tag \"registry.k8s.io/pause:3.10\", repo digest \"registry.k8s.io/pause@sha256:ee6521f290b2168b6e0935a181d4cff9be1ac3f505666ef0e3c98fae8199917a\", size \"267933\" in 478.002494ms" Nov 4 23:20:53.592854 containerd[1977]: time="2025-11-04T23:20:53.592813718Z" level=info msg="PullImage \"registry.k8s.io/pause:3.10\" returns image reference \"sha256:afb61768ce381961ca0beff95337601f29dc70ff3ed14e5e4b3e5699057e6aa8\"" Nov 4 23:20:53.594471 containerd[1977]: time="2025-11-04T23:20:53.594351086Z" level=info msg="PullImage \"registry.k8s.io/etcd:3.5.16-0\"" Nov 4 23:20:54.106391 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount337337685.mount: Deactivated successfully. Nov 4 23:20:56.372809 containerd[1977]: time="2025-11-04T23:20:56.372751204Z" level=info msg="ImageCreate event name:\"registry.k8s.io/etcd:3.5.16-0\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:20:56.375226 containerd[1977]: time="2025-11-04T23:20:56.374937592Z" level=info msg="stop pulling image registry.k8s.io/etcd:3.5.16-0: active requests=0, bytes read=67943165" Nov 4 23:20:56.375226 containerd[1977]: time="2025-11-04T23:20:56.375154756Z" level=info msg="ImageCreate event name:\"sha256:7fc9d4aa817aa6a3e549f3cd49d1f7b496407be979fc36dd5f356d59ce8c3a82\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:20:56.380416 containerd[1977]: time="2025-11-04T23:20:56.380366944Z" level=info msg="ImageCreate event name:\"registry.k8s.io/etcd@sha256:c6a9d11cc5c04b114ccdef39a9265eeef818e3d02f5359be035ae784097fdec5\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:20:56.382864 containerd[1977]: time="2025-11-04T23:20:56.382561300Z" level=info msg="Pulled image \"registry.k8s.io/etcd:3.5.16-0\" with image id \"sha256:7fc9d4aa817aa6a3e549f3cd49d1f7b496407be979fc36dd5f356d59ce8c3a82\", repo tag \"registry.k8s.io/etcd:3.5.16-0\", repo digest \"registry.k8s.io/etcd@sha256:c6a9d11cc5c04b114ccdef39a9265eeef818e3d02f5359be035ae784097fdec5\", size \"67941650\" in 2.787889082s" Nov 4 23:20:56.382864 containerd[1977]: time="2025-11-04T23:20:56.382609996Z" level=info msg="PullImage \"registry.k8s.io/etcd:3.5.16-0\" returns image reference \"sha256:7fc9d4aa817aa6a3e549f3cd49d1f7b496407be979fc36dd5f356d59ce8c3a82\"" Nov 4 23:20:57.676298 systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 2. Nov 4 23:20:57.681532 systemd[1]: Starting kubelet.service - kubelet: The Kubernetes Node Agent... Nov 4 23:20:58.013527 systemd[1]: Started kubelet.service - kubelet: The Kubernetes Node Agent. Nov 4 23:20:58.028083 (kubelet)[2792]: kubelet.service: Referenced but unset environment variable evaluates to an empty string: KUBELET_EXTRA_ARGS, KUBELET_KUBEADM_ARGS Nov 4 23:20:58.106123 kubelet[2792]: E1104 23:20:58.106035 2792 run.go:72] "command failed" err="failed to load kubelet config file, path: /var/lib/kubelet/config.yaml, error: failed to load Kubelet config file /var/lib/kubelet/config.yaml, error failed to read kubelet config file \"/var/lib/kubelet/config.yaml\", error: open /var/lib/kubelet/config.yaml: no such file or directory" Nov 4 23:20:58.111305 systemd[1]: kubelet.service: Main process exited, code=exited, status=1/FAILURE Nov 4 23:20:58.111759 systemd[1]: kubelet.service: Failed with result 'exit-code'. Nov 4 23:20:58.112805 systemd[1]: kubelet.service: Consumed 297ms CPU time, 107.5M memory peak. Nov 4 23:21:01.717184 systemd[1]: systemd-hostnamed.service: Deactivated successfully. Nov 4 23:21:03.672665 systemd[1]: Stopped kubelet.service - kubelet: The Kubernetes Node Agent. Nov 4 23:21:03.673808 systemd[1]: kubelet.service: Consumed 297ms CPU time, 107.5M memory peak. Nov 4 23:21:03.685656 systemd[1]: Starting kubelet.service - kubelet: The Kubernetes Node Agent... Nov 4 23:21:03.737492 systemd[1]: Reload requested from client PID 2810 ('systemctl') (unit session-7.scope)... Nov 4 23:21:03.737523 systemd[1]: Reloading... Nov 4 23:21:04.037266 zram_generator::config[2858]: No configuration found. Nov 4 23:21:04.521265 systemd[1]: Reloading finished in 783 ms. Nov 4 23:21:04.624125 systemd[1]: kubelet.service: Control process exited, code=killed, status=15/TERM Nov 4 23:21:04.624561 systemd[1]: kubelet.service: Failed with result 'signal'. Nov 4 23:21:04.627319 systemd[1]: Stopped kubelet.service - kubelet: The Kubernetes Node Agent. Nov 4 23:21:04.627437 systemd[1]: kubelet.service: Consumed 244ms CPU time, 95.1M memory peak. Nov 4 23:21:04.632680 systemd[1]: Starting kubelet.service - kubelet: The Kubernetes Node Agent... Nov 4 23:21:04.978814 systemd[1]: Started kubelet.service - kubelet: The Kubernetes Node Agent. Nov 4 23:21:04.994987 (kubelet)[2919]: kubelet.service: Referenced but unset environment variable evaluates to an empty string: KUBELET_EXTRA_ARGS Nov 4 23:21:05.066629 kubelet[2919]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 4 23:21:05.066629 kubelet[2919]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Nov 4 23:21:05.066629 kubelet[2919]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 4 23:21:05.067173 kubelet[2919]: I1104 23:21:05.066754 2919 server.go:215] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Nov 4 23:21:05.764547 kubelet[2919]: I1104 23:21:05.764468 2919 server.go:520] "Kubelet version" kubeletVersion="v1.32.4" Nov 4 23:21:05.764547 kubelet[2919]: I1104 23:21:05.764527 2919 server.go:522] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Nov 4 23:21:05.767241 kubelet[2919]: I1104 23:21:05.765415 2919 server.go:954] "Client rotation is on, will bootstrap in background" Nov 4 23:21:05.820032 kubelet[2919]: E1104 23:21:05.819982 2919 certificate_manager.go:562] "Unhandled Error" err="kubernetes.io/kube-apiserver-client-kubelet: Failed while requesting a signed certificate from the control plane: cannot create certificate signing request: Post \"https://172.31.21.124:6443/apis/certificates.k8s.io/v1/certificatesigningrequests\": dial tcp 172.31.21.124:6443: connect: connection refused" logger="UnhandledError" Nov 4 23:21:05.823048 kubelet[2919]: I1104 23:21:05.823010 2919 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" Nov 4 23:21:05.834596 kubelet[2919]: I1104 23:21:05.834563 2919 server.go:1444] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Nov 4 23:21:05.840462 kubelet[2919]: I1104 23:21:05.840426 2919 server.go:772] "--cgroups-per-qos enabled, but --cgroup-root was not specified. defaulting to /" Nov 4 23:21:05.841107 kubelet[2919]: I1104 23:21:05.841061 2919 container_manager_linux.go:268] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Nov 4 23:21:05.841521 kubelet[2919]: I1104 23:21:05.841242 2919 container_manager_linux.go:273] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-172-31-21-124","RuntimeCgroupsName":"","SystemCgroupsName":"","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":false,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":null,"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"ExperimentalMemoryManagerPolicy":"None","ExperimentalMemoryManagerReservedMemory":null,"PodPidsLimit":-1,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Nov 4 23:21:05.841890 kubelet[2919]: I1104 23:21:05.841870 2919 topology_manager.go:138] "Creating topology manager with none policy" Nov 4 23:21:05.841990 kubelet[2919]: I1104 23:21:05.841973 2919 container_manager_linux.go:304] "Creating device plugin manager" Nov 4 23:21:05.842438 kubelet[2919]: I1104 23:21:05.842418 2919 state_mem.go:36] "Initialized new in-memory state store" Nov 4 23:21:05.848659 kubelet[2919]: I1104 23:21:05.848609 2919 kubelet.go:446] "Attempting to sync node with API server" Nov 4 23:21:05.848878 kubelet[2919]: I1104 23:21:05.848854 2919 kubelet.go:341] "Adding static pod path" path="/etc/kubernetes/manifests" Nov 4 23:21:05.849023 kubelet[2919]: I1104 23:21:05.849004 2919 kubelet.go:352] "Adding apiserver pod source" Nov 4 23:21:05.849141 kubelet[2919]: I1104 23:21:05.849122 2919 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Nov 4 23:21:05.856577 kubelet[2919]: W1104 23:21:05.856481 2919 reflector.go:569] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: Get "https://172.31.21.124:6443/api/v1/nodes?fieldSelector=metadata.name%3Dip-172-31-21-124&limit=500&resourceVersion=0": dial tcp 172.31.21.124:6443: connect: connection refused Nov 4 23:21:05.856729 kubelet[2919]: E1104 23:21:05.856595 2919 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: Get \"https://172.31.21.124:6443/api/v1/nodes?fieldSelector=metadata.name%3Dip-172-31-21-124&limit=500&resourceVersion=0\": dial tcp 172.31.21.124:6443: connect: connection refused" logger="UnhandledError" Nov 4 23:21:05.857026 kubelet[2919]: I1104 23:21:05.856986 2919 kuberuntime_manager.go:269] "Container runtime initialized" containerRuntime="containerd" version="v2.0.5" apiVersion="v1" Nov 4 23:21:05.858090 kubelet[2919]: I1104 23:21:05.858037 2919 kubelet.go:890] "Not starting ClusterTrustBundle informer because we are in static kubelet mode" Nov 4 23:21:05.858347 kubelet[2919]: W1104 23:21:05.858310 2919 probe.go:272] Flexvolume plugin directory at /opt/libexec/kubernetes/kubelet-plugins/volume/exec/ does not exist. Recreating. Nov 4 23:21:05.860684 kubelet[2919]: I1104 23:21:05.860631 2919 watchdog_linux.go:99] "Systemd watchdog is not enabled" Nov 4 23:21:05.860823 kubelet[2919]: I1104 23:21:05.860696 2919 server.go:1287] "Started kubelet" Nov 4 23:21:05.874393 kubelet[2919]: I1104 23:21:05.874313 2919 server.go:169] "Starting to listen" address="0.0.0.0" port=10250 Nov 4 23:21:05.875675 kubelet[2919]: I1104 23:21:05.875576 2919 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Nov 4 23:21:05.876360 kubelet[2919]: I1104 23:21:05.876266 2919 server.go:243] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Nov 4 23:21:05.877718 kubelet[2919]: E1104 23:21:05.877228 2919 event.go:368] "Unable to write event (may retry after sleeping)" err="Post \"https://172.31.21.124:6443/api/v1/namespaces/default/events\": dial tcp 172.31.21.124:6443: connect: connection refused" event="&Event{ObjectMeta:{ip-172-31-21-124.1874f11e1dd7412f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-172-31-21-124,UID:ip-172-31-21-124,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-172-31-21-124,},FirstTimestamp:2025-11-04 23:21:05.860665647 +0000 UTC m=+0.859242041,LastTimestamp:2025-11-04 23:21:05.860665647 +0000 UTC m=+0.859242041,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-172-31-21-124,}" Nov 4 23:21:05.879940 kubelet[2919]: I1104 23:21:05.879810 2919 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Nov 4 23:21:05.880726 kubelet[2919]: I1104 23:21:05.880686 2919 server.go:479] "Adding debug handlers to kubelet server" Nov 4 23:21:05.884623 kubelet[2919]: I1104 23:21:05.884316 2919 dynamic_serving_content.go:135] "Starting controller" name="kubelet-server-cert-files::/var/lib/kubelet/pki/kubelet.crt::/var/lib/kubelet/pki/kubelet.key" Nov 4 23:21:05.885226 kubelet[2919]: W1104 23:21:05.884776 2919 reflector.go:569] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: Get "https://172.31.21.124:6443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&limit=500&resourceVersion=0": dial tcp 172.31.21.124:6443: connect: connection refused Nov 4 23:21:05.885226 kubelet[2919]: E1104 23:21:05.884932 2919 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: Get \"https://172.31.21.124:6443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&limit=500&resourceVersion=0\": dial tcp 172.31.21.124:6443: connect: connection refused" logger="UnhandledError" Nov 4 23:21:05.891502 kubelet[2919]: I1104 23:21:05.891435 2919 volume_manager.go:297] "Starting Kubelet Volume Manager" Nov 4 23:21:05.895402 kubelet[2919]: I1104 23:21:05.895365 2919 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Nov 4 23:21:05.896556 kubelet[2919]: I1104 23:21:05.895577 2919 reconciler.go:26] "Reconciler: start to sync state" Nov 4 23:21:05.898160 kubelet[2919]: W1104 23:21:05.898027 2919 reflector.go:569] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: Get "https://172.31.21.124:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": dial tcp 172.31.21.124:6443: connect: connection refused Nov 4 23:21:05.898322 kubelet[2919]: E1104 23:21:05.898148 2919 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: Get \"https://172.31.21.124:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0\": dial tcp 172.31.21.124:6443: connect: connection refused" logger="UnhandledError" Nov 4 23:21:05.898385 kubelet[2919]: E1104 23:21:05.898326 2919 kubelet_node_status.go:466] "Error getting the current node from lister" err="node \"ip-172-31-21-124\" not found" Nov 4 23:21:05.899761 kubelet[2919]: E1104 23:21:05.899708 2919 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://172.31.21.124:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-172-31-21-124?timeout=10s\": dial tcp 172.31.21.124:6443: connect: connection refused" interval="200ms" Nov 4 23:21:05.900594 kubelet[2919]: I1104 23:21:05.900511 2919 factory.go:219] Registration of the crio container factory failed: Get "http://%2Fvar%2Frun%2Fcrio%2Fcrio.sock/info": dial unix /var/run/crio/crio.sock: connect: no such file or directory Nov 4 23:21:05.901476 kubelet[2919]: E1104 23:21:05.901405 2919 kubelet.go:1555] "Image garbage collection failed once. Stats initialization may not have completed yet" err="invalid capacity 0 on image filesystem" Nov 4 23:21:05.904263 kubelet[2919]: I1104 23:21:05.903613 2919 factory.go:221] Registration of the containerd container factory successfully Nov 4 23:21:05.904263 kubelet[2919]: I1104 23:21:05.903643 2919 factory.go:221] Registration of the systemd container factory successfully Nov 4 23:21:05.928936 kubelet[2919]: I1104 23:21:05.928564 2919 cpu_manager.go:221] "Starting CPU manager" policy="none" Nov 4 23:21:05.928936 kubelet[2919]: I1104 23:21:05.928598 2919 cpu_manager.go:222] "Reconciling" reconcilePeriod="10s" Nov 4 23:21:05.928936 kubelet[2919]: I1104 23:21:05.928629 2919 state_mem.go:36] "Initialized new in-memory state store" Nov 4 23:21:05.933616 kubelet[2919]: I1104 23:21:05.933132 2919 policy_none.go:49] "None policy: Start" Nov 4 23:21:05.933616 kubelet[2919]: I1104 23:21:05.933172 2919 memory_manager.go:186] "Starting memorymanager" policy="None" Nov 4 23:21:05.933616 kubelet[2919]: I1104 23:21:05.933194 2919 state_mem.go:35] "Initializing new in-memory state store" Nov 4 23:21:05.935493 kubelet[2919]: I1104 23:21:05.935189 2919 kubelet_network_linux.go:50] "Initialized iptables rules." protocol="IPv4" Nov 4 23:21:05.938346 kubelet[2919]: I1104 23:21:05.937839 2919 kubelet_network_linux.go:50] "Initialized iptables rules." protocol="IPv6" Nov 4 23:21:05.938346 kubelet[2919]: I1104 23:21:05.937890 2919 status_manager.go:227] "Starting to sync pod status with apiserver" Nov 4 23:21:05.938346 kubelet[2919]: I1104 23:21:05.937927 2919 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Nov 4 23:21:05.938346 kubelet[2919]: I1104 23:21:05.937941 2919 kubelet.go:2382] "Starting kubelet main sync loop" Nov 4 23:21:05.938346 kubelet[2919]: E1104 23:21:05.938006 2919 kubelet.go:2406] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Nov 4 23:21:05.948938 kubelet[2919]: W1104 23:21:05.948346 2919 reflector.go:569] k8s.io/client-go/informers/factory.go:160: failed to list *v1.RuntimeClass: Get "https://172.31.21.124:6443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0": dial tcp 172.31.21.124:6443: connect: connection refused Nov 4 23:21:05.948938 kubelet[2919]: E1104 23:21:05.948916 2919 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.RuntimeClass: failed to list *v1.RuntimeClass: Get \"https://172.31.21.124:6443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0\": dial tcp 172.31.21.124:6443: connect: connection refused" logger="UnhandledError" Nov 4 23:21:05.954339 systemd[1]: Created slice kubepods.slice - libcontainer container kubepods.slice. Nov 4 23:21:05.974746 systemd[1]: Created slice kubepods-burstable.slice - libcontainer container kubepods-burstable.slice. Nov 4 23:21:05.981864 systemd[1]: Created slice kubepods-besteffort.slice - libcontainer container kubepods-besteffort.slice. Nov 4 23:21:05.991891 kubelet[2919]: I1104 23:21:05.991855 2919 manager.go:519] "Failed to read data from checkpoint" checkpoint="kubelet_internal_checkpoint" err="checkpoint is not found" Nov 4 23:21:05.992383 kubelet[2919]: I1104 23:21:05.992359 2919 eviction_manager.go:189] "Eviction manager: starting control loop" Nov 4 23:21:05.992548 kubelet[2919]: I1104 23:21:05.992492 2919 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Nov 4 23:21:05.993117 kubelet[2919]: I1104 23:21:05.993089 2919 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Nov 4 23:21:05.994830 kubelet[2919]: E1104 23:21:05.994795 2919 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="no imagefs label for configured runtime" Nov 4 23:21:05.995084 kubelet[2919]: E1104 23:21:05.995061 2919 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-172-31-21-124\" not found" Nov 4 23:21:06.059490 systemd[1]: Created slice kubepods-burstable-pod02372e48dc6ef431478e29c59562647b.slice - libcontainer container kubepods-burstable-pod02372e48dc6ef431478e29c59562647b.slice. Nov 4 23:21:06.077444 kubelet[2919]: E1104 23:21:06.077370 2919 kubelet.go:3190] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-172-31-21-124\" not found" node="ip-172-31-21-124" Nov 4 23:21:06.086163 systemd[1]: Created slice kubepods-burstable-podabb637b02775c35fc8354635606d3c8e.slice - libcontainer container kubepods-burstable-podabb637b02775c35fc8354635606d3c8e.slice. Nov 4 23:21:06.097253 kubelet[2919]: I1104 23:21:06.096235 2919 kubelet_node_status.go:75] "Attempting to register node" node="ip-172-31-21-124" Nov 4 23:21:06.097819 kubelet[2919]: I1104 23:21:06.097782 2919 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeconfig\" (UniqueName: \"kubernetes.io/host-path/fd0774693474f1f8ec55f92a54e657dc-kubeconfig\") pod \"kube-scheduler-ip-172-31-21-124\" (UID: \"fd0774693474f1f8ec55f92a54e657dc\") " pod="kube-system/kube-scheduler-ip-172-31-21-124" Nov 4 23:21:06.097973 kubelet[2919]: I1104 23:21:06.097948 2919 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-certs\" (UniqueName: \"kubernetes.io/host-path/02372e48dc6ef431478e29c59562647b-ca-certs\") pod \"kube-apiserver-ip-172-31-21-124\" (UID: \"02372e48dc6ef431478e29c59562647b\") " pod="kube-system/kube-apiserver-ip-172-31-21-124" Nov 4 23:21:06.098112 kubelet[2919]: I1104 23:21:06.098089 2919 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-certs\" (UniqueName: \"kubernetes.io/host-path/abb637b02775c35fc8354635606d3c8e-ca-certs\") pod \"kube-controller-manager-ip-172-31-21-124\" (UID: \"abb637b02775c35fc8354635606d3c8e\") " pod="kube-system/kube-controller-manager-ip-172-31-21-124" Nov 4 23:21:06.098387 kubelet[2919]: I1104 23:21:06.098297 2919 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"k8s-certs\" (UniqueName: \"kubernetes.io/host-path/abb637b02775c35fc8354635606d3c8e-k8s-certs\") pod \"kube-controller-manager-ip-172-31-21-124\" (UID: \"abb637b02775c35fc8354635606d3c8e\") " pod="kube-system/kube-controller-manager-ip-172-31-21-124" Nov 4 23:21:06.098861 kubelet[2919]: I1104 23:21:06.098702 2919 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-share-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/abb637b02775c35fc8354635606d3c8e-usr-share-ca-certificates\") pod \"kube-controller-manager-ip-172-31-21-124\" (UID: \"abb637b02775c35fc8354635606d3c8e\") " pod="kube-system/kube-controller-manager-ip-172-31-21-124" Nov 4 23:21:06.099760 kubelet[2919]: I1104 23:21:06.099303 2919 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"k8s-certs\" (UniqueName: \"kubernetes.io/host-path/02372e48dc6ef431478e29c59562647b-k8s-certs\") pod \"kube-apiserver-ip-172-31-21-124\" (UID: \"02372e48dc6ef431478e29c59562647b\") " pod="kube-system/kube-apiserver-ip-172-31-21-124" Nov 4 23:21:06.099760 kubelet[2919]: I1104 23:21:06.099544 2919 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-share-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/02372e48dc6ef431478e29c59562647b-usr-share-ca-certificates\") pod \"kube-apiserver-ip-172-31-21-124\" (UID: \"02372e48dc6ef431478e29c59562647b\") " pod="kube-system/kube-apiserver-ip-172-31-21-124" Nov 4 23:21:06.099760 kubelet[2919]: I1104 23:21:06.099584 2919 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"flexvolume-dir\" (UniqueName: \"kubernetes.io/host-path/abb637b02775c35fc8354635606d3c8e-flexvolume-dir\") pod \"kube-controller-manager-ip-172-31-21-124\" (UID: \"abb637b02775c35fc8354635606d3c8e\") " pod="kube-system/kube-controller-manager-ip-172-31-21-124" Nov 4 23:21:06.099760 kubelet[2919]: I1104 23:21:06.099619 2919 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeconfig\" (UniqueName: \"kubernetes.io/host-path/abb637b02775c35fc8354635606d3c8e-kubeconfig\") pod \"kube-controller-manager-ip-172-31-21-124\" (UID: \"abb637b02775c35fc8354635606d3c8e\") " pod="kube-system/kube-controller-manager-ip-172-31-21-124" Nov 4 23:21:06.099760 kubelet[2919]: E1104 23:21:06.097609 2919 kubelet_node_status.go:107] "Unable to register node with API server" err="Post \"https://172.31.21.124:6443/api/v1/nodes\": dial tcp 172.31.21.124:6443: connect: connection refused" node="ip-172-31-21-124" Nov 4 23:21:06.101020 kubelet[2919]: E1104 23:21:06.100636 2919 kubelet.go:3190] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-172-31-21-124\" not found" node="ip-172-31-21-124" Nov 4 23:21:06.101382 kubelet[2919]: E1104 23:21:06.101337 2919 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://172.31.21.124:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-172-31-21-124?timeout=10s\": dial tcp 172.31.21.124:6443: connect: connection refused" interval="400ms" Nov 4 23:21:06.106391 systemd[1]: Created slice kubepods-burstable-podfd0774693474f1f8ec55f92a54e657dc.slice - libcontainer container kubepods-burstable-podfd0774693474f1f8ec55f92a54e657dc.slice. Nov 4 23:21:06.111046 kubelet[2919]: E1104 23:21:06.110902 2919 kubelet.go:3190] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-172-31-21-124\" not found" node="ip-172-31-21-124" Nov 4 23:21:06.302481 kubelet[2919]: I1104 23:21:06.302428 2919 kubelet_node_status.go:75] "Attempting to register node" node="ip-172-31-21-124" Nov 4 23:21:06.303036 kubelet[2919]: E1104 23:21:06.302986 2919 kubelet_node_status.go:107] "Unable to register node with API server" err="Post \"https://172.31.21.124:6443/api/v1/nodes\": dial tcp 172.31.21.124:6443: connect: connection refused" node="ip-172-31-21-124" Nov 4 23:21:06.382723 containerd[1977]: time="2025-11-04T23:21:06.382563458Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-apiserver-ip-172-31-21-124,Uid:02372e48dc6ef431478e29c59562647b,Namespace:kube-system,Attempt:0,}" Nov 4 23:21:06.402498 containerd[1977]: time="2025-11-04T23:21:06.401820446Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-controller-manager-ip-172-31-21-124,Uid:abb637b02775c35fc8354635606d3c8e,Namespace:kube-system,Attempt:0,}" Nov 4 23:21:06.414588 containerd[1977]: time="2025-11-04T23:21:06.414380126Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-scheduler-ip-172-31-21-124,Uid:fd0774693474f1f8ec55f92a54e657dc,Namespace:kube-system,Attempt:0,}" Nov 4 23:21:06.422357 containerd[1977]: time="2025-11-04T23:21:06.421852166Z" level=info msg="connecting to shim bc4b5f5883aa467e79e0158a634679587310b15aa32bac243cba5c99b3ad1c17" address="unix:///run/containerd/s/f82f439e8ed6706fa121edcdbccd692a12bf628e5554c75cc390796f67bcaf1c" namespace=k8s.io protocol=ttrpc version=3 Nov 4 23:21:06.478309 containerd[1977]: time="2025-11-04T23:21:06.478033082Z" level=info msg="connecting to shim c6d92ae43385576b2f8fff81d176c22c8a2319d29208f2e653a313895e2ccc4d" address="unix:///run/containerd/s/4257e4aae2283efd17f38139900d21bdf2565cb578da9f04dace91c5d34f0a04" namespace=k8s.io protocol=ttrpc version=3 Nov 4 23:21:06.487488 containerd[1977]: time="2025-11-04T23:21:06.487431398Z" level=info msg="connecting to shim c2e51d1b3969d495a3265f2b9af797a79e2177e475b4d0ab3e5e57039eae855b" address="unix:///run/containerd/s/75dd118befc80347d788ca5515d456d78f70be890b3becd777ee4b926b6c0687" namespace=k8s.io protocol=ttrpc version=3 Nov 4 23:21:06.503812 kubelet[2919]: E1104 23:21:06.503681 2919 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://172.31.21.124:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-172-31-21-124?timeout=10s\": dial tcp 172.31.21.124:6443: connect: connection refused" interval="800ms" Nov 4 23:21:06.531313 systemd[1]: Started cri-containerd-bc4b5f5883aa467e79e0158a634679587310b15aa32bac243cba5c99b3ad1c17.scope - libcontainer container bc4b5f5883aa467e79e0158a634679587310b15aa32bac243cba5c99b3ad1c17. Nov 4 23:21:06.585815 systemd[1]: Started cri-containerd-c6d92ae43385576b2f8fff81d176c22c8a2319d29208f2e653a313895e2ccc4d.scope - libcontainer container c6d92ae43385576b2f8fff81d176c22c8a2319d29208f2e653a313895e2ccc4d. Nov 4 23:21:06.599758 systemd[1]: Started cri-containerd-c2e51d1b3969d495a3265f2b9af797a79e2177e475b4d0ab3e5e57039eae855b.scope - libcontainer container c2e51d1b3969d495a3265f2b9af797a79e2177e475b4d0ab3e5e57039eae855b. Nov 4 23:21:06.714494 kubelet[2919]: I1104 23:21:06.712642 2919 kubelet_node_status.go:75] "Attempting to register node" node="ip-172-31-21-124" Nov 4 23:21:06.722351 kubelet[2919]: E1104 23:21:06.722194 2919 kubelet_node_status.go:107] "Unable to register node with API server" err="Post \"https://172.31.21.124:6443/api/v1/nodes\": dial tcp 172.31.21.124:6443: connect: connection refused" node="ip-172-31-21-124" Nov 4 23:21:06.747680 containerd[1977]: time="2025-11-04T23:21:06.747596488Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-apiserver-ip-172-31-21-124,Uid:02372e48dc6ef431478e29c59562647b,Namespace:kube-system,Attempt:0,} returns sandbox id \"bc4b5f5883aa467e79e0158a634679587310b15aa32bac243cba5c99b3ad1c17\"" Nov 4 23:21:06.763831 containerd[1977]: time="2025-11-04T23:21:06.763764988Z" level=info msg="CreateContainer within sandbox \"bc4b5f5883aa467e79e0158a634679587310b15aa32bac243cba5c99b3ad1c17\" for container &ContainerMetadata{Name:kube-apiserver,Attempt:0,}" Nov 4 23:21:06.781182 containerd[1977]: time="2025-11-04T23:21:06.781037992Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-controller-manager-ip-172-31-21-124,Uid:abb637b02775c35fc8354635606d3c8e,Namespace:kube-system,Attempt:0,} returns sandbox id \"c6d92ae43385576b2f8fff81d176c22c8a2319d29208f2e653a313895e2ccc4d\"" Nov 4 23:21:06.791254 containerd[1977]: time="2025-11-04T23:21:06.790511992Z" level=info msg="Container 6282acb9ec35679b3d31e5e993b98379b5a92eab0798386d1b6290e3fe9c4459: CDI devices from CRI Config.CDIDevices: []" Nov 4 23:21:06.791575 containerd[1977]: time="2025-11-04T23:21:06.791514112Z" level=info msg="CreateContainer within sandbox \"c6d92ae43385576b2f8fff81d176c22c8a2319d29208f2e653a313895e2ccc4d\" for container &ContainerMetadata{Name:kube-controller-manager,Attempt:0,}" Nov 4 23:21:06.803524 containerd[1977]: time="2025-11-04T23:21:06.803459344Z" level=info msg="Container 328512a3e6a4337d47c713a9195595fcc92f899633887fa9dd04c85086d30879: CDI devices from CRI Config.CDIDevices: []" Nov 4 23:21:06.823683 containerd[1977]: time="2025-11-04T23:21:06.823626784Z" level=info msg="CreateContainer within sandbox \"c6d92ae43385576b2f8fff81d176c22c8a2319d29208f2e653a313895e2ccc4d\" for &ContainerMetadata{Name:kube-controller-manager,Attempt:0,} returns container id \"328512a3e6a4337d47c713a9195595fcc92f899633887fa9dd04c85086d30879\"" Nov 4 23:21:06.825495 containerd[1977]: time="2025-11-04T23:21:06.825383188Z" level=info msg="StartContainer for \"328512a3e6a4337d47c713a9195595fcc92f899633887fa9dd04c85086d30879\"" Nov 4 23:21:06.826772 containerd[1977]: time="2025-11-04T23:21:06.826327324Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-scheduler-ip-172-31-21-124,Uid:fd0774693474f1f8ec55f92a54e657dc,Namespace:kube-system,Attempt:0,} returns sandbox id \"c2e51d1b3969d495a3265f2b9af797a79e2177e475b4d0ab3e5e57039eae855b\"" Nov 4 23:21:06.830170 containerd[1977]: time="2025-11-04T23:21:06.829772692Z" level=info msg="CreateContainer within sandbox \"bc4b5f5883aa467e79e0158a634679587310b15aa32bac243cba5c99b3ad1c17\" for &ContainerMetadata{Name:kube-apiserver,Attempt:0,} returns container id \"6282acb9ec35679b3d31e5e993b98379b5a92eab0798386d1b6290e3fe9c4459\"" Nov 4 23:21:06.830744 containerd[1977]: time="2025-11-04T23:21:06.830682952Z" level=info msg="connecting to shim 328512a3e6a4337d47c713a9195595fcc92f899633887fa9dd04c85086d30879" address="unix:///run/containerd/s/4257e4aae2283efd17f38139900d21bdf2565cb578da9f04dace91c5d34f0a04" protocol=ttrpc version=3 Nov 4 23:21:06.831225 containerd[1977]: time="2025-11-04T23:21:06.831010960Z" level=info msg="StartContainer for \"6282acb9ec35679b3d31e5e993b98379b5a92eab0798386d1b6290e3fe9c4459\"" Nov 4 23:21:06.836296 containerd[1977]: time="2025-11-04T23:21:06.835129708Z" level=info msg="CreateContainer within sandbox \"c2e51d1b3969d495a3265f2b9af797a79e2177e475b4d0ab3e5e57039eae855b\" for container &ContainerMetadata{Name:kube-scheduler,Attempt:0,}" Nov 4 23:21:06.836296 containerd[1977]: time="2025-11-04T23:21:06.835957516Z" level=info msg="connecting to shim 6282acb9ec35679b3d31e5e993b98379b5a92eab0798386d1b6290e3fe9c4459" address="unix:///run/containerd/s/f82f439e8ed6706fa121edcdbccd692a12bf628e5554c75cc390796f67bcaf1c" protocol=ttrpc version=3 Nov 4 23:21:06.853802 containerd[1977]: time="2025-11-04T23:21:06.853683280Z" level=info msg="Container 74f0155bc25450258827d8b0395f9dca554cf24249db65354ab68b1cfdda0188: CDI devices from CRI Config.CDIDevices: []" Nov 4 23:21:06.864766 containerd[1977]: time="2025-11-04T23:21:06.864244852Z" level=info msg="CreateContainer within sandbox \"c2e51d1b3969d495a3265f2b9af797a79e2177e475b4d0ab3e5e57039eae855b\" for &ContainerMetadata{Name:kube-scheduler,Attempt:0,} returns container id \"74f0155bc25450258827d8b0395f9dca554cf24249db65354ab68b1cfdda0188\"" Nov 4 23:21:06.865300 containerd[1977]: time="2025-11-04T23:21:06.865260952Z" level=info msg="StartContainer for \"74f0155bc25450258827d8b0395f9dca554cf24249db65354ab68b1cfdda0188\"" Nov 4 23:21:06.876093 containerd[1977]: time="2025-11-04T23:21:06.875702632Z" level=info msg="connecting to shim 74f0155bc25450258827d8b0395f9dca554cf24249db65354ab68b1cfdda0188" address="unix:///run/containerd/s/75dd118befc80347d788ca5515d456d78f70be890b3becd777ee4b926b6c0687" protocol=ttrpc version=3 Nov 4 23:21:06.887809 systemd[1]: Started cri-containerd-6282acb9ec35679b3d31e5e993b98379b5a92eab0798386d1b6290e3fe9c4459.scope - libcontainer container 6282acb9ec35679b3d31e5e993b98379b5a92eab0798386d1b6290e3fe9c4459. Nov 4 23:21:06.893054 kubelet[2919]: W1104 23:21:06.892767 2919 reflector.go:569] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: Get "https://172.31.21.124:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": dial tcp 172.31.21.124:6443: connect: connection refused Nov 4 23:21:06.893054 kubelet[2919]: E1104 23:21:06.892867 2919 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: Get \"https://172.31.21.124:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0\": dial tcp 172.31.21.124:6443: connect: connection refused" logger="UnhandledError" Nov 4 23:21:06.902891 systemd[1]: Started cri-containerd-328512a3e6a4337d47c713a9195595fcc92f899633887fa9dd04c85086d30879.scope - libcontainer container 328512a3e6a4337d47c713a9195595fcc92f899633887fa9dd04c85086d30879. Nov 4 23:21:06.928184 systemd[1]: Started cri-containerd-74f0155bc25450258827d8b0395f9dca554cf24249db65354ab68b1cfdda0188.scope - libcontainer container 74f0155bc25450258827d8b0395f9dca554cf24249db65354ab68b1cfdda0188. Nov 4 23:21:07.007687 kubelet[2919]: W1104 23:21:07.007426 2919 reflector.go:569] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: Get "https://172.31.21.124:6443/api/v1/nodes?fieldSelector=metadata.name%3Dip-172-31-21-124&limit=500&resourceVersion=0": dial tcp 172.31.21.124:6443: connect: connection refused Nov 4 23:21:07.007687 kubelet[2919]: E1104 23:21:07.007535 2919 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: Get \"https://172.31.21.124:6443/api/v1/nodes?fieldSelector=metadata.name%3Dip-172-31-21-124&limit=500&resourceVersion=0\": dial tcp 172.31.21.124:6443: connect: connection refused" logger="UnhandledError" Nov 4 23:21:07.040913 kubelet[2919]: W1104 23:21:07.040809 2919 reflector.go:569] k8s.io/client-go/informers/factory.go:160: failed to list *v1.RuntimeClass: Get "https://172.31.21.124:6443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0": dial tcp 172.31.21.124:6443: connect: connection refused Nov 4 23:21:07.041077 kubelet[2919]: E1104 23:21:07.040917 2919 reflector.go:166] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.RuntimeClass: failed to list *v1.RuntimeClass: Get \"https://172.31.21.124:6443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0\": dial tcp 172.31.21.124:6443: connect: connection refused" logger="UnhandledError" Nov 4 23:21:07.080569 containerd[1977]: time="2025-11-04T23:21:07.080349001Z" level=info msg="StartContainer for \"6282acb9ec35679b3d31e5e993b98379b5a92eab0798386d1b6290e3fe9c4459\" returns successfully" Nov 4 23:21:07.119634 containerd[1977]: time="2025-11-04T23:21:07.119567533Z" level=info msg="StartContainer for \"74f0155bc25450258827d8b0395f9dca554cf24249db65354ab68b1cfdda0188\" returns successfully" Nov 4 23:21:07.139040 containerd[1977]: time="2025-11-04T23:21:07.138950462Z" level=info msg="StartContainer for \"328512a3e6a4337d47c713a9195595fcc92f899633887fa9dd04c85086d30879\" returns successfully" Nov 4 23:21:07.529117 kubelet[2919]: I1104 23:21:07.529061 2919 kubelet_node_status.go:75] "Attempting to register node" node="ip-172-31-21-124" Nov 4 23:21:07.999790 kubelet[2919]: E1104 23:21:07.999732 2919 kubelet.go:3190] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-172-31-21-124\" not found" node="ip-172-31-21-124" Nov 4 23:21:08.010082 kubelet[2919]: E1104 23:21:08.010032 2919 kubelet.go:3190] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-172-31-21-124\" not found" node="ip-172-31-21-124" Nov 4 23:21:08.019751 kubelet[2919]: E1104 23:21:08.019476 2919 kubelet.go:3190] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-172-31-21-124\" not found" node="ip-172-31-21-124" Nov 4 23:21:09.022572 kubelet[2919]: E1104 23:21:09.022278 2919 kubelet.go:3190] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-172-31-21-124\" not found" node="ip-172-31-21-124" Nov 4 23:21:09.023157 kubelet[2919]: E1104 23:21:09.022763 2919 kubelet.go:3190] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-172-31-21-124\" not found" node="ip-172-31-21-124" Nov 4 23:21:09.025315 kubelet[2919]: E1104 23:21:09.024868 2919 kubelet.go:3190] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-172-31-21-124\" not found" node="ip-172-31-21-124" Nov 4 23:21:10.028223 kubelet[2919]: E1104 23:21:10.025648 2919 kubelet.go:3190] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-172-31-21-124\" not found" node="ip-172-31-21-124" Nov 4 23:21:10.029181 kubelet[2919]: E1104 23:21:10.029151 2919 kubelet.go:3190] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-172-31-21-124\" not found" node="ip-172-31-21-124" Nov 4 23:21:10.029661 kubelet[2919]: E1104 23:21:10.029637 2919 kubelet.go:3190] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-172-31-21-124\" not found" node="ip-172-31-21-124" Nov 4 23:21:11.876230 kubelet[2919]: I1104 23:21:11.875897 2919 apiserver.go:52] "Watching apiserver" Nov 4 23:21:11.909693 kubelet[2919]: E1104 23:21:11.909633 2919 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-172-31-21-124\" not found" node="ip-172-31-21-124" Nov 4 23:21:11.997163 kubelet[2919]: I1104 23:21:11.997092 2919 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Nov 4 23:21:12.009783 kubelet[2919]: E1104 23:21:12.009511 2919 event.go:359] "Server rejected event (will not retry!)" err="namespaces \"default\" not found" event="&Event{ObjectMeta:{ip-172-31-21-124.1874f11e1dd7412f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-172-31-21-124,UID:ip-172-31-21-124,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-172-31-21-124,},FirstTimestamp:2025-11-04 23:21:05.860665647 +0000 UTC m=+0.859242041,LastTimestamp:2025-11-04 23:21:05.860665647 +0000 UTC m=+0.859242041,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-172-31-21-124,}" Nov 4 23:21:12.011479 kubelet[2919]: I1104 23:21:12.011434 2919 kubelet_node_status.go:78] "Successfully registered node" node="ip-172-31-21-124" Nov 4 23:21:12.095546 kubelet[2919]: I1104 23:21:12.095422 2919 kubelet.go:3194] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-ip-172-31-21-124" Nov 4 23:21:12.111230 kubelet[2919]: E1104 23:21:12.110808 2919 kubelet.go:3196] "Failed creating a mirror pod" err="pods \"kube-apiserver-ip-172-31-21-124\" is forbidden: no PriorityClass with name system-node-critical was found" pod="kube-system/kube-apiserver-ip-172-31-21-124" Nov 4 23:21:12.111230 kubelet[2919]: I1104 23:21:12.110859 2919 kubelet.go:3194] "Creating a mirror pod for static pod" pod="kube-system/kube-controller-manager-ip-172-31-21-124" Nov 4 23:21:12.117278 kubelet[2919]: E1104 23:21:12.116742 2919 kubelet.go:3196] "Failed creating a mirror pod" err="pods \"kube-controller-manager-ip-172-31-21-124\" is forbidden: no PriorityClass with name system-node-critical was found" pod="kube-system/kube-controller-manager-ip-172-31-21-124" Nov 4 23:21:12.117851 kubelet[2919]: I1104 23:21:12.117491 2919 kubelet.go:3194] "Creating a mirror pod for static pod" pod="kube-system/kube-scheduler-ip-172-31-21-124" Nov 4 23:21:12.126401 kubelet[2919]: E1104 23:21:12.126259 2919 kubelet.go:3196] "Failed creating a mirror pod" err="pods \"kube-scheduler-ip-172-31-21-124\" is forbidden: no PriorityClass with name system-node-critical was found" pod="kube-system/kube-scheduler-ip-172-31-21-124" Nov 4 23:21:12.582589 kubelet[2919]: I1104 23:21:12.582536 2919 kubelet.go:3194] "Creating a mirror pod for static pod" pod="kube-system/kube-scheduler-ip-172-31-21-124" Nov 4 23:21:13.984826 systemd[1]: Reload requested from client PID 3188 ('systemctl') (unit session-7.scope)... Nov 4 23:21:13.985579 systemd[1]: Reloading... Nov 4 23:21:14.256378 zram_generator::config[3242]: No configuration found. Nov 4 23:21:14.834967 systemd[1]: Reloading finished in 848 ms. Nov 4 23:21:14.890297 systemd[1]: Stopping kubelet.service - kubelet: The Kubernetes Node Agent... Nov 4 23:21:14.910361 systemd[1]: kubelet.service: Deactivated successfully. Nov 4 23:21:14.911138 systemd[1]: Stopped kubelet.service - kubelet: The Kubernetes Node Agent. Nov 4 23:21:14.911471 systemd[1]: kubelet.service: Consumed 1.687s CPU time, 127.8M memory peak. Nov 4 23:21:14.916953 systemd[1]: Starting kubelet.service - kubelet: The Kubernetes Node Agent... Nov 4 23:21:15.366806 systemd[1]: Started kubelet.service - kubelet: The Kubernetes Node Agent. Nov 4 23:21:15.385841 (kubelet)[3293]: kubelet.service: Referenced but unset environment variable evaluates to an empty string: KUBELET_EXTRA_ARGS Nov 4 23:21:15.505302 kubelet[3293]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 4 23:21:15.506312 kubelet[3293]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Nov 4 23:21:15.506575 kubelet[3293]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 4 23:21:15.507040 kubelet[3293]: I1104 23:21:15.506967 3293 server.go:215] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Nov 4 23:21:15.532693 kubelet[3293]: I1104 23:21:15.532557 3293 server.go:520] "Kubelet version" kubeletVersion="v1.32.4" Nov 4 23:21:15.532693 kubelet[3293]: I1104 23:21:15.532680 3293 server.go:522] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Nov 4 23:21:15.537398 kubelet[3293]: I1104 23:21:15.537330 3293 server.go:954] "Client rotation is on, will bootstrap in background" Nov 4 23:21:15.545632 kubelet[3293]: I1104 23:21:15.544393 3293 certificate_store.go:130] Loading cert/key pair from "/var/lib/kubelet/pki/kubelet-client-current.pem". Nov 4 23:21:15.550839 kubelet[3293]: I1104 23:21:15.550759 3293 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" Nov 4 23:21:15.564531 kubelet[3293]: I1104 23:21:15.564450 3293 server.go:1444] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Nov 4 23:21:15.567003 update_engine[1950]: I20251104 23:21:15.566428 1950 update_attempter.cc:509] Updating boot flags... Nov 4 23:21:15.579868 kubelet[3293]: I1104 23:21:15.579815 3293 server.go:772] "--cgroups-per-qos enabled, but --cgroup-root was not specified. defaulting to /" Nov 4 23:21:15.580313 kubelet[3293]: I1104 23:21:15.580253 3293 container_manager_linux.go:268] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Nov 4 23:21:15.580613 kubelet[3293]: I1104 23:21:15.580315 3293 container_manager_linux.go:273] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-172-31-21-124","RuntimeCgroupsName":"","SystemCgroupsName":"","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":false,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":null,"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"ExperimentalMemoryManagerPolicy":"None","ExperimentalMemoryManagerReservedMemory":null,"PodPidsLimit":-1,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Nov 4 23:21:15.580793 kubelet[3293]: I1104 23:21:15.580626 3293 topology_manager.go:138] "Creating topology manager with none policy" Nov 4 23:21:15.580793 kubelet[3293]: I1104 23:21:15.580648 3293 container_manager_linux.go:304] "Creating device plugin manager" Nov 4 23:21:15.580793 kubelet[3293]: I1104 23:21:15.580733 3293 state_mem.go:36] "Initialized new in-memory state store" Nov 4 23:21:15.581009 kubelet[3293]: I1104 23:21:15.580990 3293 kubelet.go:446] "Attempting to sync node with API server" Nov 4 23:21:15.581079 kubelet[3293]: I1104 23:21:15.581021 3293 kubelet.go:341] "Adding static pod path" path="/etc/kubernetes/manifests" Nov 4 23:21:15.581079 kubelet[3293]: I1104 23:21:15.581065 3293 kubelet.go:352] "Adding apiserver pod source" Nov 4 23:21:15.582271 kubelet[3293]: I1104 23:21:15.581086 3293 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Nov 4 23:21:15.590848 kubelet[3293]: I1104 23:21:15.590637 3293 kuberuntime_manager.go:269] "Container runtime initialized" containerRuntime="containerd" version="v2.0.5" apiVersion="v1" Nov 4 23:21:15.598644 kubelet[3293]: I1104 23:21:15.598569 3293 kubelet.go:890] "Not starting ClusterTrustBundle informer because we are in static kubelet mode" Nov 4 23:21:15.599562 kubelet[3293]: I1104 23:21:15.599500 3293 watchdog_linux.go:99] "Systemd watchdog is not enabled" Nov 4 23:21:15.599731 kubelet[3293]: I1104 23:21:15.599584 3293 server.go:1287] "Started kubelet" Nov 4 23:21:15.603943 kubelet[3293]: I1104 23:21:15.603899 3293 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Nov 4 23:21:15.604399 kubelet[3293]: I1104 23:21:15.604319 3293 server.go:169] "Starting to listen" address="0.0.0.0" port=10250 Nov 4 23:21:15.614233 kubelet[3293]: I1104 23:21:15.613657 3293 server.go:479] "Adding debug handlers to kubelet server" Nov 4 23:21:15.624897 kubelet[3293]: I1104 23:21:15.624502 3293 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Nov 4 23:21:15.626792 kubelet[3293]: I1104 23:21:15.625091 3293 server.go:243] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Nov 4 23:21:15.648303 kubelet[3293]: I1104 23:21:15.647334 3293 dynamic_serving_content.go:135] "Starting controller" name="kubelet-server-cert-files::/var/lib/kubelet/pki/kubelet.crt::/var/lib/kubelet/pki/kubelet.key" Nov 4 23:21:15.662139 kubelet[3293]: I1104 23:21:15.662067 3293 volume_manager.go:297] "Starting Kubelet Volume Manager" Nov 4 23:21:15.662688 kubelet[3293]: E1104 23:21:15.662615 3293 kubelet_node_status.go:466] "Error getting the current node from lister" err="node \"ip-172-31-21-124\" not found" Nov 4 23:21:15.667583 kubelet[3293]: I1104 23:21:15.667135 3293 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Nov 4 23:21:15.669660 kubelet[3293]: I1104 23:21:15.669588 3293 reconciler.go:26] "Reconciler: start to sync state" Nov 4 23:21:15.706997 kubelet[3293]: I1104 23:21:15.706958 3293 factory.go:221] Registration of the systemd container factory successfully Nov 4 23:21:15.707453 kubelet[3293]: I1104 23:21:15.707391 3293 factory.go:219] Registration of the crio container factory failed: Get "http://%2Fvar%2Frun%2Fcrio%2Fcrio.sock/info": dial unix /var/run/crio/crio.sock: connect: no such file or directory Nov 4 23:21:15.733540 kubelet[3293]: E1104 23:21:15.733441 3293 kubelet.go:1555] "Image garbage collection failed once. Stats initialization may not have completed yet" err="invalid capacity 0 on image filesystem" Nov 4 23:21:15.740690 kubelet[3293]: I1104 23:21:15.740613 3293 factory.go:221] Registration of the containerd container factory successfully Nov 4 23:21:15.845145 kubelet[3293]: I1104 23:21:15.845051 3293 kubelet_network_linux.go:50] "Initialized iptables rules." protocol="IPv4" Nov 4 23:21:15.855245 kubelet[3293]: I1104 23:21:15.854281 3293 kubelet_network_linux.go:50] "Initialized iptables rules." protocol="IPv6" Nov 4 23:21:15.855245 kubelet[3293]: I1104 23:21:15.854351 3293 status_manager.go:227] "Starting to sync pod status with apiserver" Nov 4 23:21:15.855245 kubelet[3293]: I1104 23:21:15.854384 3293 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Nov 4 23:21:15.855245 kubelet[3293]: I1104 23:21:15.854400 3293 kubelet.go:2382] "Starting kubelet main sync loop" Nov 4 23:21:15.855245 kubelet[3293]: E1104 23:21:15.854475 3293 kubelet.go:2406] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Nov 4 23:21:15.955332 kubelet[3293]: E1104 23:21:15.954735 3293 kubelet.go:2406] "Skipping pod synchronization" err="container runtime status check may not have completed yet" Nov 4 23:21:16.026111 kubelet[3293]: I1104 23:21:16.026036 3293 cpu_manager.go:221] "Starting CPU manager" policy="none" Nov 4 23:21:16.026111 kubelet[3293]: I1104 23:21:16.026089 3293 cpu_manager.go:222] "Reconciling" reconcilePeriod="10s" Nov 4 23:21:16.026411 kubelet[3293]: I1104 23:21:16.026130 3293 state_mem.go:36] "Initialized new in-memory state store" Nov 4 23:21:16.026411 kubelet[3293]: I1104 23:21:16.026546 3293 state_mem.go:88] "Updated default CPUSet" cpuSet="" Nov 4 23:21:16.026411 kubelet[3293]: I1104 23:21:16.026578 3293 state_mem.go:96] "Updated CPUSet assignments" assignments={} Nov 4 23:21:16.026411 kubelet[3293]: I1104 23:21:16.026615 3293 policy_none.go:49] "None policy: Start" Nov 4 23:21:16.026411 kubelet[3293]: I1104 23:21:16.026636 3293 memory_manager.go:186] "Starting memorymanager" policy="None" Nov 4 23:21:16.026411 kubelet[3293]: I1104 23:21:16.026661 3293 state_mem.go:35] "Initializing new in-memory state store" Nov 4 23:21:16.026411 kubelet[3293]: I1104 23:21:16.026874 3293 state_mem.go:75] "Updated machine memory state" Nov 4 23:21:16.044730 kubelet[3293]: I1104 23:21:16.044669 3293 manager.go:519] "Failed to read data from checkpoint" checkpoint="kubelet_internal_checkpoint" err="checkpoint is not found" Nov 4 23:21:16.045044 kubelet[3293]: I1104 23:21:16.045000 3293 eviction_manager.go:189] "Eviction manager: starting control loop" Nov 4 23:21:16.045172 kubelet[3293]: I1104 23:21:16.045040 3293 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Nov 4 23:21:16.047665 kubelet[3293]: I1104 23:21:16.047591 3293 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Nov 4 23:21:16.053915 kubelet[3293]: E1104 23:21:16.053762 3293 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="no imagefs label for configured runtime" Nov 4 23:21:16.156186 kubelet[3293]: I1104 23:21:16.156100 3293 kubelet.go:3194] "Creating a mirror pod for static pod" pod="kube-system/kube-scheduler-ip-172-31-21-124" Nov 4 23:21:16.164192 kubelet[3293]: I1104 23:21:16.163881 3293 kubelet.go:3194] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-ip-172-31-21-124" Nov 4 23:21:16.168781 kubelet[3293]: I1104 23:21:16.168715 3293 kubelet.go:3194] "Creating a mirror pod for static pod" pod="kube-system/kube-controller-manager-ip-172-31-21-124" Nov 4 23:21:16.174087 kubelet[3293]: I1104 23:21:16.173978 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-certs\" (UniqueName: \"kubernetes.io/host-path/02372e48dc6ef431478e29c59562647b-ca-certs\") pod \"kube-apiserver-ip-172-31-21-124\" (UID: \"02372e48dc6ef431478e29c59562647b\") " pod="kube-system/kube-apiserver-ip-172-31-21-124" Nov 4 23:21:16.174087 kubelet[3293]: I1104 23:21:16.174053 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-share-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/02372e48dc6ef431478e29c59562647b-usr-share-ca-certificates\") pod \"kube-apiserver-ip-172-31-21-124\" (UID: \"02372e48dc6ef431478e29c59562647b\") " pod="kube-system/kube-apiserver-ip-172-31-21-124" Nov 4 23:21:16.175406 kubelet[3293]: I1104 23:21:16.174103 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"k8s-certs\" (UniqueName: \"kubernetes.io/host-path/02372e48dc6ef431478e29c59562647b-k8s-certs\") pod \"kube-apiserver-ip-172-31-21-124\" (UID: \"02372e48dc6ef431478e29c59562647b\") " pod="kube-system/kube-apiserver-ip-172-31-21-124" Nov 4 23:21:16.175406 kubelet[3293]: I1104 23:21:16.174145 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-certs\" (UniqueName: \"kubernetes.io/host-path/abb637b02775c35fc8354635606d3c8e-ca-certs\") pod \"kube-controller-manager-ip-172-31-21-124\" (UID: \"abb637b02775c35fc8354635606d3c8e\") " pod="kube-system/kube-controller-manager-ip-172-31-21-124" Nov 4 23:21:16.176270 kubelet[3293]: I1104 23:21:16.174187 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"flexvolume-dir\" (UniqueName: \"kubernetes.io/host-path/abb637b02775c35fc8354635606d3c8e-flexvolume-dir\") pod \"kube-controller-manager-ip-172-31-21-124\" (UID: \"abb637b02775c35fc8354635606d3c8e\") " pod="kube-system/kube-controller-manager-ip-172-31-21-124" Nov 4 23:21:16.176365 kubelet[3293]: I1104 23:21:16.176320 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"k8s-certs\" (UniqueName: \"kubernetes.io/host-path/abb637b02775c35fc8354635606d3c8e-k8s-certs\") pod \"kube-controller-manager-ip-172-31-21-124\" (UID: \"abb637b02775c35fc8354635606d3c8e\") " pod="kube-system/kube-controller-manager-ip-172-31-21-124" Nov 4 23:21:16.176424 kubelet[3293]: I1104 23:21:16.176366 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeconfig\" (UniqueName: \"kubernetes.io/host-path/abb637b02775c35fc8354635606d3c8e-kubeconfig\") pod \"kube-controller-manager-ip-172-31-21-124\" (UID: \"abb637b02775c35fc8354635606d3c8e\") " pod="kube-system/kube-controller-manager-ip-172-31-21-124" Nov 4 23:21:16.176424 kubelet[3293]: I1104 23:21:16.176402 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-share-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/abb637b02775c35fc8354635606d3c8e-usr-share-ca-certificates\") pod \"kube-controller-manager-ip-172-31-21-124\" (UID: \"abb637b02775c35fc8354635606d3c8e\") " pod="kube-system/kube-controller-manager-ip-172-31-21-124" Nov 4 23:21:16.176628 kubelet[3293]: I1104 23:21:16.176456 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeconfig\" (UniqueName: \"kubernetes.io/host-path/fd0774693474f1f8ec55f92a54e657dc-kubeconfig\") pod \"kube-scheduler-ip-172-31-21-124\" (UID: \"fd0774693474f1f8ec55f92a54e657dc\") " pod="kube-system/kube-scheduler-ip-172-31-21-124" Nov 4 23:21:16.199315 kubelet[3293]: E1104 23:21:16.199232 3293 kubelet.go:3196] "Failed creating a mirror pod" err="pods \"kube-scheduler-ip-172-31-21-124\" already exists" pod="kube-system/kube-scheduler-ip-172-31-21-124" Nov 4 23:21:16.228719 kubelet[3293]: I1104 23:21:16.224458 3293 kubelet_node_status.go:75] "Attempting to register node" node="ip-172-31-21-124" Nov 4 23:21:16.268260 kubelet[3293]: I1104 23:21:16.267114 3293 kubelet_node_status.go:124] "Node was previously registered" node="ip-172-31-21-124" Nov 4 23:21:16.270312 kubelet[3293]: I1104 23:21:16.270257 3293 kubelet_node_status.go:78] "Successfully registered node" node="ip-172-31-21-124" Nov 4 23:21:16.583680 kubelet[3293]: I1104 23:21:16.583630 3293 apiserver.go:52] "Watching apiserver" Nov 4 23:21:16.669426 kubelet[3293]: I1104 23:21:16.669361 3293 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Nov 4 23:21:17.014992 kubelet[3293]: I1104 23:21:17.014399 3293 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-scheduler-ip-172-31-21-124" podStartSLOduration=5.014374259 podStartE2EDuration="5.014374259s" podCreationTimestamp="2025-11-04 23:21:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-04 23:21:16.99816995 +0000 UTC m=+1.600833452" watchObservedRunningTime="2025-11-04 23:21:17.014374259 +0000 UTC m=+1.617037749" Nov 4 23:21:17.014992 kubelet[3293]: I1104 23:21:17.014563 3293 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-ip-172-31-21-124" podStartSLOduration=1.014554235 podStartE2EDuration="1.014554235s" podCreationTimestamp="2025-11-04 23:21:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-04 23:21:17.014368931 +0000 UTC m=+1.617032433" watchObservedRunningTime="2025-11-04 23:21:17.014554235 +0000 UTC m=+1.617217713" Nov 4 23:21:17.038698 kubelet[3293]: I1104 23:21:17.037882 3293 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-controller-manager-ip-172-31-21-124" podStartSLOduration=1.037862987 podStartE2EDuration="1.037862987s" podCreationTimestamp="2025-11-04 23:21:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-04 23:21:17.037378967 +0000 UTC m=+1.640042481" watchObservedRunningTime="2025-11-04 23:21:17.037862987 +0000 UTC m=+1.640526489" Nov 4 23:21:19.607711 kubelet[3293]: I1104 23:21:19.607659 3293 kuberuntime_manager.go:1702] "Updating runtime config through cri with podcidr" CIDR="192.168.0.0/24" Nov 4 23:21:19.608999 containerd[1977]: time="2025-11-04T23:21:19.608698899Z" level=info msg="No cni config template is specified, wait for other system components to drop the config." Nov 4 23:21:19.610285 kubelet[3293]: I1104 23:21:19.609584 3293 kubelet_network.go:61] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="192.168.0.0/24" Nov 4 23:21:20.437048 systemd[1]: Created slice kubepods-besteffort-pod3b80c982_14e7_4b8c_b76a_ecd39bf0eee3.slice - libcontainer container kubepods-besteffort-pod3b80c982_14e7_4b8c_b76a_ecd39bf0eee3.slice. Nov 4 23:21:20.511192 kubelet[3293]: I1104 23:21:20.510944 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-proxy\" (UniqueName: \"kubernetes.io/configmap/3b80c982-14e7-4b8c-b76a-ecd39bf0eee3-kube-proxy\") pod \"kube-proxy-tdb7c\" (UID: \"3b80c982-14e7-4b8c-b76a-ecd39bf0eee3\") " pod="kube-system/kube-proxy-tdb7c" Nov 4 23:21:20.511192 kubelet[3293]: I1104 23:21:20.511012 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/3b80c982-14e7-4b8c-b76a-ecd39bf0eee3-xtables-lock\") pod \"kube-proxy-tdb7c\" (UID: \"3b80c982-14e7-4b8c-b76a-ecd39bf0eee3\") " pod="kube-system/kube-proxy-tdb7c" Nov 4 23:21:20.511192 kubelet[3293]: I1104 23:21:20.511054 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vd7x4\" (UniqueName: \"kubernetes.io/projected/3b80c982-14e7-4b8c-b76a-ecd39bf0eee3-kube-api-access-vd7x4\") pod \"kube-proxy-tdb7c\" (UID: \"3b80c982-14e7-4b8c-b76a-ecd39bf0eee3\") " pod="kube-system/kube-proxy-tdb7c" Nov 4 23:21:20.511192 kubelet[3293]: I1104 23:21:20.511121 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3b80c982-14e7-4b8c-b76a-ecd39bf0eee3-lib-modules\") pod \"kube-proxy-tdb7c\" (UID: \"3b80c982-14e7-4b8c-b76a-ecd39bf0eee3\") " pod="kube-system/kube-proxy-tdb7c" Nov 4 23:21:20.756652 containerd[1977]: time="2025-11-04T23:21:20.756587981Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-proxy-tdb7c,Uid:3b80c982-14e7-4b8c-b76a-ecd39bf0eee3,Namespace:kube-system,Attempt:0,}" Nov 4 23:21:20.817174 kubelet[3293]: I1104 23:21:20.817040 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-calico\" (UniqueName: \"kubernetes.io/host-path/8d36240a-af1a-4cd5-9b52-fa94105e662f-var-lib-calico\") pod \"tigera-operator-7dcd859c48-wj98f\" (UID: \"8d36240a-af1a-4cd5-9b52-fa94105e662f\") " pod="tigera-operator/tigera-operator-7dcd859c48-wj98f" Nov 4 23:21:20.819555 kubelet[3293]: I1104 23:21:20.817191 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpnl6\" (UniqueName: \"kubernetes.io/projected/8d36240a-af1a-4cd5-9b52-fa94105e662f-kube-api-access-lpnl6\") pod \"tigera-operator-7dcd859c48-wj98f\" (UID: \"8d36240a-af1a-4cd5-9b52-fa94105e662f\") " pod="tigera-operator/tigera-operator-7dcd859c48-wj98f" Nov 4 23:21:20.823696 systemd[1]: Created slice kubepods-besteffort-pod8d36240a_af1a_4cd5_9b52_fa94105e662f.slice - libcontainer container kubepods-besteffort-pod8d36240a_af1a_4cd5_9b52_fa94105e662f.slice. Nov 4 23:21:20.830777 containerd[1977]: time="2025-11-04T23:21:20.830391138Z" level=info msg="connecting to shim 0f62b448b4b4da9b81bbafd31cbd6c99c23c1d6e0566c2659018823aea5ebafc" address="unix:///run/containerd/s/bd1f1f36392ce6e19464f6566c241d591f1a9caf164ca8150efe641898ef48a8" namespace=k8s.io protocol=ttrpc version=3 Nov 4 23:21:20.894516 systemd[1]: Started cri-containerd-0f62b448b4b4da9b81bbafd31cbd6c99c23c1d6e0566c2659018823aea5ebafc.scope - libcontainer container 0f62b448b4b4da9b81bbafd31cbd6c99c23c1d6e0566c2659018823aea5ebafc. Nov 4 23:21:20.968370 containerd[1977]: time="2025-11-04T23:21:20.968304138Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-proxy-tdb7c,Uid:3b80c982-14e7-4b8c-b76a-ecd39bf0eee3,Namespace:kube-system,Attempt:0,} returns sandbox id \"0f62b448b4b4da9b81bbafd31cbd6c99c23c1d6e0566c2659018823aea5ebafc\"" Nov 4 23:21:20.976055 containerd[1977]: time="2025-11-04T23:21:20.975870294Z" level=info msg="CreateContainer within sandbox \"0f62b448b4b4da9b81bbafd31cbd6c99c23c1d6e0566c2659018823aea5ebafc\" for container &ContainerMetadata{Name:kube-proxy,Attempt:0,}" Nov 4 23:21:21.004879 containerd[1977]: time="2025-11-04T23:21:21.003666578Z" level=info msg="Container c388552a0103dd37b1304b4ed09a2aee8d37e7ca97c55109a0347529207a5302: CDI devices from CRI Config.CDIDevices: []" Nov 4 23:21:21.023380 containerd[1977]: time="2025-11-04T23:21:21.022823918Z" level=info msg="CreateContainer within sandbox \"0f62b448b4b4da9b81bbafd31cbd6c99c23c1d6e0566c2659018823aea5ebafc\" for &ContainerMetadata{Name:kube-proxy,Attempt:0,} returns container id \"c388552a0103dd37b1304b4ed09a2aee8d37e7ca97c55109a0347529207a5302\"" Nov 4 23:21:21.026136 containerd[1977]: time="2025-11-04T23:21:21.025884326Z" level=info msg="StartContainer for \"c388552a0103dd37b1304b4ed09a2aee8d37e7ca97c55109a0347529207a5302\"" Nov 4 23:21:21.032460 containerd[1977]: time="2025-11-04T23:21:21.031378791Z" level=info msg="connecting to shim c388552a0103dd37b1304b4ed09a2aee8d37e7ca97c55109a0347529207a5302" address="unix:///run/containerd/s/bd1f1f36392ce6e19464f6566c241d591f1a9caf164ca8150efe641898ef48a8" protocol=ttrpc version=3 Nov 4 23:21:21.073573 systemd[1]: Started cri-containerd-c388552a0103dd37b1304b4ed09a2aee8d37e7ca97c55109a0347529207a5302.scope - libcontainer container c388552a0103dd37b1304b4ed09a2aee8d37e7ca97c55109a0347529207a5302. Nov 4 23:21:21.143508 containerd[1977]: time="2025-11-04T23:21:21.143433423Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:tigera-operator-7dcd859c48-wj98f,Uid:8d36240a-af1a-4cd5-9b52-fa94105e662f,Namespace:tigera-operator,Attempt:0,}" Nov 4 23:21:21.169011 containerd[1977]: time="2025-11-04T23:21:21.168864975Z" level=info msg="StartContainer for \"c388552a0103dd37b1304b4ed09a2aee8d37e7ca97c55109a0347529207a5302\" returns successfully" Nov 4 23:21:21.192565 containerd[1977]: time="2025-11-04T23:21:21.192490383Z" level=info msg="connecting to shim 9dd3b9ffa344dde9217b73eddea275057baf50fd942d38de07afee1b98562183" address="unix:///run/containerd/s/712c59929a6897ce6dfc804c4c91d11b8a2fc6d898268137ff0d131dd7c9f578" namespace=k8s.io protocol=ttrpc version=3 Nov 4 23:21:21.253549 systemd[1]: Started cri-containerd-9dd3b9ffa344dde9217b73eddea275057baf50fd942d38de07afee1b98562183.scope - libcontainer container 9dd3b9ffa344dde9217b73eddea275057baf50fd942d38de07afee1b98562183. Nov 4 23:21:21.366555 containerd[1977]: time="2025-11-04T23:21:21.366086788Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:tigera-operator-7dcd859c48-wj98f,Uid:8d36240a-af1a-4cd5-9b52-fa94105e662f,Namespace:tigera-operator,Attempt:0,} returns sandbox id \"9dd3b9ffa344dde9217b73eddea275057baf50fd942d38de07afee1b98562183\"" Nov 4 23:21:21.375137 containerd[1977]: time="2025-11-04T23:21:21.375059908Z" level=info msg="PullImage \"quay.io/tigera/operator:v1.38.7\"" Nov 4 23:21:21.990612 kubelet[3293]: I1104 23:21:21.988943 3293 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-proxy-tdb7c" podStartSLOduration=1.988917763 podStartE2EDuration="1.988917763s" podCreationTimestamp="2025-11-04 23:21:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-04 23:21:21.988457059 +0000 UTC m=+6.591120573" watchObservedRunningTime="2025-11-04 23:21:21.988917763 +0000 UTC m=+6.591581253" Nov 4 23:21:22.755497 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount868838812.mount: Deactivated successfully. Nov 4 23:21:23.755514 containerd[1977]: time="2025-11-04T23:21:23.755441480Z" level=info msg="ImageCreate event name:\"quay.io/tigera/operator:v1.38.7\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:21:23.757268 containerd[1977]: time="2025-11-04T23:21:23.756933524Z" level=info msg="stop pulling image quay.io/tigera/operator:v1.38.7: active requests=0, bytes read=22152004" Nov 4 23:21:23.758379 containerd[1977]: time="2025-11-04T23:21:23.758300480Z" level=info msg="ImageCreate event name:\"sha256:19f52e4b7ea471a91d4186e9701288b905145dc20d4928cbbf2eac8d9dfce54b\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:21:23.762080 containerd[1977]: time="2025-11-04T23:21:23.761975660Z" level=info msg="ImageCreate event name:\"quay.io/tigera/operator@sha256:1b629a1403f5b6d7243f7dd523d04b8a50352a33c1d4d6970b6002a8733acf2e\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:21:23.763999 containerd[1977]: time="2025-11-04T23:21:23.763791440Z" level=info msg="Pulled image \"quay.io/tigera/operator:v1.38.7\" with image id \"sha256:19f52e4b7ea471a91d4186e9701288b905145dc20d4928cbbf2eac8d9dfce54b\", repo tag \"quay.io/tigera/operator:v1.38.7\", repo digest \"quay.io/tigera/operator@sha256:1b629a1403f5b6d7243f7dd523d04b8a50352a33c1d4d6970b6002a8733acf2e\", size \"22147999\" in 2.388646704s" Nov 4 23:21:23.763999 containerd[1977]: time="2025-11-04T23:21:23.763860320Z" level=info msg="PullImage \"quay.io/tigera/operator:v1.38.7\" returns image reference \"sha256:19f52e4b7ea471a91d4186e9701288b905145dc20d4928cbbf2eac8d9dfce54b\"" Nov 4 23:21:23.770033 containerd[1977]: time="2025-11-04T23:21:23.769944044Z" level=info msg="CreateContainer within sandbox \"9dd3b9ffa344dde9217b73eddea275057baf50fd942d38de07afee1b98562183\" for container &ContainerMetadata{Name:tigera-operator,Attempt:0,}" Nov 4 23:21:23.784150 containerd[1977]: time="2025-11-04T23:21:23.783252344Z" level=info msg="Container f9b85ea8664a1226d39751dd3c6f6ef1139e10c4371a11fdebf868b152c60017: CDI devices from CRI Config.CDIDevices: []" Nov 4 23:21:23.790973 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount7200102.mount: Deactivated successfully. Nov 4 23:21:23.799677 containerd[1977]: time="2025-11-04T23:21:23.799601804Z" level=info msg="CreateContainer within sandbox \"9dd3b9ffa344dde9217b73eddea275057baf50fd942d38de07afee1b98562183\" for &ContainerMetadata{Name:tigera-operator,Attempt:0,} returns container id \"f9b85ea8664a1226d39751dd3c6f6ef1139e10c4371a11fdebf868b152c60017\"" Nov 4 23:21:23.800910 containerd[1977]: time="2025-11-04T23:21:23.800773280Z" level=info msg="StartContainer for \"f9b85ea8664a1226d39751dd3c6f6ef1139e10c4371a11fdebf868b152c60017\"" Nov 4 23:21:23.803672 containerd[1977]: time="2025-11-04T23:21:23.803562524Z" level=info msg="connecting to shim f9b85ea8664a1226d39751dd3c6f6ef1139e10c4371a11fdebf868b152c60017" address="unix:///run/containerd/s/712c59929a6897ce6dfc804c4c91d11b8a2fc6d898268137ff0d131dd7c9f578" protocol=ttrpc version=3 Nov 4 23:21:23.850618 systemd[1]: Started cri-containerd-f9b85ea8664a1226d39751dd3c6f6ef1139e10c4371a11fdebf868b152c60017.scope - libcontainer container f9b85ea8664a1226d39751dd3c6f6ef1139e10c4371a11fdebf868b152c60017. Nov 4 23:21:23.921708 containerd[1977]: time="2025-11-04T23:21:23.921641577Z" level=info msg="StartContainer for \"f9b85ea8664a1226d39751dd3c6f6ef1139e10c4371a11fdebf868b152c60017\" returns successfully" Nov 4 23:21:24.016593 kubelet[3293]: I1104 23:21:24.015733 3293 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="tigera-operator/tigera-operator-7dcd859c48-wj98f" podStartSLOduration=1.623608937 podStartE2EDuration="4.015708005s" podCreationTimestamp="2025-11-04 23:21:20 +0000 UTC" firstStartedPulling="2025-11-04 23:21:21.373442428 +0000 UTC m=+5.976105918" lastFinishedPulling="2025-11-04 23:21:23.765541496 +0000 UTC m=+8.368204986" observedRunningTime="2025-11-04 23:21:24.015239165 +0000 UTC m=+8.617902667" watchObservedRunningTime="2025-11-04 23:21:24.015708005 +0000 UTC m=+8.618371495" Nov 4 23:21:30.986052 sudo[2337]: pam_unix(sudo:session): session closed for user root Nov 4 23:21:31.013012 sshd[2336]: Connection closed by 139.178.89.65 port 39180 Nov 4 23:21:31.014493 sshd-session[2333]: pam_unix(sshd:session): session closed for user core Nov 4 23:21:31.031428 systemd[1]: sshd@6-172.31.21.124:22-139.178.89.65:39180.service: Deactivated successfully. Nov 4 23:21:31.039608 systemd[1]: session-7.scope: Deactivated successfully. Nov 4 23:21:31.041457 systemd[1]: session-7.scope: Consumed 11.027s CPU time, 223.3M memory peak. Nov 4 23:21:31.044668 systemd-logind[1949]: Session 7 logged out. Waiting for processes to exit. Nov 4 23:21:31.049875 systemd-logind[1949]: Removed session 7. Nov 4 23:21:52.261177 systemd[1]: Created slice kubepods-besteffort-podec213a2f_0cb6_4f96_b220_fe9c2820d943.slice - libcontainer container kubepods-besteffort-podec213a2f_0cb6_4f96_b220_fe9c2820d943.slice. Nov 4 23:21:52.336971 kubelet[3293]: I1104 23:21:52.336889 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"typha-certs\" (UniqueName: \"kubernetes.io/secret/ec213a2f-0cb6-4f96-b220-fe9c2820d943-typha-certs\") pod \"calico-typha-66dfd96b94-952vq\" (UID: \"ec213a2f-0cb6-4f96-b220-fe9c2820d943\") " pod="calico-system/calico-typha-66dfd96b94-952vq" Nov 4 23:21:52.336971 kubelet[3293]: I1104 23:21:52.336971 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sf5gf\" (UniqueName: \"kubernetes.io/projected/ec213a2f-0cb6-4f96-b220-fe9c2820d943-kube-api-access-sf5gf\") pod \"calico-typha-66dfd96b94-952vq\" (UID: \"ec213a2f-0cb6-4f96-b220-fe9c2820d943\") " pod="calico-system/calico-typha-66dfd96b94-952vq" Nov 4 23:21:52.338911 kubelet[3293]: I1104 23:21:52.337027 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tigera-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec213a2f-0cb6-4f96-b220-fe9c2820d943-tigera-ca-bundle\") pod \"calico-typha-66dfd96b94-952vq\" (UID: \"ec213a2f-0cb6-4f96-b220-fe9c2820d943\") " pod="calico-system/calico-typha-66dfd96b94-952vq" Nov 4 23:21:52.447866 systemd[1]: Created slice kubepods-besteffort-pod4376deba_0698_46e8_9197_b640e7e9f1b6.slice - libcontainer container kubepods-besteffort-pod4376deba_0698_46e8_9197_b640e7e9f1b6.slice. Nov 4 23:21:52.539491 kubelet[3293]: I1104 23:21:52.539010 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqxj2\" (UniqueName: \"kubernetes.io/projected/4376deba-0698-46e8-9197-b640e7e9f1b6-kube-api-access-pqxj2\") pod \"calico-node-k482k\" (UID: \"4376deba-0698-46e8-9197-b640e7e9f1b6\") " pod="calico-system/calico-node-k482k" Nov 4 23:21:52.539491 kubelet[3293]: I1104 23:21:52.539072 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"flexvol-driver-host\" (UniqueName: \"kubernetes.io/host-path/4376deba-0698-46e8-9197-b640e7e9f1b6-flexvol-driver-host\") pod \"calico-node-k482k\" (UID: \"4376deba-0698-46e8-9197-b640e7e9f1b6\") " pod="calico-system/calico-node-k482k" Nov 4 23:21:52.539491 kubelet[3293]: I1104 23:21:52.539108 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-run-calico\" (UniqueName: \"kubernetes.io/host-path/4376deba-0698-46e8-9197-b640e7e9f1b6-var-run-calico\") pod \"calico-node-k482k\" (UID: \"4376deba-0698-46e8-9197-b640e7e9f1b6\") " pod="calico-system/calico-node-k482k" Nov 4 23:21:52.539491 kubelet[3293]: I1104 23:21:52.539148 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-calico\" (UniqueName: \"kubernetes.io/host-path/4376deba-0698-46e8-9197-b640e7e9f1b6-var-lib-calico\") pod \"calico-node-k482k\" (UID: \"4376deba-0698-46e8-9197-b640e7e9f1b6\") " pod="calico-system/calico-node-k482k" Nov 4 23:21:52.539491 kubelet[3293]: I1104 23:21:52.539188 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-net-dir\" (UniqueName: \"kubernetes.io/host-path/4376deba-0698-46e8-9197-b640e7e9f1b6-cni-net-dir\") pod \"calico-node-k482k\" (UID: \"4376deba-0698-46e8-9197-b640e7e9f1b6\") " pod="calico-system/calico-node-k482k" Nov 4 23:21:52.539832 kubelet[3293]: I1104 23:21:52.539277 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4376deba-0698-46e8-9197-b640e7e9f1b6-lib-modules\") pod \"calico-node-k482k\" (UID: \"4376deba-0698-46e8-9197-b640e7e9f1b6\") " pod="calico-system/calico-node-k482k" Nov 4 23:21:52.539832 kubelet[3293]: I1104 23:21:52.539335 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/4376deba-0698-46e8-9197-b640e7e9f1b6-xtables-lock\") pod \"calico-node-k482k\" (UID: \"4376deba-0698-46e8-9197-b640e7e9f1b6\") " pod="calico-system/calico-node-k482k" Nov 4 23:21:52.539832 kubelet[3293]: I1104 23:21:52.539451 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-bin-dir\" (UniqueName: \"kubernetes.io/host-path/4376deba-0698-46e8-9197-b640e7e9f1b6-cni-bin-dir\") pod \"calico-node-k482k\" (UID: \"4376deba-0698-46e8-9197-b640e7e9f1b6\") " pod="calico-system/calico-node-k482k" Nov 4 23:21:52.539832 kubelet[3293]: I1104 23:21:52.539509 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"policysync\" (UniqueName: \"kubernetes.io/host-path/4376deba-0698-46e8-9197-b640e7e9f1b6-policysync\") pod \"calico-node-k482k\" (UID: \"4376deba-0698-46e8-9197-b640e7e9f1b6\") " pod="calico-system/calico-node-k482k" Nov 4 23:21:52.539832 kubelet[3293]: I1104 23:21:52.539596 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-log-dir\" (UniqueName: \"kubernetes.io/host-path/4376deba-0698-46e8-9197-b640e7e9f1b6-cni-log-dir\") pod \"calico-node-k482k\" (UID: \"4376deba-0698-46e8-9197-b640e7e9f1b6\") " pod="calico-system/calico-node-k482k" Nov 4 23:21:52.540100 kubelet[3293]: I1104 23:21:52.539671 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-certs\" (UniqueName: \"kubernetes.io/secret/4376deba-0698-46e8-9197-b640e7e9f1b6-node-certs\") pod \"calico-node-k482k\" (UID: \"4376deba-0698-46e8-9197-b640e7e9f1b6\") " pod="calico-system/calico-node-k482k" Nov 4 23:21:52.540100 kubelet[3293]: I1104 23:21:52.539740 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tigera-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4376deba-0698-46e8-9197-b640e7e9f1b6-tigera-ca-bundle\") pod \"calico-node-k482k\" (UID: \"4376deba-0698-46e8-9197-b640e7e9f1b6\") " pod="calico-system/calico-node-k482k" Nov 4 23:21:52.563677 kubelet[3293]: E1104 23:21:52.563377 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized" pod="calico-system/csi-node-driver-5fvm8" podUID="0d16ca69-85e0-4dac-8492-1209e5dd061d" Nov 4 23:21:52.573988 containerd[1977]: time="2025-11-04T23:21:52.573584711Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-typha-66dfd96b94-952vq,Uid:ec213a2f-0cb6-4f96-b220-fe9c2820d943,Namespace:calico-system,Attempt:0,}" Nov 4 23:21:52.628040 containerd[1977]: time="2025-11-04T23:21:52.627708263Z" level=info msg="connecting to shim 4b41772d6cbf65a98bdeaa35b7d9afd67aec6bb1fb0e0196d81df04a8b180b2d" address="unix:///run/containerd/s/5e72dca3d647d3be10b1816d53b31d8a9799304efa2e8c3750b616b2397ac79c" namespace=k8s.io protocol=ttrpc version=3 Nov 4 23:21:52.643234 kubelet[3293]: I1104 23:21:52.642433 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0d16ca69-85e0-4dac-8492-1209e5dd061d-socket-dir\") pod \"csi-node-driver-5fvm8\" (UID: \"0d16ca69-85e0-4dac-8492-1209e5dd061d\") " pod="calico-system/csi-node-driver-5fvm8" Nov 4 23:21:52.643234 kubelet[3293]: I1104 23:21:52.642497 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0d16ca69-85e0-4dac-8492-1209e5dd061d-kubelet-dir\") pod \"csi-node-driver-5fvm8\" (UID: \"0d16ca69-85e0-4dac-8492-1209e5dd061d\") " pod="calico-system/csi-node-driver-5fvm8" Nov 4 23:21:52.643234 kubelet[3293]: I1104 23:21:52.642561 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0d16ca69-85e0-4dac-8492-1209e5dd061d-registration-dir\") pod \"csi-node-driver-5fvm8\" (UID: \"0d16ca69-85e0-4dac-8492-1209e5dd061d\") " pod="calico-system/csi-node-driver-5fvm8" Nov 4 23:21:52.643234 kubelet[3293]: I1104 23:21:52.642675 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"varrun\" (UniqueName: \"kubernetes.io/host-path/0d16ca69-85e0-4dac-8492-1209e5dd061d-varrun\") pod \"csi-node-driver-5fvm8\" (UID: \"0d16ca69-85e0-4dac-8492-1209e5dd061d\") " pod="calico-system/csi-node-driver-5fvm8" Nov 4 23:21:52.643234 kubelet[3293]: I1104 23:21:52.642810 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg84v\" (UniqueName: \"kubernetes.io/projected/0d16ca69-85e0-4dac-8492-1209e5dd061d-kube-api-access-hg84v\") pod \"csi-node-driver-5fvm8\" (UID: \"0d16ca69-85e0-4dac-8492-1209e5dd061d\") " pod="calico-system/csi-node-driver-5fvm8" Nov 4 23:21:52.655482 kubelet[3293]: E1104 23:21:52.655439 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:52.656974 kubelet[3293]: W1104 23:21:52.656729 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:52.658061 kubelet[3293]: E1104 23:21:52.657953 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:52.674067 kubelet[3293]: E1104 23:21:52.672477 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:52.674067 kubelet[3293]: W1104 23:21:52.672542 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:52.674067 kubelet[3293]: E1104 23:21:52.672578 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:52.701970 kubelet[3293]: E1104 23:21:52.701882 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:52.701970 kubelet[3293]: W1104 23:21:52.701958 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:52.702267 kubelet[3293]: E1104 23:21:52.701993 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:52.735407 systemd[1]: Started cri-containerd-4b41772d6cbf65a98bdeaa35b7d9afd67aec6bb1fb0e0196d81df04a8b180b2d.scope - libcontainer container 4b41772d6cbf65a98bdeaa35b7d9afd67aec6bb1fb0e0196d81df04a8b180b2d. Nov 4 23:21:52.745509 kubelet[3293]: E1104 23:21:52.745430 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:52.745951 kubelet[3293]: W1104 23:21:52.745741 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:52.746184 kubelet[3293]: E1104 23:21:52.745974 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:52.747928 kubelet[3293]: E1104 23:21:52.747874 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:52.747928 kubelet[3293]: W1104 23:21:52.747915 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:52.748393 kubelet[3293]: E1104 23:21:52.747964 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:52.748758 kubelet[3293]: E1104 23:21:52.748725 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:52.749164 kubelet[3293]: W1104 23:21:52.748931 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:52.749164 kubelet[3293]: E1104 23:21:52.748978 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:52.750390 kubelet[3293]: E1104 23:21:52.750349 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:52.750626 kubelet[3293]: W1104 23:21:52.750575 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:52.750804 kubelet[3293]: E1104 23:21:52.750750 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:52.751509 kubelet[3293]: E1104 23:21:52.751475 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:52.752122 kubelet[3293]: W1104 23:21:52.752047 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:52.752390 kubelet[3293]: E1104 23:21:52.752365 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:52.753059 kubelet[3293]: E1104 23:21:52.752828 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:52.753059 kubelet[3293]: W1104 23:21:52.752853 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:52.753059 kubelet[3293]: E1104 23:21:52.752913 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:52.754834 kubelet[3293]: E1104 23:21:52.753904 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:52.754834 kubelet[3293]: W1104 23:21:52.753936 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:52.754834 kubelet[3293]: E1104 23:21:52.754006 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:52.755639 kubelet[3293]: E1104 23:21:52.755604 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:52.755907 kubelet[3293]: W1104 23:21:52.755787 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:52.755907 kubelet[3293]: E1104 23:21:52.755863 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:52.756656 kubelet[3293]: E1104 23:21:52.756623 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:52.757243 kubelet[3293]: W1104 23:21:52.756818 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:52.757243 kubelet[3293]: E1104 23:21:52.757173 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:52.759399 kubelet[3293]: E1104 23:21:52.759317 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:52.759399 kubelet[3293]: W1104 23:21:52.759357 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:52.759724 kubelet[3293]: E1104 23:21:52.759698 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:52.760483 kubelet[3293]: E1104 23:21:52.760338 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:52.760483 kubelet[3293]: W1104 23:21:52.760369 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:52.760483 kubelet[3293]: E1104 23:21:52.760439 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:52.761044 kubelet[3293]: E1104 23:21:52.761011 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:52.761275 kubelet[3293]: W1104 23:21:52.761151 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:52.761275 kubelet[3293]: E1104 23:21:52.761242 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:52.761718 kubelet[3293]: E1104 23:21:52.761688 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:52.761931 kubelet[3293]: W1104 23:21:52.761826 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:52.761931 kubelet[3293]: E1104 23:21:52.761899 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:52.763383 kubelet[3293]: E1104 23:21:52.763343 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:52.763700 kubelet[3293]: W1104 23:21:52.763567 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:52.763788 kubelet[3293]: E1104 23:21:52.763700 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:52.764244 kubelet[3293]: E1104 23:21:52.764180 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:52.764477 kubelet[3293]: W1104 23:21:52.764366 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:52.764845 kubelet[3293]: E1104 23:21:52.764817 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:52.765655 kubelet[3293]: W1104 23:21:52.764958 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:52.765655 kubelet[3293]: E1104 23:21:52.765254 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:52.765655 kubelet[3293]: E1104 23:21:52.765293 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:52.766405 kubelet[3293]: E1104 23:21:52.766355 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:52.766405 kubelet[3293]: W1104 23:21:52.766392 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:52.767865 kubelet[3293]: E1104 23:21:52.767004 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:52.767865 kubelet[3293]: W1104 23:21:52.767039 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:52.767865 kubelet[3293]: E1104 23:21:52.767739 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:52.767865 kubelet[3293]: E1104 23:21:52.767786 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:52.770298 containerd[1977]: time="2025-11-04T23:21:52.767316012Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-node-k482k,Uid:4376deba-0698-46e8-9197-b640e7e9f1b6,Namespace:calico-system,Attempt:0,}" Nov 4 23:21:52.771130 kubelet[3293]: E1104 23:21:52.771086 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:52.771130 kubelet[3293]: W1104 23:21:52.771121 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:52.772026 kubelet[3293]: E1104 23:21:52.771339 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:52.772454 kubelet[3293]: E1104 23:21:52.772383 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:52.772454 kubelet[3293]: W1104 23:21:52.772448 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:52.772815 kubelet[3293]: E1104 23:21:52.772592 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:52.773880 kubelet[3293]: E1104 23:21:52.773610 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:52.773880 kubelet[3293]: W1104 23:21:52.773650 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:52.774267 kubelet[3293]: E1104 23:21:52.774098 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:52.774986 kubelet[3293]: E1104 23:21:52.774941 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:52.774986 kubelet[3293]: W1104 23:21:52.774978 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:52.776507 kubelet[3293]: E1104 23:21:52.776263 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:52.776676 kubelet[3293]: E1104 23:21:52.776511 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:52.776676 kubelet[3293]: W1104 23:21:52.776533 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:52.777800 kubelet[3293]: E1104 23:21:52.776749 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:52.777800 kubelet[3293]: E1104 23:21:52.776978 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:52.777800 kubelet[3293]: W1104 23:21:52.776996 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:52.777800 kubelet[3293]: E1104 23:21:52.777031 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:52.778590 kubelet[3293]: E1104 23:21:52.778519 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:52.778590 kubelet[3293]: W1104 23:21:52.778563 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:52.778777 kubelet[3293]: E1104 23:21:52.778597 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:52.823283 containerd[1977]: time="2025-11-04T23:21:52.822258324Z" level=info msg="connecting to shim 78d6693cb12a42c82c2e7073b5c60b7af92e724683b600b959c6588113e64f7a" address="unix:///run/containerd/s/37287f1461421ddb3449cf83eb2647f53e3a5758e03914bee4a2594775209b02" namespace=k8s.io protocol=ttrpc version=3 Nov 4 23:21:52.829234 kubelet[3293]: E1104 23:21:52.828613 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:52.829234 kubelet[3293]: W1104 23:21:52.828676 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:52.829234 kubelet[3293]: E1104 23:21:52.828710 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:52.893668 systemd[1]: Started cri-containerd-78d6693cb12a42c82c2e7073b5c60b7af92e724683b600b959c6588113e64f7a.scope - libcontainer container 78d6693cb12a42c82c2e7073b5c60b7af92e724683b600b959c6588113e64f7a. Nov 4 23:21:52.981373 containerd[1977]: time="2025-11-04T23:21:52.981135889Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-typha-66dfd96b94-952vq,Uid:ec213a2f-0cb6-4f96-b220-fe9c2820d943,Namespace:calico-system,Attempt:0,} returns sandbox id \"4b41772d6cbf65a98bdeaa35b7d9afd67aec6bb1fb0e0196d81df04a8b180b2d\"" Nov 4 23:21:52.986551 containerd[1977]: time="2025-11-04T23:21:52.986503645Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/typha:v3.30.4\"" Nov 4 23:21:53.004376 containerd[1977]: time="2025-11-04T23:21:53.004254609Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-node-k482k,Uid:4376deba-0698-46e8-9197-b640e7e9f1b6,Namespace:calico-system,Attempt:0,} returns sandbox id \"78d6693cb12a42c82c2e7073b5c60b7af92e724683b600b959c6588113e64f7a\"" Nov 4 23:21:53.855800 kubelet[3293]: E1104 23:21:53.855703 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized" pod="calico-system/csi-node-driver-5fvm8" podUID="0d16ca69-85e0-4dac-8492-1209e5dd061d" Nov 4 23:21:54.172794 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount250077315.mount: Deactivated successfully. Nov 4 23:21:54.978019 containerd[1977]: time="2025-11-04T23:21:54.977932659Z" level=info msg="ImageCreate event name:\"ghcr.io/flatcar/calico/typha:v3.30.4\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:21:54.980379 containerd[1977]: time="2025-11-04T23:21:54.980283543Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/typha:v3.30.4: active requests=0, bytes read=33090687" Nov 4 23:21:54.982564 containerd[1977]: time="2025-11-04T23:21:54.981177783Z" level=info msg="ImageCreate event name:\"sha256:5fe38d12a54098df5aaf5ec7228dc2f976f60cb4f434d7256f03126b004fdc5b\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:21:54.990308 containerd[1977]: time="2025-11-04T23:21:54.990128307Z" level=info msg="ImageCreate event name:\"ghcr.io/flatcar/calico/typha@sha256:6f437220b5b3c627fb4a0fc8dc323363101f3c22a8f337612c2a1ddfb73b810c\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:21:54.991663 containerd[1977]: time="2025-11-04T23:21:54.991591731Z" level=info msg="Pulled image \"ghcr.io/flatcar/calico/typha:v3.30.4\" with image id \"sha256:5fe38d12a54098df5aaf5ec7228dc2f976f60cb4f434d7256f03126b004fdc5b\", repo tag \"ghcr.io/flatcar/calico/typha:v3.30.4\", repo digest \"ghcr.io/flatcar/calico/typha@sha256:6f437220b5b3c627fb4a0fc8dc323363101f3c22a8f337612c2a1ddfb73b810c\", size \"33090541\" in 2.003016322s" Nov 4 23:21:54.992005 containerd[1977]: time="2025-11-04T23:21:54.991921095Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/typha:v3.30.4\" returns image reference \"sha256:5fe38d12a54098df5aaf5ec7228dc2f976f60cb4f434d7256f03126b004fdc5b\"" Nov 4 23:21:54.996231 containerd[1977]: time="2025-11-04T23:21:54.995939067Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/pod2daemon-flexvol:v3.30.4\"" Nov 4 23:21:55.039585 containerd[1977]: time="2025-11-04T23:21:55.039530111Z" level=info msg="CreateContainer within sandbox \"4b41772d6cbf65a98bdeaa35b7d9afd67aec6bb1fb0e0196d81df04a8b180b2d\" for container &ContainerMetadata{Name:calico-typha,Attempt:0,}" Nov 4 23:21:55.054260 containerd[1977]: time="2025-11-04T23:21:55.052874964Z" level=info msg="Container 6a6c696afeea9e2385882df7169f7b1828860dbf42e76db8ca18bd6d8de6f527: CDI devices from CRI Config.CDIDevices: []" Nov 4 23:21:55.065953 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount1099353602.mount: Deactivated successfully. Nov 4 23:21:55.073860 containerd[1977]: time="2025-11-04T23:21:55.073749084Z" level=info msg="CreateContainer within sandbox \"4b41772d6cbf65a98bdeaa35b7d9afd67aec6bb1fb0e0196d81df04a8b180b2d\" for &ContainerMetadata{Name:calico-typha,Attempt:0,} returns container id \"6a6c696afeea9e2385882df7169f7b1828860dbf42e76db8ca18bd6d8de6f527\"" Nov 4 23:21:55.075424 containerd[1977]: time="2025-11-04T23:21:55.075354312Z" level=info msg="StartContainer for \"6a6c696afeea9e2385882df7169f7b1828860dbf42e76db8ca18bd6d8de6f527\"" Nov 4 23:21:55.078168 containerd[1977]: time="2025-11-04T23:21:55.078087036Z" level=info msg="connecting to shim 6a6c696afeea9e2385882df7169f7b1828860dbf42e76db8ca18bd6d8de6f527" address="unix:///run/containerd/s/5e72dca3d647d3be10b1816d53b31d8a9799304efa2e8c3750b616b2397ac79c" protocol=ttrpc version=3 Nov 4 23:21:55.128551 systemd[1]: Started cri-containerd-6a6c696afeea9e2385882df7169f7b1828860dbf42e76db8ca18bd6d8de6f527.scope - libcontainer container 6a6c696afeea9e2385882df7169f7b1828860dbf42e76db8ca18bd6d8de6f527. Nov 4 23:21:55.239347 containerd[1977]: time="2025-11-04T23:21:55.237929472Z" level=info msg="StartContainer for \"6a6c696afeea9e2385882df7169f7b1828860dbf42e76db8ca18bd6d8de6f527\" returns successfully" Nov 4 23:21:55.863129 kubelet[3293]: E1104 23:21:55.863043 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized" pod="calico-system/csi-node-driver-5fvm8" podUID="0d16ca69-85e0-4dac-8492-1209e5dd061d" Nov 4 23:21:56.179948 containerd[1977]: time="2025-11-04T23:21:56.179571709Z" level=info msg="ImageCreate event name:\"ghcr.io/flatcar/calico/pod2daemon-flexvol:v3.30.4\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:21:56.181951 containerd[1977]: time="2025-11-04T23:21:56.180920485Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/pod2daemon-flexvol:v3.30.4: active requests=0, bytes read=4266741" Nov 4 23:21:56.185109 containerd[1977]: time="2025-11-04T23:21:56.184943077Z" level=info msg="ImageCreate event name:\"sha256:90ff755393144dc5a3c05f95ffe1a3ecd2f89b98ecf36d9e4721471b80af4640\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:21:56.191268 containerd[1977]: time="2025-11-04T23:21:56.191174353Z" level=info msg="ImageCreate event name:\"ghcr.io/flatcar/calico/pod2daemon-flexvol@sha256:50bdfe370b7308fa9957ed1eaccd094aa4f27f9a4f1dfcfef2f8a7696a1551e1\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:21:56.194150 containerd[1977]: time="2025-11-04T23:21:56.193948561Z" level=info msg="Pulled image \"ghcr.io/flatcar/calico/pod2daemon-flexvol:v3.30.4\" with image id \"sha256:90ff755393144dc5a3c05f95ffe1a3ecd2f89b98ecf36d9e4721471b80af4640\", repo tag \"ghcr.io/flatcar/calico/pod2daemon-flexvol:v3.30.4\", repo digest \"ghcr.io/flatcar/calico/pod2daemon-flexvol@sha256:50bdfe370b7308fa9957ed1eaccd094aa4f27f9a4f1dfcfef2f8a7696a1551e1\", size \"5636392\" in 1.197929754s" Nov 4 23:21:56.194150 containerd[1977]: time="2025-11-04T23:21:56.194021137Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/pod2daemon-flexvol:v3.30.4\" returns image reference \"sha256:90ff755393144dc5a3c05f95ffe1a3ecd2f89b98ecf36d9e4721471b80af4640\"" Nov 4 23:21:56.202678 containerd[1977]: time="2025-11-04T23:21:56.202595341Z" level=info msg="CreateContainer within sandbox \"78d6693cb12a42c82c2e7073b5c60b7af92e724683b600b959c6588113e64f7a\" for container &ContainerMetadata{Name:flexvol-driver,Attempt:0,}" Nov 4 23:21:56.220265 containerd[1977]: time="2025-11-04T23:21:56.216543733Z" level=info msg="Container 61f828b7a4b0ae9095264d84fd4edc191d24051390ddeb52ae2de5baa6c24d40: CDI devices from CRI Config.CDIDevices: []" Nov 4 23:21:56.228592 kubelet[3293]: E1104 23:21:56.227119 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:56.228592 kubelet[3293]: W1104 23:21:56.228257 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:56.228592 kubelet[3293]: E1104 23:21:56.228333 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:56.229182 kubelet[3293]: E1104 23:21:56.229155 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:56.229858 kubelet[3293]: W1104 23:21:56.229713 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:56.229858 kubelet[3293]: E1104 23:21:56.229822 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:56.231114 kubelet[3293]: E1104 23:21:56.231062 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:56.231568 kubelet[3293]: W1104 23:21:56.231383 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:56.231568 kubelet[3293]: E1104 23:21:56.231423 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:56.234176 kubelet[3293]: E1104 23:21:56.233747 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:56.234176 kubelet[3293]: W1104 23:21:56.233780 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:56.234176 kubelet[3293]: E1104 23:21:56.233835 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:56.235556 kubelet[3293]: E1104 23:21:56.235393 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:56.236494 kubelet[3293]: W1104 23:21:56.235714 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:56.236494 kubelet[3293]: E1104 23:21:56.236258 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:56.237558 kubelet[3293]: I1104 23:21:56.237127 3293 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="calico-system/calico-typha-66dfd96b94-952vq" podStartSLOduration=2.228269447 podStartE2EDuration="4.237107485s" podCreationTimestamp="2025-11-04 23:21:52 +0000 UTC" firstStartedPulling="2025-11-04 23:21:52.985616005 +0000 UTC m=+37.588279495" lastFinishedPulling="2025-11-04 23:21:54.994454055 +0000 UTC m=+39.597117533" observedRunningTime="2025-11-04 23:21:56.176936869 +0000 UTC m=+40.779600371" watchObservedRunningTime="2025-11-04 23:21:56.237107485 +0000 UTC m=+40.839770963" Nov 4 23:21:56.237786 containerd[1977]: time="2025-11-04T23:21:56.237317461Z" level=info msg="CreateContainer within sandbox \"78d6693cb12a42c82c2e7073b5c60b7af92e724683b600b959c6588113e64f7a\" for &ContainerMetadata{Name:flexvol-driver,Attempt:0,} returns container id \"61f828b7a4b0ae9095264d84fd4edc191d24051390ddeb52ae2de5baa6c24d40\"" Nov 4 23:21:56.241008 containerd[1977]: time="2025-11-04T23:21:56.240445753Z" level=info msg="StartContainer for \"61f828b7a4b0ae9095264d84fd4edc191d24051390ddeb52ae2de5baa6c24d40\"" Nov 4 23:21:56.241387 kubelet[3293]: E1104 23:21:56.238190 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:56.241387 kubelet[3293]: W1104 23:21:56.241287 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:56.241387 kubelet[3293]: E1104 23:21:56.241333 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:56.242581 kubelet[3293]: E1104 23:21:56.242492 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:56.242581 kubelet[3293]: W1104 23:21:56.242530 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:56.242581 kubelet[3293]: E1104 23:21:56.242562 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:56.244573 kubelet[3293]: E1104 23:21:56.244350 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:56.244573 kubelet[3293]: W1104 23:21:56.244391 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:56.244573 kubelet[3293]: E1104 23:21:56.244423 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:56.245720 kubelet[3293]: E1104 23:21:56.245666 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:56.245720 kubelet[3293]: W1104 23:21:56.245702 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:56.246036 kubelet[3293]: E1104 23:21:56.245734 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:56.247990 containerd[1977]: time="2025-11-04T23:21:56.247825273Z" level=info msg="connecting to shim 61f828b7a4b0ae9095264d84fd4edc191d24051390ddeb52ae2de5baa6c24d40" address="unix:///run/containerd/s/37287f1461421ddb3449cf83eb2647f53e3a5758e03914bee4a2594775209b02" protocol=ttrpc version=3 Nov 4 23:21:56.248305 kubelet[3293]: E1104 23:21:56.248126 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:56.248305 kubelet[3293]: W1104 23:21:56.248156 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:56.248820 kubelet[3293]: E1104 23:21:56.248187 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:56.251248 kubelet[3293]: E1104 23:21:56.251095 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:56.251248 kubelet[3293]: W1104 23:21:56.251158 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:56.251248 kubelet[3293]: E1104 23:21:56.251191 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:56.258879 kubelet[3293]: E1104 23:21:56.258526 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:56.258879 kubelet[3293]: W1104 23:21:56.258567 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:56.258879 kubelet[3293]: E1104 23:21:56.258600 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:56.260181 kubelet[3293]: E1104 23:21:56.259898 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:56.260181 kubelet[3293]: W1104 23:21:56.259933 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:56.260181 kubelet[3293]: E1104 23:21:56.259963 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:56.262927 kubelet[3293]: E1104 23:21:56.262884 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:56.263509 kubelet[3293]: W1104 23:21:56.263104 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:56.263509 kubelet[3293]: E1104 23:21:56.263148 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:56.265573 kubelet[3293]: E1104 23:21:56.265400 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:56.265573 kubelet[3293]: W1104 23:21:56.265436 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:56.265573 kubelet[3293]: E1104 23:21:56.265468 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:56.292539 kubelet[3293]: E1104 23:21:56.292485 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:56.292835 kubelet[3293]: W1104 23:21:56.292732 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:56.292835 kubelet[3293]: E1104 23:21:56.292773 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:56.295916 kubelet[3293]: E1104 23:21:56.295847 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:56.296508 kubelet[3293]: W1104 23:21:56.296125 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:56.296508 kubelet[3293]: E1104 23:21:56.296434 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:56.297729 kubelet[3293]: E1104 23:21:56.297678 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:56.297729 kubelet[3293]: W1104 23:21:56.297719 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:56.297729 kubelet[3293]: E1104 23:21:56.297768 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:56.300333 kubelet[3293]: E1104 23:21:56.300191 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:56.300333 kubelet[3293]: W1104 23:21:56.300276 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:56.300785 kubelet[3293]: E1104 23:21:56.300546 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:56.301435 kubelet[3293]: E1104 23:21:56.301378 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:56.301435 kubelet[3293]: W1104 23:21:56.301415 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:56.301666 kubelet[3293]: E1104 23:21:56.301450 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:56.302607 kubelet[3293]: E1104 23:21:56.302553 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:56.302607 kubelet[3293]: W1104 23:21:56.302594 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:56.303743 kubelet[3293]: E1104 23:21:56.302668 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:56.303743 kubelet[3293]: E1104 23:21:56.303428 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:56.303743 kubelet[3293]: W1104 23:21:56.303455 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:56.304356 kubelet[3293]: E1104 23:21:56.303865 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:56.306776 kubelet[3293]: E1104 23:21:56.306718 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:56.306776 kubelet[3293]: W1104 23:21:56.306758 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:56.308143 kubelet[3293]: E1104 23:21:56.308099 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:56.308779 kubelet[3293]: E1104 23:21:56.308599 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:56.308779 kubelet[3293]: W1104 23:21:56.308635 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:56.309818 kubelet[3293]: E1104 23:21:56.309674 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:56.309818 kubelet[3293]: W1104 23:21:56.309708 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:56.311775 kubelet[3293]: E1104 23:21:56.311393 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:56.311775 kubelet[3293]: W1104 23:21:56.311431 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:56.311775 kubelet[3293]: E1104 23:21:56.311465 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:56.313903 kubelet[3293]: E1104 23:21:56.313850 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:56.313903 kubelet[3293]: W1104 23:21:56.313892 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:56.314129 kubelet[3293]: E1104 23:21:56.313923 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:56.314129 kubelet[3293]: E1104 23:21:56.313966 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:56.316533 kubelet[3293]: E1104 23:21:56.316414 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:56.316533 kubelet[3293]: W1104 23:21:56.316453 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:56.316533 kubelet[3293]: E1104 23:21:56.316486 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:56.317168 kubelet[3293]: E1104 23:21:56.317107 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:56.317168 kubelet[3293]: W1104 23:21:56.317140 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:56.317168 kubelet[3293]: E1104 23:21:56.317169 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:56.317544 kubelet[3293]: E1104 23:21:56.317246 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:56.320554 kubelet[3293]: E1104 23:21:56.320390 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:56.320864 kubelet[3293]: W1104 23:21:56.320430 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:56.321329 kubelet[3293]: E1104 23:21:56.321291 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:56.324393 kubelet[3293]: E1104 23:21:56.324354 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:56.324634 kubelet[3293]: W1104 23:21:56.324563 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:56.325410 kubelet[3293]: E1104 23:21:56.324888 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:56.327129 kubelet[3293]: E1104 23:21:56.327078 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:56.327620 kubelet[3293]: W1104 23:21:56.327462 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:56.327620 kubelet[3293]: E1104 23:21:56.327500 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:56.334796 kubelet[3293]: E1104 23:21:56.334480 3293 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:56.334796 kubelet[3293]: W1104 23:21:56.334726 3293 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:56.335258 kubelet[3293]: E1104 23:21:56.334765 3293 plugins.go:695] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:56.338534 systemd[1]: Started cri-containerd-61f828b7a4b0ae9095264d84fd4edc191d24051390ddeb52ae2de5baa6c24d40.scope - libcontainer container 61f828b7a4b0ae9095264d84fd4edc191d24051390ddeb52ae2de5baa6c24d40. Nov 4 23:21:56.568592 containerd[1977]: time="2025-11-04T23:21:56.568514103Z" level=info msg="StartContainer for \"61f828b7a4b0ae9095264d84fd4edc191d24051390ddeb52ae2de5baa6c24d40\" returns successfully" Nov 4 23:21:56.612615 systemd[1]: cri-containerd-61f828b7a4b0ae9095264d84fd4edc191d24051390ddeb52ae2de5baa6c24d40.scope: Deactivated successfully. Nov 4 23:21:56.621521 containerd[1977]: time="2025-11-04T23:21:56.621451155Z" level=info msg="TaskExit event in podsandbox handler container_id:\"61f828b7a4b0ae9095264d84fd4edc191d24051390ddeb52ae2de5baa6c24d40\" id:\"61f828b7a4b0ae9095264d84fd4edc191d24051390ddeb52ae2de5baa6c24d40\" pid:4130 exited_at:{seconds:1762298516 nanos:620105787}" Nov 4 23:21:56.621836 containerd[1977]: time="2025-11-04T23:21:56.621735879Z" level=info msg="received exit event container_id:\"61f828b7a4b0ae9095264d84fd4edc191d24051390ddeb52ae2de5baa6c24d40\" id:\"61f828b7a4b0ae9095264d84fd4edc191d24051390ddeb52ae2de5baa6c24d40\" pid:4130 exited_at:{seconds:1762298516 nanos:620105787}" Nov 4 23:21:56.678149 systemd[1]: run-containerd-io.containerd.runtime.v2.task-k8s.io-61f828b7a4b0ae9095264d84fd4edc191d24051390ddeb52ae2de5baa6c24d40-rootfs.mount: Deactivated successfully. Nov 4 23:21:57.150431 containerd[1977]: time="2025-11-04T23:21:57.149266382Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/cni:v3.30.4\"" Nov 4 23:21:57.855020 kubelet[3293]: E1104 23:21:57.854877 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized" pod="calico-system/csi-node-driver-5fvm8" podUID="0d16ca69-85e0-4dac-8492-1209e5dd061d" Nov 4 23:21:59.855108 kubelet[3293]: E1104 23:21:59.855031 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized" pod="calico-system/csi-node-driver-5fvm8" podUID="0d16ca69-85e0-4dac-8492-1209e5dd061d" Nov 4 23:22:00.075973 containerd[1977]: time="2025-11-04T23:22:00.075919780Z" level=info msg="ImageCreate event name:\"ghcr.io/flatcar/calico/cni:v3.30.4\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:22:00.078247 containerd[1977]: time="2025-11-04T23:22:00.078152464Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/cni:v3.30.4: active requests=0, bytes read=65925816" Nov 4 23:22:00.079315 containerd[1977]: time="2025-11-04T23:22:00.079176088Z" level=info msg="ImageCreate event name:\"sha256:e60d442b6496497355efdf45eaa3ea72f5a2b28a5187aeab33442933f3c735d2\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:22:00.084227 containerd[1977]: time="2025-11-04T23:22:00.082821556Z" level=info msg="ImageCreate event name:\"ghcr.io/flatcar/calico/cni@sha256:273501a9cfbd848ade2b6a8452dfafdd3adb4f9bf9aec45c398a5d19b8026627\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:22:00.084421 containerd[1977]: time="2025-11-04T23:22:00.084380416Z" level=info msg="Pulled image \"ghcr.io/flatcar/calico/cni:v3.30.4\" with image id \"sha256:e60d442b6496497355efdf45eaa3ea72f5a2b28a5187aeab33442933f3c735d2\", repo tag \"ghcr.io/flatcar/calico/cni:v3.30.4\", repo digest \"ghcr.io/flatcar/calico/cni@sha256:273501a9cfbd848ade2b6a8452dfafdd3adb4f9bf9aec45c398a5d19b8026627\", size \"67295507\" in 2.934530054s" Nov 4 23:22:00.084544 containerd[1977]: time="2025-11-04T23:22:00.084517336Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/cni:v3.30.4\" returns image reference \"sha256:e60d442b6496497355efdf45eaa3ea72f5a2b28a5187aeab33442933f3c735d2\"" Nov 4 23:22:00.090573 containerd[1977]: time="2025-11-04T23:22:00.090516377Z" level=info msg="CreateContainer within sandbox \"78d6693cb12a42c82c2e7073b5c60b7af92e724683b600b959c6588113e64f7a\" for container &ContainerMetadata{Name:install-cni,Attempt:0,}" Nov 4 23:22:00.116172 containerd[1977]: time="2025-11-04T23:22:00.115458725Z" level=info msg="Container e5555ba45611e6f3d73c524ab52078e06e22c3f3f6b76aa4906b19ca9ac87ab5: CDI devices from CRI Config.CDIDevices: []" Nov 4 23:22:00.126472 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount3613829653.mount: Deactivated successfully. Nov 4 23:22:00.137968 containerd[1977]: time="2025-11-04T23:22:00.137877605Z" level=info msg="CreateContainer within sandbox \"78d6693cb12a42c82c2e7073b5c60b7af92e724683b600b959c6588113e64f7a\" for &ContainerMetadata{Name:install-cni,Attempt:0,} returns container id \"e5555ba45611e6f3d73c524ab52078e06e22c3f3f6b76aa4906b19ca9ac87ab5\"" Nov 4 23:22:00.139687 containerd[1977]: time="2025-11-04T23:22:00.139498445Z" level=info msg="StartContainer for \"e5555ba45611e6f3d73c524ab52078e06e22c3f3f6b76aa4906b19ca9ac87ab5\"" Nov 4 23:22:00.143456 containerd[1977]: time="2025-11-04T23:22:00.143328425Z" level=info msg="connecting to shim e5555ba45611e6f3d73c524ab52078e06e22c3f3f6b76aa4906b19ca9ac87ab5" address="unix:///run/containerd/s/37287f1461421ddb3449cf83eb2647f53e3a5758e03914bee4a2594775209b02" protocol=ttrpc version=3 Nov 4 23:22:00.203531 systemd[1]: Started cri-containerd-e5555ba45611e6f3d73c524ab52078e06e22c3f3f6b76aa4906b19ca9ac87ab5.scope - libcontainer container e5555ba45611e6f3d73c524ab52078e06e22c3f3f6b76aa4906b19ca9ac87ab5. Nov 4 23:22:00.292302 containerd[1977]: time="2025-11-04T23:22:00.292249002Z" level=info msg="StartContainer for \"e5555ba45611e6f3d73c524ab52078e06e22c3f3f6b76aa4906b19ca9ac87ab5\" returns successfully" Nov 4 23:22:01.364006 containerd[1977]: time="2025-11-04T23:22:01.363920251Z" level=error msg="failed to reload cni configuration after receiving fs change event(WRITE \"/etc/cni/net.d/calico-kubeconfig\")" error="cni config load failed: no network config found in /etc/cni/net.d: cni plugin not initialized: failed to load cni config" Nov 4 23:22:01.368750 systemd[1]: cri-containerd-e5555ba45611e6f3d73c524ab52078e06e22c3f3f6b76aa4906b19ca9ac87ab5.scope: Deactivated successfully. Nov 4 23:22:01.369791 systemd[1]: cri-containerd-e5555ba45611e6f3d73c524ab52078e06e22c3f3f6b76aa4906b19ca9ac87ab5.scope: Consumed 1.029s CPU time, 189.6M memory peak, 165.9M written to disk. Nov 4 23:22:01.375635 containerd[1977]: time="2025-11-04T23:22:01.375485383Z" level=info msg="received exit event container_id:\"e5555ba45611e6f3d73c524ab52078e06e22c3f3f6b76aa4906b19ca9ac87ab5\" id:\"e5555ba45611e6f3d73c524ab52078e06e22c3f3f6b76aa4906b19ca9ac87ab5\" pid:4188 exited_at:{seconds:1762298521 nanos:374975851}" Nov 4 23:22:01.376077 containerd[1977]: time="2025-11-04T23:22:01.375965875Z" level=info msg="TaskExit event in podsandbox handler container_id:\"e5555ba45611e6f3d73c524ab52078e06e22c3f3f6b76aa4906b19ca9ac87ab5\" id:\"e5555ba45611e6f3d73c524ab52078e06e22c3f3f6b76aa4906b19ca9ac87ab5\" pid:4188 exited_at:{seconds:1762298521 nanos:374975851}" Nov 4 23:22:01.416989 kubelet[3293]: I1104 23:22:01.415197 3293 kubelet_node_status.go:501] "Fast updating node status as it just became ready" Nov 4 23:22:01.427174 systemd[1]: run-containerd-io.containerd.runtime.v2.task-k8s.io-e5555ba45611e6f3d73c524ab52078e06e22c3f3f6b76aa4906b19ca9ac87ab5-rootfs.mount: Deactivated successfully. Nov 4 23:22:01.515829 systemd[1]: Created slice kubepods-burstable-pod79763791_1744_4b74_b191_e2b76075f709.slice - libcontainer container kubepods-burstable-pod79763791_1744_4b74_b191_e2b76075f709.slice. Nov 4 23:22:01.546809 kubelet[3293]: I1104 23:22:01.543682 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pv6fn\" (UniqueName: \"kubernetes.io/projected/79763791-1744-4b74-b191-e2b76075f709-kube-api-access-pv6fn\") pod \"coredns-668d6bf9bc-c6r4j\" (UID: \"79763791-1744-4b74-b191-e2b76075f709\") " pod="kube-system/coredns-668d6bf9bc-c6r4j" Nov 4 23:22:01.546809 kubelet[3293]: I1104 23:22:01.544126 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/79763791-1744-4b74-b191-e2b76075f709-config-volume\") pod \"coredns-668d6bf9bc-c6r4j\" (UID: \"79763791-1744-4b74-b191-e2b76075f709\") " pod="kube-system/coredns-668d6bf9bc-c6r4j" Nov 4 23:22:01.582621 systemd[1]: Created slice kubepods-besteffort-pod89628730_c640_4e4b_9cec_2cca5b47d9fc.slice - libcontainer container kubepods-besteffort-pod89628730_c640_4e4b_9cec_2cca5b47d9fc.slice. Nov 4 23:22:01.617618 systemd[1]: Created slice kubepods-besteffort-podab3399c0_cd7b_41d5_bf32_586b469457b8.slice - libcontainer container kubepods-besteffort-podab3399c0_cd7b_41d5_bf32_586b469457b8.slice. Nov 4 23:22:01.641876 systemd[1]: Created slice kubepods-burstable-pod8bf0c72f_09cc_4446_8c96_244d797ac69d.slice - libcontainer container kubepods-burstable-pod8bf0c72f_09cc_4446_8c96_244d797ac69d.slice. Nov 4 23:22:01.644729 kubelet[3293]: I1104 23:22:01.644625 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtkhl\" (UniqueName: \"kubernetes.io/projected/af7a1c92-78ca-4756-b8d2-4992b60e6f17-kube-api-access-jtkhl\") pod \"calico-apiserver-fcc487596-l2mz4\" (UID: \"af7a1c92-78ca-4756-b8d2-4992b60e6f17\") " pod="calico-apiserver/calico-apiserver-fcc487596-l2mz4" Nov 4 23:22:01.648854 kubelet[3293]: I1104 23:22:01.648377 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8bf0c72f-09cc-4446-8c96-244d797ac69d-config-volume\") pod \"coredns-668d6bf9bc-cgqkm\" (UID: \"8bf0c72f-09cc-4446-8c96-244d797ac69d\") " pod="kube-system/coredns-668d6bf9bc-cgqkm" Nov 4 23:22:01.649386 kubelet[3293]: I1104 23:22:01.649093 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbpdt\" (UniqueName: \"kubernetes.io/projected/89628730-c640-4e4b-9cec-2cca5b47d9fc-kube-api-access-lbpdt\") pod \"calico-kube-controllers-5c9f7c8689-qhpsj\" (UID: \"89628730-c640-4e4b-9cec-2cca5b47d9fc\") " pod="calico-system/calico-kube-controllers-5c9f7c8689-qhpsj" Nov 4 23:22:01.653580 kubelet[3293]: I1104 23:22:01.652684 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"goldmane-key-pair\" (UniqueName: \"kubernetes.io/secret/cdd3b3e0-4537-4eef-a9c5-bf20b3379786-goldmane-key-pair\") pod \"goldmane-666569f655-lxlsr\" (UID: \"cdd3b3e0-4537-4eef-a9c5-bf20b3379786\") " pod="calico-system/goldmane-666569f655-lxlsr" Nov 4 23:22:01.655442 kubelet[3293]: I1104 23:22:01.654336 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whisker-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/223980ad-b499-47fd-849e-fcd45a77d378-whisker-ca-bundle\") pod \"whisker-5b765c5dbb-mtvn6\" (UID: \"223980ad-b499-47fd-849e-fcd45a77d378\") " pod="calico-system/whisker-5b765c5dbb-mtvn6" Nov 4 23:22:01.656446 kubelet[3293]: I1104 23:22:01.656033 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tigera-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89628730-c640-4e4b-9cec-2cca5b47d9fc-tigera-ca-bundle\") pod \"calico-kube-controllers-5c9f7c8689-qhpsj\" (UID: \"89628730-c640-4e4b-9cec-2cca5b47d9fc\") " pod="calico-system/calico-kube-controllers-5c9f7c8689-qhpsj" Nov 4 23:22:01.656446 kubelet[3293]: I1104 23:22:01.656131 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"calico-apiserver-certs\" (UniqueName: \"kubernetes.io/secret/ab3399c0-cd7b-41d5-bf32-586b469457b8-calico-apiserver-certs\") pod \"calico-apiserver-996fc7fbb-2jd5x\" (UID: \"ab3399c0-cd7b-41d5-bf32-586b469457b8\") " pod="calico-apiserver/calico-apiserver-996fc7fbb-2jd5x" Nov 4 23:22:01.656446 kubelet[3293]: I1104 23:22:01.656180 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xg8bw\" (UniqueName: \"kubernetes.io/projected/8bf0c72f-09cc-4446-8c96-244d797ac69d-kube-api-access-xg8bw\") pod \"coredns-668d6bf9bc-cgqkm\" (UID: \"8bf0c72f-09cc-4446-8c96-244d797ac69d\") " pod="kube-system/coredns-668d6bf9bc-cgqkm" Nov 4 23:22:01.658880 kubelet[3293]: I1104 23:22:01.657414 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"goldmane-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdd3b3e0-4537-4eef-a9c5-bf20b3379786-goldmane-ca-bundle\") pod \"goldmane-666569f655-lxlsr\" (UID: \"cdd3b3e0-4537-4eef-a9c5-bf20b3379786\") " pod="calico-system/goldmane-666569f655-lxlsr" Nov 4 23:22:01.658880 kubelet[3293]: I1104 23:22:01.657486 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npqps\" (UniqueName: \"kubernetes.io/projected/223980ad-b499-47fd-849e-fcd45a77d378-kube-api-access-npqps\") pod \"whisker-5b765c5dbb-mtvn6\" (UID: \"223980ad-b499-47fd-849e-fcd45a77d378\") " pod="calico-system/whisker-5b765c5dbb-mtvn6" Nov 4 23:22:01.658880 kubelet[3293]: I1104 23:22:01.657533 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"calico-apiserver-certs\" (UniqueName: \"kubernetes.io/secret/068373b4-e189-432e-9f0e-0da4317cec26-calico-apiserver-certs\") pod \"calico-apiserver-fcc487596-jrhr4\" (UID: \"068373b4-e189-432e-9f0e-0da4317cec26\") " pod="calico-apiserver/calico-apiserver-fcc487596-jrhr4" Nov 4 23:22:01.658880 kubelet[3293]: I1104 23:22:01.657614 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpg72\" (UniqueName: \"kubernetes.io/projected/ab3399c0-cd7b-41d5-bf32-586b469457b8-kube-api-access-mpg72\") pod \"calico-apiserver-996fc7fbb-2jd5x\" (UID: \"ab3399c0-cd7b-41d5-bf32-586b469457b8\") " pod="calico-apiserver/calico-apiserver-996fc7fbb-2jd5x" Nov 4 23:22:01.658880 kubelet[3293]: I1104 23:22:01.657658 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"calico-apiserver-certs\" (UniqueName: \"kubernetes.io/secret/af7a1c92-78ca-4756-b8d2-4992b60e6f17-calico-apiserver-certs\") pod \"calico-apiserver-fcc487596-l2mz4\" (UID: \"af7a1c92-78ca-4756-b8d2-4992b60e6f17\") " pod="calico-apiserver/calico-apiserver-fcc487596-l2mz4" Nov 4 23:22:01.659425 kubelet[3293]: I1104 23:22:01.657734 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cdd3b3e0-4537-4eef-a9c5-bf20b3379786-config\") pod \"goldmane-666569f655-lxlsr\" (UID: \"cdd3b3e0-4537-4eef-a9c5-bf20b3379786\") " pod="calico-system/goldmane-666569f655-lxlsr" Nov 4 23:22:01.659425 kubelet[3293]: I1104 23:22:01.657775 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkw2k\" (UniqueName: \"kubernetes.io/projected/cdd3b3e0-4537-4eef-a9c5-bf20b3379786-kube-api-access-hkw2k\") pod \"goldmane-666569f655-lxlsr\" (UID: \"cdd3b3e0-4537-4eef-a9c5-bf20b3379786\") " pod="calico-system/goldmane-666569f655-lxlsr" Nov 4 23:22:01.659425 kubelet[3293]: I1104 23:22:01.657826 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whisker-backend-key-pair\" (UniqueName: \"kubernetes.io/secret/223980ad-b499-47fd-849e-fcd45a77d378-whisker-backend-key-pair\") pod \"whisker-5b765c5dbb-mtvn6\" (UID: \"223980ad-b499-47fd-849e-fcd45a77d378\") " pod="calico-system/whisker-5b765c5dbb-mtvn6" Nov 4 23:22:01.659425 kubelet[3293]: I1104 23:22:01.657872 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9769\" (UniqueName: \"kubernetes.io/projected/068373b4-e189-432e-9f0e-0da4317cec26-kube-api-access-z9769\") pod \"calico-apiserver-fcc487596-jrhr4\" (UID: \"068373b4-e189-432e-9f0e-0da4317cec26\") " pod="calico-apiserver/calico-apiserver-fcc487596-jrhr4" Nov 4 23:22:01.674395 systemd[1]: Created slice kubepods-besteffort-pod068373b4_e189_432e_9f0e_0da4317cec26.slice - libcontainer container kubepods-besteffort-pod068373b4_e189_432e_9f0e_0da4317cec26.slice. Nov 4 23:22:01.703608 systemd[1]: Created slice kubepods-besteffort-podaf7a1c92_78ca_4756_b8d2_4992b60e6f17.slice - libcontainer container kubepods-besteffort-podaf7a1c92_78ca_4756_b8d2_4992b60e6f17.slice. Nov 4 23:22:01.763239 systemd[1]: Created slice kubepods-besteffort-podcdd3b3e0_4537_4eef_a9c5_bf20b3379786.slice - libcontainer container kubepods-besteffort-podcdd3b3e0_4537_4eef_a9c5_bf20b3379786.slice. Nov 4 23:22:01.845341 containerd[1977]: time="2025-11-04T23:22:01.845257593Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-668d6bf9bc-c6r4j,Uid:79763791-1744-4b74-b191-e2b76075f709,Namespace:kube-system,Attempt:0,}" Nov 4 23:22:01.870834 systemd[1]: Created slice kubepods-besteffort-pod223980ad_b499_47fd_849e_fcd45a77d378.slice - libcontainer container kubepods-besteffort-pod223980ad_b499_47fd_849e_fcd45a77d378.slice. Nov 4 23:22:01.907611 systemd[1]: Created slice kubepods-besteffort-pod0d16ca69_85e0_4dac_8492_1209e5dd061d.slice - libcontainer container kubepods-besteffort-pod0d16ca69_85e0_4dac_8492_1209e5dd061d.slice. Nov 4 23:22:01.922901 containerd[1977]: time="2025-11-04T23:22:01.922832098Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-kube-controllers-5c9f7c8689-qhpsj,Uid:89628730-c640-4e4b-9cec-2cca5b47d9fc,Namespace:calico-system,Attempt:0,}" Nov 4 23:22:01.960916 containerd[1977]: time="2025-11-04T23:22:01.959880658Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:csi-node-driver-5fvm8,Uid:0d16ca69-85e0-4dac-8492-1209e5dd061d,Namespace:calico-system,Attempt:0,}" Nov 4 23:22:01.964839 containerd[1977]: time="2025-11-04T23:22:01.964719490Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-668d6bf9bc-cgqkm,Uid:8bf0c72f-09cc-4446-8c96-244d797ac69d,Namespace:kube-system,Attempt:0,}" Nov 4 23:22:01.991527 containerd[1977]: time="2025-11-04T23:22:01.990926230Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-fcc487596-jrhr4,Uid:068373b4-e189-432e-9f0e-0da4317cec26,Namespace:calico-apiserver,Attempt:0,}" Nov 4 23:22:02.028966 containerd[1977]: time="2025-11-04T23:22:02.027664914Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-fcc487596-l2mz4,Uid:af7a1c92-78ca-4756-b8d2-4992b60e6f17,Namespace:calico-apiserver,Attempt:0,}" Nov 4 23:22:02.155849 containerd[1977]: time="2025-11-04T23:22:02.155455411Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:goldmane-666569f655-lxlsr,Uid:cdd3b3e0-4537-4eef-a9c5-bf20b3379786,Namespace:calico-system,Attempt:0,}" Nov 4 23:22:02.189615 containerd[1977]: time="2025-11-04T23:22:02.189100735Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:whisker-5b765c5dbb-mtvn6,Uid:223980ad-b499-47fd-849e-fcd45a77d378,Namespace:calico-system,Attempt:0,}" Nov 4 23:22:02.249993 containerd[1977]: time="2025-11-04T23:22:02.249546271Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-996fc7fbb-2jd5x,Uid:ab3399c0-cd7b-41d5-bf32-586b469457b8,Namespace:calico-apiserver,Attempt:0,}" Nov 4 23:22:02.252188 containerd[1977]: time="2025-11-04T23:22:02.252112447Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/node:v3.30.4\"" Nov 4 23:22:02.555592 containerd[1977]: time="2025-11-04T23:22:02.555396021Z" level=error msg="Failed to destroy network for sandbox \"a1f9b6f3ea346219acac001fdd60cfcc82c989c328a5499ccd9937cfdc4b09df\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 4 23:22:02.562024 systemd[1]: run-netns-cni\x2d41396165\x2d8b39\x2d90b3\x2dfd49\x2d0fb58d4b165e.mount: Deactivated successfully. Nov 4 23:22:02.567976 containerd[1977]: time="2025-11-04T23:22:02.567897009Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-fcc487596-jrhr4,Uid:068373b4-e189-432e-9f0e-0da4317cec26,Namespace:calico-apiserver,Attempt:0,} failed, error" error="rpc error: code = Unknown desc = failed to setup network for sandbox \"a1f9b6f3ea346219acac001fdd60cfcc82c989c328a5499ccd9937cfdc4b09df\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 4 23:22:02.571055 kubelet[3293]: E1104 23:22:02.570606 3293 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a1f9b6f3ea346219acac001fdd60cfcc82c989c328a5499ccd9937cfdc4b09df\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 4 23:22:02.571055 kubelet[3293]: E1104 23:22:02.570791 3293 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a1f9b6f3ea346219acac001fdd60cfcc82c989c328a5499ccd9937cfdc4b09df\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-fcc487596-jrhr4" Nov 4 23:22:02.571055 kubelet[3293]: E1104 23:22:02.570837 3293 kuberuntime_manager.go:1237] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a1f9b6f3ea346219acac001fdd60cfcc82c989c328a5499ccd9937cfdc4b09df\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-fcc487596-jrhr4" Nov 4 23:22:02.573756 kubelet[3293]: E1104 23:22:02.570983 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"calico-apiserver-fcc487596-jrhr4_calico-apiserver(068373b4-e189-432e-9f0e-0da4317cec26)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"calico-apiserver-fcc487596-jrhr4_calico-apiserver(068373b4-e189-432e-9f0e-0da4317cec26)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"a1f9b6f3ea346219acac001fdd60cfcc82c989c328a5499ccd9937cfdc4b09df\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-apiserver/calico-apiserver-fcc487596-jrhr4" podUID="068373b4-e189-432e-9f0e-0da4317cec26" Nov 4 23:22:02.664594 containerd[1977]: time="2025-11-04T23:22:02.663431973Z" level=error msg="Failed to destroy network for sandbox \"f1f19c8033c92786562626f9962065b7ffa5f465ca289a76854c2bd1c8276c8e\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 4 23:22:02.672452 systemd[1]: run-netns-cni\x2de68397be\x2d513c\x2d3a35\x2d0a58\x2d5a7805ecf0c2.mount: Deactivated successfully. Nov 4 23:22:02.676930 containerd[1977]: time="2025-11-04T23:22:02.674172645Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-668d6bf9bc-cgqkm,Uid:8bf0c72f-09cc-4446-8c96-244d797ac69d,Namespace:kube-system,Attempt:0,} failed, error" error="rpc error: code = Unknown desc = failed to setup network for sandbox \"f1f19c8033c92786562626f9962065b7ffa5f465ca289a76854c2bd1c8276c8e\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 4 23:22:02.678719 kubelet[3293]: E1104 23:22:02.678637 3293 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"f1f19c8033c92786562626f9962065b7ffa5f465ca289a76854c2bd1c8276c8e\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 4 23:22:02.678886 kubelet[3293]: E1104 23:22:02.678733 3293 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"f1f19c8033c92786562626f9962065b7ffa5f465ca289a76854c2bd1c8276c8e\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-668d6bf9bc-cgqkm" Nov 4 23:22:02.678886 kubelet[3293]: E1104 23:22:02.678769 3293 kuberuntime_manager.go:1237] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"f1f19c8033c92786562626f9962065b7ffa5f465ca289a76854c2bd1c8276c8e\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-668d6bf9bc-cgqkm" Nov 4 23:22:02.678886 kubelet[3293]: E1104 23:22:02.678837 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-668d6bf9bc-cgqkm_kube-system(8bf0c72f-09cc-4446-8c96-244d797ac69d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-668d6bf9bc-cgqkm_kube-system(8bf0c72f-09cc-4446-8c96-244d797ac69d)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"f1f19c8033c92786562626f9962065b7ffa5f465ca289a76854c2bd1c8276c8e\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="kube-system/coredns-668d6bf9bc-cgqkm" podUID="8bf0c72f-09cc-4446-8c96-244d797ac69d" Nov 4 23:22:02.693729 containerd[1977]: time="2025-11-04T23:22:02.693586941Z" level=error msg="Failed to destroy network for sandbox \"f0e0fd22958cf7e033cb975fb1bdd8b79707036e4b7c4286872f4863116b6fcb\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 4 23:22:02.700735 containerd[1977]: time="2025-11-04T23:22:02.700484721Z" level=error msg="Failed to destroy network for sandbox \"53d3717316dd00eba6be0a55bf2a7c46bd835b0dae1b7129b9ad49592a33f619\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 4 23:22:02.701065 systemd[1]: run-netns-cni\x2da5ac9eda\x2de64c\x2d9476\x2d90e3\x2d5048c7690000.mount: Deactivated successfully. Nov 4 23:22:02.710153 systemd[1]: run-netns-cni\x2debb15bc3\x2d48f4\x2d32ad\x2d90fc\x2dd633ec0cf0ba.mount: Deactivated successfully. Nov 4 23:22:02.711323 containerd[1977]: time="2025-11-04T23:22:02.711250894Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:goldmane-666569f655-lxlsr,Uid:cdd3b3e0-4537-4eef-a9c5-bf20b3379786,Namespace:calico-system,Attempt:0,} failed, error" error="rpc error: code = Unknown desc = failed to setup network for sandbox \"f0e0fd22958cf7e033cb975fb1bdd8b79707036e4b7c4286872f4863116b6fcb\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 4 23:22:02.713845 kubelet[3293]: E1104 23:22:02.713751 3293 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"f0e0fd22958cf7e033cb975fb1bdd8b79707036e4b7c4286872f4863116b6fcb\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 4 23:22:02.713845 kubelet[3293]: E1104 23:22:02.713852 3293 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"f0e0fd22958cf7e033cb975fb1bdd8b79707036e4b7c4286872f4863116b6fcb\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/goldmane-666569f655-lxlsr" Nov 4 23:22:02.714106 kubelet[3293]: E1104 23:22:02.713890 3293 kuberuntime_manager.go:1237] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"f0e0fd22958cf7e033cb975fb1bdd8b79707036e4b7c4286872f4863116b6fcb\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/goldmane-666569f655-lxlsr" Nov 4 23:22:02.714106 kubelet[3293]: E1104 23:22:02.713966 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"goldmane-666569f655-lxlsr_calico-system(cdd3b3e0-4537-4eef-a9c5-bf20b3379786)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"goldmane-666569f655-lxlsr_calico-system(cdd3b3e0-4537-4eef-a9c5-bf20b3379786)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"f0e0fd22958cf7e033cb975fb1bdd8b79707036e4b7c4286872f4863116b6fcb\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-system/goldmane-666569f655-lxlsr" podUID="cdd3b3e0-4537-4eef-a9c5-bf20b3379786" Nov 4 23:22:02.718737 containerd[1977]: time="2025-11-04T23:22:02.717319090Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:csi-node-driver-5fvm8,Uid:0d16ca69-85e0-4dac-8492-1209e5dd061d,Namespace:calico-system,Attempt:0,} failed, error" error="rpc error: code = Unknown desc = failed to setup network for sandbox \"53d3717316dd00eba6be0a55bf2a7c46bd835b0dae1b7129b9ad49592a33f619\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 4 23:22:02.719285 kubelet[3293]: E1104 23:22:02.718256 3293 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"53d3717316dd00eba6be0a55bf2a7c46bd835b0dae1b7129b9ad49592a33f619\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 4 23:22:02.719285 kubelet[3293]: E1104 23:22:02.718379 3293 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"53d3717316dd00eba6be0a55bf2a7c46bd835b0dae1b7129b9ad49592a33f619\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/csi-node-driver-5fvm8" Nov 4 23:22:02.719285 kubelet[3293]: E1104 23:22:02.718563 3293 kuberuntime_manager.go:1237] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"53d3717316dd00eba6be0a55bf2a7c46bd835b0dae1b7129b9ad49592a33f619\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/csi-node-driver-5fvm8" Nov 4 23:22:02.720329 kubelet[3293]: E1104 23:22:02.718765 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"csi-node-driver-5fvm8_calico-system(0d16ca69-85e0-4dac-8492-1209e5dd061d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"csi-node-driver-5fvm8_calico-system(0d16ca69-85e0-4dac-8492-1209e5dd061d)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"53d3717316dd00eba6be0a55bf2a7c46bd835b0dae1b7129b9ad49592a33f619\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-system/csi-node-driver-5fvm8" podUID="0d16ca69-85e0-4dac-8492-1209e5dd061d" Nov 4 23:22:02.733828 containerd[1977]: time="2025-11-04T23:22:02.733696426Z" level=error msg="Failed to destroy network for sandbox \"171e2de5e4e2990f47c066f66332ea25f04b68739747cf482763b9d90c5ef733\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 4 23:22:02.735778 containerd[1977]: time="2025-11-04T23:22:02.735644662Z" level=error msg="Failed to destroy network for sandbox \"d257a04052723e6127f3459e3d482348b1d50952ed8df6ec00e17595b80ed6a1\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 4 23:22:02.735939 containerd[1977]: time="2025-11-04T23:22:02.735859654Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-668d6bf9bc-c6r4j,Uid:79763791-1744-4b74-b191-e2b76075f709,Namespace:kube-system,Attempt:0,} failed, error" error="rpc error: code = Unknown desc = failed to setup network for sandbox \"171e2de5e4e2990f47c066f66332ea25f04b68739747cf482763b9d90c5ef733\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 4 23:22:02.736421 kubelet[3293]: E1104 23:22:02.736283 3293 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"171e2de5e4e2990f47c066f66332ea25f04b68739747cf482763b9d90c5ef733\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 4 23:22:02.736421 kubelet[3293]: E1104 23:22:02.736376 3293 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"171e2de5e4e2990f47c066f66332ea25f04b68739747cf482763b9d90c5ef733\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-668d6bf9bc-c6r4j" Nov 4 23:22:02.736421 kubelet[3293]: E1104 23:22:02.736412 3293 kuberuntime_manager.go:1237] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"171e2de5e4e2990f47c066f66332ea25f04b68739747cf482763b9d90c5ef733\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-668d6bf9bc-c6r4j" Nov 4 23:22:02.738598 kubelet[3293]: E1104 23:22:02.736501 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-668d6bf9bc-c6r4j_kube-system(79763791-1744-4b74-b191-e2b76075f709)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-668d6bf9bc-c6r4j_kube-system(79763791-1744-4b74-b191-e2b76075f709)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"171e2de5e4e2990f47c066f66332ea25f04b68739747cf482763b9d90c5ef733\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="kube-system/coredns-668d6bf9bc-c6r4j" podUID="79763791-1744-4b74-b191-e2b76075f709" Nov 4 23:22:02.740289 containerd[1977]: time="2025-11-04T23:22:02.739700050Z" level=error msg="Failed to destroy network for sandbox \"886152ed8ef7f1b164b633c3d15e92255a11a217ae77bb625c83aafd440bf23e\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 4 23:22:02.741783 containerd[1977]: time="2025-11-04T23:22:02.741608086Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-kube-controllers-5c9f7c8689-qhpsj,Uid:89628730-c640-4e4b-9cec-2cca5b47d9fc,Namespace:calico-system,Attempt:0,} failed, error" error="rpc error: code = Unknown desc = failed to setup network for sandbox \"d257a04052723e6127f3459e3d482348b1d50952ed8df6ec00e17595b80ed6a1\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 4 23:22:02.742951 kubelet[3293]: E1104 23:22:02.742865 3293 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"d257a04052723e6127f3459e3d482348b1d50952ed8df6ec00e17595b80ed6a1\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 4 23:22:02.743147 kubelet[3293]: E1104 23:22:02.742953 3293 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"d257a04052723e6127f3459e3d482348b1d50952ed8df6ec00e17595b80ed6a1\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/calico-kube-controllers-5c9f7c8689-qhpsj" Nov 4 23:22:02.743147 kubelet[3293]: E1104 23:22:02.742988 3293 kuberuntime_manager.go:1237] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"d257a04052723e6127f3459e3d482348b1d50952ed8df6ec00e17595b80ed6a1\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/calico-kube-controllers-5c9f7c8689-qhpsj" Nov 4 23:22:02.744114 kubelet[3293]: E1104 23:22:02.744024 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"calico-kube-controllers-5c9f7c8689-qhpsj_calico-system(89628730-c640-4e4b-9cec-2cca5b47d9fc)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"calico-kube-controllers-5c9f7c8689-qhpsj_calico-system(89628730-c640-4e4b-9cec-2cca5b47d9fc)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"d257a04052723e6127f3459e3d482348b1d50952ed8df6ec00e17595b80ed6a1\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-system/calico-kube-controllers-5c9f7c8689-qhpsj" podUID="89628730-c640-4e4b-9cec-2cca5b47d9fc" Nov 4 23:22:02.744803 containerd[1977]: time="2025-11-04T23:22:02.744614170Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-fcc487596-l2mz4,Uid:af7a1c92-78ca-4756-b8d2-4992b60e6f17,Namespace:calico-apiserver,Attempt:0,} failed, error" error="rpc error: code = Unknown desc = failed to setup network for sandbox \"886152ed8ef7f1b164b633c3d15e92255a11a217ae77bb625c83aafd440bf23e\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 4 23:22:02.746862 kubelet[3293]: E1104 23:22:02.745746 3293 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"886152ed8ef7f1b164b633c3d15e92255a11a217ae77bb625c83aafd440bf23e\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 4 23:22:02.746862 kubelet[3293]: E1104 23:22:02.745845 3293 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"886152ed8ef7f1b164b633c3d15e92255a11a217ae77bb625c83aafd440bf23e\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-fcc487596-l2mz4" Nov 4 23:22:02.746862 kubelet[3293]: E1104 23:22:02.745909 3293 kuberuntime_manager.go:1237] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"886152ed8ef7f1b164b633c3d15e92255a11a217ae77bb625c83aafd440bf23e\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-fcc487596-l2mz4" Nov 4 23:22:02.747189 kubelet[3293]: E1104 23:22:02.746009 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"calico-apiserver-fcc487596-l2mz4_calico-apiserver(af7a1c92-78ca-4756-b8d2-4992b60e6f17)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"calico-apiserver-fcc487596-l2mz4_calico-apiserver(af7a1c92-78ca-4756-b8d2-4992b60e6f17)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"886152ed8ef7f1b164b633c3d15e92255a11a217ae77bb625c83aafd440bf23e\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-apiserver/calico-apiserver-fcc487596-l2mz4" podUID="af7a1c92-78ca-4756-b8d2-4992b60e6f17" Nov 4 23:22:02.767666 containerd[1977]: time="2025-11-04T23:22:02.767430454Z" level=error msg="Failed to destroy network for sandbox \"b2f4fb5ce396051e7454b5ddcf88bb4775bc56b16c1df17b73a283938bb175e8\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 4 23:22:02.770249 containerd[1977]: time="2025-11-04T23:22:02.769398682Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:whisker-5b765c5dbb-mtvn6,Uid:223980ad-b499-47fd-849e-fcd45a77d378,Namespace:calico-system,Attempt:0,} failed, error" error="rpc error: code = Unknown desc = failed to setup network for sandbox \"b2f4fb5ce396051e7454b5ddcf88bb4775bc56b16c1df17b73a283938bb175e8\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 4 23:22:02.770595 kubelet[3293]: E1104 23:22:02.770528 3293 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b2f4fb5ce396051e7454b5ddcf88bb4775bc56b16c1df17b73a283938bb175e8\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 4 23:22:02.770808 kubelet[3293]: E1104 23:22:02.770617 3293 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b2f4fb5ce396051e7454b5ddcf88bb4775bc56b16c1df17b73a283938bb175e8\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/whisker-5b765c5dbb-mtvn6" Nov 4 23:22:02.770808 kubelet[3293]: E1104 23:22:02.770655 3293 kuberuntime_manager.go:1237] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b2f4fb5ce396051e7454b5ddcf88bb4775bc56b16c1df17b73a283938bb175e8\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/whisker-5b765c5dbb-mtvn6" Nov 4 23:22:02.770808 kubelet[3293]: E1104 23:22:02.770717 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"whisker-5b765c5dbb-mtvn6_calico-system(223980ad-b499-47fd-849e-fcd45a77d378)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"whisker-5b765c5dbb-mtvn6_calico-system(223980ad-b499-47fd-849e-fcd45a77d378)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"b2f4fb5ce396051e7454b5ddcf88bb4775bc56b16c1df17b73a283938bb175e8\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-system/whisker-5b765c5dbb-mtvn6" podUID="223980ad-b499-47fd-849e-fcd45a77d378" Nov 4 23:22:02.793279 containerd[1977]: time="2025-11-04T23:22:02.793170730Z" level=error msg="Failed to destroy network for sandbox \"20bfe35c1cc93b2a924a10b579e80328fb4d31362d1ee453c05942435ecb216f\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 4 23:22:02.794534 containerd[1977]: time="2025-11-04T23:22:02.794459314Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-996fc7fbb-2jd5x,Uid:ab3399c0-cd7b-41d5-bf32-586b469457b8,Namespace:calico-apiserver,Attempt:0,} failed, error" error="rpc error: code = Unknown desc = failed to setup network for sandbox \"20bfe35c1cc93b2a924a10b579e80328fb4d31362d1ee453c05942435ecb216f\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 4 23:22:02.794861 kubelet[3293]: E1104 23:22:02.794789 3293 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"20bfe35c1cc93b2a924a10b579e80328fb4d31362d1ee453c05942435ecb216f\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 4 23:22:02.795053 kubelet[3293]: E1104 23:22:02.794885 3293 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"20bfe35c1cc93b2a924a10b579e80328fb4d31362d1ee453c05942435ecb216f\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-996fc7fbb-2jd5x" Nov 4 23:22:02.795053 kubelet[3293]: E1104 23:22:02.794923 3293 kuberuntime_manager.go:1237] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"20bfe35c1cc93b2a924a10b579e80328fb4d31362d1ee453c05942435ecb216f\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-996fc7fbb-2jd5x" Nov 4 23:22:02.795053 kubelet[3293]: E1104 23:22:02.794986 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"calico-apiserver-996fc7fbb-2jd5x_calico-apiserver(ab3399c0-cd7b-41d5-bf32-586b469457b8)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"calico-apiserver-996fc7fbb-2jd5x_calico-apiserver(ab3399c0-cd7b-41d5-bf32-586b469457b8)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"20bfe35c1cc93b2a924a10b579e80328fb4d31362d1ee453c05942435ecb216f\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-apiserver/calico-apiserver-996fc7fbb-2jd5x" podUID="ab3399c0-cd7b-41d5-bf32-586b469457b8" Nov 4 23:22:03.429005 systemd[1]: run-netns-cni\x2d7269e351\x2d219a\x2db575\x2d45e9\x2d538c7dd3ee58.mount: Deactivated successfully. Nov 4 23:22:03.429402 systemd[1]: run-netns-cni\x2d388cf906\x2dfd48\x2dcaea\x2dd3a6\x2d1df07e060d0f.mount: Deactivated successfully. Nov 4 23:22:03.429550 systemd[1]: run-netns-cni\x2df4017df1\x2d2c1d\x2dea3c\x2d1e3c\x2d45dd543debe2.mount: Deactivated successfully. Nov 4 23:22:03.429685 systemd[1]: run-netns-cni\x2d08afbb00\x2d2155\x2dc80b\x2dc84d\x2d4ee2318266eb.mount: Deactivated successfully. Nov 4 23:22:03.429813 systemd[1]: run-netns-cni\x2d7dc8ffd5\x2dccea\x2dd486\x2d7f2d\x2de32ec5481e47.mount: Deactivated successfully. Nov 4 23:22:09.252458 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount1430723491.mount: Deactivated successfully. Nov 4 23:22:09.358252 containerd[1977]: time="2025-11-04T23:22:09.356947119Z" level=info msg="ImageCreate event name:\"ghcr.io/flatcar/calico/node:v3.30.4\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:22:09.358252 containerd[1977]: time="2025-11-04T23:22:09.358158519Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/node:v3.30.4: active requests=0, bytes read=150934562" Nov 4 23:22:09.359070 containerd[1977]: time="2025-11-04T23:22:09.359009739Z" level=info msg="ImageCreate event name:\"sha256:43a5290057a103af76996c108856f92ed902f34573d7a864f55f15b8aaf4683b\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:22:09.362621 containerd[1977]: time="2025-11-04T23:22:09.362541075Z" level=info msg="ImageCreate event name:\"ghcr.io/flatcar/calico/node@sha256:e92cca333202c87d07bf57f38182fd68f0779f912ef55305eda1fccc9f33667c\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:22:09.364095 containerd[1977]: time="2025-11-04T23:22:09.364004043Z" level=info msg="Pulled image \"ghcr.io/flatcar/calico/node:v3.30.4\" with image id \"sha256:43a5290057a103af76996c108856f92ed902f34573d7a864f55f15b8aaf4683b\", repo tag \"ghcr.io/flatcar/calico/node:v3.30.4\", repo digest \"ghcr.io/flatcar/calico/node@sha256:e92cca333202c87d07bf57f38182fd68f0779f912ef55305eda1fccc9f33667c\", size \"150934424\" in 7.11181476s" Nov 4 23:22:09.364412 containerd[1977]: time="2025-11-04T23:22:09.364365519Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/node:v3.30.4\" returns image reference \"sha256:43a5290057a103af76996c108856f92ed902f34573d7a864f55f15b8aaf4683b\"" Nov 4 23:22:09.395170 containerd[1977]: time="2025-11-04T23:22:09.395059599Z" level=info msg="CreateContainer within sandbox \"78d6693cb12a42c82c2e7073b5c60b7af92e724683b600b959c6588113e64f7a\" for container &ContainerMetadata{Name:calico-node,Attempt:0,}" Nov 4 23:22:09.415257 containerd[1977]: time="2025-11-04T23:22:09.414950835Z" level=info msg="Container 6fbaacd9f420f26c2371bcff475a8067c2659e0a2c0d2d16b2a01703f87776c8: CDI devices from CRI Config.CDIDevices: []" Nov 4 23:22:09.427699 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount324596209.mount: Deactivated successfully. Nov 4 23:22:09.442541 containerd[1977]: time="2025-11-04T23:22:09.442436787Z" level=info msg="CreateContainer within sandbox \"78d6693cb12a42c82c2e7073b5c60b7af92e724683b600b959c6588113e64f7a\" for &ContainerMetadata{Name:calico-node,Attempt:0,} returns container id \"6fbaacd9f420f26c2371bcff475a8067c2659e0a2c0d2d16b2a01703f87776c8\"" Nov 4 23:22:09.444136 containerd[1977]: time="2025-11-04T23:22:09.444062115Z" level=info msg="StartContainer for \"6fbaacd9f420f26c2371bcff475a8067c2659e0a2c0d2d16b2a01703f87776c8\"" Nov 4 23:22:09.454175 containerd[1977]: time="2025-11-04T23:22:09.454107963Z" level=info msg="connecting to shim 6fbaacd9f420f26c2371bcff475a8067c2659e0a2c0d2d16b2a01703f87776c8" address="unix:///run/containerd/s/37287f1461421ddb3449cf83eb2647f53e3a5758e03914bee4a2594775209b02" protocol=ttrpc version=3 Nov 4 23:22:09.502068 systemd[1]: Started cri-containerd-6fbaacd9f420f26c2371bcff475a8067c2659e0a2c0d2d16b2a01703f87776c8.scope - libcontainer container 6fbaacd9f420f26c2371bcff475a8067c2659e0a2c0d2d16b2a01703f87776c8. Nov 4 23:22:09.611977 containerd[1977]: time="2025-11-04T23:22:09.611684452Z" level=info msg="StartContainer for \"6fbaacd9f420f26c2371bcff475a8067c2659e0a2c0d2d16b2a01703f87776c8\" returns successfully" Nov 4 23:22:09.977060 kernel: wireguard: WireGuard 1.0.0 loaded. See www.wireguard.com for information. Nov 4 23:22:09.977432 kernel: wireguard: Copyright (C) 2015-2019 Jason A. Donenfeld . All Rights Reserved. Nov 4 23:22:10.331406 kubelet[3293]: I1104 23:22:10.331228 3293 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="calico-system/calico-node-k482k" podStartSLOduration=1.972554329 podStartE2EDuration="18.331040511s" podCreationTimestamp="2025-11-04 23:21:52 +0000 UTC" firstStartedPulling="2025-11-04 23:21:53.007160217 +0000 UTC m=+37.609823719" lastFinishedPulling="2025-11-04 23:22:09.365646387 +0000 UTC m=+53.968309901" observedRunningTime="2025-11-04 23:22:10.329229663 +0000 UTC m=+54.931893345" watchObservedRunningTime="2025-11-04 23:22:10.331040511 +0000 UTC m=+54.933704013" Nov 4 23:22:10.353788 kubelet[3293]: I1104 23:22:10.353609 3293 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"whisker-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/223980ad-b499-47fd-849e-fcd45a77d378-whisker-ca-bundle\") pod \"223980ad-b499-47fd-849e-fcd45a77d378\" (UID: \"223980ad-b499-47fd-849e-fcd45a77d378\") " Nov 4 23:22:10.355630 kubelet[3293]: I1104 23:22:10.355429 3293 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"whisker-backend-key-pair\" (UniqueName: \"kubernetes.io/secret/223980ad-b499-47fd-849e-fcd45a77d378-whisker-backend-key-pair\") pod \"223980ad-b499-47fd-849e-fcd45a77d378\" (UID: \"223980ad-b499-47fd-849e-fcd45a77d378\") " Nov 4 23:22:10.356150 kubelet[3293]: I1104 23:22:10.355540 3293 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-npqps\" (UniqueName: \"kubernetes.io/projected/223980ad-b499-47fd-849e-fcd45a77d378-kube-api-access-npqps\") pod \"223980ad-b499-47fd-849e-fcd45a77d378\" (UID: \"223980ad-b499-47fd-849e-fcd45a77d378\") " Nov 4 23:22:10.358699 kubelet[3293]: I1104 23:22:10.358058 3293 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/223980ad-b499-47fd-849e-fcd45a77d378-whisker-ca-bundle" (OuterVolumeSpecName: "whisker-ca-bundle") pod "223980ad-b499-47fd-849e-fcd45a77d378" (UID: "223980ad-b499-47fd-849e-fcd45a77d378"). InnerVolumeSpecName "whisker-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 4 23:22:10.374450 systemd[1]: var-lib-kubelet-pods-223980ad\x2db499\x2d47fd\x2d849e\x2dfcd45a77d378-volumes-kubernetes.io\x7esecret-whisker\x2dbackend\x2dkey\x2dpair.mount: Deactivated successfully. Nov 4 23:22:10.378695 kubelet[3293]: I1104 23:22:10.378571 3293 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/223980ad-b499-47fd-849e-fcd45a77d378-whisker-backend-key-pair" (OuterVolumeSpecName: "whisker-backend-key-pair") pod "223980ad-b499-47fd-849e-fcd45a77d378" (UID: "223980ad-b499-47fd-849e-fcd45a77d378"). InnerVolumeSpecName "whisker-backend-key-pair". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 4 23:22:10.386421 kubelet[3293]: I1104 23:22:10.386335 3293 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/223980ad-b499-47fd-849e-fcd45a77d378-kube-api-access-npqps" (OuterVolumeSpecName: "kube-api-access-npqps") pod "223980ad-b499-47fd-849e-fcd45a77d378" (UID: "223980ad-b499-47fd-849e-fcd45a77d378"). InnerVolumeSpecName "kube-api-access-npqps". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 4 23:22:10.387441 systemd[1]: var-lib-kubelet-pods-223980ad\x2db499\x2d47fd\x2d849e\x2dfcd45a77d378-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dnpqps.mount: Deactivated successfully. Nov 4 23:22:10.460546 kubelet[3293]: I1104 23:22:10.460295 3293 reconciler_common.go:299] "Volume detached for volume \"whisker-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/223980ad-b499-47fd-849e-fcd45a77d378-whisker-ca-bundle\") on node \"ip-172-31-21-124\" DevicePath \"\"" Nov 4 23:22:10.460546 kubelet[3293]: I1104 23:22:10.460378 3293 reconciler_common.go:299] "Volume detached for volume \"whisker-backend-key-pair\" (UniqueName: \"kubernetes.io/secret/223980ad-b499-47fd-849e-fcd45a77d378-whisker-backend-key-pair\") on node \"ip-172-31-21-124\" DevicePath \"\"" Nov 4 23:22:10.460546 kubelet[3293]: I1104 23:22:10.460500 3293 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-npqps\" (UniqueName: \"kubernetes.io/projected/223980ad-b499-47fd-849e-fcd45a77d378-kube-api-access-npqps\") on node \"ip-172-31-21-124\" DevicePath \"\"" Nov 4 23:22:10.605783 systemd[1]: Removed slice kubepods-besteffort-pod223980ad_b499_47fd_849e_fcd45a77d378.slice - libcontainer container kubepods-besteffort-pod223980ad_b499_47fd_849e_fcd45a77d378.slice. Nov 4 23:22:10.730856 systemd[1]: Created slice kubepods-besteffort-pod404b99f5_b096_49e7_baa1_6b3afbc90705.slice - libcontainer container kubepods-besteffort-pod404b99f5_b096_49e7_baa1_6b3afbc90705.slice. Nov 4 23:22:10.864370 kubelet[3293]: I1104 23:22:10.863797 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whisker-backend-key-pair\" (UniqueName: \"kubernetes.io/secret/404b99f5-b096-49e7-baa1-6b3afbc90705-whisker-backend-key-pair\") pod \"whisker-778cbdb456-4xzz7\" (UID: \"404b99f5-b096-49e7-baa1-6b3afbc90705\") " pod="calico-system/whisker-778cbdb456-4xzz7" Nov 4 23:22:10.864370 kubelet[3293]: I1104 23:22:10.863880 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjghm\" (UniqueName: \"kubernetes.io/projected/404b99f5-b096-49e7-baa1-6b3afbc90705-kube-api-access-fjghm\") pod \"whisker-778cbdb456-4xzz7\" (UID: \"404b99f5-b096-49e7-baa1-6b3afbc90705\") " pod="calico-system/whisker-778cbdb456-4xzz7" Nov 4 23:22:10.864370 kubelet[3293]: I1104 23:22:10.863925 3293 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whisker-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/404b99f5-b096-49e7-baa1-6b3afbc90705-whisker-ca-bundle\") pod \"whisker-778cbdb456-4xzz7\" (UID: \"404b99f5-b096-49e7-baa1-6b3afbc90705\") " pod="calico-system/whisker-778cbdb456-4xzz7" Nov 4 23:22:11.043678 containerd[1977]: time="2025-11-04T23:22:11.043548459Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:whisker-778cbdb456-4xzz7,Uid:404b99f5-b096-49e7-baa1-6b3afbc90705,Namespace:calico-system,Attempt:0,}" Nov 4 23:22:11.461075 containerd[1977]: time="2025-11-04T23:22:11.460998245Z" level=info msg="TaskExit event in podsandbox handler container_id:\"6fbaacd9f420f26c2371bcff475a8067c2659e0a2c0d2d16b2a01703f87776c8\" id:\"0066d714253ae821d2631b88bfcbb77f41c8221661aec0303d0b42ab0be52667\" pid:4565 exit_status:1 exited_at:{seconds:1762298531 nanos:460326641}" Nov 4 23:22:11.861378 kubelet[3293]: I1104 23:22:11.861176 3293 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="223980ad-b499-47fd-849e-fcd45a77d378" path="/var/lib/kubelet/pods/223980ad-b499-47fd-849e-fcd45a77d378/volumes" Nov 4 23:22:12.395606 (udev-worker)[4517]: Network interface NamePolicy= disabled on kernel command line. Nov 4 23:22:12.400407 systemd-networkd[1573]: cali5b3ce9ec845: Link UP Nov 4 23:22:12.400914 systemd-networkd[1573]: cali5b3ce9ec845: Gained carrier Nov 4 23:22:12.539248 containerd[1977]: 2025-11-04 23:22:11.164 [INFO][4545] cni-plugin/utils.go 100: File /var/lib/calico/mtu does not exist Nov 4 23:22:12.539248 containerd[1977]: 2025-11-04 23:22:12.016 [INFO][4545] cni-plugin/plugin.go 340: Calico CNI found existing endpoint: &{{WorkloadEndpoint projectcalico.org/v3} {ip--172--31--21--124-k8s-whisker--778cbdb456--4xzz7-eth0 whisker-778cbdb456- calico-system 404b99f5-b096-49e7-baa1-6b3afbc90705 943 0 2025-11-04 23:22:10 +0000 UTC map[app.kubernetes.io/name:whisker k8s-app:whisker pod-template-hash:778cbdb456 projectcalico.org/namespace:calico-system projectcalico.org/orchestrator:k8s projectcalico.org/serviceaccount:whisker] map[] [] [] []} {k8s ip-172-31-21-124 whisker-778cbdb456-4xzz7 eth0 whisker [] [] [kns.calico-system ksa.calico-system.whisker] cali5b3ce9ec845 [] [] }} ContainerID="2a7686a7d0e910ea2cb4f7d4f3be4f6320f515faa85e802e1e6ee7725cba0768" Namespace="calico-system" Pod="whisker-778cbdb456-4xzz7" WorkloadEndpoint="ip--172--31--21--124-k8s-whisker--778cbdb456--4xzz7-" Nov 4 23:22:12.539248 containerd[1977]: 2025-11-04 23:22:12.017 [INFO][4545] cni-plugin/k8s.go 74: Extracted identifiers for CmdAddK8s ContainerID="2a7686a7d0e910ea2cb4f7d4f3be4f6320f515faa85e802e1e6ee7725cba0768" Namespace="calico-system" Pod="whisker-778cbdb456-4xzz7" WorkloadEndpoint="ip--172--31--21--124-k8s-whisker--778cbdb456--4xzz7-eth0" Nov 4 23:22:12.539248 containerd[1977]: 2025-11-04 23:22:12.236 [INFO][4604] ipam/ipam_plugin.go 227: Calico CNI IPAM request count IPv4=1 IPv6=0 ContainerID="2a7686a7d0e910ea2cb4f7d4f3be4f6320f515faa85e802e1e6ee7725cba0768" HandleID="k8s-pod-network.2a7686a7d0e910ea2cb4f7d4f3be4f6320f515faa85e802e1e6ee7725cba0768" Workload="ip--172--31--21--124-k8s-whisker--778cbdb456--4xzz7-eth0" Nov 4 23:22:12.540084 containerd[1977]: 2025-11-04 23:22:12.238 [INFO][4604] ipam/ipam_plugin.go 275: Auto assigning IP ContainerID="2a7686a7d0e910ea2cb4f7d4f3be4f6320f515faa85e802e1e6ee7725cba0768" HandleID="k8s-pod-network.2a7686a7d0e910ea2cb4f7d4f3be4f6320f515faa85e802e1e6ee7725cba0768" Workload="ip--172--31--21--124-k8s-whisker--778cbdb456--4xzz7-eth0" assignArgs=ipam.AutoAssignArgs{Num4:1, Num6:0, HandleID:(*string)(0x4000363de0), Attrs:map[string]string{"namespace":"calico-system", "node":"ip-172-31-21-124", "pod":"whisker-778cbdb456-4xzz7", "timestamp":"2025-11-04 23:22:12.236145149 +0000 UTC"}, Hostname:"ip-172-31-21-124", IPv4Pools:[]net.IPNet{}, IPv6Pools:[]net.IPNet{}, MaxBlocksPerHost:0, HostReservedAttrIPv4s:(*ipam.HostReservedAttr)(nil), HostReservedAttrIPv6s:(*ipam.HostReservedAttr)(nil), IntendedUse:"Workload"} Nov 4 23:22:12.540084 containerd[1977]: 2025-11-04 23:22:12.238 [INFO][4604] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 4 23:22:12.540084 containerd[1977]: 2025-11-04 23:22:12.238 [INFO][4604] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 4 23:22:12.540084 containerd[1977]: 2025-11-04 23:22:12.239 [INFO][4604] ipam/ipam.go 110: Auto-assign 1 ipv4, 0 ipv6 addrs for host 'ip-172-31-21-124' Nov 4 23:22:12.540084 containerd[1977]: 2025-11-04 23:22:12.263 [INFO][4604] ipam/ipam.go 691: Looking up existing affinities for host handle="k8s-pod-network.2a7686a7d0e910ea2cb4f7d4f3be4f6320f515faa85e802e1e6ee7725cba0768" host="ip-172-31-21-124" Nov 4 23:22:12.540084 containerd[1977]: 2025-11-04 23:22:12.282 [INFO][4604] ipam/ipam.go 394: Looking up existing affinities for host host="ip-172-31-21-124" Nov 4 23:22:12.540084 containerd[1977]: 2025-11-04 23:22:12.294 [INFO][4604] ipam/ipam.go 511: Trying affinity for 192.168.9.0/26 host="ip-172-31-21-124" Nov 4 23:22:12.540084 containerd[1977]: 2025-11-04 23:22:12.301 [INFO][4604] ipam/ipam.go 158: Attempting to load block cidr=192.168.9.0/26 host="ip-172-31-21-124" Nov 4 23:22:12.540084 containerd[1977]: 2025-11-04 23:22:12.307 [INFO][4604] ipam/ipam.go 235: Affinity is confirmed and block has been loaded cidr=192.168.9.0/26 host="ip-172-31-21-124" Nov 4 23:22:12.540084 containerd[1977]: 2025-11-04 23:22:12.307 [INFO][4604] ipam/ipam.go 1219: Attempting to assign 1 addresses from block block=192.168.9.0/26 handle="k8s-pod-network.2a7686a7d0e910ea2cb4f7d4f3be4f6320f515faa85e802e1e6ee7725cba0768" host="ip-172-31-21-124" Nov 4 23:22:12.542191 containerd[1977]: 2025-11-04 23:22:12.312 [INFO][4604] ipam/ipam.go 1780: Creating new handle: k8s-pod-network.2a7686a7d0e910ea2cb4f7d4f3be4f6320f515faa85e802e1e6ee7725cba0768 Nov 4 23:22:12.542191 containerd[1977]: 2025-11-04 23:22:12.322 [INFO][4604] ipam/ipam.go 1246: Writing block in order to claim IPs block=192.168.9.0/26 handle="k8s-pod-network.2a7686a7d0e910ea2cb4f7d4f3be4f6320f515faa85e802e1e6ee7725cba0768" host="ip-172-31-21-124" Nov 4 23:22:12.542191 containerd[1977]: 2025-11-04 23:22:12.343 [INFO][4604] ipam/ipam.go 1262: Successfully claimed IPs: [192.168.9.1/26] block=192.168.9.0/26 handle="k8s-pod-network.2a7686a7d0e910ea2cb4f7d4f3be4f6320f515faa85e802e1e6ee7725cba0768" host="ip-172-31-21-124" Nov 4 23:22:12.542191 containerd[1977]: 2025-11-04 23:22:12.343 [INFO][4604] ipam/ipam.go 878: Auto-assigned 1 out of 1 IPv4s: [192.168.9.1/26] handle="k8s-pod-network.2a7686a7d0e910ea2cb4f7d4f3be4f6320f515faa85e802e1e6ee7725cba0768" host="ip-172-31-21-124" Nov 4 23:22:12.542191 containerd[1977]: 2025-11-04 23:22:12.343 [INFO][4604] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 4 23:22:12.542191 containerd[1977]: 2025-11-04 23:22:12.344 [INFO][4604] ipam/ipam_plugin.go 299: Calico CNI IPAM assigned addresses IPv4=[192.168.9.1/26] IPv6=[] ContainerID="2a7686a7d0e910ea2cb4f7d4f3be4f6320f515faa85e802e1e6ee7725cba0768" HandleID="k8s-pod-network.2a7686a7d0e910ea2cb4f7d4f3be4f6320f515faa85e802e1e6ee7725cba0768" Workload="ip--172--31--21--124-k8s-whisker--778cbdb456--4xzz7-eth0" Nov 4 23:22:12.543003 containerd[1977]: 2025-11-04 23:22:12.355 [INFO][4545] cni-plugin/k8s.go 418: Populated endpoint ContainerID="2a7686a7d0e910ea2cb4f7d4f3be4f6320f515faa85e802e1e6ee7725cba0768" Namespace="calico-system" Pod="whisker-778cbdb456-4xzz7" WorkloadEndpoint="ip--172--31--21--124-k8s-whisker--778cbdb456--4xzz7-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--21--124-k8s-whisker--778cbdb456--4xzz7-eth0", GenerateName:"whisker-778cbdb456-", Namespace:"calico-system", SelfLink:"", UID:"404b99f5-b096-49e7-baa1-6b3afbc90705", ResourceVersion:"943", Generation:0, CreationTimestamp:time.Date(2025, time.November, 4, 23, 22, 10, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app.kubernetes.io/name":"whisker", "k8s-app":"whisker", "pod-template-hash":"778cbdb456", "projectcalico.org/namespace":"calico-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"whisker"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-21-124", ContainerID:"", Pod:"whisker-778cbdb456-4xzz7", Endpoint:"eth0", ServiceAccountName:"whisker", IPNetworks:[]string{"192.168.9.1/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-system", "ksa.calico-system.whisker"}, InterfaceName:"cali5b3ce9ec845", MAC:"", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 4 23:22:12.543003 containerd[1977]: 2025-11-04 23:22:12.355 [INFO][4545] cni-plugin/k8s.go 419: Calico CNI using IPs: [192.168.9.1/32] ContainerID="2a7686a7d0e910ea2cb4f7d4f3be4f6320f515faa85e802e1e6ee7725cba0768" Namespace="calico-system" Pod="whisker-778cbdb456-4xzz7" WorkloadEndpoint="ip--172--31--21--124-k8s-whisker--778cbdb456--4xzz7-eth0" Nov 4 23:22:12.544896 containerd[1977]: 2025-11-04 23:22:12.356 [INFO][4545] cni-plugin/dataplane_linux.go 69: Setting the host side veth name to cali5b3ce9ec845 ContainerID="2a7686a7d0e910ea2cb4f7d4f3be4f6320f515faa85e802e1e6ee7725cba0768" Namespace="calico-system" Pod="whisker-778cbdb456-4xzz7" WorkloadEndpoint="ip--172--31--21--124-k8s-whisker--778cbdb456--4xzz7-eth0" Nov 4 23:22:12.544896 containerd[1977]: 2025-11-04 23:22:12.430 [INFO][4545] cni-plugin/dataplane_linux.go 508: Disabling IPv4 forwarding ContainerID="2a7686a7d0e910ea2cb4f7d4f3be4f6320f515faa85e802e1e6ee7725cba0768" Namespace="calico-system" Pod="whisker-778cbdb456-4xzz7" WorkloadEndpoint="ip--172--31--21--124-k8s-whisker--778cbdb456--4xzz7-eth0" Nov 4 23:22:12.545380 containerd[1977]: 2025-11-04 23:22:12.431 [INFO][4545] cni-plugin/k8s.go 446: Added Mac, interface name, and active container ID to endpoint ContainerID="2a7686a7d0e910ea2cb4f7d4f3be4f6320f515faa85e802e1e6ee7725cba0768" Namespace="calico-system" Pod="whisker-778cbdb456-4xzz7" WorkloadEndpoint="ip--172--31--21--124-k8s-whisker--778cbdb456--4xzz7-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--21--124-k8s-whisker--778cbdb456--4xzz7-eth0", GenerateName:"whisker-778cbdb456-", Namespace:"calico-system", SelfLink:"", UID:"404b99f5-b096-49e7-baa1-6b3afbc90705", ResourceVersion:"943", Generation:0, CreationTimestamp:time.Date(2025, time.November, 4, 23, 22, 10, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app.kubernetes.io/name":"whisker", "k8s-app":"whisker", "pod-template-hash":"778cbdb456", "projectcalico.org/namespace":"calico-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"whisker"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-21-124", ContainerID:"2a7686a7d0e910ea2cb4f7d4f3be4f6320f515faa85e802e1e6ee7725cba0768", Pod:"whisker-778cbdb456-4xzz7", Endpoint:"eth0", ServiceAccountName:"whisker", IPNetworks:[]string{"192.168.9.1/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-system", "ksa.calico-system.whisker"}, InterfaceName:"cali5b3ce9ec845", MAC:"5e:12:32:80:ce:62", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 4 23:22:12.545554 containerd[1977]: 2025-11-04 23:22:12.525 [INFO][4545] cni-plugin/k8s.go 532: Wrote updated endpoint to datastore ContainerID="2a7686a7d0e910ea2cb4f7d4f3be4f6320f515faa85e802e1e6ee7725cba0768" Namespace="calico-system" Pod="whisker-778cbdb456-4xzz7" WorkloadEndpoint="ip--172--31--21--124-k8s-whisker--778cbdb456--4xzz7-eth0" Nov 4 23:22:12.617791 containerd[1977]: time="2025-11-04T23:22:12.617602831Z" level=info msg="connecting to shim 2a7686a7d0e910ea2cb4f7d4f3be4f6320f515faa85e802e1e6ee7725cba0768" address="unix:///run/containerd/s/7610fc7a1c37065eb340e018523e2d8eb6755734d7f9b8990181c76860df75fc" namespace=k8s.io protocol=ttrpc version=3 Nov 4 23:22:12.732597 systemd[1]: Started cri-containerd-2a7686a7d0e910ea2cb4f7d4f3be4f6320f515faa85e802e1e6ee7725cba0768.scope - libcontainer container 2a7686a7d0e910ea2cb4f7d4f3be4f6320f515faa85e802e1e6ee7725cba0768. Nov 4 23:22:12.859534 containerd[1977]: time="2025-11-04T23:22:12.859474208Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-kube-controllers-5c9f7c8689-qhpsj,Uid:89628730-c640-4e4b-9cec-2cca5b47d9fc,Namespace:calico-system,Attempt:0,}" Nov 4 23:22:12.944235 containerd[1977]: time="2025-11-04T23:22:12.943603508Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:whisker-778cbdb456-4xzz7,Uid:404b99f5-b096-49e7-baa1-6b3afbc90705,Namespace:calico-system,Attempt:0,} returns sandbox id \"2a7686a7d0e910ea2cb4f7d4f3be4f6320f515faa85e802e1e6ee7725cba0768\"" Nov 4 23:22:12.958899 containerd[1977]: time="2025-11-04T23:22:12.958751228Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/whisker:v3.30.4\"" Nov 4 23:22:13.212909 containerd[1977]: time="2025-11-04T23:22:13.212570742Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:22:13.214476 containerd[1977]: time="2025-11-04T23:22:13.214279362Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/whisker:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" Nov 4 23:22:13.215719 containerd[1977]: time="2025-11-04T23:22:13.214891266Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/whisker:v3.30.4: active requests=0, bytes read=73" Nov 4 23:22:13.215891 kubelet[3293]: E1104 23:22:13.215695 3293 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker:v3.30.4" Nov 4 23:22:13.215891 kubelet[3293]: E1104 23:22:13.215854 3293 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker:v3.30.4" Nov 4 23:22:13.228373 kubelet[3293]: E1104 23:22:13.227985 3293 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:whisker,Image:ghcr.io/flatcar/calico/whisker:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:INFO,ValueFrom:nil,},EnvVar{Name:CALICO_VERSION,Value:v3.30.4,ValueFrom:nil,},EnvVar{Name:CLUSTER_ID,Value:0ca3151f26aa44ec95a034255ce8af62,ValueFrom:nil,},EnvVar{Name:CLUSTER_TYPE,Value:typha,kdd,k8s,operator,bgp,kubeadm,ValueFrom:nil,},EnvVar{Name:NOTIFICATIONS,Value:Enabled,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-fjghm,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod whisker-778cbdb456-4xzz7_calico-system(404b99f5-b096-49e7-baa1-6b3afbc90705): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" logger="UnhandledError" Nov 4 23:22:13.232367 containerd[1977]: time="2025-11-04T23:22:13.232100274Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\"" Nov 4 23:22:13.311947 systemd-networkd[1573]: cali71fae08a329: Link UP Nov 4 23:22:13.314307 systemd-networkd[1573]: cali71fae08a329: Gained carrier Nov 4 23:22:13.364706 containerd[1977]: 2025-11-04 23:22:13.026 [INFO][4747] cni-plugin/utils.go 100: File /var/lib/calico/mtu does not exist Nov 4 23:22:13.364706 containerd[1977]: 2025-11-04 23:22:13.076 [INFO][4747] cni-plugin/plugin.go 340: Calico CNI found existing endpoint: &{{WorkloadEndpoint projectcalico.org/v3} {ip--172--31--21--124-k8s-calico--kube--controllers--5c9f7c8689--qhpsj-eth0 calico-kube-controllers-5c9f7c8689- calico-system 89628730-c640-4e4b-9cec-2cca5b47d9fc 876 0 2025-11-04 23:21:52 +0000 UTC map[app.kubernetes.io/name:calico-kube-controllers k8s-app:calico-kube-controllers pod-template-hash:5c9f7c8689 projectcalico.org/namespace:calico-system projectcalico.org/orchestrator:k8s projectcalico.org/serviceaccount:calico-kube-controllers] map[] [] [] []} {k8s ip-172-31-21-124 calico-kube-controllers-5c9f7c8689-qhpsj eth0 calico-kube-controllers [] [] [kns.calico-system ksa.calico-system.calico-kube-controllers] cali71fae08a329 [] [] }} ContainerID="0895f91b84ecc974769c02496dff948800fe5621d6ff58aff563bf708bc2e7bc" Namespace="calico-system" Pod="calico-kube-controllers-5c9f7c8689-qhpsj" WorkloadEndpoint="ip--172--31--21--124-k8s-calico--kube--controllers--5c9f7c8689--qhpsj-" Nov 4 23:22:13.364706 containerd[1977]: 2025-11-04 23:22:13.076 [INFO][4747] cni-plugin/k8s.go 74: Extracted identifiers for CmdAddK8s ContainerID="0895f91b84ecc974769c02496dff948800fe5621d6ff58aff563bf708bc2e7bc" Namespace="calico-system" Pod="calico-kube-controllers-5c9f7c8689-qhpsj" WorkloadEndpoint="ip--172--31--21--124-k8s-calico--kube--controllers--5c9f7c8689--qhpsj-eth0" Nov 4 23:22:13.364706 containerd[1977]: 2025-11-04 23:22:13.173 [INFO][4761] ipam/ipam_plugin.go 227: Calico CNI IPAM request count IPv4=1 IPv6=0 ContainerID="0895f91b84ecc974769c02496dff948800fe5621d6ff58aff563bf708bc2e7bc" HandleID="k8s-pod-network.0895f91b84ecc974769c02496dff948800fe5621d6ff58aff563bf708bc2e7bc" Workload="ip--172--31--21--124-k8s-calico--kube--controllers--5c9f7c8689--qhpsj-eth0" Nov 4 23:22:13.365097 containerd[1977]: 2025-11-04 23:22:13.174 [INFO][4761] ipam/ipam_plugin.go 275: Auto assigning IP ContainerID="0895f91b84ecc974769c02496dff948800fe5621d6ff58aff563bf708bc2e7bc" HandleID="k8s-pod-network.0895f91b84ecc974769c02496dff948800fe5621d6ff58aff563bf708bc2e7bc" Workload="ip--172--31--21--124-k8s-calico--kube--controllers--5c9f7c8689--qhpsj-eth0" assignArgs=ipam.AutoAssignArgs{Num4:1, Num6:0, HandleID:(*string)(0x4000103600), Attrs:map[string]string{"namespace":"calico-system", "node":"ip-172-31-21-124", "pod":"calico-kube-controllers-5c9f7c8689-qhpsj", "timestamp":"2025-11-04 23:22:13.17361207 +0000 UTC"}, Hostname:"ip-172-31-21-124", IPv4Pools:[]net.IPNet{}, IPv6Pools:[]net.IPNet{}, MaxBlocksPerHost:0, HostReservedAttrIPv4s:(*ipam.HostReservedAttr)(nil), HostReservedAttrIPv6s:(*ipam.HostReservedAttr)(nil), IntendedUse:"Workload"} Nov 4 23:22:13.365097 containerd[1977]: 2025-11-04 23:22:13.174 [INFO][4761] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 4 23:22:13.365097 containerd[1977]: 2025-11-04 23:22:13.175 [INFO][4761] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 4 23:22:13.365097 containerd[1977]: 2025-11-04 23:22:13.175 [INFO][4761] ipam/ipam.go 110: Auto-assign 1 ipv4, 0 ipv6 addrs for host 'ip-172-31-21-124' Nov 4 23:22:13.365097 containerd[1977]: 2025-11-04 23:22:13.193 [INFO][4761] ipam/ipam.go 691: Looking up existing affinities for host handle="k8s-pod-network.0895f91b84ecc974769c02496dff948800fe5621d6ff58aff563bf708bc2e7bc" host="ip-172-31-21-124" Nov 4 23:22:13.365097 containerd[1977]: 2025-11-04 23:22:13.203 [INFO][4761] ipam/ipam.go 394: Looking up existing affinities for host host="ip-172-31-21-124" Nov 4 23:22:13.365097 containerd[1977]: 2025-11-04 23:22:13.223 [INFO][4761] ipam/ipam.go 511: Trying affinity for 192.168.9.0/26 host="ip-172-31-21-124" Nov 4 23:22:13.365097 containerd[1977]: 2025-11-04 23:22:13.233 [INFO][4761] ipam/ipam.go 158: Attempting to load block cidr=192.168.9.0/26 host="ip-172-31-21-124" Nov 4 23:22:13.365097 containerd[1977]: 2025-11-04 23:22:13.244 [INFO][4761] ipam/ipam.go 235: Affinity is confirmed and block has been loaded cidr=192.168.9.0/26 host="ip-172-31-21-124" Nov 4 23:22:13.366687 containerd[1977]: 2025-11-04 23:22:13.244 [INFO][4761] ipam/ipam.go 1219: Attempting to assign 1 addresses from block block=192.168.9.0/26 handle="k8s-pod-network.0895f91b84ecc974769c02496dff948800fe5621d6ff58aff563bf708bc2e7bc" host="ip-172-31-21-124" Nov 4 23:22:13.366687 containerd[1977]: 2025-11-04 23:22:13.248 [INFO][4761] ipam/ipam.go 1780: Creating new handle: k8s-pod-network.0895f91b84ecc974769c02496dff948800fe5621d6ff58aff563bf708bc2e7bc Nov 4 23:22:13.366687 containerd[1977]: 2025-11-04 23:22:13.264 [INFO][4761] ipam/ipam.go 1246: Writing block in order to claim IPs block=192.168.9.0/26 handle="k8s-pod-network.0895f91b84ecc974769c02496dff948800fe5621d6ff58aff563bf708bc2e7bc" host="ip-172-31-21-124" Nov 4 23:22:13.366687 containerd[1977]: 2025-11-04 23:22:13.281 [INFO][4761] ipam/ipam.go 1262: Successfully claimed IPs: [192.168.9.2/26] block=192.168.9.0/26 handle="k8s-pod-network.0895f91b84ecc974769c02496dff948800fe5621d6ff58aff563bf708bc2e7bc" host="ip-172-31-21-124" Nov 4 23:22:13.366687 containerd[1977]: 2025-11-04 23:22:13.281 [INFO][4761] ipam/ipam.go 878: Auto-assigned 1 out of 1 IPv4s: [192.168.9.2/26] handle="k8s-pod-network.0895f91b84ecc974769c02496dff948800fe5621d6ff58aff563bf708bc2e7bc" host="ip-172-31-21-124" Nov 4 23:22:13.366687 containerd[1977]: 2025-11-04 23:22:13.281 [INFO][4761] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 4 23:22:13.366687 containerd[1977]: 2025-11-04 23:22:13.281 [INFO][4761] ipam/ipam_plugin.go 299: Calico CNI IPAM assigned addresses IPv4=[192.168.9.2/26] IPv6=[] ContainerID="0895f91b84ecc974769c02496dff948800fe5621d6ff58aff563bf708bc2e7bc" HandleID="k8s-pod-network.0895f91b84ecc974769c02496dff948800fe5621d6ff58aff563bf708bc2e7bc" Workload="ip--172--31--21--124-k8s-calico--kube--controllers--5c9f7c8689--qhpsj-eth0" Nov 4 23:22:13.367049 containerd[1977]: 2025-11-04 23:22:13.290 [INFO][4747] cni-plugin/k8s.go 418: Populated endpoint ContainerID="0895f91b84ecc974769c02496dff948800fe5621d6ff58aff563bf708bc2e7bc" Namespace="calico-system" Pod="calico-kube-controllers-5c9f7c8689-qhpsj" WorkloadEndpoint="ip--172--31--21--124-k8s-calico--kube--controllers--5c9f7c8689--qhpsj-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--21--124-k8s-calico--kube--controllers--5c9f7c8689--qhpsj-eth0", GenerateName:"calico-kube-controllers-5c9f7c8689-", Namespace:"calico-system", SelfLink:"", UID:"89628730-c640-4e4b-9cec-2cca5b47d9fc", ResourceVersion:"876", Generation:0, CreationTimestamp:time.Date(2025, time.November, 4, 23, 21, 52, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app.kubernetes.io/name":"calico-kube-controllers", "k8s-app":"calico-kube-controllers", "pod-template-hash":"5c9f7c8689", "projectcalico.org/namespace":"calico-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"calico-kube-controllers"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-21-124", ContainerID:"", Pod:"calico-kube-controllers-5c9f7c8689-qhpsj", Endpoint:"eth0", ServiceAccountName:"calico-kube-controllers", IPNetworks:[]string{"192.168.9.2/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-system", "ksa.calico-system.calico-kube-controllers"}, InterfaceName:"cali71fae08a329", MAC:"", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 4 23:22:13.368624 containerd[1977]: 2025-11-04 23:22:13.291 [INFO][4747] cni-plugin/k8s.go 419: Calico CNI using IPs: [192.168.9.2/32] ContainerID="0895f91b84ecc974769c02496dff948800fe5621d6ff58aff563bf708bc2e7bc" Namespace="calico-system" Pod="calico-kube-controllers-5c9f7c8689-qhpsj" WorkloadEndpoint="ip--172--31--21--124-k8s-calico--kube--controllers--5c9f7c8689--qhpsj-eth0" Nov 4 23:22:13.368624 containerd[1977]: 2025-11-04 23:22:13.291 [INFO][4747] cni-plugin/dataplane_linux.go 69: Setting the host side veth name to cali71fae08a329 ContainerID="0895f91b84ecc974769c02496dff948800fe5621d6ff58aff563bf708bc2e7bc" Namespace="calico-system" Pod="calico-kube-controllers-5c9f7c8689-qhpsj" WorkloadEndpoint="ip--172--31--21--124-k8s-calico--kube--controllers--5c9f7c8689--qhpsj-eth0" Nov 4 23:22:13.368624 containerd[1977]: 2025-11-04 23:22:13.318 [INFO][4747] cni-plugin/dataplane_linux.go 508: Disabling IPv4 forwarding ContainerID="0895f91b84ecc974769c02496dff948800fe5621d6ff58aff563bf708bc2e7bc" Namespace="calico-system" Pod="calico-kube-controllers-5c9f7c8689-qhpsj" WorkloadEndpoint="ip--172--31--21--124-k8s-calico--kube--controllers--5c9f7c8689--qhpsj-eth0" Nov 4 23:22:13.368950 containerd[1977]: 2025-11-04 23:22:13.320 [INFO][4747] cni-plugin/k8s.go 446: Added Mac, interface name, and active container ID to endpoint ContainerID="0895f91b84ecc974769c02496dff948800fe5621d6ff58aff563bf708bc2e7bc" Namespace="calico-system" Pod="calico-kube-controllers-5c9f7c8689-qhpsj" WorkloadEndpoint="ip--172--31--21--124-k8s-calico--kube--controllers--5c9f7c8689--qhpsj-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--21--124-k8s-calico--kube--controllers--5c9f7c8689--qhpsj-eth0", GenerateName:"calico-kube-controllers-5c9f7c8689-", Namespace:"calico-system", SelfLink:"", UID:"89628730-c640-4e4b-9cec-2cca5b47d9fc", ResourceVersion:"876", Generation:0, CreationTimestamp:time.Date(2025, time.November, 4, 23, 21, 52, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app.kubernetes.io/name":"calico-kube-controllers", "k8s-app":"calico-kube-controllers", "pod-template-hash":"5c9f7c8689", "projectcalico.org/namespace":"calico-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"calico-kube-controllers"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-21-124", ContainerID:"0895f91b84ecc974769c02496dff948800fe5621d6ff58aff563bf708bc2e7bc", Pod:"calico-kube-controllers-5c9f7c8689-qhpsj", Endpoint:"eth0", ServiceAccountName:"calico-kube-controllers", IPNetworks:[]string{"192.168.9.2/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-system", "ksa.calico-system.calico-kube-controllers"}, InterfaceName:"cali71fae08a329", MAC:"a2:35:b4:9f:a7:6a", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 4 23:22:13.369107 containerd[1977]: 2025-11-04 23:22:13.347 [INFO][4747] cni-plugin/k8s.go 532: Wrote updated endpoint to datastore ContainerID="0895f91b84ecc974769c02496dff948800fe5621d6ff58aff563bf708bc2e7bc" Namespace="calico-system" Pod="calico-kube-controllers-5c9f7c8689-qhpsj" WorkloadEndpoint="ip--172--31--21--124-k8s-calico--kube--controllers--5c9f7c8689--qhpsj-eth0" Nov 4 23:22:13.428907 containerd[1977]: time="2025-11-04T23:22:13.428822203Z" level=info msg="connecting to shim 0895f91b84ecc974769c02496dff948800fe5621d6ff58aff563bf708bc2e7bc" address="unix:///run/containerd/s/b1bf152f83e28916a4e2d182cc0aa015933c42b7d7aafa0a8aab2caf778fd535" namespace=k8s.io protocol=ttrpc version=3 Nov 4 23:22:13.522701 systemd[1]: Started cri-containerd-0895f91b84ecc974769c02496dff948800fe5621d6ff58aff563bf708bc2e7bc.scope - libcontainer container 0895f91b84ecc974769c02496dff948800fe5621d6ff58aff563bf708bc2e7bc. Nov 4 23:22:13.548424 containerd[1977]: time="2025-11-04T23:22:13.548150815Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:22:13.549690 containerd[1977]: time="2025-11-04T23:22:13.549616267Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" Nov 4 23:22:13.550385 containerd[1977]: time="2025-11-04T23:22:13.549816619Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/whisker-backend:v3.30.4: active requests=0, bytes read=85" Nov 4 23:22:13.550827 kubelet[3293]: E1104 23:22:13.550750 3293 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker-backend:v3.30.4" Nov 4 23:22:13.551135 kubelet[3293]: E1104 23:22:13.550831 3293 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker-backend:v3.30.4" Nov 4 23:22:13.552669 kubelet[3293]: E1104 23:22:13.552154 3293 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:whisker-backend,Image:ghcr.io/flatcar/calico/whisker-backend:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:INFO,ValueFrom:nil,},EnvVar{Name:PORT,Value:3002,ValueFrom:nil,},EnvVar{Name:GOLDMANE_HOST,Value:goldmane.calico-system.svc.cluster.local:7443,ValueFrom:nil,},EnvVar{Name:TLS_CERT_PATH,Value:/whisker-backend-key-pair/tls.crt,ValueFrom:nil,},EnvVar{Name:TLS_KEY_PATH,Value:/whisker-backend-key-pair/tls.key,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:whisker-backend-key-pair,ReadOnly:true,MountPath:/whisker-backend-key-pair,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:whisker-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-fjghm,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod whisker-778cbdb456-4xzz7_calico-system(404b99f5-b096-49e7-baa1-6b3afbc90705): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" logger="UnhandledError" Nov 4 23:22:13.554506 kubelet[3293]: E1104 23:22:13.554414 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"whisker\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found\", failed to \"StartContainer\" for \"whisker-backend\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found\"]" pod="calico-system/whisker-778cbdb456-4xzz7" podUID="404b99f5-b096-49e7-baa1-6b3afbc90705" Nov 4 23:22:13.761709 containerd[1977]: time="2025-11-04T23:22:13.761622188Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-kube-controllers-5c9f7c8689-qhpsj,Uid:89628730-c640-4e4b-9cec-2cca5b47d9fc,Namespace:calico-system,Attempt:0,} returns sandbox id \"0895f91b84ecc974769c02496dff948800fe5621d6ff58aff563bf708bc2e7bc\"" Nov 4 23:22:13.769394 containerd[1977]: time="2025-11-04T23:22:13.768919496Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\"" Nov 4 23:22:13.823389 containerd[1977]: time="2025-11-04T23:22:13.822726489Z" level=info msg="TaskExit event in podsandbox handler container_id:\"6fbaacd9f420f26c2371bcff475a8067c2659e0a2c0d2d16b2a01703f87776c8\" id:\"b2b0a3871ca2e9038e0bf6b8f2589019699c90947ba14d02edb6c01b90094bb8\" pid:4680 exit_status:1 exited_at:{seconds:1762298533 nanos:821263521}" Nov 4 23:22:14.032649 containerd[1977]: time="2025-11-04T23:22:14.032387442Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:22:14.034264 containerd[1977]: time="2025-11-04T23:22:14.034132218Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" Nov 4 23:22:14.034264 containerd[1977]: time="2025-11-04T23:22:14.034228710Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/kube-controllers:v3.30.4: active requests=0, bytes read=85" Nov 4 23:22:14.034941 kubelet[3293]: E1104 23:22:14.034749 3293 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" image="ghcr.io/flatcar/calico/kube-controllers:v3.30.4" Nov 4 23:22:14.034941 kubelet[3293]: E1104 23:22:14.034818 3293 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" image="ghcr.io/flatcar/calico/kube-controllers:v3.30.4" Nov 4 23:22:14.035365 kubelet[3293]: E1104 23:22:14.035056 3293 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:calico-kube-controllers,Image:ghcr.io/flatcar/calico/kube-controllers:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:KUBE_CONTROLLERS_CONFIG_NAME,Value:default,ValueFrom:nil,},EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:ENABLED_CONTROLLERS,Value:node,loadbalancer,ValueFrom:nil,},EnvVar{Name:DISABLE_KUBE_CONTROLLERS_CONFIG_API,Value:false,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:CA_CRT_PATH,Value:/etc/pki/tls/certs/tigera-ca-bundle.crt,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:tigera-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:tigera-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/cert.pem,SubPath:ca-bundle.crt,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-lbpdt,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/usr/bin/check-status -l],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:10,TimeoutSeconds:10,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:6,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/usr/bin/check-status -r],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:10,PeriodSeconds:30,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*999,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-kube-controllers-5c9f7c8689-qhpsj_calico-system(89628730-c640-4e4b-9cec-2cca5b47d9fc): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" logger="UnhandledError" Nov 4 23:22:14.037609 kubelet[3293]: E1104 23:22:14.036689 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-kube-controllers\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found\"" pod="calico-system/calico-kube-controllers-5c9f7c8689-qhpsj" podUID="89628730-c640-4e4b-9cec-2cca5b47d9fc" Nov 4 23:22:14.334533 kubelet[3293]: E1104 23:22:14.334255 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-kube-controllers\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found\"" pod="calico-system/calico-kube-controllers-5c9f7c8689-qhpsj" podUID="89628730-c640-4e4b-9cec-2cca5b47d9fc" Nov 4 23:22:14.336923 kubelet[3293]: E1104 23:22:14.335545 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"whisker\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found\", failed to \"StartContainer\" for \"whisker-backend\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found\"]" pod="calico-system/whisker-778cbdb456-4xzz7" podUID="404b99f5-b096-49e7-baa1-6b3afbc90705" Nov 4 23:22:14.351357 systemd-networkd[1573]: cali5b3ce9ec845: Gained IPv6LL Nov 4 23:22:14.663839 systemd-networkd[1573]: vxlan.calico: Link UP Nov 4 23:22:14.665136 systemd-networkd[1573]: vxlan.calico: Gained carrier Nov 4 23:22:14.671079 systemd-networkd[1573]: cali71fae08a329: Gained IPv6LL Nov 4 23:22:14.721260 (udev-worker)[4511]: Network interface NamePolicy= disabled on kernel command line. Nov 4 23:22:14.857864 containerd[1977]: time="2025-11-04T23:22:14.857007514Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-668d6bf9bc-cgqkm,Uid:8bf0c72f-09cc-4446-8c96-244d797ac69d,Namespace:kube-system,Attempt:0,}" Nov 4 23:22:14.857864 containerd[1977]: time="2025-11-04T23:22:14.857794630Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-fcc487596-jrhr4,Uid:068373b4-e189-432e-9f0e-0da4317cec26,Namespace:calico-apiserver,Attempt:0,}" Nov 4 23:22:15.302273 systemd-networkd[1573]: cali87156d172cb: Link UP Nov 4 23:22:15.304963 systemd-networkd[1573]: cali87156d172cb: Gained carrier Nov 4 23:22:15.338270 kubelet[3293]: E1104 23:22:15.336841 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-kube-controllers\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found\"" pod="calico-system/calico-kube-controllers-5c9f7c8689-qhpsj" podUID="89628730-c640-4e4b-9cec-2cca5b47d9fc" Nov 4 23:22:15.424162 containerd[1977]: 2025-11-04 23:22:14.994 [INFO][4895] cni-plugin/plugin.go 340: Calico CNI found existing endpoint: &{{WorkloadEndpoint projectcalico.org/v3} {ip--172--31--21--124-k8s-coredns--668d6bf9bc--cgqkm-eth0 coredns-668d6bf9bc- kube-system 8bf0c72f-09cc-4446-8c96-244d797ac69d 885 0 2025-11-04 23:21:20 +0000 UTC map[k8s-app:kube-dns pod-template-hash:668d6bf9bc projectcalico.org/namespace:kube-system projectcalico.org/orchestrator:k8s projectcalico.org/serviceaccount:coredns] map[] [] [] []} {k8s ip-172-31-21-124 coredns-668d6bf9bc-cgqkm eth0 coredns [] [] [kns.kube-system ksa.kube-system.coredns] cali87156d172cb [{dns UDP 53 0 } {dns-tcp TCP 53 0 } {metrics TCP 9153 0 }] [] }} ContainerID="8cb14b076dade17652452f2bb54a8a3b6e0252566b3e10918145a274da17253c" Namespace="kube-system" Pod="coredns-668d6bf9bc-cgqkm" WorkloadEndpoint="ip--172--31--21--124-k8s-coredns--668d6bf9bc--cgqkm-" Nov 4 23:22:15.424162 containerd[1977]: 2025-11-04 23:22:14.999 [INFO][4895] cni-plugin/k8s.go 74: Extracted identifiers for CmdAddK8s ContainerID="8cb14b076dade17652452f2bb54a8a3b6e0252566b3e10918145a274da17253c" Namespace="kube-system" Pod="coredns-668d6bf9bc-cgqkm" WorkloadEndpoint="ip--172--31--21--124-k8s-coredns--668d6bf9bc--cgqkm-eth0" Nov 4 23:22:15.424162 containerd[1977]: 2025-11-04 23:22:15.132 [INFO][4917] ipam/ipam_plugin.go 227: Calico CNI IPAM request count IPv4=1 IPv6=0 ContainerID="8cb14b076dade17652452f2bb54a8a3b6e0252566b3e10918145a274da17253c" HandleID="k8s-pod-network.8cb14b076dade17652452f2bb54a8a3b6e0252566b3e10918145a274da17253c" Workload="ip--172--31--21--124-k8s-coredns--668d6bf9bc--cgqkm-eth0" Nov 4 23:22:15.424568 containerd[1977]: 2025-11-04 23:22:15.132 [INFO][4917] ipam/ipam_plugin.go 275: Auto assigning IP ContainerID="8cb14b076dade17652452f2bb54a8a3b6e0252566b3e10918145a274da17253c" HandleID="k8s-pod-network.8cb14b076dade17652452f2bb54a8a3b6e0252566b3e10918145a274da17253c" Workload="ip--172--31--21--124-k8s-coredns--668d6bf9bc--cgqkm-eth0" assignArgs=ipam.AutoAssignArgs{Num4:1, Num6:0, HandleID:(*string)(0x40003a5890), Attrs:map[string]string{"namespace":"kube-system", "node":"ip-172-31-21-124", "pod":"coredns-668d6bf9bc-cgqkm", "timestamp":"2025-11-04 23:22:15.132115363 +0000 UTC"}, Hostname:"ip-172-31-21-124", IPv4Pools:[]net.IPNet{}, IPv6Pools:[]net.IPNet{}, MaxBlocksPerHost:0, HostReservedAttrIPv4s:(*ipam.HostReservedAttr)(nil), HostReservedAttrIPv6s:(*ipam.HostReservedAttr)(nil), IntendedUse:"Workload"} Nov 4 23:22:15.424568 containerd[1977]: 2025-11-04 23:22:15.132 [INFO][4917] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 4 23:22:15.424568 containerd[1977]: 2025-11-04 23:22:15.132 [INFO][4917] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 4 23:22:15.424568 containerd[1977]: 2025-11-04 23:22:15.132 [INFO][4917] ipam/ipam.go 110: Auto-assign 1 ipv4, 0 ipv6 addrs for host 'ip-172-31-21-124' Nov 4 23:22:15.424568 containerd[1977]: 2025-11-04 23:22:15.185 [INFO][4917] ipam/ipam.go 691: Looking up existing affinities for host handle="k8s-pod-network.8cb14b076dade17652452f2bb54a8a3b6e0252566b3e10918145a274da17253c" host="ip-172-31-21-124" Nov 4 23:22:15.424568 containerd[1977]: 2025-11-04 23:22:15.208 [INFO][4917] ipam/ipam.go 394: Looking up existing affinities for host host="ip-172-31-21-124" Nov 4 23:22:15.424568 containerd[1977]: 2025-11-04 23:22:15.224 [INFO][4917] ipam/ipam.go 511: Trying affinity for 192.168.9.0/26 host="ip-172-31-21-124" Nov 4 23:22:15.424568 containerd[1977]: 2025-11-04 23:22:15.228 [INFO][4917] ipam/ipam.go 158: Attempting to load block cidr=192.168.9.0/26 host="ip-172-31-21-124" Nov 4 23:22:15.424568 containerd[1977]: 2025-11-04 23:22:15.235 [INFO][4917] ipam/ipam.go 235: Affinity is confirmed and block has been loaded cidr=192.168.9.0/26 host="ip-172-31-21-124" Nov 4 23:22:15.424568 containerd[1977]: 2025-11-04 23:22:15.236 [INFO][4917] ipam/ipam.go 1219: Attempting to assign 1 addresses from block block=192.168.9.0/26 handle="k8s-pod-network.8cb14b076dade17652452f2bb54a8a3b6e0252566b3e10918145a274da17253c" host="ip-172-31-21-124" Nov 4 23:22:15.426574 containerd[1977]: 2025-11-04 23:22:15.241 [INFO][4917] ipam/ipam.go 1780: Creating new handle: k8s-pod-network.8cb14b076dade17652452f2bb54a8a3b6e0252566b3e10918145a274da17253c Nov 4 23:22:15.426574 containerd[1977]: 2025-11-04 23:22:15.254 [INFO][4917] ipam/ipam.go 1246: Writing block in order to claim IPs block=192.168.9.0/26 handle="k8s-pod-network.8cb14b076dade17652452f2bb54a8a3b6e0252566b3e10918145a274da17253c" host="ip-172-31-21-124" Nov 4 23:22:15.426574 containerd[1977]: 2025-11-04 23:22:15.271 [INFO][4917] ipam/ipam.go 1262: Successfully claimed IPs: [192.168.9.3/26] block=192.168.9.0/26 handle="k8s-pod-network.8cb14b076dade17652452f2bb54a8a3b6e0252566b3e10918145a274da17253c" host="ip-172-31-21-124" Nov 4 23:22:15.426574 containerd[1977]: 2025-11-04 23:22:15.273 [INFO][4917] ipam/ipam.go 878: Auto-assigned 1 out of 1 IPv4s: [192.168.9.3/26] handle="k8s-pod-network.8cb14b076dade17652452f2bb54a8a3b6e0252566b3e10918145a274da17253c" host="ip-172-31-21-124" Nov 4 23:22:15.426574 containerd[1977]: 2025-11-04 23:22:15.273 [INFO][4917] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 4 23:22:15.426574 containerd[1977]: 2025-11-04 23:22:15.273 [INFO][4917] ipam/ipam_plugin.go 299: Calico CNI IPAM assigned addresses IPv4=[192.168.9.3/26] IPv6=[] ContainerID="8cb14b076dade17652452f2bb54a8a3b6e0252566b3e10918145a274da17253c" HandleID="k8s-pod-network.8cb14b076dade17652452f2bb54a8a3b6e0252566b3e10918145a274da17253c" Workload="ip--172--31--21--124-k8s-coredns--668d6bf9bc--cgqkm-eth0" Nov 4 23:22:15.426902 containerd[1977]: 2025-11-04 23:22:15.284 [INFO][4895] cni-plugin/k8s.go 418: Populated endpoint ContainerID="8cb14b076dade17652452f2bb54a8a3b6e0252566b3e10918145a274da17253c" Namespace="kube-system" Pod="coredns-668d6bf9bc-cgqkm" WorkloadEndpoint="ip--172--31--21--124-k8s-coredns--668d6bf9bc--cgqkm-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--21--124-k8s-coredns--668d6bf9bc--cgqkm-eth0", GenerateName:"coredns-668d6bf9bc-", Namespace:"kube-system", SelfLink:"", UID:"8bf0c72f-09cc-4446-8c96-244d797ac69d", ResourceVersion:"885", Generation:0, CreationTimestamp:time.Date(2025, time.November, 4, 23, 21, 20, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-dns", "pod-template-hash":"668d6bf9bc", "projectcalico.org/namespace":"kube-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"coredns"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-21-124", ContainerID:"", Pod:"coredns-668d6bf9bc-cgqkm", Endpoint:"eth0", ServiceAccountName:"coredns", IPNetworks:[]string{"192.168.9.3/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.kube-system", "ksa.kube-system.coredns"}, InterfaceName:"cali87156d172cb", MAC:"", Ports:[]v3.WorkloadEndpointPort{v3.WorkloadEndpointPort{Name:"dns", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"UDP"}, Port:0x35, HostPort:0x0, HostIP:""}, v3.WorkloadEndpointPort{Name:"dns-tcp", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"TCP"}, Port:0x35, HostPort:0x0, HostIP:""}, v3.WorkloadEndpointPort{Name:"metrics", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"TCP"}, Port:0x23c1, HostPort:0x0, HostIP:""}}, AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 4 23:22:15.426902 containerd[1977]: 2025-11-04 23:22:15.284 [INFO][4895] cni-plugin/k8s.go 419: Calico CNI using IPs: [192.168.9.3/32] ContainerID="8cb14b076dade17652452f2bb54a8a3b6e0252566b3e10918145a274da17253c" Namespace="kube-system" Pod="coredns-668d6bf9bc-cgqkm" WorkloadEndpoint="ip--172--31--21--124-k8s-coredns--668d6bf9bc--cgqkm-eth0" Nov 4 23:22:15.426902 containerd[1977]: 2025-11-04 23:22:15.284 [INFO][4895] cni-plugin/dataplane_linux.go 69: Setting the host side veth name to cali87156d172cb ContainerID="8cb14b076dade17652452f2bb54a8a3b6e0252566b3e10918145a274da17253c" Namespace="kube-system" Pod="coredns-668d6bf9bc-cgqkm" WorkloadEndpoint="ip--172--31--21--124-k8s-coredns--668d6bf9bc--cgqkm-eth0" Nov 4 23:22:15.426902 containerd[1977]: 2025-11-04 23:22:15.307 [INFO][4895] cni-plugin/dataplane_linux.go 508: Disabling IPv4 forwarding ContainerID="8cb14b076dade17652452f2bb54a8a3b6e0252566b3e10918145a274da17253c" Namespace="kube-system" Pod="coredns-668d6bf9bc-cgqkm" WorkloadEndpoint="ip--172--31--21--124-k8s-coredns--668d6bf9bc--cgqkm-eth0" Nov 4 23:22:15.426902 containerd[1977]: 2025-11-04 23:22:15.309 [INFO][4895] cni-plugin/k8s.go 446: Added Mac, interface name, and active container ID to endpoint ContainerID="8cb14b076dade17652452f2bb54a8a3b6e0252566b3e10918145a274da17253c" Namespace="kube-system" Pod="coredns-668d6bf9bc-cgqkm" WorkloadEndpoint="ip--172--31--21--124-k8s-coredns--668d6bf9bc--cgqkm-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--21--124-k8s-coredns--668d6bf9bc--cgqkm-eth0", GenerateName:"coredns-668d6bf9bc-", Namespace:"kube-system", SelfLink:"", UID:"8bf0c72f-09cc-4446-8c96-244d797ac69d", ResourceVersion:"885", Generation:0, CreationTimestamp:time.Date(2025, time.November, 4, 23, 21, 20, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-dns", "pod-template-hash":"668d6bf9bc", "projectcalico.org/namespace":"kube-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"coredns"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-21-124", ContainerID:"8cb14b076dade17652452f2bb54a8a3b6e0252566b3e10918145a274da17253c", Pod:"coredns-668d6bf9bc-cgqkm", Endpoint:"eth0", ServiceAccountName:"coredns", IPNetworks:[]string{"192.168.9.3/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.kube-system", "ksa.kube-system.coredns"}, InterfaceName:"cali87156d172cb", MAC:"ba:7b:07:7b:3a:dd", Ports:[]v3.WorkloadEndpointPort{v3.WorkloadEndpointPort{Name:"dns", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"UDP"}, Port:0x35, HostPort:0x0, HostIP:""}, v3.WorkloadEndpointPort{Name:"dns-tcp", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"TCP"}, Port:0x35, HostPort:0x0, HostIP:""}, v3.WorkloadEndpointPort{Name:"metrics", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"TCP"}, Port:0x23c1, HostPort:0x0, HostIP:""}}, AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 4 23:22:15.426902 containerd[1977]: 2025-11-04 23:22:15.420 [INFO][4895] cni-plugin/k8s.go 532: Wrote updated endpoint to datastore ContainerID="8cb14b076dade17652452f2bb54a8a3b6e0252566b3e10918145a274da17253c" Namespace="kube-system" Pod="coredns-668d6bf9bc-cgqkm" WorkloadEndpoint="ip--172--31--21--124-k8s-coredns--668d6bf9bc--cgqkm-eth0" Nov 4 23:22:15.486028 containerd[1977]: time="2025-11-04T23:22:15.485233833Z" level=info msg="connecting to shim 8cb14b076dade17652452f2bb54a8a3b6e0252566b3e10918145a274da17253c" address="unix:///run/containerd/s/93dac627112d179a39ae76c36e4cd3612088daec7ef7ed6ccbba6b0d0cfd0b9e" namespace=k8s.io protocol=ttrpc version=3 Nov 4 23:22:15.557874 systemd-networkd[1573]: cali7cf82df4573: Link UP Nov 4 23:22:15.563730 systemd-networkd[1573]: cali7cf82df4573: Gained carrier Nov 4 23:22:15.584653 systemd[1]: Started cri-containerd-8cb14b076dade17652452f2bb54a8a3b6e0252566b3e10918145a274da17253c.scope - libcontainer container 8cb14b076dade17652452f2bb54a8a3b6e0252566b3e10918145a274da17253c. Nov 4 23:22:15.649614 containerd[1977]: 2025-11-04 23:22:15.104 [INFO][4900] cni-plugin/plugin.go 340: Calico CNI found existing endpoint: &{{WorkloadEndpoint projectcalico.org/v3} {ip--172--31--21--124-k8s-calico--apiserver--fcc487596--jrhr4-eth0 calico-apiserver-fcc487596- calico-apiserver 068373b4-e189-432e-9f0e-0da4317cec26 880 0 2025-11-04 23:21:35 +0000 UTC map[apiserver:true app.kubernetes.io/name:calico-apiserver k8s-app:calico-apiserver pod-template-hash:fcc487596 projectcalico.org/namespace:calico-apiserver projectcalico.org/orchestrator:k8s projectcalico.org/serviceaccount:calico-apiserver] map[] [] [] []} {k8s ip-172-31-21-124 calico-apiserver-fcc487596-jrhr4 eth0 calico-apiserver [] [] [kns.calico-apiserver ksa.calico-apiserver.calico-apiserver] cali7cf82df4573 [] [] }} ContainerID="7687286fe3331cc586f40016f0dc0640ad549c29274715b2bac582686eecc8bc" Namespace="calico-apiserver" Pod="calico-apiserver-fcc487596-jrhr4" WorkloadEndpoint="ip--172--31--21--124-k8s-calico--apiserver--fcc487596--jrhr4-" Nov 4 23:22:15.649614 containerd[1977]: 2025-11-04 23:22:15.107 [INFO][4900] cni-plugin/k8s.go 74: Extracted identifiers for CmdAddK8s ContainerID="7687286fe3331cc586f40016f0dc0640ad549c29274715b2bac582686eecc8bc" Namespace="calico-apiserver" Pod="calico-apiserver-fcc487596-jrhr4" WorkloadEndpoint="ip--172--31--21--124-k8s-calico--apiserver--fcc487596--jrhr4-eth0" Nov 4 23:22:15.649614 containerd[1977]: 2025-11-04 23:22:15.253 [INFO][4928] ipam/ipam_plugin.go 227: Calico CNI IPAM request count IPv4=1 IPv6=0 ContainerID="7687286fe3331cc586f40016f0dc0640ad549c29274715b2bac582686eecc8bc" HandleID="k8s-pod-network.7687286fe3331cc586f40016f0dc0640ad549c29274715b2bac582686eecc8bc" Workload="ip--172--31--21--124-k8s-calico--apiserver--fcc487596--jrhr4-eth0" Nov 4 23:22:15.649614 containerd[1977]: 2025-11-04 23:22:15.254 [INFO][4928] ipam/ipam_plugin.go 275: Auto assigning IP ContainerID="7687286fe3331cc586f40016f0dc0640ad549c29274715b2bac582686eecc8bc" HandleID="k8s-pod-network.7687286fe3331cc586f40016f0dc0640ad549c29274715b2bac582686eecc8bc" Workload="ip--172--31--21--124-k8s-calico--apiserver--fcc487596--jrhr4-eth0" assignArgs=ipam.AutoAssignArgs{Num4:1, Num6:0, HandleID:(*string)(0x4000390550), Attrs:map[string]string{"namespace":"calico-apiserver", "node":"ip-172-31-21-124", "pod":"calico-apiserver-fcc487596-jrhr4", "timestamp":"2025-11-04 23:22:15.253094912 +0000 UTC"}, Hostname:"ip-172-31-21-124", IPv4Pools:[]net.IPNet{}, IPv6Pools:[]net.IPNet{}, MaxBlocksPerHost:0, HostReservedAttrIPv4s:(*ipam.HostReservedAttr)(nil), HostReservedAttrIPv6s:(*ipam.HostReservedAttr)(nil), IntendedUse:"Workload"} Nov 4 23:22:15.649614 containerd[1977]: 2025-11-04 23:22:15.254 [INFO][4928] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 4 23:22:15.649614 containerd[1977]: 2025-11-04 23:22:15.273 [INFO][4928] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 4 23:22:15.649614 containerd[1977]: 2025-11-04 23:22:15.273 [INFO][4928] ipam/ipam.go 110: Auto-assign 1 ipv4, 0 ipv6 addrs for host 'ip-172-31-21-124' Nov 4 23:22:15.649614 containerd[1977]: 2025-11-04 23:22:15.303 [INFO][4928] ipam/ipam.go 691: Looking up existing affinities for host handle="k8s-pod-network.7687286fe3331cc586f40016f0dc0640ad549c29274715b2bac582686eecc8bc" host="ip-172-31-21-124" Nov 4 23:22:15.649614 containerd[1977]: 2025-11-04 23:22:15.321 [INFO][4928] ipam/ipam.go 394: Looking up existing affinities for host host="ip-172-31-21-124" Nov 4 23:22:15.649614 containerd[1977]: 2025-11-04 23:22:15.429 [INFO][4928] ipam/ipam.go 511: Trying affinity for 192.168.9.0/26 host="ip-172-31-21-124" Nov 4 23:22:15.649614 containerd[1977]: 2025-11-04 23:22:15.435 [INFO][4928] ipam/ipam.go 158: Attempting to load block cidr=192.168.9.0/26 host="ip-172-31-21-124" Nov 4 23:22:15.649614 containerd[1977]: 2025-11-04 23:22:15.444 [INFO][4928] ipam/ipam.go 235: Affinity is confirmed and block has been loaded cidr=192.168.9.0/26 host="ip-172-31-21-124" Nov 4 23:22:15.649614 containerd[1977]: 2025-11-04 23:22:15.445 [INFO][4928] ipam/ipam.go 1219: Attempting to assign 1 addresses from block block=192.168.9.0/26 handle="k8s-pod-network.7687286fe3331cc586f40016f0dc0640ad549c29274715b2bac582686eecc8bc" host="ip-172-31-21-124" Nov 4 23:22:15.649614 containerd[1977]: 2025-11-04 23:22:15.464 [INFO][4928] ipam/ipam.go 1780: Creating new handle: k8s-pod-network.7687286fe3331cc586f40016f0dc0640ad549c29274715b2bac582686eecc8bc Nov 4 23:22:15.649614 containerd[1977]: 2025-11-04 23:22:15.481 [INFO][4928] ipam/ipam.go 1246: Writing block in order to claim IPs block=192.168.9.0/26 handle="k8s-pod-network.7687286fe3331cc586f40016f0dc0640ad549c29274715b2bac582686eecc8bc" host="ip-172-31-21-124" Nov 4 23:22:15.649614 containerd[1977]: 2025-11-04 23:22:15.508 [INFO][4928] ipam/ipam.go 1262: Successfully claimed IPs: [192.168.9.4/26] block=192.168.9.0/26 handle="k8s-pod-network.7687286fe3331cc586f40016f0dc0640ad549c29274715b2bac582686eecc8bc" host="ip-172-31-21-124" Nov 4 23:22:15.649614 containerd[1977]: 2025-11-04 23:22:15.508 [INFO][4928] ipam/ipam.go 878: Auto-assigned 1 out of 1 IPv4s: [192.168.9.4/26] handle="k8s-pod-network.7687286fe3331cc586f40016f0dc0640ad549c29274715b2bac582686eecc8bc" host="ip-172-31-21-124" Nov 4 23:22:15.649614 containerd[1977]: 2025-11-04 23:22:15.510 [INFO][4928] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 4 23:22:15.649614 containerd[1977]: 2025-11-04 23:22:15.510 [INFO][4928] ipam/ipam_plugin.go 299: Calico CNI IPAM assigned addresses IPv4=[192.168.9.4/26] IPv6=[] ContainerID="7687286fe3331cc586f40016f0dc0640ad549c29274715b2bac582686eecc8bc" HandleID="k8s-pod-network.7687286fe3331cc586f40016f0dc0640ad549c29274715b2bac582686eecc8bc" Workload="ip--172--31--21--124-k8s-calico--apiserver--fcc487596--jrhr4-eth0" Nov 4 23:22:15.650888 containerd[1977]: 2025-11-04 23:22:15.536 [INFO][4900] cni-plugin/k8s.go 418: Populated endpoint ContainerID="7687286fe3331cc586f40016f0dc0640ad549c29274715b2bac582686eecc8bc" Namespace="calico-apiserver" Pod="calico-apiserver-fcc487596-jrhr4" WorkloadEndpoint="ip--172--31--21--124-k8s-calico--apiserver--fcc487596--jrhr4-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--21--124-k8s-calico--apiserver--fcc487596--jrhr4-eth0", GenerateName:"calico-apiserver-fcc487596-", Namespace:"calico-apiserver", SelfLink:"", UID:"068373b4-e189-432e-9f0e-0da4317cec26", ResourceVersion:"880", Generation:0, CreationTimestamp:time.Date(2025, time.November, 4, 23, 21, 35, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"apiserver":"true", "app.kubernetes.io/name":"calico-apiserver", "k8s-app":"calico-apiserver", "pod-template-hash":"fcc487596", "projectcalico.org/namespace":"calico-apiserver", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"calico-apiserver"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-21-124", ContainerID:"", Pod:"calico-apiserver-fcc487596-jrhr4", Endpoint:"eth0", ServiceAccountName:"calico-apiserver", IPNetworks:[]string{"192.168.9.4/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-apiserver", "ksa.calico-apiserver.calico-apiserver"}, InterfaceName:"cali7cf82df4573", MAC:"", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 4 23:22:15.650888 containerd[1977]: 2025-11-04 23:22:15.538 [INFO][4900] cni-plugin/k8s.go 419: Calico CNI using IPs: [192.168.9.4/32] ContainerID="7687286fe3331cc586f40016f0dc0640ad549c29274715b2bac582686eecc8bc" Namespace="calico-apiserver" Pod="calico-apiserver-fcc487596-jrhr4" WorkloadEndpoint="ip--172--31--21--124-k8s-calico--apiserver--fcc487596--jrhr4-eth0" Nov 4 23:22:15.650888 containerd[1977]: 2025-11-04 23:22:15.538 [INFO][4900] cni-plugin/dataplane_linux.go 69: Setting the host side veth name to cali7cf82df4573 ContainerID="7687286fe3331cc586f40016f0dc0640ad549c29274715b2bac582686eecc8bc" Namespace="calico-apiserver" Pod="calico-apiserver-fcc487596-jrhr4" WorkloadEndpoint="ip--172--31--21--124-k8s-calico--apiserver--fcc487596--jrhr4-eth0" Nov 4 23:22:15.650888 containerd[1977]: 2025-11-04 23:22:15.570 [INFO][4900] cni-plugin/dataplane_linux.go 508: Disabling IPv4 forwarding ContainerID="7687286fe3331cc586f40016f0dc0640ad549c29274715b2bac582686eecc8bc" Namespace="calico-apiserver" Pod="calico-apiserver-fcc487596-jrhr4" WorkloadEndpoint="ip--172--31--21--124-k8s-calico--apiserver--fcc487596--jrhr4-eth0" Nov 4 23:22:15.650888 containerd[1977]: 2025-11-04 23:22:15.595 [INFO][4900] cni-plugin/k8s.go 446: Added Mac, interface name, and active container ID to endpoint ContainerID="7687286fe3331cc586f40016f0dc0640ad549c29274715b2bac582686eecc8bc" Namespace="calico-apiserver" Pod="calico-apiserver-fcc487596-jrhr4" WorkloadEndpoint="ip--172--31--21--124-k8s-calico--apiserver--fcc487596--jrhr4-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--21--124-k8s-calico--apiserver--fcc487596--jrhr4-eth0", GenerateName:"calico-apiserver-fcc487596-", Namespace:"calico-apiserver", SelfLink:"", UID:"068373b4-e189-432e-9f0e-0da4317cec26", ResourceVersion:"880", Generation:0, CreationTimestamp:time.Date(2025, time.November, 4, 23, 21, 35, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"apiserver":"true", "app.kubernetes.io/name":"calico-apiserver", "k8s-app":"calico-apiserver", "pod-template-hash":"fcc487596", "projectcalico.org/namespace":"calico-apiserver", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"calico-apiserver"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-21-124", ContainerID:"7687286fe3331cc586f40016f0dc0640ad549c29274715b2bac582686eecc8bc", Pod:"calico-apiserver-fcc487596-jrhr4", Endpoint:"eth0", ServiceAccountName:"calico-apiserver", IPNetworks:[]string{"192.168.9.4/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-apiserver", "ksa.calico-apiserver.calico-apiserver"}, InterfaceName:"cali7cf82df4573", MAC:"e2:ff:26:b8:40:ba", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 4 23:22:15.650888 containerd[1977]: 2025-11-04 23:22:15.639 [INFO][4900] cni-plugin/k8s.go 532: Wrote updated endpoint to datastore ContainerID="7687286fe3331cc586f40016f0dc0640ad549c29274715b2bac582686eecc8bc" Namespace="calico-apiserver" Pod="calico-apiserver-fcc487596-jrhr4" WorkloadEndpoint="ip--172--31--21--124-k8s-calico--apiserver--fcc487596--jrhr4-eth0" Nov 4 23:22:15.754094 containerd[1977]: time="2025-11-04T23:22:15.753649966Z" level=info msg="connecting to shim 7687286fe3331cc586f40016f0dc0640ad549c29274715b2bac582686eecc8bc" address="unix:///run/containerd/s/a53e700c508f7a3a50d2a27c3fc99a4142b2602810f03ed56f6b550ac927d79a" namespace=k8s.io protocol=ttrpc version=3 Nov 4 23:22:15.861819 systemd[1]: Started cri-containerd-7687286fe3331cc586f40016f0dc0640ad549c29274715b2bac582686eecc8bc.scope - libcontainer container 7687286fe3331cc586f40016f0dc0640ad549c29274715b2bac582686eecc8bc. Nov 4 23:22:15.886238 containerd[1977]: time="2025-11-04T23:22:15.884509235Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-996fc7fbb-2jd5x,Uid:ab3399c0-cd7b-41d5-bf32-586b469457b8,Namespace:calico-apiserver,Attempt:0,}" Nov 4 23:22:15.887354 systemd-networkd[1573]: vxlan.calico: Gained IPv6LL Nov 4 23:22:15.930755 containerd[1977]: time="2025-11-04T23:22:15.930652391Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-668d6bf9bc-cgqkm,Uid:8bf0c72f-09cc-4446-8c96-244d797ac69d,Namespace:kube-system,Attempt:0,} returns sandbox id \"8cb14b076dade17652452f2bb54a8a3b6e0252566b3e10918145a274da17253c\"" Nov 4 23:22:15.968907 containerd[1977]: time="2025-11-04T23:22:15.968709047Z" level=info msg="CreateContainer within sandbox \"8cb14b076dade17652452f2bb54a8a3b6e0252566b3e10918145a274da17253c\" for container &ContainerMetadata{Name:coredns,Attempt:0,}" Nov 4 23:22:16.035301 containerd[1977]: time="2025-11-04T23:22:16.035196524Z" level=info msg="Container 19d53b77c223dde3329a61bb630989fd63168e317136a6649819f479c0e6c923: CDI devices from CRI Config.CDIDevices: []" Nov 4 23:22:16.058844 containerd[1977]: time="2025-11-04T23:22:16.058626908Z" level=info msg="CreateContainer within sandbox \"8cb14b076dade17652452f2bb54a8a3b6e0252566b3e10918145a274da17253c\" for &ContainerMetadata{Name:coredns,Attempt:0,} returns container id \"19d53b77c223dde3329a61bb630989fd63168e317136a6649819f479c0e6c923\"" Nov 4 23:22:16.061264 containerd[1977]: time="2025-11-04T23:22:16.060347936Z" level=info msg="StartContainer for \"19d53b77c223dde3329a61bb630989fd63168e317136a6649819f479c0e6c923\"" Nov 4 23:22:16.070905 containerd[1977]: time="2025-11-04T23:22:16.070813532Z" level=info msg="connecting to shim 19d53b77c223dde3329a61bb630989fd63168e317136a6649819f479c0e6c923" address="unix:///run/containerd/s/93dac627112d179a39ae76c36e4cd3612088daec7ef7ed6ccbba6b0d0cfd0b9e" protocol=ttrpc version=3 Nov 4 23:22:16.216739 systemd[1]: Started cri-containerd-19d53b77c223dde3329a61bb630989fd63168e317136a6649819f479c0e6c923.scope - libcontainer container 19d53b77c223dde3329a61bb630989fd63168e317136a6649819f479c0e6c923. Nov 4 23:22:16.454767 containerd[1977]: time="2025-11-04T23:22:16.454659802Z" level=info msg="StartContainer for \"19d53b77c223dde3329a61bb630989fd63168e317136a6649819f479c0e6c923\" returns successfully" Nov 4 23:22:16.463108 systemd-networkd[1573]: cali87156d172cb: Gained IPv6LL Nov 4 23:22:16.591479 containerd[1977]: time="2025-11-04T23:22:16.591367114Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-fcc487596-jrhr4,Uid:068373b4-e189-432e-9f0e-0da4317cec26,Namespace:calico-apiserver,Attempt:0,} returns sandbox id \"7687286fe3331cc586f40016f0dc0640ad549c29274715b2bac582686eecc8bc\"" Nov 4 23:22:16.600593 containerd[1977]: time="2025-11-04T23:22:16.600432035Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\"" Nov 4 23:22:16.615823 systemd-networkd[1573]: cali0da873d9a5f: Link UP Nov 4 23:22:16.619174 systemd-networkd[1573]: cali0da873d9a5f: Gained carrier Nov 4 23:22:16.674841 containerd[1977]: 2025-11-04 23:22:16.207 [INFO][5066] cni-plugin/plugin.go 340: Calico CNI found existing endpoint: &{{WorkloadEndpoint projectcalico.org/v3} {ip--172--31--21--124-k8s-calico--apiserver--996fc7fbb--2jd5x-eth0 calico-apiserver-996fc7fbb- calico-apiserver ab3399c0-cd7b-41d5-bf32-586b469457b8 882 0 2025-11-04 23:21:38 +0000 UTC map[apiserver:true app.kubernetes.io/name:calico-apiserver k8s-app:calico-apiserver pod-template-hash:996fc7fbb projectcalico.org/namespace:calico-apiserver projectcalico.org/orchestrator:k8s projectcalico.org/serviceaccount:calico-apiserver] map[] [] [] []} {k8s ip-172-31-21-124 calico-apiserver-996fc7fbb-2jd5x eth0 calico-apiserver [] [] [kns.calico-apiserver ksa.calico-apiserver.calico-apiserver] cali0da873d9a5f [] [] }} ContainerID="d3ee148cdc352f2c941c8ed6e165074b881486465365c6ab78d8b8a9b3f127c7" Namespace="calico-apiserver" Pod="calico-apiserver-996fc7fbb-2jd5x" WorkloadEndpoint="ip--172--31--21--124-k8s-calico--apiserver--996fc7fbb--2jd5x-" Nov 4 23:22:16.674841 containerd[1977]: 2025-11-04 23:22:16.212 [INFO][5066] cni-plugin/k8s.go 74: Extracted identifiers for CmdAddK8s ContainerID="d3ee148cdc352f2c941c8ed6e165074b881486465365c6ab78d8b8a9b3f127c7" Namespace="calico-apiserver" Pod="calico-apiserver-996fc7fbb-2jd5x" WorkloadEndpoint="ip--172--31--21--124-k8s-calico--apiserver--996fc7fbb--2jd5x-eth0" Nov 4 23:22:16.674841 containerd[1977]: 2025-11-04 23:22:16.313 [INFO][5102] ipam/ipam_plugin.go 227: Calico CNI IPAM request count IPv4=1 IPv6=0 ContainerID="d3ee148cdc352f2c941c8ed6e165074b881486465365c6ab78d8b8a9b3f127c7" HandleID="k8s-pod-network.d3ee148cdc352f2c941c8ed6e165074b881486465365c6ab78d8b8a9b3f127c7" Workload="ip--172--31--21--124-k8s-calico--apiserver--996fc7fbb--2jd5x-eth0" Nov 4 23:22:16.674841 containerd[1977]: 2025-11-04 23:22:16.315 [INFO][5102] ipam/ipam_plugin.go 275: Auto assigning IP ContainerID="d3ee148cdc352f2c941c8ed6e165074b881486465365c6ab78d8b8a9b3f127c7" HandleID="k8s-pod-network.d3ee148cdc352f2c941c8ed6e165074b881486465365c6ab78d8b8a9b3f127c7" Workload="ip--172--31--21--124-k8s-calico--apiserver--996fc7fbb--2jd5x-eth0" assignArgs=ipam.AutoAssignArgs{Num4:1, Num6:0, HandleID:(*string)(0x4000102550), Attrs:map[string]string{"namespace":"calico-apiserver", "node":"ip-172-31-21-124", "pod":"calico-apiserver-996fc7fbb-2jd5x", "timestamp":"2025-11-04 23:22:16.313842729 +0000 UTC"}, Hostname:"ip-172-31-21-124", IPv4Pools:[]net.IPNet{}, IPv6Pools:[]net.IPNet{}, MaxBlocksPerHost:0, HostReservedAttrIPv4s:(*ipam.HostReservedAttr)(nil), HostReservedAttrIPv6s:(*ipam.HostReservedAttr)(nil), IntendedUse:"Workload"} Nov 4 23:22:16.674841 containerd[1977]: 2025-11-04 23:22:16.315 [INFO][5102] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 4 23:22:16.674841 containerd[1977]: 2025-11-04 23:22:16.316 [INFO][5102] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 4 23:22:16.674841 containerd[1977]: 2025-11-04 23:22:16.316 [INFO][5102] ipam/ipam.go 110: Auto-assign 1 ipv4, 0 ipv6 addrs for host 'ip-172-31-21-124' Nov 4 23:22:16.674841 containerd[1977]: 2025-11-04 23:22:16.377 [INFO][5102] ipam/ipam.go 691: Looking up existing affinities for host handle="k8s-pod-network.d3ee148cdc352f2c941c8ed6e165074b881486465365c6ab78d8b8a9b3f127c7" host="ip-172-31-21-124" Nov 4 23:22:16.674841 containerd[1977]: 2025-11-04 23:22:16.409 [INFO][5102] ipam/ipam.go 394: Looking up existing affinities for host host="ip-172-31-21-124" Nov 4 23:22:16.674841 containerd[1977]: 2025-11-04 23:22:16.470 [INFO][5102] ipam/ipam.go 511: Trying affinity for 192.168.9.0/26 host="ip-172-31-21-124" Nov 4 23:22:16.674841 containerd[1977]: 2025-11-04 23:22:16.476 [INFO][5102] ipam/ipam.go 158: Attempting to load block cidr=192.168.9.0/26 host="ip-172-31-21-124" Nov 4 23:22:16.674841 containerd[1977]: 2025-11-04 23:22:16.483 [INFO][5102] ipam/ipam.go 235: Affinity is confirmed and block has been loaded cidr=192.168.9.0/26 host="ip-172-31-21-124" Nov 4 23:22:16.674841 containerd[1977]: 2025-11-04 23:22:16.484 [INFO][5102] ipam/ipam.go 1219: Attempting to assign 1 addresses from block block=192.168.9.0/26 handle="k8s-pod-network.d3ee148cdc352f2c941c8ed6e165074b881486465365c6ab78d8b8a9b3f127c7" host="ip-172-31-21-124" Nov 4 23:22:16.674841 containerd[1977]: 2025-11-04 23:22:16.489 [INFO][5102] ipam/ipam.go 1780: Creating new handle: k8s-pod-network.d3ee148cdc352f2c941c8ed6e165074b881486465365c6ab78d8b8a9b3f127c7 Nov 4 23:22:16.674841 containerd[1977]: 2025-11-04 23:22:16.510 [INFO][5102] ipam/ipam.go 1246: Writing block in order to claim IPs block=192.168.9.0/26 handle="k8s-pod-network.d3ee148cdc352f2c941c8ed6e165074b881486465365c6ab78d8b8a9b3f127c7" host="ip-172-31-21-124" Nov 4 23:22:16.674841 containerd[1977]: 2025-11-04 23:22:16.550 [INFO][5102] ipam/ipam.go 1262: Successfully claimed IPs: [192.168.9.5/26] block=192.168.9.0/26 handle="k8s-pod-network.d3ee148cdc352f2c941c8ed6e165074b881486465365c6ab78d8b8a9b3f127c7" host="ip-172-31-21-124" Nov 4 23:22:16.674841 containerd[1977]: 2025-11-04 23:22:16.553 [INFO][5102] ipam/ipam.go 878: Auto-assigned 1 out of 1 IPv4s: [192.168.9.5/26] handle="k8s-pod-network.d3ee148cdc352f2c941c8ed6e165074b881486465365c6ab78d8b8a9b3f127c7" host="ip-172-31-21-124" Nov 4 23:22:16.674841 containerd[1977]: 2025-11-04 23:22:16.555 [INFO][5102] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 4 23:22:16.674841 containerd[1977]: 2025-11-04 23:22:16.555 [INFO][5102] ipam/ipam_plugin.go 299: Calico CNI IPAM assigned addresses IPv4=[192.168.9.5/26] IPv6=[] ContainerID="d3ee148cdc352f2c941c8ed6e165074b881486465365c6ab78d8b8a9b3f127c7" HandleID="k8s-pod-network.d3ee148cdc352f2c941c8ed6e165074b881486465365c6ab78d8b8a9b3f127c7" Workload="ip--172--31--21--124-k8s-calico--apiserver--996fc7fbb--2jd5x-eth0" Nov 4 23:22:16.677405 containerd[1977]: 2025-11-04 23:22:16.589 [INFO][5066] cni-plugin/k8s.go 418: Populated endpoint ContainerID="d3ee148cdc352f2c941c8ed6e165074b881486465365c6ab78d8b8a9b3f127c7" Namespace="calico-apiserver" Pod="calico-apiserver-996fc7fbb-2jd5x" WorkloadEndpoint="ip--172--31--21--124-k8s-calico--apiserver--996fc7fbb--2jd5x-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--21--124-k8s-calico--apiserver--996fc7fbb--2jd5x-eth0", GenerateName:"calico-apiserver-996fc7fbb-", Namespace:"calico-apiserver", SelfLink:"", UID:"ab3399c0-cd7b-41d5-bf32-586b469457b8", ResourceVersion:"882", Generation:0, CreationTimestamp:time.Date(2025, time.November, 4, 23, 21, 38, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"apiserver":"true", "app.kubernetes.io/name":"calico-apiserver", "k8s-app":"calico-apiserver", "pod-template-hash":"996fc7fbb", "projectcalico.org/namespace":"calico-apiserver", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"calico-apiserver"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-21-124", ContainerID:"", Pod:"calico-apiserver-996fc7fbb-2jd5x", Endpoint:"eth0", ServiceAccountName:"calico-apiserver", IPNetworks:[]string{"192.168.9.5/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-apiserver", "ksa.calico-apiserver.calico-apiserver"}, InterfaceName:"cali0da873d9a5f", MAC:"", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 4 23:22:16.677405 containerd[1977]: 2025-11-04 23:22:16.590 [INFO][5066] cni-plugin/k8s.go 419: Calico CNI using IPs: [192.168.9.5/32] ContainerID="d3ee148cdc352f2c941c8ed6e165074b881486465365c6ab78d8b8a9b3f127c7" Namespace="calico-apiserver" Pod="calico-apiserver-996fc7fbb-2jd5x" WorkloadEndpoint="ip--172--31--21--124-k8s-calico--apiserver--996fc7fbb--2jd5x-eth0" Nov 4 23:22:16.677405 containerd[1977]: 2025-11-04 23:22:16.590 [INFO][5066] cni-plugin/dataplane_linux.go 69: Setting the host side veth name to cali0da873d9a5f ContainerID="d3ee148cdc352f2c941c8ed6e165074b881486465365c6ab78d8b8a9b3f127c7" Namespace="calico-apiserver" Pod="calico-apiserver-996fc7fbb-2jd5x" WorkloadEndpoint="ip--172--31--21--124-k8s-calico--apiserver--996fc7fbb--2jd5x-eth0" Nov 4 23:22:16.677405 containerd[1977]: 2025-11-04 23:22:16.624 [INFO][5066] cni-plugin/dataplane_linux.go 508: Disabling IPv4 forwarding ContainerID="d3ee148cdc352f2c941c8ed6e165074b881486465365c6ab78d8b8a9b3f127c7" Namespace="calico-apiserver" Pod="calico-apiserver-996fc7fbb-2jd5x" WorkloadEndpoint="ip--172--31--21--124-k8s-calico--apiserver--996fc7fbb--2jd5x-eth0" Nov 4 23:22:16.677405 containerd[1977]: 2025-11-04 23:22:16.627 [INFO][5066] cni-plugin/k8s.go 446: Added Mac, interface name, and active container ID to endpoint ContainerID="d3ee148cdc352f2c941c8ed6e165074b881486465365c6ab78d8b8a9b3f127c7" Namespace="calico-apiserver" Pod="calico-apiserver-996fc7fbb-2jd5x" WorkloadEndpoint="ip--172--31--21--124-k8s-calico--apiserver--996fc7fbb--2jd5x-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--21--124-k8s-calico--apiserver--996fc7fbb--2jd5x-eth0", GenerateName:"calico-apiserver-996fc7fbb-", Namespace:"calico-apiserver", SelfLink:"", UID:"ab3399c0-cd7b-41d5-bf32-586b469457b8", ResourceVersion:"882", Generation:0, CreationTimestamp:time.Date(2025, time.November, 4, 23, 21, 38, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"apiserver":"true", "app.kubernetes.io/name":"calico-apiserver", "k8s-app":"calico-apiserver", "pod-template-hash":"996fc7fbb", "projectcalico.org/namespace":"calico-apiserver", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"calico-apiserver"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-21-124", ContainerID:"d3ee148cdc352f2c941c8ed6e165074b881486465365c6ab78d8b8a9b3f127c7", Pod:"calico-apiserver-996fc7fbb-2jd5x", Endpoint:"eth0", ServiceAccountName:"calico-apiserver", IPNetworks:[]string{"192.168.9.5/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-apiserver", "ksa.calico-apiserver.calico-apiserver"}, InterfaceName:"cali0da873d9a5f", MAC:"a6:2c:22:f7:9b:cb", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 4 23:22:16.677405 containerd[1977]: 2025-11-04 23:22:16.665 [INFO][5066] cni-plugin/k8s.go 532: Wrote updated endpoint to datastore ContainerID="d3ee148cdc352f2c941c8ed6e165074b881486465365c6ab78d8b8a9b3f127c7" Namespace="calico-apiserver" Pod="calico-apiserver-996fc7fbb-2jd5x" WorkloadEndpoint="ip--172--31--21--124-k8s-calico--apiserver--996fc7fbb--2jd5x-eth0" Nov 4 23:22:16.735464 containerd[1977]: time="2025-11-04T23:22:16.735360575Z" level=info msg="connecting to shim d3ee148cdc352f2c941c8ed6e165074b881486465365c6ab78d8b8a9b3f127c7" address="unix:///run/containerd/s/e2993f972f65d7e61f633ff0f2d166d76261bb2c11d179c9d4ee2167d1cabcd9" namespace=k8s.io protocol=ttrpc version=3 Nov 4 23:22:16.843552 systemd[1]: Started cri-containerd-d3ee148cdc352f2c941c8ed6e165074b881486465365c6ab78d8b8a9b3f127c7.scope - libcontainer container d3ee148cdc352f2c941c8ed6e165074b881486465365c6ab78d8b8a9b3f127c7. Nov 4 23:22:16.860414 containerd[1977]: time="2025-11-04T23:22:16.858801636Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-fcc487596-l2mz4,Uid:af7a1c92-78ca-4756-b8d2-4992b60e6f17,Namespace:calico-apiserver,Attempt:0,}" Nov 4 23:22:16.860784 containerd[1977]: time="2025-11-04T23:22:16.859601352Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:csi-node-driver-5fvm8,Uid:0d16ca69-85e0-4dac-8492-1209e5dd061d,Namespace:calico-system,Attempt:0,}" Nov 4 23:22:16.861789 containerd[1977]: time="2025-11-04T23:22:16.861667920Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:goldmane-666569f655-lxlsr,Uid:cdd3b3e0-4537-4eef-a9c5-bf20b3379786,Namespace:calico-system,Attempt:0,}" Nov 4 23:22:16.872590 containerd[1977]: time="2025-11-04T23:22:16.872473176Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-668d6bf9bc-c6r4j,Uid:79763791-1744-4b74-b191-e2b76075f709,Namespace:kube-system,Attempt:0,}" Nov 4 23:22:16.885276 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount662867781.mount: Deactivated successfully. Nov 4 23:22:16.898390 containerd[1977]: time="2025-11-04T23:22:16.898001880Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:22:16.941310 containerd[1977]: time="2025-11-04T23:22:16.940063332Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" Nov 4 23:22:16.942229 containerd[1977]: time="2025-11-04T23:22:16.941804604Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/apiserver:v3.30.4: active requests=0, bytes read=77" Nov 4 23:22:16.942417 kubelet[3293]: E1104 23:22:16.942005 3293 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 4 23:22:16.942417 kubelet[3293]: E1104 23:22:16.942108 3293 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 4 23:22:16.946225 kubelet[3293]: E1104 23:22:16.943716 3293 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:calico-apiserver,Image:ghcr.io/flatcar/calico/apiserver:v3.30.4,Command:[],Args:[--secure-port=5443 --tls-private-key-file=/calico-apiserver-certs/tls.key --tls-cert-file=/calico-apiserver-certs/tls.crt],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:LOG_LEVEL,Value:info,ValueFrom:nil,},EnvVar{Name:MULTI_INTERFACE_MODE,Value:none,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:calico-apiserver-certs,ReadOnly:true,MountPath:/calico-apiserver-certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-z9769,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 5443 },Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-apiserver-fcc487596-jrhr4_calico-apiserver(068373b4-e189-432e-9f0e-0da4317cec26): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" logger="UnhandledError" Nov 4 23:22:16.948285 kubelet[3293]: E1104 23:22:16.947159 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-fcc487596-jrhr4" podUID="068373b4-e189-432e-9f0e-0da4317cec26" Nov 4 23:22:17.102394 systemd-networkd[1573]: cali7cf82df4573: Gained IPv6LL Nov 4 23:22:17.232630 containerd[1977]: time="2025-11-04T23:22:17.231593806Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-996fc7fbb-2jd5x,Uid:ab3399c0-cd7b-41d5-bf32-586b469457b8,Namespace:calico-apiserver,Attempt:0,} returns sandbox id \"d3ee148cdc352f2c941c8ed6e165074b881486465365c6ab78d8b8a9b3f127c7\"" Nov 4 23:22:17.243636 containerd[1977]: time="2025-11-04T23:22:17.243028798Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\"" Nov 4 23:22:17.386122 kubelet[3293]: E1104 23:22:17.385590 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-fcc487596-jrhr4" podUID="068373b4-e189-432e-9f0e-0da4317cec26" Nov 4 23:22:17.534245 kubelet[3293]: I1104 23:22:17.530859 3293 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/coredns-668d6bf9bc-cgqkm" podStartSLOduration=57.530831879 podStartE2EDuration="57.530831879s" podCreationTimestamp="2025-11-04 23:21:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-04 23:22:17.524503055 +0000 UTC m=+62.127166545" watchObservedRunningTime="2025-11-04 23:22:17.530831879 +0000 UTC m=+62.133495357" Nov 4 23:22:17.603716 containerd[1977]: time="2025-11-04T23:22:17.603656196Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:22:17.607828 containerd[1977]: time="2025-11-04T23:22:17.607755408Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/apiserver:v3.30.4: active requests=0, bytes read=77" Nov 4 23:22:17.608417 containerd[1977]: time="2025-11-04T23:22:17.608167356Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" Nov 4 23:22:17.611132 kubelet[3293]: E1104 23:22:17.610923 3293 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 4 23:22:17.611458 kubelet[3293]: E1104 23:22:17.611122 3293 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 4 23:22:17.612039 kubelet[3293]: E1104 23:22:17.611832 3293 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:calico-apiserver,Image:ghcr.io/flatcar/calico/apiserver:v3.30.4,Command:[],Args:[--secure-port=5443 --tls-private-key-file=/calico-apiserver-certs/tls.key --tls-cert-file=/calico-apiserver-certs/tls.crt],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:LOG_LEVEL,Value:info,ValueFrom:nil,},EnvVar{Name:MULTI_INTERFACE_MODE,Value:none,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:calico-apiserver-certs,ReadOnly:true,MountPath:/calico-apiserver-certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-mpg72,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 5443 },Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-apiserver-996fc7fbb-2jd5x_calico-apiserver(ab3399c0-cd7b-41d5-bf32-586b469457b8): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" logger="UnhandledError" Nov 4 23:22:17.615507 kubelet[3293]: E1104 23:22:17.613652 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-996fc7fbb-2jd5x" podUID="ab3399c0-cd7b-41d5-bf32-586b469457b8" Nov 4 23:22:17.626157 systemd-networkd[1573]: calibd4f50a0c75: Link UP Nov 4 23:22:17.631520 systemd-networkd[1573]: calibd4f50a0c75: Gained carrier Nov 4 23:22:17.684477 containerd[1977]: 2025-11-04 23:22:17.188 [INFO][5189] cni-plugin/plugin.go 340: Calico CNI found existing endpoint: &{{WorkloadEndpoint projectcalico.org/v3} {ip--172--31--21--124-k8s-calico--apiserver--fcc487596--l2mz4-eth0 calico-apiserver-fcc487596- calico-apiserver af7a1c92-78ca-4756-b8d2-4992b60e6f17 881 0 2025-11-04 23:21:35 +0000 UTC map[apiserver:true app.kubernetes.io/name:calico-apiserver k8s-app:calico-apiserver pod-template-hash:fcc487596 projectcalico.org/namespace:calico-apiserver projectcalico.org/orchestrator:k8s projectcalico.org/serviceaccount:calico-apiserver] map[] [] [] []} {k8s ip-172-31-21-124 calico-apiserver-fcc487596-l2mz4 eth0 calico-apiserver [] [] [kns.calico-apiserver ksa.calico-apiserver.calico-apiserver] calibd4f50a0c75 [] [] }} ContainerID="20999f9a82c4268772485a7f3f654ef2923ede5a3b1101e6b6970cd6233adca4" Namespace="calico-apiserver" Pod="calico-apiserver-fcc487596-l2mz4" WorkloadEndpoint="ip--172--31--21--124-k8s-calico--apiserver--fcc487596--l2mz4-" Nov 4 23:22:17.684477 containerd[1977]: 2025-11-04 23:22:17.189 [INFO][5189] cni-plugin/k8s.go 74: Extracted identifiers for CmdAddK8s ContainerID="20999f9a82c4268772485a7f3f654ef2923ede5a3b1101e6b6970cd6233adca4" Namespace="calico-apiserver" Pod="calico-apiserver-fcc487596-l2mz4" WorkloadEndpoint="ip--172--31--21--124-k8s-calico--apiserver--fcc487596--l2mz4-eth0" Nov 4 23:22:17.684477 containerd[1977]: 2025-11-04 23:22:17.326 [INFO][5242] ipam/ipam_plugin.go 227: Calico CNI IPAM request count IPv4=1 IPv6=0 ContainerID="20999f9a82c4268772485a7f3f654ef2923ede5a3b1101e6b6970cd6233adca4" HandleID="k8s-pod-network.20999f9a82c4268772485a7f3f654ef2923ede5a3b1101e6b6970cd6233adca4" Workload="ip--172--31--21--124-k8s-calico--apiserver--fcc487596--l2mz4-eth0" Nov 4 23:22:17.684477 containerd[1977]: 2025-11-04 23:22:17.327 [INFO][5242] ipam/ipam_plugin.go 275: Auto assigning IP ContainerID="20999f9a82c4268772485a7f3f654ef2923ede5a3b1101e6b6970cd6233adca4" HandleID="k8s-pod-network.20999f9a82c4268772485a7f3f654ef2923ede5a3b1101e6b6970cd6233adca4" Workload="ip--172--31--21--124-k8s-calico--apiserver--fcc487596--l2mz4-eth0" assignArgs=ipam.AutoAssignArgs{Num4:1, Num6:0, HandleID:(*string)(0x4000339ec0), Attrs:map[string]string{"namespace":"calico-apiserver", "node":"ip-172-31-21-124", "pod":"calico-apiserver-fcc487596-l2mz4", "timestamp":"2025-11-04 23:22:17.326847886 +0000 UTC"}, Hostname:"ip-172-31-21-124", IPv4Pools:[]net.IPNet{}, IPv6Pools:[]net.IPNet{}, MaxBlocksPerHost:0, HostReservedAttrIPv4s:(*ipam.HostReservedAttr)(nil), HostReservedAttrIPv6s:(*ipam.HostReservedAttr)(nil), IntendedUse:"Workload"} Nov 4 23:22:17.684477 containerd[1977]: 2025-11-04 23:22:17.328 [INFO][5242] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 4 23:22:17.684477 containerd[1977]: 2025-11-04 23:22:17.328 [INFO][5242] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 4 23:22:17.684477 containerd[1977]: 2025-11-04 23:22:17.328 [INFO][5242] ipam/ipam.go 110: Auto-assign 1 ipv4, 0 ipv6 addrs for host 'ip-172-31-21-124' Nov 4 23:22:17.684477 containerd[1977]: 2025-11-04 23:22:17.370 [INFO][5242] ipam/ipam.go 691: Looking up existing affinities for host handle="k8s-pod-network.20999f9a82c4268772485a7f3f654ef2923ede5a3b1101e6b6970cd6233adca4" host="ip-172-31-21-124" Nov 4 23:22:17.684477 containerd[1977]: 2025-11-04 23:22:17.403 [INFO][5242] ipam/ipam.go 394: Looking up existing affinities for host host="ip-172-31-21-124" Nov 4 23:22:17.684477 containerd[1977]: 2025-11-04 23:22:17.422 [INFO][5242] ipam/ipam.go 511: Trying affinity for 192.168.9.0/26 host="ip-172-31-21-124" Nov 4 23:22:17.684477 containerd[1977]: 2025-11-04 23:22:17.443 [INFO][5242] ipam/ipam.go 158: Attempting to load block cidr=192.168.9.0/26 host="ip-172-31-21-124" Nov 4 23:22:17.684477 containerd[1977]: 2025-11-04 23:22:17.496 [INFO][5242] ipam/ipam.go 235: Affinity is confirmed and block has been loaded cidr=192.168.9.0/26 host="ip-172-31-21-124" Nov 4 23:22:17.684477 containerd[1977]: 2025-11-04 23:22:17.496 [INFO][5242] ipam/ipam.go 1219: Attempting to assign 1 addresses from block block=192.168.9.0/26 handle="k8s-pod-network.20999f9a82c4268772485a7f3f654ef2923ede5a3b1101e6b6970cd6233adca4" host="ip-172-31-21-124" Nov 4 23:22:17.684477 containerd[1977]: 2025-11-04 23:22:17.518 [INFO][5242] ipam/ipam.go 1780: Creating new handle: k8s-pod-network.20999f9a82c4268772485a7f3f654ef2923ede5a3b1101e6b6970cd6233adca4 Nov 4 23:22:17.684477 containerd[1977]: 2025-11-04 23:22:17.553 [INFO][5242] ipam/ipam.go 1246: Writing block in order to claim IPs block=192.168.9.0/26 handle="k8s-pod-network.20999f9a82c4268772485a7f3f654ef2923ede5a3b1101e6b6970cd6233adca4" host="ip-172-31-21-124" Nov 4 23:22:17.684477 containerd[1977]: 2025-11-04 23:22:17.589 [INFO][5242] ipam/ipam.go 1262: Successfully claimed IPs: [192.168.9.6/26] block=192.168.9.0/26 handle="k8s-pod-network.20999f9a82c4268772485a7f3f654ef2923ede5a3b1101e6b6970cd6233adca4" host="ip-172-31-21-124" Nov 4 23:22:17.684477 containerd[1977]: 2025-11-04 23:22:17.589 [INFO][5242] ipam/ipam.go 878: Auto-assigned 1 out of 1 IPv4s: [192.168.9.6/26] handle="k8s-pod-network.20999f9a82c4268772485a7f3f654ef2923ede5a3b1101e6b6970cd6233adca4" host="ip-172-31-21-124" Nov 4 23:22:17.684477 containerd[1977]: 2025-11-04 23:22:17.590 [INFO][5242] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 4 23:22:17.684477 containerd[1977]: 2025-11-04 23:22:17.590 [INFO][5242] ipam/ipam_plugin.go 299: Calico CNI IPAM assigned addresses IPv4=[192.168.9.6/26] IPv6=[] ContainerID="20999f9a82c4268772485a7f3f654ef2923ede5a3b1101e6b6970cd6233adca4" HandleID="k8s-pod-network.20999f9a82c4268772485a7f3f654ef2923ede5a3b1101e6b6970cd6233adca4" Workload="ip--172--31--21--124-k8s-calico--apiserver--fcc487596--l2mz4-eth0" Nov 4 23:22:17.689070 containerd[1977]: 2025-11-04 23:22:17.608 [INFO][5189] cni-plugin/k8s.go 418: Populated endpoint ContainerID="20999f9a82c4268772485a7f3f654ef2923ede5a3b1101e6b6970cd6233adca4" Namespace="calico-apiserver" Pod="calico-apiserver-fcc487596-l2mz4" WorkloadEndpoint="ip--172--31--21--124-k8s-calico--apiserver--fcc487596--l2mz4-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--21--124-k8s-calico--apiserver--fcc487596--l2mz4-eth0", GenerateName:"calico-apiserver-fcc487596-", Namespace:"calico-apiserver", SelfLink:"", UID:"af7a1c92-78ca-4756-b8d2-4992b60e6f17", ResourceVersion:"881", Generation:0, CreationTimestamp:time.Date(2025, time.November, 4, 23, 21, 35, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"apiserver":"true", "app.kubernetes.io/name":"calico-apiserver", "k8s-app":"calico-apiserver", "pod-template-hash":"fcc487596", "projectcalico.org/namespace":"calico-apiserver", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"calico-apiserver"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-21-124", ContainerID:"", Pod:"calico-apiserver-fcc487596-l2mz4", Endpoint:"eth0", ServiceAccountName:"calico-apiserver", IPNetworks:[]string{"192.168.9.6/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-apiserver", "ksa.calico-apiserver.calico-apiserver"}, InterfaceName:"calibd4f50a0c75", MAC:"", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 4 23:22:17.689070 containerd[1977]: 2025-11-04 23:22:17.610 [INFO][5189] cni-plugin/k8s.go 419: Calico CNI using IPs: [192.168.9.6/32] ContainerID="20999f9a82c4268772485a7f3f654ef2923ede5a3b1101e6b6970cd6233adca4" Namespace="calico-apiserver" Pod="calico-apiserver-fcc487596-l2mz4" WorkloadEndpoint="ip--172--31--21--124-k8s-calico--apiserver--fcc487596--l2mz4-eth0" Nov 4 23:22:17.689070 containerd[1977]: 2025-11-04 23:22:17.611 [INFO][5189] cni-plugin/dataplane_linux.go 69: Setting the host side veth name to calibd4f50a0c75 ContainerID="20999f9a82c4268772485a7f3f654ef2923ede5a3b1101e6b6970cd6233adca4" Namespace="calico-apiserver" Pod="calico-apiserver-fcc487596-l2mz4" WorkloadEndpoint="ip--172--31--21--124-k8s-calico--apiserver--fcc487596--l2mz4-eth0" Nov 4 23:22:17.689070 containerd[1977]: 2025-11-04 23:22:17.631 [INFO][5189] cni-plugin/dataplane_linux.go 508: Disabling IPv4 forwarding ContainerID="20999f9a82c4268772485a7f3f654ef2923ede5a3b1101e6b6970cd6233adca4" Namespace="calico-apiserver" Pod="calico-apiserver-fcc487596-l2mz4" WorkloadEndpoint="ip--172--31--21--124-k8s-calico--apiserver--fcc487596--l2mz4-eth0" Nov 4 23:22:17.689070 containerd[1977]: 2025-11-04 23:22:17.642 [INFO][5189] cni-plugin/k8s.go 446: Added Mac, interface name, and active container ID to endpoint ContainerID="20999f9a82c4268772485a7f3f654ef2923ede5a3b1101e6b6970cd6233adca4" Namespace="calico-apiserver" Pod="calico-apiserver-fcc487596-l2mz4" WorkloadEndpoint="ip--172--31--21--124-k8s-calico--apiserver--fcc487596--l2mz4-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--21--124-k8s-calico--apiserver--fcc487596--l2mz4-eth0", GenerateName:"calico-apiserver-fcc487596-", Namespace:"calico-apiserver", SelfLink:"", UID:"af7a1c92-78ca-4756-b8d2-4992b60e6f17", ResourceVersion:"881", Generation:0, CreationTimestamp:time.Date(2025, time.November, 4, 23, 21, 35, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"apiserver":"true", "app.kubernetes.io/name":"calico-apiserver", "k8s-app":"calico-apiserver", "pod-template-hash":"fcc487596", "projectcalico.org/namespace":"calico-apiserver", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"calico-apiserver"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-21-124", ContainerID:"20999f9a82c4268772485a7f3f654ef2923ede5a3b1101e6b6970cd6233adca4", Pod:"calico-apiserver-fcc487596-l2mz4", Endpoint:"eth0", ServiceAccountName:"calico-apiserver", IPNetworks:[]string{"192.168.9.6/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-apiserver", "ksa.calico-apiserver.calico-apiserver"}, InterfaceName:"calibd4f50a0c75", MAC:"62:fc:79:ec:87:ca", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 4 23:22:17.689070 containerd[1977]: 2025-11-04 23:22:17.677 [INFO][5189] cni-plugin/k8s.go 532: Wrote updated endpoint to datastore ContainerID="20999f9a82c4268772485a7f3f654ef2923ede5a3b1101e6b6970cd6233adca4" Namespace="calico-apiserver" Pod="calico-apiserver-fcc487596-l2mz4" WorkloadEndpoint="ip--172--31--21--124-k8s-calico--apiserver--fcc487596--l2mz4-eth0" Nov 4 23:22:17.780490 systemd-networkd[1573]: calicc6077f3144: Link UP Nov 4 23:22:17.781055 systemd-networkd[1573]: calicc6077f3144: Gained carrier Nov 4 23:22:17.796252 containerd[1977]: time="2025-11-04T23:22:17.795712512Z" level=info msg="connecting to shim 20999f9a82c4268772485a7f3f654ef2923ede5a3b1101e6b6970cd6233adca4" address="unix:///run/containerd/s/c4bb0cb0c3f55c75cfdd6aace739a51e6ab7175a5ade181eaab5be972fde0dd7" namespace=k8s.io protocol=ttrpc version=3 Nov 4 23:22:17.837652 containerd[1977]: 2025-11-04 23:22:17.178 [INFO][5182] cni-plugin/plugin.go 340: Calico CNI found existing endpoint: &{{WorkloadEndpoint projectcalico.org/v3} {ip--172--31--21--124-k8s-csi--node--driver--5fvm8-eth0 csi-node-driver- calico-system 0d16ca69-85e0-4dac-8492-1209e5dd061d 777 0 2025-11-04 23:21:52 +0000 UTC map[app.kubernetes.io/name:csi-node-driver controller-revision-hash:857b56db8f k8s-app:csi-node-driver name:csi-node-driver pod-template-generation:1 projectcalico.org/namespace:calico-system projectcalico.org/orchestrator:k8s projectcalico.org/serviceaccount:csi-node-driver] map[] [] [] []} {k8s ip-172-31-21-124 csi-node-driver-5fvm8 eth0 csi-node-driver [] [] [kns.calico-system ksa.calico-system.csi-node-driver] calicc6077f3144 [] [] }} ContainerID="1ab60b57866cda617c36f7cc651b346b87609842690a8cb8cb4e21e660dfb9f3" Namespace="calico-system" Pod="csi-node-driver-5fvm8" WorkloadEndpoint="ip--172--31--21--124-k8s-csi--node--driver--5fvm8-" Nov 4 23:22:17.837652 containerd[1977]: 2025-11-04 23:22:17.178 [INFO][5182] cni-plugin/k8s.go 74: Extracted identifiers for CmdAddK8s ContainerID="1ab60b57866cda617c36f7cc651b346b87609842690a8cb8cb4e21e660dfb9f3" Namespace="calico-system" Pod="csi-node-driver-5fvm8" WorkloadEndpoint="ip--172--31--21--124-k8s-csi--node--driver--5fvm8-eth0" Nov 4 23:22:17.837652 containerd[1977]: 2025-11-04 23:22:17.375 [INFO][5240] ipam/ipam_plugin.go 227: Calico CNI IPAM request count IPv4=1 IPv6=0 ContainerID="1ab60b57866cda617c36f7cc651b346b87609842690a8cb8cb4e21e660dfb9f3" HandleID="k8s-pod-network.1ab60b57866cda617c36f7cc651b346b87609842690a8cb8cb4e21e660dfb9f3" Workload="ip--172--31--21--124-k8s-csi--node--driver--5fvm8-eth0" Nov 4 23:22:17.837652 containerd[1977]: 2025-11-04 23:22:17.375 [INFO][5240] ipam/ipam_plugin.go 275: Auto assigning IP ContainerID="1ab60b57866cda617c36f7cc651b346b87609842690a8cb8cb4e21e660dfb9f3" HandleID="k8s-pod-network.1ab60b57866cda617c36f7cc651b346b87609842690a8cb8cb4e21e660dfb9f3" Workload="ip--172--31--21--124-k8s-csi--node--driver--5fvm8-eth0" assignArgs=ipam.AutoAssignArgs{Num4:1, Num6:0, HandleID:(*string)(0x4000103d20), Attrs:map[string]string{"namespace":"calico-system", "node":"ip-172-31-21-124", "pod":"csi-node-driver-5fvm8", "timestamp":"2025-11-04 23:22:17.375402286 +0000 UTC"}, Hostname:"ip-172-31-21-124", IPv4Pools:[]net.IPNet{}, IPv6Pools:[]net.IPNet{}, MaxBlocksPerHost:0, HostReservedAttrIPv4s:(*ipam.HostReservedAttr)(nil), HostReservedAttrIPv6s:(*ipam.HostReservedAttr)(nil), IntendedUse:"Workload"} Nov 4 23:22:17.837652 containerd[1977]: 2025-11-04 23:22:17.375 [INFO][5240] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 4 23:22:17.837652 containerd[1977]: 2025-11-04 23:22:17.590 [INFO][5240] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 4 23:22:17.837652 containerd[1977]: 2025-11-04 23:22:17.590 [INFO][5240] ipam/ipam.go 110: Auto-assign 1 ipv4, 0 ipv6 addrs for host 'ip-172-31-21-124' Nov 4 23:22:17.837652 containerd[1977]: 2025-11-04 23:22:17.657 [INFO][5240] ipam/ipam.go 691: Looking up existing affinities for host handle="k8s-pod-network.1ab60b57866cda617c36f7cc651b346b87609842690a8cb8cb4e21e660dfb9f3" host="ip-172-31-21-124" Nov 4 23:22:17.837652 containerd[1977]: 2025-11-04 23:22:17.678 [INFO][5240] ipam/ipam.go 394: Looking up existing affinities for host host="ip-172-31-21-124" Nov 4 23:22:17.837652 containerd[1977]: 2025-11-04 23:22:17.698 [INFO][5240] ipam/ipam.go 511: Trying affinity for 192.168.9.0/26 host="ip-172-31-21-124" Nov 4 23:22:17.837652 containerd[1977]: 2025-11-04 23:22:17.704 [INFO][5240] ipam/ipam.go 158: Attempting to load block cidr=192.168.9.0/26 host="ip-172-31-21-124" Nov 4 23:22:17.837652 containerd[1977]: 2025-11-04 23:22:17.717 [INFO][5240] ipam/ipam.go 235: Affinity is confirmed and block has been loaded cidr=192.168.9.0/26 host="ip-172-31-21-124" Nov 4 23:22:17.837652 containerd[1977]: 2025-11-04 23:22:17.718 [INFO][5240] ipam/ipam.go 1219: Attempting to assign 1 addresses from block block=192.168.9.0/26 handle="k8s-pod-network.1ab60b57866cda617c36f7cc651b346b87609842690a8cb8cb4e21e660dfb9f3" host="ip-172-31-21-124" Nov 4 23:22:17.837652 containerd[1977]: 2025-11-04 23:22:17.724 [INFO][5240] ipam/ipam.go 1780: Creating new handle: k8s-pod-network.1ab60b57866cda617c36f7cc651b346b87609842690a8cb8cb4e21e660dfb9f3 Nov 4 23:22:17.837652 containerd[1977]: 2025-11-04 23:22:17.738 [INFO][5240] ipam/ipam.go 1246: Writing block in order to claim IPs block=192.168.9.0/26 handle="k8s-pod-network.1ab60b57866cda617c36f7cc651b346b87609842690a8cb8cb4e21e660dfb9f3" host="ip-172-31-21-124" Nov 4 23:22:17.837652 containerd[1977]: 2025-11-04 23:22:17.752 [INFO][5240] ipam/ipam.go 1262: Successfully claimed IPs: [192.168.9.7/26] block=192.168.9.0/26 handle="k8s-pod-network.1ab60b57866cda617c36f7cc651b346b87609842690a8cb8cb4e21e660dfb9f3" host="ip-172-31-21-124" Nov 4 23:22:17.837652 containerd[1977]: 2025-11-04 23:22:17.752 [INFO][5240] ipam/ipam.go 878: Auto-assigned 1 out of 1 IPv4s: [192.168.9.7/26] handle="k8s-pod-network.1ab60b57866cda617c36f7cc651b346b87609842690a8cb8cb4e21e660dfb9f3" host="ip-172-31-21-124" Nov 4 23:22:17.837652 containerd[1977]: 2025-11-04 23:22:17.752 [INFO][5240] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 4 23:22:17.837652 containerd[1977]: 2025-11-04 23:22:17.752 [INFO][5240] ipam/ipam_plugin.go 299: Calico CNI IPAM assigned addresses IPv4=[192.168.9.7/26] IPv6=[] ContainerID="1ab60b57866cda617c36f7cc651b346b87609842690a8cb8cb4e21e660dfb9f3" HandleID="k8s-pod-network.1ab60b57866cda617c36f7cc651b346b87609842690a8cb8cb4e21e660dfb9f3" Workload="ip--172--31--21--124-k8s-csi--node--driver--5fvm8-eth0" Nov 4 23:22:17.841043 containerd[1977]: 2025-11-04 23:22:17.761 [INFO][5182] cni-plugin/k8s.go 418: Populated endpoint ContainerID="1ab60b57866cda617c36f7cc651b346b87609842690a8cb8cb4e21e660dfb9f3" Namespace="calico-system" Pod="csi-node-driver-5fvm8" WorkloadEndpoint="ip--172--31--21--124-k8s-csi--node--driver--5fvm8-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--21--124-k8s-csi--node--driver--5fvm8-eth0", GenerateName:"csi-node-driver-", Namespace:"calico-system", SelfLink:"", UID:"0d16ca69-85e0-4dac-8492-1209e5dd061d", ResourceVersion:"777", Generation:0, CreationTimestamp:time.Date(2025, time.November, 4, 23, 21, 52, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app.kubernetes.io/name":"csi-node-driver", "controller-revision-hash":"857b56db8f", "k8s-app":"csi-node-driver", "name":"csi-node-driver", "pod-template-generation":"1", "projectcalico.org/namespace":"calico-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"csi-node-driver"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-21-124", ContainerID:"", Pod:"csi-node-driver-5fvm8", Endpoint:"eth0", ServiceAccountName:"csi-node-driver", IPNetworks:[]string{"192.168.9.7/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-system", "ksa.calico-system.csi-node-driver"}, InterfaceName:"calicc6077f3144", MAC:"", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 4 23:22:17.841043 containerd[1977]: 2025-11-04 23:22:17.761 [INFO][5182] cni-plugin/k8s.go 419: Calico CNI using IPs: [192.168.9.7/32] ContainerID="1ab60b57866cda617c36f7cc651b346b87609842690a8cb8cb4e21e660dfb9f3" Namespace="calico-system" Pod="csi-node-driver-5fvm8" WorkloadEndpoint="ip--172--31--21--124-k8s-csi--node--driver--5fvm8-eth0" Nov 4 23:22:17.841043 containerd[1977]: 2025-11-04 23:22:17.762 [INFO][5182] cni-plugin/dataplane_linux.go 69: Setting the host side veth name to calicc6077f3144 ContainerID="1ab60b57866cda617c36f7cc651b346b87609842690a8cb8cb4e21e660dfb9f3" Namespace="calico-system" Pod="csi-node-driver-5fvm8" WorkloadEndpoint="ip--172--31--21--124-k8s-csi--node--driver--5fvm8-eth0" Nov 4 23:22:17.841043 containerd[1977]: 2025-11-04 23:22:17.785 [INFO][5182] cni-plugin/dataplane_linux.go 508: Disabling IPv4 forwarding ContainerID="1ab60b57866cda617c36f7cc651b346b87609842690a8cb8cb4e21e660dfb9f3" Namespace="calico-system" Pod="csi-node-driver-5fvm8" WorkloadEndpoint="ip--172--31--21--124-k8s-csi--node--driver--5fvm8-eth0" Nov 4 23:22:17.841043 containerd[1977]: 2025-11-04 23:22:17.790 [INFO][5182] cni-plugin/k8s.go 446: Added Mac, interface name, and active container ID to endpoint ContainerID="1ab60b57866cda617c36f7cc651b346b87609842690a8cb8cb4e21e660dfb9f3" Namespace="calico-system" Pod="csi-node-driver-5fvm8" WorkloadEndpoint="ip--172--31--21--124-k8s-csi--node--driver--5fvm8-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--21--124-k8s-csi--node--driver--5fvm8-eth0", GenerateName:"csi-node-driver-", Namespace:"calico-system", SelfLink:"", UID:"0d16ca69-85e0-4dac-8492-1209e5dd061d", ResourceVersion:"777", Generation:0, CreationTimestamp:time.Date(2025, time.November, 4, 23, 21, 52, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app.kubernetes.io/name":"csi-node-driver", "controller-revision-hash":"857b56db8f", "k8s-app":"csi-node-driver", "name":"csi-node-driver", "pod-template-generation":"1", "projectcalico.org/namespace":"calico-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"csi-node-driver"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-21-124", ContainerID:"1ab60b57866cda617c36f7cc651b346b87609842690a8cb8cb4e21e660dfb9f3", Pod:"csi-node-driver-5fvm8", Endpoint:"eth0", ServiceAccountName:"csi-node-driver", IPNetworks:[]string{"192.168.9.7/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-system", "ksa.calico-system.csi-node-driver"}, InterfaceName:"calicc6077f3144", MAC:"16:82:8c:62:45:f4", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 4 23:22:17.841043 containerd[1977]: 2025-11-04 23:22:17.832 [INFO][5182] cni-plugin/k8s.go 532: Wrote updated endpoint to datastore ContainerID="1ab60b57866cda617c36f7cc651b346b87609842690a8cb8cb4e21e660dfb9f3" Namespace="calico-system" Pod="csi-node-driver-5fvm8" WorkloadEndpoint="ip--172--31--21--124-k8s-csi--node--driver--5fvm8-eth0" Nov 4 23:22:17.984391 containerd[1977]: time="2025-11-04T23:22:17.983844505Z" level=info msg="connecting to shim 1ab60b57866cda617c36f7cc651b346b87609842690a8cb8cb4e21e660dfb9f3" address="unix:///run/containerd/s/bc04af38455abdece352b16839a1bb116c2df5e251be3e9ea5c33a889b6928d0" namespace=k8s.io protocol=ttrpc version=3 Nov 4 23:22:18.023764 systemd[1]: Started cri-containerd-20999f9a82c4268772485a7f3f654ef2923ede5a3b1101e6b6970cd6233adca4.scope - libcontainer container 20999f9a82c4268772485a7f3f654ef2923ede5a3b1101e6b6970cd6233adca4. Nov 4 23:22:18.061432 systemd-networkd[1573]: cali0da873d9a5f: Gained IPv6LL Nov 4 23:22:18.079409 systemd-networkd[1573]: cali2b2455a5301: Link UP Nov 4 23:22:18.084486 systemd-networkd[1573]: cali2b2455a5301: Gained carrier Nov 4 23:22:18.161030 systemd[1]: Started cri-containerd-1ab60b57866cda617c36f7cc651b346b87609842690a8cb8cb4e21e660dfb9f3.scope - libcontainer container 1ab60b57866cda617c36f7cc651b346b87609842690a8cb8cb4e21e660dfb9f3. Nov 4 23:22:18.173616 containerd[1977]: 2025-11-04 23:22:17.292 [INFO][5191] cni-plugin/plugin.go 340: Calico CNI found existing endpoint: &{{WorkloadEndpoint projectcalico.org/v3} {ip--172--31--21--124-k8s-goldmane--666569f655--lxlsr-eth0 goldmane-666569f655- calico-system cdd3b3e0-4537-4eef-a9c5-bf20b3379786 883 0 2025-11-04 23:21:48 +0000 UTC map[app.kubernetes.io/name:goldmane k8s-app:goldmane pod-template-hash:666569f655 projectcalico.org/namespace:calico-system projectcalico.org/orchestrator:k8s projectcalico.org/serviceaccount:goldmane] map[] [] [] []} {k8s ip-172-31-21-124 goldmane-666569f655-lxlsr eth0 goldmane [] [] [kns.calico-system ksa.calico-system.goldmane] cali2b2455a5301 [] [] }} ContainerID="791e399a0272b701dc895b5f946ac6110f21c4e7a77d101b3089bec66d904405" Namespace="calico-system" Pod="goldmane-666569f655-lxlsr" WorkloadEndpoint="ip--172--31--21--124-k8s-goldmane--666569f655--lxlsr-" Nov 4 23:22:18.173616 containerd[1977]: 2025-11-04 23:22:17.297 [INFO][5191] cni-plugin/k8s.go 74: Extracted identifiers for CmdAddK8s ContainerID="791e399a0272b701dc895b5f946ac6110f21c4e7a77d101b3089bec66d904405" Namespace="calico-system" Pod="goldmane-666569f655-lxlsr" WorkloadEndpoint="ip--172--31--21--124-k8s-goldmane--666569f655--lxlsr-eth0" Nov 4 23:22:18.173616 containerd[1977]: 2025-11-04 23:22:17.556 [INFO][5255] ipam/ipam_plugin.go 227: Calico CNI IPAM request count IPv4=1 IPv6=0 ContainerID="791e399a0272b701dc895b5f946ac6110f21c4e7a77d101b3089bec66d904405" HandleID="k8s-pod-network.791e399a0272b701dc895b5f946ac6110f21c4e7a77d101b3089bec66d904405" Workload="ip--172--31--21--124-k8s-goldmane--666569f655--lxlsr-eth0" Nov 4 23:22:18.173616 containerd[1977]: 2025-11-04 23:22:17.556 [INFO][5255] ipam/ipam_plugin.go 275: Auto assigning IP ContainerID="791e399a0272b701dc895b5f946ac6110f21c4e7a77d101b3089bec66d904405" HandleID="k8s-pod-network.791e399a0272b701dc895b5f946ac6110f21c4e7a77d101b3089bec66d904405" Workload="ip--172--31--21--124-k8s-goldmane--666569f655--lxlsr-eth0" assignArgs=ipam.AutoAssignArgs{Num4:1, Num6:0, HandleID:(*string)(0x4000438220), Attrs:map[string]string{"namespace":"calico-system", "node":"ip-172-31-21-124", "pod":"goldmane-666569f655-lxlsr", "timestamp":"2025-11-04 23:22:17.556367663 +0000 UTC"}, Hostname:"ip-172-31-21-124", IPv4Pools:[]net.IPNet{}, IPv6Pools:[]net.IPNet{}, MaxBlocksPerHost:0, HostReservedAttrIPv4s:(*ipam.HostReservedAttr)(nil), HostReservedAttrIPv6s:(*ipam.HostReservedAttr)(nil), IntendedUse:"Workload"} Nov 4 23:22:18.173616 containerd[1977]: 2025-11-04 23:22:17.556 [INFO][5255] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 4 23:22:18.173616 containerd[1977]: 2025-11-04 23:22:17.752 [INFO][5255] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 4 23:22:18.173616 containerd[1977]: 2025-11-04 23:22:17.754 [INFO][5255] ipam/ipam.go 110: Auto-assign 1 ipv4, 0 ipv6 addrs for host 'ip-172-31-21-124' Nov 4 23:22:18.173616 containerd[1977]: 2025-11-04 23:22:17.816 [INFO][5255] ipam/ipam.go 691: Looking up existing affinities for host handle="k8s-pod-network.791e399a0272b701dc895b5f946ac6110f21c4e7a77d101b3089bec66d904405" host="ip-172-31-21-124" Nov 4 23:22:18.173616 containerd[1977]: 2025-11-04 23:22:17.849 [INFO][5255] ipam/ipam.go 394: Looking up existing affinities for host host="ip-172-31-21-124" Nov 4 23:22:18.173616 containerd[1977]: 2025-11-04 23:22:17.907 [INFO][5255] ipam/ipam.go 511: Trying affinity for 192.168.9.0/26 host="ip-172-31-21-124" Nov 4 23:22:18.173616 containerd[1977]: 2025-11-04 23:22:17.925 [INFO][5255] ipam/ipam.go 158: Attempting to load block cidr=192.168.9.0/26 host="ip-172-31-21-124" Nov 4 23:22:18.173616 containerd[1977]: 2025-11-04 23:22:17.941 [INFO][5255] ipam/ipam.go 235: Affinity is confirmed and block has been loaded cidr=192.168.9.0/26 host="ip-172-31-21-124" Nov 4 23:22:18.173616 containerd[1977]: 2025-11-04 23:22:17.941 [INFO][5255] ipam/ipam.go 1219: Attempting to assign 1 addresses from block block=192.168.9.0/26 handle="k8s-pod-network.791e399a0272b701dc895b5f946ac6110f21c4e7a77d101b3089bec66d904405" host="ip-172-31-21-124" Nov 4 23:22:18.173616 containerd[1977]: 2025-11-04 23:22:17.949 [INFO][5255] ipam/ipam.go 1780: Creating new handle: k8s-pod-network.791e399a0272b701dc895b5f946ac6110f21c4e7a77d101b3089bec66d904405 Nov 4 23:22:18.173616 containerd[1977]: 2025-11-04 23:22:17.964 [INFO][5255] ipam/ipam.go 1246: Writing block in order to claim IPs block=192.168.9.0/26 handle="k8s-pod-network.791e399a0272b701dc895b5f946ac6110f21c4e7a77d101b3089bec66d904405" host="ip-172-31-21-124" Nov 4 23:22:18.173616 containerd[1977]: 2025-11-04 23:22:18.005 [INFO][5255] ipam/ipam.go 1262: Successfully claimed IPs: [192.168.9.8/26] block=192.168.9.0/26 handle="k8s-pod-network.791e399a0272b701dc895b5f946ac6110f21c4e7a77d101b3089bec66d904405" host="ip-172-31-21-124" Nov 4 23:22:18.173616 containerd[1977]: 2025-11-04 23:22:18.005 [INFO][5255] ipam/ipam.go 878: Auto-assigned 1 out of 1 IPv4s: [192.168.9.8/26] handle="k8s-pod-network.791e399a0272b701dc895b5f946ac6110f21c4e7a77d101b3089bec66d904405" host="ip-172-31-21-124" Nov 4 23:22:18.173616 containerd[1977]: 2025-11-04 23:22:18.005 [INFO][5255] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 4 23:22:18.173616 containerd[1977]: 2025-11-04 23:22:18.005 [INFO][5255] ipam/ipam_plugin.go 299: Calico CNI IPAM assigned addresses IPv4=[192.168.9.8/26] IPv6=[] ContainerID="791e399a0272b701dc895b5f946ac6110f21c4e7a77d101b3089bec66d904405" HandleID="k8s-pod-network.791e399a0272b701dc895b5f946ac6110f21c4e7a77d101b3089bec66d904405" Workload="ip--172--31--21--124-k8s-goldmane--666569f655--lxlsr-eth0" Nov 4 23:22:18.176080 containerd[1977]: 2025-11-04 23:22:18.059 [INFO][5191] cni-plugin/k8s.go 418: Populated endpoint ContainerID="791e399a0272b701dc895b5f946ac6110f21c4e7a77d101b3089bec66d904405" Namespace="calico-system" Pod="goldmane-666569f655-lxlsr" WorkloadEndpoint="ip--172--31--21--124-k8s-goldmane--666569f655--lxlsr-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--21--124-k8s-goldmane--666569f655--lxlsr-eth0", GenerateName:"goldmane-666569f655-", Namespace:"calico-system", SelfLink:"", UID:"cdd3b3e0-4537-4eef-a9c5-bf20b3379786", ResourceVersion:"883", Generation:0, CreationTimestamp:time.Date(2025, time.November, 4, 23, 21, 48, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app.kubernetes.io/name":"goldmane", "k8s-app":"goldmane", "pod-template-hash":"666569f655", "projectcalico.org/namespace":"calico-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"goldmane"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-21-124", ContainerID:"", Pod:"goldmane-666569f655-lxlsr", Endpoint:"eth0", ServiceAccountName:"goldmane", IPNetworks:[]string{"192.168.9.8/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-system", "ksa.calico-system.goldmane"}, InterfaceName:"cali2b2455a5301", MAC:"", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 4 23:22:18.176080 containerd[1977]: 2025-11-04 23:22:18.059 [INFO][5191] cni-plugin/k8s.go 419: Calico CNI using IPs: [192.168.9.8/32] ContainerID="791e399a0272b701dc895b5f946ac6110f21c4e7a77d101b3089bec66d904405" Namespace="calico-system" Pod="goldmane-666569f655-lxlsr" WorkloadEndpoint="ip--172--31--21--124-k8s-goldmane--666569f655--lxlsr-eth0" Nov 4 23:22:18.176080 containerd[1977]: 2025-11-04 23:22:18.066 [INFO][5191] cni-plugin/dataplane_linux.go 69: Setting the host side veth name to cali2b2455a5301 ContainerID="791e399a0272b701dc895b5f946ac6110f21c4e7a77d101b3089bec66d904405" Namespace="calico-system" Pod="goldmane-666569f655-lxlsr" WorkloadEndpoint="ip--172--31--21--124-k8s-goldmane--666569f655--lxlsr-eth0" Nov 4 23:22:18.176080 containerd[1977]: 2025-11-04 23:22:18.106 [INFO][5191] cni-plugin/dataplane_linux.go 508: Disabling IPv4 forwarding ContainerID="791e399a0272b701dc895b5f946ac6110f21c4e7a77d101b3089bec66d904405" Namespace="calico-system" Pod="goldmane-666569f655-lxlsr" WorkloadEndpoint="ip--172--31--21--124-k8s-goldmane--666569f655--lxlsr-eth0" Nov 4 23:22:18.176080 containerd[1977]: 2025-11-04 23:22:18.118 [INFO][5191] cni-plugin/k8s.go 446: Added Mac, interface name, and active container ID to endpoint ContainerID="791e399a0272b701dc895b5f946ac6110f21c4e7a77d101b3089bec66d904405" Namespace="calico-system" Pod="goldmane-666569f655-lxlsr" WorkloadEndpoint="ip--172--31--21--124-k8s-goldmane--666569f655--lxlsr-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--21--124-k8s-goldmane--666569f655--lxlsr-eth0", GenerateName:"goldmane-666569f655-", Namespace:"calico-system", SelfLink:"", UID:"cdd3b3e0-4537-4eef-a9c5-bf20b3379786", ResourceVersion:"883", Generation:0, CreationTimestamp:time.Date(2025, time.November, 4, 23, 21, 48, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app.kubernetes.io/name":"goldmane", "k8s-app":"goldmane", "pod-template-hash":"666569f655", "projectcalico.org/namespace":"calico-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"goldmane"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-21-124", ContainerID:"791e399a0272b701dc895b5f946ac6110f21c4e7a77d101b3089bec66d904405", Pod:"goldmane-666569f655-lxlsr", Endpoint:"eth0", ServiceAccountName:"goldmane", IPNetworks:[]string{"192.168.9.8/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-system", "ksa.calico-system.goldmane"}, InterfaceName:"cali2b2455a5301", MAC:"8e:28:a0:f2:5c:fc", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 4 23:22:18.176080 containerd[1977]: 2025-11-04 23:22:18.160 [INFO][5191] cni-plugin/k8s.go 532: Wrote updated endpoint to datastore ContainerID="791e399a0272b701dc895b5f946ac6110f21c4e7a77d101b3089bec66d904405" Namespace="calico-system" Pod="goldmane-666569f655-lxlsr" WorkloadEndpoint="ip--172--31--21--124-k8s-goldmane--666569f655--lxlsr-eth0" Nov 4 23:22:18.263280 containerd[1977]: time="2025-11-04T23:22:18.261114239Z" level=info msg="connecting to shim 791e399a0272b701dc895b5f946ac6110f21c4e7a77d101b3089bec66d904405" address="unix:///run/containerd/s/3655335d4fb1a521ff3a3b8f67d1a81f8773eac9fa29b488f2b735d5a3971142" namespace=k8s.io protocol=ttrpc version=3 Nov 4 23:22:18.293796 systemd-networkd[1573]: cali5c4929dfd4c: Link UP Nov 4 23:22:18.309247 systemd-networkd[1573]: cali5c4929dfd4c: Gained carrier Nov 4 23:22:18.371076 containerd[1977]: 2025-11-04 23:22:17.308 [INFO][5198] cni-plugin/plugin.go 340: Calico CNI found existing endpoint: &{{WorkloadEndpoint projectcalico.org/v3} {ip--172--31--21--124-k8s-coredns--668d6bf9bc--c6r4j-eth0 coredns-668d6bf9bc- kube-system 79763791-1744-4b74-b191-e2b76075f709 872 0 2025-11-04 23:21:20 +0000 UTC map[k8s-app:kube-dns pod-template-hash:668d6bf9bc projectcalico.org/namespace:kube-system projectcalico.org/orchestrator:k8s projectcalico.org/serviceaccount:coredns] map[] [] [] []} {k8s ip-172-31-21-124 coredns-668d6bf9bc-c6r4j eth0 coredns [] [] [kns.kube-system ksa.kube-system.coredns] cali5c4929dfd4c [{dns UDP 53 0 } {dns-tcp TCP 53 0 } {metrics TCP 9153 0 }] [] }} ContainerID="20a023f045238cc7af86a62ebdbd548456c745fa4d62b7abe6b504d990ab9dbb" Namespace="kube-system" Pod="coredns-668d6bf9bc-c6r4j" WorkloadEndpoint="ip--172--31--21--124-k8s-coredns--668d6bf9bc--c6r4j-" Nov 4 23:22:18.371076 containerd[1977]: 2025-11-04 23:22:17.308 [INFO][5198] cni-plugin/k8s.go 74: Extracted identifiers for CmdAddK8s ContainerID="20a023f045238cc7af86a62ebdbd548456c745fa4d62b7abe6b504d990ab9dbb" Namespace="kube-system" Pod="coredns-668d6bf9bc-c6r4j" WorkloadEndpoint="ip--172--31--21--124-k8s-coredns--668d6bf9bc--c6r4j-eth0" Nov 4 23:22:18.371076 containerd[1977]: 2025-11-04 23:22:17.562 [INFO][5259] ipam/ipam_plugin.go 227: Calico CNI IPAM request count IPv4=1 IPv6=0 ContainerID="20a023f045238cc7af86a62ebdbd548456c745fa4d62b7abe6b504d990ab9dbb" HandleID="k8s-pod-network.20a023f045238cc7af86a62ebdbd548456c745fa4d62b7abe6b504d990ab9dbb" Workload="ip--172--31--21--124-k8s-coredns--668d6bf9bc--c6r4j-eth0" Nov 4 23:22:18.371076 containerd[1977]: 2025-11-04 23:22:17.563 [INFO][5259] ipam/ipam_plugin.go 275: Auto assigning IP ContainerID="20a023f045238cc7af86a62ebdbd548456c745fa4d62b7abe6b504d990ab9dbb" HandleID="k8s-pod-network.20a023f045238cc7af86a62ebdbd548456c745fa4d62b7abe6b504d990ab9dbb" Workload="ip--172--31--21--124-k8s-coredns--668d6bf9bc--c6r4j-eth0" assignArgs=ipam.AutoAssignArgs{Num4:1, Num6:0, HandleID:(*string)(0x4000103c60), Attrs:map[string]string{"namespace":"kube-system", "node":"ip-172-31-21-124", "pod":"coredns-668d6bf9bc-c6r4j", "timestamp":"2025-11-04 23:22:17.562119491 +0000 UTC"}, Hostname:"ip-172-31-21-124", IPv4Pools:[]net.IPNet{}, IPv6Pools:[]net.IPNet{}, MaxBlocksPerHost:0, HostReservedAttrIPv4s:(*ipam.HostReservedAttr)(nil), HostReservedAttrIPv6s:(*ipam.HostReservedAttr)(nil), IntendedUse:"Workload"} Nov 4 23:22:18.371076 containerd[1977]: 2025-11-04 23:22:17.563 [INFO][5259] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 4 23:22:18.371076 containerd[1977]: 2025-11-04 23:22:18.006 [INFO][5259] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 4 23:22:18.371076 containerd[1977]: 2025-11-04 23:22:18.006 [INFO][5259] ipam/ipam.go 110: Auto-assign 1 ipv4, 0 ipv6 addrs for host 'ip-172-31-21-124' Nov 4 23:22:18.371076 containerd[1977]: 2025-11-04 23:22:18.115 [INFO][5259] ipam/ipam.go 691: Looking up existing affinities for host handle="k8s-pod-network.20a023f045238cc7af86a62ebdbd548456c745fa4d62b7abe6b504d990ab9dbb" host="ip-172-31-21-124" Nov 4 23:22:18.371076 containerd[1977]: 2025-11-04 23:22:18.142 [INFO][5259] ipam/ipam.go 394: Looking up existing affinities for host host="ip-172-31-21-124" Nov 4 23:22:18.371076 containerd[1977]: 2025-11-04 23:22:18.168 [INFO][5259] ipam/ipam.go 511: Trying affinity for 192.168.9.0/26 host="ip-172-31-21-124" Nov 4 23:22:18.371076 containerd[1977]: 2025-11-04 23:22:18.178 [INFO][5259] ipam/ipam.go 158: Attempting to load block cidr=192.168.9.0/26 host="ip-172-31-21-124" Nov 4 23:22:18.371076 containerd[1977]: 2025-11-04 23:22:18.187 [INFO][5259] ipam/ipam.go 235: Affinity is confirmed and block has been loaded cidr=192.168.9.0/26 host="ip-172-31-21-124" Nov 4 23:22:18.371076 containerd[1977]: 2025-11-04 23:22:18.188 [INFO][5259] ipam/ipam.go 1219: Attempting to assign 1 addresses from block block=192.168.9.0/26 handle="k8s-pod-network.20a023f045238cc7af86a62ebdbd548456c745fa4d62b7abe6b504d990ab9dbb" host="ip-172-31-21-124" Nov 4 23:22:18.371076 containerd[1977]: 2025-11-04 23:22:18.194 [INFO][5259] ipam/ipam.go 1780: Creating new handle: k8s-pod-network.20a023f045238cc7af86a62ebdbd548456c745fa4d62b7abe6b504d990ab9dbb Nov 4 23:22:18.371076 containerd[1977]: 2025-11-04 23:22:18.209 [INFO][5259] ipam/ipam.go 1246: Writing block in order to claim IPs block=192.168.9.0/26 handle="k8s-pod-network.20a023f045238cc7af86a62ebdbd548456c745fa4d62b7abe6b504d990ab9dbb" host="ip-172-31-21-124" Nov 4 23:22:18.371076 containerd[1977]: 2025-11-04 23:22:18.235 [INFO][5259] ipam/ipam.go 1262: Successfully claimed IPs: [192.168.9.9/26] block=192.168.9.0/26 handle="k8s-pod-network.20a023f045238cc7af86a62ebdbd548456c745fa4d62b7abe6b504d990ab9dbb" host="ip-172-31-21-124" Nov 4 23:22:18.371076 containerd[1977]: 2025-11-04 23:22:18.237 [INFO][5259] ipam/ipam.go 878: Auto-assigned 1 out of 1 IPv4s: [192.168.9.9/26] handle="k8s-pod-network.20a023f045238cc7af86a62ebdbd548456c745fa4d62b7abe6b504d990ab9dbb" host="ip-172-31-21-124" Nov 4 23:22:18.371076 containerd[1977]: 2025-11-04 23:22:18.239 [INFO][5259] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 4 23:22:18.371076 containerd[1977]: 2025-11-04 23:22:18.240 [INFO][5259] ipam/ipam_plugin.go 299: Calico CNI IPAM assigned addresses IPv4=[192.168.9.9/26] IPv6=[] ContainerID="20a023f045238cc7af86a62ebdbd548456c745fa4d62b7abe6b504d990ab9dbb" HandleID="k8s-pod-network.20a023f045238cc7af86a62ebdbd548456c745fa4d62b7abe6b504d990ab9dbb" Workload="ip--172--31--21--124-k8s-coredns--668d6bf9bc--c6r4j-eth0" Nov 4 23:22:18.373123 containerd[1977]: 2025-11-04 23:22:18.261 [INFO][5198] cni-plugin/k8s.go 418: Populated endpoint ContainerID="20a023f045238cc7af86a62ebdbd548456c745fa4d62b7abe6b504d990ab9dbb" Namespace="kube-system" Pod="coredns-668d6bf9bc-c6r4j" WorkloadEndpoint="ip--172--31--21--124-k8s-coredns--668d6bf9bc--c6r4j-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--21--124-k8s-coredns--668d6bf9bc--c6r4j-eth0", GenerateName:"coredns-668d6bf9bc-", Namespace:"kube-system", SelfLink:"", UID:"79763791-1744-4b74-b191-e2b76075f709", ResourceVersion:"872", Generation:0, CreationTimestamp:time.Date(2025, time.November, 4, 23, 21, 20, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-dns", "pod-template-hash":"668d6bf9bc", "projectcalico.org/namespace":"kube-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"coredns"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-21-124", ContainerID:"", Pod:"coredns-668d6bf9bc-c6r4j", Endpoint:"eth0", ServiceAccountName:"coredns", IPNetworks:[]string{"192.168.9.9/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.kube-system", "ksa.kube-system.coredns"}, InterfaceName:"cali5c4929dfd4c", MAC:"", Ports:[]v3.WorkloadEndpointPort{v3.WorkloadEndpointPort{Name:"dns", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"UDP"}, Port:0x35, HostPort:0x0, HostIP:""}, v3.WorkloadEndpointPort{Name:"dns-tcp", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"TCP"}, Port:0x35, HostPort:0x0, HostIP:""}, v3.WorkloadEndpointPort{Name:"metrics", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"TCP"}, Port:0x23c1, HostPort:0x0, HostIP:""}}, AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 4 23:22:18.373123 containerd[1977]: 2025-11-04 23:22:18.262 [INFO][5198] cni-plugin/k8s.go 419: Calico CNI using IPs: [192.168.9.9/32] ContainerID="20a023f045238cc7af86a62ebdbd548456c745fa4d62b7abe6b504d990ab9dbb" Namespace="kube-system" Pod="coredns-668d6bf9bc-c6r4j" WorkloadEndpoint="ip--172--31--21--124-k8s-coredns--668d6bf9bc--c6r4j-eth0" Nov 4 23:22:18.373123 containerd[1977]: 2025-11-04 23:22:18.262 [INFO][5198] cni-plugin/dataplane_linux.go 69: Setting the host side veth name to cali5c4929dfd4c ContainerID="20a023f045238cc7af86a62ebdbd548456c745fa4d62b7abe6b504d990ab9dbb" Namespace="kube-system" Pod="coredns-668d6bf9bc-c6r4j" WorkloadEndpoint="ip--172--31--21--124-k8s-coredns--668d6bf9bc--c6r4j-eth0" Nov 4 23:22:18.373123 containerd[1977]: 2025-11-04 23:22:18.314 [INFO][5198] cni-plugin/dataplane_linux.go 508: Disabling IPv4 forwarding ContainerID="20a023f045238cc7af86a62ebdbd548456c745fa4d62b7abe6b504d990ab9dbb" Namespace="kube-system" Pod="coredns-668d6bf9bc-c6r4j" WorkloadEndpoint="ip--172--31--21--124-k8s-coredns--668d6bf9bc--c6r4j-eth0" Nov 4 23:22:18.373123 containerd[1977]: 2025-11-04 23:22:18.329 [INFO][5198] cni-plugin/k8s.go 446: Added Mac, interface name, and active container ID to endpoint ContainerID="20a023f045238cc7af86a62ebdbd548456c745fa4d62b7abe6b504d990ab9dbb" Namespace="kube-system" Pod="coredns-668d6bf9bc-c6r4j" WorkloadEndpoint="ip--172--31--21--124-k8s-coredns--668d6bf9bc--c6r4j-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--21--124-k8s-coredns--668d6bf9bc--c6r4j-eth0", GenerateName:"coredns-668d6bf9bc-", Namespace:"kube-system", SelfLink:"", UID:"79763791-1744-4b74-b191-e2b76075f709", ResourceVersion:"872", Generation:0, CreationTimestamp:time.Date(2025, time.November, 4, 23, 21, 20, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-dns", "pod-template-hash":"668d6bf9bc", "projectcalico.org/namespace":"kube-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"coredns"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-21-124", ContainerID:"20a023f045238cc7af86a62ebdbd548456c745fa4d62b7abe6b504d990ab9dbb", Pod:"coredns-668d6bf9bc-c6r4j", Endpoint:"eth0", ServiceAccountName:"coredns", IPNetworks:[]string{"192.168.9.9/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.kube-system", "ksa.kube-system.coredns"}, InterfaceName:"cali5c4929dfd4c", MAC:"86:7d:76:cf:d0:a8", Ports:[]v3.WorkloadEndpointPort{v3.WorkloadEndpointPort{Name:"dns", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"UDP"}, Port:0x35, HostPort:0x0, HostIP:""}, v3.WorkloadEndpointPort{Name:"dns-tcp", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"TCP"}, Port:0x35, HostPort:0x0, HostIP:""}, v3.WorkloadEndpointPort{Name:"metrics", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"TCP"}, Port:0x23c1, HostPort:0x0, HostIP:""}}, AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 4 23:22:18.373123 containerd[1977]: 2025-11-04 23:22:18.363 [INFO][5198] cni-plugin/k8s.go 532: Wrote updated endpoint to datastore ContainerID="20a023f045238cc7af86a62ebdbd548456c745fa4d62b7abe6b504d990ab9dbb" Namespace="kube-system" Pod="coredns-668d6bf9bc-c6r4j" WorkloadEndpoint="ip--172--31--21--124-k8s-coredns--668d6bf9bc--c6r4j-eth0" Nov 4 23:22:18.427006 systemd[1]: Started cri-containerd-791e399a0272b701dc895b5f946ac6110f21c4e7a77d101b3089bec66d904405.scope - libcontainer container 791e399a0272b701dc895b5f946ac6110f21c4e7a77d101b3089bec66d904405. Nov 4 23:22:18.427902 kubelet[3293]: E1104 23:22:18.427709 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-996fc7fbb-2jd5x" podUID="ab3399c0-cd7b-41d5-bf32-586b469457b8" Nov 4 23:22:18.432651 kubelet[3293]: E1104 23:22:18.430787 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-fcc487596-jrhr4" podUID="068373b4-e189-432e-9f0e-0da4317cec26" Nov 4 23:22:18.500280 containerd[1977]: time="2025-11-04T23:22:18.499483980Z" level=info msg="connecting to shim 20a023f045238cc7af86a62ebdbd548456c745fa4d62b7abe6b504d990ab9dbb" address="unix:///run/containerd/s/eaf000445561458b2feeacea8aff813bd30aa79afaf6e410af6c8bc0998a624c" namespace=k8s.io protocol=ttrpc version=3 Nov 4 23:22:18.529149 containerd[1977]: time="2025-11-04T23:22:18.528572124Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:csi-node-driver-5fvm8,Uid:0d16ca69-85e0-4dac-8492-1209e5dd061d,Namespace:calico-system,Attempt:0,} returns sandbox id \"1ab60b57866cda617c36f7cc651b346b87609842690a8cb8cb4e21e660dfb9f3\"" Nov 4 23:22:18.540576 containerd[1977]: time="2025-11-04T23:22:18.540483948Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/csi:v3.30.4\"" Nov 4 23:22:18.659578 systemd[1]: Started cri-containerd-20a023f045238cc7af86a62ebdbd548456c745fa4d62b7abe6b504d990ab9dbb.scope - libcontainer container 20a023f045238cc7af86a62ebdbd548456c745fa4d62b7abe6b504d990ab9dbb. Nov 4 23:22:18.747695 containerd[1977]: time="2025-11-04T23:22:18.747604885Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-fcc487596-l2mz4,Uid:af7a1c92-78ca-4756-b8d2-4992b60e6f17,Namespace:calico-apiserver,Attempt:0,} returns sandbox id \"20999f9a82c4268772485a7f3f654ef2923ede5a3b1101e6b6970cd6233adca4\"" Nov 4 23:22:18.813572 containerd[1977]: time="2025-11-04T23:22:18.813370958Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-668d6bf9bc-c6r4j,Uid:79763791-1744-4b74-b191-e2b76075f709,Namespace:kube-system,Attempt:0,} returns sandbox id \"20a023f045238cc7af86a62ebdbd548456c745fa4d62b7abe6b504d990ab9dbb\"" Nov 4 23:22:18.827749 containerd[1977]: time="2025-11-04T23:22:18.827647502Z" level=info msg="CreateContainer within sandbox \"20a023f045238cc7af86a62ebdbd548456c745fa4d62b7abe6b504d990ab9dbb\" for container &ContainerMetadata{Name:coredns,Attempt:0,}" Nov 4 23:22:18.828725 containerd[1977]: time="2025-11-04T23:22:18.828555302Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:22:18.831499 containerd[1977]: time="2025-11-04T23:22:18.831293330Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/csi:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" Nov 4 23:22:18.831499 containerd[1977]: time="2025-11-04T23:22:18.831454634Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/csi:v3.30.4: active requests=0, bytes read=69" Nov 4 23:22:18.832333 kubelet[3293]: E1104 23:22:18.831772 3293 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" image="ghcr.io/flatcar/calico/csi:v3.30.4" Nov 4 23:22:18.832333 kubelet[3293]: E1104 23:22:18.831851 3293 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" image="ghcr.io/flatcar/calico/csi:v3.30.4" Nov 4 23:22:18.833238 containerd[1977]: time="2025-11-04T23:22:18.833123222Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\"" Nov 4 23:22:18.834628 kubelet[3293]: E1104 23:22:18.834027 3293 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:calico-csi,Image:ghcr.io/flatcar/calico/csi:v3.30.4,Command:[],Args:[--nodeid=$(KUBE_NODE_NAME) --loglevel=$(LOG_LEVEL)],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:warn,ValueFrom:nil,},EnvVar{Name:KUBE_NODE_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:spec.nodeName,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kubelet-dir,ReadOnly:false,MountPath:/var/lib/kubelet,SubPath:,MountPropagation:*Bidirectional,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:socket-dir,ReadOnly:false,MountPath:/csi,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:varrun,ReadOnly:false,MountPath:/var/run,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-hg84v,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*true,SELinuxOptions:nil,RunAsUser:*0,RunAsNonRoot:*false,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*true,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod csi-node-driver-5fvm8_calico-system(0d16ca69-85e0-4dac-8492-1209e5dd061d): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" logger="UnhandledError" Nov 4 23:22:18.893561 systemd-networkd[1573]: calicc6077f3144: Gained IPv6LL Nov 4 23:22:18.919531 containerd[1977]: time="2025-11-04T23:22:18.919148222Z" level=info msg="Container 198d5dff0b576104ad066bf4e2e5d3bffbf9fa5b501b55c44e608914036d4ad3: CDI devices from CRI Config.CDIDevices: []" Nov 4 23:22:18.922308 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount1734174305.mount: Deactivated successfully. Nov 4 23:22:18.939237 containerd[1977]: time="2025-11-04T23:22:18.938905538Z" level=info msg="CreateContainer within sandbox \"20a023f045238cc7af86a62ebdbd548456c745fa4d62b7abe6b504d990ab9dbb\" for &ContainerMetadata{Name:coredns,Attempt:0,} returns container id \"198d5dff0b576104ad066bf4e2e5d3bffbf9fa5b501b55c44e608914036d4ad3\"" Nov 4 23:22:18.942483 containerd[1977]: time="2025-11-04T23:22:18.942422174Z" level=info msg="StartContainer for \"198d5dff0b576104ad066bf4e2e5d3bffbf9fa5b501b55c44e608914036d4ad3\"" Nov 4 23:22:18.951492 containerd[1977]: time="2025-11-04T23:22:18.951390026Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:goldmane-666569f655-lxlsr,Uid:cdd3b3e0-4537-4eef-a9c5-bf20b3379786,Namespace:calico-system,Attempt:0,} returns sandbox id \"791e399a0272b701dc895b5f946ac6110f21c4e7a77d101b3089bec66d904405\"" Nov 4 23:22:18.954771 containerd[1977]: time="2025-11-04T23:22:18.954704666Z" level=info msg="connecting to shim 198d5dff0b576104ad066bf4e2e5d3bffbf9fa5b501b55c44e608914036d4ad3" address="unix:///run/containerd/s/eaf000445561458b2feeacea8aff813bd30aa79afaf6e410af6c8bc0998a624c" protocol=ttrpc version=3 Nov 4 23:22:19.023626 systemd[1]: Started cri-containerd-198d5dff0b576104ad066bf4e2e5d3bffbf9fa5b501b55c44e608914036d4ad3.scope - libcontainer container 198d5dff0b576104ad066bf4e2e5d3bffbf9fa5b501b55c44e608914036d4ad3. Nov 4 23:22:19.099081 containerd[1977]: time="2025-11-04T23:22:19.098068307Z" level=info msg="StartContainer for \"198d5dff0b576104ad066bf4e2e5d3bffbf9fa5b501b55c44e608914036d4ad3\" returns successfully" Nov 4 23:22:19.180640 containerd[1977]: time="2025-11-04T23:22:19.180427595Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:22:19.182222 containerd[1977]: time="2025-11-04T23:22:19.182130107Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" Nov 4 23:22:19.182476 containerd[1977]: time="2025-11-04T23:22:19.182187323Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/apiserver:v3.30.4: active requests=0, bytes read=77" Nov 4 23:22:19.183446 kubelet[3293]: E1104 23:22:19.182862 3293 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 4 23:22:19.183446 kubelet[3293]: E1104 23:22:19.182930 3293 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 4 23:22:19.185033 containerd[1977]: time="2025-11-04T23:22:19.184916519Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\"" Nov 4 23:22:19.185939 kubelet[3293]: E1104 23:22:19.185490 3293 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:calico-apiserver,Image:ghcr.io/flatcar/calico/apiserver:v3.30.4,Command:[],Args:[--secure-port=5443 --tls-private-key-file=/calico-apiserver-certs/tls.key --tls-cert-file=/calico-apiserver-certs/tls.crt],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:LOG_LEVEL,Value:info,ValueFrom:nil,},EnvVar{Name:MULTI_INTERFACE_MODE,Value:none,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:calico-apiserver-certs,ReadOnly:true,MountPath:/calico-apiserver-certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-jtkhl,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 5443 },Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-apiserver-fcc487596-l2mz4_calico-apiserver(af7a1c92-78ca-4756-b8d2-4992b60e6f17): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" logger="UnhandledError" Nov 4 23:22:19.187935 kubelet[3293]: E1104 23:22:19.187801 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-fcc487596-l2mz4" podUID="af7a1c92-78ca-4756-b8d2-4992b60e6f17" Nov 4 23:22:19.430550 containerd[1977]: time="2025-11-04T23:22:19.429607669Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:22:19.433178 containerd[1977]: time="2025-11-04T23:22:19.432434833Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: active requests=0, bytes read=93" Nov 4 23:22:19.433898 containerd[1977]: time="2025-11-04T23:22:19.433347805Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" Nov 4 23:22:19.435582 kubelet[3293]: E1104 23:22:19.435457 3293 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" image="ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4" Nov 4 23:22:19.437852 kubelet[3293]: E1104 23:22:19.436722 3293 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" image="ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4" Nov 4 23:22:19.437852 kubelet[3293]: E1104 23:22:19.437070 3293 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:csi-node-driver-registrar,Image:ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4,Command:[],Args:[--v=5 --csi-address=$(ADDRESS) --kubelet-registration-path=$(DRIVER_REG_SOCK_PATH)],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:ADDRESS,Value:/csi/csi.sock,ValueFrom:nil,},EnvVar{Name:DRIVER_REG_SOCK_PATH,Value:/var/lib/kubelet/plugins/csi.tigera.io/csi.sock,ValueFrom:nil,},EnvVar{Name:KUBE_NODE_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:spec.nodeName,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:registration-dir,ReadOnly:false,MountPath:/registration,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:socket-dir,ReadOnly:false,MountPath:/csi,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-hg84v,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*true,SELinuxOptions:nil,RunAsUser:*0,RunAsNonRoot:*false,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*true,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod csi-node-driver-5fvm8_calico-system(0d16ca69-85e0-4dac-8492-1209e5dd061d): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" logger="UnhandledError" Nov 4 23:22:19.439710 kubelet[3293]: E1104 23:22:19.439410 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"calico-csi\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ghcr.io/flatcar/calico/csi:v3.30.4: not found\", failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found\"]" pod="calico-system/csi-node-driver-5fvm8" podUID="0d16ca69-85e0-4dac-8492-1209e5dd061d" Nov 4 23:22:19.439940 containerd[1977]: time="2025-11-04T23:22:19.438976441Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/goldmane:v3.30.4\"" Nov 4 23:22:19.459810 kubelet[3293]: E1104 23:22:19.459598 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"calico-csi\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ghcr.io/flatcar/calico/csi:v3.30.4: not found\", failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found\"]" pod="calico-system/csi-node-driver-5fvm8" podUID="0d16ca69-85e0-4dac-8492-1209e5dd061d" Nov 4 23:22:19.463896 kubelet[3293]: E1104 23:22:19.463676 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-fcc487596-l2mz4" podUID="af7a1c92-78ca-4756-b8d2-4992b60e6f17" Nov 4 23:22:19.472616 systemd-networkd[1573]: calibd4f50a0c75: Gained IPv6LL Nov 4 23:22:19.532862 kubelet[3293]: I1104 23:22:19.532378 3293 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/coredns-668d6bf9bc-c6r4j" podStartSLOduration=59.532350661 podStartE2EDuration="59.532350661s" podCreationTimestamp="2025-11-04 23:21:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-04 23:22:19.531319717 +0000 UTC m=+64.133983231" watchObservedRunningTime="2025-11-04 23:22:19.532350661 +0000 UTC m=+64.135014151" Nov 4 23:22:19.725600 systemd-networkd[1573]: cali2b2455a5301: Gained IPv6LL Nov 4 23:22:19.747194 containerd[1977]: time="2025-11-04T23:22:19.747107942Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:22:19.749416 containerd[1977]: time="2025-11-04T23:22:19.749307014Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/goldmane:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" Nov 4 23:22:19.749820 containerd[1977]: time="2025-11-04T23:22:19.749476694Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/goldmane:v3.30.4: active requests=0, bytes read=77" Nov 4 23:22:19.750295 kubelet[3293]: E1104 23:22:19.750129 3293 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" image="ghcr.io/flatcar/calico/goldmane:v3.30.4" Nov 4 23:22:19.750909 kubelet[3293]: E1104 23:22:19.750500 3293 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" image="ghcr.io/flatcar/calico/goldmane:v3.30.4" Nov 4 23:22:19.750909 kubelet[3293]: E1104 23:22:19.750789 3293 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:goldmane,Image:ghcr.io/flatcar/calico/goldmane:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:INFO,ValueFrom:nil,},EnvVar{Name:PORT,Value:7443,ValueFrom:nil,},EnvVar{Name:SERVER_CERT_PATH,Value:/goldmane-key-pair/tls.crt,ValueFrom:nil,},EnvVar{Name:SERVER_KEY_PATH,Value:/goldmane-key-pair/tls.key,ValueFrom:nil,},EnvVar{Name:CA_CERT_PATH,Value:/etc/pki/tls/certs/tigera-ca-bundle.crt,ValueFrom:nil,},EnvVar{Name:PUSH_URL,Value:https://guardian.calico-system.svc.cluster.local:443/api/v1/flows/bulk,ValueFrom:nil,},EnvVar{Name:FILE_CONFIG_PATH,Value:/config/config.json,ValueFrom:nil,},EnvVar{Name:HEALTH_ENABLED,Value:true,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:config,ReadOnly:true,MountPath:/config,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:goldmane-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:goldmane-key-pair,ReadOnly:true,MountPath:/goldmane-key-pair,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-hkw2k,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/health -live],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/health -ready],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:30,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod goldmane-666569f655-lxlsr_calico-system(cdd3b3e0-4537-4eef-a9c5-bf20b3379786): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" logger="UnhandledError" Nov 4 23:22:19.752508 kubelet[3293]: E1104 23:22:19.752428 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"goldmane\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found\"" pod="calico-system/goldmane-666569f655-lxlsr" podUID="cdd3b3e0-4537-4eef-a9c5-bf20b3379786" Nov 4 23:22:20.046574 systemd-networkd[1573]: cali5c4929dfd4c: Gained IPv6LL Nov 4 23:22:20.510744 kubelet[3293]: E1104 23:22:20.510289 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"goldmane\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found\"" pod="calico-system/goldmane-666569f655-lxlsr" podUID="cdd3b3e0-4537-4eef-a9c5-bf20b3379786" Nov 4 23:22:20.510744 kubelet[3293]: E1104 23:22:20.510579 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-fcc487596-l2mz4" podUID="af7a1c92-78ca-4756-b8d2-4992b60e6f17" Nov 4 23:22:20.514512 kubelet[3293]: E1104 23:22:20.513650 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"calico-csi\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ghcr.io/flatcar/calico/csi:v3.30.4: not found\", failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found\"]" pod="calico-system/csi-node-driver-5fvm8" podUID="0d16ca69-85e0-4dac-8492-1209e5dd061d" Nov 4 23:22:22.122732 systemd[1]: Started sshd@7-172.31.21.124:22-139.178.89.65:58170.service - OpenSSH per-connection server daemon (139.178.89.65:58170). Nov 4 23:22:22.397832 sshd[5545]: Accepted publickey for core from 139.178.89.65 port 58170 ssh2: RSA SHA256:hDiwkCWvCQBqijfvK1jv0H0YtRR2s7jf/pLBmZjqWNg Nov 4 23:22:22.401308 sshd-session[5545]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 4 23:22:22.412908 systemd-logind[1949]: New session 8 of user core. Nov 4 23:22:22.418564 systemd[1]: Started session-8.scope - Session 8 of User core. Nov 4 23:22:22.763128 sshd[5548]: Connection closed by 139.178.89.65 port 58170 Nov 4 23:22:22.764284 sshd-session[5545]: pam_unix(sshd:session): session closed for user core Nov 4 23:22:22.774586 systemd[1]: sshd@7-172.31.21.124:22-139.178.89.65:58170.service: Deactivated successfully. Nov 4 23:22:22.780564 systemd[1]: session-8.scope: Deactivated successfully. Nov 4 23:22:22.783631 systemd-logind[1949]: Session 8 logged out. Waiting for processes to exit. Nov 4 23:22:22.787002 systemd-logind[1949]: Removed session 8. Nov 4 23:22:22.939102 ntpd[1942]: Listen normally on 6 vxlan.calico 192.168.9.0:123 Nov 4 23:22:22.939629 ntpd[1942]: 4 Nov 23:22:22 ntpd[1942]: Listen normally on 6 vxlan.calico 192.168.9.0:123 Nov 4 23:22:22.939629 ntpd[1942]: 4 Nov 23:22:22 ntpd[1942]: Listen normally on 7 cali5b3ce9ec845 [fe80::ecee:eeff:feee:eeee%4]:123 Nov 4 23:22:22.939629 ntpd[1942]: 4 Nov 23:22:22 ntpd[1942]: Listen normally on 8 cali71fae08a329 [fe80::ecee:eeff:feee:eeee%5]:123 Nov 4 23:22:22.939629 ntpd[1942]: 4 Nov 23:22:22 ntpd[1942]: Listen normally on 9 vxlan.calico [fe80::64f0:b6ff:feee:8bc7%6]:123 Nov 4 23:22:22.939629 ntpd[1942]: 4 Nov 23:22:22 ntpd[1942]: Listen normally on 10 cali87156d172cb [fe80::ecee:eeff:feee:eeee%9]:123 Nov 4 23:22:22.939629 ntpd[1942]: 4 Nov 23:22:22 ntpd[1942]: Listen normally on 11 cali7cf82df4573 [fe80::ecee:eeff:feee:eeee%10]:123 Nov 4 23:22:22.939629 ntpd[1942]: 4 Nov 23:22:22 ntpd[1942]: Listen normally on 12 cali0da873d9a5f [fe80::ecee:eeff:feee:eeee%11]:123 Nov 4 23:22:22.939629 ntpd[1942]: 4 Nov 23:22:22 ntpd[1942]: Listen normally on 13 calibd4f50a0c75 [fe80::ecee:eeff:feee:eeee%12]:123 Nov 4 23:22:22.939243 ntpd[1942]: Listen normally on 7 cali5b3ce9ec845 [fe80::ecee:eeff:feee:eeee%4]:123 Nov 4 23:22:22.940193 ntpd[1942]: 4 Nov 23:22:22 ntpd[1942]: Listen normally on 14 calicc6077f3144 [fe80::ecee:eeff:feee:eeee%13]:123 Nov 4 23:22:22.940193 ntpd[1942]: 4 Nov 23:22:22 ntpd[1942]: Listen normally on 15 cali2b2455a5301 [fe80::ecee:eeff:feee:eeee%14]:123 Nov 4 23:22:22.940193 ntpd[1942]: 4 Nov 23:22:22 ntpd[1942]: Listen normally on 16 cali5c4929dfd4c [fe80::ecee:eeff:feee:eeee%15]:123 Nov 4 23:22:22.939302 ntpd[1942]: Listen normally on 8 cali71fae08a329 [fe80::ecee:eeff:feee:eeee%5]:123 Nov 4 23:22:22.939350 ntpd[1942]: Listen normally on 9 vxlan.calico [fe80::64f0:b6ff:feee:8bc7%6]:123 Nov 4 23:22:22.939395 ntpd[1942]: Listen normally on 10 cali87156d172cb [fe80::ecee:eeff:feee:eeee%9]:123 Nov 4 23:22:22.939441 ntpd[1942]: Listen normally on 11 cali7cf82df4573 [fe80::ecee:eeff:feee:eeee%10]:123 Nov 4 23:22:22.939495 ntpd[1942]: Listen normally on 12 cali0da873d9a5f [fe80::ecee:eeff:feee:eeee%11]:123 Nov 4 23:22:22.939594 ntpd[1942]: Listen normally on 13 calibd4f50a0c75 [fe80::ecee:eeff:feee:eeee%12]:123 Nov 4 23:22:22.939644 ntpd[1942]: Listen normally on 14 calicc6077f3144 [fe80::ecee:eeff:feee:eeee%13]:123 Nov 4 23:22:22.939688 ntpd[1942]: Listen normally on 15 cali2b2455a5301 [fe80::ecee:eeff:feee:eeee%14]:123 Nov 4 23:22:22.939730 ntpd[1942]: Listen normally on 16 cali5c4929dfd4c [fe80::ecee:eeff:feee:eeee%15]:123 Nov 4 23:22:25.860573 containerd[1977]: time="2025-11-04T23:22:25.860492193Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/whisker:v3.30.4\"" Nov 4 23:22:26.148424 containerd[1977]: time="2025-11-04T23:22:26.148177002Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:22:26.151143 containerd[1977]: time="2025-11-04T23:22:26.151025766Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/whisker:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" Nov 4 23:22:26.151580 containerd[1977]: time="2025-11-04T23:22:26.151096506Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/whisker:v3.30.4: active requests=0, bytes read=73" Nov 4 23:22:26.151902 kubelet[3293]: E1104 23:22:26.151562 3293 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker:v3.30.4" Nov 4 23:22:26.151902 kubelet[3293]: E1104 23:22:26.151629 3293 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker:v3.30.4" Nov 4 23:22:26.151902 kubelet[3293]: E1104 23:22:26.151790 3293 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:whisker,Image:ghcr.io/flatcar/calico/whisker:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:INFO,ValueFrom:nil,},EnvVar{Name:CALICO_VERSION,Value:v3.30.4,ValueFrom:nil,},EnvVar{Name:CLUSTER_ID,Value:0ca3151f26aa44ec95a034255ce8af62,ValueFrom:nil,},EnvVar{Name:CLUSTER_TYPE,Value:typha,kdd,k8s,operator,bgp,kubeadm,ValueFrom:nil,},EnvVar{Name:NOTIFICATIONS,Value:Enabled,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-fjghm,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod whisker-778cbdb456-4xzz7_calico-system(404b99f5-b096-49e7-baa1-6b3afbc90705): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" logger="UnhandledError" Nov 4 23:22:26.154829 containerd[1977]: time="2025-11-04T23:22:26.154746546Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\"" Nov 4 23:22:26.424945 containerd[1977]: time="2025-11-04T23:22:26.424655707Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:22:26.427407 containerd[1977]: time="2025-11-04T23:22:26.427178923Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" Nov 4 23:22:26.427407 containerd[1977]: time="2025-11-04T23:22:26.427251511Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/whisker-backend:v3.30.4: active requests=0, bytes read=85" Nov 4 23:22:26.427626 kubelet[3293]: E1104 23:22:26.427533 3293 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker-backend:v3.30.4" Nov 4 23:22:26.427626 kubelet[3293]: E1104 23:22:26.427598 3293 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker-backend:v3.30.4" Nov 4 23:22:26.427850 kubelet[3293]: E1104 23:22:26.427755 3293 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:whisker-backend,Image:ghcr.io/flatcar/calico/whisker-backend:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:INFO,ValueFrom:nil,},EnvVar{Name:PORT,Value:3002,ValueFrom:nil,},EnvVar{Name:GOLDMANE_HOST,Value:goldmane.calico-system.svc.cluster.local:7443,ValueFrom:nil,},EnvVar{Name:TLS_CERT_PATH,Value:/whisker-backend-key-pair/tls.crt,ValueFrom:nil,},EnvVar{Name:TLS_KEY_PATH,Value:/whisker-backend-key-pair/tls.key,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:whisker-backend-key-pair,ReadOnly:true,MountPath:/whisker-backend-key-pair,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:whisker-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-fjghm,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod whisker-778cbdb456-4xzz7_calico-system(404b99f5-b096-49e7-baa1-6b3afbc90705): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" logger="UnhandledError" Nov 4 23:22:26.429082 kubelet[3293]: E1104 23:22:26.428982 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"whisker\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found\", failed to \"StartContainer\" for \"whisker-backend\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found\"]" pod="calico-system/whisker-778cbdb456-4xzz7" podUID="404b99f5-b096-49e7-baa1-6b3afbc90705" Nov 4 23:22:26.858964 containerd[1977]: time="2025-11-04T23:22:26.858876813Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\"" Nov 4 23:22:27.174342 containerd[1977]: time="2025-11-04T23:22:27.174140143Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:22:27.176867 containerd[1977]: time="2025-11-04T23:22:27.176735275Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" Nov 4 23:22:27.176867 containerd[1977]: time="2025-11-04T23:22:27.176820175Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/kube-controllers:v3.30.4: active requests=0, bytes read=85" Nov 4 23:22:27.177112 kubelet[3293]: E1104 23:22:27.177031 3293 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" image="ghcr.io/flatcar/calico/kube-controllers:v3.30.4" Nov 4 23:22:27.177112 kubelet[3293]: E1104 23:22:27.177093 3293 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" image="ghcr.io/flatcar/calico/kube-controllers:v3.30.4" Nov 4 23:22:27.177732 kubelet[3293]: E1104 23:22:27.177296 3293 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:calico-kube-controllers,Image:ghcr.io/flatcar/calico/kube-controllers:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:KUBE_CONTROLLERS_CONFIG_NAME,Value:default,ValueFrom:nil,},EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:ENABLED_CONTROLLERS,Value:node,loadbalancer,ValueFrom:nil,},EnvVar{Name:DISABLE_KUBE_CONTROLLERS_CONFIG_API,Value:false,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:CA_CRT_PATH,Value:/etc/pki/tls/certs/tigera-ca-bundle.crt,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:tigera-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:tigera-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/cert.pem,SubPath:ca-bundle.crt,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-lbpdt,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/usr/bin/check-status -l],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:10,TimeoutSeconds:10,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:6,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/usr/bin/check-status -r],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:10,PeriodSeconds:30,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*999,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-kube-controllers-5c9f7c8689-qhpsj_calico-system(89628730-c640-4e4b-9cec-2cca5b47d9fc): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" logger="UnhandledError" Nov 4 23:22:27.179087 kubelet[3293]: E1104 23:22:27.179020 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-kube-controllers\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found\"" pod="calico-system/calico-kube-controllers-5c9f7c8689-qhpsj" podUID="89628730-c640-4e4b-9cec-2cca5b47d9fc" Nov 4 23:22:27.805822 systemd[1]: Started sshd@8-172.31.21.124:22-139.178.89.65:46162.service - OpenSSH per-connection server daemon (139.178.89.65:46162). Nov 4 23:22:28.017610 sshd[5570]: Accepted publickey for core from 139.178.89.65 port 46162 ssh2: RSA SHA256:hDiwkCWvCQBqijfvK1jv0H0YtRR2s7jf/pLBmZjqWNg Nov 4 23:22:28.020415 sshd-session[5570]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 4 23:22:28.030457 systemd-logind[1949]: New session 9 of user core. Nov 4 23:22:28.040507 systemd[1]: Started session-9.scope - Session 9 of User core. Nov 4 23:22:28.304738 sshd[5573]: Connection closed by 139.178.89.65 port 46162 Nov 4 23:22:28.306548 sshd-session[5570]: pam_unix(sshd:session): session closed for user core Nov 4 23:22:28.314763 systemd[1]: sshd@8-172.31.21.124:22-139.178.89.65:46162.service: Deactivated successfully. Nov 4 23:22:28.319080 systemd[1]: session-9.scope: Deactivated successfully. Nov 4 23:22:28.323740 systemd-logind[1949]: Session 9 logged out. Waiting for processes to exit. Nov 4 23:22:28.327724 systemd-logind[1949]: Removed session 9. Nov 4 23:22:31.860041 containerd[1977]: time="2025-11-04T23:22:31.859974530Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/goldmane:v3.30.4\"" Nov 4 23:22:32.155553 containerd[1977]: time="2025-11-04T23:22:32.155380008Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:22:32.157667 containerd[1977]: time="2025-11-04T23:22:32.157554792Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/goldmane:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" Nov 4 23:22:32.157667 containerd[1977]: time="2025-11-04T23:22:32.157626912Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/goldmane:v3.30.4: active requests=0, bytes read=77" Nov 4 23:22:32.158092 kubelet[3293]: E1104 23:22:32.158024 3293 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" image="ghcr.io/flatcar/calico/goldmane:v3.30.4" Nov 4 23:22:32.159025 kubelet[3293]: E1104 23:22:32.158104 3293 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" image="ghcr.io/flatcar/calico/goldmane:v3.30.4" Nov 4 23:22:32.159025 kubelet[3293]: E1104 23:22:32.158415 3293 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:goldmane,Image:ghcr.io/flatcar/calico/goldmane:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:INFO,ValueFrom:nil,},EnvVar{Name:PORT,Value:7443,ValueFrom:nil,},EnvVar{Name:SERVER_CERT_PATH,Value:/goldmane-key-pair/tls.crt,ValueFrom:nil,},EnvVar{Name:SERVER_KEY_PATH,Value:/goldmane-key-pair/tls.key,ValueFrom:nil,},EnvVar{Name:CA_CERT_PATH,Value:/etc/pki/tls/certs/tigera-ca-bundle.crt,ValueFrom:nil,},EnvVar{Name:PUSH_URL,Value:https://guardian.calico-system.svc.cluster.local:443/api/v1/flows/bulk,ValueFrom:nil,},EnvVar{Name:FILE_CONFIG_PATH,Value:/config/config.json,ValueFrom:nil,},EnvVar{Name:HEALTH_ENABLED,Value:true,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:config,ReadOnly:true,MountPath:/config,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:goldmane-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:goldmane-key-pair,ReadOnly:true,MountPath:/goldmane-key-pair,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-hkw2k,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/health -live],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/health -ready],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:30,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod goldmane-666569f655-lxlsr_calico-system(cdd3b3e0-4537-4eef-a9c5-bf20b3379786): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" logger="UnhandledError" Nov 4 23:22:32.160671 kubelet[3293]: E1104 23:22:32.160611 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"goldmane\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found\"" pod="calico-system/goldmane-666569f655-lxlsr" podUID="cdd3b3e0-4537-4eef-a9c5-bf20b3379786" Nov 4 23:22:32.160790 containerd[1977]: time="2025-11-04T23:22:32.160684596Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\"" Nov 4 23:22:32.461258 containerd[1977]: time="2025-11-04T23:22:32.460558093Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:22:32.462913 containerd[1977]: time="2025-11-04T23:22:32.462831661Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" Nov 4 23:22:32.463260 containerd[1977]: time="2025-11-04T23:22:32.463025281Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/apiserver:v3.30.4: active requests=0, bytes read=77" Nov 4 23:22:32.464358 kubelet[3293]: E1104 23:22:32.463458 3293 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 4 23:22:32.464358 kubelet[3293]: E1104 23:22:32.463518 3293 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 4 23:22:32.464358 kubelet[3293]: E1104 23:22:32.463679 3293 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:calico-apiserver,Image:ghcr.io/flatcar/calico/apiserver:v3.30.4,Command:[],Args:[--secure-port=5443 --tls-private-key-file=/calico-apiserver-certs/tls.key --tls-cert-file=/calico-apiserver-certs/tls.crt],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:LOG_LEVEL,Value:info,ValueFrom:nil,},EnvVar{Name:MULTI_INTERFACE_MODE,Value:none,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:calico-apiserver-certs,ReadOnly:true,MountPath:/calico-apiserver-certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-mpg72,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 5443 },Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-apiserver-996fc7fbb-2jd5x_calico-apiserver(ab3399c0-cd7b-41d5-bf32-586b469457b8): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" logger="UnhandledError" Nov 4 23:22:32.464868 kubelet[3293]: E1104 23:22:32.464822 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-996fc7fbb-2jd5x" podUID="ab3399c0-cd7b-41d5-bf32-586b469457b8" Nov 4 23:22:32.856602 containerd[1977]: time="2025-11-04T23:22:32.856509831Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\"" Nov 4 23:22:33.175758 containerd[1977]: time="2025-11-04T23:22:33.175486381Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:22:33.177830 containerd[1977]: time="2025-11-04T23:22:33.177732217Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" Nov 4 23:22:33.178005 containerd[1977]: time="2025-11-04T23:22:33.177882805Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/apiserver:v3.30.4: active requests=0, bytes read=77" Nov 4 23:22:33.178350 kubelet[3293]: E1104 23:22:33.178262 3293 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 4 23:22:33.179366 kubelet[3293]: E1104 23:22:33.178928 3293 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 4 23:22:33.179366 kubelet[3293]: E1104 23:22:33.179161 3293 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:calico-apiserver,Image:ghcr.io/flatcar/calico/apiserver:v3.30.4,Command:[],Args:[--secure-port=5443 --tls-private-key-file=/calico-apiserver-certs/tls.key --tls-cert-file=/calico-apiserver-certs/tls.crt],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:LOG_LEVEL,Value:info,ValueFrom:nil,},EnvVar{Name:MULTI_INTERFACE_MODE,Value:none,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:calico-apiserver-certs,ReadOnly:true,MountPath:/calico-apiserver-certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-z9769,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 5443 },Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-apiserver-fcc487596-jrhr4_calico-apiserver(068373b4-e189-432e-9f0e-0da4317cec26): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" logger="UnhandledError" Nov 4 23:22:33.180708 kubelet[3293]: E1104 23:22:33.180506 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-fcc487596-jrhr4" podUID="068373b4-e189-432e-9f0e-0da4317cec26" Nov 4 23:22:33.346528 systemd[1]: Started sshd@9-172.31.21.124:22-139.178.89.65:46176.service - OpenSSH per-connection server daemon (139.178.89.65:46176). Nov 4 23:22:33.546039 sshd[5587]: Accepted publickey for core from 139.178.89.65 port 46176 ssh2: RSA SHA256:hDiwkCWvCQBqijfvK1jv0H0YtRR2s7jf/pLBmZjqWNg Nov 4 23:22:33.550485 sshd-session[5587]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 4 23:22:33.561427 systemd-logind[1949]: New session 10 of user core. Nov 4 23:22:33.566541 systemd[1]: Started session-10.scope - Session 10 of User core. Nov 4 23:22:33.822826 sshd[5590]: Connection closed by 139.178.89.65 port 46176 Nov 4 23:22:33.824255 sshd-session[5587]: pam_unix(sshd:session): session closed for user core Nov 4 23:22:33.833477 systemd[1]: sshd@9-172.31.21.124:22-139.178.89.65:46176.service: Deactivated successfully. Nov 4 23:22:33.838304 systemd[1]: session-10.scope: Deactivated successfully. Nov 4 23:22:33.842134 systemd-logind[1949]: Session 10 logged out. Waiting for processes to exit. Nov 4 23:22:33.845155 systemd-logind[1949]: Removed session 10. Nov 4 23:22:33.863227 containerd[1977]: time="2025-11-04T23:22:33.862624804Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/csi:v3.30.4\"" Nov 4 23:22:33.864691 systemd[1]: Started sshd@10-172.31.21.124:22-139.178.89.65:46190.service - OpenSSH per-connection server daemon (139.178.89.65:46190). Nov 4 23:22:34.095030 sshd[5603]: Accepted publickey for core from 139.178.89.65 port 46190 ssh2: RSA SHA256:hDiwkCWvCQBqijfvK1jv0H0YtRR2s7jf/pLBmZjqWNg Nov 4 23:22:34.097300 sshd-session[5603]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 4 23:22:34.106282 systemd-logind[1949]: New session 11 of user core. Nov 4 23:22:34.113501 systemd[1]: Started session-11.scope - Session 11 of User core. Nov 4 23:22:34.140592 containerd[1977]: time="2025-11-04T23:22:34.140526866Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:22:34.142774 containerd[1977]: time="2025-11-04T23:22:34.142703126Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/csi:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" Nov 4 23:22:34.143472 kubelet[3293]: E1104 23:22:34.142996 3293 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" image="ghcr.io/flatcar/calico/csi:v3.30.4" Nov 4 23:22:34.143472 kubelet[3293]: E1104 23:22:34.143061 3293 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" image="ghcr.io/flatcar/calico/csi:v3.30.4" Nov 4 23:22:34.144147 containerd[1977]: time="2025-11-04T23:22:34.143883326Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/csi:v3.30.4: active requests=0, bytes read=69" Nov 4 23:22:34.144288 kubelet[3293]: E1104 23:22:34.144028 3293 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:calico-csi,Image:ghcr.io/flatcar/calico/csi:v3.30.4,Command:[],Args:[--nodeid=$(KUBE_NODE_NAME) --loglevel=$(LOG_LEVEL)],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:warn,ValueFrom:nil,},EnvVar{Name:KUBE_NODE_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:spec.nodeName,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kubelet-dir,ReadOnly:false,MountPath:/var/lib/kubelet,SubPath:,MountPropagation:*Bidirectional,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:socket-dir,ReadOnly:false,MountPath:/csi,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:varrun,ReadOnly:false,MountPath:/var/run,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-hg84v,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*true,SELinuxOptions:nil,RunAsUser:*0,RunAsNonRoot:*false,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*true,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod csi-node-driver-5fvm8_calico-system(0d16ca69-85e0-4dac-8492-1209e5dd061d): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" logger="UnhandledError" Nov 4 23:22:34.148235 containerd[1977]: time="2025-11-04T23:22:34.147410054Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\"" Nov 4 23:22:34.414306 containerd[1977]: time="2025-11-04T23:22:34.413778543Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:22:34.416232 containerd[1977]: time="2025-11-04T23:22:34.416103867Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" Nov 4 23:22:34.416412 containerd[1977]: time="2025-11-04T23:22:34.416136615Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: active requests=0, bytes read=93" Nov 4 23:22:34.417324 kubelet[3293]: E1104 23:22:34.416563 3293 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" image="ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4" Nov 4 23:22:34.419649 kubelet[3293]: E1104 23:22:34.417360 3293 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" image="ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4" Nov 4 23:22:34.419649 kubelet[3293]: E1104 23:22:34.417883 3293 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:csi-node-driver-registrar,Image:ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4,Command:[],Args:[--v=5 --csi-address=$(ADDRESS) --kubelet-registration-path=$(DRIVER_REG_SOCK_PATH)],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:ADDRESS,Value:/csi/csi.sock,ValueFrom:nil,},EnvVar{Name:DRIVER_REG_SOCK_PATH,Value:/var/lib/kubelet/plugins/csi.tigera.io/csi.sock,ValueFrom:nil,},EnvVar{Name:KUBE_NODE_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:spec.nodeName,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:registration-dir,ReadOnly:false,MountPath:/registration,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:socket-dir,ReadOnly:false,MountPath:/csi,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-hg84v,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*true,SELinuxOptions:nil,RunAsUser:*0,RunAsNonRoot:*false,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*true,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod csi-node-driver-5fvm8_calico-system(0d16ca69-85e0-4dac-8492-1209e5dd061d): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" logger="UnhandledError" Nov 4 23:22:34.419649 kubelet[3293]: E1104 23:22:34.419323 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"calico-csi\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ghcr.io/flatcar/calico/csi:v3.30.4: not found\", failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found\"]" pod="calico-system/csi-node-driver-5fvm8" podUID="0d16ca69-85e0-4dac-8492-1209e5dd061d" Nov 4 23:22:34.484913 sshd[5606]: Connection closed by 139.178.89.65 port 46190 Nov 4 23:22:34.486488 sshd-session[5603]: pam_unix(sshd:session): session closed for user core Nov 4 23:22:34.499063 systemd[1]: sshd@10-172.31.21.124:22-139.178.89.65:46190.service: Deactivated successfully. Nov 4 23:22:34.511440 systemd[1]: session-11.scope: Deactivated successfully. Nov 4 23:22:34.543238 systemd-logind[1949]: Session 11 logged out. Waiting for processes to exit. Nov 4 23:22:34.546584 systemd[1]: Started sshd@11-172.31.21.124:22-139.178.89.65:46194.service - OpenSSH per-connection server daemon (139.178.89.65:46194). Nov 4 23:22:34.555064 systemd-logind[1949]: Removed session 11. Nov 4 23:22:34.766635 sshd[5616]: Accepted publickey for core from 139.178.89.65 port 46194 ssh2: RSA SHA256:hDiwkCWvCQBqijfvK1jv0H0YtRR2s7jf/pLBmZjqWNg Nov 4 23:22:34.769325 sshd-session[5616]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 4 23:22:34.782272 systemd-logind[1949]: New session 12 of user core. Nov 4 23:22:34.790545 systemd[1]: Started session-12.scope - Session 12 of User core. Nov 4 23:22:35.109811 sshd[5619]: Connection closed by 139.178.89.65 port 46194 Nov 4 23:22:35.110638 sshd-session[5616]: pam_unix(sshd:session): session closed for user core Nov 4 23:22:35.123576 systemd[1]: sshd@11-172.31.21.124:22-139.178.89.65:46194.service: Deactivated successfully. Nov 4 23:22:35.134382 systemd[1]: session-12.scope: Deactivated successfully. Nov 4 23:22:35.138863 systemd-logind[1949]: Session 12 logged out. Waiting for processes to exit. Nov 4 23:22:35.144501 systemd-logind[1949]: Removed session 12. Nov 4 23:22:35.858781 containerd[1977]: time="2025-11-04T23:22:35.858443406Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\"" Nov 4 23:22:36.124291 containerd[1977]: time="2025-11-04T23:22:36.124083556Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:22:36.126497 containerd[1977]: time="2025-11-04T23:22:36.126357508Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" Nov 4 23:22:36.126497 containerd[1977]: time="2025-11-04T23:22:36.126422092Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/apiserver:v3.30.4: active requests=0, bytes read=77" Nov 4 23:22:36.126894 kubelet[3293]: E1104 23:22:36.126730 3293 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 4 23:22:36.126894 kubelet[3293]: E1104 23:22:36.126792 3293 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 4 23:22:36.128390 kubelet[3293]: E1104 23:22:36.126956 3293 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:calico-apiserver,Image:ghcr.io/flatcar/calico/apiserver:v3.30.4,Command:[],Args:[--secure-port=5443 --tls-private-key-file=/calico-apiserver-certs/tls.key --tls-cert-file=/calico-apiserver-certs/tls.crt],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:LOG_LEVEL,Value:info,ValueFrom:nil,},EnvVar{Name:MULTI_INTERFACE_MODE,Value:none,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:calico-apiserver-certs,ReadOnly:true,MountPath:/calico-apiserver-certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-jtkhl,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 5443 },Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-apiserver-fcc487596-l2mz4_calico-apiserver(af7a1c92-78ca-4756-b8d2-4992b60e6f17): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" logger="UnhandledError" Nov 4 23:22:36.128922 kubelet[3293]: E1104 23:22:36.128858 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-fcc487596-l2mz4" podUID="af7a1c92-78ca-4756-b8d2-4992b60e6f17" Nov 4 23:22:38.860139 kubelet[3293]: E1104 23:22:38.860015 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"whisker\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found\", failed to \"StartContainer\" for \"whisker-backend\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found\"]" pod="calico-system/whisker-778cbdb456-4xzz7" podUID="404b99f5-b096-49e7-baa1-6b3afbc90705" Nov 4 23:22:40.155693 systemd[1]: Started sshd@12-172.31.21.124:22-139.178.89.65:47960.service - OpenSSH per-connection server daemon (139.178.89.65:47960). Nov 4 23:22:40.379367 sshd[5644]: Accepted publickey for core from 139.178.89.65 port 47960 ssh2: RSA SHA256:hDiwkCWvCQBqijfvK1jv0H0YtRR2s7jf/pLBmZjqWNg Nov 4 23:22:40.382483 sshd-session[5644]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 4 23:22:40.402568 systemd-logind[1949]: New session 13 of user core. Nov 4 23:22:40.408599 systemd[1]: Started session-13.scope - Session 13 of User core. Nov 4 23:22:40.686831 sshd[5648]: Connection closed by 139.178.89.65 port 47960 Nov 4 23:22:40.688115 sshd-session[5644]: pam_unix(sshd:session): session closed for user core Nov 4 23:22:40.698570 systemd[1]: sshd@12-172.31.21.124:22-139.178.89.65:47960.service: Deactivated successfully. Nov 4 23:22:40.707541 systemd[1]: session-13.scope: Deactivated successfully. Nov 4 23:22:40.712427 systemd-logind[1949]: Session 13 logged out. Waiting for processes to exit. Nov 4 23:22:40.719090 systemd-logind[1949]: Removed session 13. Nov 4 23:22:42.509366 containerd[1977]: time="2025-11-04T23:22:42.509037443Z" level=info msg="TaskExit event in podsandbox handler container_id:\"6fbaacd9f420f26c2371bcff475a8067c2659e0a2c0d2d16b2a01703f87776c8\" id:\"975510bede6c6e48f2a991a2c66293a2b30585d3c090929356e9486561e9264a\" pid:5673 exit_status:1 exited_at:{seconds:1762298562 nanos:508012991}" Nov 4 23:22:42.859488 kubelet[3293]: E1104 23:22:42.858873 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-kube-controllers\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found\"" pod="calico-system/calico-kube-controllers-5c9f7c8689-qhpsj" podUID="89628730-c640-4e4b-9cec-2cca5b47d9fc" Nov 4 23:22:45.730142 systemd[1]: Started sshd@13-172.31.21.124:22-139.178.89.65:47972.service - OpenSSH per-connection server daemon (139.178.89.65:47972). Nov 4 23:22:45.864675 kubelet[3293]: E1104 23:22:45.864554 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"calico-csi\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ghcr.io/flatcar/calico/csi:v3.30.4: not found\", failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found\"]" pod="calico-system/csi-node-driver-5fvm8" podUID="0d16ca69-85e0-4dac-8492-1209e5dd061d" Nov 4 23:22:45.946727 sshd[5687]: Accepted publickey for core from 139.178.89.65 port 47972 ssh2: RSA SHA256:hDiwkCWvCQBqijfvK1jv0H0YtRR2s7jf/pLBmZjqWNg Nov 4 23:22:45.949637 sshd-session[5687]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 4 23:22:45.959637 systemd-logind[1949]: New session 14 of user core. Nov 4 23:22:45.971675 systemd[1]: Started session-14.scope - Session 14 of User core. Nov 4 23:22:46.256302 sshd[5690]: Connection closed by 139.178.89.65 port 47972 Nov 4 23:22:46.257445 sshd-session[5687]: pam_unix(sshd:session): session closed for user core Nov 4 23:22:46.266164 systemd[1]: sshd@13-172.31.21.124:22-139.178.89.65:47972.service: Deactivated successfully. Nov 4 23:22:46.272417 systemd[1]: session-14.scope: Deactivated successfully. Nov 4 23:22:46.275346 systemd-logind[1949]: Session 14 logged out. Waiting for processes to exit. Nov 4 23:22:46.278927 systemd-logind[1949]: Removed session 14. Nov 4 23:22:46.859268 kubelet[3293]: E1104 23:22:46.859138 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"goldmane\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found\"" pod="calico-system/goldmane-666569f655-lxlsr" podUID="cdd3b3e0-4537-4eef-a9c5-bf20b3379786" Nov 4 23:22:46.859853 kubelet[3293]: E1104 23:22:46.859774 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-996fc7fbb-2jd5x" podUID="ab3399c0-cd7b-41d5-bf32-586b469457b8" Nov 4 23:22:46.860046 kubelet[3293]: E1104 23:22:46.859990 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-fcc487596-jrhr4" podUID="068373b4-e189-432e-9f0e-0da4317cec26" Nov 4 23:22:48.857260 kubelet[3293]: E1104 23:22:48.857105 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-fcc487596-l2mz4" podUID="af7a1c92-78ca-4756-b8d2-4992b60e6f17" Nov 4 23:22:49.861116 containerd[1977]: time="2025-11-04T23:22:49.860961380Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/whisker:v3.30.4\"" Nov 4 23:22:50.154648 containerd[1977]: time="2025-11-04T23:22:50.154481405Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:22:50.157660 containerd[1977]: time="2025-11-04T23:22:50.157559837Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/whisker:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" Nov 4 23:22:50.157880 containerd[1977]: time="2025-11-04T23:22:50.157710413Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/whisker:v3.30.4: active requests=0, bytes read=73" Nov 4 23:22:50.158019 kubelet[3293]: E1104 23:22:50.157973 3293 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker:v3.30.4" Nov 4 23:22:50.159346 kubelet[3293]: E1104 23:22:50.158059 3293 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker:v3.30.4" Nov 4 23:22:50.159346 kubelet[3293]: E1104 23:22:50.158454 3293 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:whisker,Image:ghcr.io/flatcar/calico/whisker:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:INFO,ValueFrom:nil,},EnvVar{Name:CALICO_VERSION,Value:v3.30.4,ValueFrom:nil,},EnvVar{Name:CLUSTER_ID,Value:0ca3151f26aa44ec95a034255ce8af62,ValueFrom:nil,},EnvVar{Name:CLUSTER_TYPE,Value:typha,kdd,k8s,operator,bgp,kubeadm,ValueFrom:nil,},EnvVar{Name:NOTIFICATIONS,Value:Enabled,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-fjghm,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod whisker-778cbdb456-4xzz7_calico-system(404b99f5-b096-49e7-baa1-6b3afbc90705): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" logger="UnhandledError" Nov 4 23:22:50.162399 containerd[1977]: time="2025-11-04T23:22:50.162338225Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\"" Nov 4 23:22:50.498795 containerd[1977]: time="2025-11-04T23:22:50.498648199Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:22:50.501435 containerd[1977]: time="2025-11-04T23:22:50.501322183Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" Nov 4 23:22:50.501781 containerd[1977]: time="2025-11-04T23:22:50.501339235Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/whisker-backend:v3.30.4: active requests=0, bytes read=85" Nov 4 23:22:50.501890 kubelet[3293]: E1104 23:22:50.501665 3293 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker-backend:v3.30.4" Nov 4 23:22:50.501890 kubelet[3293]: E1104 23:22:50.501732 3293 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker-backend:v3.30.4" Nov 4 23:22:50.502022 kubelet[3293]: E1104 23:22:50.501900 3293 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:whisker-backend,Image:ghcr.io/flatcar/calico/whisker-backend:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:INFO,ValueFrom:nil,},EnvVar{Name:PORT,Value:3002,ValueFrom:nil,},EnvVar{Name:GOLDMANE_HOST,Value:goldmane.calico-system.svc.cluster.local:7443,ValueFrom:nil,},EnvVar{Name:TLS_CERT_PATH,Value:/whisker-backend-key-pair/tls.crt,ValueFrom:nil,},EnvVar{Name:TLS_KEY_PATH,Value:/whisker-backend-key-pair/tls.key,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:whisker-backend-key-pair,ReadOnly:true,MountPath:/whisker-backend-key-pair,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:whisker-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-fjghm,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod whisker-778cbdb456-4xzz7_calico-system(404b99f5-b096-49e7-baa1-6b3afbc90705): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" logger="UnhandledError" Nov 4 23:22:50.503504 kubelet[3293]: E1104 23:22:50.503428 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"whisker\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found\", failed to \"StartContainer\" for \"whisker-backend\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found\"]" pod="calico-system/whisker-778cbdb456-4xzz7" podUID="404b99f5-b096-49e7-baa1-6b3afbc90705" Nov 4 23:22:51.298044 systemd[1]: Started sshd@14-172.31.21.124:22-139.178.89.65:41676.service - OpenSSH per-connection server daemon (139.178.89.65:41676). Nov 4 23:22:51.504225 sshd[5706]: Accepted publickey for core from 139.178.89.65 port 41676 ssh2: RSA SHA256:hDiwkCWvCQBqijfvK1jv0H0YtRR2s7jf/pLBmZjqWNg Nov 4 23:22:51.507649 sshd-session[5706]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 4 23:22:51.518375 systemd-logind[1949]: New session 15 of user core. Nov 4 23:22:51.526470 systemd[1]: Started session-15.scope - Session 15 of User core. Nov 4 23:22:51.778324 sshd[5711]: Connection closed by 139.178.89.65 port 41676 Nov 4 23:22:51.779465 sshd-session[5706]: pam_unix(sshd:session): session closed for user core Nov 4 23:22:51.788001 systemd[1]: sshd@14-172.31.21.124:22-139.178.89.65:41676.service: Deactivated successfully. Nov 4 23:22:51.796009 systemd[1]: session-15.scope: Deactivated successfully. Nov 4 23:22:51.799540 systemd-logind[1949]: Session 15 logged out. Waiting for processes to exit. Nov 4 23:22:51.804003 systemd-logind[1949]: Removed session 15. Nov 4 23:22:56.832180 systemd[1]: Started sshd@15-172.31.21.124:22-139.178.89.65:50866.service - OpenSSH per-connection server daemon (139.178.89.65:50866). Nov 4 23:22:56.862690 containerd[1977]: time="2025-11-04T23:22:56.862620963Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/csi:v3.30.4\"" Nov 4 23:22:57.091620 sshd[5729]: Accepted publickey for core from 139.178.89.65 port 50866 ssh2: RSA SHA256:hDiwkCWvCQBqijfvK1jv0H0YtRR2s7jf/pLBmZjqWNg Nov 4 23:22:57.094727 sshd-session[5729]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 4 23:22:57.111322 systemd-logind[1949]: New session 16 of user core. Nov 4 23:22:57.118836 systemd[1]: Started session-16.scope - Session 16 of User core. Nov 4 23:22:57.135116 containerd[1977]: time="2025-11-04T23:22:57.135052740Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:22:57.138952 containerd[1977]: time="2025-11-04T23:22:57.138763404Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/csi:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" Nov 4 23:22:57.139119 containerd[1977]: time="2025-11-04T23:22:57.138841884Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/csi:v3.30.4: active requests=0, bytes read=69" Nov 4 23:22:57.139341 kubelet[3293]: E1104 23:22:57.139183 3293 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" image="ghcr.io/flatcar/calico/csi:v3.30.4" Nov 4 23:22:57.140874 kubelet[3293]: E1104 23:22:57.139336 3293 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" image="ghcr.io/flatcar/calico/csi:v3.30.4" Nov 4 23:22:57.140874 kubelet[3293]: E1104 23:22:57.139590 3293 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:calico-csi,Image:ghcr.io/flatcar/calico/csi:v3.30.4,Command:[],Args:[--nodeid=$(KUBE_NODE_NAME) --loglevel=$(LOG_LEVEL)],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:warn,ValueFrom:nil,},EnvVar{Name:KUBE_NODE_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:spec.nodeName,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kubelet-dir,ReadOnly:false,MountPath:/var/lib/kubelet,SubPath:,MountPropagation:*Bidirectional,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:socket-dir,ReadOnly:false,MountPath:/csi,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:varrun,ReadOnly:false,MountPath:/var/run,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-hg84v,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*true,SELinuxOptions:nil,RunAsUser:*0,RunAsNonRoot:*false,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*true,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod csi-node-driver-5fvm8_calico-system(0d16ca69-85e0-4dac-8492-1209e5dd061d): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" logger="UnhandledError" Nov 4 23:22:57.146130 containerd[1977]: time="2025-11-04T23:22:57.146062920Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\"" Nov 4 23:22:57.397622 sshd[5732]: Connection closed by 139.178.89.65 port 50866 Nov 4 23:22:57.399072 sshd-session[5729]: pam_unix(sshd:session): session closed for user core Nov 4 23:22:57.409408 systemd-logind[1949]: Session 16 logged out. Waiting for processes to exit. Nov 4 23:22:57.410588 systemd[1]: sshd@15-172.31.21.124:22-139.178.89.65:50866.service: Deactivated successfully. Nov 4 23:22:57.411031 containerd[1977]: time="2025-11-04T23:22:57.410966245Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:22:57.416746 containerd[1977]: time="2025-11-04T23:22:57.416452033Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" Nov 4 23:22:57.416746 containerd[1977]: time="2025-11-04T23:22:57.416586205Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: active requests=0, bytes read=93" Nov 4 23:22:57.417238 kubelet[3293]: E1104 23:22:57.417107 3293 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" image="ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4" Nov 4 23:22:57.417933 kubelet[3293]: E1104 23:22:57.417250 3293 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" image="ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4" Nov 4 23:22:57.417933 kubelet[3293]: E1104 23:22:57.417460 3293 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:csi-node-driver-registrar,Image:ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4,Command:[],Args:[--v=5 --csi-address=$(ADDRESS) --kubelet-registration-path=$(DRIVER_REG_SOCK_PATH)],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:ADDRESS,Value:/csi/csi.sock,ValueFrom:nil,},EnvVar{Name:DRIVER_REG_SOCK_PATH,Value:/var/lib/kubelet/plugins/csi.tigera.io/csi.sock,ValueFrom:nil,},EnvVar{Name:KUBE_NODE_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:spec.nodeName,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:registration-dir,ReadOnly:false,MountPath:/registration,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:socket-dir,ReadOnly:false,MountPath:/csi,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-hg84v,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*true,SELinuxOptions:nil,RunAsUser:*0,RunAsNonRoot:*false,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*true,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod csi-node-driver-5fvm8_calico-system(0d16ca69-85e0-4dac-8492-1209e5dd061d): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" logger="UnhandledError" Nov 4 23:22:57.418248 systemd[1]: session-16.scope: Deactivated successfully. Nov 4 23:22:57.421121 kubelet[3293]: E1104 23:22:57.418642 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"calico-csi\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ghcr.io/flatcar/calico/csi:v3.30.4: not found\", failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found\"]" pod="calico-system/csi-node-driver-5fvm8" podUID="0d16ca69-85e0-4dac-8492-1209e5dd061d" Nov 4 23:22:57.444595 systemd-logind[1949]: Removed session 16. Nov 4 23:22:57.445046 systemd[1]: Started sshd@16-172.31.21.124:22-139.178.89.65:50876.service - OpenSSH per-connection server daemon (139.178.89.65:50876). Nov 4 23:22:57.660771 sshd[5744]: Accepted publickey for core from 139.178.89.65 port 50876 ssh2: RSA SHA256:hDiwkCWvCQBqijfvK1jv0H0YtRR2s7jf/pLBmZjqWNg Nov 4 23:22:57.662847 sshd-session[5744]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 4 23:22:57.674227 systemd-logind[1949]: New session 17 of user core. Nov 4 23:22:57.680578 systemd[1]: Started session-17.scope - Session 17 of User core. Nov 4 23:22:57.861468 containerd[1977]: time="2025-11-04T23:22:57.859317063Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\"" Nov 4 23:22:58.131487 containerd[1977]: time="2025-11-04T23:22:58.131405737Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:22:58.133819 containerd[1977]: time="2025-11-04T23:22:58.133687081Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" Nov 4 23:22:58.133819 containerd[1977]: time="2025-11-04T23:22:58.133756681Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/apiserver:v3.30.4: active requests=0, bytes read=77" Nov 4 23:22:58.134087 kubelet[3293]: E1104 23:22:58.133990 3293 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 4 23:22:58.134087 kubelet[3293]: E1104 23:22:58.134048 3293 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 4 23:22:58.134596 containerd[1977]: time="2025-11-04T23:22:58.134540389Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\"" Nov 4 23:22:58.137435 kubelet[3293]: E1104 23:22:58.137305 3293 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:calico-apiserver,Image:ghcr.io/flatcar/calico/apiserver:v3.30.4,Command:[],Args:[--secure-port=5443 --tls-private-key-file=/calico-apiserver-certs/tls.key --tls-cert-file=/calico-apiserver-certs/tls.crt],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:LOG_LEVEL,Value:info,ValueFrom:nil,},EnvVar{Name:MULTI_INTERFACE_MODE,Value:none,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:calico-apiserver-certs,ReadOnly:true,MountPath:/calico-apiserver-certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-z9769,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 5443 },Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-apiserver-fcc487596-jrhr4_calico-apiserver(068373b4-e189-432e-9f0e-0da4317cec26): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" logger="UnhandledError" Nov 4 23:22:58.143994 kubelet[3293]: E1104 23:22:58.143292 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-fcc487596-jrhr4" podUID="068373b4-e189-432e-9f0e-0da4317cec26" Nov 4 23:22:58.433945 containerd[1977]: time="2025-11-04T23:22:58.433306226Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:22:58.437836 containerd[1977]: time="2025-11-04T23:22:58.437693354Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" Nov 4 23:22:58.437836 containerd[1977]: time="2025-11-04T23:22:58.437819198Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/kube-controllers:v3.30.4: active requests=0, bytes read=85" Nov 4 23:22:58.438897 kubelet[3293]: E1104 23:22:58.438804 3293 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" image="ghcr.io/flatcar/calico/kube-controllers:v3.30.4" Nov 4 23:22:58.439425 kubelet[3293]: E1104 23:22:58.438911 3293 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" image="ghcr.io/flatcar/calico/kube-controllers:v3.30.4" Nov 4 23:22:58.439425 kubelet[3293]: E1104 23:22:58.439248 3293 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:calico-kube-controllers,Image:ghcr.io/flatcar/calico/kube-controllers:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:KUBE_CONTROLLERS_CONFIG_NAME,Value:default,ValueFrom:nil,},EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:ENABLED_CONTROLLERS,Value:node,loadbalancer,ValueFrom:nil,},EnvVar{Name:DISABLE_KUBE_CONTROLLERS_CONFIG_API,Value:false,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:CA_CRT_PATH,Value:/etc/pki/tls/certs/tigera-ca-bundle.crt,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:tigera-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:tigera-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/cert.pem,SubPath:ca-bundle.crt,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-lbpdt,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/usr/bin/check-status -l],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:10,TimeoutSeconds:10,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:6,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/usr/bin/check-status -r],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:10,PeriodSeconds:30,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*999,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-kube-controllers-5c9f7c8689-qhpsj_calico-system(89628730-c640-4e4b-9cec-2cca5b47d9fc): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" logger="UnhandledError" Nov 4 23:22:58.442022 kubelet[3293]: E1104 23:22:58.440805 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-kube-controllers\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found\"" pod="calico-system/calico-kube-controllers-5c9f7c8689-qhpsj" podUID="89628730-c640-4e4b-9cec-2cca5b47d9fc" Nov 4 23:22:58.442131 containerd[1977]: time="2025-11-04T23:22:58.439513094Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/goldmane:v3.30.4\"" Nov 4 23:22:58.728173 containerd[1977]: time="2025-11-04T23:22:58.727660828Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:22:58.730018 containerd[1977]: time="2025-11-04T23:22:58.729919120Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/goldmane:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" Nov 4 23:22:58.730368 containerd[1977]: time="2025-11-04T23:22:58.729976084Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/goldmane:v3.30.4: active requests=0, bytes read=77" Nov 4 23:22:58.731161 kubelet[3293]: E1104 23:22:58.731019 3293 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" image="ghcr.io/flatcar/calico/goldmane:v3.30.4" Nov 4 23:22:58.732986 kubelet[3293]: E1104 23:22:58.731125 3293 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" image="ghcr.io/flatcar/calico/goldmane:v3.30.4" Nov 4 23:22:58.734615 kubelet[3293]: E1104 23:22:58.733453 3293 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:goldmane,Image:ghcr.io/flatcar/calico/goldmane:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:INFO,ValueFrom:nil,},EnvVar{Name:PORT,Value:7443,ValueFrom:nil,},EnvVar{Name:SERVER_CERT_PATH,Value:/goldmane-key-pair/tls.crt,ValueFrom:nil,},EnvVar{Name:SERVER_KEY_PATH,Value:/goldmane-key-pair/tls.key,ValueFrom:nil,},EnvVar{Name:CA_CERT_PATH,Value:/etc/pki/tls/certs/tigera-ca-bundle.crt,ValueFrom:nil,},EnvVar{Name:PUSH_URL,Value:https://guardian.calico-system.svc.cluster.local:443/api/v1/flows/bulk,ValueFrom:nil,},EnvVar{Name:FILE_CONFIG_PATH,Value:/config/config.json,ValueFrom:nil,},EnvVar{Name:HEALTH_ENABLED,Value:true,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:config,ReadOnly:true,MountPath:/config,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:goldmane-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:goldmane-key-pair,ReadOnly:true,MountPath:/goldmane-key-pair,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-hkw2k,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/health -live],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/health -ready],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:30,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod goldmane-666569f655-lxlsr_calico-system(cdd3b3e0-4537-4eef-a9c5-bf20b3379786): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" logger="UnhandledError" Nov 4 23:22:58.735886 kubelet[3293]: E1104 23:22:58.735755 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"goldmane\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found\"" pod="calico-system/goldmane-666569f655-lxlsr" podUID="cdd3b3e0-4537-4eef-a9c5-bf20b3379786" Nov 4 23:22:58.897986 sshd[5747]: Connection closed by 139.178.89.65 port 50876 Nov 4 23:22:58.898816 sshd-session[5744]: pam_unix(sshd:session): session closed for user core Nov 4 23:22:58.909744 systemd[1]: sshd@16-172.31.21.124:22-139.178.89.65:50876.service: Deactivated successfully. Nov 4 23:22:58.917699 systemd[1]: session-17.scope: Deactivated successfully. Nov 4 23:22:58.921193 systemd-logind[1949]: Session 17 logged out. Waiting for processes to exit. Nov 4 23:22:58.941131 systemd[1]: Started sshd@17-172.31.21.124:22-139.178.89.65:50884.service - OpenSSH per-connection server daemon (139.178.89.65:50884). Nov 4 23:22:58.945599 systemd-logind[1949]: Removed session 17. Nov 4 23:22:59.142758 sshd[5759]: Accepted publickey for core from 139.178.89.65 port 50884 ssh2: RSA SHA256:hDiwkCWvCQBqijfvK1jv0H0YtRR2s7jf/pLBmZjqWNg Nov 4 23:22:59.145397 sshd-session[5759]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 4 23:22:59.157340 systemd-logind[1949]: New session 18 of user core. Nov 4 23:22:59.165493 systemd[1]: Started session-18.scope - Session 18 of User core. Nov 4 23:23:00.414268 sshd[5762]: Connection closed by 139.178.89.65 port 50884 Nov 4 23:23:00.415514 sshd-session[5759]: pam_unix(sshd:session): session closed for user core Nov 4 23:23:00.425053 systemd[1]: sshd@17-172.31.21.124:22-139.178.89.65:50884.service: Deactivated successfully. Nov 4 23:23:00.430814 systemd[1]: session-18.scope: Deactivated successfully. Nov 4 23:23:00.439407 systemd-logind[1949]: Session 18 logged out. Waiting for processes to exit. Nov 4 23:23:00.468849 systemd[1]: Started sshd@18-172.31.21.124:22-139.178.89.65:50900.service - OpenSSH per-connection server daemon (139.178.89.65:50900). Nov 4 23:23:00.473192 systemd-logind[1949]: Removed session 18. Nov 4 23:23:00.704035 sshd[5795]: Accepted publickey for core from 139.178.89.65 port 50900 ssh2: RSA SHA256:hDiwkCWvCQBqijfvK1jv0H0YtRR2s7jf/pLBmZjqWNg Nov 4 23:23:00.706997 sshd-session[5795]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 4 23:23:00.717306 systemd-logind[1949]: New session 19 of user core. Nov 4 23:23:00.728582 systemd[1]: Started session-19.scope - Session 19 of User core. Nov 4 23:23:00.860694 containerd[1977]: time="2025-11-04T23:23:00.860347662Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\"" Nov 4 23:23:01.123260 containerd[1977]: time="2025-11-04T23:23:01.122479924Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:23:01.125912 containerd[1977]: time="2025-11-04T23:23:01.125702464Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" Nov 4 23:23:01.125912 containerd[1977]: time="2025-11-04T23:23:01.125834428Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/apiserver:v3.30.4: active requests=0, bytes read=77" Nov 4 23:23:01.126509 kubelet[3293]: E1104 23:23:01.126349 3293 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 4 23:23:01.126509 kubelet[3293]: E1104 23:23:01.126421 3293 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 4 23:23:01.128117 kubelet[3293]: E1104 23:23:01.127762 3293 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:calico-apiserver,Image:ghcr.io/flatcar/calico/apiserver:v3.30.4,Command:[],Args:[--secure-port=5443 --tls-private-key-file=/calico-apiserver-certs/tls.key --tls-cert-file=/calico-apiserver-certs/tls.crt],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:LOG_LEVEL,Value:info,ValueFrom:nil,},EnvVar{Name:MULTI_INTERFACE_MODE,Value:none,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:calico-apiserver-certs,ReadOnly:true,MountPath:/calico-apiserver-certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-mpg72,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 5443 },Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-apiserver-996fc7fbb-2jd5x_calico-apiserver(ab3399c0-cd7b-41d5-bf32-586b469457b8): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" logger="UnhandledError" Nov 4 23:23:01.130576 kubelet[3293]: E1104 23:23:01.130454 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-996fc7fbb-2jd5x" podUID="ab3399c0-cd7b-41d5-bf32-586b469457b8" Nov 4 23:23:01.331361 sshd[5799]: Connection closed by 139.178.89.65 port 50900 Nov 4 23:23:01.333568 sshd-session[5795]: pam_unix(sshd:session): session closed for user core Nov 4 23:23:01.342603 systemd-logind[1949]: Session 19 logged out. Waiting for processes to exit. Nov 4 23:23:01.344455 systemd[1]: sshd@18-172.31.21.124:22-139.178.89.65:50900.service: Deactivated successfully. Nov 4 23:23:01.349134 systemd[1]: session-19.scope: Deactivated successfully. Nov 4 23:23:01.354668 systemd-logind[1949]: Removed session 19. Nov 4 23:23:01.370309 systemd[1]: Started sshd@19-172.31.21.124:22-139.178.89.65:50910.service - OpenSSH per-connection server daemon (139.178.89.65:50910). Nov 4 23:23:01.577508 sshd[5811]: Accepted publickey for core from 139.178.89.65 port 50910 ssh2: RSA SHA256:hDiwkCWvCQBqijfvK1jv0H0YtRR2s7jf/pLBmZjqWNg Nov 4 23:23:01.580594 sshd-session[5811]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 4 23:23:01.591351 systemd-logind[1949]: New session 20 of user core. Nov 4 23:23:01.595493 systemd[1]: Started session-20.scope - Session 20 of User core. Nov 4 23:23:01.843744 sshd[5814]: Connection closed by 139.178.89.65 port 50910 Nov 4 23:23:01.847917 sshd-session[5811]: pam_unix(sshd:session): session closed for user core Nov 4 23:23:01.856654 systemd[1]: sshd@19-172.31.21.124:22-139.178.89.65:50910.service: Deactivated successfully. Nov 4 23:23:01.870985 kubelet[3293]: E1104 23:23:01.870912 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"whisker\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found\", failed to \"StartContainer\" for \"whisker-backend\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found\"]" pod="calico-system/whisker-778cbdb456-4xzz7" podUID="404b99f5-b096-49e7-baa1-6b3afbc90705" Nov 4 23:23:01.871990 systemd[1]: session-20.scope: Deactivated successfully. Nov 4 23:23:01.878540 systemd-logind[1949]: Session 20 logged out. Waiting for processes to exit. Nov 4 23:23:01.887932 systemd-logind[1949]: Removed session 20. Nov 4 23:23:03.860474 containerd[1977]: time="2025-11-04T23:23:03.860247981Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\"" Nov 4 23:23:04.141101 containerd[1977]: time="2025-11-04T23:23:04.140915503Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:23:04.143412 containerd[1977]: time="2025-11-04T23:23:04.143193271Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" Nov 4 23:23:04.143589 containerd[1977]: time="2025-11-04T23:23:04.143255395Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/apiserver:v3.30.4: active requests=0, bytes read=77" Nov 4 23:23:04.144043 kubelet[3293]: E1104 23:23:04.143798 3293 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 4 23:23:04.144043 kubelet[3293]: E1104 23:23:04.143867 3293 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 4 23:23:04.145531 kubelet[3293]: E1104 23:23:04.145266 3293 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:calico-apiserver,Image:ghcr.io/flatcar/calico/apiserver:v3.30.4,Command:[],Args:[--secure-port=5443 --tls-private-key-file=/calico-apiserver-certs/tls.key --tls-cert-file=/calico-apiserver-certs/tls.crt],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:LOG_LEVEL,Value:info,ValueFrom:nil,},EnvVar{Name:MULTI_INTERFACE_MODE,Value:none,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:calico-apiserver-certs,ReadOnly:true,MountPath:/calico-apiserver-certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-jtkhl,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 5443 },Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-apiserver-fcc487596-l2mz4_calico-apiserver(af7a1c92-78ca-4756-b8d2-4992b60e6f17): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" logger="UnhandledError" Nov 4 23:23:04.147307 kubelet[3293]: E1104 23:23:04.147131 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-fcc487596-l2mz4" podUID="af7a1c92-78ca-4756-b8d2-4992b60e6f17" Nov 4 23:23:06.883189 systemd[1]: Started sshd@20-172.31.21.124:22-139.178.89.65:38708.service - OpenSSH per-connection server daemon (139.178.89.65:38708). Nov 4 23:23:07.096947 sshd[5827]: Accepted publickey for core from 139.178.89.65 port 38708 ssh2: RSA SHA256:hDiwkCWvCQBqijfvK1jv0H0YtRR2s7jf/pLBmZjqWNg Nov 4 23:23:07.100308 sshd-session[5827]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 4 23:23:07.109511 systemd-logind[1949]: New session 21 of user core. Nov 4 23:23:07.122509 systemd[1]: Started session-21.scope - Session 21 of User core. Nov 4 23:23:07.446858 sshd[5832]: Connection closed by 139.178.89.65 port 38708 Nov 4 23:23:07.447931 sshd-session[5827]: pam_unix(sshd:session): session closed for user core Nov 4 23:23:07.462021 systemd[1]: sshd@20-172.31.21.124:22-139.178.89.65:38708.service: Deactivated successfully. Nov 4 23:23:07.471105 systemd[1]: session-21.scope: Deactivated successfully. Nov 4 23:23:07.473393 systemd-logind[1949]: Session 21 logged out. Waiting for processes to exit. Nov 4 23:23:07.476438 systemd-logind[1949]: Removed session 21. Nov 4 23:23:09.862880 kubelet[3293]: E1104 23:23:09.862763 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"calico-csi\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ghcr.io/flatcar/calico/csi:v3.30.4: not found\", failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found\"]" pod="calico-system/csi-node-driver-5fvm8" podUID="0d16ca69-85e0-4dac-8492-1209e5dd061d" Nov 4 23:23:10.857664 kubelet[3293]: E1104 23:23:10.857045 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-fcc487596-jrhr4" podUID="068373b4-e189-432e-9f0e-0da4317cec26" Nov 4 23:23:11.858427 kubelet[3293]: E1104 23:23:11.856980 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-kube-controllers\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found\"" pod="calico-system/calico-kube-controllers-5c9f7c8689-qhpsj" podUID="89628730-c640-4e4b-9cec-2cca5b47d9fc" Nov 4 23:23:12.443989 containerd[1977]: time="2025-11-04T23:23:12.443847940Z" level=info msg="TaskExit event in podsandbox handler container_id:\"6fbaacd9f420f26c2371bcff475a8067c2659e0a2c0d2d16b2a01703f87776c8\" id:\"339537221dbc5052fa5eeceb9263bcd5b9b5c632bab6ec515a32c72b4786d97a\" pid:5854 exited_at:{seconds:1762298592 nanos:443300044}" Nov 4 23:23:12.492734 systemd[1]: Started sshd@21-172.31.21.124:22-139.178.89.65:38714.service - OpenSSH per-connection server daemon (139.178.89.65:38714). Nov 4 23:23:12.706995 sshd[5866]: Accepted publickey for core from 139.178.89.65 port 38714 ssh2: RSA SHA256:hDiwkCWvCQBqijfvK1jv0H0YtRR2s7jf/pLBmZjqWNg Nov 4 23:23:12.711111 sshd-session[5866]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 4 23:23:12.723339 systemd-logind[1949]: New session 22 of user core. Nov 4 23:23:12.738574 systemd[1]: Started session-22.scope - Session 22 of User core. Nov 4 23:23:13.006998 sshd[5869]: Connection closed by 139.178.89.65 port 38714 Nov 4 23:23:13.007553 sshd-session[5866]: pam_unix(sshd:session): session closed for user core Nov 4 23:23:13.018649 systemd[1]: sshd@21-172.31.21.124:22-139.178.89.65:38714.service: Deactivated successfully. Nov 4 23:23:13.022958 systemd[1]: session-22.scope: Deactivated successfully. Nov 4 23:23:13.028923 systemd-logind[1949]: Session 22 logged out. Waiting for processes to exit. Nov 4 23:23:13.032476 systemd-logind[1949]: Removed session 22. Nov 4 23:23:13.859281 kubelet[3293]: E1104 23:23:13.857146 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"goldmane\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found\"" pod="calico-system/goldmane-666569f655-lxlsr" podUID="cdd3b3e0-4537-4eef-a9c5-bf20b3379786" Nov 4 23:23:14.858371 kubelet[3293]: E1104 23:23:14.858295 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-996fc7fbb-2jd5x" podUID="ab3399c0-cd7b-41d5-bf32-586b469457b8" Nov 4 23:23:15.865716 kubelet[3293]: E1104 23:23:15.865588 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"whisker\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found\", failed to \"StartContainer\" for \"whisker-backend\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found\"]" pod="calico-system/whisker-778cbdb456-4xzz7" podUID="404b99f5-b096-49e7-baa1-6b3afbc90705" Nov 4 23:23:16.857879 kubelet[3293]: E1104 23:23:16.857801 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-fcc487596-l2mz4" podUID="af7a1c92-78ca-4756-b8d2-4992b60e6f17" Nov 4 23:23:18.048477 systemd[1]: Started sshd@22-172.31.21.124:22-139.178.89.65:54102.service - OpenSSH per-connection server daemon (139.178.89.65:54102). Nov 4 23:23:18.260238 sshd[5885]: Accepted publickey for core from 139.178.89.65 port 54102 ssh2: RSA SHA256:hDiwkCWvCQBqijfvK1jv0H0YtRR2s7jf/pLBmZjqWNg Nov 4 23:23:18.262756 sshd-session[5885]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 4 23:23:18.276600 systemd-logind[1949]: New session 23 of user core. Nov 4 23:23:18.284625 systemd[1]: Started session-23.scope - Session 23 of User core. Nov 4 23:23:18.584574 sshd[5888]: Connection closed by 139.178.89.65 port 54102 Nov 4 23:23:18.585816 sshd-session[5885]: pam_unix(sshd:session): session closed for user core Nov 4 23:23:18.595067 systemd[1]: sshd@22-172.31.21.124:22-139.178.89.65:54102.service: Deactivated successfully. Nov 4 23:23:18.603594 systemd[1]: session-23.scope: Deactivated successfully. Nov 4 23:23:18.609347 systemd-logind[1949]: Session 23 logged out. Waiting for processes to exit. Nov 4 23:23:18.613695 systemd-logind[1949]: Removed session 23. Nov 4 23:23:20.862389 kubelet[3293]: E1104 23:23:20.862260 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"calico-csi\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ghcr.io/flatcar/calico/csi:v3.30.4: not found\", failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found\"]" pod="calico-system/csi-node-driver-5fvm8" podUID="0d16ca69-85e0-4dac-8492-1209e5dd061d" Nov 4 23:23:21.858535 kubelet[3293]: E1104 23:23:21.857845 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-fcc487596-jrhr4" podUID="068373b4-e189-432e-9f0e-0da4317cec26" Nov 4 23:23:23.630686 systemd[1]: Started sshd@23-172.31.21.124:22-139.178.89.65:54116.service - OpenSSH per-connection server daemon (139.178.89.65:54116). Nov 4 23:23:23.847565 sshd[5902]: Accepted publickey for core from 139.178.89.65 port 54116 ssh2: RSA SHA256:hDiwkCWvCQBqijfvK1jv0H0YtRR2s7jf/pLBmZjqWNg Nov 4 23:23:23.852596 sshd-session[5902]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 4 23:23:23.872516 systemd-logind[1949]: New session 24 of user core. Nov 4 23:23:23.882283 systemd[1]: Started session-24.scope - Session 24 of User core. Nov 4 23:23:24.234581 sshd[5905]: Connection closed by 139.178.89.65 port 54116 Nov 4 23:23:24.236949 sshd-session[5902]: pam_unix(sshd:session): session closed for user core Nov 4 23:23:24.247759 systemd[1]: sshd@23-172.31.21.124:22-139.178.89.65:54116.service: Deactivated successfully. Nov 4 23:23:24.253944 systemd[1]: session-24.scope: Deactivated successfully. Nov 4 23:23:24.256866 systemd-logind[1949]: Session 24 logged out. Waiting for processes to exit. Nov 4 23:23:24.262157 systemd-logind[1949]: Removed session 24. Nov 4 23:23:25.860507 kubelet[3293]: E1104 23:23:25.860415 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-kube-controllers\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found\"" pod="calico-system/calico-kube-controllers-5c9f7c8689-qhpsj" podUID="89628730-c640-4e4b-9cec-2cca5b47d9fc" Nov 4 23:23:27.859934 kubelet[3293]: E1104 23:23:27.859732 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"goldmane\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found\"" pod="calico-system/goldmane-666569f655-lxlsr" podUID="cdd3b3e0-4537-4eef-a9c5-bf20b3379786" Nov 4 23:23:28.859302 kubelet[3293]: E1104 23:23:28.858790 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-fcc487596-l2mz4" podUID="af7a1c92-78ca-4756-b8d2-4992b60e6f17" Nov 4 23:23:29.277157 systemd[1]: Started sshd@24-172.31.21.124:22-139.178.89.65:43670.service - OpenSSH per-connection server daemon (139.178.89.65:43670). Nov 4 23:23:29.502331 sshd[5917]: Accepted publickey for core from 139.178.89.65 port 43670 ssh2: RSA SHA256:hDiwkCWvCQBqijfvK1jv0H0YtRR2s7jf/pLBmZjqWNg Nov 4 23:23:29.505045 sshd-session[5917]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 4 23:23:29.516776 systemd-logind[1949]: New session 25 of user core. Nov 4 23:23:29.524928 systemd[1]: Started session-25.scope - Session 25 of User core. Nov 4 23:23:29.867322 kubelet[3293]: E1104 23:23:29.866876 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-996fc7fbb-2jd5x" podUID="ab3399c0-cd7b-41d5-bf32-586b469457b8" Nov 4 23:23:29.904174 sshd[5920]: Connection closed by 139.178.89.65 port 43670 Nov 4 23:23:29.907272 sshd-session[5917]: pam_unix(sshd:session): session closed for user core Nov 4 23:23:29.925639 systemd[1]: sshd@24-172.31.21.124:22-139.178.89.65:43670.service: Deactivated successfully. Nov 4 23:23:29.934901 systemd[1]: session-25.scope: Deactivated successfully. Nov 4 23:23:29.944080 systemd-logind[1949]: Session 25 logged out. Waiting for processes to exit. Nov 4 23:23:29.949091 systemd-logind[1949]: Removed session 25. Nov 4 23:23:30.859827 containerd[1977]: time="2025-11-04T23:23:30.859727567Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/whisker:v3.30.4\"" Nov 4 23:23:31.123695 containerd[1977]: time="2025-11-04T23:23:31.123252009Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:23:31.125589 containerd[1977]: time="2025-11-04T23:23:31.125500857Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/whisker:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" Nov 4 23:23:31.126351 containerd[1977]: time="2025-11-04T23:23:31.125654973Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/whisker:v3.30.4: active requests=0, bytes read=73" Nov 4 23:23:31.126493 kubelet[3293]: E1104 23:23:31.125827 3293 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker:v3.30.4" Nov 4 23:23:31.126493 kubelet[3293]: E1104 23:23:31.125890 3293 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker:v3.30.4" Nov 4 23:23:31.126493 kubelet[3293]: E1104 23:23:31.126077 3293 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:whisker,Image:ghcr.io/flatcar/calico/whisker:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:INFO,ValueFrom:nil,},EnvVar{Name:CALICO_VERSION,Value:v3.30.4,ValueFrom:nil,},EnvVar{Name:CLUSTER_ID,Value:0ca3151f26aa44ec95a034255ce8af62,ValueFrom:nil,},EnvVar{Name:CLUSTER_TYPE,Value:typha,kdd,k8s,operator,bgp,kubeadm,ValueFrom:nil,},EnvVar{Name:NOTIFICATIONS,Value:Enabled,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-fjghm,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod whisker-778cbdb456-4xzz7_calico-system(404b99f5-b096-49e7-baa1-6b3afbc90705): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" logger="UnhandledError" Nov 4 23:23:31.130582 containerd[1977]: time="2025-11-04T23:23:31.130524717Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\"" Nov 4 23:23:31.411415 containerd[1977]: time="2025-11-04T23:23:31.410824294Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:23:31.413376 containerd[1977]: time="2025-11-04T23:23:31.413077678Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" Nov 4 23:23:31.413376 containerd[1977]: time="2025-11-04T23:23:31.413241466Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/whisker-backend:v3.30.4: active requests=0, bytes read=85" Nov 4 23:23:31.413984 kubelet[3293]: E1104 23:23:31.413807 3293 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker-backend:v3.30.4" Nov 4 23:23:31.413984 kubelet[3293]: E1104 23:23:31.413922 3293 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker-backend:v3.30.4" Nov 4 23:23:31.414542 kubelet[3293]: E1104 23:23:31.414412 3293 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:whisker-backend,Image:ghcr.io/flatcar/calico/whisker-backend:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:INFO,ValueFrom:nil,},EnvVar{Name:PORT,Value:3002,ValueFrom:nil,},EnvVar{Name:GOLDMANE_HOST,Value:goldmane.calico-system.svc.cluster.local:7443,ValueFrom:nil,},EnvVar{Name:TLS_CERT_PATH,Value:/whisker-backend-key-pair/tls.crt,ValueFrom:nil,},EnvVar{Name:TLS_KEY_PATH,Value:/whisker-backend-key-pair/tls.key,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:whisker-backend-key-pair,ReadOnly:true,MountPath:/whisker-backend-key-pair,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:whisker-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-fjghm,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod whisker-778cbdb456-4xzz7_calico-system(404b99f5-b096-49e7-baa1-6b3afbc90705): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" logger="UnhandledError" Nov 4 23:23:31.416078 kubelet[3293]: E1104 23:23:31.415993 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"whisker\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found\", failed to \"StartContainer\" for \"whisker-backend\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found\"]" pod="calico-system/whisker-778cbdb456-4xzz7" podUID="404b99f5-b096-49e7-baa1-6b3afbc90705" Nov 4 23:23:32.857519 kubelet[3293]: E1104 23:23:32.857431 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-fcc487596-jrhr4" podUID="068373b4-e189-432e-9f0e-0da4317cec26" Nov 4 23:23:34.860036 kubelet[3293]: E1104 23:23:34.859932 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"calico-csi\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ghcr.io/flatcar/calico/csi:v3.30.4: not found\", failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found\"]" pod="calico-system/csi-node-driver-5fvm8" podUID="0d16ca69-85e0-4dac-8492-1209e5dd061d" Nov 4 23:23:34.945410 systemd[1]: Started sshd@25-172.31.21.124:22-139.178.89.65:43684.service - OpenSSH per-connection server daemon (139.178.89.65:43684). Nov 4 23:23:35.177196 sshd[5933]: Accepted publickey for core from 139.178.89.65 port 43684 ssh2: RSA SHA256:hDiwkCWvCQBqijfvK1jv0H0YtRR2s7jf/pLBmZjqWNg Nov 4 23:23:35.180418 sshd-session[5933]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 4 23:23:35.196548 systemd-logind[1949]: New session 26 of user core. Nov 4 23:23:35.203519 systemd[1]: Started session-26.scope - Session 26 of User core. Nov 4 23:23:35.552101 sshd[5936]: Connection closed by 139.178.89.65 port 43684 Nov 4 23:23:35.553838 sshd-session[5933]: pam_unix(sshd:session): session closed for user core Nov 4 23:23:35.564886 systemd[1]: sshd@25-172.31.21.124:22-139.178.89.65:43684.service: Deactivated successfully. Nov 4 23:23:35.573973 systemd[1]: session-26.scope: Deactivated successfully. Nov 4 23:23:35.578738 systemd-logind[1949]: Session 26 logged out. Waiting for processes to exit. Nov 4 23:23:35.584760 systemd-logind[1949]: Removed session 26. Nov 4 23:23:39.858416 kubelet[3293]: E1104 23:23:39.858320 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-fcc487596-l2mz4" podUID="af7a1c92-78ca-4756-b8d2-4992b60e6f17" Nov 4 23:23:40.857052 containerd[1977]: time="2025-11-04T23:23:40.856918149Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\"" Nov 4 23:23:41.100556 containerd[1977]: time="2025-11-04T23:23:41.100485738Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:23:41.102881 containerd[1977]: time="2025-11-04T23:23:41.102786330Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" Nov 4 23:23:41.102881 containerd[1977]: time="2025-11-04T23:23:41.102845262Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/kube-controllers:v3.30.4: active requests=0, bytes read=85" Nov 4 23:23:41.103159 kubelet[3293]: E1104 23:23:41.103106 3293 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" image="ghcr.io/flatcar/calico/kube-controllers:v3.30.4" Nov 4 23:23:41.103905 kubelet[3293]: E1104 23:23:41.103169 3293 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" image="ghcr.io/flatcar/calico/kube-controllers:v3.30.4" Nov 4 23:23:41.103905 kubelet[3293]: E1104 23:23:41.103387 3293 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:calico-kube-controllers,Image:ghcr.io/flatcar/calico/kube-controllers:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:KUBE_CONTROLLERS_CONFIG_NAME,Value:default,ValueFrom:nil,},EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:ENABLED_CONTROLLERS,Value:node,loadbalancer,ValueFrom:nil,},EnvVar{Name:DISABLE_KUBE_CONTROLLERS_CONFIG_API,Value:false,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:CA_CRT_PATH,Value:/etc/pki/tls/certs/tigera-ca-bundle.crt,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:tigera-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:tigera-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/cert.pem,SubPath:ca-bundle.crt,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-lbpdt,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/usr/bin/check-status -l],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:10,TimeoutSeconds:10,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:6,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/usr/bin/check-status -r],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:10,PeriodSeconds:30,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*999,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-kube-controllers-5c9f7c8689-qhpsj_calico-system(89628730-c640-4e4b-9cec-2cca5b47d9fc): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" logger="UnhandledError" Nov 4 23:23:41.104746 kubelet[3293]: E1104 23:23:41.104676 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-kube-controllers\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found\"" pod="calico-system/calico-kube-controllers-5c9f7c8689-qhpsj" podUID="89628730-c640-4e4b-9cec-2cca5b47d9fc" Nov 4 23:23:41.857233 containerd[1977]: time="2025-11-04T23:23:41.857104102Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/goldmane:v3.30.4\"" Nov 4 23:23:42.164686 containerd[1977]: time="2025-11-04T23:23:42.164381744Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:23:42.166732 containerd[1977]: time="2025-11-04T23:23:42.166570820Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/goldmane:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" Nov 4 23:23:42.166732 containerd[1977]: time="2025-11-04T23:23:42.166651376Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/goldmane:v3.30.4: active requests=0, bytes read=77" Nov 4 23:23:42.167160 kubelet[3293]: E1104 23:23:42.166924 3293 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" image="ghcr.io/flatcar/calico/goldmane:v3.30.4" Nov 4 23:23:42.167160 kubelet[3293]: E1104 23:23:42.166984 3293 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" image="ghcr.io/flatcar/calico/goldmane:v3.30.4" Nov 4 23:23:42.167826 kubelet[3293]: E1104 23:23:42.167180 3293 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:goldmane,Image:ghcr.io/flatcar/calico/goldmane:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:INFO,ValueFrom:nil,},EnvVar{Name:PORT,Value:7443,ValueFrom:nil,},EnvVar{Name:SERVER_CERT_PATH,Value:/goldmane-key-pair/tls.crt,ValueFrom:nil,},EnvVar{Name:SERVER_KEY_PATH,Value:/goldmane-key-pair/tls.key,ValueFrom:nil,},EnvVar{Name:CA_CERT_PATH,Value:/etc/pki/tls/certs/tigera-ca-bundle.crt,ValueFrom:nil,},EnvVar{Name:PUSH_URL,Value:https://guardian.calico-system.svc.cluster.local:443/api/v1/flows/bulk,ValueFrom:nil,},EnvVar{Name:FILE_CONFIG_PATH,Value:/config/config.json,ValueFrom:nil,},EnvVar{Name:HEALTH_ENABLED,Value:true,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:config,ReadOnly:true,MountPath:/config,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:goldmane-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:goldmane-key-pair,ReadOnly:true,MountPath:/goldmane-key-pair,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-hkw2k,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/health -live],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/health -ready],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:30,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod goldmane-666569f655-lxlsr_calico-system(cdd3b3e0-4537-4eef-a9c5-bf20b3379786): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" logger="UnhandledError" Nov 4 23:23:42.168546 kubelet[3293]: E1104 23:23:42.168470 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"goldmane\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found\"" pod="calico-system/goldmane-666569f655-lxlsr" podUID="cdd3b3e0-4537-4eef-a9c5-bf20b3379786" Nov 4 23:23:42.445406 containerd[1977]: time="2025-11-04T23:23:42.445196409Z" level=info msg="TaskExit event in podsandbox handler container_id:\"6fbaacd9f420f26c2371bcff475a8067c2659e0a2c0d2d16b2a01703f87776c8\" id:\"d1660963c829ce5541cc456b21fcce24229605e569bb96d89bc6ec937ad97775\" pid:5972 exited_at:{seconds:1762298622 nanos:444546561}" Nov 4 23:23:43.859723 containerd[1977]: time="2025-11-04T23:23:43.859180164Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\"" Nov 4 23:23:44.139004 containerd[1977]: time="2025-11-04T23:23:44.138678885Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:23:44.141095 containerd[1977]: time="2025-11-04T23:23:44.140892105Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" Nov 4 23:23:44.141095 containerd[1977]: time="2025-11-04T23:23:44.141035253Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/apiserver:v3.30.4: active requests=0, bytes read=77" Nov 4 23:23:44.141940 kubelet[3293]: E1104 23:23:44.141374 3293 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 4 23:23:44.141940 kubelet[3293]: E1104 23:23:44.141435 3293 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 4 23:23:44.141940 kubelet[3293]: E1104 23:23:44.141628 3293 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:calico-apiserver,Image:ghcr.io/flatcar/calico/apiserver:v3.30.4,Command:[],Args:[--secure-port=5443 --tls-private-key-file=/calico-apiserver-certs/tls.key --tls-cert-file=/calico-apiserver-certs/tls.crt],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:LOG_LEVEL,Value:info,ValueFrom:nil,},EnvVar{Name:MULTI_INTERFACE_MODE,Value:none,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:calico-apiserver-certs,ReadOnly:true,MountPath:/calico-apiserver-certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-mpg72,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 5443 },Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-apiserver-996fc7fbb-2jd5x_calico-apiserver(ab3399c0-cd7b-41d5-bf32-586b469457b8): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" logger="UnhandledError" Nov 4 23:23:44.143135 kubelet[3293]: E1104 23:23:44.142920 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-996fc7fbb-2jd5x" podUID="ab3399c0-cd7b-41d5-bf32-586b469457b8" Nov 4 23:23:44.858826 kubelet[3293]: E1104 23:23:44.858749 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"whisker\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found\", failed to \"StartContainer\" for \"whisker-backend\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found\"]" pod="calico-system/whisker-778cbdb456-4xzz7" podUID="404b99f5-b096-49e7-baa1-6b3afbc90705" Nov 4 23:23:45.859243 containerd[1977]: time="2025-11-04T23:23:45.858375830Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\"" Nov 4 23:23:46.145942 containerd[1977]: time="2025-11-04T23:23:46.145806983Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:23:46.148400 containerd[1977]: time="2025-11-04T23:23:46.148232171Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" Nov 4 23:23:46.148400 containerd[1977]: time="2025-11-04T23:23:46.148360307Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/apiserver:v3.30.4: active requests=0, bytes read=77" Nov 4 23:23:46.148913 kubelet[3293]: E1104 23:23:46.148817 3293 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 4 23:23:46.148913 kubelet[3293]: E1104 23:23:46.148882 3293 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 4 23:23:46.149904 kubelet[3293]: E1104 23:23:46.149756 3293 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:calico-apiserver,Image:ghcr.io/flatcar/calico/apiserver:v3.30.4,Command:[],Args:[--secure-port=5443 --tls-private-key-file=/calico-apiserver-certs/tls.key --tls-cert-file=/calico-apiserver-certs/tls.crt],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:LOG_LEVEL,Value:info,ValueFrom:nil,},EnvVar{Name:MULTI_INTERFACE_MODE,Value:none,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:calico-apiserver-certs,ReadOnly:true,MountPath:/calico-apiserver-certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-z9769,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 5443 },Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-apiserver-fcc487596-jrhr4_calico-apiserver(068373b4-e189-432e-9f0e-0da4317cec26): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" logger="UnhandledError" Nov 4 23:23:46.151097 kubelet[3293]: E1104 23:23:46.151016 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-fcc487596-jrhr4" podUID="068373b4-e189-432e-9f0e-0da4317cec26" Nov 4 23:23:47.857254 containerd[1977]: time="2025-11-04T23:23:47.857159464Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/csi:v3.30.4\"" Nov 4 23:23:48.149505 containerd[1977]: time="2025-11-04T23:23:48.149314321Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:23:48.152224 containerd[1977]: time="2025-11-04T23:23:48.152123533Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/csi:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" Nov 4 23:23:48.152373 containerd[1977]: time="2025-11-04T23:23:48.152297581Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/csi:v3.30.4: active requests=0, bytes read=69" Nov 4 23:23:48.152614 kubelet[3293]: E1104 23:23:48.152498 3293 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" image="ghcr.io/flatcar/calico/csi:v3.30.4" Nov 4 23:23:48.152614 kubelet[3293]: E1104 23:23:48.152559 3293 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" image="ghcr.io/flatcar/calico/csi:v3.30.4" Nov 4 23:23:48.153240 kubelet[3293]: E1104 23:23:48.152980 3293 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:calico-csi,Image:ghcr.io/flatcar/calico/csi:v3.30.4,Command:[],Args:[--nodeid=$(KUBE_NODE_NAME) --loglevel=$(LOG_LEVEL)],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:warn,ValueFrom:nil,},EnvVar{Name:KUBE_NODE_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:spec.nodeName,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kubelet-dir,ReadOnly:false,MountPath:/var/lib/kubelet,SubPath:,MountPropagation:*Bidirectional,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:socket-dir,ReadOnly:false,MountPath:/csi,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:varrun,ReadOnly:false,MountPath:/var/run,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-hg84v,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*true,SELinuxOptions:nil,RunAsUser:*0,RunAsNonRoot:*false,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*true,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod csi-node-driver-5fvm8_calico-system(0d16ca69-85e0-4dac-8492-1209e5dd061d): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" logger="UnhandledError" Nov 4 23:23:48.155645 containerd[1977]: time="2025-11-04T23:23:48.155594569Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\"" Nov 4 23:23:48.425803 containerd[1977]: time="2025-11-04T23:23:48.425650743Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:23:48.428465 containerd[1977]: time="2025-11-04T23:23:48.428381223Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" Nov 4 23:23:48.428465 containerd[1977]: time="2025-11-04T23:23:48.428436003Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: active requests=0, bytes read=93" Nov 4 23:23:48.429069 kubelet[3293]: E1104 23:23:48.429009 3293 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" image="ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4" Nov 4 23:23:48.429179 kubelet[3293]: E1104 23:23:48.429080 3293 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" image="ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4" Nov 4 23:23:48.429550 kubelet[3293]: E1104 23:23:48.429431 3293 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:csi-node-driver-registrar,Image:ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4,Command:[],Args:[--v=5 --csi-address=$(ADDRESS) --kubelet-registration-path=$(DRIVER_REG_SOCK_PATH)],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:ADDRESS,Value:/csi/csi.sock,ValueFrom:nil,},EnvVar{Name:DRIVER_REG_SOCK_PATH,Value:/var/lib/kubelet/plugins/csi.tigera.io/csi.sock,ValueFrom:nil,},EnvVar{Name:KUBE_NODE_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:spec.nodeName,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:registration-dir,ReadOnly:false,MountPath:/registration,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:socket-dir,ReadOnly:false,MountPath:/csi,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-hg84v,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*true,SELinuxOptions:nil,RunAsUser:*0,RunAsNonRoot:*false,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*true,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod csi-node-driver-5fvm8_calico-system(0d16ca69-85e0-4dac-8492-1209e5dd061d): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" logger="UnhandledError" Nov 4 23:23:48.431039 kubelet[3293]: E1104 23:23:48.430954 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"calico-csi\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ghcr.io/flatcar/calico/csi:v3.30.4: not found\", failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found\"]" pod="calico-system/csi-node-driver-5fvm8" podUID="0d16ca69-85e0-4dac-8492-1209e5dd061d" Nov 4 23:23:49.306848 systemd[1]: cri-containerd-f9b85ea8664a1226d39751dd3c6f6ef1139e10c4371a11fdebf868b152c60017.scope: Deactivated successfully. Nov 4 23:23:49.307894 systemd[1]: cri-containerd-f9b85ea8664a1226d39751dd3c6f6ef1139e10c4371a11fdebf868b152c60017.scope: Consumed 32.454s CPU time, 108.1M memory peak. Nov 4 23:23:49.313236 containerd[1977]: time="2025-11-04T23:23:49.313139415Z" level=info msg="received exit event container_id:\"f9b85ea8664a1226d39751dd3c6f6ef1139e10c4371a11fdebf868b152c60017\" id:\"f9b85ea8664a1226d39751dd3c6f6ef1139e10c4371a11fdebf868b152c60017\" pid:3810 exit_status:1 exited_at:{seconds:1762298629 nanos:311717319}" Nov 4 23:23:49.314343 containerd[1977]: time="2025-11-04T23:23:49.314270199Z" level=info msg="TaskExit event in podsandbox handler container_id:\"f9b85ea8664a1226d39751dd3c6f6ef1139e10c4371a11fdebf868b152c60017\" id:\"f9b85ea8664a1226d39751dd3c6f6ef1139e10c4371a11fdebf868b152c60017\" pid:3810 exit_status:1 exited_at:{seconds:1762298629 nanos:311717319}" Nov 4 23:23:49.356918 systemd[1]: run-containerd-io.containerd.runtime.v2.task-k8s.io-f9b85ea8664a1226d39751dd3c6f6ef1139e10c4371a11fdebf868b152c60017-rootfs.mount: Deactivated successfully. Nov 4 23:23:49.633467 systemd[1]: cri-containerd-328512a3e6a4337d47c713a9195595fcc92f899633887fa9dd04c85086d30879.scope: Deactivated successfully. Nov 4 23:23:49.637618 systemd[1]: cri-containerd-328512a3e6a4337d47c713a9195595fcc92f899633887fa9dd04c85086d30879.scope: Consumed 7.135s CPU time, 61.7M memory peak. Nov 4 23:23:49.640907 containerd[1977]: time="2025-11-04T23:23:49.640848029Z" level=info msg="TaskExit event in podsandbox handler container_id:\"328512a3e6a4337d47c713a9195595fcc92f899633887fa9dd04c85086d30879\" id:\"328512a3e6a4337d47c713a9195595fcc92f899633887fa9dd04c85086d30879\" pid:3133 exit_status:1 exited_at:{seconds:1762298629 nanos:636029237}" Nov 4 23:23:49.642504 containerd[1977]: time="2025-11-04T23:23:49.642430013Z" level=info msg="received exit event container_id:\"328512a3e6a4337d47c713a9195595fcc92f899633887fa9dd04c85086d30879\" id:\"328512a3e6a4337d47c713a9195595fcc92f899633887fa9dd04c85086d30879\" pid:3133 exit_status:1 exited_at:{seconds:1762298629 nanos:636029237}" Nov 4 23:23:49.687620 systemd[1]: run-containerd-io.containerd.runtime.v2.task-k8s.io-328512a3e6a4337d47c713a9195595fcc92f899633887fa9dd04c85086d30879-rootfs.mount: Deactivated successfully. Nov 4 23:23:49.833547 kubelet[3293]: I1104 23:23:49.833502 3293 scope.go:117] "RemoveContainer" containerID="f9b85ea8664a1226d39751dd3c6f6ef1139e10c4371a11fdebf868b152c60017" Nov 4 23:23:49.840653 kubelet[3293]: I1104 23:23:49.840606 3293 scope.go:117] "RemoveContainer" containerID="328512a3e6a4337d47c713a9195595fcc92f899633887fa9dd04c85086d30879" Nov 4 23:23:49.844841 containerd[1977]: time="2025-11-04T23:23:49.844774290Z" level=info msg="CreateContainer within sandbox \"9dd3b9ffa344dde9217b73eddea275057baf50fd942d38de07afee1b98562183\" for container &ContainerMetadata{Name:tigera-operator,Attempt:1,}" Nov 4 23:23:49.845773 containerd[1977]: time="2025-11-04T23:23:49.845713938Z" level=info msg="CreateContainer within sandbox \"c6d92ae43385576b2f8fff81d176c22c8a2319d29208f2e653a313895e2ccc4d\" for container &ContainerMetadata{Name:kube-controller-manager,Attempt:1,}" Nov 4 23:23:49.867689 containerd[1977]: time="2025-11-04T23:23:49.867529314Z" level=info msg="Container f5d747a4cab10825e0cedd16a30af4f21dbdb46faae8c13189ecdd08d957c2db: CDI devices from CRI Config.CDIDevices: []" Nov 4 23:23:49.883230 containerd[1977]: time="2025-11-04T23:23:49.883133058Z" level=info msg="Container 04e4c073aab45cc0a3d503cace9bc3d3494b7e6599ddf6492abb7f17461edd36: CDI devices from CRI Config.CDIDevices: []" Nov 4 23:23:49.896015 containerd[1977]: time="2025-11-04T23:23:49.895789830Z" level=info msg="CreateContainer within sandbox \"c6d92ae43385576b2f8fff81d176c22c8a2319d29208f2e653a313895e2ccc4d\" for &ContainerMetadata{Name:kube-controller-manager,Attempt:1,} returns container id \"f5d747a4cab10825e0cedd16a30af4f21dbdb46faae8c13189ecdd08d957c2db\"" Nov 4 23:23:49.898142 containerd[1977]: time="2025-11-04T23:23:49.898068462Z" level=info msg="StartContainer for \"f5d747a4cab10825e0cedd16a30af4f21dbdb46faae8c13189ecdd08d957c2db\"" Nov 4 23:23:49.901934 containerd[1977]: time="2025-11-04T23:23:49.901864542Z" level=info msg="connecting to shim f5d747a4cab10825e0cedd16a30af4f21dbdb46faae8c13189ecdd08d957c2db" address="unix:///run/containerd/s/4257e4aae2283efd17f38139900d21bdf2565cb578da9f04dace91c5d34f0a04" protocol=ttrpc version=3 Nov 4 23:23:49.912193 containerd[1977]: time="2025-11-04T23:23:49.909939006Z" level=info msg="CreateContainer within sandbox \"9dd3b9ffa344dde9217b73eddea275057baf50fd942d38de07afee1b98562183\" for &ContainerMetadata{Name:tigera-operator,Attempt:1,} returns container id \"04e4c073aab45cc0a3d503cace9bc3d3494b7e6599ddf6492abb7f17461edd36\"" Nov 4 23:23:49.914113 containerd[1977]: time="2025-11-04T23:23:49.914069994Z" level=info msg="StartContainer for \"04e4c073aab45cc0a3d503cace9bc3d3494b7e6599ddf6492abb7f17461edd36\"" Nov 4 23:23:49.916681 containerd[1977]: time="2025-11-04T23:23:49.916566378Z" level=info msg="connecting to shim 04e4c073aab45cc0a3d503cace9bc3d3494b7e6599ddf6492abb7f17461edd36" address="unix:///run/containerd/s/712c59929a6897ce6dfc804c4c91d11b8a2fc6d898268137ff0d131dd7c9f578" protocol=ttrpc version=3 Nov 4 23:23:49.952578 systemd[1]: Started cri-containerd-f5d747a4cab10825e0cedd16a30af4f21dbdb46faae8c13189ecdd08d957c2db.scope - libcontainer container f5d747a4cab10825e0cedd16a30af4f21dbdb46faae8c13189ecdd08d957c2db. Nov 4 23:23:49.983620 systemd[1]: Started cri-containerd-04e4c073aab45cc0a3d503cace9bc3d3494b7e6599ddf6492abb7f17461edd36.scope - libcontainer container 04e4c073aab45cc0a3d503cace9bc3d3494b7e6599ddf6492abb7f17461edd36. Nov 4 23:23:50.088926 containerd[1977]: time="2025-11-04T23:23:50.088863135Z" level=info msg="StartContainer for \"04e4c073aab45cc0a3d503cace9bc3d3494b7e6599ddf6492abb7f17461edd36\" returns successfully" Nov 4 23:23:50.098459 containerd[1977]: time="2025-11-04T23:23:50.098368599Z" level=info msg="StartContainer for \"f5d747a4cab10825e0cedd16a30af4f21dbdb46faae8c13189ecdd08d957c2db\" returns successfully" Nov 4 23:23:50.361121 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount2210992387.mount: Deactivated successfully. Nov 4 23:23:53.862788 containerd[1977]: time="2025-11-04T23:23:53.862703530Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\"" Nov 4 23:23:54.148310 containerd[1977]: time="2025-11-04T23:23:54.147827431Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:23:54.150488 containerd[1977]: time="2025-11-04T23:23:54.150308719Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" Nov 4 23:23:54.150488 containerd[1977]: time="2025-11-04T23:23:54.150386875Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/apiserver:v3.30.4: active requests=0, bytes read=77" Nov 4 23:23:54.151007 kubelet[3293]: E1104 23:23:54.150917 3293 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 4 23:23:54.151916 kubelet[3293]: E1104 23:23:54.151016 3293 kuberuntime_image.go:55] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 4 23:23:54.151916 kubelet[3293]: E1104 23:23:54.151284 3293 kuberuntime_manager.go:1341] "Unhandled Error" err="container &Container{Name:calico-apiserver,Image:ghcr.io/flatcar/calico/apiserver:v3.30.4,Command:[],Args:[--secure-port=5443 --tls-private-key-file=/calico-apiserver-certs/tls.key --tls-cert-file=/calico-apiserver-certs/tls.crt],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:LOG_LEVEL,Value:info,ValueFrom:nil,},EnvVar{Name:MULTI_INTERFACE_MODE,Value:none,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:calico-apiserver-certs,ReadOnly:true,MountPath:/calico-apiserver-certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-jtkhl,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 5443 },Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-apiserver-fcc487596-l2mz4_calico-apiserver(af7a1c92-78ca-4756-b8d2-4992b60e6f17): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" logger="UnhandledError" Nov 4 23:23:54.152637 kubelet[3293]: E1104 23:23:54.152568 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-fcc487596-l2mz4" podUID="af7a1c92-78ca-4756-b8d2-4992b60e6f17" Nov 4 23:23:54.457768 systemd[1]: cri-containerd-74f0155bc25450258827d8b0395f9dca554cf24249db65354ab68b1cfdda0188.scope: Deactivated successfully. Nov 4 23:23:54.461368 systemd[1]: cri-containerd-74f0155bc25450258827d8b0395f9dca554cf24249db65354ab68b1cfdda0188.scope: Consumed 4.495s CPU time, 23M memory peak. Nov 4 23:23:54.464680 containerd[1977]: time="2025-11-04T23:23:54.464385465Z" level=info msg="received exit event container_id:\"74f0155bc25450258827d8b0395f9dca554cf24249db65354ab68b1cfdda0188\" id:\"74f0155bc25450258827d8b0395f9dca554cf24249db65354ab68b1cfdda0188\" pid:3141 exit_status:1 exited_at:{seconds:1762298634 nanos:463440453}" Nov 4 23:23:54.464996 containerd[1977]: time="2025-11-04T23:23:54.464507781Z" level=info msg="TaskExit event in podsandbox handler container_id:\"74f0155bc25450258827d8b0395f9dca554cf24249db65354ab68b1cfdda0188\" id:\"74f0155bc25450258827d8b0395f9dca554cf24249db65354ab68b1cfdda0188\" pid:3141 exit_status:1 exited_at:{seconds:1762298634 nanos:463440453}" Nov 4 23:23:54.509694 systemd[1]: run-containerd-io.containerd.runtime.v2.task-k8s.io-74f0155bc25450258827d8b0395f9dca554cf24249db65354ab68b1cfdda0188-rootfs.mount: Deactivated successfully. Nov 4 23:23:54.856762 kubelet[3293]: E1104 23:23:54.856666 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-kube-controllers\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found\"" pod="calico-system/calico-kube-controllers-5c9f7c8689-qhpsj" podUID="89628730-c640-4e4b-9cec-2cca5b47d9fc" Nov 4 23:23:54.874491 kubelet[3293]: I1104 23:23:54.874446 3293 scope.go:117] "RemoveContainer" containerID="74f0155bc25450258827d8b0395f9dca554cf24249db65354ab68b1cfdda0188" Nov 4 23:23:54.877904 containerd[1977]: time="2025-11-04T23:23:54.877805291Z" level=info msg="CreateContainer within sandbox \"c2e51d1b3969d495a3265f2b9af797a79e2177e475b4d0ab3e5e57039eae855b\" for container &ContainerMetadata{Name:kube-scheduler,Attempt:1,}" Nov 4 23:23:54.901807 containerd[1977]: time="2025-11-04T23:23:54.898530875Z" level=info msg="Container f44765086eab7ee6ccc43c686f266182ee40d2e83adc0c3da52bfa9f0ef0a579: CDI devices from CRI Config.CDIDevices: []" Nov 4 23:23:54.917708 containerd[1977]: time="2025-11-04T23:23:54.917653091Z" level=info msg="CreateContainer within sandbox \"c2e51d1b3969d495a3265f2b9af797a79e2177e475b4d0ab3e5e57039eae855b\" for &ContainerMetadata{Name:kube-scheduler,Attempt:1,} returns container id \"f44765086eab7ee6ccc43c686f266182ee40d2e83adc0c3da52bfa9f0ef0a579\"" Nov 4 23:23:54.918843 containerd[1977]: time="2025-11-04T23:23:54.918777515Z" level=info msg="StartContainer for \"f44765086eab7ee6ccc43c686f266182ee40d2e83adc0c3da52bfa9f0ef0a579\"" Nov 4 23:23:54.921007 containerd[1977]: time="2025-11-04T23:23:54.920945471Z" level=info msg="connecting to shim f44765086eab7ee6ccc43c686f266182ee40d2e83adc0c3da52bfa9f0ef0a579" address="unix:///run/containerd/s/75dd118befc80347d788ca5515d456d78f70be890b3becd777ee4b926b6c0687" protocol=ttrpc version=3 Nov 4 23:23:54.964526 systemd[1]: Started cri-containerd-f44765086eab7ee6ccc43c686f266182ee40d2e83adc0c3da52bfa9f0ef0a579.scope - libcontainer container f44765086eab7ee6ccc43c686f266182ee40d2e83adc0c3da52bfa9f0ef0a579. Nov 4 23:23:55.049000 containerd[1977]: time="2025-11-04T23:23:55.048953984Z" level=info msg="StartContainer for \"f44765086eab7ee6ccc43c686f266182ee40d2e83adc0c3da52bfa9f0ef0a579\" returns successfully" Nov 4 23:23:55.859584 kubelet[3293]: E1104 23:23:55.859184 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-996fc7fbb-2jd5x" podUID="ab3399c0-cd7b-41d5-bf32-586b469457b8" Nov 4 23:23:55.863002 kubelet[3293]: E1104 23:23:55.862945 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"whisker\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found\", failed to \"StartContainer\" for \"whisker-backend\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found\"]" pod="calico-system/whisker-778cbdb456-4xzz7" podUID="404b99f5-b096-49e7-baa1-6b3afbc90705" Nov 4 23:23:56.856476 kubelet[3293]: E1104 23:23:56.856339 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"goldmane\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found\"" pod="calico-system/goldmane-666569f655-lxlsr" podUID="cdd3b3e0-4537-4eef-a9c5-bf20b3379786" Nov 4 23:23:58.814698 kubelet[3293]: E1104 23:23:58.814333 3293 controller.go:195] "Failed to update lease" err="Put \"https://172.31.21.124:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-172-31-21-124?timeout=10s\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 4 23:23:58.856859 kubelet[3293]: E1104 23:23:58.856721 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-fcc487596-jrhr4" podUID="068373b4-e189-432e-9f0e-0da4317cec26" Nov 4 23:23:58.857749 kubelet[3293]: E1104 23:23:58.857597 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"calico-csi\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ghcr.io/flatcar/calico/csi:v3.30.4: not found\", failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found\"]" pod="calico-system/csi-node-driver-5fvm8" podUID="0d16ca69-85e0-4dac-8492-1209e5dd061d" Nov 4 23:24:01.608122 systemd[1]: cri-containerd-04e4c073aab45cc0a3d503cace9bc3d3494b7e6599ddf6492abb7f17461edd36.scope: Deactivated successfully. Nov 4 23:24:01.611161 containerd[1977]: time="2025-11-04T23:24:01.611098516Z" level=info msg="received exit event container_id:\"04e4c073aab45cc0a3d503cace9bc3d3494b7e6599ddf6492abb7f17461edd36\" id:\"04e4c073aab45cc0a3d503cace9bc3d3494b7e6599ddf6492abb7f17461edd36\" pid:6054 exit_status:1 exited_at:{seconds:1762298641 nanos:610709008}" Nov 4 23:24:01.612166 containerd[1977]: time="2025-11-04T23:24:01.612073564Z" level=info msg="TaskExit event in podsandbox handler container_id:\"04e4c073aab45cc0a3d503cace9bc3d3494b7e6599ddf6492abb7f17461edd36\" id:\"04e4c073aab45cc0a3d503cace9bc3d3494b7e6599ddf6492abb7f17461edd36\" pid:6054 exit_status:1 exited_at:{seconds:1762298641 nanos:610709008}" Nov 4 23:24:01.651121 systemd[1]: run-containerd-io.containerd.runtime.v2.task-k8s.io-04e4c073aab45cc0a3d503cace9bc3d3494b7e6599ddf6492abb7f17461edd36-rootfs.mount: Deactivated successfully. Nov 4 23:24:01.905006 kubelet[3293]: I1104 23:24:01.904873 3293 scope.go:117] "RemoveContainer" containerID="f9b85ea8664a1226d39751dd3c6f6ef1139e10c4371a11fdebf868b152c60017" Nov 4 23:24:01.906638 kubelet[3293]: I1104 23:24:01.906585 3293 scope.go:117] "RemoveContainer" containerID="04e4c073aab45cc0a3d503cace9bc3d3494b7e6599ddf6492abb7f17461edd36" Nov 4 23:24:01.907537 kubelet[3293]: E1104 23:24:01.906867 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"tigera-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=tigera-operator pod=tigera-operator-7dcd859c48-wj98f_tigera-operator(8d36240a-af1a-4cd5-9b52-fa94105e662f)\"" pod="tigera-operator/tigera-operator-7dcd859c48-wj98f" podUID="8d36240a-af1a-4cd5-9b52-fa94105e662f" Nov 4 23:24:01.911134 containerd[1977]: time="2025-11-04T23:24:01.910760466Z" level=info msg="RemoveContainer for \"f9b85ea8664a1226d39751dd3c6f6ef1139e10c4371a11fdebf868b152c60017\"" Nov 4 23:24:01.920409 containerd[1977]: time="2025-11-04T23:24:01.920332434Z" level=info msg="RemoveContainer for \"f9b85ea8664a1226d39751dd3c6f6ef1139e10c4371a11fdebf868b152c60017\" returns successfully" Nov 4 23:24:05.857630 kubelet[3293]: E1104 23:24:05.857306 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-kube-controllers\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found\"" pod="calico-system/calico-kube-controllers-5c9f7c8689-qhpsj" podUID="89628730-c640-4e4b-9cec-2cca5b47d9fc" Nov 4 23:24:05.857630 kubelet[3293]: E1104 23:24:05.857867 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-fcc487596-l2mz4" podUID="af7a1c92-78ca-4756-b8d2-4992b60e6f17" Nov 4 23:24:07.858759 kubelet[3293]: E1104 23:24:07.858655 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"whisker\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found\", failed to \"StartContainer\" for \"whisker-backend\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found\"]" pod="calico-system/whisker-778cbdb456-4xzz7" podUID="404b99f5-b096-49e7-baa1-6b3afbc90705" Nov 4 23:24:08.814891 kubelet[3293]: E1104 23:24:08.814811 3293 controller.go:195] "Failed to update lease" err="Put \"https://172.31.21.124:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-172-31-21-124?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 4 23:24:09.856847 kubelet[3293]: E1104 23:24:09.856618 3293 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-996fc7fbb-2jd5x" podUID="ab3399c0-cd7b-41d5-bf32-586b469457b8"