Nov 4 23:19:55.080123 kernel: Booting Linux on physical CPU 0x0000000000 [0x410fd083] Nov 4 23:19:55.080170 kernel: Linux version 6.12.54-flatcar (build@pony-truck.infra.kinvolk.io) (aarch64-cros-linux-gnu-gcc (Gentoo Hardened 14.3.1_p20250801 p4) 14.3.1 20250801, GNU ld (Gentoo 2.45 p3) 2.45.0) #1 SMP PREEMPT Tue Nov 4 22:00:29 -00 2025 Nov 4 23:19:55.080195 kernel: KASLR disabled due to lack of seed Nov 4 23:19:55.080212 kernel: efi: EFI v2.7 by EDK II Nov 4 23:19:55.080228 kernel: efi: SMBIOS=0x7bed0000 SMBIOS 3.0=0x7beb0000 ACPI=0x786e0000 ACPI 2.0=0x786e0014 MEMATTR=0x7a731a98 MEMRESERVE=0x78557598 Nov 4 23:19:55.080243 kernel: secureboot: Secure boot disabled Nov 4 23:19:55.080261 kernel: ACPI: Early table checksum verification disabled Nov 4 23:19:55.080276 kernel: ACPI: RSDP 0x00000000786E0014 000024 (v02 AMAZON) Nov 4 23:19:55.080292 kernel: ACPI: XSDT 0x00000000786D00E8 000064 (v01 AMAZON AMZNFACP 00000001 01000013) Nov 4 23:19:55.080311 kernel: ACPI: FACP 0x00000000786B0000 000114 (v06 AMAZON AMZNFACP 00000001 AMZN 00000001) Nov 4 23:19:55.080328 kernel: ACPI: DSDT 0x0000000078640000 00159D (v02 AMAZON AMZNDSDT 00000001 INTL 20160527) Nov 4 23:19:55.080343 kernel: ACPI: FACS 0x0000000078630000 000040 Nov 4 23:19:55.080358 kernel: ACPI: APIC 0x00000000786C0000 000108 (v04 AMAZON AMZNAPIC 00000001 AMZN 00000001) Nov 4 23:19:55.080374 kernel: ACPI: SPCR 0x00000000786A0000 000050 (v02 AMAZON AMZNSPCR 00000001 AMZN 00000001) Nov 4 23:19:55.080397 kernel: ACPI: GTDT 0x0000000078690000 000060 (v02 AMAZON AMZNGTDT 00000001 AMZN 00000001) Nov 4 23:19:55.080413 kernel: ACPI: MCFG 0x0000000078680000 00003C (v02 AMAZON AMZNMCFG 00000001 AMZN 00000001) Nov 4 23:19:55.080430 kernel: ACPI: SLIT 0x0000000078670000 00002D (v01 AMAZON AMZNSLIT 00000001 AMZN 00000001) Nov 4 23:19:55.080447 kernel: ACPI: IORT 0x0000000078660000 000078 (v01 AMAZON AMZNIORT 00000001 AMZN 00000001) Nov 4 23:19:55.080463 kernel: ACPI: PPTT 0x0000000078650000 0000EC (v01 AMAZON AMZNPPTT 00000001 AMZN 00000001) Nov 4 23:19:55.080479 kernel: ACPI: SPCR: console: uart,mmio,0x90a0000,115200 Nov 4 23:19:55.080495 kernel: earlycon: uart0 at MMIO 0x00000000090a0000 (options '115200') Nov 4 23:19:55.080511 kernel: printk: legacy bootconsole [uart0] enabled Nov 4 23:19:55.080527 kernel: ACPI: Use ACPI SPCR as default console: No Nov 4 23:19:55.080544 kernel: NUMA: Faking a node at [mem 0x0000000040000000-0x00000004b5ffffff] Nov 4 23:19:55.080564 kernel: NODE_DATA(0) allocated [mem 0x4b584da00-0x4b5854fff] Nov 4 23:19:55.080580 kernel: Zone ranges: Nov 4 23:19:55.080596 kernel: DMA [mem 0x0000000040000000-0x00000000ffffffff] Nov 4 23:19:55.080638 kernel: DMA32 empty Nov 4 23:19:55.080657 kernel: Normal [mem 0x0000000100000000-0x00000004b5ffffff] Nov 4 23:19:55.080674 kernel: Device empty Nov 4 23:19:55.080691 kernel: Movable zone start for each node Nov 4 23:19:55.080708 kernel: Early memory node ranges Nov 4 23:19:55.080724 kernel: node 0: [mem 0x0000000040000000-0x000000007862ffff] Nov 4 23:19:55.080741 kernel: node 0: [mem 0x0000000078630000-0x000000007863ffff] Nov 4 23:19:55.080757 kernel: node 0: [mem 0x0000000078640000-0x00000000786effff] Nov 4 23:19:55.080773 kernel: node 0: [mem 0x00000000786f0000-0x000000007872ffff] Nov 4 23:19:55.080795 kernel: node 0: [mem 0x0000000078730000-0x000000007bbfffff] Nov 4 23:19:55.080811 kernel: node 0: [mem 0x000000007bc00000-0x000000007bfdffff] Nov 4 23:19:55.080828 kernel: node 0: [mem 0x000000007bfe0000-0x000000007fffffff] Nov 4 23:19:55.080844 kernel: node 0: [mem 0x0000000400000000-0x00000004b5ffffff] Nov 4 23:19:55.080867 kernel: Initmem setup node 0 [mem 0x0000000040000000-0x00000004b5ffffff] Nov 4 23:19:55.080888 kernel: On node 0, zone Normal: 8192 pages in unavailable ranges Nov 4 23:19:55.080906 kernel: cma: Reserved 16 MiB at 0x000000007f000000 on node -1 Nov 4 23:19:55.080923 kernel: psci: probing for conduit method from ACPI. Nov 4 23:19:55.080940 kernel: psci: PSCIv1.0 detected in firmware. Nov 4 23:19:55.080957 kernel: psci: Using standard PSCI v0.2 function IDs Nov 4 23:19:55.080974 kernel: psci: Trusted OS migration not required Nov 4 23:19:55.080991 kernel: psci: SMC Calling Convention v1.1 Nov 4 23:19:55.081008 kernel: smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000001) Nov 4 23:19:55.081026 kernel: percpu: Embedded 33 pages/cpu s98200 r8192 d28776 u135168 Nov 4 23:19:55.081047 kernel: pcpu-alloc: s98200 r8192 d28776 u135168 alloc=33*4096 Nov 4 23:19:55.081065 kernel: pcpu-alloc: [0] 0 [0] 1 Nov 4 23:19:55.081082 kernel: Detected PIPT I-cache on CPU0 Nov 4 23:19:55.081099 kernel: CPU features: detected: GIC system register CPU interface Nov 4 23:19:55.081116 kernel: CPU features: detected: Spectre-v2 Nov 4 23:19:55.081133 kernel: CPU features: detected: Spectre-v3a Nov 4 23:19:55.081150 kernel: CPU features: detected: Spectre-BHB Nov 4 23:19:55.081167 kernel: CPU features: detected: ARM erratum 1742098 Nov 4 23:19:55.081185 kernel: CPU features: detected: ARM errata 1165522, 1319367, or 1530923 Nov 4 23:19:55.081202 kernel: alternatives: applying boot alternatives Nov 4 23:19:55.081221 kernel: Kernel command line: BOOT_IMAGE=/flatcar/vmlinuz-a mount.usr=/dev/mapper/usr verity.usr=PARTUUID=7130c94a-213a-4e5a-8e26-6cce9662f132 rootflags=rw mount.usrflags=ro consoleblank=0 root=LABEL=ROOT console=tty1 console=ttyS0,115200n8 earlycon flatcar.first_boot=detected acpi=force flatcar.oem.id=ec2 modprobe.blacklist=xen_fbfront net.ifnames=0 nvme_core.io_timeout=4294967295 verity.usrhash=f5fad2f14ba33eafa636a02c130b28d1e2865e3fd8b50e1d7ad0f6eb8ba09fec Nov 4 23:19:55.081243 kernel: Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) Nov 4 23:19:55.081260 kernel: Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) Nov 4 23:19:55.081277 kernel: Fallback order for Node 0: 0 Nov 4 23:19:55.081294 kernel: Built 1 zonelists, mobility grouping on. Total pages: 1007616 Nov 4 23:19:55.081311 kernel: Policy zone: Normal Nov 4 23:19:55.081328 kernel: mem auto-init: stack:off, heap alloc:off, heap free:off Nov 4 23:19:55.081345 kernel: software IO TLB: area num 2. Nov 4 23:19:55.081362 kernel: software IO TLB: mapped [mem 0x000000006f800000-0x0000000073800000] (64MB) Nov 4 23:19:55.081380 kernel: SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=2, Nodes=1 Nov 4 23:19:55.081397 kernel: rcu: Preemptible hierarchical RCU implementation. Nov 4 23:19:55.081419 kernel: rcu: RCU event tracing is enabled. Nov 4 23:19:55.081437 kernel: rcu: RCU restricting CPUs from NR_CPUS=512 to nr_cpu_ids=2. Nov 4 23:19:55.081454 kernel: Trampoline variant of Tasks RCU enabled. Nov 4 23:19:55.081472 kernel: Tracing variant of Tasks RCU enabled. Nov 4 23:19:55.081489 kernel: rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. Nov 4 23:19:55.081507 kernel: rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=2 Nov 4 23:19:55.081524 kernel: RCU Tasks: Setting shift to 1 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=2. Nov 4 23:19:55.081541 kernel: RCU Tasks Trace: Setting shift to 1 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=2. Nov 4 23:19:55.081558 kernel: NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 Nov 4 23:19:55.081575 kernel: GICv3: 96 SPIs implemented Nov 4 23:19:55.081592 kernel: GICv3: 0 Extended SPIs implemented Nov 4 23:19:55.083641 kernel: Root IRQ handler: gic_handle_irq Nov 4 23:19:55.083663 kernel: GICv3: GICv3 features: 16 PPIs Nov 4 23:19:55.083681 kernel: GICv3: GICD_CTRL.DS=1, SCR_EL3.FIQ=0 Nov 4 23:19:55.083699 kernel: GICv3: CPU0: found redistributor 0 region 0:0x0000000010200000 Nov 4 23:19:55.083716 kernel: ITS [mem 0x10080000-0x1009ffff] Nov 4 23:19:55.083733 kernel: ITS@0x0000000010080000: allocated 8192 Devices @4000f0000 (indirect, esz 8, psz 64K, shr 1) Nov 4 23:19:55.083752 kernel: ITS@0x0000000010080000: allocated 8192 Interrupt Collections @400100000 (flat, esz 8, psz 64K, shr 1) Nov 4 23:19:55.083770 kernel: GICv3: using LPI property table @0x0000000400110000 Nov 4 23:19:55.083787 kernel: ITS: Using hypervisor restricted LPI range [128] Nov 4 23:19:55.083804 kernel: GICv3: CPU0: using allocated LPI pending table @0x0000000400120000 Nov 4 23:19:55.083821 kernel: rcu: srcu_init: Setting srcu_struct sizes based on contention. Nov 4 23:19:55.083845 kernel: arch_timer: cp15 timer(s) running at 83.33MHz (virt). Nov 4 23:19:55.083863 kernel: clocksource: arch_sys_counter: mask: 0x1ffffffffffffff max_cycles: 0x13381ebeec, max_idle_ns: 440795203145 ns Nov 4 23:19:55.083881 kernel: sched_clock: 57 bits at 83MHz, resolution 12ns, wraps every 4398046511100ns Nov 4 23:19:55.083898 kernel: Console: colour dummy device 80x25 Nov 4 23:19:55.083917 kernel: printk: legacy console [tty1] enabled Nov 4 23:19:55.083935 kernel: ACPI: Core revision 20240827 Nov 4 23:19:55.083954 kernel: Calibrating delay loop (skipped), value calculated using timer frequency.. 166.66 BogoMIPS (lpj=83333) Nov 4 23:19:55.083972 kernel: pid_max: default: 32768 minimum: 301 Nov 4 23:19:55.084012 kernel: LSM: initializing lsm=lockdown,capability,landlock,selinux,ima Nov 4 23:19:55.084033 kernel: landlock: Up and running. Nov 4 23:19:55.084051 kernel: SELinux: Initializing. Nov 4 23:19:55.084069 kernel: Mount-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) Nov 4 23:19:55.084087 kernel: Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) Nov 4 23:19:55.084105 kernel: rcu: Hierarchical SRCU implementation. Nov 4 23:19:55.084123 kernel: rcu: Max phase no-delay instances is 400. Nov 4 23:19:55.084141 kernel: Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level Nov 4 23:19:55.084164 kernel: Remapping and enabling EFI services. Nov 4 23:19:55.084181 kernel: smp: Bringing up secondary CPUs ... Nov 4 23:19:55.084199 kernel: Detected PIPT I-cache on CPU1 Nov 4 23:19:55.084217 kernel: GICv3: CPU1: found redistributor 1 region 0:0x0000000010220000 Nov 4 23:19:55.084235 kernel: GICv3: CPU1: using allocated LPI pending table @0x0000000400130000 Nov 4 23:19:55.084253 kernel: CPU1: Booted secondary processor 0x0000000001 [0x410fd083] Nov 4 23:19:55.084270 kernel: smp: Brought up 1 node, 2 CPUs Nov 4 23:19:55.084291 kernel: SMP: Total of 2 processors activated. Nov 4 23:19:55.084309 kernel: CPU: All CPU(s) started at EL1 Nov 4 23:19:55.084337 kernel: CPU features: detected: 32-bit EL0 Support Nov 4 23:19:55.084359 kernel: CPU features: detected: 32-bit EL1 Support Nov 4 23:19:55.084378 kernel: CPU features: detected: CRC32 instructions Nov 4 23:19:55.084396 kernel: alternatives: applying system-wide alternatives Nov 4 23:19:55.084416 kernel: Memory: 3822892K/4030464K available (11136K kernel code, 2456K rwdata, 9084K rodata, 13056K init, 1038K bss, 186228K reserved, 16384K cma-reserved) Nov 4 23:19:55.084435 kernel: devtmpfs: initialized Nov 4 23:19:55.084457 kernel: clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns Nov 4 23:19:55.084477 kernel: futex hash table entries: 512 (order: 3, 32768 bytes, linear) Nov 4 23:19:55.084495 kernel: 23520 pages in range for non-PLT usage Nov 4 23:19:55.084513 kernel: 515040 pages in range for PLT usage Nov 4 23:19:55.084532 kernel: pinctrl core: initialized pinctrl subsystem Nov 4 23:19:55.084554 kernel: SMBIOS 3.0.0 present. Nov 4 23:19:55.084573 kernel: DMI: Amazon EC2 a1.large/, BIOS 1.0 11/1/2018 Nov 4 23:19:55.084591 kernel: DMI: Memory slots populated: 0/0 Nov 4 23:19:55.084632 kernel: NET: Registered PF_NETLINK/PF_ROUTE protocol family Nov 4 23:19:55.084654 kernel: DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations Nov 4 23:19:55.084673 kernel: DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations Nov 4 23:19:55.084692 kernel: DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations Nov 4 23:19:55.084717 kernel: audit: initializing netlink subsys (disabled) Nov 4 23:19:55.084736 kernel: audit: type=2000 audit(0.224:1): state=initialized audit_enabled=0 res=1 Nov 4 23:19:55.084754 kernel: thermal_sys: Registered thermal governor 'step_wise' Nov 4 23:19:55.084773 kernel: cpuidle: using governor menu Nov 4 23:19:55.084791 kernel: hw-breakpoint: found 6 breakpoint and 4 watchpoint registers. Nov 4 23:19:55.084810 kernel: ASID allocator initialised with 65536 entries Nov 4 23:19:55.084828 kernel: acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 Nov 4 23:19:55.084851 kernel: Serial: AMBA PL011 UART driver Nov 4 23:19:55.084869 kernel: HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages Nov 4 23:19:55.084888 kernel: HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page Nov 4 23:19:55.084907 kernel: HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages Nov 4 23:19:55.084925 kernel: HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page Nov 4 23:19:55.084944 kernel: HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages Nov 4 23:19:55.084963 kernel: HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page Nov 4 23:19:55.084985 kernel: HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages Nov 4 23:19:55.085004 kernel: HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page Nov 4 23:19:55.085022 kernel: ACPI: Added _OSI(Module Device) Nov 4 23:19:55.085040 kernel: ACPI: Added _OSI(Processor Device) Nov 4 23:19:55.085058 kernel: ACPI: Added _OSI(Processor Aggregator Device) Nov 4 23:19:55.085077 kernel: ACPI: 1 ACPI AML tables successfully acquired and loaded Nov 4 23:19:55.085095 kernel: ACPI: Interpreter enabled Nov 4 23:19:55.085117 kernel: ACPI: Using GIC for interrupt routing Nov 4 23:19:55.085136 kernel: ACPI: MCFG table detected, 1 entries Nov 4 23:19:55.085154 kernel: ACPI: CPU0 has been hot-added Nov 4 23:19:55.085173 kernel: ACPI: CPU1 has been hot-added Nov 4 23:19:55.085191 kernel: ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-0f]) Nov 4 23:19:55.085567 kernel: acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] Nov 4 23:19:55.086890 kernel: acpi PNP0A08:00: _OSC: platform does not support [LTR] Nov 4 23:19:55.087151 kernel: acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME AER PCIeCapability] Nov 4 23:19:55.087399 kernel: acpi PNP0A08:00: ECAM area [mem 0x20000000-0x20ffffff] reserved by PNP0C02:00 Nov 4 23:19:55.087687 kernel: acpi PNP0A08:00: ECAM at [mem 0x20000000-0x20ffffff] for [bus 00-0f] Nov 4 23:19:55.087716 kernel: ACPI: Remapped I/O 0x000000001fff0000 to [io 0x0000-0xffff window] Nov 4 23:19:55.087737 kernel: acpiphp: Slot [1] registered Nov 4 23:19:55.087756 kernel: acpiphp: Slot [2] registered Nov 4 23:19:55.087782 kernel: acpiphp: Slot [3] registered Nov 4 23:19:55.087801 kernel: acpiphp: Slot [4] registered Nov 4 23:19:55.087821 kernel: acpiphp: Slot [5] registered Nov 4 23:19:55.087841 kernel: acpiphp: Slot [6] registered Nov 4 23:19:55.087861 kernel: acpiphp: Slot [7] registered Nov 4 23:19:55.087881 kernel: acpiphp: Slot [8] registered Nov 4 23:19:55.087900 kernel: acpiphp: Slot [9] registered Nov 4 23:19:55.087919 kernel: acpiphp: Slot [10] registered Nov 4 23:19:55.087943 kernel: acpiphp: Slot [11] registered Nov 4 23:19:55.087962 kernel: acpiphp: Slot [12] registered Nov 4 23:19:55.087981 kernel: acpiphp: Slot [13] registered Nov 4 23:19:55.088023 kernel: acpiphp: Slot [14] registered Nov 4 23:19:55.088043 kernel: acpiphp: Slot [15] registered Nov 4 23:19:55.088062 kernel: acpiphp: Slot [16] registered Nov 4 23:19:55.088081 kernel: acpiphp: Slot [17] registered Nov 4 23:19:55.088105 kernel: acpiphp: Slot [18] registered Nov 4 23:19:55.088124 kernel: acpiphp: Slot [19] registered Nov 4 23:19:55.088143 kernel: acpiphp: Slot [20] registered Nov 4 23:19:55.088162 kernel: acpiphp: Slot [21] registered Nov 4 23:19:55.088180 kernel: acpiphp: Slot [22] registered Nov 4 23:19:55.088199 kernel: acpiphp: Slot [23] registered Nov 4 23:19:55.088218 kernel: acpiphp: Slot [24] registered Nov 4 23:19:55.088240 kernel: acpiphp: Slot [25] registered Nov 4 23:19:55.088259 kernel: acpiphp: Slot [26] registered Nov 4 23:19:55.088278 kernel: acpiphp: Slot [27] registered Nov 4 23:19:55.088296 kernel: acpiphp: Slot [28] registered Nov 4 23:19:55.088315 kernel: acpiphp: Slot [29] registered Nov 4 23:19:55.088334 kernel: acpiphp: Slot [30] registered Nov 4 23:19:55.088352 kernel: acpiphp: Slot [31] registered Nov 4 23:19:55.088371 kernel: PCI host bridge to bus 0000:00 Nov 4 23:19:55.088701 kernel: pci_bus 0000:00: root bus resource [mem 0x80000000-0xffffffff window] Nov 4 23:19:55.088934 kernel: pci_bus 0000:00: root bus resource [io 0x0000-0xffff window] Nov 4 23:19:55.089160 kernel: pci_bus 0000:00: root bus resource [mem 0x400000000000-0x407fffffffff window] Nov 4 23:19:55.089383 kernel: pci_bus 0000:00: root bus resource [bus 00-0f] Nov 4 23:19:55.089715 kernel: pci 0000:00:00.0: [1d0f:0200] type 00 class 0x060000 conventional PCI endpoint Nov 4 23:19:55.090010 kernel: pci 0000:00:01.0: [1d0f:8250] type 00 class 0x070003 conventional PCI endpoint Nov 4 23:19:55.090279 kernel: pci 0000:00:01.0: BAR 0 [mem 0x80118000-0x80118fff] Nov 4 23:19:55.090719 kernel: pci 0000:00:04.0: [1d0f:8061] type 00 class 0x010802 PCIe Root Complex Integrated Endpoint Nov 4 23:19:55.090996 kernel: pci 0000:00:04.0: BAR 0 [mem 0x80114000-0x80117fff] Nov 4 23:19:55.091250 kernel: pci 0000:00:04.0: PME# supported from D0 D1 D2 D3hot D3cold Nov 4 23:19:55.091521 kernel: pci 0000:00:05.0: [1d0f:ec20] type 00 class 0x020000 PCIe Root Complex Integrated Endpoint Nov 4 23:19:55.091812 kernel: pci 0000:00:05.0: BAR 0 [mem 0x80110000-0x80113fff] Nov 4 23:19:55.092086 kernel: pci 0000:00:05.0: BAR 2 [mem 0x80000000-0x800fffff pref] Nov 4 23:19:55.092336 kernel: pci 0000:00:05.0: BAR 4 [mem 0x80100000-0x8010ffff] Nov 4 23:19:55.092583 kernel: pci 0000:00:05.0: PME# supported from D0 D1 D2 D3hot D3cold Nov 4 23:19:55.092874 kernel: pci 0000:00:05.0: BAR 2 [mem 0x80000000-0x800fffff pref]: assigned Nov 4 23:19:55.093129 kernel: pci 0000:00:05.0: BAR 4 [mem 0x80100000-0x8010ffff]: assigned Nov 4 23:19:55.093376 kernel: pci 0000:00:04.0: BAR 0 [mem 0x80110000-0x80113fff]: assigned Nov 4 23:19:55.093641 kernel: pci 0000:00:05.0: BAR 0 [mem 0x80114000-0x80117fff]: assigned Nov 4 23:19:55.093939 kernel: pci 0000:00:01.0: BAR 0 [mem 0x80118000-0x80118fff]: assigned Nov 4 23:19:55.094174 kernel: pci_bus 0000:00: resource 4 [mem 0x80000000-0xffffffff window] Nov 4 23:19:55.094397 kernel: pci_bus 0000:00: resource 5 [io 0x0000-0xffff window] Nov 4 23:19:55.094653 kernel: pci_bus 0000:00: resource 6 [mem 0x400000000000-0x407fffffffff window] Nov 4 23:19:55.094680 kernel: ACPI: PCI: Interrupt link GSI0 configured for IRQ 35 Nov 4 23:19:55.094700 kernel: ACPI: PCI: Interrupt link GSI1 configured for IRQ 36 Nov 4 23:19:55.094720 kernel: ACPI: PCI: Interrupt link GSI2 configured for IRQ 37 Nov 4 23:19:55.094739 kernel: ACPI: PCI: Interrupt link GSI3 configured for IRQ 38 Nov 4 23:19:55.094757 kernel: iommu: Default domain type: Translated Nov 4 23:19:55.094776 kernel: iommu: DMA domain TLB invalidation policy: strict mode Nov 4 23:19:55.094800 kernel: efivars: Registered efivars operations Nov 4 23:19:55.094819 kernel: vgaarb: loaded Nov 4 23:19:55.094837 kernel: clocksource: Switched to clocksource arch_sys_counter Nov 4 23:19:55.094856 kernel: VFS: Disk quotas dquot_6.6.0 Nov 4 23:19:55.094874 kernel: VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) Nov 4 23:19:55.094893 kernel: pnp: PnP ACPI init Nov 4 23:19:55.095156 kernel: system 00:00: [mem 0x20000000-0x2fffffff] could not be reserved Nov 4 23:19:55.095188 kernel: pnp: PnP ACPI: found 1 devices Nov 4 23:19:55.095207 kernel: NET: Registered PF_INET protocol family Nov 4 23:19:55.095226 kernel: IP idents hash table entries: 65536 (order: 7, 524288 bytes, linear) Nov 4 23:19:55.095245 kernel: tcp_listen_portaddr_hash hash table entries: 2048 (order: 3, 32768 bytes, linear) Nov 4 23:19:55.095263 kernel: Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) Nov 4 23:19:55.095283 kernel: TCP established hash table entries: 32768 (order: 6, 262144 bytes, linear) Nov 4 23:19:55.095302 kernel: TCP bind hash table entries: 32768 (order: 8, 1048576 bytes, linear) Nov 4 23:19:55.095324 kernel: TCP: Hash tables configured (established 32768 bind 32768) Nov 4 23:19:55.095344 kernel: UDP hash table entries: 2048 (order: 4, 65536 bytes, linear) Nov 4 23:19:55.095362 kernel: UDP-Lite hash table entries: 2048 (order: 4, 65536 bytes, linear) Nov 4 23:19:55.095381 kernel: NET: Registered PF_UNIX/PF_LOCAL protocol family Nov 4 23:19:55.095400 kernel: PCI: CLS 0 bytes, default 64 Nov 4 23:19:55.095418 kernel: kvm [1]: HYP mode not available Nov 4 23:19:55.095437 kernel: Initialise system trusted keyrings Nov 4 23:19:55.095459 kernel: workingset: timestamp_bits=39 max_order=20 bucket_order=0 Nov 4 23:19:55.095478 kernel: Key type asymmetric registered Nov 4 23:19:55.095496 kernel: Asymmetric key parser 'x509' registered Nov 4 23:19:55.095515 kernel: Block layer SCSI generic (bsg) driver version 0.4 loaded (major 249) Nov 4 23:19:55.095534 kernel: io scheduler mq-deadline registered Nov 4 23:19:55.095553 kernel: io scheduler kyber registered Nov 4 23:19:55.095572 kernel: io scheduler bfq registered Nov 4 23:19:55.095857 kernel: pl061_gpio ARMH0061:00: PL061 GPIO chip registered Nov 4 23:19:55.095887 kernel: input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 Nov 4 23:19:55.095906 kernel: ACPI: button: Power Button [PWRB] Nov 4 23:19:55.095925 kernel: input: Sleep Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0E:00/input/input1 Nov 4 23:19:55.095944 kernel: ACPI: button: Sleep Button [SLPB] Nov 4 23:19:55.095962 kernel: Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled Nov 4 23:19:55.096004 kernel: ACPI: \_SB_.PCI0.GSI2: Enabled at IRQ 37 Nov 4 23:19:55.096259 kernel: serial 0000:00:01.0: enabling device (0010 -> 0012) Nov 4 23:19:55.096285 kernel: printk: legacy console [ttyS0] disabled Nov 4 23:19:55.096305 kernel: 0000:00:01.0: ttyS0 at MMIO 0x80118000 (irq = 14, base_baud = 115200) is a 16550A Nov 4 23:19:55.096323 kernel: printk: legacy console [ttyS0] enabled Nov 4 23:19:55.096342 kernel: printk: legacy bootconsole [uart0] disabled Nov 4 23:19:55.096360 kernel: thunder_xcv, ver 1.0 Nov 4 23:19:55.096384 kernel: thunder_bgx, ver 1.0 Nov 4 23:19:55.096403 kernel: nicpf, ver 1.0 Nov 4 23:19:55.096421 kernel: nicvf, ver 1.0 Nov 4 23:19:55.096735 kernel: rtc-efi rtc-efi.0: registered as rtc0 Nov 4 23:19:55.096976 kernel: rtc-efi rtc-efi.0: setting system clock to 2025-11-04T23:19:51 UTC (1762298391) Nov 4 23:19:55.097003 kernel: hid: raw HID events driver (C) Jiri Kosina Nov 4 23:19:55.097022 kernel: hw perfevents: enabled with armv8_pmuv3_0 PMU driver, 3 (0,80000003) counters available Nov 4 23:19:55.097047 kernel: watchdog: NMI not fully supported Nov 4 23:19:55.097065 kernel: NET: Registered PF_INET6 protocol family Nov 4 23:19:55.097084 kernel: watchdog: Hard watchdog permanently disabled Nov 4 23:19:55.097103 kernel: Segment Routing with IPv6 Nov 4 23:19:55.097121 kernel: In-situ OAM (IOAM) with IPv6 Nov 4 23:19:55.097139 kernel: NET: Registered PF_PACKET protocol family Nov 4 23:19:55.097158 kernel: Key type dns_resolver registered Nov 4 23:19:55.097192 kernel: registered taskstats version 1 Nov 4 23:19:55.097214 kernel: Loading compiled-in X.509 certificates Nov 4 23:19:55.097234 kernel: Loaded X.509 cert 'Kinvolk GmbH: Module signing key for 6.12.54-flatcar: b9a783989f22a1b93da669ffd1529a2a9e0c2420' Nov 4 23:19:55.097253 kernel: Demotion targets for Node 0: null Nov 4 23:19:55.097271 kernel: Key type .fscrypt registered Nov 4 23:19:55.097290 kernel: Key type fscrypt-provisioning registered Nov 4 23:19:55.097308 kernel: ima: No TPM chip found, activating TPM-bypass! Nov 4 23:19:55.097331 kernel: ima: Allocated hash algorithm: sha1 Nov 4 23:19:55.097351 kernel: ima: No architecture policies found Nov 4 23:19:55.097369 kernel: alg: No test for fips(ansi_cprng) (fips_ansi_cprng) Nov 4 23:19:55.097388 kernel: clk: Disabling unused clocks Nov 4 23:19:55.097406 kernel: PM: genpd: Disabling unused power domains Nov 4 23:19:55.097425 kernel: Freeing unused kernel memory: 13056K Nov 4 23:19:55.097443 kernel: Run /init as init process Nov 4 23:19:55.097465 kernel: with arguments: Nov 4 23:19:55.097484 kernel: /init Nov 4 23:19:55.097502 kernel: with environment: Nov 4 23:19:55.097520 kernel: HOME=/ Nov 4 23:19:55.097539 kernel: TERM=linux Nov 4 23:19:55.097557 kernel: ACPI: \_SB_.PCI0.GSI0: Enabled at IRQ 35 Nov 4 23:19:55.097794 kernel: nvme nvme0: pci function 0000:00:04.0 Nov 4 23:19:55.097987 kernel: nvme nvme0: 2/0/0 default/read/poll queues Nov 4 23:19:55.098014 kernel: GPT:Primary header thinks Alt. header is not at the end of the disk. Nov 4 23:19:55.098033 kernel: GPT:25804799 != 33554431 Nov 4 23:19:55.098051 kernel: GPT:Alternate GPT header not at the end of the disk. Nov 4 23:19:55.098069 kernel: GPT:25804799 != 33554431 Nov 4 23:19:55.098088 kernel: GPT: Use GNU Parted to correct GPT errors. Nov 4 23:19:55.098106 kernel: nvme0n1: p1 p2 p3 p4 p6 p7 p9 Nov 4 23:19:55.098130 kernel: SCSI subsystem initialized Nov 4 23:19:55.098148 kernel: device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. Nov 4 23:19:55.098167 kernel: device-mapper: uevent: version 1.0.3 Nov 4 23:19:55.098185 kernel: device-mapper: ioctl: 4.48.0-ioctl (2023-03-01) initialised: dm-devel@lists.linux.dev Nov 4 23:19:55.098204 kernel: device-mapper: verity: sha256 using shash "sha256-ce" Nov 4 23:19:55.098223 kernel: raid6: neonx8 gen() 6543 MB/s Nov 4 23:19:55.098241 kernel: raid6: neonx4 gen() 6566 MB/s Nov 4 23:19:55.098264 kernel: raid6: neonx2 gen() 5455 MB/s Nov 4 23:19:55.098282 kernel: raid6: neonx1 gen() 3956 MB/s Nov 4 23:19:55.098301 kernel: raid6: int64x8 gen() 3659 MB/s Nov 4 23:19:55.098319 kernel: raid6: int64x4 gen() 3707 MB/s Nov 4 23:19:55.098337 kernel: raid6: int64x2 gen() 3604 MB/s Nov 4 23:19:55.098356 kernel: raid6: int64x1 gen() 2767 MB/s Nov 4 23:19:55.098374 kernel: raid6: using algorithm neonx4 gen() 6566 MB/s Nov 4 23:19:55.098397 kernel: raid6: .... xor() 4888 MB/s, rmw enabled Nov 4 23:19:55.098415 kernel: raid6: using neon recovery algorithm Nov 4 23:19:55.098434 kernel: xor: measuring software checksum speed Nov 4 23:19:55.098452 kernel: 8regs : 11957 MB/sec Nov 4 23:19:55.098471 kernel: 32regs : 13017 MB/sec Nov 4 23:19:55.098490 kernel: arm64_neon : 9191 MB/sec Nov 4 23:19:55.098508 kernel: xor: using function: 32regs (13017 MB/sec) Nov 4 23:19:55.098530 kernel: Btrfs loaded, zoned=no, fsverity=no Nov 4 23:19:55.098549 kernel: BTRFS: device fsid 3945a319-ac24-4f41-92d0-9c29c05b835d devid 1 transid 36 /dev/mapper/usr (254:0) scanned by mount (221) Nov 4 23:19:55.098568 kernel: BTRFS info (device dm-0): first mount of filesystem 3945a319-ac24-4f41-92d0-9c29c05b835d Nov 4 23:19:55.098588 kernel: BTRFS info (device dm-0): using crc32c (crc32c-generic) checksum algorithm Nov 4 23:19:55.098644 kernel: BTRFS info (device dm-0): enabling ssd optimizations Nov 4 23:19:55.098668 kernel: BTRFS info (device dm-0): disabling log replay at mount time Nov 4 23:19:55.098688 kernel: BTRFS info (device dm-0): enabling free space tree Nov 4 23:19:55.098711 kernel: loop: module loaded Nov 4 23:19:55.098730 kernel: loop0: detected capacity change from 0 to 91464 Nov 4 23:19:55.098749 kernel: squashfs: version 4.0 (2009/01/31) Phillip Lougher Nov 4 23:19:55.098770 systemd[1]: Successfully made /usr/ read-only. Nov 4 23:19:55.098795 systemd[1]: systemd 257.7 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +IPE +SMACK +SECCOMP -GCRYPT -GNUTLS +OPENSSL -ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 -PWQUALITY -P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP -SYSVINIT +LIBARCHIVE) Nov 4 23:19:55.098817 systemd[1]: Detected virtualization amazon. Nov 4 23:19:55.098841 systemd[1]: Detected architecture arm64. Nov 4 23:19:55.098861 systemd[1]: Running in initrd. Nov 4 23:19:55.098880 systemd[1]: No hostname configured, using default hostname. Nov 4 23:19:55.098901 systemd[1]: Hostname set to . Nov 4 23:19:55.098921 systemd[1]: Initializing machine ID from SMBIOS/DMI UUID. Nov 4 23:19:55.098942 systemd[1]: Queued start job for default target initrd.target. Nov 4 23:19:55.098975 systemd[1]: Unnecessary job was removed for dev-mapper-usr.device - /dev/mapper/usr. Nov 4 23:19:55.099000 systemd[1]: Started clevis-luks-askpass.path - Forward Password Requests to Clevis Directory Watch. Nov 4 23:19:55.099021 systemd[1]: Started systemd-ask-password-console.path - Dispatch Password Requests to Console Directory Watch. Nov 4 23:19:55.099043 systemd[1]: Expecting device dev-disk-by\x2dlabel-EFI\x2dSYSTEM.device - /dev/disk/by-label/EFI-SYSTEM... Nov 4 23:19:55.099064 systemd[1]: Expecting device dev-disk-by\x2dlabel-OEM.device - /dev/disk/by-label/OEM... Nov 4 23:19:55.099090 systemd[1]: Expecting device dev-disk-by\x2dlabel-ROOT.device - /dev/disk/by-label/ROOT... Nov 4 23:19:55.099112 systemd[1]: Expecting device dev-disk-by\x2dpartlabel-USR\x2dA.device - /dev/disk/by-partlabel/USR-A... Nov 4 23:19:55.099133 systemd[1]: Reached target cryptsetup-pre.target - Local Encrypted Volumes (Pre). Nov 4 23:19:55.099154 systemd[1]: Reached target cryptsetup.target - Local Encrypted Volumes. Nov 4 23:19:55.099176 systemd[1]: Reached target initrd-usr-fs.target - Initrd /usr File System. Nov 4 23:19:55.099197 systemd[1]: Reached target paths.target - Path Units. Nov 4 23:19:55.099221 systemd[1]: Reached target slices.target - Slice Units. Nov 4 23:19:55.099242 systemd[1]: Reached target swap.target - Swaps. Nov 4 23:19:55.099263 systemd[1]: Reached target timers.target - Timer Units. Nov 4 23:19:55.099284 systemd[1]: Listening on iscsid.socket - Open-iSCSI iscsid Socket. Nov 4 23:19:55.099305 systemd[1]: Listening on iscsiuio.socket - Open-iSCSI iscsiuio Socket. Nov 4 23:19:55.099326 systemd[1]: Listening on systemd-journald-dev-log.socket - Journal Socket (/dev/log). Nov 4 23:19:55.099347 systemd[1]: Listening on systemd-journald.socket - Journal Sockets. Nov 4 23:19:55.099372 systemd[1]: Listening on systemd-networkd.socket - Network Service Netlink Socket. Nov 4 23:19:55.099393 systemd[1]: Listening on systemd-udevd-control.socket - udev Control Socket. Nov 4 23:19:55.099414 systemd[1]: Listening on systemd-udevd-kernel.socket - udev Kernel Socket. Nov 4 23:19:55.099435 systemd[1]: Reached target sockets.target - Socket Units. Nov 4 23:19:55.099456 systemd[1]: afterburn-network-kargs.service - Afterburn Initrd Setup Network Kernel Arguments was skipped because no trigger condition checks were met. Nov 4 23:19:55.099478 systemd[1]: Starting ignition-setup-pre.service - Ignition env setup... Nov 4 23:19:55.099499 systemd[1]: Starting kmod-static-nodes.service - Create List of Static Device Nodes... Nov 4 23:19:55.099524 systemd[1]: Finished network-cleanup.service - Network Cleanup. Nov 4 23:19:55.099546 systemd[1]: systemd-battery-check.service - Check battery level during early boot was skipped because of an unmet condition check (ConditionDirectoryNotEmpty=/sys/class/power_supply). Nov 4 23:19:55.099567 systemd[1]: Starting systemd-fsck-usr.service... Nov 4 23:19:55.099592 systemd[1]: Starting systemd-journald.service - Journal Service... Nov 4 23:19:55.099641 systemd[1]: Starting systemd-modules-load.service - Load Kernel Modules... Nov 4 23:19:55.099668 systemd[1]: Starting systemd-vconsole-setup.service - Virtual Console Setup... Nov 4 23:19:55.099691 systemd[1]: Finished ignition-setup-pre.service - Ignition env setup. Nov 4 23:19:55.099719 systemd[1]: Finished kmod-static-nodes.service - Create List of Static Device Nodes. Nov 4 23:19:55.099741 systemd[1]: Starting systemd-tmpfiles-setup-dev-early.service - Create Static Device Nodes in /dev gracefully... Nov 4 23:19:55.099763 systemd[1]: Finished systemd-fsck-usr.service. Nov 4 23:19:55.099829 systemd-journald[359]: Collecting audit messages is disabled. Nov 4 23:19:55.099875 kernel: bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this. Nov 4 23:19:55.099896 systemd-journald[359]: Journal started Nov 4 23:19:55.099932 systemd-journald[359]: Runtime Journal (/run/log/journal/ec20bb9a359bad9ac27a2abdbd5cede9) is 8M, max 75.3M, 67.3M free. Nov 4 23:19:55.105425 systemd[1]: Started systemd-journald.service - Journal Service. Nov 4 23:19:55.112115 systemd[1]: Starting systemd-tmpfiles-setup.service - Create System Files and Directories... Nov 4 23:19:55.126662 kernel: Bridge firewalling registered Nov 4 23:19:55.124749 systemd-modules-load[361]: Inserted module 'br_netfilter' Nov 4 23:19:55.129678 systemd[1]: Finished systemd-modules-load.service - Load Kernel Modules. Nov 4 23:19:55.136952 systemd[1]: Starting systemd-sysctl.service - Apply Kernel Variables... Nov 4 23:19:55.148828 systemd[1]: Finished systemd-tmpfiles-setup-dev-early.service - Create Static Device Nodes in /dev gracefully. Nov 4 23:19:55.168537 systemd[1]: Finished systemd-vconsole-setup.service - Virtual Console Setup. Nov 4 23:19:55.179486 systemd[1]: Starting dracut-cmdline-ask.service - dracut ask for additional cmdline parameters... Nov 4 23:19:55.190843 systemd[1]: Starting systemd-tmpfiles-setup-dev.service - Create Static Device Nodes in /dev... Nov 4 23:19:55.191533 systemd-tmpfiles[373]: /usr/lib/tmpfiles.d/var.conf:14: Duplicate line for path "/var/log", ignoring. Nov 4 23:19:55.219279 systemd[1]: Finished systemd-tmpfiles-setup.service - Create System Files and Directories. Nov 4 23:19:55.229844 systemd[1]: Finished systemd-sysctl.service - Apply Kernel Variables. Nov 4 23:19:55.245878 systemd[1]: Starting systemd-resolved.service - Network Name Resolution... Nov 4 23:19:55.254739 systemd[1]: Finished dracut-cmdline-ask.service - dracut ask for additional cmdline parameters. Nov 4 23:19:55.264861 systemd[1]: Finished systemd-tmpfiles-setup-dev.service - Create Static Device Nodes in /dev. Nov 4 23:19:55.272809 systemd[1]: Starting dracut-cmdline.service - dracut cmdline hook... Nov 4 23:19:55.316501 dracut-cmdline[402]: Using kernel command line parameters: rd.driver.pre=btrfs SYSTEMD_SULOGIN_FORCE=1 BOOT_IMAGE=/flatcar/vmlinuz-a mount.usr=/dev/mapper/usr verity.usr=PARTUUID=7130c94a-213a-4e5a-8e26-6cce9662f132 rootflags=rw mount.usrflags=ro consoleblank=0 root=LABEL=ROOT console=tty1 console=ttyS0,115200n8 earlycon flatcar.first_boot=detected acpi=force flatcar.oem.id=ec2 modprobe.blacklist=xen_fbfront net.ifnames=0 nvme_core.io_timeout=4294967295 verity.usrhash=f5fad2f14ba33eafa636a02c130b28d1e2865e3fd8b50e1d7ad0f6eb8ba09fec Nov 4 23:19:55.440691 systemd-resolved[394]: Positive Trust Anchors: Nov 4 23:19:55.440723 systemd-resolved[394]: . IN DS 20326 8 2 e06d44b80b8f1d39a95c0b0d7c65d08458e880409bbc683457104237c7f8ec8d Nov 4 23:19:55.440732 systemd-resolved[394]: . IN DS 38696 8 2 683d2d0acb8c9b712a1948b27f741219298d0a450d612c483af444a4c0fb2b16 Nov 4 23:19:55.440795 systemd-resolved[394]: Negative trust anchors: home.arpa 10.in-addr.arpa 16.172.in-addr.arpa 17.172.in-addr.arpa 18.172.in-addr.arpa 19.172.in-addr.arpa 20.172.in-addr.arpa 21.172.in-addr.arpa 22.172.in-addr.arpa 23.172.in-addr.arpa 24.172.in-addr.arpa 25.172.in-addr.arpa 26.172.in-addr.arpa 27.172.in-addr.arpa 28.172.in-addr.arpa 29.172.in-addr.arpa 30.172.in-addr.arpa 31.172.in-addr.arpa 170.0.0.192.in-addr.arpa 171.0.0.192.in-addr.arpa 168.192.in-addr.arpa d.f.ip6.arpa ipv4only.arpa resolver.arpa corp home internal intranet lan local private test Nov 4 23:19:55.630658 kernel: Loading iSCSI transport class v2.0-870. Nov 4 23:19:55.683651 kernel: iscsi: registered transport (tcp) Nov 4 23:19:55.715670 kernel: random: crng init done Nov 4 23:19:55.716140 systemd-resolved[394]: Defaulting to hostname 'linux'. Nov 4 23:19:55.726150 systemd[1]: Started systemd-resolved.service - Network Name Resolution. Nov 4 23:19:55.728896 systemd[1]: Reached target nss-lookup.target - Host and Network Name Lookups. Nov 4 23:19:55.753682 kernel: iscsi: registered transport (qla4xxx) Nov 4 23:19:55.753770 kernel: QLogic iSCSI HBA Driver Nov 4 23:19:55.792450 systemd[1]: Starting systemd-network-generator.service - Generate network units from Kernel command line... Nov 4 23:19:55.823526 systemd[1]: Finished systemd-network-generator.service - Generate network units from Kernel command line. Nov 4 23:19:55.827242 systemd[1]: Reached target network-pre.target - Preparation for Network. Nov 4 23:19:55.910194 systemd[1]: Finished dracut-cmdline.service - dracut cmdline hook. Nov 4 23:19:55.917036 systemd[1]: Starting dracut-pre-udev.service - dracut pre-udev hook... Nov 4 23:19:55.930008 systemd[1]: Starting parse-ip-for-networkd.service - Write systemd-networkd units from cmdline... Nov 4 23:19:55.986715 systemd[1]: Finished dracut-pre-udev.service - dracut pre-udev hook. Nov 4 23:19:55.997930 systemd[1]: Starting systemd-udevd.service - Rule-based Manager for Device Events and Files... Nov 4 23:19:56.068169 systemd-udevd[634]: Using default interface naming scheme 'v257'. Nov 4 23:19:56.096318 systemd[1]: Started systemd-udevd.service - Rule-based Manager for Device Events and Files. Nov 4 23:19:56.105855 systemd[1]: Starting dracut-pre-trigger.service - dracut pre-trigger hook... Nov 4 23:19:56.154819 dracut-pre-trigger[711]: rd.md=0: removing MD RAID activation Nov 4 23:19:56.166114 systemd[1]: Finished parse-ip-for-networkd.service - Write systemd-networkd units from cmdline. Nov 4 23:19:56.177034 systemd[1]: Starting systemd-networkd.service - Network Configuration... Nov 4 23:19:56.227735 systemd[1]: Finished dracut-pre-trigger.service - dracut pre-trigger hook. Nov 4 23:19:56.234793 systemd[1]: Starting systemd-udev-trigger.service - Coldplug All udev Devices... Nov 4 23:19:56.276829 systemd-networkd[754]: lo: Link UP Nov 4 23:19:56.276848 systemd-networkd[754]: lo: Gained carrier Nov 4 23:19:56.278816 systemd[1]: Started systemd-networkd.service - Network Configuration. Nov 4 23:19:56.280998 systemd[1]: Reached target network.target - Network. Nov 4 23:19:56.398493 systemd[1]: Finished systemd-udev-trigger.service - Coldplug All udev Devices. Nov 4 23:19:56.402778 systemd[1]: Starting dracut-initqueue.service - dracut initqueue hook... Nov 4 23:19:56.635267 systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. Nov 4 23:19:56.638227 systemd[1]: Stopped systemd-vconsole-setup.service - Virtual Console Setup. Nov 4 23:19:56.643109 systemd[1]: Stopping systemd-vconsole-setup.service - Virtual Console Setup... Nov 4 23:19:56.651877 systemd[1]: Starting systemd-vconsole-setup.service - Virtual Console Setup... Nov 4 23:19:56.672411 kernel: ACPI: \_SB_.PCI0.GSI1: Enabled at IRQ 36 Nov 4 23:19:56.672481 kernel: ena 0000:00:05.0: enabling device (0010 -> 0012) Nov 4 23:19:56.679650 kernel: nvme nvme0: using unchecked data buffer Nov 4 23:19:56.686873 kernel: ena 0000:00:05.0: ENA device version: 0.10 Nov 4 23:19:56.687259 kernel: ena 0000:00:05.0: ENA controller version: 0.0.1 implementation version 1 Nov 4 23:19:56.699641 kernel: ena 0000:00:05.0: Elastic Network Adapter (ENA) found at mem 80114000, mac addr 06:41:82:05:da:67 Nov 4 23:19:56.703941 (udev-worker)[801]: Network interface NamePolicy= disabled on kernel command line. Nov 4 23:19:56.725972 systemd-networkd[754]: eth0: Found matching .network file, based on potentially unpredictable interface name: /usr/lib/systemd/network/zz-default.network Nov 4 23:19:56.725996 systemd-networkd[754]: eth0: Configuring with /usr/lib/systemd/network/zz-default.network. Nov 4 23:19:56.738046 systemd-networkd[754]: eth0: Link UP Nov 4 23:19:56.740667 systemd-networkd[754]: eth0: Gained carrier Nov 4 23:19:56.740698 systemd-networkd[754]: eth0: Found matching .network file, based on potentially unpredictable interface name: /usr/lib/systemd/network/zz-default.network Nov 4 23:19:56.752142 systemd[1]: Finished systemd-vconsole-setup.service - Virtual Console Setup. Nov 4 23:19:56.755896 systemd-networkd[754]: eth0: DHCPv4 address 172.31.23.127/20, gateway 172.31.16.1 acquired from 172.31.16.1 Nov 4 23:19:56.821457 systemd[1]: Found device dev-disk-by\x2dpartlabel-USR\x2dA.device - Amazon Elastic Block Store USR-A. Nov 4 23:19:56.870314 systemd[1]: Starting disk-uuid.service - Generate new UUID for disk GPT if necessary... Nov 4 23:19:56.910581 disk-uuid[889]: Primary Header is updated. Nov 4 23:19:56.910581 disk-uuid[889]: Secondary Entries is updated. Nov 4 23:19:56.910581 disk-uuid[889]: Secondary Header is updated. Nov 4 23:19:56.944393 systemd[1]: Found device dev-disk-by\x2dlabel-OEM.device - Amazon Elastic Block Store OEM. Nov 4 23:19:56.981139 systemd[1]: Found device dev-disk-by\x2dlabel-ROOT.device - Amazon Elastic Block Store ROOT. Nov 4 23:19:57.027788 systemd[1]: Found device dev-disk-by\x2dlabel-EFI\x2dSYSTEM.device - Amazon Elastic Block Store EFI-SYSTEM. Nov 4 23:19:57.344726 systemd[1]: Finished dracut-initqueue.service - dracut initqueue hook. Nov 4 23:19:57.357518 systemd[1]: Reached target remote-fs-pre.target - Preparation for Remote File Systems. Nov 4 23:19:57.362900 systemd[1]: Reached target remote-cryptsetup.target - Remote Encrypted Volumes. Nov 4 23:19:57.368168 systemd[1]: Reached target remote-fs.target - Remote File Systems. Nov 4 23:19:57.376365 systemd[1]: Starting dracut-pre-mount.service - dracut pre-mount hook... Nov 4 23:19:57.414688 systemd[1]: Finished dracut-pre-mount.service - dracut pre-mount hook. Nov 4 23:19:58.068284 disk-uuid[900]: Warning: The kernel is still using the old partition table. Nov 4 23:19:58.068284 disk-uuid[900]: The new table will be used at the next reboot or after you Nov 4 23:19:58.068284 disk-uuid[900]: run partprobe(8) or kpartx(8) Nov 4 23:19:58.068284 disk-uuid[900]: The operation has completed successfully. Nov 4 23:19:58.089170 systemd[1]: disk-uuid.service: Deactivated successfully. Nov 4 23:19:58.089549 systemd[1]: Finished disk-uuid.service - Generate new UUID for disk GPT if necessary. Nov 4 23:19:58.099874 systemd[1]: Starting ignition-setup.service - Ignition (setup)... Nov 4 23:19:58.150693 kernel: BTRFS: device label OEM devid 1 transid 11 /dev/nvme0n1p6 (259:5) scanned by mount (1097) Nov 4 23:19:58.154788 kernel: BTRFS info (device nvme0n1p6): first mount of filesystem 66d8fdd7-bb77-4ef3-9186-de6bf719805a Nov 4 23:19:58.154835 kernel: BTRFS info (device nvme0n1p6): using crc32c (crc32c-generic) checksum algorithm Nov 4 23:19:58.198807 kernel: BTRFS info (device nvme0n1p6): enabling ssd optimizations Nov 4 23:19:58.198886 kernel: BTRFS info (device nvme0n1p6): enabling free space tree Nov 4 23:19:58.208743 kernel: BTRFS info (device nvme0n1p6): last unmount of filesystem 66d8fdd7-bb77-4ef3-9186-de6bf719805a Nov 4 23:19:58.209955 systemd[1]: Finished ignition-setup.service - Ignition (setup). Nov 4 23:19:58.219079 systemd[1]: Starting ignition-fetch-offline.service - Ignition (fetch-offline)... Nov 4 23:19:58.728799 systemd-networkd[754]: eth0: Gained IPv6LL Nov 4 23:19:59.485450 ignition[1116]: Ignition 2.22.0 Nov 4 23:19:59.485480 ignition[1116]: Stage: fetch-offline Nov 4 23:19:59.486678 ignition[1116]: no configs at "/usr/lib/ignition/base.d" Nov 4 23:19:59.492911 systemd[1]: Finished ignition-fetch-offline.service - Ignition (fetch-offline). Nov 4 23:19:59.486708 ignition[1116]: no config dir at "/usr/lib/ignition/base.platform.d/aws" Nov 4 23:19:59.497572 systemd[1]: Starting ignition-fetch.service - Ignition (fetch)... Nov 4 23:19:59.487191 ignition[1116]: Ignition finished successfully Nov 4 23:19:59.550789 ignition[1123]: Ignition 2.22.0 Nov 4 23:19:59.550822 ignition[1123]: Stage: fetch Nov 4 23:19:59.551983 ignition[1123]: no configs at "/usr/lib/ignition/base.d" Nov 4 23:19:59.552182 ignition[1123]: no config dir at "/usr/lib/ignition/base.platform.d/aws" Nov 4 23:19:59.552693 ignition[1123]: PUT http://169.254.169.254/latest/api/token: attempt #1 Nov 4 23:19:59.568166 ignition[1123]: PUT result: OK Nov 4 23:19:59.573449 ignition[1123]: parsed url from cmdline: "" Nov 4 23:19:59.573575 ignition[1123]: no config URL provided Nov 4 23:19:59.573597 ignition[1123]: reading system config file "/usr/lib/ignition/user.ign" Nov 4 23:19:59.573801 ignition[1123]: no config at "/usr/lib/ignition/user.ign" Nov 4 23:19:59.573860 ignition[1123]: PUT http://169.254.169.254/latest/api/token: attempt #1 Nov 4 23:19:59.582691 ignition[1123]: PUT result: OK Nov 4 23:19:59.582779 ignition[1123]: GET http://169.254.169.254/2019-10-01/user-data: attempt #1 Nov 4 23:19:59.584698 ignition[1123]: GET result: OK Nov 4 23:19:59.584858 ignition[1123]: parsing config with SHA512: b9e380bf296a1512b320396c589e20a5198e436cd727e3fdf2811b4f8e3dd7cea2470ce70e49d5a579da3b6083550b6ed32293950405348c9d627f0a8ada1c95 Nov 4 23:19:59.600091 unknown[1123]: fetched base config from "system" Nov 4 23:19:59.600329 unknown[1123]: fetched base config from "system" Nov 4 23:19:59.601015 ignition[1123]: fetch: fetch complete Nov 4 23:19:59.600343 unknown[1123]: fetched user config from "aws" Nov 4 23:19:59.601027 ignition[1123]: fetch: fetch passed Nov 4 23:19:59.601132 ignition[1123]: Ignition finished successfully Nov 4 23:19:59.614547 systemd[1]: Finished ignition-fetch.service - Ignition (fetch). Nov 4 23:19:59.622826 systemd[1]: Starting ignition-kargs.service - Ignition (kargs)... Nov 4 23:19:59.672579 ignition[1130]: Ignition 2.22.0 Nov 4 23:19:59.673121 ignition[1130]: Stage: kargs Nov 4 23:19:59.673757 ignition[1130]: no configs at "/usr/lib/ignition/base.d" Nov 4 23:19:59.673777 ignition[1130]: no config dir at "/usr/lib/ignition/base.platform.d/aws" Nov 4 23:19:59.674113 ignition[1130]: PUT http://169.254.169.254/latest/api/token: attempt #1 Nov 4 23:19:59.683703 ignition[1130]: PUT result: OK Nov 4 23:19:59.688093 ignition[1130]: kargs: kargs passed Nov 4 23:19:59.688195 ignition[1130]: Ignition finished successfully Nov 4 23:19:59.694314 systemd[1]: Finished ignition-kargs.service - Ignition (kargs). Nov 4 23:19:59.702879 systemd[1]: Starting ignition-disks.service - Ignition (disks)... Nov 4 23:19:59.761269 ignition[1136]: Ignition 2.22.0 Nov 4 23:19:59.761822 ignition[1136]: Stage: disks Nov 4 23:19:59.762365 ignition[1136]: no configs at "/usr/lib/ignition/base.d" Nov 4 23:19:59.762385 ignition[1136]: no config dir at "/usr/lib/ignition/base.platform.d/aws" Nov 4 23:19:59.762511 ignition[1136]: PUT http://169.254.169.254/latest/api/token: attempt #1 Nov 4 23:19:59.771596 ignition[1136]: PUT result: OK Nov 4 23:19:59.778917 ignition[1136]: disks: disks passed Nov 4 23:19:59.779213 ignition[1136]: Ignition finished successfully Nov 4 23:19:59.787700 systemd[1]: Finished ignition-disks.service - Ignition (disks). Nov 4 23:19:59.791009 systemd[1]: Reached target initrd-root-device.target - Initrd Root Device. Nov 4 23:19:59.795696 systemd[1]: Reached target local-fs-pre.target - Preparation for Local File Systems. Nov 4 23:19:59.800753 systemd[1]: Reached target local-fs.target - Local File Systems. Nov 4 23:19:59.803220 systemd[1]: Reached target sysinit.target - System Initialization. Nov 4 23:19:59.810477 systemd[1]: Reached target basic.target - Basic System. Nov 4 23:19:59.814850 systemd[1]: Starting systemd-fsck-root.service - File System Check on /dev/disk/by-label/ROOT... Nov 4 23:19:59.950790 systemd-fsck[1144]: ROOT: clean, 15/1631200 files, 112378/1617920 blocks Nov 4 23:19:59.954810 systemd[1]: Finished systemd-fsck-root.service - File System Check on /dev/disk/by-label/ROOT. Nov 4 23:19:59.964150 systemd[1]: Mounting sysroot.mount - /sysroot... Nov 4 23:20:00.190642 kernel: EXT4-fs (nvme0n1p9): mounted filesystem 7d7dd2f0-d1ff-4725-86c9-b3137e768051 r/w with ordered data mode. Quota mode: none. Nov 4 23:20:00.192185 systemd[1]: Mounted sysroot.mount - /sysroot. Nov 4 23:20:00.196569 systemd[1]: Reached target initrd-root-fs.target - Initrd Root File System. Nov 4 23:20:00.251695 systemd[1]: Mounting sysroot-oem.mount - /sysroot/oem... Nov 4 23:20:00.256179 systemd[1]: Mounting sysroot-usr.mount - /sysroot/usr... Nov 4 23:20:00.261800 systemd[1]: flatcar-metadata-hostname.service - Flatcar Metadata Hostname Agent was skipped because no trigger condition checks were met. Nov 4 23:20:00.265165 systemd[1]: ignition-remount-sysroot.service - Remount /sysroot read-write for Ignition was skipped because of an unmet condition check (ConditionPathIsReadWrite=!/sysroot). Nov 4 23:20:00.270352 systemd[1]: Reached target ignition-diskful.target - Ignition Boot Disk Setup. Nov 4 23:20:00.290695 systemd[1]: Mounted sysroot-usr.mount - /sysroot/usr. Nov 4 23:20:00.297665 systemd[1]: Starting initrd-setup-root.service - Root filesystem setup... Nov 4 23:20:00.314672 kernel: BTRFS: device label OEM devid 1 transid 11 /dev/nvme0n1p6 (259:5) scanned by mount (1163) Nov 4 23:20:00.319260 kernel: BTRFS info (device nvme0n1p6): first mount of filesystem 66d8fdd7-bb77-4ef3-9186-de6bf719805a Nov 4 23:20:00.319323 kernel: BTRFS info (device nvme0n1p6): using crc32c (crc32c-generic) checksum algorithm Nov 4 23:20:00.326504 kernel: BTRFS info (device nvme0n1p6): enabling ssd optimizations Nov 4 23:20:00.326575 kernel: BTRFS info (device nvme0n1p6): enabling free space tree Nov 4 23:20:00.328893 systemd[1]: Mounted sysroot-oem.mount - /sysroot/oem. Nov 4 23:20:01.774173 initrd-setup-root[1187]: cut: /sysroot/etc/passwd: No such file or directory Nov 4 23:20:01.856856 initrd-setup-root[1194]: cut: /sysroot/etc/group: No such file or directory Nov 4 23:20:01.865601 initrd-setup-root[1201]: cut: /sysroot/etc/shadow: No such file or directory Nov 4 23:20:01.873975 initrd-setup-root[1208]: cut: /sysroot/etc/gshadow: No such file or directory Nov 4 23:20:02.539947 systemd[1]: Finished initrd-setup-root.service - Root filesystem setup. Nov 4 23:20:02.546170 systemd[1]: Starting ignition-mount.service - Ignition (mount)... Nov 4 23:20:02.554021 systemd[1]: Starting sysroot-boot.service - /sysroot/boot... Nov 4 23:20:02.577949 systemd[1]: sysroot-oem.mount: Deactivated successfully. Nov 4 23:20:02.582726 kernel: BTRFS info (device nvme0n1p6): last unmount of filesystem 66d8fdd7-bb77-4ef3-9186-de6bf719805a Nov 4 23:20:02.629737 systemd[1]: Finished sysroot-boot.service - /sysroot/boot. Nov 4 23:20:02.646480 ignition[1275]: INFO : Ignition 2.22.0 Nov 4 23:20:02.648565 ignition[1275]: INFO : Stage: mount Nov 4 23:20:02.648565 ignition[1275]: INFO : no configs at "/usr/lib/ignition/base.d" Nov 4 23:20:02.648565 ignition[1275]: INFO : no config dir at "/usr/lib/ignition/base.platform.d/aws" Nov 4 23:20:02.648565 ignition[1275]: INFO : PUT http://169.254.169.254/latest/api/token: attempt #1 Nov 4 23:20:02.658290 ignition[1275]: INFO : PUT result: OK Nov 4 23:20:02.662579 ignition[1275]: INFO : mount: mount passed Nov 4 23:20:02.664432 ignition[1275]: INFO : Ignition finished successfully Nov 4 23:20:02.670866 systemd[1]: Finished ignition-mount.service - Ignition (mount). Nov 4 23:20:02.678411 systemd[1]: Starting ignition-files.service - Ignition (files)... Nov 4 23:20:02.722691 systemd[1]: Mounting sysroot-oem.mount - /sysroot/oem... Nov 4 23:20:02.768648 kernel: BTRFS: device label OEM devid 1 transid 11 /dev/nvme0n1p6 (259:5) scanned by mount (1287) Nov 4 23:20:02.773644 kernel: BTRFS info (device nvme0n1p6): first mount of filesystem 66d8fdd7-bb77-4ef3-9186-de6bf719805a Nov 4 23:20:02.773698 kernel: BTRFS info (device nvme0n1p6): using crc32c (crc32c-generic) checksum algorithm Nov 4 23:20:02.780705 kernel: BTRFS info (device nvme0n1p6): enabling ssd optimizations Nov 4 23:20:02.780786 kernel: BTRFS info (device nvme0n1p6): enabling free space tree Nov 4 23:20:02.783910 systemd[1]: Mounted sysroot-oem.mount - /sysroot/oem. Nov 4 23:20:02.838671 ignition[1304]: INFO : Ignition 2.22.0 Nov 4 23:20:02.838671 ignition[1304]: INFO : Stage: files Nov 4 23:20:02.838671 ignition[1304]: INFO : no configs at "/usr/lib/ignition/base.d" Nov 4 23:20:02.838671 ignition[1304]: INFO : no config dir at "/usr/lib/ignition/base.platform.d/aws" Nov 4 23:20:02.838671 ignition[1304]: INFO : PUT http://169.254.169.254/latest/api/token: attempt #1 Nov 4 23:20:02.851032 ignition[1304]: INFO : PUT result: OK Nov 4 23:20:02.855796 ignition[1304]: DEBUG : files: compiled without relabeling support, skipping Nov 4 23:20:02.858491 ignition[1304]: INFO : files: ensureUsers: op(1): [started] creating or modifying user "core" Nov 4 23:20:02.858491 ignition[1304]: DEBUG : files: ensureUsers: op(1): executing: "usermod" "--root" "/sysroot" "core" Nov 4 23:20:02.963771 ignition[1304]: INFO : files: ensureUsers: op(1): [finished] creating or modifying user "core" Nov 4 23:20:02.966962 ignition[1304]: INFO : files: ensureUsers: op(2): [started] adding ssh keys to user "core" Nov 4 23:20:02.966962 ignition[1304]: INFO : files: ensureUsers: op(2): [finished] adding ssh keys to user "core" Nov 4 23:20:02.965142 unknown[1304]: wrote ssh authorized keys file for user: core Nov 4 23:20:03.049337 ignition[1304]: INFO : files: createFilesystemsFiles: createFiles: op(3): [started] writing file "/sysroot/opt/helm-v3.17.3-linux-arm64.tar.gz" Nov 4 23:20:03.049337 ignition[1304]: INFO : files: createFilesystemsFiles: createFiles: op(3): GET https://get.helm.sh/helm-v3.17.3-linux-arm64.tar.gz: attempt #1 Nov 4 23:20:03.140506 ignition[1304]: INFO : files: createFilesystemsFiles: createFiles: op(3): GET result: OK Nov 4 23:20:03.270532 ignition[1304]: INFO : files: createFilesystemsFiles: createFiles: op(3): [finished] writing file "/sysroot/opt/helm-v3.17.3-linux-arm64.tar.gz" Nov 4 23:20:03.270532 ignition[1304]: INFO : files: createFilesystemsFiles: createFiles: op(4): [started] writing file "/sysroot/home/core/install.sh" Nov 4 23:20:03.281621 ignition[1304]: INFO : files: createFilesystemsFiles: createFiles: op(4): [finished] writing file "/sysroot/home/core/install.sh" Nov 4 23:20:03.281621 ignition[1304]: INFO : files: createFilesystemsFiles: createFiles: op(5): [started] writing file "/sysroot/home/core/nginx.yaml" Nov 4 23:20:03.281621 ignition[1304]: INFO : files: createFilesystemsFiles: createFiles: op(5): [finished] writing file "/sysroot/home/core/nginx.yaml" Nov 4 23:20:03.281621 ignition[1304]: INFO : files: createFilesystemsFiles: createFiles: op(6): [started] writing file "/sysroot/home/core/nfs-pod.yaml" Nov 4 23:20:03.281621 ignition[1304]: INFO : files: createFilesystemsFiles: createFiles: op(6): [finished] writing file "/sysroot/home/core/nfs-pod.yaml" Nov 4 23:20:03.281621 ignition[1304]: INFO : files: createFilesystemsFiles: createFiles: op(7): [started] writing file "/sysroot/home/core/nfs-pvc.yaml" Nov 4 23:20:03.281621 ignition[1304]: INFO : files: createFilesystemsFiles: createFiles: op(7): [finished] writing file "/sysroot/home/core/nfs-pvc.yaml" Nov 4 23:20:03.309919 ignition[1304]: INFO : files: createFilesystemsFiles: createFiles: op(8): [started] writing file "/sysroot/etc/flatcar/update.conf" Nov 4 23:20:03.309919 ignition[1304]: INFO : files: createFilesystemsFiles: createFiles: op(8): [finished] writing file "/sysroot/etc/flatcar/update.conf" Nov 4 23:20:03.309919 ignition[1304]: INFO : files: createFilesystemsFiles: createFiles: op(9): [started] writing link "/sysroot/etc/extensions/kubernetes.raw" -> "/opt/extensions/kubernetes/kubernetes-v1.33.0-arm64.raw" Nov 4 23:20:03.325146 ignition[1304]: INFO : files: createFilesystemsFiles: createFiles: op(9): [finished] writing link "/sysroot/etc/extensions/kubernetes.raw" -> "/opt/extensions/kubernetes/kubernetes-v1.33.0-arm64.raw" Nov 4 23:20:03.325146 ignition[1304]: INFO : files: createFilesystemsFiles: createFiles: op(a): [started] writing file "/sysroot/opt/extensions/kubernetes/kubernetes-v1.33.0-arm64.raw" Nov 4 23:20:03.325146 ignition[1304]: INFO : files: createFilesystemsFiles: createFiles: op(a): GET https://extensions.flatcar.org/extensions/kubernetes-v1.33.0-arm64.raw: attempt #1 Nov 4 23:20:03.830561 ignition[1304]: INFO : files: createFilesystemsFiles: createFiles: op(a): GET result: OK Nov 4 23:20:04.222302 ignition[1304]: INFO : files: createFilesystemsFiles: createFiles: op(a): [finished] writing file "/sysroot/opt/extensions/kubernetes/kubernetes-v1.33.0-arm64.raw" Nov 4 23:20:04.222302 ignition[1304]: INFO : files: op(b): [started] processing unit "prepare-helm.service" Nov 4 23:20:04.250593 ignition[1304]: INFO : files: op(b): op(c): [started] writing unit "prepare-helm.service" at "/sysroot/etc/systemd/system/prepare-helm.service" Nov 4 23:20:04.260859 ignition[1304]: INFO : files: op(b): op(c): [finished] writing unit "prepare-helm.service" at "/sysroot/etc/systemd/system/prepare-helm.service" Nov 4 23:20:04.260859 ignition[1304]: INFO : files: op(b): [finished] processing unit "prepare-helm.service" Nov 4 23:20:04.260859 ignition[1304]: INFO : files: op(d): [started] setting preset to enabled for "prepare-helm.service" Nov 4 23:20:04.274327 ignition[1304]: INFO : files: op(d): [finished] setting preset to enabled for "prepare-helm.service" Nov 4 23:20:04.274327 ignition[1304]: INFO : files: createResultFile: createFiles: op(e): [started] writing file "/sysroot/etc/.ignition-result.json" Nov 4 23:20:04.274327 ignition[1304]: INFO : files: createResultFile: createFiles: op(e): [finished] writing file "/sysroot/etc/.ignition-result.json" Nov 4 23:20:04.274327 ignition[1304]: INFO : files: files passed Nov 4 23:20:04.274327 ignition[1304]: INFO : Ignition finished successfully Nov 4 23:20:04.278163 systemd[1]: Finished ignition-files.service - Ignition (files). Nov 4 23:20:04.286341 systemd[1]: Starting ignition-quench.service - Ignition (record completion)... Nov 4 23:20:04.293881 systemd[1]: Starting initrd-setup-root-after-ignition.service - Root filesystem completion... Nov 4 23:20:04.335510 systemd[1]: ignition-quench.service: Deactivated successfully. Nov 4 23:20:04.338791 systemd[1]: Finished ignition-quench.service - Ignition (record completion). Nov 4 23:20:04.356447 initrd-setup-root-after-ignition[1336]: grep: /sysroot/etc/flatcar/enabled-sysext.conf: No such file or directory Nov 4 23:20:04.356447 initrd-setup-root-after-ignition[1336]: grep: /sysroot/usr/share/flatcar/enabled-sysext.conf: No such file or directory Nov 4 23:20:04.363788 initrd-setup-root-after-ignition[1340]: grep: /sysroot/etc/flatcar/enabled-sysext.conf: No such file or directory Nov 4 23:20:04.369365 systemd[1]: Finished initrd-setup-root-after-ignition.service - Root filesystem completion. Nov 4 23:20:04.373015 systemd[1]: Reached target ignition-complete.target - Ignition Complete. Nov 4 23:20:04.382779 systemd[1]: Starting initrd-parse-etc.service - Mountpoints Configured in the Real Root... Nov 4 23:20:04.478878 systemd[1]: initrd-parse-etc.service: Deactivated successfully. Nov 4 23:20:04.479546 systemd[1]: Finished initrd-parse-etc.service - Mountpoints Configured in the Real Root. Nov 4 23:20:04.487304 systemd[1]: Reached target initrd-fs.target - Initrd File Systems. Nov 4 23:20:04.491037 systemd[1]: Reached target initrd.target - Initrd Default Target. Nov 4 23:20:04.495519 systemd[1]: dracut-mount.service - dracut mount hook was skipped because no trigger condition checks were met. Nov 4 23:20:04.499175 systemd[1]: Starting dracut-pre-pivot.service - dracut pre-pivot and cleanup hook... Nov 4 23:20:04.548247 systemd[1]: Finished dracut-pre-pivot.service - dracut pre-pivot and cleanup hook. Nov 4 23:20:04.556161 systemd[1]: Starting initrd-cleanup.service - Cleaning Up and Shutting Down Daemons... Nov 4 23:20:04.594759 systemd[1]: Unnecessary job was removed for dev-mapper-usr.device - /dev/mapper/usr. Nov 4 23:20:04.598315 systemd[1]: Stopped target nss-lookup.target - Host and Network Name Lookups. Nov 4 23:20:04.603752 systemd[1]: Stopped target remote-cryptsetup.target - Remote Encrypted Volumes. Nov 4 23:20:04.606984 systemd[1]: Stopped target timers.target - Timer Units. Nov 4 23:20:04.613423 systemd[1]: dracut-pre-pivot.service: Deactivated successfully. Nov 4 23:20:04.614035 systemd[1]: Stopped dracut-pre-pivot.service - dracut pre-pivot and cleanup hook. Nov 4 23:20:04.621662 systemd[1]: Stopped target initrd.target - Initrd Default Target. Nov 4 23:20:04.624788 systemd[1]: Stopped target basic.target - Basic System. Nov 4 23:20:04.628966 systemd[1]: Stopped target ignition-complete.target - Ignition Complete. Nov 4 23:20:04.631666 systemd[1]: Stopped target ignition-diskful.target - Ignition Boot Disk Setup. Nov 4 23:20:04.638901 systemd[1]: Stopped target initrd-root-device.target - Initrd Root Device. Nov 4 23:20:04.643841 systemd[1]: Stopped target initrd-usr-fs.target - Initrd /usr File System. Nov 4 23:20:04.650572 systemd[1]: Stopped target remote-fs.target - Remote File Systems. Nov 4 23:20:04.655217 systemd[1]: Stopped target remote-fs-pre.target - Preparation for Remote File Systems. Nov 4 23:20:04.660092 systemd[1]: Stopped target sysinit.target - System Initialization. Nov 4 23:20:04.662495 systemd[1]: Stopped target local-fs.target - Local File Systems. Nov 4 23:20:04.667352 systemd[1]: Stopped target swap.target - Swaps. Nov 4 23:20:04.667472 systemd[1]: dracut-pre-mount.service: Deactivated successfully. Nov 4 23:20:04.667586 systemd[1]: Stopped dracut-pre-mount.service - dracut pre-mount hook. Nov 4 23:20:04.677311 systemd[1]: Stopped target cryptsetup.target - Local Encrypted Volumes. Nov 4 23:20:04.681759 systemd[1]: Stopped target cryptsetup-pre.target - Local Encrypted Volumes (Pre). Nov 4 23:20:04.683949 systemd[1]: clevis-luks-askpass.path: Deactivated successfully. Nov 4 23:20:04.689232 systemd[1]: Stopped clevis-luks-askpass.path - Forward Password Requests to Clevis Directory Watch. Nov 4 23:20:04.689355 systemd[1]: dracut-initqueue.service: Deactivated successfully. Nov 4 23:20:04.689459 systemd[1]: Stopped dracut-initqueue.service - dracut initqueue hook. Nov 4 23:20:04.697048 systemd[1]: initrd-setup-root-after-ignition.service: Deactivated successfully. Nov 4 23:20:04.697140 systemd[1]: Stopped initrd-setup-root-after-ignition.service - Root filesystem completion. Nov 4 23:20:04.700428 systemd[1]: ignition-files.service: Deactivated successfully. Nov 4 23:20:04.700509 systemd[1]: Stopped ignition-files.service - Ignition (files). Nov 4 23:20:04.714200 systemd[1]: Stopping ignition-mount.service - Ignition (mount)... Nov 4 23:20:04.720991 systemd[1]: kmod-static-nodes.service: Deactivated successfully. Nov 4 23:20:04.721106 systemd[1]: Stopped kmod-static-nodes.service - Create List of Static Device Nodes. Nov 4 23:20:04.729144 systemd[1]: Stopping sysroot-boot.service - /sysroot/boot... Nov 4 23:20:04.739776 systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. Nov 4 23:20:04.740461 systemd[1]: Stopped systemd-tmpfiles-setup.service - Create System Files and Directories. Nov 4 23:20:04.748037 systemd[1]: systemd-udev-trigger.service: Deactivated successfully. Nov 4 23:20:04.751175 systemd[1]: Stopped systemd-udev-trigger.service - Coldplug All udev Devices. Nov 4 23:20:04.756707 systemd[1]: dracut-pre-trigger.service: Deactivated successfully. Nov 4 23:20:04.756826 systemd[1]: Stopped dracut-pre-trigger.service - dracut pre-trigger hook. Nov 4 23:20:04.768406 systemd[1]: initrd-cleanup.service: Deactivated successfully. Nov 4 23:20:04.772709 systemd[1]: Finished initrd-cleanup.service - Cleaning Up and Shutting Down Daemons. Nov 4 23:20:04.801901 systemd[1]: sysroot-boot.mount: Deactivated successfully. Nov 4 23:20:04.819307 ignition[1360]: INFO : Ignition 2.22.0 Nov 4 23:20:04.821402 ignition[1360]: INFO : Stage: umount Nov 4 23:20:04.821402 ignition[1360]: INFO : no configs at "/usr/lib/ignition/base.d" Nov 4 23:20:04.821402 ignition[1360]: INFO : no config dir at "/usr/lib/ignition/base.platform.d/aws" Nov 4 23:20:04.821402 ignition[1360]: INFO : PUT http://169.254.169.254/latest/api/token: attempt #1 Nov 4 23:20:04.831707 ignition[1360]: INFO : PUT result: OK Nov 4 23:20:04.836972 ignition[1360]: INFO : umount: umount passed Nov 4 23:20:04.839035 ignition[1360]: INFO : Ignition finished successfully Nov 4 23:20:04.841575 systemd[1]: ignition-mount.service: Deactivated successfully. Nov 4 23:20:04.841959 systemd[1]: Stopped ignition-mount.service - Ignition (mount). Nov 4 23:20:04.848908 systemd[1]: ignition-disks.service: Deactivated successfully. Nov 4 23:20:04.849023 systemd[1]: Stopped ignition-disks.service - Ignition (disks). Nov 4 23:20:04.851474 systemd[1]: ignition-kargs.service: Deactivated successfully. Nov 4 23:20:04.851699 systemd[1]: Stopped ignition-kargs.service - Ignition (kargs). Nov 4 23:20:04.853941 systemd[1]: ignition-fetch.service: Deactivated successfully. Nov 4 23:20:04.854043 systemd[1]: Stopped ignition-fetch.service - Ignition (fetch). Nov 4 23:20:04.860575 systemd[1]: Stopped target network.target - Network. Nov 4 23:20:04.864920 systemd[1]: ignition-fetch-offline.service: Deactivated successfully. Nov 4 23:20:04.865021 systemd[1]: Stopped ignition-fetch-offline.service - Ignition (fetch-offline). Nov 4 23:20:04.872250 systemd[1]: Stopped target paths.target - Path Units. Nov 4 23:20:04.874498 systemd[1]: systemd-ask-password-console.path: Deactivated successfully. Nov 4 23:20:04.878386 systemd[1]: Stopped systemd-ask-password-console.path - Dispatch Password Requests to Console Directory Watch. Nov 4 23:20:04.881597 systemd[1]: Stopped target slices.target - Slice Units. Nov 4 23:20:04.888217 systemd[1]: Stopped target sockets.target - Socket Units. Nov 4 23:20:04.890499 systemd[1]: iscsid.socket: Deactivated successfully. Nov 4 23:20:04.890579 systemd[1]: Closed iscsid.socket - Open-iSCSI iscsid Socket. Nov 4 23:20:04.893153 systemd[1]: iscsiuio.socket: Deactivated successfully. Nov 4 23:20:04.893226 systemd[1]: Closed iscsiuio.socket - Open-iSCSI iscsiuio Socket. Nov 4 23:20:04.900028 systemd[1]: ignition-setup.service: Deactivated successfully. Nov 4 23:20:04.900146 systemd[1]: Stopped ignition-setup.service - Ignition (setup). Nov 4 23:20:04.903106 systemd[1]: ignition-setup-pre.service: Deactivated successfully. Nov 4 23:20:04.903204 systemd[1]: Stopped ignition-setup-pre.service - Ignition env setup. Nov 4 23:20:04.911119 systemd[1]: Stopping systemd-networkd.service - Network Configuration... Nov 4 23:20:04.920571 systemd[1]: Stopping systemd-resolved.service - Network Name Resolution... Nov 4 23:20:04.946376 systemd[1]: systemd-resolved.service: Deactivated successfully. Nov 4 23:20:04.946666 systemd[1]: Stopped systemd-resolved.service - Network Name Resolution. Nov 4 23:20:04.962460 systemd[1]: systemd-networkd.service: Deactivated successfully. Nov 4 23:20:04.966627 systemd[1]: Stopped systemd-networkd.service - Network Configuration. Nov 4 23:20:04.976025 systemd[1]: Stopped target network-pre.target - Preparation for Network. Nov 4 23:20:04.981256 systemd[1]: systemd-networkd.socket: Deactivated successfully. Nov 4 23:20:04.981340 systemd[1]: Closed systemd-networkd.socket - Network Service Netlink Socket. Nov 4 23:20:04.985467 systemd[1]: Stopping network-cleanup.service - Network Cleanup... Nov 4 23:20:04.987732 systemd[1]: parse-ip-for-networkd.service: Deactivated successfully. Nov 4 23:20:04.987853 systemd[1]: Stopped parse-ip-for-networkd.service - Write systemd-networkd units from cmdline. Nov 4 23:20:04.993025 systemd[1]: systemd-sysctl.service: Deactivated successfully. Nov 4 23:20:04.993136 systemd[1]: Stopped systemd-sysctl.service - Apply Kernel Variables. Nov 4 23:20:04.995684 systemd[1]: systemd-modules-load.service: Deactivated successfully. Nov 4 23:20:04.995793 systemd[1]: Stopped systemd-modules-load.service - Load Kernel Modules. Nov 4 23:20:05.005350 systemd[1]: Stopping systemd-udevd.service - Rule-based Manager for Device Events and Files... Nov 4 23:20:05.046951 systemd[1]: systemd-udevd.service: Deactivated successfully. Nov 4 23:20:05.050563 systemd[1]: Stopped systemd-udevd.service - Rule-based Manager for Device Events and Files. Nov 4 23:20:05.054193 systemd[1]: systemd-udevd-control.socket: Deactivated successfully. Nov 4 23:20:05.054284 systemd[1]: Closed systemd-udevd-control.socket - udev Control Socket. Nov 4 23:20:05.056899 systemd[1]: systemd-udevd-kernel.socket: Deactivated successfully. Nov 4 23:20:05.056972 systemd[1]: Closed systemd-udevd-kernel.socket - udev Kernel Socket. Nov 4 23:20:05.059456 systemd[1]: dracut-pre-udev.service: Deactivated successfully. Nov 4 23:20:05.059564 systemd[1]: Stopped dracut-pre-udev.service - dracut pre-udev hook. Nov 4 23:20:05.069975 systemd[1]: dracut-cmdline.service: Deactivated successfully. Nov 4 23:20:05.070088 systemd[1]: Stopped dracut-cmdline.service - dracut cmdline hook. Nov 4 23:20:05.071079 systemd[1]: dracut-cmdline-ask.service: Deactivated successfully. Nov 4 23:20:05.071166 systemd[1]: Stopped dracut-cmdline-ask.service - dracut ask for additional cmdline parameters. Nov 4 23:20:05.087059 systemd[1]: Starting initrd-udevadm-cleanup-db.service - Cleanup udev Database... Nov 4 23:20:05.101489 systemd[1]: systemd-network-generator.service: Deactivated successfully. Nov 4 23:20:05.101628 systemd[1]: Stopped systemd-network-generator.service - Generate network units from Kernel command line. Nov 4 23:20:05.105902 systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. Nov 4 23:20:05.106015 systemd[1]: Stopped systemd-tmpfiles-setup-dev.service - Create Static Device Nodes in /dev. Nov 4 23:20:05.114201 systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. Nov 4 23:20:05.114307 systemd[1]: Stopped systemd-vconsole-setup.service - Virtual Console Setup. Nov 4 23:20:05.118841 systemd[1]: sysroot-boot.service: Deactivated successfully. Nov 4 23:20:05.119062 systemd[1]: Stopped sysroot-boot.service - /sysroot/boot. Nov 4 23:20:05.134423 systemd[1]: initrd-setup-root.service: Deactivated successfully. Nov 4 23:20:05.139661 systemd[1]: Stopped initrd-setup-root.service - Root filesystem setup. Nov 4 23:20:05.152261 systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. Nov 4 23:20:05.157008 systemd[1]: Finished initrd-udevadm-cleanup-db.service - Cleanup udev Database. Nov 4 23:20:05.168145 systemd[1]: network-cleanup.service: Deactivated successfully. Nov 4 23:20:05.169889 systemd[1]: Stopped network-cleanup.service - Network Cleanup. Nov 4 23:20:05.173117 systemd[1]: Reached target initrd-switch-root.target - Switch Root. Nov 4 23:20:05.181994 systemd[1]: Starting initrd-switch-root.service - Switch Root... Nov 4 23:20:05.227356 systemd[1]: Switching root. Nov 4 23:20:05.297691 systemd-journald[359]: Journal stopped Nov 4 23:20:09.112055 systemd-journald[359]: Received SIGTERM from PID 1 (systemd). Nov 4 23:20:09.112190 kernel: SELinux: policy capability network_peer_controls=1 Nov 4 23:20:09.112235 kernel: SELinux: policy capability open_perms=1 Nov 4 23:20:09.112267 kernel: SELinux: policy capability extended_socket_class=1 Nov 4 23:20:09.112305 kernel: SELinux: policy capability always_check_network=0 Nov 4 23:20:09.112336 kernel: SELinux: policy capability cgroup_seclabel=1 Nov 4 23:20:09.112367 kernel: SELinux: policy capability nnp_nosuid_transition=1 Nov 4 23:20:09.112404 kernel: SELinux: policy capability genfs_seclabel_symlinks=0 Nov 4 23:20:09.112433 kernel: SELinux: policy capability ioctl_skip_cloexec=0 Nov 4 23:20:09.112462 kernel: SELinux: policy capability userspace_initial_context=0 Nov 4 23:20:09.112492 kernel: audit: type=1403 audit(1762298406.206:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 Nov 4 23:20:09.112529 systemd[1]: Successfully loaded SELinux policy in 249.759ms. Nov 4 23:20:09.112572 systemd[1]: Relabeled /dev/, /dev/shm/, /run/ in 15.761ms. Nov 4 23:20:09.112657 systemd[1]: systemd 257.7 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +IPE +SMACK +SECCOMP -GCRYPT -GNUTLS +OPENSSL -ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 -PWQUALITY -P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP -SYSVINIT +LIBARCHIVE) Nov 4 23:20:09.112696 systemd[1]: Detected virtualization amazon. Nov 4 23:20:09.112727 systemd[1]: Detected architecture arm64. Nov 4 23:20:09.112760 systemd[1]: Detected first boot. Nov 4 23:20:09.112793 systemd[1]: Initializing machine ID from SMBIOS/DMI UUID. Nov 4 23:20:09.112829 zram_generator::config[1406]: No configuration found. Nov 4 23:20:09.112864 kernel: NET: Registered PF_VSOCK protocol family Nov 4 23:20:09.112895 systemd[1]: Populated /etc with preset unit settings. Nov 4 23:20:09.112927 systemd[1]: initrd-switch-root.service: Deactivated successfully. Nov 4 23:20:09.112960 systemd[1]: Stopped initrd-switch-root.service - Switch Root. Nov 4 23:20:09.113000 systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. Nov 4 23:20:09.113035 systemd[1]: Created slice system-addon\x2dconfig.slice - Slice /system/addon-config. Nov 4 23:20:09.113070 systemd[1]: Created slice system-addon\x2drun.slice - Slice /system/addon-run. Nov 4 23:20:09.113105 systemd[1]: Created slice system-getty.slice - Slice /system/getty. Nov 4 23:20:09.113136 systemd[1]: Created slice system-modprobe.slice - Slice /system/modprobe. Nov 4 23:20:09.113168 systemd[1]: Created slice system-serial\x2dgetty.slice - Slice /system/serial-getty. Nov 4 23:20:09.113199 systemd[1]: Created slice system-system\x2dcloudinit.slice - Slice /system/system-cloudinit. Nov 4 23:20:09.113232 systemd[1]: Created slice system-systemd\x2dfsck.slice - Slice /system/systemd-fsck. Nov 4 23:20:09.113268 systemd[1]: Created slice user.slice - User and Session Slice. Nov 4 23:20:09.113300 systemd[1]: Started clevis-luks-askpass.path - Forward Password Requests to Clevis Directory Watch. Nov 4 23:20:09.113331 systemd[1]: Started systemd-ask-password-console.path - Dispatch Password Requests to Console Directory Watch. Nov 4 23:20:09.113361 systemd[1]: Started systemd-ask-password-wall.path - Forward Password Requests to Wall Directory Watch. Nov 4 23:20:09.113392 systemd[1]: Set up automount boot.automount - Boot partition Automount Point. Nov 4 23:20:09.113424 systemd[1]: Set up automount proc-sys-fs-binfmt_misc.automount - Arbitrary Executable File Formats File System Automount Point. Nov 4 23:20:09.113457 systemd[1]: Expecting device dev-disk-by\x2dlabel-OEM.device - /dev/disk/by-label/OEM... Nov 4 23:20:09.113492 systemd[1]: Expecting device dev-ttyS0.device - /dev/ttyS0... Nov 4 23:20:09.113523 systemd[1]: Reached target cryptsetup-pre.target - Local Encrypted Volumes (Pre). Nov 4 23:20:09.113556 systemd[1]: Reached target cryptsetup.target - Local Encrypted Volumes. Nov 4 23:20:09.113586 systemd[1]: Stopped target initrd-switch-root.target - Switch Root. Nov 4 23:20:09.113677 systemd[1]: Stopped target initrd-fs.target - Initrd File Systems. Nov 4 23:20:09.113710 systemd[1]: Stopped target initrd-root-fs.target - Initrd Root File System. Nov 4 23:20:09.113741 systemd[1]: Reached target integritysetup.target - Local Integrity Protected Volumes. Nov 4 23:20:09.113778 systemd[1]: Reached target remote-cryptsetup.target - Remote Encrypted Volumes. Nov 4 23:20:09.113810 systemd[1]: Reached target remote-fs.target - Remote File Systems. Nov 4 23:20:09.113842 systemd[1]: Reached target slices.target - Slice Units. Nov 4 23:20:09.113877 systemd[1]: Reached target swap.target - Swaps. Nov 4 23:20:09.113910 systemd[1]: Reached target veritysetup.target - Local Verity Protected Volumes. Nov 4 23:20:09.113942 systemd[1]: Listening on systemd-coredump.socket - Process Core Dump Socket. Nov 4 23:20:09.113974 systemd[1]: Listening on systemd-creds.socket - Credential Encryption/Decryption. Nov 4 23:20:09.114008 systemd[1]: Listening on systemd-networkd.socket - Network Service Netlink Socket. Nov 4 23:20:09.114040 systemd[1]: Listening on systemd-udevd-control.socket - udev Control Socket. Nov 4 23:20:09.114070 systemd[1]: Listening on systemd-udevd-kernel.socket - udev Kernel Socket. Nov 4 23:20:09.114102 systemd[1]: Listening on systemd-userdbd.socket - User Database Manager Socket. Nov 4 23:20:09.114134 systemd[1]: Mounting dev-hugepages.mount - Huge Pages File System... Nov 4 23:20:09.114175 systemd[1]: Mounting dev-mqueue.mount - POSIX Message Queue File System... Nov 4 23:20:09.114205 systemd[1]: Mounting media.mount - External Media Directory... Nov 4 23:20:09.114243 systemd[1]: Mounting sys-kernel-debug.mount - Kernel Debug File System... Nov 4 23:20:09.114272 systemd[1]: Mounting sys-kernel-tracing.mount - Kernel Trace File System... Nov 4 23:20:09.114303 systemd[1]: Mounting tmp.mount - Temporary Directory /tmp... Nov 4 23:20:09.114334 systemd[1]: var-lib-machines.mount - Virtual Machine and Container Storage (Compatibility) was skipped because of an unmet condition check (ConditionPathExists=/var/lib/machines.raw). Nov 4 23:20:09.114364 systemd[1]: Reached target machines.target - Containers. Nov 4 23:20:09.114396 systemd[1]: Starting flatcar-tmpfiles.service - Create missing system files... Nov 4 23:20:09.114425 systemd[1]: ignition-delete-config.service - Ignition (delete config) was skipped because no trigger condition checks were met. Nov 4 23:20:09.114459 systemd[1]: Starting kmod-static-nodes.service - Create List of Static Device Nodes... Nov 4 23:20:09.114490 systemd[1]: Starting modprobe@configfs.service - Load Kernel Module configfs... Nov 4 23:20:09.114519 systemd[1]: Starting modprobe@dm_mod.service - Load Kernel Module dm_mod... Nov 4 23:20:09.114548 systemd[1]: Starting modprobe@drm.service - Load Kernel Module drm... Nov 4 23:20:09.114577 systemd[1]: Starting modprobe@efi_pstore.service - Load Kernel Module efi_pstore... Nov 4 23:20:09.115709 systemd[1]: Starting modprobe@fuse.service - Load Kernel Module fuse... Nov 4 23:20:09.115762 systemd[1]: Starting modprobe@loop.service - Load Kernel Module loop... Nov 4 23:20:09.115801 systemd[1]: setup-nsswitch.service - Create /etc/nsswitch.conf was skipped because of an unmet condition check (ConditionPathExists=!/etc/nsswitch.conf). Nov 4 23:20:09.115831 systemd[1]: systemd-fsck-root.service: Deactivated successfully. Nov 4 23:20:09.115860 systemd[1]: Stopped systemd-fsck-root.service - File System Check on Root Device. Nov 4 23:20:09.115911 systemd[1]: systemd-fsck-usr.service: Deactivated successfully. Nov 4 23:20:09.115943 systemd[1]: Stopped systemd-fsck-usr.service. Nov 4 23:20:09.115974 systemd[1]: systemd-hibernate-clear.service - Clear Stale Hibernate Storage Info was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67). Nov 4 23:20:09.116011 systemd[1]: Starting systemd-journald.service - Journal Service... Nov 4 23:20:09.116040 systemd[1]: Starting systemd-modules-load.service - Load Kernel Modules... Nov 4 23:20:09.116069 systemd[1]: Starting systemd-network-generator.service - Generate network units from Kernel command line... Nov 4 23:20:09.116098 systemd[1]: Starting systemd-remount-fs.service - Remount Root and Kernel File Systems... Nov 4 23:20:09.116128 systemd[1]: Starting systemd-udev-load-credentials.service - Load udev Rules from Credentials... Nov 4 23:20:09.116156 systemd[1]: Starting systemd-udev-trigger.service - Coldplug All udev Devices... Nov 4 23:20:09.116188 systemd[1]: Mounted dev-hugepages.mount - Huge Pages File System. Nov 4 23:20:09.116223 systemd[1]: Mounted dev-mqueue.mount - POSIX Message Queue File System. Nov 4 23:20:09.116252 systemd[1]: Mounted media.mount - External Media Directory. Nov 4 23:20:09.116281 systemd[1]: Mounted sys-kernel-debug.mount - Kernel Debug File System. Nov 4 23:20:09.116312 systemd[1]: Mounted sys-kernel-tracing.mount - Kernel Trace File System. Nov 4 23:20:09.116347 systemd[1]: Mounted tmp.mount - Temporary Directory /tmp. Nov 4 23:20:09.116377 systemd[1]: Finished kmod-static-nodes.service - Create List of Static Device Nodes. Nov 4 23:20:09.116407 systemd[1]: modprobe@dm_mod.service: Deactivated successfully. Nov 4 23:20:09.116466 systemd[1]: Finished modprobe@dm_mod.service - Load Kernel Module dm_mod. Nov 4 23:20:09.116536 systemd[1]: modprobe@efi_pstore.service: Deactivated successfully. Nov 4 23:20:09.116595 systemd[1]: Finished modprobe@efi_pstore.service - Load Kernel Module efi_pstore. Nov 4 23:20:09.118749 systemd[1]: modprobe@loop.service: Deactivated successfully. Nov 4 23:20:09.118808 systemd[1]: Finished modprobe@loop.service - Load Kernel Module loop. Nov 4 23:20:09.118840 systemd[1]: Finished systemd-modules-load.service - Load Kernel Modules. Nov 4 23:20:09.118873 systemd[1]: Finished systemd-remount-fs.service - Remount Root and Kernel File Systems. Nov 4 23:20:09.118903 systemd[1]: Listening on systemd-importd.socket - Disk Image Download Service Socket. Nov 4 23:20:09.118936 systemd[1]: remount-root.service - Remount Root File System was skipped because of an unmet condition check (ConditionPathIsReadWrite=!/). Nov 4 23:20:09.118967 systemd[1]: Reached target local-fs.target - Local File Systems. Nov 4 23:20:09.119001 systemd[1]: Listening on systemd-sysext.socket - System Extension Image Management. Nov 4 23:20:09.119051 systemd[1]: systemd-binfmt.service - Set Up Additional Binary Formats was skipped because no trigger condition checks were met. Nov 4 23:20:09.119085 systemd[1]: Starting systemd-hwdb-update.service - Rebuild Hardware Database... Nov 4 23:20:09.119118 systemd[1]: systemd-pstore.service - Platform Persistent Storage Archival was skipped because of an unmet condition check (ConditionDirectoryNotEmpty=/sys/fs/pstore). Nov 4 23:20:09.119150 systemd[1]: Starting systemd-random-seed.service - Load/Save OS Random Seed... Nov 4 23:20:09.119184 systemd[1]: systemd-repart.service - Repartition Root Disk was skipped because no trigger condition checks were met. Nov 4 23:20:09.119260 systemd-journald[1492]: Collecting audit messages is disabled. Nov 4 23:20:09.119310 systemd[1]: Starting systemd-sysctl.service - Apply Kernel Variables... Nov 4 23:20:09.119341 systemd-journald[1492]: Journal started Nov 4 23:20:09.119387 systemd-journald[1492]: Runtime Journal (/run/log/journal/ec20bb9a359bad9ac27a2abdbd5cede9) is 8M, max 75.3M, 67.3M free. Nov 4 23:20:08.463912 systemd[1]: Queued start job for default target multi-user.target. Nov 4 23:20:08.478362 systemd[1]: Unnecessary job was removed for dev-nvme0n1p6.device - /dev/nvme0n1p6. Nov 4 23:20:08.479297 systemd[1]: systemd-journald.service: Deactivated successfully. Nov 4 23:20:09.132630 systemd[1]: Starting systemd-sysext.service - Merge System Extension Images into /usr/ and /opt/... Nov 4 23:20:09.140644 systemd[1]: Started systemd-journald.service - Journal Service. Nov 4 23:20:09.140744 kernel: fuse: init (API version 7.41) Nov 4 23:20:09.145718 systemd[1]: modprobe@configfs.service: Deactivated successfully. Nov 4 23:20:09.146145 systemd[1]: Finished modprobe@configfs.service - Load Kernel Module configfs. Nov 4 23:20:09.149768 systemd[1]: Finished systemd-network-generator.service - Generate network units from Kernel command line. Nov 4 23:20:09.163861 systemd[1]: modprobe@fuse.service: Deactivated successfully. Nov 4 23:20:09.166252 systemd[1]: Finished modprobe@fuse.service - Load Kernel Module fuse. Nov 4 23:20:09.179974 kernel: ACPI: bus type drm_connector registered Nov 4 23:20:09.184782 systemd[1]: Finished flatcar-tmpfiles.service - Create missing system files. Nov 4 23:20:09.188552 systemd[1]: modprobe@drm.service: Deactivated successfully. Nov 4 23:20:09.190161 systemd[1]: Finished modprobe@drm.service - Load Kernel Module drm. Nov 4 23:20:09.195072 systemd[1]: Finished systemd-udev-load-credentials.service - Load udev Rules from Credentials. Nov 4 23:20:09.199964 systemd[1]: Finished systemd-random-seed.service - Load/Save OS Random Seed. Nov 4 23:20:09.226310 systemd[1]: Reached target first-boot-complete.target - First Boot Complete. Nov 4 23:20:09.229097 systemd[1]: Reached target network-pre.target - Preparation for Network. Nov 4 23:20:09.233931 systemd[1]: Starting systemd-journal-flush.service - Flush Journal to Persistent Storage... Nov 4 23:20:09.245871 systemd[1]: Starting systemd-machine-id-commit.service - Save Transient machine-id to Disk... Nov 4 23:20:09.256042 systemd[1]: Starting systemd-sysusers.service - Create System Users... Nov 4 23:20:09.281659 kernel: loop1: detected capacity change from 0 to 61264 Nov 4 23:20:09.286561 systemd[1]: Finished systemd-sysctl.service - Apply Kernel Variables. Nov 4 23:20:09.305008 systemd-journald[1492]: Time spent on flushing to /var/log/journal/ec20bb9a359bad9ac27a2abdbd5cede9 is 36.452ms for 913 entries. Nov 4 23:20:09.305008 systemd-journald[1492]: System Journal (/var/log/journal/ec20bb9a359bad9ac27a2abdbd5cede9) is 8M, max 588.1M, 580.1M free. Nov 4 23:20:09.362472 systemd-journald[1492]: Received client request to flush runtime journal. Nov 4 23:20:09.325742 systemd[1]: Finished systemd-machine-id-commit.service - Save Transient machine-id to Disk. Nov 4 23:20:09.365756 systemd[1]: Finished systemd-journal-flush.service - Flush Journal to Persistent Storage. Nov 4 23:20:09.396545 systemd[1]: Finished systemd-sysusers.service - Create System Users. Nov 4 23:20:09.408015 systemd[1]: Starting systemd-resolved.service - Network Name Resolution... Nov 4 23:20:09.414008 systemd[1]: Starting systemd-tmpfiles-setup-dev.service - Create Static Device Nodes in /dev... Nov 4 23:20:09.477010 systemd[1]: Starting systemd-userdbd.service - User Database Manager... Nov 4 23:20:09.483516 systemd[1]: etc-machine\x2did.mount: Deactivated successfully. Nov 4 23:20:09.488952 systemd[1]: Mounting sys-fs-fuse-connections.mount - FUSE Control File System... Nov 4 23:20:09.498823 systemd[1]: Mounting sys-kernel-config.mount - Kernel Configuration File System... Nov 4 23:20:09.517239 systemd-tmpfiles[1552]: ACLs are not supported, ignoring. Nov 4 23:20:09.517263 systemd-tmpfiles[1552]: ACLs are not supported, ignoring. Nov 4 23:20:09.528090 systemd[1]: Mounted sys-fs-fuse-connections.mount - FUSE Control File System. Nov 4 23:20:09.531114 systemd[1]: Mounted sys-kernel-config.mount - Kernel Configuration File System. Nov 4 23:20:09.547787 systemd[1]: Finished systemd-tmpfiles-setup-dev.service - Create Static Device Nodes in /dev. Nov 4 23:20:09.579768 systemd[1]: Finished systemd-udev-trigger.service - Coldplug All udev Devices. Nov 4 23:20:09.624819 systemd[1]: Started systemd-userdbd.service - User Database Manager. Nov 4 23:20:09.656663 kernel: loop2: detected capacity change from 0 to 211168 Nov 4 23:20:09.754351 systemd-resolved[1551]: Positive Trust Anchors: Nov 4 23:20:09.754385 systemd-resolved[1551]: . IN DS 20326 8 2 e06d44b80b8f1d39a95c0b0d7c65d08458e880409bbc683457104237c7f8ec8d Nov 4 23:20:09.754394 systemd-resolved[1551]: . IN DS 38696 8 2 683d2d0acb8c9b712a1948b27f741219298d0a450d612c483af444a4c0fb2b16 Nov 4 23:20:09.754456 systemd-resolved[1551]: Negative trust anchors: home.arpa 10.in-addr.arpa 16.172.in-addr.arpa 17.172.in-addr.arpa 18.172.in-addr.arpa 19.172.in-addr.arpa 20.172.in-addr.arpa 21.172.in-addr.arpa 22.172.in-addr.arpa 23.172.in-addr.arpa 24.172.in-addr.arpa 25.172.in-addr.arpa 26.172.in-addr.arpa 27.172.in-addr.arpa 28.172.in-addr.arpa 29.172.in-addr.arpa 30.172.in-addr.arpa 31.172.in-addr.arpa 170.0.0.192.in-addr.arpa 171.0.0.192.in-addr.arpa 168.192.in-addr.arpa d.f.ip6.arpa ipv4only.arpa resolver.arpa corp home internal intranet lan local private test Nov 4 23:20:09.767789 systemd-resolved[1551]: Defaulting to hostname 'linux'. Nov 4 23:20:09.770123 systemd[1]: Started systemd-resolved.service - Network Name Resolution. Nov 4 23:20:09.772825 systemd[1]: Reached target nss-lookup.target - Host and Network Name Lookups. Nov 4 23:20:09.964673 kernel: loop3: detected capacity change from 0 to 119344 Nov 4 23:20:10.230710 systemd[1]: Finished systemd-hwdb-update.service - Rebuild Hardware Database. Nov 4 23:20:10.236298 systemd[1]: Starting systemd-udevd.service - Rule-based Manager for Device Events and Files... Nov 4 23:20:10.262654 kernel: loop4: detected capacity change from 0 to 100624 Nov 4 23:20:10.294478 systemd-udevd[1570]: Using default interface naming scheme 'v257'. Nov 4 23:20:10.334281 systemd[1]: Started systemd-udevd.service - Rule-based Manager for Device Events and Files. Nov 4 23:20:10.347131 systemd[1]: Starting systemd-networkd.service - Network Configuration... Nov 4 23:20:10.457266 (udev-worker)[1584]: Network interface NamePolicy= disabled on kernel command line. Nov 4 23:20:10.498743 systemd-networkd[1575]: lo: Link UP Nov 4 23:20:10.498759 systemd-networkd[1575]: lo: Gained carrier Nov 4 23:20:10.501078 systemd[1]: Started systemd-networkd.service - Network Configuration. Nov 4 23:20:10.503826 systemd[1]: Reached target network.target - Network. Nov 4 23:20:10.510530 systemd[1]: Starting systemd-networkd-persistent-storage.service - Enable Persistent Storage in systemd-networkd... Nov 4 23:20:10.515991 systemd[1]: Starting systemd-networkd-wait-online.service - Wait for Network to be Configured... Nov 4 23:20:10.570687 systemd[1]: Finished systemd-networkd-persistent-storage.service - Enable Persistent Storage in systemd-networkd. Nov 4 23:20:10.593753 systemd-networkd[1575]: eth0: Found matching .network file, based on potentially unpredictable interface name: /usr/lib/systemd/network/zz-default.network Nov 4 23:20:10.593768 systemd-networkd[1575]: eth0: Configuring with /usr/lib/systemd/network/zz-default.network. Nov 4 23:20:10.596436 systemd[1]: Condition check resulted in dev-ttyS0.device - /dev/ttyS0 being skipped. Nov 4 23:20:10.605928 systemd-networkd[1575]: eth0: Link UP Nov 4 23:20:10.606201 systemd-networkd[1575]: eth0: Gained carrier Nov 4 23:20:10.606233 systemd-networkd[1575]: eth0: Found matching .network file, based on potentially unpredictable interface name: /usr/lib/systemd/network/zz-default.network Nov 4 23:20:10.608654 kernel: loop5: detected capacity change from 0 to 61264 Nov 4 23:20:10.622772 systemd-networkd[1575]: eth0: DHCPv4 address 172.31.23.127/20, gateway 172.31.16.1 acquired from 172.31.16.1 Nov 4 23:20:10.635272 kernel: loop6: detected capacity change from 0 to 211168 Nov 4 23:20:10.665650 kernel: loop7: detected capacity change from 0 to 119344 Nov 4 23:20:10.685646 kernel: loop1: detected capacity change from 0 to 100624 Nov 4 23:20:10.700431 (sd-merge)[1608]: Using extensions 'containerd-flatcar.raw', 'docker-flatcar.raw', 'kubernetes.raw', 'oem-ami.raw'. Nov 4 23:20:10.708917 (sd-merge)[1608]: Merged extensions into '/usr'. Nov 4 23:20:10.757206 systemd[1]: Reload requested from client PID 1519 ('systemd-sysext') (unit systemd-sysext.service)... Nov 4 23:20:10.757233 systemd[1]: Reloading... Nov 4 23:20:11.066105 zram_generator::config[1749]: No configuration found. Nov 4 23:20:11.587557 systemd[1]: Found device dev-disk-by\x2dlabel-OEM.device - Amazon Elastic Block Store OEM. Nov 4 23:20:11.591586 systemd[1]: Reloading finished in 833 ms. Nov 4 23:20:11.619566 systemd[1]: Finished systemd-sysext.service - Merge System Extension Images into /usr/ and /opt/. Nov 4 23:20:11.690701 systemd[1]: Starting ensure-sysext.service... Nov 4 23:20:11.700863 systemd[1]: Starting systemd-fsck@dev-disk-by\x2dlabel-OEM.service - File System Check on /dev/disk/by-label/OEM... Nov 4 23:20:11.710869 systemd[1]: Starting systemd-tmpfiles-setup.service - Create System Files and Directories... Nov 4 23:20:11.722920 systemd[1]: Starting systemd-vconsole-setup.service - Virtual Console Setup... Nov 4 23:20:11.759765 systemd[1]: Finished systemd-fsck@dev-disk-by\x2dlabel-OEM.service - File System Check on /dev/disk/by-label/OEM. Nov 4 23:20:11.768393 systemd[1]: Reload requested from client PID 1788 ('systemctl') (unit ensure-sysext.service)... Nov 4 23:20:11.768431 systemd[1]: Reloading... Nov 4 23:20:11.783892 systemd-tmpfiles[1790]: /usr/lib/tmpfiles.d/nfs-utils.conf:6: Duplicate line for path "/var/lib/nfs/sm", ignoring. Nov 4 23:20:11.784964 systemd-tmpfiles[1790]: /usr/lib/tmpfiles.d/nfs-utils.conf:7: Duplicate line for path "/var/lib/nfs/sm.bak", ignoring. Nov 4 23:20:11.786340 systemd-tmpfiles[1790]: /usr/lib/tmpfiles.d/provision.conf:20: Duplicate line for path "/root", ignoring. Nov 4 23:20:11.787456 systemd-tmpfiles[1790]: /usr/lib/tmpfiles.d/systemd-flatcar.conf:6: Duplicate line for path "/var/log/journal", ignoring. Nov 4 23:20:11.789849 systemd-tmpfiles[1790]: /usr/lib/tmpfiles.d/systemd.conf:29: Duplicate line for path "/var/lib/systemd", ignoring. Nov 4 23:20:11.791200 systemd-tmpfiles[1790]: ACLs are not supported, ignoring. Nov 4 23:20:11.791510 systemd-tmpfiles[1790]: ACLs are not supported, ignoring. Nov 4 23:20:11.806882 systemd-tmpfiles[1790]: Detected autofs mount point /boot during canonicalization of boot. Nov 4 23:20:11.807083 systemd-tmpfiles[1790]: Skipping /boot Nov 4 23:20:11.827402 systemd-tmpfiles[1790]: Detected autofs mount point /boot during canonicalization of boot. Nov 4 23:20:11.828225 systemd-tmpfiles[1790]: Skipping /boot Nov 4 23:20:11.952669 zram_generator::config[1839]: No configuration found. Nov 4 23:20:12.352067 systemd[1]: Reloading finished in 582 ms. Nov 4 23:20:12.360826 systemd-networkd[1575]: eth0: Gained IPv6LL Nov 4 23:20:12.371912 systemd[1]: Finished systemd-networkd-wait-online.service - Wait for Network to be Configured. Nov 4 23:20:12.396013 systemd[1]: Finished systemd-tmpfiles-setup.service - Create System Files and Directories. Nov 4 23:20:12.403064 systemd[1]: Finished systemd-vconsole-setup.service - Virtual Console Setup. Nov 4 23:20:12.420768 systemd[1]: Reached target network-online.target - Network is Online. Nov 4 23:20:12.425918 systemd[1]: Starting audit-rules.service - Load Audit Rules... Nov 4 23:20:12.437967 systemd[1]: Starting clean-ca-certificates.service - Clean up broken links in /etc/ssl/certs... Nov 4 23:20:12.447266 systemd[1]: Starting ldconfig.service - Rebuild Dynamic Linker Cache... Nov 4 23:20:12.454085 systemd[1]: Starting systemd-journal-catalog-update.service - Rebuild Journal Catalog... Nov 4 23:20:12.461899 systemd[1]: Starting systemd-update-utmp.service - Record System Boot/Shutdown in UTMP... Nov 4 23:20:12.471997 systemd[1]: ignition-delete-config.service - Ignition (delete config) was skipped because no trigger condition checks were met. Nov 4 23:20:12.476369 systemd[1]: Starting modprobe@dm_mod.service - Load Kernel Module dm_mod... Nov 4 23:20:12.481174 systemd[1]: Starting modprobe@efi_pstore.service - Load Kernel Module efi_pstore... Nov 4 23:20:12.490183 systemd[1]: Starting modprobe@loop.service - Load Kernel Module loop... Nov 4 23:20:12.492789 systemd[1]: systemd-binfmt.service - Set Up Additional Binary Formats was skipped because no trigger condition checks were met. Nov 4 23:20:12.493038 systemd[1]: systemd-hibernate-clear.service - Clear Stale Hibernate Storage Info was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67). Nov 4 23:20:12.502897 systemd[1]: ignition-delete-config.service - Ignition (delete config) was skipped because no trigger condition checks were met. Nov 4 23:20:12.504097 systemd[1]: systemd-binfmt.service - Set Up Additional Binary Formats was skipped because no trigger condition checks were met. Nov 4 23:20:12.504302 systemd[1]: systemd-hibernate-clear.service - Clear Stale Hibernate Storage Info was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67). Nov 4 23:20:12.516869 systemd[1]: ignition-delete-config.service - Ignition (delete config) was skipped because no trigger condition checks were met. Nov 4 23:20:12.531240 systemd[1]: Starting modprobe@drm.service - Load Kernel Module drm... Nov 4 23:20:12.533862 systemd[1]: systemd-binfmt.service - Set Up Additional Binary Formats was skipped because no trigger condition checks were met. Nov 4 23:20:12.534105 systemd[1]: systemd-hibernate-clear.service - Clear Stale Hibernate Storage Info was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67). Nov 4 23:20:12.534405 systemd[1]: Reached target time-set.target - System Time Set. Nov 4 23:20:12.554461 systemd[1]: Finished ensure-sysext.service. Nov 4 23:20:12.572701 systemd[1]: Finished systemd-update-utmp.service - Record System Boot/Shutdown in UTMP. Nov 4 23:20:12.596212 systemd[1]: modprobe@loop.service: Deactivated successfully. Nov 4 23:20:12.596595 systemd[1]: Finished modprobe@loop.service - Load Kernel Module loop. Nov 4 23:20:12.608566 systemd[1]: modprobe@dm_mod.service: Deactivated successfully. Nov 4 23:20:12.611463 systemd[1]: Finished modprobe@dm_mod.service - Load Kernel Module dm_mod. Nov 4 23:20:12.617969 systemd[1]: modprobe@efi_pstore.service: Deactivated successfully. Nov 4 23:20:12.620158 systemd[1]: Finished modprobe@efi_pstore.service - Load Kernel Module efi_pstore. Nov 4 23:20:12.626981 systemd[1]: systemd-pstore.service - Platform Persistent Storage Archival was skipped because of an unmet condition check (ConditionDirectoryNotEmpty=/sys/fs/pstore). Nov 4 23:20:12.627117 systemd[1]: systemd-repart.service - Repartition Root Disk was skipped because no trigger condition checks were met. Nov 4 23:20:12.630173 systemd[1]: modprobe@drm.service: Deactivated successfully. Nov 4 23:20:12.633979 systemd[1]: Finished modprobe@drm.service - Load Kernel Module drm. Nov 4 23:20:12.641091 systemd[1]: Finished systemd-journal-catalog-update.service - Rebuild Journal Catalog. Nov 4 23:20:12.686657 augenrules[1920]: No rules Nov 4 23:20:12.690125 systemd[1]: audit-rules.service: Deactivated successfully. Nov 4 23:20:12.692719 systemd[1]: Finished audit-rules.service - Load Audit Rules. Nov 4 23:20:12.735983 systemd[1]: Finished clean-ca-certificates.service - Clean up broken links in /etc/ssl/certs. Nov 4 23:20:12.739497 systemd[1]: update-ca-certificates.service - Update CA bundle at /etc/ssl/certs/ca-certificates.crt was skipped because of an unmet condition check (ConditionPathIsSymbolicLink=!/etc/ssl/certs/ca-certificates.crt). Nov 4 23:20:13.129529 ldconfig[1887]: /sbin/ldconfig: /usr/lib/ld.so.conf is not an ELF file - it has the wrong magic bytes at the start. Nov 4 23:20:13.134991 systemd[1]: Finished ldconfig.service - Rebuild Dynamic Linker Cache. Nov 4 23:20:13.143947 systemd[1]: Starting systemd-update-done.service - Update is Completed... Nov 4 23:20:13.175781 systemd[1]: Finished systemd-update-done.service - Update is Completed. Nov 4 23:20:13.178831 systemd[1]: Reached target sysinit.target - System Initialization. Nov 4 23:20:13.181500 systemd[1]: Started motdgen.path - Watch for update engine configuration changes. Nov 4 23:20:13.184403 systemd[1]: Started user-cloudinit@var-lib-flatcar\x2dinstall-user_data.path - Watch for a cloud-config at /var/lib/flatcar-install/user_data. Nov 4 23:20:13.187738 systemd[1]: Started logrotate.timer - Daily rotation of log files. Nov 4 23:20:13.190360 systemd[1]: Started mdadm.timer - Weekly check for MD array's redundancy information.. Nov 4 23:20:13.193317 systemd[1]: Started systemd-tmpfiles-clean.timer - Daily Cleanup of Temporary Directories. Nov 4 23:20:13.196127 systemd[1]: update-engine-stub.timer - Update Engine Stub Timer was skipped because of an unmet condition check (ConditionPathExists=/usr/.noupdate). Nov 4 23:20:13.196297 systemd[1]: Reached target paths.target - Path Units. Nov 4 23:20:13.198346 systemd[1]: Reached target timers.target - Timer Units. Nov 4 23:20:13.201799 systemd[1]: Listening on dbus.socket - D-Bus System Message Bus Socket. Nov 4 23:20:13.206842 systemd[1]: Starting docker.socket - Docker Socket for the API... Nov 4 23:20:13.213120 systemd[1]: Listening on sshd-unix-local.socket - OpenSSH Server Socket (systemd-ssh-generator, AF_UNIX Local). Nov 4 23:20:13.216509 systemd[1]: Listening on sshd-vsock.socket - OpenSSH Server Socket (systemd-ssh-generator, AF_VSOCK). Nov 4 23:20:13.219494 systemd[1]: Reached target ssh-access.target - SSH Access Available. Nov 4 23:20:13.226569 systemd[1]: Listening on sshd.socket - OpenSSH Server Socket. Nov 4 23:20:13.230227 systemd[1]: Listening on systemd-hostnamed.socket - Hostname Service Socket. Nov 4 23:20:13.233985 systemd[1]: Listening on docker.socket - Docker Socket for the API. Nov 4 23:20:13.236892 systemd[1]: Reached target sockets.target - Socket Units. Nov 4 23:20:13.239158 systemd[1]: Reached target basic.target - Basic System. Nov 4 23:20:13.241332 systemd[1]: addon-config@oem.service - Configure Addon /oem was skipped because no trigger condition checks were met. Nov 4 23:20:13.241400 systemd[1]: addon-run@oem.service - Run Addon /oem was skipped because no trigger condition checks were met. Nov 4 23:20:13.244798 systemd[1]: Starting containerd.service - containerd container runtime... Nov 4 23:20:13.252322 systemd[1]: Starting coreos-metadata.service - Flatcar Metadata Agent... Nov 4 23:20:13.262108 systemd[1]: Starting dbus.service - D-Bus System Message Bus... Nov 4 23:20:13.272984 systemd[1]: Starting dracut-shutdown.service - Restore /run/initramfs on shutdown... Nov 4 23:20:13.279353 systemd[1]: Starting enable-oem-cloudinit.service - Enable cloudinit... Nov 4 23:20:13.285180 systemd[1]: Starting extend-filesystems.service - Extend Filesystems... Nov 4 23:20:13.287727 systemd[1]: flatcar-setup-environment.service - Modifies /etc/environment for CoreOS was skipped because of an unmet condition check (ConditionPathExists=/oem/bin/flatcar-setup-environment). Nov 4 23:20:13.300874 systemd[1]: Starting kubelet.service - kubelet: The Kubernetes Node Agent... Nov 4 23:20:13.309800 systemd[1]: Starting motdgen.service - Generate /run/flatcar/motd... Nov 4 23:20:13.323207 systemd[1]: Started ntpd.service - Network Time Service. Nov 4 23:20:13.329550 systemd[1]: Starting nvidia.service - NVIDIA Configure Service... Nov 4 23:20:13.340959 systemd[1]: Starting prepare-helm.service - Unpack helm to /opt/bin... Nov 4 23:20:13.346595 jq[1938]: false Nov 4 23:20:13.350933 systemd[1]: Starting setup-oem.service - Setup OEM... Nov 4 23:20:13.375000 systemd[1]: Starting ssh-key-proc-cmdline.service - Install an ssh key from /proc/cmdline... Nov 4 23:20:13.384084 systemd[1]: Starting sshd-keygen.service - Generate sshd host keys... Nov 4 23:20:13.399070 systemd[1]: Starting systemd-logind.service - User Login Management... Nov 4 23:20:13.401811 systemd[1]: tcsd.service - TCG Core Services Daemon was skipped because of an unmet condition check (ConditionPathExists=/dev/tpm0). Nov 4 23:20:13.402684 systemd[1]: cgroup compatibility translation between legacy and unified hierarchy settings activated. See cgroup-compat debug messages for details. Nov 4 23:20:13.410017 systemd[1]: Starting update-engine.service - Update Engine... Nov 4 23:20:13.422140 systemd[1]: Starting update-ssh-keys-after-ignition.service - Run update-ssh-keys once after Ignition... Nov 4 23:20:13.432700 systemd[1]: Finished dracut-shutdown.service - Restore /run/initramfs on shutdown. Nov 4 23:20:13.436555 systemd[1]: enable-oem-cloudinit.service: Skipped due to 'exec-condition'. Nov 4 23:20:13.439937 systemd[1]: Condition check resulted in enable-oem-cloudinit.service - Enable cloudinit being skipped. Nov 4 23:20:13.476187 ntpd[1944]: ntpd 4.2.8p18@1.4062-o Tue Nov 4 21:31:46 UTC 2025 (1): Starting Nov 4 23:20:13.493318 ntpd[1944]: 4 Nov 23:20:13 ntpd[1944]: ntpd 4.2.8p18@1.4062-o Tue Nov 4 21:31:46 UTC 2025 (1): Starting Nov 4 23:20:13.493318 ntpd[1944]: 4 Nov 23:20:13 ntpd[1944]: Command line: /usr/sbin/ntpd -g -n -u ntp:ntp Nov 4 23:20:13.493318 ntpd[1944]: 4 Nov 23:20:13 ntpd[1944]: ---------------------------------------------------- Nov 4 23:20:13.493318 ntpd[1944]: 4 Nov 23:20:13 ntpd[1944]: ntp-4 is maintained by Network Time Foundation, Nov 4 23:20:13.493318 ntpd[1944]: 4 Nov 23:20:13 ntpd[1944]: Inc. (NTF), a non-profit 501(c)(3) public-benefit Nov 4 23:20:13.493318 ntpd[1944]: 4 Nov 23:20:13 ntpd[1944]: corporation. Support and training for ntp-4 are Nov 4 23:20:13.493318 ntpd[1944]: 4 Nov 23:20:13 ntpd[1944]: available at https://www.nwtime.org/support Nov 4 23:20:13.493318 ntpd[1944]: 4 Nov 23:20:13 ntpd[1944]: ---------------------------------------------------- Nov 4 23:20:13.493318 ntpd[1944]: 4 Nov 23:20:13 ntpd[1944]: proto: precision = 0.096 usec (-23) Nov 4 23:20:13.493318 ntpd[1944]: 4 Nov 23:20:13 ntpd[1944]: basedate set to 2025-10-23 Nov 4 23:20:13.493318 ntpd[1944]: 4 Nov 23:20:13 ntpd[1944]: gps base set to 2025-10-26 (week 2390) Nov 4 23:20:13.493318 ntpd[1944]: 4 Nov 23:20:13 ntpd[1944]: Listen and drop on 0 v6wildcard [::]:123 Nov 4 23:20:13.493318 ntpd[1944]: 4 Nov 23:20:13 ntpd[1944]: Listen and drop on 1 v4wildcard 0.0.0.0:123 Nov 4 23:20:13.493318 ntpd[1944]: 4 Nov 23:20:13 ntpd[1944]: Listen normally on 2 lo 127.0.0.1:123 Nov 4 23:20:13.493318 ntpd[1944]: 4 Nov 23:20:13 ntpd[1944]: Listen normally on 3 eth0 172.31.23.127:123 Nov 4 23:20:13.493318 ntpd[1944]: 4 Nov 23:20:13 ntpd[1944]: Listen normally on 4 lo [::1]:123 Nov 4 23:20:13.493318 ntpd[1944]: 4 Nov 23:20:13 ntpd[1944]: Listen normally on 5 eth0 [fe80::441:82ff:fe05:da67%2]:123 Nov 4 23:20:13.493318 ntpd[1944]: 4 Nov 23:20:13 ntpd[1944]: Listening on routing socket on fd #22 for interface updates Nov 4 23:20:13.476300 ntpd[1944]: Command line: /usr/sbin/ntpd -g -n -u ntp:ntp Nov 4 23:20:13.507343 ntpd[1944]: 4 Nov 23:20:13 ntpd[1944]: kernel reports TIME_ERROR: 0x41: Clock Unsynchronized Nov 4 23:20:13.507343 ntpd[1944]: 4 Nov 23:20:13 ntpd[1944]: kernel reports TIME_ERROR: 0x41: Clock Unsynchronized Nov 4 23:20:13.476318 ntpd[1944]: ---------------------------------------------------- Nov 4 23:20:13.476334 ntpd[1944]: ntp-4 is maintained by Network Time Foundation, Nov 4 23:20:13.476351 ntpd[1944]: Inc. (NTF), a non-profit 501(c)(3) public-benefit Nov 4 23:20:13.476367 ntpd[1944]: corporation. Support and training for ntp-4 are Nov 4 23:20:13.518787 coreos-metadata[1935]: Nov 04 23:20:13.511 INFO Putting http://169.254.169.254/latest/api/token: Attempt #1 Nov 4 23:20:13.518787 coreos-metadata[1935]: Nov 04 23:20:13.511 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/instance-id: Attempt #1 Nov 4 23:20:13.518787 coreos-metadata[1935]: Nov 04 23:20:13.511 INFO Fetch successful Nov 4 23:20:13.518787 coreos-metadata[1935]: Nov 04 23:20:13.511 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/instance-type: Attempt #1 Nov 4 23:20:13.518787 coreos-metadata[1935]: Nov 04 23:20:13.515 INFO Fetch successful Nov 4 23:20:13.518787 coreos-metadata[1935]: Nov 04 23:20:13.515 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/local-ipv4: Attempt #1 Nov 4 23:20:13.476387 ntpd[1944]: available at https://www.nwtime.org/support Nov 4 23:20:13.476404 ntpd[1944]: ---------------------------------------------------- Nov 4 23:20:13.483359 ntpd[1944]: proto: precision = 0.096 usec (-23) Nov 4 23:20:13.484279 ntpd[1944]: basedate set to 2025-10-23 Nov 4 23:20:13.484313 ntpd[1944]: gps base set to 2025-10-26 (week 2390) Nov 4 23:20:13.484497 ntpd[1944]: Listen and drop on 0 v6wildcard [::]:123 Nov 4 23:20:13.484541 ntpd[1944]: Listen and drop on 1 v4wildcard 0.0.0.0:123 Nov 4 23:20:13.484870 ntpd[1944]: Listen normally on 2 lo 127.0.0.1:123 Nov 4 23:20:13.484921 ntpd[1944]: Listen normally on 3 eth0 172.31.23.127:123 Nov 4 23:20:13.484966 ntpd[1944]: Listen normally on 4 lo [::1]:123 Nov 4 23:20:13.485010 ntpd[1944]: Listen normally on 5 eth0 [fe80::441:82ff:fe05:da67%2]:123 Nov 4 23:20:13.485051 ntpd[1944]: Listening on routing socket on fd #22 for interface updates Nov 4 23:20:13.501682 ntpd[1944]: kernel reports TIME_ERROR: 0x41: Clock Unsynchronized Nov 4 23:20:13.501729 ntpd[1944]: kernel reports TIME_ERROR: 0x41: Clock Unsynchronized Nov 4 23:20:13.524638 coreos-metadata[1935]: Nov 04 23:20:13.522 INFO Fetch successful Nov 4 23:20:13.524638 coreos-metadata[1935]: Nov 04 23:20:13.522 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/public-ipv4: Attempt #1 Nov 4 23:20:13.524638 coreos-metadata[1935]: Nov 04 23:20:13.523 INFO Fetch successful Nov 4 23:20:13.528310 coreos-metadata[1935]: Nov 04 23:20:13.525 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/ipv6: Attempt #1 Nov 4 23:20:13.536140 coreos-metadata[1935]: Nov 04 23:20:13.535 INFO Fetch failed with 404: resource not found Nov 4 23:20:13.536140 coreos-metadata[1935]: Nov 04 23:20:13.535 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/placement/availability-zone: Attempt #1 Nov 4 23:20:13.538491 extend-filesystems[1939]: Found /dev/nvme0n1p6 Nov 4 23:20:13.545108 coreos-metadata[1935]: Nov 04 23:20:13.537 INFO Fetch successful Nov 4 23:20:13.545108 coreos-metadata[1935]: Nov 04 23:20:13.538 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/placement/availability-zone-id: Attempt #1 Nov 4 23:20:13.545108 coreos-metadata[1935]: Nov 04 23:20:13.542 INFO Fetch successful Nov 4 23:20:13.545108 coreos-metadata[1935]: Nov 04 23:20:13.544 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/hostname: Attempt #1 Nov 4 23:20:13.547232 coreos-metadata[1935]: Nov 04 23:20:13.547 INFO Fetch successful Nov 4 23:20:13.556640 coreos-metadata[1935]: Nov 04 23:20:13.550 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/public-hostname: Attempt #1 Nov 4 23:20:13.556640 coreos-metadata[1935]: Nov 04 23:20:13.554 INFO Fetch successful Nov 4 23:20:13.556640 coreos-metadata[1935]: Nov 04 23:20:13.554 INFO Fetching http://169.254.169.254/2021-01-03/dynamic/instance-identity/document: Attempt #1 Nov 4 23:20:13.558183 coreos-metadata[1935]: Nov 04 23:20:13.558 INFO Fetch successful Nov 4 23:20:13.568480 systemd[1]: ssh-key-proc-cmdline.service: Deactivated successfully. Nov 4 23:20:13.569151 systemd[1]: Finished ssh-key-proc-cmdline.service - Install an ssh key from /proc/cmdline. Nov 4 23:20:13.577348 extend-filesystems[1939]: Found /dev/nvme0n1p9 Nov 4 23:20:13.583576 (ntainerd)[1974]: containerd.service: Referenced but unset environment variable evaluates to an empty string: TORCX_IMAGEDIR, TORCX_UNPACKDIR Nov 4 23:20:13.608591 extend-filesystems[1939]: Checking size of /dev/nvme0n1p9 Nov 4 23:20:13.611921 jq[1956]: true Nov 4 23:20:13.626655 systemd[1]: Finished nvidia.service - NVIDIA Configure Service. Nov 4 23:20:13.636893 systemd[1]: motdgen.service: Deactivated successfully. Nov 4 23:20:13.637457 systemd[1]: Finished motdgen.service - Generate /run/flatcar/motd. Nov 4 23:20:13.664397 dbus-daemon[1936]: [system] SELinux support is enabled Nov 4 23:20:13.664798 systemd[1]: Started dbus.service - D-Bus System Message Bus. Nov 4 23:20:13.673912 systemd[1]: system-cloudinit@usr-share-oem-cloud\x2dconfig.yml.service - Load cloud-config from /usr/share/oem/cloud-config.yml was skipped because of an unmet condition check (ConditionFileNotEmpty=/usr/share/oem/cloud-config.yml). Nov 4 23:20:13.673961 systemd[1]: Reached target system-config.target - Load system-provided cloud configs. Nov 4 23:20:13.676960 systemd[1]: user-cloudinit-proc-cmdline.service - Load cloud-config from url defined in /proc/cmdline was skipped because of an unmet condition check (ConditionKernelCommandLine=cloud-config-url). Nov 4 23:20:13.676995 systemd[1]: Reached target user-config.target - Load user-provided cloud configs. Nov 4 23:20:13.692633 tar[1971]: linux-arm64/LICENSE Nov 4 23:20:13.692633 tar[1971]: linux-arm64/helm Nov 4 23:20:13.735154 dbus-daemon[1936]: [system] Activating via systemd: service name='org.freedesktop.hostname1' unit='dbus-org.freedesktop.hostname1.service' requested by ':1.1' (uid=244 pid=1575 comm="/usr/lib/systemd/systemd-networkd" label="system_u:system_r:kernel_t:s0") Nov 4 23:20:13.740296 systemd[1]: Starting systemd-hostnamed.service - Hostname Service... Nov 4 23:20:13.752434 extend-filesystems[1939]: Resized partition /dev/nvme0n1p9 Nov 4 23:20:13.774750 extend-filesystems[2011]: resize2fs 1.47.3 (8-Jul-2025) Nov 4 23:20:13.779929 jq[1995]: true Nov 4 23:20:13.797653 kernel: EXT4-fs (nvme0n1p9): resizing filesystem from 1617920 to 2604027 blocks Nov 4 23:20:13.821883 systemd[1]: Finished setup-oem.service - Setup OEM. Nov 4 23:20:13.827483 update_engine[1955]: I20251104 23:20:13.826850 1955 main.cc:92] Flatcar Update Engine starting Nov 4 23:20:13.833278 systemd[1]: Started amazon-ssm-agent.service - amazon-ssm-agent. Nov 4 23:20:13.842527 update_engine[1955]: I20251104 23:20:13.839933 1955 update_check_scheduler.cc:74] Next update check in 11m23s Nov 4 23:20:13.836169 systemd[1]: Started update-engine.service - Update Engine. Nov 4 23:20:13.855539 kernel: EXT4-fs (nvme0n1p9): resized filesystem to 2604027 Nov 4 23:20:13.870220 systemd[1]: Started locksmithd.service - Cluster reboot manager. Nov 4 23:20:13.882658 extend-filesystems[2011]: Filesystem at /dev/nvme0n1p9 is mounted on /; on-line resizing required Nov 4 23:20:13.882658 extend-filesystems[2011]: old_desc_blocks = 1, new_desc_blocks = 2 Nov 4 23:20:13.882658 extend-filesystems[2011]: The filesystem on /dev/nvme0n1p9 is now 2604027 (4k) blocks long. Nov 4 23:20:13.906363 extend-filesystems[1939]: Resized filesystem in /dev/nvme0n1p9 Nov 4 23:20:13.884474 systemd[1]: extend-filesystems.service: Deactivated successfully. Nov 4 23:20:13.885634 systemd[1]: Finished extend-filesystems.service - Extend Filesystems. Nov 4 23:20:13.909775 systemd[1]: Finished coreos-metadata.service - Flatcar Metadata Agent. Nov 4 23:20:13.930783 systemd[1]: packet-phone-home.service - Report Success to Packet was skipped because no trigger condition checks were met. Nov 4 23:20:14.097345 bash[2036]: Updated "/home/core/.ssh/authorized_keys" Nov 4 23:20:14.110069 systemd[1]: Finished update-ssh-keys-after-ignition.service - Run update-ssh-keys once after Ignition. Nov 4 23:20:14.113567 systemd-logind[1953]: Watching system buttons on /dev/input/event0 (Power Button) Nov 4 23:20:14.113626 systemd-logind[1953]: Watching system buttons on /dev/input/event1 (Sleep Button) Nov 4 23:20:14.114120 systemd-logind[1953]: New seat seat0. Nov 4 23:20:14.124073 systemd[1]: Starting sshkeys.service... Nov 4 23:20:14.125857 systemd[1]: Started systemd-logind.service - User Login Management. Nov 4 23:20:14.306386 systemd[1]: Created slice system-coreos\x2dmetadata\x2dsshkeys.slice - Slice /system/coreos-metadata-sshkeys. Nov 4 23:20:14.318911 systemd[1]: Starting coreos-metadata-sshkeys@core.service - Flatcar Metadata Agent (SSH Keys)... Nov 4 23:20:14.352422 systemd[1]: Started systemd-hostnamed.service - Hostname Service. Nov 4 23:20:14.364270 dbus-daemon[1936]: [system] Successfully activated service 'org.freedesktop.hostname1' Nov 4 23:20:14.371912 dbus-daemon[1936]: [system] Activating via systemd: service name='org.freedesktop.PolicyKit1' unit='polkit.service' requested by ':1.5' (uid=0 pid=2007 comm="/usr/lib/systemd/systemd-hostnamed" label="system_u:system_r:kernel_t:s0") Nov 4 23:20:14.388279 systemd[1]: Starting polkit.service - Authorization Manager... Nov 4 23:20:14.436549 locksmithd[2018]: locksmithd starting currentOperation="UPDATE_STATUS_IDLE" strategy="reboot" Nov 4 23:20:14.449858 amazon-ssm-agent[2017]: Initializing new seelog logger Nov 4 23:20:14.450332 amazon-ssm-agent[2017]: New Seelog Logger Creation Complete Nov 4 23:20:14.450332 amazon-ssm-agent[2017]: 2025/11/04 23:20:14 Found config file at /etc/amazon/ssm/amazon-ssm-agent.json. Nov 4 23:20:14.450332 amazon-ssm-agent[2017]: Applying config override from /etc/amazon/ssm/amazon-ssm-agent.json. Nov 4 23:20:14.458154 amazon-ssm-agent[2017]: 2025/11/04 23:20:14 processing appconfig overrides Nov 4 23:20:14.458893 amazon-ssm-agent[2017]: 2025/11/04 23:20:14 Found config file at /etc/amazon/ssm/amazon-ssm-agent.json. Nov 4 23:20:14.458893 amazon-ssm-agent[2017]: Applying config override from /etc/amazon/ssm/amazon-ssm-agent.json. Nov 4 23:20:14.459016 amazon-ssm-agent[2017]: 2025/11/04 23:20:14 processing appconfig overrides Nov 4 23:20:14.459658 amazon-ssm-agent[2017]: 2025/11/04 23:20:14 Found config file at /etc/amazon/ssm/amazon-ssm-agent.json. Nov 4 23:20:14.459658 amazon-ssm-agent[2017]: Applying config override from /etc/amazon/ssm/amazon-ssm-agent.json. Nov 4 23:20:14.459658 amazon-ssm-agent[2017]: 2025/11/04 23:20:14 processing appconfig overrides Nov 4 23:20:14.466482 amazon-ssm-agent[2017]: 2025-11-04 23:20:14.4585 INFO Proxy environment variables: Nov 4 23:20:14.472661 amazon-ssm-agent[2017]: 2025/11/04 23:20:14 Found config file at /etc/amazon/ssm/amazon-ssm-agent.json. Nov 4 23:20:14.472661 amazon-ssm-agent[2017]: Applying config override from /etc/amazon/ssm/amazon-ssm-agent.json. Nov 4 23:20:14.472661 amazon-ssm-agent[2017]: 2025/11/04 23:20:14 processing appconfig overrides Nov 4 23:20:14.591215 amazon-ssm-agent[2017]: 2025-11-04 23:20:14.4585 INFO https_proxy: Nov 4 23:20:14.670923 containerd[1974]: time="2025-11-04T23:20:14Z" level=warning msg="Ignoring unknown key in TOML" column=1 error="strict mode: fields in the document are missing in the target struct" file=/usr/share/containerd/config.toml key=subreaper row=8 Nov 4 23:20:14.677706 containerd[1974]: time="2025-11-04T23:20:14.673381987Z" level=info msg="starting containerd" revision=fb4c30d4ede3531652d86197bf3fc9515e5276d9 version=v2.0.5 Nov 4 23:20:14.693641 amazon-ssm-agent[2017]: 2025-11-04 23:20:14.4585 INFO http_proxy: Nov 4 23:20:14.734138 containerd[1974]: time="2025-11-04T23:20:14.733712491Z" level=warning msg="Configuration migrated from version 2, use `containerd config migrate` to avoid migration" t="16.356µs" Nov 4 23:20:14.734138 containerd[1974]: time="2025-11-04T23:20:14.733779895Z" level=info msg="loading plugin" id=io.containerd.image-verifier.v1.bindir type=io.containerd.image-verifier.v1 Nov 4 23:20:14.734138 containerd[1974]: time="2025-11-04T23:20:14.733819963Z" level=info msg="loading plugin" id=io.containerd.internal.v1.opt type=io.containerd.internal.v1 Nov 4 23:20:14.734138 containerd[1974]: time="2025-11-04T23:20:14.734108839Z" level=info msg="loading plugin" id=io.containerd.warning.v1.deprecations type=io.containerd.warning.v1 Nov 4 23:20:14.734138 containerd[1974]: time="2025-11-04T23:20:14.734140975Z" level=info msg="loading plugin" id=io.containerd.content.v1.content type=io.containerd.content.v1 Nov 4 23:20:14.734432 containerd[1974]: time="2025-11-04T23:20:14.734190103Z" level=info msg="loading plugin" id=io.containerd.snapshotter.v1.blockfile type=io.containerd.snapshotter.v1 Nov 4 23:20:14.734432 containerd[1974]: time="2025-11-04T23:20:14.734308147Z" level=info msg="skip loading plugin" error="no scratch file generator: skip plugin" id=io.containerd.snapshotter.v1.blockfile type=io.containerd.snapshotter.v1 Nov 4 23:20:14.734432 containerd[1974]: time="2025-11-04T23:20:14.734355439Z" level=info msg="loading plugin" id=io.containerd.snapshotter.v1.btrfs type=io.containerd.snapshotter.v1 Nov 4 23:20:14.735878 containerd[1974]: time="2025-11-04T23:20:14.735779311Z" level=info msg="skip loading plugin" error="path /var/lib/containerd/io.containerd.snapshotter.v1.btrfs (ext4) must be a btrfs filesystem to be used with the btrfs snapshotter: skip plugin" id=io.containerd.snapshotter.v1.btrfs type=io.containerd.snapshotter.v1 Nov 4 23:20:14.735878 containerd[1974]: time="2025-11-04T23:20:14.735867811Z" level=info msg="loading plugin" id=io.containerd.snapshotter.v1.devmapper type=io.containerd.snapshotter.v1 Nov 4 23:20:14.736023 containerd[1974]: time="2025-11-04T23:20:14.735906487Z" level=info msg="skip loading plugin" error="devmapper not configured: skip plugin" id=io.containerd.snapshotter.v1.devmapper type=io.containerd.snapshotter.v1 Nov 4 23:20:14.736023 containerd[1974]: time="2025-11-04T23:20:14.735929275Z" level=info msg="loading plugin" id=io.containerd.snapshotter.v1.native type=io.containerd.snapshotter.v1 Nov 4 23:20:14.736191 containerd[1974]: time="2025-11-04T23:20:14.736147375Z" level=info msg="loading plugin" id=io.containerd.snapshotter.v1.overlayfs type=io.containerd.snapshotter.v1 Nov 4 23:20:14.740637 containerd[1974]: time="2025-11-04T23:20:14.738017023Z" level=info msg="loading plugin" id=io.containerd.snapshotter.v1.zfs type=io.containerd.snapshotter.v1 Nov 4 23:20:14.740637 containerd[1974]: time="2025-11-04T23:20:14.738114511Z" level=info msg="skip loading plugin" error="lstat /var/lib/containerd/io.containerd.snapshotter.v1.zfs: no such file or directory: skip plugin" id=io.containerd.snapshotter.v1.zfs type=io.containerd.snapshotter.v1 Nov 4 23:20:14.740637 containerd[1974]: time="2025-11-04T23:20:14.738141247Z" level=info msg="loading plugin" id=io.containerd.event.v1.exchange type=io.containerd.event.v1 Nov 4 23:20:14.740637 containerd[1974]: time="2025-11-04T23:20:14.739668439Z" level=info msg="loading plugin" id=io.containerd.monitor.task.v1.cgroups type=io.containerd.monitor.task.v1 Nov 4 23:20:14.746788 containerd[1974]: time="2025-11-04T23:20:14.741972019Z" level=info msg="loading plugin" id=io.containerd.metadata.v1.bolt type=io.containerd.metadata.v1 Nov 4 23:20:14.746788 containerd[1974]: time="2025-11-04T23:20:14.742150543Z" level=info msg="metadata content store policy set" policy=shared Nov 4 23:20:14.756679 containerd[1974]: time="2025-11-04T23:20:14.755289067Z" level=info msg="loading plugin" id=io.containerd.gc.v1.scheduler type=io.containerd.gc.v1 Nov 4 23:20:14.756679 containerd[1974]: time="2025-11-04T23:20:14.755397823Z" level=info msg="loading plugin" id=io.containerd.differ.v1.walking type=io.containerd.differ.v1 Nov 4 23:20:14.756679 containerd[1974]: time="2025-11-04T23:20:14.755454595Z" level=info msg="loading plugin" id=io.containerd.lease.v1.manager type=io.containerd.lease.v1 Nov 4 23:20:14.756679 containerd[1974]: time="2025-11-04T23:20:14.755493055Z" level=info msg="loading plugin" id=io.containerd.service.v1.containers-service type=io.containerd.service.v1 Nov 4 23:20:14.756679 containerd[1974]: time="2025-11-04T23:20:14.755523571Z" level=info msg="loading plugin" id=io.containerd.service.v1.content-service type=io.containerd.service.v1 Nov 4 23:20:14.756679 containerd[1974]: time="2025-11-04T23:20:14.755561383Z" level=info msg="loading plugin" id=io.containerd.service.v1.diff-service type=io.containerd.service.v1 Nov 4 23:20:14.756679 containerd[1974]: time="2025-11-04T23:20:14.755590663Z" level=info msg="loading plugin" id=io.containerd.service.v1.images-service type=io.containerd.service.v1 Nov 4 23:20:14.756679 containerd[1974]: time="2025-11-04T23:20:14.755640271Z" level=info msg="loading plugin" id=io.containerd.service.v1.introspection-service type=io.containerd.service.v1 Nov 4 23:20:14.756679 containerd[1974]: time="2025-11-04T23:20:14.755672515Z" level=info msg="loading plugin" id=io.containerd.service.v1.namespaces-service type=io.containerd.service.v1 Nov 4 23:20:14.756679 containerd[1974]: time="2025-11-04T23:20:14.755701123Z" level=info msg="loading plugin" id=io.containerd.service.v1.snapshots-service type=io.containerd.service.v1 Nov 4 23:20:14.756679 containerd[1974]: time="2025-11-04T23:20:14.755724667Z" level=info msg="loading plugin" id=io.containerd.shim.v1.manager type=io.containerd.shim.v1 Nov 4 23:20:14.756679 containerd[1974]: time="2025-11-04T23:20:14.755757283Z" level=info msg="loading plugin" id=io.containerd.runtime.v2.task type=io.containerd.runtime.v2 Nov 4 23:20:14.756679 containerd[1974]: time="2025-11-04T23:20:14.756007987Z" level=info msg="loading plugin" id=io.containerd.service.v1.tasks-service type=io.containerd.service.v1 Nov 4 23:20:14.756679 containerd[1974]: time="2025-11-04T23:20:14.756058303Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.containers type=io.containerd.grpc.v1 Nov 4 23:20:14.757363 containerd[1974]: time="2025-11-04T23:20:14.756093787Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.content type=io.containerd.grpc.v1 Nov 4 23:20:14.757363 containerd[1974]: time="2025-11-04T23:20:14.756120931Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.diff type=io.containerd.grpc.v1 Nov 4 23:20:14.757363 containerd[1974]: time="2025-11-04T23:20:14.756147847Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.events type=io.containerd.grpc.v1 Nov 4 23:20:14.757363 containerd[1974]: time="2025-11-04T23:20:14.756174103Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.images type=io.containerd.grpc.v1 Nov 4 23:20:14.757363 containerd[1974]: time="2025-11-04T23:20:14.756200803Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.introspection type=io.containerd.grpc.v1 Nov 4 23:20:14.757363 containerd[1974]: time="2025-11-04T23:20:14.756225679Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.leases type=io.containerd.grpc.v1 Nov 4 23:20:14.757363 containerd[1974]: time="2025-11-04T23:20:14.756252211Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.namespaces type=io.containerd.grpc.v1 Nov 4 23:20:14.757363 containerd[1974]: time="2025-11-04T23:20:14.756277027Z" level=info msg="loading plugin" id=io.containerd.sandbox.store.v1.local type=io.containerd.sandbox.store.v1 Nov 4 23:20:14.757363 containerd[1974]: time="2025-11-04T23:20:14.756302599Z" level=info msg="loading plugin" id=io.containerd.cri.v1.images type=io.containerd.cri.v1 Nov 4 23:20:14.762405 containerd[1974]: time="2025-11-04T23:20:14.761280091Z" level=info msg="Get image filesystem path \"/var/lib/containerd/io.containerd.snapshotter.v1.overlayfs\" for snapshotter \"overlayfs\"" Nov 4 23:20:14.762405 containerd[1974]: time="2025-11-04T23:20:14.761348587Z" level=info msg="Start snapshots syncer" Nov 4 23:20:14.762405 containerd[1974]: time="2025-11-04T23:20:14.761395327Z" level=info msg="loading plugin" id=io.containerd.cri.v1.runtime type=io.containerd.cri.v1 Nov 4 23:20:14.765818 containerd[1974]: time="2025-11-04T23:20:14.763902607Z" level=info msg="starting cri plugin" config="{\"containerd\":{\"defaultRuntimeName\":\"runc\",\"runtimes\":{\"runc\":{\"runtimeType\":\"io.containerd.runc.v2\",\"runtimePath\":\"\",\"PodAnnotations\":null,\"ContainerAnnotations\":null,\"options\":{\"BinaryName\":\"\",\"CriuImagePath\":\"\",\"CriuWorkPath\":\"\",\"IoGid\":0,\"IoUid\":0,\"NoNewKeyring\":false,\"Root\":\"\",\"ShimCgroup\":\"\",\"SystemdCgroup\":true},\"privileged_without_host_devices\":false,\"privileged_without_host_devices_all_devices_allowed\":false,\"baseRuntimeSpec\":\"\",\"cniConfDir\":\"\",\"cniMaxConfNum\":0,\"snapshotter\":\"\",\"sandboxer\":\"podsandbox\",\"io_type\":\"\"}},\"ignoreBlockIONotEnabledErrors\":false,\"ignoreRdtNotEnabledErrors\":false},\"cni\":{\"binDir\":\"/opt/cni/bin\",\"confDir\":\"/etc/cni/net.d\",\"maxConfNum\":1,\"setupSerially\":false,\"confTemplate\":\"\",\"ipPref\":\"\",\"useInternalLoopback\":false},\"enableSelinux\":true,\"selinuxCategoryRange\":1024,\"maxContainerLogSize\":16384,\"disableApparmor\":false,\"restrictOOMScoreAdj\":false,\"disableProcMount\":false,\"unsetSeccompProfile\":\"\",\"tolerateMissingHugetlbController\":true,\"disableHugetlbController\":true,\"device_ownership_from_security_context\":false,\"ignoreImageDefinedVolumes\":false,\"netnsMountsUnderStateDir\":false,\"enableUnprivilegedPorts\":true,\"enableUnprivilegedICMP\":true,\"enableCDI\":true,\"cdiSpecDirs\":[\"/etc/cdi\",\"/var/run/cdi\"],\"drainExecSyncIOTimeout\":\"0s\",\"ignoreDeprecationWarnings\":null,\"containerdRootDir\":\"/var/lib/containerd\",\"containerdEndpoint\":\"/run/containerd/containerd.sock\",\"rootDir\":\"/var/lib/containerd/io.containerd.grpc.v1.cri\",\"stateDir\":\"/run/containerd/io.containerd.grpc.v1.cri\"}" Nov 4 23:20:14.765818 containerd[1974]: time="2025-11-04T23:20:14.764021095Z" level=info msg="loading plugin" id=io.containerd.podsandbox.controller.v1.podsandbox type=io.containerd.podsandbox.controller.v1 Nov 4 23:20:14.766095 containerd[1974]: time="2025-11-04T23:20:14.764185975Z" level=info msg="loading plugin" id=io.containerd.sandbox.controller.v1.shim type=io.containerd.sandbox.controller.v1 Nov 4 23:20:14.766095 containerd[1974]: time="2025-11-04T23:20:14.764392687Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.sandbox-controllers type=io.containerd.grpc.v1 Nov 4 23:20:14.766095 containerd[1974]: time="2025-11-04T23:20:14.764433307Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.sandboxes type=io.containerd.grpc.v1 Nov 4 23:20:14.766095 containerd[1974]: time="2025-11-04T23:20:14.764460259Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.snapshots type=io.containerd.grpc.v1 Nov 4 23:20:14.766095 containerd[1974]: time="2025-11-04T23:20:14.764489263Z" level=info msg="loading plugin" id=io.containerd.streaming.v1.manager type=io.containerd.streaming.v1 Nov 4 23:20:14.766095 containerd[1974]: time="2025-11-04T23:20:14.764517595Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.streaming type=io.containerd.grpc.v1 Nov 4 23:20:14.766095 containerd[1974]: time="2025-11-04T23:20:14.764544103Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.tasks type=io.containerd.grpc.v1 Nov 4 23:20:14.766095 containerd[1974]: time="2025-11-04T23:20:14.764571367Z" level=info msg="loading plugin" id=io.containerd.transfer.v1.local type=io.containerd.transfer.v1 Nov 4 23:20:14.774722 containerd[1974]: time="2025-11-04T23:20:14.773343775Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.transfer type=io.containerd.grpc.v1 Nov 4 23:20:14.774722 containerd[1974]: time="2025-11-04T23:20:14.773463163Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.version type=io.containerd.grpc.v1 Nov 4 23:20:14.774722 containerd[1974]: time="2025-11-04T23:20:14.773526115Z" level=info msg="loading plugin" id=io.containerd.monitor.container.v1.restart type=io.containerd.monitor.container.v1 Nov 4 23:20:14.774722 containerd[1974]: time="2025-11-04T23:20:14.773888947Z" level=info msg="loading plugin" id=io.containerd.tracing.processor.v1.otlp type=io.containerd.tracing.processor.v1 Nov 4 23:20:14.775590 coreos-metadata[2065]: Nov 04 23:20:14.774 INFO Putting http://169.254.169.254/latest/api/token: Attempt #1 Nov 4 23:20:14.776083 containerd[1974]: time="2025-11-04T23:20:14.774677407Z" level=info msg="skip loading plugin" error="skip plugin: tracing endpoint not configured" id=io.containerd.tracing.processor.v1.otlp type=io.containerd.tracing.processor.v1 Nov 4 23:20:14.776083 containerd[1974]: time="2025-11-04T23:20:14.775449427Z" level=info msg="loading plugin" id=io.containerd.internal.v1.tracing type=io.containerd.internal.v1 Nov 4 23:20:14.776083 containerd[1974]: time="2025-11-04T23:20:14.775514203Z" level=info msg="skip loading plugin" error="skip plugin: tracing endpoint not configured" id=io.containerd.internal.v1.tracing type=io.containerd.internal.v1 Nov 4 23:20:14.776083 containerd[1974]: time="2025-11-04T23:20:14.775539559Z" level=info msg="loading plugin" id=io.containerd.ttrpc.v1.otelttrpc type=io.containerd.ttrpc.v1 Nov 4 23:20:14.778634 containerd[1974]: time="2025-11-04T23:20:14.776301427Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.healthcheck type=io.containerd.grpc.v1 Nov 4 23:20:14.779426 containerd[1974]: time="2025-11-04T23:20:14.778827043Z" level=info msg="loading plugin" id=io.containerd.nri.v1.nri type=io.containerd.nri.v1 Nov 4 23:20:14.779426 containerd[1974]: time="2025-11-04T23:20:14.779078455Z" level=info msg="runtime interface created" Nov 4 23:20:14.779426 containerd[1974]: time="2025-11-04T23:20:14.779097583Z" level=info msg="created NRI interface" Nov 4 23:20:14.779426 containerd[1974]: time="2025-11-04T23:20:14.779129527Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.cri type=io.containerd.grpc.v1 Nov 4 23:20:14.779426 containerd[1974]: time="2025-11-04T23:20:14.779187619Z" level=info msg="Connect containerd service" Nov 4 23:20:14.779426 containerd[1974]: time="2025-11-04T23:20:14.779292787Z" level=info msg="using experimental NRI integration - disable nri plugin to prevent this" Nov 4 23:20:14.788266 coreos-metadata[2065]: Nov 04 23:20:14.787 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/public-keys: Attempt #1 Nov 4 23:20:14.788868 containerd[1974]: time="2025-11-04T23:20:14.788668879Z" level=error msg="failed to load cni during init, please check CRI plugin status before setting up network for pods" error="cni config load failed: no network config found in /etc/cni/net.d: cni plugin not initialized: failed to load cni config" Nov 4 23:20:14.791910 amazon-ssm-agent[2017]: 2025-11-04 23:20:14.4585 INFO no_proxy: Nov 4 23:20:14.792096 coreos-metadata[2065]: Nov 04 23:20:14.791 INFO Fetch successful Nov 4 23:20:14.792096 coreos-metadata[2065]: Nov 04 23:20:14.791 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/public-keys/0/openssh-key: Attempt #1 Nov 4 23:20:14.798058 coreos-metadata[2065]: Nov 04 23:20:14.794 INFO Fetch successful Nov 4 23:20:14.800224 unknown[2065]: wrote ssh authorized keys file for user: core Nov 4 23:20:14.893670 amazon-ssm-agent[2017]: 2025-11-04 23:20:14.4590 INFO Checking if agent identity type OnPrem can be assumed Nov 4 23:20:14.909455 update-ssh-keys[2131]: Updated "/home/core/.ssh/authorized_keys" Nov 4 23:20:14.912701 systemd[1]: Finished coreos-metadata-sshkeys@core.service - Flatcar Metadata Agent (SSH Keys). Nov 4 23:20:14.924758 systemd[1]: Finished sshkeys.service. Nov 4 23:20:14.994492 amazon-ssm-agent[2017]: 2025-11-04 23:20:14.4591 INFO Checking if agent identity type EC2 can be assumed Nov 4 23:20:15.071399 polkitd[2066]: Started polkitd version 126 Nov 4 23:20:15.096145 amazon-ssm-agent[2017]: 2025-11-04 23:20:14.7618 INFO Agent will take identity from EC2 Nov 4 23:20:15.170635 polkitd[2066]: Loading rules from directory /etc/polkit-1/rules.d Nov 4 23:20:15.171238 polkitd[2066]: Loading rules from directory /run/polkit-1/rules.d Nov 4 23:20:15.171314 polkitd[2066]: Error opening rules directory: Error opening directory “/run/polkit-1/rules.d”: No such file or directory (g-file-error-quark, 4) Nov 4 23:20:15.175272 polkitd[2066]: Loading rules from directory /usr/local/share/polkit-1/rules.d Nov 4 23:20:15.175362 polkitd[2066]: Error opening rules directory: Error opening directory “/usr/local/share/polkit-1/rules.d”: No such file or directory (g-file-error-quark, 4) Nov 4 23:20:15.175444 polkitd[2066]: Loading rules from directory /usr/share/polkit-1/rules.d Nov 4 23:20:15.181341 polkitd[2066]: Finished loading, compiling and executing 2 rules Nov 4 23:20:15.184004 systemd[1]: Started polkit.service - Authorization Manager. Nov 4 23:20:15.196782 amazon-ssm-agent[2017]: 2025-11-04 23:20:14.7699 INFO [amazon-ssm-agent] amazon-ssm-agent - v3.3.0.0 Nov 4 23:20:15.198658 containerd[1974]: time="2025-11-04T23:20:15.197744885Z" level=info msg="Start subscribing containerd event" Nov 4 23:20:15.198658 containerd[1974]: time="2025-11-04T23:20:15.197899769Z" level=info msg="Start recovering state" Nov 4 23:20:15.198658 containerd[1974]: time="2025-11-04T23:20:15.198096485Z" level=info msg="Start event monitor" Nov 4 23:20:15.198658 containerd[1974]: time="2025-11-04T23:20:15.198122465Z" level=info msg="Start cni network conf syncer for default" Nov 4 23:20:15.198658 containerd[1974]: time="2025-11-04T23:20:15.198140105Z" level=info msg="Start streaming server" Nov 4 23:20:15.198658 containerd[1974]: time="2025-11-04T23:20:15.198188645Z" level=info msg="Registered namespace \"k8s.io\" with NRI" Nov 4 23:20:15.198658 containerd[1974]: time="2025-11-04T23:20:15.198206249Z" level=info msg="runtime interface starting up..." Nov 4 23:20:15.198658 containerd[1974]: time="2025-11-04T23:20:15.198220745Z" level=info msg="starting plugins..." Nov 4 23:20:15.198658 containerd[1974]: time="2025-11-04T23:20:15.198272801Z" level=info msg="Synchronizing NRI (plugin) with current runtime state" Nov 4 23:20:15.204951 containerd[1974]: time="2025-11-04T23:20:15.202894637Z" level=info msg=serving... address=/run/containerd/containerd.sock.ttrpc Nov 4 23:20:15.205441 dbus-daemon[1936]: [system] Successfully activated service 'org.freedesktop.PolicyKit1' Nov 4 23:20:15.215023 polkitd[2066]: Acquired the name org.freedesktop.PolicyKit1 on the system bus Nov 4 23:20:15.218861 containerd[1974]: time="2025-11-04T23:20:15.215913209Z" level=info msg=serving... address=/run/containerd/containerd.sock Nov 4 23:20:15.231134 containerd[1974]: time="2025-11-04T23:20:15.228355769Z" level=info msg="containerd successfully booted in 0.562136s" Nov 4 23:20:15.228513 systemd[1]: Started containerd.service - containerd container runtime. Nov 4 23:20:15.300627 amazon-ssm-agent[2017]: 2025-11-04 23:20:14.7699 INFO [amazon-ssm-agent] OS: linux, Arch: arm64 Nov 4 23:20:15.399386 amazon-ssm-agent[2017]: 2025-11-04 23:20:14.7699 INFO [amazon-ssm-agent] Starting Core Agent Nov 4 23:20:15.443458 systemd-hostnamed[2007]: Hostname set to (transient) Nov 4 23:20:15.444549 systemd-resolved[1551]: System hostname changed to 'ip-172-31-23-127'. Nov 4 23:20:15.499504 amazon-ssm-agent[2017]: 2025-11-04 23:20:14.7699 INFO [amazon-ssm-agent] Registrar detected. Attempting registration Nov 4 23:20:15.551116 sshd_keygen[1962]: ssh-keygen: generating new host keys: RSA ECDSA ED25519 Nov 4 23:20:15.599731 amazon-ssm-agent[2017]: 2025-11-04 23:20:14.7699 INFO [Registrar] Starting registrar module Nov 4 23:20:15.657414 systemd[1]: Finished sshd-keygen.service - Generate sshd host keys. Nov 4 23:20:15.665044 systemd[1]: Starting issuegen.service - Generate /run/issue... Nov 4 23:20:15.700070 amazon-ssm-agent[2017]: 2025-11-04 23:20:14.7777 INFO [EC2Identity] Checking disk for registration info Nov 4 23:20:15.708306 tar[1971]: linux-arm64/README.md Nov 4 23:20:15.709323 systemd[1]: issuegen.service: Deactivated successfully. Nov 4 23:20:15.709856 systemd[1]: Finished issuegen.service - Generate /run/issue. Nov 4 23:20:15.725302 systemd[1]: Starting systemd-user-sessions.service - Permit User Sessions... Nov 4 23:20:15.752838 systemd[1]: Finished prepare-helm.service - Unpack helm to /opt/bin. Nov 4 23:20:15.766683 systemd[1]: Finished systemd-user-sessions.service - Permit User Sessions. Nov 4 23:20:15.773809 systemd[1]: Started getty@tty1.service - Getty on tty1. Nov 4 23:20:15.783305 systemd[1]: Started serial-getty@ttyS0.service - Serial Getty on ttyS0. Nov 4 23:20:15.786251 systemd[1]: Reached target getty.target - Login Prompts. Nov 4 23:20:15.801795 amazon-ssm-agent[2017]: 2025-11-04 23:20:14.7778 INFO [EC2Identity] No registration info found for ec2 instance, attempting registration Nov 4 23:20:15.902240 amazon-ssm-agent[2017]: 2025-11-04 23:20:14.7778 INFO [EC2Identity] Generating registration keypair Nov 4 23:20:15.968221 amazon-ssm-agent[2017]: 2025/11/04 23:20:15 Found config file at /etc/amazon/ssm/amazon-ssm-agent.json. Nov 4 23:20:15.969664 amazon-ssm-agent[2017]: Applying config override from /etc/amazon/ssm/amazon-ssm-agent.json. Nov 4 23:20:15.969664 amazon-ssm-agent[2017]: 2025/11/04 23:20:15 processing appconfig overrides Nov 4 23:20:16.003736 amazon-ssm-agent[2017]: 2025-11-04 23:20:15.9220 INFO [EC2Identity] Checking write access before registering Nov 4 23:20:16.005488 amazon-ssm-agent[2017]: 2025-11-04 23:20:15.9227 INFO [EC2Identity] Registering EC2 instance with Systems Manager Nov 4 23:20:16.005683 amazon-ssm-agent[2017]: 2025-11-04 23:20:15.9679 INFO [EC2Identity] EC2 registration was successful. Nov 4 23:20:16.005778 amazon-ssm-agent[2017]: 2025-11-04 23:20:15.9679 INFO [amazon-ssm-agent] Registration attempted. Resuming core agent startup. Nov 4 23:20:16.006065 amazon-ssm-agent[2017]: 2025-11-04 23:20:15.9680 INFO [CredentialRefresher] credentialRefresher has started Nov 4 23:20:16.006065 amazon-ssm-agent[2017]: 2025-11-04 23:20:15.9680 INFO [CredentialRefresher] Starting credentials refresher loop Nov 4 23:20:16.006065 amazon-ssm-agent[2017]: 2025-11-04 23:20:16.0051 INFO EC2RoleProvider Successfully connected with instance profile role credentials Nov 4 23:20:16.006065 amazon-ssm-agent[2017]: 2025-11-04 23:20:16.0053 INFO [CredentialRefresher] Credentials ready Nov 4 23:20:16.103910 amazon-ssm-agent[2017]: 2025-11-04 23:20:16.0059 INFO [CredentialRefresher] Next credential rotation will be in 29.9999860385 minutes Nov 4 23:20:17.034006 amazon-ssm-agent[2017]: 2025-11-04 23:20:17.0338 INFO [amazon-ssm-agent] [LongRunningWorkerContainer] [WorkerProvider] Worker ssm-agent-worker is not running, starting worker process Nov 4 23:20:17.135366 amazon-ssm-agent[2017]: 2025-11-04 23:20:17.0747 INFO [amazon-ssm-agent] [LongRunningWorkerContainer] [WorkerProvider] Worker ssm-agent-worker (pid:2212) started Nov 4 23:20:17.235782 amazon-ssm-agent[2017]: 2025-11-04 23:20:17.0747 INFO [amazon-ssm-agent] [LongRunningWorkerContainer] Monitor long running worker health every 60 seconds Nov 4 23:20:18.205014 systemd[1]: Started kubelet.service - kubelet: The Kubernetes Node Agent. Nov 4 23:20:18.208854 systemd[1]: Reached target multi-user.target - Multi-User System. Nov 4 23:20:18.213769 systemd[1]: Startup finished in 3.614s (kernel) + 12.029s (initrd) + 12.256s (userspace) = 27.900s. Nov 4 23:20:18.227097 (kubelet)[2228]: kubelet.service: Referenced but unset environment variable evaluates to an empty string: KUBELET_EXTRA_ARGS, KUBELET_KUBEADM_ARGS Nov 4 23:20:20.180283 kubelet[2228]: E1104 23:20:20.180194 2228 run.go:72] "command failed" err="failed to load kubelet config file, path: /var/lib/kubelet/config.yaml, error: failed to load Kubelet config file /var/lib/kubelet/config.yaml, error failed to read kubelet config file \"/var/lib/kubelet/config.yaml\", error: open /var/lib/kubelet/config.yaml: no such file or directory" Nov 4 23:20:20.184746 systemd[1]: kubelet.service: Main process exited, code=exited, status=1/FAILURE Nov 4 23:20:20.185056 systemd[1]: kubelet.service: Failed with result 'exit-code'. Nov 4 23:20:20.185987 systemd[1]: kubelet.service: Consumed 1.464s CPU time, 260.5M memory peak. Nov 4 23:20:20.761859 systemd-resolved[1551]: Clock change detected. Flushing caches. Nov 4 23:20:21.548025 systemd[1]: Created slice system-sshd.slice - Slice /system/sshd. Nov 4 23:20:21.550632 systemd[1]: Started sshd@0-172.31.23.127:22-139.178.89.65:38212.service - OpenSSH per-connection server daemon (139.178.89.65:38212). Nov 4 23:20:21.777555 sshd[2240]: Accepted publickey for core from 139.178.89.65 port 38212 ssh2: RSA SHA256:hDiwkCWvCQBqijfvK1jv0H0YtRR2s7jf/pLBmZjqWNg Nov 4 23:20:21.781248 sshd-session[2240]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 4 23:20:21.807018 systemd-logind[1953]: New session 1 of user core. Nov 4 23:20:21.808209 systemd[1]: Created slice user-500.slice - User Slice of UID 500. Nov 4 23:20:21.811215 systemd[1]: Starting user-runtime-dir@500.service - User Runtime Directory /run/user/500... Nov 4 23:20:21.845999 systemd[1]: Finished user-runtime-dir@500.service - User Runtime Directory /run/user/500. Nov 4 23:20:21.850745 systemd[1]: Starting user@500.service - User Manager for UID 500... Nov 4 23:20:21.870040 (systemd)[2245]: pam_unix(systemd-user:session): session opened for user core(uid=500) by (uid=0) Nov 4 23:20:21.874313 systemd-logind[1953]: New session c1 of user core. Nov 4 23:20:22.143896 systemd[2245]: Queued start job for default target default.target. Nov 4 23:20:22.156195 systemd[2245]: Created slice app.slice - User Application Slice. Nov 4 23:20:22.156261 systemd[2245]: Reached target paths.target - Paths. Nov 4 23:20:22.156349 systemd[2245]: Reached target timers.target - Timers. Nov 4 23:20:22.158655 systemd[2245]: Starting dbus.socket - D-Bus User Message Bus Socket... Nov 4 23:20:22.179138 systemd[2245]: Listening on dbus.socket - D-Bus User Message Bus Socket. Nov 4 23:20:22.179401 systemd[2245]: Reached target sockets.target - Sockets. Nov 4 23:20:22.179483 systemd[2245]: Reached target basic.target - Basic System. Nov 4 23:20:22.179564 systemd[2245]: Reached target default.target - Main User Target. Nov 4 23:20:22.179626 systemd[2245]: Startup finished in 293ms. Nov 4 23:20:22.180002 systemd[1]: Started user@500.service - User Manager for UID 500. Nov 4 23:20:22.189173 systemd[1]: Started session-1.scope - Session 1 of User core. Nov 4 23:20:22.347199 systemd[1]: Started sshd@1-172.31.23.127:22-139.178.89.65:38226.service - OpenSSH per-connection server daemon (139.178.89.65:38226). Nov 4 23:20:22.558720 sshd[2256]: Accepted publickey for core from 139.178.89.65 port 38226 ssh2: RSA SHA256:hDiwkCWvCQBqijfvK1jv0H0YtRR2s7jf/pLBmZjqWNg Nov 4 23:20:22.560982 sshd-session[2256]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 4 23:20:22.568957 systemd-logind[1953]: New session 2 of user core. Nov 4 23:20:22.578181 systemd[1]: Started session-2.scope - Session 2 of User core. Nov 4 23:20:22.706994 sshd[2259]: Connection closed by 139.178.89.65 port 38226 Nov 4 23:20:22.707799 sshd-session[2256]: pam_unix(sshd:session): session closed for user core Nov 4 23:20:22.714695 systemd[1]: sshd@1-172.31.23.127:22-139.178.89.65:38226.service: Deactivated successfully. Nov 4 23:20:22.720365 systemd[1]: session-2.scope: Deactivated successfully. Nov 4 23:20:22.723670 systemd-logind[1953]: Session 2 logged out. Waiting for processes to exit. Nov 4 23:20:22.726237 systemd-logind[1953]: Removed session 2. Nov 4 23:20:22.743394 systemd[1]: Started sshd@2-172.31.23.127:22-139.178.89.65:38242.service - OpenSSH per-connection server daemon (139.178.89.65:38242). Nov 4 23:20:22.941901 sshd[2265]: Accepted publickey for core from 139.178.89.65 port 38242 ssh2: RSA SHA256:hDiwkCWvCQBqijfvK1jv0H0YtRR2s7jf/pLBmZjqWNg Nov 4 23:20:22.944233 sshd-session[2265]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 4 23:20:22.952174 systemd-logind[1953]: New session 3 of user core. Nov 4 23:20:22.961159 systemd[1]: Started session-3.scope - Session 3 of User core. Nov 4 23:20:23.079980 sshd[2268]: Connection closed by 139.178.89.65 port 38242 Nov 4 23:20:23.080759 sshd-session[2265]: pam_unix(sshd:session): session closed for user core Nov 4 23:20:23.089373 systemd[1]: sshd@2-172.31.23.127:22-139.178.89.65:38242.service: Deactivated successfully. Nov 4 23:20:23.095970 systemd[1]: session-3.scope: Deactivated successfully. Nov 4 23:20:23.098048 systemd-logind[1953]: Session 3 logged out. Waiting for processes to exit. Nov 4 23:20:23.100673 systemd-logind[1953]: Removed session 3. Nov 4 23:20:23.115007 systemd[1]: Started sshd@3-172.31.23.127:22-139.178.89.65:38246.service - OpenSSH per-connection server daemon (139.178.89.65:38246). Nov 4 23:20:23.320835 sshd[2274]: Accepted publickey for core from 139.178.89.65 port 38246 ssh2: RSA SHA256:hDiwkCWvCQBqijfvK1jv0H0YtRR2s7jf/pLBmZjqWNg Nov 4 23:20:23.323504 sshd-session[2274]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 4 23:20:23.332029 systemd-logind[1953]: New session 4 of user core. Nov 4 23:20:23.339261 systemd[1]: Started session-4.scope - Session 4 of User core. Nov 4 23:20:23.464721 sshd[2277]: Connection closed by 139.178.89.65 port 38246 Nov 4 23:20:23.465575 sshd-session[2274]: pam_unix(sshd:session): session closed for user core Nov 4 23:20:23.471868 systemd-logind[1953]: Session 4 logged out. Waiting for processes to exit. Nov 4 23:20:23.472380 systemd[1]: sshd@3-172.31.23.127:22-139.178.89.65:38246.service: Deactivated successfully. Nov 4 23:20:23.475020 systemd[1]: session-4.scope: Deactivated successfully. Nov 4 23:20:23.479432 systemd-logind[1953]: Removed session 4. Nov 4 23:20:23.507478 systemd[1]: Started sshd@4-172.31.23.127:22-139.178.89.65:38250.service - OpenSSH per-connection server daemon (139.178.89.65:38250). Nov 4 23:20:23.719296 sshd[2283]: Accepted publickey for core from 139.178.89.65 port 38250 ssh2: RSA SHA256:hDiwkCWvCQBqijfvK1jv0H0YtRR2s7jf/pLBmZjqWNg Nov 4 23:20:23.721513 sshd-session[2283]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 4 23:20:23.729635 systemd-logind[1953]: New session 5 of user core. Nov 4 23:20:23.738207 systemd[1]: Started session-5.scope - Session 5 of User core. Nov 4 23:20:23.860300 sudo[2287]: core : PWD=/home/core ; USER=root ; COMMAND=/usr/sbin/setenforce 1 Nov 4 23:20:23.860893 sudo[2287]: pam_unix(sudo:session): session opened for user root(uid=0) by core(uid=500) Nov 4 23:20:23.879820 sudo[2287]: pam_unix(sudo:session): session closed for user root Nov 4 23:20:23.904622 sshd[2286]: Connection closed by 139.178.89.65 port 38250 Nov 4 23:20:23.905322 sshd-session[2283]: pam_unix(sshd:session): session closed for user core Nov 4 23:20:23.914289 systemd[1]: sshd@4-172.31.23.127:22-139.178.89.65:38250.service: Deactivated successfully. Nov 4 23:20:23.919796 systemd[1]: session-5.scope: Deactivated successfully. Nov 4 23:20:23.922985 systemd-logind[1953]: Session 5 logged out. Waiting for processes to exit. Nov 4 23:20:23.925546 systemd-logind[1953]: Removed session 5. Nov 4 23:20:23.944901 systemd[1]: Started sshd@5-172.31.23.127:22-139.178.89.65:38256.service - OpenSSH per-connection server daemon (139.178.89.65:38256). Nov 4 23:20:24.147426 sshd[2293]: Accepted publickey for core from 139.178.89.65 port 38256 ssh2: RSA SHA256:hDiwkCWvCQBqijfvK1jv0H0YtRR2s7jf/pLBmZjqWNg Nov 4 23:20:24.149669 sshd-session[2293]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 4 23:20:24.159009 systemd-logind[1953]: New session 6 of user core. Nov 4 23:20:24.166199 systemd[1]: Started session-6.scope - Session 6 of User core. Nov 4 23:20:24.273460 sudo[2298]: core : PWD=/home/core ; USER=root ; COMMAND=/usr/sbin/rm -rf /etc/audit/rules.d/80-selinux.rules /etc/audit/rules.d/99-default.rules Nov 4 23:20:24.274079 sudo[2298]: pam_unix(sudo:session): session opened for user root(uid=0) by core(uid=500) Nov 4 23:20:24.284013 sudo[2298]: pam_unix(sudo:session): session closed for user root Nov 4 23:20:24.295676 sudo[2297]: core : PWD=/home/core ; USER=root ; COMMAND=/usr/sbin/systemctl restart audit-rules Nov 4 23:20:24.296324 sudo[2297]: pam_unix(sudo:session): session opened for user root(uid=0) by core(uid=500) Nov 4 23:20:24.315479 systemd[1]: Starting audit-rules.service - Load Audit Rules... Nov 4 23:20:24.371138 augenrules[2320]: No rules Nov 4 23:20:24.373484 systemd[1]: audit-rules.service: Deactivated successfully. Nov 4 23:20:24.375044 systemd[1]: Finished audit-rules.service - Load Audit Rules. Nov 4 23:20:24.378086 sudo[2297]: pam_unix(sudo:session): session closed for user root Nov 4 23:20:24.402906 sshd[2296]: Connection closed by 139.178.89.65 port 38256 Nov 4 23:20:24.403886 sshd-session[2293]: pam_unix(sshd:session): session closed for user core Nov 4 23:20:24.411726 systemd[1]: sshd@5-172.31.23.127:22-139.178.89.65:38256.service: Deactivated successfully. Nov 4 23:20:24.414777 systemd[1]: session-6.scope: Deactivated successfully. Nov 4 23:20:24.416827 systemd-logind[1953]: Session 6 logged out. Waiting for processes to exit. Nov 4 23:20:24.419149 systemd-logind[1953]: Removed session 6. Nov 4 23:20:24.437013 systemd[1]: Started sshd@6-172.31.23.127:22-139.178.89.65:38272.service - OpenSSH per-connection server daemon (139.178.89.65:38272). Nov 4 23:20:24.643228 sshd[2329]: Accepted publickey for core from 139.178.89.65 port 38272 ssh2: RSA SHA256:hDiwkCWvCQBqijfvK1jv0H0YtRR2s7jf/pLBmZjqWNg Nov 4 23:20:24.645446 sshd-session[2329]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 4 23:20:24.653998 systemd-logind[1953]: New session 7 of user core. Nov 4 23:20:24.662201 systemd[1]: Started session-7.scope - Session 7 of User core. Nov 4 23:20:24.770493 sudo[2333]: core : PWD=/home/core ; USER=root ; COMMAND=/home/core/install.sh Nov 4 23:20:24.771141 sudo[2333]: pam_unix(sudo:session): session opened for user root(uid=0) by core(uid=500) Nov 4 23:20:25.306141 systemd[1]: Starting docker.service - Docker Application Container Engine... Nov 4 23:20:25.325396 (dockerd)[2350]: docker.service: Referenced but unset environment variable evaluates to an empty string: DOCKER_CGROUPS, DOCKER_OPTS, DOCKER_OPT_BIP, DOCKER_OPT_IPMASQ, DOCKER_OPT_MTU Nov 4 23:20:25.706543 dockerd[2350]: time="2025-11-04T23:20:25.705971836Z" level=info msg="Starting up" Nov 4 23:20:25.708523 dockerd[2350]: time="2025-11-04T23:20:25.708468832Z" level=info msg="OTEL tracing is not configured, using no-op tracer provider" Nov 4 23:20:25.728525 dockerd[2350]: time="2025-11-04T23:20:25.728461744Z" level=info msg="Creating a containerd client" address=/var/run/docker/libcontainerd/docker-containerd.sock timeout=1m0s Nov 4 23:20:25.829555 dockerd[2350]: time="2025-11-04T23:20:25.829292597Z" level=info msg="Loading containers: start." Nov 4 23:20:25.848003 kernel: Initializing XFRM netlink socket Nov 4 23:20:26.179027 (udev-worker)[2372]: Network interface NamePolicy= disabled on kernel command line. Nov 4 23:20:26.256273 systemd-networkd[1575]: docker0: Link UP Nov 4 23:20:26.266310 dockerd[2350]: time="2025-11-04T23:20:26.266253783Z" level=info msg="Loading containers: done." Nov 4 23:20:26.292687 systemd[1]: var-lib-docker-overlay2-opaque\x2dbug\x2dcheck1836105318-merged.mount: Deactivated successfully. Nov 4 23:20:26.300328 dockerd[2350]: time="2025-11-04T23:20:26.300258255Z" level=warning msg="Not using native diff for overlay2, this may cause degraded performance for building images: kernel has CONFIG_OVERLAY_FS_REDIRECT_DIR enabled" storage-driver=overlay2 Nov 4 23:20:26.300524 dockerd[2350]: time="2025-11-04T23:20:26.300372543Z" level=info msg="Docker daemon" commit=6430e49a55babd9b8f4d08e70ecb2b68900770fe containerd-snapshotter=false storage-driver=overlay2 version=28.0.4 Nov 4 23:20:26.300579 dockerd[2350]: time="2025-11-04T23:20:26.300519279Z" level=info msg="Initializing buildkit" Nov 4 23:20:26.356934 dockerd[2350]: time="2025-11-04T23:20:26.356859387Z" level=info msg="Completed buildkit initialization" Nov 4 23:20:26.372109 dockerd[2350]: time="2025-11-04T23:20:26.372034827Z" level=info msg="Daemon has completed initialization" Nov 4 23:20:26.372255 dockerd[2350]: time="2025-11-04T23:20:26.372142503Z" level=info msg="API listen on /run/docker.sock" Nov 4 23:20:26.372546 systemd[1]: Started docker.service - Docker Application Container Engine. Nov 4 23:20:28.163816 containerd[1974]: time="2025-11-04T23:20:28.163747264Z" level=info msg="PullImage \"registry.k8s.io/kube-apiserver:v1.33.5\"" Nov 4 23:20:28.802751 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount4223521220.mount: Deactivated successfully. Nov 4 23:20:30.418970 containerd[1974]: time="2025-11-04T23:20:30.418310731Z" level=info msg="ImageCreate event name:\"registry.k8s.io/kube-apiserver:v1.33.5\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:20:30.421751 containerd[1974]: time="2025-11-04T23:20:30.421676851Z" level=info msg="stop pulling image registry.k8s.io/kube-apiserver:v1.33.5: active requests=0, bytes read=27390228" Nov 4 23:20:30.422025 containerd[1974]: time="2025-11-04T23:20:30.421975831Z" level=info msg="ImageCreate event name:\"sha256:6a7fd297b49102b08dc3d8d4fd7f1538bcf21d3131eae8bf62ba26ce3283237f\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:20:30.430696 containerd[1974]: time="2025-11-04T23:20:30.430638836Z" level=info msg="ImageCreate event name:\"registry.k8s.io/kube-apiserver@sha256:1b9c6c00bc1fe86860e72efb8e4148f9e436a132eba4ca636ca4f48d61d6dfb4\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:20:30.432679 containerd[1974]: time="2025-11-04T23:20:30.432629108Z" level=info msg="Pulled image \"registry.k8s.io/kube-apiserver:v1.33.5\" with image id \"sha256:6a7fd297b49102b08dc3d8d4fd7f1538bcf21d3131eae8bf62ba26ce3283237f\", repo tag \"registry.k8s.io/kube-apiserver:v1.33.5\", repo digest \"registry.k8s.io/kube-apiserver@sha256:1b9c6c00bc1fe86860e72efb8e4148f9e436a132eba4ca636ca4f48d61d6dfb4\", size \"27386827\" in 2.268820248s" Nov 4 23:20:30.432861 containerd[1974]: time="2025-11-04T23:20:30.432832208Z" level=info msg="PullImage \"registry.k8s.io/kube-apiserver:v1.33.5\" returns image reference \"sha256:6a7fd297b49102b08dc3d8d4fd7f1538bcf21d3131eae8bf62ba26ce3283237f\"" Nov 4 23:20:30.435877 containerd[1974]: time="2025-11-04T23:20:30.435807308Z" level=info msg="PullImage \"registry.k8s.io/kube-controller-manager:v1.33.5\"" Nov 4 23:20:30.670731 systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 1. Nov 4 23:20:30.673487 systemd[1]: Starting kubelet.service - kubelet: The Kubernetes Node Agent... Nov 4 23:20:31.048287 systemd[1]: Started kubelet.service - kubelet: The Kubernetes Node Agent. Nov 4 23:20:31.064667 (kubelet)[2629]: kubelet.service: Referenced but unset environment variable evaluates to an empty string: KUBELET_EXTRA_ARGS, KUBELET_KUBEADM_ARGS Nov 4 23:20:31.142670 kubelet[2629]: E1104 23:20:31.142586 2629 run.go:72] "command failed" err="failed to load kubelet config file, path: /var/lib/kubelet/config.yaml, error: failed to load Kubelet config file /var/lib/kubelet/config.yaml, error failed to read kubelet config file \"/var/lib/kubelet/config.yaml\", error: open /var/lib/kubelet/config.yaml: no such file or directory" Nov 4 23:20:31.150239 systemd[1]: kubelet.service: Main process exited, code=exited, status=1/FAILURE Nov 4 23:20:31.150553 systemd[1]: kubelet.service: Failed with result 'exit-code'. Nov 4 23:20:31.151545 systemd[1]: kubelet.service: Consumed 323ms CPU time, 104.5M memory peak. Nov 4 23:20:32.327483 containerd[1974]: time="2025-11-04T23:20:32.327402225Z" level=info msg="ImageCreate event name:\"registry.k8s.io/kube-controller-manager:v1.33.5\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:20:32.329552 containerd[1974]: time="2025-11-04T23:20:32.329222529Z" level=info msg="stop pulling image registry.k8s.io/kube-controller-manager:v1.33.5: active requests=0, bytes read=23547917" Nov 4 23:20:32.330718 containerd[1974]: time="2025-11-04T23:20:32.330658833Z" level=info msg="ImageCreate event name:\"sha256:2dd4c25a937008b7b8a6cdca70d816403b5078b51550926721b7a7762139cd23\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:20:32.335479 containerd[1974]: time="2025-11-04T23:20:32.335424609Z" level=info msg="ImageCreate event name:\"registry.k8s.io/kube-controller-manager@sha256:1082a6ab67fb46397314dd36b36cb197ba4a4c5365033e9ad22bc7edaaaabd5c\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:20:32.337503 containerd[1974]: time="2025-11-04T23:20:32.337454337Z" level=info msg="Pulled image \"registry.k8s.io/kube-controller-manager:v1.33.5\" with image id \"sha256:2dd4c25a937008b7b8a6cdca70d816403b5078b51550926721b7a7762139cd23\", repo tag \"registry.k8s.io/kube-controller-manager:v1.33.5\", repo digest \"registry.k8s.io/kube-controller-manager@sha256:1082a6ab67fb46397314dd36b36cb197ba4a4c5365033e9ad22bc7edaaaabd5c\", size \"25135832\" in 1.901583057s" Nov 4 23:20:32.337800 containerd[1974]: time="2025-11-04T23:20:32.337662093Z" level=info msg="PullImage \"registry.k8s.io/kube-controller-manager:v1.33.5\" returns image reference \"sha256:2dd4c25a937008b7b8a6cdca70d816403b5078b51550926721b7a7762139cd23\"" Nov 4 23:20:32.338426 containerd[1974]: time="2025-11-04T23:20:32.338388225Z" level=info msg="PullImage \"registry.k8s.io/kube-scheduler:v1.33.5\"" Nov 4 23:20:33.893909 containerd[1974]: time="2025-11-04T23:20:33.893829637Z" level=info msg="ImageCreate event name:\"registry.k8s.io/kube-scheduler:v1.33.5\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:20:33.896160 containerd[1974]: time="2025-11-04T23:20:33.896090785Z" level=info msg="stop pulling image registry.k8s.io/kube-scheduler:v1.33.5: active requests=0, bytes read=18295977" Nov 4 23:20:33.899064 containerd[1974]: time="2025-11-04T23:20:33.898960837Z" level=info msg="ImageCreate event name:\"sha256:5e600beaed8620718e0650dd2721266869ce1d737488c004a869333273e6ec15\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:20:33.905951 containerd[1974]: time="2025-11-04T23:20:33.905878969Z" level=info msg="ImageCreate event name:\"registry.k8s.io/kube-scheduler@sha256:3e7b57c9d9f06b77f0064e5be7f3df61e0151101160acd5fdecce911df28a189\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:20:33.907395 containerd[1974]: time="2025-11-04T23:20:33.907268269Z" level=info msg="Pulled image \"registry.k8s.io/kube-scheduler:v1.33.5\" with image id \"sha256:5e600beaed8620718e0650dd2721266869ce1d737488c004a869333273e6ec15\", repo tag \"registry.k8s.io/kube-scheduler:v1.33.5\", repo digest \"registry.k8s.io/kube-scheduler@sha256:3e7b57c9d9f06b77f0064e5be7f3df61e0151101160acd5fdecce911df28a189\", size \"19883910\" in 1.568698688s" Nov 4 23:20:33.907395 containerd[1974]: time="2025-11-04T23:20:33.907338529Z" level=info msg="PullImage \"registry.k8s.io/kube-scheduler:v1.33.5\" returns image reference \"sha256:5e600beaed8620718e0650dd2721266869ce1d737488c004a869333273e6ec15\"" Nov 4 23:20:33.908879 containerd[1974]: time="2025-11-04T23:20:33.908776513Z" level=info msg="PullImage \"registry.k8s.io/kube-proxy:v1.33.5\"" Nov 4 23:20:35.144993 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount898224877.mount: Deactivated successfully. Nov 4 23:20:35.751693 containerd[1974]: time="2025-11-04T23:20:35.751600634Z" level=info msg="ImageCreate event name:\"registry.k8s.io/kube-proxy:v1.33.5\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:20:35.753506 containerd[1974]: time="2025-11-04T23:20:35.753131582Z" level=info msg="stop pulling image registry.k8s.io/kube-proxy:v1.33.5: active requests=0, bytes read=28240106" Nov 4 23:20:35.755934 containerd[1974]: time="2025-11-04T23:20:35.755855690Z" level=info msg="ImageCreate event name:\"sha256:021a8d45ab0c346664e47d95595ff5180ce90a22a681ea27904c65ae90788e70\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:20:35.760939 containerd[1974]: time="2025-11-04T23:20:35.760860122Z" level=info msg="ImageCreate event name:\"registry.k8s.io/kube-proxy@sha256:71445ec84ad98bd52a7784865a9d31b1b50b56092d3f7699edc39eefd71befe1\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:20:35.762250 containerd[1974]: time="2025-11-04T23:20:35.762205886Z" level=info msg="Pulled image \"registry.k8s.io/kube-proxy:v1.33.5\" with image id \"sha256:021a8d45ab0c346664e47d95595ff5180ce90a22a681ea27904c65ae90788e70\", repo tag \"registry.k8s.io/kube-proxy:v1.33.5\", repo digest \"registry.k8s.io/kube-proxy@sha256:71445ec84ad98bd52a7784865a9d31b1b50b56092d3f7699edc39eefd71befe1\", size \"28239125\" in 1.853370765s" Nov 4 23:20:35.762407 containerd[1974]: time="2025-11-04T23:20:35.762380294Z" level=info msg="PullImage \"registry.k8s.io/kube-proxy:v1.33.5\" returns image reference \"sha256:021a8d45ab0c346664e47d95595ff5180ce90a22a681ea27904c65ae90788e70\"" Nov 4 23:20:35.763215 containerd[1974]: time="2025-11-04T23:20:35.763065770Z" level=info msg="PullImage \"registry.k8s.io/coredns/coredns:v1.12.0\"" Nov 4 23:20:36.370033 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount4208544067.mount: Deactivated successfully. Nov 4 23:20:37.580946 containerd[1974]: time="2025-11-04T23:20:37.580445103Z" level=info msg="ImageCreate event name:\"registry.k8s.io/coredns/coredns:v1.12.0\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:20:37.583748 containerd[1974]: time="2025-11-04T23:20:37.583684059Z" level=info msg="stop pulling image registry.k8s.io/coredns/coredns:v1.12.0: active requests=0, bytes read=19152117" Nov 4 23:20:37.585077 containerd[1974]: time="2025-11-04T23:20:37.584978343Z" level=info msg="ImageCreate event name:\"sha256:f72407be9e08c3a1b29a88318cbfee87b9f2da489f84015a5090b1e386e4dbc1\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:20:37.590180 containerd[1974]: time="2025-11-04T23:20:37.589176543Z" level=info msg="ImageCreate event name:\"registry.k8s.io/coredns/coredns@sha256:40384aa1f5ea6bfdc77997d243aec73da05f27aed0c5e9d65bfa98933c519d97\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:20:37.591393 containerd[1974]: time="2025-11-04T23:20:37.591331515Z" level=info msg="Pulled image \"registry.k8s.io/coredns/coredns:v1.12.0\" with image id \"sha256:f72407be9e08c3a1b29a88318cbfee87b9f2da489f84015a5090b1e386e4dbc1\", repo tag \"registry.k8s.io/coredns/coredns:v1.12.0\", repo digest \"registry.k8s.io/coredns/coredns@sha256:40384aa1f5ea6bfdc77997d243aec73da05f27aed0c5e9d65bfa98933c519d97\", size \"19148915\" in 1.828014525s" Nov 4 23:20:37.591393 containerd[1974]: time="2025-11-04T23:20:37.591388407Z" level=info msg="PullImage \"registry.k8s.io/coredns/coredns:v1.12.0\" returns image reference \"sha256:f72407be9e08c3a1b29a88318cbfee87b9f2da489f84015a5090b1e386e4dbc1\"" Nov 4 23:20:37.592334 containerd[1974]: time="2025-11-04T23:20:37.592282419Z" level=info msg="PullImage \"registry.k8s.io/pause:3.10\"" Nov 4 23:20:38.011717 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount1190501052.mount: Deactivated successfully. Nov 4 23:20:38.019793 containerd[1974]: time="2025-11-04T23:20:38.019719277Z" level=info msg="ImageCreate event name:\"registry.k8s.io/pause:3.10\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"} labels:{key:\"io.cri-containerd.pinned\" value:\"pinned\"}" Nov 4 23:20:38.021094 containerd[1974]: time="2025-11-04T23:20:38.021045109Z" level=info msg="stop pulling image registry.k8s.io/pause:3.10: active requests=0, bytes read=268703" Nov 4 23:20:38.022959 containerd[1974]: time="2025-11-04T23:20:38.021953533Z" level=info msg="ImageCreate event name:\"sha256:afb61768ce381961ca0beff95337601f29dc70ff3ed14e5e4b3e5699057e6aa8\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"} labels:{key:\"io.cri-containerd.pinned\" value:\"pinned\"}" Nov 4 23:20:38.027387 containerd[1974]: time="2025-11-04T23:20:38.027333145Z" level=info msg="ImageCreate event name:\"registry.k8s.io/pause@sha256:ee6521f290b2168b6e0935a181d4cff9be1ac3f505666ef0e3c98fae8199917a\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"} labels:{key:\"io.cri-containerd.pinned\" value:\"pinned\"}" Nov 4 23:20:38.028737 containerd[1974]: time="2025-11-04T23:20:38.028680133Z" level=info msg="Pulled image \"registry.k8s.io/pause:3.10\" with image id \"sha256:afb61768ce381961ca0beff95337601f29dc70ff3ed14e5e4b3e5699057e6aa8\", repo tag \"registry.k8s.io/pause:3.10\", repo digest \"registry.k8s.io/pause@sha256:ee6521f290b2168b6e0935a181d4cff9be1ac3f505666ef0e3c98fae8199917a\", size \"267933\" in 436.340378ms" Nov 4 23:20:38.029039 containerd[1974]: time="2025-11-04T23:20:38.028734397Z" level=info msg="PullImage \"registry.k8s.io/pause:3.10\" returns image reference \"sha256:afb61768ce381961ca0beff95337601f29dc70ff3ed14e5e4b3e5699057e6aa8\"" Nov 4 23:20:38.029433 containerd[1974]: time="2025-11-04T23:20:38.029352037Z" level=info msg="PullImage \"registry.k8s.io/etcd:3.5.21-0\"" Nov 4 23:20:38.552102 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount2756525660.mount: Deactivated successfully. Nov 4 23:20:41.057658 containerd[1974]: time="2025-11-04T23:20:41.057602632Z" level=info msg="ImageCreate event name:\"registry.k8s.io/etcd:3.5.21-0\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:20:41.062013 containerd[1974]: time="2025-11-04T23:20:41.061912468Z" level=info msg="stop pulling image registry.k8s.io/etcd:3.5.21-0: active requests=0, bytes read=69465857" Nov 4 23:20:41.066972 containerd[1974]: time="2025-11-04T23:20:41.065780680Z" level=info msg="ImageCreate event name:\"sha256:31747a36ce712f0bf61b50a0c06e99768522025e7b8daedd6dc63d1ae84837b5\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:20:41.071680 containerd[1974]: time="2025-11-04T23:20:41.071623792Z" level=info msg="ImageCreate event name:\"registry.k8s.io/etcd@sha256:d58c035df557080a27387d687092e3fc2b64c6d0e3162dc51453a115f847d121\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:20:41.073900 containerd[1974]: time="2025-11-04T23:20:41.073831108Z" level=info msg="Pulled image \"registry.k8s.io/etcd:3.5.21-0\" with image id \"sha256:31747a36ce712f0bf61b50a0c06e99768522025e7b8daedd6dc63d1ae84837b5\", repo tag \"registry.k8s.io/etcd:3.5.21-0\", repo digest \"registry.k8s.io/etcd@sha256:d58c035df557080a27387d687092e3fc2b64c6d0e3162dc51453a115f847d121\", size \"70026017\" in 3.044420247s" Nov 4 23:20:41.073900 containerd[1974]: time="2025-11-04T23:20:41.073894144Z" level=info msg="PullImage \"registry.k8s.io/etcd:3.5.21-0\" returns image reference \"sha256:31747a36ce712f0bf61b50a0c06e99768522025e7b8daedd6dc63d1ae84837b5\"" Nov 4 23:20:41.170494 systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 2. Nov 4 23:20:41.175574 systemd[1]: Starting kubelet.service - kubelet: The Kubernetes Node Agent... Nov 4 23:20:41.506506 systemd[1]: Started kubelet.service - kubelet: The Kubernetes Node Agent. Nov 4 23:20:41.520609 (kubelet)[2777]: kubelet.service: Referenced but unset environment variable evaluates to an empty string: KUBELET_EXTRA_ARGS, KUBELET_KUBEADM_ARGS Nov 4 23:20:41.601947 kubelet[2777]: E1104 23:20:41.601857 2777 run.go:72] "command failed" err="failed to load kubelet config file, path: /var/lib/kubelet/config.yaml, error: failed to load Kubelet config file /var/lib/kubelet/config.yaml, error failed to read kubelet config file \"/var/lib/kubelet/config.yaml\", error: open /var/lib/kubelet/config.yaml: no such file or directory" Nov 4 23:20:41.611664 systemd[1]: kubelet.service: Main process exited, code=exited, status=1/FAILURE Nov 4 23:20:41.612090 systemd[1]: kubelet.service: Failed with result 'exit-code'. Nov 4 23:20:41.612722 systemd[1]: kubelet.service: Consumed 300ms CPU time, 107.4M memory peak. Nov 4 23:20:45.740282 systemd[1]: systemd-hostnamed.service: Deactivated successfully. Nov 4 23:20:48.118377 systemd[1]: Stopped kubelet.service - kubelet: The Kubernetes Node Agent. Nov 4 23:20:48.119408 systemd[1]: kubelet.service: Consumed 300ms CPU time, 107.4M memory peak. Nov 4 23:20:48.123572 systemd[1]: Starting kubelet.service - kubelet: The Kubernetes Node Agent... Nov 4 23:20:48.175494 systemd[1]: Reload requested from client PID 2809 ('systemctl') (unit session-7.scope)... Nov 4 23:20:48.175521 systemd[1]: Reloading... Nov 4 23:20:48.431980 zram_generator::config[2857]: No configuration found. Nov 4 23:20:48.894597 systemd[1]: Reloading finished in 718 ms. Nov 4 23:20:48.997128 systemd[1]: kubelet.service: Control process exited, code=killed, status=15/TERM Nov 4 23:20:48.997310 systemd[1]: kubelet.service: Failed with result 'signal'. Nov 4 23:20:48.997815 systemd[1]: Stopped kubelet.service - kubelet: The Kubernetes Node Agent. Nov 4 23:20:48.997902 systemd[1]: kubelet.service: Consumed 229ms CPU time, 95.3M memory peak. Nov 4 23:20:49.003039 systemd[1]: Starting kubelet.service - kubelet: The Kubernetes Node Agent... Nov 4 23:20:49.327960 systemd[1]: Started kubelet.service - kubelet: The Kubernetes Node Agent. Nov 4 23:20:49.343431 (kubelet)[2917]: kubelet.service: Referenced but unset environment variable evaluates to an empty string: KUBELET_EXTRA_ARGS Nov 4 23:20:49.416890 kubelet[2917]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 4 23:20:49.416890 kubelet[2917]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Nov 4 23:20:49.416890 kubelet[2917]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 4 23:20:49.417967 kubelet[2917]: I1104 23:20:49.417619 2917 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Nov 4 23:20:50.619360 kubelet[2917]: I1104 23:20:50.619302 2917 server.go:530] "Kubelet version" kubeletVersion="v1.33.0" Nov 4 23:20:50.619360 kubelet[2917]: I1104 23:20:50.619349 2917 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Nov 4 23:20:50.620157 kubelet[2917]: I1104 23:20:50.619709 2917 server.go:956] "Client rotation is on, will bootstrap in background" Nov 4 23:20:50.665540 kubelet[2917]: I1104 23:20:50.665173 2917 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" Nov 4 23:20:50.665711 kubelet[2917]: E1104 23:20:50.665577 2917 certificate_manager.go:596] "Failed while requesting a signed certificate from the control plane" err="cannot create certificate signing request: Post \"https://172.31.23.127:6443/apis/certificates.k8s.io/v1/certificatesigningrequests\": dial tcp 172.31.23.127:6443: connect: connection refused" logger="kubernetes.io/kube-apiserver-client-kubelet.UnhandledError" Nov 4 23:20:50.678941 kubelet[2917]: I1104 23:20:50.678830 2917 server.go:1446] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Nov 4 23:20:50.690232 kubelet[2917]: I1104 23:20:50.690140 2917 server.go:782] "--cgroups-per-qos enabled, but --cgroup-root was not specified. defaulting to /" Nov 4 23:20:50.691990 kubelet[2917]: I1104 23:20:50.691228 2917 container_manager_linux.go:267] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Nov 4 23:20:50.691990 kubelet[2917]: I1104 23:20:50.691278 2917 container_manager_linux.go:272] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-172-31-23-127","RuntimeCgroupsName":"","SystemCgroupsName":"","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":false,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":null,"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":-1,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Nov 4 23:20:50.691990 kubelet[2917]: I1104 23:20:50.691731 2917 topology_manager.go:138] "Creating topology manager with none policy" Nov 4 23:20:50.691990 kubelet[2917]: I1104 23:20:50.691752 2917 container_manager_linux.go:303] "Creating device plugin manager" Nov 4 23:20:50.693502 kubelet[2917]: I1104 23:20:50.693450 2917 state_mem.go:36] "Initialized new in-memory state store" Nov 4 23:20:50.700341 kubelet[2917]: I1104 23:20:50.700137 2917 kubelet.go:480] "Attempting to sync node with API server" Nov 4 23:20:50.700341 kubelet[2917]: I1104 23:20:50.700184 2917 kubelet.go:375] "Adding static pod path" path="/etc/kubernetes/manifests" Nov 4 23:20:50.702332 kubelet[2917]: I1104 23:20:50.702208 2917 kubelet.go:386] "Adding apiserver pod source" Nov 4 23:20:50.705036 kubelet[2917]: E1104 23:20:50.704985 2917 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: Get \"https://172.31.23.127:6443/api/v1/nodes?fieldSelector=metadata.name%3Dip-172-31-23-127&limit=500&resourceVersion=0\": dial tcp 172.31.23.127:6443: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Nov 4 23:20:50.706950 kubelet[2917]: I1104 23:20:50.705232 2917 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Nov 4 23:20:50.707396 kubelet[2917]: E1104 23:20:50.707361 2917 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: Get \"https://172.31.23.127:6443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&limit=500&resourceVersion=0\": dial tcp 172.31.23.127:6443: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Nov 4 23:20:50.708037 kubelet[2917]: I1104 23:20:50.708006 2917 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="containerd" version="v2.0.5" apiVersion="v1" Nov 4 23:20:50.709404 kubelet[2917]: I1104 23:20:50.709369 2917 kubelet.go:935] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Nov 4 23:20:50.709769 kubelet[2917]: W1104 23:20:50.709748 2917 probe.go:272] Flexvolume plugin directory at /opt/libexec/kubernetes/kubelet-plugins/volume/exec/ does not exist. Recreating. Nov 4 23:20:50.717542 kubelet[2917]: I1104 23:20:50.717512 2917 watchdog_linux.go:99] "Systemd watchdog is not enabled" Nov 4 23:20:50.717748 kubelet[2917]: I1104 23:20:50.717730 2917 server.go:1289] "Started kubelet" Nov 4 23:20:50.719960 kubelet[2917]: I1104 23:20:50.719868 2917 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Nov 4 23:20:50.723966 kubelet[2917]: I1104 23:20:50.722418 2917 server.go:317] "Adding debug handlers to kubelet server" Nov 4 23:20:50.723966 kubelet[2917]: I1104 23:20:50.723170 2917 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Nov 4 23:20:50.723966 kubelet[2917]: I1104 23:20:50.723736 2917 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Nov 4 23:20:50.727003 kubelet[2917]: E1104 23:20:50.724276 2917 event.go:368] "Unable to write event (may retry after sleeping)" err="Post \"https://172.31.23.127:6443/api/v1/namespaces/default/events\": dial tcp 172.31.23.127:6443: connect: connection refused" event="&Event{ObjectMeta:{ip-172-31-23-127.1874f11a973fca44 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-172-31-23-127,UID:ip-172-31-23-127,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-172-31-23-127,},FirstTimestamp:2025-11-04 23:20:50.717690436 +0000 UTC m=+1.366777891,LastTimestamp:2025-11-04 23:20:50.717690436 +0000 UTC m=+1.366777891,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-172-31-23-127,}" Nov 4 23:20:50.732966 kubelet[2917]: E1104 23:20:50.732897 2917 kubelet.go:1600] "Image garbage collection failed once. Stats initialization may not have completed yet" err="invalid capacity 0 on image filesystem" Nov 4 23:20:50.733772 kubelet[2917]: I1104 23:20:50.733730 2917 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Nov 4 23:20:50.734138 kubelet[2917]: I1104 23:20:50.734116 2917 volume_manager.go:297] "Starting Kubelet Volume Manager" Nov 4 23:20:50.734460 kubelet[2917]: I1104 23:20:50.734434 2917 dynamic_serving_content.go:135] "Starting controller" name="kubelet-server-cert-files::/var/lib/kubelet/pki/kubelet.crt::/var/lib/kubelet/pki/kubelet.key" Nov 4 23:20:50.737762 kubelet[2917]: I1104 23:20:50.737729 2917 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Nov 4 23:20:50.738173 kubelet[2917]: I1104 23:20:50.738151 2917 reconciler.go:26] "Reconciler: start to sync state" Nov 4 23:20:50.739493 kubelet[2917]: E1104 23:20:50.739445 2917 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: Get \"https://172.31.23.127:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0\": dial tcp 172.31.23.127:6443: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Nov 4 23:20:50.740638 kubelet[2917]: E1104 23:20:50.740595 2917 kubelet_node_status.go:466] "Error getting the current node from lister" err="node \"ip-172-31-23-127\" not found" Nov 4 23:20:50.741242 kubelet[2917]: E1104 23:20:50.741192 2917 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://172.31.23.127:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-172-31-23-127?timeout=10s\": dial tcp 172.31.23.127:6443: connect: connection refused" interval="200ms" Nov 4 23:20:50.742293 kubelet[2917]: I1104 23:20:50.742260 2917 factory.go:223] Registration of the systemd container factory successfully Nov 4 23:20:50.742625 kubelet[2917]: I1104 23:20:50.742593 2917 factory.go:221] Registration of the crio container factory failed: Get "http://%2Fvar%2Frun%2Fcrio%2Fcrio.sock/info": dial unix /var/run/crio/crio.sock: connect: no such file or directory Nov 4 23:20:50.744946 kubelet[2917]: I1104 23:20:50.744881 2917 factory.go:223] Registration of the containerd container factory successfully Nov 4 23:20:50.781297 kubelet[2917]: I1104 23:20:50.778301 2917 cpu_manager.go:221] "Starting CPU manager" policy="none" Nov 4 23:20:50.781297 kubelet[2917]: I1104 23:20:50.778364 2917 cpu_manager.go:222] "Reconciling" reconcilePeriod="10s" Nov 4 23:20:50.781297 kubelet[2917]: I1104 23:20:50.778396 2917 state_mem.go:36] "Initialized new in-memory state store" Nov 4 23:20:50.785014 kubelet[2917]: I1104 23:20:50.784971 2917 policy_none.go:49] "None policy: Start" Nov 4 23:20:50.785014 kubelet[2917]: I1104 23:20:50.785015 2917 memory_manager.go:186] "Starting memorymanager" policy="None" Nov 4 23:20:50.785181 kubelet[2917]: I1104 23:20:50.785041 2917 state_mem.go:35] "Initializing new in-memory state store" Nov 4 23:20:50.795428 kubelet[2917]: I1104 23:20:50.795368 2917 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Nov 4 23:20:50.797855 kubelet[2917]: I1104 23:20:50.797795 2917 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Nov 4 23:20:50.797855 kubelet[2917]: I1104 23:20:50.797844 2917 status_manager.go:230] "Starting to sync pod status with apiserver" Nov 4 23:20:50.798085 kubelet[2917]: I1104 23:20:50.797880 2917 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Nov 4 23:20:50.798085 kubelet[2917]: I1104 23:20:50.797895 2917 kubelet.go:2436] "Starting kubelet main sync loop" Nov 4 23:20:50.798085 kubelet[2917]: E1104 23:20:50.798027 2917 kubelet.go:2460] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Nov 4 23:20:50.804319 kubelet[2917]: E1104 23:20:50.804274 2917 reflector.go:200] "Failed to watch" err="failed to list *v1.RuntimeClass: Get \"https://172.31.23.127:6443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0\": dial tcp 172.31.23.127:6443: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Nov 4 23:20:50.808027 systemd[1]: Created slice kubepods.slice - libcontainer container kubepods.slice. Nov 4 23:20:50.823610 systemd[1]: Created slice kubepods-burstable.slice - libcontainer container kubepods-burstable.slice. Nov 4 23:20:50.831583 systemd[1]: Created slice kubepods-besteffort.slice - libcontainer container kubepods-besteffort.slice. Nov 4 23:20:50.841257 kubelet[2917]: E1104 23:20:50.841002 2917 kubelet_node_status.go:466] "Error getting the current node from lister" err="node \"ip-172-31-23-127\" not found" Nov 4 23:20:50.841697 kubelet[2917]: E1104 23:20:50.841639 2917 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Nov 4 23:20:50.841979 kubelet[2917]: I1104 23:20:50.841950 2917 eviction_manager.go:189] "Eviction manager: starting control loop" Nov 4 23:20:50.842073 kubelet[2917]: I1104 23:20:50.841981 2917 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Nov 4 23:20:50.843234 kubelet[2917]: I1104 23:20:50.843152 2917 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Nov 4 23:20:50.844863 kubelet[2917]: E1104 23:20:50.844825 2917 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="no imagefs label for configured runtime" Nov 4 23:20:50.845239 kubelet[2917]: E1104 23:20:50.844894 2917 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-172-31-23-127\" not found" Nov 4 23:20:50.921750 systemd[1]: Created slice kubepods-burstable-podb6bbf81508644c64b91268745faee192.slice - libcontainer container kubepods-burstable-podb6bbf81508644c64b91268745faee192.slice. Nov 4 23:20:50.939963 kubelet[2917]: I1104 23:20:50.939193 2917 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-certs\" (UniqueName: \"kubernetes.io/host-path/b264570ee012d952c07deb1970e775e5-ca-certs\") pod \"kube-apiserver-ip-172-31-23-127\" (UID: \"b264570ee012d952c07deb1970e775e5\") " pod="kube-system/kube-apiserver-ip-172-31-23-127" Nov 4 23:20:50.939963 kubelet[2917]: E1104 23:20:50.939549 2917 kubelet.go:3305] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-172-31-23-127\" not found" node="ip-172-31-23-127" Nov 4 23:20:50.942046 kubelet[2917]: E1104 23:20:50.941982 2917 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://172.31.23.127:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-172-31-23-127?timeout=10s\": dial tcp 172.31.23.127:6443: connect: connection refused" interval="400ms" Nov 4 23:20:50.946236 systemd[1]: Created slice kubepods-burstable-podb264570ee012d952c07deb1970e775e5.slice - libcontainer container kubepods-burstable-podb264570ee012d952c07deb1970e775e5.slice. Nov 4 23:20:50.947797 kubelet[2917]: I1104 23:20:50.947737 2917 kubelet_node_status.go:75] "Attempting to register node" node="ip-172-31-23-127" Nov 4 23:20:50.948509 kubelet[2917]: E1104 23:20:50.948379 2917 kubelet_node_status.go:107] "Unable to register node with API server" err="Post \"https://172.31.23.127:6443/api/v1/nodes\": dial tcp 172.31.23.127:6443: connect: connection refused" node="ip-172-31-23-127" Nov 4 23:20:50.962166 kubelet[2917]: E1104 23:20:50.961977 2917 kubelet.go:3305] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-172-31-23-127\" not found" node="ip-172-31-23-127" Nov 4 23:20:50.968982 systemd[1]: Created slice kubepods-burstable-podd030c19ee8333db3194e108895ba79f8.slice - libcontainer container kubepods-burstable-podd030c19ee8333db3194e108895ba79f8.slice. Nov 4 23:20:50.972719 kubelet[2917]: E1104 23:20:50.972670 2917 kubelet.go:3305] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-172-31-23-127\" not found" node="ip-172-31-23-127" Nov 4 23:20:51.040066 kubelet[2917]: I1104 23:20:51.040022 2917 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"k8s-certs\" (UniqueName: \"kubernetes.io/host-path/d030c19ee8333db3194e108895ba79f8-k8s-certs\") pod \"kube-controller-manager-ip-172-31-23-127\" (UID: \"d030c19ee8333db3194e108895ba79f8\") " pod="kube-system/kube-controller-manager-ip-172-31-23-127" Nov 4 23:20:51.040704 kubelet[2917]: I1104 23:20:51.040243 2917 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeconfig\" (UniqueName: \"kubernetes.io/host-path/d030c19ee8333db3194e108895ba79f8-kubeconfig\") pod \"kube-controller-manager-ip-172-31-23-127\" (UID: \"d030c19ee8333db3194e108895ba79f8\") " pod="kube-system/kube-controller-manager-ip-172-31-23-127" Nov 4 23:20:51.040704 kubelet[2917]: I1104 23:20:51.040309 2917 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-share-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/d030c19ee8333db3194e108895ba79f8-usr-share-ca-certificates\") pod \"kube-controller-manager-ip-172-31-23-127\" (UID: \"d030c19ee8333db3194e108895ba79f8\") " pod="kube-system/kube-controller-manager-ip-172-31-23-127" Nov 4 23:20:51.040704 kubelet[2917]: I1104 23:20:51.040394 2917 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-share-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/b264570ee012d952c07deb1970e775e5-usr-share-ca-certificates\") pod \"kube-apiserver-ip-172-31-23-127\" (UID: \"b264570ee012d952c07deb1970e775e5\") " pod="kube-system/kube-apiserver-ip-172-31-23-127" Nov 4 23:20:51.040704 kubelet[2917]: I1104 23:20:51.040429 2917 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-certs\" (UniqueName: \"kubernetes.io/host-path/d030c19ee8333db3194e108895ba79f8-ca-certs\") pod \"kube-controller-manager-ip-172-31-23-127\" (UID: \"d030c19ee8333db3194e108895ba79f8\") " pod="kube-system/kube-controller-manager-ip-172-31-23-127" Nov 4 23:20:51.040704 kubelet[2917]: I1104 23:20:51.040481 2917 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"flexvolume-dir\" (UniqueName: \"kubernetes.io/host-path/d030c19ee8333db3194e108895ba79f8-flexvolume-dir\") pod \"kube-controller-manager-ip-172-31-23-127\" (UID: \"d030c19ee8333db3194e108895ba79f8\") " pod="kube-system/kube-controller-manager-ip-172-31-23-127" Nov 4 23:20:51.041001 kubelet[2917]: I1104 23:20:51.040523 2917 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeconfig\" (UniqueName: \"kubernetes.io/host-path/b6bbf81508644c64b91268745faee192-kubeconfig\") pod \"kube-scheduler-ip-172-31-23-127\" (UID: \"b6bbf81508644c64b91268745faee192\") " pod="kube-system/kube-scheduler-ip-172-31-23-127" Nov 4 23:20:51.041001 kubelet[2917]: I1104 23:20:51.040560 2917 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"k8s-certs\" (UniqueName: \"kubernetes.io/host-path/b264570ee012d952c07deb1970e775e5-k8s-certs\") pod \"kube-apiserver-ip-172-31-23-127\" (UID: \"b264570ee012d952c07deb1970e775e5\") " pod="kube-system/kube-apiserver-ip-172-31-23-127" Nov 4 23:20:51.151941 kubelet[2917]: I1104 23:20:51.151553 2917 kubelet_node_status.go:75] "Attempting to register node" node="ip-172-31-23-127" Nov 4 23:20:51.152585 kubelet[2917]: E1104 23:20:51.152513 2917 kubelet_node_status.go:107] "Unable to register node with API server" err="Post \"https://172.31.23.127:6443/api/v1/nodes\": dial tcp 172.31.23.127:6443: connect: connection refused" node="ip-172-31-23-127" Nov 4 23:20:51.241550 containerd[1974]: time="2025-11-04T23:20:51.241397235Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-scheduler-ip-172-31-23-127,Uid:b6bbf81508644c64b91268745faee192,Namespace:kube-system,Attempt:0,}" Nov 4 23:20:51.264393 containerd[1974]: time="2025-11-04T23:20:51.264317511Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-apiserver-ip-172-31-23-127,Uid:b264570ee012d952c07deb1970e775e5,Namespace:kube-system,Attempt:0,}" Nov 4 23:20:51.274173 containerd[1974]: time="2025-11-04T23:20:51.274097823Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-controller-manager-ip-172-31-23-127,Uid:d030c19ee8333db3194e108895ba79f8,Namespace:kube-system,Attempt:0,}" Nov 4 23:20:51.343466 kubelet[2917]: E1104 23:20:51.343399 2917 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://172.31.23.127:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-172-31-23-127?timeout=10s\": dial tcp 172.31.23.127:6443: connect: connection refused" interval="800ms" Nov 4 23:20:51.407241 containerd[1974]: time="2025-11-04T23:20:51.407182744Z" level=info msg="connecting to shim 6f1223eceeaf1fe9251c76aeba32215c7dc98d660af778decbf0a62bffb76638" address="unix:///run/containerd/s/fbec4111710e12d8a751078ee2e8293de531deaf9a7d45e962a60c097c5069b1" namespace=k8s.io protocol=ttrpc version=3 Nov 4 23:20:51.435284 containerd[1974]: time="2025-11-04T23:20:51.435147700Z" level=info msg="connecting to shim 7b37d37c1babb9e3d5663a2a1b9ce1f1b05c095ce0372e75683c631c83c87fa1" address="unix:///run/containerd/s/718f28a2b08cb38397891dc2abd529178c38c9b13d7b1659f5f06019eea3dfa9" namespace=k8s.io protocol=ttrpc version=3 Nov 4 23:20:51.449460 containerd[1974]: time="2025-11-04T23:20:51.449386528Z" level=info msg="connecting to shim 02f5de3ec9cc02f8bf779102125d1dc77530d5937a34f06041a84fae29cf3c5c" address="unix:///run/containerd/s/e8573a1b4486440d842eac75dbca1afecdbd18d870c55dd5101f4db19d88481b" namespace=k8s.io protocol=ttrpc version=3 Nov 4 23:20:51.495383 systemd[1]: Started cri-containerd-6f1223eceeaf1fe9251c76aeba32215c7dc98d660af778decbf0a62bffb76638.scope - libcontainer container 6f1223eceeaf1fe9251c76aeba32215c7dc98d660af778decbf0a62bffb76638. Nov 4 23:20:51.527311 systemd[1]: Started cri-containerd-02f5de3ec9cc02f8bf779102125d1dc77530d5937a34f06041a84fae29cf3c5c.scope - libcontainer container 02f5de3ec9cc02f8bf779102125d1dc77530d5937a34f06041a84fae29cf3c5c. Nov 4 23:20:51.540479 systemd[1]: Started cri-containerd-7b37d37c1babb9e3d5663a2a1b9ce1f1b05c095ce0372e75683c631c83c87fa1.scope - libcontainer container 7b37d37c1babb9e3d5663a2a1b9ce1f1b05c095ce0372e75683c631c83c87fa1. Nov 4 23:20:51.546909 kubelet[2917]: E1104 23:20:51.546750 2917 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: Get \"https://172.31.23.127:6443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&limit=500&resourceVersion=0\": dial tcp 172.31.23.127:6443: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Nov 4 23:20:51.560443 kubelet[2917]: I1104 23:20:51.560372 2917 kubelet_node_status.go:75] "Attempting to register node" node="ip-172-31-23-127" Nov 4 23:20:51.563338 kubelet[2917]: E1104 23:20:51.563257 2917 kubelet_node_status.go:107] "Unable to register node with API server" err="Post \"https://172.31.23.127:6443/api/v1/nodes\": dial tcp 172.31.23.127:6443: connect: connection refused" node="ip-172-31-23-127" Nov 4 23:20:51.647904 containerd[1974]: time="2025-11-04T23:20:51.647661089Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-controller-manager-ip-172-31-23-127,Uid:d030c19ee8333db3194e108895ba79f8,Namespace:kube-system,Attempt:0,} returns sandbox id \"6f1223eceeaf1fe9251c76aeba32215c7dc98d660af778decbf0a62bffb76638\"" Nov 4 23:20:51.668907 containerd[1974]: time="2025-11-04T23:20:51.668747813Z" level=info msg="CreateContainer within sandbox \"6f1223eceeaf1fe9251c76aeba32215c7dc98d660af778decbf0a62bffb76638\" for container &ContainerMetadata{Name:kube-controller-manager,Attempt:0,}" Nov 4 23:20:51.673231 containerd[1974]: time="2025-11-04T23:20:51.673080521Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-apiserver-ip-172-31-23-127,Uid:b264570ee012d952c07deb1970e775e5,Namespace:kube-system,Attempt:0,} returns sandbox id \"02f5de3ec9cc02f8bf779102125d1dc77530d5937a34f06041a84fae29cf3c5c\"" Nov 4 23:20:51.684246 containerd[1974]: time="2025-11-04T23:20:51.684197357Z" level=info msg="CreateContainer within sandbox \"02f5de3ec9cc02f8bf779102125d1dc77530d5937a34f06041a84fae29cf3c5c\" for container &ContainerMetadata{Name:kube-apiserver,Attempt:0,}" Nov 4 23:20:51.695337 kubelet[2917]: E1104 23:20:51.695091 2917 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: Get \"https://172.31.23.127:6443/api/v1/nodes?fieldSelector=metadata.name%3Dip-172-31-23-127&limit=500&resourceVersion=0\": dial tcp 172.31.23.127:6443: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Nov 4 23:20:51.700344 containerd[1974]: time="2025-11-04T23:20:51.700270205Z" level=info msg="Container 3f07c9bb0876f1574579301a8d2dbfb0382fd73319b582cd168309b81be5c0d1: CDI devices from CRI Config.CDIDevices: []" Nov 4 23:20:51.721040 containerd[1974]: time="2025-11-04T23:20:51.720566645Z" level=info msg="Container acedf13b1bbbd505588961d32e69dfcd61730990f14fbb10b24644a5a89bbad5: CDI devices from CRI Config.CDIDevices: []" Nov 4 23:20:51.721300 containerd[1974]: time="2025-11-04T23:20:51.721148645Z" level=info msg="CreateContainer within sandbox \"6f1223eceeaf1fe9251c76aeba32215c7dc98d660af778decbf0a62bffb76638\" for &ContainerMetadata{Name:kube-controller-manager,Attempt:0,} returns container id \"3f07c9bb0876f1574579301a8d2dbfb0382fd73319b582cd168309b81be5c0d1\"" Nov 4 23:20:51.722728 containerd[1974]: time="2025-11-04T23:20:51.722670305Z" level=info msg="StartContainer for \"3f07c9bb0876f1574579301a8d2dbfb0382fd73319b582cd168309b81be5c0d1\"" Nov 4 23:20:51.724481 containerd[1974]: time="2025-11-04T23:20:51.724434449Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-scheduler-ip-172-31-23-127,Uid:b6bbf81508644c64b91268745faee192,Namespace:kube-system,Attempt:0,} returns sandbox id \"7b37d37c1babb9e3d5663a2a1b9ce1f1b05c095ce0372e75683c631c83c87fa1\"" Nov 4 23:20:51.727779 containerd[1974]: time="2025-11-04T23:20:51.727699481Z" level=info msg="connecting to shim 3f07c9bb0876f1574579301a8d2dbfb0382fd73319b582cd168309b81be5c0d1" address="unix:///run/containerd/s/fbec4111710e12d8a751078ee2e8293de531deaf9a7d45e962a60c097c5069b1" protocol=ttrpc version=3 Nov 4 23:20:51.736953 containerd[1974]: time="2025-11-04T23:20:51.736541345Z" level=info msg="CreateContainer within sandbox \"7b37d37c1babb9e3d5663a2a1b9ce1f1b05c095ce0372e75683c631c83c87fa1\" for container &ContainerMetadata{Name:kube-scheduler,Attempt:0,}" Nov 4 23:20:51.745454 containerd[1974]: time="2025-11-04T23:20:51.745363649Z" level=info msg="CreateContainer within sandbox \"02f5de3ec9cc02f8bf779102125d1dc77530d5937a34f06041a84fae29cf3c5c\" for &ContainerMetadata{Name:kube-apiserver,Attempt:0,} returns container id \"acedf13b1bbbd505588961d32e69dfcd61730990f14fbb10b24644a5a89bbad5\"" Nov 4 23:20:51.748576 containerd[1974]: time="2025-11-04T23:20:51.748436849Z" level=info msg="StartContainer for \"acedf13b1bbbd505588961d32e69dfcd61730990f14fbb10b24644a5a89bbad5\"" Nov 4 23:20:51.765419 containerd[1974]: time="2025-11-04T23:20:51.765335165Z" level=info msg="connecting to shim acedf13b1bbbd505588961d32e69dfcd61730990f14fbb10b24644a5a89bbad5" address="unix:///run/containerd/s/e8573a1b4486440d842eac75dbca1afecdbd18d870c55dd5101f4db19d88481b" protocol=ttrpc version=3 Nov 4 23:20:51.771559 systemd[1]: Started cri-containerd-3f07c9bb0876f1574579301a8d2dbfb0382fd73319b582cd168309b81be5c0d1.scope - libcontainer container 3f07c9bb0876f1574579301a8d2dbfb0382fd73319b582cd168309b81be5c0d1. Nov 4 23:20:51.790199 containerd[1974]: time="2025-11-04T23:20:51.790141410Z" level=info msg="Container 21315192975cfd49a4b1972bd5a911b6c8de018b4bcfdec5d3e5806f0c04f8a0: CDI devices from CRI Config.CDIDevices: []" Nov 4 23:20:51.796417 kubelet[2917]: E1104 23:20:51.796255 2917 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: Get \"https://172.31.23.127:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0\": dial tcp 172.31.23.127:6443: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Nov 4 23:20:51.813833 containerd[1974]: time="2025-11-04T23:20:51.813761406Z" level=info msg="CreateContainer within sandbox \"7b37d37c1babb9e3d5663a2a1b9ce1f1b05c095ce0372e75683c631c83c87fa1\" for &ContainerMetadata{Name:kube-scheduler,Attempt:0,} returns container id \"21315192975cfd49a4b1972bd5a911b6c8de018b4bcfdec5d3e5806f0c04f8a0\"" Nov 4 23:20:51.814637 containerd[1974]: time="2025-11-04T23:20:51.814569918Z" level=info msg="StartContainer for \"21315192975cfd49a4b1972bd5a911b6c8de018b4bcfdec5d3e5806f0c04f8a0\"" Nov 4 23:20:51.819524 containerd[1974]: time="2025-11-04T23:20:51.819439830Z" level=info msg="connecting to shim 21315192975cfd49a4b1972bd5a911b6c8de018b4bcfdec5d3e5806f0c04f8a0" address="unix:///run/containerd/s/718f28a2b08cb38397891dc2abd529178c38c9b13d7b1659f5f06019eea3dfa9" protocol=ttrpc version=3 Nov 4 23:20:51.820410 kubelet[2917]: E1104 23:20:51.820298 2917 reflector.go:200] "Failed to watch" err="failed to list *v1.RuntimeClass: Get \"https://172.31.23.127:6443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0\": dial tcp 172.31.23.127:6443: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Nov 4 23:20:51.825263 systemd[1]: Started cri-containerd-acedf13b1bbbd505588961d32e69dfcd61730990f14fbb10b24644a5a89bbad5.scope - libcontainer container acedf13b1bbbd505588961d32e69dfcd61730990f14fbb10b24644a5a89bbad5. Nov 4 23:20:51.897558 systemd[1]: Started cri-containerd-21315192975cfd49a4b1972bd5a911b6c8de018b4bcfdec5d3e5806f0c04f8a0.scope - libcontainer container 21315192975cfd49a4b1972bd5a911b6c8de018b4bcfdec5d3e5806f0c04f8a0. Nov 4 23:20:51.970183 containerd[1974]: time="2025-11-04T23:20:51.969559051Z" level=info msg="StartContainer for \"3f07c9bb0876f1574579301a8d2dbfb0382fd73319b582cd168309b81be5c0d1\" returns successfully" Nov 4 23:20:51.997645 containerd[1974]: time="2025-11-04T23:20:51.997534255Z" level=info msg="StartContainer for \"acedf13b1bbbd505588961d32e69dfcd61730990f14fbb10b24644a5a89bbad5\" returns successfully" Nov 4 23:20:52.077407 containerd[1974]: time="2025-11-04T23:20:52.077211507Z" level=info msg="StartContainer for \"21315192975cfd49a4b1972bd5a911b6c8de018b4bcfdec5d3e5806f0c04f8a0\" returns successfully" Nov 4 23:20:52.144468 kubelet[2917]: E1104 23:20:52.144374 2917 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://172.31.23.127:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-172-31-23-127?timeout=10s\": dial tcp 172.31.23.127:6443: connect: connection refused" interval="1.6s" Nov 4 23:20:52.161193 kubelet[2917]: E1104 23:20:52.160885 2917 event.go:368] "Unable to write event (may retry after sleeping)" err="Post \"https://172.31.23.127:6443/api/v1/namespaces/default/events\": dial tcp 172.31.23.127:6443: connect: connection refused" event="&Event{ObjectMeta:{ip-172-31-23-127.1874f11a973fca44 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-172-31-23-127,UID:ip-172-31-23-127,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-172-31-23-127,},FirstTimestamp:2025-11-04 23:20:50.717690436 +0000 UTC m=+1.366777891,LastTimestamp:2025-11-04 23:20:50.717690436 +0000 UTC m=+1.366777891,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-172-31-23-127,}" Nov 4 23:20:52.366502 kubelet[2917]: I1104 23:20:52.366370 2917 kubelet_node_status.go:75] "Attempting to register node" node="ip-172-31-23-127" Nov 4 23:20:52.873947 kubelet[2917]: E1104 23:20:52.871585 2917 kubelet.go:3305] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-172-31-23-127\" not found" node="ip-172-31-23-127" Nov 4 23:20:52.886939 kubelet[2917]: E1104 23:20:52.886510 2917 kubelet.go:3305] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-172-31-23-127\" not found" node="ip-172-31-23-127" Nov 4 23:20:52.896393 kubelet[2917]: E1104 23:20:52.896135 2917 kubelet.go:3305] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-172-31-23-127\" not found" node="ip-172-31-23-127" Nov 4 23:20:53.897499 kubelet[2917]: E1104 23:20:53.897448 2917 kubelet.go:3305] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-172-31-23-127\" not found" node="ip-172-31-23-127" Nov 4 23:20:53.899391 kubelet[2917]: E1104 23:20:53.898812 2917 kubelet.go:3305] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-172-31-23-127\" not found" node="ip-172-31-23-127" Nov 4 23:20:53.899862 kubelet[2917]: E1104 23:20:53.899813 2917 kubelet.go:3305] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-172-31-23-127\" not found" node="ip-172-31-23-127" Nov 4 23:20:54.901365 kubelet[2917]: E1104 23:20:54.901299 2917 kubelet.go:3305] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-172-31-23-127\" not found" node="ip-172-31-23-127" Nov 4 23:20:54.902572 kubelet[2917]: E1104 23:20:54.902136 2917 kubelet.go:3305] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-172-31-23-127\" not found" node="ip-172-31-23-127" Nov 4 23:20:54.904904 kubelet[2917]: E1104 23:20:54.904846 2917 kubelet.go:3305] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-172-31-23-127\" not found" node="ip-172-31-23-127" Nov 4 23:20:56.150224 kubelet[2917]: I1104 23:20:56.150087 2917 kubelet_node_status.go:78] "Successfully registered node" node="ip-172-31-23-127" Nov 4 23:20:56.150224 kubelet[2917]: E1104 23:20:56.150167 2917 kubelet_node_status.go:548] "Error updating node status, will retry" err="error getting node \"ip-172-31-23-127\": node \"ip-172-31-23-127\" not found" Nov 4 23:20:56.242464 kubelet[2917]: I1104 23:20:56.242394 2917 kubelet.go:3309] "Creating a mirror pod for static pod" pod="kube-system/kube-scheduler-ip-172-31-23-127" Nov 4 23:20:56.305732 kubelet[2917]: E1104 23:20:56.305501 2917 kubelet.go:3311] "Failed creating a mirror pod" err="pods \"kube-scheduler-ip-172-31-23-127\" is forbidden: no PriorityClass with name system-node-critical was found" pod="kube-system/kube-scheduler-ip-172-31-23-127" Nov 4 23:20:56.305732 kubelet[2917]: I1104 23:20:56.305551 2917 kubelet.go:3309] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-ip-172-31-23-127" Nov 4 23:20:56.309781 kubelet[2917]: E1104 23:20:56.309573 2917 kubelet.go:3311] "Failed creating a mirror pod" err="pods \"kube-apiserver-ip-172-31-23-127\" is forbidden: no PriorityClass with name system-node-critical was found" pod="kube-system/kube-apiserver-ip-172-31-23-127" Nov 4 23:20:56.309781 kubelet[2917]: I1104 23:20:56.309617 2917 kubelet.go:3309] "Creating a mirror pod for static pod" pod="kube-system/kube-controller-manager-ip-172-31-23-127" Nov 4 23:20:56.320175 kubelet[2917]: E1104 23:20:56.320120 2917 kubelet.go:3311] "Failed creating a mirror pod" err="pods \"kube-controller-manager-ip-172-31-23-127\" is forbidden: no PriorityClass with name system-node-critical was found" pod="kube-system/kube-controller-manager-ip-172-31-23-127" Nov 4 23:20:56.719735 kubelet[2917]: I1104 23:20:56.719395 2917 apiserver.go:52] "Watching apiserver" Nov 4 23:20:56.738642 kubelet[2917]: I1104 23:20:56.738526 2917 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Nov 4 23:20:58.304380 kubelet[2917]: I1104 23:20:58.304015 2917 kubelet.go:3309] "Creating a mirror pod for static pod" pod="kube-system/kube-scheduler-ip-172-31-23-127" Nov 4 23:20:58.339791 systemd[1]: Reload requested from client PID 3198 ('systemctl') (unit session-7.scope)... Nov 4 23:20:58.339823 systemd[1]: Reloading... Nov 4 23:20:58.538885 kubelet[2917]: I1104 23:20:58.538708 2917 kubelet.go:3309] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-ip-172-31-23-127" Nov 4 23:20:58.570967 zram_generator::config[3245]: No configuration found. Nov 4 23:20:59.144043 systemd[1]: Reloading finished in 803 ms. Nov 4 23:20:59.191146 systemd[1]: Stopping kubelet.service - kubelet: The Kubernetes Node Agent... Nov 4 23:20:59.206663 systemd[1]: kubelet.service: Deactivated successfully. Nov 4 23:20:59.209033 systemd[1]: Stopped kubelet.service - kubelet: The Kubernetes Node Agent. Nov 4 23:20:59.209126 systemd[1]: kubelet.service: Consumed 2.092s CPU time, 126.2M memory peak. Nov 4 23:20:59.212897 systemd[1]: Starting kubelet.service - kubelet: The Kubernetes Node Agent... Nov 4 23:20:59.588072 systemd[1]: Started kubelet.service - kubelet: The Kubernetes Node Agent. Nov 4 23:20:59.599051 update_engine[1955]: I20251104 23:20:59.598960 1955 update_attempter.cc:509] Updating boot flags... Nov 4 23:20:59.608550 (kubelet)[3304]: kubelet.service: Referenced but unset environment variable evaluates to an empty string: KUBELET_EXTRA_ARGS Nov 4 23:20:59.793966 kubelet[3304]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 4 23:20:59.793966 kubelet[3304]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Nov 4 23:20:59.793966 kubelet[3304]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 4 23:20:59.793966 kubelet[3304]: I1104 23:20:59.792662 3304 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Nov 4 23:20:59.821399 kubelet[3304]: I1104 23:20:59.821342 3304 server.go:530] "Kubelet version" kubeletVersion="v1.33.0" Nov 4 23:20:59.822812 kubelet[3304]: I1104 23:20:59.822116 3304 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Nov 4 23:20:59.822812 kubelet[3304]: I1104 23:20:59.822518 3304 server.go:956] "Client rotation is on, will bootstrap in background" Nov 4 23:20:59.828367 kubelet[3304]: I1104 23:20:59.828064 3304 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem" Nov 4 23:20:59.837682 kubelet[3304]: I1104 23:20:59.837638 3304 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" Nov 4 23:20:59.855829 kubelet[3304]: I1104 23:20:59.855656 3304 server.go:1446] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Nov 4 23:20:59.903784 kubelet[3304]: I1104 23:20:59.903742 3304 server.go:782] "--cgroups-per-qos enabled, but --cgroup-root was not specified. defaulting to /" Nov 4 23:20:59.905526 kubelet[3304]: I1104 23:20:59.905110 3304 container_manager_linux.go:267] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Nov 4 23:20:59.905526 kubelet[3304]: I1104 23:20:59.905164 3304 container_manager_linux.go:272] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-172-31-23-127","RuntimeCgroupsName":"","SystemCgroupsName":"","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":false,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":null,"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":-1,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Nov 4 23:20:59.905526 kubelet[3304]: I1104 23:20:59.905425 3304 topology_manager.go:138] "Creating topology manager with none policy" Nov 4 23:20:59.905526 kubelet[3304]: I1104 23:20:59.905444 3304 container_manager_linux.go:303] "Creating device plugin manager" Nov 4 23:20:59.906330 kubelet[3304]: I1104 23:20:59.906116 3304 state_mem.go:36] "Initialized new in-memory state store" Nov 4 23:20:59.910689 kubelet[3304]: I1104 23:20:59.907757 3304 kubelet.go:480] "Attempting to sync node with API server" Nov 4 23:20:59.910689 kubelet[3304]: I1104 23:20:59.909058 3304 kubelet.go:375] "Adding static pod path" path="/etc/kubernetes/manifests" Nov 4 23:20:59.910689 kubelet[3304]: I1104 23:20:59.909116 3304 kubelet.go:386] "Adding apiserver pod source" Nov 4 23:20:59.910689 kubelet[3304]: I1104 23:20:59.909143 3304 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Nov 4 23:20:59.915979 kubelet[3304]: I1104 23:20:59.913370 3304 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="containerd" version="v2.0.5" apiVersion="v1" Nov 4 23:20:59.921146 kubelet[3304]: I1104 23:20:59.921101 3304 kubelet.go:935] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Nov 4 23:20:59.945698 kubelet[3304]: I1104 23:20:59.945652 3304 watchdog_linux.go:99] "Systemd watchdog is not enabled" Nov 4 23:20:59.948800 kubelet[3304]: I1104 23:20:59.948768 3304 server.go:1289] "Started kubelet" Nov 4 23:20:59.962300 kubelet[3304]: I1104 23:20:59.962031 3304 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Nov 4 23:20:59.964120 kubelet[3304]: I1104 23:20:59.963396 3304 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Nov 4 23:20:59.985963 kubelet[3304]: I1104 23:20:59.984814 3304 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Nov 4 23:20:59.991044 kubelet[3304]: I1104 23:20:59.990992 3304 server.go:317] "Adding debug handlers to kubelet server" Nov 4 23:21:00.019027 kubelet[3304]: I1104 23:21:00.018982 3304 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Nov 4 23:21:00.036503 kubelet[3304]: I1104 23:21:00.036009 3304 dynamic_serving_content.go:135] "Starting controller" name="kubelet-server-cert-files::/var/lib/kubelet/pki/kubelet.crt::/var/lib/kubelet/pki/kubelet.key" Nov 4 23:21:00.037030 kubelet[3304]: I1104 23:21:00.036988 3304 volume_manager.go:297] "Starting Kubelet Volume Manager" Nov 4 23:21:00.040380 kubelet[3304]: E1104 23:21:00.038912 3304 kubelet_node_status.go:466] "Error getting the current node from lister" err="node \"ip-172-31-23-127\" not found" Nov 4 23:21:00.041364 kubelet[3304]: I1104 23:21:00.041326 3304 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Nov 4 23:21:00.057031 kubelet[3304]: I1104 23:21:00.056982 3304 reconciler.go:26] "Reconciler: start to sync state" Nov 4 23:21:00.141060 kubelet[3304]: E1104 23:21:00.140053 3304 kubelet.go:1600] "Image garbage collection failed once. Stats initialization may not have completed yet" err="invalid capacity 0 on image filesystem" Nov 4 23:21:00.196430 kubelet[3304]: I1104 23:21:00.196394 3304 factory.go:223] Registration of the containerd container factory successfully Nov 4 23:21:00.199110 kubelet[3304]: I1104 23:21:00.197770 3304 factory.go:223] Registration of the systemd container factory successfully Nov 4 23:21:00.203133 kubelet[3304]: I1104 23:21:00.203083 3304 factory.go:221] Registration of the crio container factory failed: Get "http://%2Fvar%2Frun%2Fcrio%2Fcrio.sock/info": dial unix /var/run/crio/crio.sock: connect: no such file or directory Nov 4 23:21:00.276026 kubelet[3304]: I1104 23:21:00.273827 3304 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Nov 4 23:21:00.285071 kubelet[3304]: I1104 23:21:00.285028 3304 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Nov 4 23:21:00.285261 kubelet[3304]: I1104 23:21:00.285242 3304 status_manager.go:230] "Starting to sync pod status with apiserver" Nov 4 23:21:00.285403 kubelet[3304]: I1104 23:21:00.285379 3304 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Nov 4 23:21:00.289003 kubelet[3304]: I1104 23:21:00.288318 3304 kubelet.go:2436] "Starting kubelet main sync loop" Nov 4 23:21:00.296457 kubelet[3304]: E1104 23:21:00.296412 3304 kubelet.go:2460] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Nov 4 23:21:00.404038 kubelet[3304]: E1104 23:21:00.402974 3304 kubelet.go:2460] "Skipping pod synchronization" err="container runtime status check may not have completed yet" Nov 4 23:21:00.485127 kubelet[3304]: I1104 23:21:00.484550 3304 cpu_manager.go:221] "Starting CPU manager" policy="none" Nov 4 23:21:00.485127 kubelet[3304]: I1104 23:21:00.484586 3304 cpu_manager.go:222] "Reconciling" reconcilePeriod="10s" Nov 4 23:21:00.485127 kubelet[3304]: I1104 23:21:00.484620 3304 state_mem.go:36] "Initialized new in-memory state store" Nov 4 23:21:00.485127 kubelet[3304]: I1104 23:21:00.484837 3304 state_mem.go:88] "Updated default CPUSet" cpuSet="" Nov 4 23:21:00.485127 kubelet[3304]: I1104 23:21:00.484857 3304 state_mem.go:96] "Updated CPUSet assignments" assignments={} Nov 4 23:21:00.485127 kubelet[3304]: I1104 23:21:00.484886 3304 policy_none.go:49] "None policy: Start" Nov 4 23:21:00.485127 kubelet[3304]: I1104 23:21:00.484906 3304 memory_manager.go:186] "Starting memorymanager" policy="None" Nov 4 23:21:00.485127 kubelet[3304]: I1104 23:21:00.484980 3304 state_mem.go:35] "Initializing new in-memory state store" Nov 4 23:21:00.486264 kubelet[3304]: I1104 23:21:00.486209 3304 state_mem.go:75] "Updated machine memory state" Nov 4 23:21:00.504894 kubelet[3304]: E1104 23:21:00.504647 3304 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Nov 4 23:21:00.507980 kubelet[3304]: I1104 23:21:00.507938 3304 eviction_manager.go:189] "Eviction manager: starting control loop" Nov 4 23:21:00.508093 kubelet[3304]: I1104 23:21:00.507981 3304 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Nov 4 23:21:00.508500 kubelet[3304]: I1104 23:21:00.508451 3304 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Nov 4 23:21:00.514747 kubelet[3304]: E1104 23:21:00.514709 3304 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="no imagefs label for configured runtime" Nov 4 23:21:00.605343 kubelet[3304]: I1104 23:21:00.605247 3304 kubelet.go:3309] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-ip-172-31-23-127" Nov 4 23:21:00.609521 kubelet[3304]: I1104 23:21:00.609454 3304 kubelet.go:3309] "Creating a mirror pod for static pod" pod="kube-system/kube-controller-manager-ip-172-31-23-127" Nov 4 23:21:00.612937 kubelet[3304]: I1104 23:21:00.612330 3304 kubelet.go:3309] "Creating a mirror pod for static pod" pod="kube-system/kube-scheduler-ip-172-31-23-127" Nov 4 23:21:00.634662 kubelet[3304]: I1104 23:21:00.634535 3304 kubelet_node_status.go:75] "Attempting to register node" node="ip-172-31-23-127" Nov 4 23:21:00.673960 kubelet[3304]: E1104 23:21:00.672636 3304 kubelet.go:3311] "Failed creating a mirror pod" err="pods \"kube-apiserver-ip-172-31-23-127\" already exists" pod="kube-system/kube-apiserver-ip-172-31-23-127" Nov 4 23:21:00.684252 kubelet[3304]: I1104 23:21:00.684201 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-certs\" (UniqueName: \"kubernetes.io/host-path/b264570ee012d952c07deb1970e775e5-ca-certs\") pod \"kube-apiserver-ip-172-31-23-127\" (UID: \"b264570ee012d952c07deb1970e775e5\") " pod="kube-system/kube-apiserver-ip-172-31-23-127" Nov 4 23:21:00.687208 kubelet[3304]: I1104 23:21:00.686036 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"k8s-certs\" (UniqueName: \"kubernetes.io/host-path/b264570ee012d952c07deb1970e775e5-k8s-certs\") pod \"kube-apiserver-ip-172-31-23-127\" (UID: \"b264570ee012d952c07deb1970e775e5\") " pod="kube-system/kube-apiserver-ip-172-31-23-127" Nov 4 23:21:00.687208 kubelet[3304]: I1104 23:21:00.686120 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-share-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/b264570ee012d952c07deb1970e775e5-usr-share-ca-certificates\") pod \"kube-apiserver-ip-172-31-23-127\" (UID: \"b264570ee012d952c07deb1970e775e5\") " pod="kube-system/kube-apiserver-ip-172-31-23-127" Nov 4 23:21:00.687208 kubelet[3304]: I1104 23:21:00.686169 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"k8s-certs\" (UniqueName: \"kubernetes.io/host-path/d030c19ee8333db3194e108895ba79f8-k8s-certs\") pod \"kube-controller-manager-ip-172-31-23-127\" (UID: \"d030c19ee8333db3194e108895ba79f8\") " pod="kube-system/kube-controller-manager-ip-172-31-23-127" Nov 4 23:21:00.687208 kubelet[3304]: I1104 23:21:00.686219 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeconfig\" (UniqueName: \"kubernetes.io/host-path/d030c19ee8333db3194e108895ba79f8-kubeconfig\") pod \"kube-controller-manager-ip-172-31-23-127\" (UID: \"d030c19ee8333db3194e108895ba79f8\") " pod="kube-system/kube-controller-manager-ip-172-31-23-127" Nov 4 23:21:00.687208 kubelet[3304]: I1104 23:21:00.686267 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-share-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/d030c19ee8333db3194e108895ba79f8-usr-share-ca-certificates\") pod \"kube-controller-manager-ip-172-31-23-127\" (UID: \"d030c19ee8333db3194e108895ba79f8\") " pod="kube-system/kube-controller-manager-ip-172-31-23-127" Nov 4 23:21:00.687633 kubelet[3304]: I1104 23:21:00.686315 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeconfig\" (UniqueName: \"kubernetes.io/host-path/b6bbf81508644c64b91268745faee192-kubeconfig\") pod \"kube-scheduler-ip-172-31-23-127\" (UID: \"b6bbf81508644c64b91268745faee192\") " pod="kube-system/kube-scheduler-ip-172-31-23-127" Nov 4 23:21:00.687633 kubelet[3304]: I1104 23:21:00.686360 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-certs\" (UniqueName: \"kubernetes.io/host-path/d030c19ee8333db3194e108895ba79f8-ca-certs\") pod \"kube-controller-manager-ip-172-31-23-127\" (UID: \"d030c19ee8333db3194e108895ba79f8\") " pod="kube-system/kube-controller-manager-ip-172-31-23-127" Nov 4 23:21:00.687633 kubelet[3304]: I1104 23:21:00.686411 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"flexvolume-dir\" (UniqueName: \"kubernetes.io/host-path/d030c19ee8333db3194e108895ba79f8-flexvolume-dir\") pod \"kube-controller-manager-ip-172-31-23-127\" (UID: \"d030c19ee8333db3194e108895ba79f8\") " pod="kube-system/kube-controller-manager-ip-172-31-23-127" Nov 4 23:21:00.687633 kubelet[3304]: E1104 23:21:00.686827 3304 kubelet.go:3311] "Failed creating a mirror pod" err="pods \"kube-scheduler-ip-172-31-23-127\" already exists" pod="kube-system/kube-scheduler-ip-172-31-23-127" Nov 4 23:21:00.713959 kubelet[3304]: I1104 23:21:00.713862 3304 kubelet_node_status.go:124] "Node was previously registered" node="ip-172-31-23-127" Nov 4 23:21:00.715079 kubelet[3304]: I1104 23:21:00.715034 3304 kubelet_node_status.go:78] "Successfully registered node" node="ip-172-31-23-127" Nov 4 23:21:00.913029 kubelet[3304]: I1104 23:21:00.912986 3304 apiserver.go:52] "Watching apiserver" Nov 4 23:21:00.957986 kubelet[3304]: I1104 23:21:00.957441 3304 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Nov 4 23:21:01.037313 kubelet[3304]: I1104 23:21:01.037171 3304 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-ip-172-31-23-127" podStartSLOduration=3.037146456 podStartE2EDuration="3.037146456s" podCreationTimestamp="2025-11-04 23:20:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-04 23:21:01.036532272 +0000 UTC m=+1.413952352" watchObservedRunningTime="2025-11-04 23:21:01.037146456 +0000 UTC m=+1.414566536" Nov 4 23:21:01.072946 kubelet[3304]: I1104 23:21:01.072399 3304 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-scheduler-ip-172-31-23-127" podStartSLOduration=3.072377724 podStartE2EDuration="3.072377724s" podCreationTimestamp="2025-11-04 23:20:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-04 23:21:01.057638844 +0000 UTC m=+1.435058936" watchObservedRunningTime="2025-11-04 23:21:01.072377724 +0000 UTC m=+1.449797804" Nov 4 23:21:01.095120 kubelet[3304]: I1104 23:21:01.094510 3304 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-controller-manager-ip-172-31-23-127" podStartSLOduration=1.094488492 podStartE2EDuration="1.094488492s" podCreationTimestamp="2025-11-04 23:21:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-04 23:21:01.073008072 +0000 UTC m=+1.450428176" watchObservedRunningTime="2025-11-04 23:21:01.094488492 +0000 UTC m=+1.471908596" Nov 4 23:21:03.541688 kubelet[3304]: I1104 23:21:03.541623 3304 kuberuntime_manager.go:1746] "Updating runtime config through cri with podcidr" CIDR="192.168.0.0/24" Nov 4 23:21:03.543352 containerd[1974]: time="2025-11-04T23:21:03.543083464Z" level=info msg="No cni config template is specified, wait for other system components to drop the config." Nov 4 23:21:03.544383 kubelet[3304]: I1104 23:21:03.544198 3304 kubelet_network.go:61] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="192.168.0.0/24" Nov 4 23:21:04.269236 systemd[1]: Created slice kubepods-besteffort-pod99731c43_f8a5_4c52_8a86_c5390bee3030.slice - libcontainer container kubepods-besteffort-pod99731c43_f8a5_4c52_8a86_c5390bee3030.slice. Nov 4 23:21:04.313128 kubelet[3304]: I1104 23:21:04.312823 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzzcg\" (UniqueName: \"kubernetes.io/projected/99731c43-f8a5-4c52-8a86-c5390bee3030-kube-api-access-gzzcg\") pod \"kube-proxy-dlwln\" (UID: \"99731c43-f8a5-4c52-8a86-c5390bee3030\") " pod="kube-system/kube-proxy-dlwln" Nov 4 23:21:04.313838 kubelet[3304]: I1104 23:21:04.313776 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-proxy\" (UniqueName: \"kubernetes.io/configmap/99731c43-f8a5-4c52-8a86-c5390bee3030-kube-proxy\") pod \"kube-proxy-dlwln\" (UID: \"99731c43-f8a5-4c52-8a86-c5390bee3030\") " pod="kube-system/kube-proxy-dlwln" Nov 4 23:21:04.314454 kubelet[3304]: I1104 23:21:04.314011 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/99731c43-f8a5-4c52-8a86-c5390bee3030-xtables-lock\") pod \"kube-proxy-dlwln\" (UID: \"99731c43-f8a5-4c52-8a86-c5390bee3030\") " pod="kube-system/kube-proxy-dlwln" Nov 4 23:21:04.314826 kubelet[3304]: I1104 23:21:04.314582 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/99731c43-f8a5-4c52-8a86-c5390bee3030-lib-modules\") pod \"kube-proxy-dlwln\" (UID: \"99731c43-f8a5-4c52-8a86-c5390bee3030\") " pod="kube-system/kube-proxy-dlwln" Nov 4 23:21:04.582323 containerd[1974]: time="2025-11-04T23:21:04.581826689Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-proxy-dlwln,Uid:99731c43-f8a5-4c52-8a86-c5390bee3030,Namespace:kube-system,Attempt:0,}" Nov 4 23:21:04.626814 containerd[1974]: time="2025-11-04T23:21:04.626248073Z" level=info msg="connecting to shim f961865038a74d6b686a505e117d31299503682837839cdad5f3f5b8bc3fb7ea" address="unix:///run/containerd/s/818593f52235398f23ddd742e3add51066ee74b66b21d9d110674fba9a710b5e" namespace=k8s.io protocol=ttrpc version=3 Nov 4 23:21:04.684246 systemd[1]: Started cri-containerd-f961865038a74d6b686a505e117d31299503682837839cdad5f3f5b8bc3fb7ea.scope - libcontainer container f961865038a74d6b686a505e117d31299503682837839cdad5f3f5b8bc3fb7ea. Nov 4 23:21:04.768379 systemd[1]: Created slice kubepods-besteffort-pod0698d1a7_7eb3_44d6_af6a_98f5d0b39e9a.slice - libcontainer container kubepods-besteffort-pod0698d1a7_7eb3_44d6_af6a_98f5d0b39e9a.slice. Nov 4 23:21:04.819754 kubelet[3304]: I1104 23:21:04.819623 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f72ml\" (UniqueName: \"kubernetes.io/projected/0698d1a7-7eb3-44d6-af6a-98f5d0b39e9a-kube-api-access-f72ml\") pod \"tigera-operator-7dcd859c48-t7r6j\" (UID: \"0698d1a7-7eb3-44d6-af6a-98f5d0b39e9a\") " pod="tigera-operator/tigera-operator-7dcd859c48-t7r6j" Nov 4 23:21:04.821012 kubelet[3304]: I1104 23:21:04.820385 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-calico\" (UniqueName: \"kubernetes.io/host-path/0698d1a7-7eb3-44d6-af6a-98f5d0b39e9a-var-lib-calico\") pod \"tigera-operator-7dcd859c48-t7r6j\" (UID: \"0698d1a7-7eb3-44d6-af6a-98f5d0b39e9a\") " pod="tigera-operator/tigera-operator-7dcd859c48-t7r6j" Nov 4 23:21:04.821737 containerd[1974]: time="2025-11-04T23:21:04.821660550Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-proxy-dlwln,Uid:99731c43-f8a5-4c52-8a86-c5390bee3030,Namespace:kube-system,Attempt:0,} returns sandbox id \"f961865038a74d6b686a505e117d31299503682837839cdad5f3f5b8bc3fb7ea\"" Nov 4 23:21:04.833860 containerd[1974]: time="2025-11-04T23:21:04.833652594Z" level=info msg="CreateContainer within sandbox \"f961865038a74d6b686a505e117d31299503682837839cdad5f3f5b8bc3fb7ea\" for container &ContainerMetadata{Name:kube-proxy,Attempt:0,}" Nov 4 23:21:04.859206 containerd[1974]: time="2025-11-04T23:21:04.859129315Z" level=info msg="Container 54b661edda2a3738f133e8854bb0a262b8c48560f58fd7c05bc2bbab9de85366: CDI devices from CRI Config.CDIDevices: []" Nov 4 23:21:04.876564 containerd[1974]: time="2025-11-04T23:21:04.876495391Z" level=info msg="CreateContainer within sandbox \"f961865038a74d6b686a505e117d31299503682837839cdad5f3f5b8bc3fb7ea\" for &ContainerMetadata{Name:kube-proxy,Attempt:0,} returns container id \"54b661edda2a3738f133e8854bb0a262b8c48560f58fd7c05bc2bbab9de85366\"" Nov 4 23:21:04.877478 containerd[1974]: time="2025-11-04T23:21:04.877424155Z" level=info msg="StartContainer for \"54b661edda2a3738f133e8854bb0a262b8c48560f58fd7c05bc2bbab9de85366\"" Nov 4 23:21:04.881279 containerd[1974]: time="2025-11-04T23:21:04.881165791Z" level=info msg="connecting to shim 54b661edda2a3738f133e8854bb0a262b8c48560f58fd7c05bc2bbab9de85366" address="unix:///run/containerd/s/818593f52235398f23ddd742e3add51066ee74b66b21d9d110674fba9a710b5e" protocol=ttrpc version=3 Nov 4 23:21:04.919488 systemd[1]: Started cri-containerd-54b661edda2a3738f133e8854bb0a262b8c48560f58fd7c05bc2bbab9de85366.scope - libcontainer container 54b661edda2a3738f133e8854bb0a262b8c48560f58fd7c05bc2bbab9de85366. Nov 4 23:21:05.018373 containerd[1974]: time="2025-11-04T23:21:05.018220995Z" level=info msg="StartContainer for \"54b661edda2a3738f133e8854bb0a262b8c48560f58fd7c05bc2bbab9de85366\" returns successfully" Nov 4 23:21:05.078529 containerd[1974]: time="2025-11-04T23:21:05.078164704Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:tigera-operator-7dcd859c48-t7r6j,Uid:0698d1a7-7eb3-44d6-af6a-98f5d0b39e9a,Namespace:tigera-operator,Attempt:0,}" Nov 4 23:21:05.118500 containerd[1974]: time="2025-11-04T23:21:05.118352680Z" level=info msg="connecting to shim b70db2ee5836c3171f7a5f6644dfdf61e380ef8c4027532ac02c164f65c66c57" address="unix:///run/containerd/s/18eff8890ab0976dacbe3d54ba2558b962e3490061c4389fd2328a421b2ab7b7" namespace=k8s.io protocol=ttrpc version=3 Nov 4 23:21:05.179955 systemd[1]: Started cri-containerd-b70db2ee5836c3171f7a5f6644dfdf61e380ef8c4027532ac02c164f65c66c57.scope - libcontainer container b70db2ee5836c3171f7a5f6644dfdf61e380ef8c4027532ac02c164f65c66c57. Nov 4 23:21:05.280800 containerd[1974]: time="2025-11-04T23:21:05.280662389Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:tigera-operator-7dcd859c48-t7r6j,Uid:0698d1a7-7eb3-44d6-af6a-98f5d0b39e9a,Namespace:tigera-operator,Attempt:0,} returns sandbox id \"b70db2ee5836c3171f7a5f6644dfdf61e380ef8c4027532ac02c164f65c66c57\"" Nov 4 23:21:05.285870 containerd[1974]: time="2025-11-04T23:21:05.285821033Z" level=info msg="PullImage \"quay.io/tigera/operator:v1.38.7\"" Nov 4 23:21:05.408657 kubelet[3304]: I1104 23:21:05.408449 3304 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-proxy-dlwln" podStartSLOduration=1.408428861 podStartE2EDuration="1.408428861s" podCreationTimestamp="2025-11-04 23:21:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-04 23:21:05.408101081 +0000 UTC m=+5.785521173" watchObservedRunningTime="2025-11-04 23:21:05.408428861 +0000 UTC m=+5.785848941" Nov 4 23:21:06.928526 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount931009365.mount: Deactivated successfully. Nov 4 23:21:07.704573 containerd[1974]: time="2025-11-04T23:21:07.704516433Z" level=info msg="ImageCreate event name:\"quay.io/tigera/operator:v1.38.7\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:21:07.708072 containerd[1974]: time="2025-11-04T23:21:07.708012969Z" level=info msg="stop pulling image quay.io/tigera/operator:v1.38.7: active requests=0, bytes read=22152004" Nov 4 23:21:07.710063 containerd[1974]: time="2025-11-04T23:21:07.710005581Z" level=info msg="ImageCreate event name:\"sha256:19f52e4b7ea471a91d4186e9701288b905145dc20d4928cbbf2eac8d9dfce54b\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:21:07.714235 containerd[1974]: time="2025-11-04T23:21:07.714118425Z" level=info msg="ImageCreate event name:\"quay.io/tigera/operator@sha256:1b629a1403f5b6d7243f7dd523d04b8a50352a33c1d4d6970b6002a8733acf2e\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:21:07.715581 containerd[1974]: time="2025-11-04T23:21:07.715517709Z" level=info msg="Pulled image \"quay.io/tigera/operator:v1.38.7\" with image id \"sha256:19f52e4b7ea471a91d4186e9701288b905145dc20d4928cbbf2eac8d9dfce54b\", repo tag \"quay.io/tigera/operator:v1.38.7\", repo digest \"quay.io/tigera/operator@sha256:1b629a1403f5b6d7243f7dd523d04b8a50352a33c1d4d6970b6002a8733acf2e\", size \"22147999\" in 2.428392948s" Nov 4 23:21:07.715709 containerd[1974]: time="2025-11-04T23:21:07.715578405Z" level=info msg="PullImage \"quay.io/tigera/operator:v1.38.7\" returns image reference \"sha256:19f52e4b7ea471a91d4186e9701288b905145dc20d4928cbbf2eac8d9dfce54b\"" Nov 4 23:21:07.726379 containerd[1974]: time="2025-11-04T23:21:07.726333525Z" level=info msg="CreateContainer within sandbox \"b70db2ee5836c3171f7a5f6644dfdf61e380ef8c4027532ac02c164f65c66c57\" for container &ContainerMetadata{Name:tigera-operator,Attempt:0,}" Nov 4 23:21:07.739906 containerd[1974]: time="2025-11-04T23:21:07.739854705Z" level=info msg="Container b46c190b06fdfb1fb313b7fa7f5aadb00806914bd17552420c40ebc5550f241d: CDI devices from CRI Config.CDIDevices: []" Nov 4 23:21:07.749400 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount3632135770.mount: Deactivated successfully. Nov 4 23:21:07.759379 containerd[1974]: time="2025-11-04T23:21:07.759301065Z" level=info msg="CreateContainer within sandbox \"b70db2ee5836c3171f7a5f6644dfdf61e380ef8c4027532ac02c164f65c66c57\" for &ContainerMetadata{Name:tigera-operator,Attempt:0,} returns container id \"b46c190b06fdfb1fb313b7fa7f5aadb00806914bd17552420c40ebc5550f241d\"" Nov 4 23:21:07.762128 containerd[1974]: time="2025-11-04T23:21:07.760793757Z" level=info msg="StartContainer for \"b46c190b06fdfb1fb313b7fa7f5aadb00806914bd17552420c40ebc5550f241d\"" Nov 4 23:21:07.763035 containerd[1974]: time="2025-11-04T23:21:07.762986673Z" level=info msg="connecting to shim b46c190b06fdfb1fb313b7fa7f5aadb00806914bd17552420c40ebc5550f241d" address="unix:///run/containerd/s/18eff8890ab0976dacbe3d54ba2558b962e3490061c4389fd2328a421b2ab7b7" protocol=ttrpc version=3 Nov 4 23:21:07.806229 systemd[1]: Started cri-containerd-b46c190b06fdfb1fb313b7fa7f5aadb00806914bd17552420c40ebc5550f241d.scope - libcontainer container b46c190b06fdfb1fb313b7fa7f5aadb00806914bd17552420c40ebc5550f241d. Nov 4 23:21:07.861758 containerd[1974]: time="2025-11-04T23:21:07.861211413Z" level=info msg="StartContainer for \"b46c190b06fdfb1fb313b7fa7f5aadb00806914bd17552420c40ebc5550f241d\" returns successfully" Nov 4 23:21:09.206031 kubelet[3304]: I1104 23:21:09.205503 3304 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="tigera-operator/tigera-operator-7dcd859c48-t7r6j" podStartSLOduration=2.77196584 podStartE2EDuration="5.20545538s" podCreationTimestamp="2025-11-04 23:21:04 +0000 UTC" firstStartedPulling="2025-11-04 23:21:05.284124677 +0000 UTC m=+5.661544757" lastFinishedPulling="2025-11-04 23:21:07.717614217 +0000 UTC m=+8.095034297" observedRunningTime="2025-11-04 23:21:08.418871048 +0000 UTC m=+8.796291128" watchObservedRunningTime="2025-11-04 23:21:09.20545538 +0000 UTC m=+9.582875460" Nov 4 23:21:16.908264 sudo[2333]: pam_unix(sudo:session): session closed for user root Nov 4 23:21:16.934960 sshd[2332]: Connection closed by 139.178.89.65 port 38272 Nov 4 23:21:16.936145 sshd-session[2329]: pam_unix(sshd:session): session closed for user core Nov 4 23:21:16.945291 systemd-logind[1953]: Session 7 logged out. Waiting for processes to exit. Nov 4 23:21:16.946287 systemd[1]: sshd@6-172.31.23.127:22-139.178.89.65:38272.service: Deactivated successfully. Nov 4 23:21:16.953669 systemd[1]: session-7.scope: Deactivated successfully. Nov 4 23:21:16.954727 systemd[1]: session-7.scope: Consumed 10.909s CPU time, 226.8M memory peak. Nov 4 23:21:16.963194 systemd-logind[1953]: Removed session 7. Nov 4 23:21:36.278650 systemd[1]: Created slice kubepods-besteffort-pod7404b984_2983_49db_b946_4be1400115d0.slice - libcontainer container kubepods-besteffort-pod7404b984_2983_49db_b946_4be1400115d0.slice. Nov 4 23:21:36.349573 kubelet[3304]: I1104 23:21:36.349487 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tigera-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7404b984-2983-49db-b946-4be1400115d0-tigera-ca-bundle\") pod \"calico-typha-66f4cd6457-c9c6b\" (UID: \"7404b984-2983-49db-b946-4be1400115d0\") " pod="calico-system/calico-typha-66f4cd6457-c9c6b" Nov 4 23:21:36.350574 kubelet[3304]: I1104 23:21:36.349613 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"typha-certs\" (UniqueName: \"kubernetes.io/secret/7404b984-2983-49db-b946-4be1400115d0-typha-certs\") pod \"calico-typha-66f4cd6457-c9c6b\" (UID: \"7404b984-2983-49db-b946-4be1400115d0\") " pod="calico-system/calico-typha-66f4cd6457-c9c6b" Nov 4 23:21:36.350574 kubelet[3304]: I1104 23:21:36.349658 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9qrz\" (UniqueName: \"kubernetes.io/projected/7404b984-2983-49db-b946-4be1400115d0-kube-api-access-x9qrz\") pod \"calico-typha-66f4cd6457-c9c6b\" (UID: \"7404b984-2983-49db-b946-4be1400115d0\") " pod="calico-system/calico-typha-66f4cd6457-c9c6b" Nov 4 23:21:36.460049 systemd[1]: Created slice kubepods-besteffort-pod585a1876_2a8d_4508_9960_a53ec1e574e8.slice - libcontainer container kubepods-besteffort-pod585a1876_2a8d_4508_9960_a53ec1e574e8.slice. Nov 4 23:21:36.554492 kubelet[3304]: I1104 23:21:36.554087 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xjth\" (UniqueName: \"kubernetes.io/projected/585a1876-2a8d-4508-9960-a53ec1e574e8-kube-api-access-4xjth\") pod \"calico-node-jrpvk\" (UID: \"585a1876-2a8d-4508-9960-a53ec1e574e8\") " pod="calico-system/calico-node-jrpvk" Nov 4 23:21:36.555222 kubelet[3304]: I1104 23:21:36.554999 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-certs\" (UniqueName: \"kubernetes.io/secret/585a1876-2a8d-4508-9960-a53ec1e574e8-node-certs\") pod \"calico-node-jrpvk\" (UID: \"585a1876-2a8d-4508-9960-a53ec1e574e8\") " pod="calico-system/calico-node-jrpvk" Nov 4 23:21:36.555940 kubelet[3304]: I1104 23:21:36.555812 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/585a1876-2a8d-4508-9960-a53ec1e574e8-lib-modules\") pod \"calico-node-jrpvk\" (UID: \"585a1876-2a8d-4508-9960-a53ec1e574e8\") " pod="calico-system/calico-node-jrpvk" Nov 4 23:21:36.556321 kubelet[3304]: I1104 23:21:36.556201 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-calico\" (UniqueName: \"kubernetes.io/host-path/585a1876-2a8d-4508-9960-a53ec1e574e8-var-lib-calico\") pod \"calico-node-jrpvk\" (UID: \"585a1876-2a8d-4508-9960-a53ec1e574e8\") " pod="calico-system/calico-node-jrpvk" Nov 4 23:21:36.556772 kubelet[3304]: I1104 23:21:36.556643 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tigera-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/585a1876-2a8d-4508-9960-a53ec1e574e8-tigera-ca-bundle\") pod \"calico-node-jrpvk\" (UID: \"585a1876-2a8d-4508-9960-a53ec1e574e8\") " pod="calico-system/calico-node-jrpvk" Nov 4 23:21:36.557236 kubelet[3304]: I1104 23:21:36.557106 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-bin-dir\" (UniqueName: \"kubernetes.io/host-path/585a1876-2a8d-4508-9960-a53ec1e574e8-cni-bin-dir\") pod \"calico-node-jrpvk\" (UID: \"585a1876-2a8d-4508-9960-a53ec1e574e8\") " pod="calico-system/calico-node-jrpvk" Nov 4 23:21:36.557647 kubelet[3304]: I1104 23:21:36.557527 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-net-dir\" (UniqueName: \"kubernetes.io/host-path/585a1876-2a8d-4508-9960-a53ec1e574e8-cni-net-dir\") pod \"calico-node-jrpvk\" (UID: \"585a1876-2a8d-4508-9960-a53ec1e574e8\") " pod="calico-system/calico-node-jrpvk" Nov 4 23:21:36.558055 kubelet[3304]: I1104 23:21:36.558007 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"flexvol-driver-host\" (UniqueName: \"kubernetes.io/host-path/585a1876-2a8d-4508-9960-a53ec1e574e8-flexvol-driver-host\") pod \"calico-node-jrpvk\" (UID: \"585a1876-2a8d-4508-9960-a53ec1e574e8\") " pod="calico-system/calico-node-jrpvk" Nov 4 23:21:36.558674 kubelet[3304]: I1104 23:21:36.558522 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-log-dir\" (UniqueName: \"kubernetes.io/host-path/585a1876-2a8d-4508-9960-a53ec1e574e8-cni-log-dir\") pod \"calico-node-jrpvk\" (UID: \"585a1876-2a8d-4508-9960-a53ec1e574e8\") " pod="calico-system/calico-node-jrpvk" Nov 4 23:21:36.559096 kubelet[3304]: I1104 23:21:36.559055 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"policysync\" (UniqueName: \"kubernetes.io/host-path/585a1876-2a8d-4508-9960-a53ec1e574e8-policysync\") pod \"calico-node-jrpvk\" (UID: \"585a1876-2a8d-4508-9960-a53ec1e574e8\") " pod="calico-system/calico-node-jrpvk" Nov 4 23:21:36.559500 kubelet[3304]: I1104 23:21:36.559382 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/585a1876-2a8d-4508-9960-a53ec1e574e8-xtables-lock\") pod \"calico-node-jrpvk\" (UID: \"585a1876-2a8d-4508-9960-a53ec1e574e8\") " pod="calico-system/calico-node-jrpvk" Nov 4 23:21:36.560011 kubelet[3304]: I1104 23:21:36.559757 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-run-calico\" (UniqueName: \"kubernetes.io/host-path/585a1876-2a8d-4508-9960-a53ec1e574e8-var-run-calico\") pod \"calico-node-jrpvk\" (UID: \"585a1876-2a8d-4508-9960-a53ec1e574e8\") " pod="calico-system/calico-node-jrpvk" Nov 4 23:21:36.591723 kubelet[3304]: E1104 23:21:36.590413 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized" pod="calico-system/csi-node-driver-n5cdd" podUID="024e93aa-74ad-4ec2-b309-ed5d7023cfd9" Nov 4 23:21:36.591902 containerd[1974]: time="2025-11-04T23:21:36.591056088Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-typha-66f4cd6457-c9c6b,Uid:7404b984-2983-49db-b946-4be1400115d0,Namespace:calico-system,Attempt:0,}" Nov 4 23:21:36.666252 containerd[1974]: time="2025-11-04T23:21:36.666194941Z" level=info msg="connecting to shim d0edd6e09e8fcec8d6388062a77e9bf03a187bccebdbc91cde49a9015d372024" address="unix:///run/containerd/s/01cbfb5483a945a7153f48de3f9fb7fd12a5e14ea6735b8c24f982a1e6035226" namespace=k8s.io protocol=ttrpc version=3 Nov 4 23:21:36.667988 kubelet[3304]: E1104 23:21:36.667849 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.669265 kubelet[3304]: W1104 23:21:36.668411 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.669265 kubelet[3304]: E1104 23:21:36.668480 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.679957 kubelet[3304]: E1104 23:21:36.678455 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.679957 kubelet[3304]: W1104 23:21:36.678527 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.679957 kubelet[3304]: E1104 23:21:36.678563 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.684959 kubelet[3304]: E1104 23:21:36.681256 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.684959 kubelet[3304]: W1104 23:21:36.681313 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.684959 kubelet[3304]: E1104 23:21:36.681344 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.684959 kubelet[3304]: E1104 23:21:36.681709 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.684959 kubelet[3304]: W1104 23:21:36.681753 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.684959 kubelet[3304]: E1104 23:21:36.681840 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.684959 kubelet[3304]: E1104 23:21:36.682279 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.684959 kubelet[3304]: W1104 23:21:36.682298 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.684959 kubelet[3304]: E1104 23:21:36.682318 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.684959 kubelet[3304]: E1104 23:21:36.682747 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.691053 kubelet[3304]: W1104 23:21:36.682788 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.691053 kubelet[3304]: E1104 23:21:36.682812 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.691053 kubelet[3304]: E1104 23:21:36.684359 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.691053 kubelet[3304]: W1104 23:21:36.684403 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.691053 kubelet[3304]: E1104 23:21:36.684428 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.691053 kubelet[3304]: E1104 23:21:36.684784 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.691053 kubelet[3304]: W1104 23:21:36.684798 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.691053 kubelet[3304]: E1104 23:21:36.684839 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.691053 kubelet[3304]: E1104 23:21:36.686815 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.691053 kubelet[3304]: W1104 23:21:36.686847 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.691541 kubelet[3304]: E1104 23:21:36.686878 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.691541 kubelet[3304]: E1104 23:21:36.689377 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.691541 kubelet[3304]: W1104 23:21:36.689404 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.691541 kubelet[3304]: E1104 23:21:36.689434 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.691541 kubelet[3304]: E1104 23:21:36.689751 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.691541 kubelet[3304]: W1104 23:21:36.689766 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.691541 kubelet[3304]: E1104 23:21:36.689785 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.691541 kubelet[3304]: E1104 23:21:36.691138 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.691541 kubelet[3304]: W1104 23:21:36.691163 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.691541 kubelet[3304]: E1104 23:21:36.691192 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.696555 kubelet[3304]: E1104 23:21:36.691700 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.696555 kubelet[3304]: W1104 23:21:36.691717 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.696555 kubelet[3304]: E1104 23:21:36.691737 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.696555 kubelet[3304]: E1104 23:21:36.693492 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.696555 kubelet[3304]: W1104 23:21:36.693968 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.696555 kubelet[3304]: E1104 23:21:36.694013 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.697066 kubelet[3304]: E1104 23:21:36.696811 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.700808 kubelet[3304]: W1104 23:21:36.696837 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.700808 kubelet[3304]: E1104 23:21:36.697174 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.700808 kubelet[3304]: E1104 23:21:36.700400 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.701099 kubelet[3304]: W1104 23:21:36.700815 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.701099 kubelet[3304]: E1104 23:21:36.700856 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.703720 kubelet[3304]: E1104 23:21:36.703622 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.703720 kubelet[3304]: W1104 23:21:36.703664 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.703720 kubelet[3304]: E1104 23:21:36.703718 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.713151 kubelet[3304]: E1104 23:21:36.709120 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.713151 kubelet[3304]: W1104 23:21:36.709161 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.713151 kubelet[3304]: E1104 23:21:36.709195 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.713151 kubelet[3304]: E1104 23:21:36.711013 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.713151 kubelet[3304]: W1104 23:21:36.711042 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.713151 kubelet[3304]: E1104 23:21:36.711103 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.713151 kubelet[3304]: E1104 23:21:36.712189 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.713151 kubelet[3304]: W1104 23:21:36.713055 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.713151 kubelet[3304]: E1104 23:21:36.713085 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.713665 kubelet[3304]: E1104 23:21:36.713563 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.713665 kubelet[3304]: W1104 23:21:36.713585 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.713665 kubelet[3304]: E1104 23:21:36.713606 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.716270 kubelet[3304]: E1104 23:21:36.716216 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.716270 kubelet[3304]: W1104 23:21:36.716255 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.716464 kubelet[3304]: E1104 23:21:36.716289 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.721310 kubelet[3304]: E1104 23:21:36.721259 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.721310 kubelet[3304]: W1104 23:21:36.721298 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.721524 kubelet[3304]: E1104 23:21:36.721330 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.764728 kubelet[3304]: E1104 23:21:36.764613 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.764728 kubelet[3304]: W1104 23:21:36.764722 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.765140 kubelet[3304]: E1104 23:21:36.764756 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.765140 kubelet[3304]: I1104 23:21:36.764812 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/024e93aa-74ad-4ec2-b309-ed5d7023cfd9-kubelet-dir\") pod \"csi-node-driver-n5cdd\" (UID: \"024e93aa-74ad-4ec2-b309-ed5d7023cfd9\") " pod="calico-system/csi-node-driver-n5cdd" Nov 4 23:21:36.766801 kubelet[3304]: E1104 23:21:36.766756 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.766801 kubelet[3304]: W1104 23:21:36.766796 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.767037 kubelet[3304]: E1104 23:21:36.766829 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.767037 kubelet[3304]: I1104 23:21:36.766885 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/024e93aa-74ad-4ec2-b309-ed5d7023cfd9-registration-dir\") pod \"csi-node-driver-n5cdd\" (UID: \"024e93aa-74ad-4ec2-b309-ed5d7023cfd9\") " pod="calico-system/csi-node-driver-n5cdd" Nov 4 23:21:36.767597 kubelet[3304]: E1104 23:21:36.767570 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.767877 kubelet[3304]: W1104 23:21:36.767715 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.767877 kubelet[3304]: E1104 23:21:36.767749 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.768417 kubelet[3304]: E1104 23:21:36.768389 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.768815 kubelet[3304]: W1104 23:21:36.768508 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.768815 kubelet[3304]: E1104 23:21:36.768581 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.769435 kubelet[3304]: E1104 23:21:36.769291 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.769785 kubelet[3304]: W1104 23:21:36.769564 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.769785 kubelet[3304]: E1104 23:21:36.769599 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.770186 kubelet[3304]: E1104 23:21:36.770161 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.770326 kubelet[3304]: W1104 23:21:36.770300 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.770442 kubelet[3304]: E1104 23:21:36.770419 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.771236 kubelet[3304]: E1104 23:21:36.770966 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.771236 kubelet[3304]: W1104 23:21:36.770994 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.771236 kubelet[3304]: E1104 23:21:36.771022 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.771236 kubelet[3304]: I1104 23:21:36.771079 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/024e93aa-74ad-4ec2-b309-ed5d7023cfd9-socket-dir\") pod \"csi-node-driver-n5cdd\" (UID: \"024e93aa-74ad-4ec2-b309-ed5d7023cfd9\") " pod="calico-system/csi-node-driver-n5cdd" Nov 4 23:21:36.771732 kubelet[3304]: E1104 23:21:36.771705 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.772068 kubelet[3304]: W1104 23:21:36.771844 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.772068 kubelet[3304]: E1104 23:21:36.771880 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.772068 kubelet[3304]: I1104 23:21:36.771975 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49z2c\" (UniqueName: \"kubernetes.io/projected/024e93aa-74ad-4ec2-b309-ed5d7023cfd9-kube-api-access-49z2c\") pod \"csi-node-driver-n5cdd\" (UID: \"024e93aa-74ad-4ec2-b309-ed5d7023cfd9\") " pod="calico-system/csi-node-driver-n5cdd" Nov 4 23:21:36.772577 containerd[1974]: time="2025-11-04T23:21:36.772507765Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-node-jrpvk,Uid:585a1876-2a8d-4508-9960-a53ec1e574e8,Namespace:calico-system,Attempt:0,}" Nov 4 23:21:36.774739 kubelet[3304]: E1104 23:21:36.774688 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.774739 kubelet[3304]: W1104 23:21:36.774729 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.775104 kubelet[3304]: E1104 23:21:36.774764 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.777329 kubelet[3304]: E1104 23:21:36.777273 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.777329 kubelet[3304]: W1104 23:21:36.777312 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.777861 kubelet[3304]: E1104 23:21:36.777346 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.781006 kubelet[3304]: E1104 23:21:36.780505 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.781006 kubelet[3304]: W1104 23:21:36.780560 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.781006 kubelet[3304]: E1104 23:21:36.780596 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.781712 kubelet[3304]: I1104 23:21:36.781584 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"varrun\" (UniqueName: \"kubernetes.io/host-path/024e93aa-74ad-4ec2-b309-ed5d7023cfd9-varrun\") pod \"csi-node-driver-n5cdd\" (UID: \"024e93aa-74ad-4ec2-b309-ed5d7023cfd9\") " pod="calico-system/csi-node-driver-n5cdd" Nov 4 23:21:36.784321 kubelet[3304]: E1104 23:21:36.784200 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.784321 kubelet[3304]: W1104 23:21:36.784240 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.784321 kubelet[3304]: E1104 23:21:36.784274 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.785167 kubelet[3304]: E1104 23:21:36.784669 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.785167 kubelet[3304]: W1104 23:21:36.784689 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.785167 kubelet[3304]: E1104 23:21:36.784712 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.786952 kubelet[3304]: E1104 23:21:36.785733 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.786952 kubelet[3304]: W1104 23:21:36.785766 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.786952 kubelet[3304]: E1104 23:21:36.785799 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.787322 kubelet[3304]: E1104 23:21:36.787213 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.787322 kubelet[3304]: W1104 23:21:36.787237 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.787322 kubelet[3304]: E1104 23:21:36.787269 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.811084 systemd[1]: Started cri-containerd-d0edd6e09e8fcec8d6388062a77e9bf03a187bccebdbc91cde49a9015d372024.scope - libcontainer container d0edd6e09e8fcec8d6388062a77e9bf03a187bccebdbc91cde49a9015d372024. Nov 4 23:21:36.854249 containerd[1974]: time="2025-11-04T23:21:36.854111629Z" level=info msg="connecting to shim 174d599e856275ee6a58f174adb43ea931b7b70a4e43b2843d82efe492fdd33c" address="unix:///run/containerd/s/5d1abf79fb0f82835eac6de8519e846dab72f24982afed029c42a2c1a6242384" namespace=k8s.io protocol=ttrpc version=3 Nov 4 23:21:36.884609 kubelet[3304]: E1104 23:21:36.884561 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.884609 kubelet[3304]: W1104 23:21:36.884597 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.885154 kubelet[3304]: E1104 23:21:36.884630 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.885595 kubelet[3304]: E1104 23:21:36.885418 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.885595 kubelet[3304]: W1104 23:21:36.885569 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.886957 kubelet[3304]: E1104 23:21:36.885599 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.888069 kubelet[3304]: E1104 23:21:36.887558 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.888069 kubelet[3304]: W1104 23:21:36.887591 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.888069 kubelet[3304]: E1104 23:21:36.887622 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.889346 kubelet[3304]: E1104 23:21:36.888441 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.889346 kubelet[3304]: W1104 23:21:36.888469 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.889346 kubelet[3304]: E1104 23:21:36.888497 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.891416 kubelet[3304]: E1104 23:21:36.891380 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.892234 kubelet[3304]: W1104 23:21:36.891658 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.892719 kubelet[3304]: E1104 23:21:36.892677 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.894181 kubelet[3304]: E1104 23:21:36.894014 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.894181 kubelet[3304]: W1104 23:21:36.894046 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.894181 kubelet[3304]: E1104 23:21:36.894076 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.895364 kubelet[3304]: E1104 23:21:36.895302 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.895649 kubelet[3304]: W1104 23:21:36.895333 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.895649 kubelet[3304]: E1104 23:21:36.895537 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.896673 kubelet[3304]: E1104 23:21:36.896646 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.897010 kubelet[3304]: W1104 23:21:36.896784 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.897010 kubelet[3304]: E1104 23:21:36.896821 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.897972 kubelet[3304]: E1104 23:21:36.897886 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.898285 kubelet[3304]: W1104 23:21:36.898131 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.898285 kubelet[3304]: E1104 23:21:36.898182 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.899305 kubelet[3304]: E1104 23:21:36.899255 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.899674 kubelet[3304]: W1104 23:21:36.899493 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.899674 kubelet[3304]: E1104 23:21:36.899558 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.901068 kubelet[3304]: E1104 23:21:36.900860 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.901068 kubelet[3304]: W1104 23:21:36.900993 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.901068 kubelet[3304]: E1104 23:21:36.901023 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.903287 kubelet[3304]: E1104 23:21:36.903187 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.903792 kubelet[3304]: W1104 23:21:36.903473 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.903792 kubelet[3304]: E1104 23:21:36.903508 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.904879 kubelet[3304]: E1104 23:21:36.904839 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.905302 kubelet[3304]: W1104 23:21:36.904985 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.905302 kubelet[3304]: E1104 23:21:36.905015 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.906201 kubelet[3304]: E1104 23:21:36.906164 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.906629 kubelet[3304]: W1104 23:21:36.906300 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.906629 kubelet[3304]: E1104 23:21:36.906442 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.908152 kubelet[3304]: E1104 23:21:36.908015 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.908408 kubelet[3304]: W1104 23:21:36.908231 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.908677 kubelet[3304]: E1104 23:21:36.908268 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.909559 kubelet[3304]: E1104 23:21:36.909520 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.909835 kubelet[3304]: W1104 23:21:36.909659 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.909835 kubelet[3304]: E1104 23:21:36.909691 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.911166 kubelet[3304]: E1104 23:21:36.911033 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.911166 kubelet[3304]: W1104 23:21:36.911092 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.911166 kubelet[3304]: E1104 23:21:36.911122 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.914357 kubelet[3304]: E1104 23:21:36.914014 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.914357 kubelet[3304]: W1104 23:21:36.914055 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.914357 kubelet[3304]: E1104 23:21:36.914088 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.915018 kubelet[3304]: E1104 23:21:36.914738 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.915018 kubelet[3304]: W1104 23:21:36.914764 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.915018 kubelet[3304]: E1104 23:21:36.914789 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.915619 kubelet[3304]: E1104 23:21:36.915369 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.915619 kubelet[3304]: W1104 23:21:36.915394 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.915619 kubelet[3304]: E1104 23:21:36.915420 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.916018 kubelet[3304]: E1104 23:21:36.915996 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.917063 kubelet[3304]: W1104 23:21:36.916266 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.917063 kubelet[3304]: E1104 23:21:36.916304 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.917766 kubelet[3304]: E1104 23:21:36.917739 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.918007 kubelet[3304]: W1104 23:21:36.917979 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.918579 kubelet[3304]: E1104 23:21:36.918394 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.920550 kubelet[3304]: E1104 23:21:36.920342 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.920550 kubelet[3304]: W1104 23:21:36.920373 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.920550 kubelet[3304]: E1104 23:21:36.920403 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.922018 kubelet[3304]: E1104 23:21:36.921985 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.922336 kubelet[3304]: W1104 23:21:36.922178 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.922336 kubelet[3304]: E1104 23:21:36.922218 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.923241 kubelet[3304]: E1104 23:21:36.923211 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.923642 kubelet[3304]: W1104 23:21:36.923392 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.923642 kubelet[3304]: E1104 23:21:36.923458 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.939978 systemd[1]: Started cri-containerd-174d599e856275ee6a58f174adb43ea931b7b70a4e43b2843d82efe492fdd33c.scope - libcontainer container 174d599e856275ee6a58f174adb43ea931b7b70a4e43b2843d82efe492fdd33c. Nov 4 23:21:36.954796 kubelet[3304]: E1104 23:21:36.954745 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:36.955268 kubelet[3304]: W1104 23:21:36.954825 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:36.955268 kubelet[3304]: E1104 23:21:36.954859 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:36.992726 containerd[1974]: time="2025-11-04T23:21:36.992560586Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-typha-66f4cd6457-c9c6b,Uid:7404b984-2983-49db-b946-4be1400115d0,Namespace:calico-system,Attempt:0,} returns sandbox id \"d0edd6e09e8fcec8d6388062a77e9bf03a187bccebdbc91cde49a9015d372024\"" Nov 4 23:21:37.001313 containerd[1974]: time="2025-11-04T23:21:37.000858298Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/typha:v3.30.4\"" Nov 4 23:21:37.049590 containerd[1974]: time="2025-11-04T23:21:37.049426570Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-node-jrpvk,Uid:585a1876-2a8d-4508-9960-a53ec1e574e8,Namespace:calico-system,Attempt:0,} returns sandbox id \"174d599e856275ee6a58f174adb43ea931b7b70a4e43b2843d82efe492fdd33c\"" Nov 4 23:21:38.198979 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount1197511264.mount: Deactivated successfully. Nov 4 23:21:38.299504 kubelet[3304]: E1104 23:21:38.299452 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized" pod="calico-system/csi-node-driver-n5cdd" podUID="024e93aa-74ad-4ec2-b309-ed5d7023cfd9" Nov 4 23:21:38.961959 containerd[1974]: time="2025-11-04T23:21:38.961127200Z" level=info msg="ImageCreate event name:\"ghcr.io/flatcar/calico/typha:v3.30.4\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:21:38.963343 containerd[1974]: time="2025-11-04T23:21:38.963291748Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/typha:v3.30.4: active requests=0, bytes read=33090687" Nov 4 23:21:38.964540 containerd[1974]: time="2025-11-04T23:21:38.964477216Z" level=info msg="ImageCreate event name:\"sha256:5fe38d12a54098df5aaf5ec7228dc2f976f60cb4f434d7256f03126b004fdc5b\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:21:38.971758 containerd[1974]: time="2025-11-04T23:21:38.971678788Z" level=info msg="ImageCreate event name:\"ghcr.io/flatcar/calico/typha@sha256:6f437220b5b3c627fb4a0fc8dc323363101f3c22a8f337612c2a1ddfb73b810c\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:21:38.973765 containerd[1974]: time="2025-11-04T23:21:38.973332292Z" level=info msg="Pulled image \"ghcr.io/flatcar/calico/typha:v3.30.4\" with image id \"sha256:5fe38d12a54098df5aaf5ec7228dc2f976f60cb4f434d7256f03126b004fdc5b\", repo tag \"ghcr.io/flatcar/calico/typha:v3.30.4\", repo digest \"ghcr.io/flatcar/calico/typha@sha256:6f437220b5b3c627fb4a0fc8dc323363101f3c22a8f337612c2a1ddfb73b810c\", size \"33090541\" in 1.972250314s" Nov 4 23:21:38.973765 containerd[1974]: time="2025-11-04T23:21:38.973390720Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/typha:v3.30.4\" returns image reference \"sha256:5fe38d12a54098df5aaf5ec7228dc2f976f60cb4f434d7256f03126b004fdc5b\"" Nov 4 23:21:38.978834 containerd[1974]: time="2025-11-04T23:21:38.978317212Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/pod2daemon-flexvol:v3.30.4\"" Nov 4 23:21:39.022824 containerd[1974]: time="2025-11-04T23:21:39.022764108Z" level=info msg="CreateContainer within sandbox \"d0edd6e09e8fcec8d6388062a77e9bf03a187bccebdbc91cde49a9015d372024\" for container &ContainerMetadata{Name:calico-typha,Attempt:0,}" Nov 4 23:21:39.040116 containerd[1974]: time="2025-11-04T23:21:39.040040484Z" level=info msg="Container 5a66f8eb89e8c0d2e83ee1e4a252bd99002fab4fba5917eeaccfad8b839438b1: CDI devices from CRI Config.CDIDevices: []" Nov 4 23:21:39.059080 containerd[1974]: time="2025-11-04T23:21:39.059005608Z" level=info msg="CreateContainer within sandbox \"d0edd6e09e8fcec8d6388062a77e9bf03a187bccebdbc91cde49a9015d372024\" for &ContainerMetadata{Name:calico-typha,Attempt:0,} returns container id \"5a66f8eb89e8c0d2e83ee1e4a252bd99002fab4fba5917eeaccfad8b839438b1\"" Nov 4 23:21:39.061255 containerd[1974]: time="2025-11-04T23:21:39.061181436Z" level=info msg="StartContainer for \"5a66f8eb89e8c0d2e83ee1e4a252bd99002fab4fba5917eeaccfad8b839438b1\"" Nov 4 23:21:39.064483 containerd[1974]: time="2025-11-04T23:21:39.064387968Z" level=info msg="connecting to shim 5a66f8eb89e8c0d2e83ee1e4a252bd99002fab4fba5917eeaccfad8b839438b1" address="unix:///run/containerd/s/01cbfb5483a945a7153f48de3f9fb7fd12a5e14ea6735b8c24f982a1e6035226" protocol=ttrpc version=3 Nov 4 23:21:39.107224 systemd[1]: Started cri-containerd-5a66f8eb89e8c0d2e83ee1e4a252bd99002fab4fba5917eeaccfad8b839438b1.scope - libcontainer container 5a66f8eb89e8c0d2e83ee1e4a252bd99002fab4fba5917eeaccfad8b839438b1. Nov 4 23:21:39.190267 containerd[1974]: time="2025-11-04T23:21:39.190213009Z" level=info msg="StartContainer for \"5a66f8eb89e8c0d2e83ee1e4a252bd99002fab4fba5917eeaccfad8b839438b1\" returns successfully" Nov 4 23:21:39.540130 kubelet[3304]: E1104 23:21:39.540070 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:39.541458 kubelet[3304]: W1104 23:21:39.540740 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:39.541458 kubelet[3304]: E1104 23:21:39.541016 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:39.541885 kubelet[3304]: E1104 23:21:39.541727 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:39.542872 kubelet[3304]: W1104 23:21:39.541747 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:39.542872 kubelet[3304]: E1104 23:21:39.542119 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:39.544204 kubelet[3304]: E1104 23:21:39.543975 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:39.544204 kubelet[3304]: W1104 23:21:39.544006 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:39.544204 kubelet[3304]: E1104 23:21:39.544036 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:39.546621 kubelet[3304]: E1104 23:21:39.546035 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:39.546861 kubelet[3304]: W1104 23:21:39.546800 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:39.547095 kubelet[3304]: E1104 23:21:39.547016 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:39.548271 kubelet[3304]: E1104 23:21:39.548001 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:39.548271 kubelet[3304]: W1104 23:21:39.548050 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:39.548271 kubelet[3304]: E1104 23:21:39.548082 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:39.548732 kubelet[3304]: E1104 23:21:39.548649 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:39.548732 kubelet[3304]: W1104 23:21:39.548678 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:39.549074 kubelet[3304]: E1104 23:21:39.549043 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:39.550091 kubelet[3304]: E1104 23:21:39.549857 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:39.550438 kubelet[3304]: W1104 23:21:39.550184 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:39.550438 kubelet[3304]: E1104 23:21:39.550220 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:39.551947 kubelet[3304]: E1104 23:21:39.551818 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:39.551947 kubelet[3304]: W1104 23:21:39.551874 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:39.552341 kubelet[3304]: E1104 23:21:39.552170 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:39.553298 kubelet[3304]: E1104 23:21:39.553236 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:39.553717 kubelet[3304]: W1104 23:21:39.553268 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:39.553717 kubelet[3304]: E1104 23:21:39.553502 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:39.554486 kubelet[3304]: E1104 23:21:39.554318 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:39.555049 kubelet[3304]: W1104 23:21:39.554649 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:39.555049 kubelet[3304]: E1104 23:21:39.554707 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:39.555645 kubelet[3304]: E1104 23:21:39.555458 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:39.556264 kubelet[3304]: W1104 23:21:39.555795 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:39.556264 kubelet[3304]: E1104 23:21:39.555840 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:39.557985 kubelet[3304]: E1104 23:21:39.557203 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:39.558193 kubelet[3304]: W1104 23:21:39.558154 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:39.558359 kubelet[3304]: E1104 23:21:39.558327 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:39.558868 kubelet[3304]: E1104 23:21:39.558842 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:39.559293 kubelet[3304]: W1104 23:21:39.559088 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:39.559293 kubelet[3304]: E1104 23:21:39.559130 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:39.560134 kubelet[3304]: E1104 23:21:39.560099 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:39.560514 kubelet[3304]: W1104 23:21:39.560283 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:39.560514 kubelet[3304]: E1104 23:21:39.560320 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:39.560844 kubelet[3304]: E1104 23:21:39.560821 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:39.561139 kubelet[3304]: W1104 23:21:39.561005 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:39.561139 kubelet[3304]: E1104 23:21:39.561039 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:39.609942 kubelet[3304]: I1104 23:21:39.609420 3304 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="calico-system/calico-typha-66f4cd6457-c9c6b" podStartSLOduration=1.632860273 podStartE2EDuration="3.609397719s" podCreationTimestamp="2025-11-04 23:21:36 +0000 UTC" firstStartedPulling="2025-11-04 23:21:36.998847794 +0000 UTC m=+37.376267862" lastFinishedPulling="2025-11-04 23:21:38.97538524 +0000 UTC m=+39.352805308" observedRunningTime="2025-11-04 23:21:39.546266823 +0000 UTC m=+39.923686903" watchObservedRunningTime="2025-11-04 23:21:39.609397719 +0000 UTC m=+39.986817799" Nov 4 23:21:39.623460 kubelet[3304]: E1104 23:21:39.623422 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:39.623703 kubelet[3304]: W1104 23:21:39.623673 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:39.623900 kubelet[3304]: E1104 23:21:39.623773 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:39.625057 kubelet[3304]: E1104 23:21:39.625021 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:39.627090 kubelet[3304]: W1104 23:21:39.625306 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:39.627407 kubelet[3304]: E1104 23:21:39.627330 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:39.628125 kubelet[3304]: E1104 23:21:39.628094 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:39.628343 kubelet[3304]: W1104 23:21:39.628270 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:39.628343 kubelet[3304]: E1104 23:21:39.628309 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:39.629386 kubelet[3304]: E1104 23:21:39.629124 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:39.629386 kubelet[3304]: W1104 23:21:39.629156 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:39.629386 kubelet[3304]: E1104 23:21:39.629184 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:39.629854 kubelet[3304]: E1104 23:21:39.629807 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:39.631130 kubelet[3304]: W1104 23:21:39.631081 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:39.631321 kubelet[3304]: E1104 23:21:39.631296 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:39.632162 kubelet[3304]: E1104 23:21:39.631946 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:39.632162 kubelet[3304]: W1104 23:21:39.631975 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:39.632162 kubelet[3304]: E1104 23:21:39.631999 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:39.632619 kubelet[3304]: E1104 23:21:39.632558 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:39.632619 kubelet[3304]: W1104 23:21:39.632582 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:39.632850 kubelet[3304]: E1104 23:21:39.632767 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:39.634695 kubelet[3304]: E1104 23:21:39.634510 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:39.634695 kubelet[3304]: W1104 23:21:39.634547 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:39.634695 kubelet[3304]: E1104 23:21:39.634579 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:39.635477 kubelet[3304]: E1104 23:21:39.635308 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:39.635477 kubelet[3304]: W1104 23:21:39.635343 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:39.635477 kubelet[3304]: E1104 23:21:39.635371 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:39.636979 kubelet[3304]: E1104 23:21:39.636789 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:39.636979 kubelet[3304]: W1104 23:21:39.636825 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:39.636979 kubelet[3304]: E1104 23:21:39.636885 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:39.638041 kubelet[3304]: E1104 23:21:39.637989 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:39.639213 kubelet[3304]: W1104 23:21:39.638030 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:39.639213 kubelet[3304]: E1104 23:21:39.638092 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:39.639411 kubelet[3304]: E1104 23:21:39.639371 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:39.639479 kubelet[3304]: W1104 23:21:39.639407 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:39.639479 kubelet[3304]: E1104 23:21:39.639467 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:39.641211 kubelet[3304]: E1104 23:21:39.641158 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:39.641211 kubelet[3304]: W1104 23:21:39.641199 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:39.643151 kubelet[3304]: E1104 23:21:39.641233 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:39.643214 kubelet[3304]: E1104 23:21:39.643191 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:39.643263 kubelet[3304]: W1104 23:21:39.643220 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:39.643312 kubelet[3304]: E1104 23:21:39.643280 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:39.643850 kubelet[3304]: E1104 23:21:39.643809 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:39.643850 kubelet[3304]: W1104 23:21:39.643840 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:39.646175 kubelet[3304]: E1104 23:21:39.643893 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:39.646175 kubelet[3304]: E1104 23:21:39.645144 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:39.646175 kubelet[3304]: W1104 23:21:39.645189 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:39.646175 kubelet[3304]: E1104 23:21:39.645221 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:39.648203 kubelet[3304]: E1104 23:21:39.648098 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:39.648203 kubelet[3304]: W1104 23:21:39.648135 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:39.648203 kubelet[3304]: E1104 23:21:39.648167 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:39.649437 kubelet[3304]: E1104 23:21:39.649314 3304 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Nov 4 23:21:39.649437 kubelet[3304]: W1104 23:21:39.649348 3304 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Nov 4 23:21:39.649437 kubelet[3304]: E1104 23:21:39.649378 3304 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Nov 4 23:21:40.223182 containerd[1974]: time="2025-11-04T23:21:40.223104122Z" level=info msg="ImageCreate event name:\"ghcr.io/flatcar/calico/pod2daemon-flexvol:v3.30.4\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:21:40.225104 containerd[1974]: time="2025-11-04T23:21:40.225031658Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/pod2daemon-flexvol:v3.30.4: active requests=0, bytes read=4266741" Nov 4 23:21:40.227546 containerd[1974]: time="2025-11-04T23:21:40.227472350Z" level=info msg="ImageCreate event name:\"sha256:90ff755393144dc5a3c05f95ffe1a3ecd2f89b98ecf36d9e4721471b80af4640\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:21:40.231942 containerd[1974]: time="2025-11-04T23:21:40.231834446Z" level=info msg="ImageCreate event name:\"ghcr.io/flatcar/calico/pod2daemon-flexvol@sha256:50bdfe370b7308fa9957ed1eaccd094aa4f27f9a4f1dfcfef2f8a7696a1551e1\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:21:40.233863 containerd[1974]: time="2025-11-04T23:21:40.233113334Z" level=info msg="Pulled image \"ghcr.io/flatcar/calico/pod2daemon-flexvol:v3.30.4\" with image id \"sha256:90ff755393144dc5a3c05f95ffe1a3ecd2f89b98ecf36d9e4721471b80af4640\", repo tag \"ghcr.io/flatcar/calico/pod2daemon-flexvol:v3.30.4\", repo digest \"ghcr.io/flatcar/calico/pod2daemon-flexvol@sha256:50bdfe370b7308fa9957ed1eaccd094aa4f27f9a4f1dfcfef2f8a7696a1551e1\", size \"5636392\" in 1.254737178s" Nov 4 23:21:40.233863 containerd[1974]: time="2025-11-04T23:21:40.233177366Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/pod2daemon-flexvol:v3.30.4\" returns image reference \"sha256:90ff755393144dc5a3c05f95ffe1a3ecd2f89b98ecf36d9e4721471b80af4640\"" Nov 4 23:21:40.242835 containerd[1974]: time="2025-11-04T23:21:40.242768150Z" level=info msg="CreateContainer within sandbox \"174d599e856275ee6a58f174adb43ea931b7b70a4e43b2843d82efe492fdd33c\" for container &ContainerMetadata{Name:flexvol-driver,Attempt:0,}" Nov 4 23:21:40.260960 containerd[1974]: time="2025-11-04T23:21:40.260109722Z" level=info msg="Container d948d39039d8b478c3d35338061babd9a442356bf0c95cac60da8904c8dbbff6: CDI devices from CRI Config.CDIDevices: []" Nov 4 23:21:40.283544 containerd[1974]: time="2025-11-04T23:21:40.283457714Z" level=info msg="CreateContainer within sandbox \"174d599e856275ee6a58f174adb43ea931b7b70a4e43b2843d82efe492fdd33c\" for &ContainerMetadata{Name:flexvol-driver,Attempt:0,} returns container id \"d948d39039d8b478c3d35338061babd9a442356bf0c95cac60da8904c8dbbff6\"" Nov 4 23:21:40.285565 containerd[1974]: time="2025-11-04T23:21:40.285090374Z" level=info msg="StartContainer for \"d948d39039d8b478c3d35338061babd9a442356bf0c95cac60da8904c8dbbff6\"" Nov 4 23:21:40.288703 containerd[1974]: time="2025-11-04T23:21:40.288650883Z" level=info msg="connecting to shim d948d39039d8b478c3d35338061babd9a442356bf0c95cac60da8904c8dbbff6" address="unix:///run/containerd/s/5d1abf79fb0f82835eac6de8519e846dab72f24982afed029c42a2c1a6242384" protocol=ttrpc version=3 Nov 4 23:21:40.298332 kubelet[3304]: E1104 23:21:40.297815 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized" pod="calico-system/csi-node-driver-n5cdd" podUID="024e93aa-74ad-4ec2-b309-ed5d7023cfd9" Nov 4 23:21:40.337253 systemd[1]: Started cri-containerd-d948d39039d8b478c3d35338061babd9a442356bf0c95cac60da8904c8dbbff6.scope - libcontainer container d948d39039d8b478c3d35338061babd9a442356bf0c95cac60da8904c8dbbff6. Nov 4 23:21:40.428385 containerd[1974]: time="2025-11-04T23:21:40.428339415Z" level=info msg="StartContainer for \"d948d39039d8b478c3d35338061babd9a442356bf0c95cac60da8904c8dbbff6\" returns successfully" Nov 4 23:21:40.458208 systemd[1]: cri-containerd-d948d39039d8b478c3d35338061babd9a442356bf0c95cac60da8904c8dbbff6.scope: Deactivated successfully. Nov 4 23:21:40.464478 containerd[1974]: time="2025-11-04T23:21:40.464415519Z" level=info msg="TaskExit event in podsandbox handler container_id:\"d948d39039d8b478c3d35338061babd9a442356bf0c95cac60da8904c8dbbff6\" id:\"d948d39039d8b478c3d35338061babd9a442356bf0c95cac60da8904c8dbbff6\" pid:4172 exited_at:{seconds:1762298500 nanos:463465227}" Nov 4 23:21:40.464632 containerd[1974]: time="2025-11-04T23:21:40.464471895Z" level=info msg="received exit event container_id:\"d948d39039d8b478c3d35338061babd9a442356bf0c95cac60da8904c8dbbff6\" id:\"d948d39039d8b478c3d35338061babd9a442356bf0c95cac60da8904c8dbbff6\" pid:4172 exited_at:{seconds:1762298500 nanos:463465227}" Nov 4 23:21:40.506649 systemd[1]: run-containerd-io.containerd.runtime.v2.task-k8s.io-d948d39039d8b478c3d35338061babd9a442356bf0c95cac60da8904c8dbbff6-rootfs.mount: Deactivated successfully. Nov 4 23:21:41.539641 containerd[1974]: time="2025-11-04T23:21:41.539394245Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/cni:v3.30.4\"" Nov 4 23:21:42.298458 kubelet[3304]: E1104 23:21:42.297383 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized" pod="calico-system/csi-node-driver-n5cdd" podUID="024e93aa-74ad-4ec2-b309-ed5d7023cfd9" Nov 4 23:21:44.297931 kubelet[3304]: E1104 23:21:44.297862 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized" pod="calico-system/csi-node-driver-n5cdd" podUID="024e93aa-74ad-4ec2-b309-ed5d7023cfd9" Nov 4 23:21:44.397862 containerd[1974]: time="2025-11-04T23:21:44.396592915Z" level=info msg="ImageCreate event name:\"ghcr.io/flatcar/calico/cni:v3.30.4\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:21:44.397862 containerd[1974]: time="2025-11-04T23:21:44.397809883Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/cni:v3.30.4: active requests=0, bytes read=65925816" Nov 4 23:21:44.398768 containerd[1974]: time="2025-11-04T23:21:44.398692183Z" level=info msg="ImageCreate event name:\"sha256:e60d442b6496497355efdf45eaa3ea72f5a2b28a5187aeab33442933f3c735d2\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:21:44.402241 containerd[1974]: time="2025-11-04T23:21:44.402177127Z" level=info msg="ImageCreate event name:\"ghcr.io/flatcar/calico/cni@sha256:273501a9cfbd848ade2b6a8452dfafdd3adb4f9bf9aec45c398a5d19b8026627\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:21:44.403803 containerd[1974]: time="2025-11-04T23:21:44.403756147Z" level=info msg="Pulled image \"ghcr.io/flatcar/calico/cni:v3.30.4\" with image id \"sha256:e60d442b6496497355efdf45eaa3ea72f5a2b28a5187aeab33442933f3c735d2\", repo tag \"ghcr.io/flatcar/calico/cni:v3.30.4\", repo digest \"ghcr.io/flatcar/calico/cni@sha256:273501a9cfbd848ade2b6a8452dfafdd3adb4f9bf9aec45c398a5d19b8026627\", size \"67295507\" in 2.863375574s" Nov 4 23:21:44.403988 containerd[1974]: time="2025-11-04T23:21:44.403959007Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/cni:v3.30.4\" returns image reference \"sha256:e60d442b6496497355efdf45eaa3ea72f5a2b28a5187aeab33442933f3c735d2\"" Nov 4 23:21:44.412168 containerd[1974]: time="2025-11-04T23:21:44.411892843Z" level=info msg="CreateContainer within sandbox \"174d599e856275ee6a58f174adb43ea931b7b70a4e43b2843d82efe492fdd33c\" for container &ContainerMetadata{Name:install-cni,Attempt:0,}" Nov 4 23:21:44.432818 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount2920829443.mount: Deactivated successfully. Nov 4 23:21:44.435614 containerd[1974]: time="2025-11-04T23:21:44.434431807Z" level=info msg="Container 4cff79d32740c9c8e445ba63e3d96cf489928e8a5ae2b5614068cf8fe8d0c309: CDI devices from CRI Config.CDIDevices: []" Nov 4 23:21:44.453041 containerd[1974]: time="2025-11-04T23:21:44.452989675Z" level=info msg="CreateContainer within sandbox \"174d599e856275ee6a58f174adb43ea931b7b70a4e43b2843d82efe492fdd33c\" for &ContainerMetadata{Name:install-cni,Attempt:0,} returns container id \"4cff79d32740c9c8e445ba63e3d96cf489928e8a5ae2b5614068cf8fe8d0c309\"" Nov 4 23:21:44.454299 containerd[1974]: time="2025-11-04T23:21:44.454231123Z" level=info msg="StartContainer for \"4cff79d32740c9c8e445ba63e3d96cf489928e8a5ae2b5614068cf8fe8d0c309\"" Nov 4 23:21:44.457784 containerd[1974]: time="2025-11-04T23:21:44.457724539Z" level=info msg="connecting to shim 4cff79d32740c9c8e445ba63e3d96cf489928e8a5ae2b5614068cf8fe8d0c309" address="unix:///run/containerd/s/5d1abf79fb0f82835eac6de8519e846dab72f24982afed029c42a2c1a6242384" protocol=ttrpc version=3 Nov 4 23:21:44.495276 systemd[1]: Started cri-containerd-4cff79d32740c9c8e445ba63e3d96cf489928e8a5ae2b5614068cf8fe8d0c309.scope - libcontainer container 4cff79d32740c9c8e445ba63e3d96cf489928e8a5ae2b5614068cf8fe8d0c309. Nov 4 23:21:44.593408 containerd[1974]: time="2025-11-04T23:21:44.593246588Z" level=info msg="StartContainer for \"4cff79d32740c9c8e445ba63e3d96cf489928e8a5ae2b5614068cf8fe8d0c309\" returns successfully" Nov 4 23:21:45.542793 systemd[1]: cri-containerd-4cff79d32740c9c8e445ba63e3d96cf489928e8a5ae2b5614068cf8fe8d0c309.scope: Deactivated successfully. Nov 4 23:21:45.543352 systemd[1]: cri-containerd-4cff79d32740c9c8e445ba63e3d96cf489928e8a5ae2b5614068cf8fe8d0c309.scope: Consumed 940ms CPU time, 184M memory peak, 165.9M written to disk. Nov 4 23:21:45.547864 containerd[1974]: time="2025-11-04T23:21:45.547641813Z" level=info msg="received exit event container_id:\"4cff79d32740c9c8e445ba63e3d96cf489928e8a5ae2b5614068cf8fe8d0c309\" id:\"4cff79d32740c9c8e445ba63e3d96cf489928e8a5ae2b5614068cf8fe8d0c309\" pid:4233 exited_at:{seconds:1762298505 nanos:547273941}" Nov 4 23:21:45.548736 containerd[1974]: time="2025-11-04T23:21:45.548338905Z" level=info msg="TaskExit event in podsandbox handler container_id:\"4cff79d32740c9c8e445ba63e3d96cf489928e8a5ae2b5614068cf8fe8d0c309\" id:\"4cff79d32740c9c8e445ba63e3d96cf489928e8a5ae2b5614068cf8fe8d0c309\" pid:4233 exited_at:{seconds:1762298505 nanos:547273941}" Nov 4 23:21:45.601354 kubelet[3304]: I1104 23:21:45.600905 3304 kubelet_node_status.go:501] "Fast updating node status as it just became ready" Nov 4 23:21:45.625822 systemd[1]: run-containerd-io.containerd.runtime.v2.task-k8s.io-4cff79d32740c9c8e445ba63e3d96cf489928e8a5ae2b5614068cf8fe8d0c309-rootfs.mount: Deactivated successfully. Nov 4 23:21:45.705660 systemd[1]: Created slice kubepods-burstable-podc8ee1bb8_dd7e_475b_8eb7_dab815e66227.slice - libcontainer container kubepods-burstable-podc8ee1bb8_dd7e_475b_8eb7_dab815e66227.slice. Nov 4 23:21:45.757369 systemd[1]: Created slice kubepods-besteffort-pod6c8eb056_a29a_4a21_b501_58521c19fc76.slice - libcontainer container kubepods-besteffort-pod6c8eb056_a29a_4a21_b501_58521c19fc76.slice. Nov 4 23:21:45.778360 systemd[1]: Created slice kubepods-besteffort-poda2dd6680_1f53_4788_9ae9_bffdb1850825.slice - libcontainer container kubepods-besteffort-poda2dd6680_1f53_4788_9ae9_bffdb1850825.slice. Nov 4 23:21:45.782283 kubelet[3304]: I1104 23:21:45.777852 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwrp8\" (UniqueName: \"kubernetes.io/projected/6c8eb056-a29a-4a21-b501-58521c19fc76-kube-api-access-qwrp8\") pod \"whisker-6b6c6b6cfd-5ww2m\" (UID: \"6c8eb056-a29a-4a21-b501-58521c19fc76\") " pod="calico-system/whisker-6b6c6b6cfd-5ww2m" Nov 4 23:21:45.782283 kubelet[3304]: I1104 23:21:45.778737 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psbhk\" (UniqueName: \"kubernetes.io/projected/c8ee1bb8-dd7e-475b-8eb7-dab815e66227-kube-api-access-psbhk\") pod \"coredns-674b8bbfcf-29vjx\" (UID: \"c8ee1bb8-dd7e-475b-8eb7-dab815e66227\") " pod="kube-system/coredns-674b8bbfcf-29vjx" Nov 4 23:21:45.782283 kubelet[3304]: I1104 23:21:45.778828 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whisker-backend-key-pair\" (UniqueName: \"kubernetes.io/secret/6c8eb056-a29a-4a21-b501-58521c19fc76-whisker-backend-key-pair\") pod \"whisker-6b6c6b6cfd-5ww2m\" (UID: \"6c8eb056-a29a-4a21-b501-58521c19fc76\") " pod="calico-system/whisker-6b6c6b6cfd-5ww2m" Nov 4 23:21:45.782283 kubelet[3304]: I1104 23:21:45.778947 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c8ee1bb8-dd7e-475b-8eb7-dab815e66227-config-volume\") pod \"coredns-674b8bbfcf-29vjx\" (UID: \"c8ee1bb8-dd7e-475b-8eb7-dab815e66227\") " pod="kube-system/coredns-674b8bbfcf-29vjx" Nov 4 23:21:45.782283 kubelet[3304]: I1104 23:21:45.778996 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whisker-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c8eb056-a29a-4a21-b501-58521c19fc76-whisker-ca-bundle\") pod \"whisker-6b6c6b6cfd-5ww2m\" (UID: \"6c8eb056-a29a-4a21-b501-58521c19fc76\") " pod="calico-system/whisker-6b6c6b6cfd-5ww2m" Nov 4 23:21:45.815843 systemd[1]: Created slice kubepods-besteffort-pod4d28b7f3_4e9e_4cbc_92fc_da554118a9c3.slice - libcontainer container kubepods-besteffort-pod4d28b7f3_4e9e_4cbc_92fc_da554118a9c3.slice. Nov 4 23:21:45.852541 systemd[1]: Created slice kubepods-besteffort-podf026c0ae_4dbf_4901_893b_d3b577723fff.slice - libcontainer container kubepods-besteffort-podf026c0ae_4dbf_4901_893b_d3b577723fff.slice. Nov 4 23:21:45.879960 kubelet[3304]: I1104 23:21:45.879394 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"goldmane-key-pair\" (UniqueName: \"kubernetes.io/secret/f026c0ae-4dbf-4901-893b-d3b577723fff-goldmane-key-pair\") pod \"goldmane-666569f655-sfktq\" (UID: \"f026c0ae-4dbf-4901-893b-d3b577723fff\") " pod="calico-system/goldmane-666569f655-sfktq" Nov 4 23:21:45.879960 kubelet[3304]: I1104 23:21:45.879494 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vpxq\" (UniqueName: \"kubernetes.io/projected/f026c0ae-4dbf-4901-893b-d3b577723fff-kube-api-access-2vpxq\") pod \"goldmane-666569f655-sfktq\" (UID: \"f026c0ae-4dbf-4901-893b-d3b577723fff\") " pod="calico-system/goldmane-666569f655-sfktq" Nov 4 23:21:45.879960 kubelet[3304]: I1104 23:21:45.879576 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8glv\" (UniqueName: \"kubernetes.io/projected/4d28b7f3-4e9e-4cbc-92fc-da554118a9c3-kube-api-access-g8glv\") pod \"calico-kube-controllers-77c845d5cc-h2d4p\" (UID: \"4d28b7f3-4e9e-4cbc-92fc-da554118a9c3\") " pod="calico-system/calico-kube-controllers-77c845d5cc-h2d4p" Nov 4 23:21:45.879960 kubelet[3304]: I1104 23:21:45.879629 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"goldmane-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f026c0ae-4dbf-4901-893b-d3b577723fff-goldmane-ca-bundle\") pod \"goldmane-666569f655-sfktq\" (UID: \"f026c0ae-4dbf-4901-893b-d3b577723fff\") " pod="calico-system/goldmane-666569f655-sfktq" Nov 4 23:21:45.879960 kubelet[3304]: I1104 23:21:45.879671 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f026c0ae-4dbf-4901-893b-d3b577723fff-config\") pod \"goldmane-666569f655-sfktq\" (UID: \"f026c0ae-4dbf-4901-893b-d3b577723fff\") " pod="calico-system/goldmane-666569f655-sfktq" Nov 4 23:21:45.903787 kubelet[3304]: I1104 23:21:45.879711 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"calico-apiserver-certs\" (UniqueName: \"kubernetes.io/secret/a2dd6680-1f53-4788-9ae9-bffdb1850825-calico-apiserver-certs\") pod \"calico-apiserver-f66b9548c-ghbgm\" (UID: \"a2dd6680-1f53-4788-9ae9-bffdb1850825\") " pod="calico-apiserver/calico-apiserver-f66b9548c-ghbgm" Nov 4 23:21:45.903787 kubelet[3304]: I1104 23:21:45.879746 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhlrj\" (UniqueName: \"kubernetes.io/projected/a2dd6680-1f53-4788-9ae9-bffdb1850825-kube-api-access-lhlrj\") pod \"calico-apiserver-f66b9548c-ghbgm\" (UID: \"a2dd6680-1f53-4788-9ae9-bffdb1850825\") " pod="calico-apiserver/calico-apiserver-f66b9548c-ghbgm" Nov 4 23:21:45.903787 kubelet[3304]: I1104 23:21:45.879795 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tigera-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d28b7f3-4e9e-4cbc-92fc-da554118a9c3-tigera-ca-bundle\") pod \"calico-kube-controllers-77c845d5cc-h2d4p\" (UID: \"4d28b7f3-4e9e-4cbc-92fc-da554118a9c3\") " pod="calico-system/calico-kube-controllers-77c845d5cc-h2d4p" Nov 4 23:21:45.980668 kubelet[3304]: I1104 23:21:45.980601 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtt6s\" (UniqueName: \"kubernetes.io/projected/dd597e6a-157b-48d4-adfc-7b1e75758f0b-kube-api-access-qtt6s\") pod \"coredns-674b8bbfcf-ml5hb\" (UID: \"dd597e6a-157b-48d4-adfc-7b1e75758f0b\") " pod="kube-system/coredns-674b8bbfcf-ml5hb" Nov 4 23:21:45.980822 kubelet[3304]: I1104 23:21:45.980709 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dd597e6a-157b-48d4-adfc-7b1e75758f0b-config-volume\") pod \"coredns-674b8bbfcf-ml5hb\" (UID: \"dd597e6a-157b-48d4-adfc-7b1e75758f0b\") " pod="kube-system/coredns-674b8bbfcf-ml5hb" Nov 4 23:21:45.982375 kubelet[3304]: I1104 23:21:45.980912 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"calico-apiserver-certs\" (UniqueName: \"kubernetes.io/secret/3262dea2-8952-4d22-82d3-50fc85d38fcd-calico-apiserver-certs\") pod \"calico-apiserver-f66b9548c-6sxnc\" (UID: \"3262dea2-8952-4d22-82d3-50fc85d38fcd\") " pod="calico-apiserver/calico-apiserver-f66b9548c-6sxnc" Nov 4 23:21:45.982536 kubelet[3304]: I1104 23:21:45.982423 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvnkz\" (UniqueName: \"kubernetes.io/projected/3262dea2-8952-4d22-82d3-50fc85d38fcd-kube-api-access-cvnkz\") pod \"calico-apiserver-f66b9548c-6sxnc\" (UID: \"3262dea2-8952-4d22-82d3-50fc85d38fcd\") " pod="calico-apiserver/calico-apiserver-f66b9548c-6sxnc" Nov 4 23:21:45.984622 systemd[1]: Created slice kubepods-besteffort-pod3262dea2_8952_4d22_82d3_50fc85d38fcd.slice - libcontainer container kubepods-besteffort-pod3262dea2_8952_4d22_82d3_50fc85d38fcd.slice. Nov 4 23:21:46.019835 systemd[1]: Created slice kubepods-burstable-poddd597e6a_157b_48d4_adfc_7b1e75758f0b.slice - libcontainer container kubepods-burstable-poddd597e6a_157b_48d4_adfc_7b1e75758f0b.slice. Nov 4 23:21:46.035553 containerd[1974]: time="2025-11-04T23:21:46.035231083Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-674b8bbfcf-29vjx,Uid:c8ee1bb8-dd7e-475b-8eb7-dab815e66227,Namespace:kube-system,Attempt:0,}" Nov 4 23:21:46.086006 containerd[1974]: time="2025-11-04T23:21:46.085839487Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:whisker-6b6c6b6cfd-5ww2m,Uid:6c8eb056-a29a-4a21-b501-58521c19fc76,Namespace:calico-system,Attempt:0,}" Nov 4 23:21:46.091803 containerd[1974]: time="2025-11-04T23:21:46.091745887Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-f66b9548c-ghbgm,Uid:a2dd6680-1f53-4788-9ae9-bffdb1850825,Namespace:calico-apiserver,Attempt:0,}" Nov 4 23:21:46.152263 containerd[1974]: time="2025-11-04T23:21:46.152179532Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-kube-controllers-77c845d5cc-h2d4p,Uid:4d28b7f3-4e9e-4cbc-92fc-da554118a9c3,Namespace:calico-system,Attempt:0,}" Nov 4 23:21:46.159208 containerd[1974]: time="2025-11-04T23:21:46.159149720Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:goldmane-666569f655-sfktq,Uid:f026c0ae-4dbf-4901-893b-d3b577723fff,Namespace:calico-system,Attempt:0,}" Nov 4 23:21:46.316549 containerd[1974]: time="2025-11-04T23:21:46.316051244Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-f66b9548c-6sxnc,Uid:3262dea2-8952-4d22-82d3-50fc85d38fcd,Namespace:calico-apiserver,Attempt:0,}" Nov 4 23:21:46.335734 systemd[1]: Created slice kubepods-besteffort-pod024e93aa_74ad_4ec2_b309_ed5d7023cfd9.slice - libcontainer container kubepods-besteffort-pod024e93aa_74ad_4ec2_b309_ed5d7023cfd9.slice. Nov 4 23:21:46.345160 containerd[1974]: time="2025-11-04T23:21:46.345020193Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:csi-node-driver-n5cdd,Uid:024e93aa-74ad-4ec2-b309-ed5d7023cfd9,Namespace:calico-system,Attempt:0,}" Nov 4 23:21:46.373357 containerd[1974]: time="2025-11-04T23:21:46.373281909Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-674b8bbfcf-ml5hb,Uid:dd597e6a-157b-48d4-adfc-7b1e75758f0b,Namespace:kube-system,Attempt:0,}" Nov 4 23:21:46.561047 containerd[1974]: time="2025-11-04T23:21:46.556688518Z" level=error msg="Failed to destroy network for sandbox \"4a23c2ee883cd4207860d07a72775b4fad67eb5268e4ed0f0891facd61f97fcd\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 4 23:21:46.566896 containerd[1974]: time="2025-11-04T23:21:46.566807398Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:goldmane-666569f655-sfktq,Uid:f026c0ae-4dbf-4901-893b-d3b577723fff,Namespace:calico-system,Attempt:0,} failed, error" error="rpc error: code = Unknown desc = failed to setup network for sandbox \"4a23c2ee883cd4207860d07a72775b4fad67eb5268e4ed0f0891facd61f97fcd\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 4 23:21:46.567304 kubelet[3304]: E1104 23:21:46.567204 3304 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"4a23c2ee883cd4207860d07a72775b4fad67eb5268e4ed0f0891facd61f97fcd\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 4 23:21:46.567401 kubelet[3304]: E1104 23:21:46.567295 3304 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"4a23c2ee883cd4207860d07a72775b4fad67eb5268e4ed0f0891facd61f97fcd\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/goldmane-666569f655-sfktq" Nov 4 23:21:46.567401 kubelet[3304]: E1104 23:21:46.567333 3304 kuberuntime_manager.go:1252] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"4a23c2ee883cd4207860d07a72775b4fad67eb5268e4ed0f0891facd61f97fcd\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/goldmane-666569f655-sfktq" Nov 4 23:21:46.567505 kubelet[3304]: E1104 23:21:46.567418 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"goldmane-666569f655-sfktq_calico-system(f026c0ae-4dbf-4901-893b-d3b577723fff)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"goldmane-666569f655-sfktq_calico-system(f026c0ae-4dbf-4901-893b-d3b577723fff)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"4a23c2ee883cd4207860d07a72775b4fad67eb5268e4ed0f0891facd61f97fcd\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-system/goldmane-666569f655-sfktq" podUID="f026c0ae-4dbf-4901-893b-d3b577723fff" Nov 4 23:21:46.654822 containerd[1974]: time="2025-11-04T23:21:46.654498070Z" level=error msg="Failed to destroy network for sandbox \"105bda58231c1ee16b507d966c7830d1bcc1b411da1250bd1400badd4a24c14f\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 4 23:21:46.661423 containerd[1974]: time="2025-11-04T23:21:46.661246342Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/node:v3.30.4\"" Nov 4 23:21:46.687028 systemd[1]: run-netns-cni\x2dcbdbe7f9\x2d9e39\x2d676f\x2d29ce\x2d10f266ba1aa3.mount: Deactivated successfully. Nov 4 23:21:46.719138 containerd[1974]: time="2025-11-04T23:21:46.710558314Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-674b8bbfcf-29vjx,Uid:c8ee1bb8-dd7e-475b-8eb7-dab815e66227,Namespace:kube-system,Attempt:0,} failed, error" error="rpc error: code = Unknown desc = failed to setup network for sandbox \"105bda58231c1ee16b507d966c7830d1bcc1b411da1250bd1400badd4a24c14f\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 4 23:21:46.719654 kubelet[3304]: E1104 23:21:46.719600 3304 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"105bda58231c1ee16b507d966c7830d1bcc1b411da1250bd1400badd4a24c14f\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 4 23:21:46.720897 kubelet[3304]: E1104 23:21:46.719676 3304 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"105bda58231c1ee16b507d966c7830d1bcc1b411da1250bd1400badd4a24c14f\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-674b8bbfcf-29vjx" Nov 4 23:21:46.720897 kubelet[3304]: E1104 23:21:46.719715 3304 kuberuntime_manager.go:1252] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"105bda58231c1ee16b507d966c7830d1bcc1b411da1250bd1400badd4a24c14f\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-674b8bbfcf-29vjx" Nov 4 23:21:46.720897 kubelet[3304]: E1104 23:21:46.719793 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-674b8bbfcf-29vjx_kube-system(c8ee1bb8-dd7e-475b-8eb7-dab815e66227)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-674b8bbfcf-29vjx_kube-system(c8ee1bb8-dd7e-475b-8eb7-dab815e66227)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"105bda58231c1ee16b507d966c7830d1bcc1b411da1250bd1400badd4a24c14f\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="kube-system/coredns-674b8bbfcf-29vjx" podUID="c8ee1bb8-dd7e-475b-8eb7-dab815e66227" Nov 4 23:21:46.757759 containerd[1974]: time="2025-11-04T23:21:46.757682603Z" level=error msg="Failed to destroy network for sandbox \"17faa3b1c47cbc5fd691bf7021986e5587105e5757c394b6bf889482b442a534\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 4 23:21:46.763951 containerd[1974]: time="2025-11-04T23:21:46.762715775Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:whisker-6b6c6b6cfd-5ww2m,Uid:6c8eb056-a29a-4a21-b501-58521c19fc76,Namespace:calico-system,Attempt:0,} failed, error" error="rpc error: code = Unknown desc = failed to setup network for sandbox \"17faa3b1c47cbc5fd691bf7021986e5587105e5757c394b6bf889482b442a534\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 4 23:21:46.764146 kubelet[3304]: E1104 23:21:46.764055 3304 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"17faa3b1c47cbc5fd691bf7021986e5587105e5757c394b6bf889482b442a534\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 4 23:21:46.764462 kubelet[3304]: E1104 23:21:46.764330 3304 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"17faa3b1c47cbc5fd691bf7021986e5587105e5757c394b6bf889482b442a534\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/whisker-6b6c6b6cfd-5ww2m" Nov 4 23:21:46.764462 kubelet[3304]: E1104 23:21:46.764384 3304 kuberuntime_manager.go:1252] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"17faa3b1c47cbc5fd691bf7021986e5587105e5757c394b6bf889482b442a534\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/whisker-6b6c6b6cfd-5ww2m" Nov 4 23:21:46.765685 kubelet[3304]: E1104 23:21:46.764461 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"whisker-6b6c6b6cfd-5ww2m_calico-system(6c8eb056-a29a-4a21-b501-58521c19fc76)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"whisker-6b6c6b6cfd-5ww2m_calico-system(6c8eb056-a29a-4a21-b501-58521c19fc76)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"17faa3b1c47cbc5fd691bf7021986e5587105e5757c394b6bf889482b442a534\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-system/whisker-6b6c6b6cfd-5ww2m" podUID="6c8eb056-a29a-4a21-b501-58521c19fc76" Nov 4 23:21:46.768252 systemd[1]: run-netns-cni\x2dc6e5f6a4\x2db91b\x2dd18a\x2d1381\x2d94b6f5934811.mount: Deactivated successfully. Nov 4 23:21:46.801352 containerd[1974]: time="2025-11-04T23:21:46.801226907Z" level=error msg="Failed to destroy network for sandbox \"d9281f50821a605ad9c8a603daaafa15ca167930780bee7c99d9c0ffed2a16ed\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 4 23:21:46.806269 containerd[1974]: time="2025-11-04T23:21:46.806189231Z" level=error msg="Failed to destroy network for sandbox \"c55b63d377b8969915d1fa2b5b2bed7cb93f444f9c989d591a44dd79d0ae452b\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 4 23:21:46.811225 systemd[1]: run-netns-cni\x2daa432006\x2dd174\x2dbdba\x2db4fd\x2d214e7a95d2d8.mount: Deactivated successfully. Nov 4 23:21:46.814075 containerd[1974]: time="2025-11-04T23:21:46.813529019Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-f66b9548c-ghbgm,Uid:a2dd6680-1f53-4788-9ae9-bffdb1850825,Namespace:calico-apiserver,Attempt:0,} failed, error" error="rpc error: code = Unknown desc = failed to setup network for sandbox \"d9281f50821a605ad9c8a603daaafa15ca167930780bee7c99d9c0ffed2a16ed\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 4 23:21:46.815479 kubelet[3304]: E1104 23:21:46.814127 3304 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"d9281f50821a605ad9c8a603daaafa15ca167930780bee7c99d9c0ffed2a16ed\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 4 23:21:46.815479 kubelet[3304]: E1104 23:21:46.814201 3304 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"d9281f50821a605ad9c8a603daaafa15ca167930780bee7c99d9c0ffed2a16ed\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-f66b9548c-ghbgm" Nov 4 23:21:46.815479 kubelet[3304]: E1104 23:21:46.814286 3304 kuberuntime_manager.go:1252] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"d9281f50821a605ad9c8a603daaafa15ca167930780bee7c99d9c0ffed2a16ed\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-f66b9548c-ghbgm" Nov 4 23:21:46.816881 kubelet[3304]: E1104 23:21:46.814373 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"calico-apiserver-f66b9548c-ghbgm_calico-apiserver(a2dd6680-1f53-4788-9ae9-bffdb1850825)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"calico-apiserver-f66b9548c-ghbgm_calico-apiserver(a2dd6680-1f53-4788-9ae9-bffdb1850825)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"d9281f50821a605ad9c8a603daaafa15ca167930780bee7c99d9c0ffed2a16ed\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-apiserver/calico-apiserver-f66b9548c-ghbgm" podUID="a2dd6680-1f53-4788-9ae9-bffdb1850825" Nov 4 23:21:46.823254 systemd[1]: run-netns-cni\x2db08f2518\x2df09c\x2d6d35\x2db957\x2d17f9f1db5c68.mount: Deactivated successfully. Nov 4 23:21:46.823596 containerd[1974]: time="2025-11-04T23:21:46.823516883Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-kube-controllers-77c845d5cc-h2d4p,Uid:4d28b7f3-4e9e-4cbc-92fc-da554118a9c3,Namespace:calico-system,Attempt:0,} failed, error" error="rpc error: code = Unknown desc = failed to setup network for sandbox \"c55b63d377b8969915d1fa2b5b2bed7cb93f444f9c989d591a44dd79d0ae452b\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 4 23:21:46.824629 kubelet[3304]: E1104 23:21:46.824278 3304 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"c55b63d377b8969915d1fa2b5b2bed7cb93f444f9c989d591a44dd79d0ae452b\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 4 23:21:46.825219 kubelet[3304]: E1104 23:21:46.825134 3304 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"c55b63d377b8969915d1fa2b5b2bed7cb93f444f9c989d591a44dd79d0ae452b\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/calico-kube-controllers-77c845d5cc-h2d4p" Nov 4 23:21:46.827020 kubelet[3304]: E1104 23:21:46.825395 3304 kuberuntime_manager.go:1252] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"c55b63d377b8969915d1fa2b5b2bed7cb93f444f9c989d591a44dd79d0ae452b\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/calico-kube-controllers-77c845d5cc-h2d4p" Nov 4 23:21:46.828089 kubelet[3304]: E1104 23:21:46.828029 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"calico-kube-controllers-77c845d5cc-h2d4p_calico-system(4d28b7f3-4e9e-4cbc-92fc-da554118a9c3)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"calico-kube-controllers-77c845d5cc-h2d4p_calico-system(4d28b7f3-4e9e-4cbc-92fc-da554118a9c3)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"c55b63d377b8969915d1fa2b5b2bed7cb93f444f9c989d591a44dd79d0ae452b\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-system/calico-kube-controllers-77c845d5cc-h2d4p" podUID="4d28b7f3-4e9e-4cbc-92fc-da554118a9c3" Nov 4 23:21:46.829486 containerd[1974]: time="2025-11-04T23:21:46.829369859Z" level=error msg="Failed to destroy network for sandbox \"8f0dd7f9238050f6d602d2ee9b119dc7fbe98220661062eb489199917bf6e70a\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 4 23:21:46.834112 containerd[1974]: time="2025-11-04T23:21:46.833616971Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-674b8bbfcf-ml5hb,Uid:dd597e6a-157b-48d4-adfc-7b1e75758f0b,Namespace:kube-system,Attempt:0,} failed, error" error="rpc error: code = Unknown desc = failed to setup network for sandbox \"8f0dd7f9238050f6d602d2ee9b119dc7fbe98220661062eb489199917bf6e70a\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 4 23:21:46.836156 kubelet[3304]: E1104 23:21:46.836082 3304 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"8f0dd7f9238050f6d602d2ee9b119dc7fbe98220661062eb489199917bf6e70a\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 4 23:21:46.836156 kubelet[3304]: E1104 23:21:46.836175 3304 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"8f0dd7f9238050f6d602d2ee9b119dc7fbe98220661062eb489199917bf6e70a\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-674b8bbfcf-ml5hb" Nov 4 23:21:46.836156 kubelet[3304]: E1104 23:21:46.836214 3304 kuberuntime_manager.go:1252] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"8f0dd7f9238050f6d602d2ee9b119dc7fbe98220661062eb489199917bf6e70a\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-674b8bbfcf-ml5hb" Nov 4 23:21:46.836553 kubelet[3304]: E1104 23:21:46.836303 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-674b8bbfcf-ml5hb_kube-system(dd597e6a-157b-48d4-adfc-7b1e75758f0b)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-674b8bbfcf-ml5hb_kube-system(dd597e6a-157b-48d4-adfc-7b1e75758f0b)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"8f0dd7f9238050f6d602d2ee9b119dc7fbe98220661062eb489199917bf6e70a\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="kube-system/coredns-674b8bbfcf-ml5hb" podUID="dd597e6a-157b-48d4-adfc-7b1e75758f0b" Nov 4 23:21:46.851465 containerd[1974]: time="2025-11-04T23:21:46.851209715Z" level=error msg="Failed to destroy network for sandbox \"9983aae9f72501d823e979349c2cfb5894a77c3db283a8834a9d3dc031a88dc9\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 4 23:21:46.855078 containerd[1974]: time="2025-11-04T23:21:46.854775995Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-f66b9548c-6sxnc,Uid:3262dea2-8952-4d22-82d3-50fc85d38fcd,Namespace:calico-apiserver,Attempt:0,} failed, error" error="rpc error: code = Unknown desc = failed to setup network for sandbox \"9983aae9f72501d823e979349c2cfb5894a77c3db283a8834a9d3dc031a88dc9\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 4 23:21:46.856061 kubelet[3304]: E1104 23:21:46.855672 3304 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"9983aae9f72501d823e979349c2cfb5894a77c3db283a8834a9d3dc031a88dc9\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 4 23:21:46.856061 kubelet[3304]: E1104 23:21:46.855834 3304 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"9983aae9f72501d823e979349c2cfb5894a77c3db283a8834a9d3dc031a88dc9\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-f66b9548c-6sxnc" Nov 4 23:21:46.856061 kubelet[3304]: E1104 23:21:46.855875 3304 kuberuntime_manager.go:1252] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"9983aae9f72501d823e979349c2cfb5894a77c3db283a8834a9d3dc031a88dc9\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-f66b9548c-6sxnc" Nov 4 23:21:46.856723 kubelet[3304]: E1104 23:21:46.856001 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"calico-apiserver-f66b9548c-6sxnc_calico-apiserver(3262dea2-8952-4d22-82d3-50fc85d38fcd)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"calico-apiserver-f66b9548c-6sxnc_calico-apiserver(3262dea2-8952-4d22-82d3-50fc85d38fcd)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"9983aae9f72501d823e979349c2cfb5894a77c3db283a8834a9d3dc031a88dc9\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-apiserver/calico-apiserver-f66b9548c-6sxnc" podUID="3262dea2-8952-4d22-82d3-50fc85d38fcd" Nov 4 23:21:46.861247 containerd[1974]: time="2025-11-04T23:21:46.861178235Z" level=error msg="Failed to destroy network for sandbox \"6facce2268abd43bd1ded548f576503f7475cfbfdf10a08d2b8dc4f1be601127\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 4 23:21:46.863142 containerd[1974]: time="2025-11-04T23:21:46.863076215Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:csi-node-driver-n5cdd,Uid:024e93aa-74ad-4ec2-b309-ed5d7023cfd9,Namespace:calico-system,Attempt:0,} failed, error" error="rpc error: code = Unknown desc = failed to setup network for sandbox \"6facce2268abd43bd1ded548f576503f7475cfbfdf10a08d2b8dc4f1be601127\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 4 23:21:46.864093 kubelet[3304]: E1104 23:21:46.863982 3304 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"6facce2268abd43bd1ded548f576503f7475cfbfdf10a08d2b8dc4f1be601127\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Nov 4 23:21:46.864093 kubelet[3304]: E1104 23:21:46.864086 3304 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"6facce2268abd43bd1ded548f576503f7475cfbfdf10a08d2b8dc4f1be601127\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/csi-node-driver-n5cdd" Nov 4 23:21:46.864093 kubelet[3304]: E1104 23:21:46.864121 3304 kuberuntime_manager.go:1252] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"6facce2268abd43bd1ded548f576503f7475cfbfdf10a08d2b8dc4f1be601127\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/csi-node-driver-n5cdd" Nov 4 23:21:46.864524 kubelet[3304]: E1104 23:21:46.864246 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"csi-node-driver-n5cdd_calico-system(024e93aa-74ad-4ec2-b309-ed5d7023cfd9)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"csi-node-driver-n5cdd_calico-system(024e93aa-74ad-4ec2-b309-ed5d7023cfd9)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"6facce2268abd43bd1ded548f576503f7475cfbfdf10a08d2b8dc4f1be601127\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-system/csi-node-driver-n5cdd" podUID="024e93aa-74ad-4ec2-b309-ed5d7023cfd9" Nov 4 23:21:47.613825 systemd[1]: run-netns-cni\x2d99d0ea3c\x2d6af3\x2da6bd\x2dd1d4\x2d25d4777d457c.mount: Deactivated successfully. Nov 4 23:21:47.614023 systemd[1]: run-netns-cni\x2d8a19e168\x2dd062\x2d3e81\x2daf40\x2d9690f18f3bdd.mount: Deactivated successfully. Nov 4 23:21:47.614155 systemd[1]: run-netns-cni\x2dd3bb7498\x2d920c\x2d88cd\x2d727f\x2db0de779049a7.mount: Deactivated successfully. Nov 4 23:21:53.381353 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount3770153801.mount: Deactivated successfully. Nov 4 23:21:53.459777 containerd[1974]: time="2025-11-04T23:21:53.459620008Z" level=info msg="ImageCreate event name:\"ghcr.io/flatcar/calico/node:v3.30.4\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:21:53.461803 containerd[1974]: time="2025-11-04T23:21:53.461721436Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/node:v3.30.4: active requests=0, bytes read=150934562" Nov 4 23:21:53.464485 containerd[1974]: time="2025-11-04T23:21:53.464370388Z" level=info msg="ImageCreate event name:\"sha256:43a5290057a103af76996c108856f92ed902f34573d7a864f55f15b8aaf4683b\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:21:53.469123 containerd[1974]: time="2025-11-04T23:21:53.469037116Z" level=info msg="ImageCreate event name:\"ghcr.io/flatcar/calico/node@sha256:e92cca333202c87d07bf57f38182fd68f0779f912ef55305eda1fccc9f33667c\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Nov 4 23:21:53.470981 containerd[1974]: time="2025-11-04T23:21:53.470162596Z" level=info msg="Pulled image \"ghcr.io/flatcar/calico/node:v3.30.4\" with image id \"sha256:43a5290057a103af76996c108856f92ed902f34573d7a864f55f15b8aaf4683b\", repo tag \"ghcr.io/flatcar/calico/node:v3.30.4\", repo digest \"ghcr.io/flatcar/calico/node@sha256:e92cca333202c87d07bf57f38182fd68f0779f912ef55305eda1fccc9f33667c\", size \"150934424\" in 6.808841974s" Nov 4 23:21:53.470981 containerd[1974]: time="2025-11-04T23:21:53.470227096Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/node:v3.30.4\" returns image reference \"sha256:43a5290057a103af76996c108856f92ed902f34573d7a864f55f15b8aaf4683b\"" Nov 4 23:21:53.507131 containerd[1974]: time="2025-11-04T23:21:53.507058732Z" level=info msg="CreateContainer within sandbox \"174d599e856275ee6a58f174adb43ea931b7b70a4e43b2843d82efe492fdd33c\" for container &ContainerMetadata{Name:calico-node,Attempt:0,}" Nov 4 23:21:53.532708 containerd[1974]: time="2025-11-04T23:21:53.529185724Z" level=info msg="Container 734968a2bf7847c37be53b16593806fb188615b60b4ab06e25a834e12dd854f0: CDI devices from CRI Config.CDIDevices: []" Nov 4 23:21:53.555043 containerd[1974]: time="2025-11-04T23:21:53.554992960Z" level=info msg="CreateContainer within sandbox \"174d599e856275ee6a58f174adb43ea931b7b70a4e43b2843d82efe492fdd33c\" for &ContainerMetadata{Name:calico-node,Attempt:0,} returns container id \"734968a2bf7847c37be53b16593806fb188615b60b4ab06e25a834e12dd854f0\"" Nov 4 23:21:53.557039 containerd[1974]: time="2025-11-04T23:21:53.556977280Z" level=info msg="StartContainer for \"734968a2bf7847c37be53b16593806fb188615b60b4ab06e25a834e12dd854f0\"" Nov 4 23:21:53.561957 containerd[1974]: time="2025-11-04T23:21:53.561834076Z" level=info msg="connecting to shim 734968a2bf7847c37be53b16593806fb188615b60b4ab06e25a834e12dd854f0" address="unix:///run/containerd/s/5d1abf79fb0f82835eac6de8519e846dab72f24982afed029c42a2c1a6242384" protocol=ttrpc version=3 Nov 4 23:21:53.606904 systemd[1]: Started cri-containerd-734968a2bf7847c37be53b16593806fb188615b60b4ab06e25a834e12dd854f0.scope - libcontainer container 734968a2bf7847c37be53b16593806fb188615b60b4ab06e25a834e12dd854f0. Nov 4 23:21:53.716610 containerd[1974]: time="2025-11-04T23:21:53.716479577Z" level=info msg="StartContainer for \"734968a2bf7847c37be53b16593806fb188615b60b4ab06e25a834e12dd854f0\" returns successfully" Nov 4 23:21:54.113814 kernel: wireguard: WireGuard 1.0.0 loaded. See www.wireguard.com for information. Nov 4 23:21:54.113999 kernel: wireguard: Copyright (C) 2015-2019 Jason A. Donenfeld . All Rights Reserved. Nov 4 23:21:54.476166 kubelet[3304]: I1104 23:21:54.476103 3304 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qwrp8\" (UniqueName: \"kubernetes.io/projected/6c8eb056-a29a-4a21-b501-58521c19fc76-kube-api-access-qwrp8\") pod \"6c8eb056-a29a-4a21-b501-58521c19fc76\" (UID: \"6c8eb056-a29a-4a21-b501-58521c19fc76\") " Nov 4 23:21:54.476780 kubelet[3304]: I1104 23:21:54.476184 3304 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"whisker-backend-key-pair\" (UniqueName: \"kubernetes.io/secret/6c8eb056-a29a-4a21-b501-58521c19fc76-whisker-backend-key-pair\") pod \"6c8eb056-a29a-4a21-b501-58521c19fc76\" (UID: \"6c8eb056-a29a-4a21-b501-58521c19fc76\") " Nov 4 23:21:54.476780 kubelet[3304]: I1104 23:21:54.476254 3304 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"whisker-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c8eb056-a29a-4a21-b501-58521c19fc76-whisker-ca-bundle\") pod \"6c8eb056-a29a-4a21-b501-58521c19fc76\" (UID: \"6c8eb056-a29a-4a21-b501-58521c19fc76\") " Nov 4 23:21:54.480912 kubelet[3304]: I1104 23:21:54.480720 3304 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c8eb056-a29a-4a21-b501-58521c19fc76-whisker-ca-bundle" (OuterVolumeSpecName: "whisker-ca-bundle") pod "6c8eb056-a29a-4a21-b501-58521c19fc76" (UID: "6c8eb056-a29a-4a21-b501-58521c19fc76"). InnerVolumeSpecName "whisker-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 4 23:21:54.490662 systemd[1]: var-lib-kubelet-pods-6c8eb056\x2da29a\x2d4a21\x2db501\x2d58521c19fc76-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dqwrp8.mount: Deactivated successfully. Nov 4 23:21:54.494341 kubelet[3304]: I1104 23:21:54.494260 3304 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c8eb056-a29a-4a21-b501-58521c19fc76-kube-api-access-qwrp8" (OuterVolumeSpecName: "kube-api-access-qwrp8") pod "6c8eb056-a29a-4a21-b501-58521c19fc76" (UID: "6c8eb056-a29a-4a21-b501-58521c19fc76"). InnerVolumeSpecName "kube-api-access-qwrp8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 4 23:21:54.496973 kubelet[3304]: I1104 23:21:54.496329 3304 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c8eb056-a29a-4a21-b501-58521c19fc76-whisker-backend-key-pair" (OuterVolumeSpecName: "whisker-backend-key-pair") pod "6c8eb056-a29a-4a21-b501-58521c19fc76" (UID: "6c8eb056-a29a-4a21-b501-58521c19fc76"). InnerVolumeSpecName "whisker-backend-key-pair". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 4 23:21:54.501301 systemd[1]: var-lib-kubelet-pods-6c8eb056\x2da29a\x2d4a21\x2db501\x2d58521c19fc76-volumes-kubernetes.io\x7esecret-whisker\x2dbackend\x2dkey\x2dpair.mount: Deactivated successfully. Nov 4 23:21:54.577502 kubelet[3304]: I1104 23:21:54.577454 3304 reconciler_common.go:299] "Volume detached for volume \"whisker-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c8eb056-a29a-4a21-b501-58521c19fc76-whisker-ca-bundle\") on node \"ip-172-31-23-127\" DevicePath \"\"" Nov 4 23:21:54.577502 kubelet[3304]: I1104 23:21:54.577507 3304 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qwrp8\" (UniqueName: \"kubernetes.io/projected/6c8eb056-a29a-4a21-b501-58521c19fc76-kube-api-access-qwrp8\") on node \"ip-172-31-23-127\" DevicePath \"\"" Nov 4 23:21:54.577728 kubelet[3304]: I1104 23:21:54.577532 3304 reconciler_common.go:299] "Volume detached for volume \"whisker-backend-key-pair\" (UniqueName: \"kubernetes.io/secret/6c8eb056-a29a-4a21-b501-58521c19fc76-whisker-backend-key-pair\") on node \"ip-172-31-23-127\" DevicePath \"\"" Nov 4 23:21:54.749456 systemd[1]: Removed slice kubepods-besteffort-pod6c8eb056_a29a_4a21_b501_58521c19fc76.slice - libcontainer container kubepods-besteffort-pod6c8eb056_a29a_4a21_b501_58521c19fc76.slice. Nov 4 23:21:54.778477 kubelet[3304]: I1104 23:21:54.778381 3304 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="calico-system/calico-node-jrpvk" podStartSLOduration=2.358124172 podStartE2EDuration="18.778349874s" podCreationTimestamp="2025-11-04 23:21:36 +0000 UTC" firstStartedPulling="2025-11-04 23:21:37.051657082 +0000 UTC m=+37.429077162" lastFinishedPulling="2025-11-04 23:21:53.471882784 +0000 UTC m=+53.849302864" observedRunningTime="2025-11-04 23:21:54.776720754 +0000 UTC m=+55.154140846" watchObservedRunningTime="2025-11-04 23:21:54.778349874 +0000 UTC m=+55.155769990" Nov 4 23:21:54.917950 systemd[1]: Created slice kubepods-besteffort-podcba52d39_d0ad_4c67_aaef_c5790877e8e6.slice - libcontainer container kubepods-besteffort-podcba52d39_d0ad_4c67_aaef_c5790877e8e6.slice. Nov 4 23:21:54.981797 kubelet[3304]: I1104 23:21:54.981725 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whisker-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cba52d39-d0ad-4c67-aaef-c5790877e8e6-whisker-ca-bundle\") pod \"whisker-7c85d6c7cb-dd4pw\" (UID: \"cba52d39-d0ad-4c67-aaef-c5790877e8e6\") " pod="calico-system/whisker-7c85d6c7cb-dd4pw" Nov 4 23:21:54.982009 kubelet[3304]: I1104 23:21:54.981812 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swwgh\" (UniqueName: \"kubernetes.io/projected/cba52d39-d0ad-4c67-aaef-c5790877e8e6-kube-api-access-swwgh\") pod \"whisker-7c85d6c7cb-dd4pw\" (UID: \"cba52d39-d0ad-4c67-aaef-c5790877e8e6\") " pod="calico-system/whisker-7c85d6c7cb-dd4pw" Nov 4 23:21:54.982009 kubelet[3304]: I1104 23:21:54.981872 3304 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whisker-backend-key-pair\" (UniqueName: \"kubernetes.io/secret/cba52d39-d0ad-4c67-aaef-c5790877e8e6-whisker-backend-key-pair\") pod \"whisker-7c85d6c7cb-dd4pw\" (UID: \"cba52d39-d0ad-4c67-aaef-c5790877e8e6\") " pod="calico-system/whisker-7c85d6c7cb-dd4pw" Nov 4 23:21:55.069780 containerd[1974]: time="2025-11-04T23:21:55.069629860Z" level=info msg="TaskExit event in podsandbox handler container_id:\"734968a2bf7847c37be53b16593806fb188615b60b4ab06e25a834e12dd854f0\" id:\"5e00284dd7ae35d8b7ec5e3fe3b9ad7555793b61a60ba3ccdfdb95528c00cbae\" pid:4555 exit_status:1 exited_at:{seconds:1762298515 nanos:68044948}" Nov 4 23:21:55.227336 containerd[1974]: time="2025-11-04T23:21:55.227208509Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:whisker-7c85d6c7cb-dd4pw,Uid:cba52d39-d0ad-4c67-aaef-c5790877e8e6,Namespace:calico-system,Attempt:0,}" Nov 4 23:21:55.526578 (udev-worker)[4531]: Network interface NamePolicy= disabled on kernel command line. Nov 4 23:21:55.533005 systemd-networkd[1575]: calidbe9727f026: Link UP Nov 4 23:21:55.534996 systemd-networkd[1575]: calidbe9727f026: Gained carrier Nov 4 23:21:55.567280 containerd[1974]: 2025-11-04 23:21:55.277 [INFO][4577] cni-plugin/utils.go 100: File /var/lib/calico/mtu does not exist Nov 4 23:21:55.567280 containerd[1974]: 2025-11-04 23:21:55.359 [INFO][4577] cni-plugin/plugin.go 340: Calico CNI found existing endpoint: &{{WorkloadEndpoint projectcalico.org/v3} {ip--172--31--23--127-k8s-whisker--7c85d6c7cb--dd4pw-eth0 whisker-7c85d6c7cb- calico-system cba52d39-d0ad-4c67-aaef-c5790877e8e6 922 0 2025-11-04 23:21:54 +0000 UTC map[app.kubernetes.io/name:whisker k8s-app:whisker pod-template-hash:7c85d6c7cb projectcalico.org/namespace:calico-system projectcalico.org/orchestrator:k8s projectcalico.org/serviceaccount:whisker] map[] [] [] []} {k8s ip-172-31-23-127 whisker-7c85d6c7cb-dd4pw eth0 whisker [] [] [kns.calico-system ksa.calico-system.whisker] calidbe9727f026 [] [] }} ContainerID="5594662cf27c60a825d61cffb1df174888b1815ad6caa475b569e83c22a896e0" Namespace="calico-system" Pod="whisker-7c85d6c7cb-dd4pw" WorkloadEndpoint="ip--172--31--23--127-k8s-whisker--7c85d6c7cb--dd4pw-" Nov 4 23:21:55.567280 containerd[1974]: 2025-11-04 23:21:55.360 [INFO][4577] cni-plugin/k8s.go 74: Extracted identifiers for CmdAddK8s ContainerID="5594662cf27c60a825d61cffb1df174888b1815ad6caa475b569e83c22a896e0" Namespace="calico-system" Pod="whisker-7c85d6c7cb-dd4pw" WorkloadEndpoint="ip--172--31--23--127-k8s-whisker--7c85d6c7cb--dd4pw-eth0" Nov 4 23:21:55.567280 containerd[1974]: 2025-11-04 23:21:55.446 [INFO][4588] ipam/ipam_plugin.go 227: Calico CNI IPAM request count IPv4=1 IPv6=0 ContainerID="5594662cf27c60a825d61cffb1df174888b1815ad6caa475b569e83c22a896e0" HandleID="k8s-pod-network.5594662cf27c60a825d61cffb1df174888b1815ad6caa475b569e83c22a896e0" Workload="ip--172--31--23--127-k8s-whisker--7c85d6c7cb--dd4pw-eth0" Nov 4 23:21:55.567710 containerd[1974]: 2025-11-04 23:21:55.446 [INFO][4588] ipam/ipam_plugin.go 275: Auto assigning IP ContainerID="5594662cf27c60a825d61cffb1df174888b1815ad6caa475b569e83c22a896e0" HandleID="k8s-pod-network.5594662cf27c60a825d61cffb1df174888b1815ad6caa475b569e83c22a896e0" Workload="ip--172--31--23--127-k8s-whisker--7c85d6c7cb--dd4pw-eth0" assignArgs=ipam.AutoAssignArgs{Num4:1, Num6:0, HandleID:(*string)(0x40003b8440), Attrs:map[string]string{"namespace":"calico-system", "node":"ip-172-31-23-127", "pod":"whisker-7c85d6c7cb-dd4pw", "timestamp":"2025-11-04 23:21:55.446078178 +0000 UTC"}, Hostname:"ip-172-31-23-127", IPv4Pools:[]net.IPNet{}, IPv6Pools:[]net.IPNet{}, MaxBlocksPerHost:0, HostReservedAttrIPv4s:(*ipam.HostReservedAttr)(nil), HostReservedAttrIPv6s:(*ipam.HostReservedAttr)(nil), IntendedUse:"Workload"} Nov 4 23:21:55.567710 containerd[1974]: 2025-11-04 23:21:55.446 [INFO][4588] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 4 23:21:55.567710 containerd[1974]: 2025-11-04 23:21:55.446 [INFO][4588] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 4 23:21:55.567710 containerd[1974]: 2025-11-04 23:21:55.446 [INFO][4588] ipam/ipam.go 110: Auto-assign 1 ipv4, 0 ipv6 addrs for host 'ip-172-31-23-127' Nov 4 23:21:55.567710 containerd[1974]: 2025-11-04 23:21:55.465 [INFO][4588] ipam/ipam.go 691: Looking up existing affinities for host handle="k8s-pod-network.5594662cf27c60a825d61cffb1df174888b1815ad6caa475b569e83c22a896e0" host="ip-172-31-23-127" Nov 4 23:21:55.567710 containerd[1974]: 2025-11-04 23:21:55.473 [INFO][4588] ipam/ipam.go 394: Looking up existing affinities for host host="ip-172-31-23-127" Nov 4 23:21:55.567710 containerd[1974]: 2025-11-04 23:21:55.480 [INFO][4588] ipam/ipam.go 511: Trying affinity for 192.168.115.192/26 host="ip-172-31-23-127" Nov 4 23:21:55.567710 containerd[1974]: 2025-11-04 23:21:55.484 [INFO][4588] ipam/ipam.go 158: Attempting to load block cidr=192.168.115.192/26 host="ip-172-31-23-127" Nov 4 23:21:55.567710 containerd[1974]: 2025-11-04 23:21:55.487 [INFO][4588] ipam/ipam.go 235: Affinity is confirmed and block has been loaded cidr=192.168.115.192/26 host="ip-172-31-23-127" Nov 4 23:21:55.568508 containerd[1974]: 2025-11-04 23:21:55.488 [INFO][4588] ipam/ipam.go 1219: Attempting to assign 1 addresses from block block=192.168.115.192/26 handle="k8s-pod-network.5594662cf27c60a825d61cffb1df174888b1815ad6caa475b569e83c22a896e0" host="ip-172-31-23-127" Nov 4 23:21:55.568508 containerd[1974]: 2025-11-04 23:21:55.490 [INFO][4588] ipam/ipam.go 1780: Creating new handle: k8s-pod-network.5594662cf27c60a825d61cffb1df174888b1815ad6caa475b569e83c22a896e0 Nov 4 23:21:55.568508 containerd[1974]: 2025-11-04 23:21:55.497 [INFO][4588] ipam/ipam.go 1246: Writing block in order to claim IPs block=192.168.115.192/26 handle="k8s-pod-network.5594662cf27c60a825d61cffb1df174888b1815ad6caa475b569e83c22a896e0" host="ip-172-31-23-127" Nov 4 23:21:55.568508 containerd[1974]: 2025-11-04 23:21:55.505 [INFO][4588] ipam/ipam.go 1262: Successfully claimed IPs: [192.168.115.193/26] block=192.168.115.192/26 handle="k8s-pod-network.5594662cf27c60a825d61cffb1df174888b1815ad6caa475b569e83c22a896e0" host="ip-172-31-23-127" Nov 4 23:21:55.568508 containerd[1974]: 2025-11-04 23:21:55.505 [INFO][4588] ipam/ipam.go 878: Auto-assigned 1 out of 1 IPv4s: [192.168.115.193/26] handle="k8s-pod-network.5594662cf27c60a825d61cffb1df174888b1815ad6caa475b569e83c22a896e0" host="ip-172-31-23-127" Nov 4 23:21:55.568508 containerd[1974]: 2025-11-04 23:21:55.505 [INFO][4588] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 4 23:21:55.568508 containerd[1974]: 2025-11-04 23:21:55.505 [INFO][4588] ipam/ipam_plugin.go 299: Calico CNI IPAM assigned addresses IPv4=[192.168.115.193/26] IPv6=[] ContainerID="5594662cf27c60a825d61cffb1df174888b1815ad6caa475b569e83c22a896e0" HandleID="k8s-pod-network.5594662cf27c60a825d61cffb1df174888b1815ad6caa475b569e83c22a896e0" Workload="ip--172--31--23--127-k8s-whisker--7c85d6c7cb--dd4pw-eth0" Nov 4 23:21:55.569082 containerd[1974]: 2025-11-04 23:21:55.513 [INFO][4577] cni-plugin/k8s.go 418: Populated endpoint ContainerID="5594662cf27c60a825d61cffb1df174888b1815ad6caa475b569e83c22a896e0" Namespace="calico-system" Pod="whisker-7c85d6c7cb-dd4pw" WorkloadEndpoint="ip--172--31--23--127-k8s-whisker--7c85d6c7cb--dd4pw-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--23--127-k8s-whisker--7c85d6c7cb--dd4pw-eth0", GenerateName:"whisker-7c85d6c7cb-", Namespace:"calico-system", SelfLink:"", UID:"cba52d39-d0ad-4c67-aaef-c5790877e8e6", ResourceVersion:"922", Generation:0, CreationTimestamp:time.Date(2025, time.November, 4, 23, 21, 54, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app.kubernetes.io/name":"whisker", "k8s-app":"whisker", "pod-template-hash":"7c85d6c7cb", "projectcalico.org/namespace":"calico-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"whisker"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-23-127", ContainerID:"", Pod:"whisker-7c85d6c7cb-dd4pw", Endpoint:"eth0", ServiceAccountName:"whisker", IPNetworks:[]string{"192.168.115.193/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-system", "ksa.calico-system.whisker"}, InterfaceName:"calidbe9727f026", MAC:"", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 4 23:21:55.569082 containerd[1974]: 2025-11-04 23:21:55.514 [INFO][4577] cni-plugin/k8s.go 419: Calico CNI using IPs: [192.168.115.193/32] ContainerID="5594662cf27c60a825d61cffb1df174888b1815ad6caa475b569e83c22a896e0" Namespace="calico-system" Pod="whisker-7c85d6c7cb-dd4pw" WorkloadEndpoint="ip--172--31--23--127-k8s-whisker--7c85d6c7cb--dd4pw-eth0" Nov 4 23:21:55.569559 containerd[1974]: 2025-11-04 23:21:55.514 [INFO][4577] cni-plugin/dataplane_linux.go 69: Setting the host side veth name to calidbe9727f026 ContainerID="5594662cf27c60a825d61cffb1df174888b1815ad6caa475b569e83c22a896e0" Namespace="calico-system" Pod="whisker-7c85d6c7cb-dd4pw" WorkloadEndpoint="ip--172--31--23--127-k8s-whisker--7c85d6c7cb--dd4pw-eth0" Nov 4 23:21:55.569559 containerd[1974]: 2025-11-04 23:21:55.535 [INFO][4577] cni-plugin/dataplane_linux.go 508: Disabling IPv4 forwarding ContainerID="5594662cf27c60a825d61cffb1df174888b1815ad6caa475b569e83c22a896e0" Namespace="calico-system" Pod="whisker-7c85d6c7cb-dd4pw" WorkloadEndpoint="ip--172--31--23--127-k8s-whisker--7c85d6c7cb--dd4pw-eth0" Nov 4 23:21:55.569761 containerd[1974]: 2025-11-04 23:21:55.536 [INFO][4577] cni-plugin/k8s.go 446: Added Mac, interface name, and active container ID to endpoint ContainerID="5594662cf27c60a825d61cffb1df174888b1815ad6caa475b569e83c22a896e0" Namespace="calico-system" Pod="whisker-7c85d6c7cb-dd4pw" WorkloadEndpoint="ip--172--31--23--127-k8s-whisker--7c85d6c7cb--dd4pw-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--23--127-k8s-whisker--7c85d6c7cb--dd4pw-eth0", GenerateName:"whisker-7c85d6c7cb-", Namespace:"calico-system", SelfLink:"", UID:"cba52d39-d0ad-4c67-aaef-c5790877e8e6", ResourceVersion:"922", Generation:0, CreationTimestamp:time.Date(2025, time.November, 4, 23, 21, 54, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app.kubernetes.io/name":"whisker", "k8s-app":"whisker", "pod-template-hash":"7c85d6c7cb", "projectcalico.org/namespace":"calico-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"whisker"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-23-127", ContainerID:"5594662cf27c60a825d61cffb1df174888b1815ad6caa475b569e83c22a896e0", Pod:"whisker-7c85d6c7cb-dd4pw", Endpoint:"eth0", ServiceAccountName:"whisker", IPNetworks:[]string{"192.168.115.193/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-system", "ksa.calico-system.whisker"}, InterfaceName:"calidbe9727f026", MAC:"52:a0:7c:27:d2:10", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 4 23:21:55.570067 containerd[1974]: 2025-11-04 23:21:55.561 [INFO][4577] cni-plugin/k8s.go 532: Wrote updated endpoint to datastore ContainerID="5594662cf27c60a825d61cffb1df174888b1815ad6caa475b569e83c22a896e0" Namespace="calico-system" Pod="whisker-7c85d6c7cb-dd4pw" WorkloadEndpoint="ip--172--31--23--127-k8s-whisker--7c85d6c7cb--dd4pw-eth0" Nov 4 23:21:55.611475 containerd[1974]: time="2025-11-04T23:21:55.611409943Z" level=info msg="connecting to shim 5594662cf27c60a825d61cffb1df174888b1815ad6caa475b569e83c22a896e0" address="unix:///run/containerd/s/544849cb14c559910fddc714567b598bb934eff03c9c70c699c505250e392d1b" namespace=k8s.io protocol=ttrpc version=3 Nov 4 23:21:55.667245 systemd[1]: Started cri-containerd-5594662cf27c60a825d61cffb1df174888b1815ad6caa475b569e83c22a896e0.scope - libcontainer container 5594662cf27c60a825d61cffb1df174888b1815ad6caa475b569e83c22a896e0. Nov 4 23:21:55.768238 containerd[1974]: time="2025-11-04T23:21:55.768162763Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:whisker-7c85d6c7cb-dd4pw,Uid:cba52d39-d0ad-4c67-aaef-c5790877e8e6,Namespace:calico-system,Attempt:0,} returns sandbox id \"5594662cf27c60a825d61cffb1df174888b1815ad6caa475b569e83c22a896e0\"" Nov 4 23:21:55.776590 containerd[1974]: time="2025-11-04T23:21:55.776522515Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/whisker:v3.30.4\"" Nov 4 23:21:56.054967 containerd[1974]: time="2025-11-04T23:21:56.054280217Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:21:56.057755 containerd[1974]: time="2025-11-04T23:21:56.057525593Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/whisker:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" Nov 4 23:21:56.057755 containerd[1974]: time="2025-11-04T23:21:56.057693257Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/whisker:v3.30.4: active requests=0, bytes read=73" Nov 4 23:21:56.058035 kubelet[3304]: E1104 23:21:56.057987 3304 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker:v3.30.4" Nov 4 23:21:56.059541 kubelet[3304]: E1104 23:21:56.059377 3304 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker:v3.30.4" Nov 4 23:21:56.061764 kubelet[3304]: E1104 23:21:56.061619 3304 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:whisker,Image:ghcr.io/flatcar/calico/whisker:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:INFO,ValueFrom:nil,},EnvVar{Name:CALICO_VERSION,Value:v3.30.4,ValueFrom:nil,},EnvVar{Name:CLUSTER_ID,Value:8dba38a1bbf64129b15305fae4af3a0f,ValueFrom:nil,},EnvVar{Name:CLUSTER_TYPE,Value:typha,kdd,k8s,operator,bgp,kubeadm,ValueFrom:nil,},EnvVar{Name:NOTIFICATIONS,Value:Enabled,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-swwgh,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod whisker-7c85d6c7cb-dd4pw_calico-system(cba52d39-d0ad-4c67-aaef-c5790877e8e6): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" logger="UnhandledError" Nov 4 23:21:56.067095 containerd[1974]: time="2025-11-04T23:21:56.066651845Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\"" Nov 4 23:21:56.307436 kubelet[3304]: I1104 23:21:56.307176 3304 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c8eb056-a29a-4a21-b501-58521c19fc76" path="/var/lib/kubelet/pods/6c8eb056-a29a-4a21-b501-58521c19fc76/volumes" Nov 4 23:21:56.319342 containerd[1974]: time="2025-11-04T23:21:56.319138914Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:21:56.321576 containerd[1974]: time="2025-11-04T23:21:56.321462930Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" Nov 4 23:21:56.322643 containerd[1974]: time="2025-11-04T23:21:56.321525570Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/whisker-backend:v3.30.4: active requests=0, bytes read=85" Nov 4 23:21:56.324574 kubelet[3304]: E1104 23:21:56.323062 3304 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker-backend:v3.30.4" Nov 4 23:21:56.324900 kubelet[3304]: E1104 23:21:56.324545 3304 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker-backend:v3.30.4" Nov 4 23:21:56.326508 kubelet[3304]: E1104 23:21:56.325328 3304 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:whisker-backend,Image:ghcr.io/flatcar/calico/whisker-backend:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:INFO,ValueFrom:nil,},EnvVar{Name:PORT,Value:3002,ValueFrom:nil,},EnvVar{Name:GOLDMANE_HOST,Value:goldmane.calico-system.svc.cluster.local:7443,ValueFrom:nil,},EnvVar{Name:TLS_CERT_PATH,Value:/whisker-backend-key-pair/tls.crt,ValueFrom:nil,},EnvVar{Name:TLS_KEY_PATH,Value:/whisker-backend-key-pair/tls.key,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:whisker-backend-key-pair,ReadOnly:true,MountPath:/whisker-backend-key-pair,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:whisker-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-swwgh,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod whisker-7c85d6c7cb-dd4pw_calico-system(cba52d39-d0ad-4c67-aaef-c5790877e8e6): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" logger="UnhandledError" Nov 4 23:21:56.329092 kubelet[3304]: E1104 23:21:56.328999 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"whisker\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found\", failed to \"StartContainer\" for \"whisker-backend\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found\"]" pod="calico-system/whisker-7c85d6c7cb-dd4pw" podUID="cba52d39-d0ad-4c67-aaef-c5790877e8e6" Nov 4 23:21:56.464298 containerd[1974]: time="2025-11-04T23:21:56.463450207Z" level=info msg="TaskExit event in podsandbox handler container_id:\"734968a2bf7847c37be53b16593806fb188615b60b4ab06e25a834e12dd854f0\" id:\"35aa520b12d7d0ec4e23dd711dc35b6bec3a96a5f1dc20bbf7c9026363f78015\" pid:4659 exit_status:1 exited_at:{seconds:1762298516 nanos:462704539}" Nov 4 23:21:56.741706 kubelet[3304]: E1104 23:21:56.741594 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"whisker\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found\", failed to \"StartContainer\" for \"whisker-backend\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found\"]" pod="calico-system/whisker-7c85d6c7cb-dd4pw" podUID="cba52d39-d0ad-4c67-aaef-c5790877e8e6" Nov 4 23:21:57.262524 (udev-worker)[4530]: Network interface NamePolicy= disabled on kernel command line. Nov 4 23:21:57.280500 systemd-networkd[1575]: vxlan.calico: Link UP Nov 4 23:21:57.280520 systemd-networkd[1575]: vxlan.calico: Gained carrier Nov 4 23:21:57.298596 containerd[1974]: time="2025-11-04T23:21:57.298533175Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:goldmane-666569f655-sfktq,Uid:f026c0ae-4dbf-4901-893b-d3b577723fff,Namespace:calico-system,Attempt:0,}" Nov 4 23:21:57.476646 systemd-networkd[1575]: calidbe9727f026: Gained IPv6LL Nov 4 23:21:57.561267 (udev-worker)[4837]: Network interface NamePolicy= disabled on kernel command line. Nov 4 23:21:57.563239 systemd-networkd[1575]: cali275f02f0dc5: Link UP Nov 4 23:21:57.566564 systemd-networkd[1575]: cali275f02f0dc5: Gained carrier Nov 4 23:21:57.604994 containerd[1974]: 2025-11-04 23:21:57.430 [INFO][4821] cni-plugin/plugin.go 340: Calico CNI found existing endpoint: &{{WorkloadEndpoint projectcalico.org/v3} {ip--172--31--23--127-k8s-goldmane--666569f655--sfktq-eth0 goldmane-666569f655- calico-system f026c0ae-4dbf-4901-893b-d3b577723fff 854 0 2025-11-04 23:21:28 +0000 UTC map[app.kubernetes.io/name:goldmane k8s-app:goldmane pod-template-hash:666569f655 projectcalico.org/namespace:calico-system projectcalico.org/orchestrator:k8s projectcalico.org/serviceaccount:goldmane] map[] [] [] []} {k8s ip-172-31-23-127 goldmane-666569f655-sfktq eth0 goldmane [] [] [kns.calico-system ksa.calico-system.goldmane] cali275f02f0dc5 [] [] }} ContainerID="00822127048dff586acd7df1e85861db810f091202bcdef25be924a818b85195" Namespace="calico-system" Pod="goldmane-666569f655-sfktq" WorkloadEndpoint="ip--172--31--23--127-k8s-goldmane--666569f655--sfktq-" Nov 4 23:21:57.604994 containerd[1974]: 2025-11-04 23:21:57.430 [INFO][4821] cni-plugin/k8s.go 74: Extracted identifiers for CmdAddK8s ContainerID="00822127048dff586acd7df1e85861db810f091202bcdef25be924a818b85195" Namespace="calico-system" Pod="goldmane-666569f655-sfktq" WorkloadEndpoint="ip--172--31--23--127-k8s-goldmane--666569f655--sfktq-eth0" Nov 4 23:21:57.604994 containerd[1974]: 2025-11-04 23:21:57.490 [INFO][4843] ipam/ipam_plugin.go 227: Calico CNI IPAM request count IPv4=1 IPv6=0 ContainerID="00822127048dff586acd7df1e85861db810f091202bcdef25be924a818b85195" HandleID="k8s-pod-network.00822127048dff586acd7df1e85861db810f091202bcdef25be924a818b85195" Workload="ip--172--31--23--127-k8s-goldmane--666569f655--sfktq-eth0" Nov 4 23:21:57.605704 containerd[1974]: 2025-11-04 23:21:57.490 [INFO][4843] ipam/ipam_plugin.go 275: Auto assigning IP ContainerID="00822127048dff586acd7df1e85861db810f091202bcdef25be924a818b85195" HandleID="k8s-pod-network.00822127048dff586acd7df1e85861db810f091202bcdef25be924a818b85195" Workload="ip--172--31--23--127-k8s-goldmane--666569f655--sfktq-eth0" assignArgs=ipam.AutoAssignArgs{Num4:1, Num6:0, HandleID:(*string)(0x40002d3be0), Attrs:map[string]string{"namespace":"calico-system", "node":"ip-172-31-23-127", "pod":"goldmane-666569f655-sfktq", "timestamp":"2025-11-04 23:21:57.490207472 +0000 UTC"}, Hostname:"ip-172-31-23-127", IPv4Pools:[]net.IPNet{}, IPv6Pools:[]net.IPNet{}, MaxBlocksPerHost:0, HostReservedAttrIPv4s:(*ipam.HostReservedAttr)(nil), HostReservedAttrIPv6s:(*ipam.HostReservedAttr)(nil), IntendedUse:"Workload"} Nov 4 23:21:57.605704 containerd[1974]: 2025-11-04 23:21:57.490 [INFO][4843] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 4 23:21:57.605704 containerd[1974]: 2025-11-04 23:21:57.490 [INFO][4843] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 4 23:21:57.605704 containerd[1974]: 2025-11-04 23:21:57.490 [INFO][4843] ipam/ipam.go 110: Auto-assign 1 ipv4, 0 ipv6 addrs for host 'ip-172-31-23-127' Nov 4 23:21:57.605704 containerd[1974]: 2025-11-04 23:21:57.506 [INFO][4843] ipam/ipam.go 691: Looking up existing affinities for host handle="k8s-pod-network.00822127048dff586acd7df1e85861db810f091202bcdef25be924a818b85195" host="ip-172-31-23-127" Nov 4 23:21:57.605704 containerd[1974]: 2025-11-04 23:21:57.516 [INFO][4843] ipam/ipam.go 394: Looking up existing affinities for host host="ip-172-31-23-127" Nov 4 23:21:57.605704 containerd[1974]: 2025-11-04 23:21:57.523 [INFO][4843] ipam/ipam.go 511: Trying affinity for 192.168.115.192/26 host="ip-172-31-23-127" Nov 4 23:21:57.605704 containerd[1974]: 2025-11-04 23:21:57.528 [INFO][4843] ipam/ipam.go 158: Attempting to load block cidr=192.168.115.192/26 host="ip-172-31-23-127" Nov 4 23:21:57.605704 containerd[1974]: 2025-11-04 23:21:57.532 [INFO][4843] ipam/ipam.go 235: Affinity is confirmed and block has been loaded cidr=192.168.115.192/26 host="ip-172-31-23-127" Nov 4 23:21:57.606203 containerd[1974]: 2025-11-04 23:21:57.532 [INFO][4843] ipam/ipam.go 1219: Attempting to assign 1 addresses from block block=192.168.115.192/26 handle="k8s-pod-network.00822127048dff586acd7df1e85861db810f091202bcdef25be924a818b85195" host="ip-172-31-23-127" Nov 4 23:21:57.606203 containerd[1974]: 2025-11-04 23:21:57.535 [INFO][4843] ipam/ipam.go 1780: Creating new handle: k8s-pod-network.00822127048dff586acd7df1e85861db810f091202bcdef25be924a818b85195 Nov 4 23:21:57.606203 containerd[1974]: 2025-11-04 23:21:57.543 [INFO][4843] ipam/ipam.go 1246: Writing block in order to claim IPs block=192.168.115.192/26 handle="k8s-pod-network.00822127048dff586acd7df1e85861db810f091202bcdef25be924a818b85195" host="ip-172-31-23-127" Nov 4 23:21:57.606203 containerd[1974]: 2025-11-04 23:21:57.552 [INFO][4843] ipam/ipam.go 1262: Successfully claimed IPs: [192.168.115.194/26] block=192.168.115.192/26 handle="k8s-pod-network.00822127048dff586acd7df1e85861db810f091202bcdef25be924a818b85195" host="ip-172-31-23-127" Nov 4 23:21:57.606203 containerd[1974]: 2025-11-04 23:21:57.552 [INFO][4843] ipam/ipam.go 878: Auto-assigned 1 out of 1 IPv4s: [192.168.115.194/26] handle="k8s-pod-network.00822127048dff586acd7df1e85861db810f091202bcdef25be924a818b85195" host="ip-172-31-23-127" Nov 4 23:21:57.606203 containerd[1974]: 2025-11-04 23:21:57.552 [INFO][4843] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 4 23:21:57.606203 containerd[1974]: 2025-11-04 23:21:57.552 [INFO][4843] ipam/ipam_plugin.go 299: Calico CNI IPAM assigned addresses IPv4=[192.168.115.194/26] IPv6=[] ContainerID="00822127048dff586acd7df1e85861db810f091202bcdef25be924a818b85195" HandleID="k8s-pod-network.00822127048dff586acd7df1e85861db810f091202bcdef25be924a818b85195" Workload="ip--172--31--23--127-k8s-goldmane--666569f655--sfktq-eth0" Nov 4 23:21:57.606561 containerd[1974]: 2025-11-04 23:21:57.556 [INFO][4821] cni-plugin/k8s.go 418: Populated endpoint ContainerID="00822127048dff586acd7df1e85861db810f091202bcdef25be924a818b85195" Namespace="calico-system" Pod="goldmane-666569f655-sfktq" WorkloadEndpoint="ip--172--31--23--127-k8s-goldmane--666569f655--sfktq-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--23--127-k8s-goldmane--666569f655--sfktq-eth0", GenerateName:"goldmane-666569f655-", Namespace:"calico-system", SelfLink:"", UID:"f026c0ae-4dbf-4901-893b-d3b577723fff", ResourceVersion:"854", Generation:0, CreationTimestamp:time.Date(2025, time.November, 4, 23, 21, 28, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app.kubernetes.io/name":"goldmane", "k8s-app":"goldmane", "pod-template-hash":"666569f655", "projectcalico.org/namespace":"calico-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"goldmane"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-23-127", ContainerID:"", Pod:"goldmane-666569f655-sfktq", Endpoint:"eth0", ServiceAccountName:"goldmane", IPNetworks:[]string{"192.168.115.194/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-system", "ksa.calico-system.goldmane"}, InterfaceName:"cali275f02f0dc5", MAC:"", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 4 23:21:57.606561 containerd[1974]: 2025-11-04 23:21:57.556 [INFO][4821] cni-plugin/k8s.go 419: Calico CNI using IPs: [192.168.115.194/32] ContainerID="00822127048dff586acd7df1e85861db810f091202bcdef25be924a818b85195" Namespace="calico-system" Pod="goldmane-666569f655-sfktq" WorkloadEndpoint="ip--172--31--23--127-k8s-goldmane--666569f655--sfktq-eth0" Nov 4 23:21:57.606741 containerd[1974]: 2025-11-04 23:21:57.556 [INFO][4821] cni-plugin/dataplane_linux.go 69: Setting the host side veth name to cali275f02f0dc5 ContainerID="00822127048dff586acd7df1e85861db810f091202bcdef25be924a818b85195" Namespace="calico-system" Pod="goldmane-666569f655-sfktq" WorkloadEndpoint="ip--172--31--23--127-k8s-goldmane--666569f655--sfktq-eth0" Nov 4 23:21:57.606741 containerd[1974]: 2025-11-04 23:21:57.567 [INFO][4821] cni-plugin/dataplane_linux.go 508: Disabling IPv4 forwarding ContainerID="00822127048dff586acd7df1e85861db810f091202bcdef25be924a818b85195" Namespace="calico-system" Pod="goldmane-666569f655-sfktq" WorkloadEndpoint="ip--172--31--23--127-k8s-goldmane--666569f655--sfktq-eth0" Nov 4 23:21:57.606845 containerd[1974]: 2025-11-04 23:21:57.572 [INFO][4821] cni-plugin/k8s.go 446: Added Mac, interface name, and active container ID to endpoint ContainerID="00822127048dff586acd7df1e85861db810f091202bcdef25be924a818b85195" Namespace="calico-system" Pod="goldmane-666569f655-sfktq" WorkloadEndpoint="ip--172--31--23--127-k8s-goldmane--666569f655--sfktq-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--23--127-k8s-goldmane--666569f655--sfktq-eth0", GenerateName:"goldmane-666569f655-", Namespace:"calico-system", SelfLink:"", UID:"f026c0ae-4dbf-4901-893b-d3b577723fff", ResourceVersion:"854", Generation:0, CreationTimestamp:time.Date(2025, time.November, 4, 23, 21, 28, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app.kubernetes.io/name":"goldmane", "k8s-app":"goldmane", "pod-template-hash":"666569f655", "projectcalico.org/namespace":"calico-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"goldmane"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-23-127", ContainerID:"00822127048dff586acd7df1e85861db810f091202bcdef25be924a818b85195", Pod:"goldmane-666569f655-sfktq", Endpoint:"eth0", ServiceAccountName:"goldmane", IPNetworks:[]string{"192.168.115.194/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-system", "ksa.calico-system.goldmane"}, InterfaceName:"cali275f02f0dc5", MAC:"8a:f3:c7:93:bd:0d", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 4 23:21:57.608181 containerd[1974]: 2025-11-04 23:21:57.598 [INFO][4821] cni-plugin/k8s.go 532: Wrote updated endpoint to datastore ContainerID="00822127048dff586acd7df1e85861db810f091202bcdef25be924a818b85195" Namespace="calico-system" Pod="goldmane-666569f655-sfktq" WorkloadEndpoint="ip--172--31--23--127-k8s-goldmane--666569f655--sfktq-eth0" Nov 4 23:21:57.668496 containerd[1974]: time="2025-11-04T23:21:57.668425545Z" level=info msg="connecting to shim 00822127048dff586acd7df1e85861db810f091202bcdef25be924a818b85195" address="unix:///run/containerd/s/ce6d29d92770b1d2a386095075ac5b1f0e74105e74714eccce80503bd4db746b" namespace=k8s.io protocol=ttrpc version=3 Nov 4 23:21:57.723292 systemd[1]: Started cri-containerd-00822127048dff586acd7df1e85861db810f091202bcdef25be924a818b85195.scope - libcontainer container 00822127048dff586acd7df1e85861db810f091202bcdef25be924a818b85195. Nov 4 23:21:57.748506 kubelet[3304]: E1104 23:21:57.748188 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"whisker\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found\", failed to \"StartContainer\" for \"whisker-backend\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found\"]" pod="calico-system/whisker-7c85d6c7cb-dd4pw" podUID="cba52d39-d0ad-4c67-aaef-c5790877e8e6" Nov 4 23:21:57.894880 containerd[1974]: time="2025-11-04T23:21:57.894668518Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:goldmane-666569f655-sfktq,Uid:f026c0ae-4dbf-4901-893b-d3b577723fff,Namespace:calico-system,Attempt:0,} returns sandbox id \"00822127048dff586acd7df1e85861db810f091202bcdef25be924a818b85195\"" Nov 4 23:21:57.898213 containerd[1974]: time="2025-11-04T23:21:57.898144798Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/goldmane:v3.30.4\"" Nov 4 23:21:58.192443 containerd[1974]: time="2025-11-04T23:21:58.192382123Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:21:58.194688 containerd[1974]: time="2025-11-04T23:21:58.194626195Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/goldmane:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" Nov 4 23:21:58.194986 containerd[1974]: time="2025-11-04T23:21:58.194746363Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/goldmane:v3.30.4: active requests=0, bytes read=77" Nov 4 23:21:58.195287 kubelet[3304]: E1104 23:21:58.195203 3304 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" image="ghcr.io/flatcar/calico/goldmane:v3.30.4" Nov 4 23:21:58.195451 kubelet[3304]: E1104 23:21:58.195300 3304 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" image="ghcr.io/flatcar/calico/goldmane:v3.30.4" Nov 4 23:21:58.196103 kubelet[3304]: E1104 23:21:58.195973 3304 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:goldmane,Image:ghcr.io/flatcar/calico/goldmane:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:INFO,ValueFrom:nil,},EnvVar{Name:PORT,Value:7443,ValueFrom:nil,},EnvVar{Name:SERVER_CERT_PATH,Value:/goldmane-key-pair/tls.crt,ValueFrom:nil,},EnvVar{Name:SERVER_KEY_PATH,Value:/goldmane-key-pair/tls.key,ValueFrom:nil,},EnvVar{Name:CA_CERT_PATH,Value:/etc/pki/tls/certs/tigera-ca-bundle.crt,ValueFrom:nil,},EnvVar{Name:PUSH_URL,Value:https://guardian.calico-system.svc.cluster.local:443/api/v1/flows/bulk,ValueFrom:nil,},EnvVar{Name:FILE_CONFIG_PATH,Value:/config/config.json,ValueFrom:nil,},EnvVar{Name:HEALTH_ENABLED,Value:true,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:config,ReadOnly:true,MountPath:/config,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:goldmane-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:goldmane-key-pair,ReadOnly:true,MountPath:/goldmane-key-pair,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-2vpxq,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/health -live],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/health -ready],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:30,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod goldmane-666569f655-sfktq_calico-system(f026c0ae-4dbf-4901-893b-d3b577723fff): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" logger="UnhandledError" Nov 4 23:21:58.197528 kubelet[3304]: E1104 23:21:58.197459 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"goldmane\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found\"" pod="calico-system/goldmane-666569f655-sfktq" podUID="f026c0ae-4dbf-4901-893b-d3b577723fff" Nov 4 23:21:58.436325 systemd-networkd[1575]: vxlan.calico: Gained IPv6LL Nov 4 23:21:58.747643 kubelet[3304]: E1104 23:21:58.747570 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"goldmane\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found\"" pod="calico-system/goldmane-666569f655-sfktq" podUID="f026c0ae-4dbf-4901-893b-d3b577723fff" Nov 4 23:21:58.884787 systemd-networkd[1575]: cali275f02f0dc5: Gained IPv6LL Nov 4 23:21:59.298757 containerd[1974]: time="2025-11-04T23:21:59.298682373Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-f66b9548c-6sxnc,Uid:3262dea2-8952-4d22-82d3-50fc85d38fcd,Namespace:calico-apiserver,Attempt:0,}" Nov 4 23:21:59.299412 containerd[1974]: time="2025-11-04T23:21:59.299370105Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-674b8bbfcf-29vjx,Uid:c8ee1bb8-dd7e-475b-8eb7-dab815e66227,Namespace:kube-system,Attempt:0,}" Nov 4 23:21:59.704628 systemd-networkd[1575]: cali9b90589e4e4: Link UP Nov 4 23:21:59.705096 systemd-networkd[1575]: cali9b90589e4e4: Gained carrier Nov 4 23:21:59.757042 containerd[1974]: 2025-11-04 23:21:59.435 [INFO][4940] cni-plugin/plugin.go 340: Calico CNI found existing endpoint: &{{WorkloadEndpoint projectcalico.org/v3} {ip--172--31--23--127-k8s-calico--apiserver--f66b9548c--6sxnc-eth0 calico-apiserver-f66b9548c- calico-apiserver 3262dea2-8952-4d22-82d3-50fc85d38fcd 857 0 2025-11-04 23:21:18 +0000 UTC map[apiserver:true app.kubernetes.io/name:calico-apiserver k8s-app:calico-apiserver pod-template-hash:f66b9548c projectcalico.org/namespace:calico-apiserver projectcalico.org/orchestrator:k8s projectcalico.org/serviceaccount:calico-apiserver] map[] [] [] []} {k8s ip-172-31-23-127 calico-apiserver-f66b9548c-6sxnc eth0 calico-apiserver [] [] [kns.calico-apiserver ksa.calico-apiserver.calico-apiserver] cali9b90589e4e4 [] [] }} ContainerID="6e20fb988384218a5ef1d89dbee862ffcfe1ed3e771481eb88c786f51467f293" Namespace="calico-apiserver" Pod="calico-apiserver-f66b9548c-6sxnc" WorkloadEndpoint="ip--172--31--23--127-k8s-calico--apiserver--f66b9548c--6sxnc-" Nov 4 23:21:59.757042 containerd[1974]: 2025-11-04 23:21:59.436 [INFO][4940] cni-plugin/k8s.go 74: Extracted identifiers for CmdAddK8s ContainerID="6e20fb988384218a5ef1d89dbee862ffcfe1ed3e771481eb88c786f51467f293" Namespace="calico-apiserver" Pod="calico-apiserver-f66b9548c-6sxnc" WorkloadEndpoint="ip--172--31--23--127-k8s-calico--apiserver--f66b9548c--6sxnc-eth0" Nov 4 23:21:59.757042 containerd[1974]: 2025-11-04 23:21:59.561 [INFO][4965] ipam/ipam_plugin.go 227: Calico CNI IPAM request count IPv4=1 IPv6=0 ContainerID="6e20fb988384218a5ef1d89dbee862ffcfe1ed3e771481eb88c786f51467f293" HandleID="k8s-pod-network.6e20fb988384218a5ef1d89dbee862ffcfe1ed3e771481eb88c786f51467f293" Workload="ip--172--31--23--127-k8s-calico--apiserver--f66b9548c--6sxnc-eth0" Nov 4 23:21:59.757404 containerd[1974]: 2025-11-04 23:21:59.562 [INFO][4965] ipam/ipam_plugin.go 275: Auto assigning IP ContainerID="6e20fb988384218a5ef1d89dbee862ffcfe1ed3e771481eb88c786f51467f293" HandleID="k8s-pod-network.6e20fb988384218a5ef1d89dbee862ffcfe1ed3e771481eb88c786f51467f293" Workload="ip--172--31--23--127-k8s-calico--apiserver--f66b9548c--6sxnc-eth0" assignArgs=ipam.AutoAssignArgs{Num4:1, Num6:0, HandleID:(*string)(0x4000330ac0), Attrs:map[string]string{"namespace":"calico-apiserver", "node":"ip-172-31-23-127", "pod":"calico-apiserver-f66b9548c-6sxnc", "timestamp":"2025-11-04 23:21:59.56167177 +0000 UTC"}, Hostname:"ip-172-31-23-127", IPv4Pools:[]net.IPNet{}, IPv6Pools:[]net.IPNet{}, MaxBlocksPerHost:0, HostReservedAttrIPv4s:(*ipam.HostReservedAttr)(nil), HostReservedAttrIPv6s:(*ipam.HostReservedAttr)(nil), IntendedUse:"Workload"} Nov 4 23:21:59.757404 containerd[1974]: 2025-11-04 23:21:59.563 [INFO][4965] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 4 23:21:59.757404 containerd[1974]: 2025-11-04 23:21:59.563 [INFO][4965] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 4 23:21:59.757404 containerd[1974]: 2025-11-04 23:21:59.564 [INFO][4965] ipam/ipam.go 110: Auto-assign 1 ipv4, 0 ipv6 addrs for host 'ip-172-31-23-127' Nov 4 23:21:59.757404 containerd[1974]: 2025-11-04 23:21:59.594 [INFO][4965] ipam/ipam.go 691: Looking up existing affinities for host handle="k8s-pod-network.6e20fb988384218a5ef1d89dbee862ffcfe1ed3e771481eb88c786f51467f293" host="ip-172-31-23-127" Nov 4 23:21:59.757404 containerd[1974]: 2025-11-04 23:21:59.623 [INFO][4965] ipam/ipam.go 394: Looking up existing affinities for host host="ip-172-31-23-127" Nov 4 23:21:59.757404 containerd[1974]: 2025-11-04 23:21:59.638 [INFO][4965] ipam/ipam.go 511: Trying affinity for 192.168.115.192/26 host="ip-172-31-23-127" Nov 4 23:21:59.757404 containerd[1974]: 2025-11-04 23:21:59.643 [INFO][4965] ipam/ipam.go 158: Attempting to load block cidr=192.168.115.192/26 host="ip-172-31-23-127" Nov 4 23:21:59.757404 containerd[1974]: 2025-11-04 23:21:59.650 [INFO][4965] ipam/ipam.go 235: Affinity is confirmed and block has been loaded cidr=192.168.115.192/26 host="ip-172-31-23-127" Nov 4 23:21:59.761650 containerd[1974]: 2025-11-04 23:21:59.651 [INFO][4965] ipam/ipam.go 1219: Attempting to assign 1 addresses from block block=192.168.115.192/26 handle="k8s-pod-network.6e20fb988384218a5ef1d89dbee862ffcfe1ed3e771481eb88c786f51467f293" host="ip-172-31-23-127" Nov 4 23:21:59.761650 containerd[1974]: 2025-11-04 23:21:59.655 [INFO][4965] ipam/ipam.go 1780: Creating new handle: k8s-pod-network.6e20fb988384218a5ef1d89dbee862ffcfe1ed3e771481eb88c786f51467f293 Nov 4 23:21:59.761650 containerd[1974]: 2025-11-04 23:21:59.674 [INFO][4965] ipam/ipam.go 1246: Writing block in order to claim IPs block=192.168.115.192/26 handle="k8s-pod-network.6e20fb988384218a5ef1d89dbee862ffcfe1ed3e771481eb88c786f51467f293" host="ip-172-31-23-127" Nov 4 23:21:59.761650 containerd[1974]: 2025-11-04 23:21:59.688 [INFO][4965] ipam/ipam.go 1262: Successfully claimed IPs: [192.168.115.195/26] block=192.168.115.192/26 handle="k8s-pod-network.6e20fb988384218a5ef1d89dbee862ffcfe1ed3e771481eb88c786f51467f293" host="ip-172-31-23-127" Nov 4 23:21:59.761650 containerd[1974]: 2025-11-04 23:21:59.688 [INFO][4965] ipam/ipam.go 878: Auto-assigned 1 out of 1 IPv4s: [192.168.115.195/26] handle="k8s-pod-network.6e20fb988384218a5ef1d89dbee862ffcfe1ed3e771481eb88c786f51467f293" host="ip-172-31-23-127" Nov 4 23:21:59.761650 containerd[1974]: 2025-11-04 23:21:59.688 [INFO][4965] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 4 23:21:59.761650 containerd[1974]: 2025-11-04 23:21:59.688 [INFO][4965] ipam/ipam_plugin.go 299: Calico CNI IPAM assigned addresses IPv4=[192.168.115.195/26] IPv6=[] ContainerID="6e20fb988384218a5ef1d89dbee862ffcfe1ed3e771481eb88c786f51467f293" HandleID="k8s-pod-network.6e20fb988384218a5ef1d89dbee862ffcfe1ed3e771481eb88c786f51467f293" Workload="ip--172--31--23--127-k8s-calico--apiserver--f66b9548c--6sxnc-eth0" Nov 4 23:21:59.762062 kubelet[3304]: E1104 23:21:59.758149 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"goldmane\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found\"" pod="calico-system/goldmane-666569f655-sfktq" podUID="f026c0ae-4dbf-4901-893b-d3b577723fff" Nov 4 23:21:59.762763 containerd[1974]: 2025-11-04 23:21:59.694 [INFO][4940] cni-plugin/k8s.go 418: Populated endpoint ContainerID="6e20fb988384218a5ef1d89dbee862ffcfe1ed3e771481eb88c786f51467f293" Namespace="calico-apiserver" Pod="calico-apiserver-f66b9548c-6sxnc" WorkloadEndpoint="ip--172--31--23--127-k8s-calico--apiserver--f66b9548c--6sxnc-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--23--127-k8s-calico--apiserver--f66b9548c--6sxnc-eth0", GenerateName:"calico-apiserver-f66b9548c-", Namespace:"calico-apiserver", SelfLink:"", UID:"3262dea2-8952-4d22-82d3-50fc85d38fcd", ResourceVersion:"857", Generation:0, CreationTimestamp:time.Date(2025, time.November, 4, 23, 21, 18, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"apiserver":"true", "app.kubernetes.io/name":"calico-apiserver", "k8s-app":"calico-apiserver", "pod-template-hash":"f66b9548c", "projectcalico.org/namespace":"calico-apiserver", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"calico-apiserver"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-23-127", ContainerID:"", Pod:"calico-apiserver-f66b9548c-6sxnc", Endpoint:"eth0", ServiceAccountName:"calico-apiserver", IPNetworks:[]string{"192.168.115.195/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-apiserver", "ksa.calico-apiserver.calico-apiserver"}, InterfaceName:"cali9b90589e4e4", MAC:"", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 4 23:21:59.765011 containerd[1974]: 2025-11-04 23:21:59.695 [INFO][4940] cni-plugin/k8s.go 419: Calico CNI using IPs: [192.168.115.195/32] ContainerID="6e20fb988384218a5ef1d89dbee862ffcfe1ed3e771481eb88c786f51467f293" Namespace="calico-apiserver" Pod="calico-apiserver-f66b9548c-6sxnc" WorkloadEndpoint="ip--172--31--23--127-k8s-calico--apiserver--f66b9548c--6sxnc-eth0" Nov 4 23:21:59.765011 containerd[1974]: 2025-11-04 23:21:59.695 [INFO][4940] cni-plugin/dataplane_linux.go 69: Setting the host side veth name to cali9b90589e4e4 ContainerID="6e20fb988384218a5ef1d89dbee862ffcfe1ed3e771481eb88c786f51467f293" Namespace="calico-apiserver" Pod="calico-apiserver-f66b9548c-6sxnc" WorkloadEndpoint="ip--172--31--23--127-k8s-calico--apiserver--f66b9548c--6sxnc-eth0" Nov 4 23:21:59.765011 containerd[1974]: 2025-11-04 23:21:59.708 [INFO][4940] cni-plugin/dataplane_linux.go 508: Disabling IPv4 forwarding ContainerID="6e20fb988384218a5ef1d89dbee862ffcfe1ed3e771481eb88c786f51467f293" Namespace="calico-apiserver" Pod="calico-apiserver-f66b9548c-6sxnc" WorkloadEndpoint="ip--172--31--23--127-k8s-calico--apiserver--f66b9548c--6sxnc-eth0" Nov 4 23:21:59.766196 containerd[1974]: 2025-11-04 23:21:59.711 [INFO][4940] cni-plugin/k8s.go 446: Added Mac, interface name, and active container ID to endpoint ContainerID="6e20fb988384218a5ef1d89dbee862ffcfe1ed3e771481eb88c786f51467f293" Namespace="calico-apiserver" Pod="calico-apiserver-f66b9548c-6sxnc" WorkloadEndpoint="ip--172--31--23--127-k8s-calico--apiserver--f66b9548c--6sxnc-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--23--127-k8s-calico--apiserver--f66b9548c--6sxnc-eth0", GenerateName:"calico-apiserver-f66b9548c-", Namespace:"calico-apiserver", SelfLink:"", UID:"3262dea2-8952-4d22-82d3-50fc85d38fcd", ResourceVersion:"857", Generation:0, CreationTimestamp:time.Date(2025, time.November, 4, 23, 21, 18, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"apiserver":"true", "app.kubernetes.io/name":"calico-apiserver", "k8s-app":"calico-apiserver", "pod-template-hash":"f66b9548c", "projectcalico.org/namespace":"calico-apiserver", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"calico-apiserver"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-23-127", ContainerID:"6e20fb988384218a5ef1d89dbee862ffcfe1ed3e771481eb88c786f51467f293", Pod:"calico-apiserver-f66b9548c-6sxnc", Endpoint:"eth0", ServiceAccountName:"calico-apiserver", IPNetworks:[]string{"192.168.115.195/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-apiserver", "ksa.calico-apiserver.calico-apiserver"}, InterfaceName:"cali9b90589e4e4", MAC:"ba:3f:fb:e6:6e:fd", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 4 23:21:59.766391 containerd[1974]: 2025-11-04 23:21:59.746 [INFO][4940] cni-plugin/k8s.go 532: Wrote updated endpoint to datastore ContainerID="6e20fb988384218a5ef1d89dbee862ffcfe1ed3e771481eb88c786f51467f293" Namespace="calico-apiserver" Pod="calico-apiserver-f66b9548c-6sxnc" WorkloadEndpoint="ip--172--31--23--127-k8s-calico--apiserver--f66b9548c--6sxnc-eth0" Nov 4 23:21:59.852989 systemd-networkd[1575]: cali6c0b68de4ed: Link UP Nov 4 23:21:59.853444 systemd-networkd[1575]: cali6c0b68de4ed: Gained carrier Nov 4 23:21:59.876631 containerd[1974]: time="2025-11-04T23:21:59.876491712Z" level=info msg="connecting to shim 6e20fb988384218a5ef1d89dbee862ffcfe1ed3e771481eb88c786f51467f293" address="unix:///run/containerd/s/2f6405d7e6b180a18c60fa79661020c814a62bf8c0f092e3c306447015128e6c" namespace=k8s.io protocol=ttrpc version=3 Nov 4 23:21:59.914053 containerd[1974]: 2025-11-04 23:21:59.458 [INFO][4948] cni-plugin/plugin.go 340: Calico CNI found existing endpoint: &{{WorkloadEndpoint projectcalico.org/v3} {ip--172--31--23--127-k8s-coredns--674b8bbfcf--29vjx-eth0 coredns-674b8bbfcf- kube-system c8ee1bb8-dd7e-475b-8eb7-dab815e66227 847 0 2025-11-04 23:21:04 +0000 UTC map[k8s-app:kube-dns pod-template-hash:674b8bbfcf projectcalico.org/namespace:kube-system projectcalico.org/orchestrator:k8s projectcalico.org/serviceaccount:coredns] map[] [] [] []} {k8s ip-172-31-23-127 coredns-674b8bbfcf-29vjx eth0 coredns [] [] [kns.kube-system ksa.kube-system.coredns] cali6c0b68de4ed [{dns UDP 53 0 } {dns-tcp TCP 53 0 } {metrics TCP 9153 0 }] [] }} ContainerID="51b7112aca6845a21331318564121433053a571e928996b55876c0d7c61c9865" Namespace="kube-system" Pod="coredns-674b8bbfcf-29vjx" WorkloadEndpoint="ip--172--31--23--127-k8s-coredns--674b8bbfcf--29vjx-" Nov 4 23:21:59.914053 containerd[1974]: 2025-11-04 23:21:59.458 [INFO][4948] cni-plugin/k8s.go 74: Extracted identifiers for CmdAddK8s ContainerID="51b7112aca6845a21331318564121433053a571e928996b55876c0d7c61c9865" Namespace="kube-system" Pod="coredns-674b8bbfcf-29vjx" WorkloadEndpoint="ip--172--31--23--127-k8s-coredns--674b8bbfcf--29vjx-eth0" Nov 4 23:21:59.914053 containerd[1974]: 2025-11-04 23:21:59.583 [INFO][4970] ipam/ipam_plugin.go 227: Calico CNI IPAM request count IPv4=1 IPv6=0 ContainerID="51b7112aca6845a21331318564121433053a571e928996b55876c0d7c61c9865" HandleID="k8s-pod-network.51b7112aca6845a21331318564121433053a571e928996b55876c0d7c61c9865" Workload="ip--172--31--23--127-k8s-coredns--674b8bbfcf--29vjx-eth0" Nov 4 23:21:59.915183 containerd[1974]: 2025-11-04 23:21:59.583 [INFO][4970] ipam/ipam_plugin.go 275: Auto assigning IP ContainerID="51b7112aca6845a21331318564121433053a571e928996b55876c0d7c61c9865" HandleID="k8s-pod-network.51b7112aca6845a21331318564121433053a571e928996b55876c0d7c61c9865" Workload="ip--172--31--23--127-k8s-coredns--674b8bbfcf--29vjx-eth0" assignArgs=ipam.AutoAssignArgs{Num4:1, Num6:0, HandleID:(*string)(0x400060c8a0), Attrs:map[string]string{"namespace":"kube-system", "node":"ip-172-31-23-127", "pod":"coredns-674b8bbfcf-29vjx", "timestamp":"2025-11-04 23:21:59.583026562 +0000 UTC"}, Hostname:"ip-172-31-23-127", IPv4Pools:[]net.IPNet{}, IPv6Pools:[]net.IPNet{}, MaxBlocksPerHost:0, HostReservedAttrIPv4s:(*ipam.HostReservedAttr)(nil), HostReservedAttrIPv6s:(*ipam.HostReservedAttr)(nil), IntendedUse:"Workload"} Nov 4 23:21:59.915183 containerd[1974]: 2025-11-04 23:21:59.583 [INFO][4970] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 4 23:21:59.915183 containerd[1974]: 2025-11-04 23:21:59.688 [INFO][4970] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 4 23:21:59.915183 containerd[1974]: 2025-11-04 23:21:59.688 [INFO][4970] ipam/ipam.go 110: Auto-assign 1 ipv4, 0 ipv6 addrs for host 'ip-172-31-23-127' Nov 4 23:21:59.915183 containerd[1974]: 2025-11-04 23:21:59.720 [INFO][4970] ipam/ipam.go 691: Looking up existing affinities for host handle="k8s-pod-network.51b7112aca6845a21331318564121433053a571e928996b55876c0d7c61c9865" host="ip-172-31-23-127" Nov 4 23:21:59.915183 containerd[1974]: 2025-11-04 23:21:59.745 [INFO][4970] ipam/ipam.go 394: Looking up existing affinities for host host="ip-172-31-23-127" Nov 4 23:21:59.915183 containerd[1974]: 2025-11-04 23:21:59.759 [INFO][4970] ipam/ipam.go 511: Trying affinity for 192.168.115.192/26 host="ip-172-31-23-127" Nov 4 23:21:59.915183 containerd[1974]: 2025-11-04 23:21:59.774 [INFO][4970] ipam/ipam.go 158: Attempting to load block cidr=192.168.115.192/26 host="ip-172-31-23-127" Nov 4 23:21:59.915183 containerd[1974]: 2025-11-04 23:21:59.781 [INFO][4970] ipam/ipam.go 235: Affinity is confirmed and block has been loaded cidr=192.168.115.192/26 host="ip-172-31-23-127" Nov 4 23:21:59.917356 containerd[1974]: 2025-11-04 23:21:59.783 [INFO][4970] ipam/ipam.go 1219: Attempting to assign 1 addresses from block block=192.168.115.192/26 handle="k8s-pod-network.51b7112aca6845a21331318564121433053a571e928996b55876c0d7c61c9865" host="ip-172-31-23-127" Nov 4 23:21:59.917356 containerd[1974]: 2025-11-04 23:21:59.790 [INFO][4970] ipam/ipam.go 1780: Creating new handle: k8s-pod-network.51b7112aca6845a21331318564121433053a571e928996b55876c0d7c61c9865 Nov 4 23:21:59.917356 containerd[1974]: 2025-11-04 23:21:59.805 [INFO][4970] ipam/ipam.go 1246: Writing block in order to claim IPs block=192.168.115.192/26 handle="k8s-pod-network.51b7112aca6845a21331318564121433053a571e928996b55876c0d7c61c9865" host="ip-172-31-23-127" Nov 4 23:21:59.917356 containerd[1974]: 2025-11-04 23:21:59.832 [INFO][4970] ipam/ipam.go 1262: Successfully claimed IPs: [192.168.115.196/26] block=192.168.115.192/26 handle="k8s-pod-network.51b7112aca6845a21331318564121433053a571e928996b55876c0d7c61c9865" host="ip-172-31-23-127" Nov 4 23:21:59.917356 containerd[1974]: 2025-11-04 23:21:59.832 [INFO][4970] ipam/ipam.go 878: Auto-assigned 1 out of 1 IPv4s: [192.168.115.196/26] handle="k8s-pod-network.51b7112aca6845a21331318564121433053a571e928996b55876c0d7c61c9865" host="ip-172-31-23-127" Nov 4 23:21:59.917356 containerd[1974]: 2025-11-04 23:21:59.834 [INFO][4970] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 4 23:21:59.917356 containerd[1974]: 2025-11-04 23:21:59.834 [INFO][4970] ipam/ipam_plugin.go 299: Calico CNI IPAM assigned addresses IPv4=[192.168.115.196/26] IPv6=[] ContainerID="51b7112aca6845a21331318564121433053a571e928996b55876c0d7c61c9865" HandleID="k8s-pod-network.51b7112aca6845a21331318564121433053a571e928996b55876c0d7c61c9865" Workload="ip--172--31--23--127-k8s-coredns--674b8bbfcf--29vjx-eth0" Nov 4 23:21:59.917697 containerd[1974]: 2025-11-04 23:21:59.841 [INFO][4948] cni-plugin/k8s.go 418: Populated endpoint ContainerID="51b7112aca6845a21331318564121433053a571e928996b55876c0d7c61c9865" Namespace="kube-system" Pod="coredns-674b8bbfcf-29vjx" WorkloadEndpoint="ip--172--31--23--127-k8s-coredns--674b8bbfcf--29vjx-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--23--127-k8s-coredns--674b8bbfcf--29vjx-eth0", GenerateName:"coredns-674b8bbfcf-", Namespace:"kube-system", SelfLink:"", UID:"c8ee1bb8-dd7e-475b-8eb7-dab815e66227", ResourceVersion:"847", Generation:0, CreationTimestamp:time.Date(2025, time.November, 4, 23, 21, 4, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-dns", "pod-template-hash":"674b8bbfcf", "projectcalico.org/namespace":"kube-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"coredns"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-23-127", ContainerID:"", Pod:"coredns-674b8bbfcf-29vjx", Endpoint:"eth0", ServiceAccountName:"coredns", IPNetworks:[]string{"192.168.115.196/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.kube-system", "ksa.kube-system.coredns"}, InterfaceName:"cali6c0b68de4ed", MAC:"", Ports:[]v3.WorkloadEndpointPort{v3.WorkloadEndpointPort{Name:"dns", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"UDP"}, Port:0x35, HostPort:0x0, HostIP:""}, v3.WorkloadEndpointPort{Name:"dns-tcp", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"TCP"}, Port:0x35, HostPort:0x0, HostIP:""}, v3.WorkloadEndpointPort{Name:"metrics", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"TCP"}, Port:0x23c1, HostPort:0x0, HostIP:""}}, AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 4 23:21:59.917697 containerd[1974]: 2025-11-04 23:21:59.842 [INFO][4948] cni-plugin/k8s.go 419: Calico CNI using IPs: [192.168.115.196/32] ContainerID="51b7112aca6845a21331318564121433053a571e928996b55876c0d7c61c9865" Namespace="kube-system" Pod="coredns-674b8bbfcf-29vjx" WorkloadEndpoint="ip--172--31--23--127-k8s-coredns--674b8bbfcf--29vjx-eth0" Nov 4 23:21:59.917697 containerd[1974]: 2025-11-04 23:21:59.842 [INFO][4948] cni-plugin/dataplane_linux.go 69: Setting the host side veth name to cali6c0b68de4ed ContainerID="51b7112aca6845a21331318564121433053a571e928996b55876c0d7c61c9865" Namespace="kube-system" Pod="coredns-674b8bbfcf-29vjx" WorkloadEndpoint="ip--172--31--23--127-k8s-coredns--674b8bbfcf--29vjx-eth0" Nov 4 23:21:59.917697 containerd[1974]: 2025-11-04 23:21:59.854 [INFO][4948] cni-plugin/dataplane_linux.go 508: Disabling IPv4 forwarding ContainerID="51b7112aca6845a21331318564121433053a571e928996b55876c0d7c61c9865" Namespace="kube-system" Pod="coredns-674b8bbfcf-29vjx" WorkloadEndpoint="ip--172--31--23--127-k8s-coredns--674b8bbfcf--29vjx-eth0" Nov 4 23:21:59.917697 containerd[1974]: 2025-11-04 23:21:59.855 [INFO][4948] cni-plugin/k8s.go 446: Added Mac, interface name, and active container ID to endpoint ContainerID="51b7112aca6845a21331318564121433053a571e928996b55876c0d7c61c9865" Namespace="kube-system" Pod="coredns-674b8bbfcf-29vjx" WorkloadEndpoint="ip--172--31--23--127-k8s-coredns--674b8bbfcf--29vjx-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--23--127-k8s-coredns--674b8bbfcf--29vjx-eth0", GenerateName:"coredns-674b8bbfcf-", Namespace:"kube-system", SelfLink:"", UID:"c8ee1bb8-dd7e-475b-8eb7-dab815e66227", ResourceVersion:"847", Generation:0, CreationTimestamp:time.Date(2025, time.November, 4, 23, 21, 4, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-dns", "pod-template-hash":"674b8bbfcf", "projectcalico.org/namespace":"kube-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"coredns"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-23-127", ContainerID:"51b7112aca6845a21331318564121433053a571e928996b55876c0d7c61c9865", Pod:"coredns-674b8bbfcf-29vjx", Endpoint:"eth0", ServiceAccountName:"coredns", IPNetworks:[]string{"192.168.115.196/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.kube-system", "ksa.kube-system.coredns"}, InterfaceName:"cali6c0b68de4ed", MAC:"9a:48:fc:0b:11:74", Ports:[]v3.WorkloadEndpointPort{v3.WorkloadEndpointPort{Name:"dns", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"UDP"}, Port:0x35, HostPort:0x0, HostIP:""}, v3.WorkloadEndpointPort{Name:"dns-tcp", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"TCP"}, Port:0x35, HostPort:0x0, HostIP:""}, v3.WorkloadEndpointPort{Name:"metrics", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"TCP"}, Port:0x23c1, HostPort:0x0, HostIP:""}}, AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 4 23:21:59.917697 containerd[1974]: 2025-11-04 23:21:59.888 [INFO][4948] cni-plugin/k8s.go 532: Wrote updated endpoint to datastore ContainerID="51b7112aca6845a21331318564121433053a571e928996b55876c0d7c61c9865" Namespace="kube-system" Pod="coredns-674b8bbfcf-29vjx" WorkloadEndpoint="ip--172--31--23--127-k8s-coredns--674b8bbfcf--29vjx-eth0" Nov 4 23:21:59.966398 systemd[1]: Started cri-containerd-6e20fb988384218a5ef1d89dbee862ffcfe1ed3e771481eb88c786f51467f293.scope - libcontainer container 6e20fb988384218a5ef1d89dbee862ffcfe1ed3e771481eb88c786f51467f293. Nov 4 23:22:00.016943 containerd[1974]: time="2025-11-04T23:22:00.016753173Z" level=info msg="connecting to shim 51b7112aca6845a21331318564121433053a571e928996b55876c0d7c61c9865" address="unix:///run/containerd/s/d5b490eafc317e0366864885f59a0ec9e99b04b4346bec7b473d39934f0296e7" namespace=k8s.io protocol=ttrpc version=3 Nov 4 23:22:00.098450 systemd[1]: Started cri-containerd-51b7112aca6845a21331318564121433053a571e928996b55876c0d7c61c9865.scope - libcontainer container 51b7112aca6845a21331318564121433053a571e928996b55876c0d7c61c9865. Nov 4 23:22:00.204038 containerd[1974]: time="2025-11-04T23:22:00.203858241Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-674b8bbfcf-29vjx,Uid:c8ee1bb8-dd7e-475b-8eb7-dab815e66227,Namespace:kube-system,Attempt:0,} returns sandbox id \"51b7112aca6845a21331318564121433053a571e928996b55876c0d7c61c9865\"" Nov 4 23:22:00.223514 containerd[1974]: time="2025-11-04T23:22:00.223210234Z" level=info msg="CreateContainer within sandbox \"51b7112aca6845a21331318564121433053a571e928996b55876c0d7c61c9865\" for container &ContainerMetadata{Name:coredns,Attempt:0,}" Nov 4 23:22:00.249778 containerd[1974]: time="2025-11-04T23:22:00.249686830Z" level=info msg="Container 7959e66bf4919dc3c521109d6f2819cc875310c21705694f68c501e70f83ce3c: CDI devices from CRI Config.CDIDevices: []" Nov 4 23:22:00.266431 containerd[1974]: time="2025-11-04T23:22:00.266346370Z" level=info msg="CreateContainer within sandbox \"51b7112aca6845a21331318564121433053a571e928996b55876c0d7c61c9865\" for &ContainerMetadata{Name:coredns,Attempt:0,} returns container id \"7959e66bf4919dc3c521109d6f2819cc875310c21705694f68c501e70f83ce3c\"" Nov 4 23:22:00.269954 containerd[1974]: time="2025-11-04T23:22:00.269063602Z" level=info msg="StartContainer for \"7959e66bf4919dc3c521109d6f2819cc875310c21705694f68c501e70f83ce3c\"" Nov 4 23:22:00.271884 containerd[1974]: time="2025-11-04T23:22:00.271829158Z" level=info msg="connecting to shim 7959e66bf4919dc3c521109d6f2819cc875310c21705694f68c501e70f83ce3c" address="unix:///run/containerd/s/d5b490eafc317e0366864885f59a0ec9e99b04b4346bec7b473d39934f0296e7" protocol=ttrpc version=3 Nov 4 23:22:00.308953 containerd[1974]: time="2025-11-04T23:22:00.307403782Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-f66b9548c-ghbgm,Uid:a2dd6680-1f53-4788-9ae9-bffdb1850825,Namespace:calico-apiserver,Attempt:0,}" Nov 4 23:22:00.314797 containerd[1974]: time="2025-11-04T23:22:00.310081978Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-674b8bbfcf-ml5hb,Uid:dd597e6a-157b-48d4-adfc-7b1e75758f0b,Namespace:kube-system,Attempt:0,}" Nov 4 23:22:00.317262 containerd[1974]: time="2025-11-04T23:22:00.317206642Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-kube-controllers-77c845d5cc-h2d4p,Uid:4d28b7f3-4e9e-4cbc-92fc-da554118a9c3,Namespace:calico-system,Attempt:0,}" Nov 4 23:22:00.419234 systemd[1]: Started cri-containerd-7959e66bf4919dc3c521109d6f2819cc875310c21705694f68c501e70f83ce3c.scope - libcontainer container 7959e66bf4919dc3c521109d6f2819cc875310c21705694f68c501e70f83ce3c. Nov 4 23:22:00.592415 containerd[1974]: time="2025-11-04T23:22:00.592048715Z" level=info msg="StartContainer for \"7959e66bf4919dc3c521109d6f2819cc875310c21705694f68c501e70f83ce3c\" returns successfully" Nov 4 23:22:00.892171 containerd[1974]: time="2025-11-04T23:22:00.891534649Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-f66b9548c-6sxnc,Uid:3262dea2-8952-4d22-82d3-50fc85d38fcd,Namespace:calico-apiserver,Attempt:0,} returns sandbox id \"6e20fb988384218a5ef1d89dbee862ffcfe1ed3e771481eb88c786f51467f293\"" Nov 4 23:22:00.907634 containerd[1974]: time="2025-11-04T23:22:00.907532257Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\"" Nov 4 23:22:01.066333 systemd-networkd[1575]: cali8132e3181fb: Link UP Nov 4 23:22:01.078998 systemd-networkd[1575]: cali8132e3181fb: Gained carrier Nov 4 23:22:01.135799 kubelet[3304]: I1104 23:22:01.134846 3304 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/coredns-674b8bbfcf-29vjx" podStartSLOduration=57.134823478 podStartE2EDuration="57.134823478s" podCreationTimestamp="2025-11-04 23:21:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-04 23:22:00.864112489 +0000 UTC m=+61.241532653" watchObservedRunningTime="2025-11-04 23:22:01.134823478 +0000 UTC m=+61.512243558" Nov 4 23:22:01.145334 containerd[1974]: 2025-11-04 23:22:00.571 [INFO][5108] cni-plugin/plugin.go 340: Calico CNI found existing endpoint: &{{WorkloadEndpoint projectcalico.org/v3} {ip--172--31--23--127-k8s-coredns--674b8bbfcf--ml5hb-eth0 coredns-674b8bbfcf- kube-system dd597e6a-157b-48d4-adfc-7b1e75758f0b 856 0 2025-11-04 23:21:04 +0000 UTC map[k8s-app:kube-dns pod-template-hash:674b8bbfcf projectcalico.org/namespace:kube-system projectcalico.org/orchestrator:k8s projectcalico.org/serviceaccount:coredns] map[] [] [] []} {k8s ip-172-31-23-127 coredns-674b8bbfcf-ml5hb eth0 coredns [] [] [kns.kube-system ksa.kube-system.coredns] cali8132e3181fb [{dns UDP 53 0 } {dns-tcp TCP 53 0 } {metrics TCP 9153 0 }] [] }} ContainerID="cf841e8874bac4b472c4d48e4c64bed71f9f0747887a7c9c33a763188cf6502e" Namespace="kube-system" Pod="coredns-674b8bbfcf-ml5hb" WorkloadEndpoint="ip--172--31--23--127-k8s-coredns--674b8bbfcf--ml5hb-" Nov 4 23:22:01.145334 containerd[1974]: 2025-11-04 23:22:00.573 [INFO][5108] cni-plugin/k8s.go 74: Extracted identifiers for CmdAddK8s ContainerID="cf841e8874bac4b472c4d48e4c64bed71f9f0747887a7c9c33a763188cf6502e" Namespace="kube-system" Pod="coredns-674b8bbfcf-ml5hb" WorkloadEndpoint="ip--172--31--23--127-k8s-coredns--674b8bbfcf--ml5hb-eth0" Nov 4 23:22:01.145334 containerd[1974]: 2025-11-04 23:22:00.697 [INFO][5147] ipam/ipam_plugin.go 227: Calico CNI IPAM request count IPv4=1 IPv6=0 ContainerID="cf841e8874bac4b472c4d48e4c64bed71f9f0747887a7c9c33a763188cf6502e" HandleID="k8s-pod-network.cf841e8874bac4b472c4d48e4c64bed71f9f0747887a7c9c33a763188cf6502e" Workload="ip--172--31--23--127-k8s-coredns--674b8bbfcf--ml5hb-eth0" Nov 4 23:22:01.145334 containerd[1974]: 2025-11-04 23:22:00.698 [INFO][5147] ipam/ipam_plugin.go 275: Auto assigning IP ContainerID="cf841e8874bac4b472c4d48e4c64bed71f9f0747887a7c9c33a763188cf6502e" HandleID="k8s-pod-network.cf841e8874bac4b472c4d48e4c64bed71f9f0747887a7c9c33a763188cf6502e" Workload="ip--172--31--23--127-k8s-coredns--674b8bbfcf--ml5hb-eth0" assignArgs=ipam.AutoAssignArgs{Num4:1, Num6:0, HandleID:(*string)(0x40004d49d0), Attrs:map[string]string{"namespace":"kube-system", "node":"ip-172-31-23-127", "pod":"coredns-674b8bbfcf-ml5hb", "timestamp":"2025-11-04 23:22:00.697524984 +0000 UTC"}, Hostname:"ip-172-31-23-127", IPv4Pools:[]net.IPNet{}, IPv6Pools:[]net.IPNet{}, MaxBlocksPerHost:0, HostReservedAttrIPv4s:(*ipam.HostReservedAttr)(nil), HostReservedAttrIPv6s:(*ipam.HostReservedAttr)(nil), IntendedUse:"Workload"} Nov 4 23:22:01.145334 containerd[1974]: 2025-11-04 23:22:00.698 [INFO][5147] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 4 23:22:01.145334 containerd[1974]: 2025-11-04 23:22:00.698 [INFO][5147] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 4 23:22:01.145334 containerd[1974]: 2025-11-04 23:22:00.698 [INFO][5147] ipam/ipam.go 110: Auto-assign 1 ipv4, 0 ipv6 addrs for host 'ip-172-31-23-127' Nov 4 23:22:01.145334 containerd[1974]: 2025-11-04 23:22:00.765 [INFO][5147] ipam/ipam.go 691: Looking up existing affinities for host handle="k8s-pod-network.cf841e8874bac4b472c4d48e4c64bed71f9f0747887a7c9c33a763188cf6502e" host="ip-172-31-23-127" Nov 4 23:22:01.145334 containerd[1974]: 2025-11-04 23:22:00.807 [INFO][5147] ipam/ipam.go 394: Looking up existing affinities for host host="ip-172-31-23-127" Nov 4 23:22:01.145334 containerd[1974]: 2025-11-04 23:22:00.871 [INFO][5147] ipam/ipam.go 511: Trying affinity for 192.168.115.192/26 host="ip-172-31-23-127" Nov 4 23:22:01.145334 containerd[1974]: 2025-11-04 23:22:00.895 [INFO][5147] ipam/ipam.go 158: Attempting to load block cidr=192.168.115.192/26 host="ip-172-31-23-127" Nov 4 23:22:01.145334 containerd[1974]: 2025-11-04 23:22:00.914 [INFO][5147] ipam/ipam.go 235: Affinity is confirmed and block has been loaded cidr=192.168.115.192/26 host="ip-172-31-23-127" Nov 4 23:22:01.145334 containerd[1974]: 2025-11-04 23:22:00.918 [INFO][5147] ipam/ipam.go 1219: Attempting to assign 1 addresses from block block=192.168.115.192/26 handle="k8s-pod-network.cf841e8874bac4b472c4d48e4c64bed71f9f0747887a7c9c33a763188cf6502e" host="ip-172-31-23-127" Nov 4 23:22:01.145334 containerd[1974]: 2025-11-04 23:22:00.931 [INFO][5147] ipam/ipam.go 1780: Creating new handle: k8s-pod-network.cf841e8874bac4b472c4d48e4c64bed71f9f0747887a7c9c33a763188cf6502e Nov 4 23:22:01.145334 containerd[1974]: 2025-11-04 23:22:00.986 [INFO][5147] ipam/ipam.go 1246: Writing block in order to claim IPs block=192.168.115.192/26 handle="k8s-pod-network.cf841e8874bac4b472c4d48e4c64bed71f9f0747887a7c9c33a763188cf6502e" host="ip-172-31-23-127" Nov 4 23:22:01.145334 containerd[1974]: 2025-11-04 23:22:01.009 [INFO][5147] ipam/ipam.go 1262: Successfully claimed IPs: [192.168.115.197/26] block=192.168.115.192/26 handle="k8s-pod-network.cf841e8874bac4b472c4d48e4c64bed71f9f0747887a7c9c33a763188cf6502e" host="ip-172-31-23-127" Nov 4 23:22:01.145334 containerd[1974]: 2025-11-04 23:22:01.010 [INFO][5147] ipam/ipam.go 878: Auto-assigned 1 out of 1 IPv4s: [192.168.115.197/26] handle="k8s-pod-network.cf841e8874bac4b472c4d48e4c64bed71f9f0747887a7c9c33a763188cf6502e" host="ip-172-31-23-127" Nov 4 23:22:01.145334 containerd[1974]: 2025-11-04 23:22:01.010 [INFO][5147] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 4 23:22:01.145334 containerd[1974]: 2025-11-04 23:22:01.011 [INFO][5147] ipam/ipam_plugin.go 299: Calico CNI IPAM assigned addresses IPv4=[192.168.115.197/26] IPv6=[] ContainerID="cf841e8874bac4b472c4d48e4c64bed71f9f0747887a7c9c33a763188cf6502e" HandleID="k8s-pod-network.cf841e8874bac4b472c4d48e4c64bed71f9f0747887a7c9c33a763188cf6502e" Workload="ip--172--31--23--127-k8s-coredns--674b8bbfcf--ml5hb-eth0" Nov 4 23:22:01.148876 containerd[1974]: 2025-11-04 23:22:01.027 [INFO][5108] cni-plugin/k8s.go 418: Populated endpoint ContainerID="cf841e8874bac4b472c4d48e4c64bed71f9f0747887a7c9c33a763188cf6502e" Namespace="kube-system" Pod="coredns-674b8bbfcf-ml5hb" WorkloadEndpoint="ip--172--31--23--127-k8s-coredns--674b8bbfcf--ml5hb-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--23--127-k8s-coredns--674b8bbfcf--ml5hb-eth0", GenerateName:"coredns-674b8bbfcf-", Namespace:"kube-system", SelfLink:"", UID:"dd597e6a-157b-48d4-adfc-7b1e75758f0b", ResourceVersion:"856", Generation:0, CreationTimestamp:time.Date(2025, time.November, 4, 23, 21, 4, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-dns", "pod-template-hash":"674b8bbfcf", "projectcalico.org/namespace":"kube-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"coredns"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-23-127", ContainerID:"", Pod:"coredns-674b8bbfcf-ml5hb", Endpoint:"eth0", ServiceAccountName:"coredns", IPNetworks:[]string{"192.168.115.197/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.kube-system", "ksa.kube-system.coredns"}, InterfaceName:"cali8132e3181fb", MAC:"", Ports:[]v3.WorkloadEndpointPort{v3.WorkloadEndpointPort{Name:"dns", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"UDP"}, Port:0x35, HostPort:0x0, HostIP:""}, v3.WorkloadEndpointPort{Name:"dns-tcp", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"TCP"}, Port:0x35, HostPort:0x0, HostIP:""}, v3.WorkloadEndpointPort{Name:"metrics", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"TCP"}, Port:0x23c1, HostPort:0x0, HostIP:""}}, AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 4 23:22:01.148876 containerd[1974]: 2025-11-04 23:22:01.028 [INFO][5108] cni-plugin/k8s.go 419: Calico CNI using IPs: [192.168.115.197/32] ContainerID="cf841e8874bac4b472c4d48e4c64bed71f9f0747887a7c9c33a763188cf6502e" Namespace="kube-system" Pod="coredns-674b8bbfcf-ml5hb" WorkloadEndpoint="ip--172--31--23--127-k8s-coredns--674b8bbfcf--ml5hb-eth0" Nov 4 23:22:01.148876 containerd[1974]: 2025-11-04 23:22:01.028 [INFO][5108] cni-plugin/dataplane_linux.go 69: Setting the host side veth name to cali8132e3181fb ContainerID="cf841e8874bac4b472c4d48e4c64bed71f9f0747887a7c9c33a763188cf6502e" Namespace="kube-system" Pod="coredns-674b8bbfcf-ml5hb" WorkloadEndpoint="ip--172--31--23--127-k8s-coredns--674b8bbfcf--ml5hb-eth0" Nov 4 23:22:01.148876 containerd[1974]: 2025-11-04 23:22:01.098 [INFO][5108] cni-plugin/dataplane_linux.go 508: Disabling IPv4 forwarding ContainerID="cf841e8874bac4b472c4d48e4c64bed71f9f0747887a7c9c33a763188cf6502e" Namespace="kube-system" Pod="coredns-674b8bbfcf-ml5hb" WorkloadEndpoint="ip--172--31--23--127-k8s-coredns--674b8bbfcf--ml5hb-eth0" Nov 4 23:22:01.148876 containerd[1974]: 2025-11-04 23:22:01.106 [INFO][5108] cni-plugin/k8s.go 446: Added Mac, interface name, and active container ID to endpoint ContainerID="cf841e8874bac4b472c4d48e4c64bed71f9f0747887a7c9c33a763188cf6502e" Namespace="kube-system" Pod="coredns-674b8bbfcf-ml5hb" WorkloadEndpoint="ip--172--31--23--127-k8s-coredns--674b8bbfcf--ml5hb-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--23--127-k8s-coredns--674b8bbfcf--ml5hb-eth0", GenerateName:"coredns-674b8bbfcf-", Namespace:"kube-system", SelfLink:"", UID:"dd597e6a-157b-48d4-adfc-7b1e75758f0b", ResourceVersion:"856", Generation:0, CreationTimestamp:time.Date(2025, time.November, 4, 23, 21, 4, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-dns", "pod-template-hash":"674b8bbfcf", "projectcalico.org/namespace":"kube-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"coredns"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-23-127", ContainerID:"cf841e8874bac4b472c4d48e4c64bed71f9f0747887a7c9c33a763188cf6502e", Pod:"coredns-674b8bbfcf-ml5hb", Endpoint:"eth0", ServiceAccountName:"coredns", IPNetworks:[]string{"192.168.115.197/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.kube-system", "ksa.kube-system.coredns"}, InterfaceName:"cali8132e3181fb", MAC:"6a:b1:38:e9:c6:3b", Ports:[]v3.WorkloadEndpointPort{v3.WorkloadEndpointPort{Name:"dns", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"UDP"}, Port:0x35, HostPort:0x0, HostIP:""}, v3.WorkloadEndpointPort{Name:"dns-tcp", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"TCP"}, Port:0x35, HostPort:0x0, HostIP:""}, v3.WorkloadEndpointPort{Name:"metrics", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"TCP"}, Port:0x23c1, HostPort:0x0, HostIP:""}}, AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 4 23:22:01.148876 containerd[1974]: 2025-11-04 23:22:01.133 [INFO][5108] cni-plugin/k8s.go 532: Wrote updated endpoint to datastore ContainerID="cf841e8874bac4b472c4d48e4c64bed71f9f0747887a7c9c33a763188cf6502e" Namespace="kube-system" Pod="coredns-674b8bbfcf-ml5hb" WorkloadEndpoint="ip--172--31--23--127-k8s-coredns--674b8bbfcf--ml5hb-eth0" Nov 4 23:22:01.187812 systemd-networkd[1575]: cali84754e6a01f: Link UP Nov 4 23:22:01.195000 systemd-networkd[1575]: cali84754e6a01f: Gained carrier Nov 4 23:22:01.229511 containerd[1974]: time="2025-11-04T23:22:01.229393163Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:22:01.232707 containerd[1974]: time="2025-11-04T23:22:01.232637687Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/apiserver:v3.30.4: active requests=0, bytes read=77" Nov 4 23:22:01.233225 containerd[1974]: time="2025-11-04T23:22:01.233157095Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" Nov 4 23:22:01.234310 kubelet[3304]: E1104 23:22:01.234164 3304 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 4 23:22:01.234310 kubelet[3304]: E1104 23:22:01.234237 3304 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 4 23:22:01.234731 kubelet[3304]: E1104 23:22:01.234486 3304 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:calico-apiserver,Image:ghcr.io/flatcar/calico/apiserver:v3.30.4,Command:[],Args:[--secure-port=5443 --tls-private-key-file=/calico-apiserver-certs/tls.key --tls-cert-file=/calico-apiserver-certs/tls.crt],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:LOG_LEVEL,Value:info,ValueFrom:nil,},EnvVar{Name:MULTI_INTERFACE_MODE,Value:none,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:calico-apiserver-certs,ReadOnly:true,MountPath:/calico-apiserver-certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-cvnkz,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 5443 },Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-apiserver-f66b9548c-6sxnc_calico-apiserver(3262dea2-8952-4d22-82d3-50fc85d38fcd): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" logger="UnhandledError" Nov 4 23:22:01.235863 kubelet[3304]: E1104 23:22:01.235777 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-f66b9548c-6sxnc" podUID="3262dea2-8952-4d22-82d3-50fc85d38fcd" Nov 4 23:22:01.245642 containerd[1974]: time="2025-11-04T23:22:01.245493911Z" level=info msg="connecting to shim cf841e8874bac4b472c4d48e4c64bed71f9f0747887a7c9c33a763188cf6502e" address="unix:///run/containerd/s/9c2aa1d1d1ba4a96b890726949ca4f4187fc6be08df4f4bf653a22d7f18329a9" namespace=k8s.io protocol=ttrpc version=3 Nov 4 23:22:01.284138 containerd[1974]: 2025-11-04 23:22:00.705 [INFO][5117] cni-plugin/plugin.go 340: Calico CNI found existing endpoint: &{{WorkloadEndpoint projectcalico.org/v3} {ip--172--31--23--127-k8s-calico--kube--controllers--77c845d5cc--h2d4p-eth0 calico-kube-controllers-77c845d5cc- calico-system 4d28b7f3-4e9e-4cbc-92fc-da554118a9c3 855 0 2025-11-04 23:21:36 +0000 UTC map[app.kubernetes.io/name:calico-kube-controllers k8s-app:calico-kube-controllers pod-template-hash:77c845d5cc projectcalico.org/namespace:calico-system projectcalico.org/orchestrator:k8s projectcalico.org/serviceaccount:calico-kube-controllers] map[] [] [] []} {k8s ip-172-31-23-127 calico-kube-controllers-77c845d5cc-h2d4p eth0 calico-kube-controllers [] [] [kns.calico-system ksa.calico-system.calico-kube-controllers] cali84754e6a01f [] [] }} ContainerID="1a48461b7755526a6ee738f1c2400205e479252f80ec2b2ff96818968ed60fac" Namespace="calico-system" Pod="calico-kube-controllers-77c845d5cc-h2d4p" WorkloadEndpoint="ip--172--31--23--127-k8s-calico--kube--controllers--77c845d5cc--h2d4p-" Nov 4 23:22:01.284138 containerd[1974]: 2025-11-04 23:22:00.709 [INFO][5117] cni-plugin/k8s.go 74: Extracted identifiers for CmdAddK8s ContainerID="1a48461b7755526a6ee738f1c2400205e479252f80ec2b2ff96818968ed60fac" Namespace="calico-system" Pod="calico-kube-controllers-77c845d5cc-h2d4p" WorkloadEndpoint="ip--172--31--23--127-k8s-calico--kube--controllers--77c845d5cc--h2d4p-eth0" Nov 4 23:22:01.284138 containerd[1974]: 2025-11-04 23:22:00.965 [INFO][5165] ipam/ipam_plugin.go 227: Calico CNI IPAM request count IPv4=1 IPv6=0 ContainerID="1a48461b7755526a6ee738f1c2400205e479252f80ec2b2ff96818968ed60fac" HandleID="k8s-pod-network.1a48461b7755526a6ee738f1c2400205e479252f80ec2b2ff96818968ed60fac" Workload="ip--172--31--23--127-k8s-calico--kube--controllers--77c845d5cc--h2d4p-eth0" Nov 4 23:22:01.284138 containerd[1974]: 2025-11-04 23:22:00.967 [INFO][5165] ipam/ipam_plugin.go 275: Auto assigning IP ContainerID="1a48461b7755526a6ee738f1c2400205e479252f80ec2b2ff96818968ed60fac" HandleID="k8s-pod-network.1a48461b7755526a6ee738f1c2400205e479252f80ec2b2ff96818968ed60fac" Workload="ip--172--31--23--127-k8s-calico--kube--controllers--77c845d5cc--h2d4p-eth0" assignArgs=ipam.AutoAssignArgs{Num4:1, Num6:0, HandleID:(*string)(0x400038d210), Attrs:map[string]string{"namespace":"calico-system", "node":"ip-172-31-23-127", "pod":"calico-kube-controllers-77c845d5cc-h2d4p", "timestamp":"2025-11-04 23:22:00.965164957 +0000 UTC"}, Hostname:"ip-172-31-23-127", IPv4Pools:[]net.IPNet{}, IPv6Pools:[]net.IPNet{}, MaxBlocksPerHost:0, HostReservedAttrIPv4s:(*ipam.HostReservedAttr)(nil), HostReservedAttrIPv6s:(*ipam.HostReservedAttr)(nil), IntendedUse:"Workload"} Nov 4 23:22:01.284138 containerd[1974]: 2025-11-04 23:22:00.967 [INFO][5165] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 4 23:22:01.284138 containerd[1974]: 2025-11-04 23:22:01.010 [INFO][5165] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 4 23:22:01.284138 containerd[1974]: 2025-11-04 23:22:01.012 [INFO][5165] ipam/ipam.go 110: Auto-assign 1 ipv4, 0 ipv6 addrs for host 'ip-172-31-23-127' Nov 4 23:22:01.284138 containerd[1974]: 2025-11-04 23:22:01.057 [INFO][5165] ipam/ipam.go 691: Looking up existing affinities for host handle="k8s-pod-network.1a48461b7755526a6ee738f1c2400205e479252f80ec2b2ff96818968ed60fac" host="ip-172-31-23-127" Nov 4 23:22:01.284138 containerd[1974]: 2025-11-04 23:22:01.087 [INFO][5165] ipam/ipam.go 394: Looking up existing affinities for host host="ip-172-31-23-127" Nov 4 23:22:01.284138 containerd[1974]: 2025-11-04 23:22:01.110 [INFO][5165] ipam/ipam.go 511: Trying affinity for 192.168.115.192/26 host="ip-172-31-23-127" Nov 4 23:22:01.284138 containerd[1974]: 2025-11-04 23:22:01.115 [INFO][5165] ipam/ipam.go 158: Attempting to load block cidr=192.168.115.192/26 host="ip-172-31-23-127" Nov 4 23:22:01.284138 containerd[1974]: 2025-11-04 23:22:01.127 [INFO][5165] ipam/ipam.go 235: Affinity is confirmed and block has been loaded cidr=192.168.115.192/26 host="ip-172-31-23-127" Nov 4 23:22:01.284138 containerd[1974]: 2025-11-04 23:22:01.127 [INFO][5165] ipam/ipam.go 1219: Attempting to assign 1 addresses from block block=192.168.115.192/26 handle="k8s-pod-network.1a48461b7755526a6ee738f1c2400205e479252f80ec2b2ff96818968ed60fac" host="ip-172-31-23-127" Nov 4 23:22:01.284138 containerd[1974]: 2025-11-04 23:22:01.132 [INFO][5165] ipam/ipam.go 1780: Creating new handle: k8s-pod-network.1a48461b7755526a6ee738f1c2400205e479252f80ec2b2ff96818968ed60fac Nov 4 23:22:01.284138 containerd[1974]: 2025-11-04 23:22:01.145 [INFO][5165] ipam/ipam.go 1246: Writing block in order to claim IPs block=192.168.115.192/26 handle="k8s-pod-network.1a48461b7755526a6ee738f1c2400205e479252f80ec2b2ff96818968ed60fac" host="ip-172-31-23-127" Nov 4 23:22:01.284138 containerd[1974]: 2025-11-04 23:22:01.167 [INFO][5165] ipam/ipam.go 1262: Successfully claimed IPs: [192.168.115.198/26] block=192.168.115.192/26 handle="k8s-pod-network.1a48461b7755526a6ee738f1c2400205e479252f80ec2b2ff96818968ed60fac" host="ip-172-31-23-127" Nov 4 23:22:01.284138 containerd[1974]: 2025-11-04 23:22:01.168 [INFO][5165] ipam/ipam.go 878: Auto-assigned 1 out of 1 IPv4s: [192.168.115.198/26] handle="k8s-pod-network.1a48461b7755526a6ee738f1c2400205e479252f80ec2b2ff96818968ed60fac" host="ip-172-31-23-127" Nov 4 23:22:01.284138 containerd[1974]: 2025-11-04 23:22:01.168 [INFO][5165] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 4 23:22:01.284138 containerd[1974]: 2025-11-04 23:22:01.168 [INFO][5165] ipam/ipam_plugin.go 299: Calico CNI IPAM assigned addresses IPv4=[192.168.115.198/26] IPv6=[] ContainerID="1a48461b7755526a6ee738f1c2400205e479252f80ec2b2ff96818968ed60fac" HandleID="k8s-pod-network.1a48461b7755526a6ee738f1c2400205e479252f80ec2b2ff96818968ed60fac" Workload="ip--172--31--23--127-k8s-calico--kube--controllers--77c845d5cc--h2d4p-eth0" Nov 4 23:22:01.286631 containerd[1974]: 2025-11-04 23:22:01.176 [INFO][5117] cni-plugin/k8s.go 418: Populated endpoint ContainerID="1a48461b7755526a6ee738f1c2400205e479252f80ec2b2ff96818968ed60fac" Namespace="calico-system" Pod="calico-kube-controllers-77c845d5cc-h2d4p" WorkloadEndpoint="ip--172--31--23--127-k8s-calico--kube--controllers--77c845d5cc--h2d4p-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--23--127-k8s-calico--kube--controllers--77c845d5cc--h2d4p-eth0", GenerateName:"calico-kube-controllers-77c845d5cc-", Namespace:"calico-system", SelfLink:"", UID:"4d28b7f3-4e9e-4cbc-92fc-da554118a9c3", ResourceVersion:"855", Generation:0, CreationTimestamp:time.Date(2025, time.November, 4, 23, 21, 36, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app.kubernetes.io/name":"calico-kube-controllers", "k8s-app":"calico-kube-controllers", "pod-template-hash":"77c845d5cc", "projectcalico.org/namespace":"calico-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"calico-kube-controllers"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-23-127", ContainerID:"", Pod:"calico-kube-controllers-77c845d5cc-h2d4p", Endpoint:"eth0", ServiceAccountName:"calico-kube-controllers", IPNetworks:[]string{"192.168.115.198/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-system", "ksa.calico-system.calico-kube-controllers"}, InterfaceName:"cali84754e6a01f", MAC:"", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 4 23:22:01.286631 containerd[1974]: 2025-11-04 23:22:01.177 [INFO][5117] cni-plugin/k8s.go 419: Calico CNI using IPs: [192.168.115.198/32] ContainerID="1a48461b7755526a6ee738f1c2400205e479252f80ec2b2ff96818968ed60fac" Namespace="calico-system" Pod="calico-kube-controllers-77c845d5cc-h2d4p" WorkloadEndpoint="ip--172--31--23--127-k8s-calico--kube--controllers--77c845d5cc--h2d4p-eth0" Nov 4 23:22:01.286631 containerd[1974]: 2025-11-04 23:22:01.177 [INFO][5117] cni-plugin/dataplane_linux.go 69: Setting the host side veth name to cali84754e6a01f ContainerID="1a48461b7755526a6ee738f1c2400205e479252f80ec2b2ff96818968ed60fac" Namespace="calico-system" Pod="calico-kube-controllers-77c845d5cc-h2d4p" WorkloadEndpoint="ip--172--31--23--127-k8s-calico--kube--controllers--77c845d5cc--h2d4p-eth0" Nov 4 23:22:01.286631 containerd[1974]: 2025-11-04 23:22:01.200 [INFO][5117] cni-plugin/dataplane_linux.go 508: Disabling IPv4 forwarding ContainerID="1a48461b7755526a6ee738f1c2400205e479252f80ec2b2ff96818968ed60fac" Namespace="calico-system" Pod="calico-kube-controllers-77c845d5cc-h2d4p" WorkloadEndpoint="ip--172--31--23--127-k8s-calico--kube--controllers--77c845d5cc--h2d4p-eth0" Nov 4 23:22:01.286631 containerd[1974]: 2025-11-04 23:22:01.212 [INFO][5117] cni-plugin/k8s.go 446: Added Mac, interface name, and active container ID to endpoint ContainerID="1a48461b7755526a6ee738f1c2400205e479252f80ec2b2ff96818968ed60fac" Namespace="calico-system" Pod="calico-kube-controllers-77c845d5cc-h2d4p" WorkloadEndpoint="ip--172--31--23--127-k8s-calico--kube--controllers--77c845d5cc--h2d4p-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--23--127-k8s-calico--kube--controllers--77c845d5cc--h2d4p-eth0", GenerateName:"calico-kube-controllers-77c845d5cc-", Namespace:"calico-system", SelfLink:"", UID:"4d28b7f3-4e9e-4cbc-92fc-da554118a9c3", ResourceVersion:"855", Generation:0, CreationTimestamp:time.Date(2025, time.November, 4, 23, 21, 36, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app.kubernetes.io/name":"calico-kube-controllers", "k8s-app":"calico-kube-controllers", "pod-template-hash":"77c845d5cc", "projectcalico.org/namespace":"calico-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"calico-kube-controllers"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-23-127", ContainerID:"1a48461b7755526a6ee738f1c2400205e479252f80ec2b2ff96818968ed60fac", Pod:"calico-kube-controllers-77c845d5cc-h2d4p", Endpoint:"eth0", ServiceAccountName:"calico-kube-controllers", IPNetworks:[]string{"192.168.115.198/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-system", "ksa.calico-system.calico-kube-controllers"}, InterfaceName:"cali84754e6a01f", MAC:"56:93:44:ba:32:db", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 4 23:22:01.286631 containerd[1974]: 2025-11-04 23:22:01.254 [INFO][5117] cni-plugin/k8s.go 532: Wrote updated endpoint to datastore ContainerID="1a48461b7755526a6ee738f1c2400205e479252f80ec2b2ff96818968ed60fac" Namespace="calico-system" Pod="calico-kube-controllers-77c845d5cc-h2d4p" WorkloadEndpoint="ip--172--31--23--127-k8s-calico--kube--controllers--77c845d5cc--h2d4p-eth0" Nov 4 23:22:01.299388 containerd[1974]: time="2025-11-04T23:22:01.299204339Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:csi-node-driver-n5cdd,Uid:024e93aa-74ad-4ec2-b309-ed5d7023cfd9,Namespace:calico-system,Attempt:0,}" Nov 4 23:22:01.418064 systemd-networkd[1575]: calib6fa7882ada: Link UP Nov 4 23:22:01.423540 systemd-networkd[1575]: calib6fa7882ada: Gained carrier Nov 4 23:22:01.470815 systemd[1]: Started cri-containerd-cf841e8874bac4b472c4d48e4c64bed71f9f0747887a7c9c33a763188cf6502e.scope - libcontainer container cf841e8874bac4b472c4d48e4c64bed71f9f0747887a7c9c33a763188cf6502e. Nov 4 23:22:01.495213 containerd[1974]: 2025-11-04 23:22:00.719 [INFO][5096] cni-plugin/plugin.go 340: Calico CNI found existing endpoint: &{{WorkloadEndpoint projectcalico.org/v3} {ip--172--31--23--127-k8s-calico--apiserver--f66b9548c--ghbgm-eth0 calico-apiserver-f66b9548c- calico-apiserver a2dd6680-1f53-4788-9ae9-bffdb1850825 853 0 2025-11-04 23:21:18 +0000 UTC map[apiserver:true app.kubernetes.io/name:calico-apiserver k8s-app:calico-apiserver pod-template-hash:f66b9548c projectcalico.org/namespace:calico-apiserver projectcalico.org/orchestrator:k8s projectcalico.org/serviceaccount:calico-apiserver] map[] [] [] []} {k8s ip-172-31-23-127 calico-apiserver-f66b9548c-ghbgm eth0 calico-apiserver [] [] [kns.calico-apiserver ksa.calico-apiserver.calico-apiserver] calib6fa7882ada [] [] }} ContainerID="d6d12cf90c55d1c07ff0c0d8d4748924946328c8a3e1ef756f018bd0ddd0fef0" Namespace="calico-apiserver" Pod="calico-apiserver-f66b9548c-ghbgm" WorkloadEndpoint="ip--172--31--23--127-k8s-calico--apiserver--f66b9548c--ghbgm-" Nov 4 23:22:01.495213 containerd[1974]: 2025-11-04 23:22:00.728 [INFO][5096] cni-plugin/k8s.go 74: Extracted identifiers for CmdAddK8s ContainerID="d6d12cf90c55d1c07ff0c0d8d4748924946328c8a3e1ef756f018bd0ddd0fef0" Namespace="calico-apiserver" Pod="calico-apiserver-f66b9548c-ghbgm" WorkloadEndpoint="ip--172--31--23--127-k8s-calico--apiserver--f66b9548c--ghbgm-eth0" Nov 4 23:22:01.495213 containerd[1974]: 2025-11-04 23:22:01.011 [INFO][5164] ipam/ipam_plugin.go 227: Calico CNI IPAM request count IPv4=1 IPv6=0 ContainerID="d6d12cf90c55d1c07ff0c0d8d4748924946328c8a3e1ef756f018bd0ddd0fef0" HandleID="k8s-pod-network.d6d12cf90c55d1c07ff0c0d8d4748924946328c8a3e1ef756f018bd0ddd0fef0" Workload="ip--172--31--23--127-k8s-calico--apiserver--f66b9548c--ghbgm-eth0" Nov 4 23:22:01.495213 containerd[1974]: 2025-11-04 23:22:01.016 [INFO][5164] ipam/ipam_plugin.go 275: Auto assigning IP ContainerID="d6d12cf90c55d1c07ff0c0d8d4748924946328c8a3e1ef756f018bd0ddd0fef0" HandleID="k8s-pod-network.d6d12cf90c55d1c07ff0c0d8d4748924946328c8a3e1ef756f018bd0ddd0fef0" Workload="ip--172--31--23--127-k8s-calico--apiserver--f66b9548c--ghbgm-eth0" assignArgs=ipam.AutoAssignArgs{Num4:1, Num6:0, HandleID:(*string)(0x4000314670), Attrs:map[string]string{"namespace":"calico-apiserver", "node":"ip-172-31-23-127", "pod":"calico-apiserver-f66b9548c-ghbgm", "timestamp":"2025-11-04 23:22:01.011744457 +0000 UTC"}, Hostname:"ip-172-31-23-127", IPv4Pools:[]net.IPNet{}, IPv6Pools:[]net.IPNet{}, MaxBlocksPerHost:0, HostReservedAttrIPv4s:(*ipam.HostReservedAttr)(nil), HostReservedAttrIPv6s:(*ipam.HostReservedAttr)(nil), IntendedUse:"Workload"} Nov 4 23:22:01.495213 containerd[1974]: 2025-11-04 23:22:01.016 [INFO][5164] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 4 23:22:01.495213 containerd[1974]: 2025-11-04 23:22:01.168 [INFO][5164] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 4 23:22:01.495213 containerd[1974]: 2025-11-04 23:22:01.169 [INFO][5164] ipam/ipam.go 110: Auto-assign 1 ipv4, 0 ipv6 addrs for host 'ip-172-31-23-127' Nov 4 23:22:01.495213 containerd[1974]: 2025-11-04 23:22:01.235 [INFO][5164] ipam/ipam.go 691: Looking up existing affinities for host handle="k8s-pod-network.d6d12cf90c55d1c07ff0c0d8d4748924946328c8a3e1ef756f018bd0ddd0fef0" host="ip-172-31-23-127" Nov 4 23:22:01.495213 containerd[1974]: 2025-11-04 23:22:01.266 [INFO][5164] ipam/ipam.go 394: Looking up existing affinities for host host="ip-172-31-23-127" Nov 4 23:22:01.495213 containerd[1974]: 2025-11-04 23:22:01.288 [INFO][5164] ipam/ipam.go 511: Trying affinity for 192.168.115.192/26 host="ip-172-31-23-127" Nov 4 23:22:01.495213 containerd[1974]: 2025-11-04 23:22:01.295 [INFO][5164] ipam/ipam.go 158: Attempting to load block cidr=192.168.115.192/26 host="ip-172-31-23-127" Nov 4 23:22:01.495213 containerd[1974]: 2025-11-04 23:22:01.303 [INFO][5164] ipam/ipam.go 235: Affinity is confirmed and block has been loaded cidr=192.168.115.192/26 host="ip-172-31-23-127" Nov 4 23:22:01.495213 containerd[1974]: 2025-11-04 23:22:01.303 [INFO][5164] ipam/ipam.go 1219: Attempting to assign 1 addresses from block block=192.168.115.192/26 handle="k8s-pod-network.d6d12cf90c55d1c07ff0c0d8d4748924946328c8a3e1ef756f018bd0ddd0fef0" host="ip-172-31-23-127" Nov 4 23:22:01.495213 containerd[1974]: 2025-11-04 23:22:01.311 [INFO][5164] ipam/ipam.go 1780: Creating new handle: k8s-pod-network.d6d12cf90c55d1c07ff0c0d8d4748924946328c8a3e1ef756f018bd0ddd0fef0 Nov 4 23:22:01.495213 containerd[1974]: 2025-11-04 23:22:01.344 [INFO][5164] ipam/ipam.go 1246: Writing block in order to claim IPs block=192.168.115.192/26 handle="k8s-pod-network.d6d12cf90c55d1c07ff0c0d8d4748924946328c8a3e1ef756f018bd0ddd0fef0" host="ip-172-31-23-127" Nov 4 23:22:01.495213 containerd[1974]: 2025-11-04 23:22:01.373 [INFO][5164] ipam/ipam.go 1262: Successfully claimed IPs: [192.168.115.199/26] block=192.168.115.192/26 handle="k8s-pod-network.d6d12cf90c55d1c07ff0c0d8d4748924946328c8a3e1ef756f018bd0ddd0fef0" host="ip-172-31-23-127" Nov 4 23:22:01.495213 containerd[1974]: 2025-11-04 23:22:01.374 [INFO][5164] ipam/ipam.go 878: Auto-assigned 1 out of 1 IPv4s: [192.168.115.199/26] handle="k8s-pod-network.d6d12cf90c55d1c07ff0c0d8d4748924946328c8a3e1ef756f018bd0ddd0fef0" host="ip-172-31-23-127" Nov 4 23:22:01.495213 containerd[1974]: 2025-11-04 23:22:01.375 [INFO][5164] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 4 23:22:01.495213 containerd[1974]: 2025-11-04 23:22:01.375 [INFO][5164] ipam/ipam_plugin.go 299: Calico CNI IPAM assigned addresses IPv4=[192.168.115.199/26] IPv6=[] ContainerID="d6d12cf90c55d1c07ff0c0d8d4748924946328c8a3e1ef756f018bd0ddd0fef0" HandleID="k8s-pod-network.d6d12cf90c55d1c07ff0c0d8d4748924946328c8a3e1ef756f018bd0ddd0fef0" Workload="ip--172--31--23--127-k8s-calico--apiserver--f66b9548c--ghbgm-eth0" Nov 4 23:22:01.498751 containerd[1974]: 2025-11-04 23:22:01.393 [INFO][5096] cni-plugin/k8s.go 418: Populated endpoint ContainerID="d6d12cf90c55d1c07ff0c0d8d4748924946328c8a3e1ef756f018bd0ddd0fef0" Namespace="calico-apiserver" Pod="calico-apiserver-f66b9548c-ghbgm" WorkloadEndpoint="ip--172--31--23--127-k8s-calico--apiserver--f66b9548c--ghbgm-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--23--127-k8s-calico--apiserver--f66b9548c--ghbgm-eth0", GenerateName:"calico-apiserver-f66b9548c-", Namespace:"calico-apiserver", SelfLink:"", UID:"a2dd6680-1f53-4788-9ae9-bffdb1850825", ResourceVersion:"853", Generation:0, CreationTimestamp:time.Date(2025, time.November, 4, 23, 21, 18, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"apiserver":"true", "app.kubernetes.io/name":"calico-apiserver", "k8s-app":"calico-apiserver", "pod-template-hash":"f66b9548c", "projectcalico.org/namespace":"calico-apiserver", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"calico-apiserver"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-23-127", ContainerID:"", Pod:"calico-apiserver-f66b9548c-ghbgm", Endpoint:"eth0", ServiceAccountName:"calico-apiserver", IPNetworks:[]string{"192.168.115.199/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-apiserver", "ksa.calico-apiserver.calico-apiserver"}, InterfaceName:"calib6fa7882ada", MAC:"", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 4 23:22:01.498751 containerd[1974]: 2025-11-04 23:22:01.394 [INFO][5096] cni-plugin/k8s.go 419: Calico CNI using IPs: [192.168.115.199/32] ContainerID="d6d12cf90c55d1c07ff0c0d8d4748924946328c8a3e1ef756f018bd0ddd0fef0" Namespace="calico-apiserver" Pod="calico-apiserver-f66b9548c-ghbgm" WorkloadEndpoint="ip--172--31--23--127-k8s-calico--apiserver--f66b9548c--ghbgm-eth0" Nov 4 23:22:01.498751 containerd[1974]: 2025-11-04 23:22:01.394 [INFO][5096] cni-plugin/dataplane_linux.go 69: Setting the host side veth name to calib6fa7882ada ContainerID="d6d12cf90c55d1c07ff0c0d8d4748924946328c8a3e1ef756f018bd0ddd0fef0" Namespace="calico-apiserver" Pod="calico-apiserver-f66b9548c-ghbgm" WorkloadEndpoint="ip--172--31--23--127-k8s-calico--apiserver--f66b9548c--ghbgm-eth0" Nov 4 23:22:01.498751 containerd[1974]: 2025-11-04 23:22:01.431 [INFO][5096] cni-plugin/dataplane_linux.go 508: Disabling IPv4 forwarding ContainerID="d6d12cf90c55d1c07ff0c0d8d4748924946328c8a3e1ef756f018bd0ddd0fef0" Namespace="calico-apiserver" Pod="calico-apiserver-f66b9548c-ghbgm" WorkloadEndpoint="ip--172--31--23--127-k8s-calico--apiserver--f66b9548c--ghbgm-eth0" Nov 4 23:22:01.498751 containerd[1974]: 2025-11-04 23:22:01.436 [INFO][5096] cni-plugin/k8s.go 446: Added Mac, interface name, and active container ID to endpoint ContainerID="d6d12cf90c55d1c07ff0c0d8d4748924946328c8a3e1ef756f018bd0ddd0fef0" Namespace="calico-apiserver" Pod="calico-apiserver-f66b9548c-ghbgm" WorkloadEndpoint="ip--172--31--23--127-k8s-calico--apiserver--f66b9548c--ghbgm-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--23--127-k8s-calico--apiserver--f66b9548c--ghbgm-eth0", GenerateName:"calico-apiserver-f66b9548c-", Namespace:"calico-apiserver", SelfLink:"", UID:"a2dd6680-1f53-4788-9ae9-bffdb1850825", ResourceVersion:"853", Generation:0, CreationTimestamp:time.Date(2025, time.November, 4, 23, 21, 18, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"apiserver":"true", "app.kubernetes.io/name":"calico-apiserver", "k8s-app":"calico-apiserver", "pod-template-hash":"f66b9548c", "projectcalico.org/namespace":"calico-apiserver", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"calico-apiserver"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-23-127", ContainerID:"d6d12cf90c55d1c07ff0c0d8d4748924946328c8a3e1ef756f018bd0ddd0fef0", Pod:"calico-apiserver-f66b9548c-ghbgm", Endpoint:"eth0", ServiceAccountName:"calico-apiserver", IPNetworks:[]string{"192.168.115.199/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-apiserver", "ksa.calico-apiserver.calico-apiserver"}, InterfaceName:"calib6fa7882ada", MAC:"2a:2d:f0:c7:ea:9b", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 4 23:22:01.498751 containerd[1974]: 2025-11-04 23:22:01.485 [INFO][5096] cni-plugin/k8s.go 532: Wrote updated endpoint to datastore ContainerID="d6d12cf90c55d1c07ff0c0d8d4748924946328c8a3e1ef756f018bd0ddd0fef0" Namespace="calico-apiserver" Pod="calico-apiserver-f66b9548c-ghbgm" WorkloadEndpoint="ip--172--31--23--127-k8s-calico--apiserver--f66b9548c--ghbgm-eth0" Nov 4 23:22:01.517419 containerd[1974]: time="2025-11-04T23:22:01.517311180Z" level=info msg="connecting to shim 1a48461b7755526a6ee738f1c2400205e479252f80ec2b2ff96818968ed60fac" address="unix:///run/containerd/s/af7385243cfcd469a5d148150117ed14207ab09ec51afd34900550df38184ce7" namespace=k8s.io protocol=ttrpc version=3 Nov 4 23:22:01.636316 systemd-networkd[1575]: cali9b90589e4e4: Gained IPv6LL Nov 4 23:22:01.660631 systemd[1]: Started cri-containerd-1a48461b7755526a6ee738f1c2400205e479252f80ec2b2ff96818968ed60fac.scope - libcontainer container 1a48461b7755526a6ee738f1c2400205e479252f80ec2b2ff96818968ed60fac. Nov 4 23:22:01.687321 containerd[1974]: time="2025-11-04T23:22:01.685471249Z" level=info msg="connecting to shim d6d12cf90c55d1c07ff0c0d8d4748924946328c8a3e1ef756f018bd0ddd0fef0" address="unix:///run/containerd/s/f02ad0cabdeab4c5cc2e51e7e13af06dc60465e4d0ecaad5a01207e7d4e0c9c6" namespace=k8s.io protocol=ttrpc version=3 Nov 4 23:22:01.779890 containerd[1974]: time="2025-11-04T23:22:01.779609449Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-674b8bbfcf-ml5hb,Uid:dd597e6a-157b-48d4-adfc-7b1e75758f0b,Namespace:kube-system,Attempt:0,} returns sandbox id \"cf841e8874bac4b472c4d48e4c64bed71f9f0747887a7c9c33a763188cf6502e\"" Nov 4 23:22:01.820556 systemd[1]: Started cri-containerd-d6d12cf90c55d1c07ff0c0d8d4748924946328c8a3e1ef756f018bd0ddd0fef0.scope - libcontainer container d6d12cf90c55d1c07ff0c0d8d4748924946328c8a3e1ef756f018bd0ddd0fef0. Nov 4 23:22:01.836024 containerd[1974]: time="2025-11-04T23:22:01.835647914Z" level=info msg="CreateContainer within sandbox \"cf841e8874bac4b472c4d48e4c64bed71f9f0747887a7c9c33a763188cf6502e\" for container &ContainerMetadata{Name:coredns,Attempt:0,}" Nov 4 23:22:01.868872 kubelet[3304]: E1104 23:22:01.868673 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-f66b9548c-6sxnc" podUID="3262dea2-8952-4d22-82d3-50fc85d38fcd" Nov 4 23:22:01.886824 containerd[1974]: time="2025-11-04T23:22:01.886769858Z" level=info msg="Container a407605737bc77d1a41649ea3318cdfde9d02ce2e8ea3df3b1481abe07fda94b: CDI devices from CRI Config.CDIDevices: []" Nov 4 23:22:01.892245 systemd-networkd[1575]: cali6c0b68de4ed: Gained IPv6LL Nov 4 23:22:01.918120 containerd[1974]: time="2025-11-04T23:22:01.917781350Z" level=info msg="CreateContainer within sandbox \"cf841e8874bac4b472c4d48e4c64bed71f9f0747887a7c9c33a763188cf6502e\" for &ContainerMetadata{Name:coredns,Attempt:0,} returns container id \"a407605737bc77d1a41649ea3318cdfde9d02ce2e8ea3df3b1481abe07fda94b\"" Nov 4 23:22:01.920850 containerd[1974]: time="2025-11-04T23:22:01.920551454Z" level=info msg="StartContainer for \"a407605737bc77d1a41649ea3318cdfde9d02ce2e8ea3df3b1481abe07fda94b\"" Nov 4 23:22:01.928307 containerd[1974]: time="2025-11-04T23:22:01.928184390Z" level=info msg="connecting to shim a407605737bc77d1a41649ea3318cdfde9d02ce2e8ea3df3b1481abe07fda94b" address="unix:///run/containerd/s/9c2aa1d1d1ba4a96b890726949ca4f4187fc6be08df4f4bf653a22d7f18329a9" protocol=ttrpc version=3 Nov 4 23:22:02.037314 systemd[1]: Started cri-containerd-a407605737bc77d1a41649ea3318cdfde9d02ce2e8ea3df3b1481abe07fda94b.scope - libcontainer container a407605737bc77d1a41649ea3318cdfde9d02ce2e8ea3df3b1481abe07fda94b. Nov 4 23:22:02.101255 containerd[1974]: time="2025-11-04T23:22:02.100862471Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-kube-controllers-77c845d5cc-h2d4p,Uid:4d28b7f3-4e9e-4cbc-92fc-da554118a9c3,Namespace:calico-system,Attempt:0,} returns sandbox id \"1a48461b7755526a6ee738f1c2400205e479252f80ec2b2ff96818968ed60fac\"" Nov 4 23:22:02.106376 containerd[1974]: time="2025-11-04T23:22:02.106103747Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\"" Nov 4 23:22:02.153419 systemd-networkd[1575]: cali5db350369df: Link UP Nov 4 23:22:02.156708 systemd-networkd[1575]: cali5db350369df: Gained carrier Nov 4 23:22:02.208540 containerd[1974]: 2025-11-04 23:22:01.747 [INFO][5229] cni-plugin/plugin.go 340: Calico CNI found existing endpoint: &{{WorkloadEndpoint projectcalico.org/v3} {ip--172--31--23--127-k8s-csi--node--driver--n5cdd-eth0 csi-node-driver- calico-system 024e93aa-74ad-4ec2-b309-ed5d7023cfd9 751 0 2025-11-04 23:21:36 +0000 UTC map[app.kubernetes.io/name:csi-node-driver controller-revision-hash:857b56db8f k8s-app:csi-node-driver name:csi-node-driver pod-template-generation:1 projectcalico.org/namespace:calico-system projectcalico.org/orchestrator:k8s projectcalico.org/serviceaccount:csi-node-driver] map[] [] [] []} {k8s ip-172-31-23-127 csi-node-driver-n5cdd eth0 csi-node-driver [] [] [kns.calico-system ksa.calico-system.csi-node-driver] cali5db350369df [] [] }} ContainerID="dd34979c91f7c038a520cfba1f509ef19e1e1a4612e302246123da3f793f3aa1" Namespace="calico-system" Pod="csi-node-driver-n5cdd" WorkloadEndpoint="ip--172--31--23--127-k8s-csi--node--driver--n5cdd-" Nov 4 23:22:02.208540 containerd[1974]: 2025-11-04 23:22:01.748 [INFO][5229] cni-plugin/k8s.go 74: Extracted identifiers for CmdAddK8s ContainerID="dd34979c91f7c038a520cfba1f509ef19e1e1a4612e302246123da3f793f3aa1" Namespace="calico-system" Pod="csi-node-driver-n5cdd" WorkloadEndpoint="ip--172--31--23--127-k8s-csi--node--driver--n5cdd-eth0" Nov 4 23:22:02.208540 containerd[1974]: 2025-11-04 23:22:01.861 [INFO][5342] ipam/ipam_plugin.go 227: Calico CNI IPAM request count IPv4=1 IPv6=0 ContainerID="dd34979c91f7c038a520cfba1f509ef19e1e1a4612e302246123da3f793f3aa1" HandleID="k8s-pod-network.dd34979c91f7c038a520cfba1f509ef19e1e1a4612e302246123da3f793f3aa1" Workload="ip--172--31--23--127-k8s-csi--node--driver--n5cdd-eth0" Nov 4 23:22:02.208540 containerd[1974]: 2025-11-04 23:22:01.862 [INFO][5342] ipam/ipam_plugin.go 275: Auto assigning IP ContainerID="dd34979c91f7c038a520cfba1f509ef19e1e1a4612e302246123da3f793f3aa1" HandleID="k8s-pod-network.dd34979c91f7c038a520cfba1f509ef19e1e1a4612e302246123da3f793f3aa1" Workload="ip--172--31--23--127-k8s-csi--node--driver--n5cdd-eth0" assignArgs=ipam.AutoAssignArgs{Num4:1, Num6:0, HandleID:(*string)(0x400034bc40), Attrs:map[string]string{"namespace":"calico-system", "node":"ip-172-31-23-127", "pod":"csi-node-driver-n5cdd", "timestamp":"2025-11-04 23:22:01.861989186 +0000 UTC"}, Hostname:"ip-172-31-23-127", IPv4Pools:[]net.IPNet{}, IPv6Pools:[]net.IPNet{}, MaxBlocksPerHost:0, HostReservedAttrIPv4s:(*ipam.HostReservedAttr)(nil), HostReservedAttrIPv6s:(*ipam.HostReservedAttr)(nil), IntendedUse:"Workload"} Nov 4 23:22:02.208540 containerd[1974]: 2025-11-04 23:22:01.863 [INFO][5342] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Nov 4 23:22:02.208540 containerd[1974]: 2025-11-04 23:22:01.863 [INFO][5342] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Nov 4 23:22:02.208540 containerd[1974]: 2025-11-04 23:22:01.863 [INFO][5342] ipam/ipam.go 110: Auto-assign 1 ipv4, 0 ipv6 addrs for host 'ip-172-31-23-127' Nov 4 23:22:02.208540 containerd[1974]: 2025-11-04 23:22:01.888 [INFO][5342] ipam/ipam.go 691: Looking up existing affinities for host handle="k8s-pod-network.dd34979c91f7c038a520cfba1f509ef19e1e1a4612e302246123da3f793f3aa1" host="ip-172-31-23-127" Nov 4 23:22:02.208540 containerd[1974]: 2025-11-04 23:22:01.915 [INFO][5342] ipam/ipam.go 394: Looking up existing affinities for host host="ip-172-31-23-127" Nov 4 23:22:02.208540 containerd[1974]: 2025-11-04 23:22:01.962 [INFO][5342] ipam/ipam.go 511: Trying affinity for 192.168.115.192/26 host="ip-172-31-23-127" Nov 4 23:22:02.208540 containerd[1974]: 2025-11-04 23:22:02.016 [INFO][5342] ipam/ipam.go 158: Attempting to load block cidr=192.168.115.192/26 host="ip-172-31-23-127" Nov 4 23:22:02.208540 containerd[1974]: 2025-11-04 23:22:02.046 [INFO][5342] ipam/ipam.go 235: Affinity is confirmed and block has been loaded cidr=192.168.115.192/26 host="ip-172-31-23-127" Nov 4 23:22:02.208540 containerd[1974]: 2025-11-04 23:22:02.048 [INFO][5342] ipam/ipam.go 1219: Attempting to assign 1 addresses from block block=192.168.115.192/26 handle="k8s-pod-network.dd34979c91f7c038a520cfba1f509ef19e1e1a4612e302246123da3f793f3aa1" host="ip-172-31-23-127" Nov 4 23:22:02.208540 containerd[1974]: 2025-11-04 23:22:02.066 [INFO][5342] ipam/ipam.go 1780: Creating new handle: k8s-pod-network.dd34979c91f7c038a520cfba1f509ef19e1e1a4612e302246123da3f793f3aa1 Nov 4 23:22:02.208540 containerd[1974]: 2025-11-04 23:22:02.089 [INFO][5342] ipam/ipam.go 1246: Writing block in order to claim IPs block=192.168.115.192/26 handle="k8s-pod-network.dd34979c91f7c038a520cfba1f509ef19e1e1a4612e302246123da3f793f3aa1" host="ip-172-31-23-127" Nov 4 23:22:02.208540 containerd[1974]: 2025-11-04 23:22:02.125 [INFO][5342] ipam/ipam.go 1262: Successfully claimed IPs: [192.168.115.200/26] block=192.168.115.192/26 handle="k8s-pod-network.dd34979c91f7c038a520cfba1f509ef19e1e1a4612e302246123da3f793f3aa1" host="ip-172-31-23-127" Nov 4 23:22:02.208540 containerd[1974]: 2025-11-04 23:22:02.125 [INFO][5342] ipam/ipam.go 878: Auto-assigned 1 out of 1 IPv4s: [192.168.115.200/26] handle="k8s-pod-network.dd34979c91f7c038a520cfba1f509ef19e1e1a4612e302246123da3f793f3aa1" host="ip-172-31-23-127" Nov 4 23:22:02.208540 containerd[1974]: 2025-11-04 23:22:02.125 [INFO][5342] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Nov 4 23:22:02.208540 containerd[1974]: 2025-11-04 23:22:02.125 [INFO][5342] ipam/ipam_plugin.go 299: Calico CNI IPAM assigned addresses IPv4=[192.168.115.200/26] IPv6=[] ContainerID="dd34979c91f7c038a520cfba1f509ef19e1e1a4612e302246123da3f793f3aa1" HandleID="k8s-pod-network.dd34979c91f7c038a520cfba1f509ef19e1e1a4612e302246123da3f793f3aa1" Workload="ip--172--31--23--127-k8s-csi--node--driver--n5cdd-eth0" Nov 4 23:22:02.209683 containerd[1974]: 2025-11-04 23:22:02.133 [INFO][5229] cni-plugin/k8s.go 418: Populated endpoint ContainerID="dd34979c91f7c038a520cfba1f509ef19e1e1a4612e302246123da3f793f3aa1" Namespace="calico-system" Pod="csi-node-driver-n5cdd" WorkloadEndpoint="ip--172--31--23--127-k8s-csi--node--driver--n5cdd-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--23--127-k8s-csi--node--driver--n5cdd-eth0", GenerateName:"csi-node-driver-", Namespace:"calico-system", SelfLink:"", UID:"024e93aa-74ad-4ec2-b309-ed5d7023cfd9", ResourceVersion:"751", Generation:0, CreationTimestamp:time.Date(2025, time.November, 4, 23, 21, 36, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app.kubernetes.io/name":"csi-node-driver", "controller-revision-hash":"857b56db8f", "k8s-app":"csi-node-driver", "name":"csi-node-driver", "pod-template-generation":"1", "projectcalico.org/namespace":"calico-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"csi-node-driver"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-23-127", ContainerID:"", Pod:"csi-node-driver-n5cdd", Endpoint:"eth0", ServiceAccountName:"csi-node-driver", IPNetworks:[]string{"192.168.115.200/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-system", "ksa.calico-system.csi-node-driver"}, InterfaceName:"cali5db350369df", MAC:"", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 4 23:22:02.209683 containerd[1974]: 2025-11-04 23:22:02.134 [INFO][5229] cni-plugin/k8s.go 419: Calico CNI using IPs: [192.168.115.200/32] ContainerID="dd34979c91f7c038a520cfba1f509ef19e1e1a4612e302246123da3f793f3aa1" Namespace="calico-system" Pod="csi-node-driver-n5cdd" WorkloadEndpoint="ip--172--31--23--127-k8s-csi--node--driver--n5cdd-eth0" Nov 4 23:22:02.209683 containerd[1974]: 2025-11-04 23:22:02.134 [INFO][5229] cni-plugin/dataplane_linux.go 69: Setting the host side veth name to cali5db350369df ContainerID="dd34979c91f7c038a520cfba1f509ef19e1e1a4612e302246123da3f793f3aa1" Namespace="calico-system" Pod="csi-node-driver-n5cdd" WorkloadEndpoint="ip--172--31--23--127-k8s-csi--node--driver--n5cdd-eth0" Nov 4 23:22:02.209683 containerd[1974]: 2025-11-04 23:22:02.161 [INFO][5229] cni-plugin/dataplane_linux.go 508: Disabling IPv4 forwarding ContainerID="dd34979c91f7c038a520cfba1f509ef19e1e1a4612e302246123da3f793f3aa1" Namespace="calico-system" Pod="csi-node-driver-n5cdd" WorkloadEndpoint="ip--172--31--23--127-k8s-csi--node--driver--n5cdd-eth0" Nov 4 23:22:02.209683 containerd[1974]: 2025-11-04 23:22:02.163 [INFO][5229] cni-plugin/k8s.go 446: Added Mac, interface name, and active container ID to endpoint ContainerID="dd34979c91f7c038a520cfba1f509ef19e1e1a4612e302246123da3f793f3aa1" Namespace="calico-system" Pod="csi-node-driver-n5cdd" WorkloadEndpoint="ip--172--31--23--127-k8s-csi--node--driver--n5cdd-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--23--127-k8s-csi--node--driver--n5cdd-eth0", GenerateName:"csi-node-driver-", Namespace:"calico-system", SelfLink:"", UID:"024e93aa-74ad-4ec2-b309-ed5d7023cfd9", ResourceVersion:"751", Generation:0, CreationTimestamp:time.Date(2025, time.November, 4, 23, 21, 36, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app.kubernetes.io/name":"csi-node-driver", "controller-revision-hash":"857b56db8f", "k8s-app":"csi-node-driver", "name":"csi-node-driver", "pod-template-generation":"1", "projectcalico.org/namespace":"calico-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"csi-node-driver"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-23-127", ContainerID:"dd34979c91f7c038a520cfba1f509ef19e1e1a4612e302246123da3f793f3aa1", Pod:"csi-node-driver-n5cdd", Endpoint:"eth0", ServiceAccountName:"csi-node-driver", IPNetworks:[]string{"192.168.115.200/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-system", "ksa.calico-system.csi-node-driver"}, InterfaceName:"cali5db350369df", MAC:"2a:13:21:fa:51:f3", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Nov 4 23:22:02.209683 containerd[1974]: 2025-11-04 23:22:02.187 [INFO][5229] cni-plugin/k8s.go 532: Wrote updated endpoint to datastore ContainerID="dd34979c91f7c038a520cfba1f509ef19e1e1a4612e302246123da3f793f3aa1" Namespace="calico-system" Pod="csi-node-driver-n5cdd" WorkloadEndpoint="ip--172--31--23--127-k8s-csi--node--driver--n5cdd-eth0" Nov 4 23:22:02.223229 containerd[1974]: time="2025-11-04T23:22:02.223162331Z" level=info msg="StartContainer for \"a407605737bc77d1a41649ea3318cdfde9d02ce2e8ea3df3b1481abe07fda94b\" returns successfully" Nov 4 23:22:02.278315 containerd[1974]: time="2025-11-04T23:22:02.278216796Z" level=info msg="connecting to shim dd34979c91f7c038a520cfba1f509ef19e1e1a4612e302246123da3f793f3aa1" address="unix:///run/containerd/s/911300c764311be3ba20cfc03e6dae9b99f00702b0bf356830428f5096052225" namespace=k8s.io protocol=ttrpc version=3 Nov 4 23:22:02.386540 systemd[1]: Started cri-containerd-dd34979c91f7c038a520cfba1f509ef19e1e1a4612e302246123da3f793f3aa1.scope - libcontainer container dd34979c91f7c038a520cfba1f509ef19e1e1a4612e302246123da3f793f3aa1. Nov 4 23:22:02.406994 containerd[1974]: time="2025-11-04T23:22:02.406943988Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:22:02.413286 containerd[1974]: time="2025-11-04T23:22:02.412682640Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" Nov 4 23:22:02.413286 containerd[1974]: time="2025-11-04T23:22:02.413116500Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/kube-controllers:v3.30.4: active requests=0, bytes read=85" Nov 4 23:22:02.413655 kubelet[3304]: E1104 23:22:02.413504 3304 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" image="ghcr.io/flatcar/calico/kube-controllers:v3.30.4" Nov 4 23:22:02.416693 kubelet[3304]: E1104 23:22:02.413660 3304 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" image="ghcr.io/flatcar/calico/kube-controllers:v3.30.4" Nov 4 23:22:02.416693 kubelet[3304]: E1104 23:22:02.414410 3304 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:calico-kube-controllers,Image:ghcr.io/flatcar/calico/kube-controllers:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:KUBE_CONTROLLERS_CONFIG_NAME,Value:default,ValueFrom:nil,},EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:ENABLED_CONTROLLERS,Value:node,loadbalancer,ValueFrom:nil,},EnvVar{Name:DISABLE_KUBE_CONTROLLERS_CONFIG_API,Value:false,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:CA_CRT_PATH,Value:/etc/pki/tls/certs/tigera-ca-bundle.crt,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:tigera-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:tigera-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/cert.pem,SubPath:ca-bundle.crt,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-g8glv,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/usr/bin/check-status -l],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:10,TimeoutSeconds:10,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:6,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/usr/bin/check-status -r],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:10,PeriodSeconds:30,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*999,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-kube-controllers-77c845d5cc-h2d4p_calico-system(4d28b7f3-4e9e-4cbc-92fc-da554118a9c3): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" logger="UnhandledError" Nov 4 23:22:02.416693 kubelet[3304]: E1104 23:22:02.415759 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-kube-controllers\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found\"" pod="calico-system/calico-kube-controllers-77c845d5cc-h2d4p" podUID="4d28b7f3-4e9e-4cbc-92fc-da554118a9c3" Nov 4 23:22:02.420779 containerd[1974]: time="2025-11-04T23:22:02.420695460Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-f66b9548c-ghbgm,Uid:a2dd6680-1f53-4788-9ae9-bffdb1850825,Namespace:calico-apiserver,Attempt:0,} returns sandbox id \"d6d12cf90c55d1c07ff0c0d8d4748924946328c8a3e1ef756f018bd0ddd0fef0\"" Nov 4 23:22:02.426115 containerd[1974]: time="2025-11-04T23:22:02.426053412Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\"" Nov 4 23:22:02.468357 systemd-networkd[1575]: cali84754e6a01f: Gained IPv6LL Nov 4 23:22:02.477777 containerd[1974]: time="2025-11-04T23:22:02.477688321Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:csi-node-driver-n5cdd,Uid:024e93aa-74ad-4ec2-b309-ed5d7023cfd9,Namespace:calico-system,Attempt:0,} returns sandbox id \"dd34979c91f7c038a520cfba1f509ef19e1e1a4612e302246123da3f793f3aa1\"" Nov 4 23:22:02.711887 containerd[1974]: time="2025-11-04T23:22:02.711722450Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:22:02.714483 containerd[1974]: time="2025-11-04T23:22:02.714397214Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" Nov 4 23:22:02.714889 containerd[1974]: time="2025-11-04T23:22:02.714408890Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/apiserver:v3.30.4: active requests=0, bytes read=77" Nov 4 23:22:02.715332 kubelet[3304]: E1104 23:22:02.714860 3304 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 4 23:22:02.715332 kubelet[3304]: E1104 23:22:02.714970 3304 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 4 23:22:02.716203 kubelet[3304]: E1104 23:22:02.716073 3304 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:calico-apiserver,Image:ghcr.io/flatcar/calico/apiserver:v3.30.4,Command:[],Args:[--secure-port=5443 --tls-private-key-file=/calico-apiserver-certs/tls.key --tls-cert-file=/calico-apiserver-certs/tls.crt],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:LOG_LEVEL,Value:info,ValueFrom:nil,},EnvVar{Name:MULTI_INTERFACE_MODE,Value:none,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:calico-apiserver-certs,ReadOnly:true,MountPath:/calico-apiserver-certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-lhlrj,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 5443 },Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-apiserver-f66b9548c-ghbgm_calico-apiserver(a2dd6680-1f53-4788-9ae9-bffdb1850825): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" logger="UnhandledError" Nov 4 23:22:02.716475 containerd[1974]: time="2025-11-04T23:22:02.716341190Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/csi:v3.30.4\"" Nov 4 23:22:02.718157 kubelet[3304]: E1104 23:22:02.718069 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-f66b9548c-ghbgm" podUID="a2dd6680-1f53-4788-9ae9-bffdb1850825" Nov 4 23:22:02.867145 kubelet[3304]: E1104 23:22:02.867053 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-kube-controllers\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found\"" pod="calico-system/calico-kube-controllers-77c845d5cc-h2d4p" podUID="4d28b7f3-4e9e-4cbc-92fc-da554118a9c3" Nov 4 23:22:02.884049 kubelet[3304]: E1104 23:22:02.883966 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-f66b9548c-ghbgm" podUID="a2dd6680-1f53-4788-9ae9-bffdb1850825" Nov 4 23:22:02.888710 kubelet[3304]: E1104 23:22:02.888627 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-f66b9548c-6sxnc" podUID="3262dea2-8952-4d22-82d3-50fc85d38fcd" Nov 4 23:22:02.916530 systemd-networkd[1575]: cali8132e3181fb: Gained IPv6LL Nov 4 23:22:02.924425 kubelet[3304]: I1104 23:22:02.924329 3304 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/coredns-674b8bbfcf-ml5hb" podStartSLOduration=58.924306627 podStartE2EDuration="58.924306627s" podCreationTimestamp="2025-11-04 23:21:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-11-04 23:22:02.923860683 +0000 UTC m=+63.301280859" watchObservedRunningTime="2025-11-04 23:22:02.924306627 +0000 UTC m=+63.301726707" Nov 4 23:22:03.041450 containerd[1974]: time="2025-11-04T23:22:03.041290056Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:22:03.043526 containerd[1974]: time="2025-11-04T23:22:03.043437396Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/csi:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" Nov 4 23:22:03.044995 containerd[1974]: time="2025-11-04T23:22:03.043574868Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/csi:v3.30.4: active requests=0, bytes read=69" Nov 4 23:22:03.045131 kubelet[3304]: E1104 23:22:03.044067 3304 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" image="ghcr.io/flatcar/calico/csi:v3.30.4" Nov 4 23:22:03.045131 kubelet[3304]: E1104 23:22:03.044129 3304 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" image="ghcr.io/flatcar/calico/csi:v3.30.4" Nov 4 23:22:03.045131 kubelet[3304]: E1104 23:22:03.044357 3304 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:calico-csi,Image:ghcr.io/flatcar/calico/csi:v3.30.4,Command:[],Args:[--nodeid=$(KUBE_NODE_NAME) --loglevel=$(LOG_LEVEL)],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:warn,ValueFrom:nil,},EnvVar{Name:KUBE_NODE_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:spec.nodeName,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kubelet-dir,ReadOnly:false,MountPath:/var/lib/kubelet,SubPath:,MountPropagation:*Bidirectional,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:socket-dir,ReadOnly:false,MountPath:/csi,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:varrun,ReadOnly:false,MountPath:/var/run,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-49z2c,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*true,SELinuxOptions:nil,RunAsUser:*0,RunAsNonRoot:*false,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*true,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod csi-node-driver-n5cdd_calico-system(024e93aa-74ad-4ec2-b309-ed5d7023cfd9): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" logger="UnhandledError" Nov 4 23:22:03.049136 containerd[1974]: time="2025-11-04T23:22:03.049091220Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\"" Nov 4 23:22:03.300776 systemd-networkd[1575]: calib6fa7882ada: Gained IPv6LL Nov 4 23:22:03.306360 containerd[1974]: time="2025-11-04T23:22:03.306287197Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:22:03.308571 containerd[1974]: time="2025-11-04T23:22:03.308486077Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" Nov 4 23:22:03.308683 containerd[1974]: time="2025-11-04T23:22:03.308622853Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: active requests=0, bytes read=93" Nov 4 23:22:03.308881 kubelet[3304]: E1104 23:22:03.308827 3304 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" image="ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4" Nov 4 23:22:03.308994 kubelet[3304]: E1104 23:22:03.308897 3304 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" image="ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4" Nov 4 23:22:03.309427 kubelet[3304]: E1104 23:22:03.309227 3304 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:csi-node-driver-registrar,Image:ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4,Command:[],Args:[--v=5 --csi-address=$(ADDRESS) --kubelet-registration-path=$(DRIVER_REG_SOCK_PATH)],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:ADDRESS,Value:/csi/csi.sock,ValueFrom:nil,},EnvVar{Name:DRIVER_REG_SOCK_PATH,Value:/var/lib/kubelet/plugins/csi.tigera.io/csi.sock,ValueFrom:nil,},EnvVar{Name:KUBE_NODE_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:spec.nodeName,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:registration-dir,ReadOnly:false,MountPath:/registration,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:socket-dir,ReadOnly:false,MountPath:/csi,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-49z2c,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*true,SELinuxOptions:nil,RunAsUser:*0,RunAsNonRoot:*false,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*true,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod csi-node-driver-n5cdd_calico-system(024e93aa-74ad-4ec2-b309-ed5d7023cfd9): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" logger="UnhandledError" Nov 4 23:22:03.310682 kubelet[3304]: E1104 23:22:03.310618 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"calico-csi\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ghcr.io/flatcar/calico/csi:v3.30.4: not found\", failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found\"]" pod="calico-system/csi-node-driver-n5cdd" podUID="024e93aa-74ad-4ec2-b309-ed5d7023cfd9" Nov 4 23:22:03.876825 systemd-networkd[1575]: cali5db350369df: Gained IPv6LL Nov 4 23:22:03.887101 kubelet[3304]: E1104 23:22:03.886727 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-f66b9548c-ghbgm" podUID="a2dd6680-1f53-4788-9ae9-bffdb1850825" Nov 4 23:22:03.888801 kubelet[3304]: E1104 23:22:03.888679 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-kube-controllers\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found\"" pod="calico-system/calico-kube-controllers-77c845d5cc-h2d4p" podUID="4d28b7f3-4e9e-4cbc-92fc-da554118a9c3" Nov 4 23:22:03.891664 kubelet[3304]: E1104 23:22:03.890335 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"calico-csi\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ghcr.io/flatcar/calico/csi:v3.30.4: not found\", failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found\"]" pod="calico-system/csi-node-driver-n5cdd" podUID="024e93aa-74ad-4ec2-b309-ed5d7023cfd9" Nov 4 23:22:05.689426 systemd[1]: Started sshd@7-172.31.23.127:22-139.178.89.65:40742.service - OpenSSH per-connection server daemon (139.178.89.65:40742). Nov 4 23:22:05.948540 sshd[5485]: Accepted publickey for core from 139.178.89.65 port 40742 ssh2: RSA SHA256:hDiwkCWvCQBqijfvK1jv0H0YtRR2s7jf/pLBmZjqWNg Nov 4 23:22:05.953028 sshd-session[5485]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 4 23:22:05.963032 systemd-logind[1953]: New session 8 of user core. Nov 4 23:22:05.967208 systemd[1]: Started session-8.scope - Session 8 of User core. Nov 4 23:22:06.306149 sshd[5488]: Connection closed by 139.178.89.65 port 40742 Nov 4 23:22:06.306989 sshd-session[5485]: pam_unix(sshd:session): session closed for user core Nov 4 23:22:06.315054 systemd-logind[1953]: Session 8 logged out. Waiting for processes to exit. Nov 4 23:22:06.317082 systemd[1]: sshd@7-172.31.23.127:22-139.178.89.65:40742.service: Deactivated successfully. Nov 4 23:22:06.321773 systemd[1]: session-8.scope: Deactivated successfully. Nov 4 23:22:06.324813 systemd-logind[1953]: Removed session 8. Nov 4 23:22:06.761832 ntpd[1944]: Listen normally on 6 vxlan.calico 192.168.115.192:123 Nov 4 23:22:06.761960 ntpd[1944]: Listen normally on 7 calidbe9727f026 [fe80::ecee:eeff:feee:eeee%4]:123 Nov 4 23:22:06.762426 ntpd[1944]: 4 Nov 23:22:06 ntpd[1944]: Listen normally on 6 vxlan.calico 192.168.115.192:123 Nov 4 23:22:06.762426 ntpd[1944]: 4 Nov 23:22:06 ntpd[1944]: Listen normally on 7 calidbe9727f026 [fe80::ecee:eeff:feee:eeee%4]:123 Nov 4 23:22:06.762426 ntpd[1944]: 4 Nov 23:22:06 ntpd[1944]: Listen normally on 8 vxlan.calico [fe80::643f:23ff:fe6a:1547%5]:123 Nov 4 23:22:06.762426 ntpd[1944]: 4 Nov 23:22:06 ntpd[1944]: Listen normally on 9 cali275f02f0dc5 [fe80::ecee:eeff:feee:eeee%8]:123 Nov 4 23:22:06.762426 ntpd[1944]: 4 Nov 23:22:06 ntpd[1944]: Listen normally on 10 cali9b90589e4e4 [fe80::ecee:eeff:feee:eeee%9]:123 Nov 4 23:22:06.762426 ntpd[1944]: 4 Nov 23:22:06 ntpd[1944]: Listen normally on 11 cali6c0b68de4ed [fe80::ecee:eeff:feee:eeee%10]:123 Nov 4 23:22:06.762426 ntpd[1944]: 4 Nov 23:22:06 ntpd[1944]: Listen normally on 12 cali8132e3181fb [fe80::ecee:eeff:feee:eeee%11]:123 Nov 4 23:22:06.762426 ntpd[1944]: 4 Nov 23:22:06 ntpd[1944]: Listen normally on 13 cali84754e6a01f [fe80::ecee:eeff:feee:eeee%12]:123 Nov 4 23:22:06.762426 ntpd[1944]: 4 Nov 23:22:06 ntpd[1944]: Listen normally on 14 calib6fa7882ada [fe80::ecee:eeff:feee:eeee%13]:123 Nov 4 23:22:06.762426 ntpd[1944]: 4 Nov 23:22:06 ntpd[1944]: Listen normally on 15 cali5db350369df [fe80::ecee:eeff:feee:eeee%14]:123 Nov 4 23:22:06.762014 ntpd[1944]: Listen normally on 8 vxlan.calico [fe80::643f:23ff:fe6a:1547%5]:123 Nov 4 23:22:06.762061 ntpd[1944]: Listen normally on 9 cali275f02f0dc5 [fe80::ecee:eeff:feee:eeee%8]:123 Nov 4 23:22:06.762106 ntpd[1944]: Listen normally on 10 cali9b90589e4e4 [fe80::ecee:eeff:feee:eeee%9]:123 Nov 4 23:22:06.762151 ntpd[1944]: Listen normally on 11 cali6c0b68de4ed [fe80::ecee:eeff:feee:eeee%10]:123 Nov 4 23:22:06.762196 ntpd[1944]: Listen normally on 12 cali8132e3181fb [fe80::ecee:eeff:feee:eeee%11]:123 Nov 4 23:22:06.762265 ntpd[1944]: Listen normally on 13 cali84754e6a01f [fe80::ecee:eeff:feee:eeee%12]:123 Nov 4 23:22:06.762313 ntpd[1944]: Listen normally on 14 calib6fa7882ada [fe80::ecee:eeff:feee:eeee%13]:123 Nov 4 23:22:06.762366 ntpd[1944]: Listen normally on 15 cali5db350369df [fe80::ecee:eeff:feee:eeee%14]:123 Nov 4 23:22:10.301836 containerd[1974]: time="2025-11-04T23:22:10.301452284Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/whisker:v3.30.4\"" Nov 4 23:22:10.602666 containerd[1974]: time="2025-11-04T23:22:10.602495181Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:22:10.604755 containerd[1974]: time="2025-11-04T23:22:10.604682073Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/whisker:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" Nov 4 23:22:10.604889 containerd[1974]: time="2025-11-04T23:22:10.604800801Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/whisker:v3.30.4: active requests=0, bytes read=73" Nov 4 23:22:10.605090 kubelet[3304]: E1104 23:22:10.605043 3304 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker:v3.30.4" Nov 4 23:22:10.606031 kubelet[3304]: E1104 23:22:10.605110 3304 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker:v3.30.4" Nov 4 23:22:10.606031 kubelet[3304]: E1104 23:22:10.605263 3304 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:whisker,Image:ghcr.io/flatcar/calico/whisker:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:INFO,ValueFrom:nil,},EnvVar{Name:CALICO_VERSION,Value:v3.30.4,ValueFrom:nil,},EnvVar{Name:CLUSTER_ID,Value:8dba38a1bbf64129b15305fae4af3a0f,ValueFrom:nil,},EnvVar{Name:CLUSTER_TYPE,Value:typha,kdd,k8s,operator,bgp,kubeadm,ValueFrom:nil,},EnvVar{Name:NOTIFICATIONS,Value:Enabled,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-swwgh,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod whisker-7c85d6c7cb-dd4pw_calico-system(cba52d39-d0ad-4c67-aaef-c5790877e8e6): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" logger="UnhandledError" Nov 4 23:22:10.608810 containerd[1974]: time="2025-11-04T23:22:10.608761077Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\"" Nov 4 23:22:10.854941 containerd[1974]: time="2025-11-04T23:22:10.854635822Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:22:10.857026 containerd[1974]: time="2025-11-04T23:22:10.856875262Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" Nov 4 23:22:10.857026 containerd[1974]: time="2025-11-04T23:22:10.856959526Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/whisker-backend:v3.30.4: active requests=0, bytes read=85" Nov 4 23:22:10.857540 kubelet[3304]: E1104 23:22:10.857478 3304 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker-backend:v3.30.4" Nov 4 23:22:10.857669 kubelet[3304]: E1104 23:22:10.857552 3304 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker-backend:v3.30.4" Nov 4 23:22:10.857806 kubelet[3304]: E1104 23:22:10.857733 3304 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:whisker-backend,Image:ghcr.io/flatcar/calico/whisker-backend:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:INFO,ValueFrom:nil,},EnvVar{Name:PORT,Value:3002,ValueFrom:nil,},EnvVar{Name:GOLDMANE_HOST,Value:goldmane.calico-system.svc.cluster.local:7443,ValueFrom:nil,},EnvVar{Name:TLS_CERT_PATH,Value:/whisker-backend-key-pair/tls.crt,ValueFrom:nil,},EnvVar{Name:TLS_KEY_PATH,Value:/whisker-backend-key-pair/tls.key,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:whisker-backend-key-pair,ReadOnly:true,MountPath:/whisker-backend-key-pair,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:whisker-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-swwgh,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod whisker-7c85d6c7cb-dd4pw_calico-system(cba52d39-d0ad-4c67-aaef-c5790877e8e6): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" logger="UnhandledError" Nov 4 23:22:10.859667 kubelet[3304]: E1104 23:22:10.859567 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"whisker\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found\", failed to \"StartContainer\" for \"whisker-backend\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found\"]" pod="calico-system/whisker-7c85d6c7cb-dd4pw" podUID="cba52d39-d0ad-4c67-aaef-c5790877e8e6" Nov 4 23:22:11.346419 systemd[1]: Started sshd@8-172.31.23.127:22-139.178.89.65:45062.service - OpenSSH per-connection server daemon (139.178.89.65:45062). Nov 4 23:22:11.550753 sshd[5510]: Accepted publickey for core from 139.178.89.65 port 45062 ssh2: RSA SHA256:hDiwkCWvCQBqijfvK1jv0H0YtRR2s7jf/pLBmZjqWNg Nov 4 23:22:11.553249 sshd-session[5510]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 4 23:22:11.562493 systemd-logind[1953]: New session 9 of user core. Nov 4 23:22:11.567229 systemd[1]: Started session-9.scope - Session 9 of User core. Nov 4 23:22:11.828988 sshd[5513]: Connection closed by 139.178.89.65 port 45062 Nov 4 23:22:11.829858 sshd-session[5510]: pam_unix(sshd:session): session closed for user core Nov 4 23:22:11.839177 systemd[1]: sshd@8-172.31.23.127:22-139.178.89.65:45062.service: Deactivated successfully. Nov 4 23:22:11.844399 systemd[1]: session-9.scope: Deactivated successfully. Nov 4 23:22:11.847907 systemd-logind[1953]: Session 9 logged out. Waiting for processes to exit. Nov 4 23:22:11.851762 systemd-logind[1953]: Removed session 9. Nov 4 23:22:12.301676 containerd[1974]: time="2025-11-04T23:22:12.301561906Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/goldmane:v3.30.4\"" Nov 4 23:22:12.579093 containerd[1974]: time="2025-11-04T23:22:12.578764955Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:22:12.581162 containerd[1974]: time="2025-11-04T23:22:12.581008919Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/goldmane:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" Nov 4 23:22:12.581162 containerd[1974]: time="2025-11-04T23:22:12.581082779Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/goldmane:v3.30.4: active requests=0, bytes read=77" Nov 4 23:22:12.581433 kubelet[3304]: E1104 23:22:12.581358 3304 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" image="ghcr.io/flatcar/calico/goldmane:v3.30.4" Nov 4 23:22:12.582234 kubelet[3304]: E1104 23:22:12.581431 3304 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" image="ghcr.io/flatcar/calico/goldmane:v3.30.4" Nov 4 23:22:12.582793 kubelet[3304]: E1104 23:22:12.581675 3304 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:goldmane,Image:ghcr.io/flatcar/calico/goldmane:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:INFO,ValueFrom:nil,},EnvVar{Name:PORT,Value:7443,ValueFrom:nil,},EnvVar{Name:SERVER_CERT_PATH,Value:/goldmane-key-pair/tls.crt,ValueFrom:nil,},EnvVar{Name:SERVER_KEY_PATH,Value:/goldmane-key-pair/tls.key,ValueFrom:nil,},EnvVar{Name:CA_CERT_PATH,Value:/etc/pki/tls/certs/tigera-ca-bundle.crt,ValueFrom:nil,},EnvVar{Name:PUSH_URL,Value:https://guardian.calico-system.svc.cluster.local:443/api/v1/flows/bulk,ValueFrom:nil,},EnvVar{Name:FILE_CONFIG_PATH,Value:/config/config.json,ValueFrom:nil,},EnvVar{Name:HEALTH_ENABLED,Value:true,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:config,ReadOnly:true,MountPath:/config,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:goldmane-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:goldmane-key-pair,ReadOnly:true,MountPath:/goldmane-key-pair,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-2vpxq,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/health -live],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/health -ready],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:30,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod goldmane-666569f655-sfktq_calico-system(f026c0ae-4dbf-4901-893b-d3b577723fff): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" logger="UnhandledError" Nov 4 23:22:12.584132 kubelet[3304]: E1104 23:22:12.584023 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"goldmane\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found\"" pod="calico-system/goldmane-666569f655-sfktq" podUID="f026c0ae-4dbf-4901-893b-d3b577723fff" Nov 4 23:22:14.299261 containerd[1974]: time="2025-11-04T23:22:14.299180531Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\"" Nov 4 23:22:14.566375 containerd[1974]: time="2025-11-04T23:22:14.566203465Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:22:14.568793 containerd[1974]: time="2025-11-04T23:22:14.568706245Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" Nov 4 23:22:14.568793 containerd[1974]: time="2025-11-04T23:22:14.568744285Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/apiserver:v3.30.4: active requests=0, bytes read=77" Nov 4 23:22:14.569769 kubelet[3304]: E1104 23:22:14.569117 3304 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 4 23:22:14.569769 kubelet[3304]: E1104 23:22:14.569672 3304 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 4 23:22:14.571567 kubelet[3304]: E1104 23:22:14.571077 3304 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:calico-apiserver,Image:ghcr.io/flatcar/calico/apiserver:v3.30.4,Command:[],Args:[--secure-port=5443 --tls-private-key-file=/calico-apiserver-certs/tls.key --tls-cert-file=/calico-apiserver-certs/tls.crt],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:LOG_LEVEL,Value:info,ValueFrom:nil,},EnvVar{Name:MULTI_INTERFACE_MODE,Value:none,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:calico-apiserver-certs,ReadOnly:true,MountPath:/calico-apiserver-certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-cvnkz,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 5443 },Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-apiserver-f66b9548c-6sxnc_calico-apiserver(3262dea2-8952-4d22-82d3-50fc85d38fcd): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" logger="UnhandledError" Nov 4 23:22:14.572806 kubelet[3304]: E1104 23:22:14.572388 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-f66b9548c-6sxnc" podUID="3262dea2-8952-4d22-82d3-50fc85d38fcd" Nov 4 23:22:16.301231 containerd[1974]: time="2025-11-04T23:22:16.301181593Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\"" Nov 4 23:22:16.634766 containerd[1974]: time="2025-11-04T23:22:16.634595691Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:22:16.636943 containerd[1974]: time="2025-11-04T23:22:16.636867207Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" Nov 4 23:22:16.637076 containerd[1974]: time="2025-11-04T23:22:16.637006863Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/kube-controllers:v3.30.4: active requests=0, bytes read=85" Nov 4 23:22:16.637379 kubelet[3304]: E1104 23:22:16.637298 3304 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" image="ghcr.io/flatcar/calico/kube-controllers:v3.30.4" Nov 4 23:22:16.638499 kubelet[3304]: E1104 23:22:16.637375 3304 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" image="ghcr.io/flatcar/calico/kube-controllers:v3.30.4" Nov 4 23:22:16.638499 kubelet[3304]: E1104 23:22:16.637591 3304 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:calico-kube-controllers,Image:ghcr.io/flatcar/calico/kube-controllers:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:KUBE_CONTROLLERS_CONFIG_NAME,Value:default,ValueFrom:nil,},EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:ENABLED_CONTROLLERS,Value:node,loadbalancer,ValueFrom:nil,},EnvVar{Name:DISABLE_KUBE_CONTROLLERS_CONFIG_API,Value:false,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:CA_CRT_PATH,Value:/etc/pki/tls/certs/tigera-ca-bundle.crt,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:tigera-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:tigera-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/cert.pem,SubPath:ca-bundle.crt,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-g8glv,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/usr/bin/check-status -l],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:10,TimeoutSeconds:10,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:6,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/usr/bin/check-status -r],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:10,PeriodSeconds:30,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*999,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-kube-controllers-77c845d5cc-h2d4p_calico-system(4d28b7f3-4e9e-4cbc-92fc-da554118a9c3): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" logger="UnhandledError" Nov 4 23:22:16.639338 kubelet[3304]: E1104 23:22:16.638844 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-kube-controllers\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found\"" pod="calico-system/calico-kube-controllers-77c845d5cc-h2d4p" podUID="4d28b7f3-4e9e-4cbc-92fc-da554118a9c3" Nov 4 23:22:16.867206 systemd[1]: Started sshd@9-172.31.23.127:22-139.178.89.65:57190.service - OpenSSH per-connection server daemon (139.178.89.65:57190). Nov 4 23:22:17.063827 sshd[5528]: Accepted publickey for core from 139.178.89.65 port 57190 ssh2: RSA SHA256:hDiwkCWvCQBqijfvK1jv0H0YtRR2s7jf/pLBmZjqWNg Nov 4 23:22:17.066167 sshd-session[5528]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 4 23:22:17.074760 systemd-logind[1953]: New session 10 of user core. Nov 4 23:22:17.086225 systemd[1]: Started session-10.scope - Session 10 of User core. Nov 4 23:22:17.359824 sshd[5531]: Connection closed by 139.178.89.65 port 57190 Nov 4 23:22:17.360716 sshd-session[5528]: pam_unix(sshd:session): session closed for user core Nov 4 23:22:17.370585 systemd[1]: sshd@9-172.31.23.127:22-139.178.89.65:57190.service: Deactivated successfully. Nov 4 23:22:17.376777 systemd[1]: session-10.scope: Deactivated successfully. Nov 4 23:22:17.382281 systemd-logind[1953]: Session 10 logged out. Waiting for processes to exit. Nov 4 23:22:17.404206 systemd[1]: Started sshd@10-172.31.23.127:22-139.178.89.65:57204.service - OpenSSH per-connection server daemon (139.178.89.65:57204). Nov 4 23:22:17.407287 systemd-logind[1953]: Removed session 10. Nov 4 23:22:17.606960 sshd[5544]: Accepted publickey for core from 139.178.89.65 port 57204 ssh2: RSA SHA256:hDiwkCWvCQBqijfvK1jv0H0YtRR2s7jf/pLBmZjqWNg Nov 4 23:22:17.609511 sshd-session[5544]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 4 23:22:17.617790 systemd-logind[1953]: New session 11 of user core. Nov 4 23:22:17.629205 systemd[1]: Started session-11.scope - Session 11 of User core. Nov 4 23:22:17.969461 sshd[5547]: Connection closed by 139.178.89.65 port 57204 Nov 4 23:22:17.970601 sshd-session[5544]: pam_unix(sshd:session): session closed for user core Nov 4 23:22:17.980851 systemd[1]: sshd@10-172.31.23.127:22-139.178.89.65:57204.service: Deactivated successfully. Nov 4 23:22:17.989478 systemd[1]: session-11.scope: Deactivated successfully. Nov 4 23:22:17.998669 systemd-logind[1953]: Session 11 logged out. Waiting for processes to exit. Nov 4 23:22:18.025841 systemd[1]: Started sshd@11-172.31.23.127:22-139.178.89.65:57210.service - OpenSSH per-connection server daemon (139.178.89.65:57210). Nov 4 23:22:18.032016 systemd-logind[1953]: Removed session 11. Nov 4 23:22:18.251185 sshd[5559]: Accepted publickey for core from 139.178.89.65 port 57210 ssh2: RSA SHA256:hDiwkCWvCQBqijfvK1jv0H0YtRR2s7jf/pLBmZjqWNg Nov 4 23:22:18.254175 sshd-session[5559]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 4 23:22:18.262814 systemd-logind[1953]: New session 12 of user core. Nov 4 23:22:18.270219 systemd[1]: Started session-12.scope - Session 12 of User core. Nov 4 23:22:18.301317 containerd[1974]: time="2025-11-04T23:22:18.301170423Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\"" Nov 4 23:22:18.546428 sshd[5565]: Connection closed by 139.178.89.65 port 57210 Nov 4 23:22:18.547578 sshd-session[5559]: pam_unix(sshd:session): session closed for user core Nov 4 23:22:18.554827 systemd-logind[1953]: Session 12 logged out. Waiting for processes to exit. Nov 4 23:22:18.555258 systemd[1]: sshd@11-172.31.23.127:22-139.178.89.65:57210.service: Deactivated successfully. Nov 4 23:22:18.559637 systemd[1]: session-12.scope: Deactivated successfully. Nov 4 23:22:18.565622 systemd-logind[1953]: Removed session 12. Nov 4 23:22:18.585616 containerd[1974]: time="2025-11-04T23:22:18.585538589Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:22:18.587855 containerd[1974]: time="2025-11-04T23:22:18.587765261Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" Nov 4 23:22:18.587988 containerd[1974]: time="2025-11-04T23:22:18.587944889Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/apiserver:v3.30.4: active requests=0, bytes read=77" Nov 4 23:22:18.588210 kubelet[3304]: E1104 23:22:18.588141 3304 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 4 23:22:18.589631 kubelet[3304]: E1104 23:22:18.588223 3304 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 4 23:22:18.589631 kubelet[3304]: E1104 23:22:18.588658 3304 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:calico-apiserver,Image:ghcr.io/flatcar/calico/apiserver:v3.30.4,Command:[],Args:[--secure-port=5443 --tls-private-key-file=/calico-apiserver-certs/tls.key --tls-cert-file=/calico-apiserver-certs/tls.crt],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:LOG_LEVEL,Value:info,ValueFrom:nil,},EnvVar{Name:MULTI_INTERFACE_MODE,Value:none,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:calico-apiserver-certs,ReadOnly:true,MountPath:/calico-apiserver-certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-lhlrj,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 5443 },Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-apiserver-f66b9548c-ghbgm_calico-apiserver(a2dd6680-1f53-4788-9ae9-bffdb1850825): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" logger="UnhandledError" Nov 4 23:22:18.590691 kubelet[3304]: E1104 23:22:18.590363 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-f66b9548c-ghbgm" podUID="a2dd6680-1f53-4788-9ae9-bffdb1850825" Nov 4 23:22:18.591037 containerd[1974]: time="2025-11-04T23:22:18.590444249Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/csi:v3.30.4\"" Nov 4 23:22:18.834906 containerd[1974]: time="2025-11-04T23:22:18.834625206Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:22:18.837051 containerd[1974]: time="2025-11-04T23:22:18.836969406Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/csi:v3.30.4: active requests=0, bytes read=69" Nov 4 23:22:18.837699 containerd[1974]: time="2025-11-04T23:22:18.836969778Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/csi:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" Nov 4 23:22:18.837803 kubelet[3304]: E1104 23:22:18.837307 3304 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" image="ghcr.io/flatcar/calico/csi:v3.30.4" Nov 4 23:22:18.837803 kubelet[3304]: E1104 23:22:18.837368 3304 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" image="ghcr.io/flatcar/calico/csi:v3.30.4" Nov 4 23:22:18.837803 kubelet[3304]: E1104 23:22:18.837564 3304 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:calico-csi,Image:ghcr.io/flatcar/calico/csi:v3.30.4,Command:[],Args:[--nodeid=$(KUBE_NODE_NAME) --loglevel=$(LOG_LEVEL)],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:warn,ValueFrom:nil,},EnvVar{Name:KUBE_NODE_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:spec.nodeName,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kubelet-dir,ReadOnly:false,MountPath:/var/lib/kubelet,SubPath:,MountPropagation:*Bidirectional,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:socket-dir,ReadOnly:false,MountPath:/csi,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:varrun,ReadOnly:false,MountPath:/var/run,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-49z2c,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*true,SELinuxOptions:nil,RunAsUser:*0,RunAsNonRoot:*false,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*true,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod csi-node-driver-n5cdd_calico-system(024e93aa-74ad-4ec2-b309-ed5d7023cfd9): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" logger="UnhandledError" Nov 4 23:22:18.841741 containerd[1974]: time="2025-11-04T23:22:18.841675062Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\"" Nov 4 23:22:19.106583 containerd[1974]: time="2025-11-04T23:22:19.106296987Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:22:19.108753 containerd[1974]: time="2025-11-04T23:22:19.108568491Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" Nov 4 23:22:19.108753 containerd[1974]: time="2025-11-04T23:22:19.108698643Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: active requests=0, bytes read=93" Nov 4 23:22:19.109215 kubelet[3304]: E1104 23:22:19.109140 3304 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" image="ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4" Nov 4 23:22:19.109322 kubelet[3304]: E1104 23:22:19.109231 3304 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" image="ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4" Nov 4 23:22:19.110109 kubelet[3304]: E1104 23:22:19.109485 3304 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:csi-node-driver-registrar,Image:ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4,Command:[],Args:[--v=5 --csi-address=$(ADDRESS) --kubelet-registration-path=$(DRIVER_REG_SOCK_PATH)],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:ADDRESS,Value:/csi/csi.sock,ValueFrom:nil,},EnvVar{Name:DRIVER_REG_SOCK_PATH,Value:/var/lib/kubelet/plugins/csi.tigera.io/csi.sock,ValueFrom:nil,},EnvVar{Name:KUBE_NODE_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:spec.nodeName,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:registration-dir,ReadOnly:false,MountPath:/registration,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:socket-dir,ReadOnly:false,MountPath:/csi,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-49z2c,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*true,SELinuxOptions:nil,RunAsUser:*0,RunAsNonRoot:*false,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*true,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod csi-node-driver-n5cdd_calico-system(024e93aa-74ad-4ec2-b309-ed5d7023cfd9): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" logger="UnhandledError" Nov 4 23:22:19.111878 kubelet[3304]: E1104 23:22:19.111823 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"calico-csi\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ghcr.io/flatcar/calico/csi:v3.30.4: not found\", failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found\"]" pod="calico-system/csi-node-driver-n5cdd" podUID="024e93aa-74ad-4ec2-b309-ed5d7023cfd9" Nov 4 23:22:22.302682 kubelet[3304]: E1104 23:22:22.302583 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"whisker\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found\", failed to \"StartContainer\" for \"whisker-backend\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found\"]" pod="calico-system/whisker-7c85d6c7cb-dd4pw" podUID="cba52d39-d0ad-4c67-aaef-c5790877e8e6" Nov 4 23:22:23.590696 systemd[1]: Started sshd@12-172.31.23.127:22-139.178.89.65:57212.service - OpenSSH per-connection server daemon (139.178.89.65:57212). Nov 4 23:22:23.804983 sshd[5580]: Accepted publickey for core from 139.178.89.65 port 57212 ssh2: RSA SHA256:hDiwkCWvCQBqijfvK1jv0H0YtRR2s7jf/pLBmZjqWNg Nov 4 23:22:23.809235 sshd-session[5580]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 4 23:22:23.822038 systemd-logind[1953]: New session 13 of user core. Nov 4 23:22:23.829239 systemd[1]: Started session-13.scope - Session 13 of User core. Nov 4 23:22:24.157488 sshd[5586]: Connection closed by 139.178.89.65 port 57212 Nov 4 23:22:24.158721 sshd-session[5580]: pam_unix(sshd:session): session closed for user core Nov 4 23:22:24.172111 systemd[1]: sshd@12-172.31.23.127:22-139.178.89.65:57212.service: Deactivated successfully. Nov 4 23:22:24.177795 systemd[1]: session-13.scope: Deactivated successfully. Nov 4 23:22:24.182164 systemd-logind[1953]: Session 13 logged out. Waiting for processes to exit. Nov 4 23:22:24.188160 systemd-logind[1953]: Removed session 13. Nov 4 23:22:25.881696 containerd[1974]: time="2025-11-04T23:22:25.881627353Z" level=info msg="TaskExit event in podsandbox handler container_id:\"734968a2bf7847c37be53b16593806fb188615b60b4ab06e25a834e12dd854f0\" id:\"802c77f98bcf679b7e092b3b105621b063af9d5c7ad2eddebeaa89a8b2438850\" pid:5609 exit_status:1 exited_at:{seconds:1762298545 nanos:880567681}" Nov 4 23:22:26.300067 kubelet[3304]: E1104 23:22:26.298775 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"goldmane\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found\"" pod="calico-system/goldmane-666569f655-sfktq" podUID="f026c0ae-4dbf-4901-893b-d3b577723fff" Nov 4 23:22:28.301947 kubelet[3304]: E1104 23:22:28.300826 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-f66b9548c-6sxnc" podUID="3262dea2-8952-4d22-82d3-50fc85d38fcd" Nov 4 23:22:29.205572 systemd[1]: Started sshd@13-172.31.23.127:22-139.178.89.65:35288.service - OpenSSH per-connection server daemon (139.178.89.65:35288). Nov 4 23:22:29.301804 kubelet[3304]: E1104 23:22:29.301366 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-kube-controllers\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found\"" pod="calico-system/calico-kube-controllers-77c845d5cc-h2d4p" podUID="4d28b7f3-4e9e-4cbc-92fc-da554118a9c3" Nov 4 23:22:29.425301 sshd[5621]: Accepted publickey for core from 139.178.89.65 port 35288 ssh2: RSA SHA256:hDiwkCWvCQBqijfvK1jv0H0YtRR2s7jf/pLBmZjqWNg Nov 4 23:22:29.427328 sshd-session[5621]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 4 23:22:29.438046 systemd-logind[1953]: New session 14 of user core. Nov 4 23:22:29.443171 systemd[1]: Started session-14.scope - Session 14 of User core. Nov 4 23:22:29.690957 sshd[5625]: Connection closed by 139.178.89.65 port 35288 Nov 4 23:22:29.690907 sshd-session[5621]: pam_unix(sshd:session): session closed for user core Nov 4 23:22:29.699333 systemd[1]: sshd@13-172.31.23.127:22-139.178.89.65:35288.service: Deactivated successfully. Nov 4 23:22:29.704883 systemd[1]: session-14.scope: Deactivated successfully. Nov 4 23:22:29.707529 systemd-logind[1953]: Session 14 logged out. Waiting for processes to exit. Nov 4 23:22:29.711034 systemd-logind[1953]: Removed session 14. Nov 4 23:22:30.305009 kubelet[3304]: E1104 23:22:30.304854 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"calico-csi\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ghcr.io/flatcar/calico/csi:v3.30.4: not found\", failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found\"]" pod="calico-system/csi-node-driver-n5cdd" podUID="024e93aa-74ad-4ec2-b309-ed5d7023cfd9" Nov 4 23:22:31.300363 kubelet[3304]: E1104 23:22:31.300250 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-f66b9548c-ghbgm" podUID="a2dd6680-1f53-4788-9ae9-bffdb1850825" Nov 4 23:22:33.300367 containerd[1974]: time="2025-11-04T23:22:33.300261702Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/whisker:v3.30.4\"" Nov 4 23:22:33.556572 containerd[1974]: time="2025-11-04T23:22:33.556061419Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:22:33.558379 containerd[1974]: time="2025-11-04T23:22:33.558233575Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/whisker:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" Nov 4 23:22:33.558379 containerd[1974]: time="2025-11-04T23:22:33.558295975Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/whisker:v3.30.4: active requests=0, bytes read=73" Nov 4 23:22:33.558675 kubelet[3304]: E1104 23:22:33.558541 3304 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker:v3.30.4" Nov 4 23:22:33.558675 kubelet[3304]: E1104 23:22:33.558602 3304 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker:v3.30.4" Nov 4 23:22:33.559719 kubelet[3304]: E1104 23:22:33.558775 3304 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:whisker,Image:ghcr.io/flatcar/calico/whisker:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:INFO,ValueFrom:nil,},EnvVar{Name:CALICO_VERSION,Value:v3.30.4,ValueFrom:nil,},EnvVar{Name:CLUSTER_ID,Value:8dba38a1bbf64129b15305fae4af3a0f,ValueFrom:nil,},EnvVar{Name:CLUSTER_TYPE,Value:typha,kdd,k8s,operator,bgp,kubeadm,ValueFrom:nil,},EnvVar{Name:NOTIFICATIONS,Value:Enabled,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-swwgh,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod whisker-7c85d6c7cb-dd4pw_calico-system(cba52d39-d0ad-4c67-aaef-c5790877e8e6): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" logger="UnhandledError" Nov 4 23:22:33.562717 containerd[1974]: time="2025-11-04T23:22:33.562593187Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\"" Nov 4 23:22:33.859978 containerd[1974]: time="2025-11-04T23:22:33.859369941Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:22:33.861859 containerd[1974]: time="2025-11-04T23:22:33.861785025Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" Nov 4 23:22:33.862502 containerd[1974]: time="2025-11-04T23:22:33.862113993Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/whisker-backend:v3.30.4: active requests=0, bytes read=85" Nov 4 23:22:33.862631 kubelet[3304]: E1104 23:22:33.862313 3304 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker-backend:v3.30.4" Nov 4 23:22:33.862631 kubelet[3304]: E1104 23:22:33.862375 3304 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker-backend:v3.30.4" Nov 4 23:22:33.864221 kubelet[3304]: E1104 23:22:33.862946 3304 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:whisker-backend,Image:ghcr.io/flatcar/calico/whisker-backend:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:INFO,ValueFrom:nil,},EnvVar{Name:PORT,Value:3002,ValueFrom:nil,},EnvVar{Name:GOLDMANE_HOST,Value:goldmane.calico-system.svc.cluster.local:7443,ValueFrom:nil,},EnvVar{Name:TLS_CERT_PATH,Value:/whisker-backend-key-pair/tls.crt,ValueFrom:nil,},EnvVar{Name:TLS_KEY_PATH,Value:/whisker-backend-key-pair/tls.key,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:whisker-backend-key-pair,ReadOnly:true,MountPath:/whisker-backend-key-pair,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:whisker-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-swwgh,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod whisker-7c85d6c7cb-dd4pw_calico-system(cba52d39-d0ad-4c67-aaef-c5790877e8e6): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" logger="UnhandledError" Nov 4 23:22:33.865414 kubelet[3304]: E1104 23:22:33.865328 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"whisker\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found\", failed to \"StartContainer\" for \"whisker-backend\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found\"]" pod="calico-system/whisker-7c85d6c7cb-dd4pw" podUID="cba52d39-d0ad-4c67-aaef-c5790877e8e6" Nov 4 23:22:34.731587 systemd[1]: Started sshd@14-172.31.23.127:22-139.178.89.65:35300.service - OpenSSH per-connection server daemon (139.178.89.65:35300). Nov 4 23:22:34.929655 sshd[5639]: Accepted publickey for core from 139.178.89.65 port 35300 ssh2: RSA SHA256:hDiwkCWvCQBqijfvK1jv0H0YtRR2s7jf/pLBmZjqWNg Nov 4 23:22:34.932102 sshd-session[5639]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 4 23:22:34.941883 systemd-logind[1953]: New session 15 of user core. Nov 4 23:22:34.951213 systemd[1]: Started session-15.scope - Session 15 of User core. Nov 4 23:22:35.216108 sshd[5642]: Connection closed by 139.178.89.65 port 35300 Nov 4 23:22:35.215982 sshd-session[5639]: pam_unix(sshd:session): session closed for user core Nov 4 23:22:35.224024 systemd-logind[1953]: Session 15 logged out. Waiting for processes to exit. Nov 4 23:22:35.224229 systemd[1]: sshd@14-172.31.23.127:22-139.178.89.65:35300.service: Deactivated successfully. Nov 4 23:22:35.229537 systemd[1]: session-15.scope: Deactivated successfully. Nov 4 23:22:35.234943 systemd-logind[1953]: Removed session 15. Nov 4 23:22:40.256636 systemd[1]: Started sshd@15-172.31.23.127:22-139.178.89.65:58136.service - OpenSSH per-connection server daemon (139.178.89.65:58136). Nov 4 23:22:40.465197 sshd[5662]: Accepted publickey for core from 139.178.89.65 port 58136 ssh2: RSA SHA256:hDiwkCWvCQBqijfvK1jv0H0YtRR2s7jf/pLBmZjqWNg Nov 4 23:22:40.468445 sshd-session[5662]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 4 23:22:40.482247 systemd-logind[1953]: New session 16 of user core. Nov 4 23:22:40.492224 systemd[1]: Started session-16.scope - Session 16 of User core. Nov 4 23:22:40.768333 sshd[5665]: Connection closed by 139.178.89.65 port 58136 Nov 4 23:22:40.769264 sshd-session[5662]: pam_unix(sshd:session): session closed for user core Nov 4 23:22:40.777126 systemd[1]: sshd@15-172.31.23.127:22-139.178.89.65:58136.service: Deactivated successfully. Nov 4 23:22:40.780559 systemd[1]: session-16.scope: Deactivated successfully. Nov 4 23:22:40.785625 systemd-logind[1953]: Session 16 logged out. Waiting for processes to exit. Nov 4 23:22:40.788142 systemd-logind[1953]: Removed session 16. Nov 4 23:22:40.809515 systemd[1]: Started sshd@16-172.31.23.127:22-139.178.89.65:58150.service - OpenSSH per-connection server daemon (139.178.89.65:58150). Nov 4 23:22:41.012990 sshd[5686]: Accepted publickey for core from 139.178.89.65 port 58150 ssh2: RSA SHA256:hDiwkCWvCQBqijfvK1jv0H0YtRR2s7jf/pLBmZjqWNg Nov 4 23:22:41.014597 sshd-session[5686]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 4 23:22:41.024132 systemd-logind[1953]: New session 17 of user core. Nov 4 23:22:41.039233 systemd[1]: Started session-17.scope - Session 17 of User core. Nov 4 23:22:41.304818 containerd[1974]: time="2025-11-04T23:22:41.304516586Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\"" Nov 4 23:22:41.584041 containerd[1974]: time="2025-11-04T23:22:41.583796739Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:22:41.586574 containerd[1974]: time="2025-11-04T23:22:41.586447335Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" Nov 4 23:22:41.586574 containerd[1974]: time="2025-11-04T23:22:41.586518315Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/apiserver:v3.30.4: active requests=0, bytes read=77" Nov 4 23:22:41.587194 kubelet[3304]: E1104 23:22:41.587062 3304 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 4 23:22:41.588588 kubelet[3304]: E1104 23:22:41.587173 3304 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 4 23:22:41.588588 kubelet[3304]: E1104 23:22:41.588126 3304 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:calico-apiserver,Image:ghcr.io/flatcar/calico/apiserver:v3.30.4,Command:[],Args:[--secure-port=5443 --tls-private-key-file=/calico-apiserver-certs/tls.key --tls-cert-file=/calico-apiserver-certs/tls.crt],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:LOG_LEVEL,Value:info,ValueFrom:nil,},EnvVar{Name:MULTI_INTERFACE_MODE,Value:none,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:calico-apiserver-certs,ReadOnly:true,MountPath:/calico-apiserver-certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-cvnkz,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 5443 },Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-apiserver-f66b9548c-6sxnc_calico-apiserver(3262dea2-8952-4d22-82d3-50fc85d38fcd): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" logger="UnhandledError" Nov 4 23:22:41.589375 containerd[1974]: time="2025-11-04T23:22:41.589310979Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/goldmane:v3.30.4\"" Nov 4 23:22:41.590710 kubelet[3304]: E1104 23:22:41.590081 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-f66b9548c-6sxnc" podUID="3262dea2-8952-4d22-82d3-50fc85d38fcd" Nov 4 23:22:41.872664 containerd[1974]: time="2025-11-04T23:22:41.872452156Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:22:41.874733 containerd[1974]: time="2025-11-04T23:22:41.874586872Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/goldmane:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" Nov 4 23:22:41.874733 containerd[1974]: time="2025-11-04T23:22:41.874668928Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/goldmane:v3.30.4: active requests=0, bytes read=77" Nov 4 23:22:41.875279 kubelet[3304]: E1104 23:22:41.874962 3304 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" image="ghcr.io/flatcar/calico/goldmane:v3.30.4" Nov 4 23:22:41.875279 kubelet[3304]: E1104 23:22:41.875023 3304 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" image="ghcr.io/flatcar/calico/goldmane:v3.30.4" Nov 4 23:22:41.875428 kubelet[3304]: E1104 23:22:41.875226 3304 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:goldmane,Image:ghcr.io/flatcar/calico/goldmane:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:INFO,ValueFrom:nil,},EnvVar{Name:PORT,Value:7443,ValueFrom:nil,},EnvVar{Name:SERVER_CERT_PATH,Value:/goldmane-key-pair/tls.crt,ValueFrom:nil,},EnvVar{Name:SERVER_KEY_PATH,Value:/goldmane-key-pair/tls.key,ValueFrom:nil,},EnvVar{Name:CA_CERT_PATH,Value:/etc/pki/tls/certs/tigera-ca-bundle.crt,ValueFrom:nil,},EnvVar{Name:PUSH_URL,Value:https://guardian.calico-system.svc.cluster.local:443/api/v1/flows/bulk,ValueFrom:nil,},EnvVar{Name:FILE_CONFIG_PATH,Value:/config/config.json,ValueFrom:nil,},EnvVar{Name:HEALTH_ENABLED,Value:true,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:config,ReadOnly:true,MountPath:/config,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:goldmane-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:goldmane-key-pair,ReadOnly:true,MountPath:/goldmane-key-pair,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-2vpxq,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/health -live],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/health -ready],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:30,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod goldmane-666569f655-sfktq_calico-system(f026c0ae-4dbf-4901-893b-d3b577723fff): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" logger="UnhandledError" Nov 4 23:22:41.877098 kubelet[3304]: E1104 23:22:41.877033 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"goldmane\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found\"" pod="calico-system/goldmane-666569f655-sfktq" podUID="f026c0ae-4dbf-4901-893b-d3b577723fff" Nov 4 23:22:42.207663 sshd[5689]: Connection closed by 139.178.89.65 port 58150 Nov 4 23:22:42.208016 sshd-session[5686]: pam_unix(sshd:session): session closed for user core Nov 4 23:22:42.217872 systemd[1]: sshd@16-172.31.23.127:22-139.178.89.65:58150.service: Deactivated successfully. Nov 4 23:22:42.222660 systemd[1]: session-17.scope: Deactivated successfully. Nov 4 23:22:42.226691 systemd-logind[1953]: Session 17 logged out. Waiting for processes to exit. Nov 4 23:22:42.229907 systemd-logind[1953]: Removed session 17. Nov 4 23:22:42.249429 systemd[1]: Started sshd@17-172.31.23.127:22-139.178.89.65:58162.service - OpenSSH per-connection server daemon (139.178.89.65:58162). Nov 4 23:22:42.464647 sshd[5699]: Accepted publickey for core from 139.178.89.65 port 58162 ssh2: RSA SHA256:hDiwkCWvCQBqijfvK1jv0H0YtRR2s7jf/pLBmZjqWNg Nov 4 23:22:42.468687 sshd-session[5699]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 4 23:22:42.478050 systemd-logind[1953]: New session 18 of user core. Nov 4 23:22:42.487232 systemd[1]: Started session-18.scope - Session 18 of User core. Nov 4 23:22:43.718041 sshd[5704]: Connection closed by 139.178.89.65 port 58162 Nov 4 23:22:43.718946 sshd-session[5699]: pam_unix(sshd:session): session closed for user core Nov 4 23:22:43.731858 systemd[1]: sshd@17-172.31.23.127:22-139.178.89.65:58162.service: Deactivated successfully. Nov 4 23:22:43.742962 systemd[1]: session-18.scope: Deactivated successfully. Nov 4 23:22:43.747666 systemd-logind[1953]: Session 18 logged out. Waiting for processes to exit. Nov 4 23:22:43.772202 systemd[1]: Started sshd@18-172.31.23.127:22-139.178.89.65:58164.service - OpenSSH per-connection server daemon (139.178.89.65:58164). Nov 4 23:22:43.778214 systemd-logind[1953]: Removed session 18. Nov 4 23:22:43.980705 sshd[5721]: Accepted publickey for core from 139.178.89.65 port 58164 ssh2: RSA SHA256:hDiwkCWvCQBqijfvK1jv0H0YtRR2s7jf/pLBmZjqWNg Nov 4 23:22:43.983240 sshd-session[5721]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 4 23:22:43.997152 systemd-logind[1953]: New session 19 of user core. Nov 4 23:22:44.004334 systemd[1]: Started session-19.scope - Session 19 of User core. Nov 4 23:22:44.315838 containerd[1974]: time="2025-11-04T23:22:44.315124217Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\"" Nov 4 23:22:44.557989 sshd[5724]: Connection closed by 139.178.89.65 port 58164 Nov 4 23:22:44.559080 sshd-session[5721]: pam_unix(sshd:session): session closed for user core Nov 4 23:22:44.574989 systemd-logind[1953]: Session 19 logged out. Waiting for processes to exit. Nov 4 23:22:44.576233 systemd[1]: sshd@18-172.31.23.127:22-139.178.89.65:58164.service: Deactivated successfully. Nov 4 23:22:44.582417 systemd[1]: session-19.scope: Deactivated successfully. Nov 4 23:22:44.595559 containerd[1974]: time="2025-11-04T23:22:44.595351086Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:22:44.597718 containerd[1974]: time="2025-11-04T23:22:44.597530514Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" Nov 4 23:22:44.597718 containerd[1974]: time="2025-11-04T23:22:44.597658470Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/kube-controllers:v3.30.4: active requests=0, bytes read=85" Nov 4 23:22:44.598904 kubelet[3304]: E1104 23:22:44.598288 3304 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" image="ghcr.io/flatcar/calico/kube-controllers:v3.30.4" Nov 4 23:22:44.598904 kubelet[3304]: E1104 23:22:44.598709 3304 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" image="ghcr.io/flatcar/calico/kube-controllers:v3.30.4" Nov 4 23:22:44.601037 kubelet[3304]: E1104 23:22:44.599830 3304 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:calico-kube-controllers,Image:ghcr.io/flatcar/calico/kube-controllers:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:KUBE_CONTROLLERS_CONFIG_NAME,Value:default,ValueFrom:nil,},EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:ENABLED_CONTROLLERS,Value:node,loadbalancer,ValueFrom:nil,},EnvVar{Name:DISABLE_KUBE_CONTROLLERS_CONFIG_API,Value:false,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:CA_CRT_PATH,Value:/etc/pki/tls/certs/tigera-ca-bundle.crt,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:tigera-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:tigera-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/cert.pem,SubPath:ca-bundle.crt,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-g8glv,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/usr/bin/check-status -l],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:10,TimeoutSeconds:10,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:6,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/usr/bin/check-status -r],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:10,PeriodSeconds:30,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*999,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-kube-controllers-77c845d5cc-h2d4p_calico-system(4d28b7f3-4e9e-4cbc-92fc-da554118a9c3): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" logger="UnhandledError" Nov 4 23:22:44.601523 kubelet[3304]: E1104 23:22:44.601255 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-kube-controllers\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found\"" pod="calico-system/calico-kube-controllers-77c845d5cc-h2d4p" podUID="4d28b7f3-4e9e-4cbc-92fc-da554118a9c3" Nov 4 23:22:44.602699 systemd[1]: Started sshd@19-172.31.23.127:22-139.178.89.65:58174.service - OpenSSH per-connection server daemon (139.178.89.65:58174). Nov 4 23:22:44.606586 systemd-logind[1953]: Removed session 19. Nov 4 23:22:44.803493 sshd[5734]: Accepted publickey for core from 139.178.89.65 port 58174 ssh2: RSA SHA256:hDiwkCWvCQBqijfvK1jv0H0YtRR2s7jf/pLBmZjqWNg Nov 4 23:22:44.805822 sshd-session[5734]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 4 23:22:44.815541 systemd-logind[1953]: New session 20 of user core. Nov 4 23:22:44.820209 systemd[1]: Started session-20.scope - Session 20 of User core. Nov 4 23:22:45.093058 sshd[5737]: Connection closed by 139.178.89.65 port 58174 Nov 4 23:22:45.093955 sshd-session[5734]: pam_unix(sshd:session): session closed for user core Nov 4 23:22:45.102132 systemd[1]: sshd@19-172.31.23.127:22-139.178.89.65:58174.service: Deactivated successfully. Nov 4 23:22:45.106317 systemd[1]: session-20.scope: Deactivated successfully. Nov 4 23:22:45.109024 systemd-logind[1953]: Session 20 logged out. Waiting for processes to exit. Nov 4 23:22:45.112771 systemd-logind[1953]: Removed session 20. Nov 4 23:22:45.300519 containerd[1974]: time="2025-11-04T23:22:45.300435017Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/csi:v3.30.4\"" Nov 4 23:22:45.583275 containerd[1974]: time="2025-11-04T23:22:45.583212907Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:22:45.587799 containerd[1974]: time="2025-11-04T23:22:45.587689951Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/csi:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" Nov 4 23:22:45.587799 containerd[1974]: time="2025-11-04T23:22:45.587761987Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/csi:v3.30.4: active requests=0, bytes read=69" Nov 4 23:22:45.588082 kubelet[3304]: E1104 23:22:45.588017 3304 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" image="ghcr.io/flatcar/calico/csi:v3.30.4" Nov 4 23:22:45.588189 kubelet[3304]: E1104 23:22:45.588076 3304 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" image="ghcr.io/flatcar/calico/csi:v3.30.4" Nov 4 23:22:45.588346 kubelet[3304]: E1104 23:22:45.588269 3304 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:calico-csi,Image:ghcr.io/flatcar/calico/csi:v3.30.4,Command:[],Args:[--nodeid=$(KUBE_NODE_NAME) --loglevel=$(LOG_LEVEL)],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:warn,ValueFrom:nil,},EnvVar{Name:KUBE_NODE_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:spec.nodeName,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kubelet-dir,ReadOnly:false,MountPath:/var/lib/kubelet,SubPath:,MountPropagation:*Bidirectional,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:socket-dir,ReadOnly:false,MountPath:/csi,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:varrun,ReadOnly:false,MountPath:/var/run,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-49z2c,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*true,SELinuxOptions:nil,RunAsUser:*0,RunAsNonRoot:*false,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*true,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod csi-node-driver-n5cdd_calico-system(024e93aa-74ad-4ec2-b309-ed5d7023cfd9): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" logger="UnhandledError" Nov 4 23:22:45.592784 containerd[1974]: time="2025-11-04T23:22:45.592579543Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\"" Nov 4 23:22:45.883282 containerd[1974]: time="2025-11-04T23:22:45.883109960Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:22:45.885588 containerd[1974]: time="2025-11-04T23:22:45.885511844Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" Nov 4 23:22:45.885588 containerd[1974]: time="2025-11-04T23:22:45.885544556Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: active requests=0, bytes read=93" Nov 4 23:22:45.885897 kubelet[3304]: E1104 23:22:45.885822 3304 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" image="ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4" Nov 4 23:22:45.886395 kubelet[3304]: E1104 23:22:45.885900 3304 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" image="ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4" Nov 4 23:22:45.886395 kubelet[3304]: E1104 23:22:45.886096 3304 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:csi-node-driver-registrar,Image:ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4,Command:[],Args:[--v=5 --csi-address=$(ADDRESS) --kubelet-registration-path=$(DRIVER_REG_SOCK_PATH)],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:ADDRESS,Value:/csi/csi.sock,ValueFrom:nil,},EnvVar{Name:DRIVER_REG_SOCK_PATH,Value:/var/lib/kubelet/plugins/csi.tigera.io/csi.sock,ValueFrom:nil,},EnvVar{Name:KUBE_NODE_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:spec.nodeName,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:registration-dir,ReadOnly:false,MountPath:/registration,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:socket-dir,ReadOnly:false,MountPath:/csi,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-49z2c,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*true,SELinuxOptions:nil,RunAsUser:*0,RunAsNonRoot:*false,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*true,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod csi-node-driver-n5cdd_calico-system(024e93aa-74ad-4ec2-b309-ed5d7023cfd9): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" logger="UnhandledError" Nov 4 23:22:45.888206 kubelet[3304]: E1104 23:22:45.888126 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"calico-csi\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ghcr.io/flatcar/calico/csi:v3.30.4: not found\", failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found\"]" pod="calico-system/csi-node-driver-n5cdd" podUID="024e93aa-74ad-4ec2-b309-ed5d7023cfd9" Nov 4 23:22:46.299907 containerd[1974]: time="2025-11-04T23:22:46.299680794Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\"" Nov 4 23:22:46.595536 containerd[1974]: time="2025-11-04T23:22:46.595245140Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:22:46.597459 containerd[1974]: time="2025-11-04T23:22:46.597360836Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" Nov 4 23:22:46.597601 containerd[1974]: time="2025-11-04T23:22:46.597513020Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/apiserver:v3.30.4: active requests=0, bytes read=77" Nov 4 23:22:46.597936 kubelet[3304]: E1104 23:22:46.597798 3304 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 4 23:22:46.597936 kubelet[3304]: E1104 23:22:46.597865 3304 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 4 23:22:46.598538 kubelet[3304]: E1104 23:22:46.598430 3304 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:calico-apiserver,Image:ghcr.io/flatcar/calico/apiserver:v3.30.4,Command:[],Args:[--secure-port=5443 --tls-private-key-file=/calico-apiserver-certs/tls.key --tls-cert-file=/calico-apiserver-certs/tls.crt],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:LOG_LEVEL,Value:info,ValueFrom:nil,},EnvVar{Name:MULTI_INTERFACE_MODE,Value:none,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:calico-apiserver-certs,ReadOnly:true,MountPath:/calico-apiserver-certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-lhlrj,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 5443 },Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-apiserver-f66b9548c-ghbgm_calico-apiserver(a2dd6680-1f53-4788-9ae9-bffdb1850825): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" logger="UnhandledError" Nov 4 23:22:46.599767 kubelet[3304]: E1104 23:22:46.599692 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-f66b9548c-ghbgm" podUID="a2dd6680-1f53-4788-9ae9-bffdb1850825" Nov 4 23:22:47.304971 kubelet[3304]: E1104 23:22:47.303585 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"whisker\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found\", failed to \"StartContainer\" for \"whisker-backend\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found\"]" pod="calico-system/whisker-7c85d6c7cb-dd4pw" podUID="cba52d39-d0ad-4c67-aaef-c5790877e8e6" Nov 4 23:22:50.135743 systemd[1]: Started sshd@20-172.31.23.127:22-139.178.89.65:60580.service - OpenSSH per-connection server daemon (139.178.89.65:60580). Nov 4 23:22:50.335743 sshd[5749]: Accepted publickey for core from 139.178.89.65 port 60580 ssh2: RSA SHA256:hDiwkCWvCQBqijfvK1jv0H0YtRR2s7jf/pLBmZjqWNg Nov 4 23:22:50.338780 sshd-session[5749]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 4 23:22:50.348198 systemd-logind[1953]: New session 21 of user core. Nov 4 23:22:50.356441 systemd[1]: Started session-21.scope - Session 21 of User core. Nov 4 23:22:50.601987 sshd[5752]: Connection closed by 139.178.89.65 port 60580 Nov 4 23:22:50.602815 sshd-session[5749]: pam_unix(sshd:session): session closed for user core Nov 4 23:22:50.611821 systemd[1]: sshd@20-172.31.23.127:22-139.178.89.65:60580.service: Deactivated successfully. Nov 4 23:22:50.615186 systemd[1]: session-21.scope: Deactivated successfully. Nov 4 23:22:50.617580 systemd-logind[1953]: Session 21 logged out. Waiting for processes to exit. Nov 4 23:22:50.620843 systemd-logind[1953]: Removed session 21. Nov 4 23:22:54.308004 kubelet[3304]: E1104 23:22:54.305621 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-f66b9548c-6sxnc" podUID="3262dea2-8952-4d22-82d3-50fc85d38fcd" Nov 4 23:22:55.642365 systemd[1]: Started sshd@21-172.31.23.127:22-139.178.89.65:60596.service - OpenSSH per-connection server daemon (139.178.89.65:60596). Nov 4 23:22:55.853696 sshd[5766]: Accepted publickey for core from 139.178.89.65 port 60596 ssh2: RSA SHA256:hDiwkCWvCQBqijfvK1jv0H0YtRR2s7jf/pLBmZjqWNg Nov 4 23:22:55.857969 sshd-session[5766]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 4 23:22:55.874580 systemd-logind[1953]: New session 22 of user core. Nov 4 23:22:55.879248 systemd[1]: Started session-22.scope - Session 22 of User core. Nov 4 23:22:55.978186 containerd[1974]: time="2025-11-04T23:22:55.978085482Z" level=info msg="TaskExit event in podsandbox handler container_id:\"734968a2bf7847c37be53b16593806fb188615b60b4ab06e25a834e12dd854f0\" id:\"f7d8d325e73989ffe74ca9704325e34ed024741b2ec80569f023c69cfedb508c\" pid:5781 exited_at:{seconds:1762298575 nanos:973339098}" Nov 4 23:22:56.165974 sshd[5791]: Connection closed by 139.178.89.65 port 60596 Nov 4 23:22:56.166256 sshd-session[5766]: pam_unix(sshd:session): session closed for user core Nov 4 23:22:56.177389 systemd[1]: sshd@21-172.31.23.127:22-139.178.89.65:60596.service: Deactivated successfully. Nov 4 23:22:56.177577 systemd-logind[1953]: Session 22 logged out. Waiting for processes to exit. Nov 4 23:22:56.186517 systemd[1]: session-22.scope: Deactivated successfully. Nov 4 23:22:56.191347 systemd-logind[1953]: Removed session 22. Nov 4 23:22:56.301663 kubelet[3304]: E1104 23:22:56.301175 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"goldmane\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found\"" pod="calico-system/goldmane-666569f655-sfktq" podUID="f026c0ae-4dbf-4901-893b-d3b577723fff" Nov 4 23:22:57.302949 kubelet[3304]: E1104 23:22:57.301659 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"calico-csi\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ghcr.io/flatcar/calico/csi:v3.30.4: not found\", failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found\"]" pod="calico-system/csi-node-driver-n5cdd" podUID="024e93aa-74ad-4ec2-b309-ed5d7023cfd9" Nov 4 23:22:58.299732 kubelet[3304]: E1104 23:22:58.299635 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-kube-controllers\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found\"" pod="calico-system/calico-kube-controllers-77c845d5cc-h2d4p" podUID="4d28b7f3-4e9e-4cbc-92fc-da554118a9c3" Nov 4 23:23:00.303735 kubelet[3304]: E1104 23:23:00.303622 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"whisker\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found\", failed to \"StartContainer\" for \"whisker-backend\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found\"]" pod="calico-system/whisker-7c85d6c7cb-dd4pw" podUID="cba52d39-d0ad-4c67-aaef-c5790877e8e6" Nov 4 23:23:01.207430 systemd[1]: Started sshd@22-172.31.23.127:22-139.178.89.65:58370.service - OpenSSH per-connection server daemon (139.178.89.65:58370). Nov 4 23:23:01.299764 kubelet[3304]: E1104 23:23:01.299674 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-f66b9548c-ghbgm" podUID="a2dd6680-1f53-4788-9ae9-bffdb1850825" Nov 4 23:23:01.422381 sshd[5808]: Accepted publickey for core from 139.178.89.65 port 58370 ssh2: RSA SHA256:hDiwkCWvCQBqijfvK1jv0H0YtRR2s7jf/pLBmZjqWNg Nov 4 23:23:01.426642 sshd-session[5808]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 4 23:23:01.444334 systemd-logind[1953]: New session 23 of user core. Nov 4 23:23:01.451877 systemd[1]: Started session-23.scope - Session 23 of User core. Nov 4 23:23:01.756965 sshd[5811]: Connection closed by 139.178.89.65 port 58370 Nov 4 23:23:01.758484 sshd-session[5808]: pam_unix(sshd:session): session closed for user core Nov 4 23:23:01.771135 systemd[1]: sshd@22-172.31.23.127:22-139.178.89.65:58370.service: Deactivated successfully. Nov 4 23:23:01.783863 systemd[1]: session-23.scope: Deactivated successfully. Nov 4 23:23:01.790196 systemd-logind[1953]: Session 23 logged out. Waiting for processes to exit. Nov 4 23:23:01.795516 systemd-logind[1953]: Removed session 23. Nov 4 23:23:05.300048 kubelet[3304]: E1104 23:23:05.299478 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-f66b9548c-6sxnc" podUID="3262dea2-8952-4d22-82d3-50fc85d38fcd" Nov 4 23:23:06.793451 systemd[1]: Started sshd@23-172.31.23.127:22-139.178.89.65:55876.service - OpenSSH per-connection server daemon (139.178.89.65:55876). Nov 4 23:23:07.006486 sshd[5827]: Accepted publickey for core from 139.178.89.65 port 55876 ssh2: RSA SHA256:hDiwkCWvCQBqijfvK1jv0H0YtRR2s7jf/pLBmZjqWNg Nov 4 23:23:07.010330 sshd-session[5827]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 4 23:23:07.023479 systemd-logind[1953]: New session 24 of user core. Nov 4 23:23:07.030285 systemd[1]: Started session-24.scope - Session 24 of User core. Nov 4 23:23:07.345179 sshd[5830]: Connection closed by 139.178.89.65 port 55876 Nov 4 23:23:07.346312 sshd-session[5827]: pam_unix(sshd:session): session closed for user core Nov 4 23:23:07.356830 systemd[1]: sshd@23-172.31.23.127:22-139.178.89.65:55876.service: Deactivated successfully. Nov 4 23:23:07.358382 systemd-logind[1953]: Session 24 logged out. Waiting for processes to exit. Nov 4 23:23:07.366293 systemd[1]: session-24.scope: Deactivated successfully. Nov 4 23:23:07.378682 systemd-logind[1953]: Removed session 24. Nov 4 23:23:11.301636 kubelet[3304]: E1104 23:23:11.301490 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"goldmane\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found\"" pod="calico-system/goldmane-666569f655-sfktq" podUID="f026c0ae-4dbf-4901-893b-d3b577723fff" Nov 4 23:23:12.302362 kubelet[3304]: E1104 23:23:12.302269 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-f66b9548c-ghbgm" podUID="a2dd6680-1f53-4788-9ae9-bffdb1850825" Nov 4 23:23:12.306167 kubelet[3304]: E1104 23:23:12.306024 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"calico-csi\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ghcr.io/flatcar/calico/csi:v3.30.4: not found\", failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found\"]" pod="calico-system/csi-node-driver-n5cdd" podUID="024e93aa-74ad-4ec2-b309-ed5d7023cfd9" Nov 4 23:23:12.391194 systemd[1]: Started sshd@24-172.31.23.127:22-139.178.89.65:55884.service - OpenSSH per-connection server daemon (139.178.89.65:55884). Nov 4 23:23:12.613256 sshd[5843]: Accepted publickey for core from 139.178.89.65 port 55884 ssh2: RSA SHA256:hDiwkCWvCQBqijfvK1jv0H0YtRR2s7jf/pLBmZjqWNg Nov 4 23:23:12.617479 sshd-session[5843]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 4 23:23:12.632715 systemd-logind[1953]: New session 25 of user core. Nov 4 23:23:12.640412 systemd[1]: Started session-25.scope - Session 25 of User core. Nov 4 23:23:12.928691 sshd[5846]: Connection closed by 139.178.89.65 port 55884 Nov 4 23:23:12.930606 sshd-session[5843]: pam_unix(sshd:session): session closed for user core Nov 4 23:23:12.940501 systemd[1]: sshd@24-172.31.23.127:22-139.178.89.65:55884.service: Deactivated successfully. Nov 4 23:23:12.949937 systemd[1]: session-25.scope: Deactivated successfully. Nov 4 23:23:12.952011 systemd-logind[1953]: Session 25 logged out. Waiting for processes to exit. Nov 4 23:23:12.956320 systemd-logind[1953]: Removed session 25. Nov 4 23:23:13.302541 kubelet[3304]: E1104 23:23:13.301996 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-kube-controllers\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found\"" pod="calico-system/calico-kube-controllers-77c845d5cc-h2d4p" podUID="4d28b7f3-4e9e-4cbc-92fc-da554118a9c3" Nov 4 23:23:14.302747 containerd[1974]: time="2025-11-04T23:23:14.301508745Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/whisker:v3.30.4\"" Nov 4 23:23:14.584045 containerd[1974]: time="2025-11-04T23:23:14.583199735Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:23:14.585695 containerd[1974]: time="2025-11-04T23:23:14.585526847Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/whisker:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" Nov 4 23:23:14.585695 containerd[1974]: time="2025-11-04T23:23:14.585634547Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/whisker:v3.30.4: active requests=0, bytes read=73" Nov 4 23:23:14.586212 kubelet[3304]: E1104 23:23:14.586128 3304 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker:v3.30.4" Nov 4 23:23:14.586212 kubelet[3304]: E1104 23:23:14.586200 3304 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker:v3.30.4" Nov 4 23:23:14.587443 kubelet[3304]: E1104 23:23:14.586380 3304 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:whisker,Image:ghcr.io/flatcar/calico/whisker:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:INFO,ValueFrom:nil,},EnvVar{Name:CALICO_VERSION,Value:v3.30.4,ValueFrom:nil,},EnvVar{Name:CLUSTER_ID,Value:8dba38a1bbf64129b15305fae4af3a0f,ValueFrom:nil,},EnvVar{Name:CLUSTER_TYPE,Value:typha,kdd,k8s,operator,bgp,kubeadm,ValueFrom:nil,},EnvVar{Name:NOTIFICATIONS,Value:Enabled,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-swwgh,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod whisker-7c85d6c7cb-dd4pw_calico-system(cba52d39-d0ad-4c67-aaef-c5790877e8e6): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" logger="UnhandledError" Nov 4 23:23:14.591197 containerd[1974]: time="2025-11-04T23:23:14.591123863Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\"" Nov 4 23:23:14.880028 containerd[1974]: time="2025-11-04T23:23:14.879858852Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:23:14.882910 containerd[1974]: time="2025-11-04T23:23:14.882730824Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" Nov 4 23:23:14.882910 containerd[1974]: time="2025-11-04T23:23:14.882783732Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/whisker-backend:v3.30.4: active requests=0, bytes read=85" Nov 4 23:23:14.883706 kubelet[3304]: E1104 23:23:14.883350 3304 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker-backend:v3.30.4" Nov 4 23:23:14.883706 kubelet[3304]: E1104 23:23:14.883415 3304 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker-backend:v3.30.4" Nov 4 23:23:14.883706 kubelet[3304]: E1104 23:23:14.883608 3304 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:whisker-backend,Image:ghcr.io/flatcar/calico/whisker-backend:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:INFO,ValueFrom:nil,},EnvVar{Name:PORT,Value:3002,ValueFrom:nil,},EnvVar{Name:GOLDMANE_HOST,Value:goldmane.calico-system.svc.cluster.local:7443,ValueFrom:nil,},EnvVar{Name:TLS_CERT_PATH,Value:/whisker-backend-key-pair/tls.crt,ValueFrom:nil,},EnvVar{Name:TLS_KEY_PATH,Value:/whisker-backend-key-pair/tls.key,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:whisker-backend-key-pair,ReadOnly:true,MountPath:/whisker-backend-key-pair,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:whisker-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-swwgh,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod whisker-7c85d6c7cb-dd4pw_calico-system(cba52d39-d0ad-4c67-aaef-c5790877e8e6): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" logger="UnhandledError" Nov 4 23:23:14.885245 kubelet[3304]: E1104 23:23:14.884866 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"whisker\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found\", failed to \"StartContainer\" for \"whisker-backend\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found\"]" pod="calico-system/whisker-7c85d6c7cb-dd4pw" podUID="cba52d39-d0ad-4c67-aaef-c5790877e8e6" Nov 4 23:23:17.299935 kubelet[3304]: E1104 23:23:17.299388 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-f66b9548c-6sxnc" podUID="3262dea2-8952-4d22-82d3-50fc85d38fcd" Nov 4 23:23:17.979060 systemd[1]: Started sshd@25-172.31.23.127:22-139.178.89.65:56842.service - OpenSSH per-connection server daemon (139.178.89.65:56842). Nov 4 23:23:18.202798 sshd[5860]: Accepted publickey for core from 139.178.89.65 port 56842 ssh2: RSA SHA256:hDiwkCWvCQBqijfvK1jv0H0YtRR2s7jf/pLBmZjqWNg Nov 4 23:23:18.207848 sshd-session[5860]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Nov 4 23:23:18.218950 systemd-logind[1953]: New session 26 of user core. Nov 4 23:23:18.228205 systemd[1]: Started session-26.scope - Session 26 of User core. Nov 4 23:23:18.536171 sshd[5867]: Connection closed by 139.178.89.65 port 56842 Nov 4 23:23:18.537522 sshd-session[5860]: pam_unix(sshd:session): session closed for user core Nov 4 23:23:18.548500 systemd[1]: sshd@25-172.31.23.127:22-139.178.89.65:56842.service: Deactivated successfully. Nov 4 23:23:18.557070 systemd[1]: session-26.scope: Deactivated successfully. Nov 4 23:23:18.562859 systemd-logind[1953]: Session 26 logged out. Waiting for processes to exit. Nov 4 23:23:18.567623 systemd-logind[1953]: Removed session 26. Nov 4 23:23:24.304096 kubelet[3304]: E1104 23:23:24.304035 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-f66b9548c-ghbgm" podUID="a2dd6680-1f53-4788-9ae9-bffdb1850825" Nov 4 23:23:25.877415 containerd[1974]: time="2025-11-04T23:23:25.877303019Z" level=info msg="TaskExit event in podsandbox handler container_id:\"734968a2bf7847c37be53b16593806fb188615b60b4ab06e25a834e12dd854f0\" id:\"3ab406147ac0d451bca8783cc03da966646f3f3c57aaf15282047aa0abdbed4c\" pid:5893 exited_at:{seconds:1762298605 nanos:876431687}" Nov 4 23:23:26.303769 containerd[1974]: time="2025-11-04T23:23:26.303709713Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/csi:v3.30.4\"" Nov 4 23:23:26.308550 kubelet[3304]: E1104 23:23:26.308439 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"whisker\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found\", failed to \"StartContainer\" for \"whisker-backend\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found\"]" pod="calico-system/whisker-7c85d6c7cb-dd4pw" podUID="cba52d39-d0ad-4c67-aaef-c5790877e8e6" Nov 4 23:23:26.576623 containerd[1974]: time="2025-11-04T23:23:26.576190570Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:23:26.579225 containerd[1974]: time="2025-11-04T23:23:26.579081646Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/csi:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" Nov 4 23:23:26.579225 containerd[1974]: time="2025-11-04T23:23:26.579159286Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/csi:v3.30.4: active requests=0, bytes read=69" Nov 4 23:23:26.579517 kubelet[3304]: E1104 23:23:26.579442 3304 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" image="ghcr.io/flatcar/calico/csi:v3.30.4" Nov 4 23:23:26.579517 kubelet[3304]: E1104 23:23:26.579504 3304 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" image="ghcr.io/flatcar/calico/csi:v3.30.4" Nov 4 23:23:26.580188 kubelet[3304]: E1104 23:23:26.580021 3304 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:calico-csi,Image:ghcr.io/flatcar/calico/csi:v3.30.4,Command:[],Args:[--nodeid=$(KUBE_NODE_NAME) --loglevel=$(LOG_LEVEL)],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:warn,ValueFrom:nil,},EnvVar{Name:KUBE_NODE_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:spec.nodeName,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kubelet-dir,ReadOnly:false,MountPath:/var/lib/kubelet,SubPath:,MountPropagation:*Bidirectional,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:socket-dir,ReadOnly:false,MountPath:/csi,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:varrun,ReadOnly:false,MountPath:/var/run,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-49z2c,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*true,SELinuxOptions:nil,RunAsUser:*0,RunAsNonRoot:*false,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*true,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod csi-node-driver-n5cdd_calico-system(024e93aa-74ad-4ec2-b309-ed5d7023cfd9): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" logger="UnhandledError" Nov 4 23:23:26.580478 containerd[1974]: time="2025-11-04T23:23:26.580366486Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/goldmane:v3.30.4\"" Nov 4 23:23:26.867712 containerd[1974]: time="2025-11-04T23:23:26.867539232Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:23:26.870325 containerd[1974]: time="2025-11-04T23:23:26.870252516Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/goldmane:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" Nov 4 23:23:26.870758 containerd[1974]: time="2025-11-04T23:23:26.870384912Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/goldmane:v3.30.4: active requests=0, bytes read=77" Nov 4 23:23:26.871258 kubelet[3304]: E1104 23:23:26.870599 3304 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" image="ghcr.io/flatcar/calico/goldmane:v3.30.4" Nov 4 23:23:26.871258 kubelet[3304]: E1104 23:23:26.870663 3304 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" image="ghcr.io/flatcar/calico/goldmane:v3.30.4" Nov 4 23:23:26.871258 kubelet[3304]: E1104 23:23:26.871030 3304 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:goldmane,Image:ghcr.io/flatcar/calico/goldmane:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:INFO,ValueFrom:nil,},EnvVar{Name:PORT,Value:7443,ValueFrom:nil,},EnvVar{Name:SERVER_CERT_PATH,Value:/goldmane-key-pair/tls.crt,ValueFrom:nil,},EnvVar{Name:SERVER_KEY_PATH,Value:/goldmane-key-pair/tls.key,ValueFrom:nil,},EnvVar{Name:CA_CERT_PATH,Value:/etc/pki/tls/certs/tigera-ca-bundle.crt,ValueFrom:nil,},EnvVar{Name:PUSH_URL,Value:https://guardian.calico-system.svc.cluster.local:443/api/v1/flows/bulk,ValueFrom:nil,},EnvVar{Name:FILE_CONFIG_PATH,Value:/config/config.json,ValueFrom:nil,},EnvVar{Name:HEALTH_ENABLED,Value:true,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:config,ReadOnly:true,MountPath:/config,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:goldmane-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:goldmane-key-pair,ReadOnly:true,MountPath:/goldmane-key-pair,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-2vpxq,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/health -live],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/health -ready],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:30,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod goldmane-666569f655-sfktq_calico-system(f026c0ae-4dbf-4901-893b-d3b577723fff): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" logger="UnhandledError" Nov 4 23:23:26.871995 containerd[1974]: time="2025-11-04T23:23:26.871648044Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\"" Nov 4 23:23:26.872870 kubelet[3304]: E1104 23:23:26.872792 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"goldmane\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found\"" pod="calico-system/goldmane-666569f655-sfktq" podUID="f026c0ae-4dbf-4901-893b-d3b577723fff" Nov 4 23:23:27.122234 containerd[1974]: time="2025-11-04T23:23:27.121511253Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:23:27.123713 containerd[1974]: time="2025-11-04T23:23:27.123640209Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" Nov 4 23:23:27.123713 containerd[1974]: time="2025-11-04T23:23:27.123663189Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: active requests=0, bytes read=93" Nov 4 23:23:27.124133 kubelet[3304]: E1104 23:23:27.124018 3304 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" image="ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4" Nov 4 23:23:27.124228 kubelet[3304]: E1104 23:23:27.124153 3304 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" image="ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4" Nov 4 23:23:27.124623 kubelet[3304]: E1104 23:23:27.124511 3304 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:csi-node-driver-registrar,Image:ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4,Command:[],Args:[--v=5 --csi-address=$(ADDRESS) --kubelet-registration-path=$(DRIVER_REG_SOCK_PATH)],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:ADDRESS,Value:/csi/csi.sock,ValueFrom:nil,},EnvVar{Name:DRIVER_REG_SOCK_PATH,Value:/var/lib/kubelet/plugins/csi.tigera.io/csi.sock,ValueFrom:nil,},EnvVar{Name:KUBE_NODE_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:spec.nodeName,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:registration-dir,ReadOnly:false,MountPath:/registration,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:socket-dir,ReadOnly:false,MountPath:/csi,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-49z2c,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*true,SELinuxOptions:nil,RunAsUser:*0,RunAsNonRoot:*false,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*true,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod csi-node-driver-n5cdd_calico-system(024e93aa-74ad-4ec2-b309-ed5d7023cfd9): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" logger="UnhandledError" Nov 4 23:23:27.125837 kubelet[3304]: E1104 23:23:27.125761 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"calico-csi\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ghcr.io/flatcar/calico/csi:v3.30.4: not found\", failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found\"]" pod="calico-system/csi-node-driver-n5cdd" podUID="024e93aa-74ad-4ec2-b309-ed5d7023cfd9" Nov 4 23:23:28.300986 containerd[1974]: time="2025-11-04T23:23:28.300655067Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\"" Nov 4 23:23:28.608893 containerd[1974]: time="2025-11-04T23:23:28.608717857Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:23:28.611473 containerd[1974]: time="2025-11-04T23:23:28.611300281Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" Nov 4 23:23:28.611473 containerd[1974]: time="2025-11-04T23:23:28.611319661Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/apiserver:v3.30.4: active requests=0, bytes read=77" Nov 4 23:23:28.611899 kubelet[3304]: E1104 23:23:28.611826 3304 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 4 23:23:28.613053 kubelet[3304]: E1104 23:23:28.611899 3304 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 4 23:23:28.613053 kubelet[3304]: E1104 23:23:28.612290 3304 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:calico-apiserver,Image:ghcr.io/flatcar/calico/apiserver:v3.30.4,Command:[],Args:[--secure-port=5443 --tls-private-key-file=/calico-apiserver-certs/tls.key --tls-cert-file=/calico-apiserver-certs/tls.crt],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:LOG_LEVEL,Value:info,ValueFrom:nil,},EnvVar{Name:MULTI_INTERFACE_MODE,Value:none,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:calico-apiserver-certs,ReadOnly:true,MountPath:/calico-apiserver-certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-cvnkz,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 5443 },Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-apiserver-f66b9548c-6sxnc_calico-apiserver(3262dea2-8952-4d22-82d3-50fc85d38fcd): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" logger="UnhandledError" Nov 4 23:23:28.613302 containerd[1974]: time="2025-11-04T23:23:28.612332821Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\"" Nov 4 23:23:28.613674 kubelet[3304]: E1104 23:23:28.613604 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-f66b9548c-6sxnc" podUID="3262dea2-8952-4d22-82d3-50fc85d38fcd" Nov 4 23:23:28.900414 containerd[1974]: time="2025-11-04T23:23:28.899687366Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:23:28.902062 containerd[1974]: time="2025-11-04T23:23:28.901949618Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" Nov 4 23:23:28.902154 containerd[1974]: time="2025-11-04T23:23:28.901950242Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/kube-controllers:v3.30.4: active requests=0, bytes read=85" Nov 4 23:23:28.902452 kubelet[3304]: E1104 23:23:28.902369 3304 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" image="ghcr.io/flatcar/calico/kube-controllers:v3.30.4" Nov 4 23:23:28.902571 kubelet[3304]: E1104 23:23:28.902463 3304 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" image="ghcr.io/flatcar/calico/kube-controllers:v3.30.4" Nov 4 23:23:28.902749 kubelet[3304]: E1104 23:23:28.902655 3304 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:calico-kube-controllers,Image:ghcr.io/flatcar/calico/kube-controllers:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:KUBE_CONTROLLERS_CONFIG_NAME,Value:default,ValueFrom:nil,},EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:ENABLED_CONTROLLERS,Value:node,loadbalancer,ValueFrom:nil,},EnvVar{Name:DISABLE_KUBE_CONTROLLERS_CONFIG_API,Value:false,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:CA_CRT_PATH,Value:/etc/pki/tls/certs/tigera-ca-bundle.crt,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:tigera-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:tigera-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/cert.pem,SubPath:ca-bundle.crt,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-g8glv,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/usr/bin/check-status -l],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:10,TimeoutSeconds:10,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:6,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/usr/bin/check-status -r],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:10,PeriodSeconds:30,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*999,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-kube-controllers-77c845d5cc-h2d4p_calico-system(4d28b7f3-4e9e-4cbc-92fc-da554118a9c3): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" logger="UnhandledError" Nov 4 23:23:28.903972 kubelet[3304]: E1104 23:23:28.903891 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-kube-controllers\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found\"" pod="calico-system/calico-kube-controllers-77c845d5cc-h2d4p" podUID="4d28b7f3-4e9e-4cbc-92fc-da554118a9c3" Nov 4 23:23:33.489883 systemd[1]: cri-containerd-3f07c9bb0876f1574579301a8d2dbfb0382fd73319b582cd168309b81be5c0d1.scope: Deactivated successfully. Nov 4 23:23:33.491819 systemd[1]: cri-containerd-3f07c9bb0876f1574579301a8d2dbfb0382fd73319b582cd168309b81be5c0d1.scope: Consumed 6.097s CPU time, 59.6M memory peak. Nov 4 23:23:33.500619 containerd[1974]: time="2025-11-04T23:23:33.500511269Z" level=info msg="received exit event container_id:\"3f07c9bb0876f1574579301a8d2dbfb0382fd73319b582cd168309b81be5c0d1\" id:\"3f07c9bb0876f1574579301a8d2dbfb0382fd73319b582cd168309b81be5c0d1\" pid:3109 exit_status:1 exited_at:{seconds:1762298613 nanos:499431749}" Nov 4 23:23:33.504063 containerd[1974]: time="2025-11-04T23:23:33.502445585Z" level=info msg="TaskExit event in podsandbox handler container_id:\"3f07c9bb0876f1574579301a8d2dbfb0382fd73319b582cd168309b81be5c0d1\" id:\"3f07c9bb0876f1574579301a8d2dbfb0382fd73319b582cd168309b81be5c0d1\" pid:3109 exit_status:1 exited_at:{seconds:1762298613 nanos:499431749}" Nov 4 23:23:33.505371 systemd[1]: cri-containerd-b46c190b06fdfb1fb313b7fa7f5aadb00806914bd17552420c40ebc5550f241d.scope: Deactivated successfully. Nov 4 23:23:33.506484 systemd[1]: cri-containerd-b46c190b06fdfb1fb313b7fa7f5aadb00806914bd17552420c40ebc5550f241d.scope: Consumed 28.835s CPU time, 101.8M memory peak. Nov 4 23:23:33.515702 containerd[1974]: time="2025-11-04T23:23:33.515484437Z" level=info msg="received exit event container_id:\"b46c190b06fdfb1fb313b7fa7f5aadb00806914bd17552420c40ebc5550f241d\" id:\"b46c190b06fdfb1fb313b7fa7f5aadb00806914bd17552420c40ebc5550f241d\" pid:3815 exit_status:1 exited_at:{seconds:1762298613 nanos:514505153}" Nov 4 23:23:33.515702 containerd[1974]: time="2025-11-04T23:23:33.515598629Z" level=info msg="TaskExit event in podsandbox handler container_id:\"b46c190b06fdfb1fb313b7fa7f5aadb00806914bd17552420c40ebc5550f241d\" id:\"b46c190b06fdfb1fb313b7fa7f5aadb00806914bd17552420c40ebc5550f241d\" pid:3815 exit_status:1 exited_at:{seconds:1762298613 nanos:514505153}" Nov 4 23:23:33.570285 kubelet[3304]: E1104 23:23:33.570172 3304 controller.go:195] "Failed to update lease" err="Put \"https://172.31.23.127:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-172-31-23-127?timeout=10s\": context deadline exceeded" Nov 4 23:23:33.573500 systemd[1]: run-containerd-io.containerd.runtime.v2.task-k8s.io-3f07c9bb0876f1574579301a8d2dbfb0382fd73319b582cd168309b81be5c0d1-rootfs.mount: Deactivated successfully. Nov 4 23:23:33.590121 systemd[1]: run-containerd-io.containerd.runtime.v2.task-k8s.io-b46c190b06fdfb1fb313b7fa7f5aadb00806914bd17552420c40ebc5550f241d-rootfs.mount: Deactivated successfully. Nov 4 23:23:34.200709 kubelet[3304]: I1104 23:23:34.200666 3304 scope.go:117] "RemoveContainer" containerID="b46c190b06fdfb1fb313b7fa7f5aadb00806914bd17552420c40ebc5550f241d" Nov 4 23:23:34.204057 containerd[1974]: time="2025-11-04T23:23:34.204002056Z" level=info msg="CreateContainer within sandbox \"b70db2ee5836c3171f7a5f6644dfdf61e380ef8c4027532ac02c164f65c66c57\" for container &ContainerMetadata{Name:tigera-operator,Attempt:1,}" Nov 4 23:23:34.206802 kubelet[3304]: I1104 23:23:34.206753 3304 scope.go:117] "RemoveContainer" containerID="3f07c9bb0876f1574579301a8d2dbfb0382fd73319b582cd168309b81be5c0d1" Nov 4 23:23:34.228184 containerd[1974]: time="2025-11-04T23:23:34.228109996Z" level=info msg="Container 4f208e1ec9c94e18ea704cb13a12af69af15e2eda993389f5c08f52fa68a37d2: CDI devices from CRI Config.CDIDevices: []" Nov 4 23:23:34.236430 containerd[1974]: time="2025-11-04T23:23:34.236299228Z" level=info msg="CreateContainer within sandbox \"6f1223eceeaf1fe9251c76aeba32215c7dc98d660af778decbf0a62bffb76638\" for container &ContainerMetadata{Name:kube-controller-manager,Attempt:1,}" Nov 4 23:23:34.258575 containerd[1974]: time="2025-11-04T23:23:34.258497477Z" level=info msg="CreateContainer within sandbox \"b70db2ee5836c3171f7a5f6644dfdf61e380ef8c4027532ac02c164f65c66c57\" for &ContainerMetadata{Name:tigera-operator,Attempt:1,} returns container id \"4f208e1ec9c94e18ea704cb13a12af69af15e2eda993389f5c08f52fa68a37d2\"" Nov 4 23:23:34.261646 containerd[1974]: time="2025-11-04T23:23:34.261596705Z" level=info msg="StartContainer for \"4f208e1ec9c94e18ea704cb13a12af69af15e2eda993389f5c08f52fa68a37d2\"" Nov 4 23:23:34.268711 containerd[1974]: time="2025-11-04T23:23:34.268272173Z" level=info msg="Container c732959dd9ba9848fd3566d1a634b4fc325d0c1c8e1b8cec5238518d24c8d664: CDI devices from CRI Config.CDIDevices: []" Nov 4 23:23:34.272074 containerd[1974]: time="2025-11-04T23:23:34.271982369Z" level=info msg="connecting to shim 4f208e1ec9c94e18ea704cb13a12af69af15e2eda993389f5c08f52fa68a37d2" address="unix:///run/containerd/s/18eff8890ab0976dacbe3d54ba2558b962e3490061c4389fd2328a421b2ab7b7" protocol=ttrpc version=3 Nov 4 23:23:34.308548 containerd[1974]: time="2025-11-04T23:23:34.308476685Z" level=info msg="CreateContainer within sandbox \"6f1223eceeaf1fe9251c76aeba32215c7dc98d660af778decbf0a62bffb76638\" for &ContainerMetadata{Name:kube-controller-manager,Attempt:1,} returns container id \"c732959dd9ba9848fd3566d1a634b4fc325d0c1c8e1b8cec5238518d24c8d664\"" Nov 4 23:23:34.311801 containerd[1974]: time="2025-11-04T23:23:34.311483633Z" level=info msg="StartContainer for \"c732959dd9ba9848fd3566d1a634b4fc325d0c1c8e1b8cec5238518d24c8d664\"" Nov 4 23:23:34.321219 containerd[1974]: time="2025-11-04T23:23:34.321099473Z" level=info msg="connecting to shim c732959dd9ba9848fd3566d1a634b4fc325d0c1c8e1b8cec5238518d24c8d664" address="unix:///run/containerd/s/fbec4111710e12d8a751078ee2e8293de531deaf9a7d45e962a60c097c5069b1" protocol=ttrpc version=3 Nov 4 23:23:34.325538 systemd[1]: Started cri-containerd-4f208e1ec9c94e18ea704cb13a12af69af15e2eda993389f5c08f52fa68a37d2.scope - libcontainer container 4f208e1ec9c94e18ea704cb13a12af69af15e2eda993389f5c08f52fa68a37d2. Nov 4 23:23:34.365194 systemd[1]: Started cri-containerd-c732959dd9ba9848fd3566d1a634b4fc325d0c1c8e1b8cec5238518d24c8d664.scope - libcontainer container c732959dd9ba9848fd3566d1a634b4fc325d0c1c8e1b8cec5238518d24c8d664. Nov 4 23:23:34.444686 containerd[1974]: time="2025-11-04T23:23:34.444466734Z" level=info msg="StartContainer for \"4f208e1ec9c94e18ea704cb13a12af69af15e2eda993389f5c08f52fa68a37d2\" returns successfully" Nov 4 23:23:34.498965 containerd[1974]: time="2025-11-04T23:23:34.498725646Z" level=info msg="StartContainer for \"c732959dd9ba9848fd3566d1a634b4fc325d0c1c8e1b8cec5238518d24c8d664\" returns successfully" Nov 4 23:23:36.300411 containerd[1974]: time="2025-11-04T23:23:36.300214879Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\"" Nov 4 23:23:36.586119 containerd[1974]: time="2025-11-04T23:23:36.585858548Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Nov 4 23:23:36.588656 containerd[1974]: time="2025-11-04T23:23:36.588545720Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" Nov 4 23:23:36.588988 containerd[1974]: time="2025-11-04T23:23:36.588621176Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/apiserver:v3.30.4: active requests=0, bytes read=77" Nov 4 23:23:36.589372 kubelet[3304]: E1104 23:23:36.589304 3304 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 4 23:23:36.590234 kubelet[3304]: E1104 23:23:36.589702 3304 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Nov 4 23:23:36.590545 kubelet[3304]: E1104 23:23:36.590426 3304 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:calico-apiserver,Image:ghcr.io/flatcar/calico/apiserver:v3.30.4,Command:[],Args:[--secure-port=5443 --tls-private-key-file=/calico-apiserver-certs/tls.key --tls-cert-file=/calico-apiserver-certs/tls.crt],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:LOG_LEVEL,Value:info,ValueFrom:nil,},EnvVar{Name:MULTI_INTERFACE_MODE,Value:none,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:calico-apiserver-certs,ReadOnly:true,MountPath:/calico-apiserver-certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-lhlrj,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 5443 },Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-apiserver-f66b9548c-ghbgm_calico-apiserver(a2dd6680-1f53-4788-9ae9-bffdb1850825): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" logger="UnhandledError" Nov 4 23:23:36.591729 kubelet[3304]: E1104 23:23:36.591678 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-f66b9548c-ghbgm" podUID="a2dd6680-1f53-4788-9ae9-bffdb1850825" Nov 4 23:23:38.301484 kubelet[3304]: E1104 23:23:38.301199 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"goldmane\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found\"" pod="calico-system/goldmane-666569f655-sfktq" podUID="f026c0ae-4dbf-4901-893b-d3b577723fff" Nov 4 23:23:38.377530 systemd[1]: cri-containerd-21315192975cfd49a4b1972bd5a911b6c8de018b4bcfdec5d3e5806f0c04f8a0.scope: Deactivated successfully. Nov 4 23:23:38.379529 systemd[1]: cri-containerd-21315192975cfd49a4b1972bd5a911b6c8de018b4bcfdec5d3e5806f0c04f8a0.scope: Consumed 4.055s CPU time, 19.9M memory peak. Nov 4 23:23:38.387804 containerd[1974]: time="2025-11-04T23:23:38.387609705Z" level=info msg="received exit event container_id:\"21315192975cfd49a4b1972bd5a911b6c8de018b4bcfdec5d3e5806f0c04f8a0\" id:\"21315192975cfd49a4b1972bd5a911b6c8de018b4bcfdec5d3e5806f0c04f8a0\" pid:3148 exit_status:1 exited_at:{seconds:1762298618 nanos:387171633}" Nov 4 23:23:38.391624 containerd[1974]: time="2025-11-04T23:23:38.391561125Z" level=info msg="TaskExit event in podsandbox handler container_id:\"21315192975cfd49a4b1972bd5a911b6c8de018b4bcfdec5d3e5806f0c04f8a0\" id:\"21315192975cfd49a4b1972bd5a911b6c8de018b4bcfdec5d3e5806f0c04f8a0\" pid:3148 exit_status:1 exited_at:{seconds:1762298618 nanos:387171633}" Nov 4 23:23:38.453536 systemd[1]: run-containerd-io.containerd.runtime.v2.task-k8s.io-21315192975cfd49a4b1972bd5a911b6c8de018b4bcfdec5d3e5806f0c04f8a0-rootfs.mount: Deactivated successfully. Nov 4 23:23:39.237945 kubelet[3304]: I1104 23:23:39.237871 3304 scope.go:117] "RemoveContainer" containerID="21315192975cfd49a4b1972bd5a911b6c8de018b4bcfdec5d3e5806f0c04f8a0" Nov 4 23:23:39.242454 containerd[1974]: time="2025-11-04T23:23:39.242363529Z" level=info msg="CreateContainer within sandbox \"7b37d37c1babb9e3d5663a2a1b9ce1f1b05c095ce0372e75683c631c83c87fa1\" for container &ContainerMetadata{Name:kube-scheduler,Attempt:1,}" Nov 4 23:23:39.261012 containerd[1974]: time="2025-11-04T23:23:39.259024677Z" level=info msg="Container 094269d1171e22e67ee5482f06cff7f6a1fe0cacdcc96a33f0c7c3b853350d57: CDI devices from CRI Config.CDIDevices: []" Nov 4 23:23:39.279859 containerd[1974]: time="2025-11-04T23:23:39.279726250Z" level=info msg="CreateContainer within sandbox \"7b37d37c1babb9e3d5663a2a1b9ce1f1b05c095ce0372e75683c631c83c87fa1\" for &ContainerMetadata{Name:kube-scheduler,Attempt:1,} returns container id \"094269d1171e22e67ee5482f06cff7f6a1fe0cacdcc96a33f0c7c3b853350d57\"" Nov 4 23:23:39.280784 containerd[1974]: time="2025-11-04T23:23:39.280731598Z" level=info msg="StartContainer for \"094269d1171e22e67ee5482f06cff7f6a1fe0cacdcc96a33f0c7c3b853350d57\"" Nov 4 23:23:39.282809 containerd[1974]: time="2025-11-04T23:23:39.282749338Z" level=info msg="connecting to shim 094269d1171e22e67ee5482f06cff7f6a1fe0cacdcc96a33f0c7c3b853350d57" address="unix:///run/containerd/s/718f28a2b08cb38397891dc2abd529178c38c9b13d7b1659f5f06019eea3dfa9" protocol=ttrpc version=3 Nov 4 23:23:39.303033 kubelet[3304]: E1104 23:23:39.302683 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"calico-csi\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ghcr.io/flatcar/calico/csi:v3.30.4: not found\", failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found\"]" pod="calico-system/csi-node-driver-n5cdd" podUID="024e93aa-74ad-4ec2-b309-ed5d7023cfd9" Nov 4 23:23:39.323258 systemd[1]: Started cri-containerd-094269d1171e22e67ee5482f06cff7f6a1fe0cacdcc96a33f0c7c3b853350d57.scope - libcontainer container 094269d1171e22e67ee5482f06cff7f6a1fe0cacdcc96a33f0c7c3b853350d57. Nov 4 23:23:39.406430 containerd[1974]: time="2025-11-04T23:23:39.406363474Z" level=info msg="StartContainer for \"094269d1171e22e67ee5482f06cff7f6a1fe0cacdcc96a33f0c7c3b853350d57\" returns successfully" Nov 4 23:23:41.299330 kubelet[3304]: E1104 23:23:41.299262 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"whisker\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found\", failed to \"StartContainer\" for \"whisker-backend\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found\"]" pod="calico-system/whisker-7c85d6c7cb-dd4pw" podUID="cba52d39-d0ad-4c67-aaef-c5790877e8e6" Nov 4 23:23:42.300808 kubelet[3304]: E1104 23:23:42.300638 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-f66b9548c-6sxnc" podUID="3262dea2-8952-4d22-82d3-50fc85d38fcd" Nov 4 23:23:43.298585 kubelet[3304]: E1104 23:23:43.298435 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-kube-controllers\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found\"" pod="calico-system/calico-kube-controllers-77c845d5cc-h2d4p" podUID="4d28b7f3-4e9e-4cbc-92fc-da554118a9c3" Nov 4 23:23:43.573045 kubelet[3304]: E1104 23:23:43.572632 3304 controller.go:195] "Failed to update lease" err="Put \"https://172.31.23.127:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-172-31-23-127?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 4 23:23:45.928696 systemd[1]: cri-containerd-4f208e1ec9c94e18ea704cb13a12af69af15e2eda993389f5c08f52fa68a37d2.scope: Deactivated successfully. Nov 4 23:23:45.932709 containerd[1974]: time="2025-11-04T23:23:45.932506507Z" level=info msg="received exit event container_id:\"4f208e1ec9c94e18ea704cb13a12af69af15e2eda993389f5c08f52fa68a37d2\" id:\"4f208e1ec9c94e18ea704cb13a12af69af15e2eda993389f5c08f52fa68a37d2\" pid:5965 exit_status:1 exited_at:{seconds:1762298625 nanos:932155483}" Nov 4 23:23:45.934743 containerd[1974]: time="2025-11-04T23:23:45.934687351Z" level=info msg="TaskExit event in podsandbox handler container_id:\"4f208e1ec9c94e18ea704cb13a12af69af15e2eda993389f5c08f52fa68a37d2\" id:\"4f208e1ec9c94e18ea704cb13a12af69af15e2eda993389f5c08f52fa68a37d2\" pid:5965 exit_status:1 exited_at:{seconds:1762298625 nanos:932155483}" Nov 4 23:23:45.972474 systemd[1]: run-containerd-io.containerd.runtime.v2.task-k8s.io-4f208e1ec9c94e18ea704cb13a12af69af15e2eda993389f5c08f52fa68a37d2-rootfs.mount: Deactivated successfully. Nov 4 23:23:46.267890 kubelet[3304]: I1104 23:23:46.267758 3304 scope.go:117] "RemoveContainer" containerID="b46c190b06fdfb1fb313b7fa7f5aadb00806914bd17552420c40ebc5550f241d" Nov 4 23:23:46.270478 kubelet[3304]: I1104 23:23:46.270228 3304 scope.go:117] "RemoveContainer" containerID="4f208e1ec9c94e18ea704cb13a12af69af15e2eda993389f5c08f52fa68a37d2" Nov 4 23:23:46.271499 kubelet[3304]: E1104 23:23:46.271440 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"tigera-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=tigera-operator pod=tigera-operator-7dcd859c48-t7r6j_tigera-operator(0698d1a7-7eb3-44d6-af6a-98f5d0b39e9a)\"" pod="tigera-operator/tigera-operator-7dcd859c48-t7r6j" podUID="0698d1a7-7eb3-44d6-af6a-98f5d0b39e9a" Nov 4 23:23:46.273429 containerd[1974]: time="2025-11-04T23:23:46.273357160Z" level=info msg="RemoveContainer for \"b46c190b06fdfb1fb313b7fa7f5aadb00806914bd17552420c40ebc5550f241d\"" Nov 4 23:23:46.296164 containerd[1974]: time="2025-11-04T23:23:46.296086408Z" level=info msg="RemoveContainer for \"b46c190b06fdfb1fb313b7fa7f5aadb00806914bd17552420c40ebc5550f241d\" returns successfully" Nov 4 23:23:51.298476 kubelet[3304]: E1104 23:23:51.298407 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"goldmane\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found\"" pod="calico-system/goldmane-666569f655-sfktq" podUID="f026c0ae-4dbf-4901-893b-d3b577723fff" Nov 4 23:23:51.299326 kubelet[3304]: E1104 23:23:51.298755 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-f66b9548c-ghbgm" podUID="a2dd6680-1f53-4788-9ae9-bffdb1850825" Nov 4 23:23:53.298846 kubelet[3304]: E1104 23:23:53.298758 3304 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"whisker\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found\", failed to \"StartContainer\" for \"whisker-backend\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found\"]" pod="calico-system/whisker-7c85d6c7cb-dd4pw" podUID="cba52d39-d0ad-4c67-aaef-c5790877e8e6" Nov 4 23:23:53.573814 kubelet[3304]: E1104 23:23:53.573139 3304 controller.go:195] "Failed to update lease" err="Put \"https://172.31.23.127:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-172-31-23-127?timeout=10s\": context deadline exceeded"