Oct 28 04:39:04.262533 kernel: Booting Linux on physical CPU 0x0000000000 [0x410fd083] Oct 28 04:39:04.262578 kernel: Linux version 6.12.54-flatcar (build@pony-truck.infra.kinvolk.io) (aarch64-cros-linux-gnu-gcc (Gentoo Hardened 14.3.1_p20250801 p4) 14.3.1 20250801, GNU ld (Gentoo 2.45 p3) 2.45.0) #1 SMP PREEMPT Tue Oct 28 03:20:07 -00 2025 Oct 28 04:39:04.262603 kernel: KASLR disabled due to lack of seed Oct 28 04:39:04.262619 kernel: efi: EFI v2.7 by EDK II Oct 28 04:39:04.262635 kernel: efi: SMBIOS=0x7bed0000 SMBIOS 3.0=0x7beb0000 ACPI=0x786e0000 ACPI 2.0=0x786e0014 MEMATTR=0x7a731a98 MEMRESERVE=0x78557598 Oct 28 04:39:04.262650 kernel: secureboot: Secure boot disabled Oct 28 04:39:04.262668 kernel: ACPI: Early table checksum verification disabled Oct 28 04:39:04.262684 kernel: ACPI: RSDP 0x00000000786E0014 000024 (v02 AMAZON) Oct 28 04:39:04.262700 kernel: ACPI: XSDT 0x00000000786D00E8 000064 (v01 AMAZON AMZNFACP 00000001 01000013) Oct 28 04:39:04.262719 kernel: ACPI: FACP 0x00000000786B0000 000114 (v06 AMAZON AMZNFACP 00000001 AMZN 00000001) Oct 28 04:39:04.262736 kernel: ACPI: DSDT 0x0000000078640000 00159D (v02 AMAZON AMZNDSDT 00000001 INTL 20160527) Oct 28 04:39:04.262752 kernel: ACPI: FACS 0x0000000078630000 000040 Oct 28 04:39:04.262767 kernel: ACPI: APIC 0x00000000786C0000 000108 (v04 AMAZON AMZNAPIC 00000001 AMZN 00000001) Oct 28 04:39:04.262783 kernel: ACPI: SPCR 0x00000000786A0000 000050 (v02 AMAZON AMZNSPCR 00000001 AMZN 00000001) Oct 28 04:39:04.262806 kernel: ACPI: GTDT 0x0000000078690000 000060 (v02 AMAZON AMZNGTDT 00000001 AMZN 00000001) Oct 28 04:39:04.262823 kernel: ACPI: MCFG 0x0000000078680000 00003C (v02 AMAZON AMZNMCFG 00000001 AMZN 00000001) Oct 28 04:39:04.262841 kernel: ACPI: SLIT 0x0000000078670000 00002D (v01 AMAZON AMZNSLIT 00000001 AMZN 00000001) Oct 28 04:39:04.262857 kernel: ACPI: IORT 0x0000000078660000 000078 (v01 AMAZON AMZNIORT 00000001 AMZN 00000001) Oct 28 04:39:04.262875 kernel: ACPI: PPTT 0x0000000078650000 0000EC (v01 AMAZON AMZNPPTT 00000001 AMZN 00000001) Oct 28 04:39:04.262891 kernel: ACPI: SPCR: console: uart,mmio,0x90a0000,115200 Oct 28 04:39:04.262908 kernel: earlycon: uart0 at MMIO 0x00000000090a0000 (options '115200') Oct 28 04:39:04.262925 kernel: printk: legacy bootconsole [uart0] enabled Oct 28 04:39:04.262942 kernel: ACPI: Use ACPI SPCR as default console: No Oct 28 04:39:04.262958 kernel: NUMA: Faking a node at [mem 0x0000000040000000-0x00000004b5ffffff] Oct 28 04:39:04.262979 kernel: NODE_DATA(0) allocated [mem 0x4b584da00-0x4b5854fff] Oct 28 04:39:04.262996 kernel: Zone ranges: Oct 28 04:39:04.263013 kernel: DMA [mem 0x0000000040000000-0x00000000ffffffff] Oct 28 04:39:04.263030 kernel: DMA32 empty Oct 28 04:39:04.263046 kernel: Normal [mem 0x0000000100000000-0x00000004b5ffffff] Oct 28 04:39:04.263063 kernel: Device empty Oct 28 04:39:04.263079 kernel: Movable zone start for each node Oct 28 04:39:04.263096 kernel: Early memory node ranges Oct 28 04:39:04.263112 kernel: node 0: [mem 0x0000000040000000-0x000000007862ffff] Oct 28 04:39:04.263129 kernel: node 0: [mem 0x0000000078630000-0x000000007863ffff] Oct 28 04:39:04.263145 kernel: node 0: [mem 0x0000000078640000-0x00000000786effff] Oct 28 04:39:04.263188 kernel: node 0: [mem 0x00000000786f0000-0x000000007872ffff] Oct 28 04:39:04.263242 kernel: node 0: [mem 0x0000000078730000-0x000000007bbfffff] Oct 28 04:39:04.263260 kernel: node 0: [mem 0x000000007bc00000-0x000000007bfdffff] Oct 28 04:39:04.263277 kernel: node 0: [mem 0x000000007bfe0000-0x000000007fffffff] Oct 28 04:39:04.263295 kernel: node 0: [mem 0x0000000400000000-0x00000004b5ffffff] Oct 28 04:39:04.263319 kernel: Initmem setup node 0 [mem 0x0000000040000000-0x00000004b5ffffff] Oct 28 04:39:04.263341 kernel: On node 0, zone Normal: 8192 pages in unavailable ranges Oct 28 04:39:04.263359 kernel: cma: Reserved 16 MiB at 0x000000007f000000 on node -1 Oct 28 04:39:04.263377 kernel: psci: probing for conduit method from ACPI. Oct 28 04:39:04.263394 kernel: psci: PSCIv1.0 detected in firmware. Oct 28 04:39:04.263412 kernel: psci: Using standard PSCI v0.2 function IDs Oct 28 04:39:04.263429 kernel: psci: Trusted OS migration not required Oct 28 04:39:04.263447 kernel: psci: SMC Calling Convention v1.1 Oct 28 04:39:04.263466 kernel: smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000001) Oct 28 04:39:04.263483 kernel: percpu: Embedded 33 pages/cpu s98200 r8192 d28776 u135168 Oct 28 04:39:04.263505 kernel: pcpu-alloc: s98200 r8192 d28776 u135168 alloc=33*4096 Oct 28 04:39:04.263523 kernel: pcpu-alloc: [0] 0 [0] 1 Oct 28 04:39:04.263540 kernel: Detected PIPT I-cache on CPU0 Oct 28 04:39:04.263577 kernel: CPU features: detected: GIC system register CPU interface Oct 28 04:39:04.263599 kernel: CPU features: detected: Spectre-v2 Oct 28 04:39:04.263618 kernel: CPU features: detected: Spectre-v3a Oct 28 04:39:04.263637 kernel: CPU features: detected: Spectre-BHB Oct 28 04:39:04.263654 kernel: CPU features: detected: ARM erratum 1742098 Oct 28 04:39:04.263672 kernel: CPU features: detected: ARM errata 1165522, 1319367, or 1530923 Oct 28 04:39:04.263690 kernel: alternatives: applying boot alternatives Oct 28 04:39:04.263709 kernel: Kernel command line: BOOT_IMAGE=/flatcar/vmlinuz-a mount.usr=/dev/mapper/usr verity.usr=PARTUUID=7130c94a-213a-4e5a-8e26-6cce9662f132 rootflags=rw mount.usrflags=ro consoleblank=0 root=LABEL=ROOT console=tty1 console=ttyS0,115200n8 earlycon flatcar.first_boot=detected acpi=force flatcar.oem.id=ec2 modprobe.blacklist=xen_fbfront net.ifnames=0 nvme_core.io_timeout=4294967295 verity.usrhash=1f35b74acbf2082d1ccaf19af5ba856ed6811e7fe1caa7e6e44e2aaa205180aa Oct 28 04:39:04.264219 kernel: Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) Oct 28 04:39:04.264259 kernel: Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) Oct 28 04:39:04.264277 kernel: Fallback order for Node 0: 0 Oct 28 04:39:04.264295 kernel: Built 1 zonelists, mobility grouping on. Total pages: 1007616 Oct 28 04:39:04.264313 kernel: Policy zone: Normal Oct 28 04:39:04.264330 kernel: mem auto-init: stack:off, heap alloc:off, heap free:off Oct 28 04:39:04.264347 kernel: software IO TLB: area num 2. Oct 28 04:39:04.264365 kernel: software IO TLB: mapped [mem 0x000000006f800000-0x0000000073800000] (64MB) Oct 28 04:39:04.264382 kernel: SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=2, Nodes=1 Oct 28 04:39:04.264399 kernel: rcu: Preemptible hierarchical RCU implementation. Oct 28 04:39:04.264423 kernel: rcu: RCU event tracing is enabled. Oct 28 04:39:04.264441 kernel: rcu: RCU restricting CPUs from NR_CPUS=512 to nr_cpu_ids=2. Oct 28 04:39:04.264459 kernel: Trampoline variant of Tasks RCU enabled. Oct 28 04:39:04.264477 kernel: Tracing variant of Tasks RCU enabled. Oct 28 04:39:04.264495 kernel: rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. Oct 28 04:39:04.264512 kernel: rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=2 Oct 28 04:39:04.264530 kernel: RCU Tasks: Setting shift to 1 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=2. Oct 28 04:39:04.264547 kernel: RCU Tasks Trace: Setting shift to 1 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=2. Oct 28 04:39:04.264565 kernel: NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 Oct 28 04:39:04.264582 kernel: GICv3: 96 SPIs implemented Oct 28 04:39:04.264599 kernel: GICv3: 0 Extended SPIs implemented Oct 28 04:39:04.264621 kernel: Root IRQ handler: gic_handle_irq Oct 28 04:39:04.264638 kernel: GICv3: GICv3 features: 16 PPIs Oct 28 04:39:04.264655 kernel: GICv3: GICD_CTRL.DS=1, SCR_EL3.FIQ=0 Oct 28 04:39:04.264672 kernel: GICv3: CPU0: found redistributor 0 region 0:0x0000000010200000 Oct 28 04:39:04.264690 kernel: ITS [mem 0x10080000-0x1009ffff] Oct 28 04:39:04.264707 kernel: ITS@0x0000000010080000: allocated 8192 Devices @4000f0000 (indirect, esz 8, psz 64K, shr 1) Oct 28 04:39:04.264738 kernel: ITS@0x0000000010080000: allocated 8192 Interrupt Collections @400100000 (flat, esz 8, psz 64K, shr 1) Oct 28 04:39:04.264758 kernel: GICv3: using LPI property table @0x0000000400110000 Oct 28 04:39:04.264775 kernel: ITS: Using hypervisor restricted LPI range [128] Oct 28 04:39:04.264793 kernel: GICv3: CPU0: using allocated LPI pending table @0x0000000400120000 Oct 28 04:39:04.264811 kernel: rcu: srcu_init: Setting srcu_struct sizes based on contention. Oct 28 04:39:04.264833 kernel: arch_timer: cp15 timer(s) running at 83.33MHz (virt). Oct 28 04:39:04.264851 kernel: clocksource: arch_sys_counter: mask: 0x1ffffffffffffff max_cycles: 0x13381ebeec, max_idle_ns: 440795203145 ns Oct 28 04:39:04.264869 kernel: sched_clock: 57 bits at 83MHz, resolution 12ns, wraps every 4398046511100ns Oct 28 04:39:04.264887 kernel: Console: colour dummy device 80x25 Oct 28 04:39:04.264905 kernel: printk: legacy console [tty1] enabled Oct 28 04:39:04.264924 kernel: ACPI: Core revision 20240827 Oct 28 04:39:04.264942 kernel: Calibrating delay loop (skipped), value calculated using timer frequency.. 166.66 BogoMIPS (lpj=83333) Oct 28 04:39:04.264960 kernel: pid_max: default: 32768 minimum: 301 Oct 28 04:39:04.264982 kernel: LSM: initializing lsm=lockdown,capability,landlock,selinux,ima Oct 28 04:39:04.265001 kernel: landlock: Up and running. Oct 28 04:39:04.265018 kernel: SELinux: Initializing. Oct 28 04:39:04.265036 kernel: Mount-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) Oct 28 04:39:04.265055 kernel: Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) Oct 28 04:39:04.265072 kernel: rcu: Hierarchical SRCU implementation. Oct 28 04:39:04.265091 kernel: rcu: Max phase no-delay instances is 400. Oct 28 04:39:04.265109 kernel: Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level Oct 28 04:39:04.265131 kernel: Remapping and enabling EFI services. Oct 28 04:39:04.265149 kernel: smp: Bringing up secondary CPUs ... Oct 28 04:39:04.265193 kernel: Detected PIPT I-cache on CPU1 Oct 28 04:39:04.265214 kernel: GICv3: CPU1: found redistributor 1 region 0:0x0000000010220000 Oct 28 04:39:04.265233 kernel: GICv3: CPU1: using allocated LPI pending table @0x0000000400130000 Oct 28 04:39:04.265252 kernel: CPU1: Booted secondary processor 0x0000000001 [0x410fd083] Oct 28 04:39:04.265270 kernel: smp: Brought up 1 node, 2 CPUs Oct 28 04:39:04.265293 kernel: SMP: Total of 2 processors activated. Oct 28 04:39:04.265321 kernel: CPU: All CPU(s) started at EL1 Oct 28 04:39:04.265356 kernel: CPU features: detected: 32-bit EL0 Support Oct 28 04:39:04.265379 kernel: CPU features: detected: 32-bit EL1 Support Oct 28 04:39:04.265398 kernel: CPU features: detected: CRC32 instructions Oct 28 04:39:04.265417 kernel: alternatives: applying system-wide alternatives Oct 28 04:39:04.265437 kernel: Memory: 3822956K/4030464K available (11136K kernel code, 2456K rwdata, 9084K rodata, 12992K init, 1038K bss, 186164K reserved, 16384K cma-reserved) Oct 28 04:39:04.265457 kernel: devtmpfs: initialized Oct 28 04:39:04.265480 kernel: clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns Oct 28 04:39:04.265499 kernel: futex hash table entries: 512 (order: 3, 32768 bytes, linear) Oct 28 04:39:04.265518 kernel: 23536 pages in range for non-PLT usage Oct 28 04:39:04.265536 kernel: 515056 pages in range for PLT usage Oct 28 04:39:04.265555 kernel: pinctrl core: initialized pinctrl subsystem Oct 28 04:39:04.265578 kernel: SMBIOS 3.0.0 present. Oct 28 04:39:04.265596 kernel: DMI: Amazon EC2 a1.large/, BIOS 1.0 11/1/2018 Oct 28 04:39:04.265615 kernel: DMI: Memory slots populated: 0/0 Oct 28 04:39:04.265634 kernel: NET: Registered PF_NETLINK/PF_ROUTE protocol family Oct 28 04:39:04.265653 kernel: DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations Oct 28 04:39:04.265672 kernel: DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations Oct 28 04:39:04.265691 kernel: DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations Oct 28 04:39:04.265714 kernel: audit: initializing netlink subsys (disabled) Oct 28 04:39:04.265733 kernel: audit: type=2000 audit(0.225:1): state=initialized audit_enabled=0 res=1 Oct 28 04:39:04.265752 kernel: thermal_sys: Registered thermal governor 'step_wise' Oct 28 04:39:04.265770 kernel: cpuidle: using governor menu Oct 28 04:39:04.265789 kernel: hw-breakpoint: found 6 breakpoint and 4 watchpoint registers. Oct 28 04:39:04.265808 kernel: ASID allocator initialised with 65536 entries Oct 28 04:39:04.265827 kernel: acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 Oct 28 04:39:04.265849 kernel: Serial: AMBA PL011 UART driver Oct 28 04:39:04.265868 kernel: HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages Oct 28 04:39:04.265887 kernel: HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page Oct 28 04:39:04.265906 kernel: HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages Oct 28 04:39:04.265925 kernel: HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page Oct 28 04:39:04.265943 kernel: HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages Oct 28 04:39:04.265962 kernel: HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page Oct 28 04:39:04.265985 kernel: HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages Oct 28 04:39:04.266004 kernel: HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page Oct 28 04:39:04.266023 kernel: ACPI: Added _OSI(Module Device) Oct 28 04:39:04.266042 kernel: ACPI: Added _OSI(Processor Device) Oct 28 04:39:04.266061 kernel: ACPI: Added _OSI(Processor Aggregator Device) Oct 28 04:39:04.266079 kernel: ACPI: 1 ACPI AML tables successfully acquired and loaded Oct 28 04:39:04.266098 kernel: ACPI: Interpreter enabled Oct 28 04:39:04.266120 kernel: ACPI: Using GIC for interrupt routing Oct 28 04:39:04.266139 kernel: ACPI: MCFG table detected, 1 entries Oct 28 04:39:04.266157 kernel: ACPI: CPU0 has been hot-added Oct 28 04:39:04.266195 kernel: ACPI: CPU1 has been hot-added Oct 28 04:39:04.266215 kernel: ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-0f]) Oct 28 04:39:04.267250 kernel: acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] Oct 28 04:39:04.267521 kernel: acpi PNP0A08:00: _OSC: platform does not support [LTR] Oct 28 04:39:04.267791 kernel: acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME AER PCIeCapability] Oct 28 04:39:04.269364 kernel: acpi PNP0A08:00: ECAM area [mem 0x20000000-0x20ffffff] reserved by PNP0C02:00 Oct 28 04:39:04.269666 kernel: acpi PNP0A08:00: ECAM at [mem 0x20000000-0x20ffffff] for [bus 00-0f] Oct 28 04:39:04.269693 kernel: ACPI: Remapped I/O 0x000000001fff0000 to [io 0x0000-0xffff window] Oct 28 04:39:04.269713 kernel: acpiphp: Slot [1] registered Oct 28 04:39:04.269732 kernel: acpiphp: Slot [2] registered Oct 28 04:39:04.269761 kernel: acpiphp: Slot [3] registered Oct 28 04:39:04.269780 kernel: acpiphp: Slot [4] registered Oct 28 04:39:04.269799 kernel: acpiphp: Slot [5] registered Oct 28 04:39:04.269818 kernel: acpiphp: Slot [6] registered Oct 28 04:39:04.269837 kernel: acpiphp: Slot [7] registered Oct 28 04:39:04.269856 kernel: acpiphp: Slot [8] registered Oct 28 04:39:04.269874 kernel: acpiphp: Slot [9] registered Oct 28 04:39:04.269893 kernel: acpiphp: Slot [10] registered Oct 28 04:39:04.269916 kernel: acpiphp: Slot [11] registered Oct 28 04:39:04.269934 kernel: acpiphp: Slot [12] registered Oct 28 04:39:04.269953 kernel: acpiphp: Slot [13] registered Oct 28 04:39:04.269972 kernel: acpiphp: Slot [14] registered Oct 28 04:39:04.269991 kernel: acpiphp: Slot [15] registered Oct 28 04:39:04.270009 kernel: acpiphp: Slot [16] registered Oct 28 04:39:04.270028 kernel: acpiphp: Slot [17] registered Oct 28 04:39:04.270052 kernel: acpiphp: Slot [18] registered Oct 28 04:39:04.270070 kernel: acpiphp: Slot [19] registered Oct 28 04:39:04.270089 kernel: acpiphp: Slot [20] registered Oct 28 04:39:04.270108 kernel: acpiphp: Slot [21] registered Oct 28 04:39:04.270126 kernel: acpiphp: Slot [22] registered Oct 28 04:39:04.270145 kernel: acpiphp: Slot [23] registered Oct 28 04:39:04.270188 kernel: acpiphp: Slot [24] registered Oct 28 04:39:04.270241 kernel: acpiphp: Slot [25] registered Oct 28 04:39:04.270267 kernel: acpiphp: Slot [26] registered Oct 28 04:39:04.270286 kernel: acpiphp: Slot [27] registered Oct 28 04:39:04.270305 kernel: acpiphp: Slot [28] registered Oct 28 04:39:04.270324 kernel: acpiphp: Slot [29] registered Oct 28 04:39:04.270343 kernel: acpiphp: Slot [30] registered Oct 28 04:39:04.276202 kernel: acpiphp: Slot [31] registered Oct 28 04:39:04.276259 kernel: PCI host bridge to bus 0000:00 Oct 28 04:39:04.276575 kernel: pci_bus 0000:00: root bus resource [mem 0x80000000-0xffffffff window] Oct 28 04:39:04.276808 kernel: pci_bus 0000:00: root bus resource [io 0x0000-0xffff window] Oct 28 04:39:04.277034 kernel: pci_bus 0000:00: root bus resource [mem 0x400000000000-0x407fffffffff window] Oct 28 04:39:04.277411 kernel: pci_bus 0000:00: root bus resource [bus 00-0f] Oct 28 04:39:04.277706 kernel: pci 0000:00:00.0: [1d0f:0200] type 00 class 0x060000 conventional PCI endpoint Oct 28 04:39:04.277983 kernel: pci 0000:00:01.0: [1d0f:8250] type 00 class 0x070003 conventional PCI endpoint Oct 28 04:39:04.278279 kernel: pci 0000:00:01.0: BAR 0 [mem 0x80118000-0x80118fff] Oct 28 04:39:04.278546 kernel: pci 0000:00:04.0: [1d0f:8061] type 00 class 0x010802 PCIe Root Complex Integrated Endpoint Oct 28 04:39:04.278827 kernel: pci 0000:00:04.0: BAR 0 [mem 0x80114000-0x80117fff] Oct 28 04:39:04.279097 kernel: pci 0000:00:04.0: PME# supported from D0 D1 D2 D3hot D3cold Oct 28 04:39:04.279467 kernel: pci 0000:00:05.0: [1d0f:ec20] type 00 class 0x020000 PCIe Root Complex Integrated Endpoint Oct 28 04:39:04.279750 kernel: pci 0000:00:05.0: BAR 0 [mem 0x80110000-0x80113fff] Oct 28 04:39:04.280019 kernel: pci 0000:00:05.0: BAR 2 [mem 0x80000000-0x800fffff pref] Oct 28 04:39:04.280350 kernel: pci 0000:00:05.0: BAR 4 [mem 0x80100000-0x8010ffff] Oct 28 04:39:04.285414 kernel: pci 0000:00:05.0: PME# supported from D0 D1 D2 D3hot D3cold Oct 28 04:39:04.285680 kernel: pci 0000:00:05.0: BAR 2 [mem 0x80000000-0x800fffff pref]: assigned Oct 28 04:39:04.285938 kernel: pci 0000:00:05.0: BAR 4 [mem 0x80100000-0x8010ffff]: assigned Oct 28 04:39:04.286213 kernel: pci 0000:00:04.0: BAR 0 [mem 0x80110000-0x80113fff]: assigned Oct 28 04:39:04.286465 kernel: pci 0000:00:05.0: BAR 0 [mem 0x80114000-0x80117fff]: assigned Oct 28 04:39:04.286728 kernel: pci 0000:00:01.0: BAR 0 [mem 0x80118000-0x80118fff]: assigned Oct 28 04:39:04.286957 kernel: pci_bus 0000:00: resource 4 [mem 0x80000000-0xffffffff window] Oct 28 04:39:04.287218 kernel: pci_bus 0000:00: resource 5 [io 0x0000-0xffff window] Oct 28 04:39:04.287453 kernel: pci_bus 0000:00: resource 6 [mem 0x400000000000-0x407fffffffff window] Oct 28 04:39:04.287479 kernel: ACPI: PCI: Interrupt link GSI0 configured for IRQ 35 Oct 28 04:39:04.287499 kernel: ACPI: PCI: Interrupt link GSI1 configured for IRQ 36 Oct 28 04:39:04.287518 kernel: ACPI: PCI: Interrupt link GSI2 configured for IRQ 37 Oct 28 04:39:04.287537 kernel: ACPI: PCI: Interrupt link GSI3 configured for IRQ 38 Oct 28 04:39:04.287555 kernel: iommu: Default domain type: Translated Oct 28 04:39:04.287574 kernel: iommu: DMA domain TLB invalidation policy: strict mode Oct 28 04:39:04.287598 kernel: efivars: Registered efivars operations Oct 28 04:39:04.287617 kernel: vgaarb: loaded Oct 28 04:39:04.287635 kernel: clocksource: Switched to clocksource arch_sys_counter Oct 28 04:39:04.287654 kernel: VFS: Disk quotas dquot_6.6.0 Oct 28 04:39:04.287673 kernel: VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) Oct 28 04:39:04.287691 kernel: pnp: PnP ACPI init Oct 28 04:39:04.287951 kernel: system 00:00: [mem 0x20000000-0x2fffffff] could not be reserved Oct 28 04:39:04.287983 kernel: pnp: PnP ACPI: found 1 devices Oct 28 04:39:04.288002 kernel: NET: Registered PF_INET protocol family Oct 28 04:39:04.288021 kernel: IP idents hash table entries: 65536 (order: 7, 524288 bytes, linear) Oct 28 04:39:04.288040 kernel: tcp_listen_portaddr_hash hash table entries: 2048 (order: 3, 32768 bytes, linear) Oct 28 04:39:04.288060 kernel: Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) Oct 28 04:39:04.288079 kernel: TCP established hash table entries: 32768 (order: 6, 262144 bytes, linear) Oct 28 04:39:04.288098 kernel: TCP bind hash table entries: 32768 (order: 8, 1048576 bytes, linear) Oct 28 04:39:04.288121 kernel: TCP: Hash tables configured (established 32768 bind 32768) Oct 28 04:39:04.288140 kernel: UDP hash table entries: 2048 (order: 4, 65536 bytes, linear) Oct 28 04:39:04.288175 kernel: UDP-Lite hash table entries: 2048 (order: 4, 65536 bytes, linear) Oct 28 04:39:04.288201 kernel: NET: Registered PF_UNIX/PF_LOCAL protocol family Oct 28 04:39:04.288221 kernel: PCI: CLS 0 bytes, default 64 Oct 28 04:39:04.288262 kernel: kvm [1]: HYP mode not available Oct 28 04:39:04.288281 kernel: Initialise system trusted keyrings Oct 28 04:39:04.288306 kernel: workingset: timestamp_bits=39 max_order=20 bucket_order=0 Oct 28 04:39:04.288417 kernel: Key type asymmetric registered Oct 28 04:39:04.288491 kernel: Asymmetric key parser 'x509' registered Oct 28 04:39:04.288514 kernel: Block layer SCSI generic (bsg) driver version 0.4 loaded (major 249) Oct 28 04:39:04.288535 kernel: io scheduler mq-deadline registered Oct 28 04:39:04.288555 kernel: io scheduler kyber registered Oct 28 04:39:04.288574 kernel: io scheduler bfq registered Oct 28 04:39:04.288886 kernel: pl061_gpio ARMH0061:00: PL061 GPIO chip registered Oct 28 04:39:04.288916 kernel: input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 Oct 28 04:39:04.288936 kernel: ACPI: button: Power Button [PWRB] Oct 28 04:39:04.288956 kernel: input: Sleep Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0E:00/input/input1 Oct 28 04:39:04.288975 kernel: ACPI: button: Sleep Button [SLPB] Oct 28 04:39:04.288994 kernel: Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled Oct 28 04:39:04.289019 kernel: ACPI: \_SB_.PCI0.GSI2: Enabled at IRQ 37 Oct 28 04:39:04.289311 kernel: serial 0000:00:01.0: enabling device (0010 -> 0012) Oct 28 04:39:04.289339 kernel: printk: legacy console [ttyS0] disabled Oct 28 04:39:04.289359 kernel: 0000:00:01.0: ttyS0 at MMIO 0x80118000 (irq = 14, base_baud = 115200) is a 16550A Oct 28 04:39:04.289378 kernel: printk: legacy console [ttyS0] enabled Oct 28 04:39:04.289397 kernel: printk: legacy bootconsole [uart0] disabled Oct 28 04:39:04.289416 kernel: thunder_xcv, ver 1.0 Oct 28 04:39:04.289440 kernel: thunder_bgx, ver 1.0 Oct 28 04:39:04.289459 kernel: nicpf, ver 1.0 Oct 28 04:39:04.289478 kernel: nicvf, ver 1.0 Oct 28 04:39:04.289754 kernel: rtc-efi rtc-efi.0: registered as rtc0 Oct 28 04:39:04.289992 kernel: rtc-efi rtc-efi.0: setting system clock to 2025-10-28T04:39:00 UTC (1761626340) Oct 28 04:39:04.290018 kernel: hid: raw HID events driver (C) Jiri Kosina Oct 28 04:39:04.290038 kernel: hw perfevents: enabled with armv8_pmuv3_0 PMU driver, 3 (0,80000003) counters available Oct 28 04:39:04.290062 kernel: watchdog: NMI not fully supported Oct 28 04:39:04.290081 kernel: NET: Registered PF_INET6 protocol family Oct 28 04:39:04.290100 kernel: watchdog: Hard watchdog permanently disabled Oct 28 04:39:04.290119 kernel: Segment Routing with IPv6 Oct 28 04:39:04.290137 kernel: In-situ OAM (IOAM) with IPv6 Oct 28 04:39:04.290156 kernel: NET: Registered PF_PACKET protocol family Oct 28 04:39:04.290218 kernel: Key type dns_resolver registered Oct 28 04:39:04.290243 kernel: registered taskstats version 1 Oct 28 04:39:04.290262 kernel: Loading compiled-in X.509 certificates Oct 28 04:39:04.290281 kernel: Loaded X.509 cert 'Kinvolk GmbH: Module signing key for 6.12.54-flatcar: 26b98883ef58589f904405bf68dab5f3eec1fa06' Oct 28 04:39:04.290300 kernel: Demotion targets for Node 0: null Oct 28 04:39:04.290318 kernel: Key type .fscrypt registered Oct 28 04:39:04.290337 kernel: Key type fscrypt-provisioning registered Oct 28 04:39:04.290355 kernel: ima: No TPM chip found, activating TPM-bypass! Oct 28 04:39:04.290378 kernel: ima: Allocated hash algorithm: sha1 Oct 28 04:39:04.290398 kernel: ima: No architecture policies found Oct 28 04:39:04.290417 kernel: alg: No test for fips(ansi_cprng) (fips_ansi_cprng) Oct 28 04:39:04.290436 kernel: clk: Disabling unused clocks Oct 28 04:39:04.290454 kernel: PM: genpd: Disabling unused power domains Oct 28 04:39:04.290473 kernel: Freeing unused kernel memory: 12992K Oct 28 04:39:04.291755 kernel: Run /init as init process Oct 28 04:39:04.291799 kernel: with arguments: Oct 28 04:39:04.291818 kernel: /init Oct 28 04:39:04.291837 kernel: with environment: Oct 28 04:39:04.291855 kernel: HOME=/ Oct 28 04:39:04.291874 kernel: TERM=linux Oct 28 04:39:04.291893 kernel: ACPI: \_SB_.PCI0.GSI0: Enabled at IRQ 35 Oct 28 04:39:04.292130 kernel: nvme nvme0: pci function 0000:00:04.0 Oct 28 04:39:04.292453 kernel: nvme nvme0: 2/0/0 default/read/poll queues Oct 28 04:39:04.292486 kernel: GPT:Primary header thinks Alt. header is not at the end of the disk. Oct 28 04:39:04.292506 kernel: GPT:25804799 != 33554431 Oct 28 04:39:04.292525 kernel: GPT:Alternate GPT header not at the end of the disk. Oct 28 04:39:04.292543 kernel: GPT:25804799 != 33554431 Oct 28 04:39:04.292562 kernel: GPT: Use GNU Parted to correct GPT errors. Oct 28 04:39:04.292581 kernel: nvme0n1: p1 p2 p3 p4 p6 p7 p9 Oct 28 04:39:04.292607 kernel: Invalid ELF header magic: != \u007fELF Oct 28 04:39:04.292627 kernel: Invalid ELF header magic: != \u007fELF Oct 28 04:39:04.292646 kernel: SCSI subsystem initialized Oct 28 04:39:04.292665 kernel: Invalid ELF header magic: != \u007fELF Oct 28 04:39:04.292685 kernel: device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. Oct 28 04:39:04.292705 kernel: device-mapper: uevent: version 1.0.3 Oct 28 04:39:04.292724 kernel: device-mapper: ioctl: 4.48.0-ioctl (2023-03-01) initialised: dm-devel@lists.linux.dev Oct 28 04:39:04.292747 kernel: device-mapper: verity: sha256 using shash "sha256-ce" Oct 28 04:39:04.292766 kernel: Invalid ELF header magic: != \u007fELF Oct 28 04:39:04.292784 kernel: Invalid ELF header magic: != \u007fELF Oct 28 04:39:04.292803 kernel: Invalid ELF header magic: != \u007fELF Oct 28 04:39:04.292822 kernel: raid6: neonx8 gen() 6489 MB/s Oct 28 04:39:04.292840 kernel: raid6: neonx4 gen() 6505 MB/s Oct 28 04:39:04.292859 kernel: raid6: neonx2 gen() 5428 MB/s Oct 28 04:39:04.292881 kernel: raid6: neonx1 gen() 3941 MB/s Oct 28 04:39:04.292900 kernel: raid6: int64x8 gen() 3625 MB/s Oct 28 04:39:04.292919 kernel: raid6: int64x4 gen() 3704 MB/s Oct 28 04:39:04.292937 kernel: raid6: int64x2 gen() 3590 MB/s Oct 28 04:39:04.292956 kernel: raid6: int64x1 gen() 2770 MB/s Oct 28 04:39:04.292976 kernel: raid6: using algorithm neonx4 gen() 6505 MB/s Oct 28 04:39:04.292995 kernel: raid6: .... xor() 4852 MB/s, rmw enabled Oct 28 04:39:04.293014 kernel: raid6: using neon recovery algorithm Oct 28 04:39:04.293037 kernel: Invalid ELF header magic: != \u007fELF Oct 28 04:39:04.293055 kernel: Invalid ELF header magic: != \u007fELF Oct 28 04:39:04.293074 kernel: Invalid ELF header magic: != \u007fELF Oct 28 04:39:04.293092 kernel: Invalid ELF header magic: != \u007fELF Oct 28 04:39:04.293110 kernel: xor: measuring software checksum speed Oct 28 04:39:04.293129 kernel: 8regs : 12938 MB/sec Oct 28 04:39:04.293148 kernel: 32regs : 13007 MB/sec Oct 28 04:39:04.295741 kernel: arm64_neon : 8684 MB/sec Oct 28 04:39:04.295786 kernel: xor: using function: 32regs (13007 MB/sec) Oct 28 04:39:04.295807 kernel: Invalid ELF header magic: != \u007fELF Oct 28 04:39:04.295827 kernel: Btrfs loaded, zoned=no, fsverity=no Oct 28 04:39:04.295847 kernel: BTRFS: device fsid caa7e5e1-1ce1-458b-ad52-fda248cb60f9 devid 1 transid 36 /dev/mapper/usr (254:0) scanned by mount (220) Oct 28 04:39:04.295867 kernel: BTRFS info (device dm-0): first mount of filesystem caa7e5e1-1ce1-458b-ad52-fda248cb60f9 Oct 28 04:39:04.295887 kernel: BTRFS info (device dm-0): using crc32c (crc32c-generic) checksum algorithm Oct 28 04:39:04.295906 kernel: BTRFS info (device dm-0): enabling ssd optimizations Oct 28 04:39:04.295929 kernel: BTRFS info (device dm-0): disabling log replay at mount time Oct 28 04:39:04.295949 kernel: BTRFS info (device dm-0): enabling free space tree Oct 28 04:39:04.295969 kernel: Invalid ELF header magic: != \u007fELF Oct 28 04:39:04.296007 kernel: loop: module loaded Oct 28 04:39:04.296032 kernel: loop0: detected capacity change from 0 to 91480 Oct 28 04:39:04.296053 kernel: squashfs: version 4.0 (2009/01/31) Phillip Lougher Oct 28 04:39:04.296077 systemd[1]: Successfully made /usr/ read-only. Oct 28 04:39:04.296109 systemd[1]: systemd 257.7 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +IPE +SMACK +SECCOMP -GCRYPT -GNUTLS +OPENSSL -ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 -PWQUALITY -P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP -SYSVINIT +LIBARCHIVE) Oct 28 04:39:04.296131 systemd[1]: Detected virtualization amazon. Oct 28 04:39:04.296152 systemd[1]: Detected architecture arm64. Oct 28 04:39:04.296198 systemd[1]: Running in initrd. Oct 28 04:39:04.296236 systemd[1]: No hostname configured, using default hostname. Oct 28 04:39:04.296270 systemd[1]: Hostname set to . Oct 28 04:39:04.296295 systemd[1]: Initializing machine ID from SMBIOS/DMI UUID. Oct 28 04:39:04.296316 systemd[1]: Queued start job for default target initrd.target. Oct 28 04:39:04.296337 systemd[1]: Unnecessary job was removed for dev-mapper-usr.device - /dev/mapper/usr. Oct 28 04:39:04.296358 systemd[1]: Started clevis-luks-askpass.path - Forward Password Requests to Clevis Directory Watch. Oct 28 04:39:04.296379 systemd[1]: Started systemd-ask-password-console.path - Dispatch Password Requests to Console Directory Watch. Oct 28 04:39:04.296402 systemd[1]: Expecting device dev-disk-by\x2dlabel-EFI\x2dSYSTEM.device - /dev/disk/by-label/EFI-SYSTEM... Oct 28 04:39:04.296428 systemd[1]: Expecting device dev-disk-by\x2dlabel-OEM.device - /dev/disk/by-label/OEM... Oct 28 04:39:04.296450 systemd[1]: Expecting device dev-disk-by\x2dlabel-ROOT.device - /dev/disk/by-label/ROOT... Oct 28 04:39:04.296472 systemd[1]: Expecting device dev-disk-by\x2dpartlabel-USR\x2dA.device - /dev/disk/by-partlabel/USR-A... Oct 28 04:39:04.296494 systemd[1]: Reached target cryptsetup-pre.target - Local Encrypted Volumes (Pre). Oct 28 04:39:04.296516 systemd[1]: Reached target cryptsetup.target - Local Encrypted Volumes. Oct 28 04:39:04.296537 systemd[1]: Reached target initrd-usr-fs.target - Initrd /usr File System. Oct 28 04:39:04.296562 systemd[1]: Reached target paths.target - Path Units. Oct 28 04:39:04.296584 systemd[1]: Reached target slices.target - Slice Units. Oct 28 04:39:04.296605 systemd[1]: Reached target swap.target - Swaps. Oct 28 04:39:04.296625 systemd[1]: Reached target timers.target - Timer Units. Oct 28 04:39:04.296647 systemd[1]: Listening on iscsid.socket - Open-iSCSI iscsid Socket. Oct 28 04:39:04.296668 systemd[1]: Listening on iscsiuio.socket - Open-iSCSI iscsiuio Socket. Oct 28 04:39:04.296689 systemd[1]: Listening on systemd-journald-dev-log.socket - Journal Socket (/dev/log). Oct 28 04:39:04.296714 systemd[1]: Listening on systemd-journald.socket - Journal Sockets. Oct 28 04:39:04.296736 systemd[1]: Listening on systemd-networkd.socket - Network Service Netlink Socket. Oct 28 04:39:04.296757 systemd[1]: Listening on systemd-udevd-control.socket - udev Control Socket. Oct 28 04:39:04.296778 systemd[1]: Listening on systemd-udevd-kernel.socket - udev Kernel Socket. Oct 28 04:39:04.296799 systemd[1]: Reached target sockets.target - Socket Units. Oct 28 04:39:04.296821 systemd[1]: afterburn-network-kargs.service - Afterburn Initrd Setup Network Kernel Arguments was skipped because no trigger condition checks were met. Oct 28 04:39:04.296846 systemd[1]: Starting ignition-setup-pre.service - Ignition env setup... Oct 28 04:39:04.296868 systemd[1]: Starting kmod-static-nodes.service - Create List of Static Device Nodes... Oct 28 04:39:04.296888 systemd[1]: Finished network-cleanup.service - Network Cleanup. Oct 28 04:39:04.296910 systemd[1]: systemd-battery-check.service - Check battery level during early boot was skipped because of an unmet condition check (ConditionDirectoryNotEmpty=/sys/class/power_supply). Oct 28 04:39:04.296932 systemd[1]: Starting systemd-fsck-usr.service... Oct 28 04:39:04.296958 systemd[1]: Starting systemd-journald.service - Journal Service... Oct 28 04:39:04.296979 systemd[1]: Starting systemd-modules-load.service - Load Kernel Modules... Oct 28 04:39:04.297001 systemd[1]: Starting systemd-vconsole-setup.service - Virtual Console Setup... Oct 28 04:39:04.297023 systemd[1]: Finished ignition-setup-pre.service - Ignition env setup. Oct 28 04:39:04.297048 systemd[1]: Finished kmod-static-nodes.service - Create List of Static Device Nodes. Oct 28 04:39:04.297070 systemd[1]: Starting systemd-tmpfiles-setup-dev-early.service - Create Static Device Nodes in /dev gracefully... Oct 28 04:39:04.297091 systemd[1]: Finished systemd-fsck-usr.service. Oct 28 04:39:04.297112 kernel: bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this. Oct 28 04:39:04.297133 kernel: Bridge firewalling registered Oct 28 04:39:04.297155 systemd[1]: Finished systemd-modules-load.service - Load Kernel Modules. Oct 28 04:39:04.297326 systemd-journald[357]: Collecting audit messages is disabled. Oct 28 04:39:04.297375 systemd[1]: Starting systemd-sysctl.service - Apply Kernel Variables... Oct 28 04:39:04.297399 systemd[1]: Finished systemd-tmpfiles-setup-dev-early.service - Create Static Device Nodes in /dev gracefully. Oct 28 04:39:04.297427 systemd[1]: Finished systemd-vconsole-setup.service - Virtual Console Setup. Oct 28 04:39:04.297450 systemd[1]: Finished systemd-sysctl.service - Apply Kernel Variables. Oct 28 04:39:04.297472 systemd[1]: Starting dracut-cmdline-ask.service - dracut ask for additional cmdline parameters... Oct 28 04:39:04.297494 systemd-journald[357]: Journal started Oct 28 04:39:04.297532 systemd-journald[357]: Runtime Journal (/run/log/journal/ec2b2b140f22e66888c92782b8a5df09) is 8M, max 75.3M, 67.3M free. Oct 28 04:39:04.233992 systemd-modules-load[358]: Inserted module 'br_netfilter' Oct 28 04:39:04.317502 systemd[1]: Starting systemd-resolved.service - Network Name Resolution... Oct 28 04:39:04.326850 systemd[1]: Starting systemd-tmpfiles-setup-dev.service - Create Static Device Nodes in /dev... Oct 28 04:39:04.334481 systemd[1]: Started systemd-journald.service - Journal Service. Oct 28 04:39:04.346670 systemd[1]: Starting systemd-tmpfiles-setup.service - Create System Files and Directories... Oct 28 04:39:04.373100 systemd[1]: Finished systemd-tmpfiles-setup-dev.service - Create Static Device Nodes in /dev. Oct 28 04:39:04.376499 systemd[1]: Finished dracut-cmdline-ask.service - dracut ask for additional cmdline parameters. Oct 28 04:39:04.389383 systemd[1]: Starting dracut-cmdline.service - dracut cmdline hook... Oct 28 04:39:04.397756 systemd-tmpfiles[388]: /usr/lib/tmpfiles.d/var.conf:14: Duplicate line for path "/var/log", ignoring. Oct 28 04:39:04.418397 systemd[1]: Finished systemd-tmpfiles-setup.service - Create System Files and Directories. Oct 28 04:39:04.438082 dracut-cmdline[397]: Using kernel command line parameters: rd.driver.pre=btrfs SYSTEMD_SULOGIN_FORCE=1 BOOT_IMAGE=/flatcar/vmlinuz-a mount.usr=/dev/mapper/usr verity.usr=PARTUUID=7130c94a-213a-4e5a-8e26-6cce9662f132 rootflags=rw mount.usrflags=ro consoleblank=0 root=LABEL=ROOT console=tty1 console=ttyS0,115200n8 earlycon flatcar.first_boot=detected acpi=force flatcar.oem.id=ec2 modprobe.blacklist=xen_fbfront net.ifnames=0 nvme_core.io_timeout=4294967295 verity.usrhash=1f35b74acbf2082d1ccaf19af5ba856ed6811e7fe1caa7e6e44e2aaa205180aa Oct 28 04:39:04.531898 systemd-resolved[373]: Positive Trust Anchors: Oct 28 04:39:04.531925 systemd-resolved[373]: . IN DS 20326 8 2 e06d44b80b8f1d39a95c0b0d7c65d08458e880409bbc683457104237c7f8ec8d Oct 28 04:39:04.531933 systemd-resolved[373]: . IN DS 38696 8 2 683d2d0acb8c9b712a1948b27f741219298d0a450d612c483af444a4c0fb2b16 Oct 28 04:39:04.531993 systemd-resolved[373]: Negative trust anchors: home.arpa 10.in-addr.arpa 16.172.in-addr.arpa 17.172.in-addr.arpa 18.172.in-addr.arpa 19.172.in-addr.arpa 20.172.in-addr.arpa 21.172.in-addr.arpa 22.172.in-addr.arpa 23.172.in-addr.arpa 24.172.in-addr.arpa 25.172.in-addr.arpa 26.172.in-addr.arpa 27.172.in-addr.arpa 28.172.in-addr.arpa 29.172.in-addr.arpa 30.172.in-addr.arpa 31.172.in-addr.arpa 170.0.0.192.in-addr.arpa 171.0.0.192.in-addr.arpa 168.192.in-addr.arpa d.f.ip6.arpa ipv4only.arpa resolver.arpa corp home internal intranet lan local private test Oct 28 04:39:04.767242 kernel: Loading iSCSI transport class v2.0-870. Oct 28 04:39:04.812259 kernel: random: crng init done Oct 28 04:39:04.812732 systemd-resolved[373]: Defaulting to hostname 'linux'. Oct 28 04:39:04.833662 systemd[1]: Started systemd-resolved.service - Network Name Resolution. Oct 28 04:39:04.845968 systemd[1]: Reached target nss-lookup.target - Host and Network Name Lookups. Oct 28 04:39:04.862219 kernel: iscsi: registered transport (tcp) Oct 28 04:39:04.921218 kernel: iscsi: registered transport (qla4xxx) Oct 28 04:39:04.921295 kernel: QLogic iSCSI HBA Driver Oct 28 04:39:04.960010 systemd[1]: Starting systemd-network-generator.service - Generate network units from Kernel command line... Oct 28 04:39:04.985744 systemd[1]: Finished systemd-network-generator.service - Generate network units from Kernel command line. Oct 28 04:39:04.992776 systemd[1]: Reached target network-pre.target - Preparation for Network. Oct 28 04:39:05.073707 systemd[1]: Finished dracut-cmdline.service - dracut cmdline hook. Oct 28 04:39:05.081358 systemd[1]: Starting dracut-pre-udev.service - dracut pre-udev hook... Oct 28 04:39:05.087353 systemd[1]: Starting parse-ip-for-networkd.service - Write systemd-networkd units from cmdline... Oct 28 04:39:05.151718 systemd[1]: Finished dracut-pre-udev.service - dracut pre-udev hook. Oct 28 04:39:05.160128 systemd[1]: Starting systemd-udevd.service - Rule-based Manager for Device Events and Files... Oct 28 04:39:05.220964 systemd-udevd[641]: Using default interface naming scheme 'v257'. Oct 28 04:39:05.240377 systemd[1]: Started systemd-udevd.service - Rule-based Manager for Device Events and Files. Oct 28 04:39:05.250517 systemd[1]: Starting dracut-pre-trigger.service - dracut pre-trigger hook... Oct 28 04:39:05.297438 dracut-pre-trigger[710]: rd.md=0: removing MD RAID activation Oct 28 04:39:05.299466 systemd[1]: Finished parse-ip-for-networkd.service - Write systemd-networkd units from cmdline. Oct 28 04:39:05.311428 systemd[1]: Starting systemd-networkd.service - Network Configuration... Oct 28 04:39:05.364265 systemd[1]: Finished dracut-pre-trigger.service - dracut pre-trigger hook. Oct 28 04:39:05.376435 systemd[1]: Starting systemd-udev-trigger.service - Coldplug All udev Devices... Oct 28 04:39:05.415783 systemd-networkd[750]: lo: Link UP Oct 28 04:39:05.417416 systemd-networkd[750]: lo: Gained carrier Oct 28 04:39:05.418469 systemd[1]: Started systemd-networkd.service - Network Configuration. Oct 28 04:39:05.421414 systemd[1]: Reached target network.target - Network. Oct 28 04:39:05.530710 systemd[1]: Finished systemd-udev-trigger.service - Coldplug All udev Devices. Oct 28 04:39:05.537869 systemd[1]: Starting dracut-initqueue.service - dracut initqueue hook... Oct 28 04:39:05.730831 systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. Oct 28 04:39:05.733141 systemd[1]: Stopped systemd-vconsole-setup.service - Virtual Console Setup. Oct 28 04:39:05.738858 systemd[1]: Stopping systemd-vconsole-setup.service - Virtual Console Setup... Oct 28 04:39:05.745372 systemd[1]: Starting systemd-vconsole-setup.service - Virtual Console Setup... Oct 28 04:39:05.780241 kernel: ACPI: \_SB_.PCI0.GSI1: Enabled at IRQ 36 Oct 28 04:39:05.780316 kernel: ena 0000:00:05.0: enabling device (0010 -> 0012) Oct 28 04:39:05.801625 systemd[1]: Finished systemd-vconsole-setup.service - Virtual Console Setup. Oct 28 04:39:05.809853 kernel: ena 0000:00:05.0: ENA device version: 0.10 Oct 28 04:39:05.810252 kernel: ena 0000:00:05.0: ENA controller version: 0.0.1 implementation version 1 Oct 28 04:39:05.810572 kernel: nvme nvme0: using unchecked data buffer Oct 28 04:39:05.826197 kernel: ena 0000:00:05.0: Elastic Network Adapter (ENA) found at mem 80114000, mac addr 06:2f:d2:f4:bf:9f Oct 28 04:39:05.826842 (udev-worker)[799]: Network interface NamePolicy= disabled on kernel command line. Oct 28 04:39:05.839201 systemd-networkd[750]: eth0: Found matching .network file, based on potentially unpredictable interface name: /usr/lib/systemd/network/zz-default.network Oct 28 04:39:05.839215 systemd-networkd[750]: eth0: Configuring with /usr/lib/systemd/network/zz-default.network. Oct 28 04:39:05.850903 systemd-networkd[750]: eth0: Link UP Oct 28 04:39:05.853359 systemd-networkd[750]: eth0: Gained carrier Oct 28 04:39:05.853387 systemd-networkd[750]: eth0: Found matching .network file, based on potentially unpredictable interface name: /usr/lib/systemd/network/zz-default.network Oct 28 04:39:05.871275 systemd-networkd[750]: eth0: DHCPv4 address 172.31.30.14/20, gateway 172.31.16.1 acquired from 172.31.16.1 Oct 28 04:39:05.944478 systemd[1]: Found device dev-disk-by\x2dpartlabel-USR\x2dA.device - Amazon Elastic Block Store USR-A. Oct 28 04:39:05.968296 systemd[1]: Starting disk-uuid.service - Generate new UUID for disk GPT if necessary... Oct 28 04:39:06.001890 disk-uuid[860]: Primary Header is updated. Oct 28 04:39:06.001890 disk-uuid[860]: Secondary Entries is updated. Oct 28 04:39:06.001890 disk-uuid[860]: Secondary Header is updated. Oct 28 04:39:06.091158 systemd[1]: Found device dev-disk-by\x2dlabel-OEM.device - Amazon Elastic Block Store OEM. Oct 28 04:39:06.152637 systemd[1]: Found device dev-disk-by\x2dlabel-EFI\x2dSYSTEM.device - Amazon Elastic Block Store EFI-SYSTEM. Oct 28 04:39:06.192330 systemd[1]: Found device dev-disk-by\x2dlabel-ROOT.device - Amazon Elastic Block Store ROOT. Oct 28 04:39:06.319316 systemd[1]: Finished dracut-initqueue.service - dracut initqueue hook. Oct 28 04:39:06.326962 systemd[1]: Reached target remote-fs-pre.target - Preparation for Remote File Systems. Oct 28 04:39:06.332268 systemd[1]: Reached target remote-cryptsetup.target - Remote Encrypted Volumes. Oct 28 04:39:06.337219 systemd[1]: Reached target remote-fs.target - Remote File Systems. Oct 28 04:39:06.344626 systemd[1]: Starting dracut-pre-mount.service - dracut pre-mount hook... Oct 28 04:39:06.378931 systemd[1]: Finished dracut-pre-mount.service - dracut pre-mount hook. Oct 28 04:39:07.109521 disk-uuid[866]: Warning: The kernel is still using the old partition table. Oct 28 04:39:07.109521 disk-uuid[866]: The new table will be used at the next reboot or after you Oct 28 04:39:07.109521 disk-uuid[866]: run partprobe(8) or kpartx(8) Oct 28 04:39:07.109521 disk-uuid[866]: The operation has completed successfully. Oct 28 04:39:07.131693 systemd[1]: disk-uuid.service: Deactivated successfully. Oct 28 04:39:07.134224 systemd[1]: Finished disk-uuid.service - Generate new UUID for disk GPT if necessary. Oct 28 04:39:07.142246 systemd[1]: Starting ignition-setup.service - Ignition (setup)... Oct 28 04:39:07.213214 kernel: BTRFS: device label OEM devid 1 transid 11 /dev/nvme0n1p6 (259:5) scanned by mount (1009) Oct 28 04:39:07.217937 kernel: BTRFS info (device nvme0n1p6): first mount of filesystem 52a6d1c0-1d9b-4b64-8a3d-40978d54767d Oct 28 04:39:07.217997 kernel: BTRFS info (device nvme0n1p6): using crc32c (crc32c-generic) checksum algorithm Oct 28 04:39:07.268407 kernel: BTRFS info (device nvme0n1p6): enabling ssd optimizations Oct 28 04:39:07.268470 kernel: BTRFS info (device nvme0n1p6): enabling free space tree Oct 28 04:39:07.278250 kernel: BTRFS info (device nvme0n1p6): last unmount of filesystem 52a6d1c0-1d9b-4b64-8a3d-40978d54767d Oct 28 04:39:07.279962 systemd[1]: Finished ignition-setup.service - Ignition (setup). Oct 28 04:39:07.287418 systemd[1]: Starting ignition-fetch-offline.service - Ignition (fetch-offline)... Oct 28 04:39:07.842349 systemd-networkd[750]: eth0: Gained IPv6LL Oct 28 04:39:08.979676 ignition[1028]: Ignition 2.22.0 Oct 28 04:39:08.979706 ignition[1028]: Stage: fetch-offline Oct 28 04:39:08.983682 ignition[1028]: no configs at "/usr/lib/ignition/base.d" Oct 28 04:39:08.983726 ignition[1028]: no config dir at "/usr/lib/ignition/base.platform.d/aws" Oct 28 04:39:08.988498 ignition[1028]: Ignition finished successfully Oct 28 04:39:08.992994 systemd[1]: Finished ignition-fetch-offline.service - Ignition (fetch-offline). Oct 28 04:39:08.997624 systemd[1]: Starting ignition-fetch.service - Ignition (fetch)... Oct 28 04:39:09.056634 ignition[1037]: Ignition 2.22.0 Oct 28 04:39:09.056664 ignition[1037]: Stage: fetch Oct 28 04:39:09.058100 ignition[1037]: no configs at "/usr/lib/ignition/base.d" Oct 28 04:39:09.058427 ignition[1037]: no config dir at "/usr/lib/ignition/base.platform.d/aws" Oct 28 04:39:09.058567 ignition[1037]: PUT http://169.254.169.254/latest/api/token: attempt #1 Oct 28 04:39:09.086775 ignition[1037]: PUT result: OK Oct 28 04:39:09.090203 ignition[1037]: parsed url from cmdline: "" Oct 28 04:39:09.090226 ignition[1037]: no config URL provided Oct 28 04:39:09.090242 ignition[1037]: reading system config file "/usr/lib/ignition/user.ign" Oct 28 04:39:09.090275 ignition[1037]: no config at "/usr/lib/ignition/user.ign" Oct 28 04:39:09.090305 ignition[1037]: PUT http://169.254.169.254/latest/api/token: attempt #1 Oct 28 04:39:09.091996 ignition[1037]: PUT result: OK Oct 28 04:39:09.092088 ignition[1037]: GET http://169.254.169.254/2019-10-01/user-data: attempt #1 Oct 28 04:39:09.096761 ignition[1037]: GET result: OK Oct 28 04:39:09.096994 ignition[1037]: parsing config with SHA512: ab7a067ac0dc1c120f841ee9a5e55bcfbc036609b522f95abc5ddc45bc76b52205804ee1d3c09c902cd08717a857c2db974c29f3400f7f92d29bc8b11af44c1c Oct 28 04:39:09.112834 unknown[1037]: fetched base config from "system" Oct 28 04:39:09.113240 unknown[1037]: fetched base config from "system" Oct 28 04:39:09.113867 ignition[1037]: fetch: fetch complete Oct 28 04:39:09.113255 unknown[1037]: fetched user config from "aws" Oct 28 04:39:09.113878 ignition[1037]: fetch: fetch passed Oct 28 04:39:09.113968 ignition[1037]: Ignition finished successfully Oct 28 04:39:09.125717 systemd[1]: Finished ignition-fetch.service - Ignition (fetch). Oct 28 04:39:09.130047 systemd[1]: Starting ignition-kargs.service - Ignition (kargs)... Oct 28 04:39:09.176009 ignition[1044]: Ignition 2.22.0 Oct 28 04:39:09.176558 ignition[1044]: Stage: kargs Oct 28 04:39:09.177095 ignition[1044]: no configs at "/usr/lib/ignition/base.d" Oct 28 04:39:09.177116 ignition[1044]: no config dir at "/usr/lib/ignition/base.platform.d/aws" Oct 28 04:39:09.177309 ignition[1044]: PUT http://169.254.169.254/latest/api/token: attempt #1 Oct 28 04:39:09.181407 ignition[1044]: PUT result: OK Oct 28 04:39:09.190025 ignition[1044]: kargs: kargs passed Oct 28 04:39:09.190128 ignition[1044]: Ignition finished successfully Oct 28 04:39:09.195296 systemd[1]: Finished ignition-kargs.service - Ignition (kargs). Oct 28 04:39:09.199597 systemd[1]: Starting ignition-disks.service - Ignition (disks)... Oct 28 04:39:09.255634 ignition[1050]: Ignition 2.22.0 Oct 28 04:39:09.256141 ignition[1050]: Stage: disks Oct 28 04:39:09.256778 ignition[1050]: no configs at "/usr/lib/ignition/base.d" Oct 28 04:39:09.256810 ignition[1050]: no config dir at "/usr/lib/ignition/base.platform.d/aws" Oct 28 04:39:09.257000 ignition[1050]: PUT http://169.254.169.254/latest/api/token: attempt #1 Oct 28 04:39:09.263292 ignition[1050]: PUT result: OK Oct 28 04:39:09.270743 ignition[1050]: disks: disks passed Oct 28 04:39:09.271035 ignition[1050]: Ignition finished successfully Oct 28 04:39:09.276606 systemd[1]: Finished ignition-disks.service - Ignition (disks). Oct 28 04:39:09.282830 systemd[1]: Reached target initrd-root-device.target - Initrd Root Device. Oct 28 04:39:09.287753 systemd[1]: Reached target local-fs-pre.target - Preparation for Local File Systems. Oct 28 04:39:09.292960 systemd[1]: Reached target local-fs.target - Local File Systems. Oct 28 04:39:09.293240 systemd[1]: Reached target sysinit.target - System Initialization. Oct 28 04:39:09.299668 systemd[1]: Reached target basic.target - Basic System. Oct 28 04:39:09.305516 systemd[1]: Starting systemd-fsck-root.service - File System Check on /dev/disk/by-label/ROOT... Oct 28 04:39:09.414958 systemd-fsck[1058]: ROOT: clean, 15/1631200 files, 112378/1617920 blocks Oct 28 04:39:09.420833 systemd[1]: Finished systemd-fsck-root.service - File System Check on /dev/disk/by-label/ROOT. Oct 28 04:39:09.428765 systemd[1]: Mounting sysroot.mount - /sysroot... Oct 28 04:39:09.703203 kernel: EXT4-fs (nvme0n1p9): mounted filesystem 8fca153a-dda8-4620-af0a-8ec5cf72e73c r/w with ordered data mode. Quota mode: none. Oct 28 04:39:09.705225 systemd[1]: Mounted sysroot.mount - /sysroot. Oct 28 04:39:09.709088 systemd[1]: Reached target initrd-root-fs.target - Initrd Root File System. Oct 28 04:39:09.766906 systemd[1]: Mounting sysroot-oem.mount - /sysroot/oem... Oct 28 04:39:09.775951 systemd[1]: Mounting sysroot-usr.mount - /sysroot/usr... Oct 28 04:39:09.781660 systemd[1]: flatcar-metadata-hostname.service - Flatcar Metadata Hostname Agent was skipped because no trigger condition checks were met. Oct 28 04:39:09.781749 systemd[1]: ignition-remount-sysroot.service - Remount /sysroot read-write for Ignition was skipped because of an unmet condition check (ConditionPathIsReadWrite=!/sysroot). Oct 28 04:39:09.781877 systemd[1]: Reached target ignition-diskful.target - Ignition Boot Disk Setup. Oct 28 04:39:09.805302 kernel: BTRFS: device label OEM devid 1 transid 11 /dev/nvme0n1p6 (259:5) scanned by mount (1077) Oct 28 04:39:09.809669 kernel: BTRFS info (device nvme0n1p6): first mount of filesystem 52a6d1c0-1d9b-4b64-8a3d-40978d54767d Oct 28 04:39:09.809726 kernel: BTRFS info (device nvme0n1p6): using crc32c (crc32c-generic) checksum algorithm Oct 28 04:39:09.816881 systemd[1]: Mounted sysroot-usr.mount - /sysroot/usr. Oct 28 04:39:09.820213 kernel: BTRFS info (device nvme0n1p6): enabling ssd optimizations Oct 28 04:39:09.820251 kernel: BTRFS info (device nvme0n1p6): enabling free space tree Oct 28 04:39:09.825254 systemd[1]: Mounted sysroot-oem.mount - /sysroot/oem. Oct 28 04:39:09.831715 systemd[1]: Starting initrd-setup-root.service - Root filesystem setup... Oct 28 04:39:11.054915 initrd-setup-root[1101]: cut: /sysroot/etc/passwd: No such file or directory Oct 28 04:39:11.064825 initrd-setup-root[1108]: cut: /sysroot/etc/group: No such file or directory Oct 28 04:39:11.075511 initrd-setup-root[1115]: cut: /sysroot/etc/shadow: No such file or directory Oct 28 04:39:11.084811 initrd-setup-root[1122]: cut: /sysroot/etc/gshadow: No such file or directory Oct 28 04:39:11.661099 systemd[1]: Finished initrd-setup-root.service - Root filesystem setup. Oct 28 04:39:11.666118 systemd[1]: Starting ignition-mount.service - Ignition (mount)... Oct 28 04:39:11.675417 systemd[1]: Starting sysroot-boot.service - /sysroot/boot... Oct 28 04:39:11.699399 systemd[1]: sysroot-oem.mount: Deactivated successfully. Oct 28 04:39:11.702408 kernel: BTRFS info (device nvme0n1p6): last unmount of filesystem 52a6d1c0-1d9b-4b64-8a3d-40978d54767d Oct 28 04:39:11.741255 systemd[1]: Finished sysroot-boot.service - /sysroot/boot. Oct 28 04:39:11.757490 ignition[1190]: INFO : Ignition 2.22.0 Oct 28 04:39:11.757490 ignition[1190]: INFO : Stage: mount Oct 28 04:39:11.761107 ignition[1190]: INFO : no configs at "/usr/lib/ignition/base.d" Oct 28 04:39:11.761107 ignition[1190]: INFO : no config dir at "/usr/lib/ignition/base.platform.d/aws" Oct 28 04:39:11.766417 ignition[1190]: INFO : PUT http://169.254.169.254/latest/api/token: attempt #1 Oct 28 04:39:11.769335 ignition[1190]: INFO : PUT result: OK Oct 28 04:39:11.773587 ignition[1190]: INFO : mount: mount passed Oct 28 04:39:11.773587 ignition[1190]: INFO : Ignition finished successfully Oct 28 04:39:11.776269 systemd[1]: Finished ignition-mount.service - Ignition (mount). Oct 28 04:39:11.785049 systemd[1]: Starting ignition-files.service - Ignition (files)... Oct 28 04:39:11.815477 systemd[1]: Mounting sysroot-oem.mount - /sysroot/oem... Oct 28 04:39:11.852210 kernel: BTRFS: device label OEM devid 1 transid 11 /dev/nvme0n1p6 (259:5) scanned by mount (1202) Oct 28 04:39:11.857980 kernel: BTRFS info (device nvme0n1p6): first mount of filesystem 52a6d1c0-1d9b-4b64-8a3d-40978d54767d Oct 28 04:39:11.858036 kernel: BTRFS info (device nvme0n1p6): using crc32c (crc32c-generic) checksum algorithm Oct 28 04:39:11.866308 kernel: BTRFS info (device nvme0n1p6): enabling ssd optimizations Oct 28 04:39:11.866371 kernel: BTRFS info (device nvme0n1p6): enabling free space tree Oct 28 04:39:11.869764 systemd[1]: Mounted sysroot-oem.mount - /sysroot/oem. Oct 28 04:39:11.922811 ignition[1219]: INFO : Ignition 2.22.0 Oct 28 04:39:11.925849 ignition[1219]: INFO : Stage: files Oct 28 04:39:11.925849 ignition[1219]: INFO : no configs at "/usr/lib/ignition/base.d" Oct 28 04:39:11.925849 ignition[1219]: INFO : no config dir at "/usr/lib/ignition/base.platform.d/aws" Oct 28 04:39:11.925849 ignition[1219]: INFO : PUT http://169.254.169.254/latest/api/token: attempt #1 Oct 28 04:39:11.935375 ignition[1219]: INFO : PUT result: OK Oct 28 04:39:11.940125 ignition[1219]: DEBUG : files: compiled without relabeling support, skipping Oct 28 04:39:11.971741 ignition[1219]: INFO : files: ensureUsers: op(1): [started] creating or modifying user "core" Oct 28 04:39:11.974814 ignition[1219]: DEBUG : files: ensureUsers: op(1): executing: "usermod" "--root" "/sysroot" "core" Oct 28 04:39:11.982891 ignition[1219]: INFO : files: ensureUsers: op(1): [finished] creating or modifying user "core" Oct 28 04:39:11.988556 ignition[1219]: INFO : files: ensureUsers: op(2): [started] adding ssh keys to user "core" Oct 28 04:39:11.991879 unknown[1219]: wrote ssh authorized keys file for user: core Oct 28 04:39:11.994418 ignition[1219]: INFO : files: ensureUsers: op(2): [finished] adding ssh keys to user "core" Oct 28 04:39:11.998314 ignition[1219]: INFO : files: createFilesystemsFiles: createFiles: op(3): [started] writing file "/sysroot/opt/helm-v3.17.3-linux-arm64.tar.gz" Oct 28 04:39:11.998314 ignition[1219]: INFO : files: createFilesystemsFiles: createFiles: op(3): GET https://get.helm.sh/helm-v3.17.3-linux-arm64.tar.gz: attempt #1 Oct 28 04:39:12.088433 ignition[1219]: INFO : files: createFilesystemsFiles: createFiles: op(3): GET result: OK Oct 28 04:39:12.235628 ignition[1219]: INFO : files: createFilesystemsFiles: createFiles: op(3): [finished] writing file "/sysroot/opt/helm-v3.17.3-linux-arm64.tar.gz" Oct 28 04:39:12.239990 ignition[1219]: INFO : files: createFilesystemsFiles: createFiles: op(4): [started] writing file "/sysroot/home/core/install.sh" Oct 28 04:39:12.243855 ignition[1219]: INFO : files: createFilesystemsFiles: createFiles: op(4): [finished] writing file "/sysroot/home/core/install.sh" Oct 28 04:39:12.243855 ignition[1219]: INFO : files: createFilesystemsFiles: createFiles: op(5): [started] writing file "/sysroot/home/core/nginx.yaml" Oct 28 04:39:12.251580 ignition[1219]: INFO : files: createFilesystemsFiles: createFiles: op(5): [finished] writing file "/sysroot/home/core/nginx.yaml" Oct 28 04:39:12.251580 ignition[1219]: INFO : files: createFilesystemsFiles: createFiles: op(6): [started] writing file "/sysroot/home/core/nfs-pod.yaml" Oct 28 04:39:12.251580 ignition[1219]: INFO : files: createFilesystemsFiles: createFiles: op(6): [finished] writing file "/sysroot/home/core/nfs-pod.yaml" Oct 28 04:39:12.251580 ignition[1219]: INFO : files: createFilesystemsFiles: createFiles: op(7): [started] writing file "/sysroot/home/core/nfs-pvc.yaml" Oct 28 04:39:12.251580 ignition[1219]: INFO : files: createFilesystemsFiles: createFiles: op(7): [finished] writing file "/sysroot/home/core/nfs-pvc.yaml" Oct 28 04:39:12.272338 ignition[1219]: INFO : files: createFilesystemsFiles: createFiles: op(8): [started] writing file "/sysroot/etc/flatcar/update.conf" Oct 28 04:39:12.276297 ignition[1219]: INFO : files: createFilesystemsFiles: createFiles: op(8): [finished] writing file "/sysroot/etc/flatcar/update.conf" Oct 28 04:39:12.276297 ignition[1219]: INFO : files: createFilesystemsFiles: createFiles: op(9): [started] writing link "/sysroot/etc/extensions/kubernetes.raw" -> "/opt/extensions/kubernetes/kubernetes-v1.33.0-arm64.raw" Oct 28 04:39:12.287976 ignition[1219]: INFO : files: createFilesystemsFiles: createFiles: op(9): [finished] writing link "/sysroot/etc/extensions/kubernetes.raw" -> "/opt/extensions/kubernetes/kubernetes-v1.33.0-arm64.raw" Oct 28 04:39:12.293460 ignition[1219]: INFO : files: createFilesystemsFiles: createFiles: op(a): [started] writing file "/sysroot/opt/extensions/kubernetes/kubernetes-v1.33.0-arm64.raw" Oct 28 04:39:12.293460 ignition[1219]: INFO : files: createFilesystemsFiles: createFiles: op(a): GET https://extensions.flatcar.org/extensions/kubernetes-v1.33.0-arm64.raw: attempt #1 Oct 28 04:39:12.756928 ignition[1219]: INFO : files: createFilesystemsFiles: createFiles: op(a): GET result: OK Oct 28 04:39:13.175555 ignition[1219]: INFO : files: createFilesystemsFiles: createFiles: op(a): [finished] writing file "/sysroot/opt/extensions/kubernetes/kubernetes-v1.33.0-arm64.raw" Oct 28 04:39:13.180708 ignition[1219]: INFO : files: op(b): [started] processing unit "prepare-helm.service" Oct 28 04:39:13.180708 ignition[1219]: INFO : files: op(b): op(c): [started] writing unit "prepare-helm.service" at "/sysroot/etc/systemd/system/prepare-helm.service" Oct 28 04:39:13.189631 ignition[1219]: INFO : files: op(b): op(c): [finished] writing unit "prepare-helm.service" at "/sysroot/etc/systemd/system/prepare-helm.service" Oct 28 04:39:13.189631 ignition[1219]: INFO : files: op(b): [finished] processing unit "prepare-helm.service" Oct 28 04:39:13.189631 ignition[1219]: INFO : files: op(d): [started] setting preset to enabled for "prepare-helm.service" Oct 28 04:39:13.189631 ignition[1219]: INFO : files: op(d): [finished] setting preset to enabled for "prepare-helm.service" Oct 28 04:39:13.203214 ignition[1219]: INFO : files: createResultFile: createFiles: op(e): [started] writing file "/sysroot/etc/.ignition-result.json" Oct 28 04:39:13.203214 ignition[1219]: INFO : files: createResultFile: createFiles: op(e): [finished] writing file "/sysroot/etc/.ignition-result.json" Oct 28 04:39:13.203214 ignition[1219]: INFO : files: files passed Oct 28 04:39:13.203214 ignition[1219]: INFO : Ignition finished successfully Oct 28 04:39:13.216877 systemd[1]: Finished ignition-files.service - Ignition (files). Oct 28 04:39:13.223003 systemd[1]: Starting ignition-quench.service - Ignition (record completion)... Oct 28 04:39:13.228369 systemd[1]: Starting initrd-setup-root-after-ignition.service - Root filesystem completion... Oct 28 04:39:13.253125 systemd[1]: ignition-quench.service: Deactivated successfully. Oct 28 04:39:13.253394 systemd[1]: Finished ignition-quench.service - Ignition (record completion). Oct 28 04:39:13.273464 initrd-setup-root-after-ignition[1251]: grep: /sysroot/etc/flatcar/enabled-sysext.conf: No such file or directory Oct 28 04:39:13.273464 initrd-setup-root-after-ignition[1251]: grep: /sysroot/usr/share/flatcar/enabled-sysext.conf: No such file or directory Oct 28 04:39:13.282713 initrd-setup-root-after-ignition[1255]: grep: /sysroot/etc/flatcar/enabled-sysext.conf: No such file or directory Oct 28 04:39:13.288126 systemd[1]: Finished initrd-setup-root-after-ignition.service - Root filesystem completion. Oct 28 04:39:13.291604 systemd[1]: Reached target ignition-complete.target - Ignition Complete. Oct 28 04:39:13.298966 systemd[1]: Starting initrd-parse-etc.service - Mountpoints Configured in the Real Root... Oct 28 04:39:13.382980 systemd[1]: initrd-parse-etc.service: Deactivated successfully. Oct 28 04:39:13.383212 systemd[1]: Finished initrd-parse-etc.service - Mountpoints Configured in the Real Root. Oct 28 04:39:13.386618 systemd[1]: Reached target initrd-fs.target - Initrd File Systems. Oct 28 04:39:13.390688 systemd[1]: Reached target initrd.target - Initrd Default Target. Oct 28 04:39:13.398484 systemd[1]: dracut-mount.service - dracut mount hook was skipped because no trigger condition checks were met. Oct 28 04:39:13.400399 systemd[1]: Starting dracut-pre-pivot.service - dracut pre-pivot and cleanup hook... Oct 28 04:39:13.447285 systemd[1]: Finished dracut-pre-pivot.service - dracut pre-pivot and cleanup hook. Oct 28 04:39:13.455245 systemd[1]: Starting initrd-cleanup.service - Cleaning Up and Shutting Down Daemons... Oct 28 04:39:13.506702 systemd[1]: Unnecessary job was removed for dev-mapper-usr.device - /dev/mapper/usr. Oct 28 04:39:13.508040 systemd[1]: Stopped target nss-lookup.target - Host and Network Name Lookups. Oct 28 04:39:13.515027 systemd[1]: Stopped target remote-cryptsetup.target - Remote Encrypted Volumes. Oct 28 04:39:13.520365 systemd[1]: Stopped target timers.target - Timer Units. Oct 28 04:39:13.522533 systemd[1]: dracut-pre-pivot.service: Deactivated successfully. Oct 28 04:39:13.522900 systemd[1]: Stopped dracut-pre-pivot.service - dracut pre-pivot and cleanup hook. Oct 28 04:39:13.530597 systemd[1]: Stopped target initrd.target - Initrd Default Target. Oct 28 04:39:13.539818 systemd[1]: Stopped target basic.target - Basic System. Oct 28 04:39:13.544417 systemd[1]: Stopped target ignition-complete.target - Ignition Complete. Oct 28 04:39:13.549359 systemd[1]: Stopped target ignition-diskful.target - Ignition Boot Disk Setup. Oct 28 04:39:13.554381 systemd[1]: Stopped target initrd-root-device.target - Initrd Root Device. Oct 28 04:39:13.557815 systemd[1]: Stopped target initrd-usr-fs.target - Initrd /usr File System. Oct 28 04:39:13.562407 systemd[1]: Stopped target remote-fs.target - Remote File Systems. Oct 28 04:39:13.569454 systemd[1]: Stopped target remote-fs-pre.target - Preparation for Remote File Systems. Oct 28 04:39:13.572369 systemd[1]: Stopped target sysinit.target - System Initialization. Oct 28 04:39:13.579510 systemd[1]: Stopped target local-fs.target - Local File Systems. Oct 28 04:39:13.581876 systemd[1]: Stopped target swap.target - Swaps. Oct 28 04:39:13.584841 systemd[1]: dracut-pre-mount.service: Deactivated successfully. Oct 28 04:39:13.585074 systemd[1]: Stopped dracut-pre-mount.service - dracut pre-mount hook. Oct 28 04:39:13.589001 systemd[1]: Stopped target cryptsetup.target - Local Encrypted Volumes. Oct 28 04:39:13.591956 systemd[1]: Stopped target cryptsetup-pre.target - Local Encrypted Volumes (Pre). Oct 28 04:39:13.604333 systemd[1]: clevis-luks-askpass.path: Deactivated successfully. Oct 28 04:39:13.606392 systemd[1]: Stopped clevis-luks-askpass.path - Forward Password Requests to Clevis Directory Watch. Oct 28 04:39:13.609877 systemd[1]: dracut-initqueue.service: Deactivated successfully. Oct 28 04:39:13.610120 systemd[1]: Stopped dracut-initqueue.service - dracut initqueue hook. Oct 28 04:39:13.619898 systemd[1]: initrd-setup-root-after-ignition.service: Deactivated successfully. Oct 28 04:39:13.622567 systemd[1]: Stopped initrd-setup-root-after-ignition.service - Root filesystem completion. Oct 28 04:39:13.628225 systemd[1]: ignition-files.service: Deactivated successfully. Oct 28 04:39:13.628445 systemd[1]: Stopped ignition-files.service - Ignition (files). Oct 28 04:39:13.635464 systemd[1]: Stopping ignition-mount.service - Ignition (mount)... Oct 28 04:39:13.644873 systemd[1]: Stopping sysroot-boot.service - /sysroot/boot... Oct 28 04:39:13.650246 systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. Oct 28 04:39:13.651085 systemd[1]: Stopped systemd-tmpfiles-setup.service - Create System Files and Directories. Oct 28 04:39:13.661350 systemd[1]: systemd-udev-trigger.service: Deactivated successfully. Oct 28 04:39:13.661820 systemd[1]: Stopped systemd-udev-trigger.service - Coldplug All udev Devices. Oct 28 04:39:13.669611 systemd[1]: dracut-pre-trigger.service: Deactivated successfully. Oct 28 04:39:13.670027 systemd[1]: Stopped dracut-pre-trigger.service - dracut pre-trigger hook. Oct 28 04:39:13.684231 systemd[1]: initrd-cleanup.service: Deactivated successfully. Oct 28 04:39:13.693821 systemd[1]: Finished initrd-cleanup.service - Cleaning Up and Shutting Down Daemons. Oct 28 04:39:13.733024 systemd[1]: sysroot-boot.mount: Deactivated successfully. Oct 28 04:39:13.743815 ignition[1276]: INFO : Ignition 2.22.0 Oct 28 04:39:13.746659 ignition[1276]: INFO : Stage: umount Oct 28 04:39:13.748317 ignition[1276]: INFO : no configs at "/usr/lib/ignition/base.d" Oct 28 04:39:13.748317 ignition[1276]: INFO : no config dir at "/usr/lib/ignition/base.platform.d/aws" Oct 28 04:39:13.748317 ignition[1276]: INFO : PUT http://169.254.169.254/latest/api/token: attempt #1 Oct 28 04:39:13.758460 ignition[1276]: INFO : PUT result: OK Oct 28 04:39:13.766104 ignition[1276]: INFO : umount: umount passed Oct 28 04:39:13.768081 ignition[1276]: INFO : Ignition finished successfully Oct 28 04:39:13.773053 systemd[1]: ignition-mount.service: Deactivated successfully. Oct 28 04:39:13.775411 systemd[1]: Stopped ignition-mount.service - Ignition (mount). Oct 28 04:39:13.778151 systemd[1]: ignition-disks.service: Deactivated successfully. Oct 28 04:39:13.778262 systemd[1]: Stopped ignition-disks.service - Ignition (disks). Oct 28 04:39:13.781541 systemd[1]: ignition-kargs.service: Deactivated successfully. Oct 28 04:39:13.781629 systemd[1]: Stopped ignition-kargs.service - Ignition (kargs). Oct 28 04:39:13.787625 systemd[1]: ignition-fetch.service: Deactivated successfully. Oct 28 04:39:13.787720 systemd[1]: Stopped ignition-fetch.service - Ignition (fetch). Oct 28 04:39:13.790742 systemd[1]: Stopped target network.target - Network. Oct 28 04:39:13.796638 systemd[1]: ignition-fetch-offline.service: Deactivated successfully. Oct 28 04:39:13.796755 systemd[1]: Stopped ignition-fetch-offline.service - Ignition (fetch-offline). Oct 28 04:39:13.799985 systemd[1]: Stopped target paths.target - Path Units. Oct 28 04:39:13.805517 systemd[1]: systemd-ask-password-console.path: Deactivated successfully. Oct 28 04:39:13.821636 systemd[1]: Stopped systemd-ask-password-console.path - Dispatch Password Requests to Console Directory Watch. Oct 28 04:39:13.830837 systemd[1]: Stopped target slices.target - Slice Units. Oct 28 04:39:13.835260 systemd[1]: Stopped target sockets.target - Socket Units. Oct 28 04:39:13.837552 systemd[1]: iscsid.socket: Deactivated successfully. Oct 28 04:39:13.837636 systemd[1]: Closed iscsid.socket - Open-iSCSI iscsid Socket. Oct 28 04:39:13.840681 systemd[1]: iscsiuio.socket: Deactivated successfully. Oct 28 04:39:13.840748 systemd[1]: Closed iscsiuio.socket - Open-iSCSI iscsiuio Socket. Oct 28 04:39:13.843616 systemd[1]: ignition-setup.service: Deactivated successfully. Oct 28 04:39:13.843727 systemd[1]: Stopped ignition-setup.service - Ignition (setup). Oct 28 04:39:13.846089 systemd[1]: ignition-setup-pre.service: Deactivated successfully. Oct 28 04:39:13.846218 systemd[1]: Stopped ignition-setup-pre.service - Ignition env setup. Oct 28 04:39:13.850658 systemd[1]: Stopping systemd-networkd.service - Network Configuration... Oct 28 04:39:13.855088 systemd[1]: Stopping systemd-resolved.service - Network Name Resolution... Oct 28 04:39:13.884284 systemd[1]: systemd-resolved.service: Deactivated successfully. Oct 28 04:39:13.885723 systemd[1]: Stopped systemd-resolved.service - Network Name Resolution. Oct 28 04:39:13.893038 systemd[1]: systemd-networkd.service: Deactivated successfully. Oct 28 04:39:13.893254 systemd[1]: Stopped systemd-networkd.service - Network Configuration. Oct 28 04:39:13.902099 systemd[1]: Stopped target network-pre.target - Preparation for Network. Oct 28 04:39:13.910236 systemd[1]: systemd-networkd.socket: Deactivated successfully. Oct 28 04:39:13.910323 systemd[1]: Closed systemd-networkd.socket - Network Service Netlink Socket. Oct 28 04:39:13.924715 systemd[1]: Stopping network-cleanup.service - Network Cleanup... Oct 28 04:39:13.932313 systemd[1]: parse-ip-for-networkd.service: Deactivated successfully. Oct 28 04:39:13.932440 systemd[1]: Stopped parse-ip-for-networkd.service - Write systemd-networkd units from cmdline. Oct 28 04:39:13.936827 systemd[1]: systemd-sysctl.service: Deactivated successfully. Oct 28 04:39:13.936939 systemd[1]: Stopped systemd-sysctl.service - Apply Kernel Variables. Oct 28 04:39:13.941898 systemd[1]: systemd-modules-load.service: Deactivated successfully. Oct 28 04:39:13.942019 systemd[1]: Stopped systemd-modules-load.service - Load Kernel Modules. Oct 28 04:39:13.948212 systemd[1]: Stopping systemd-udevd.service - Rule-based Manager for Device Events and Files... Oct 28 04:39:13.960621 systemd[1]: sysroot-boot.service: Deactivated successfully. Oct 28 04:39:13.960825 systemd[1]: Stopped sysroot-boot.service - /sysroot/boot. Oct 28 04:39:13.979648 systemd[1]: initrd-setup-root.service: Deactivated successfully. Oct 28 04:39:13.979960 systemd[1]: Stopped initrd-setup-root.service - Root filesystem setup. Oct 28 04:39:13.991333 systemd[1]: systemd-udevd.service: Deactivated successfully. Oct 28 04:39:13.991630 systemd[1]: Stopped systemd-udevd.service - Rule-based Manager for Device Events and Files. Oct 28 04:39:13.995847 systemd[1]: systemd-udevd-control.socket: Deactivated successfully. Oct 28 04:39:13.995930 systemd[1]: Closed systemd-udevd-control.socket - udev Control Socket. Oct 28 04:39:13.999799 systemd[1]: systemd-udevd-kernel.socket: Deactivated successfully. Oct 28 04:39:13.999869 systemd[1]: Closed systemd-udevd-kernel.socket - udev Kernel Socket. Oct 28 04:39:14.003014 systemd[1]: dracut-pre-udev.service: Deactivated successfully. Oct 28 04:39:14.003122 systemd[1]: Stopped dracut-pre-udev.service - dracut pre-udev hook. Oct 28 04:39:14.010785 systemd[1]: dracut-cmdline.service: Deactivated successfully. Oct 28 04:39:14.010894 systemd[1]: Stopped dracut-cmdline.service - dracut cmdline hook. Oct 28 04:39:14.018775 systemd[1]: dracut-cmdline-ask.service: Deactivated successfully. Oct 28 04:39:14.018886 systemd[1]: Stopped dracut-cmdline-ask.service - dracut ask for additional cmdline parameters. Oct 28 04:39:14.030088 systemd[1]: Starting initrd-udevadm-cleanup-db.service - Cleanup udev Database... Oct 28 04:39:14.047958 systemd[1]: systemd-network-generator.service: Deactivated successfully. Oct 28 04:39:14.048074 systemd[1]: Stopped systemd-network-generator.service - Generate network units from Kernel command line. Oct 28 04:39:14.048738 systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. Oct 28 04:39:14.048817 systemd[1]: Stopped systemd-tmpfiles-setup-dev.service - Create Static Device Nodes in /dev. Oct 28 04:39:14.049085 systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. Oct 28 04:39:14.049186 systemd[1]: Stopped systemd-tmpfiles-setup-dev-early.service - Create Static Device Nodes in /dev gracefully. Oct 28 04:39:14.049457 systemd[1]: kmod-static-nodes.service: Deactivated successfully. Oct 28 04:39:14.049530 systemd[1]: Stopped kmod-static-nodes.service - Create List of Static Device Nodes. Oct 28 04:39:14.049815 systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. Oct 28 04:39:14.049888 systemd[1]: Stopped systemd-vconsole-setup.service - Virtual Console Setup. Oct 28 04:39:14.105885 systemd[1]: network-cleanup.service: Deactivated successfully. Oct 28 04:39:14.108260 systemd[1]: Stopped network-cleanup.service - Network Cleanup. Oct 28 04:39:14.114456 systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. Oct 28 04:39:14.116899 systemd[1]: Finished initrd-udevadm-cleanup-db.service - Cleanup udev Database. Oct 28 04:39:14.120268 systemd[1]: Reached target initrd-switch-root.target - Switch Root. Oct 28 04:39:14.126894 systemd[1]: Starting initrd-switch-root.service - Switch Root... Oct 28 04:39:14.157296 systemd[1]: Switching root. Oct 28 04:39:14.220659 systemd-journald[357]: Journal stopped Oct 28 04:39:18.129621 systemd-journald[357]: Received SIGTERM from PID 1 (systemd). Oct 28 04:39:18.129751 kernel: SELinux: policy capability network_peer_controls=1 Oct 28 04:39:18.129790 kernel: SELinux: policy capability open_perms=1 Oct 28 04:39:18.129823 kernel: SELinux: policy capability extended_socket_class=1 Oct 28 04:39:18.129860 kernel: SELinux: policy capability always_check_network=0 Oct 28 04:39:18.129901 kernel: SELinux: policy capability cgroup_seclabel=1 Oct 28 04:39:18.129939 kernel: SELinux: policy capability nnp_nosuid_transition=1 Oct 28 04:39:18.129970 kernel: SELinux: policy capability genfs_seclabel_symlinks=0 Oct 28 04:39:18.130004 kernel: SELinux: policy capability ioctl_skip_cloexec=0 Oct 28 04:39:18.130035 kernel: SELinux: policy capability userspace_initial_context=0 Oct 28 04:39:18.130065 kernel: audit: type=1403 audit(1761626355.122:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 Oct 28 04:39:18.130100 systemd[1]: Successfully loaded SELinux policy in 156.420ms. Oct 28 04:39:18.130153 systemd[1]: Relabeled /dev/, /dev/shm/, /run/ in 15.805ms. Oct 28 04:39:18.130226 systemd[1]: systemd 257.7 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +IPE +SMACK +SECCOMP -GCRYPT -GNUTLS +OPENSSL -ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 -PWQUALITY -P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP -SYSVINIT +LIBARCHIVE) Oct 28 04:39:18.130263 systemd[1]: Detected virtualization amazon. Oct 28 04:39:18.130303 systemd[1]: Detected architecture arm64. Oct 28 04:39:18.130333 systemd[1]: Detected first boot. Oct 28 04:39:18.130366 systemd[1]: Initializing machine ID from SMBIOS/DMI UUID. Oct 28 04:39:18.130410 zram_generator::config[1322]: No configuration found. Oct 28 04:39:18.130446 kernel: NET: Registered PF_VSOCK protocol family Oct 28 04:39:18.130476 systemd[1]: Populated /etc with preset unit settings. Oct 28 04:39:18.130506 systemd[1]: initrd-switch-root.service: Deactivated successfully. Oct 28 04:39:18.130538 systemd[1]: Stopped initrd-switch-root.service - Switch Root. Oct 28 04:39:18.130568 systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. Oct 28 04:39:18.130601 systemd[1]: Created slice system-addon\x2dconfig.slice - Slice /system/addon-config. Oct 28 04:39:18.130638 systemd[1]: Created slice system-addon\x2drun.slice - Slice /system/addon-run. Oct 28 04:39:18.130669 systemd[1]: Created slice system-getty.slice - Slice /system/getty. Oct 28 04:39:18.130700 systemd[1]: Created slice system-modprobe.slice - Slice /system/modprobe. Oct 28 04:39:18.130734 systemd[1]: Created slice system-serial\x2dgetty.slice - Slice /system/serial-getty. Oct 28 04:39:18.130764 systemd[1]: Created slice system-system\x2dcloudinit.slice - Slice /system/system-cloudinit. Oct 28 04:39:18.130797 systemd[1]: Created slice system-systemd\x2dfsck.slice - Slice /system/systemd-fsck. Oct 28 04:39:18.130828 systemd[1]: Created slice user.slice - User and Session Slice. Oct 28 04:39:18.130862 systemd[1]: Started clevis-luks-askpass.path - Forward Password Requests to Clevis Directory Watch. Oct 28 04:39:18.130894 systemd[1]: Started systemd-ask-password-console.path - Dispatch Password Requests to Console Directory Watch. Oct 28 04:39:18.130925 systemd[1]: Started systemd-ask-password-wall.path - Forward Password Requests to Wall Directory Watch. Oct 28 04:39:18.130954 systemd[1]: Set up automount boot.automount - Boot partition Automount Point. Oct 28 04:39:18.130983 systemd[1]: Set up automount proc-sys-fs-binfmt_misc.automount - Arbitrary Executable File Formats File System Automount Point. Oct 28 04:39:18.131013 systemd[1]: Expecting device dev-disk-by\x2dlabel-OEM.device - /dev/disk/by-label/OEM... Oct 28 04:39:18.131044 systemd[1]: Expecting device dev-ttyS0.device - /dev/ttyS0... Oct 28 04:39:18.131078 systemd[1]: Reached target cryptsetup-pre.target - Local Encrypted Volumes (Pre). Oct 28 04:39:18.131110 systemd[1]: Reached target cryptsetup.target - Local Encrypted Volumes. Oct 28 04:39:18.131138 systemd[1]: Stopped target initrd-switch-root.target - Switch Root. Oct 28 04:39:18.137971 systemd[1]: Stopped target initrd-fs.target - Initrd File Systems. Oct 28 04:39:18.138027 systemd[1]: Stopped target initrd-root-fs.target - Initrd Root File System. Oct 28 04:39:18.138061 systemd[1]: Reached target integritysetup.target - Local Integrity Protected Volumes. Oct 28 04:39:18.138105 systemd[1]: Reached target remote-cryptsetup.target - Remote Encrypted Volumes. Oct 28 04:39:18.138139 systemd[1]: Reached target remote-fs.target - Remote File Systems. Oct 28 04:39:18.138196 systemd[1]: Reached target slices.target - Slice Units. Oct 28 04:39:18.138232 systemd[1]: Reached target swap.target - Swaps. Oct 28 04:39:18.138262 systemd[1]: Reached target veritysetup.target - Local Verity Protected Volumes. Oct 28 04:39:18.138294 systemd[1]: Listening on systemd-coredump.socket - Process Core Dump Socket. Oct 28 04:39:18.138326 systemd[1]: Listening on systemd-creds.socket - Credential Encryption/Decryption. Oct 28 04:39:18.138364 systemd[1]: Listening on systemd-networkd.socket - Network Service Netlink Socket. Oct 28 04:39:18.138397 systemd[1]: Listening on systemd-udevd-control.socket - udev Control Socket. Oct 28 04:39:18.138426 systemd[1]: Listening on systemd-udevd-kernel.socket - udev Kernel Socket. Oct 28 04:39:18.138455 systemd[1]: Listening on systemd-userdbd.socket - User Database Manager Socket. Oct 28 04:39:18.138488 systemd[1]: Mounting dev-hugepages.mount - Huge Pages File System... Oct 28 04:39:18.138519 systemd[1]: Mounting dev-mqueue.mount - POSIX Message Queue File System... Oct 28 04:39:18.138550 systemd[1]: Mounting media.mount - External Media Directory... Oct 28 04:39:18.139019 systemd[1]: Mounting sys-kernel-debug.mount - Kernel Debug File System... Oct 28 04:39:18.139745 systemd[1]: Mounting sys-kernel-tracing.mount - Kernel Trace File System... Oct 28 04:39:18.140072 systemd[1]: Mounting tmp.mount - Temporary Directory /tmp... Oct 28 04:39:18.140107 systemd[1]: var-lib-machines.mount - Virtual Machine and Container Storage (Compatibility) was skipped because of an unmet condition check (ConditionPathExists=/var/lib/machines.raw). Oct 28 04:39:18.140137 systemd[1]: Reached target machines.target - Containers. Oct 28 04:39:18.146254 systemd[1]: Starting flatcar-tmpfiles.service - Create missing system files... Oct 28 04:39:18.146296 systemd[1]: ignition-delete-config.service - Ignition (delete config) was skipped because no trigger condition checks were met. Oct 28 04:39:18.146338 systemd[1]: Starting kmod-static-nodes.service - Create List of Static Device Nodes... Oct 28 04:39:18.146370 systemd[1]: Starting modprobe@configfs.service - Load Kernel Module configfs... Oct 28 04:39:18.146404 systemd[1]: Starting modprobe@dm_mod.service - Load Kernel Module dm_mod... Oct 28 04:39:18.146434 systemd[1]: Starting modprobe@drm.service - Load Kernel Module drm... Oct 28 04:39:18.146465 systemd[1]: Starting modprobe@efi_pstore.service - Load Kernel Module efi_pstore... Oct 28 04:39:18.146494 systemd[1]: Starting modprobe@fuse.service - Load Kernel Module fuse... Oct 28 04:39:18.146526 systemd[1]: Starting modprobe@loop.service - Load Kernel Module loop... Oct 28 04:39:18.146559 systemd[1]: setup-nsswitch.service - Create /etc/nsswitch.conf was skipped because of an unmet condition check (ConditionPathExists=!/etc/nsswitch.conf). Oct 28 04:39:18.146588 systemd[1]: systemd-fsck-root.service: Deactivated successfully. Oct 28 04:39:18.146618 systemd[1]: Stopped systemd-fsck-root.service - File System Check on Root Device. Oct 28 04:39:18.146651 systemd[1]: systemd-fsck-usr.service: Deactivated successfully. Oct 28 04:39:18.146680 systemd[1]: Stopped systemd-fsck-usr.service. Oct 28 04:39:18.146711 systemd[1]: systemd-hibernate-clear.service - Clear Stale Hibernate Storage Info was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67). Oct 28 04:39:18.146743 systemd[1]: Starting systemd-journald.service - Journal Service... Oct 28 04:39:18.146775 systemd[1]: Starting systemd-modules-load.service - Load Kernel Modules... Oct 28 04:39:18.146805 systemd[1]: Starting systemd-network-generator.service - Generate network units from Kernel command line... Oct 28 04:39:18.146836 systemd[1]: Starting systemd-remount-fs.service - Remount Root and Kernel File Systems... Oct 28 04:39:18.146870 kernel: fuse: init (API version 7.41) Oct 28 04:39:18.146900 systemd[1]: Starting systemd-udev-load-credentials.service - Load udev Rules from Credentials... Oct 28 04:39:18.146930 systemd[1]: Starting systemd-udev-trigger.service - Coldplug All udev Devices... Oct 28 04:39:18.146962 systemd[1]: Mounted dev-hugepages.mount - Huge Pages File System. Oct 28 04:39:18.146992 systemd[1]: Mounted dev-mqueue.mount - POSIX Message Queue File System. Oct 28 04:39:18.147022 systemd[1]: Mounted media.mount - External Media Directory. Oct 28 04:39:18.147051 systemd[1]: Mounted sys-kernel-debug.mount - Kernel Debug File System. Oct 28 04:39:18.147085 systemd[1]: Mounted sys-kernel-tracing.mount - Kernel Trace File System. Oct 28 04:39:18.147115 systemd[1]: Mounted tmp.mount - Temporary Directory /tmp. Oct 28 04:39:18.147144 systemd[1]: Finished kmod-static-nodes.service - Create List of Static Device Nodes. Oct 28 04:39:18.147196 systemd[1]: modprobe@configfs.service: Deactivated successfully. Oct 28 04:39:18.147229 systemd[1]: Finished modprobe@configfs.service - Load Kernel Module configfs. Oct 28 04:39:18.147258 systemd[1]: modprobe@dm_mod.service: Deactivated successfully. Oct 28 04:39:18.147287 systemd[1]: Finished modprobe@dm_mod.service - Load Kernel Module dm_mod. Oct 28 04:39:18.147321 systemd[1]: modprobe@efi_pstore.service: Deactivated successfully. Oct 28 04:39:18.147350 systemd[1]: Finished modprobe@efi_pstore.service - Load Kernel Module efi_pstore. Oct 28 04:39:18.147379 systemd[1]: modprobe@fuse.service: Deactivated successfully. Oct 28 04:39:18.147407 systemd[1]: Finished modprobe@fuse.service - Load Kernel Module fuse. Oct 28 04:39:18.147439 systemd[1]: modprobe@loop.service: Deactivated successfully. Oct 28 04:39:18.147469 systemd[1]: Finished modprobe@loop.service - Load Kernel Module loop. Oct 28 04:39:18.147502 systemd[1]: Finished systemd-modules-load.service - Load Kernel Modules. Oct 28 04:39:18.147532 systemd[1]: Finished systemd-network-generator.service - Generate network units from Kernel command line. Oct 28 04:39:18.147563 systemd[1]: Finished systemd-remount-fs.service - Remount Root and Kernel File Systems. Oct 28 04:39:18.147594 systemd[1]: Reached target network-pre.target - Preparation for Network. Oct 28 04:39:18.147623 systemd[1]: Listening on systemd-importd.socket - Disk Image Download Service Socket. Oct 28 04:39:18.147697 systemd-journald[1401]: Collecting audit messages is disabled. Oct 28 04:39:18.147752 systemd[1]: remount-root.service - Remount Root File System was skipped because of an unmet condition check (ConditionPathIsReadWrite=!/). Oct 28 04:39:18.147785 systemd[1]: Reached target local-fs.target - Local File Systems. Oct 28 04:39:18.147815 systemd[1]: Listening on systemd-sysext.socket - System Extension Image Management. Oct 28 04:39:18.147847 systemd[1]: systemd-binfmt.service - Set Up Additional Binary Formats was skipped because no trigger condition checks were met. Oct 28 04:39:18.147877 systemd[1]: Starting systemd-hwdb-update.service - Rebuild Hardware Database... Oct 28 04:39:18.147909 systemd[1]: systemd-pstore.service - Platform Persistent Storage Archival was skipped because of an unmet condition check (ConditionDirectoryNotEmpty=/sys/fs/pstore). Oct 28 04:39:18.147944 systemd[1]: Starting systemd-random-seed.service - Load/Save OS Random Seed... Oct 28 04:39:18.147974 systemd[1]: systemd-repart.service - Repartition Root Disk was skipped because no trigger condition checks were met. Oct 28 04:39:18.148005 systemd-journald[1401]: Journal started Oct 28 04:39:18.148055 systemd-journald[1401]: Runtime Journal (/run/log/journal/ec2b2b140f22e66888c92782b8a5df09) is 8M, max 75.3M, 67.3M free. Oct 28 04:39:18.155799 systemd[1]: Starting systemd-sysctl.service - Apply Kernel Variables... Oct 28 04:39:17.454798 systemd[1]: Queued start job for default target multi-user.target. Oct 28 04:39:17.469920 systemd[1]: Unnecessary job was removed for dev-nvme0n1p6.device - /dev/nvme0n1p6. Oct 28 04:39:17.470856 systemd[1]: systemd-journald.service: Deactivated successfully. Oct 28 04:39:18.176440 systemd[1]: Starting systemd-sysext.service - Merge System Extension Images into /usr/ and /opt/... Oct 28 04:39:18.198847 systemd[1]: Starting systemd-tmpfiles-setup-dev-early.service - Create Static Device Nodes in /dev gracefully... Oct 28 04:39:18.200404 systemd[1]: Started systemd-journald.service - Journal Service. Oct 28 04:39:18.215397 systemd[1]: Finished systemd-udev-load-credentials.service - Load udev Rules from Credentials. Oct 28 04:39:18.236484 systemd[1]: Finished systemd-random-seed.service - Load/Save OS Random Seed. Oct 28 04:39:18.252790 kernel: ACPI: bus type drm_connector registered Oct 28 04:39:18.255017 systemd[1]: Finished flatcar-tmpfiles.service - Create missing system files. Oct 28 04:39:18.261055 systemd[1]: modprobe@drm.service: Deactivated successfully. Oct 28 04:39:18.261532 systemd[1]: Finished modprobe@drm.service - Load Kernel Module drm. Oct 28 04:39:18.275851 systemd[1]: Reached target first-boot-complete.target - First Boot Complete. Oct 28 04:39:18.284431 kernel: loop1: detected capacity change from 0 to 61504 Oct 28 04:39:18.284908 systemd[1]: Starting systemd-journal-flush.service - Flush Journal to Persistent Storage... Oct 28 04:39:18.294460 systemd[1]: Starting systemd-machine-id-commit.service - Save Transient machine-id to Disk... Oct 28 04:39:18.305381 systemd[1]: Finished systemd-sysctl.service - Apply Kernel Variables. Oct 28 04:39:18.354058 systemd-tmpfiles[1433]: ACLs are not supported, ignoring. Oct 28 04:39:18.354091 systemd-tmpfiles[1433]: ACLs are not supported, ignoring. Oct 28 04:39:18.360320 systemd[1]: Finished systemd-machine-id-commit.service - Save Transient machine-id to Disk. Oct 28 04:39:18.369263 systemd-journald[1401]: Time spent on flushing to /var/log/journal/ec2b2b140f22e66888c92782b8a5df09 is 43.175ms for 930 entries. Oct 28 04:39:18.369263 systemd-journald[1401]: System Journal (/var/log/journal/ec2b2b140f22e66888c92782b8a5df09) is 8M, max 588.1M, 580.1M free. Oct 28 04:39:18.441425 systemd-journald[1401]: Received client request to flush runtime journal. Oct 28 04:39:18.378427 systemd[1]: Finished systemd-tmpfiles-setup-dev-early.service - Create Static Device Nodes in /dev gracefully. Oct 28 04:39:18.390525 systemd[1]: Starting systemd-sysusers.service - Create System Users... Oct 28 04:39:18.446072 systemd[1]: Finished systemd-journal-flush.service - Flush Journal to Persistent Storage. Oct 28 04:39:18.471985 systemd[1]: Finished systemd-udev-trigger.service - Coldplug All udev Devices. Oct 28 04:39:18.477903 systemd[1]: etc-machine\x2did.mount: Deactivated successfully. Oct 28 04:39:18.480907 systemd[1]: Mounting sys-fs-fuse-connections.mount - FUSE Control File System... Oct 28 04:39:18.491541 systemd[1]: Mounting sys-kernel-config.mount - Kernel Configuration File System... Oct 28 04:39:18.513063 systemd[1]: Mounted sys-fs-fuse-connections.mount - FUSE Control File System. Oct 28 04:39:18.517434 systemd[1]: Mounted sys-kernel-config.mount - Kernel Configuration File System. Oct 28 04:39:18.619415 systemd[1]: Finished systemd-sysusers.service - Create System Users. Oct 28 04:39:18.631438 systemd[1]: Starting systemd-resolved.service - Network Name Resolution... Oct 28 04:39:18.637732 systemd[1]: Starting systemd-tmpfiles-setup-dev.service - Create Static Device Nodes in /dev... Oct 28 04:39:18.657657 kernel: loop2: detected capacity change from 0 to 119400 Oct 28 04:39:18.681974 systemd-tmpfiles[1476]: ACLs are not supported, ignoring. Oct 28 04:39:18.682016 systemd-tmpfiles[1476]: ACLs are not supported, ignoring. Oct 28 04:39:18.689230 systemd[1]: Finished systemd-tmpfiles-setup-dev.service - Create Static Device Nodes in /dev. Oct 28 04:39:18.756693 systemd[1]: Starting systemd-userdbd.service - User Database Manager... Oct 28 04:39:18.836380 systemd[1]: Started systemd-userdbd.service - User Database Manager. Oct 28 04:39:18.996209 kernel: loop3: detected capacity change from 0 to 100192 Oct 28 04:39:19.018793 systemd-resolved[1475]: Positive Trust Anchors: Oct 28 04:39:19.018828 systemd-resolved[1475]: . IN DS 20326 8 2 e06d44b80b8f1d39a95c0b0d7c65d08458e880409bbc683457104237c7f8ec8d Oct 28 04:39:19.018837 systemd-resolved[1475]: . IN DS 38696 8 2 683d2d0acb8c9b712a1948b27f741219298d0a450d612c483af444a4c0fb2b16 Oct 28 04:39:19.018899 systemd-resolved[1475]: Negative trust anchors: home.arpa 10.in-addr.arpa 16.172.in-addr.arpa 17.172.in-addr.arpa 18.172.in-addr.arpa 19.172.in-addr.arpa 20.172.in-addr.arpa 21.172.in-addr.arpa 22.172.in-addr.arpa 23.172.in-addr.arpa 24.172.in-addr.arpa 25.172.in-addr.arpa 26.172.in-addr.arpa 27.172.in-addr.arpa 28.172.in-addr.arpa 29.172.in-addr.arpa 30.172.in-addr.arpa 31.172.in-addr.arpa 170.0.0.192.in-addr.arpa 171.0.0.192.in-addr.arpa 168.192.in-addr.arpa d.f.ip6.arpa ipv4only.arpa resolver.arpa corp home internal intranet lan local private test Oct 28 04:39:19.032619 systemd-resolved[1475]: Defaulting to hostname 'linux'. Oct 28 04:39:19.035460 systemd[1]: Started systemd-resolved.service - Network Name Resolution. Oct 28 04:39:19.040490 systemd[1]: Reached target nss-lookup.target - Host and Network Name Lookups. Oct 28 04:39:19.240334 systemd[1]: Finished systemd-hwdb-update.service - Rebuild Hardware Database. Oct 28 04:39:19.246075 systemd[1]: Starting systemd-udevd.service - Rule-based Manager for Device Events and Files... Oct 28 04:39:19.305231 systemd-udevd[1488]: Using default interface naming scheme 'v257'. Oct 28 04:39:19.317223 kernel: loop4: detected capacity change from 0 to 211168 Oct 28 04:39:19.451955 systemd[1]: Started systemd-udevd.service - Rule-based Manager for Device Events and Files. Oct 28 04:39:19.459804 systemd[1]: Starting systemd-networkd.service - Network Configuration... Oct 28 04:39:19.544273 (udev-worker)[1501]: Network interface NamePolicy= disabled on kernel command line. Oct 28 04:39:19.582209 kernel: loop5: detected capacity change from 0 to 61504 Oct 28 04:39:19.609601 kernel: loop6: detected capacity change from 0 to 119400 Oct 28 04:39:19.636236 kernel: loop7: detected capacity change from 0 to 100192 Oct 28 04:39:19.639643 systemd-networkd[1494]: lo: Link UP Oct 28 04:39:19.640195 systemd-networkd[1494]: lo: Gained carrier Oct 28 04:39:19.642964 systemd[1]: Started systemd-networkd.service - Network Configuration. Oct 28 04:39:19.648497 systemd[1]: Reached target network.target - Network. Oct 28 04:39:19.652761 systemd[1]: Starting systemd-networkd-persistent-storage.service - Enable Persistent Storage in systemd-networkd... Oct 28 04:39:19.670348 kernel: loop1: detected capacity change from 0 to 211168 Oct 28 04:39:19.666480 systemd[1]: Starting systemd-networkd-wait-online.service - Wait for Network to be Configured... Oct 28 04:39:19.676667 systemd[1]: Condition check resulted in dev-ttyS0.device - /dev/ttyS0 being skipped. Oct 28 04:39:19.690953 (sd-merge)[1518]: Using extensions 'containerd-flatcar.raw', 'docker-flatcar.raw', 'kubernetes.raw', 'oem-ami.raw'. Oct 28 04:39:19.700543 systemd-networkd[1494]: eth0: Found matching .network file, based on potentially unpredictable interface name: /usr/lib/systemd/network/zz-default.network Oct 28 04:39:19.701845 (sd-merge)[1518]: Merged extensions into '/usr'. Oct 28 04:39:19.707254 systemd-networkd[1494]: eth0: Configuring with /usr/lib/systemd/network/zz-default.network. Oct 28 04:39:19.720462 systemd[1]: Reload requested from client PID 1432 ('systemd-sysext') (unit systemd-sysext.service)... Oct 28 04:39:19.720488 systemd[1]: Reloading... Oct 28 04:39:19.725635 systemd-networkd[1494]: eth0: Link UP Oct 28 04:39:19.729426 systemd-networkd[1494]: eth0: Gained carrier Oct 28 04:39:19.729469 systemd-networkd[1494]: eth0: Found matching .network file, based on potentially unpredictable interface name: /usr/lib/systemd/network/zz-default.network Oct 28 04:39:19.754857 systemd-networkd[1494]: eth0: DHCPv4 address 172.31.30.14/20, gateway 172.31.16.1 acquired from 172.31.16.1 Oct 28 04:39:19.969195 zram_generator::config[1570]: No configuration found. Oct 28 04:39:20.535459 systemd[1]: Reloading finished in 814 ms. Oct 28 04:39:20.557479 systemd[1]: Finished systemd-networkd-persistent-storage.service - Enable Persistent Storage in systemd-networkd. Oct 28 04:39:20.561221 systemd[1]: Finished systemd-sysext.service - Merge System Extension Images into /usr/ and /opt/. Oct 28 04:39:20.622501 systemd[1]: Found device dev-disk-by\x2dlabel-OEM.device - Amazon Elastic Block Store OEM. Oct 28 04:39:20.651281 systemd[1]: Starting ensure-sysext.service... Oct 28 04:39:20.659446 systemd[1]: Starting systemd-fsck@dev-disk-by\x2dlabel-OEM.service - File System Check on /dev/disk/by-label/OEM... Oct 28 04:39:20.666438 systemd[1]: Starting systemd-tmpfiles-setup.service - Create System Files and Directories... Oct 28 04:39:20.675513 systemd[1]: Starting systemd-vconsole-setup.service - Virtual Console Setup... Oct 28 04:39:20.716611 systemd[1]: Reload requested from client PID 1707 ('systemctl') (unit ensure-sysext.service)... Oct 28 04:39:20.716638 systemd[1]: Reloading... Oct 28 04:39:20.771348 systemd-tmpfiles[1709]: /usr/lib/tmpfiles.d/nfs-utils.conf:6: Duplicate line for path "/var/lib/nfs/sm", ignoring. Oct 28 04:39:20.771421 systemd-tmpfiles[1709]: /usr/lib/tmpfiles.d/nfs-utils.conf:7: Duplicate line for path "/var/lib/nfs/sm.bak", ignoring. Oct 28 04:39:20.772008 systemd-tmpfiles[1709]: /usr/lib/tmpfiles.d/provision.conf:20: Duplicate line for path "/root", ignoring. Oct 28 04:39:20.772775 systemd-tmpfiles[1709]: /usr/lib/tmpfiles.d/systemd-flatcar.conf:6: Duplicate line for path "/var/log/journal", ignoring. Oct 28 04:39:20.774574 systemd-tmpfiles[1709]: /usr/lib/tmpfiles.d/systemd.conf:29: Duplicate line for path "/var/lib/systemd", ignoring. Oct 28 04:39:20.775106 systemd-tmpfiles[1709]: ACLs are not supported, ignoring. Oct 28 04:39:20.775287 systemd-tmpfiles[1709]: ACLs are not supported, ignoring. Oct 28 04:39:20.787658 systemd-tmpfiles[1709]: Detected autofs mount point /boot during canonicalization of boot. Oct 28 04:39:20.788242 systemd-tmpfiles[1709]: Skipping /boot Oct 28 04:39:20.813058 systemd-tmpfiles[1709]: Detected autofs mount point /boot during canonicalization of boot. Oct 28 04:39:20.813088 systemd-tmpfiles[1709]: Skipping /boot Oct 28 04:39:20.892221 zram_generator::config[1747]: No configuration found. Oct 28 04:39:21.282414 systemd-networkd[1494]: eth0: Gained IPv6LL Oct 28 04:39:21.317585 systemd[1]: Reloading finished in 600 ms. Oct 28 04:39:21.355261 systemd[1]: Finished systemd-networkd-wait-online.service - Wait for Network to be Configured. Oct 28 04:39:21.379300 systemd[1]: Finished systemd-fsck@dev-disk-by\x2dlabel-OEM.service - File System Check on /dev/disk/by-label/OEM. Oct 28 04:39:21.384684 systemd[1]: Finished systemd-tmpfiles-setup.service - Create System Files and Directories. Oct 28 04:39:21.403188 systemd[1]: Reached target network-online.target - Network is Online. Oct 28 04:39:21.408286 systemd[1]: Starting audit-rules.service - Load Audit Rules... Oct 28 04:39:21.414640 systemd[1]: Starting clean-ca-certificates.service - Clean up broken links in /etc/ssl/certs... Oct 28 04:39:21.418698 systemd[1]: Starting ldconfig.service - Rebuild Dynamic Linker Cache... Oct 28 04:39:21.424756 systemd[1]: Starting systemd-journal-catalog-update.service - Rebuild Journal Catalog... Oct 28 04:39:21.430786 systemd[1]: Starting systemd-update-utmp.service - Record System Boot/Shutdown in UTMP... Oct 28 04:39:21.440930 systemd[1]: ignition-delete-config.service - Ignition (delete config) was skipped because no trigger condition checks were met. Oct 28 04:39:21.449866 systemd[1]: Starting modprobe@dm_mod.service - Load Kernel Module dm_mod... Oct 28 04:39:21.455723 systemd[1]: Starting modprobe@efi_pstore.service - Load Kernel Module efi_pstore... Oct 28 04:39:21.466363 systemd[1]: Starting modprobe@loop.service - Load Kernel Module loop... Oct 28 04:39:21.469303 systemd[1]: systemd-binfmt.service - Set Up Additional Binary Formats was skipped because no trigger condition checks were met. Oct 28 04:39:21.469582 systemd[1]: systemd-hibernate-clear.service - Clear Stale Hibernate Storage Info was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67). Oct 28 04:39:21.478707 systemd[1]: ignition-delete-config.service - Ignition (delete config) was skipped because no trigger condition checks were met. Oct 28 04:39:21.479069 systemd[1]: systemd-binfmt.service - Set Up Additional Binary Formats was skipped because no trigger condition checks were met. Oct 28 04:39:21.479288 systemd[1]: systemd-hibernate-clear.service - Clear Stale Hibernate Storage Info was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67). Oct 28 04:39:21.488975 systemd[1]: Finished systemd-vconsole-setup.service - Virtual Console Setup. Oct 28 04:39:21.499004 systemd[1]: modprobe@dm_mod.service: Deactivated successfully. Oct 28 04:39:21.499500 systemd[1]: Finished modprobe@dm_mod.service - Load Kernel Module dm_mod. Oct 28 04:39:21.516746 systemd[1]: modprobe@efi_pstore.service: Deactivated successfully. Oct 28 04:39:21.519511 systemd[1]: Finished modprobe@efi_pstore.service - Load Kernel Module efi_pstore. Oct 28 04:39:21.530656 systemd[1]: ignition-delete-config.service - Ignition (delete config) was skipped because no trigger condition checks were met. Oct 28 04:39:21.536449 systemd[1]: Starting modprobe@dm_mod.service - Load Kernel Module dm_mod... Oct 28 04:39:21.541854 systemd[1]: Starting modprobe@drm.service - Load Kernel Module drm... Oct 28 04:39:21.548637 systemd[1]: systemd-binfmt.service - Set Up Additional Binary Formats was skipped because no trigger condition checks were met. Oct 28 04:39:21.549084 systemd[1]: systemd-hibernate-clear.service - Clear Stale Hibernate Storage Info was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67). Oct 28 04:39:21.549587 systemd[1]: systemd-pstore.service - Platform Persistent Storage Archival was skipped because of an unmet condition check (ConditionDirectoryNotEmpty=/sys/fs/pstore). Oct 28 04:39:21.551254 systemd[1]: Reached target time-set.target - System Time Set. Oct 28 04:39:21.562249 systemd[1]: Finished systemd-update-utmp.service - Record System Boot/Shutdown in UTMP. Oct 28 04:39:21.566226 systemd[1]: Finished ensure-sysext.service. Oct 28 04:39:21.568704 systemd[1]: modprobe@loop.service: Deactivated successfully. Oct 28 04:39:21.569134 systemd[1]: Finished modprobe@loop.service - Load Kernel Module loop. Oct 28 04:39:21.603695 systemd[1]: Finished systemd-journal-catalog-update.service - Rebuild Journal Catalog. Oct 28 04:39:21.607524 systemd[1]: modprobe@dm_mod.service: Deactivated successfully. Oct 28 04:39:21.607935 systemd[1]: Finished modprobe@dm_mod.service - Load Kernel Module dm_mod. Oct 28 04:39:21.611337 systemd[1]: modprobe@drm.service: Deactivated successfully. Oct 28 04:39:21.611754 systemd[1]: Finished modprobe@drm.service - Load Kernel Module drm. Oct 28 04:39:21.617811 systemd[1]: systemd-repart.service - Repartition Root Disk was skipped because no trigger condition checks were met. Oct 28 04:39:21.714772 augenrules[1842]: No rules Oct 28 04:39:21.719221 systemd[1]: audit-rules.service: Deactivated successfully. Oct 28 04:39:21.719880 systemd[1]: Finished audit-rules.service - Load Audit Rules. Oct 28 04:39:21.942274 systemd[1]: Finished clean-ca-certificates.service - Clean up broken links in /etc/ssl/certs. Oct 28 04:39:21.945597 systemd[1]: update-ca-certificates.service - Update CA bundle at /etc/ssl/certs/ca-certificates.crt was skipped because of an unmet condition check (ConditionPathIsSymbolicLink=!/etc/ssl/certs/ca-certificates.crt). Oct 28 04:39:24.223278 ldconfig[1805]: /sbin/ldconfig: /usr/lib/ld.so.conf is not an ELF file - it has the wrong magic bytes at the start. Oct 28 04:39:24.232323 systemd[1]: Finished ldconfig.service - Rebuild Dynamic Linker Cache. Oct 28 04:39:24.237814 systemd[1]: Starting systemd-update-done.service - Update is Completed... Oct 28 04:39:24.263516 systemd[1]: Finished systemd-update-done.service - Update is Completed. Oct 28 04:39:24.266496 systemd[1]: Reached target sysinit.target - System Initialization. Oct 28 04:39:24.269036 systemd[1]: Started motdgen.path - Watch for update engine configuration changes. Oct 28 04:39:24.271961 systemd[1]: Started user-cloudinit@var-lib-flatcar\x2dinstall-user_data.path - Watch for a cloud-config at /var/lib/flatcar-install/user_data. Oct 28 04:39:24.275037 systemd[1]: Started logrotate.timer - Daily rotation of log files. Oct 28 04:39:24.277777 systemd[1]: Started mdadm.timer - Weekly check for MD array's redundancy information.. Oct 28 04:39:24.280458 systemd[1]: Started systemd-tmpfiles-clean.timer - Daily Cleanup of Temporary Directories. Oct 28 04:39:24.283131 systemd[1]: update-engine-stub.timer - Update Engine Stub Timer was skipped because of an unmet condition check (ConditionPathExists=/usr/.noupdate). Oct 28 04:39:24.283205 systemd[1]: Reached target paths.target - Path Units. Oct 28 04:39:24.285552 systemd[1]: Reached target timers.target - Timer Units. Oct 28 04:39:24.289622 systemd[1]: Listening on dbus.socket - D-Bus System Message Bus Socket. Oct 28 04:39:24.294469 systemd[1]: Starting docker.socket - Docker Socket for the API... Oct 28 04:39:24.300744 systemd[1]: Listening on sshd-unix-local.socket - OpenSSH Server Socket (systemd-ssh-generator, AF_UNIX Local). Oct 28 04:39:24.304018 systemd[1]: Listening on sshd-vsock.socket - OpenSSH Server Socket (systemd-ssh-generator, AF_VSOCK). Oct 28 04:39:24.306949 systemd[1]: Reached target ssh-access.target - SSH Access Available. Oct 28 04:39:24.313343 systemd[1]: Listening on sshd.socket - OpenSSH Server Socket. Oct 28 04:39:24.316401 systemd[1]: Listening on systemd-hostnamed.socket - Hostname Service Socket. Oct 28 04:39:24.320055 systemd[1]: Listening on docker.socket - Docker Socket for the API. Oct 28 04:39:24.322658 systemd[1]: Reached target sockets.target - Socket Units. Oct 28 04:39:24.324849 systemd[1]: Reached target basic.target - Basic System. Oct 28 04:39:24.326963 systemd[1]: addon-config@oem.service - Configure Addon /oem was skipped because no trigger condition checks were met. Oct 28 04:39:24.327019 systemd[1]: addon-run@oem.service - Run Addon /oem was skipped because no trigger condition checks were met. Oct 28 04:39:24.328890 systemd[1]: Starting containerd.service - containerd container runtime... Oct 28 04:39:24.334043 systemd[1]: Starting coreos-metadata.service - Flatcar Metadata Agent... Oct 28 04:39:24.338377 systemd[1]: Starting dbus.service - D-Bus System Message Bus... Oct 28 04:39:24.346562 systemd[1]: Starting dracut-shutdown.service - Restore /run/initramfs on shutdown... Oct 28 04:39:24.354498 systemd[1]: Starting enable-oem-cloudinit.service - Enable cloudinit... Oct 28 04:39:24.360535 systemd[1]: Starting extend-filesystems.service - Extend Filesystems... Oct 28 04:39:24.362882 systemd[1]: flatcar-setup-environment.service - Modifies /etc/environment for CoreOS was skipped because of an unmet condition check (ConditionPathExists=/oem/bin/flatcar-setup-environment). Oct 28 04:39:24.377224 systemd[1]: Starting kubelet.service - kubelet: The Kubernetes Node Agent... Oct 28 04:39:24.383746 systemd[1]: Starting motdgen.service - Generate /run/flatcar/motd... Oct 28 04:39:24.391629 jq[1858]: false Oct 28 04:39:24.392803 systemd[1]: Started ntpd.service - Network Time Service. Oct 28 04:39:24.399098 systemd[1]: Starting nvidia.service - NVIDIA Configure Service... Oct 28 04:39:24.406696 systemd[1]: Starting prepare-helm.service - Unpack helm to /opt/bin... Oct 28 04:39:24.414531 systemd[1]: Starting setup-oem.service - Setup OEM... Oct 28 04:39:24.422554 systemd[1]: Starting ssh-key-proc-cmdline.service - Install an ssh key from /proc/cmdline... Oct 28 04:39:24.441547 systemd[1]: Starting sshd-keygen.service - Generate sshd host keys... Oct 28 04:39:24.462866 systemd[1]: Starting systemd-logind.service - User Login Management... Oct 28 04:39:24.465411 systemd[1]: tcsd.service - TCG Core Services Daemon was skipped because of an unmet condition check (ConditionPathExists=/dev/tpm0). Oct 28 04:39:24.466488 systemd[1]: cgroup compatibility translation between legacy and unified hierarchy settings activated. See cgroup-compat debug messages for details. Oct 28 04:39:24.469759 systemd[1]: Starting update-engine.service - Update Engine... Oct 28 04:39:24.480282 extend-filesystems[1859]: Found /dev/nvme0n1p6 Oct 28 04:39:24.485379 systemd[1]: Starting update-ssh-keys-after-ignition.service - Run update-ssh-keys once after Ignition... Oct 28 04:39:24.497184 systemd[1]: Finished dracut-shutdown.service - Restore /run/initramfs on shutdown. Oct 28 04:39:24.502548 systemd[1]: enable-oem-cloudinit.service: Skipped due to 'exec-condition'. Oct 28 04:39:24.509523 systemd[1]: Condition check resulted in enable-oem-cloudinit.service - Enable cloudinit being skipped. Oct 28 04:39:24.573035 extend-filesystems[1859]: Found /dev/nvme0n1p9 Oct 28 04:39:24.589753 extend-filesystems[1859]: Checking size of /dev/nvme0n1p9 Oct 28 04:39:24.607260 jq[1874]: true Oct 28 04:39:24.609338 systemd[1]: ssh-key-proc-cmdline.service: Deactivated successfully. Oct 28 04:39:24.609776 systemd[1]: Finished ssh-key-proc-cmdline.service - Install an ssh key from /proc/cmdline. Oct 28 04:39:24.642297 update_engine[1872]: I20251028 04:39:24.637619 1872 main.cc:92] Flatcar Update Engine starting Oct 28 04:39:24.669069 dbus-daemon[1856]: [system] SELinux support is enabled Oct 28 04:39:24.676744 tar[1878]: linux-arm64/LICENSE Oct 28 04:39:24.676744 tar[1878]: linux-arm64/helm Oct 28 04:39:24.679382 systemd[1]: Started dbus.service - D-Bus System Message Bus. Oct 28 04:39:24.687754 systemd[1]: motdgen.service: Deactivated successfully. Oct 28 04:39:24.690242 systemd[1]: Finished motdgen.service - Generate /run/flatcar/motd. Oct 28 04:39:24.698611 systemd[1]: system-cloudinit@usr-share-oem-cloud\x2dconfig.yml.service - Load cloud-config from /usr/share/oem/cloud-config.yml was skipped because of an unmet condition check (ConditionFileNotEmpty=/usr/share/oem/cloud-config.yml). Oct 28 04:39:24.699107 systemd[1]: Reached target system-config.target - Load system-provided cloud configs. Oct 28 04:39:24.702367 systemd[1]: user-cloudinit-proc-cmdline.service - Load cloud-config from url defined in /proc/cmdline was skipped because of an unmet condition check (ConditionKernelCommandLine=cloud-config-url). Oct 28 04:39:24.702407 systemd[1]: Reached target user-config.target - Load user-provided cloud configs. Oct 28 04:39:24.718727 dbus-daemon[1856]: [system] Activating systemd to hand-off: service name='org.freedesktop.hostname1' unit='dbus-org.freedesktop.hostname1.service' requested by ':1.0' (uid=244 pid=1494 comm="/usr/lib/systemd/systemd-networkd" label="system_u:system_r:kernel_t:s0") Oct 28 04:39:24.738197 jq[1908]: true Oct 28 04:39:24.736823 dbus-daemon[1856]: [system] Successfully activated service 'org.freedesktop.systemd1' Oct 28 04:39:24.734592 systemd[1]: Finished setup-oem.service - Setup OEM. Oct 28 04:39:24.747320 update_engine[1872]: I20251028 04:39:24.742449 1872 update_check_scheduler.cc:74] Next update check in 3m45s Oct 28 04:39:24.742559 systemd[1]: Started update-engine.service - Update Engine. Oct 28 04:39:24.759243 extend-filesystems[1859]: Resized partition /dev/nvme0n1p9 Oct 28 04:39:24.751146 systemd[1]: Started amazon-ssm-agent.service - amazon-ssm-agent. Oct 28 04:39:24.766748 systemd[1]: Starting systemd-hostnamed.service - Hostname Service... Oct 28 04:39:24.773557 systemd[1]: Started locksmithd.service - Cluster reboot manager. Oct 28 04:39:24.783188 extend-filesystems[1929]: resize2fs 1.47.3 (8-Jul-2025) Oct 28 04:39:24.802200 kernel: EXT4-fs (nvme0n1p9): resizing filesystem from 1617920 to 2604027 blocks Oct 28 04:39:24.806948 ntpd[1862]: ntpd 4.2.8p18@1.4062-o Tue Oct 28 02:53:21 UTC 2025 (1): Starting Oct 28 04:39:24.825362 kernel: EXT4-fs (nvme0n1p9): resized filesystem to 2604027 Oct 28 04:39:24.825432 ntpd[1862]: 28 Oct 04:39:24 ntpd[1862]: ntpd 4.2.8p18@1.4062-o Tue Oct 28 02:53:21 UTC 2025 (1): Starting Oct 28 04:39:24.825432 ntpd[1862]: 28 Oct 04:39:24 ntpd[1862]: Command line: /usr/sbin/ntpd -g -n -u ntp:ntp Oct 28 04:39:24.825432 ntpd[1862]: 28 Oct 04:39:24 ntpd[1862]: ---------------------------------------------------- Oct 28 04:39:24.825432 ntpd[1862]: 28 Oct 04:39:24 ntpd[1862]: ntp-4 is maintained by Network Time Foundation, Oct 28 04:39:24.825432 ntpd[1862]: 28 Oct 04:39:24 ntpd[1862]: Inc. (NTF), a non-profit 501(c)(3) public-benefit Oct 28 04:39:24.825432 ntpd[1862]: 28 Oct 04:39:24 ntpd[1862]: corporation. Support and training for ntp-4 are Oct 28 04:39:24.825432 ntpd[1862]: 28 Oct 04:39:24 ntpd[1862]: available at https://www.nwtime.org/support Oct 28 04:39:24.825432 ntpd[1862]: 28 Oct 04:39:24 ntpd[1862]: ---------------------------------------------------- Oct 28 04:39:24.809383 ntpd[1862]: Command line: /usr/sbin/ntpd -g -n -u ntp:ntp Oct 28 04:39:24.809404 ntpd[1862]: ---------------------------------------------------- Oct 28 04:39:24.832981 systemd[1]: extend-filesystems.service: Deactivated successfully. Oct 28 04:39:24.833840 extend-filesystems[1929]: Filesystem at /dev/nvme0n1p9 is mounted on /; on-line resizing required Oct 28 04:39:24.833840 extend-filesystems[1929]: old_desc_blocks = 1, new_desc_blocks = 2 Oct 28 04:39:24.833840 extend-filesystems[1929]: The filesystem on /dev/nvme0n1p9 is now 2604027 (4k) blocks long. Oct 28 04:39:24.809422 ntpd[1862]: ntp-4 is maintained by Network Time Foundation, Oct 28 04:39:24.846416 ntpd[1862]: 28 Oct 04:39:24 ntpd[1862]: proto: precision = 0.108 usec (-23) Oct 28 04:39:24.846416 ntpd[1862]: 28 Oct 04:39:24 ntpd[1862]: basedate set to 2025-10-16 Oct 28 04:39:24.846416 ntpd[1862]: 28 Oct 04:39:24 ntpd[1862]: gps base set to 2025-10-19 (week 2389) Oct 28 04:39:24.846416 ntpd[1862]: 28 Oct 04:39:24 ntpd[1862]: Listen and drop on 0 v6wildcard [::]:123 Oct 28 04:39:24.846416 ntpd[1862]: 28 Oct 04:39:24 ntpd[1862]: Listen and drop on 1 v4wildcard 0.0.0.0:123 Oct 28 04:39:24.846617 extend-filesystems[1859]: Resized filesystem in /dev/nvme0n1p9 Oct 28 04:39:24.809440 ntpd[1862]: Inc. (NTF), a non-profit 501(c)(3) public-benefit Oct 28 04:39:24.849515 systemd[1]: Finished extend-filesystems.service - Extend Filesystems. Oct 28 04:39:24.858013 ntpd[1862]: 28 Oct 04:39:24 ntpd[1862]: Listen normally on 2 lo 127.0.0.1:123 Oct 28 04:39:24.858013 ntpd[1862]: 28 Oct 04:39:24 ntpd[1862]: Listen normally on 3 eth0 172.31.30.14:123 Oct 28 04:39:24.858013 ntpd[1862]: 28 Oct 04:39:24 ntpd[1862]: Listen normally on 4 lo [::1]:123 Oct 28 04:39:24.858013 ntpd[1862]: 28 Oct 04:39:24 ntpd[1862]: Listen normally on 5 eth0 [fe80::42f:d2ff:fef4:bf9f%2]:123 Oct 28 04:39:24.858013 ntpd[1862]: 28 Oct 04:39:24 ntpd[1862]: Listening on routing socket on fd #22 for interface updates Oct 28 04:39:24.809457 ntpd[1862]: corporation. Support and training for ntp-4 are Oct 28 04:39:24.859381 systemd[1]: Finished nvidia.service - NVIDIA Configure Service. Oct 28 04:39:24.809473 ntpd[1862]: available at https://www.nwtime.org/support Oct 28 04:39:24.809490 ntpd[1862]: ---------------------------------------------------- Oct 28 04:39:24.837477 ntpd[1862]: proto: precision = 0.108 usec (-23) Oct 28 04:39:24.837896 ntpd[1862]: basedate set to 2025-10-16 Oct 28 04:39:24.837918 ntpd[1862]: gps base set to 2025-10-19 (week 2389) Oct 28 04:39:24.838088 ntpd[1862]: Listen and drop on 0 v6wildcard [::]:123 Oct 28 04:39:24.838133 ntpd[1862]: Listen and drop on 1 v4wildcard 0.0.0.0:123 Oct 28 04:39:24.847787 ntpd[1862]: Listen normally on 2 lo 127.0.0.1:123 Oct 28 04:39:24.847837 ntpd[1862]: Listen normally on 3 eth0 172.31.30.14:123 Oct 28 04:39:24.847885 ntpd[1862]: Listen normally on 4 lo [::1]:123 Oct 28 04:39:24.847928 ntpd[1862]: Listen normally on 5 eth0 [fe80::42f:d2ff:fef4:bf9f%2]:123 Oct 28 04:39:24.847969 ntpd[1862]: Listening on routing socket on fd #22 for interface updates Oct 28 04:39:24.925975 ntpd[1862]: kernel reports TIME_ERROR: 0x41: Clock Unsynchronized Oct 28 04:39:24.930803 ntpd[1862]: 28 Oct 04:39:24 ntpd[1862]: kernel reports TIME_ERROR: 0x41: Clock Unsynchronized Oct 28 04:39:24.933241 ntpd[1862]: kernel reports TIME_ERROR: 0x41: Clock Unsynchronized Oct 28 04:39:24.934485 ntpd[1862]: 28 Oct 04:39:24 ntpd[1862]: kernel reports TIME_ERROR: 0x41: Clock Unsynchronized Oct 28 04:39:24.952755 systemd-logind[1871]: Watching system buttons on /dev/input/event0 (Power Button) Oct 28 04:39:24.952805 systemd-logind[1871]: Watching system buttons on /dev/input/event1 (Sleep Button) Oct 28 04:39:24.954664 systemd-logind[1871]: New seat seat0. Oct 28 04:39:24.962849 systemd[1]: Started systemd-logind.service - User Login Management. Oct 28 04:39:25.188694 coreos-metadata[1855]: Oct 28 04:39:25.186 INFO Putting http://169.254.169.254/latest/api/token: Attempt #1 Oct 28 04:39:25.197305 coreos-metadata[1855]: Oct 28 04:39:25.193 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/instance-id: Attempt #1 Oct 28 04:39:25.202539 coreos-metadata[1855]: Oct 28 04:39:25.202 INFO Fetch successful Oct 28 04:39:25.202539 coreos-metadata[1855]: Oct 28 04:39:25.202 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/instance-type: Attempt #1 Oct 28 04:39:25.203809 coreos-metadata[1855]: Oct 28 04:39:25.203 INFO Fetch successful Oct 28 04:39:25.203809 coreos-metadata[1855]: Oct 28 04:39:25.203 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/local-ipv4: Attempt #1 Oct 28 04:39:25.205251 bash[1961]: Updated "/home/core/.ssh/authorized_keys" Oct 28 04:39:25.211380 coreos-metadata[1855]: Oct 28 04:39:25.207 INFO Fetch successful Oct 28 04:39:25.211380 coreos-metadata[1855]: Oct 28 04:39:25.210 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/public-ipv4: Attempt #1 Oct 28 04:39:25.212482 systemd[1]: Finished update-ssh-keys-after-ignition.service - Run update-ssh-keys once after Ignition. Oct 28 04:39:25.225935 coreos-metadata[1855]: Oct 28 04:39:25.222 INFO Fetch successful Oct 28 04:39:25.225935 coreos-metadata[1855]: Oct 28 04:39:25.222 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/ipv6: Attempt #1 Oct 28 04:39:25.223212 systemd[1]: Starting sshkeys.service... Oct 28 04:39:25.234724 coreos-metadata[1855]: Oct 28 04:39:25.232 INFO Fetch failed with 404: resource not found Oct 28 04:39:25.234724 coreos-metadata[1855]: Oct 28 04:39:25.232 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/placement/availability-zone: Attempt #1 Oct 28 04:39:25.244310 coreos-metadata[1855]: Oct 28 04:39:25.239 INFO Fetch successful Oct 28 04:39:25.244310 coreos-metadata[1855]: Oct 28 04:39:25.239 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/placement/availability-zone-id: Attempt #1 Oct 28 04:39:25.245369 coreos-metadata[1855]: Oct 28 04:39:25.245 INFO Fetch successful Oct 28 04:39:25.245369 coreos-metadata[1855]: Oct 28 04:39:25.245 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/hostname: Attempt #1 Oct 28 04:39:25.255691 coreos-metadata[1855]: Oct 28 04:39:25.255 INFO Fetch successful Oct 28 04:39:25.255691 coreos-metadata[1855]: Oct 28 04:39:25.255 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/public-hostname: Attempt #1 Oct 28 04:39:25.258797 coreos-metadata[1855]: Oct 28 04:39:25.258 INFO Fetch successful Oct 28 04:39:25.258797 coreos-metadata[1855]: Oct 28 04:39:25.258 INFO Fetching http://169.254.169.254/2021-01-03/dynamic/instance-identity/document: Attempt #1 Oct 28 04:39:25.269201 coreos-metadata[1855]: Oct 28 04:39:25.265 INFO Fetch successful Oct 28 04:39:25.300257 amazon-ssm-agent[1925]: Initializing new seelog logger Oct 28 04:39:25.300945 amazon-ssm-agent[1925]: New Seelog Logger Creation Complete Oct 28 04:39:25.301178 amazon-ssm-agent[1925]: 2025/10/28 04:39:25 Found config file at /etc/amazon/ssm/amazon-ssm-agent.json. Oct 28 04:39:25.301285 amazon-ssm-agent[1925]: Applying config override from /etc/amazon/ssm/amazon-ssm-agent.json. Oct 28 04:39:25.302038 amazon-ssm-agent[1925]: 2025/10/28 04:39:25 processing appconfig overrides Oct 28 04:39:25.302724 amazon-ssm-agent[1925]: 2025/10/28 04:39:25 Found config file at /etc/amazon/ssm/amazon-ssm-agent.json. Oct 28 04:39:25.302822 amazon-ssm-agent[1925]: Applying config override from /etc/amazon/ssm/amazon-ssm-agent.json. Oct 28 04:39:25.303040 amazon-ssm-agent[1925]: 2025/10/28 04:39:25 processing appconfig overrides Oct 28 04:39:25.303351 amazon-ssm-agent[1925]: 2025/10/28 04:39:25 Found config file at /etc/amazon/ssm/amazon-ssm-agent.json. Oct 28 04:39:25.303428 amazon-ssm-agent[1925]: Applying config override from /etc/amazon/ssm/amazon-ssm-agent.json. Oct 28 04:39:25.303636 amazon-ssm-agent[1925]: 2025/10/28 04:39:25 processing appconfig overrides Oct 28 04:39:25.304901 amazon-ssm-agent[1925]: 2025-10-28 04:39:25.3026 INFO Proxy environment variables: Oct 28 04:39:25.312243 amazon-ssm-agent[1925]: 2025/10/28 04:39:25 Found config file at /etc/amazon/ssm/amazon-ssm-agent.json. Oct 28 04:39:25.312243 amazon-ssm-agent[1925]: Applying config override from /etc/amazon/ssm/amazon-ssm-agent.json. Oct 28 04:39:25.312243 amazon-ssm-agent[1925]: 2025/10/28 04:39:25 processing appconfig overrides Oct 28 04:39:25.370540 systemd[1]: Finished coreos-metadata.service - Flatcar Metadata Agent. Oct 28 04:39:25.373955 systemd[1]: packet-phone-home.service - Report Success to Packet was skipped because no trigger condition checks were met. Oct 28 04:39:25.401893 systemd[1]: Created slice system-coreos\x2dmetadata\x2dsshkeys.slice - Slice /system/coreos-metadata-sshkeys. Oct 28 04:39:25.405269 amazon-ssm-agent[1925]: 2025-10-28 04:39:25.3026 INFO https_proxy: Oct 28 04:39:25.410719 systemd[1]: Starting coreos-metadata-sshkeys@core.service - Flatcar Metadata Agent (SSH Keys)... Oct 28 04:39:25.507197 amazon-ssm-agent[1925]: 2025-10-28 04:39:25.3026 INFO http_proxy: Oct 28 04:39:25.507847 systemd[1]: Started systemd-hostnamed.service - Hostname Service. Oct 28 04:39:25.513422 dbus-daemon[1856]: [system] Successfully activated service 'org.freedesktop.hostname1' Oct 28 04:39:25.514408 dbus-daemon[1856]: [system] Activating via systemd: service name='org.freedesktop.PolicyKit1' unit='polkit.service' requested by ':1.5' (uid=0 pid=1927 comm="/usr/lib/systemd/systemd-hostnamed" label="system_u:system_r:kernel_t:s0") Oct 28 04:39:25.523762 systemd[1]: Starting polkit.service - Authorization Manager... Oct 28 04:39:25.605794 amazon-ssm-agent[1925]: 2025-10-28 04:39:25.3026 INFO no_proxy: Oct 28 04:39:25.713220 amazon-ssm-agent[1925]: 2025-10-28 04:39:25.3031 INFO Checking if agent identity type OnPrem can be assumed Oct 28 04:39:25.799776 coreos-metadata[1998]: Oct 28 04:39:25.799 INFO Putting http://169.254.169.254/latest/api/token: Attempt #1 Oct 28 04:39:25.803699 coreos-metadata[1998]: Oct 28 04:39:25.803 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/public-keys: Attempt #1 Oct 28 04:39:25.811190 amazon-ssm-agent[1925]: 2025-10-28 04:39:25.3032 INFO Checking if agent identity type EC2 can be assumed Oct 28 04:39:25.811311 coreos-metadata[1998]: Oct 28 04:39:25.810 INFO Fetch successful Oct 28 04:39:25.811311 coreos-metadata[1998]: Oct 28 04:39:25.810 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/public-keys/0/openssh-key: Attempt #1 Oct 28 04:39:25.815241 coreos-metadata[1998]: Oct 28 04:39:25.813 INFO Fetch successful Oct 28 04:39:25.820546 unknown[1998]: wrote ssh authorized keys file for user: core Oct 28 04:39:25.926190 amazon-ssm-agent[1925]: 2025-10-28 04:39:25.7599 INFO Agent will take identity from EC2 Oct 28 04:39:25.976655 update-ssh-keys[2061]: Updated "/home/core/.ssh/authorized_keys" Oct 28 04:39:25.982317 systemd[1]: Finished coreos-metadata-sshkeys@core.service - Flatcar Metadata Agent (SSH Keys). Oct 28 04:39:25.991241 systemd[1]: Finished sshkeys.service. Oct 28 04:39:26.019799 containerd[1890]: time="2025-10-28T04:39:26Z" level=warning msg="Ignoring unknown key in TOML" column=1 error="strict mode: fields in the document are missing in the target struct" file=/usr/share/containerd/config.toml key=subreaper row=8 Oct 28 04:39:26.023268 containerd[1890]: time="2025-10-28T04:39:26.022891446Z" level=info msg="starting containerd" revision=fb4c30d4ede3531652d86197bf3fc9515e5276d9 version=v2.0.5 Oct 28 04:39:26.029183 amazon-ssm-agent[1925]: 2025-10-28 04:39:25.7748 INFO [amazon-ssm-agent] amazon-ssm-agent - v3.3.0.0 Oct 28 04:39:26.053700 containerd[1890]: time="2025-10-28T04:39:26.053581938Z" level=warning msg="Configuration migrated from version 2, use `containerd config migrate` to avoid migration" t="14.184µs" Oct 28 04:39:26.053850 containerd[1890]: time="2025-10-28T04:39:26.053818770Z" level=info msg="loading plugin" id=io.containerd.image-verifier.v1.bindir type=io.containerd.image-verifier.v1 Oct 28 04:39:26.053979 containerd[1890]: time="2025-10-28T04:39:26.053950782Z" level=info msg="loading plugin" id=io.containerd.internal.v1.opt type=io.containerd.internal.v1 Oct 28 04:39:26.054353 containerd[1890]: time="2025-10-28T04:39:26.054322782Z" level=info msg="loading plugin" id=io.containerd.warning.v1.deprecations type=io.containerd.warning.v1 Oct 28 04:39:26.056184 containerd[1890]: time="2025-10-28T04:39:26.055206318Z" level=info msg="loading plugin" id=io.containerd.content.v1.content type=io.containerd.content.v1 Oct 28 04:39:26.056184 containerd[1890]: time="2025-10-28T04:39:26.055274262Z" level=info msg="loading plugin" id=io.containerd.snapshotter.v1.blockfile type=io.containerd.snapshotter.v1 Oct 28 04:39:26.056184 containerd[1890]: time="2025-10-28T04:39:26.055408062Z" level=info msg="skip loading plugin" error="no scratch file generator: skip plugin" id=io.containerd.snapshotter.v1.blockfile type=io.containerd.snapshotter.v1 Oct 28 04:39:26.056184 containerd[1890]: time="2025-10-28T04:39:26.055432734Z" level=info msg="loading plugin" id=io.containerd.snapshotter.v1.btrfs type=io.containerd.snapshotter.v1 Oct 28 04:39:26.056184 containerd[1890]: time="2025-10-28T04:39:26.055736178Z" level=info msg="skip loading plugin" error="path /var/lib/containerd/io.containerd.snapshotter.v1.btrfs (ext4) must be a btrfs filesystem to be used with the btrfs snapshotter: skip plugin" id=io.containerd.snapshotter.v1.btrfs type=io.containerd.snapshotter.v1 Oct 28 04:39:26.056184 containerd[1890]: time="2025-10-28T04:39:26.055764174Z" level=info msg="loading plugin" id=io.containerd.snapshotter.v1.devmapper type=io.containerd.snapshotter.v1 Oct 28 04:39:26.056184 containerd[1890]: time="2025-10-28T04:39:26.055788894Z" level=info msg="skip loading plugin" error="devmapper not configured: skip plugin" id=io.containerd.snapshotter.v1.devmapper type=io.containerd.snapshotter.v1 Oct 28 04:39:26.056184 containerd[1890]: time="2025-10-28T04:39:26.055809174Z" level=info msg="loading plugin" id=io.containerd.snapshotter.v1.native type=io.containerd.snapshotter.v1 Oct 28 04:39:26.056184 containerd[1890]: time="2025-10-28T04:39:26.055950126Z" level=info msg="loading plugin" id=io.containerd.snapshotter.v1.overlayfs type=io.containerd.snapshotter.v1 Oct 28 04:39:26.057044 containerd[1890]: time="2025-10-28T04:39:26.056997258Z" level=info msg="loading plugin" id=io.containerd.snapshotter.v1.zfs type=io.containerd.snapshotter.v1 Oct 28 04:39:26.058211 containerd[1890]: time="2025-10-28T04:39:26.057872250Z" level=info msg="skip loading plugin" error="lstat /var/lib/containerd/io.containerd.snapshotter.v1.zfs: no such file or directory: skip plugin" id=io.containerd.snapshotter.v1.zfs type=io.containerd.snapshotter.v1 Oct 28 04:39:26.058211 containerd[1890]: time="2025-10-28T04:39:26.057914958Z" level=info msg="loading plugin" id=io.containerd.event.v1.exchange type=io.containerd.event.v1 Oct 28 04:39:26.058211 containerd[1890]: time="2025-10-28T04:39:26.058000326Z" level=info msg="loading plugin" id=io.containerd.monitor.task.v1.cgroups type=io.containerd.monitor.task.v1 Oct 28 04:39:26.058822 containerd[1890]: time="2025-10-28T04:39:26.058785318Z" level=info msg="loading plugin" id=io.containerd.metadata.v1.bolt type=io.containerd.metadata.v1 Oct 28 04:39:26.059723 containerd[1890]: time="2025-10-28T04:39:26.059372670Z" level=info msg="metadata content store policy set" policy=shared Oct 28 04:39:26.073146 containerd[1890]: time="2025-10-28T04:39:26.072959395Z" level=info msg="loading plugin" id=io.containerd.gc.v1.scheduler type=io.containerd.gc.v1 Oct 28 04:39:26.073146 containerd[1890]: time="2025-10-28T04:39:26.073084135Z" level=info msg="loading plugin" id=io.containerd.differ.v1.walking type=io.containerd.differ.v1 Oct 28 04:39:26.073440 containerd[1890]: time="2025-10-28T04:39:26.073115851Z" level=info msg="loading plugin" id=io.containerd.lease.v1.manager type=io.containerd.lease.v1 Oct 28 04:39:26.074989 containerd[1890]: time="2025-10-28T04:39:26.073540639Z" level=info msg="loading plugin" id=io.containerd.service.v1.containers-service type=io.containerd.service.v1 Oct 28 04:39:26.074989 containerd[1890]: time="2025-10-28T04:39:26.073597123Z" level=info msg="loading plugin" id=io.containerd.service.v1.content-service type=io.containerd.service.v1 Oct 28 04:39:26.074989 containerd[1890]: time="2025-10-28T04:39:26.073624903Z" level=info msg="loading plugin" id=io.containerd.service.v1.diff-service type=io.containerd.service.v1 Oct 28 04:39:26.074989 containerd[1890]: time="2025-10-28T04:39:26.073655863Z" level=info msg="loading plugin" id=io.containerd.service.v1.images-service type=io.containerd.service.v1 Oct 28 04:39:26.074989 containerd[1890]: time="2025-10-28T04:39:26.073715275Z" level=info msg="loading plugin" id=io.containerd.service.v1.introspection-service type=io.containerd.service.v1 Oct 28 04:39:26.074989 containerd[1890]: time="2025-10-28T04:39:26.073745455Z" level=info msg="loading plugin" id=io.containerd.service.v1.namespaces-service type=io.containerd.service.v1 Oct 28 04:39:26.074989 containerd[1890]: time="2025-10-28T04:39:26.073771939Z" level=info msg="loading plugin" id=io.containerd.service.v1.snapshots-service type=io.containerd.service.v1 Oct 28 04:39:26.074989 containerd[1890]: time="2025-10-28T04:39:26.073797859Z" level=info msg="loading plugin" id=io.containerd.shim.v1.manager type=io.containerd.shim.v1 Oct 28 04:39:26.074989 containerd[1890]: time="2025-10-28T04:39:26.073825771Z" level=info msg="loading plugin" id=io.containerd.runtime.v2.task type=io.containerd.runtime.v2 Oct 28 04:39:26.074989 containerd[1890]: time="2025-10-28T04:39:26.074058907Z" level=info msg="loading plugin" id=io.containerd.service.v1.tasks-service type=io.containerd.service.v1 Oct 28 04:39:26.074989 containerd[1890]: time="2025-10-28T04:39:26.074096263Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.containers type=io.containerd.grpc.v1 Oct 28 04:39:26.074989 containerd[1890]: time="2025-10-28T04:39:26.074128159Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.content type=io.containerd.grpc.v1 Oct 28 04:39:26.074989 containerd[1890]: time="2025-10-28T04:39:26.074158579Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.diff type=io.containerd.grpc.v1 Oct 28 04:39:26.074989 containerd[1890]: time="2025-10-28T04:39:26.074211943Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.events type=io.containerd.grpc.v1 Oct 28 04:39:26.075657 containerd[1890]: time="2025-10-28T04:39:26.074237395Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.images type=io.containerd.grpc.v1 Oct 28 04:39:26.075657 containerd[1890]: time="2025-10-28T04:39:26.074276575Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.introspection type=io.containerd.grpc.v1 Oct 28 04:39:26.075657 containerd[1890]: time="2025-10-28T04:39:26.074303779Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.leases type=io.containerd.grpc.v1 Oct 28 04:39:26.075657 containerd[1890]: time="2025-10-28T04:39:26.074332639Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.namespaces type=io.containerd.grpc.v1 Oct 28 04:39:26.075657 containerd[1890]: time="2025-10-28T04:39:26.074359951Z" level=info msg="loading plugin" id=io.containerd.sandbox.store.v1.local type=io.containerd.sandbox.store.v1 Oct 28 04:39:26.075657 containerd[1890]: time="2025-10-28T04:39:26.074384779Z" level=info msg="loading plugin" id=io.containerd.cri.v1.images type=io.containerd.cri.v1 Oct 28 04:39:26.075657 containerd[1890]: time="2025-10-28T04:39:26.074897647Z" level=info msg="Get image filesystem path \"/var/lib/containerd/io.containerd.snapshotter.v1.overlayfs\" for snapshotter \"overlayfs\"" Oct 28 04:39:26.075657 containerd[1890]: time="2025-10-28T04:39:26.074934079Z" level=info msg="Start snapshots syncer" Oct 28 04:39:26.078436 containerd[1890]: time="2025-10-28T04:39:26.077986231Z" level=info msg="loading plugin" id=io.containerd.cri.v1.runtime type=io.containerd.cri.v1 Oct 28 04:39:26.086194 containerd[1890]: time="2025-10-28T04:39:26.083846035Z" level=info msg="starting cri plugin" config="{\"containerd\":{\"defaultRuntimeName\":\"runc\",\"runtimes\":{\"runc\":{\"runtimeType\":\"io.containerd.runc.v2\",\"runtimePath\":\"\",\"PodAnnotations\":null,\"ContainerAnnotations\":null,\"options\":{\"BinaryName\":\"\",\"CriuImagePath\":\"\",\"CriuWorkPath\":\"\",\"IoGid\":0,\"IoUid\":0,\"NoNewKeyring\":false,\"Root\":\"\",\"ShimCgroup\":\"\",\"SystemdCgroup\":true},\"privileged_without_host_devices\":false,\"privileged_without_host_devices_all_devices_allowed\":false,\"baseRuntimeSpec\":\"\",\"cniConfDir\":\"\",\"cniMaxConfNum\":0,\"snapshotter\":\"\",\"sandboxer\":\"podsandbox\",\"io_type\":\"\"}},\"ignoreBlockIONotEnabledErrors\":false,\"ignoreRdtNotEnabledErrors\":false},\"cni\":{\"binDir\":\"/opt/cni/bin\",\"confDir\":\"/etc/cni/net.d\",\"maxConfNum\":1,\"setupSerially\":false,\"confTemplate\":\"\",\"ipPref\":\"\",\"useInternalLoopback\":false},\"enableSelinux\":true,\"selinuxCategoryRange\":1024,\"maxContainerLogSize\":16384,\"disableApparmor\":false,\"restrictOOMScoreAdj\":false,\"disableProcMount\":false,\"unsetSeccompProfile\":\"\",\"tolerateMissingHugetlbController\":true,\"disableHugetlbController\":true,\"device_ownership_from_security_context\":false,\"ignoreImageDefinedVolumes\":false,\"netnsMountsUnderStateDir\":false,\"enableUnprivilegedPorts\":true,\"enableUnprivilegedICMP\":true,\"enableCDI\":true,\"cdiSpecDirs\":[\"/etc/cdi\",\"/var/run/cdi\"],\"drainExecSyncIOTimeout\":\"0s\",\"ignoreDeprecationWarnings\":null,\"containerdRootDir\":\"/var/lib/containerd\",\"containerdEndpoint\":\"/run/containerd/containerd.sock\",\"rootDir\":\"/var/lib/containerd/io.containerd.grpc.v1.cri\",\"stateDir\":\"/run/containerd/io.containerd.grpc.v1.cri\"}" Oct 28 04:39:26.087711 containerd[1890]: time="2025-10-28T04:39:26.087657907Z" level=info msg="loading plugin" id=io.containerd.podsandbox.controller.v1.podsandbox type=io.containerd.podsandbox.controller.v1 Oct 28 04:39:26.088371 containerd[1890]: time="2025-10-28T04:39:26.088331983Z" level=info msg="loading plugin" id=io.containerd.sandbox.controller.v1.shim type=io.containerd.sandbox.controller.v1 Oct 28 04:39:26.089254 containerd[1890]: time="2025-10-28T04:39:26.089214199Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.sandbox-controllers type=io.containerd.grpc.v1 Oct 28 04:39:26.089637 containerd[1890]: time="2025-10-28T04:39:26.089603659Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.sandboxes type=io.containerd.grpc.v1 Oct 28 04:39:26.089925 containerd[1890]: time="2025-10-28T04:39:26.089895271Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.snapshots type=io.containerd.grpc.v1 Oct 28 04:39:26.090032 containerd[1890]: time="2025-10-28T04:39:26.090005815Z" level=info msg="loading plugin" id=io.containerd.streaming.v1.manager type=io.containerd.streaming.v1 Oct 28 04:39:26.090136 containerd[1890]: time="2025-10-28T04:39:26.090110011Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.streaming type=io.containerd.grpc.v1 Oct 28 04:39:26.090278 containerd[1890]: time="2025-10-28T04:39:26.090250699Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.tasks type=io.containerd.grpc.v1 Oct 28 04:39:26.090380 containerd[1890]: time="2025-10-28T04:39:26.090354283Z" level=info msg="loading plugin" id=io.containerd.transfer.v1.local type=io.containerd.transfer.v1 Oct 28 04:39:26.091114 containerd[1890]: time="2025-10-28T04:39:26.090863239Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.transfer type=io.containerd.grpc.v1 Oct 28 04:39:26.091114 containerd[1890]: time="2025-10-28T04:39:26.090904411Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.version type=io.containerd.grpc.v1 Oct 28 04:39:26.091114 containerd[1890]: time="2025-10-28T04:39:26.090935443Z" level=info msg="loading plugin" id=io.containerd.monitor.container.v1.restart type=io.containerd.monitor.container.v1 Oct 28 04:39:26.091114 containerd[1890]: time="2025-10-28T04:39:26.091053103Z" level=info msg="loading plugin" id=io.containerd.tracing.processor.v1.otlp type=io.containerd.tracing.processor.v1 Oct 28 04:39:26.091458 containerd[1890]: time="2025-10-28T04:39:26.091085815Z" level=info msg="skip loading plugin" error="skip plugin: tracing endpoint not configured" id=io.containerd.tracing.processor.v1.otlp type=io.containerd.tracing.processor.v1 Oct 28 04:39:26.092006 containerd[1890]: time="2025-10-28T04:39:26.091531963Z" level=info msg="loading plugin" id=io.containerd.internal.v1.tracing type=io.containerd.internal.v1 Oct 28 04:39:26.092006 containerd[1890]: time="2025-10-28T04:39:26.091566007Z" level=info msg="skip loading plugin" error="skip plugin: tracing endpoint not configured" id=io.containerd.internal.v1.tracing type=io.containerd.internal.v1 Oct 28 04:39:26.092006 containerd[1890]: time="2025-10-28T04:39:26.091589287Z" level=info msg="loading plugin" id=io.containerd.ttrpc.v1.otelttrpc type=io.containerd.ttrpc.v1 Oct 28 04:39:26.092006 containerd[1890]: time="2025-10-28T04:39:26.091614535Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.healthcheck type=io.containerd.grpc.v1 Oct 28 04:39:26.092006 containerd[1890]: time="2025-10-28T04:39:26.091640587Z" level=info msg="loading plugin" id=io.containerd.nri.v1.nri type=io.containerd.nri.v1 Oct 28 04:39:26.092006 containerd[1890]: time="2025-10-28T04:39:26.091809727Z" level=info msg="runtime interface created" Oct 28 04:39:26.092006 containerd[1890]: time="2025-10-28T04:39:26.091828003Z" level=info msg="created NRI interface" Oct 28 04:39:26.092006 containerd[1890]: time="2025-10-28T04:39:26.091851247Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.cri type=io.containerd.grpc.v1 Oct 28 04:39:26.092006 containerd[1890]: time="2025-10-28T04:39:26.091882075Z" level=info msg="Connect containerd service" Oct 28 04:39:26.092006 containerd[1890]: time="2025-10-28T04:39:26.091938223Z" level=info msg="using experimental NRI integration - disable nri plugin to prevent this" Oct 28 04:39:26.097084 containerd[1890]: time="2025-10-28T04:39:26.096361291Z" level=error msg="failed to load cni during init, please check CRI plugin status before setting up network for pods" error="cni config load failed: no network config found in /etc/cni/net.d: cni plugin not initialized: failed to load cni config" Oct 28 04:39:26.099417 locksmithd[1928]: locksmithd starting currentOperation="UPDATE_STATUS_IDLE" strategy="reboot" Oct 28 04:39:26.128211 amazon-ssm-agent[1925]: 2025-10-28 04:39:25.7748 INFO [amazon-ssm-agent] OS: linux, Arch: arm64 Oct 28 04:39:26.226592 amazon-ssm-agent[1925]: 2025-10-28 04:39:25.7748 INFO [amazon-ssm-agent] Starting Core Agent Oct 28 04:39:26.327812 amazon-ssm-agent[1925]: 2025-10-28 04:39:25.7748 INFO [amazon-ssm-agent] Registrar detected. Attempting registration Oct 28 04:39:26.382975 polkitd[2025]: Started polkitd version 126 Oct 28 04:39:26.428318 amazon-ssm-agent[1925]: 2025-10-28 04:39:25.7748 INFO [Registrar] Starting registrar module Oct 28 04:39:26.450943 polkitd[2025]: Loading rules from directory /etc/polkit-1/rules.d Oct 28 04:39:26.455949 polkitd[2025]: Loading rules from directory /run/polkit-1/rules.d Oct 28 04:39:26.457277 polkitd[2025]: Error opening rules directory: Error opening directory “/run/polkit-1/rules.d”: No such file or directory (g-file-error-quark, 4) Oct 28 04:39:26.458023 polkitd[2025]: Loading rules from directory /usr/local/share/polkit-1/rules.d Oct 28 04:39:26.461276 polkitd[2025]: Error opening rules directory: Error opening directory “/usr/local/share/polkit-1/rules.d”: No such file or directory (g-file-error-quark, 4) Oct 28 04:39:26.461366 polkitd[2025]: Loading rules from directory /usr/share/polkit-1/rules.d Oct 28 04:39:26.462273 polkitd[2025]: Finished loading, compiling and executing 2 rules Oct 28 04:39:26.462816 systemd[1]: Started polkit.service - Authorization Manager. Oct 28 04:39:26.471533 dbus-daemon[1856]: [system] Successfully activated service 'org.freedesktop.PolicyKit1' Oct 28 04:39:26.474325 polkitd[2025]: Acquired the name org.freedesktop.PolicyKit1 on the system bus Oct 28 04:39:26.524983 systemd-hostnamed[1927]: Hostname set to (transient) Oct 28 04:39:26.525527 systemd-resolved[1475]: System hostname changed to 'ip-172-31-30-14'. Oct 28 04:39:26.529186 amazon-ssm-agent[1925]: 2025-10-28 04:39:25.7883 INFO [EC2Identity] Checking disk for registration info Oct 28 04:39:26.590071 containerd[1890]: time="2025-10-28T04:39:26.589762389Z" level=info msg="Start subscribing containerd event" Oct 28 04:39:26.590071 containerd[1890]: time="2025-10-28T04:39:26.589874241Z" level=info msg="Start recovering state" Oct 28 04:39:26.590450 containerd[1890]: time="2025-10-28T04:39:26.590310549Z" level=info msg="Start event monitor" Oct 28 04:39:26.591769 containerd[1890]: time="2025-10-28T04:39:26.591219885Z" level=info msg="Start cni network conf syncer for default" Oct 28 04:39:26.591769 containerd[1890]: time="2025-10-28T04:39:26.591252729Z" level=info msg="Start streaming server" Oct 28 04:39:26.591769 containerd[1890]: time="2025-10-28T04:39:26.591482901Z" level=info msg="Registered namespace \"k8s.io\" with NRI" Oct 28 04:39:26.591769 containerd[1890]: time="2025-10-28T04:39:26.591502197Z" level=info msg="runtime interface starting up..." Oct 28 04:39:26.591769 containerd[1890]: time="2025-10-28T04:39:26.591517209Z" level=info msg="starting plugins..." Oct 28 04:39:26.591769 containerd[1890]: time="2025-10-28T04:39:26.591560973Z" level=info msg="Synchronizing NRI (plugin) with current runtime state" Oct 28 04:39:26.597476 containerd[1890]: time="2025-10-28T04:39:26.595669917Z" level=info msg=serving... address=/run/containerd/containerd.sock.ttrpc Oct 28 04:39:26.597476 containerd[1890]: time="2025-10-28T04:39:26.595800165Z" level=info msg=serving... address=/run/containerd/containerd.sock Oct 28 04:39:26.597476 containerd[1890]: time="2025-10-28T04:39:26.595913553Z" level=info msg="containerd successfully booted in 0.576788s" Oct 28 04:39:26.596108 systemd[1]: Started containerd.service - containerd container runtime. Oct 28 04:39:26.636008 amazon-ssm-agent[1925]: 2025-10-28 04:39:25.7884 INFO [EC2Identity] No registration info found for ec2 instance, attempting registration Oct 28 04:39:26.740185 amazon-ssm-agent[1925]: 2025-10-28 04:39:25.7885 INFO [EC2Identity] Generating registration keypair Oct 28 04:39:26.825379 tar[1878]: linux-arm64/README.md Oct 28 04:39:26.867305 systemd[1]: Finished prepare-helm.service - Unpack helm to /opt/bin. Oct 28 04:39:26.978956 sshd_keygen[1914]: ssh-keygen: generating new host keys: RSA ECDSA ED25519 Oct 28 04:39:26.991512 amazon-ssm-agent[1925]: 2025-10-28 04:39:26.9912 INFO [EC2Identity] Checking write access before registering Oct 28 04:39:27.024103 systemd[1]: Finished sshd-keygen.service - Generate sshd host keys. Oct 28 04:39:27.031849 systemd[1]: Starting issuegen.service - Generate /run/issue... Oct 28 04:39:27.039207 amazon-ssm-agent[1925]: 2025/10/28 04:39:27 Found config file at /etc/amazon/ssm/amazon-ssm-agent.json. Oct 28 04:39:27.039207 amazon-ssm-agent[1925]: Applying config override from /etc/amazon/ssm/amazon-ssm-agent.json. Oct 28 04:39:27.039369 amazon-ssm-agent[1925]: 2025/10/28 04:39:27 processing appconfig overrides Oct 28 04:39:27.060624 systemd[1]: issuegen.service: Deactivated successfully. Oct 28 04:39:27.061110 systemd[1]: Finished issuegen.service - Generate /run/issue. Oct 28 04:39:27.069691 systemd[1]: Starting systemd-user-sessions.service - Permit User Sessions... Oct 28 04:39:27.072453 amazon-ssm-agent[1925]: 2025-10-28 04:39:26.9920 INFO [EC2Identity] Registering EC2 instance with Systems Manager Oct 28 04:39:27.072762 amazon-ssm-agent[1925]: 2025-10-28 04:39:27.0369 INFO [EC2Identity] EC2 registration was successful. Oct 28 04:39:27.072762 amazon-ssm-agent[1925]: 2025-10-28 04:39:27.0372 INFO [amazon-ssm-agent] Registration attempted. Resuming core agent startup. Oct 28 04:39:27.073086 amazon-ssm-agent[1925]: 2025-10-28 04:39:27.0379 INFO [CredentialRefresher] credentialRefresher has started Oct 28 04:39:27.073086 amazon-ssm-agent[1925]: 2025-10-28 04:39:27.0380 INFO [CredentialRefresher] Starting credentials refresher loop Oct 28 04:39:27.073086 amazon-ssm-agent[1925]: 2025-10-28 04:39:27.0700 INFO EC2RoleProvider Successfully connected with instance profile role credentials Oct 28 04:39:27.073086 amazon-ssm-agent[1925]: 2025-10-28 04:39:27.0722 INFO [CredentialRefresher] Credentials ready Oct 28 04:39:27.092883 amazon-ssm-agent[1925]: 2025-10-28 04:39:27.0730 INFO [CredentialRefresher] Next credential rotation will be in 29.9999497337 minutes Oct 28 04:39:27.103858 systemd[1]: Finished systemd-user-sessions.service - Permit User Sessions. Oct 28 04:39:27.110942 systemd[1]: Started getty@tty1.service - Getty on tty1. Oct 28 04:39:27.118743 systemd[1]: Started serial-getty@ttyS0.service - Serial Getty on ttyS0. Oct 28 04:39:27.121688 systemd[1]: Reached target getty.target - Login Prompts. Oct 28 04:39:28.100847 amazon-ssm-agent[1925]: 2025-10-28 04:39:28.1004 INFO [amazon-ssm-agent] [LongRunningWorkerContainer] [WorkerProvider] Worker ssm-agent-worker is not running, starting worker process Oct 28 04:39:28.201736 amazon-ssm-agent[1925]: 2025-10-28 04:39:28.1038 INFO [amazon-ssm-agent] [LongRunningWorkerContainer] [WorkerProvider] Worker ssm-agent-worker (pid:2136) started Oct 28 04:39:28.302203 amazon-ssm-agent[1925]: 2025-10-28 04:39:28.1038 INFO [amazon-ssm-agent] [LongRunningWorkerContainer] Monitor long running worker health every 60 seconds Oct 28 04:39:29.251876 systemd[1]: Started kubelet.service - kubelet: The Kubernetes Node Agent. Oct 28 04:39:29.256054 systemd[1]: Reached target multi-user.target - Multi-User System. Oct 28 04:39:29.266351 systemd[1]: Startup finished in 3.717s (kernel) + 11.949s (initrd) + 14.299s (userspace) = 29.967s. Oct 28 04:39:29.270683 (kubelet)[2152]: kubelet.service: Referenced but unset environment variable evaluates to an empty string: KUBELET_EXTRA_ARGS, KUBELET_KUBEADM_ARGS Oct 28 04:39:30.335219 systemd[1]: Created slice system-sshd.slice - Slice /system/sshd. Oct 28 04:39:30.337906 systemd[1]: Started sshd@0-172.31.30.14:22-147.75.109.163:42248.service - OpenSSH per-connection server daemon (147.75.109.163:42248). Oct 28 04:39:30.568487 sshd[2162]: Accepted publickey for core from 147.75.109.163 port 42248 ssh2: RSA SHA256:n8I+mfZFO+vpjscdCCq4ICa9JhGSHCmaRNUJmvrCQJg Oct 28 04:39:30.573753 sshd-session[2162]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Oct 28 04:39:30.592841 systemd[1]: Created slice user-500.slice - User Slice of UID 500. Oct 28 04:39:30.596559 systemd[1]: Starting user-runtime-dir@500.service - User Runtime Directory /run/user/500... Oct 28 04:39:30.612852 systemd-logind[1871]: New session 1 of user core. Oct 28 04:39:30.638470 systemd[1]: Finished user-runtime-dir@500.service - User Runtime Directory /run/user/500. Oct 28 04:39:30.648673 systemd[1]: Starting user@500.service - User Manager for UID 500... Oct 28 04:39:30.669739 (systemd)[2167]: pam_unix(systemd-user:session): session opened for user core(uid=500) by (uid=0) Oct 28 04:39:30.675911 systemd-logind[1871]: New session c1 of user core. Oct 28 04:39:31.031056 systemd[2167]: Queued start job for default target default.target. Oct 28 04:39:31.040935 systemd[2167]: Created slice app.slice - User Application Slice. Oct 28 04:39:31.041280 systemd[2167]: Reached target paths.target - Paths. Oct 28 04:39:31.041791 systemd[2167]: Reached target timers.target - Timers. Oct 28 04:39:31.045572 systemd[2167]: Starting dbus.socket - D-Bus User Message Bus Socket... Oct 28 04:39:31.080815 systemd[2167]: Listening on dbus.socket - D-Bus User Message Bus Socket. Oct 28 04:39:31.081044 systemd[2167]: Reached target sockets.target - Sockets. Oct 28 04:39:31.081130 systemd[2167]: Reached target basic.target - Basic System. Oct 28 04:39:31.081906 systemd[1]: Started user@500.service - User Manager for UID 500. Oct 28 04:39:31.082122 systemd[2167]: Reached target default.target - Main User Target. Oct 28 04:39:31.082244 systemd[2167]: Startup finished in 388ms. Oct 28 04:39:31.094455 systemd[1]: Started session-1.scope - Session 1 of User core. Oct 28 04:39:31.150045 kubelet[2152]: E1028 04:39:31.147362 2152 run.go:72] "command failed" err="failed to load kubelet config file, path: /var/lib/kubelet/config.yaml, error: failed to load Kubelet config file /var/lib/kubelet/config.yaml, error failed to read kubelet config file \"/var/lib/kubelet/config.yaml\", error: open /var/lib/kubelet/config.yaml: no such file or directory" Oct 28 04:39:31.153425 systemd[1]: kubelet.service: Main process exited, code=exited, status=1/FAILURE Oct 28 04:39:31.153717 systemd[1]: kubelet.service: Failed with result 'exit-code'. Oct 28 04:39:31.154729 systemd[1]: kubelet.service: Consumed 1.445s CPU time, 262.2M memory peak. Oct 28 04:39:31.189678 systemd[1]: Started sshd@1-172.31.30.14:22-147.75.109.163:40458.service - OpenSSH per-connection server daemon (147.75.109.163:40458). Oct 28 04:39:31.380484 sshd[2180]: Accepted publickey for core from 147.75.109.163 port 40458 ssh2: RSA SHA256:n8I+mfZFO+vpjscdCCq4ICa9JhGSHCmaRNUJmvrCQJg Oct 28 04:39:31.382885 sshd-session[2180]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Oct 28 04:39:31.391920 systemd-logind[1871]: New session 2 of user core. Oct 28 04:39:31.417420 systemd[1]: Started session-2.scope - Session 2 of User core. Oct 28 04:39:31.480964 sshd[2183]: Connection closed by 147.75.109.163 port 40458 Oct 28 04:39:31.481738 sshd-session[2180]: pam_unix(sshd:session): session closed for user core Oct 28 04:39:31.488714 systemd[1]: sshd@1-172.31.30.14:22-147.75.109.163:40458.service: Deactivated successfully. Oct 28 04:39:31.493830 systemd[1]: session-2.scope: Deactivated successfully. Oct 28 04:39:31.496063 systemd-logind[1871]: Session 2 logged out. Waiting for processes to exit. Oct 28 04:39:31.498528 systemd-logind[1871]: Removed session 2. Oct 28 04:39:31.524477 systemd[1]: Started sshd@2-172.31.30.14:22-147.75.109.163:40474.service - OpenSSH per-connection server daemon (147.75.109.163:40474). Oct 28 04:39:31.703713 sshd[2189]: Accepted publickey for core from 147.75.109.163 port 40474 ssh2: RSA SHA256:n8I+mfZFO+vpjscdCCq4ICa9JhGSHCmaRNUJmvrCQJg Oct 28 04:39:31.706389 sshd-session[2189]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Oct 28 04:39:31.714263 systemd-logind[1871]: New session 3 of user core. Oct 28 04:39:31.725439 systemd[1]: Started session-3.scope - Session 3 of User core. Oct 28 04:39:31.780884 sshd[2192]: Connection closed by 147.75.109.163 port 40474 Oct 28 04:39:31.781663 sshd-session[2189]: pam_unix(sshd:session): session closed for user core Oct 28 04:39:31.790099 systemd[1]: sshd@2-172.31.30.14:22-147.75.109.163:40474.service: Deactivated successfully. Oct 28 04:39:31.794036 systemd[1]: session-3.scope: Deactivated successfully. Oct 28 04:39:31.797286 systemd-logind[1871]: Session 3 logged out. Waiting for processes to exit. Oct 28 04:39:31.799288 systemd-logind[1871]: Removed session 3. Oct 28 04:39:31.507236 systemd-resolved[1475]: Clock change detected. Flushing caches. Oct 28 04:39:31.521360 systemd-journald[1401]: Time jumped backwards, rotating. Oct 28 04:39:31.514791 systemd[1]: Started sshd@3-172.31.30.14:22-147.75.109.163:40484.service - OpenSSH per-connection server daemon (147.75.109.163:40484). Oct 28 04:39:31.692832 sshd[2198]: Accepted publickey for core from 147.75.109.163 port 40484 ssh2: RSA SHA256:n8I+mfZFO+vpjscdCCq4ICa9JhGSHCmaRNUJmvrCQJg Oct 28 04:39:31.695008 sshd-session[2198]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Oct 28 04:39:31.704491 systemd-logind[1871]: New session 4 of user core. Oct 28 04:39:31.709950 systemd[1]: Started session-4.scope - Session 4 of User core. Oct 28 04:39:31.774774 sshd[2202]: Connection closed by 147.75.109.163 port 40484 Oct 28 04:39:31.772954 sshd-session[2198]: pam_unix(sshd:session): session closed for user core Oct 28 04:39:31.779467 systemd[1]: sshd@3-172.31.30.14:22-147.75.109.163:40484.service: Deactivated successfully. Oct 28 04:39:31.782290 systemd[1]: session-4.scope: Deactivated successfully. Oct 28 04:39:31.786794 systemd-logind[1871]: Session 4 logged out. Waiting for processes to exit. Oct 28 04:39:31.788418 systemd-logind[1871]: Removed session 4. Oct 28 04:39:31.809108 systemd[1]: Started sshd@4-172.31.30.14:22-147.75.109.163:40498.service - OpenSSH per-connection server daemon (147.75.109.163:40498). Oct 28 04:39:31.993906 sshd[2208]: Accepted publickey for core from 147.75.109.163 port 40498 ssh2: RSA SHA256:n8I+mfZFO+vpjscdCCq4ICa9JhGSHCmaRNUJmvrCQJg Oct 28 04:39:31.996230 sshd-session[2208]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Oct 28 04:39:32.004190 systemd-logind[1871]: New session 5 of user core. Oct 28 04:39:32.024939 systemd[1]: Started session-5.scope - Session 5 of User core. Oct 28 04:39:32.082479 sudo[2212]: core : PWD=/home/core ; USER=root ; COMMAND=/usr/sbin/setenforce 1 Oct 28 04:39:32.083547 sudo[2212]: pam_unix(sudo:session): session opened for user root(uid=0) by core(uid=500) Oct 28 04:39:32.107992 sudo[2212]: pam_unix(sudo:session): session closed for user root Oct 28 04:39:32.131568 sshd[2211]: Connection closed by 147.75.109.163 port 40498 Oct 28 04:39:32.132550 sshd-session[2208]: pam_unix(sshd:session): session closed for user core Oct 28 04:39:32.141753 systemd[1]: sshd@4-172.31.30.14:22-147.75.109.163:40498.service: Deactivated successfully. Oct 28 04:39:32.146292 systemd[1]: session-5.scope: Deactivated successfully. Oct 28 04:39:32.148103 systemd-logind[1871]: Session 5 logged out. Waiting for processes to exit. Oct 28 04:39:32.150801 systemd-logind[1871]: Removed session 5. Oct 28 04:39:32.168994 systemd[1]: Started sshd@5-172.31.30.14:22-147.75.109.163:40514.service - OpenSSH per-connection server daemon (147.75.109.163:40514). Oct 28 04:39:32.353209 sshd[2218]: Accepted publickey for core from 147.75.109.163 port 40514 ssh2: RSA SHA256:n8I+mfZFO+vpjscdCCq4ICa9JhGSHCmaRNUJmvrCQJg Oct 28 04:39:32.355567 sshd-session[2218]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Oct 28 04:39:32.364758 systemd-logind[1871]: New session 6 of user core. Oct 28 04:39:32.372924 systemd[1]: Started session-6.scope - Session 6 of User core. Oct 28 04:39:32.417252 sudo[2223]: core : PWD=/home/core ; USER=root ; COMMAND=/usr/sbin/rm -rf /etc/audit/rules.d/80-selinux.rules /etc/audit/rules.d/99-default.rules Oct 28 04:39:32.417922 sudo[2223]: pam_unix(sudo:session): session opened for user root(uid=0) by core(uid=500) Oct 28 04:39:32.427136 sudo[2223]: pam_unix(sudo:session): session closed for user root Oct 28 04:39:32.439002 sudo[2222]: core : PWD=/home/core ; USER=root ; COMMAND=/usr/sbin/systemctl restart audit-rules Oct 28 04:39:32.439567 sudo[2222]: pam_unix(sudo:session): session opened for user root(uid=0) by core(uid=500) Oct 28 04:39:32.456542 systemd[1]: Starting audit-rules.service - Load Audit Rules... Oct 28 04:39:32.516024 augenrules[2245]: No rules Oct 28 04:39:32.518311 systemd[1]: audit-rules.service: Deactivated successfully. Oct 28 04:39:32.518840 systemd[1]: Finished audit-rules.service - Load Audit Rules. Oct 28 04:39:32.520927 sudo[2222]: pam_unix(sudo:session): session closed for user root Oct 28 04:39:32.544561 sshd[2221]: Connection closed by 147.75.109.163 port 40514 Oct 28 04:39:32.545328 sshd-session[2218]: pam_unix(sshd:session): session closed for user core Oct 28 04:39:32.552726 systemd[1]: sshd@5-172.31.30.14:22-147.75.109.163:40514.service: Deactivated successfully. Oct 28 04:39:32.555549 systemd[1]: session-6.scope: Deactivated successfully. Oct 28 04:39:32.557119 systemd-logind[1871]: Session 6 logged out. Waiting for processes to exit. Oct 28 04:39:32.560227 systemd-logind[1871]: Removed session 6. Oct 28 04:39:32.585080 systemd[1]: Started sshd@6-172.31.30.14:22-147.75.109.163:40526.service - OpenSSH per-connection server daemon (147.75.109.163:40526). Oct 28 04:39:32.771905 sshd[2254]: Accepted publickey for core from 147.75.109.163 port 40526 ssh2: RSA SHA256:n8I+mfZFO+vpjscdCCq4ICa9JhGSHCmaRNUJmvrCQJg Oct 28 04:39:32.774196 sshd-session[2254]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Oct 28 04:39:32.783759 systemd-logind[1871]: New session 7 of user core. Oct 28 04:39:32.790936 systemd[1]: Started session-7.scope - Session 7 of User core. Oct 28 04:39:32.834549 sudo[2258]: core : PWD=/home/core ; USER=root ; COMMAND=/home/core/install.sh Oct 28 04:39:32.835191 sudo[2258]: pam_unix(sudo:session): session opened for user root(uid=0) by core(uid=500) Oct 28 04:39:34.037220 systemd[1]: Starting docker.service - Docker Application Container Engine... Oct 28 04:39:34.069135 (dockerd)[2275]: docker.service: Referenced but unset environment variable evaluates to an empty string: DOCKER_CGROUPS, DOCKER_OPTS, DOCKER_OPT_BIP, DOCKER_OPT_IPMASQ, DOCKER_OPT_MTU Oct 28 04:39:35.127985 dockerd[2275]: time="2025-10-28T04:39:35.127913325Z" level=info msg="Starting up" Oct 28 04:39:35.132309 dockerd[2275]: time="2025-10-28T04:39:35.132263962Z" level=info msg="OTEL tracing is not configured, using no-op tracer provider" Oct 28 04:39:35.155174 dockerd[2275]: time="2025-10-28T04:39:35.155115238Z" level=info msg="Creating a containerd client" address=/var/run/docker/libcontainerd/docker-containerd.sock timeout=1m0s Oct 28 04:39:35.193296 systemd[1]: var-lib-docker-check\x2doverlayfs\x2dsupport256304666-merged.mount: Deactivated successfully. Oct 28 04:39:35.210893 systemd[1]: var-lib-docker-metacopy\x2dcheck1121880490-merged.mount: Deactivated successfully. Oct 28 04:39:35.230945 dockerd[2275]: time="2025-10-28T04:39:35.230732362Z" level=info msg="Loading containers: start." Oct 28 04:39:35.284719 kernel: Initializing XFRM netlink socket Oct 28 04:39:35.782208 (udev-worker)[2297]: Network interface NamePolicy= disabled on kernel command line. Oct 28 04:39:35.860541 systemd-networkd[1494]: docker0: Link UP Oct 28 04:39:35.870411 dockerd[2275]: time="2025-10-28T04:39:35.870322813Z" level=info msg="Loading containers: done." Oct 28 04:39:35.904691 dockerd[2275]: time="2025-10-28T04:39:35.903979957Z" level=warning msg="Not using native diff for overlay2, this may cause degraded performance for building images: kernel has CONFIG_OVERLAY_FS_REDIRECT_DIR enabled" storage-driver=overlay2 Oct 28 04:39:35.904691 dockerd[2275]: time="2025-10-28T04:39:35.904099945Z" level=info msg="Docker daemon" commit=6430e49a55babd9b8f4d08e70ecb2b68900770fe containerd-snapshotter=false storage-driver=overlay2 version=28.0.4 Oct 28 04:39:35.904691 dockerd[2275]: time="2025-10-28T04:39:35.904387285Z" level=info msg="Initializing buildkit" Oct 28 04:39:35.955308 dockerd[2275]: time="2025-10-28T04:39:35.955258586Z" level=info msg="Completed buildkit initialization" Oct 28 04:39:35.970625 dockerd[2275]: time="2025-10-28T04:39:35.970548650Z" level=info msg="Daemon has completed initialization" Oct 28 04:39:35.971174 dockerd[2275]: time="2025-10-28T04:39:35.970952990Z" level=info msg="API listen on /run/docker.sock" Oct 28 04:39:35.972155 systemd[1]: Started docker.service - Docker Application Container Engine. Oct 28 04:39:36.185745 systemd[1]: var-lib-docker-overlay2-opaque\x2dbug\x2dcheck2578052408-merged.mount: Deactivated successfully. Oct 28 04:39:37.822908 containerd[1890]: time="2025-10-28T04:39:37.822843411Z" level=info msg="PullImage \"registry.k8s.io/kube-apiserver:v1.33.5\"" Oct 28 04:39:38.456151 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount2186479362.mount: Deactivated successfully. Oct 28 04:39:39.905726 containerd[1890]: time="2025-10-28T04:39:39.905159081Z" level=info msg="ImageCreate event name:\"registry.k8s.io/kube-apiserver:v1.33.5\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Oct 28 04:39:39.907386 containerd[1890]: time="2025-10-28T04:39:39.907307897Z" level=info msg="stop pulling image registry.k8s.io/kube-apiserver:v1.33.5: active requests=0, bytes read=27390228" Oct 28 04:39:39.910179 containerd[1890]: time="2025-10-28T04:39:39.910103033Z" level=info msg="ImageCreate event name:\"sha256:6a7fd297b49102b08dc3d8d4fd7f1538bcf21d3131eae8bf62ba26ce3283237f\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Oct 28 04:39:39.916397 containerd[1890]: time="2025-10-28T04:39:39.916334885Z" level=info msg="ImageCreate event name:\"registry.k8s.io/kube-apiserver@sha256:1b9c6c00bc1fe86860e72efb8e4148f9e436a132eba4ca636ca4f48d61d6dfb4\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Oct 28 04:39:39.917762 containerd[1890]: time="2025-10-28T04:39:39.917712245Z" level=info msg="Pulled image \"registry.k8s.io/kube-apiserver:v1.33.5\" with image id \"sha256:6a7fd297b49102b08dc3d8d4fd7f1538bcf21d3131eae8bf62ba26ce3283237f\", repo tag \"registry.k8s.io/kube-apiserver:v1.33.5\", repo digest \"registry.k8s.io/kube-apiserver@sha256:1b9c6c00bc1fe86860e72efb8e4148f9e436a132eba4ca636ca4f48d61d6dfb4\", size \"27386827\" in 2.094789586s" Oct 28 04:39:39.917880 containerd[1890]: time="2025-10-28T04:39:39.917771117Z" level=info msg="PullImage \"registry.k8s.io/kube-apiserver:v1.33.5\" returns image reference \"sha256:6a7fd297b49102b08dc3d8d4fd7f1538bcf21d3131eae8bf62ba26ce3283237f\"" Oct 28 04:39:39.920996 containerd[1890]: time="2025-10-28T04:39:39.920942897Z" level=info msg="PullImage \"registry.k8s.io/kube-controller-manager:v1.33.5\"" Oct 28 04:39:41.042650 systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 1. Oct 28 04:39:41.048367 systemd[1]: Starting kubelet.service - kubelet: The Kubernetes Node Agent... Oct 28 04:39:41.440267 systemd[1]: Started kubelet.service - kubelet: The Kubernetes Node Agent. Oct 28 04:39:41.455227 (kubelet)[2557]: kubelet.service: Referenced but unset environment variable evaluates to an empty string: KUBELET_EXTRA_ARGS, KUBELET_KUBEADM_ARGS Oct 28 04:39:41.540233 kubelet[2557]: E1028 04:39:41.539752 2557 run.go:72] "command failed" err="failed to load kubelet config file, path: /var/lib/kubelet/config.yaml, error: failed to load Kubelet config file /var/lib/kubelet/config.yaml, error failed to read kubelet config file \"/var/lib/kubelet/config.yaml\", error: open /var/lib/kubelet/config.yaml: no such file or directory" Oct 28 04:39:41.548504 systemd[1]: kubelet.service: Main process exited, code=exited, status=1/FAILURE Oct 28 04:39:41.549141 systemd[1]: kubelet.service: Failed with result 'exit-code'. Oct 28 04:39:41.551848 systemd[1]: kubelet.service: Consumed 334ms CPU time, 107.7M memory peak. Oct 28 04:39:41.927576 containerd[1890]: time="2025-10-28T04:39:41.927512191Z" level=info msg="ImageCreate event name:\"registry.k8s.io/kube-controller-manager:v1.33.5\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Oct 28 04:39:41.929252 containerd[1890]: time="2025-10-28T04:39:41.929196415Z" level=info msg="stop pulling image registry.k8s.io/kube-controller-manager:v1.33.5: active requests=0, bytes read=23547917" Oct 28 04:39:41.930877 containerd[1890]: time="2025-10-28T04:39:41.929925391Z" level=info msg="ImageCreate event name:\"sha256:2dd4c25a937008b7b8a6cdca70d816403b5078b51550926721b7a7762139cd23\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Oct 28 04:39:41.934757 containerd[1890]: time="2025-10-28T04:39:41.934709239Z" level=info msg="ImageCreate event name:\"registry.k8s.io/kube-controller-manager@sha256:1082a6ab67fb46397314dd36b36cb197ba4a4c5365033e9ad22bc7edaaaabd5c\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Oct 28 04:39:41.936852 containerd[1890]: time="2025-10-28T04:39:41.936792907Z" level=info msg="Pulled image \"registry.k8s.io/kube-controller-manager:v1.33.5\" with image id \"sha256:2dd4c25a937008b7b8a6cdca70d816403b5078b51550926721b7a7762139cd23\", repo tag \"registry.k8s.io/kube-controller-manager:v1.33.5\", repo digest \"registry.k8s.io/kube-controller-manager@sha256:1082a6ab67fb46397314dd36b36cb197ba4a4c5365033e9ad22bc7edaaaabd5c\", size \"25135832\" in 2.015794498s" Oct 28 04:39:41.936937 containerd[1890]: time="2025-10-28T04:39:41.936849247Z" level=info msg="PullImage \"registry.k8s.io/kube-controller-manager:v1.33.5\" returns image reference \"sha256:2dd4c25a937008b7b8a6cdca70d816403b5078b51550926721b7a7762139cd23\"" Oct 28 04:39:41.937682 containerd[1890]: time="2025-10-28T04:39:41.937622575Z" level=info msg="PullImage \"registry.k8s.io/kube-scheduler:v1.33.5\"" Oct 28 04:39:43.266699 containerd[1890]: time="2025-10-28T04:39:43.266224086Z" level=info msg="ImageCreate event name:\"registry.k8s.io/kube-scheduler:v1.33.5\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Oct 28 04:39:43.267760 containerd[1890]: time="2025-10-28T04:39:43.267699774Z" level=info msg="stop pulling image registry.k8s.io/kube-scheduler:v1.33.5: active requests=0, bytes read=18295977" Oct 28 04:39:43.269110 containerd[1890]: time="2025-10-28T04:39:43.269054262Z" level=info msg="ImageCreate event name:\"sha256:5e600beaed8620718e0650dd2721266869ce1d737488c004a869333273e6ec15\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Oct 28 04:39:43.273916 containerd[1890]: time="2025-10-28T04:39:43.273867402Z" level=info msg="ImageCreate event name:\"registry.k8s.io/kube-scheduler@sha256:3e7b57c9d9f06b77f0064e5be7f3df61e0151101160acd5fdecce911df28a189\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Oct 28 04:39:43.276055 containerd[1890]: time="2025-10-28T04:39:43.275881962Z" level=info msg="Pulled image \"registry.k8s.io/kube-scheduler:v1.33.5\" with image id \"sha256:5e600beaed8620718e0650dd2721266869ce1d737488c004a869333273e6ec15\", repo tag \"registry.k8s.io/kube-scheduler:v1.33.5\", repo digest \"registry.k8s.io/kube-scheduler@sha256:3e7b57c9d9f06b77f0064e5be7f3df61e0151101160acd5fdecce911df28a189\", size \"19883910\" in 1.338090391s" Oct 28 04:39:43.276055 containerd[1890]: time="2025-10-28T04:39:43.275930874Z" level=info msg="PullImage \"registry.k8s.io/kube-scheduler:v1.33.5\" returns image reference \"sha256:5e600beaed8620718e0650dd2721266869ce1d737488c004a869333273e6ec15\"" Oct 28 04:39:43.276488 containerd[1890]: time="2025-10-28T04:39:43.276454230Z" level=info msg="PullImage \"registry.k8s.io/kube-proxy:v1.33.5\"" Oct 28 04:39:44.587458 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount1364161511.mount: Deactivated successfully. Oct 28 04:39:45.202432 containerd[1890]: time="2025-10-28T04:39:45.202366112Z" level=info msg="ImageCreate event name:\"registry.k8s.io/kube-proxy:v1.33.5\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Oct 28 04:39:45.203774 containerd[1890]: time="2025-10-28T04:39:45.203578892Z" level=info msg="stop pulling image registry.k8s.io/kube-proxy:v1.33.5: active requests=0, bytes read=28240106" Oct 28 04:39:45.204814 containerd[1890]: time="2025-10-28T04:39:45.204758552Z" level=info msg="ImageCreate event name:\"sha256:021a8d45ab0c346664e47d95595ff5180ce90a22a681ea27904c65ae90788e70\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Oct 28 04:39:45.210407 containerd[1890]: time="2025-10-28T04:39:45.209128916Z" level=info msg="ImageCreate event name:\"registry.k8s.io/kube-proxy@sha256:71445ec84ad98bd52a7784865a9d31b1b50b56092d3f7699edc39eefd71befe1\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Oct 28 04:39:45.210407 containerd[1890]: time="2025-10-28T04:39:45.210221828Z" level=info msg="Pulled image \"registry.k8s.io/kube-proxy:v1.33.5\" with image id \"sha256:021a8d45ab0c346664e47d95595ff5180ce90a22a681ea27904c65ae90788e70\", repo tag \"registry.k8s.io/kube-proxy:v1.33.5\", repo digest \"registry.k8s.io/kube-proxy@sha256:71445ec84ad98bd52a7784865a9d31b1b50b56092d3f7699edc39eefd71befe1\", size \"28239125\" in 1.933603126s" Oct 28 04:39:45.210407 containerd[1890]: time="2025-10-28T04:39:45.210274232Z" level=info msg="PullImage \"registry.k8s.io/kube-proxy:v1.33.5\" returns image reference \"sha256:021a8d45ab0c346664e47d95595ff5180ce90a22a681ea27904c65ae90788e70\"" Oct 28 04:39:45.211829 containerd[1890]: time="2025-10-28T04:39:45.211782872Z" level=info msg="PullImage \"registry.k8s.io/coredns/coredns:v1.12.0\"" Oct 28 04:39:45.764803 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount4244666037.mount: Deactivated successfully. Oct 28 04:39:46.961259 containerd[1890]: time="2025-10-28T04:39:46.961190592Z" level=info msg="ImageCreate event name:\"registry.k8s.io/coredns/coredns:v1.12.0\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Oct 28 04:39:46.962982 containerd[1890]: time="2025-10-28T04:39:46.962929596Z" level=info msg="stop pulling image registry.k8s.io/coredns/coredns:v1.12.0: active requests=0, bytes read=19152117" Oct 28 04:39:46.964719 containerd[1890]: time="2025-10-28T04:39:46.964065360Z" level=info msg="ImageCreate event name:\"sha256:f72407be9e08c3a1b29a88318cbfee87b9f2da489f84015a5090b1e386e4dbc1\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Oct 28 04:39:46.970153 containerd[1890]: time="2025-10-28T04:39:46.970081176Z" level=info msg="ImageCreate event name:\"registry.k8s.io/coredns/coredns@sha256:40384aa1f5ea6bfdc77997d243aec73da05f27aed0c5e9d65bfa98933c519d97\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Oct 28 04:39:46.972789 containerd[1890]: time="2025-10-28T04:39:46.972269076Z" level=info msg="Pulled image \"registry.k8s.io/coredns/coredns:v1.12.0\" with image id \"sha256:f72407be9e08c3a1b29a88318cbfee87b9f2da489f84015a5090b1e386e4dbc1\", repo tag \"registry.k8s.io/coredns/coredns:v1.12.0\", repo digest \"registry.k8s.io/coredns/coredns@sha256:40384aa1f5ea6bfdc77997d243aec73da05f27aed0c5e9d65bfa98933c519d97\", size \"19148915\" in 1.760428964s" Oct 28 04:39:46.972789 containerd[1890]: time="2025-10-28T04:39:46.972329040Z" level=info msg="PullImage \"registry.k8s.io/coredns/coredns:v1.12.0\" returns image reference \"sha256:f72407be9e08c3a1b29a88318cbfee87b9f2da489f84015a5090b1e386e4dbc1\"" Oct 28 04:39:46.972978 containerd[1890]: time="2025-10-28T04:39:46.972916368Z" level=info msg="PullImage \"registry.k8s.io/pause:3.10\"" Oct 28 04:39:47.393172 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount2321893836.mount: Deactivated successfully. Oct 28 04:39:47.401605 containerd[1890]: time="2025-10-28T04:39:47.401524834Z" level=info msg="ImageCreate event name:\"registry.k8s.io/pause:3.10\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"} labels:{key:\"io.cri-containerd.pinned\" value:\"pinned\"}" Oct 28 04:39:47.402926 containerd[1890]: time="2025-10-28T04:39:47.402866206Z" level=info msg="stop pulling image registry.k8s.io/pause:3.10: active requests=0, bytes read=268703" Oct 28 04:39:47.404715 containerd[1890]: time="2025-10-28T04:39:47.403961854Z" level=info msg="ImageCreate event name:\"sha256:afb61768ce381961ca0beff95337601f29dc70ff3ed14e5e4b3e5699057e6aa8\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"} labels:{key:\"io.cri-containerd.pinned\" value:\"pinned\"}" Oct 28 04:39:47.408679 containerd[1890]: time="2025-10-28T04:39:47.407360842Z" level=info msg="ImageCreate event name:\"registry.k8s.io/pause@sha256:ee6521f290b2168b6e0935a181d4cff9be1ac3f505666ef0e3c98fae8199917a\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"} labels:{key:\"io.cri-containerd.pinned\" value:\"pinned\"}" Oct 28 04:39:47.408936 containerd[1890]: time="2025-10-28T04:39:47.408894694Z" level=info msg="Pulled image \"registry.k8s.io/pause:3.10\" with image id \"sha256:afb61768ce381961ca0beff95337601f29dc70ff3ed14e5e4b3e5699057e6aa8\", repo tag \"registry.k8s.io/pause:3.10\", repo digest \"registry.k8s.io/pause@sha256:ee6521f290b2168b6e0935a181d4cff9be1ac3f505666ef0e3c98fae8199917a\", size \"267933\" in 435.931082ms" Oct 28 04:39:47.409054 containerd[1890]: time="2025-10-28T04:39:47.409028086Z" level=info msg="PullImage \"registry.k8s.io/pause:3.10\" returns image reference \"sha256:afb61768ce381961ca0beff95337601f29dc70ff3ed14e5e4b3e5699057e6aa8\"" Oct 28 04:39:47.409721 containerd[1890]: time="2025-10-28T04:39:47.409684678Z" level=info msg="PullImage \"registry.k8s.io/etcd:3.5.21-0\"" Oct 28 04:39:47.933095 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount4090886509.mount: Deactivated successfully. Oct 28 04:39:50.255140 containerd[1890]: time="2025-10-28T04:39:50.255054289Z" level=info msg="ImageCreate event name:\"registry.k8s.io/etcd:3.5.21-0\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Oct 28 04:39:50.257161 containerd[1890]: time="2025-10-28T04:39:50.257035093Z" level=info msg="stop pulling image registry.k8s.io/etcd:3.5.21-0: active requests=0, bytes read=69465857" Oct 28 04:39:50.259100 containerd[1890]: time="2025-10-28T04:39:50.258143449Z" level=info msg="ImageCreate event name:\"sha256:31747a36ce712f0bf61b50a0c06e99768522025e7b8daedd6dc63d1ae84837b5\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Oct 28 04:39:50.263948 containerd[1890]: time="2025-10-28T04:39:50.263879281Z" level=info msg="ImageCreate event name:\"registry.k8s.io/etcd@sha256:d58c035df557080a27387d687092e3fc2b64c6d0e3162dc51453a115f847d121\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Oct 28 04:39:50.267455 containerd[1890]: time="2025-10-28T04:39:50.267365605Z" level=info msg="Pulled image \"registry.k8s.io/etcd:3.5.21-0\" with image id \"sha256:31747a36ce712f0bf61b50a0c06e99768522025e7b8daedd6dc63d1ae84837b5\", repo tag \"registry.k8s.io/etcd:3.5.21-0\", repo digest \"registry.k8s.io/etcd@sha256:d58c035df557080a27387d687092e3fc2b64c6d0e3162dc51453a115f847d121\", size \"70026017\" in 2.857491687s" Oct 28 04:39:50.267455 containerd[1890]: time="2025-10-28T04:39:50.267424633Z" level=info msg="PullImage \"registry.k8s.io/etcd:3.5.21-0\" returns image reference \"sha256:31747a36ce712f0bf61b50a0c06e99768522025e7b8daedd6dc63d1ae84837b5\"" Oct 28 04:39:51.619777 systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 2. Oct 28 04:39:51.624975 systemd[1]: Starting kubelet.service - kubelet: The Kubernetes Node Agent... Oct 28 04:39:51.957584 systemd[1]: Started kubelet.service - kubelet: The Kubernetes Node Agent. Oct 28 04:39:51.972136 (kubelet)[2716]: kubelet.service: Referenced but unset environment variable evaluates to an empty string: KUBELET_EXTRA_ARGS, KUBELET_KUBEADM_ARGS Oct 28 04:39:52.043371 kubelet[2716]: E1028 04:39:52.043313 2716 run.go:72] "command failed" err="failed to load kubelet config file, path: /var/lib/kubelet/config.yaml, error: failed to load Kubelet config file /var/lib/kubelet/config.yaml, error failed to read kubelet config file \"/var/lib/kubelet/config.yaml\", error: open /var/lib/kubelet/config.yaml: no such file or directory" Oct 28 04:39:52.048290 systemd[1]: kubelet.service: Main process exited, code=exited, status=1/FAILURE Oct 28 04:39:52.048834 systemd[1]: kubelet.service: Failed with result 'exit-code'. Oct 28 04:39:52.049827 systemd[1]: kubelet.service: Consumed 290ms CPU time, 104.2M memory peak. Oct 28 04:39:55.640290 systemd[1]: Stopped kubelet.service - kubelet: The Kubernetes Node Agent. Oct 28 04:39:55.641186 systemd[1]: kubelet.service: Consumed 290ms CPU time, 104.2M memory peak. Oct 28 04:39:55.646408 systemd[1]: Starting kubelet.service - kubelet: The Kubernetes Node Agent... Oct 28 04:39:55.704235 systemd[1]: Reload requested from client PID 2730 ('systemctl') (unit session-7.scope)... Oct 28 04:39:55.704275 systemd[1]: Reloading... Oct 28 04:39:55.975739 zram_generator::config[2779]: No configuration found. Oct 28 04:39:56.436893 systemd[1]: Reloading finished in 731 ms. Oct 28 04:39:56.496816 systemd[1]: systemd-hostnamed.service: Deactivated successfully. Oct 28 04:39:56.572578 systemd[1]: Stopping kubelet.service - kubelet: The Kubernetes Node Agent... Oct 28 04:39:56.576347 systemd[1]: kubelet.service: Deactivated successfully. Oct 28 04:39:56.576877 systemd[1]: Stopped kubelet.service - kubelet: The Kubernetes Node Agent. Oct 28 04:39:56.576971 systemd[1]: kubelet.service: Consumed 240ms CPU time, 95.1M memory peak. Oct 28 04:39:56.580820 systemd[1]: Starting kubelet.service - kubelet: The Kubernetes Node Agent... Oct 28 04:39:56.916298 systemd[1]: Started kubelet.service - kubelet: The Kubernetes Node Agent. Oct 28 04:39:56.930143 (kubelet)[2844]: kubelet.service: Referenced but unset environment variable evaluates to an empty string: KUBELET_EXTRA_ARGS Oct 28 04:39:57.006292 kubelet[2844]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 28 04:39:57.006931 kubelet[2844]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Oct 28 04:39:57.006931 kubelet[2844]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 28 04:39:57.007828 kubelet[2844]: I1028 04:39:57.007486 2844 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Oct 28 04:39:58.853702 kubelet[2844]: I1028 04:39:58.853098 2844 server.go:530] "Kubelet version" kubeletVersion="v1.33.0" Oct 28 04:39:58.853702 kubelet[2844]: I1028 04:39:58.853156 2844 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Oct 28 04:39:58.854285 kubelet[2844]: I1028 04:39:58.853822 2844 server.go:956] "Client rotation is on, will bootstrap in background" Oct 28 04:39:58.895994 kubelet[2844]: E1028 04:39:58.895911 2844 certificate_manager.go:596] "Failed while requesting a signed certificate from the control plane" err="cannot create certificate signing request: Post \"https://172.31.30.14:6443/apis/certificates.k8s.io/v1/certificatesigningrequests\": dial tcp 172.31.30.14:6443: connect: connection refused" logger="kubernetes.io/kube-apiserver-client-kubelet.UnhandledError" Oct 28 04:39:58.900215 kubelet[2844]: I1028 04:39:58.899963 2844 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" Oct 28 04:39:58.913570 kubelet[2844]: I1028 04:39:58.913538 2844 server.go:1446] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Oct 28 04:39:58.919702 kubelet[2844]: I1028 04:39:58.918922 2844 server.go:782] "--cgroups-per-qos enabled, but --cgroup-root was not specified. defaulting to /" Oct 28 04:39:58.919702 kubelet[2844]: I1028 04:39:58.919509 2844 container_manager_linux.go:267] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Oct 28 04:39:58.919950 kubelet[2844]: I1028 04:39:58.919560 2844 container_manager_linux.go:272] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-172-31-30-14","RuntimeCgroupsName":"","SystemCgroupsName":"","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":false,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":null,"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":-1,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Oct 28 04:39:58.920152 kubelet[2844]: I1028 04:39:58.920093 2844 topology_manager.go:138] "Creating topology manager with none policy" Oct 28 04:39:58.920152 kubelet[2844]: I1028 04:39:58.920117 2844 container_manager_linux.go:303] "Creating device plugin manager" Oct 28 04:39:58.920490 kubelet[2844]: I1028 04:39:58.920447 2844 state_mem.go:36] "Initialized new in-memory state store" Oct 28 04:39:58.927352 kubelet[2844]: I1028 04:39:58.927283 2844 kubelet.go:480] "Attempting to sync node with API server" Oct 28 04:39:58.927352 kubelet[2844]: I1028 04:39:58.927333 2844 kubelet.go:375] "Adding static pod path" path="/etc/kubernetes/manifests" Oct 28 04:39:58.929527 kubelet[2844]: I1028 04:39:58.928870 2844 kubelet.go:386] "Adding apiserver pod source" Oct 28 04:39:58.929527 kubelet[2844]: I1028 04:39:58.928913 2844 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Oct 28 04:39:58.937244 kubelet[2844]: E1028 04:39:58.937201 2844 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: Get \"https://172.31.30.14:6443/api/v1/nodes?fieldSelector=metadata.name%3Dip-172-31-30-14&limit=500&resourceVersion=0\": dial tcp 172.31.30.14:6443: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Oct 28 04:39:58.937645 kubelet[2844]: I1028 04:39:58.937616 2844 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="containerd" version="v2.0.5" apiVersion="v1" Oct 28 04:39:58.938983 kubelet[2844]: I1028 04:39:58.938954 2844 kubelet.go:935] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Oct 28 04:39:58.939328 kubelet[2844]: W1028 04:39:58.939308 2844 probe.go:272] Flexvolume plugin directory at /opt/libexec/kubernetes/kubelet-plugins/volume/exec/ does not exist. Recreating. Oct 28 04:39:58.946445 kubelet[2844]: I1028 04:39:58.945532 2844 watchdog_linux.go:99] "Systemd watchdog is not enabled" Oct 28 04:39:58.946445 kubelet[2844]: I1028 04:39:58.945595 2844 server.go:1289] "Started kubelet" Oct 28 04:39:58.948757 kubelet[2844]: I1028 04:39:58.948689 2844 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Oct 28 04:39:58.952279 kubelet[2844]: I1028 04:39:58.952241 2844 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Oct 28 04:39:58.974563 kubelet[2844]: E1028 04:39:58.966312 2844 event.go:368] "Unable to write event (may retry after sleeping)" err="Post \"https://172.31.30.14:6443/api/v1/namespaces/default/events\": dial tcp 172.31.30.14:6443: connect: connection refused" event="&Event{ObjectMeta:{ip-172-31-30-14.18728de05819c1f8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-172-31-30-14,UID:ip-172-31-30-14,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-172-31-30-14,},FirstTimestamp:2025-10-28 04:39:58.945559032 +0000 UTC m=+2.007767963,LastTimestamp:2025-10-28 04:39:58.945559032 +0000 UTC m=+2.007767963,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-172-31-30-14,}" Oct 28 04:39:58.976691 kubelet[2844]: I1028 04:39:58.952364 2844 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Oct 28 04:39:58.976691 kubelet[2844]: I1028 04:39:58.975465 2844 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Oct 28 04:39:58.976691 kubelet[2844]: I1028 04:39:58.952313 2844 server.go:317] "Adding debug handlers to kubelet server" Oct 28 04:39:58.977496 kubelet[2844]: I1028 04:39:58.977450 2844 volume_manager.go:297] "Starting Kubelet Volume Manager" Oct 28 04:39:58.978428 kubelet[2844]: E1028 04:39:58.978369 2844 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: Get \"https://172.31.30.14:6443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&limit=500&resourceVersion=0\": dial tcp 172.31.30.14:6443: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Oct 28 04:39:58.978790 kubelet[2844]: I1028 04:39:58.978749 2844 dynamic_serving_content.go:135] "Starting controller" name="kubelet-server-cert-files::/var/lib/kubelet/pki/kubelet.crt::/var/lib/kubelet/pki/kubelet.key" Oct 28 04:39:58.979877 kubelet[2844]: E1028 04:39:58.979828 2844 kubelet_node_status.go:466] "Error getting the current node from lister" err="node \"ip-172-31-30-14\" not found" Oct 28 04:39:58.985027 kubelet[2844]: E1028 04:39:58.984906 2844 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://172.31.30.14:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-172-31-30-14?timeout=10s\": dial tcp 172.31.30.14:6443: connect: connection refused" interval="200ms" Oct 28 04:39:58.987510 kubelet[2844]: I1028 04:39:58.987282 2844 factory.go:223] Registration of the systemd container factory successfully Oct 28 04:39:58.987510 kubelet[2844]: I1028 04:39:58.987442 2844 factory.go:221] Registration of the crio container factory failed: Get "http://%2Fvar%2Frun%2Fcrio%2Fcrio.sock/info": dial unix /var/run/crio/crio.sock: connect: no such file or directory Oct 28 04:39:58.990391 kubelet[2844]: I1028 04:39:58.990306 2844 reconciler.go:26] "Reconciler: start to sync state" Oct 28 04:39:58.990540 kubelet[2844]: I1028 04:39:58.990425 2844 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Oct 28 04:39:58.991466 kubelet[2844]: E1028 04:39:58.991399 2844 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: Get \"https://172.31.30.14:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0\": dial tcp 172.31.30.14:6443: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Oct 28 04:39:58.991809 kubelet[2844]: E1028 04:39:58.991763 2844 kubelet.go:1600] "Image garbage collection failed once. Stats initialization may not have completed yet" err="invalid capacity 0 on image filesystem" Oct 28 04:39:58.992242 kubelet[2844]: I1028 04:39:58.992206 2844 factory.go:223] Registration of the containerd container factory successfully Oct 28 04:39:59.019132 kubelet[2844]: I1028 04:39:59.019088 2844 cpu_manager.go:221] "Starting CPU manager" policy="none" Oct 28 04:39:59.019708 kubelet[2844]: I1028 04:39:59.019336 2844 cpu_manager.go:222] "Reconciling" reconcilePeriod="10s" Oct 28 04:39:59.019708 kubelet[2844]: I1028 04:39:59.019397 2844 state_mem.go:36] "Initialized new in-memory state store" Oct 28 04:39:59.022708 kubelet[2844]: I1028 04:39:59.022377 2844 policy_none.go:49] "None policy: Start" Oct 28 04:39:59.024433 kubelet[2844]: I1028 04:39:59.024007 2844 memory_manager.go:186] "Starting memorymanager" policy="None" Oct 28 04:39:59.024433 kubelet[2844]: I1028 04:39:59.024057 2844 state_mem.go:35] "Initializing new in-memory state store" Oct 28 04:39:59.026718 kubelet[2844]: I1028 04:39:59.026636 2844 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Oct 28 04:39:59.033964 kubelet[2844]: I1028 04:39:59.033746 2844 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Oct 28 04:39:59.033964 kubelet[2844]: I1028 04:39:59.033796 2844 status_manager.go:230] "Starting to sync pod status with apiserver" Oct 28 04:39:59.033964 kubelet[2844]: I1028 04:39:59.033855 2844 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Oct 28 04:39:59.033964 kubelet[2844]: I1028 04:39:59.033875 2844 kubelet.go:2436] "Starting kubelet main sync loop" Oct 28 04:39:59.033964 kubelet[2844]: E1028 04:39:59.033942 2844 kubelet.go:2460] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Oct 28 04:39:59.035303 kubelet[2844]: E1028 04:39:59.035238 2844 reflector.go:200] "Failed to watch" err="failed to list *v1.RuntimeClass: Get \"https://172.31.30.14:6443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0\": dial tcp 172.31.30.14:6443: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Oct 28 04:39:59.044868 systemd[1]: Created slice kubepods.slice - libcontainer container kubepods.slice. Oct 28 04:39:59.060638 systemd[1]: Created slice kubepods-burstable.slice - libcontainer container kubepods-burstable.slice. Oct 28 04:39:59.068360 systemd[1]: Created slice kubepods-besteffort.slice - libcontainer container kubepods-besteffort.slice. Oct 28 04:39:59.080511 kubelet[2844]: E1028 04:39:59.080436 2844 kubelet_node_status.go:466] "Error getting the current node from lister" err="node \"ip-172-31-30-14\" not found" Oct 28 04:39:59.085773 kubelet[2844]: E1028 04:39:59.085524 2844 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Oct 28 04:39:59.086244 kubelet[2844]: I1028 04:39:59.086219 2844 eviction_manager.go:189] "Eviction manager: starting control loop" Oct 28 04:39:59.086526 kubelet[2844]: I1028 04:39:59.086474 2844 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Oct 28 04:39:59.089199 kubelet[2844]: I1028 04:39:59.088255 2844 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Oct 28 04:39:59.092199 kubelet[2844]: E1028 04:39:59.092128 2844 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="no imagefs label for configured runtime" Oct 28 04:39:59.092325 kubelet[2844]: E1028 04:39:59.092242 2844 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-172-31-30-14\" not found" Oct 28 04:39:59.154423 systemd[1]: Created slice kubepods-burstable-podb6dfe44d6bc1090f9139de143c1f505c.slice - libcontainer container kubepods-burstable-podb6dfe44d6bc1090f9139de143c1f505c.slice. Oct 28 04:39:59.170560 kubelet[2844]: E1028 04:39:59.170189 2844 kubelet.go:3305] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-172-31-30-14\" not found" node="ip-172-31-30-14" Oct 28 04:39:59.181150 systemd[1]: Created slice kubepods-burstable-podda20331d6f93f5bd88d1a4d2a8726331.slice - libcontainer container kubepods-burstable-podda20331d6f93f5bd88d1a4d2a8726331.slice. Oct 28 04:39:59.185793 kubelet[2844]: E1028 04:39:59.185202 2844 kubelet.go:3305] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-172-31-30-14\" not found" node="ip-172-31-30-14" Oct 28 04:39:59.186468 kubelet[2844]: E1028 04:39:59.186415 2844 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://172.31.30.14:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-172-31-30-14?timeout=10s\": dial tcp 172.31.30.14:6443: connect: connection refused" interval="400ms" Oct 28 04:39:59.190499 systemd[1]: Created slice kubepods-burstable-pod75866a0a1b24c6da08bfefcb177c3600.slice - libcontainer container kubepods-burstable-pod75866a0a1b24c6da08bfefcb177c3600.slice. Oct 28 04:39:59.192786 kubelet[2844]: I1028 04:39:59.192306 2844 kubelet_node_status.go:75] "Attempting to register node" node="ip-172-31-30-14" Oct 28 04:39:59.193489 kubelet[2844]: E1028 04:39:59.193442 2844 kubelet_node_status.go:107] "Unable to register node with API server" err="Post \"https://172.31.30.14:6443/api/v1/nodes\": dial tcp 172.31.30.14:6443: connect: connection refused" node="ip-172-31-30-14" Oct 28 04:39:59.195611 kubelet[2844]: E1028 04:39:59.195579 2844 kubelet.go:3305] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-172-31-30-14\" not found" node="ip-172-31-30-14" Oct 28 04:39:59.291040 kubelet[2844]: I1028 04:39:59.290985 2844 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-certs\" (UniqueName: \"kubernetes.io/host-path/da20331d6f93f5bd88d1a4d2a8726331-ca-certs\") pod \"kube-controller-manager-ip-172-31-30-14\" (UID: \"da20331d6f93f5bd88d1a4d2a8726331\") " pod="kube-system/kube-controller-manager-ip-172-31-30-14" Oct 28 04:39:59.291167 kubelet[2844]: I1028 04:39:59.291058 2844 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeconfig\" (UniqueName: \"kubernetes.io/host-path/da20331d6f93f5bd88d1a4d2a8726331-kubeconfig\") pod \"kube-controller-manager-ip-172-31-30-14\" (UID: \"da20331d6f93f5bd88d1a4d2a8726331\") " pod="kube-system/kube-controller-manager-ip-172-31-30-14" Oct 28 04:39:59.291167 kubelet[2844]: I1028 04:39:59.291101 2844 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-share-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/da20331d6f93f5bd88d1a4d2a8726331-usr-share-ca-certificates\") pod \"kube-controller-manager-ip-172-31-30-14\" (UID: \"da20331d6f93f5bd88d1a4d2a8726331\") " pod="kube-system/kube-controller-manager-ip-172-31-30-14" Oct 28 04:39:59.291167 kubelet[2844]: I1028 04:39:59.291140 2844 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeconfig\" (UniqueName: \"kubernetes.io/host-path/75866a0a1b24c6da08bfefcb177c3600-kubeconfig\") pod \"kube-scheduler-ip-172-31-30-14\" (UID: \"75866a0a1b24c6da08bfefcb177c3600\") " pod="kube-system/kube-scheduler-ip-172-31-30-14" Oct 28 04:39:59.291321 kubelet[2844]: I1028 04:39:59.291181 2844 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-certs\" (UniqueName: \"kubernetes.io/host-path/b6dfe44d6bc1090f9139de143c1f505c-ca-certs\") pod \"kube-apiserver-ip-172-31-30-14\" (UID: \"b6dfe44d6bc1090f9139de143c1f505c\") " pod="kube-system/kube-apiserver-ip-172-31-30-14" Oct 28 04:39:59.291321 kubelet[2844]: I1028 04:39:59.291217 2844 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-share-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/b6dfe44d6bc1090f9139de143c1f505c-usr-share-ca-certificates\") pod \"kube-apiserver-ip-172-31-30-14\" (UID: \"b6dfe44d6bc1090f9139de143c1f505c\") " pod="kube-system/kube-apiserver-ip-172-31-30-14" Oct 28 04:39:59.291321 kubelet[2844]: I1028 04:39:59.291253 2844 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"flexvolume-dir\" (UniqueName: \"kubernetes.io/host-path/da20331d6f93f5bd88d1a4d2a8726331-flexvolume-dir\") pod \"kube-controller-manager-ip-172-31-30-14\" (UID: \"da20331d6f93f5bd88d1a4d2a8726331\") " pod="kube-system/kube-controller-manager-ip-172-31-30-14" Oct 28 04:39:59.291321 kubelet[2844]: I1028 04:39:59.291286 2844 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"k8s-certs\" (UniqueName: \"kubernetes.io/host-path/da20331d6f93f5bd88d1a4d2a8726331-k8s-certs\") pod \"kube-controller-manager-ip-172-31-30-14\" (UID: \"da20331d6f93f5bd88d1a4d2a8726331\") " pod="kube-system/kube-controller-manager-ip-172-31-30-14" Oct 28 04:39:59.291502 kubelet[2844]: I1028 04:39:59.291325 2844 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"k8s-certs\" (UniqueName: \"kubernetes.io/host-path/b6dfe44d6bc1090f9139de143c1f505c-k8s-certs\") pod \"kube-apiserver-ip-172-31-30-14\" (UID: \"b6dfe44d6bc1090f9139de143c1f505c\") " pod="kube-system/kube-apiserver-ip-172-31-30-14" Oct 28 04:39:59.396050 kubelet[2844]: I1028 04:39:59.396017 2844 kubelet_node_status.go:75] "Attempting to register node" node="ip-172-31-30-14" Oct 28 04:39:59.396910 kubelet[2844]: E1028 04:39:59.396861 2844 kubelet_node_status.go:107] "Unable to register node with API server" err="Post \"https://172.31.30.14:6443/api/v1/nodes\": dial tcp 172.31.30.14:6443: connect: connection refused" node="ip-172-31-30-14" Oct 28 04:39:59.472416 containerd[1890]: time="2025-10-28T04:39:59.472278658Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-apiserver-ip-172-31-30-14,Uid:b6dfe44d6bc1090f9139de143c1f505c,Namespace:kube-system,Attempt:0,}" Oct 28 04:39:59.487721 containerd[1890]: time="2025-10-28T04:39:59.487621174Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-controller-manager-ip-172-31-30-14,Uid:da20331d6f93f5bd88d1a4d2a8726331,Namespace:kube-system,Attempt:0,}" Oct 28 04:39:59.500084 containerd[1890]: time="2025-10-28T04:39:59.499985891Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-scheduler-ip-172-31-30-14,Uid:75866a0a1b24c6da08bfefcb177c3600,Namespace:kube-system,Attempt:0,}" Oct 28 04:39:59.514273 containerd[1890]: time="2025-10-28T04:39:59.514217747Z" level=info msg="connecting to shim 67c5019f7809475108aece8ff8e81aea64eefc98530eec8465f67a2be8dbcee5" address="unix:///run/containerd/s/09ad6e1e56ed5be8fa10c53cb49d0c143a63f07592214af8026051372cf901ad" namespace=k8s.io protocol=ttrpc version=3 Oct 28 04:39:59.574641 containerd[1890]: time="2025-10-28T04:39:59.574344575Z" level=info msg="connecting to shim e60dff48af31c5b568661594cb96dcbd298574bef8a1958e822b3adc03225ea9" address="unix:///run/containerd/s/2f40d1fe94046b2bfcdbab5d1c43681e94ae2a61b731f5cb52caf11566761414" namespace=k8s.io protocol=ttrpc version=3 Oct 28 04:39:59.582160 containerd[1890]: time="2025-10-28T04:39:59.582102431Z" level=info msg="connecting to shim 396ae9d24878e97bc40befe0355c29ea1ff615cfdd6c792c93c53f3165688af5" address="unix:///run/containerd/s/faef303226530476c46864f5dc4976c3f454c764bbb9a311b107229217e9f4aa" namespace=k8s.io protocol=ttrpc version=3 Oct 28 04:39:59.588751 kubelet[2844]: E1028 04:39:59.588577 2844 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://172.31.30.14:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-172-31-30-14?timeout=10s\": dial tcp 172.31.30.14:6443: connect: connection refused" interval="800ms" Oct 28 04:39:59.625038 systemd[1]: Started cri-containerd-67c5019f7809475108aece8ff8e81aea64eefc98530eec8465f67a2be8dbcee5.scope - libcontainer container 67c5019f7809475108aece8ff8e81aea64eefc98530eec8465f67a2be8dbcee5. Oct 28 04:39:59.644955 systemd[1]: Started cri-containerd-e60dff48af31c5b568661594cb96dcbd298574bef8a1958e822b3adc03225ea9.scope - libcontainer container e60dff48af31c5b568661594cb96dcbd298574bef8a1958e822b3adc03225ea9. Oct 28 04:39:59.689987 systemd[1]: Started cri-containerd-396ae9d24878e97bc40befe0355c29ea1ff615cfdd6c792c93c53f3165688af5.scope - libcontainer container 396ae9d24878e97bc40befe0355c29ea1ff615cfdd6c792c93c53f3165688af5. Oct 28 04:39:59.794420 containerd[1890]: time="2025-10-28T04:39:59.794342880Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-apiserver-ip-172-31-30-14,Uid:b6dfe44d6bc1090f9139de143c1f505c,Namespace:kube-system,Attempt:0,} returns sandbox id \"67c5019f7809475108aece8ff8e81aea64eefc98530eec8465f67a2be8dbcee5\"" Oct 28 04:39:59.803417 kubelet[2844]: I1028 04:39:59.802917 2844 kubelet_node_status.go:75] "Attempting to register node" node="ip-172-31-30-14" Oct 28 04:39:59.803847 kubelet[2844]: E1028 04:39:59.803754 2844 kubelet_node_status.go:107] "Unable to register node with API server" err="Post \"https://172.31.30.14:6443/api/v1/nodes\": dial tcp 172.31.30.14:6443: connect: connection refused" node="ip-172-31-30-14" Oct 28 04:39:59.814514 containerd[1890]: time="2025-10-28T04:39:59.814301736Z" level=info msg="CreateContainer within sandbox \"67c5019f7809475108aece8ff8e81aea64eefc98530eec8465f67a2be8dbcee5\" for container &ContainerMetadata{Name:kube-apiserver,Attempt:0,}" Oct 28 04:39:59.829101 containerd[1890]: time="2025-10-28T04:39:59.829047924Z" level=info msg="Container f5f9ca120723809878d9a0f99aa411c4f496a968cd8d55472fec23a4d3a24f2c: CDI devices from CRI Config.CDIDevices: []" Oct 28 04:39:59.840540 containerd[1890]: time="2025-10-28T04:39:59.840467100Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-controller-manager-ip-172-31-30-14,Uid:da20331d6f93f5bd88d1a4d2a8726331,Namespace:kube-system,Attempt:0,} returns sandbox id \"e60dff48af31c5b568661594cb96dcbd298574bef8a1958e822b3adc03225ea9\"" Oct 28 04:39:59.847856 containerd[1890]: time="2025-10-28T04:39:59.847739220Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-scheduler-ip-172-31-30-14,Uid:75866a0a1b24c6da08bfefcb177c3600,Namespace:kube-system,Attempt:0,} returns sandbox id \"396ae9d24878e97bc40befe0355c29ea1ff615cfdd6c792c93c53f3165688af5\"" Oct 28 04:39:59.849722 containerd[1890]: time="2025-10-28T04:39:59.849161280Z" level=info msg="CreateContainer within sandbox \"67c5019f7809475108aece8ff8e81aea64eefc98530eec8465f67a2be8dbcee5\" for &ContainerMetadata{Name:kube-apiserver,Attempt:0,} returns container id \"f5f9ca120723809878d9a0f99aa411c4f496a968cd8d55472fec23a4d3a24f2c\"" Oct 28 04:39:59.850463 containerd[1890]: time="2025-10-28T04:39:59.850419420Z" level=info msg="CreateContainer within sandbox \"e60dff48af31c5b568661594cb96dcbd298574bef8a1958e822b3adc03225ea9\" for container &ContainerMetadata{Name:kube-controller-manager,Attempt:0,}" Oct 28 04:39:59.851582 containerd[1890]: time="2025-10-28T04:39:59.851058816Z" level=info msg="StartContainer for \"f5f9ca120723809878d9a0f99aa411c4f496a968cd8d55472fec23a4d3a24f2c\"" Oct 28 04:39:59.856380 containerd[1890]: time="2025-10-28T04:39:59.856306332Z" level=info msg="connecting to shim f5f9ca120723809878d9a0f99aa411c4f496a968cd8d55472fec23a4d3a24f2c" address="unix:///run/containerd/s/09ad6e1e56ed5be8fa10c53cb49d0c143a63f07592214af8026051372cf901ad" protocol=ttrpc version=3 Oct 28 04:39:59.857572 containerd[1890]: time="2025-10-28T04:39:59.857483724Z" level=info msg="CreateContainer within sandbox \"396ae9d24878e97bc40befe0355c29ea1ff615cfdd6c792c93c53f3165688af5\" for container &ContainerMetadata{Name:kube-scheduler,Attempt:0,}" Oct 28 04:39:59.867704 containerd[1890]: time="2025-10-28T04:39:59.866420412Z" level=info msg="Container 176eadd3e0ea884cd37311157c0e08acd16bf3847f987e232a843d5a44fdd629: CDI devices from CRI Config.CDIDevices: []" Oct 28 04:39:59.876135 containerd[1890]: time="2025-10-28T04:39:59.876081264Z" level=info msg="CreateContainer within sandbox \"e60dff48af31c5b568661594cb96dcbd298574bef8a1958e822b3adc03225ea9\" for &ContainerMetadata{Name:kube-controller-manager,Attempt:0,} returns container id \"176eadd3e0ea884cd37311157c0e08acd16bf3847f987e232a843d5a44fdd629\"" Oct 28 04:39:59.878026 containerd[1890]: time="2025-10-28T04:39:59.877964400Z" level=info msg="StartContainer for \"176eadd3e0ea884cd37311157c0e08acd16bf3847f987e232a843d5a44fdd629\"" Oct 28 04:39:59.878903 containerd[1890]: time="2025-10-28T04:39:59.878858760Z" level=info msg="Container b84c1321b13822e39bcb6d1dafbbcb0c63def9c43d7165d6adfc6e4420438a6e: CDI devices from CRI Config.CDIDevices: []" Oct 28 04:39:59.884184 containerd[1890]: time="2025-10-28T04:39:59.884093868Z" level=info msg="connecting to shim 176eadd3e0ea884cd37311157c0e08acd16bf3847f987e232a843d5a44fdd629" address="unix:///run/containerd/s/2f40d1fe94046b2bfcdbab5d1c43681e94ae2a61b731f5cb52caf11566761414" protocol=ttrpc version=3 Oct 28 04:39:59.890967 containerd[1890]: time="2025-10-28T04:39:59.890875584Z" level=info msg="CreateContainer within sandbox \"396ae9d24878e97bc40befe0355c29ea1ff615cfdd6c792c93c53f3165688af5\" for &ContainerMetadata{Name:kube-scheduler,Attempt:0,} returns container id \"b84c1321b13822e39bcb6d1dafbbcb0c63def9c43d7165d6adfc6e4420438a6e\"" Oct 28 04:39:59.892179 containerd[1890]: time="2025-10-28T04:39:59.891767484Z" level=info msg="StartContainer for \"b84c1321b13822e39bcb6d1dafbbcb0c63def9c43d7165d6adfc6e4420438a6e\"" Oct 28 04:39:59.894956 containerd[1890]: time="2025-10-28T04:39:59.894896617Z" level=info msg="connecting to shim b84c1321b13822e39bcb6d1dafbbcb0c63def9c43d7165d6adfc6e4420438a6e" address="unix:///run/containerd/s/faef303226530476c46864f5dc4976c3f454c764bbb9a311b107229217e9f4aa" protocol=ttrpc version=3 Oct 28 04:39:59.910977 systemd[1]: Started cri-containerd-f5f9ca120723809878d9a0f99aa411c4f496a968cd8d55472fec23a4d3a24f2c.scope - libcontainer container f5f9ca120723809878d9a0f99aa411c4f496a968cd8d55472fec23a4d3a24f2c. Oct 28 04:39:59.948014 systemd[1]: Started cri-containerd-176eadd3e0ea884cd37311157c0e08acd16bf3847f987e232a843d5a44fdd629.scope - libcontainer container 176eadd3e0ea884cd37311157c0e08acd16bf3847f987e232a843d5a44fdd629. Oct 28 04:39:59.961099 kubelet[2844]: E1028 04:39:59.960585 2844 reflector.go:200] "Failed to watch" err="failed to list *v1.RuntimeClass: Get \"https://172.31.30.14:6443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0\": dial tcp 172.31.30.14:6443: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Oct 28 04:39:59.966360 systemd[1]: Started cri-containerd-b84c1321b13822e39bcb6d1dafbbcb0c63def9c43d7165d6adfc6e4420438a6e.scope - libcontainer container b84c1321b13822e39bcb6d1dafbbcb0c63def9c43d7165d6adfc6e4420438a6e. Oct 28 04:39:59.971976 kubelet[2844]: E1028 04:39:59.971917 2844 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: Get \"https://172.31.30.14:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0\": dial tcp 172.31.30.14:6443: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Oct 28 04:40:00.077459 containerd[1890]: time="2025-10-28T04:40:00.077298633Z" level=info msg="StartContainer for \"f5f9ca120723809878d9a0f99aa411c4f496a968cd8d55472fec23a4d3a24f2c\" returns successfully" Oct 28 04:40:00.124796 kubelet[2844]: E1028 04:40:00.124475 2844 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: Get \"https://172.31.30.14:6443/api/v1/nodes?fieldSelector=metadata.name%3Dip-172-31-30-14&limit=500&resourceVersion=0\": dial tcp 172.31.30.14:6443: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Oct 28 04:40:00.129744 containerd[1890]: time="2025-10-28T04:40:00.129564730Z" level=info msg="StartContainer for \"176eadd3e0ea884cd37311157c0e08acd16bf3847f987e232a843d5a44fdd629\" returns successfully" Oct 28 04:40:00.183039 containerd[1890]: time="2025-10-28T04:40:00.182591746Z" level=info msg="StartContainer for \"b84c1321b13822e39bcb6d1dafbbcb0c63def9c43d7165d6adfc6e4420438a6e\" returns successfully" Oct 28 04:40:00.324279 kubelet[2844]: E1028 04:40:00.324214 2844 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: Get \"https://172.31.30.14:6443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&limit=500&resourceVersion=0\": dial tcp 172.31.30.14:6443: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Oct 28 04:40:00.610512 kubelet[2844]: I1028 04:40:00.609213 2844 kubelet_node_status.go:75] "Attempting to register node" node="ip-172-31-30-14" Oct 28 04:40:01.091300 kubelet[2844]: E1028 04:40:01.090702 2844 kubelet.go:3305] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-172-31-30-14\" not found" node="ip-172-31-30-14" Oct 28 04:40:01.098891 kubelet[2844]: E1028 04:40:01.098857 2844 kubelet.go:3305] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-172-31-30-14\" not found" node="ip-172-31-30-14" Oct 28 04:40:01.106132 kubelet[2844]: E1028 04:40:01.106082 2844 kubelet.go:3305] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-172-31-30-14\" not found" node="ip-172-31-30-14" Oct 28 04:40:02.108534 kubelet[2844]: E1028 04:40:02.106641 2844 kubelet.go:3305] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-172-31-30-14\" not found" node="ip-172-31-30-14" Oct 28 04:40:02.108534 kubelet[2844]: E1028 04:40:02.107004 2844 kubelet.go:3305] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-172-31-30-14\" not found" node="ip-172-31-30-14" Oct 28 04:40:02.108534 kubelet[2844]: E1028 04:40:02.107363 2844 kubelet.go:3305] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-172-31-30-14\" not found" node="ip-172-31-30-14" Oct 28 04:40:03.109818 kubelet[2844]: E1028 04:40:03.109750 2844 kubelet.go:3305] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-172-31-30-14\" not found" node="ip-172-31-30-14" Oct 28 04:40:03.111069 kubelet[2844]: E1028 04:40:03.111011 2844 kubelet.go:3305] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-172-31-30-14\" not found" node="ip-172-31-30-14" Oct 28 04:40:04.644685 kubelet[2844]: E1028 04:40:04.644606 2844 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-172-31-30-14\" not found" node="ip-172-31-30-14" Oct 28 04:40:04.657707 kubelet[2844]: I1028 04:40:04.656734 2844 kubelet_node_status.go:78] "Successfully registered node" node="ip-172-31-30-14" Oct 28 04:40:04.680566 kubelet[2844]: I1028 04:40:04.680527 2844 kubelet.go:3309] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-ip-172-31-30-14" Oct 28 04:40:04.756976 kubelet[2844]: E1028 04:40:04.756907 2844 kubelet.go:3311] "Failed creating a mirror pod" err="pods \"kube-apiserver-ip-172-31-30-14\" is forbidden: no PriorityClass with name system-node-critical was found" pod="kube-system/kube-apiserver-ip-172-31-30-14" Oct 28 04:40:04.756976 kubelet[2844]: I1028 04:40:04.756983 2844 kubelet.go:3309] "Creating a mirror pod for static pod" pod="kube-system/kube-controller-manager-ip-172-31-30-14" Oct 28 04:40:04.782815 kubelet[2844]: E1028 04:40:04.782725 2844 kubelet.go:3311] "Failed creating a mirror pod" err="pods \"kube-controller-manager-ip-172-31-30-14\" is forbidden: no PriorityClass with name system-node-critical was found" pod="kube-system/kube-controller-manager-ip-172-31-30-14" Oct 28 04:40:04.782815 kubelet[2844]: I1028 04:40:04.782804 2844 kubelet.go:3309] "Creating a mirror pod for static pod" pod="kube-system/kube-scheduler-ip-172-31-30-14" Oct 28 04:40:04.796101 kubelet[2844]: E1028 04:40:04.796028 2844 kubelet.go:3311] "Failed creating a mirror pod" err="pods \"kube-scheduler-ip-172-31-30-14\" is forbidden: no PriorityClass with name system-node-critical was found" pod="kube-system/kube-scheduler-ip-172-31-30-14" Oct 28 04:40:04.945937 kubelet[2844]: I1028 04:40:04.945782 2844 apiserver.go:52] "Watching apiserver" Oct 28 04:40:04.991611 kubelet[2844]: I1028 04:40:04.991523 2844 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Oct 28 04:40:06.915131 kubelet[2844]: I1028 04:40:06.915067 2844 kubelet.go:3309] "Creating a mirror pod for static pod" pod="kube-system/kube-controller-manager-ip-172-31-30-14" Oct 28 04:40:06.937931 systemd[1]: Reload requested from client PID 3125 ('systemctl') (unit session-7.scope)... Oct 28 04:40:06.937965 systemd[1]: Reloading... Oct 28 04:40:06.940330 kubelet[2844]: I1028 04:40:06.940290 2844 kubelet.go:3309] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-ip-172-31-30-14" Oct 28 04:40:07.245762 zram_generator::config[3173]: No configuration found. Oct 28 04:40:07.801777 systemd[1]: Reloading finished in 863 ms. Oct 28 04:40:07.850050 systemd[1]: Stopping kubelet.service - kubelet: The Kubernetes Node Agent... Oct 28 04:40:07.870484 systemd[1]: kubelet.service: Deactivated successfully. Oct 28 04:40:07.871576 systemd[1]: Stopped kubelet.service - kubelet: The Kubernetes Node Agent. Oct 28 04:40:07.872146 systemd[1]: kubelet.service: Consumed 2.796s CPU time, 128.5M memory peak. Oct 28 04:40:07.876275 systemd[1]: Starting kubelet.service - kubelet: The Kubernetes Node Agent... Oct 28 04:40:08.234624 systemd[1]: Started kubelet.service - kubelet: The Kubernetes Node Agent. Oct 28 04:40:08.252203 (kubelet)[3230]: kubelet.service: Referenced but unset environment variable evaluates to an empty string: KUBELET_EXTRA_ARGS Oct 28 04:40:08.356000 kubelet[3230]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 28 04:40:08.357031 kubelet[3230]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Oct 28 04:40:08.357031 kubelet[3230]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 28 04:40:08.357031 kubelet[3230]: I1028 04:40:08.356297 3230 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Oct 28 04:40:08.382117 kubelet[3230]: I1028 04:40:08.382067 3230 server.go:530] "Kubelet version" kubeletVersion="v1.33.0" Oct 28 04:40:08.382692 kubelet[3230]: I1028 04:40:08.382525 3230 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Oct 28 04:40:08.383779 kubelet[3230]: I1028 04:40:08.383217 3230 server.go:956] "Client rotation is on, will bootstrap in background" Oct 28 04:40:08.386645 kubelet[3230]: I1028 04:40:08.386545 3230 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem" Oct 28 04:40:08.392357 kubelet[3230]: I1028 04:40:08.392295 3230 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" Oct 28 04:40:08.401837 kubelet[3230]: I1028 04:40:08.401777 3230 server.go:1446] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Oct 28 04:40:08.406385 kubelet[3230]: I1028 04:40:08.406338 3230 server.go:782] "--cgroups-per-qos enabled, but --cgroup-root was not specified. defaulting to /" Oct 28 04:40:08.406882 kubelet[3230]: I1028 04:40:08.406816 3230 container_manager_linux.go:267] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Oct 28 04:40:08.411335 kubelet[3230]: I1028 04:40:08.406871 3230 container_manager_linux.go:272] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-172-31-30-14","RuntimeCgroupsName":"","SystemCgroupsName":"","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":false,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":null,"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":-1,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Oct 28 04:40:08.413518 kubelet[3230]: I1028 04:40:08.411344 3230 topology_manager.go:138] "Creating topology manager with none policy" Oct 28 04:40:08.413518 kubelet[3230]: I1028 04:40:08.411370 3230 container_manager_linux.go:303] "Creating device plugin manager" Oct 28 04:40:08.413518 kubelet[3230]: I1028 04:40:08.411459 3230 state_mem.go:36] "Initialized new in-memory state store" Oct 28 04:40:08.413518 kubelet[3230]: I1028 04:40:08.411769 3230 kubelet.go:480] "Attempting to sync node with API server" Oct 28 04:40:08.413518 kubelet[3230]: I1028 04:40:08.411793 3230 kubelet.go:375] "Adding static pod path" path="/etc/kubernetes/manifests" Oct 28 04:40:08.413518 kubelet[3230]: I1028 04:40:08.411839 3230 kubelet.go:386] "Adding apiserver pod source" Oct 28 04:40:08.413518 kubelet[3230]: I1028 04:40:08.411867 3230 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Oct 28 04:40:08.417238 kubelet[3230]: I1028 04:40:08.416340 3230 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="containerd" version="v2.0.5" apiVersion="v1" Oct 28 04:40:08.417633 kubelet[3230]: I1028 04:40:08.417587 3230 kubelet.go:935] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Oct 28 04:40:08.421357 kubelet[3230]: I1028 04:40:08.421131 3230 watchdog_linux.go:99] "Systemd watchdog is not enabled" Oct 28 04:40:08.421357 kubelet[3230]: I1028 04:40:08.421199 3230 server.go:1289] "Started kubelet" Oct 28 04:40:08.423817 kubelet[3230]: I1028 04:40:08.423585 3230 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Oct 28 04:40:08.436481 kubelet[3230]: I1028 04:40:08.435784 3230 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Oct 28 04:40:08.443604 kubelet[3230]: I1028 04:40:08.442600 3230 dynamic_serving_content.go:135] "Starting controller" name="kubelet-server-cert-files::/var/lib/kubelet/pki/kubelet.crt::/var/lib/kubelet/pki/kubelet.key" Oct 28 04:40:08.452028 kubelet[3230]: I1028 04:40:08.444949 3230 server.go:317] "Adding debug handlers to kubelet server" Oct 28 04:40:08.452028 kubelet[3230]: I1028 04:40:08.446742 3230 volume_manager.go:297] "Starting Kubelet Volume Manager" Oct 28 04:40:08.452028 kubelet[3230]: E1028 04:40:08.447081 3230 kubelet_node_status.go:466] "Error getting the current node from lister" err="node \"ip-172-31-30-14\" not found" Oct 28 04:40:08.452028 kubelet[3230]: I1028 04:40:08.448076 3230 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Oct 28 04:40:08.452028 kubelet[3230]: I1028 04:40:08.448308 3230 reconciler.go:26] "Reconciler: start to sync state" Oct 28 04:40:08.454685 kubelet[3230]: I1028 04:40:08.436027 3230 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Oct 28 04:40:08.460016 kubelet[3230]: I1028 04:40:08.459970 3230 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Oct 28 04:40:08.462159 kubelet[3230]: I1028 04:40:08.462112 3230 factory.go:223] Registration of the systemd container factory successfully Oct 28 04:40:08.462679 kubelet[3230]: I1028 04:40:08.462620 3230 factory.go:221] Registration of the crio container factory failed: Get "http://%2Fvar%2Frun%2Fcrio%2Fcrio.sock/info": dial unix /var/run/crio/crio.sock: connect: no such file or directory Oct 28 04:40:08.484402 kubelet[3230]: I1028 04:40:08.483889 3230 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Oct 28 04:40:08.491102 kubelet[3230]: I1028 04:40:08.489947 3230 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Oct 28 04:40:08.491296 kubelet[3230]: I1028 04:40:08.491271 3230 status_manager.go:230] "Starting to sync pod status with apiserver" Oct 28 04:40:08.491420 kubelet[3230]: I1028 04:40:08.491401 3230 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Oct 28 04:40:08.491522 kubelet[3230]: I1028 04:40:08.491505 3230 kubelet.go:2436] "Starting kubelet main sync loop" Oct 28 04:40:08.491728 kubelet[3230]: E1028 04:40:08.491698 3230 kubelet.go:2460] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Oct 28 04:40:08.514706 kubelet[3230]: I1028 04:40:08.513851 3230 factory.go:223] Registration of the containerd container factory successfully Oct 28 04:40:08.527081 kubelet[3230]: E1028 04:40:08.527019 3230 kubelet.go:1600] "Image garbage collection failed once. Stats initialization may not have completed yet" err="invalid capacity 0 on image filesystem" Oct 28 04:40:08.592087 kubelet[3230]: E1028 04:40:08.592032 3230 kubelet.go:2460] "Skipping pod synchronization" err="container runtime status check may not have completed yet" Oct 28 04:40:08.626488 kubelet[3230]: I1028 04:40:08.626443 3230 cpu_manager.go:221] "Starting CPU manager" policy="none" Oct 28 04:40:08.626488 kubelet[3230]: I1028 04:40:08.626476 3230 cpu_manager.go:222] "Reconciling" reconcilePeriod="10s" Oct 28 04:40:08.626716 kubelet[3230]: I1028 04:40:08.626513 3230 state_mem.go:36] "Initialized new in-memory state store" Oct 28 04:40:08.627083 kubelet[3230]: I1028 04:40:08.627028 3230 state_mem.go:88] "Updated default CPUSet" cpuSet="" Oct 28 04:40:08.627083 kubelet[3230]: I1028 04:40:08.627063 3230 state_mem.go:96] "Updated CPUSet assignments" assignments={} Oct 28 04:40:08.627204 kubelet[3230]: I1028 04:40:08.627099 3230 policy_none.go:49] "None policy: Start" Oct 28 04:40:08.627204 kubelet[3230]: I1028 04:40:08.627120 3230 memory_manager.go:186] "Starting memorymanager" policy="None" Oct 28 04:40:08.627204 kubelet[3230]: I1028 04:40:08.627141 3230 state_mem.go:35] "Initializing new in-memory state store" Oct 28 04:40:08.629175 kubelet[3230]: I1028 04:40:08.627697 3230 state_mem.go:75] "Updated machine memory state" Oct 28 04:40:08.637003 kubelet[3230]: E1028 04:40:08.636925 3230 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Oct 28 04:40:08.637618 kubelet[3230]: I1028 04:40:08.637563 3230 eviction_manager.go:189] "Eviction manager: starting control loop" Oct 28 04:40:08.637758 kubelet[3230]: I1028 04:40:08.637599 3230 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Oct 28 04:40:08.639051 kubelet[3230]: I1028 04:40:08.638933 3230 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Oct 28 04:40:08.643709 kubelet[3230]: E1028 04:40:08.643015 3230 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="no imagefs label for configured runtime" Oct 28 04:40:08.754555 kubelet[3230]: I1028 04:40:08.754429 3230 kubelet_node_status.go:75] "Attempting to register node" node="ip-172-31-30-14" Oct 28 04:40:08.771683 kubelet[3230]: I1028 04:40:08.770590 3230 kubelet_node_status.go:124] "Node was previously registered" node="ip-172-31-30-14" Oct 28 04:40:08.771683 kubelet[3230]: I1028 04:40:08.770734 3230 kubelet_node_status.go:78] "Successfully registered node" node="ip-172-31-30-14" Oct 28 04:40:08.793525 kubelet[3230]: I1028 04:40:08.793464 3230 kubelet.go:3309] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-ip-172-31-30-14" Oct 28 04:40:08.794649 kubelet[3230]: I1028 04:40:08.793476 3230 kubelet.go:3309] "Creating a mirror pod for static pod" pod="kube-system/kube-controller-manager-ip-172-31-30-14" Oct 28 04:40:08.795681 kubelet[3230]: I1028 04:40:08.794967 3230 kubelet.go:3309] "Creating a mirror pod for static pod" pod="kube-system/kube-scheduler-ip-172-31-30-14" Oct 28 04:40:08.807774 kubelet[3230]: E1028 04:40:08.807494 3230 kubelet.go:3311] "Failed creating a mirror pod" err="pods \"kube-controller-manager-ip-172-31-30-14\" already exists" pod="kube-system/kube-controller-manager-ip-172-31-30-14" Oct 28 04:40:08.819505 kubelet[3230]: E1028 04:40:08.819454 3230 kubelet.go:3311] "Failed creating a mirror pod" err="pods \"kube-apiserver-ip-172-31-30-14\" already exists" pod="kube-system/kube-apiserver-ip-172-31-30-14" Oct 28 04:40:08.850969 kubelet[3230]: I1028 04:40:08.850903 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-certs\" (UniqueName: \"kubernetes.io/host-path/da20331d6f93f5bd88d1a4d2a8726331-ca-certs\") pod \"kube-controller-manager-ip-172-31-30-14\" (UID: \"da20331d6f93f5bd88d1a4d2a8726331\") " pod="kube-system/kube-controller-manager-ip-172-31-30-14" Oct 28 04:40:08.851202 kubelet[3230]: I1028 04:40:08.851007 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"flexvolume-dir\" (UniqueName: \"kubernetes.io/host-path/da20331d6f93f5bd88d1a4d2a8726331-flexvolume-dir\") pod \"kube-controller-manager-ip-172-31-30-14\" (UID: \"da20331d6f93f5bd88d1a4d2a8726331\") " pod="kube-system/kube-controller-manager-ip-172-31-30-14" Oct 28 04:40:08.851202 kubelet[3230]: I1028 04:40:08.851046 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"k8s-certs\" (UniqueName: \"kubernetes.io/host-path/da20331d6f93f5bd88d1a4d2a8726331-k8s-certs\") pod \"kube-controller-manager-ip-172-31-30-14\" (UID: \"da20331d6f93f5bd88d1a4d2a8726331\") " pod="kube-system/kube-controller-manager-ip-172-31-30-14" Oct 28 04:40:08.851202 kubelet[3230]: I1028 04:40:08.851106 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeconfig\" (UniqueName: \"kubernetes.io/host-path/da20331d6f93f5bd88d1a4d2a8726331-kubeconfig\") pod \"kube-controller-manager-ip-172-31-30-14\" (UID: \"da20331d6f93f5bd88d1a4d2a8726331\") " pod="kube-system/kube-controller-manager-ip-172-31-30-14" Oct 28 04:40:08.851202 kubelet[3230]: I1028 04:40:08.851154 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-share-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/da20331d6f93f5bd88d1a4d2a8726331-usr-share-ca-certificates\") pod \"kube-controller-manager-ip-172-31-30-14\" (UID: \"da20331d6f93f5bd88d1a4d2a8726331\") " pod="kube-system/kube-controller-manager-ip-172-31-30-14" Oct 28 04:40:08.851202 kubelet[3230]: I1028 04:40:08.851198 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeconfig\" (UniqueName: \"kubernetes.io/host-path/75866a0a1b24c6da08bfefcb177c3600-kubeconfig\") pod \"kube-scheduler-ip-172-31-30-14\" (UID: \"75866a0a1b24c6da08bfefcb177c3600\") " pod="kube-system/kube-scheduler-ip-172-31-30-14" Oct 28 04:40:08.851444 kubelet[3230]: I1028 04:40:08.851237 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-certs\" (UniqueName: \"kubernetes.io/host-path/b6dfe44d6bc1090f9139de143c1f505c-ca-certs\") pod \"kube-apiserver-ip-172-31-30-14\" (UID: \"b6dfe44d6bc1090f9139de143c1f505c\") " pod="kube-system/kube-apiserver-ip-172-31-30-14" Oct 28 04:40:08.851444 kubelet[3230]: I1028 04:40:08.851288 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"k8s-certs\" (UniqueName: \"kubernetes.io/host-path/b6dfe44d6bc1090f9139de143c1f505c-k8s-certs\") pod \"kube-apiserver-ip-172-31-30-14\" (UID: \"b6dfe44d6bc1090f9139de143c1f505c\") " pod="kube-system/kube-apiserver-ip-172-31-30-14" Oct 28 04:40:08.851444 kubelet[3230]: I1028 04:40:08.851338 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-share-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/b6dfe44d6bc1090f9139de143c1f505c-usr-share-ca-certificates\") pod \"kube-apiserver-ip-172-31-30-14\" (UID: \"b6dfe44d6bc1090f9139de143c1f505c\") " pod="kube-system/kube-apiserver-ip-172-31-30-14" Oct 28 04:40:09.416371 kubelet[3230]: I1028 04:40:09.416318 3230 apiserver.go:52] "Watching apiserver" Oct 28 04:40:09.448438 kubelet[3230]: I1028 04:40:09.448343 3230 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Oct 28 04:40:09.579016 kubelet[3230]: I1028 04:40:09.578952 3230 kubelet.go:3309] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-ip-172-31-30-14" Oct 28 04:40:09.579490 kubelet[3230]: I1028 04:40:09.579256 3230 kubelet.go:3309] "Creating a mirror pod for static pod" pod="kube-system/kube-scheduler-ip-172-31-30-14" Oct 28 04:40:09.592988 kubelet[3230]: E1028 04:40:09.592946 3230 kubelet.go:3311] "Failed creating a mirror pod" err="pods \"kube-apiserver-ip-172-31-30-14\" already exists" pod="kube-system/kube-apiserver-ip-172-31-30-14" Oct 28 04:40:09.597109 kubelet[3230]: E1028 04:40:09.597069 3230 kubelet.go:3311] "Failed creating a mirror pod" err="pods \"kube-scheduler-ip-172-31-30-14\" already exists" pod="kube-system/kube-scheduler-ip-172-31-30-14" Oct 28 04:40:09.714233 kubelet[3230]: I1028 04:40:09.714060 3230 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-scheduler-ip-172-31-30-14" podStartSLOduration=1.714034149 podStartE2EDuration="1.714034149s" podCreationTimestamp="2025-10-28 04:40:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-28 04:40:09.673967889 +0000 UTC m=+1.410800852" watchObservedRunningTime="2025-10-28 04:40:09.714034149 +0000 UTC m=+1.450867112" Oct 28 04:40:09.768179 kubelet[3230]: I1028 04:40:09.768100 3230 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-ip-172-31-30-14" podStartSLOduration=3.7680771699999998 podStartE2EDuration="3.76807717s" podCreationTimestamp="2025-10-28 04:40:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-28 04:40:09.716186721 +0000 UTC m=+1.453019672" watchObservedRunningTime="2025-10-28 04:40:09.76807717 +0000 UTC m=+1.504910133" Oct 28 04:40:09.769025 kubelet[3230]: I1028 04:40:09.768911 3230 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-controller-manager-ip-172-31-30-14" podStartSLOduration=3.768891334 podStartE2EDuration="3.768891334s" podCreationTimestamp="2025-10-28 04:40:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-28 04:40:09.76889131 +0000 UTC m=+1.505724273" watchObservedRunningTime="2025-10-28 04:40:09.768891334 +0000 UTC m=+1.505724285" Oct 28 04:40:09.997811 update_engine[1872]: I20251028 04:40:09.997071 1872 update_attempter.cc:509] Updating boot flags... Oct 28 04:40:11.851885 kubelet[3230]: I1028 04:40:11.851834 3230 kuberuntime_manager.go:1746] "Updating runtime config through cri with podcidr" CIDR="192.168.0.0/24" Oct 28 04:40:11.852465 containerd[1890]: time="2025-10-28T04:40:11.852381192Z" level=info msg="No cni config template is specified, wait for other system components to drop the config." Oct 28 04:40:11.853538 kubelet[3230]: I1028 04:40:11.853262 3230 kubelet_network.go:61] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="192.168.0.0/24" Oct 28 04:40:12.637797 systemd[1]: Created slice kubepods-besteffort-podb9fe882a_814c_477f_9553_885bf920fee4.slice - libcontainer container kubepods-besteffort-podb9fe882a_814c_477f_9553_885bf920fee4.slice. Oct 28 04:40:12.692197 kubelet[3230]: I1028 04:40:12.690636 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-proxy\" (UniqueName: \"kubernetes.io/configmap/b9fe882a-814c-477f-9553-885bf920fee4-kube-proxy\") pod \"kube-proxy-vwms6\" (UID: \"b9fe882a-814c-477f-9553-885bf920fee4\") " pod="kube-system/kube-proxy-vwms6" Oct 28 04:40:12.692706 kubelet[3230]: I1028 04:40:12.692484 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/b9fe882a-814c-477f-9553-885bf920fee4-xtables-lock\") pod \"kube-proxy-vwms6\" (UID: \"b9fe882a-814c-477f-9553-885bf920fee4\") " pod="kube-system/kube-proxy-vwms6" Oct 28 04:40:12.694048 kubelet[3230]: I1028 04:40:12.693626 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b9fe882a-814c-477f-9553-885bf920fee4-lib-modules\") pod \"kube-proxy-vwms6\" (UID: \"b9fe882a-814c-477f-9553-885bf920fee4\") " pod="kube-system/kube-proxy-vwms6" Oct 28 04:40:12.694048 kubelet[3230]: I1028 04:40:12.693736 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6kjw\" (UniqueName: \"kubernetes.io/projected/b9fe882a-814c-477f-9553-885bf920fee4-kube-api-access-w6kjw\") pod \"kube-proxy-vwms6\" (UID: \"b9fe882a-814c-477f-9553-885bf920fee4\") " pod="kube-system/kube-proxy-vwms6" Oct 28 04:40:12.806778 kubelet[3230]: E1028 04:40:12.806719 3230 projected.go:289] Couldn't get configMap kube-system/kube-root-ca.crt: configmap "kube-root-ca.crt" not found Oct 28 04:40:12.807150 kubelet[3230]: E1028 04:40:12.806989 3230 projected.go:194] Error preparing data for projected volume kube-api-access-w6kjw for pod kube-system/kube-proxy-vwms6: configmap "kube-root-ca.crt" not found Oct 28 04:40:12.807293 kubelet[3230]: E1028 04:40:12.807256 3230 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9fe882a-814c-477f-9553-885bf920fee4-kube-api-access-w6kjw podName:b9fe882a-814c-477f-9553-885bf920fee4 nodeName:}" failed. No retries permitted until 2025-10-28 04:40:13.307104905 +0000 UTC m=+5.043937856 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-w6kjw" (UniqueName: "kubernetes.io/projected/b9fe882a-814c-477f-9553-885bf920fee4-kube-api-access-w6kjw") pod "kube-proxy-vwms6" (UID: "b9fe882a-814c-477f-9553-885bf920fee4") : configmap "kube-root-ca.crt" not found Oct 28 04:40:13.016039 systemd[1]: Created slice kubepods-besteffort-pod7dfb82e1_8370_4f68_a912_6abd6aac0533.slice - libcontainer container kubepods-besteffort-pod7dfb82e1_8370_4f68_a912_6abd6aac0533.slice. Oct 28 04:40:13.095810 kubelet[3230]: I1028 04:40:13.095744 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-calico\" (UniqueName: \"kubernetes.io/host-path/7dfb82e1-8370-4f68-a912-6abd6aac0533-var-lib-calico\") pod \"tigera-operator-7dcd859c48-7fqlc\" (UID: \"7dfb82e1-8370-4f68-a912-6abd6aac0533\") " pod="tigera-operator/tigera-operator-7dcd859c48-7fqlc" Oct 28 04:40:13.096328 kubelet[3230]: I1028 04:40:13.095851 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbvsz\" (UniqueName: \"kubernetes.io/projected/7dfb82e1-8370-4f68-a912-6abd6aac0533-kube-api-access-jbvsz\") pod \"tigera-operator-7dcd859c48-7fqlc\" (UID: \"7dfb82e1-8370-4f68-a912-6abd6aac0533\") " pod="tigera-operator/tigera-operator-7dcd859c48-7fqlc" Oct 28 04:40:13.328271 containerd[1890]: time="2025-10-28T04:40:13.328135307Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:tigera-operator-7dcd859c48-7fqlc,Uid:7dfb82e1-8370-4f68-a912-6abd6aac0533,Namespace:tigera-operator,Attempt:0,}" Oct 28 04:40:13.372686 containerd[1890]: time="2025-10-28T04:40:13.371995967Z" level=info msg="connecting to shim 30a20ce4943f53fdbe7f43e39c510545a59ee96fa65814c832434a882b2c2669" address="unix:///run/containerd/s/335a6bda8b85ef0a491c23cff4214e0299cb076c0f099df28cfc2e88b8f67215" namespace=k8s.io protocol=ttrpc version=3 Oct 28 04:40:13.432963 systemd[1]: Started cri-containerd-30a20ce4943f53fdbe7f43e39c510545a59ee96fa65814c832434a882b2c2669.scope - libcontainer container 30a20ce4943f53fdbe7f43e39c510545a59ee96fa65814c832434a882b2c2669. Oct 28 04:40:13.512163 containerd[1890]: time="2025-10-28T04:40:13.512115840Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:tigera-operator-7dcd859c48-7fqlc,Uid:7dfb82e1-8370-4f68-a912-6abd6aac0533,Namespace:tigera-operator,Attempt:0,} returns sandbox id \"30a20ce4943f53fdbe7f43e39c510545a59ee96fa65814c832434a882b2c2669\"" Oct 28 04:40:13.515968 containerd[1890]: time="2025-10-28T04:40:13.515909604Z" level=info msg="PullImage \"quay.io/tigera/operator:v1.38.7\"" Oct 28 04:40:13.550502 containerd[1890]: time="2025-10-28T04:40:13.550448268Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-proxy-vwms6,Uid:b9fe882a-814c-477f-9553-885bf920fee4,Namespace:kube-system,Attempt:0,}" Oct 28 04:40:13.600646 containerd[1890]: time="2025-10-28T04:40:13.600373645Z" level=info msg="connecting to shim 6b6f530e88adb278d876eee34126cf6e8a3dde04df57eef4b3cbeb0a58bd0a8b" address="unix:///run/containerd/s/a4081e89cfa15dd7b94fadd340016452aebde58daf475472bc380edd5d6bceaa" namespace=k8s.io protocol=ttrpc version=3 Oct 28 04:40:13.648002 systemd[1]: Started cri-containerd-6b6f530e88adb278d876eee34126cf6e8a3dde04df57eef4b3cbeb0a58bd0a8b.scope - libcontainer container 6b6f530e88adb278d876eee34126cf6e8a3dde04df57eef4b3cbeb0a58bd0a8b. Oct 28 04:40:13.697342 containerd[1890]: time="2025-10-28T04:40:13.697275733Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-proxy-vwms6,Uid:b9fe882a-814c-477f-9553-885bf920fee4,Namespace:kube-system,Attempt:0,} returns sandbox id \"6b6f530e88adb278d876eee34126cf6e8a3dde04df57eef4b3cbeb0a58bd0a8b\"" Oct 28 04:40:13.707613 containerd[1890]: time="2025-10-28T04:40:13.707555593Z" level=info msg="CreateContainer within sandbox \"6b6f530e88adb278d876eee34126cf6e8a3dde04df57eef4b3cbeb0a58bd0a8b\" for container &ContainerMetadata{Name:kube-proxy,Attempt:0,}" Oct 28 04:40:13.726699 containerd[1890]: time="2025-10-28T04:40:13.726002797Z" level=info msg="Container bdcab6115cf8ee1e3580645a321671482711a9148664ede3d32f2fb23a66caf5: CDI devices from CRI Config.CDIDevices: []" Oct 28 04:40:13.742826 containerd[1890]: time="2025-10-28T04:40:13.742776997Z" level=info msg="CreateContainer within sandbox \"6b6f530e88adb278d876eee34126cf6e8a3dde04df57eef4b3cbeb0a58bd0a8b\" for &ContainerMetadata{Name:kube-proxy,Attempt:0,} returns container id \"bdcab6115cf8ee1e3580645a321671482711a9148664ede3d32f2fb23a66caf5\"" Oct 28 04:40:13.744482 containerd[1890]: time="2025-10-28T04:40:13.744330013Z" level=info msg="StartContainer for \"bdcab6115cf8ee1e3580645a321671482711a9148664ede3d32f2fb23a66caf5\"" Oct 28 04:40:13.747570 containerd[1890]: time="2025-10-28T04:40:13.747511417Z" level=info msg="connecting to shim bdcab6115cf8ee1e3580645a321671482711a9148664ede3d32f2fb23a66caf5" address="unix:///run/containerd/s/a4081e89cfa15dd7b94fadd340016452aebde58daf475472bc380edd5d6bceaa" protocol=ttrpc version=3 Oct 28 04:40:13.784969 systemd[1]: Started cri-containerd-bdcab6115cf8ee1e3580645a321671482711a9148664ede3d32f2fb23a66caf5.scope - libcontainer container bdcab6115cf8ee1e3580645a321671482711a9148664ede3d32f2fb23a66caf5. Oct 28 04:40:13.882097 containerd[1890]: time="2025-10-28T04:40:13.881888090Z" level=info msg="StartContainer for \"bdcab6115cf8ee1e3580645a321671482711a9148664ede3d32f2fb23a66caf5\" returns successfully" Oct 28 04:40:14.637839 kubelet[3230]: I1028 04:40:14.637296 3230 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-proxy-vwms6" podStartSLOduration=2.637164962 podStartE2EDuration="2.637164962s" podCreationTimestamp="2025-10-28 04:40:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-28 04:40:14.636833522 +0000 UTC m=+6.373666509" watchObservedRunningTime="2025-10-28 04:40:14.637164962 +0000 UTC m=+6.373997925" Oct 28 04:40:16.035839 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount1855065629.mount: Deactivated successfully. Oct 28 04:40:18.323207 containerd[1890]: time="2025-10-28T04:40:18.323130184Z" level=info msg="ImageCreate event name:\"quay.io/tigera/operator:v1.38.7\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Oct 28 04:40:18.325095 containerd[1890]: time="2025-10-28T04:40:18.324817480Z" level=info msg="stop pulling image quay.io/tigera/operator:v1.38.7: active requests=0, bytes read=22152004" Oct 28 04:40:18.326970 containerd[1890]: time="2025-10-28T04:40:18.326912764Z" level=info msg="ImageCreate event name:\"sha256:19f52e4b7ea471a91d4186e9701288b905145dc20d4928cbbf2eac8d9dfce54b\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Oct 28 04:40:18.331650 containerd[1890]: time="2025-10-28T04:40:18.331600780Z" level=info msg="ImageCreate event name:\"quay.io/tigera/operator@sha256:1b629a1403f5b6d7243f7dd523d04b8a50352a33c1d4d6970b6002a8733acf2e\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Oct 28 04:40:18.333172 containerd[1890]: time="2025-10-28T04:40:18.332932648Z" level=info msg="Pulled image \"quay.io/tigera/operator:v1.38.7\" with image id \"sha256:19f52e4b7ea471a91d4186e9701288b905145dc20d4928cbbf2eac8d9dfce54b\", repo tag \"quay.io/tigera/operator:v1.38.7\", repo digest \"quay.io/tigera/operator@sha256:1b629a1403f5b6d7243f7dd523d04b8a50352a33c1d4d6970b6002a8733acf2e\", size \"22147999\" in 4.81672494s" Oct 28 04:40:18.333172 containerd[1890]: time="2025-10-28T04:40:18.333015136Z" level=info msg="PullImage \"quay.io/tigera/operator:v1.38.7\" returns image reference \"sha256:19f52e4b7ea471a91d4186e9701288b905145dc20d4928cbbf2eac8d9dfce54b\"" Oct 28 04:40:18.343385 containerd[1890]: time="2025-10-28T04:40:18.343306492Z" level=info msg="CreateContainer within sandbox \"30a20ce4943f53fdbe7f43e39c510545a59ee96fa65814c832434a882b2c2669\" for container &ContainerMetadata{Name:tigera-operator,Attempt:0,}" Oct 28 04:40:18.386768 containerd[1890]: time="2025-10-28T04:40:18.386381920Z" level=info msg="Container 0f8b4a221df12019b1d22130a4b27da330d6e0e9059b0fbf47ec97cca794e907: CDI devices from CRI Config.CDIDevices: []" Oct 28 04:40:18.403208 containerd[1890]: time="2025-10-28T04:40:18.403143544Z" level=info msg="CreateContainer within sandbox \"30a20ce4943f53fdbe7f43e39c510545a59ee96fa65814c832434a882b2c2669\" for &ContainerMetadata{Name:tigera-operator,Attempt:0,} returns container id \"0f8b4a221df12019b1d22130a4b27da330d6e0e9059b0fbf47ec97cca794e907\"" Oct 28 04:40:18.404627 containerd[1890]: time="2025-10-28T04:40:18.404532820Z" level=info msg="StartContainer for \"0f8b4a221df12019b1d22130a4b27da330d6e0e9059b0fbf47ec97cca794e907\"" Oct 28 04:40:18.406860 containerd[1890]: time="2025-10-28T04:40:18.406742212Z" level=info msg="connecting to shim 0f8b4a221df12019b1d22130a4b27da330d6e0e9059b0fbf47ec97cca794e907" address="unix:///run/containerd/s/335a6bda8b85ef0a491c23cff4214e0299cb076c0f099df28cfc2e88b8f67215" protocol=ttrpc version=3 Oct 28 04:40:18.461972 systemd[1]: Started cri-containerd-0f8b4a221df12019b1d22130a4b27da330d6e0e9059b0fbf47ec97cca794e907.scope - libcontainer container 0f8b4a221df12019b1d22130a4b27da330d6e0e9059b0fbf47ec97cca794e907. Oct 28 04:40:18.542833 containerd[1890]: time="2025-10-28T04:40:18.541994069Z" level=info msg="StartContainer for \"0f8b4a221df12019b1d22130a4b27da330d6e0e9059b0fbf47ec97cca794e907\" returns successfully" Oct 28 04:40:18.664690 kubelet[3230]: I1028 04:40:18.663768 3230 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="tigera-operator/tigera-operator-7dcd859c48-7fqlc" podStartSLOduration=1.8438555540000001 podStartE2EDuration="6.663719622s" podCreationTimestamp="2025-10-28 04:40:12 +0000 UTC" firstStartedPulling="2025-10-28 04:40:13.515423388 +0000 UTC m=+5.252256327" lastFinishedPulling="2025-10-28 04:40:18.335287456 +0000 UTC m=+10.072120395" observedRunningTime="2025-10-28 04:40:18.662006514 +0000 UTC m=+10.398839465" watchObservedRunningTime="2025-10-28 04:40:18.663719622 +0000 UTC m=+10.400552573" Oct 28 04:40:25.615209 sudo[2258]: pam_unix(sudo:session): session closed for user root Oct 28 04:40:25.639799 sshd[2257]: Connection closed by 147.75.109.163 port 40526 Oct 28 04:40:25.641945 sshd-session[2254]: pam_unix(sshd:session): session closed for user core Oct 28 04:40:25.654758 systemd-logind[1871]: Session 7 logged out. Waiting for processes to exit. Oct 28 04:40:25.655007 systemd[1]: sshd@6-172.31.30.14:22-147.75.109.163:40526.service: Deactivated successfully. Oct 28 04:40:25.665585 systemd[1]: session-7.scope: Deactivated successfully. Oct 28 04:40:25.667330 systemd[1]: session-7.scope: Consumed 9.036s CPU time, 222.7M memory peak. Oct 28 04:40:25.676355 systemd-logind[1871]: Removed session 7. Oct 28 04:40:42.772763 systemd[1]: Created slice kubepods-besteffort-podc902f069_2291_4bef_85c2_02de92fb31e7.slice - libcontainer container kubepods-besteffort-podc902f069_2291_4bef_85c2_02de92fb31e7.slice. Oct 28 04:40:42.775685 kubelet[3230]: I1028 04:40:42.773291 3230 status_manager.go:895] "Failed to get status for pod" podUID="c902f069-2291-4bef-85c2-02de92fb31e7" pod="calico-system/calico-typha-5d749c6cb8-qr9fx" err="pods \"calico-typha-5d749c6cb8-qr9fx\" is forbidden: User \"system:node:ip-172-31-30-14\" cannot get resource \"pods\" in API group \"\" in the namespace \"calico-system\": no relationship found between node 'ip-172-31-30-14' and this object" Oct 28 04:40:42.775685 kubelet[3230]: E1028 04:40:42.773734 3230 reflector.go:200] "Failed to watch" err="failed to list *v1.Secret: secrets \"typha-certs\" is forbidden: User \"system:node:ip-172-31-30-14\" cannot list resource \"secrets\" in API group \"\" in the namespace \"calico-system\": no relationship found between node 'ip-172-31-30-14' and this object" logger="UnhandledError" reflector="object-\"calico-system\"/\"typha-certs\"" type="*v1.Secret" Oct 28 04:40:42.775685 kubelet[3230]: E1028 04:40:42.774151 3230 reflector.go:200] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-172-31-30-14\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"calico-system\": no relationship found between node 'ip-172-31-30-14' and this object" logger="UnhandledError" reflector="object-\"calico-system\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Oct 28 04:40:42.775685 kubelet[3230]: E1028 04:40:42.774482 3230 reflector.go:200] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"tigera-ca-bundle\" is forbidden: User \"system:node:ip-172-31-30-14\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"calico-system\": no relationship found between node 'ip-172-31-30-14' and this object" logger="UnhandledError" reflector="object-\"calico-system\"/\"tigera-ca-bundle\"" type="*v1.ConfigMap" Oct 28 04:40:42.792696 kubelet[3230]: I1028 04:40:42.792621 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfc5f\" (UniqueName: \"kubernetes.io/projected/c902f069-2291-4bef-85c2-02de92fb31e7-kube-api-access-jfc5f\") pod \"calico-typha-5d749c6cb8-qr9fx\" (UID: \"c902f069-2291-4bef-85c2-02de92fb31e7\") " pod="calico-system/calico-typha-5d749c6cb8-qr9fx" Oct 28 04:40:42.792849 kubelet[3230]: I1028 04:40:42.792720 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tigera-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c902f069-2291-4bef-85c2-02de92fb31e7-tigera-ca-bundle\") pod \"calico-typha-5d749c6cb8-qr9fx\" (UID: \"c902f069-2291-4bef-85c2-02de92fb31e7\") " pod="calico-system/calico-typha-5d749c6cb8-qr9fx" Oct 28 04:40:42.792849 kubelet[3230]: I1028 04:40:42.792774 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"typha-certs\" (UniqueName: \"kubernetes.io/secret/c902f069-2291-4bef-85c2-02de92fb31e7-typha-certs\") pod \"calico-typha-5d749c6cb8-qr9fx\" (UID: \"c902f069-2291-4bef-85c2-02de92fb31e7\") " pod="calico-system/calico-typha-5d749c6cb8-qr9fx" Oct 28 04:40:43.089119 systemd[1]: Created slice kubepods-besteffort-pod926815c3_623e_4dd3_bfe0_235f8fdcafcf.slice - libcontainer container kubepods-besteffort-pod926815c3_623e_4dd3_bfe0_235f8fdcafcf.slice. Oct 28 04:40:43.095121 kubelet[3230]: I1028 04:40:43.095051 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-net-dir\" (UniqueName: \"kubernetes.io/host-path/926815c3-623e-4dd3-bfe0-235f8fdcafcf-cni-net-dir\") pod \"calico-node-pqgqr\" (UID: \"926815c3-623e-4dd3-bfe0-235f8fdcafcf\") " pod="calico-system/calico-node-pqgqr" Oct 28 04:40:43.095121 kubelet[3230]: I1028 04:40:43.095120 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-certs\" (UniqueName: \"kubernetes.io/secret/926815c3-623e-4dd3-bfe0-235f8fdcafcf-node-certs\") pod \"calico-node-pqgqr\" (UID: \"926815c3-623e-4dd3-bfe0-235f8fdcafcf\") " pod="calico-system/calico-node-pqgqr" Oct 28 04:40:43.095313 kubelet[3230]: I1028 04:40:43.095161 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/926815c3-623e-4dd3-bfe0-235f8fdcafcf-xtables-lock\") pod \"calico-node-pqgqr\" (UID: \"926815c3-623e-4dd3-bfe0-235f8fdcafcf\") " pod="calico-system/calico-node-pqgqr" Oct 28 04:40:43.095313 kubelet[3230]: I1028 04:40:43.095198 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6vtm\" (UniqueName: \"kubernetes.io/projected/926815c3-623e-4dd3-bfe0-235f8fdcafcf-kube-api-access-n6vtm\") pod \"calico-node-pqgqr\" (UID: \"926815c3-623e-4dd3-bfe0-235f8fdcafcf\") " pod="calico-system/calico-node-pqgqr" Oct 28 04:40:43.095313 kubelet[3230]: I1028 04:40:43.095254 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"policysync\" (UniqueName: \"kubernetes.io/host-path/926815c3-623e-4dd3-bfe0-235f8fdcafcf-policysync\") pod \"calico-node-pqgqr\" (UID: \"926815c3-623e-4dd3-bfe0-235f8fdcafcf\") " pod="calico-system/calico-node-pqgqr" Oct 28 04:40:43.095313 kubelet[3230]: I1028 04:40:43.095297 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"flexvol-driver-host\" (UniqueName: \"kubernetes.io/host-path/926815c3-623e-4dd3-bfe0-235f8fdcafcf-flexvol-driver-host\") pod \"calico-node-pqgqr\" (UID: \"926815c3-623e-4dd3-bfe0-235f8fdcafcf\") " pod="calico-system/calico-node-pqgqr" Oct 28 04:40:43.095518 kubelet[3230]: I1028 04:40:43.095331 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/926815c3-623e-4dd3-bfe0-235f8fdcafcf-lib-modules\") pod \"calico-node-pqgqr\" (UID: \"926815c3-623e-4dd3-bfe0-235f8fdcafcf\") " pod="calico-system/calico-node-pqgqr" Oct 28 04:40:43.095518 kubelet[3230]: I1028 04:40:43.095365 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-log-dir\" (UniqueName: \"kubernetes.io/host-path/926815c3-623e-4dd3-bfe0-235f8fdcafcf-cni-log-dir\") pod \"calico-node-pqgqr\" (UID: \"926815c3-623e-4dd3-bfe0-235f8fdcafcf\") " pod="calico-system/calico-node-pqgqr" Oct 28 04:40:43.095518 kubelet[3230]: I1028 04:40:43.095399 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-calico\" (UniqueName: \"kubernetes.io/host-path/926815c3-623e-4dd3-bfe0-235f8fdcafcf-var-lib-calico\") pod \"calico-node-pqgqr\" (UID: \"926815c3-623e-4dd3-bfe0-235f8fdcafcf\") " pod="calico-system/calico-node-pqgqr" Oct 28 04:40:43.095518 kubelet[3230]: I1028 04:40:43.095432 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-run-calico\" (UniqueName: \"kubernetes.io/host-path/926815c3-623e-4dd3-bfe0-235f8fdcafcf-var-run-calico\") pod \"calico-node-pqgqr\" (UID: \"926815c3-623e-4dd3-bfe0-235f8fdcafcf\") " pod="calico-system/calico-node-pqgqr" Oct 28 04:40:43.095518 kubelet[3230]: I1028 04:40:43.095477 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-bin-dir\" (UniqueName: \"kubernetes.io/host-path/926815c3-623e-4dd3-bfe0-235f8fdcafcf-cni-bin-dir\") pod \"calico-node-pqgqr\" (UID: \"926815c3-623e-4dd3-bfe0-235f8fdcafcf\") " pod="calico-system/calico-node-pqgqr" Oct 28 04:40:43.096879 kubelet[3230]: I1028 04:40:43.095518 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tigera-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/926815c3-623e-4dd3-bfe0-235f8fdcafcf-tigera-ca-bundle\") pod \"calico-node-pqgqr\" (UID: \"926815c3-623e-4dd3-bfe0-235f8fdcafcf\") " pod="calico-system/calico-node-pqgqr" Oct 28 04:40:43.205152 kubelet[3230]: E1028 04:40:43.205095 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.205152 kubelet[3230]: W1028 04:40:43.205139 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.205396 kubelet[3230]: E1028 04:40:43.205180 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.205575 kubelet[3230]: E1028 04:40:43.205529 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.205575 kubelet[3230]: W1028 04:40:43.205559 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.205728 kubelet[3230]: E1028 04:40:43.205583 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.206718 kubelet[3230]: E1028 04:40:43.206640 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.206718 kubelet[3230]: W1028 04:40:43.206710 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.206926 kubelet[3230]: E1028 04:40:43.206742 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.208742 kubelet[3230]: E1028 04:40:43.208691 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.208742 kubelet[3230]: W1028 04:40:43.208730 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.208742 kubelet[3230]: E1028 04:40:43.208763 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.214130 kubelet[3230]: E1028 04:40:43.210027 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.214130 kubelet[3230]: W1028 04:40:43.210055 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.214130 kubelet[3230]: E1028 04:40:43.210084 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.214678 kubelet[3230]: E1028 04:40:43.214489 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.214678 kubelet[3230]: W1028 04:40:43.214542 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.214678 kubelet[3230]: E1028 04:40:43.214576 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.218028 kubelet[3230]: E1028 04:40:43.217974 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.218028 kubelet[3230]: W1028 04:40:43.218016 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.218876 kubelet[3230]: E1028 04:40:43.218051 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.223420 kubelet[3230]: E1028 04:40:43.220848 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.223420 kubelet[3230]: W1028 04:40:43.220885 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.223420 kubelet[3230]: E1028 04:40:43.220917 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.223420 kubelet[3230]: E1028 04:40:43.221219 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.223420 kubelet[3230]: W1028 04:40:43.221233 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.223420 kubelet[3230]: E1028 04:40:43.221250 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.223420 kubelet[3230]: E1028 04:40:43.222089 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.223420 kubelet[3230]: W1028 04:40:43.222109 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.223420 kubelet[3230]: E1028 04:40:43.222133 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.223420 kubelet[3230]: E1028 04:40:43.222935 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.227501 kubelet[3230]: W1028 04:40:43.222959 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.227501 kubelet[3230]: E1028 04:40:43.222987 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.227501 kubelet[3230]: E1028 04:40:43.223458 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.227501 kubelet[3230]: W1028 04:40:43.223479 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.227501 kubelet[3230]: E1028 04:40:43.223501 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.227501 kubelet[3230]: E1028 04:40:43.226203 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized" pod="calico-system/csi-node-driver-jhrzl" podUID="c42b89c4-6ac3-4fdf-90fb-009bd174d781" Oct 28 04:40:43.227501 kubelet[3230]: E1028 04:40:43.226971 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.227501 kubelet[3230]: W1028 04:40:43.226995 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.227501 kubelet[3230]: E1028 04:40:43.227022 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.270994 kubelet[3230]: E1028 04:40:43.270893 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.271357 kubelet[3230]: W1028 04:40:43.271282 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.271357 kubelet[3230]: E1028 04:40:43.271333 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.272323 kubelet[3230]: E1028 04:40:43.272274 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.272593 kubelet[3230]: W1028 04:40:43.272311 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.272593 kubelet[3230]: E1028 04:40:43.272382 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.273807 kubelet[3230]: E1028 04:40:43.273184 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.273807 kubelet[3230]: W1028 04:40:43.273205 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.273807 kubelet[3230]: E1028 04:40:43.273230 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.274066 kubelet[3230]: E1028 04:40:43.273907 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.274066 kubelet[3230]: W1028 04:40:43.273927 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.274066 kubelet[3230]: E1028 04:40:43.273951 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.275633 kubelet[3230]: E1028 04:40:43.275581 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.275633 kubelet[3230]: W1028 04:40:43.275621 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.275852 kubelet[3230]: E1028 04:40:43.275798 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.278029 kubelet[3230]: E1028 04:40:43.277974 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.278029 kubelet[3230]: W1028 04:40:43.278014 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.278236 kubelet[3230]: E1028 04:40:43.278047 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.281746 kubelet[3230]: E1028 04:40:43.281693 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.281746 kubelet[3230]: W1028 04:40:43.281733 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.281958 kubelet[3230]: E1028 04:40:43.281766 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.282679 kubelet[3230]: E1028 04:40:43.282527 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.282679 kubelet[3230]: W1028 04:40:43.282565 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.282679 kubelet[3230]: E1028 04:40:43.282596 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.283583 kubelet[3230]: E1028 04:40:43.283504 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.283583 kubelet[3230]: W1028 04:40:43.283572 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.283854 kubelet[3230]: E1028 04:40:43.283604 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.286255 kubelet[3230]: E1028 04:40:43.286089 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.286255 kubelet[3230]: W1028 04:40:43.286242 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.286465 kubelet[3230]: E1028 04:40:43.286275 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.287827 kubelet[3230]: E1028 04:40:43.287766 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.287973 kubelet[3230]: W1028 04:40:43.287813 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.287973 kubelet[3230]: E1028 04:40:43.287878 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.288736 kubelet[3230]: E1028 04:40:43.288444 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.289058 kubelet[3230]: W1028 04:40:43.288714 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.289162 kubelet[3230]: E1028 04:40:43.289066 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.291149 kubelet[3230]: E1028 04:40:43.291107 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.291149 kubelet[3230]: W1028 04:40:43.291141 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.291342 kubelet[3230]: E1028 04:40:43.291184 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.291809 kubelet[3230]: E1028 04:40:43.291779 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.291893 kubelet[3230]: W1028 04:40:43.291806 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.291893 kubelet[3230]: E1028 04:40:43.291831 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.292332 kubelet[3230]: E1028 04:40:43.292302 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.292332 kubelet[3230]: W1028 04:40:43.292328 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.292452 kubelet[3230]: E1028 04:40:43.292351 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.292708 kubelet[3230]: E1028 04:40:43.292634 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.292708 kubelet[3230]: W1028 04:40:43.292679 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.292708 kubelet[3230]: E1028 04:40:43.292700 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.293290 kubelet[3230]: E1028 04:40:43.293262 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.293367 kubelet[3230]: W1028 04:40:43.293289 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.293367 kubelet[3230]: E1028 04:40:43.293312 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.293605 kubelet[3230]: E1028 04:40:43.293580 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.293695 kubelet[3230]: W1028 04:40:43.293607 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.293695 kubelet[3230]: E1028 04:40:43.293628 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.295174 kubelet[3230]: E1028 04:40:43.294864 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.295174 kubelet[3230]: W1028 04:40:43.294903 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.295174 kubelet[3230]: E1028 04:40:43.294946 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.295709 kubelet[3230]: E1028 04:40:43.295618 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.295790 kubelet[3230]: W1028 04:40:43.295736 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.295875 kubelet[3230]: E1028 04:40:43.295835 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.298377 kubelet[3230]: E1028 04:40:43.298315 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.298377 kubelet[3230]: W1028 04:40:43.298353 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.298849 kubelet[3230]: E1028 04:40:43.298412 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.298849 kubelet[3230]: I1028 04:40:43.298497 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c42b89c4-6ac3-4fdf-90fb-009bd174d781-socket-dir\") pod \"csi-node-driver-jhrzl\" (UID: \"c42b89c4-6ac3-4fdf-90fb-009bd174d781\") " pod="calico-system/csi-node-driver-jhrzl" Oct 28 04:40:43.299150 kubelet[3230]: E1028 04:40:43.299084 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.299150 kubelet[3230]: W1028 04:40:43.299114 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.299541 kubelet[3230]: E1028 04:40:43.299182 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.299776 kubelet[3230]: I1028 04:40:43.299539 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c42b89c4-6ac3-4fdf-90fb-009bd174d781-kubelet-dir\") pod \"csi-node-driver-jhrzl\" (UID: \"c42b89c4-6ac3-4fdf-90fb-009bd174d781\") " pod="calico-system/csi-node-driver-jhrzl" Oct 28 04:40:43.300075 kubelet[3230]: E1028 04:40:43.299863 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.300075 kubelet[3230]: W1028 04:40:43.299887 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.300075 kubelet[3230]: E1028 04:40:43.299913 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.300522 kubelet[3230]: E1028 04:40:43.300485 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.300522 kubelet[3230]: W1028 04:40:43.300516 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.300800 kubelet[3230]: E1028 04:40:43.300567 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.301159 kubelet[3230]: E1028 04:40:43.301063 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.301159 kubelet[3230]: W1028 04:40:43.301120 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.301159 kubelet[3230]: E1028 04:40:43.301145 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.301632 kubelet[3230]: E1028 04:40:43.301597 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.301632 kubelet[3230]: W1028 04:40:43.301625 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.302006 kubelet[3230]: E1028 04:40:43.301696 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.302297 kubelet[3230]: E1028 04:40:43.302158 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.302297 kubelet[3230]: W1028 04:40:43.302176 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.302297 kubelet[3230]: E1028 04:40:43.302198 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.302722 kubelet[3230]: I1028 04:40:43.302294 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c42b89c4-6ac3-4fdf-90fb-009bd174d781-registration-dir\") pod \"csi-node-driver-jhrzl\" (UID: \"c42b89c4-6ac3-4fdf-90fb-009bd174d781\") " pod="calico-system/csi-node-driver-jhrzl" Oct 28 04:40:43.302945 kubelet[3230]: E1028 04:40:43.302773 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.302945 kubelet[3230]: W1028 04:40:43.302793 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.302945 kubelet[3230]: E1028 04:40:43.302814 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.302945 kubelet[3230]: E1028 04:40:43.303152 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.302945 kubelet[3230]: W1028 04:40:43.303167 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.302945 kubelet[3230]: E1028 04:40:43.303187 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.304088 kubelet[3230]: E1028 04:40:43.303506 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.304088 kubelet[3230]: W1028 04:40:43.303523 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.304088 kubelet[3230]: E1028 04:40:43.303543 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.304088 kubelet[3230]: I1028 04:40:43.303596 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"varrun\" (UniqueName: \"kubernetes.io/host-path/c42b89c4-6ac3-4fdf-90fb-009bd174d781-varrun\") pod \"csi-node-driver-jhrzl\" (UID: \"c42b89c4-6ac3-4fdf-90fb-009bd174d781\") " pod="calico-system/csi-node-driver-jhrzl" Oct 28 04:40:43.304088 kubelet[3230]: E1028 04:40:43.303960 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.304088 kubelet[3230]: W1028 04:40:43.303978 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.304088 kubelet[3230]: E1028 04:40:43.303998 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.304088 kubelet[3230]: I1028 04:40:43.304037 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfrjk\" (UniqueName: \"kubernetes.io/projected/c42b89c4-6ac3-4fdf-90fb-009bd174d781-kube-api-access-qfrjk\") pod \"csi-node-driver-jhrzl\" (UID: \"c42b89c4-6ac3-4fdf-90fb-009bd174d781\") " pod="calico-system/csi-node-driver-jhrzl" Oct 28 04:40:43.305351 kubelet[3230]: E1028 04:40:43.304438 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.305351 kubelet[3230]: W1028 04:40:43.304459 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.305351 kubelet[3230]: E1028 04:40:43.304482 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.305351 kubelet[3230]: E1028 04:40:43.304836 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.305351 kubelet[3230]: W1028 04:40:43.304855 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.305351 kubelet[3230]: E1028 04:40:43.304875 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.305351 kubelet[3230]: E1028 04:40:43.305194 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.305351 kubelet[3230]: W1028 04:40:43.305209 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.305351 kubelet[3230]: E1028 04:40:43.305227 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.306149 kubelet[3230]: E1028 04:40:43.305498 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.306149 kubelet[3230]: W1028 04:40:43.305549 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.306149 kubelet[3230]: E1028 04:40:43.305568 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.407783 kubelet[3230]: E1028 04:40:43.405052 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.407783 kubelet[3230]: W1028 04:40:43.405088 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.407783 kubelet[3230]: E1028 04:40:43.405117 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.407783 kubelet[3230]: E1028 04:40:43.405418 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.407783 kubelet[3230]: W1028 04:40:43.405433 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.407783 kubelet[3230]: E1028 04:40:43.405451 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.407783 kubelet[3230]: E1028 04:40:43.405732 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.407783 kubelet[3230]: W1028 04:40:43.405748 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.407783 kubelet[3230]: E1028 04:40:43.405770 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.407783 kubelet[3230]: E1028 04:40:43.406018 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.408703 kubelet[3230]: W1028 04:40:43.406032 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.408703 kubelet[3230]: E1028 04:40:43.406065 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.408703 kubelet[3230]: E1028 04:40:43.406345 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.408703 kubelet[3230]: W1028 04:40:43.406360 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.408703 kubelet[3230]: E1028 04:40:43.406377 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.408703 kubelet[3230]: E1028 04:40:43.406692 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.408703 kubelet[3230]: W1028 04:40:43.406708 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.408703 kubelet[3230]: E1028 04:40:43.406727 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.408703 kubelet[3230]: E1028 04:40:43.406958 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.408703 kubelet[3230]: W1028 04:40:43.406971 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.409156 kubelet[3230]: E1028 04:40:43.406989 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.409156 kubelet[3230]: E1028 04:40:43.407196 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.409156 kubelet[3230]: W1028 04:40:43.407209 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.409156 kubelet[3230]: E1028 04:40:43.407225 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.409156 kubelet[3230]: E1028 04:40:43.407511 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.409156 kubelet[3230]: W1028 04:40:43.407526 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.409156 kubelet[3230]: E1028 04:40:43.407545 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.409156 kubelet[3230]: E1028 04:40:43.407933 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.409156 kubelet[3230]: W1028 04:40:43.407952 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.409156 kubelet[3230]: E1028 04:40:43.407973 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.410010 kubelet[3230]: E1028 04:40:43.408379 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.410010 kubelet[3230]: W1028 04:40:43.408398 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.410010 kubelet[3230]: E1028 04:40:43.408419 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.410758 kubelet[3230]: E1028 04:40:43.410254 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.410758 kubelet[3230]: W1028 04:40:43.410288 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.410758 kubelet[3230]: E1028 04:40:43.410315 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.411912 kubelet[3230]: E1028 04:40:43.411863 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.411912 kubelet[3230]: W1028 04:40:43.411894 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.412085 kubelet[3230]: E1028 04:40:43.411923 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.414001 kubelet[3230]: E1028 04:40:43.412821 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.414001 kubelet[3230]: W1028 04:40:43.412856 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.414001 kubelet[3230]: E1028 04:40:43.412881 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.414001 kubelet[3230]: E1028 04:40:43.413830 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.414001 kubelet[3230]: W1028 04:40:43.413854 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.414001 kubelet[3230]: E1028 04:40:43.413881 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.415265 kubelet[3230]: E1028 04:40:43.415114 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.415265 kubelet[3230]: W1028 04:40:43.415152 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.415265 kubelet[3230]: E1028 04:40:43.415195 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.416586 kubelet[3230]: E1028 04:40:43.416536 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.416833 kubelet[3230]: W1028 04:40:43.416574 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.416898 kubelet[3230]: E1028 04:40:43.416829 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.418770 kubelet[3230]: E1028 04:40:43.418721 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.418770 kubelet[3230]: W1028 04:40:43.418755 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.418945 kubelet[3230]: E1028 04:40:43.418783 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.419403 kubelet[3230]: E1028 04:40:43.419371 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.419492 kubelet[3230]: W1028 04:40:43.419400 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.419492 kubelet[3230]: E1028 04:40:43.419425 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.419849 kubelet[3230]: E1028 04:40:43.419819 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.419914 kubelet[3230]: W1028 04:40:43.419871 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.419914 kubelet[3230]: E1028 04:40:43.419895 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.420443 kubelet[3230]: E1028 04:40:43.420413 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.420541 kubelet[3230]: W1028 04:40:43.420442 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.420541 kubelet[3230]: E1028 04:40:43.420465 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.420867 kubelet[3230]: E1028 04:40:43.420840 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.420937 kubelet[3230]: W1028 04:40:43.420865 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.420937 kubelet[3230]: E1028 04:40:43.420887 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.421690 kubelet[3230]: E1028 04:40:43.421411 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.421690 kubelet[3230]: W1028 04:40:43.421436 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.421690 kubelet[3230]: E1028 04:40:43.421459 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.422685 kubelet[3230]: E1028 04:40:43.422052 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.422685 kubelet[3230]: W1028 04:40:43.422085 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.422685 kubelet[3230]: E1028 04:40:43.422110 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.422685 kubelet[3230]: E1028 04:40:43.422558 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.422685 kubelet[3230]: W1028 04:40:43.422577 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.422685 kubelet[3230]: E1028 04:40:43.422598 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.717199 kubelet[3230]: E1028 04:40:43.716953 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.717199 kubelet[3230]: W1028 04:40:43.716996 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.717199 kubelet[3230]: E1028 04:40:43.717029 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.727621 kubelet[3230]: E1028 04:40:43.727495 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.727621 kubelet[3230]: W1028 04:40:43.727527 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.727621 kubelet[3230]: E1028 04:40:43.727554 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.895321 kubelet[3230]: E1028 04:40:43.894864 3230 secret.go:189] Couldn't get secret calico-system/typha-certs: failed to sync secret cache: timed out waiting for the condition Oct 28 04:40:43.895321 kubelet[3230]: E1028 04:40:43.894984 3230 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c902f069-2291-4bef-85c2-02de92fb31e7-typha-certs podName:c902f069-2291-4bef-85c2-02de92fb31e7 nodeName:}" failed. No retries permitted until 2025-10-28 04:40:44.394957103 +0000 UTC m=+36.131790042 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "typha-certs" (UniqueName: "kubernetes.io/secret/c902f069-2291-4bef-85c2-02de92fb31e7-typha-certs") pod "calico-typha-5d749c6cb8-qr9fx" (UID: "c902f069-2291-4bef-85c2-02de92fb31e7") : failed to sync secret cache: timed out waiting for the condition Oct 28 04:40:43.909903 kubelet[3230]: E1028 04:40:43.909766 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:43.909903 kubelet[3230]: W1028 04:40:43.909798 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:43.909903 kubelet[3230]: E1028 04:40:43.909826 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:43.918109 kubelet[3230]: E1028 04:40:43.918052 3230 projected.go:289] Couldn't get configMap calico-system/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition Oct 28 04:40:43.918109 kubelet[3230]: E1028 04:40:43.918102 3230 projected.go:194] Error preparing data for projected volume kube-api-access-jfc5f for pod calico-system/calico-typha-5d749c6cb8-qr9fx: failed to sync configmap cache: timed out waiting for the condition Oct 28 04:40:43.918274 kubelet[3230]: E1028 04:40:43.918189 3230 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c902f069-2291-4bef-85c2-02de92fb31e7-kube-api-access-jfc5f podName:c902f069-2291-4bef-85c2-02de92fb31e7 nodeName:}" failed. No retries permitted until 2025-10-28 04:40:44.418162871 +0000 UTC m=+36.154995834 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jfc5f" (UniqueName: "kubernetes.io/projected/c902f069-2291-4bef-85c2-02de92fb31e7-kube-api-access-jfc5f") pod "calico-typha-5d749c6cb8-qr9fx" (UID: "c902f069-2291-4bef-85c2-02de92fb31e7") : failed to sync configmap cache: timed out waiting for the condition Oct 28 04:40:44.011439 kubelet[3230]: E1028 04:40:44.011149 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:44.011439 kubelet[3230]: W1028 04:40:44.011180 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:44.011439 kubelet[3230]: E1028 04:40:44.011209 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:44.011858 kubelet[3230]: E1028 04:40:44.011540 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:44.011858 kubelet[3230]: W1028 04:40:44.011558 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:44.011858 kubelet[3230]: E1028 04:40:44.011580 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:44.113416 kubelet[3230]: E1028 04:40:44.113343 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:44.113416 kubelet[3230]: W1028 04:40:44.113382 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:44.113416 kubelet[3230]: E1028 04:40:44.113413 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:44.114686 kubelet[3230]: E1028 04:40:44.113775 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:44.114686 kubelet[3230]: W1028 04:40:44.113805 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:44.114686 kubelet[3230]: E1028 04:40:44.113829 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:44.122358 kubelet[3230]: E1028 04:40:44.122305 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:44.122358 kubelet[3230]: W1028 04:40:44.122346 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:44.122553 kubelet[3230]: E1028 04:40:44.122380 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:44.138285 kubelet[3230]: E1028 04:40:44.138252 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:44.138521 kubelet[3230]: W1028 04:40:44.138424 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:44.138521 kubelet[3230]: E1028 04:40:44.138463 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:44.215429 kubelet[3230]: E1028 04:40:44.215387 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:44.215429 kubelet[3230]: W1028 04:40:44.215422 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:44.215648 kubelet[3230]: E1028 04:40:44.215454 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:44.215856 kubelet[3230]: E1028 04:40:44.215829 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:44.215924 kubelet[3230]: W1028 04:40:44.215855 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:44.215924 kubelet[3230]: E1028 04:40:44.215879 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:44.296846 containerd[1890]: time="2025-10-28T04:40:44.296645621Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-node-pqgqr,Uid:926815c3-623e-4dd3-bfe0-235f8fdcafcf,Namespace:calico-system,Attempt:0,}" Oct 28 04:40:44.317515 kubelet[3230]: E1028 04:40:44.317396 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:44.317515 kubelet[3230]: W1028 04:40:44.317455 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:44.318509 kubelet[3230]: E1028 04:40:44.317486 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:44.319822 kubelet[3230]: E1028 04:40:44.319632 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:44.319822 kubelet[3230]: W1028 04:40:44.319702 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:44.319822 kubelet[3230]: E1028 04:40:44.319734 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:44.352971 containerd[1890]: time="2025-10-28T04:40:44.352902377Z" level=info msg="connecting to shim 8746bb22c407a9e88391a8cfd7dbad21940353d26319112ccd72fcc566994bda" address="unix:///run/containerd/s/be56358e08d6cdb71c5b0c09ddd9545e36d4fd506ca8e52e0c63b9239485b7f2" namespace=k8s.io protocol=ttrpc version=3 Oct 28 04:40:44.410093 systemd[1]: Started cri-containerd-8746bb22c407a9e88391a8cfd7dbad21940353d26319112ccd72fcc566994bda.scope - libcontainer container 8746bb22c407a9e88391a8cfd7dbad21940353d26319112ccd72fcc566994bda. Oct 28 04:40:44.423330 kubelet[3230]: E1028 04:40:44.423279 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:44.423330 kubelet[3230]: W1028 04:40:44.423319 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:44.423330 kubelet[3230]: E1028 04:40:44.423351 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:44.424703 kubelet[3230]: E1028 04:40:44.424424 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:44.424703 kubelet[3230]: W1028 04:40:44.424461 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:44.424703 kubelet[3230]: E1028 04:40:44.424492 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:44.426861 kubelet[3230]: E1028 04:40:44.426811 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:44.426861 kubelet[3230]: W1028 04:40:44.426849 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:44.427017 kubelet[3230]: E1028 04:40:44.426881 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:44.427372 kubelet[3230]: E1028 04:40:44.427332 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:44.427372 kubelet[3230]: W1028 04:40:44.427362 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:44.427524 kubelet[3230]: E1028 04:40:44.427386 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:44.427968 kubelet[3230]: E1028 04:40:44.427892 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:44.427968 kubelet[3230]: W1028 04:40:44.427922 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:44.428102 kubelet[3230]: E1028 04:40:44.427946 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:44.428935 kubelet[3230]: E1028 04:40:44.428878 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:44.429036 kubelet[3230]: W1028 04:40:44.428942 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:44.429036 kubelet[3230]: E1028 04:40:44.428971 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:44.429726 kubelet[3230]: E1028 04:40:44.429625 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:44.430701 kubelet[3230]: W1028 04:40:44.429755 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:44.430701 kubelet[3230]: E1028 04:40:44.429786 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:44.430701 kubelet[3230]: E1028 04:40:44.430268 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:44.430701 kubelet[3230]: W1028 04:40:44.430290 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:44.430701 kubelet[3230]: E1028 04:40:44.430312 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:44.430994 kubelet[3230]: E1028 04:40:44.430944 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:44.430994 kubelet[3230]: W1028 04:40:44.430964 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:44.431117 kubelet[3230]: E1028 04:40:44.431020 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:44.432204 kubelet[3230]: E1028 04:40:44.432157 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:44.432204 kubelet[3230]: W1028 04:40:44.432192 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:44.432786 kubelet[3230]: E1028 04:40:44.432263 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:44.448741 kubelet[3230]: E1028 04:40:44.446450 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:44.448741 kubelet[3230]: W1028 04:40:44.446794 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:44.448741 kubelet[3230]: E1028 04:40:44.446834 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:44.462554 kubelet[3230]: E1028 04:40:44.462498 3230 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Oct 28 04:40:44.463230 kubelet[3230]: W1028 04:40:44.462834 3230 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Oct 28 04:40:44.463334 kubelet[3230]: E1028 04:40:44.463241 3230 plugins.go:703] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Oct 28 04:40:44.499832 containerd[1890]: time="2025-10-28T04:40:44.499734546Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-node-pqgqr,Uid:926815c3-623e-4dd3-bfe0-235f8fdcafcf,Namespace:calico-system,Attempt:0,} returns sandbox id \"8746bb22c407a9e88391a8cfd7dbad21940353d26319112ccd72fcc566994bda\"" Oct 28 04:40:44.503596 containerd[1890]: time="2025-10-28T04:40:44.502525506Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/pod2daemon-flexvol:v3.30.4\"" Oct 28 04:40:44.586313 containerd[1890]: time="2025-10-28T04:40:44.584529234Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-typha-5d749c6cb8-qr9fx,Uid:c902f069-2291-4bef-85c2-02de92fb31e7,Namespace:calico-system,Attempt:0,}" Oct 28 04:40:44.626306 containerd[1890]: time="2025-10-28T04:40:44.626241811Z" level=info msg="connecting to shim 99de64d1a66ddf65ea43150b1b11ae5f8ade1583c3e22d5d99477912c6bb0ea6" address="unix:///run/containerd/s/f7a3c93e418a746ca0f9e4d2bcd0646fb6d31463283cffab2ab45d3cff669810" namespace=k8s.io protocol=ttrpc version=3 Oct 28 04:40:44.667974 systemd[1]: Started cri-containerd-99de64d1a66ddf65ea43150b1b11ae5f8ade1583c3e22d5d99477912c6bb0ea6.scope - libcontainer container 99de64d1a66ddf65ea43150b1b11ae5f8ade1583c3e22d5d99477912c6bb0ea6. Oct 28 04:40:44.752578 containerd[1890]: time="2025-10-28T04:40:44.752427511Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-typha-5d749c6cb8-qr9fx,Uid:c902f069-2291-4bef-85c2-02de92fb31e7,Namespace:calico-system,Attempt:0,} returns sandbox id \"99de64d1a66ddf65ea43150b1b11ae5f8ade1583c3e22d5d99477912c6bb0ea6\"" Oct 28 04:40:45.492824 kubelet[3230]: E1028 04:40:45.492689 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized" pod="calico-system/csi-node-driver-jhrzl" podUID="c42b89c4-6ac3-4fdf-90fb-009bd174d781" Oct 28 04:40:45.717136 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount3953026157.mount: Deactivated successfully. Oct 28 04:40:45.845964 containerd[1890]: time="2025-10-28T04:40:45.845091261Z" level=info msg="ImageCreate event name:\"ghcr.io/flatcar/calico/pod2daemon-flexvol:v3.30.4\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Oct 28 04:40:45.847098 containerd[1890]: time="2025-10-28T04:40:45.846996153Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/pod2daemon-flexvol:v3.30.4: active requests=0, bytes read=5636570" Oct 28 04:40:45.849403 containerd[1890]: time="2025-10-28T04:40:45.849329097Z" level=info msg="ImageCreate event name:\"sha256:90ff755393144dc5a3c05f95ffe1a3ecd2f89b98ecf36d9e4721471b80af4640\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Oct 28 04:40:45.854127 containerd[1890]: time="2025-10-28T04:40:45.853682469Z" level=info msg="ImageCreate event name:\"ghcr.io/flatcar/calico/pod2daemon-flexvol@sha256:50bdfe370b7308fa9957ed1eaccd094aa4f27f9a4f1dfcfef2f8a7696a1551e1\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Oct 28 04:40:45.854867 containerd[1890]: time="2025-10-28T04:40:45.854810757Z" level=info msg="Pulled image \"ghcr.io/flatcar/calico/pod2daemon-flexvol:v3.30.4\" with image id \"sha256:90ff755393144dc5a3c05f95ffe1a3ecd2f89b98ecf36d9e4721471b80af4640\", repo tag \"ghcr.io/flatcar/calico/pod2daemon-flexvol:v3.30.4\", repo digest \"ghcr.io/flatcar/calico/pod2daemon-flexvol@sha256:50bdfe370b7308fa9957ed1eaccd094aa4f27f9a4f1dfcfef2f8a7696a1551e1\", size \"5636392\" in 1.352222851s" Oct 28 04:40:45.854979 containerd[1890]: time="2025-10-28T04:40:45.854866593Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/pod2daemon-flexvol:v3.30.4\" returns image reference \"sha256:90ff755393144dc5a3c05f95ffe1a3ecd2f89b98ecf36d9e4721471b80af4640\"" Oct 28 04:40:45.857024 containerd[1890]: time="2025-10-28T04:40:45.856962657Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/typha:v3.30.4\"" Oct 28 04:40:45.864694 containerd[1890]: time="2025-10-28T04:40:45.863859009Z" level=info msg="CreateContainer within sandbox \"8746bb22c407a9e88391a8cfd7dbad21940353d26319112ccd72fcc566994bda\" for container &ContainerMetadata{Name:flexvol-driver,Attempt:0,}" Oct 28 04:40:45.885763 containerd[1890]: time="2025-10-28T04:40:45.885056817Z" level=info msg="Container 2b63f1d45071532d09f59a18bb300077fea339cce1b1866f224eae511c6c2817: CDI devices from CRI Config.CDIDevices: []" Oct 28 04:40:45.896514 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount1627682018.mount: Deactivated successfully. Oct 28 04:40:45.908152 containerd[1890]: time="2025-10-28T04:40:45.908080581Z" level=info msg="CreateContainer within sandbox \"8746bb22c407a9e88391a8cfd7dbad21940353d26319112ccd72fcc566994bda\" for &ContainerMetadata{Name:flexvol-driver,Attempt:0,} returns container id \"2b63f1d45071532d09f59a18bb300077fea339cce1b1866f224eae511c6c2817\"" Oct 28 04:40:45.909157 containerd[1890]: time="2025-10-28T04:40:45.909094917Z" level=info msg="StartContainer for \"2b63f1d45071532d09f59a18bb300077fea339cce1b1866f224eae511c6c2817\"" Oct 28 04:40:45.912421 containerd[1890]: time="2025-10-28T04:40:45.912344001Z" level=info msg="connecting to shim 2b63f1d45071532d09f59a18bb300077fea339cce1b1866f224eae511c6c2817" address="unix:///run/containerd/s/be56358e08d6cdb71c5b0c09ddd9545e36d4fd506ca8e52e0c63b9239485b7f2" protocol=ttrpc version=3 Oct 28 04:40:45.951961 systemd[1]: Started cri-containerd-2b63f1d45071532d09f59a18bb300077fea339cce1b1866f224eae511c6c2817.scope - libcontainer container 2b63f1d45071532d09f59a18bb300077fea339cce1b1866f224eae511c6c2817. Oct 28 04:40:46.043526 containerd[1890]: time="2025-10-28T04:40:46.043458186Z" level=info msg="StartContainer for \"2b63f1d45071532d09f59a18bb300077fea339cce1b1866f224eae511c6c2817\" returns successfully" Oct 28 04:40:46.070534 systemd[1]: cri-containerd-2b63f1d45071532d09f59a18bb300077fea339cce1b1866f224eae511c6c2817.scope: Deactivated successfully. Oct 28 04:40:46.078593 containerd[1890]: time="2025-10-28T04:40:46.078525870Z" level=info msg="received exit event container_id:\"2b63f1d45071532d09f59a18bb300077fea339cce1b1866f224eae511c6c2817\" id:\"2b63f1d45071532d09f59a18bb300077fea339cce1b1866f224eae511c6c2817\" pid:4060 exited_at:{seconds:1761626446 nanos:77394486}" Oct 28 04:40:46.078783 containerd[1890]: time="2025-10-28T04:40:46.078608958Z" level=info msg="TaskExit event in podsandbox handler container_id:\"2b63f1d45071532d09f59a18bb300077fea339cce1b1866f224eae511c6c2817\" id:\"2b63f1d45071532d09f59a18bb300077fea339cce1b1866f224eae511c6c2817\" pid:4060 exited_at:{seconds:1761626446 nanos:77394486}" Oct 28 04:40:47.492408 kubelet[3230]: E1028 04:40:47.492340 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized" pod="calico-system/csi-node-driver-jhrzl" podUID="c42b89c4-6ac3-4fdf-90fb-009bd174d781" Oct 28 04:40:48.163598 containerd[1890]: time="2025-10-28T04:40:48.163419776Z" level=info msg="ImageCreate event name:\"ghcr.io/flatcar/calico/typha:v3.30.4\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Oct 28 04:40:48.165700 containerd[1890]: time="2025-10-28T04:40:48.165623084Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/typha:v3.30.4: active requests=0, bytes read=31720858" Oct 28 04:40:48.166116 containerd[1890]: time="2025-10-28T04:40:48.166047440Z" level=info msg="ImageCreate event name:\"sha256:5fe38d12a54098df5aaf5ec7228dc2f976f60cb4f434d7256f03126b004fdc5b\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Oct 28 04:40:48.169627 containerd[1890]: time="2025-10-28T04:40:48.169193756Z" level=info msg="ImageCreate event name:\"ghcr.io/flatcar/calico/typha@sha256:6f437220b5b3c627fb4a0fc8dc323363101f3c22a8f337612c2a1ddfb73b810c\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Oct 28 04:40:48.173766 containerd[1890]: time="2025-10-28T04:40:48.173453348Z" level=info msg="Pulled image \"ghcr.io/flatcar/calico/typha:v3.30.4\" with image id \"sha256:5fe38d12a54098df5aaf5ec7228dc2f976f60cb4f434d7256f03126b004fdc5b\", repo tag \"ghcr.io/flatcar/calico/typha:v3.30.4\", repo digest \"ghcr.io/flatcar/calico/typha@sha256:6f437220b5b3c627fb4a0fc8dc323363101f3c22a8f337612c2a1ddfb73b810c\", size \"33090541\" in 2.316425963s" Oct 28 04:40:48.173766 containerd[1890]: time="2025-10-28T04:40:48.173745728Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/typha:v3.30.4\" returns image reference \"sha256:5fe38d12a54098df5aaf5ec7228dc2f976f60cb4f434d7256f03126b004fdc5b\"" Oct 28 04:40:48.179092 containerd[1890]: time="2025-10-28T04:40:48.179017976Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/cni:v3.30.4\"" Oct 28 04:40:48.216710 containerd[1890]: time="2025-10-28T04:40:48.216590769Z" level=info msg="CreateContainer within sandbox \"99de64d1a66ddf65ea43150b1b11ae5f8ade1583c3e22d5d99477912c6bb0ea6\" for container &ContainerMetadata{Name:calico-typha,Attempt:0,}" Oct 28 04:40:48.228189 containerd[1890]: time="2025-10-28T04:40:48.228091941Z" level=info msg="Container b4c88289ccc551a8087e407d1815381c78191c5a4b9dc7589da586820a53d28c: CDI devices from CRI Config.CDIDevices: []" Oct 28 04:40:48.234491 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount3277205560.mount: Deactivated successfully. Oct 28 04:40:48.246242 containerd[1890]: time="2025-10-28T04:40:48.246081273Z" level=info msg="CreateContainer within sandbox \"99de64d1a66ddf65ea43150b1b11ae5f8ade1583c3e22d5d99477912c6bb0ea6\" for &ContainerMetadata{Name:calico-typha,Attempt:0,} returns container id \"b4c88289ccc551a8087e407d1815381c78191c5a4b9dc7589da586820a53d28c\"" Oct 28 04:40:48.247743 containerd[1890]: time="2025-10-28T04:40:48.247397889Z" level=info msg="StartContainer for \"b4c88289ccc551a8087e407d1815381c78191c5a4b9dc7589da586820a53d28c\"" Oct 28 04:40:48.251269 containerd[1890]: time="2025-10-28T04:40:48.251183973Z" level=info msg="connecting to shim b4c88289ccc551a8087e407d1815381c78191c5a4b9dc7589da586820a53d28c" address="unix:///run/containerd/s/f7a3c93e418a746ca0f9e4d2bcd0646fb6d31463283cffab2ab45d3cff669810" protocol=ttrpc version=3 Oct 28 04:40:48.302966 systemd[1]: Started cri-containerd-b4c88289ccc551a8087e407d1815381c78191c5a4b9dc7589da586820a53d28c.scope - libcontainer container b4c88289ccc551a8087e407d1815381c78191c5a4b9dc7589da586820a53d28c. Oct 28 04:40:48.395705 containerd[1890]: time="2025-10-28T04:40:48.395643249Z" level=info msg="StartContainer for \"b4c88289ccc551a8087e407d1815381c78191c5a4b9dc7589da586820a53d28c\" returns successfully" Oct 28 04:40:49.493562 kubelet[3230]: E1028 04:40:49.493064 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized" pod="calico-system/csi-node-driver-jhrzl" podUID="c42b89c4-6ac3-4fdf-90fb-009bd174d781" Oct 28 04:40:49.787201 kubelet[3230]: I1028 04:40:49.787001 3230 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="calico-system/calico-typha-5d749c6cb8-qr9fx" podStartSLOduration=4.365717047 podStartE2EDuration="7.786977964s" podCreationTimestamp="2025-10-28 04:40:42 +0000 UTC" firstStartedPulling="2025-10-28 04:40:44.755178307 +0000 UTC m=+36.492011246" lastFinishedPulling="2025-10-28 04:40:48.1764392 +0000 UTC m=+39.913272163" observedRunningTime="2025-10-28 04:40:48.804044303 +0000 UTC m=+40.540877254" watchObservedRunningTime="2025-10-28 04:40:49.786977964 +0000 UTC m=+41.523810915" Oct 28 04:40:51.372276 containerd[1890]: time="2025-10-28T04:40:51.372151212Z" level=info msg="ImageCreate event name:\"ghcr.io/flatcar/calico/cni:v3.30.4\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Oct 28 04:40:51.374160 containerd[1890]: time="2025-10-28T04:40:51.373823568Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/cni:v3.30.4: active requests=0, bytes read=65925816" Oct 28 04:40:51.375206 containerd[1890]: time="2025-10-28T04:40:51.375151008Z" level=info msg="ImageCreate event name:\"sha256:e60d442b6496497355efdf45eaa3ea72f5a2b28a5187aeab33442933f3c735d2\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Oct 28 04:40:51.378831 containerd[1890]: time="2025-10-28T04:40:51.378783324Z" level=info msg="ImageCreate event name:\"ghcr.io/flatcar/calico/cni@sha256:273501a9cfbd848ade2b6a8452dfafdd3adb4f9bf9aec45c398a5d19b8026627\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Oct 28 04:40:51.380171 containerd[1890]: time="2025-10-28T04:40:51.380111628Z" level=info msg="Pulled image \"ghcr.io/flatcar/calico/cni:v3.30.4\" with image id \"sha256:e60d442b6496497355efdf45eaa3ea72f5a2b28a5187aeab33442933f3c735d2\", repo tag \"ghcr.io/flatcar/calico/cni:v3.30.4\", repo digest \"ghcr.io/flatcar/calico/cni@sha256:273501a9cfbd848ade2b6a8452dfafdd3adb4f9bf9aec45c398a5d19b8026627\", size \"67295507\" in 3.201032644s" Oct 28 04:40:51.380301 containerd[1890]: time="2025-10-28T04:40:51.380168136Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/cni:v3.30.4\" returns image reference \"sha256:e60d442b6496497355efdf45eaa3ea72f5a2b28a5187aeab33442933f3c735d2\"" Oct 28 04:40:51.388151 containerd[1890]: time="2025-10-28T04:40:51.388093560Z" level=info msg="CreateContainer within sandbox \"8746bb22c407a9e88391a8cfd7dbad21940353d26319112ccd72fcc566994bda\" for container &ContainerMetadata{Name:install-cni,Attempt:0,}" Oct 28 04:40:51.406518 containerd[1890]: time="2025-10-28T04:40:51.404995668Z" level=info msg="Container 36f6302c1037062458581beaa16b912aead7360e095e640ff18fe3b7275f708f: CDI devices from CRI Config.CDIDevices: []" Oct 28 04:40:51.431963 containerd[1890]: time="2025-10-28T04:40:51.431888556Z" level=info msg="CreateContainer within sandbox \"8746bb22c407a9e88391a8cfd7dbad21940353d26319112ccd72fcc566994bda\" for &ContainerMetadata{Name:install-cni,Attempt:0,} returns container id \"36f6302c1037062458581beaa16b912aead7360e095e640ff18fe3b7275f708f\"" Oct 28 04:40:51.432649 containerd[1890]: time="2025-10-28T04:40:51.432571332Z" level=info msg="StartContainer for \"36f6302c1037062458581beaa16b912aead7360e095e640ff18fe3b7275f708f\"" Oct 28 04:40:51.439333 containerd[1890]: time="2025-10-28T04:40:51.439021021Z" level=info msg="connecting to shim 36f6302c1037062458581beaa16b912aead7360e095e640ff18fe3b7275f708f" address="unix:///run/containerd/s/be56358e08d6cdb71c5b0c09ddd9545e36d4fd506ca8e52e0c63b9239485b7f2" protocol=ttrpc version=3 Oct 28 04:40:51.485982 systemd[1]: Started cri-containerd-36f6302c1037062458581beaa16b912aead7360e095e640ff18fe3b7275f708f.scope - libcontainer container 36f6302c1037062458581beaa16b912aead7360e095e640ff18fe3b7275f708f. Oct 28 04:40:51.492163 kubelet[3230]: E1028 04:40:51.492078 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized" pod="calico-system/csi-node-driver-jhrzl" podUID="c42b89c4-6ac3-4fdf-90fb-009bd174d781" Oct 28 04:40:51.574806 containerd[1890]: time="2025-10-28T04:40:51.574647301Z" level=info msg="StartContainer for \"36f6302c1037062458581beaa16b912aead7360e095e640ff18fe3b7275f708f\" returns successfully" Oct 28 04:40:52.488430 containerd[1890]: time="2025-10-28T04:40:52.488338586Z" level=error msg="failed to reload cni configuration after receiving fs change event(WRITE \"/etc/cni/net.d/calico-kubeconfig\")" error="cni config load failed: no network config found in /etc/cni/net.d: cni plugin not initialized: failed to load cni config" Oct 28 04:40:52.494720 systemd[1]: cri-containerd-36f6302c1037062458581beaa16b912aead7360e095e640ff18fe3b7275f708f.scope: Deactivated successfully. Oct 28 04:40:52.495703 systemd[1]: cri-containerd-36f6302c1037062458581beaa16b912aead7360e095e640ff18fe3b7275f708f.scope: Consumed 921ms CPU time, 186.4M memory peak, 165.9M written to disk. Oct 28 04:40:52.507294 containerd[1890]: time="2025-10-28T04:40:52.507233138Z" level=info msg="received exit event container_id:\"36f6302c1037062458581beaa16b912aead7360e095e640ff18fe3b7275f708f\" id:\"36f6302c1037062458581beaa16b912aead7360e095e640ff18fe3b7275f708f\" pid:4164 exited_at:{seconds:1761626452 nanos:506970302}" Oct 28 04:40:52.507898 kubelet[3230]: I1028 04:40:52.507726 3230 kubelet_node_status.go:501] "Fast updating node status as it just became ready" Oct 28 04:40:52.509361 containerd[1890]: time="2025-10-28T04:40:52.509011046Z" level=info msg="TaskExit event in podsandbox handler container_id:\"36f6302c1037062458581beaa16b912aead7360e095e640ff18fe3b7275f708f\" id:\"36f6302c1037062458581beaa16b912aead7360e095e640ff18fe3b7275f708f\" pid:4164 exited_at:{seconds:1761626452 nanos:506970302}" Oct 28 04:40:52.587934 systemd[1]: run-containerd-io.containerd.runtime.v2.task-k8s.io-36f6302c1037062458581beaa16b912aead7360e095e640ff18fe3b7275f708f-rootfs.mount: Deactivated successfully. Oct 28 04:40:52.615613 systemd[1]: Created slice kubepods-burstable-pod9d93d421_2e21_4d9b_88ef_871150cd8795.slice - libcontainer container kubepods-burstable-pod9d93d421_2e21_4d9b_88ef_871150cd8795.slice. Oct 28 04:40:52.645186 systemd[1]: Created slice kubepods-burstable-poda7454325_6d3a_474b_a8d6_8ccbeabe4f69.slice - libcontainer container kubepods-burstable-poda7454325_6d3a_474b_a8d6_8ccbeabe4f69.slice. Oct 28 04:40:52.695423 kubelet[3230]: I1028 04:40:52.695294 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a7454325-6d3a-474b-a8d6-8ccbeabe4f69-config-volume\") pod \"coredns-674b8bbfcf-nbzhp\" (UID: \"a7454325-6d3a-474b-a8d6-8ccbeabe4f69\") " pod="kube-system/coredns-674b8bbfcf-nbzhp" Oct 28 04:40:52.696255 kubelet[3230]: I1028 04:40:52.695390 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d588ee10-7ecd-4970-b6a0-1f251568d2c6-config\") pod \"goldmane-666569f655-nrkfh\" (UID: \"d588ee10-7ecd-4970-b6a0-1f251568d2c6\") " pod="calico-system/goldmane-666569f655-nrkfh" Oct 28 04:40:52.696968 kubelet[3230]: I1028 04:40:52.696464 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"goldmane-key-pair\" (UniqueName: \"kubernetes.io/secret/d588ee10-7ecd-4970-b6a0-1f251568d2c6-goldmane-key-pair\") pod \"goldmane-666569f655-nrkfh\" (UID: \"d588ee10-7ecd-4970-b6a0-1f251568d2c6\") " pod="calico-system/goldmane-666569f655-nrkfh" Oct 28 04:40:52.697994 kubelet[3230]: I1028 04:40:52.697557 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr5pm\" (UniqueName: \"kubernetes.io/projected/9d93d421-2e21-4d9b-88ef-871150cd8795-kube-api-access-nr5pm\") pod \"coredns-674b8bbfcf-l754x\" (UID: \"9d93d421-2e21-4d9b-88ef-871150cd8795\") " pod="kube-system/coredns-674b8bbfcf-l754x" Oct 28 04:40:52.700830 kubelet[3230]: I1028 04:40:52.697639 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"goldmane-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d588ee10-7ecd-4970-b6a0-1f251568d2c6-goldmane-ca-bundle\") pod \"goldmane-666569f655-nrkfh\" (UID: \"d588ee10-7ecd-4970-b6a0-1f251568d2c6\") " pod="calico-system/goldmane-666569f655-nrkfh" Oct 28 04:40:52.700830 kubelet[3230]: I1028 04:40:52.698856 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tigera-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54edc01d-f226-4f67-826d-011b168afccb-tigera-ca-bundle\") pod \"calico-kube-controllers-56b4fb96c7-rtxd5\" (UID: \"54edc01d-f226-4f67-826d-011b168afccb\") " pod="calico-system/calico-kube-controllers-56b4fb96c7-rtxd5" Oct 28 04:40:52.700830 kubelet[3230]: I1028 04:40:52.698928 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxx4t\" (UniqueName: \"kubernetes.io/projected/d588ee10-7ecd-4970-b6a0-1f251568d2c6-kube-api-access-bxx4t\") pod \"goldmane-666569f655-nrkfh\" (UID: \"d588ee10-7ecd-4970-b6a0-1f251568d2c6\") " pod="calico-system/goldmane-666569f655-nrkfh" Oct 28 04:40:52.700830 kubelet[3230]: I1028 04:40:52.699022 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-654kb\" (UniqueName: \"kubernetes.io/projected/a7454325-6d3a-474b-a8d6-8ccbeabe4f69-kube-api-access-654kb\") pod \"coredns-674b8bbfcf-nbzhp\" (UID: \"a7454325-6d3a-474b-a8d6-8ccbeabe4f69\") " pod="kube-system/coredns-674b8bbfcf-nbzhp" Oct 28 04:40:52.698753 systemd[1]: Created slice kubepods-besteffort-podd588ee10_7ecd_4970_b6a0_1f251568d2c6.slice - libcontainer container kubepods-besteffort-podd588ee10_7ecd_4970_b6a0_1f251568d2c6.slice. Oct 28 04:40:52.705172 kubelet[3230]: I1028 04:40:52.699071 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhj7p\" (UniqueName: \"kubernetes.io/projected/54edc01d-f226-4f67-826d-011b168afccb-kube-api-access-rhj7p\") pod \"calico-kube-controllers-56b4fb96c7-rtxd5\" (UID: \"54edc01d-f226-4f67-826d-011b168afccb\") " pod="calico-system/calico-kube-controllers-56b4fb96c7-rtxd5" Oct 28 04:40:52.705172 kubelet[3230]: I1028 04:40:52.702900 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9d93d421-2e21-4d9b-88ef-871150cd8795-config-volume\") pod \"coredns-674b8bbfcf-l754x\" (UID: \"9d93d421-2e21-4d9b-88ef-871150cd8795\") " pod="kube-system/coredns-674b8bbfcf-l754x" Oct 28 04:40:52.725834 systemd[1]: Created slice kubepods-besteffort-pod4bc14ee4_24b8_46c1_8183_4ae1905b78dd.slice - libcontainer container kubepods-besteffort-pod4bc14ee4_24b8_46c1_8183_4ae1905b78dd.slice. Oct 28 04:40:52.753104 systemd[1]: Created slice kubepods-besteffort-pod54edc01d_f226_4f67_826d_011b168afccb.slice - libcontainer container kubepods-besteffort-pod54edc01d_f226_4f67_826d_011b168afccb.slice. Oct 28 04:40:52.772832 systemd[1]: Created slice kubepods-besteffort-pod964233f5_181d_4a9e_b75e_ce5914393292.slice - libcontainer container kubepods-besteffort-pod964233f5_181d_4a9e_b75e_ce5914393292.slice. Oct 28 04:40:52.796153 systemd[1]: Created slice kubepods-besteffort-pod9024310a_f566_4078_b96d_35169d725248.slice - libcontainer container kubepods-besteffort-pod9024310a_f566_4078_b96d_35169d725248.slice. Oct 28 04:40:52.803397 kubelet[3230]: I1028 04:40:52.803309 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rp64h\" (UniqueName: \"kubernetes.io/projected/964233f5-181d-4a9e-b75e-ce5914393292-kube-api-access-rp64h\") pod \"calico-apiserver-844c8ff9ff-trlfg\" (UID: \"964233f5-181d-4a9e-b75e-ce5914393292\") " pod="calico-apiserver/calico-apiserver-844c8ff9ff-trlfg" Oct 28 04:40:52.804517 kubelet[3230]: I1028 04:40:52.803410 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whisker-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9024310a-f566-4078-b96d-35169d725248-whisker-ca-bundle\") pod \"whisker-6455645bdd-sq5rp\" (UID: \"9024310a-f566-4078-b96d-35169d725248\") " pod="calico-system/whisker-6455645bdd-sq5rp" Oct 28 04:40:52.804517 kubelet[3230]: I1028 04:40:52.803559 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-275zr\" (UniqueName: \"kubernetes.io/projected/4bc14ee4-24b8-46c1-8183-4ae1905b78dd-kube-api-access-275zr\") pod \"calico-apiserver-844c8ff9ff-822zr\" (UID: \"4bc14ee4-24b8-46c1-8183-4ae1905b78dd\") " pod="calico-apiserver/calico-apiserver-844c8ff9ff-822zr" Oct 28 04:40:52.804517 kubelet[3230]: I1028 04:40:52.803613 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttkbv\" (UniqueName: \"kubernetes.io/projected/9024310a-f566-4078-b96d-35169d725248-kube-api-access-ttkbv\") pod \"whisker-6455645bdd-sq5rp\" (UID: \"9024310a-f566-4078-b96d-35169d725248\") " pod="calico-system/whisker-6455645bdd-sq5rp" Oct 28 04:40:52.804517 kubelet[3230]: I1028 04:40:52.803740 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"calico-apiserver-certs\" (UniqueName: \"kubernetes.io/secret/4bc14ee4-24b8-46c1-8183-4ae1905b78dd-calico-apiserver-certs\") pod \"calico-apiserver-844c8ff9ff-822zr\" (UID: \"4bc14ee4-24b8-46c1-8183-4ae1905b78dd\") " pod="calico-apiserver/calico-apiserver-844c8ff9ff-822zr" Oct 28 04:40:52.804517 kubelet[3230]: I1028 04:40:52.803782 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"calico-apiserver-certs\" (UniqueName: \"kubernetes.io/secret/964233f5-181d-4a9e-b75e-ce5914393292-calico-apiserver-certs\") pod \"calico-apiserver-844c8ff9ff-trlfg\" (UID: \"964233f5-181d-4a9e-b75e-ce5914393292\") " pod="calico-apiserver/calico-apiserver-844c8ff9ff-trlfg" Oct 28 04:40:52.804858 kubelet[3230]: I1028 04:40:52.803847 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whisker-backend-key-pair\" (UniqueName: \"kubernetes.io/secret/9024310a-f566-4078-b96d-35169d725248-whisker-backend-key-pair\") pod \"whisker-6455645bdd-sq5rp\" (UID: \"9024310a-f566-4078-b96d-35169d725248\") " pod="calico-system/whisker-6455645bdd-sq5rp" Oct 28 04:40:52.943390 containerd[1890]: time="2025-10-28T04:40:52.943128220Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-674b8bbfcf-l754x,Uid:9d93d421-2e21-4d9b-88ef-871150cd8795,Namespace:kube-system,Attempt:0,}" Oct 28 04:40:52.959327 containerd[1890]: time="2025-10-28T04:40:52.959150656Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-674b8bbfcf-nbzhp,Uid:a7454325-6d3a-474b-a8d6-8ccbeabe4f69,Namespace:kube-system,Attempt:0,}" Oct 28 04:40:53.016544 containerd[1890]: time="2025-10-28T04:40:53.016406496Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:goldmane-666569f655-nrkfh,Uid:d588ee10-7ecd-4970-b6a0-1f251568d2c6,Namespace:calico-system,Attempt:0,}" Oct 28 04:40:53.046870 containerd[1890]: time="2025-10-28T04:40:53.046773961Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-844c8ff9ff-822zr,Uid:4bc14ee4-24b8-46c1-8183-4ae1905b78dd,Namespace:calico-apiserver,Attempt:0,}" Oct 28 04:40:53.086498 containerd[1890]: time="2025-10-28T04:40:53.086447437Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-kube-controllers-56b4fb96c7-rtxd5,Uid:54edc01d-f226-4f67-826d-011b168afccb,Namespace:calico-system,Attempt:0,}" Oct 28 04:40:53.089082 containerd[1890]: time="2025-10-28T04:40:53.088857433Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-844c8ff9ff-trlfg,Uid:964233f5-181d-4a9e-b75e-ce5914393292,Namespace:calico-apiserver,Attempt:0,}" Oct 28 04:40:53.104875 containerd[1890]: time="2025-10-28T04:40:53.104823985Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:whisker-6455645bdd-sq5rp,Uid:9024310a-f566-4078-b96d-35169d725248,Namespace:calico-system,Attempt:0,}" Oct 28 04:40:53.349635 containerd[1890]: time="2025-10-28T04:40:53.349493834Z" level=error msg="Failed to destroy network for sandbox \"dd7f03a209dae5c544103f9920f20419953ba03f26797ccee912e70abd8bc830\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Oct 28 04:40:53.504055 systemd[1]: Created slice kubepods-besteffort-podc42b89c4_6ac3_4fdf_90fb_009bd174d781.slice - libcontainer container kubepods-besteffort-podc42b89c4_6ac3_4fdf_90fb_009bd174d781.slice. Oct 28 04:40:53.509799 containerd[1890]: time="2025-10-28T04:40:53.509738079Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:csi-node-driver-jhrzl,Uid:c42b89c4-6ac3-4fdf-90fb-009bd174d781,Namespace:calico-system,Attempt:0,}" Oct 28 04:40:53.730622 containerd[1890]: time="2025-10-28T04:40:53.730449148Z" level=error msg="Failed to destroy network for sandbox \"18c615338d97197c62705e5e415a01adbd971a60f7c66d6401db69c04c5c7057\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Oct 28 04:40:53.734735 systemd[1]: run-netns-cni\x2da69d8ab8\x2da92f\x2daede\x2d478c\x2de0ba0b61f419.mount: Deactivated successfully. Oct 28 04:40:53.747706 containerd[1890]: time="2025-10-28T04:40:53.747486112Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-674b8bbfcf-l754x,Uid:9d93d421-2e21-4d9b-88ef-871150cd8795,Namespace:kube-system,Attempt:0,} failed, error" error="rpc error: code = Unknown desc = failed to setup network for sandbox \"dd7f03a209dae5c544103f9920f20419953ba03f26797ccee912e70abd8bc830\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Oct 28 04:40:53.749006 kubelet[3230]: E1028 04:40:53.748781 3230 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"dd7f03a209dae5c544103f9920f20419953ba03f26797ccee912e70abd8bc830\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Oct 28 04:40:53.749006 kubelet[3230]: E1028 04:40:53.749039 3230 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"dd7f03a209dae5c544103f9920f20419953ba03f26797ccee912e70abd8bc830\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-674b8bbfcf-l754x" Oct 28 04:40:53.749006 kubelet[3230]: E1028 04:40:53.749076 3230 kuberuntime_manager.go:1252] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"dd7f03a209dae5c544103f9920f20419953ba03f26797ccee912e70abd8bc830\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-674b8bbfcf-l754x" Oct 28 04:40:53.750892 kubelet[3230]: E1028 04:40:53.750776 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-674b8bbfcf-l754x_kube-system(9d93d421-2e21-4d9b-88ef-871150cd8795)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-674b8bbfcf-l754x_kube-system(9d93d421-2e21-4d9b-88ef-871150cd8795)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"dd7f03a209dae5c544103f9920f20419953ba03f26797ccee912e70abd8bc830\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="kube-system/coredns-674b8bbfcf-l754x" podUID="9d93d421-2e21-4d9b-88ef-871150cd8795" Oct 28 04:40:53.795948 containerd[1890]: time="2025-10-28T04:40:53.795863980Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-674b8bbfcf-nbzhp,Uid:a7454325-6d3a-474b-a8d6-8ccbeabe4f69,Namespace:kube-system,Attempt:0,} failed, error" error="rpc error: code = Unknown desc = failed to setup network for sandbox \"18c615338d97197c62705e5e415a01adbd971a60f7c66d6401db69c04c5c7057\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Oct 28 04:40:53.798391 kubelet[3230]: E1028 04:40:53.798305 3230 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"18c615338d97197c62705e5e415a01adbd971a60f7c66d6401db69c04c5c7057\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Oct 28 04:40:53.798391 kubelet[3230]: E1028 04:40:53.798388 3230 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"18c615338d97197c62705e5e415a01adbd971a60f7c66d6401db69c04c5c7057\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-674b8bbfcf-nbzhp" Oct 28 04:40:53.798889 kubelet[3230]: E1028 04:40:53.798425 3230 kuberuntime_manager.go:1252] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"18c615338d97197c62705e5e415a01adbd971a60f7c66d6401db69c04c5c7057\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-674b8bbfcf-nbzhp" Oct 28 04:40:53.798889 kubelet[3230]: E1028 04:40:53.798499 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-674b8bbfcf-nbzhp_kube-system(a7454325-6d3a-474b-a8d6-8ccbeabe4f69)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-674b8bbfcf-nbzhp_kube-system(a7454325-6d3a-474b-a8d6-8ccbeabe4f69)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"18c615338d97197c62705e5e415a01adbd971a60f7c66d6401db69c04c5c7057\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="kube-system/coredns-674b8bbfcf-nbzhp" podUID="a7454325-6d3a-474b-a8d6-8ccbeabe4f69" Oct 28 04:40:53.839153 containerd[1890]: time="2025-10-28T04:40:53.837940516Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/node:v3.30.4\"" Oct 28 04:40:54.080707 containerd[1890]: time="2025-10-28T04:40:54.080561426Z" level=error msg="Failed to destroy network for sandbox \"f86f546ea33a1169a80e2c977100127a13de2fa4e2032a35249810f5defd7252\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Oct 28 04:40:54.087015 containerd[1890]: time="2025-10-28T04:40:54.085960046Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-844c8ff9ff-trlfg,Uid:964233f5-181d-4a9e-b75e-ce5914393292,Namespace:calico-apiserver,Attempt:0,} failed, error" error="rpc error: code = Unknown desc = failed to setup network for sandbox \"f86f546ea33a1169a80e2c977100127a13de2fa4e2032a35249810f5defd7252\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Oct 28 04:40:54.087206 kubelet[3230]: E1028 04:40:54.086743 3230 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"f86f546ea33a1169a80e2c977100127a13de2fa4e2032a35249810f5defd7252\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Oct 28 04:40:54.087206 kubelet[3230]: E1028 04:40:54.086826 3230 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"f86f546ea33a1169a80e2c977100127a13de2fa4e2032a35249810f5defd7252\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-844c8ff9ff-trlfg" Oct 28 04:40:54.087206 kubelet[3230]: E1028 04:40:54.086862 3230 kuberuntime_manager.go:1252] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"f86f546ea33a1169a80e2c977100127a13de2fa4e2032a35249810f5defd7252\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-844c8ff9ff-trlfg" Oct 28 04:40:54.086689 systemd[1]: run-netns-cni\x2d9b66eed4\x2d4667\x2d2f36\x2d871b\x2dd693de374fa7.mount: Deactivated successfully. Oct 28 04:40:54.089978 kubelet[3230]: E1028 04:40:54.086940 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"calico-apiserver-844c8ff9ff-trlfg_calico-apiserver(964233f5-181d-4a9e-b75e-ce5914393292)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"calico-apiserver-844c8ff9ff-trlfg_calico-apiserver(964233f5-181d-4a9e-b75e-ce5914393292)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"f86f546ea33a1169a80e2c977100127a13de2fa4e2032a35249810f5defd7252\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-apiserver/calico-apiserver-844c8ff9ff-trlfg" podUID="964233f5-181d-4a9e-b75e-ce5914393292" Oct 28 04:40:54.124861 containerd[1890]: time="2025-10-28T04:40:54.124782566Z" level=error msg="Failed to destroy network for sandbox \"fb644d53cfa0a30aca40b2c1556f8df6c97ee3fe4b8001888dadd5e0f43c9ed0\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Oct 28 04:40:54.132943 containerd[1890]: time="2025-10-28T04:40:54.132816890Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-844c8ff9ff-822zr,Uid:4bc14ee4-24b8-46c1-8183-4ae1905b78dd,Namespace:calico-apiserver,Attempt:0,} failed, error" error="rpc error: code = Unknown desc = failed to setup network for sandbox \"fb644d53cfa0a30aca40b2c1556f8df6c97ee3fe4b8001888dadd5e0f43c9ed0\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Oct 28 04:40:54.133351 kubelet[3230]: E1028 04:40:54.133166 3230 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"fb644d53cfa0a30aca40b2c1556f8df6c97ee3fe4b8001888dadd5e0f43c9ed0\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Oct 28 04:40:54.133351 kubelet[3230]: E1028 04:40:54.133254 3230 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"fb644d53cfa0a30aca40b2c1556f8df6c97ee3fe4b8001888dadd5e0f43c9ed0\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-844c8ff9ff-822zr" Oct 28 04:40:54.133351 kubelet[3230]: E1028 04:40:54.133289 3230 kuberuntime_manager.go:1252] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"fb644d53cfa0a30aca40b2c1556f8df6c97ee3fe4b8001888dadd5e0f43c9ed0\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-844c8ff9ff-822zr" Oct 28 04:40:54.134058 kubelet[3230]: E1028 04:40:54.133365 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"calico-apiserver-844c8ff9ff-822zr_calico-apiserver(4bc14ee4-24b8-46c1-8183-4ae1905b78dd)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"calico-apiserver-844c8ff9ff-822zr_calico-apiserver(4bc14ee4-24b8-46c1-8183-4ae1905b78dd)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"fb644d53cfa0a30aca40b2c1556f8df6c97ee3fe4b8001888dadd5e0f43c9ed0\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-apiserver/calico-apiserver-844c8ff9ff-822zr" podUID="4bc14ee4-24b8-46c1-8183-4ae1905b78dd" Oct 28 04:40:54.144729 containerd[1890]: time="2025-10-28T04:40:54.144527798Z" level=error msg="Failed to destroy network for sandbox \"716b816650b47866404716ad45a9ff8560483dc7dc4f55f4bafb0ad6188621f4\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Oct 28 04:40:54.146486 containerd[1890]: time="2025-10-28T04:40:54.145572758Z" level=error msg="Failed to destroy network for sandbox \"a0b4971517e6bbe035212f4f824fd0c9a5e847a3600f39c21b9eda2840a45a82\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Oct 28 04:40:54.150624 containerd[1890]: time="2025-10-28T04:40:54.150541478Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:whisker-6455645bdd-sq5rp,Uid:9024310a-f566-4078-b96d-35169d725248,Namespace:calico-system,Attempt:0,} failed, error" error="rpc error: code = Unknown desc = failed to setup network for sandbox \"a0b4971517e6bbe035212f4f824fd0c9a5e847a3600f39c21b9eda2840a45a82\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Oct 28 04:40:54.150939 kubelet[3230]: E1028 04:40:54.150880 3230 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a0b4971517e6bbe035212f4f824fd0c9a5e847a3600f39c21b9eda2840a45a82\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Oct 28 04:40:54.151051 kubelet[3230]: E1028 04:40:54.150965 3230 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a0b4971517e6bbe035212f4f824fd0c9a5e847a3600f39c21b9eda2840a45a82\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/whisker-6455645bdd-sq5rp" Oct 28 04:40:54.151051 kubelet[3230]: E1028 04:40:54.151003 3230 kuberuntime_manager.go:1252] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a0b4971517e6bbe035212f4f824fd0c9a5e847a3600f39c21b9eda2840a45a82\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/whisker-6455645bdd-sq5rp" Oct 28 04:40:54.151166 kubelet[3230]: E1028 04:40:54.151074 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"whisker-6455645bdd-sq5rp_calico-system(9024310a-f566-4078-b96d-35169d725248)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"whisker-6455645bdd-sq5rp_calico-system(9024310a-f566-4078-b96d-35169d725248)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"a0b4971517e6bbe035212f4f824fd0c9a5e847a3600f39c21b9eda2840a45a82\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-system/whisker-6455645bdd-sq5rp" podUID="9024310a-f566-4078-b96d-35169d725248" Oct 28 04:40:54.151805 containerd[1890]: time="2025-10-28T04:40:54.151577978Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-kube-controllers-56b4fb96c7-rtxd5,Uid:54edc01d-f226-4f67-826d-011b168afccb,Namespace:calico-system,Attempt:0,} failed, error" error="rpc error: code = Unknown desc = failed to setup network for sandbox \"716b816650b47866404716ad45a9ff8560483dc7dc4f55f4bafb0ad6188621f4\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Oct 28 04:40:54.153234 kubelet[3230]: E1028 04:40:54.153107 3230 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"716b816650b47866404716ad45a9ff8560483dc7dc4f55f4bafb0ad6188621f4\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Oct 28 04:40:54.153234 kubelet[3230]: E1028 04:40:54.153193 3230 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"716b816650b47866404716ad45a9ff8560483dc7dc4f55f4bafb0ad6188621f4\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/calico-kube-controllers-56b4fb96c7-rtxd5" Oct 28 04:40:54.153234 kubelet[3230]: E1028 04:40:54.153227 3230 kuberuntime_manager.go:1252] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"716b816650b47866404716ad45a9ff8560483dc7dc4f55f4bafb0ad6188621f4\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/calico-kube-controllers-56b4fb96c7-rtxd5" Oct 28 04:40:54.154095 kubelet[3230]: E1028 04:40:54.153303 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"calico-kube-controllers-56b4fb96c7-rtxd5_calico-system(54edc01d-f226-4f67-826d-011b168afccb)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"calico-kube-controllers-56b4fb96c7-rtxd5_calico-system(54edc01d-f226-4f67-826d-011b168afccb)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"716b816650b47866404716ad45a9ff8560483dc7dc4f55f4bafb0ad6188621f4\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-system/calico-kube-controllers-56b4fb96c7-rtxd5" podUID="54edc01d-f226-4f67-826d-011b168afccb" Oct 28 04:40:54.162860 containerd[1890]: time="2025-10-28T04:40:54.161864354Z" level=error msg="Failed to destroy network for sandbox \"03d5fb25e6fceb0b8c1022eb6665ef067ec99344303700a7cae50f658103976b\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Oct 28 04:40:54.167474 containerd[1890]: time="2025-10-28T04:40:54.167316578Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:goldmane-666569f655-nrkfh,Uid:d588ee10-7ecd-4970-b6a0-1f251568d2c6,Namespace:calico-system,Attempt:0,} failed, error" error="rpc error: code = Unknown desc = failed to setup network for sandbox \"03d5fb25e6fceb0b8c1022eb6665ef067ec99344303700a7cae50f658103976b\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Oct 28 04:40:54.167995 kubelet[3230]: E1028 04:40:54.167608 3230 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"03d5fb25e6fceb0b8c1022eb6665ef067ec99344303700a7cae50f658103976b\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Oct 28 04:40:54.168379 kubelet[3230]: E1028 04:40:54.168159 3230 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"03d5fb25e6fceb0b8c1022eb6665ef067ec99344303700a7cae50f658103976b\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/goldmane-666569f655-nrkfh" Oct 28 04:40:54.168379 kubelet[3230]: E1028 04:40:54.168224 3230 kuberuntime_manager.go:1252] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"03d5fb25e6fceb0b8c1022eb6665ef067ec99344303700a7cae50f658103976b\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/goldmane-666569f655-nrkfh" Oct 28 04:40:54.169593 kubelet[3230]: E1028 04:40:54.168340 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"goldmane-666569f655-nrkfh_calico-system(d588ee10-7ecd-4970-b6a0-1f251568d2c6)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"goldmane-666569f655-nrkfh_calico-system(d588ee10-7ecd-4970-b6a0-1f251568d2c6)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"03d5fb25e6fceb0b8c1022eb6665ef067ec99344303700a7cae50f658103976b\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-system/goldmane-666569f655-nrkfh" podUID="d588ee10-7ecd-4970-b6a0-1f251568d2c6" Oct 28 04:40:54.177463 containerd[1890]: time="2025-10-28T04:40:54.177384842Z" level=error msg="Failed to destroy network for sandbox \"1570aa06c0ab38199465efc8861c6b5629c3f0374b57d3e41c05fb54922d0bc8\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Oct 28 04:40:54.178793 containerd[1890]: time="2025-10-28T04:40:54.178722290Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:csi-node-driver-jhrzl,Uid:c42b89c4-6ac3-4fdf-90fb-009bd174d781,Namespace:calico-system,Attempt:0,} failed, error" error="rpc error: code = Unknown desc = failed to setup network for sandbox \"1570aa06c0ab38199465efc8861c6b5629c3f0374b57d3e41c05fb54922d0bc8\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Oct 28 04:40:54.179091 kubelet[3230]: E1028 04:40:54.179035 3230 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"1570aa06c0ab38199465efc8861c6b5629c3f0374b57d3e41c05fb54922d0bc8\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Oct 28 04:40:54.179202 kubelet[3230]: E1028 04:40:54.179120 3230 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"1570aa06c0ab38199465efc8861c6b5629c3f0374b57d3e41c05fb54922d0bc8\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/csi-node-driver-jhrzl" Oct 28 04:40:54.179202 kubelet[3230]: E1028 04:40:54.179159 3230 kuberuntime_manager.go:1252] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"1570aa06c0ab38199465efc8861c6b5629c3f0374b57d3e41c05fb54922d0bc8\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/csi-node-driver-jhrzl" Oct 28 04:40:54.179320 kubelet[3230]: E1028 04:40:54.179228 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"csi-node-driver-jhrzl_calico-system(c42b89c4-6ac3-4fdf-90fb-009bd174d781)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"csi-node-driver-jhrzl_calico-system(c42b89c4-6ac3-4fdf-90fb-009bd174d781)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"1570aa06c0ab38199465efc8861c6b5629c3f0374b57d3e41c05fb54922d0bc8\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-system/csi-node-driver-jhrzl" podUID="c42b89c4-6ac3-4fdf-90fb-009bd174d781" Oct 28 04:40:54.583853 systemd[1]: run-netns-cni\x2d5cad0acd\x2da7d6\x2d2e91\x2d25c1\x2d644e86f9d30a.mount: Deactivated successfully. Oct 28 04:40:54.584013 systemd[1]: run-netns-cni\x2d7d6dbf4c\x2da273\x2d9140\x2d37e4\x2d313450d9a481.mount: Deactivated successfully. Oct 28 04:40:54.584132 systemd[1]: run-netns-cni\x2dd36f8c6e\x2deb41\x2d1089\x2deff7\x2d66400113a293.mount: Deactivated successfully. Oct 28 04:40:54.584298 systemd[1]: run-netns-cni\x2d8122da51\x2d0221\x2d9a4f\x2da269\x2d33fc9a4ed640.mount: Deactivated successfully. Oct 28 04:40:54.584422 systemd[1]: run-netns-cni\x2dc86b4857\x2daca8\x2d46fd\x2de734\x2d27d1577f25bf.mount: Deactivated successfully. Oct 28 04:41:00.224966 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount2293382.mount: Deactivated successfully. Oct 28 04:41:00.305043 containerd[1890]: time="2025-10-28T04:41:00.304968069Z" level=info msg="ImageCreate event name:\"ghcr.io/flatcar/calico/node:v3.30.4\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Oct 28 04:41:00.309101 containerd[1890]: time="2025-10-28T04:41:00.308793789Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/node:v3.30.4: active requests=0, bytes read=150934562" Oct 28 04:41:00.312665 containerd[1890]: time="2025-10-28T04:41:00.312585345Z" level=info msg="ImageCreate event name:\"sha256:43a5290057a103af76996c108856f92ed902f34573d7a864f55f15b8aaf4683b\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Oct 28 04:41:00.318522 containerd[1890]: time="2025-10-28T04:41:00.318472389Z" level=info msg="ImageCreate event name:\"ghcr.io/flatcar/calico/node@sha256:e92cca333202c87d07bf57f38182fd68f0779f912ef55305eda1fccc9f33667c\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Oct 28 04:41:00.320691 containerd[1890]: time="2025-10-28T04:41:00.319848813Z" level=info msg="Pulled image \"ghcr.io/flatcar/calico/node:v3.30.4\" with image id \"sha256:43a5290057a103af76996c108856f92ed902f34573d7a864f55f15b8aaf4683b\", repo tag \"ghcr.io/flatcar/calico/node:v3.30.4\", repo digest \"ghcr.io/flatcar/calico/node@sha256:e92cca333202c87d07bf57f38182fd68f0779f912ef55305eda1fccc9f33667c\", size \"150934424\" in 6.480689217s" Oct 28 04:41:00.320691 containerd[1890]: time="2025-10-28T04:41:00.319909653Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/node:v3.30.4\" returns image reference \"sha256:43a5290057a103af76996c108856f92ed902f34573d7a864f55f15b8aaf4683b\"" Oct 28 04:41:00.355440 containerd[1890]: time="2025-10-28T04:41:00.355381281Z" level=info msg="CreateContainer within sandbox \"8746bb22c407a9e88391a8cfd7dbad21940353d26319112ccd72fcc566994bda\" for container &ContainerMetadata{Name:calico-node,Attempt:0,}" Oct 28 04:41:00.379102 containerd[1890]: time="2025-10-28T04:41:00.379025469Z" level=info msg="Container 15253a81462f5b0de8163beea82dd39695c0442c9740421204367d6d3be15501: CDI devices from CRI Config.CDIDevices: []" Oct 28 04:41:00.402566 containerd[1890]: time="2025-10-28T04:41:00.402425313Z" level=info msg="CreateContainer within sandbox \"8746bb22c407a9e88391a8cfd7dbad21940353d26319112ccd72fcc566994bda\" for &ContainerMetadata{Name:calico-node,Attempt:0,} returns container id \"15253a81462f5b0de8163beea82dd39695c0442c9740421204367d6d3be15501\"" Oct 28 04:41:00.403911 containerd[1890]: time="2025-10-28T04:41:00.403841001Z" level=info msg="StartContainer for \"15253a81462f5b0de8163beea82dd39695c0442c9740421204367d6d3be15501\"" Oct 28 04:41:00.408719 containerd[1890]: time="2025-10-28T04:41:00.408646797Z" level=info msg="connecting to shim 15253a81462f5b0de8163beea82dd39695c0442c9740421204367d6d3be15501" address="unix:///run/containerd/s/be56358e08d6cdb71c5b0c09ddd9545e36d4fd506ca8e52e0c63b9239485b7f2" protocol=ttrpc version=3 Oct 28 04:41:00.481067 systemd[1]: Started cri-containerd-15253a81462f5b0de8163beea82dd39695c0442c9740421204367d6d3be15501.scope - libcontainer container 15253a81462f5b0de8163beea82dd39695c0442c9740421204367d6d3be15501. Oct 28 04:41:00.588683 containerd[1890]: time="2025-10-28T04:41:00.587429962Z" level=info msg="StartContainer for \"15253a81462f5b0de8163beea82dd39695c0442c9740421204367d6d3be15501\" returns successfully" Oct 28 04:41:00.851727 kernel: wireguard: WireGuard 1.0.0 loaded. See www.wireguard.com for information. Oct 28 04:41:00.851877 kernel: wireguard: Copyright (C) 2015-2019 Jason A. Donenfeld . All Rights Reserved. Oct 28 04:41:00.932059 kubelet[3230]: I1028 04:41:00.931960 3230 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="calico-system/calico-node-pqgqr" podStartSLOduration=2.112275497 podStartE2EDuration="17.931930164s" podCreationTimestamp="2025-10-28 04:40:43 +0000 UTC" firstStartedPulling="2025-10-28 04:40:44.50219073 +0000 UTC m=+36.239023669" lastFinishedPulling="2025-10-28 04:41:00.321845397 +0000 UTC m=+52.058678336" observedRunningTime="2025-10-28 04:41:00.92081028 +0000 UTC m=+52.657643243" watchObservedRunningTime="2025-10-28 04:41:00.931930164 +0000 UTC m=+52.668763115" Oct 28 04:41:01.179730 kubelet[3230]: I1028 04:41:01.178831 3230 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"whisker-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9024310a-f566-4078-b96d-35169d725248-whisker-ca-bundle\") pod \"9024310a-f566-4078-b96d-35169d725248\" (UID: \"9024310a-f566-4078-b96d-35169d725248\") " Oct 28 04:41:01.179730 kubelet[3230]: I1028 04:41:01.178934 3230 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttkbv\" (UniqueName: \"kubernetes.io/projected/9024310a-f566-4078-b96d-35169d725248-kube-api-access-ttkbv\") pod \"9024310a-f566-4078-b96d-35169d725248\" (UID: \"9024310a-f566-4078-b96d-35169d725248\") " Oct 28 04:41:01.179730 kubelet[3230]: I1028 04:41:01.179001 3230 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"whisker-backend-key-pair\" (UniqueName: \"kubernetes.io/secret/9024310a-f566-4078-b96d-35169d725248-whisker-backend-key-pair\") pod \"9024310a-f566-4078-b96d-35169d725248\" (UID: \"9024310a-f566-4078-b96d-35169d725248\") " Oct 28 04:41:01.181353 kubelet[3230]: I1028 04:41:01.180997 3230 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9024310a-f566-4078-b96d-35169d725248-whisker-ca-bundle" (OuterVolumeSpecName: "whisker-ca-bundle") pod "9024310a-f566-4078-b96d-35169d725248" (UID: "9024310a-f566-4078-b96d-35169d725248"). InnerVolumeSpecName "whisker-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 28 04:41:01.194097 kubelet[3230]: I1028 04:41:01.194041 3230 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9024310a-f566-4078-b96d-35169d725248-whisker-backend-key-pair" (OuterVolumeSpecName: "whisker-backend-key-pair") pod "9024310a-f566-4078-b96d-35169d725248" (UID: "9024310a-f566-4078-b96d-35169d725248"). InnerVolumeSpecName "whisker-backend-key-pair". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 28 04:41:01.195891 kubelet[3230]: I1028 04:41:01.195815 3230 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9024310a-f566-4078-b96d-35169d725248-kube-api-access-ttkbv" (OuterVolumeSpecName: "kube-api-access-ttkbv") pod "9024310a-f566-4078-b96d-35169d725248" (UID: "9024310a-f566-4078-b96d-35169d725248"). InnerVolumeSpecName "kube-api-access-ttkbv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 28 04:41:01.227197 systemd[1]: var-lib-kubelet-pods-9024310a\x2df566\x2d4078\x2db96d\x2d35169d725248-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dttkbv.mount: Deactivated successfully. Oct 28 04:41:01.227387 systemd[1]: var-lib-kubelet-pods-9024310a\x2df566\x2d4078\x2db96d\x2d35169d725248-volumes-kubernetes.io\x7esecret-whisker\x2dbackend\x2dkey\x2dpair.mount: Deactivated successfully. Oct 28 04:41:01.280218 kubelet[3230]: I1028 04:41:01.280045 3230 reconciler_common.go:299] "Volume detached for volume \"whisker-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9024310a-f566-4078-b96d-35169d725248-whisker-ca-bundle\") on node \"ip-172-31-30-14\" DevicePath \"\"" Oct 28 04:41:01.280741 kubelet[3230]: I1028 04:41:01.280423 3230 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttkbv\" (UniqueName: \"kubernetes.io/projected/9024310a-f566-4078-b96d-35169d725248-kube-api-access-ttkbv\") on node \"ip-172-31-30-14\" DevicePath \"\"" Oct 28 04:41:01.280741 kubelet[3230]: I1028 04:41:01.280459 3230 reconciler_common.go:299] "Volume detached for volume \"whisker-backend-key-pair\" (UniqueName: \"kubernetes.io/secret/9024310a-f566-4078-b96d-35169d725248-whisker-backend-key-pair\") on node \"ip-172-31-30-14\" DevicePath \"\"" Oct 28 04:41:01.288210 containerd[1890]: time="2025-10-28T04:41:01.288119769Z" level=info msg="TaskExit event in podsandbox handler container_id:\"15253a81462f5b0de8163beea82dd39695c0442c9740421204367d6d3be15501\" id:\"23d68e979f0719378541b2a2a21972424b65c8767b90e289a50d6ee845857f38\" pid:4477 exit_status:1 exited_at:{seconds:1761626461 nanos:287517273}" Oct 28 04:41:01.887446 systemd[1]: Removed slice kubepods-besteffort-pod9024310a_f566_4078_b96d_35169d725248.slice - libcontainer container kubepods-besteffort-pod9024310a_f566_4078_b96d_35169d725248.slice. Oct 28 04:41:02.049875 kubelet[3230]: I1028 04:41:02.049819 3230 status_manager.go:895] "Failed to get status for pod" podUID="e49e398f-1e35-4733-8a07-8164b21c4248" pod="calico-system/whisker-845cdb6746-r6n8l" err="pods \"whisker-845cdb6746-r6n8l\" is forbidden: User \"system:node:ip-172-31-30-14\" cannot get resource \"pods\" in API group \"\" in the namespace \"calico-system\": no relationship found between node 'ip-172-31-30-14' and this object" Oct 28 04:41:02.053713 kubelet[3230]: E1028 04:41:02.050094 3230 reflector.go:200] "Failed to watch" err="failed to list *v1.Secret: secrets \"whisker-backend-key-pair\" is forbidden: User \"system:node:ip-172-31-30-14\" cannot list resource \"secrets\" in API group \"\" in the namespace \"calico-system\": no relationship found between node 'ip-172-31-30-14' and this object" logger="UnhandledError" reflector="object-\"calico-system\"/\"whisker-backend-key-pair\"" type="*v1.Secret" Oct 28 04:41:02.060880 systemd[1]: Created slice kubepods-besteffort-pode49e398f_1e35_4733_8a07_8164b21c4248.slice - libcontainer container kubepods-besteffort-pode49e398f_1e35_4733_8a07_8164b21c4248.slice. Oct 28 04:41:02.089243 kubelet[3230]: I1028 04:41:02.089183 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c96rb\" (UniqueName: \"kubernetes.io/projected/e49e398f-1e35-4733-8a07-8164b21c4248-kube-api-access-c96rb\") pod \"whisker-845cdb6746-r6n8l\" (UID: \"e49e398f-1e35-4733-8a07-8164b21c4248\") " pod="calico-system/whisker-845cdb6746-r6n8l" Oct 28 04:41:02.089687 kubelet[3230]: I1028 04:41:02.089517 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whisker-backend-key-pair\" (UniqueName: \"kubernetes.io/secret/e49e398f-1e35-4733-8a07-8164b21c4248-whisker-backend-key-pair\") pod \"whisker-845cdb6746-r6n8l\" (UID: \"e49e398f-1e35-4733-8a07-8164b21c4248\") " pod="calico-system/whisker-845cdb6746-r6n8l" Oct 28 04:41:02.089687 kubelet[3230]: I1028 04:41:02.089573 3230 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whisker-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e49e398f-1e35-4733-8a07-8164b21c4248-whisker-ca-bundle\") pod \"whisker-845cdb6746-r6n8l\" (UID: \"e49e398f-1e35-4733-8a07-8164b21c4248\") " pod="calico-system/whisker-845cdb6746-r6n8l" Oct 28 04:41:02.274746 containerd[1890]: time="2025-10-28T04:41:02.274140394Z" level=info msg="TaskExit event in podsandbox handler container_id:\"15253a81462f5b0de8163beea82dd39695c0442c9740421204367d6d3be15501\" id:\"34ba0c34a052a11c4ed3617f72979a09c24a8a7e9ba97db24f10b41a9f1efcc0\" pid:4522 exit_status:1 exited_at:{seconds:1761626462 nanos:273037798}" Oct 28 04:41:02.496962 kubelet[3230]: I1028 04:41:02.496889 3230 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9024310a-f566-4078-b96d-35169d725248" path="/var/lib/kubelet/pods/9024310a-f566-4078-b96d-35169d725248/volumes" Oct 28 04:41:03.193698 kubelet[3230]: E1028 04:41:03.193204 3230 secret.go:189] Couldn't get secret calico-system/whisker-backend-key-pair: failed to sync secret cache: timed out waiting for the condition Oct 28 04:41:03.193698 kubelet[3230]: E1028 04:41:03.193339 3230 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e49e398f-1e35-4733-8a07-8164b21c4248-whisker-backend-key-pair podName:e49e398f-1e35-4733-8a07-8164b21c4248 nodeName:}" failed. No retries permitted until 2025-10-28 04:41:03.693308299 +0000 UTC m=+55.430141250 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "whisker-backend-key-pair" (UniqueName: "kubernetes.io/secret/e49e398f-1e35-4733-8a07-8164b21c4248-whisker-backend-key-pair") pod "whisker-845cdb6746-r6n8l" (UID: "e49e398f-1e35-4733-8a07-8164b21c4248") : failed to sync secret cache: timed out waiting for the condition Oct 28 04:41:03.843219 systemd-networkd[1494]: vxlan.calico: Link UP Oct 28 04:41:03.843237 systemd-networkd[1494]: vxlan.calico: Gained carrier Oct 28 04:41:03.854627 (udev-worker)[4459]: Network interface NamePolicy= disabled on kernel command line. Oct 28 04:41:03.875529 containerd[1890]: time="2025-10-28T04:41:03.875469890Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:whisker-845cdb6746-r6n8l,Uid:e49e398f-1e35-4733-8a07-8164b21c4248,Namespace:calico-system,Attempt:0,}" Oct 28 04:41:03.930193 (udev-worker)[4462]: Network interface NamePolicy= disabled on kernel command line. Oct 28 04:41:04.230475 (udev-worker)[4705]: Network interface NamePolicy= disabled on kernel command line. Oct 28 04:41:04.237980 systemd-networkd[1494]: calie97baf9272f: Link UP Oct 28 04:41:04.239740 systemd-networkd[1494]: calie97baf9272f: Gained carrier Oct 28 04:41:04.280945 containerd[1890]: 2025-10-28 04:41:04.055 [INFO][4685] cni-plugin/plugin.go 340: Calico CNI found existing endpoint: &{{WorkloadEndpoint projectcalico.org/v3} {ip--172--31--30--14-k8s-whisker--845cdb6746--r6n8l-eth0 whisker-845cdb6746- calico-system e49e398f-1e35-4733-8a07-8164b21c4248 951 0 2025-10-28 04:41:01 +0000 UTC map[app.kubernetes.io/name:whisker k8s-app:whisker pod-template-hash:845cdb6746 projectcalico.org/namespace:calico-system projectcalico.org/orchestrator:k8s projectcalico.org/serviceaccount:whisker] map[] [] [] []} {k8s ip-172-31-30-14 whisker-845cdb6746-r6n8l eth0 whisker [] [] [kns.calico-system ksa.calico-system.whisker] calie97baf9272f [] [] }} ContainerID="bb4e2d795705578676fe2ddd37e973dbdc332b2be7c647410812a84fa0909063" Namespace="calico-system" Pod="whisker-845cdb6746-r6n8l" WorkloadEndpoint="ip--172--31--30--14-k8s-whisker--845cdb6746--r6n8l-" Oct 28 04:41:04.280945 containerd[1890]: 2025-10-28 04:41:04.056 [INFO][4685] cni-plugin/k8s.go 74: Extracted identifiers for CmdAddK8s ContainerID="bb4e2d795705578676fe2ddd37e973dbdc332b2be7c647410812a84fa0909063" Namespace="calico-system" Pod="whisker-845cdb6746-r6n8l" WorkloadEndpoint="ip--172--31--30--14-k8s-whisker--845cdb6746--r6n8l-eth0" Oct 28 04:41:04.280945 containerd[1890]: 2025-10-28 04:41:04.150 [INFO][4708] ipam/ipam_plugin.go 227: Calico CNI IPAM request count IPv4=1 IPv6=0 ContainerID="bb4e2d795705578676fe2ddd37e973dbdc332b2be7c647410812a84fa0909063" HandleID="k8s-pod-network.bb4e2d795705578676fe2ddd37e973dbdc332b2be7c647410812a84fa0909063" Workload="ip--172--31--30--14-k8s-whisker--845cdb6746--r6n8l-eth0" Oct 28 04:41:04.281265 containerd[1890]: 2025-10-28 04:41:04.151 [INFO][4708] ipam/ipam_plugin.go 275: Auto assigning IP ContainerID="bb4e2d795705578676fe2ddd37e973dbdc332b2be7c647410812a84fa0909063" HandleID="k8s-pod-network.bb4e2d795705578676fe2ddd37e973dbdc332b2be7c647410812a84fa0909063" Workload="ip--172--31--30--14-k8s-whisker--845cdb6746--r6n8l-eth0" assignArgs=ipam.AutoAssignArgs{Num4:1, Num6:0, HandleID:(*string)(0x4000103340), Attrs:map[string]string{"namespace":"calico-system", "node":"ip-172-31-30-14", "pod":"whisker-845cdb6746-r6n8l", "timestamp":"2025-10-28 04:41:04.150802824 +0000 UTC"}, Hostname:"ip-172-31-30-14", IPv4Pools:[]net.IPNet{}, IPv6Pools:[]net.IPNet{}, MaxBlocksPerHost:0, HostReservedAttrIPv4s:(*ipam.HostReservedAttr)(nil), HostReservedAttrIPv6s:(*ipam.HostReservedAttr)(nil), IntendedUse:"Workload"} Oct 28 04:41:04.281265 containerd[1890]: 2025-10-28 04:41:04.151 [INFO][4708] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Oct 28 04:41:04.281265 containerd[1890]: 2025-10-28 04:41:04.151 [INFO][4708] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Oct 28 04:41:04.281265 containerd[1890]: 2025-10-28 04:41:04.151 [INFO][4708] ipam/ipam.go 110: Auto-assign 1 ipv4, 0 ipv6 addrs for host 'ip-172-31-30-14' Oct 28 04:41:04.281265 containerd[1890]: 2025-10-28 04:41:04.167 [INFO][4708] ipam/ipam.go 691: Looking up existing affinities for host handle="k8s-pod-network.bb4e2d795705578676fe2ddd37e973dbdc332b2be7c647410812a84fa0909063" host="ip-172-31-30-14" Oct 28 04:41:04.281265 containerd[1890]: 2025-10-28 04:41:04.176 [INFO][4708] ipam/ipam.go 394: Looking up existing affinities for host host="ip-172-31-30-14" Oct 28 04:41:04.281265 containerd[1890]: 2025-10-28 04:41:04.184 [INFO][4708] ipam/ipam.go 511: Trying affinity for 192.168.28.0/26 host="ip-172-31-30-14" Oct 28 04:41:04.281265 containerd[1890]: 2025-10-28 04:41:04.187 [INFO][4708] ipam/ipam.go 158: Attempting to load block cidr=192.168.28.0/26 host="ip-172-31-30-14" Oct 28 04:41:04.281265 containerd[1890]: 2025-10-28 04:41:04.191 [INFO][4708] ipam/ipam.go 235: Affinity is confirmed and block has been loaded cidr=192.168.28.0/26 host="ip-172-31-30-14" Oct 28 04:41:04.281265 containerd[1890]: 2025-10-28 04:41:04.192 [INFO][4708] ipam/ipam.go 1219: Attempting to assign 1 addresses from block block=192.168.28.0/26 handle="k8s-pod-network.bb4e2d795705578676fe2ddd37e973dbdc332b2be7c647410812a84fa0909063" host="ip-172-31-30-14" Oct 28 04:41:04.282905 containerd[1890]: 2025-10-28 04:41:04.194 [INFO][4708] ipam/ipam.go 1780: Creating new handle: k8s-pod-network.bb4e2d795705578676fe2ddd37e973dbdc332b2be7c647410812a84fa0909063 Oct 28 04:41:04.282905 containerd[1890]: 2025-10-28 04:41:04.201 [INFO][4708] ipam/ipam.go 1246: Writing block in order to claim IPs block=192.168.28.0/26 handle="k8s-pod-network.bb4e2d795705578676fe2ddd37e973dbdc332b2be7c647410812a84fa0909063" host="ip-172-31-30-14" Oct 28 04:41:04.282905 containerd[1890]: 2025-10-28 04:41:04.213 [INFO][4708] ipam/ipam.go 1262: Successfully claimed IPs: [192.168.28.1/26] block=192.168.28.0/26 handle="k8s-pod-network.bb4e2d795705578676fe2ddd37e973dbdc332b2be7c647410812a84fa0909063" host="ip-172-31-30-14" Oct 28 04:41:04.282905 containerd[1890]: 2025-10-28 04:41:04.213 [INFO][4708] ipam/ipam.go 878: Auto-assigned 1 out of 1 IPv4s: [192.168.28.1/26] handle="k8s-pod-network.bb4e2d795705578676fe2ddd37e973dbdc332b2be7c647410812a84fa0909063" host="ip-172-31-30-14" Oct 28 04:41:04.282905 containerd[1890]: 2025-10-28 04:41:04.214 [INFO][4708] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Oct 28 04:41:04.282905 containerd[1890]: 2025-10-28 04:41:04.214 [INFO][4708] ipam/ipam_plugin.go 299: Calico CNI IPAM assigned addresses IPv4=[192.168.28.1/26] IPv6=[] ContainerID="bb4e2d795705578676fe2ddd37e973dbdc332b2be7c647410812a84fa0909063" HandleID="k8s-pod-network.bb4e2d795705578676fe2ddd37e973dbdc332b2be7c647410812a84fa0909063" Workload="ip--172--31--30--14-k8s-whisker--845cdb6746--r6n8l-eth0" Oct 28 04:41:04.283163 containerd[1890]: 2025-10-28 04:41:04.221 [INFO][4685] cni-plugin/k8s.go 418: Populated endpoint ContainerID="bb4e2d795705578676fe2ddd37e973dbdc332b2be7c647410812a84fa0909063" Namespace="calico-system" Pod="whisker-845cdb6746-r6n8l" WorkloadEndpoint="ip--172--31--30--14-k8s-whisker--845cdb6746--r6n8l-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--30--14-k8s-whisker--845cdb6746--r6n8l-eth0", GenerateName:"whisker-845cdb6746-", Namespace:"calico-system", SelfLink:"", UID:"e49e398f-1e35-4733-8a07-8164b21c4248", ResourceVersion:"951", Generation:0, CreationTimestamp:time.Date(2025, time.October, 28, 4, 41, 1, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app.kubernetes.io/name":"whisker", "k8s-app":"whisker", "pod-template-hash":"845cdb6746", "projectcalico.org/namespace":"calico-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"whisker"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-30-14", ContainerID:"", Pod:"whisker-845cdb6746-r6n8l", Endpoint:"eth0", ServiceAccountName:"whisker", IPNetworks:[]string{"192.168.28.1/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-system", "ksa.calico-system.whisker"}, InterfaceName:"calie97baf9272f", MAC:"", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Oct 28 04:41:04.283163 containerd[1890]: 2025-10-28 04:41:04.221 [INFO][4685] cni-plugin/k8s.go 419: Calico CNI using IPs: [192.168.28.1/32] ContainerID="bb4e2d795705578676fe2ddd37e973dbdc332b2be7c647410812a84fa0909063" Namespace="calico-system" Pod="whisker-845cdb6746-r6n8l" WorkloadEndpoint="ip--172--31--30--14-k8s-whisker--845cdb6746--r6n8l-eth0" Oct 28 04:41:04.283332 containerd[1890]: 2025-10-28 04:41:04.221 [INFO][4685] cni-plugin/dataplane_linux.go 69: Setting the host side veth name to calie97baf9272f ContainerID="bb4e2d795705578676fe2ddd37e973dbdc332b2be7c647410812a84fa0909063" Namespace="calico-system" Pod="whisker-845cdb6746-r6n8l" WorkloadEndpoint="ip--172--31--30--14-k8s-whisker--845cdb6746--r6n8l-eth0" Oct 28 04:41:04.283332 containerd[1890]: 2025-10-28 04:41:04.241 [INFO][4685] cni-plugin/dataplane_linux.go 508: Disabling IPv4 forwarding ContainerID="bb4e2d795705578676fe2ddd37e973dbdc332b2be7c647410812a84fa0909063" Namespace="calico-system" Pod="whisker-845cdb6746-r6n8l" WorkloadEndpoint="ip--172--31--30--14-k8s-whisker--845cdb6746--r6n8l-eth0" Oct 28 04:41:04.283438 containerd[1890]: 2025-10-28 04:41:04.242 [INFO][4685] cni-plugin/k8s.go 446: Added Mac, interface name, and active container ID to endpoint ContainerID="bb4e2d795705578676fe2ddd37e973dbdc332b2be7c647410812a84fa0909063" Namespace="calico-system" Pod="whisker-845cdb6746-r6n8l" WorkloadEndpoint="ip--172--31--30--14-k8s-whisker--845cdb6746--r6n8l-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--30--14-k8s-whisker--845cdb6746--r6n8l-eth0", GenerateName:"whisker-845cdb6746-", Namespace:"calico-system", SelfLink:"", UID:"e49e398f-1e35-4733-8a07-8164b21c4248", ResourceVersion:"951", Generation:0, CreationTimestamp:time.Date(2025, time.October, 28, 4, 41, 1, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app.kubernetes.io/name":"whisker", "k8s-app":"whisker", "pod-template-hash":"845cdb6746", "projectcalico.org/namespace":"calico-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"whisker"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-30-14", ContainerID:"bb4e2d795705578676fe2ddd37e973dbdc332b2be7c647410812a84fa0909063", Pod:"whisker-845cdb6746-r6n8l", Endpoint:"eth0", ServiceAccountName:"whisker", IPNetworks:[]string{"192.168.28.1/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-system", "ksa.calico-system.whisker"}, InterfaceName:"calie97baf9272f", MAC:"e6:c8:8d:c3:5a:a1", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Oct 28 04:41:04.283555 containerd[1890]: 2025-10-28 04:41:04.273 [INFO][4685] cni-plugin/k8s.go 532: Wrote updated endpoint to datastore ContainerID="bb4e2d795705578676fe2ddd37e973dbdc332b2be7c647410812a84fa0909063" Namespace="calico-system" Pod="whisker-845cdb6746-r6n8l" WorkloadEndpoint="ip--172--31--30--14-k8s-whisker--845cdb6746--r6n8l-eth0" Oct 28 04:41:04.388692 containerd[1890]: time="2025-10-28T04:41:04.388608373Z" level=info msg="connecting to shim bb4e2d795705578676fe2ddd37e973dbdc332b2be7c647410812a84fa0909063" address="unix:///run/containerd/s/2d6cbc60803709f8e5bf004badcbd620d664c1905871213cd37952602c0a5062" namespace=k8s.io protocol=ttrpc version=3 Oct 28 04:41:04.458461 systemd[1]: Started cri-containerd-bb4e2d795705578676fe2ddd37e973dbdc332b2be7c647410812a84fa0909063.scope - libcontainer container bb4e2d795705578676fe2ddd37e973dbdc332b2be7c647410812a84fa0909063. Oct 28 04:41:04.506525 containerd[1890]: time="2025-10-28T04:41:04.506363929Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-674b8bbfcf-nbzhp,Uid:a7454325-6d3a-474b-a8d6-8ccbeabe4f69,Namespace:kube-system,Attempt:0,}" Oct 28 04:41:04.507204 containerd[1890]: time="2025-10-28T04:41:04.507141073Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-844c8ff9ff-822zr,Uid:4bc14ee4-24b8-46c1-8183-4ae1905b78dd,Namespace:calico-apiserver,Attempt:0,}" Oct 28 04:41:04.692937 containerd[1890]: time="2025-10-28T04:41:04.692872034Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:whisker-845cdb6746-r6n8l,Uid:e49e398f-1e35-4733-8a07-8164b21c4248,Namespace:calico-system,Attempt:0,} returns sandbox id \"bb4e2d795705578676fe2ddd37e973dbdc332b2be7c647410812a84fa0909063\"" Oct 28 04:41:04.698685 containerd[1890]: time="2025-10-28T04:41:04.697719422Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/whisker:v3.30.4\"" Oct 28 04:41:04.922354 systemd-networkd[1494]: cali3f204eb6750: Link UP Oct 28 04:41:04.925857 systemd-networkd[1494]: cali3f204eb6750: Gained carrier Oct 28 04:41:04.971498 containerd[1890]: 2025-10-28 04:41:04.720 [INFO][4784] cni-plugin/plugin.go 340: Calico CNI found existing endpoint: &{{WorkloadEndpoint projectcalico.org/v3} {ip--172--31--30--14-k8s-calico--apiserver--844c8ff9ff--822zr-eth0 calico-apiserver-844c8ff9ff- calico-apiserver 4bc14ee4-24b8-46c1-8183-4ae1905b78dd 887 0 2025-10-28 04:40:28 +0000 UTC map[apiserver:true app.kubernetes.io/name:calico-apiserver k8s-app:calico-apiserver pod-template-hash:844c8ff9ff projectcalico.org/namespace:calico-apiserver projectcalico.org/orchestrator:k8s projectcalico.org/serviceaccount:calico-apiserver] map[] [] [] []} {k8s ip-172-31-30-14 calico-apiserver-844c8ff9ff-822zr eth0 calico-apiserver [] [] [kns.calico-apiserver ksa.calico-apiserver.calico-apiserver] cali3f204eb6750 [] [] }} ContainerID="66a5e17143f10af4d76582001e69262cfadf27e0a265afe9d5a83fe5d2387c51" Namespace="calico-apiserver" Pod="calico-apiserver-844c8ff9ff-822zr" WorkloadEndpoint="ip--172--31--30--14-k8s-calico--apiserver--844c8ff9ff--822zr-" Oct 28 04:41:04.971498 containerd[1890]: 2025-10-28 04:41:04.721 [INFO][4784] cni-plugin/k8s.go 74: Extracted identifiers for CmdAddK8s ContainerID="66a5e17143f10af4d76582001e69262cfadf27e0a265afe9d5a83fe5d2387c51" Namespace="calico-apiserver" Pod="calico-apiserver-844c8ff9ff-822zr" WorkloadEndpoint="ip--172--31--30--14-k8s-calico--apiserver--844c8ff9ff--822zr-eth0" Oct 28 04:41:04.971498 containerd[1890]: 2025-10-28 04:41:04.794 [INFO][4828] ipam/ipam_plugin.go 227: Calico CNI IPAM request count IPv4=1 IPv6=0 ContainerID="66a5e17143f10af4d76582001e69262cfadf27e0a265afe9d5a83fe5d2387c51" HandleID="k8s-pod-network.66a5e17143f10af4d76582001e69262cfadf27e0a265afe9d5a83fe5d2387c51" Workload="ip--172--31--30--14-k8s-calico--apiserver--844c8ff9ff--822zr-eth0" Oct 28 04:41:04.973569 containerd[1890]: 2025-10-28 04:41:04.795 [INFO][4828] ipam/ipam_plugin.go 275: Auto assigning IP ContainerID="66a5e17143f10af4d76582001e69262cfadf27e0a265afe9d5a83fe5d2387c51" HandleID="k8s-pod-network.66a5e17143f10af4d76582001e69262cfadf27e0a265afe9d5a83fe5d2387c51" Workload="ip--172--31--30--14-k8s-calico--apiserver--844c8ff9ff--822zr-eth0" assignArgs=ipam.AutoAssignArgs{Num4:1, Num6:0, HandleID:(*string)(0x4000101880), Attrs:map[string]string{"namespace":"calico-apiserver", "node":"ip-172-31-30-14", "pod":"calico-apiserver-844c8ff9ff-822zr", "timestamp":"2025-10-28 04:41:04.794964891 +0000 UTC"}, Hostname:"ip-172-31-30-14", IPv4Pools:[]net.IPNet{}, IPv6Pools:[]net.IPNet{}, MaxBlocksPerHost:0, HostReservedAttrIPv4s:(*ipam.HostReservedAttr)(nil), HostReservedAttrIPv6s:(*ipam.HostReservedAttr)(nil), IntendedUse:"Workload"} Oct 28 04:41:04.973569 containerd[1890]: 2025-10-28 04:41:04.795 [INFO][4828] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Oct 28 04:41:04.973569 containerd[1890]: 2025-10-28 04:41:04.795 [INFO][4828] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Oct 28 04:41:04.973569 containerd[1890]: 2025-10-28 04:41:04.795 [INFO][4828] ipam/ipam.go 110: Auto-assign 1 ipv4, 0 ipv6 addrs for host 'ip-172-31-30-14' Oct 28 04:41:04.973569 containerd[1890]: 2025-10-28 04:41:04.822 [INFO][4828] ipam/ipam.go 691: Looking up existing affinities for host handle="k8s-pod-network.66a5e17143f10af4d76582001e69262cfadf27e0a265afe9d5a83fe5d2387c51" host="ip-172-31-30-14" Oct 28 04:41:04.973569 containerd[1890]: 2025-10-28 04:41:04.833 [INFO][4828] ipam/ipam.go 394: Looking up existing affinities for host host="ip-172-31-30-14" Oct 28 04:41:04.973569 containerd[1890]: 2025-10-28 04:41:04.846 [INFO][4828] ipam/ipam.go 511: Trying affinity for 192.168.28.0/26 host="ip-172-31-30-14" Oct 28 04:41:04.973569 containerd[1890]: 2025-10-28 04:41:04.868 [INFO][4828] ipam/ipam.go 158: Attempting to load block cidr=192.168.28.0/26 host="ip-172-31-30-14" Oct 28 04:41:04.973569 containerd[1890]: 2025-10-28 04:41:04.875 [INFO][4828] ipam/ipam.go 235: Affinity is confirmed and block has been loaded cidr=192.168.28.0/26 host="ip-172-31-30-14" Oct 28 04:41:04.974154 containerd[1890]: 2025-10-28 04:41:04.875 [INFO][4828] ipam/ipam.go 1219: Attempting to assign 1 addresses from block block=192.168.28.0/26 handle="k8s-pod-network.66a5e17143f10af4d76582001e69262cfadf27e0a265afe9d5a83fe5d2387c51" host="ip-172-31-30-14" Oct 28 04:41:04.974154 containerd[1890]: 2025-10-28 04:41:04.882 [INFO][4828] ipam/ipam.go 1780: Creating new handle: k8s-pod-network.66a5e17143f10af4d76582001e69262cfadf27e0a265afe9d5a83fe5d2387c51 Oct 28 04:41:04.974154 containerd[1890]: 2025-10-28 04:41:04.894 [INFO][4828] ipam/ipam.go 1246: Writing block in order to claim IPs block=192.168.28.0/26 handle="k8s-pod-network.66a5e17143f10af4d76582001e69262cfadf27e0a265afe9d5a83fe5d2387c51" host="ip-172-31-30-14" Oct 28 04:41:04.974154 containerd[1890]: 2025-10-28 04:41:04.905 [INFO][4828] ipam/ipam.go 1262: Successfully claimed IPs: [192.168.28.2/26] block=192.168.28.0/26 handle="k8s-pod-network.66a5e17143f10af4d76582001e69262cfadf27e0a265afe9d5a83fe5d2387c51" host="ip-172-31-30-14" Oct 28 04:41:04.974154 containerd[1890]: 2025-10-28 04:41:04.905 [INFO][4828] ipam/ipam.go 878: Auto-assigned 1 out of 1 IPv4s: [192.168.28.2/26] handle="k8s-pod-network.66a5e17143f10af4d76582001e69262cfadf27e0a265afe9d5a83fe5d2387c51" host="ip-172-31-30-14" Oct 28 04:41:04.974154 containerd[1890]: 2025-10-28 04:41:04.905 [INFO][4828] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Oct 28 04:41:04.974154 containerd[1890]: 2025-10-28 04:41:04.905 [INFO][4828] ipam/ipam_plugin.go 299: Calico CNI IPAM assigned addresses IPv4=[192.168.28.2/26] IPv6=[] ContainerID="66a5e17143f10af4d76582001e69262cfadf27e0a265afe9d5a83fe5d2387c51" HandleID="k8s-pod-network.66a5e17143f10af4d76582001e69262cfadf27e0a265afe9d5a83fe5d2387c51" Workload="ip--172--31--30--14-k8s-calico--apiserver--844c8ff9ff--822zr-eth0" Oct 28 04:41:04.975640 containerd[1890]: 2025-10-28 04:41:04.911 [INFO][4784] cni-plugin/k8s.go 418: Populated endpoint ContainerID="66a5e17143f10af4d76582001e69262cfadf27e0a265afe9d5a83fe5d2387c51" Namespace="calico-apiserver" Pod="calico-apiserver-844c8ff9ff-822zr" WorkloadEndpoint="ip--172--31--30--14-k8s-calico--apiserver--844c8ff9ff--822zr-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--30--14-k8s-calico--apiserver--844c8ff9ff--822zr-eth0", GenerateName:"calico-apiserver-844c8ff9ff-", Namespace:"calico-apiserver", SelfLink:"", UID:"4bc14ee4-24b8-46c1-8183-4ae1905b78dd", ResourceVersion:"887", Generation:0, CreationTimestamp:time.Date(2025, time.October, 28, 4, 40, 28, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"apiserver":"true", "app.kubernetes.io/name":"calico-apiserver", "k8s-app":"calico-apiserver", "pod-template-hash":"844c8ff9ff", "projectcalico.org/namespace":"calico-apiserver", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"calico-apiserver"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-30-14", ContainerID:"", Pod:"calico-apiserver-844c8ff9ff-822zr", Endpoint:"eth0", ServiceAccountName:"calico-apiserver", IPNetworks:[]string{"192.168.28.2/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-apiserver", "ksa.calico-apiserver.calico-apiserver"}, InterfaceName:"cali3f204eb6750", MAC:"", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Oct 28 04:41:04.975885 containerd[1890]: 2025-10-28 04:41:04.911 [INFO][4784] cni-plugin/k8s.go 419: Calico CNI using IPs: [192.168.28.2/32] ContainerID="66a5e17143f10af4d76582001e69262cfadf27e0a265afe9d5a83fe5d2387c51" Namespace="calico-apiserver" Pod="calico-apiserver-844c8ff9ff-822zr" WorkloadEndpoint="ip--172--31--30--14-k8s-calico--apiserver--844c8ff9ff--822zr-eth0" Oct 28 04:41:04.975885 containerd[1890]: 2025-10-28 04:41:04.911 [INFO][4784] cni-plugin/dataplane_linux.go 69: Setting the host side veth name to cali3f204eb6750 ContainerID="66a5e17143f10af4d76582001e69262cfadf27e0a265afe9d5a83fe5d2387c51" Namespace="calico-apiserver" Pod="calico-apiserver-844c8ff9ff-822zr" WorkloadEndpoint="ip--172--31--30--14-k8s-calico--apiserver--844c8ff9ff--822zr-eth0" Oct 28 04:41:04.975885 containerd[1890]: 2025-10-28 04:41:04.930 [INFO][4784] cni-plugin/dataplane_linux.go 508: Disabling IPv4 forwarding ContainerID="66a5e17143f10af4d76582001e69262cfadf27e0a265afe9d5a83fe5d2387c51" Namespace="calico-apiserver" Pod="calico-apiserver-844c8ff9ff-822zr" WorkloadEndpoint="ip--172--31--30--14-k8s-calico--apiserver--844c8ff9ff--822zr-eth0" Oct 28 04:41:04.976030 containerd[1890]: 2025-10-28 04:41:04.934 [INFO][4784] cni-plugin/k8s.go 446: Added Mac, interface name, and active container ID to endpoint ContainerID="66a5e17143f10af4d76582001e69262cfadf27e0a265afe9d5a83fe5d2387c51" Namespace="calico-apiserver" Pod="calico-apiserver-844c8ff9ff-822zr" WorkloadEndpoint="ip--172--31--30--14-k8s-calico--apiserver--844c8ff9ff--822zr-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--30--14-k8s-calico--apiserver--844c8ff9ff--822zr-eth0", GenerateName:"calico-apiserver-844c8ff9ff-", Namespace:"calico-apiserver", SelfLink:"", UID:"4bc14ee4-24b8-46c1-8183-4ae1905b78dd", ResourceVersion:"887", Generation:0, CreationTimestamp:time.Date(2025, time.October, 28, 4, 40, 28, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"apiserver":"true", "app.kubernetes.io/name":"calico-apiserver", "k8s-app":"calico-apiserver", "pod-template-hash":"844c8ff9ff", "projectcalico.org/namespace":"calico-apiserver", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"calico-apiserver"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-30-14", ContainerID:"66a5e17143f10af4d76582001e69262cfadf27e0a265afe9d5a83fe5d2387c51", Pod:"calico-apiserver-844c8ff9ff-822zr", Endpoint:"eth0", ServiceAccountName:"calico-apiserver", IPNetworks:[]string{"192.168.28.2/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-apiserver", "ksa.calico-apiserver.calico-apiserver"}, InterfaceName:"cali3f204eb6750", MAC:"66:e4:fc:ef:49:a1", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Oct 28 04:41:04.977078 containerd[1890]: 2025-10-28 04:41:04.962 [INFO][4784] cni-plugin/k8s.go 532: Wrote updated endpoint to datastore ContainerID="66a5e17143f10af4d76582001e69262cfadf27e0a265afe9d5a83fe5d2387c51" Namespace="calico-apiserver" Pod="calico-apiserver-844c8ff9ff-822zr" WorkloadEndpoint="ip--172--31--30--14-k8s-calico--apiserver--844c8ff9ff--822zr-eth0" Oct 28 04:41:05.042557 containerd[1890]: time="2025-10-28T04:41:05.041899044Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Oct 28 04:41:05.047418 containerd[1890]: time="2025-10-28T04:41:05.047311428Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/whisker:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" Oct 28 04:41:05.047578 containerd[1890]: time="2025-10-28T04:41:05.047478756Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/whisker:v3.30.4: active requests=0, bytes read=73" Oct 28 04:41:05.048073 kubelet[3230]: E1028 04:41:05.047998 3230 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker:v3.30.4" Oct 28 04:41:05.049976 kubelet[3230]: E1028 04:41:05.048946 3230 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker:v3.30.4" Oct 28 04:41:05.055279 kubelet[3230]: E1028 04:41:05.054914 3230 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:whisker,Image:ghcr.io/flatcar/calico/whisker:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:INFO,ValueFrom:nil,},EnvVar{Name:CALICO_VERSION,Value:v3.30.4,ValueFrom:nil,},EnvVar{Name:CLUSTER_ID,Value:18ad39fbb4894dc69b7e845ad319a0ff,ValueFrom:nil,},EnvVar{Name:CLUSTER_TYPE,Value:typha,kdd,k8s,operator,bgp,kubeadm,ValueFrom:nil,},EnvVar{Name:NOTIFICATIONS,Value:Enabled,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-c96rb,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod whisker-845cdb6746-r6n8l_calico-system(e49e398f-1e35-4733-8a07-8164b21c4248): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" logger="UnhandledError" Oct 28 04:41:05.065338 containerd[1890]: time="2025-10-28T04:41:05.065080500Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\"" Oct 28 04:41:05.071891 systemd-networkd[1494]: cali0130d0c2382: Link UP Oct 28 04:41:05.078466 systemd-networkd[1494]: cali0130d0c2382: Gained carrier Oct 28 04:41:05.082036 containerd[1890]: time="2025-10-28T04:41:05.081933108Z" level=info msg="connecting to shim 66a5e17143f10af4d76582001e69262cfadf27e0a265afe9d5a83fe5d2387c51" address="unix:///run/containerd/s/e71e1ff557cc11dc8d6be1095124ffb294f5fccdbcdd9abd72bb3a5b035853c8" namespace=k8s.io protocol=ttrpc version=3 Oct 28 04:41:05.157602 containerd[1890]: 2025-10-28 04:41:04.733 [INFO][4793] cni-plugin/plugin.go 340: Calico CNI found existing endpoint: &{{WorkloadEndpoint projectcalico.org/v3} {ip--172--31--30--14-k8s-coredns--674b8bbfcf--nbzhp-eth0 coredns-674b8bbfcf- kube-system a7454325-6d3a-474b-a8d6-8ccbeabe4f69 884 0 2025-10-28 04:40:12 +0000 UTC map[k8s-app:kube-dns pod-template-hash:674b8bbfcf projectcalico.org/namespace:kube-system projectcalico.org/orchestrator:k8s projectcalico.org/serviceaccount:coredns] map[] [] [] []} {k8s ip-172-31-30-14 coredns-674b8bbfcf-nbzhp eth0 coredns [] [] [kns.kube-system ksa.kube-system.coredns] cali0130d0c2382 [{dns UDP 53 0 } {dns-tcp TCP 53 0 } {metrics TCP 9153 0 }] [] }} ContainerID="6ebb4ec29358d71559603256ac7e7ea86ee79daadbd95f7a1404505b9686d0e0" Namespace="kube-system" Pod="coredns-674b8bbfcf-nbzhp" WorkloadEndpoint="ip--172--31--30--14-k8s-coredns--674b8bbfcf--nbzhp-" Oct 28 04:41:05.157602 containerd[1890]: 2025-10-28 04:41:04.733 [INFO][4793] cni-plugin/k8s.go 74: Extracted identifiers for CmdAddK8s ContainerID="6ebb4ec29358d71559603256ac7e7ea86ee79daadbd95f7a1404505b9686d0e0" Namespace="kube-system" Pod="coredns-674b8bbfcf-nbzhp" WorkloadEndpoint="ip--172--31--30--14-k8s-coredns--674b8bbfcf--nbzhp-eth0" Oct 28 04:41:05.157602 containerd[1890]: 2025-10-28 04:41:04.812 [INFO][4833] ipam/ipam_plugin.go 227: Calico CNI IPAM request count IPv4=1 IPv6=0 ContainerID="6ebb4ec29358d71559603256ac7e7ea86ee79daadbd95f7a1404505b9686d0e0" HandleID="k8s-pod-network.6ebb4ec29358d71559603256ac7e7ea86ee79daadbd95f7a1404505b9686d0e0" Workload="ip--172--31--30--14-k8s-coredns--674b8bbfcf--nbzhp-eth0" Oct 28 04:41:05.158309 containerd[1890]: 2025-10-28 04:41:04.813 [INFO][4833] ipam/ipam_plugin.go 275: Auto assigning IP ContainerID="6ebb4ec29358d71559603256ac7e7ea86ee79daadbd95f7a1404505b9686d0e0" HandleID="k8s-pod-network.6ebb4ec29358d71559603256ac7e7ea86ee79daadbd95f7a1404505b9686d0e0" Workload="ip--172--31--30--14-k8s-coredns--674b8bbfcf--nbzhp-eth0" assignArgs=ipam.AutoAssignArgs{Num4:1, Num6:0, HandleID:(*string)(0x40002d3ae0), Attrs:map[string]string{"namespace":"kube-system", "node":"ip-172-31-30-14", "pod":"coredns-674b8bbfcf-nbzhp", "timestamp":"2025-10-28 04:41:04.812753679 +0000 UTC"}, Hostname:"ip-172-31-30-14", IPv4Pools:[]net.IPNet{}, IPv6Pools:[]net.IPNet{}, MaxBlocksPerHost:0, HostReservedAttrIPv4s:(*ipam.HostReservedAttr)(nil), HostReservedAttrIPv6s:(*ipam.HostReservedAttr)(nil), IntendedUse:"Workload"} Oct 28 04:41:05.158309 containerd[1890]: 2025-10-28 04:41:04.813 [INFO][4833] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Oct 28 04:41:05.158309 containerd[1890]: 2025-10-28 04:41:04.906 [INFO][4833] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Oct 28 04:41:05.158309 containerd[1890]: 2025-10-28 04:41:04.906 [INFO][4833] ipam/ipam.go 110: Auto-assign 1 ipv4, 0 ipv6 addrs for host 'ip-172-31-30-14' Oct 28 04:41:05.158309 containerd[1890]: 2025-10-28 04:41:04.940 [INFO][4833] ipam/ipam.go 691: Looking up existing affinities for host handle="k8s-pod-network.6ebb4ec29358d71559603256ac7e7ea86ee79daadbd95f7a1404505b9686d0e0" host="ip-172-31-30-14" Oct 28 04:41:05.158309 containerd[1890]: 2025-10-28 04:41:04.953 [INFO][4833] ipam/ipam.go 394: Looking up existing affinities for host host="ip-172-31-30-14" Oct 28 04:41:05.158309 containerd[1890]: 2025-10-28 04:41:04.974 [INFO][4833] ipam/ipam.go 511: Trying affinity for 192.168.28.0/26 host="ip-172-31-30-14" Oct 28 04:41:05.158309 containerd[1890]: 2025-10-28 04:41:04.985 [INFO][4833] ipam/ipam.go 158: Attempting to load block cidr=192.168.28.0/26 host="ip-172-31-30-14" Oct 28 04:41:05.158309 containerd[1890]: 2025-10-28 04:41:04.990 [INFO][4833] ipam/ipam.go 235: Affinity is confirmed and block has been loaded cidr=192.168.28.0/26 host="ip-172-31-30-14" Oct 28 04:41:05.158309 containerd[1890]: 2025-10-28 04:41:04.990 [INFO][4833] ipam/ipam.go 1219: Attempting to assign 1 addresses from block block=192.168.28.0/26 handle="k8s-pod-network.6ebb4ec29358d71559603256ac7e7ea86ee79daadbd95f7a1404505b9686d0e0" host="ip-172-31-30-14" Oct 28 04:41:05.160731 containerd[1890]: 2025-10-28 04:41:04.999 [INFO][4833] ipam/ipam.go 1780: Creating new handle: k8s-pod-network.6ebb4ec29358d71559603256ac7e7ea86ee79daadbd95f7a1404505b9686d0e0 Oct 28 04:41:05.160731 containerd[1890]: 2025-10-28 04:41:05.011 [INFO][4833] ipam/ipam.go 1246: Writing block in order to claim IPs block=192.168.28.0/26 handle="k8s-pod-network.6ebb4ec29358d71559603256ac7e7ea86ee79daadbd95f7a1404505b9686d0e0" host="ip-172-31-30-14" Oct 28 04:41:05.160731 containerd[1890]: 2025-10-28 04:41:05.041 [INFO][4833] ipam/ipam.go 1262: Successfully claimed IPs: [192.168.28.3/26] block=192.168.28.0/26 handle="k8s-pod-network.6ebb4ec29358d71559603256ac7e7ea86ee79daadbd95f7a1404505b9686d0e0" host="ip-172-31-30-14" Oct 28 04:41:05.160731 containerd[1890]: 2025-10-28 04:41:05.041 [INFO][4833] ipam/ipam.go 878: Auto-assigned 1 out of 1 IPv4s: [192.168.28.3/26] handle="k8s-pod-network.6ebb4ec29358d71559603256ac7e7ea86ee79daadbd95f7a1404505b9686d0e0" host="ip-172-31-30-14" Oct 28 04:41:05.160731 containerd[1890]: 2025-10-28 04:41:05.042 [INFO][4833] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Oct 28 04:41:05.160731 containerd[1890]: 2025-10-28 04:41:05.042 [INFO][4833] ipam/ipam_plugin.go 299: Calico CNI IPAM assigned addresses IPv4=[192.168.28.3/26] IPv6=[] ContainerID="6ebb4ec29358d71559603256ac7e7ea86ee79daadbd95f7a1404505b9686d0e0" HandleID="k8s-pod-network.6ebb4ec29358d71559603256ac7e7ea86ee79daadbd95f7a1404505b9686d0e0" Workload="ip--172--31--30--14-k8s-coredns--674b8bbfcf--nbzhp-eth0" Oct 28 04:41:05.161044 containerd[1890]: 2025-10-28 04:41:05.054 [INFO][4793] cni-plugin/k8s.go 418: Populated endpoint ContainerID="6ebb4ec29358d71559603256ac7e7ea86ee79daadbd95f7a1404505b9686d0e0" Namespace="kube-system" Pod="coredns-674b8bbfcf-nbzhp" WorkloadEndpoint="ip--172--31--30--14-k8s-coredns--674b8bbfcf--nbzhp-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--30--14-k8s-coredns--674b8bbfcf--nbzhp-eth0", GenerateName:"coredns-674b8bbfcf-", Namespace:"kube-system", SelfLink:"", UID:"a7454325-6d3a-474b-a8d6-8ccbeabe4f69", ResourceVersion:"884", Generation:0, CreationTimestamp:time.Date(2025, time.October, 28, 4, 40, 12, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-dns", "pod-template-hash":"674b8bbfcf", "projectcalico.org/namespace":"kube-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"coredns"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-30-14", ContainerID:"", Pod:"coredns-674b8bbfcf-nbzhp", Endpoint:"eth0", ServiceAccountName:"coredns", IPNetworks:[]string{"192.168.28.3/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.kube-system", "ksa.kube-system.coredns"}, InterfaceName:"cali0130d0c2382", MAC:"", Ports:[]v3.WorkloadEndpointPort{v3.WorkloadEndpointPort{Name:"dns", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"UDP"}, Port:0x35, HostPort:0x0, HostIP:""}, v3.WorkloadEndpointPort{Name:"dns-tcp", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"TCP"}, Port:0x35, HostPort:0x0, HostIP:""}, v3.WorkloadEndpointPort{Name:"metrics", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"TCP"}, Port:0x23c1, HostPort:0x0, HostIP:""}}, AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Oct 28 04:41:05.161044 containerd[1890]: 2025-10-28 04:41:05.055 [INFO][4793] cni-plugin/k8s.go 419: Calico CNI using IPs: [192.168.28.3/32] ContainerID="6ebb4ec29358d71559603256ac7e7ea86ee79daadbd95f7a1404505b9686d0e0" Namespace="kube-system" Pod="coredns-674b8bbfcf-nbzhp" WorkloadEndpoint="ip--172--31--30--14-k8s-coredns--674b8bbfcf--nbzhp-eth0" Oct 28 04:41:05.161044 containerd[1890]: 2025-10-28 04:41:05.055 [INFO][4793] cni-plugin/dataplane_linux.go 69: Setting the host side veth name to cali0130d0c2382 ContainerID="6ebb4ec29358d71559603256ac7e7ea86ee79daadbd95f7a1404505b9686d0e0" Namespace="kube-system" Pod="coredns-674b8bbfcf-nbzhp" WorkloadEndpoint="ip--172--31--30--14-k8s-coredns--674b8bbfcf--nbzhp-eth0" Oct 28 04:41:05.161044 containerd[1890]: 2025-10-28 04:41:05.087 [INFO][4793] cni-plugin/dataplane_linux.go 508: Disabling IPv4 forwarding ContainerID="6ebb4ec29358d71559603256ac7e7ea86ee79daadbd95f7a1404505b9686d0e0" Namespace="kube-system" Pod="coredns-674b8bbfcf-nbzhp" WorkloadEndpoint="ip--172--31--30--14-k8s-coredns--674b8bbfcf--nbzhp-eth0" Oct 28 04:41:05.161044 containerd[1890]: 2025-10-28 04:41:05.093 [INFO][4793] cni-plugin/k8s.go 446: Added Mac, interface name, and active container ID to endpoint ContainerID="6ebb4ec29358d71559603256ac7e7ea86ee79daadbd95f7a1404505b9686d0e0" Namespace="kube-system" Pod="coredns-674b8bbfcf-nbzhp" WorkloadEndpoint="ip--172--31--30--14-k8s-coredns--674b8bbfcf--nbzhp-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--30--14-k8s-coredns--674b8bbfcf--nbzhp-eth0", GenerateName:"coredns-674b8bbfcf-", Namespace:"kube-system", SelfLink:"", UID:"a7454325-6d3a-474b-a8d6-8ccbeabe4f69", ResourceVersion:"884", Generation:0, CreationTimestamp:time.Date(2025, time.October, 28, 4, 40, 12, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-dns", "pod-template-hash":"674b8bbfcf", "projectcalico.org/namespace":"kube-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"coredns"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-30-14", ContainerID:"6ebb4ec29358d71559603256ac7e7ea86ee79daadbd95f7a1404505b9686d0e0", Pod:"coredns-674b8bbfcf-nbzhp", Endpoint:"eth0", ServiceAccountName:"coredns", IPNetworks:[]string{"192.168.28.3/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.kube-system", "ksa.kube-system.coredns"}, InterfaceName:"cali0130d0c2382", MAC:"ce:3e:86:ac:70:28", Ports:[]v3.WorkloadEndpointPort{v3.WorkloadEndpointPort{Name:"dns", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"UDP"}, Port:0x35, HostPort:0x0, HostIP:""}, v3.WorkloadEndpointPort{Name:"dns-tcp", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"TCP"}, Port:0x35, HostPort:0x0, HostIP:""}, v3.WorkloadEndpointPort{Name:"metrics", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"TCP"}, Port:0x23c1, HostPort:0x0, HostIP:""}}, AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Oct 28 04:41:05.161044 containerd[1890]: 2025-10-28 04:41:05.144 [INFO][4793] cni-plugin/k8s.go 532: Wrote updated endpoint to datastore ContainerID="6ebb4ec29358d71559603256ac7e7ea86ee79daadbd95f7a1404505b9686d0e0" Namespace="kube-system" Pod="coredns-674b8bbfcf-nbzhp" WorkloadEndpoint="ip--172--31--30--14-k8s-coredns--674b8bbfcf--nbzhp-eth0" Oct 28 04:41:05.235132 systemd[1]: Started cri-containerd-66a5e17143f10af4d76582001e69262cfadf27e0a265afe9d5a83fe5d2387c51.scope - libcontainer container 66a5e17143f10af4d76582001e69262cfadf27e0a265afe9d5a83fe5d2387c51. Oct 28 04:41:05.257623 containerd[1890]: time="2025-10-28T04:41:05.257552737Z" level=info msg="connecting to shim 6ebb4ec29358d71559603256ac7e7ea86ee79daadbd95f7a1404505b9686d0e0" address="unix:///run/containerd/s/a6cf480a9d4ee784ae5cf2c8daa75fb1575de47bf0cdfd5ce51b5f238fc7e761" namespace=k8s.io protocol=ttrpc version=3 Oct 28 04:41:05.342805 containerd[1890]: time="2025-10-28T04:41:05.342258974Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Oct 28 04:41:05.346035 containerd[1890]: time="2025-10-28T04:41:05.345937070Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" Oct 28 04:41:05.346272 containerd[1890]: time="2025-10-28T04:41:05.346058438Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/whisker-backend:v3.30.4: active requests=0, bytes read=85" Oct 28 04:41:05.346902 kubelet[3230]: E1028 04:41:05.346834 3230 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker-backend:v3.30.4" Oct 28 04:41:05.347289 kubelet[3230]: E1028 04:41:05.346911 3230 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker-backend:v3.30.4" Oct 28 04:41:05.347816 kubelet[3230]: E1028 04:41:05.347097 3230 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:whisker-backend,Image:ghcr.io/flatcar/calico/whisker-backend:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:INFO,ValueFrom:nil,},EnvVar{Name:PORT,Value:3002,ValueFrom:nil,},EnvVar{Name:GOLDMANE_HOST,Value:goldmane.calico-system.svc.cluster.local:7443,ValueFrom:nil,},EnvVar{Name:TLS_CERT_PATH,Value:/whisker-backend-key-pair/tls.crt,ValueFrom:nil,},EnvVar{Name:TLS_KEY_PATH,Value:/whisker-backend-key-pair/tls.key,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:whisker-backend-key-pair,ReadOnly:true,MountPath:/whisker-backend-key-pair,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:whisker-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-c96rb,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod whisker-845cdb6746-r6n8l_calico-system(e49e398f-1e35-4733-8a07-8164b21c4248): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" logger="UnhandledError" Oct 28 04:41:05.348717 kubelet[3230]: E1028 04:41:05.348315 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"whisker\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found\", failed to \"StartContainer\" for \"whisker-backend\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found\"]" pod="calico-system/whisker-845cdb6746-r6n8l" podUID="e49e398f-1e35-4733-8a07-8164b21c4248" Oct 28 04:41:05.371412 systemd[1]: Started cri-containerd-6ebb4ec29358d71559603256ac7e7ea86ee79daadbd95f7a1404505b9686d0e0.scope - libcontainer container 6ebb4ec29358d71559603256ac7e7ea86ee79daadbd95f7a1404505b9686d0e0. Oct 28 04:41:05.546307 containerd[1890]: time="2025-10-28T04:41:05.546158211Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-674b8bbfcf-nbzhp,Uid:a7454325-6d3a-474b-a8d6-8ccbeabe4f69,Namespace:kube-system,Attempt:0,} returns sandbox id \"6ebb4ec29358d71559603256ac7e7ea86ee79daadbd95f7a1404505b9686d0e0\"" Oct 28 04:41:05.565873 containerd[1890]: time="2025-10-28T04:41:05.564679431Z" level=info msg="CreateContainer within sandbox \"6ebb4ec29358d71559603256ac7e7ea86ee79daadbd95f7a1404505b9686d0e0\" for container &ContainerMetadata{Name:coredns,Attempt:0,}" Oct 28 04:41:05.619010 systemd-networkd[1494]: vxlan.calico: Gained IPv6LL Oct 28 04:41:05.633302 containerd[1890]: time="2025-10-28T04:41:05.633190167Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-844c8ff9ff-822zr,Uid:4bc14ee4-24b8-46c1-8183-4ae1905b78dd,Namespace:calico-apiserver,Attempt:0,} returns sandbox id \"66a5e17143f10af4d76582001e69262cfadf27e0a265afe9d5a83fe5d2387c51\"" Oct 28 04:41:05.640819 containerd[1890]: time="2025-10-28T04:41:05.640731363Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\"" Oct 28 04:41:05.657947 containerd[1890]: time="2025-10-28T04:41:05.657822819Z" level=info msg="Container 09f8113cb94f6f8a60bbce5c21427189c17cae41199b03ada94d33d8076d6076: CDI devices from CRI Config.CDIDevices: []" Oct 28 04:41:05.693403 containerd[1890]: time="2025-10-28T04:41:05.693319731Z" level=info msg="CreateContainer within sandbox \"6ebb4ec29358d71559603256ac7e7ea86ee79daadbd95f7a1404505b9686d0e0\" for &ContainerMetadata{Name:coredns,Attempt:0,} returns container id \"09f8113cb94f6f8a60bbce5c21427189c17cae41199b03ada94d33d8076d6076\"" Oct 28 04:41:05.695062 containerd[1890]: time="2025-10-28T04:41:05.695017599Z" level=info msg="StartContainer for \"09f8113cb94f6f8a60bbce5c21427189c17cae41199b03ada94d33d8076d6076\"" Oct 28 04:41:05.699851 containerd[1890]: time="2025-10-28T04:41:05.699621567Z" level=info msg="connecting to shim 09f8113cb94f6f8a60bbce5c21427189c17cae41199b03ada94d33d8076d6076" address="unix:///run/containerd/s/a6cf480a9d4ee784ae5cf2c8daa75fb1575de47bf0cdfd5ce51b5f238fc7e761" protocol=ttrpc version=3 Oct 28 04:41:05.784103 systemd[1]: Started cri-containerd-09f8113cb94f6f8a60bbce5c21427189c17cae41199b03ada94d33d8076d6076.scope - libcontainer container 09f8113cb94f6f8a60bbce5c21427189c17cae41199b03ada94d33d8076d6076. Oct 28 04:41:05.882319 containerd[1890]: time="2025-10-28T04:41:05.881204860Z" level=info msg="StartContainer for \"09f8113cb94f6f8a60bbce5c21427189c17cae41199b03ada94d33d8076d6076\" returns successfully" Oct 28 04:41:05.909760 kubelet[3230]: E1028 04:41:05.909643 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"whisker\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found\", failed to \"StartContainer\" for \"whisker-backend\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found\"]" pod="calico-system/whisker-845cdb6746-r6n8l" podUID="e49e398f-1e35-4733-8a07-8164b21c4248" Oct 28 04:41:05.961638 kubelet[3230]: I1028 04:41:05.961530 3230 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/coredns-674b8bbfcf-nbzhp" podStartSLOduration=53.961506269 podStartE2EDuration="53.961506269s" podCreationTimestamp="2025-10-28 04:40:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-28 04:41:05.938023361 +0000 UTC m=+57.674856324" watchObservedRunningTime="2025-10-28 04:41:05.961506269 +0000 UTC m=+57.698339220" Oct 28 04:41:05.962968 containerd[1890]: time="2025-10-28T04:41:05.962795801Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Oct 28 04:41:05.965910 containerd[1890]: time="2025-10-28T04:41:05.965823749Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" Oct 28 04:41:05.966501 containerd[1890]: time="2025-10-28T04:41:05.965970893Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/apiserver:v3.30.4: active requests=0, bytes read=77" Oct 28 04:41:05.968041 kubelet[3230]: E1028 04:41:05.967890 3230 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Oct 28 04:41:05.968041 kubelet[3230]: E1028 04:41:05.967985 3230 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Oct 28 04:41:05.968650 kubelet[3230]: E1028 04:41:05.968522 3230 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:calico-apiserver,Image:ghcr.io/flatcar/calico/apiserver:v3.30.4,Command:[],Args:[--secure-port=5443 --tls-private-key-file=/calico-apiserver-certs/tls.key --tls-cert-file=/calico-apiserver-certs/tls.crt],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:LOG_LEVEL,Value:info,ValueFrom:nil,},EnvVar{Name:MULTI_INTERFACE_MODE,Value:none,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:calico-apiserver-certs,ReadOnly:true,MountPath:/calico-apiserver-certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-275zr,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 5443 },Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-apiserver-844c8ff9ff-822zr_calico-apiserver(4bc14ee4-24b8-46c1-8183-4ae1905b78dd): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" logger="UnhandledError" Oct 28 04:41:05.970271 kubelet[3230]: E1028 04:41:05.970200 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-844c8ff9ff-822zr" podUID="4bc14ee4-24b8-46c1-8183-4ae1905b78dd" Oct 28 04:41:06.130987 systemd-networkd[1494]: calie97baf9272f: Gained IPv6LL Oct 28 04:41:06.259484 systemd-networkd[1494]: cali0130d0c2382: Gained IPv6LL Oct 28 04:41:06.260109 systemd-networkd[1494]: cali3f204eb6750: Gained IPv6LL Oct 28 04:41:06.492961 containerd[1890]: time="2025-10-28T04:41:06.492898923Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-844c8ff9ff-trlfg,Uid:964233f5-181d-4a9e-b75e-ce5914393292,Namespace:calico-apiserver,Attempt:0,}" Oct 28 04:41:06.499913 containerd[1890]: time="2025-10-28T04:41:06.498155883Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-kube-controllers-56b4fb96c7-rtxd5,Uid:54edc01d-f226-4f67-826d-011b168afccb,Namespace:calico-system,Attempt:0,}" Oct 28 04:41:06.824946 systemd-networkd[1494]: cali365cfea3b86: Link UP Oct 28 04:41:06.826324 systemd-networkd[1494]: cali365cfea3b86: Gained carrier Oct 28 04:41:06.873376 containerd[1890]: 2025-10-28 04:41:06.616 [INFO][4992] cni-plugin/plugin.go 340: Calico CNI found existing endpoint: &{{WorkloadEndpoint projectcalico.org/v3} {ip--172--31--30--14-k8s-calico--kube--controllers--56b4fb96c7--rtxd5-eth0 calico-kube-controllers-56b4fb96c7- calico-system 54edc01d-f226-4f67-826d-011b168afccb 888 0 2025-10-28 04:40:43 +0000 UTC map[app.kubernetes.io/name:calico-kube-controllers k8s-app:calico-kube-controllers pod-template-hash:56b4fb96c7 projectcalico.org/namespace:calico-system projectcalico.org/orchestrator:k8s projectcalico.org/serviceaccount:calico-kube-controllers] map[] [] [] []} {k8s ip-172-31-30-14 calico-kube-controllers-56b4fb96c7-rtxd5 eth0 calico-kube-controllers [] [] [kns.calico-system ksa.calico-system.calico-kube-controllers] cali365cfea3b86 [] [] }} ContainerID="40f40f7a7f08537a83d9694104b01cf592a9ddc7edaa31b7816f4fb9124c0597" Namespace="calico-system" Pod="calico-kube-controllers-56b4fb96c7-rtxd5" WorkloadEndpoint="ip--172--31--30--14-k8s-calico--kube--controllers--56b4fb96c7--rtxd5-" Oct 28 04:41:06.873376 containerd[1890]: 2025-10-28 04:41:06.616 [INFO][4992] cni-plugin/k8s.go 74: Extracted identifiers for CmdAddK8s ContainerID="40f40f7a7f08537a83d9694104b01cf592a9ddc7edaa31b7816f4fb9124c0597" Namespace="calico-system" Pod="calico-kube-controllers-56b4fb96c7-rtxd5" WorkloadEndpoint="ip--172--31--30--14-k8s-calico--kube--controllers--56b4fb96c7--rtxd5-eth0" Oct 28 04:41:06.873376 containerd[1890]: 2025-10-28 04:41:06.729 [INFO][5007] ipam/ipam_plugin.go 227: Calico CNI IPAM request count IPv4=1 IPv6=0 ContainerID="40f40f7a7f08537a83d9694104b01cf592a9ddc7edaa31b7816f4fb9124c0597" HandleID="k8s-pod-network.40f40f7a7f08537a83d9694104b01cf592a9ddc7edaa31b7816f4fb9124c0597" Workload="ip--172--31--30--14-k8s-calico--kube--controllers--56b4fb96c7--rtxd5-eth0" Oct 28 04:41:06.873376 containerd[1890]: 2025-10-28 04:41:06.731 [INFO][5007] ipam/ipam_plugin.go 275: Auto assigning IP ContainerID="40f40f7a7f08537a83d9694104b01cf592a9ddc7edaa31b7816f4fb9124c0597" HandleID="k8s-pod-network.40f40f7a7f08537a83d9694104b01cf592a9ddc7edaa31b7816f4fb9124c0597" Workload="ip--172--31--30--14-k8s-calico--kube--controllers--56b4fb96c7--rtxd5-eth0" assignArgs=ipam.AutoAssignArgs{Num4:1, Num6:0, HandleID:(*string)(0x40002cb200), Attrs:map[string]string{"namespace":"calico-system", "node":"ip-172-31-30-14", "pod":"calico-kube-controllers-56b4fb96c7-rtxd5", "timestamp":"2025-10-28 04:41:06.729030016 +0000 UTC"}, Hostname:"ip-172-31-30-14", IPv4Pools:[]net.IPNet{}, IPv6Pools:[]net.IPNet{}, MaxBlocksPerHost:0, HostReservedAttrIPv4s:(*ipam.HostReservedAttr)(nil), HostReservedAttrIPv6s:(*ipam.HostReservedAttr)(nil), IntendedUse:"Workload"} Oct 28 04:41:06.873376 containerd[1890]: 2025-10-28 04:41:06.731 [INFO][5007] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Oct 28 04:41:06.873376 containerd[1890]: 2025-10-28 04:41:06.731 [INFO][5007] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Oct 28 04:41:06.873376 containerd[1890]: 2025-10-28 04:41:06.731 [INFO][5007] ipam/ipam.go 110: Auto-assign 1 ipv4, 0 ipv6 addrs for host 'ip-172-31-30-14' Oct 28 04:41:06.873376 containerd[1890]: 2025-10-28 04:41:06.768 [INFO][5007] ipam/ipam.go 691: Looking up existing affinities for host handle="k8s-pod-network.40f40f7a7f08537a83d9694104b01cf592a9ddc7edaa31b7816f4fb9124c0597" host="ip-172-31-30-14" Oct 28 04:41:06.873376 containerd[1890]: 2025-10-28 04:41:06.776 [INFO][5007] ipam/ipam.go 394: Looking up existing affinities for host host="ip-172-31-30-14" Oct 28 04:41:06.873376 containerd[1890]: 2025-10-28 04:41:06.784 [INFO][5007] ipam/ipam.go 511: Trying affinity for 192.168.28.0/26 host="ip-172-31-30-14" Oct 28 04:41:06.873376 containerd[1890]: 2025-10-28 04:41:06.787 [INFO][5007] ipam/ipam.go 158: Attempting to load block cidr=192.168.28.0/26 host="ip-172-31-30-14" Oct 28 04:41:06.873376 containerd[1890]: 2025-10-28 04:41:06.792 [INFO][5007] ipam/ipam.go 235: Affinity is confirmed and block has been loaded cidr=192.168.28.0/26 host="ip-172-31-30-14" Oct 28 04:41:06.873376 containerd[1890]: 2025-10-28 04:41:06.792 [INFO][5007] ipam/ipam.go 1219: Attempting to assign 1 addresses from block block=192.168.28.0/26 handle="k8s-pod-network.40f40f7a7f08537a83d9694104b01cf592a9ddc7edaa31b7816f4fb9124c0597" host="ip-172-31-30-14" Oct 28 04:41:06.873376 containerd[1890]: 2025-10-28 04:41:06.795 [INFO][5007] ipam/ipam.go 1780: Creating new handle: k8s-pod-network.40f40f7a7f08537a83d9694104b01cf592a9ddc7edaa31b7816f4fb9124c0597 Oct 28 04:41:06.873376 containerd[1890]: 2025-10-28 04:41:06.802 [INFO][5007] ipam/ipam.go 1246: Writing block in order to claim IPs block=192.168.28.0/26 handle="k8s-pod-network.40f40f7a7f08537a83d9694104b01cf592a9ddc7edaa31b7816f4fb9124c0597" host="ip-172-31-30-14" Oct 28 04:41:06.873376 containerd[1890]: 2025-10-28 04:41:06.814 [INFO][5007] ipam/ipam.go 1262: Successfully claimed IPs: [192.168.28.4/26] block=192.168.28.0/26 handle="k8s-pod-network.40f40f7a7f08537a83d9694104b01cf592a9ddc7edaa31b7816f4fb9124c0597" host="ip-172-31-30-14" Oct 28 04:41:06.873376 containerd[1890]: 2025-10-28 04:41:06.814 [INFO][5007] ipam/ipam.go 878: Auto-assigned 1 out of 1 IPv4s: [192.168.28.4/26] handle="k8s-pod-network.40f40f7a7f08537a83d9694104b01cf592a9ddc7edaa31b7816f4fb9124c0597" host="ip-172-31-30-14" Oct 28 04:41:06.873376 containerd[1890]: 2025-10-28 04:41:06.815 [INFO][5007] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Oct 28 04:41:06.873376 containerd[1890]: 2025-10-28 04:41:06.815 [INFO][5007] ipam/ipam_plugin.go 299: Calico CNI IPAM assigned addresses IPv4=[192.168.28.4/26] IPv6=[] ContainerID="40f40f7a7f08537a83d9694104b01cf592a9ddc7edaa31b7816f4fb9124c0597" HandleID="k8s-pod-network.40f40f7a7f08537a83d9694104b01cf592a9ddc7edaa31b7816f4fb9124c0597" Workload="ip--172--31--30--14-k8s-calico--kube--controllers--56b4fb96c7--rtxd5-eth0" Oct 28 04:41:06.874492 containerd[1890]: 2025-10-28 04:41:06.819 [INFO][4992] cni-plugin/k8s.go 418: Populated endpoint ContainerID="40f40f7a7f08537a83d9694104b01cf592a9ddc7edaa31b7816f4fb9124c0597" Namespace="calico-system" Pod="calico-kube-controllers-56b4fb96c7-rtxd5" WorkloadEndpoint="ip--172--31--30--14-k8s-calico--kube--controllers--56b4fb96c7--rtxd5-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--30--14-k8s-calico--kube--controllers--56b4fb96c7--rtxd5-eth0", GenerateName:"calico-kube-controllers-56b4fb96c7-", Namespace:"calico-system", SelfLink:"", UID:"54edc01d-f226-4f67-826d-011b168afccb", ResourceVersion:"888", Generation:0, CreationTimestamp:time.Date(2025, time.October, 28, 4, 40, 43, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app.kubernetes.io/name":"calico-kube-controllers", "k8s-app":"calico-kube-controllers", "pod-template-hash":"56b4fb96c7", "projectcalico.org/namespace":"calico-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"calico-kube-controllers"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-30-14", ContainerID:"", Pod:"calico-kube-controllers-56b4fb96c7-rtxd5", Endpoint:"eth0", ServiceAccountName:"calico-kube-controllers", IPNetworks:[]string{"192.168.28.4/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-system", "ksa.calico-system.calico-kube-controllers"}, InterfaceName:"cali365cfea3b86", MAC:"", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Oct 28 04:41:06.874492 containerd[1890]: 2025-10-28 04:41:06.820 [INFO][4992] cni-plugin/k8s.go 419: Calico CNI using IPs: [192.168.28.4/32] ContainerID="40f40f7a7f08537a83d9694104b01cf592a9ddc7edaa31b7816f4fb9124c0597" Namespace="calico-system" Pod="calico-kube-controllers-56b4fb96c7-rtxd5" WorkloadEndpoint="ip--172--31--30--14-k8s-calico--kube--controllers--56b4fb96c7--rtxd5-eth0" Oct 28 04:41:06.874492 containerd[1890]: 2025-10-28 04:41:06.820 [INFO][4992] cni-plugin/dataplane_linux.go 69: Setting the host side veth name to cali365cfea3b86 ContainerID="40f40f7a7f08537a83d9694104b01cf592a9ddc7edaa31b7816f4fb9124c0597" Namespace="calico-system" Pod="calico-kube-controllers-56b4fb96c7-rtxd5" WorkloadEndpoint="ip--172--31--30--14-k8s-calico--kube--controllers--56b4fb96c7--rtxd5-eth0" Oct 28 04:41:06.874492 containerd[1890]: 2025-10-28 04:41:06.827 [INFO][4992] cni-plugin/dataplane_linux.go 508: Disabling IPv4 forwarding ContainerID="40f40f7a7f08537a83d9694104b01cf592a9ddc7edaa31b7816f4fb9124c0597" Namespace="calico-system" Pod="calico-kube-controllers-56b4fb96c7-rtxd5" WorkloadEndpoint="ip--172--31--30--14-k8s-calico--kube--controllers--56b4fb96c7--rtxd5-eth0" Oct 28 04:41:06.874492 containerd[1890]: 2025-10-28 04:41:06.828 [INFO][4992] cni-plugin/k8s.go 446: Added Mac, interface name, and active container ID to endpoint ContainerID="40f40f7a7f08537a83d9694104b01cf592a9ddc7edaa31b7816f4fb9124c0597" Namespace="calico-system" Pod="calico-kube-controllers-56b4fb96c7-rtxd5" WorkloadEndpoint="ip--172--31--30--14-k8s-calico--kube--controllers--56b4fb96c7--rtxd5-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--30--14-k8s-calico--kube--controllers--56b4fb96c7--rtxd5-eth0", GenerateName:"calico-kube-controllers-56b4fb96c7-", Namespace:"calico-system", SelfLink:"", UID:"54edc01d-f226-4f67-826d-011b168afccb", ResourceVersion:"888", Generation:0, CreationTimestamp:time.Date(2025, time.October, 28, 4, 40, 43, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app.kubernetes.io/name":"calico-kube-controllers", "k8s-app":"calico-kube-controllers", "pod-template-hash":"56b4fb96c7", "projectcalico.org/namespace":"calico-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"calico-kube-controllers"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-30-14", ContainerID:"40f40f7a7f08537a83d9694104b01cf592a9ddc7edaa31b7816f4fb9124c0597", Pod:"calico-kube-controllers-56b4fb96c7-rtxd5", Endpoint:"eth0", ServiceAccountName:"calico-kube-controllers", IPNetworks:[]string{"192.168.28.4/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-system", "ksa.calico-system.calico-kube-controllers"}, InterfaceName:"cali365cfea3b86", MAC:"ee:28:69:cf:c1:0e", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Oct 28 04:41:06.874492 containerd[1890]: 2025-10-28 04:41:06.861 [INFO][4992] cni-plugin/k8s.go 532: Wrote updated endpoint to datastore ContainerID="40f40f7a7f08537a83d9694104b01cf592a9ddc7edaa31b7816f4fb9124c0597" Namespace="calico-system" Pod="calico-kube-controllers-56b4fb96c7-rtxd5" WorkloadEndpoint="ip--172--31--30--14-k8s-calico--kube--controllers--56b4fb96c7--rtxd5-eth0" Oct 28 04:41:06.918002 kubelet[3230]: E1028 04:41:06.917412 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-844c8ff9ff-822zr" podUID="4bc14ee4-24b8-46c1-8183-4ae1905b78dd" Oct 28 04:41:06.978933 containerd[1890]: time="2025-10-28T04:41:06.978743838Z" level=info msg="connecting to shim 40f40f7a7f08537a83d9694104b01cf592a9ddc7edaa31b7816f4fb9124c0597" address="unix:///run/containerd/s/d3aca876ed74296bfe455652f7bb7095fdcc269404d38d77ec45f5e0ad2ee43c" namespace=k8s.io protocol=ttrpc version=3 Oct 28 04:41:07.047149 systemd-networkd[1494]: califa13e08f77a: Link UP Oct 28 04:41:07.051861 systemd-networkd[1494]: califa13e08f77a: Gained carrier Oct 28 04:41:07.071064 systemd[1]: Started cri-containerd-40f40f7a7f08537a83d9694104b01cf592a9ddc7edaa31b7816f4fb9124c0597.scope - libcontainer container 40f40f7a7f08537a83d9694104b01cf592a9ddc7edaa31b7816f4fb9124c0597. Oct 28 04:41:07.099766 containerd[1890]: 2025-10-28 04:41:06.662 [INFO][4983] cni-plugin/plugin.go 340: Calico CNI found existing endpoint: &{{WorkloadEndpoint projectcalico.org/v3} {ip--172--31--30--14-k8s-calico--apiserver--844c8ff9ff--trlfg-eth0 calico-apiserver-844c8ff9ff- calico-apiserver 964233f5-181d-4a9e-b75e-ce5914393292 885 0 2025-10-28 04:40:28 +0000 UTC map[apiserver:true app.kubernetes.io/name:calico-apiserver k8s-app:calico-apiserver pod-template-hash:844c8ff9ff projectcalico.org/namespace:calico-apiserver projectcalico.org/orchestrator:k8s projectcalico.org/serviceaccount:calico-apiserver] map[] [] [] []} {k8s ip-172-31-30-14 calico-apiserver-844c8ff9ff-trlfg eth0 calico-apiserver [] [] [kns.calico-apiserver ksa.calico-apiserver.calico-apiserver] califa13e08f77a [] [] }} ContainerID="ecee3f401f7cdc630db9ba8bd179365205863a7b4e29569e220cab248e31cc3a" Namespace="calico-apiserver" Pod="calico-apiserver-844c8ff9ff-trlfg" WorkloadEndpoint="ip--172--31--30--14-k8s-calico--apiserver--844c8ff9ff--trlfg-" Oct 28 04:41:07.099766 containerd[1890]: 2025-10-28 04:41:06.662 [INFO][4983] cni-plugin/k8s.go 74: Extracted identifiers for CmdAddK8s ContainerID="ecee3f401f7cdc630db9ba8bd179365205863a7b4e29569e220cab248e31cc3a" Namespace="calico-apiserver" Pod="calico-apiserver-844c8ff9ff-trlfg" WorkloadEndpoint="ip--172--31--30--14-k8s-calico--apiserver--844c8ff9ff--trlfg-eth0" Oct 28 04:41:07.099766 containerd[1890]: 2025-10-28 04:41:06.766 [INFO][5013] ipam/ipam_plugin.go 227: Calico CNI IPAM request count IPv4=1 IPv6=0 ContainerID="ecee3f401f7cdc630db9ba8bd179365205863a7b4e29569e220cab248e31cc3a" HandleID="k8s-pod-network.ecee3f401f7cdc630db9ba8bd179365205863a7b4e29569e220cab248e31cc3a" Workload="ip--172--31--30--14-k8s-calico--apiserver--844c8ff9ff--trlfg-eth0" Oct 28 04:41:07.099766 containerd[1890]: 2025-10-28 04:41:06.767 [INFO][5013] ipam/ipam_plugin.go 275: Auto assigning IP ContainerID="ecee3f401f7cdc630db9ba8bd179365205863a7b4e29569e220cab248e31cc3a" HandleID="k8s-pod-network.ecee3f401f7cdc630db9ba8bd179365205863a7b4e29569e220cab248e31cc3a" Workload="ip--172--31--30--14-k8s-calico--apiserver--844c8ff9ff--trlfg-eth0" assignArgs=ipam.AutoAssignArgs{Num4:1, Num6:0, HandleID:(*string)(0x40002d3010), Attrs:map[string]string{"namespace":"calico-apiserver", "node":"ip-172-31-30-14", "pod":"calico-apiserver-844c8ff9ff-trlfg", "timestamp":"2025-10-28 04:41:06.766356005 +0000 UTC"}, Hostname:"ip-172-31-30-14", IPv4Pools:[]net.IPNet{}, IPv6Pools:[]net.IPNet{}, MaxBlocksPerHost:0, HostReservedAttrIPv4s:(*ipam.HostReservedAttr)(nil), HostReservedAttrIPv6s:(*ipam.HostReservedAttr)(nil), IntendedUse:"Workload"} Oct 28 04:41:07.099766 containerd[1890]: 2025-10-28 04:41:06.767 [INFO][5013] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Oct 28 04:41:07.099766 containerd[1890]: 2025-10-28 04:41:06.815 [INFO][5013] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Oct 28 04:41:07.099766 containerd[1890]: 2025-10-28 04:41:06.815 [INFO][5013] ipam/ipam.go 110: Auto-assign 1 ipv4, 0 ipv6 addrs for host 'ip-172-31-30-14' Oct 28 04:41:07.099766 containerd[1890]: 2025-10-28 04:41:06.870 [INFO][5013] ipam/ipam.go 691: Looking up existing affinities for host handle="k8s-pod-network.ecee3f401f7cdc630db9ba8bd179365205863a7b4e29569e220cab248e31cc3a" host="ip-172-31-30-14" Oct 28 04:41:07.099766 containerd[1890]: 2025-10-28 04:41:06.896 [INFO][5013] ipam/ipam.go 394: Looking up existing affinities for host host="ip-172-31-30-14" Oct 28 04:41:07.099766 containerd[1890]: 2025-10-28 04:41:06.909 [INFO][5013] ipam/ipam.go 511: Trying affinity for 192.168.28.0/26 host="ip-172-31-30-14" Oct 28 04:41:07.099766 containerd[1890]: 2025-10-28 04:41:06.922 [INFO][5013] ipam/ipam.go 158: Attempting to load block cidr=192.168.28.0/26 host="ip-172-31-30-14" Oct 28 04:41:07.099766 containerd[1890]: 2025-10-28 04:41:06.941 [INFO][5013] ipam/ipam.go 235: Affinity is confirmed and block has been loaded cidr=192.168.28.0/26 host="ip-172-31-30-14" Oct 28 04:41:07.099766 containerd[1890]: 2025-10-28 04:41:06.942 [INFO][5013] ipam/ipam.go 1219: Attempting to assign 1 addresses from block block=192.168.28.0/26 handle="k8s-pod-network.ecee3f401f7cdc630db9ba8bd179365205863a7b4e29569e220cab248e31cc3a" host="ip-172-31-30-14" Oct 28 04:41:07.099766 containerd[1890]: 2025-10-28 04:41:06.947 [INFO][5013] ipam/ipam.go 1780: Creating new handle: k8s-pod-network.ecee3f401f7cdc630db9ba8bd179365205863a7b4e29569e220cab248e31cc3a Oct 28 04:41:07.099766 containerd[1890]: 2025-10-28 04:41:06.968 [INFO][5013] ipam/ipam.go 1246: Writing block in order to claim IPs block=192.168.28.0/26 handle="k8s-pod-network.ecee3f401f7cdc630db9ba8bd179365205863a7b4e29569e220cab248e31cc3a" host="ip-172-31-30-14" Oct 28 04:41:07.099766 containerd[1890]: 2025-10-28 04:41:07.009 [INFO][5013] ipam/ipam.go 1262: Successfully claimed IPs: [192.168.28.5/26] block=192.168.28.0/26 handle="k8s-pod-network.ecee3f401f7cdc630db9ba8bd179365205863a7b4e29569e220cab248e31cc3a" host="ip-172-31-30-14" Oct 28 04:41:07.099766 containerd[1890]: 2025-10-28 04:41:07.010 [INFO][5013] ipam/ipam.go 878: Auto-assigned 1 out of 1 IPv4s: [192.168.28.5/26] handle="k8s-pod-network.ecee3f401f7cdc630db9ba8bd179365205863a7b4e29569e220cab248e31cc3a" host="ip-172-31-30-14" Oct 28 04:41:07.099766 containerd[1890]: 2025-10-28 04:41:07.010 [INFO][5013] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Oct 28 04:41:07.099766 containerd[1890]: 2025-10-28 04:41:07.010 [INFO][5013] ipam/ipam_plugin.go 299: Calico CNI IPAM assigned addresses IPv4=[192.168.28.5/26] IPv6=[] ContainerID="ecee3f401f7cdc630db9ba8bd179365205863a7b4e29569e220cab248e31cc3a" HandleID="k8s-pod-network.ecee3f401f7cdc630db9ba8bd179365205863a7b4e29569e220cab248e31cc3a" Workload="ip--172--31--30--14-k8s-calico--apiserver--844c8ff9ff--trlfg-eth0" Oct 28 04:41:07.102321 containerd[1890]: 2025-10-28 04:41:07.021 [INFO][4983] cni-plugin/k8s.go 418: Populated endpoint ContainerID="ecee3f401f7cdc630db9ba8bd179365205863a7b4e29569e220cab248e31cc3a" Namespace="calico-apiserver" Pod="calico-apiserver-844c8ff9ff-trlfg" WorkloadEndpoint="ip--172--31--30--14-k8s-calico--apiserver--844c8ff9ff--trlfg-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--30--14-k8s-calico--apiserver--844c8ff9ff--trlfg-eth0", GenerateName:"calico-apiserver-844c8ff9ff-", Namespace:"calico-apiserver", SelfLink:"", UID:"964233f5-181d-4a9e-b75e-ce5914393292", ResourceVersion:"885", Generation:0, CreationTimestamp:time.Date(2025, time.October, 28, 4, 40, 28, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"apiserver":"true", "app.kubernetes.io/name":"calico-apiserver", "k8s-app":"calico-apiserver", "pod-template-hash":"844c8ff9ff", "projectcalico.org/namespace":"calico-apiserver", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"calico-apiserver"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-30-14", ContainerID:"", Pod:"calico-apiserver-844c8ff9ff-trlfg", Endpoint:"eth0", ServiceAccountName:"calico-apiserver", IPNetworks:[]string{"192.168.28.5/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-apiserver", "ksa.calico-apiserver.calico-apiserver"}, InterfaceName:"califa13e08f77a", MAC:"", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Oct 28 04:41:07.102321 containerd[1890]: 2025-10-28 04:41:07.021 [INFO][4983] cni-plugin/k8s.go 419: Calico CNI using IPs: [192.168.28.5/32] ContainerID="ecee3f401f7cdc630db9ba8bd179365205863a7b4e29569e220cab248e31cc3a" Namespace="calico-apiserver" Pod="calico-apiserver-844c8ff9ff-trlfg" WorkloadEndpoint="ip--172--31--30--14-k8s-calico--apiserver--844c8ff9ff--trlfg-eth0" Oct 28 04:41:07.102321 containerd[1890]: 2025-10-28 04:41:07.022 [INFO][4983] cni-plugin/dataplane_linux.go 69: Setting the host side veth name to califa13e08f77a ContainerID="ecee3f401f7cdc630db9ba8bd179365205863a7b4e29569e220cab248e31cc3a" Namespace="calico-apiserver" Pod="calico-apiserver-844c8ff9ff-trlfg" WorkloadEndpoint="ip--172--31--30--14-k8s-calico--apiserver--844c8ff9ff--trlfg-eth0" Oct 28 04:41:07.102321 containerd[1890]: 2025-10-28 04:41:07.063 [INFO][4983] cni-plugin/dataplane_linux.go 508: Disabling IPv4 forwarding ContainerID="ecee3f401f7cdc630db9ba8bd179365205863a7b4e29569e220cab248e31cc3a" Namespace="calico-apiserver" Pod="calico-apiserver-844c8ff9ff-trlfg" WorkloadEndpoint="ip--172--31--30--14-k8s-calico--apiserver--844c8ff9ff--trlfg-eth0" Oct 28 04:41:07.102321 containerd[1890]: 2025-10-28 04:41:07.067 [INFO][4983] cni-plugin/k8s.go 446: Added Mac, interface name, and active container ID to endpoint ContainerID="ecee3f401f7cdc630db9ba8bd179365205863a7b4e29569e220cab248e31cc3a" Namespace="calico-apiserver" Pod="calico-apiserver-844c8ff9ff-trlfg" WorkloadEndpoint="ip--172--31--30--14-k8s-calico--apiserver--844c8ff9ff--trlfg-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--30--14-k8s-calico--apiserver--844c8ff9ff--trlfg-eth0", GenerateName:"calico-apiserver-844c8ff9ff-", Namespace:"calico-apiserver", SelfLink:"", UID:"964233f5-181d-4a9e-b75e-ce5914393292", ResourceVersion:"885", Generation:0, CreationTimestamp:time.Date(2025, time.October, 28, 4, 40, 28, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"apiserver":"true", "app.kubernetes.io/name":"calico-apiserver", "k8s-app":"calico-apiserver", "pod-template-hash":"844c8ff9ff", "projectcalico.org/namespace":"calico-apiserver", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"calico-apiserver"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-30-14", ContainerID:"ecee3f401f7cdc630db9ba8bd179365205863a7b4e29569e220cab248e31cc3a", Pod:"calico-apiserver-844c8ff9ff-trlfg", Endpoint:"eth0", ServiceAccountName:"calico-apiserver", IPNetworks:[]string{"192.168.28.5/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-apiserver", "ksa.calico-apiserver.calico-apiserver"}, InterfaceName:"califa13e08f77a", MAC:"c6:58:34:23:6f:0e", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Oct 28 04:41:07.102321 containerd[1890]: 2025-10-28 04:41:07.090 [INFO][4983] cni-plugin/k8s.go 532: Wrote updated endpoint to datastore ContainerID="ecee3f401f7cdc630db9ba8bd179365205863a7b4e29569e220cab248e31cc3a" Namespace="calico-apiserver" Pod="calico-apiserver-844c8ff9ff-trlfg" WorkloadEndpoint="ip--172--31--30--14-k8s-calico--apiserver--844c8ff9ff--trlfg-eth0" Oct 28 04:41:07.186027 containerd[1890]: time="2025-10-28T04:41:07.185934135Z" level=info msg="connecting to shim ecee3f401f7cdc630db9ba8bd179365205863a7b4e29569e220cab248e31cc3a" address="unix:///run/containerd/s/b686efb224f5fe755a3efdea67324fe1f0cfd29a6ae3564bab5263581c9e5432" namespace=k8s.io protocol=ttrpc version=3 Oct 28 04:41:07.253963 containerd[1890]: time="2025-10-28T04:41:07.253896207Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-kube-controllers-56b4fb96c7-rtxd5,Uid:54edc01d-f226-4f67-826d-011b168afccb,Namespace:calico-system,Attempt:0,} returns sandbox id \"40f40f7a7f08537a83d9694104b01cf592a9ddc7edaa31b7816f4fb9124c0597\"" Oct 28 04:41:07.264469 containerd[1890]: time="2025-10-28T04:41:07.264398187Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\"" Oct 28 04:41:07.276981 systemd[1]: Started cri-containerd-ecee3f401f7cdc630db9ba8bd179365205863a7b4e29569e220cab248e31cc3a.scope - libcontainer container ecee3f401f7cdc630db9ba8bd179365205863a7b4e29569e220cab248e31cc3a. Oct 28 04:41:07.375306 containerd[1890]: time="2025-10-28T04:41:07.374577448Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-844c8ff9ff-trlfg,Uid:964233f5-181d-4a9e-b75e-ce5914393292,Namespace:calico-apiserver,Attempt:0,} returns sandbox id \"ecee3f401f7cdc630db9ba8bd179365205863a7b4e29569e220cab248e31cc3a\"" Oct 28 04:41:07.565506 containerd[1890]: time="2025-10-28T04:41:07.565390601Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Oct 28 04:41:07.568333 containerd[1890]: time="2025-10-28T04:41:07.568162133Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" Oct 28 04:41:07.568333 containerd[1890]: time="2025-10-28T04:41:07.568292429Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/kube-controllers:v3.30.4: active requests=0, bytes read=85" Oct 28 04:41:07.569074 kubelet[3230]: E1028 04:41:07.568803 3230 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" image="ghcr.io/flatcar/calico/kube-controllers:v3.30.4" Oct 28 04:41:07.569074 kubelet[3230]: E1028 04:41:07.568872 3230 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" image="ghcr.io/flatcar/calico/kube-controllers:v3.30.4" Oct 28 04:41:07.569362 containerd[1890]: time="2025-10-28T04:41:07.569282489Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\"" Oct 28 04:41:07.570371 kubelet[3230]: E1028 04:41:07.569893 3230 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:calico-kube-controllers,Image:ghcr.io/flatcar/calico/kube-controllers:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:KUBE_CONTROLLERS_CONFIG_NAME,Value:default,ValueFrom:nil,},EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:ENABLED_CONTROLLERS,Value:node,loadbalancer,ValueFrom:nil,},EnvVar{Name:DISABLE_KUBE_CONTROLLERS_CONFIG_API,Value:false,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:CA_CRT_PATH,Value:/etc/pki/tls/certs/tigera-ca-bundle.crt,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:tigera-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:tigera-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/cert.pem,SubPath:ca-bundle.crt,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-rhj7p,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/usr/bin/check-status -l],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:10,TimeoutSeconds:10,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:6,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/usr/bin/check-status -r],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:10,PeriodSeconds:30,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*999,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-kube-controllers-56b4fb96c7-rtxd5_calico-system(54edc01d-f226-4f67-826d-011b168afccb): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" logger="UnhandledError" Oct 28 04:41:07.571521 kubelet[3230]: E1028 04:41:07.571451 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-kube-controllers\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found\"" pod="calico-system/calico-kube-controllers-56b4fb96c7-rtxd5" podUID="54edc01d-f226-4f67-826d-011b168afccb" Oct 28 04:41:07.884957 containerd[1890]: time="2025-10-28T04:41:07.884829174Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Oct 28 04:41:07.886984 containerd[1890]: time="2025-10-28T04:41:07.886920294Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" Oct 28 04:41:07.887079 containerd[1890]: time="2025-10-28T04:41:07.887026566Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/apiserver:v3.30.4: active requests=0, bytes read=77" Oct 28 04:41:07.887291 kubelet[3230]: E1028 04:41:07.887239 3230 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Oct 28 04:41:07.887400 kubelet[3230]: E1028 04:41:07.887299 3230 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Oct 28 04:41:07.887563 kubelet[3230]: E1028 04:41:07.887481 3230 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:calico-apiserver,Image:ghcr.io/flatcar/calico/apiserver:v3.30.4,Command:[],Args:[--secure-port=5443 --tls-private-key-file=/calico-apiserver-certs/tls.key --tls-cert-file=/calico-apiserver-certs/tls.crt],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:LOG_LEVEL,Value:info,ValueFrom:nil,},EnvVar{Name:MULTI_INTERFACE_MODE,Value:none,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:calico-apiserver-certs,ReadOnly:true,MountPath:/calico-apiserver-certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-rp64h,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 5443 },Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-apiserver-844c8ff9ff-trlfg_calico-apiserver(964233f5-181d-4a9e-b75e-ce5914393292): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" logger="UnhandledError" Oct 28 04:41:07.889167 kubelet[3230]: E1028 04:41:07.889096 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-844c8ff9ff-trlfg" podUID="964233f5-181d-4a9e-b75e-ce5914393292" Oct 28 04:41:07.917099 kubelet[3230]: E1028 04:41:07.917032 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-844c8ff9ff-trlfg" podUID="964233f5-181d-4a9e-b75e-ce5914393292" Oct 28 04:41:07.925713 kubelet[3230]: E1028 04:41:07.925552 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-kube-controllers\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found\"" pod="calico-system/calico-kube-controllers-56b4fb96c7-rtxd5" podUID="54edc01d-f226-4f67-826d-011b168afccb" Oct 28 04:41:08.115808 systemd-networkd[1494]: cali365cfea3b86: Gained IPv6LL Oct 28 04:41:08.501161 containerd[1890]: time="2025-10-28T04:41:08.500794217Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:csi-node-driver-jhrzl,Uid:c42b89c4-6ac3-4fdf-90fb-009bd174d781,Namespace:calico-system,Attempt:0,}" Oct 28 04:41:08.501578 containerd[1890]: time="2025-10-28T04:41:08.501529637Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-674b8bbfcf-l754x,Uid:9d93d421-2e21-4d9b-88ef-871150cd8795,Namespace:kube-system,Attempt:0,}" Oct 28 04:41:08.801143 systemd-networkd[1494]: cali3dfe848c1b2: Link UP Oct 28 04:41:08.807092 systemd-networkd[1494]: cali3dfe848c1b2: Gained carrier Oct 28 04:41:08.845500 containerd[1890]: 2025-10-28 04:41:08.627 [INFO][5147] cni-plugin/plugin.go 340: Calico CNI found existing endpoint: &{{WorkloadEndpoint projectcalico.org/v3} {ip--172--31--30--14-k8s-coredns--674b8bbfcf--l754x-eth0 coredns-674b8bbfcf- kube-system 9d93d421-2e21-4d9b-88ef-871150cd8795 879 0 2025-10-28 04:40:12 +0000 UTC map[k8s-app:kube-dns pod-template-hash:674b8bbfcf projectcalico.org/namespace:kube-system projectcalico.org/orchestrator:k8s projectcalico.org/serviceaccount:coredns] map[] [] [] []} {k8s ip-172-31-30-14 coredns-674b8bbfcf-l754x eth0 coredns [] [] [kns.kube-system ksa.kube-system.coredns] cali3dfe848c1b2 [{dns UDP 53 0 } {dns-tcp TCP 53 0 } {metrics TCP 9153 0 }] [] }} ContainerID="2ece9d89ae4756a31030aad7e5add3303b35a829806c9f141707fa86b63160f8" Namespace="kube-system" Pod="coredns-674b8bbfcf-l754x" WorkloadEndpoint="ip--172--31--30--14-k8s-coredns--674b8bbfcf--l754x-" Oct 28 04:41:08.845500 containerd[1890]: 2025-10-28 04:41:08.629 [INFO][5147] cni-plugin/k8s.go 74: Extracted identifiers for CmdAddK8s ContainerID="2ece9d89ae4756a31030aad7e5add3303b35a829806c9f141707fa86b63160f8" Namespace="kube-system" Pod="coredns-674b8bbfcf-l754x" WorkloadEndpoint="ip--172--31--30--14-k8s-coredns--674b8bbfcf--l754x-eth0" Oct 28 04:41:08.845500 containerd[1890]: 2025-10-28 04:41:08.709 [INFO][5168] ipam/ipam_plugin.go 227: Calico CNI IPAM request count IPv4=1 IPv6=0 ContainerID="2ece9d89ae4756a31030aad7e5add3303b35a829806c9f141707fa86b63160f8" HandleID="k8s-pod-network.2ece9d89ae4756a31030aad7e5add3303b35a829806c9f141707fa86b63160f8" Workload="ip--172--31--30--14-k8s-coredns--674b8bbfcf--l754x-eth0" Oct 28 04:41:08.845500 containerd[1890]: 2025-10-28 04:41:08.710 [INFO][5168] ipam/ipam_plugin.go 275: Auto assigning IP ContainerID="2ece9d89ae4756a31030aad7e5add3303b35a829806c9f141707fa86b63160f8" HandleID="k8s-pod-network.2ece9d89ae4756a31030aad7e5add3303b35a829806c9f141707fa86b63160f8" Workload="ip--172--31--30--14-k8s-coredns--674b8bbfcf--l754x-eth0" assignArgs=ipam.AutoAssignArgs{Num4:1, Num6:0, HandleID:(*string)(0x400031f8d0), Attrs:map[string]string{"namespace":"kube-system", "node":"ip-172-31-30-14", "pod":"coredns-674b8bbfcf-l754x", "timestamp":"2025-10-28 04:41:08.709533282 +0000 UTC"}, Hostname:"ip-172-31-30-14", IPv4Pools:[]net.IPNet{}, IPv6Pools:[]net.IPNet{}, MaxBlocksPerHost:0, HostReservedAttrIPv4s:(*ipam.HostReservedAttr)(nil), HostReservedAttrIPv6s:(*ipam.HostReservedAttr)(nil), IntendedUse:"Workload"} Oct 28 04:41:08.845500 containerd[1890]: 2025-10-28 04:41:08.710 [INFO][5168] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Oct 28 04:41:08.845500 containerd[1890]: 2025-10-28 04:41:08.710 [INFO][5168] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Oct 28 04:41:08.845500 containerd[1890]: 2025-10-28 04:41:08.710 [INFO][5168] ipam/ipam.go 110: Auto-assign 1 ipv4, 0 ipv6 addrs for host 'ip-172-31-30-14' Oct 28 04:41:08.845500 containerd[1890]: 2025-10-28 04:41:08.735 [INFO][5168] ipam/ipam.go 691: Looking up existing affinities for host handle="k8s-pod-network.2ece9d89ae4756a31030aad7e5add3303b35a829806c9f141707fa86b63160f8" host="ip-172-31-30-14" Oct 28 04:41:08.845500 containerd[1890]: 2025-10-28 04:41:08.742 [INFO][5168] ipam/ipam.go 394: Looking up existing affinities for host host="ip-172-31-30-14" Oct 28 04:41:08.845500 containerd[1890]: 2025-10-28 04:41:08.751 [INFO][5168] ipam/ipam.go 511: Trying affinity for 192.168.28.0/26 host="ip-172-31-30-14" Oct 28 04:41:08.845500 containerd[1890]: 2025-10-28 04:41:08.755 [INFO][5168] ipam/ipam.go 158: Attempting to load block cidr=192.168.28.0/26 host="ip-172-31-30-14" Oct 28 04:41:08.845500 containerd[1890]: 2025-10-28 04:41:08.759 [INFO][5168] ipam/ipam.go 235: Affinity is confirmed and block has been loaded cidr=192.168.28.0/26 host="ip-172-31-30-14" Oct 28 04:41:08.845500 containerd[1890]: 2025-10-28 04:41:08.760 [INFO][5168] ipam/ipam.go 1219: Attempting to assign 1 addresses from block block=192.168.28.0/26 handle="k8s-pod-network.2ece9d89ae4756a31030aad7e5add3303b35a829806c9f141707fa86b63160f8" host="ip-172-31-30-14" Oct 28 04:41:08.845500 containerd[1890]: 2025-10-28 04:41:08.763 [INFO][5168] ipam/ipam.go 1780: Creating new handle: k8s-pod-network.2ece9d89ae4756a31030aad7e5add3303b35a829806c9f141707fa86b63160f8 Oct 28 04:41:08.845500 containerd[1890]: 2025-10-28 04:41:08.774 [INFO][5168] ipam/ipam.go 1246: Writing block in order to claim IPs block=192.168.28.0/26 handle="k8s-pod-network.2ece9d89ae4756a31030aad7e5add3303b35a829806c9f141707fa86b63160f8" host="ip-172-31-30-14" Oct 28 04:41:08.845500 containerd[1890]: 2025-10-28 04:41:08.789 [INFO][5168] ipam/ipam.go 1262: Successfully claimed IPs: [192.168.28.6/26] block=192.168.28.0/26 handle="k8s-pod-network.2ece9d89ae4756a31030aad7e5add3303b35a829806c9f141707fa86b63160f8" host="ip-172-31-30-14" Oct 28 04:41:08.845500 containerd[1890]: 2025-10-28 04:41:08.789 [INFO][5168] ipam/ipam.go 878: Auto-assigned 1 out of 1 IPv4s: [192.168.28.6/26] handle="k8s-pod-network.2ece9d89ae4756a31030aad7e5add3303b35a829806c9f141707fa86b63160f8" host="ip-172-31-30-14" Oct 28 04:41:08.845500 containerd[1890]: 2025-10-28 04:41:08.789 [INFO][5168] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Oct 28 04:41:08.845500 containerd[1890]: 2025-10-28 04:41:08.790 [INFO][5168] ipam/ipam_plugin.go 299: Calico CNI IPAM assigned addresses IPv4=[192.168.28.6/26] IPv6=[] ContainerID="2ece9d89ae4756a31030aad7e5add3303b35a829806c9f141707fa86b63160f8" HandleID="k8s-pod-network.2ece9d89ae4756a31030aad7e5add3303b35a829806c9f141707fa86b63160f8" Workload="ip--172--31--30--14-k8s-coredns--674b8bbfcf--l754x-eth0" Oct 28 04:41:08.850624 containerd[1890]: 2025-10-28 04:41:08.796 [INFO][5147] cni-plugin/k8s.go 418: Populated endpoint ContainerID="2ece9d89ae4756a31030aad7e5add3303b35a829806c9f141707fa86b63160f8" Namespace="kube-system" Pod="coredns-674b8bbfcf-l754x" WorkloadEndpoint="ip--172--31--30--14-k8s-coredns--674b8bbfcf--l754x-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--30--14-k8s-coredns--674b8bbfcf--l754x-eth0", GenerateName:"coredns-674b8bbfcf-", Namespace:"kube-system", SelfLink:"", UID:"9d93d421-2e21-4d9b-88ef-871150cd8795", ResourceVersion:"879", Generation:0, CreationTimestamp:time.Date(2025, time.October, 28, 4, 40, 12, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-dns", "pod-template-hash":"674b8bbfcf", "projectcalico.org/namespace":"kube-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"coredns"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-30-14", ContainerID:"", Pod:"coredns-674b8bbfcf-l754x", Endpoint:"eth0", ServiceAccountName:"coredns", IPNetworks:[]string{"192.168.28.6/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.kube-system", "ksa.kube-system.coredns"}, InterfaceName:"cali3dfe848c1b2", MAC:"", Ports:[]v3.WorkloadEndpointPort{v3.WorkloadEndpointPort{Name:"dns", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"UDP"}, Port:0x35, HostPort:0x0, HostIP:""}, v3.WorkloadEndpointPort{Name:"dns-tcp", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"TCP"}, Port:0x35, HostPort:0x0, HostIP:""}, v3.WorkloadEndpointPort{Name:"metrics", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"TCP"}, Port:0x23c1, HostPort:0x0, HostIP:""}}, AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Oct 28 04:41:08.850624 containerd[1890]: 2025-10-28 04:41:08.796 [INFO][5147] cni-plugin/k8s.go 419: Calico CNI using IPs: [192.168.28.6/32] ContainerID="2ece9d89ae4756a31030aad7e5add3303b35a829806c9f141707fa86b63160f8" Namespace="kube-system" Pod="coredns-674b8bbfcf-l754x" WorkloadEndpoint="ip--172--31--30--14-k8s-coredns--674b8bbfcf--l754x-eth0" Oct 28 04:41:08.850624 containerd[1890]: 2025-10-28 04:41:08.796 [INFO][5147] cni-plugin/dataplane_linux.go 69: Setting the host side veth name to cali3dfe848c1b2 ContainerID="2ece9d89ae4756a31030aad7e5add3303b35a829806c9f141707fa86b63160f8" Namespace="kube-system" Pod="coredns-674b8bbfcf-l754x" WorkloadEndpoint="ip--172--31--30--14-k8s-coredns--674b8bbfcf--l754x-eth0" Oct 28 04:41:08.850624 containerd[1890]: 2025-10-28 04:41:08.806 [INFO][5147] cni-plugin/dataplane_linux.go 508: Disabling IPv4 forwarding ContainerID="2ece9d89ae4756a31030aad7e5add3303b35a829806c9f141707fa86b63160f8" Namespace="kube-system" Pod="coredns-674b8bbfcf-l754x" WorkloadEndpoint="ip--172--31--30--14-k8s-coredns--674b8bbfcf--l754x-eth0" Oct 28 04:41:08.850624 containerd[1890]: 2025-10-28 04:41:08.809 [INFO][5147] cni-plugin/k8s.go 446: Added Mac, interface name, and active container ID to endpoint ContainerID="2ece9d89ae4756a31030aad7e5add3303b35a829806c9f141707fa86b63160f8" Namespace="kube-system" Pod="coredns-674b8bbfcf-l754x" WorkloadEndpoint="ip--172--31--30--14-k8s-coredns--674b8bbfcf--l754x-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--30--14-k8s-coredns--674b8bbfcf--l754x-eth0", GenerateName:"coredns-674b8bbfcf-", Namespace:"kube-system", SelfLink:"", UID:"9d93d421-2e21-4d9b-88ef-871150cd8795", ResourceVersion:"879", Generation:0, CreationTimestamp:time.Date(2025, time.October, 28, 4, 40, 12, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-dns", "pod-template-hash":"674b8bbfcf", "projectcalico.org/namespace":"kube-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"coredns"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-30-14", ContainerID:"2ece9d89ae4756a31030aad7e5add3303b35a829806c9f141707fa86b63160f8", Pod:"coredns-674b8bbfcf-l754x", Endpoint:"eth0", ServiceAccountName:"coredns", IPNetworks:[]string{"192.168.28.6/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.kube-system", "ksa.kube-system.coredns"}, InterfaceName:"cali3dfe848c1b2", MAC:"ce:6f:75:cd:b2:43", Ports:[]v3.WorkloadEndpointPort{v3.WorkloadEndpointPort{Name:"dns", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"UDP"}, Port:0x35, HostPort:0x0, HostIP:""}, v3.WorkloadEndpointPort{Name:"dns-tcp", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"TCP"}, Port:0x35, HostPort:0x0, HostIP:""}, v3.WorkloadEndpointPort{Name:"metrics", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"TCP"}, Port:0x23c1, HostPort:0x0, HostIP:""}}, AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Oct 28 04:41:08.850624 containerd[1890]: 2025-10-28 04:41:08.839 [INFO][5147] cni-plugin/k8s.go 532: Wrote updated endpoint to datastore ContainerID="2ece9d89ae4756a31030aad7e5add3303b35a829806c9f141707fa86b63160f8" Namespace="kube-system" Pod="coredns-674b8bbfcf-l754x" WorkloadEndpoint="ip--172--31--30--14-k8s-coredns--674b8bbfcf--l754x-eth0" Oct 28 04:41:08.883525 systemd-networkd[1494]: califa13e08f77a: Gained IPv6LL Oct 28 04:41:08.937672 kubelet[3230]: E1028 04:41:08.936358 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-844c8ff9ff-trlfg" podUID="964233f5-181d-4a9e-b75e-ce5914393292" Oct 28 04:41:08.941367 kubelet[3230]: E1028 04:41:08.941106 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-kube-controllers\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found\"" pod="calico-system/calico-kube-controllers-56b4fb96c7-rtxd5" podUID="54edc01d-f226-4f67-826d-011b168afccb" Oct 28 04:41:08.975394 containerd[1890]: time="2025-10-28T04:41:08.973817372Z" level=info msg="connecting to shim 2ece9d89ae4756a31030aad7e5add3303b35a829806c9f141707fa86b63160f8" address="unix:///run/containerd/s/62abe0b089c2f318562310508aab50b296bc1f91ec9426640658c41d806a5208" namespace=k8s.io protocol=ttrpc version=3 Oct 28 04:41:09.027722 systemd-networkd[1494]: cali91d223938f4: Link UP Oct 28 04:41:09.029936 systemd-networkd[1494]: cali91d223938f4: Gained carrier Oct 28 04:41:09.082789 containerd[1890]: 2025-10-28 04:41:08.625 [INFO][5139] cni-plugin/plugin.go 340: Calico CNI found existing endpoint: &{{WorkloadEndpoint projectcalico.org/v3} {ip--172--31--30--14-k8s-csi--node--driver--jhrzl-eth0 csi-node-driver- calico-system c42b89c4-6ac3-4fdf-90fb-009bd174d781 782 0 2025-10-28 04:40:43 +0000 UTC map[app.kubernetes.io/name:csi-node-driver controller-revision-hash:857b56db8f k8s-app:csi-node-driver name:csi-node-driver pod-template-generation:1 projectcalico.org/namespace:calico-system projectcalico.org/orchestrator:k8s projectcalico.org/serviceaccount:csi-node-driver] map[] [] [] []} {k8s ip-172-31-30-14 csi-node-driver-jhrzl eth0 csi-node-driver [] [] [kns.calico-system ksa.calico-system.csi-node-driver] cali91d223938f4 [] [] }} ContainerID="ecb1c93f3cae1c48e3b89671d2e9aabd91902891ef75b6344ff540f6efce3493" Namespace="calico-system" Pod="csi-node-driver-jhrzl" WorkloadEndpoint="ip--172--31--30--14-k8s-csi--node--driver--jhrzl-" Oct 28 04:41:09.082789 containerd[1890]: 2025-10-28 04:41:08.625 [INFO][5139] cni-plugin/k8s.go 74: Extracted identifiers for CmdAddK8s ContainerID="ecb1c93f3cae1c48e3b89671d2e9aabd91902891ef75b6344ff540f6efce3493" Namespace="calico-system" Pod="csi-node-driver-jhrzl" WorkloadEndpoint="ip--172--31--30--14-k8s-csi--node--driver--jhrzl-eth0" Oct 28 04:41:09.082789 containerd[1890]: 2025-10-28 04:41:08.729 [INFO][5166] ipam/ipam_plugin.go 227: Calico CNI IPAM request count IPv4=1 IPv6=0 ContainerID="ecb1c93f3cae1c48e3b89671d2e9aabd91902891ef75b6344ff540f6efce3493" HandleID="k8s-pod-network.ecb1c93f3cae1c48e3b89671d2e9aabd91902891ef75b6344ff540f6efce3493" Workload="ip--172--31--30--14-k8s-csi--node--driver--jhrzl-eth0" Oct 28 04:41:09.082789 containerd[1890]: 2025-10-28 04:41:08.729 [INFO][5166] ipam/ipam_plugin.go 275: Auto assigning IP ContainerID="ecb1c93f3cae1c48e3b89671d2e9aabd91902891ef75b6344ff540f6efce3493" HandleID="k8s-pod-network.ecb1c93f3cae1c48e3b89671d2e9aabd91902891ef75b6344ff540f6efce3493" Workload="ip--172--31--30--14-k8s-csi--node--driver--jhrzl-eth0" assignArgs=ipam.AutoAssignArgs{Num4:1, Num6:0, HandleID:(*string)(0x400004da30), Attrs:map[string]string{"namespace":"calico-system", "node":"ip-172-31-30-14", "pod":"csi-node-driver-jhrzl", "timestamp":"2025-10-28 04:41:08.729265002 +0000 UTC"}, Hostname:"ip-172-31-30-14", IPv4Pools:[]net.IPNet{}, IPv6Pools:[]net.IPNet{}, MaxBlocksPerHost:0, HostReservedAttrIPv4s:(*ipam.HostReservedAttr)(nil), HostReservedAttrIPv6s:(*ipam.HostReservedAttr)(nil), IntendedUse:"Workload"} Oct 28 04:41:09.082789 containerd[1890]: 2025-10-28 04:41:08.730 [INFO][5166] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Oct 28 04:41:09.082789 containerd[1890]: 2025-10-28 04:41:08.789 [INFO][5166] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Oct 28 04:41:09.082789 containerd[1890]: 2025-10-28 04:41:08.790 [INFO][5166] ipam/ipam.go 110: Auto-assign 1 ipv4, 0 ipv6 addrs for host 'ip-172-31-30-14' Oct 28 04:41:09.082789 containerd[1890]: 2025-10-28 04:41:08.836 [INFO][5166] ipam/ipam.go 691: Looking up existing affinities for host handle="k8s-pod-network.ecb1c93f3cae1c48e3b89671d2e9aabd91902891ef75b6344ff540f6efce3493" host="ip-172-31-30-14" Oct 28 04:41:09.082789 containerd[1890]: 2025-10-28 04:41:08.858 [INFO][5166] ipam/ipam.go 394: Looking up existing affinities for host host="ip-172-31-30-14" Oct 28 04:41:09.082789 containerd[1890]: 2025-10-28 04:41:08.876 [INFO][5166] ipam/ipam.go 511: Trying affinity for 192.168.28.0/26 host="ip-172-31-30-14" Oct 28 04:41:09.082789 containerd[1890]: 2025-10-28 04:41:08.886 [INFO][5166] ipam/ipam.go 158: Attempting to load block cidr=192.168.28.0/26 host="ip-172-31-30-14" Oct 28 04:41:09.082789 containerd[1890]: 2025-10-28 04:41:08.897 [INFO][5166] ipam/ipam.go 235: Affinity is confirmed and block has been loaded cidr=192.168.28.0/26 host="ip-172-31-30-14" Oct 28 04:41:09.082789 containerd[1890]: 2025-10-28 04:41:08.897 [INFO][5166] ipam/ipam.go 1219: Attempting to assign 1 addresses from block block=192.168.28.0/26 handle="k8s-pod-network.ecb1c93f3cae1c48e3b89671d2e9aabd91902891ef75b6344ff540f6efce3493" host="ip-172-31-30-14" Oct 28 04:41:09.082789 containerd[1890]: 2025-10-28 04:41:08.901 [INFO][5166] ipam/ipam.go 1780: Creating new handle: k8s-pod-network.ecb1c93f3cae1c48e3b89671d2e9aabd91902891ef75b6344ff540f6efce3493 Oct 28 04:41:09.082789 containerd[1890]: 2025-10-28 04:41:08.921 [INFO][5166] ipam/ipam.go 1246: Writing block in order to claim IPs block=192.168.28.0/26 handle="k8s-pod-network.ecb1c93f3cae1c48e3b89671d2e9aabd91902891ef75b6344ff540f6efce3493" host="ip-172-31-30-14" Oct 28 04:41:09.082789 containerd[1890]: 2025-10-28 04:41:08.968 [INFO][5166] ipam/ipam.go 1262: Successfully claimed IPs: [192.168.28.7/26] block=192.168.28.0/26 handle="k8s-pod-network.ecb1c93f3cae1c48e3b89671d2e9aabd91902891ef75b6344ff540f6efce3493" host="ip-172-31-30-14" Oct 28 04:41:09.082789 containerd[1890]: 2025-10-28 04:41:08.968 [INFO][5166] ipam/ipam.go 878: Auto-assigned 1 out of 1 IPv4s: [192.168.28.7/26] handle="k8s-pod-network.ecb1c93f3cae1c48e3b89671d2e9aabd91902891ef75b6344ff540f6efce3493" host="ip-172-31-30-14" Oct 28 04:41:09.082789 containerd[1890]: 2025-10-28 04:41:08.968 [INFO][5166] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Oct 28 04:41:09.082789 containerd[1890]: 2025-10-28 04:41:08.970 [INFO][5166] ipam/ipam_plugin.go 299: Calico CNI IPAM assigned addresses IPv4=[192.168.28.7/26] IPv6=[] ContainerID="ecb1c93f3cae1c48e3b89671d2e9aabd91902891ef75b6344ff540f6efce3493" HandleID="k8s-pod-network.ecb1c93f3cae1c48e3b89671d2e9aabd91902891ef75b6344ff540f6efce3493" Workload="ip--172--31--30--14-k8s-csi--node--driver--jhrzl-eth0" Oct 28 04:41:09.083920 containerd[1890]: 2025-10-28 04:41:09.000 [INFO][5139] cni-plugin/k8s.go 418: Populated endpoint ContainerID="ecb1c93f3cae1c48e3b89671d2e9aabd91902891ef75b6344ff540f6efce3493" Namespace="calico-system" Pod="csi-node-driver-jhrzl" WorkloadEndpoint="ip--172--31--30--14-k8s-csi--node--driver--jhrzl-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--30--14-k8s-csi--node--driver--jhrzl-eth0", GenerateName:"csi-node-driver-", Namespace:"calico-system", SelfLink:"", UID:"c42b89c4-6ac3-4fdf-90fb-009bd174d781", ResourceVersion:"782", Generation:0, CreationTimestamp:time.Date(2025, time.October, 28, 4, 40, 43, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app.kubernetes.io/name":"csi-node-driver", "controller-revision-hash":"857b56db8f", "k8s-app":"csi-node-driver", "name":"csi-node-driver", "pod-template-generation":"1", "projectcalico.org/namespace":"calico-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"csi-node-driver"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-30-14", ContainerID:"", Pod:"csi-node-driver-jhrzl", Endpoint:"eth0", ServiceAccountName:"csi-node-driver", IPNetworks:[]string{"192.168.28.7/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-system", "ksa.calico-system.csi-node-driver"}, InterfaceName:"cali91d223938f4", MAC:"", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Oct 28 04:41:09.083920 containerd[1890]: 2025-10-28 04:41:09.000 [INFO][5139] cni-plugin/k8s.go 419: Calico CNI using IPs: [192.168.28.7/32] ContainerID="ecb1c93f3cae1c48e3b89671d2e9aabd91902891ef75b6344ff540f6efce3493" Namespace="calico-system" Pod="csi-node-driver-jhrzl" WorkloadEndpoint="ip--172--31--30--14-k8s-csi--node--driver--jhrzl-eth0" Oct 28 04:41:09.083920 containerd[1890]: 2025-10-28 04:41:09.000 [INFO][5139] cni-plugin/dataplane_linux.go 69: Setting the host side veth name to cali91d223938f4 ContainerID="ecb1c93f3cae1c48e3b89671d2e9aabd91902891ef75b6344ff540f6efce3493" Namespace="calico-system" Pod="csi-node-driver-jhrzl" WorkloadEndpoint="ip--172--31--30--14-k8s-csi--node--driver--jhrzl-eth0" Oct 28 04:41:09.083920 containerd[1890]: 2025-10-28 04:41:09.032 [INFO][5139] cni-plugin/dataplane_linux.go 508: Disabling IPv4 forwarding ContainerID="ecb1c93f3cae1c48e3b89671d2e9aabd91902891ef75b6344ff540f6efce3493" Namespace="calico-system" Pod="csi-node-driver-jhrzl" WorkloadEndpoint="ip--172--31--30--14-k8s-csi--node--driver--jhrzl-eth0" Oct 28 04:41:09.083920 containerd[1890]: 2025-10-28 04:41:09.034 [INFO][5139] cni-plugin/k8s.go 446: Added Mac, interface name, and active container ID to endpoint ContainerID="ecb1c93f3cae1c48e3b89671d2e9aabd91902891ef75b6344ff540f6efce3493" Namespace="calico-system" Pod="csi-node-driver-jhrzl" WorkloadEndpoint="ip--172--31--30--14-k8s-csi--node--driver--jhrzl-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--30--14-k8s-csi--node--driver--jhrzl-eth0", GenerateName:"csi-node-driver-", Namespace:"calico-system", SelfLink:"", UID:"c42b89c4-6ac3-4fdf-90fb-009bd174d781", ResourceVersion:"782", Generation:0, CreationTimestamp:time.Date(2025, time.October, 28, 4, 40, 43, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app.kubernetes.io/name":"csi-node-driver", "controller-revision-hash":"857b56db8f", "k8s-app":"csi-node-driver", "name":"csi-node-driver", "pod-template-generation":"1", "projectcalico.org/namespace":"calico-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"csi-node-driver"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-30-14", ContainerID:"ecb1c93f3cae1c48e3b89671d2e9aabd91902891ef75b6344ff540f6efce3493", Pod:"csi-node-driver-jhrzl", Endpoint:"eth0", ServiceAccountName:"csi-node-driver", IPNetworks:[]string{"192.168.28.7/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-system", "ksa.calico-system.csi-node-driver"}, InterfaceName:"cali91d223938f4", MAC:"76:d2:3d:d7:60:d4", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Oct 28 04:41:09.083920 containerd[1890]: 2025-10-28 04:41:09.064 [INFO][5139] cni-plugin/k8s.go 532: Wrote updated endpoint to datastore ContainerID="ecb1c93f3cae1c48e3b89671d2e9aabd91902891ef75b6344ff540f6efce3493" Namespace="calico-system" Pod="csi-node-driver-jhrzl" WorkloadEndpoint="ip--172--31--30--14-k8s-csi--node--driver--jhrzl-eth0" Oct 28 04:41:09.152041 systemd[1]: Started cri-containerd-2ece9d89ae4756a31030aad7e5add3303b35a829806c9f141707fa86b63160f8.scope - libcontainer container 2ece9d89ae4756a31030aad7e5add3303b35a829806c9f141707fa86b63160f8. Oct 28 04:41:09.191824 containerd[1890]: time="2025-10-28T04:41:09.191702153Z" level=info msg="connecting to shim ecb1c93f3cae1c48e3b89671d2e9aabd91902891ef75b6344ff540f6efce3493" address="unix:///run/containerd/s/425d4aa7503a9404913a525557706464489e350a265d22dec0bf2c29f49ea408" namespace=k8s.io protocol=ttrpc version=3 Oct 28 04:41:09.257011 systemd[1]: Started cri-containerd-ecb1c93f3cae1c48e3b89671d2e9aabd91902891ef75b6344ff540f6efce3493.scope - libcontainer container ecb1c93f3cae1c48e3b89671d2e9aabd91902891ef75b6344ff540f6efce3493. Oct 28 04:41:09.326235 containerd[1890]: time="2025-10-28T04:41:09.326146757Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-674b8bbfcf-l754x,Uid:9d93d421-2e21-4d9b-88ef-871150cd8795,Namespace:kube-system,Attempt:0,} returns sandbox id \"2ece9d89ae4756a31030aad7e5add3303b35a829806c9f141707fa86b63160f8\"" Oct 28 04:41:09.344636 containerd[1890]: time="2025-10-28T04:41:09.344494949Z" level=info msg="CreateContainer within sandbox \"2ece9d89ae4756a31030aad7e5add3303b35a829806c9f141707fa86b63160f8\" for container &ContainerMetadata{Name:coredns,Attempt:0,}" Oct 28 04:41:09.378449 containerd[1890]: time="2025-10-28T04:41:09.378359418Z" level=info msg="Container 4fadc50ff0c746d4f1eb0514c032dba09ce6faa04be5f5bacc330c4d3b2092a7: CDI devices from CRI Config.CDIDevices: []" Oct 28 04:41:09.405055 containerd[1890]: time="2025-10-28T04:41:09.404976402Z" level=info msg="CreateContainer within sandbox \"2ece9d89ae4756a31030aad7e5add3303b35a829806c9f141707fa86b63160f8\" for &ContainerMetadata{Name:coredns,Attempt:0,} returns container id \"4fadc50ff0c746d4f1eb0514c032dba09ce6faa04be5f5bacc330c4d3b2092a7\"" Oct 28 04:41:09.409690 containerd[1890]: time="2025-10-28T04:41:09.408699282Z" level=info msg="StartContainer for \"4fadc50ff0c746d4f1eb0514c032dba09ce6faa04be5f5bacc330c4d3b2092a7\"" Oct 28 04:41:09.415139 containerd[1890]: time="2025-10-28T04:41:09.415065954Z" level=info msg="connecting to shim 4fadc50ff0c746d4f1eb0514c032dba09ce6faa04be5f5bacc330c4d3b2092a7" address="unix:///run/containerd/s/62abe0b089c2f318562310508aab50b296bc1f91ec9426640658c41d806a5208" protocol=ttrpc version=3 Oct 28 04:41:09.447962 containerd[1890]: time="2025-10-28T04:41:09.447896502Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:csi-node-driver-jhrzl,Uid:c42b89c4-6ac3-4fdf-90fb-009bd174d781,Namespace:calico-system,Attempt:0,} returns sandbox id \"ecb1c93f3cae1c48e3b89671d2e9aabd91902891ef75b6344ff540f6efce3493\"" Oct 28 04:41:09.455501 containerd[1890]: time="2025-10-28T04:41:09.455257422Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/csi:v3.30.4\"" Oct 28 04:41:09.495101 containerd[1890]: time="2025-10-28T04:41:09.495012642Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:goldmane-666569f655-nrkfh,Uid:d588ee10-7ecd-4970-b6a0-1f251568d2c6,Namespace:calico-system,Attempt:0,}" Oct 28 04:41:09.500987 systemd[1]: Started cri-containerd-4fadc50ff0c746d4f1eb0514c032dba09ce6faa04be5f5bacc330c4d3b2092a7.scope - libcontainer container 4fadc50ff0c746d4f1eb0514c032dba09ce6faa04be5f5bacc330c4d3b2092a7. Oct 28 04:41:09.664650 containerd[1890]: time="2025-10-28T04:41:09.664481347Z" level=info msg="StartContainer for \"4fadc50ff0c746d4f1eb0514c032dba09ce6faa04be5f5bacc330c4d3b2092a7\" returns successfully" Oct 28 04:41:09.746106 containerd[1890]: time="2025-10-28T04:41:09.744730531Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Oct 28 04:41:09.749064 containerd[1890]: time="2025-10-28T04:41:09.748723231Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/csi:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" Oct 28 04:41:09.749412 containerd[1890]: time="2025-10-28T04:41:09.749274943Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/csi:v3.30.4: active requests=0, bytes read=69" Oct 28 04:41:09.750966 kubelet[3230]: E1028 04:41:09.750622 3230 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" image="ghcr.io/flatcar/calico/csi:v3.30.4" Oct 28 04:41:09.750966 kubelet[3230]: E1028 04:41:09.750869 3230 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" image="ghcr.io/flatcar/calico/csi:v3.30.4" Oct 28 04:41:09.753591 kubelet[3230]: E1028 04:41:09.752841 3230 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:calico-csi,Image:ghcr.io/flatcar/calico/csi:v3.30.4,Command:[],Args:[--nodeid=$(KUBE_NODE_NAME) --loglevel=$(LOG_LEVEL)],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:warn,ValueFrom:nil,},EnvVar{Name:KUBE_NODE_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:spec.nodeName,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kubelet-dir,ReadOnly:false,MountPath:/var/lib/kubelet,SubPath:,MountPropagation:*Bidirectional,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:socket-dir,ReadOnly:false,MountPath:/csi,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:varrun,ReadOnly:false,MountPath:/var/run,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-qfrjk,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*true,SELinuxOptions:nil,RunAsUser:*0,RunAsNonRoot:*false,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*true,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod csi-node-driver-jhrzl_calico-system(c42b89c4-6ac3-4fdf-90fb-009bd174d781): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" logger="UnhandledError" Oct 28 04:41:09.761445 containerd[1890]: time="2025-10-28T04:41:09.761195084Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\"" Oct 28 04:41:09.955911 systemd-networkd[1494]: cali47b333711d3: Link UP Oct 28 04:41:09.956367 systemd-networkd[1494]: cali47b333711d3: Gained carrier Oct 28 04:41:09.970901 systemd-networkd[1494]: cali3dfe848c1b2: Gained IPv6LL Oct 28 04:41:10.006822 containerd[1890]: time="2025-10-28T04:41:10.006564065Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Oct 28 04:41:10.009616 kubelet[3230]: I1028 04:41:10.009499 3230 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/coredns-674b8bbfcf-l754x" podStartSLOduration=58.009472781 podStartE2EDuration="58.009472781s" podCreationTimestamp="2025-10-28 04:40:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-28 04:41:10.001029497 +0000 UTC m=+61.737862460" watchObservedRunningTime="2025-10-28 04:41:10.009472781 +0000 UTC m=+61.746305768" Oct 28 04:41:10.012147 containerd[1890]: time="2025-10-28T04:41:10.011705153Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: active requests=0, bytes read=93" Oct 28 04:41:10.012147 containerd[1890]: time="2025-10-28T04:41:10.011828681Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" Oct 28 04:41:10.013769 kubelet[3230]: E1028 04:41:10.012979 3230 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" image="ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4" Oct 28 04:41:10.013769 kubelet[3230]: E1028 04:41:10.013044 3230 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" image="ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4" Oct 28 04:41:10.016577 kubelet[3230]: E1028 04:41:10.015583 3230 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:csi-node-driver-registrar,Image:ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4,Command:[],Args:[--v=5 --csi-address=$(ADDRESS) --kubelet-registration-path=$(DRIVER_REG_SOCK_PATH)],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:ADDRESS,Value:/csi/csi.sock,ValueFrom:nil,},EnvVar{Name:DRIVER_REG_SOCK_PATH,Value:/var/lib/kubelet/plugins/csi.tigera.io/csi.sock,ValueFrom:nil,},EnvVar{Name:KUBE_NODE_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:spec.nodeName,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:registration-dir,ReadOnly:false,MountPath:/registration,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:socket-dir,ReadOnly:false,MountPath:/csi,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-qfrjk,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*true,SELinuxOptions:nil,RunAsUser:*0,RunAsNonRoot:*false,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*true,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod csi-node-driver-jhrzl_calico-system(c42b89c4-6ac3-4fdf-90fb-009bd174d781): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" logger="UnhandledError" Oct 28 04:41:10.018380 kubelet[3230]: E1028 04:41:10.018210 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"calico-csi\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ghcr.io/flatcar/calico/csi:v3.30.4: not found\", failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found\"]" pod="calico-system/csi-node-driver-jhrzl" podUID="c42b89c4-6ac3-4fdf-90fb-009bd174d781" Oct 28 04:41:10.023034 containerd[1890]: 2025-10-28 04:41:09.689 [INFO][5304] cni-plugin/plugin.go 340: Calico CNI found existing endpoint: &{{WorkloadEndpoint projectcalico.org/v3} {ip--172--31--30--14-k8s-goldmane--666569f655--nrkfh-eth0 goldmane-666569f655- calico-system d588ee10-7ecd-4970-b6a0-1f251568d2c6 886 0 2025-10-28 04:40:36 +0000 UTC map[app.kubernetes.io/name:goldmane k8s-app:goldmane pod-template-hash:666569f655 projectcalico.org/namespace:calico-system projectcalico.org/orchestrator:k8s projectcalico.org/serviceaccount:goldmane] map[] [] [] []} {k8s ip-172-31-30-14 goldmane-666569f655-nrkfh eth0 goldmane [] [] [kns.calico-system ksa.calico-system.goldmane] cali47b333711d3 [] [] }} ContainerID="47a9894ecc9464c929448804989c328dd075cf62c02172f933e15758d5521851" Namespace="calico-system" Pod="goldmane-666569f655-nrkfh" WorkloadEndpoint="ip--172--31--30--14-k8s-goldmane--666569f655--nrkfh-" Oct 28 04:41:10.023034 containerd[1890]: 2025-10-28 04:41:09.691 [INFO][5304] cni-plugin/k8s.go 74: Extracted identifiers for CmdAddK8s ContainerID="47a9894ecc9464c929448804989c328dd075cf62c02172f933e15758d5521851" Namespace="calico-system" Pod="goldmane-666569f655-nrkfh" WorkloadEndpoint="ip--172--31--30--14-k8s-goldmane--666569f655--nrkfh-eth0" Oct 28 04:41:10.023034 containerd[1890]: 2025-10-28 04:41:09.805 [INFO][5338] ipam/ipam_plugin.go 227: Calico CNI IPAM request count IPv4=1 IPv6=0 ContainerID="47a9894ecc9464c929448804989c328dd075cf62c02172f933e15758d5521851" HandleID="k8s-pod-network.47a9894ecc9464c929448804989c328dd075cf62c02172f933e15758d5521851" Workload="ip--172--31--30--14-k8s-goldmane--666569f655--nrkfh-eth0" Oct 28 04:41:10.023034 containerd[1890]: 2025-10-28 04:41:09.805 [INFO][5338] ipam/ipam_plugin.go 275: Auto assigning IP ContainerID="47a9894ecc9464c929448804989c328dd075cf62c02172f933e15758d5521851" HandleID="k8s-pod-network.47a9894ecc9464c929448804989c328dd075cf62c02172f933e15758d5521851" Workload="ip--172--31--30--14-k8s-goldmane--666569f655--nrkfh-eth0" assignArgs=ipam.AutoAssignArgs{Num4:1, Num6:0, HandleID:(*string)(0x400004c570), Attrs:map[string]string{"namespace":"calico-system", "node":"ip-172-31-30-14", "pod":"goldmane-666569f655-nrkfh", "timestamp":"2025-10-28 04:41:09.805401056 +0000 UTC"}, Hostname:"ip-172-31-30-14", IPv4Pools:[]net.IPNet{}, IPv6Pools:[]net.IPNet{}, MaxBlocksPerHost:0, HostReservedAttrIPv4s:(*ipam.HostReservedAttr)(nil), HostReservedAttrIPv6s:(*ipam.HostReservedAttr)(nil), IntendedUse:"Workload"} Oct 28 04:41:10.023034 containerd[1890]: 2025-10-28 04:41:09.805 [INFO][5338] ipam/ipam_plugin.go 377: About to acquire host-wide IPAM lock. Oct 28 04:41:10.023034 containerd[1890]: 2025-10-28 04:41:09.805 [INFO][5338] ipam/ipam_plugin.go 392: Acquired host-wide IPAM lock. Oct 28 04:41:10.023034 containerd[1890]: 2025-10-28 04:41:09.805 [INFO][5338] ipam/ipam.go 110: Auto-assign 1 ipv4, 0 ipv6 addrs for host 'ip-172-31-30-14' Oct 28 04:41:10.023034 containerd[1890]: 2025-10-28 04:41:09.855 [INFO][5338] ipam/ipam.go 691: Looking up existing affinities for host handle="k8s-pod-network.47a9894ecc9464c929448804989c328dd075cf62c02172f933e15758d5521851" host="ip-172-31-30-14" Oct 28 04:41:10.023034 containerd[1890]: 2025-10-28 04:41:09.870 [INFO][5338] ipam/ipam.go 394: Looking up existing affinities for host host="ip-172-31-30-14" Oct 28 04:41:10.023034 containerd[1890]: 2025-10-28 04:41:09.880 [INFO][5338] ipam/ipam.go 511: Trying affinity for 192.168.28.0/26 host="ip-172-31-30-14" Oct 28 04:41:10.023034 containerd[1890]: 2025-10-28 04:41:09.885 [INFO][5338] ipam/ipam.go 158: Attempting to load block cidr=192.168.28.0/26 host="ip-172-31-30-14" Oct 28 04:41:10.023034 containerd[1890]: 2025-10-28 04:41:09.894 [INFO][5338] ipam/ipam.go 235: Affinity is confirmed and block has been loaded cidr=192.168.28.0/26 host="ip-172-31-30-14" Oct 28 04:41:10.023034 containerd[1890]: 2025-10-28 04:41:09.895 [INFO][5338] ipam/ipam.go 1219: Attempting to assign 1 addresses from block block=192.168.28.0/26 handle="k8s-pod-network.47a9894ecc9464c929448804989c328dd075cf62c02172f933e15758d5521851" host="ip-172-31-30-14" Oct 28 04:41:10.023034 containerd[1890]: 2025-10-28 04:41:09.898 [INFO][5338] ipam/ipam.go 1780: Creating new handle: k8s-pod-network.47a9894ecc9464c929448804989c328dd075cf62c02172f933e15758d5521851 Oct 28 04:41:10.023034 containerd[1890]: 2025-10-28 04:41:09.912 [INFO][5338] ipam/ipam.go 1246: Writing block in order to claim IPs block=192.168.28.0/26 handle="k8s-pod-network.47a9894ecc9464c929448804989c328dd075cf62c02172f933e15758d5521851" host="ip-172-31-30-14" Oct 28 04:41:10.023034 containerd[1890]: 2025-10-28 04:41:09.932 [INFO][5338] ipam/ipam.go 1262: Successfully claimed IPs: [192.168.28.8/26] block=192.168.28.0/26 handle="k8s-pod-network.47a9894ecc9464c929448804989c328dd075cf62c02172f933e15758d5521851" host="ip-172-31-30-14" Oct 28 04:41:10.023034 containerd[1890]: 2025-10-28 04:41:09.932 [INFO][5338] ipam/ipam.go 878: Auto-assigned 1 out of 1 IPv4s: [192.168.28.8/26] handle="k8s-pod-network.47a9894ecc9464c929448804989c328dd075cf62c02172f933e15758d5521851" host="ip-172-31-30-14" Oct 28 04:41:10.023034 containerd[1890]: 2025-10-28 04:41:09.932 [INFO][5338] ipam/ipam_plugin.go 398: Released host-wide IPAM lock. Oct 28 04:41:10.023034 containerd[1890]: 2025-10-28 04:41:09.932 [INFO][5338] ipam/ipam_plugin.go 299: Calico CNI IPAM assigned addresses IPv4=[192.168.28.8/26] IPv6=[] ContainerID="47a9894ecc9464c929448804989c328dd075cf62c02172f933e15758d5521851" HandleID="k8s-pod-network.47a9894ecc9464c929448804989c328dd075cf62c02172f933e15758d5521851" Workload="ip--172--31--30--14-k8s-goldmane--666569f655--nrkfh-eth0" Oct 28 04:41:10.027277 containerd[1890]: 2025-10-28 04:41:09.944 [INFO][5304] cni-plugin/k8s.go 418: Populated endpoint ContainerID="47a9894ecc9464c929448804989c328dd075cf62c02172f933e15758d5521851" Namespace="calico-system" Pod="goldmane-666569f655-nrkfh" WorkloadEndpoint="ip--172--31--30--14-k8s-goldmane--666569f655--nrkfh-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--30--14-k8s-goldmane--666569f655--nrkfh-eth0", GenerateName:"goldmane-666569f655-", Namespace:"calico-system", SelfLink:"", UID:"d588ee10-7ecd-4970-b6a0-1f251568d2c6", ResourceVersion:"886", Generation:0, CreationTimestamp:time.Date(2025, time.October, 28, 4, 40, 36, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app.kubernetes.io/name":"goldmane", "k8s-app":"goldmane", "pod-template-hash":"666569f655", "projectcalico.org/namespace":"calico-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"goldmane"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-30-14", ContainerID:"", Pod:"goldmane-666569f655-nrkfh", Endpoint:"eth0", ServiceAccountName:"goldmane", IPNetworks:[]string{"192.168.28.8/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-system", "ksa.calico-system.goldmane"}, InterfaceName:"cali47b333711d3", MAC:"", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Oct 28 04:41:10.027277 containerd[1890]: 2025-10-28 04:41:09.945 [INFO][5304] cni-plugin/k8s.go 419: Calico CNI using IPs: [192.168.28.8/32] ContainerID="47a9894ecc9464c929448804989c328dd075cf62c02172f933e15758d5521851" Namespace="calico-system" Pod="goldmane-666569f655-nrkfh" WorkloadEndpoint="ip--172--31--30--14-k8s-goldmane--666569f655--nrkfh-eth0" Oct 28 04:41:10.027277 containerd[1890]: 2025-10-28 04:41:09.945 [INFO][5304] cni-plugin/dataplane_linux.go 69: Setting the host side veth name to cali47b333711d3 ContainerID="47a9894ecc9464c929448804989c328dd075cf62c02172f933e15758d5521851" Namespace="calico-system" Pod="goldmane-666569f655-nrkfh" WorkloadEndpoint="ip--172--31--30--14-k8s-goldmane--666569f655--nrkfh-eth0" Oct 28 04:41:10.027277 containerd[1890]: 2025-10-28 04:41:09.960 [INFO][5304] cni-plugin/dataplane_linux.go 508: Disabling IPv4 forwarding ContainerID="47a9894ecc9464c929448804989c328dd075cf62c02172f933e15758d5521851" Namespace="calico-system" Pod="goldmane-666569f655-nrkfh" WorkloadEndpoint="ip--172--31--30--14-k8s-goldmane--666569f655--nrkfh-eth0" Oct 28 04:41:10.027277 containerd[1890]: 2025-10-28 04:41:09.965 [INFO][5304] cni-plugin/k8s.go 446: Added Mac, interface name, and active container ID to endpoint ContainerID="47a9894ecc9464c929448804989c328dd075cf62c02172f933e15758d5521851" Namespace="calico-system" Pod="goldmane-666569f655-nrkfh" WorkloadEndpoint="ip--172--31--30--14-k8s-goldmane--666569f655--nrkfh-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--30--14-k8s-goldmane--666569f655--nrkfh-eth0", GenerateName:"goldmane-666569f655-", Namespace:"calico-system", SelfLink:"", UID:"d588ee10-7ecd-4970-b6a0-1f251568d2c6", ResourceVersion:"886", Generation:0, CreationTimestamp:time.Date(2025, time.October, 28, 4, 40, 36, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app.kubernetes.io/name":"goldmane", "k8s-app":"goldmane", "pod-template-hash":"666569f655", "projectcalico.org/namespace":"calico-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"goldmane"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-30-14", ContainerID:"47a9894ecc9464c929448804989c328dd075cf62c02172f933e15758d5521851", Pod:"goldmane-666569f655-nrkfh", Endpoint:"eth0", ServiceAccountName:"goldmane", IPNetworks:[]string{"192.168.28.8/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-system", "ksa.calico-system.goldmane"}, InterfaceName:"cali47b333711d3", MAC:"96:fd:b9:7b:76:45", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil), QoSControls:(*v3.QoSControls)(nil)}} Oct 28 04:41:10.027277 containerd[1890]: 2025-10-28 04:41:10.014 [INFO][5304] cni-plugin/k8s.go 532: Wrote updated endpoint to datastore ContainerID="47a9894ecc9464c929448804989c328dd075cf62c02172f933e15758d5521851" Namespace="calico-system" Pod="goldmane-666569f655-nrkfh" WorkloadEndpoint="ip--172--31--30--14-k8s-goldmane--666569f655--nrkfh-eth0" Oct 28 04:41:10.101678 containerd[1890]: time="2025-10-28T04:41:10.101589845Z" level=info msg="connecting to shim 47a9894ecc9464c929448804989c328dd075cf62c02172f933e15758d5521851" address="unix:///run/containerd/s/70b388d65b55126e6a0b90975435e9dbeee309618d31965fd9eeea8efdc77172" namespace=k8s.io protocol=ttrpc version=3 Oct 28 04:41:10.224123 systemd[1]: Started cri-containerd-47a9894ecc9464c929448804989c328dd075cf62c02172f933e15758d5521851.scope - libcontainer container 47a9894ecc9464c929448804989c328dd075cf62c02172f933e15758d5521851. Oct 28 04:41:10.387147 containerd[1890]: time="2025-10-28T04:41:10.387073147Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:goldmane-666569f655-nrkfh,Uid:d588ee10-7ecd-4970-b6a0-1f251568d2c6,Namespace:calico-system,Attempt:0,} returns sandbox id \"47a9894ecc9464c929448804989c328dd075cf62c02172f933e15758d5521851\"" Oct 28 04:41:10.393533 containerd[1890]: time="2025-10-28T04:41:10.393352543Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/goldmane:v3.30.4\"" Oct 28 04:41:10.677312 containerd[1890]: time="2025-10-28T04:41:10.677206952Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Oct 28 04:41:10.679612 containerd[1890]: time="2025-10-28T04:41:10.679449092Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/goldmane:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" Oct 28 04:41:10.680018 containerd[1890]: time="2025-10-28T04:41:10.679545668Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/goldmane:v3.30.4: active requests=0, bytes read=77" Oct 28 04:41:10.680477 kubelet[3230]: E1028 04:41:10.680405 3230 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" image="ghcr.io/flatcar/calico/goldmane:v3.30.4" Oct 28 04:41:10.680764 kubelet[3230]: E1028 04:41:10.680628 3230 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" image="ghcr.io/flatcar/calico/goldmane:v3.30.4" Oct 28 04:41:10.681917 kubelet[3230]: E1028 04:41:10.681801 3230 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:goldmane,Image:ghcr.io/flatcar/calico/goldmane:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:INFO,ValueFrom:nil,},EnvVar{Name:PORT,Value:7443,ValueFrom:nil,},EnvVar{Name:SERVER_CERT_PATH,Value:/goldmane-key-pair/tls.crt,ValueFrom:nil,},EnvVar{Name:SERVER_KEY_PATH,Value:/goldmane-key-pair/tls.key,ValueFrom:nil,},EnvVar{Name:CA_CERT_PATH,Value:/etc/pki/tls/certs/tigera-ca-bundle.crt,ValueFrom:nil,},EnvVar{Name:PUSH_URL,Value:https://guardian.calico-system.svc.cluster.local:443/api/v1/flows/bulk,ValueFrom:nil,},EnvVar{Name:FILE_CONFIG_PATH,Value:/config/config.json,ValueFrom:nil,},EnvVar{Name:HEALTH_ENABLED,Value:true,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:config,ReadOnly:true,MountPath:/config,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:goldmane-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:goldmane-key-pair,ReadOnly:true,MountPath:/goldmane-key-pair,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-bxx4t,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/health -live],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/health -ready],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:30,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod goldmane-666569f655-nrkfh_calico-system(d588ee10-7ecd-4970-b6a0-1f251568d2c6): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" logger="UnhandledError" Oct 28 04:41:10.683936 kubelet[3230]: E1028 04:41:10.683845 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"goldmane\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found\"" pod="calico-system/goldmane-666569f655-nrkfh" podUID="d588ee10-7ecd-4970-b6a0-1f251568d2c6" Oct 28 04:41:10.931152 systemd-networkd[1494]: cali91d223938f4: Gained IPv6LL Oct 28 04:41:10.953572 kubelet[3230]: E1028 04:41:10.953450 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"calico-csi\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ghcr.io/flatcar/calico/csi:v3.30.4: not found\", failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found\"]" pod="calico-system/csi-node-driver-jhrzl" podUID="c42b89c4-6ac3-4fdf-90fb-009bd174d781" Oct 28 04:41:10.954303 kubelet[3230]: E1028 04:41:10.953726 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"goldmane\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found\"" pod="calico-system/goldmane-666569f655-nrkfh" podUID="d588ee10-7ecd-4970-b6a0-1f251568d2c6" Oct 28 04:41:11.379025 systemd-networkd[1494]: cali47b333711d3: Gained IPv6LL Oct 28 04:41:11.953076 kubelet[3230]: E1028 04:41:11.952954 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"goldmane\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found\"" pod="calico-system/goldmane-666569f655-nrkfh" podUID="d588ee10-7ecd-4970-b6a0-1f251568d2c6" Oct 28 04:41:13.507150 ntpd[1862]: Listen normally on 6 vxlan.calico 192.168.28.0:123 Oct 28 04:41:13.507238 ntpd[1862]: Listen normally on 7 vxlan.calico [fe80::6453:26ff:fe46:22c9%4]:123 Oct 28 04:41:13.508205 ntpd[1862]: 28 Oct 04:41:13 ntpd[1862]: Listen normally on 6 vxlan.calico 192.168.28.0:123 Oct 28 04:41:13.508205 ntpd[1862]: 28 Oct 04:41:13 ntpd[1862]: Listen normally on 7 vxlan.calico [fe80::6453:26ff:fe46:22c9%4]:123 Oct 28 04:41:13.508205 ntpd[1862]: 28 Oct 04:41:13 ntpd[1862]: Listen normally on 8 calie97baf9272f [fe80::ecee:eeff:feee:eeee%7]:123 Oct 28 04:41:13.508205 ntpd[1862]: 28 Oct 04:41:13 ntpd[1862]: Listen normally on 9 cali3f204eb6750 [fe80::ecee:eeff:feee:eeee%8]:123 Oct 28 04:41:13.508205 ntpd[1862]: 28 Oct 04:41:13 ntpd[1862]: Listen normally on 10 cali0130d0c2382 [fe80::ecee:eeff:feee:eeee%9]:123 Oct 28 04:41:13.508205 ntpd[1862]: 28 Oct 04:41:13 ntpd[1862]: Listen normally on 11 cali365cfea3b86 [fe80::ecee:eeff:feee:eeee%10]:123 Oct 28 04:41:13.508205 ntpd[1862]: 28 Oct 04:41:13 ntpd[1862]: Listen normally on 12 califa13e08f77a [fe80::ecee:eeff:feee:eeee%11]:123 Oct 28 04:41:13.508205 ntpd[1862]: 28 Oct 04:41:13 ntpd[1862]: Listen normally on 13 cali3dfe848c1b2 [fe80::ecee:eeff:feee:eeee%12]:123 Oct 28 04:41:13.508205 ntpd[1862]: 28 Oct 04:41:13 ntpd[1862]: Listen normally on 14 cali91d223938f4 [fe80::ecee:eeff:feee:eeee%13]:123 Oct 28 04:41:13.508205 ntpd[1862]: 28 Oct 04:41:13 ntpd[1862]: Listen normally on 15 cali47b333711d3 [fe80::ecee:eeff:feee:eeee%14]:123 Oct 28 04:41:13.507292 ntpd[1862]: Listen normally on 8 calie97baf9272f [fe80::ecee:eeff:feee:eeee%7]:123 Oct 28 04:41:13.507335 ntpd[1862]: Listen normally on 9 cali3f204eb6750 [fe80::ecee:eeff:feee:eeee%8]:123 Oct 28 04:41:13.507379 ntpd[1862]: Listen normally on 10 cali0130d0c2382 [fe80::ecee:eeff:feee:eeee%9]:123 Oct 28 04:41:13.507422 ntpd[1862]: Listen normally on 11 cali365cfea3b86 [fe80::ecee:eeff:feee:eeee%10]:123 Oct 28 04:41:13.507468 ntpd[1862]: Listen normally on 12 califa13e08f77a [fe80::ecee:eeff:feee:eeee%11]:123 Oct 28 04:41:13.507512 ntpd[1862]: Listen normally on 13 cali3dfe848c1b2 [fe80::ecee:eeff:feee:eeee%12]:123 Oct 28 04:41:13.507556 ntpd[1862]: Listen normally on 14 cali91d223938f4 [fe80::ecee:eeff:feee:eeee%13]:123 Oct 28 04:41:13.507599 ntpd[1862]: Listen normally on 15 cali47b333711d3 [fe80::ecee:eeff:feee:eeee%14]:123 Oct 28 04:41:15.326827 systemd[1]: Started sshd@7-172.31.30.14:22-147.75.109.163:42258.service - OpenSSH per-connection server daemon (147.75.109.163:42258). Oct 28 04:41:15.526497 sshd[5428]: Accepted publickey for core from 147.75.109.163 port 42258 ssh2: RSA SHA256:n8I+mfZFO+vpjscdCCq4ICa9JhGSHCmaRNUJmvrCQJg Oct 28 04:41:15.530263 sshd-session[5428]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Oct 28 04:41:15.539270 systemd-logind[1871]: New session 8 of user core. Oct 28 04:41:15.552919 systemd[1]: Started session-8.scope - Session 8 of User core. Oct 28 04:41:15.801081 sshd[5431]: Connection closed by 147.75.109.163 port 42258 Oct 28 04:41:15.802029 sshd-session[5428]: pam_unix(sshd:session): session closed for user core Oct 28 04:41:15.812226 systemd[1]: sshd@7-172.31.30.14:22-147.75.109.163:42258.service: Deactivated successfully. Oct 28 04:41:15.820035 systemd[1]: session-8.scope: Deactivated successfully. Oct 28 04:41:15.824400 systemd-logind[1871]: Session 8 logged out. Waiting for processes to exit. Oct 28 04:41:15.831793 systemd-logind[1871]: Removed session 8. Oct 28 04:41:18.504483 containerd[1890]: time="2025-10-28T04:41:18.504229179Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/whisker:v3.30.4\"" Oct 28 04:41:18.767230 containerd[1890]: time="2025-10-28T04:41:18.767027308Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Oct 28 04:41:18.769344 containerd[1890]: time="2025-10-28T04:41:18.769240420Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/whisker:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" Oct 28 04:41:18.769344 containerd[1890]: time="2025-10-28T04:41:18.769308172Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/whisker:v3.30.4: active requests=0, bytes read=73" Oct 28 04:41:18.769698 kubelet[3230]: E1028 04:41:18.769522 3230 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker:v3.30.4" Oct 28 04:41:18.769698 kubelet[3230]: E1028 04:41:18.769586 3230 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker:v3.30.4" Oct 28 04:41:18.770955 kubelet[3230]: E1028 04:41:18.770837 3230 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:whisker,Image:ghcr.io/flatcar/calico/whisker:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:INFO,ValueFrom:nil,},EnvVar{Name:CALICO_VERSION,Value:v3.30.4,ValueFrom:nil,},EnvVar{Name:CLUSTER_ID,Value:18ad39fbb4894dc69b7e845ad319a0ff,ValueFrom:nil,},EnvVar{Name:CLUSTER_TYPE,Value:typha,kdd,k8s,operator,bgp,kubeadm,ValueFrom:nil,},EnvVar{Name:NOTIFICATIONS,Value:Enabled,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-c96rb,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod whisker-845cdb6746-r6n8l_calico-system(e49e398f-1e35-4733-8a07-8164b21c4248): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" logger="UnhandledError" Oct 28 04:41:18.774703 containerd[1890]: time="2025-10-28T04:41:18.774586096Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\"" Oct 28 04:41:19.106010 containerd[1890]: time="2025-10-28T04:41:19.105926042Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Oct 28 04:41:19.108218 containerd[1890]: time="2025-10-28T04:41:19.108160730Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" Oct 28 04:41:19.108497 containerd[1890]: time="2025-10-28T04:41:19.108278390Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/whisker-backend:v3.30.4: active requests=0, bytes read=85" Oct 28 04:41:19.108772 kubelet[3230]: E1028 04:41:19.108623 3230 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker-backend:v3.30.4" Oct 28 04:41:19.108772 kubelet[3230]: E1028 04:41:19.108726 3230 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker-backend:v3.30.4" Oct 28 04:41:19.109284 kubelet[3230]: E1028 04:41:19.109148 3230 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:whisker-backend,Image:ghcr.io/flatcar/calico/whisker-backend:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:INFO,ValueFrom:nil,},EnvVar{Name:PORT,Value:3002,ValueFrom:nil,},EnvVar{Name:GOLDMANE_HOST,Value:goldmane.calico-system.svc.cluster.local:7443,ValueFrom:nil,},EnvVar{Name:TLS_CERT_PATH,Value:/whisker-backend-key-pair/tls.crt,ValueFrom:nil,},EnvVar{Name:TLS_KEY_PATH,Value:/whisker-backend-key-pair/tls.key,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:whisker-backend-key-pair,ReadOnly:true,MountPath:/whisker-backend-key-pair,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:whisker-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-c96rb,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod whisker-845cdb6746-r6n8l_calico-system(e49e398f-1e35-4733-8a07-8164b21c4248): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" logger="UnhandledError" Oct 28 04:41:19.111047 kubelet[3230]: E1028 04:41:19.110871 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"whisker\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found\", failed to \"StartContainer\" for \"whisker-backend\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found\"]" pod="calico-system/whisker-845cdb6746-r6n8l" podUID="e49e398f-1e35-4733-8a07-8164b21c4248" Oct 28 04:41:19.497964 containerd[1890]: time="2025-10-28T04:41:19.496807408Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\"" Oct 28 04:41:19.764451 containerd[1890]: time="2025-10-28T04:41:19.764320889Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Oct 28 04:41:19.767436 containerd[1890]: time="2025-10-28T04:41:19.767071025Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" Oct 28 04:41:19.767436 containerd[1890]: time="2025-10-28T04:41:19.767191661Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/apiserver:v3.30.4: active requests=0, bytes read=77" Oct 28 04:41:19.768019 kubelet[3230]: E1028 04:41:19.767592 3230 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Oct 28 04:41:19.768019 kubelet[3230]: E1028 04:41:19.767800 3230 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Oct 28 04:41:19.768926 kubelet[3230]: E1028 04:41:19.768225 3230 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:calico-apiserver,Image:ghcr.io/flatcar/calico/apiserver:v3.30.4,Command:[],Args:[--secure-port=5443 --tls-private-key-file=/calico-apiserver-certs/tls.key --tls-cert-file=/calico-apiserver-certs/tls.crt],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:LOG_LEVEL,Value:info,ValueFrom:nil,},EnvVar{Name:MULTI_INTERFACE_MODE,Value:none,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:calico-apiserver-certs,ReadOnly:true,MountPath:/calico-apiserver-certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-275zr,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 5443 },Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-apiserver-844c8ff9ff-822zr_calico-apiserver(4bc14ee4-24b8-46c1-8183-4ae1905b78dd): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" logger="UnhandledError" Oct 28 04:41:19.769775 kubelet[3230]: E1028 04:41:19.769718 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-844c8ff9ff-822zr" podUID="4bc14ee4-24b8-46c1-8183-4ae1905b78dd" Oct 28 04:41:20.841700 systemd[1]: Started sshd@8-172.31.30.14:22-147.75.109.163:58786.service - OpenSSH per-connection server daemon (147.75.109.163:58786). Oct 28 04:41:21.030340 sshd[5449]: Accepted publickey for core from 147.75.109.163 port 58786 ssh2: RSA SHA256:n8I+mfZFO+vpjscdCCq4ICa9JhGSHCmaRNUJmvrCQJg Oct 28 04:41:21.032952 sshd-session[5449]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Oct 28 04:41:21.042780 systemd-logind[1871]: New session 9 of user core. Oct 28 04:41:21.046992 systemd[1]: Started session-9.scope - Session 9 of User core. Oct 28 04:41:21.234711 sshd[5452]: Connection closed by 147.75.109.163 port 58786 Oct 28 04:41:21.235535 sshd-session[5449]: pam_unix(sshd:session): session closed for user core Oct 28 04:41:21.244120 systemd[1]: sshd@8-172.31.30.14:22-147.75.109.163:58786.service: Deactivated successfully. Oct 28 04:41:21.249388 systemd[1]: session-9.scope: Deactivated successfully. Oct 28 04:41:21.251525 systemd-logind[1871]: Session 9 logged out. Waiting for processes to exit. Oct 28 04:41:21.255076 systemd-logind[1871]: Removed session 9. Oct 28 04:41:21.495607 containerd[1890]: time="2025-10-28T04:41:21.494979330Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\"" Oct 28 04:41:21.747821 containerd[1890]: time="2025-10-28T04:41:21.747404407Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Oct 28 04:41:21.749720 containerd[1890]: time="2025-10-28T04:41:21.749588971Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" Oct 28 04:41:21.749720 containerd[1890]: time="2025-10-28T04:41:21.749681191Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/kube-controllers:v3.30.4: active requests=0, bytes read=85" Oct 28 04:41:21.750158 kubelet[3230]: E1028 04:41:21.750079 3230 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" image="ghcr.io/flatcar/calico/kube-controllers:v3.30.4" Oct 28 04:41:21.750647 kubelet[3230]: E1028 04:41:21.750157 3230 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" image="ghcr.io/flatcar/calico/kube-controllers:v3.30.4" Oct 28 04:41:21.751082 kubelet[3230]: E1028 04:41:21.750924 3230 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:calico-kube-controllers,Image:ghcr.io/flatcar/calico/kube-controllers:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:KUBE_CONTROLLERS_CONFIG_NAME,Value:default,ValueFrom:nil,},EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:ENABLED_CONTROLLERS,Value:node,loadbalancer,ValueFrom:nil,},EnvVar{Name:DISABLE_KUBE_CONTROLLERS_CONFIG_API,Value:false,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:CA_CRT_PATH,Value:/etc/pki/tls/certs/tigera-ca-bundle.crt,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:tigera-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:tigera-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/cert.pem,SubPath:ca-bundle.crt,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-rhj7p,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/usr/bin/check-status -l],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:10,TimeoutSeconds:10,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:6,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/usr/bin/check-status -r],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:10,PeriodSeconds:30,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*999,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-kube-controllers-56b4fb96c7-rtxd5_calico-system(54edc01d-f226-4f67-826d-011b168afccb): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" logger="UnhandledError" Oct 28 04:41:21.752447 kubelet[3230]: E1028 04:41:21.752218 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-kube-controllers\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found\"" pod="calico-system/calico-kube-controllers-56b4fb96c7-rtxd5" podUID="54edc01d-f226-4f67-826d-011b168afccb" Oct 28 04:41:24.495190 containerd[1890]: time="2025-10-28T04:41:24.493753965Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/goldmane:v3.30.4\"" Oct 28 04:41:24.749720 containerd[1890]: time="2025-10-28T04:41:24.749537854Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Oct 28 04:41:24.752378 containerd[1890]: time="2025-10-28T04:41:24.752214562Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/goldmane:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" Oct 28 04:41:24.752378 containerd[1890]: time="2025-10-28T04:41:24.752331778Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/goldmane:v3.30.4: active requests=0, bytes read=77" Oct 28 04:41:24.753930 kubelet[3230]: E1028 04:41:24.752837 3230 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" image="ghcr.io/flatcar/calico/goldmane:v3.30.4" Oct 28 04:41:24.753930 kubelet[3230]: E1028 04:41:24.752909 3230 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" image="ghcr.io/flatcar/calico/goldmane:v3.30.4" Oct 28 04:41:24.753930 kubelet[3230]: E1028 04:41:24.753198 3230 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:goldmane,Image:ghcr.io/flatcar/calico/goldmane:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:INFO,ValueFrom:nil,},EnvVar{Name:PORT,Value:7443,ValueFrom:nil,},EnvVar{Name:SERVER_CERT_PATH,Value:/goldmane-key-pair/tls.crt,ValueFrom:nil,},EnvVar{Name:SERVER_KEY_PATH,Value:/goldmane-key-pair/tls.key,ValueFrom:nil,},EnvVar{Name:CA_CERT_PATH,Value:/etc/pki/tls/certs/tigera-ca-bundle.crt,ValueFrom:nil,},EnvVar{Name:PUSH_URL,Value:https://guardian.calico-system.svc.cluster.local:443/api/v1/flows/bulk,ValueFrom:nil,},EnvVar{Name:FILE_CONFIG_PATH,Value:/config/config.json,ValueFrom:nil,},EnvVar{Name:HEALTH_ENABLED,Value:true,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:config,ReadOnly:true,MountPath:/config,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:goldmane-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:goldmane-key-pair,ReadOnly:true,MountPath:/goldmane-key-pair,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-bxx4t,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/health -live],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/health -ready],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:30,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod goldmane-666569f655-nrkfh_calico-system(d588ee10-7ecd-4970-b6a0-1f251568d2c6): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" logger="UnhandledError" Oct 28 04:41:24.755940 kubelet[3230]: E1028 04:41:24.754939 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"goldmane\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found\"" pod="calico-system/goldmane-666569f655-nrkfh" podUID="d588ee10-7ecd-4970-b6a0-1f251568d2c6" Oct 28 04:41:24.756132 containerd[1890]: time="2025-10-28T04:41:24.755050546Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\"" Oct 28 04:41:25.036071 containerd[1890]: time="2025-10-28T04:41:25.035425903Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Oct 28 04:41:25.037787 containerd[1890]: time="2025-10-28T04:41:25.037707595Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" Oct 28 04:41:25.037787 containerd[1890]: time="2025-10-28T04:41:25.037743823Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/apiserver:v3.30.4: active requests=0, bytes read=77" Oct 28 04:41:25.038938 kubelet[3230]: E1028 04:41:25.038796 3230 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Oct 28 04:41:25.038938 kubelet[3230]: E1028 04:41:25.038862 3230 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Oct 28 04:41:25.039340 kubelet[3230]: E1028 04:41:25.039262 3230 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:calico-apiserver,Image:ghcr.io/flatcar/calico/apiserver:v3.30.4,Command:[],Args:[--secure-port=5443 --tls-private-key-file=/calico-apiserver-certs/tls.key --tls-cert-file=/calico-apiserver-certs/tls.crt],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:LOG_LEVEL,Value:info,ValueFrom:nil,},EnvVar{Name:MULTI_INTERFACE_MODE,Value:none,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:calico-apiserver-certs,ReadOnly:true,MountPath:/calico-apiserver-certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-rp64h,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 5443 },Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-apiserver-844c8ff9ff-trlfg_calico-apiserver(964233f5-181d-4a9e-b75e-ce5914393292): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" logger="UnhandledError" Oct 28 04:41:25.041649 kubelet[3230]: E1028 04:41:25.041573 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-844c8ff9ff-trlfg" podUID="964233f5-181d-4a9e-b75e-ce5914393292" Oct 28 04:41:25.495876 containerd[1890]: time="2025-10-28T04:41:25.495375646Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/csi:v3.30.4\"" Oct 28 04:41:25.779611 containerd[1890]: time="2025-10-28T04:41:25.779397959Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Oct 28 04:41:25.781881 containerd[1890]: time="2025-10-28T04:41:25.781606031Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/csi:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" Oct 28 04:41:25.781881 containerd[1890]: time="2025-10-28T04:41:25.781757003Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/csi:v3.30.4: active requests=0, bytes read=69" Oct 28 04:41:25.782084 kubelet[3230]: E1028 04:41:25.782019 3230 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" image="ghcr.io/flatcar/calico/csi:v3.30.4" Oct 28 04:41:25.782541 kubelet[3230]: E1028 04:41:25.782085 3230 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" image="ghcr.io/flatcar/calico/csi:v3.30.4" Oct 28 04:41:25.782541 kubelet[3230]: E1028 04:41:25.782253 3230 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:calico-csi,Image:ghcr.io/flatcar/calico/csi:v3.30.4,Command:[],Args:[--nodeid=$(KUBE_NODE_NAME) --loglevel=$(LOG_LEVEL)],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:warn,ValueFrom:nil,},EnvVar{Name:KUBE_NODE_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:spec.nodeName,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kubelet-dir,ReadOnly:false,MountPath:/var/lib/kubelet,SubPath:,MountPropagation:*Bidirectional,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:socket-dir,ReadOnly:false,MountPath:/csi,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:varrun,ReadOnly:false,MountPath:/var/run,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-qfrjk,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*true,SELinuxOptions:nil,RunAsUser:*0,RunAsNonRoot:*false,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*true,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod csi-node-driver-jhrzl_calico-system(c42b89c4-6ac3-4fdf-90fb-009bd174d781): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" logger="UnhandledError" Oct 28 04:41:25.785492 containerd[1890]: time="2025-10-28T04:41:25.785394071Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\"" Oct 28 04:41:26.222683 containerd[1890]: time="2025-10-28T04:41:26.222602541Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Oct 28 04:41:26.224785 containerd[1890]: time="2025-10-28T04:41:26.224721789Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" Oct 28 04:41:26.224878 containerd[1890]: time="2025-10-28T04:41:26.224846325Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: active requests=0, bytes read=93" Oct 28 04:41:26.225228 kubelet[3230]: E1028 04:41:26.225165 3230 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" image="ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4" Oct 28 04:41:26.225372 kubelet[3230]: E1028 04:41:26.225242 3230 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" image="ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4" Oct 28 04:41:26.225562 kubelet[3230]: E1028 04:41:26.225433 3230 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:csi-node-driver-registrar,Image:ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4,Command:[],Args:[--v=5 --csi-address=$(ADDRESS) --kubelet-registration-path=$(DRIVER_REG_SOCK_PATH)],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:ADDRESS,Value:/csi/csi.sock,ValueFrom:nil,},EnvVar{Name:DRIVER_REG_SOCK_PATH,Value:/var/lib/kubelet/plugins/csi.tigera.io/csi.sock,ValueFrom:nil,},EnvVar{Name:KUBE_NODE_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:spec.nodeName,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:registration-dir,ReadOnly:false,MountPath:/registration,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:socket-dir,ReadOnly:false,MountPath:/csi,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-qfrjk,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*true,SELinuxOptions:nil,RunAsUser:*0,RunAsNonRoot:*false,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*true,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod csi-node-driver-jhrzl_calico-system(c42b89c4-6ac3-4fdf-90fb-009bd174d781): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" logger="UnhandledError" Oct 28 04:41:26.226879 kubelet[3230]: E1028 04:41:26.226800 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"calico-csi\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ghcr.io/flatcar/calico/csi:v3.30.4: not found\", failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found\"]" pod="calico-system/csi-node-driver-jhrzl" podUID="c42b89c4-6ac3-4fdf-90fb-009bd174d781" Oct 28 04:41:26.272730 systemd[1]: Started sshd@9-172.31.30.14:22-147.75.109.163:58802.service - OpenSSH per-connection server daemon (147.75.109.163:58802). Oct 28 04:41:26.455816 sshd[5470]: Accepted publickey for core from 147.75.109.163 port 58802 ssh2: RSA SHA256:n8I+mfZFO+vpjscdCCq4ICa9JhGSHCmaRNUJmvrCQJg Oct 28 04:41:26.458000 sshd-session[5470]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Oct 28 04:41:26.466268 systemd-logind[1871]: New session 10 of user core. Oct 28 04:41:26.471953 systemd[1]: Started session-10.scope - Session 10 of User core. Oct 28 04:41:26.673003 sshd[5473]: Connection closed by 147.75.109.163 port 58802 Oct 28 04:41:26.673977 sshd-session[5470]: pam_unix(sshd:session): session closed for user core Oct 28 04:41:26.681180 systemd[1]: sshd@9-172.31.30.14:22-147.75.109.163:58802.service: Deactivated successfully. Oct 28 04:41:26.681410 systemd-logind[1871]: Session 10 logged out. Waiting for processes to exit. Oct 28 04:41:26.686610 systemd[1]: session-10.scope: Deactivated successfully. Oct 28 04:41:26.692583 systemd-logind[1871]: Removed session 10. Oct 28 04:41:26.709088 systemd[1]: Started sshd@10-172.31.30.14:22-147.75.109.163:58812.service - OpenSSH per-connection server daemon (147.75.109.163:58812). Oct 28 04:41:26.904758 sshd[5486]: Accepted publickey for core from 147.75.109.163 port 58812 ssh2: RSA SHA256:n8I+mfZFO+vpjscdCCq4ICa9JhGSHCmaRNUJmvrCQJg Oct 28 04:41:26.907684 sshd-session[5486]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Oct 28 04:41:26.919057 systemd-logind[1871]: New session 11 of user core. Oct 28 04:41:26.926953 systemd[1]: Started session-11.scope - Session 11 of User core. Oct 28 04:41:27.220280 sshd[5489]: Connection closed by 147.75.109.163 port 58812 Oct 28 04:41:27.223204 sshd-session[5486]: pam_unix(sshd:session): session closed for user core Oct 28 04:41:27.235096 systemd[1]: sshd@10-172.31.30.14:22-147.75.109.163:58812.service: Deactivated successfully. Oct 28 04:41:27.243959 systemd[1]: session-11.scope: Deactivated successfully. Oct 28 04:41:27.249112 systemd-logind[1871]: Session 11 logged out. Waiting for processes to exit. Oct 28 04:41:27.278916 systemd[1]: Started sshd@11-172.31.30.14:22-147.75.109.163:58826.service - OpenSSH per-connection server daemon (147.75.109.163:58826). Oct 28 04:41:27.283881 systemd-logind[1871]: Removed session 11. Oct 28 04:41:27.480928 sshd[5511]: Accepted publickey for core from 147.75.109.163 port 58826 ssh2: RSA SHA256:n8I+mfZFO+vpjscdCCq4ICa9JhGSHCmaRNUJmvrCQJg Oct 28 04:41:27.483768 sshd-session[5511]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Oct 28 04:41:27.492747 systemd-logind[1871]: New session 12 of user core. Oct 28 04:41:27.501962 systemd[1]: Started session-12.scope - Session 12 of User core. Oct 28 04:41:27.694690 sshd[5514]: Connection closed by 147.75.109.163 port 58826 Oct 28 04:41:27.693575 sshd-session[5511]: pam_unix(sshd:session): session closed for user core Oct 28 04:41:27.701377 systemd[1]: sshd@11-172.31.30.14:22-147.75.109.163:58826.service: Deactivated successfully. Oct 28 04:41:27.706771 systemd[1]: session-12.scope: Deactivated successfully. Oct 28 04:41:27.710428 systemd-logind[1871]: Session 12 logged out. Waiting for processes to exit. Oct 28 04:41:27.712817 systemd-logind[1871]: Removed session 12. Oct 28 04:41:30.499753 kubelet[3230]: E1028 04:41:30.499359 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"whisker\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found\", failed to \"StartContainer\" for \"whisker-backend\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found\"]" pod="calico-system/whisker-845cdb6746-r6n8l" podUID="e49e398f-1e35-4733-8a07-8164b21c4248" Oct 28 04:41:32.055400 containerd[1890]: time="2025-10-28T04:41:32.055325510Z" level=info msg="TaskExit event in podsandbox handler container_id:\"15253a81462f5b0de8163beea82dd39695c0442c9740421204367d6d3be15501\" id:\"5190c377478696a4d47abd90bf71df7147fa4e221a5f800b3073e3b3b26fda74\" pid:5543 exited_at:{seconds:1761626492 nanos:54408998}" Oct 28 04:41:32.733179 systemd[1]: Started sshd@12-172.31.30.14:22-147.75.109.163:44386.service - OpenSSH per-connection server daemon (147.75.109.163:44386). Oct 28 04:41:32.925598 sshd[5555]: Accepted publickey for core from 147.75.109.163 port 44386 ssh2: RSA SHA256:n8I+mfZFO+vpjscdCCq4ICa9JhGSHCmaRNUJmvrCQJg Oct 28 04:41:32.930099 sshd-session[5555]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Oct 28 04:41:32.943344 systemd-logind[1871]: New session 13 of user core. Oct 28 04:41:32.950944 systemd[1]: Started session-13.scope - Session 13 of User core. Oct 28 04:41:33.179184 sshd[5561]: Connection closed by 147.75.109.163 port 44386 Oct 28 04:41:33.180104 sshd-session[5555]: pam_unix(sshd:session): session closed for user core Oct 28 04:41:33.189017 systemd[1]: sshd@12-172.31.30.14:22-147.75.109.163:44386.service: Deactivated successfully. Oct 28 04:41:33.193335 systemd[1]: session-13.scope: Deactivated successfully. Oct 28 04:41:33.195494 systemd-logind[1871]: Session 13 logged out. Waiting for processes to exit. Oct 28 04:41:33.198698 systemd-logind[1871]: Removed session 13. Oct 28 04:41:34.497813 kubelet[3230]: E1028 04:41:34.497260 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-kube-controllers\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found\"" pod="calico-system/calico-kube-controllers-56b4fb96c7-rtxd5" podUID="54edc01d-f226-4f67-826d-011b168afccb" Oct 28 04:41:34.501740 kubelet[3230]: E1028 04:41:34.498995 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-844c8ff9ff-822zr" podUID="4bc14ee4-24b8-46c1-8183-4ae1905b78dd" Oct 28 04:41:37.495858 kubelet[3230]: E1028 04:41:37.495776 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"calico-csi\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ghcr.io/flatcar/calico/csi:v3.30.4: not found\", failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found\"]" pod="calico-system/csi-node-driver-jhrzl" podUID="c42b89c4-6ac3-4fdf-90fb-009bd174d781" Oct 28 04:41:38.219148 systemd[1]: Started sshd@13-172.31.30.14:22-147.75.109.163:44398.service - OpenSSH per-connection server daemon (147.75.109.163:44398). Oct 28 04:41:38.428679 sshd[5578]: Accepted publickey for core from 147.75.109.163 port 44398 ssh2: RSA SHA256:n8I+mfZFO+vpjscdCCq4ICa9JhGSHCmaRNUJmvrCQJg Oct 28 04:41:38.435986 sshd-session[5578]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Oct 28 04:41:38.453796 systemd-logind[1871]: New session 14 of user core. Oct 28 04:41:38.459256 systemd[1]: Started session-14.scope - Session 14 of User core. Oct 28 04:41:38.500049 kubelet[3230]: E1028 04:41:38.499177 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"goldmane\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found\"" pod="calico-system/goldmane-666569f655-nrkfh" podUID="d588ee10-7ecd-4970-b6a0-1f251568d2c6" Oct 28 04:41:38.675737 sshd[5581]: Connection closed by 147.75.109.163 port 44398 Oct 28 04:41:38.676316 sshd-session[5578]: pam_unix(sshd:session): session closed for user core Oct 28 04:41:38.687497 systemd[1]: sshd@13-172.31.30.14:22-147.75.109.163:44398.service: Deactivated successfully. Oct 28 04:41:38.694582 systemd[1]: session-14.scope: Deactivated successfully. Oct 28 04:41:38.698623 systemd-logind[1871]: Session 14 logged out. Waiting for processes to exit. Oct 28 04:41:38.702015 systemd-logind[1871]: Removed session 14. Oct 28 04:41:40.495197 kubelet[3230]: E1028 04:41:40.495045 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-844c8ff9ff-trlfg" podUID="964233f5-181d-4a9e-b75e-ce5914393292" Oct 28 04:41:43.716178 systemd[1]: Started sshd@14-172.31.30.14:22-147.75.109.163:47976.service - OpenSSH per-connection server daemon (147.75.109.163:47976). Oct 28 04:41:43.911849 sshd[5595]: Accepted publickey for core from 147.75.109.163 port 47976 ssh2: RSA SHA256:n8I+mfZFO+vpjscdCCq4ICa9JhGSHCmaRNUJmvrCQJg Oct 28 04:41:43.915072 sshd-session[5595]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Oct 28 04:41:43.927412 systemd-logind[1871]: New session 15 of user core. Oct 28 04:41:43.934985 systemd[1]: Started session-15.scope - Session 15 of User core. Oct 28 04:41:44.241233 sshd[5598]: Connection closed by 147.75.109.163 port 47976 Oct 28 04:41:44.244486 sshd-session[5595]: pam_unix(sshd:session): session closed for user core Oct 28 04:41:44.255746 systemd[1]: sshd@14-172.31.30.14:22-147.75.109.163:47976.service: Deactivated successfully. Oct 28 04:41:44.263894 systemd[1]: session-15.scope: Deactivated successfully. Oct 28 04:41:44.266830 systemd-logind[1871]: Session 15 logged out. Waiting for processes to exit. Oct 28 04:41:44.270478 systemd-logind[1871]: Removed session 15. Oct 28 04:41:44.498876 containerd[1890]: time="2025-10-28T04:41:44.497338024Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/whisker:v3.30.4\"" Oct 28 04:41:44.749371 containerd[1890]: time="2025-10-28T04:41:44.748876589Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Oct 28 04:41:44.751130 containerd[1890]: time="2025-10-28T04:41:44.751064345Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/whisker:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" Oct 28 04:41:44.751262 containerd[1890]: time="2025-10-28T04:41:44.751187045Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/whisker:v3.30.4: active requests=0, bytes read=73" Oct 28 04:41:44.751683 kubelet[3230]: E1028 04:41:44.751514 3230 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker:v3.30.4" Oct 28 04:41:44.751683 kubelet[3230]: E1028 04:41:44.751584 3230 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker:v3.30.4" Oct 28 04:41:44.752822 kubelet[3230]: E1028 04:41:44.752578 3230 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:whisker,Image:ghcr.io/flatcar/calico/whisker:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:INFO,ValueFrom:nil,},EnvVar{Name:CALICO_VERSION,Value:v3.30.4,ValueFrom:nil,},EnvVar{Name:CLUSTER_ID,Value:18ad39fbb4894dc69b7e845ad319a0ff,ValueFrom:nil,},EnvVar{Name:CLUSTER_TYPE,Value:typha,kdd,k8s,operator,bgp,kubeadm,ValueFrom:nil,},EnvVar{Name:NOTIFICATIONS,Value:Enabled,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-c96rb,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod whisker-845cdb6746-r6n8l_calico-system(e49e398f-1e35-4733-8a07-8164b21c4248): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker:v3.30.4\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found" logger="UnhandledError" Oct 28 04:41:44.756240 containerd[1890]: time="2025-10-28T04:41:44.756187157Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\"" Oct 28 04:41:45.041460 containerd[1890]: time="2025-10-28T04:41:45.041175639Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Oct 28 04:41:45.043600 containerd[1890]: time="2025-10-28T04:41:45.043442307Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" Oct 28 04:41:45.043600 containerd[1890]: time="2025-10-28T04:41:45.043502343Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/whisker-backend:v3.30.4: active requests=0, bytes read=85" Oct 28 04:41:45.043904 kubelet[3230]: E1028 04:41:45.043816 3230 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker-backend:v3.30.4" Oct 28 04:41:45.044826 kubelet[3230]: E1028 04:41:45.043919 3230 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" image="ghcr.io/flatcar/calico/whisker-backend:v3.30.4" Oct 28 04:41:45.044826 kubelet[3230]: E1028 04:41:45.044200 3230 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:whisker-backend,Image:ghcr.io/flatcar/calico/whisker-backend:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:INFO,ValueFrom:nil,},EnvVar{Name:PORT,Value:3002,ValueFrom:nil,},EnvVar{Name:GOLDMANE_HOST,Value:goldmane.calico-system.svc.cluster.local:7443,ValueFrom:nil,},EnvVar{Name:TLS_CERT_PATH,Value:/whisker-backend-key-pair/tls.crt,ValueFrom:nil,},EnvVar{Name:TLS_KEY_PATH,Value:/whisker-backend-key-pair/tls.key,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:whisker-backend-key-pair,ReadOnly:true,MountPath:/whisker-backend-key-pair,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:whisker-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-c96rb,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod whisker-845cdb6746-r6n8l_calico-system(e49e398f-1e35-4733-8a07-8164b21c4248): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found" logger="UnhandledError" Oct 28 04:41:45.045958 kubelet[3230]: E1028 04:41:45.045872 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"whisker\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found\", failed to \"StartContainer\" for \"whisker-backend\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found\"]" pod="calico-system/whisker-845cdb6746-r6n8l" podUID="e49e398f-1e35-4733-8a07-8164b21c4248" Oct 28 04:41:47.496562 containerd[1890]: time="2025-10-28T04:41:47.496446583Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\"" Oct 28 04:41:47.792141 containerd[1890]: time="2025-10-28T04:41:47.792073136Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Oct 28 04:41:47.794237 containerd[1890]: time="2025-10-28T04:41:47.794161508Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" Oct 28 04:41:47.794357 containerd[1890]: time="2025-10-28T04:41:47.794273432Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/kube-controllers:v3.30.4: active requests=0, bytes read=85" Oct 28 04:41:47.794748 kubelet[3230]: E1028 04:41:47.794650 3230 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" image="ghcr.io/flatcar/calico/kube-controllers:v3.30.4" Oct 28 04:41:47.795902 kubelet[3230]: E1028 04:41:47.794753 3230 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" image="ghcr.io/flatcar/calico/kube-controllers:v3.30.4" Oct 28 04:41:47.796017 containerd[1890]: time="2025-10-28T04:41:47.795151832Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\"" Oct 28 04:41:47.796083 kubelet[3230]: E1028 04:41:47.795786 3230 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:calico-kube-controllers,Image:ghcr.io/flatcar/calico/kube-controllers:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:KUBE_CONTROLLERS_CONFIG_NAME,Value:default,ValueFrom:nil,},EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:ENABLED_CONTROLLERS,Value:node,loadbalancer,ValueFrom:nil,},EnvVar{Name:DISABLE_KUBE_CONTROLLERS_CONFIG_API,Value:false,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:CA_CRT_PATH,Value:/etc/pki/tls/certs/tigera-ca-bundle.crt,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:tigera-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:tigera-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/cert.pem,SubPath:ca-bundle.crt,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-rhj7p,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/usr/bin/check-status -l],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:10,TimeoutSeconds:10,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:6,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/usr/bin/check-status -r],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:10,PeriodSeconds:30,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*999,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-kube-controllers-56b4fb96c7-rtxd5_calico-system(54edc01d-f226-4f67-826d-011b168afccb): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found" logger="UnhandledError" Oct 28 04:41:47.797982 kubelet[3230]: E1028 04:41:47.797861 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-kube-controllers\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found\"" pod="calico-system/calico-kube-controllers-56b4fb96c7-rtxd5" podUID="54edc01d-f226-4f67-826d-011b168afccb" Oct 28 04:41:48.080704 containerd[1890]: time="2025-10-28T04:41:48.080513622Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Oct 28 04:41:48.083240 containerd[1890]: time="2025-10-28T04:41:48.083174034Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" Oct 28 04:41:48.083368 containerd[1890]: time="2025-10-28T04:41:48.083251974Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/apiserver:v3.30.4: active requests=0, bytes read=77" Oct 28 04:41:48.083730 kubelet[3230]: E1028 04:41:48.083626 3230 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Oct 28 04:41:48.083884 kubelet[3230]: E1028 04:41:48.083743 3230 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Oct 28 04:41:48.085465 kubelet[3230]: E1028 04:41:48.084174 3230 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:calico-apiserver,Image:ghcr.io/flatcar/calico/apiserver:v3.30.4,Command:[],Args:[--secure-port=5443 --tls-private-key-file=/calico-apiserver-certs/tls.key --tls-cert-file=/calico-apiserver-certs/tls.crt],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:LOG_LEVEL,Value:info,ValueFrom:nil,},EnvVar{Name:MULTI_INTERFACE_MODE,Value:none,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:calico-apiserver-certs,ReadOnly:true,MountPath:/calico-apiserver-certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-275zr,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 5443 },Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-apiserver-844c8ff9ff-822zr_calico-apiserver(4bc14ee4-24b8-46c1-8183-4ae1905b78dd): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" logger="UnhandledError" Oct 28 04:41:48.085795 kubelet[3230]: E1028 04:41:48.085443 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-844c8ff9ff-822zr" podUID="4bc14ee4-24b8-46c1-8183-4ae1905b78dd" Oct 28 04:41:48.496142 containerd[1890]: time="2025-10-28T04:41:48.495358508Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/csi:v3.30.4\"" Oct 28 04:41:48.833189 containerd[1890]: time="2025-10-28T04:41:48.832973278Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Oct 28 04:41:48.836031 containerd[1890]: time="2025-10-28T04:41:48.835848802Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/csi:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" Oct 28 04:41:48.836031 containerd[1890]: time="2025-10-28T04:41:48.835864102Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/csi:v3.30.4: active requests=0, bytes read=69" Oct 28 04:41:48.836735 kubelet[3230]: E1028 04:41:48.836358 3230 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" image="ghcr.io/flatcar/calico/csi:v3.30.4" Oct 28 04:41:48.836735 kubelet[3230]: E1028 04:41:48.836428 3230 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" image="ghcr.io/flatcar/calico/csi:v3.30.4" Oct 28 04:41:48.837712 kubelet[3230]: E1028 04:41:48.836625 3230 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:calico-csi,Image:ghcr.io/flatcar/calico/csi:v3.30.4,Command:[],Args:[--nodeid=$(KUBE_NODE_NAME) --loglevel=$(LOG_LEVEL)],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:warn,ValueFrom:nil,},EnvVar{Name:KUBE_NODE_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:spec.nodeName,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kubelet-dir,ReadOnly:false,MountPath:/var/lib/kubelet,SubPath:,MountPropagation:*Bidirectional,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:socket-dir,ReadOnly:false,MountPath:/csi,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:varrun,ReadOnly:false,MountPath:/var/run,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-qfrjk,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*true,SELinuxOptions:nil,RunAsUser:*0,RunAsNonRoot:*false,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*true,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod csi-node-driver-jhrzl_calico-system(c42b89c4-6ac3-4fdf-90fb-009bd174d781): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/csi:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/csi:v3.30.4\": ghcr.io/flatcar/calico/csi:v3.30.4: not found" logger="UnhandledError" Oct 28 04:41:48.840871 containerd[1890]: time="2025-10-28T04:41:48.840776086Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\"" Oct 28 04:41:49.121542 containerd[1890]: time="2025-10-28T04:41:49.121337875Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Oct 28 04:41:49.123649 containerd[1890]: time="2025-10-28T04:41:49.123576319Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" Oct 28 04:41:49.123985 containerd[1890]: time="2025-10-28T04:41:49.123600091Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: active requests=0, bytes read=93" Oct 28 04:41:49.124051 kubelet[3230]: E1028 04:41:49.123998 3230 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" image="ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4" Oct 28 04:41:49.124163 kubelet[3230]: E1028 04:41:49.124059 3230 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" image="ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4" Oct 28 04:41:49.125110 kubelet[3230]: E1028 04:41:49.124240 3230 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:csi-node-driver-registrar,Image:ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4,Command:[],Args:[--v=5 --csi-address=$(ADDRESS) --kubelet-registration-path=$(DRIVER_REG_SOCK_PATH)],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:ADDRESS,Value:/csi/csi.sock,ValueFrom:nil,},EnvVar{Name:DRIVER_REG_SOCK_PATH,Value:/var/lib/kubelet/plugins/csi.tigera.io/csi.sock,ValueFrom:nil,},EnvVar{Name:KUBE_NODE_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:spec.nodeName,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:registration-dir,ReadOnly:false,MountPath:/registration,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:socket-dir,ReadOnly:false,MountPath:/csi,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-qfrjk,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*true,SELinuxOptions:nil,RunAsUser:*0,RunAsNonRoot:*false,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*true,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod csi-node-driver-jhrzl_calico-system(c42b89c4-6ac3-4fdf-90fb-009bd174d781): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found" logger="UnhandledError" Oct 28 04:41:49.125630 kubelet[3230]: E1028 04:41:49.125515 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"calico-csi\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ghcr.io/flatcar/calico/csi:v3.30.4: not found\", failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found\"]" pod="calico-system/csi-node-driver-jhrzl" podUID="c42b89c4-6ac3-4fdf-90fb-009bd174d781" Oct 28 04:41:49.282090 systemd[1]: Started sshd@15-172.31.30.14:22-147.75.109.163:47984.service - OpenSSH per-connection server daemon (147.75.109.163:47984). Oct 28 04:41:49.470548 sshd[5618]: Accepted publickey for core from 147.75.109.163 port 47984 ssh2: RSA SHA256:n8I+mfZFO+vpjscdCCq4ICa9JhGSHCmaRNUJmvrCQJg Oct 28 04:41:49.474126 sshd-session[5618]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Oct 28 04:41:49.486850 systemd-logind[1871]: New session 16 of user core. Oct 28 04:41:49.492960 systemd[1]: Started session-16.scope - Session 16 of User core. Oct 28 04:41:49.726590 sshd[5621]: Connection closed by 147.75.109.163 port 47984 Oct 28 04:41:49.728190 sshd-session[5618]: pam_unix(sshd:session): session closed for user core Oct 28 04:41:49.735569 systemd-logind[1871]: Session 16 logged out. Waiting for processes to exit. Oct 28 04:41:49.736098 systemd[1]: sshd@15-172.31.30.14:22-147.75.109.163:47984.service: Deactivated successfully. Oct 28 04:41:49.741207 systemd[1]: session-16.scope: Deactivated successfully. Oct 28 04:41:49.746282 systemd-logind[1871]: Removed session 16. Oct 28 04:41:50.495841 containerd[1890]: time="2025-10-28T04:41:50.495771226Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/goldmane:v3.30.4\"" Oct 28 04:41:50.746144 containerd[1890]: time="2025-10-28T04:41:50.745996619Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Oct 28 04:41:50.748988 containerd[1890]: time="2025-10-28T04:41:50.748850843Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/goldmane:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" Oct 28 04:41:50.748988 containerd[1890]: time="2025-10-28T04:41:50.748934315Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/goldmane:v3.30.4: active requests=0, bytes read=77" Oct 28 04:41:50.749179 kubelet[3230]: E1028 04:41:50.749128 3230 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" image="ghcr.io/flatcar/calico/goldmane:v3.30.4" Oct 28 04:41:50.749744 kubelet[3230]: E1028 04:41:50.749191 3230 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" image="ghcr.io/flatcar/calico/goldmane:v3.30.4" Oct 28 04:41:50.749744 kubelet[3230]: E1028 04:41:50.749406 3230 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:goldmane,Image:ghcr.io/flatcar/calico/goldmane:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:INFO,ValueFrom:nil,},EnvVar{Name:PORT,Value:7443,ValueFrom:nil,},EnvVar{Name:SERVER_CERT_PATH,Value:/goldmane-key-pair/tls.crt,ValueFrom:nil,},EnvVar{Name:SERVER_KEY_PATH,Value:/goldmane-key-pair/tls.key,ValueFrom:nil,},EnvVar{Name:CA_CERT_PATH,Value:/etc/pki/tls/certs/tigera-ca-bundle.crt,ValueFrom:nil,},EnvVar{Name:PUSH_URL,Value:https://guardian.calico-system.svc.cluster.local:443/api/v1/flows/bulk,ValueFrom:nil,},EnvVar{Name:FILE_CONFIG_PATH,Value:/config/config.json,ValueFrom:nil,},EnvVar{Name:HEALTH_ENABLED,Value:true,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:config,ReadOnly:true,MountPath:/config,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:goldmane-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:goldmane-key-pair,ReadOnly:true,MountPath:/goldmane-key-pair,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-bxx4t,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/health -live],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/health -ready],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:30,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod goldmane-666569f655-nrkfh_calico-system(d588ee10-7ecd-4970-b6a0-1f251568d2c6): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" logger="UnhandledError" Oct 28 04:41:50.751389 kubelet[3230]: E1028 04:41:50.751305 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"goldmane\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found\"" pod="calico-system/goldmane-666569f655-nrkfh" podUID="d588ee10-7ecd-4970-b6a0-1f251568d2c6" Oct 28 04:41:52.496547 containerd[1890]: time="2025-10-28T04:41:52.496409964Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\"" Oct 28 04:41:52.784753 containerd[1890]: time="2025-10-28T04:41:52.784564321Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Oct 28 04:41:52.787117 containerd[1890]: time="2025-10-28T04:41:52.787025293Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" Oct 28 04:41:52.787303 containerd[1890]: time="2025-10-28T04:41:52.787072717Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/apiserver:v3.30.4: active requests=0, bytes read=77" Oct 28 04:41:52.787533 kubelet[3230]: E1028 04:41:52.787452 3230 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Oct 28 04:41:52.788108 kubelet[3230]: E1028 04:41:52.787546 3230 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Oct 28 04:41:52.788108 kubelet[3230]: E1028 04:41:52.787945 3230 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:calico-apiserver,Image:ghcr.io/flatcar/calico/apiserver:v3.30.4,Command:[],Args:[--secure-port=5443 --tls-private-key-file=/calico-apiserver-certs/tls.key --tls-cert-file=/calico-apiserver-certs/tls.crt],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:LOG_LEVEL,Value:info,ValueFrom:nil,},EnvVar{Name:MULTI_INTERFACE_MODE,Value:none,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:calico-apiserver-certs,ReadOnly:true,MountPath:/calico-apiserver-certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-rp64h,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 5443 },Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-apiserver-844c8ff9ff-trlfg_calico-apiserver(964233f5-181d-4a9e-b75e-ce5914393292): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" logger="UnhandledError" Oct 28 04:41:52.789436 kubelet[3230]: E1028 04:41:52.789268 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-844c8ff9ff-trlfg" podUID="964233f5-181d-4a9e-b75e-ce5914393292" Oct 28 04:41:54.766513 systemd[1]: Started sshd@16-172.31.30.14:22-147.75.109.163:48256.service - OpenSSH per-connection server daemon (147.75.109.163:48256). Oct 28 04:41:54.952096 sshd[5635]: Accepted publickey for core from 147.75.109.163 port 48256 ssh2: RSA SHA256:n8I+mfZFO+vpjscdCCq4ICa9JhGSHCmaRNUJmvrCQJg Oct 28 04:41:54.955399 sshd-session[5635]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Oct 28 04:41:54.965973 systemd-logind[1871]: New session 17 of user core. Oct 28 04:41:54.973928 systemd[1]: Started session-17.scope - Session 17 of User core. Oct 28 04:41:55.167985 sshd[5638]: Connection closed by 147.75.109.163 port 48256 Oct 28 04:41:55.167827 sshd-session[5635]: pam_unix(sshd:session): session closed for user core Oct 28 04:41:55.174508 systemd-logind[1871]: Session 17 logged out. Waiting for processes to exit. Oct 28 04:41:55.174959 systemd[1]: sshd@16-172.31.30.14:22-147.75.109.163:48256.service: Deactivated successfully. Oct 28 04:41:55.181367 systemd[1]: session-17.scope: Deactivated successfully. Oct 28 04:41:55.187421 systemd-logind[1871]: Removed session 17. Oct 28 04:41:55.206185 systemd[1]: Started sshd@17-172.31.30.14:22-147.75.109.163:48270.service - OpenSSH per-connection server daemon (147.75.109.163:48270). Oct 28 04:41:55.384115 sshd[5650]: Accepted publickey for core from 147.75.109.163 port 48270 ssh2: RSA SHA256:n8I+mfZFO+vpjscdCCq4ICa9JhGSHCmaRNUJmvrCQJg Oct 28 04:41:55.386626 sshd-session[5650]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Oct 28 04:41:55.395474 systemd-logind[1871]: New session 18 of user core. Oct 28 04:41:55.403989 systemd[1]: Started session-18.scope - Session 18 of User core. Oct 28 04:41:56.577717 sshd[5653]: Connection closed by 147.75.109.163 port 48270 Oct 28 04:41:56.578949 sshd-session[5650]: pam_unix(sshd:session): session closed for user core Oct 28 04:41:56.586645 systemd[1]: sshd@17-172.31.30.14:22-147.75.109.163:48270.service: Deactivated successfully. Oct 28 04:41:56.590969 systemd[1]: session-18.scope: Deactivated successfully. Oct 28 04:41:56.592687 systemd-logind[1871]: Session 18 logged out. Waiting for processes to exit. Oct 28 04:41:56.596298 systemd-logind[1871]: Removed session 18. Oct 28 04:41:56.627122 systemd[1]: Started sshd@18-172.31.30.14:22-147.75.109.163:48282.service - OpenSSH per-connection server daemon (147.75.109.163:48282). Oct 28 04:41:56.823105 sshd[5663]: Accepted publickey for core from 147.75.109.163 port 48282 ssh2: RSA SHA256:n8I+mfZFO+vpjscdCCq4ICa9JhGSHCmaRNUJmvrCQJg Oct 28 04:41:56.825689 sshd-session[5663]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Oct 28 04:41:56.834126 systemd-logind[1871]: New session 19 of user core. Oct 28 04:41:56.838966 systemd[1]: Started session-19.scope - Session 19 of User core. Oct 28 04:41:57.503682 kubelet[3230]: E1028 04:41:57.500333 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"whisker\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found\", failed to \"StartContainer\" for \"whisker-backend\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found\"]" pod="calico-system/whisker-845cdb6746-r6n8l" podUID="e49e398f-1e35-4733-8a07-8164b21c4248" Oct 28 04:41:57.933768 sshd[5666]: Connection closed by 147.75.109.163 port 48282 Oct 28 04:41:57.934315 sshd-session[5663]: pam_unix(sshd:session): session closed for user core Oct 28 04:41:57.945367 systemd[1]: sshd@18-172.31.30.14:22-147.75.109.163:48282.service: Deactivated successfully. Oct 28 04:41:57.956627 systemd[1]: session-19.scope: Deactivated successfully. Oct 28 04:41:57.961254 systemd-logind[1871]: Session 19 logged out. Waiting for processes to exit. Oct 28 04:41:57.993151 systemd[1]: Started sshd@19-172.31.30.14:22-147.75.109.163:48296.service - OpenSSH per-connection server daemon (147.75.109.163:48296). Oct 28 04:41:57.998479 systemd-logind[1871]: Removed session 19. Oct 28 04:41:58.191393 sshd[5682]: Accepted publickey for core from 147.75.109.163 port 48296 ssh2: RSA SHA256:n8I+mfZFO+vpjscdCCq4ICa9JhGSHCmaRNUJmvrCQJg Oct 28 04:41:58.194778 sshd-session[5682]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Oct 28 04:41:58.203829 systemd-logind[1871]: New session 20 of user core. Oct 28 04:41:58.212005 systemd[1]: Started session-20.scope - Session 20 of User core. Oct 28 04:41:58.722924 sshd[5686]: Connection closed by 147.75.109.163 port 48296 Oct 28 04:41:58.724225 sshd-session[5682]: pam_unix(sshd:session): session closed for user core Oct 28 04:41:58.736042 systemd[1]: sshd@19-172.31.30.14:22-147.75.109.163:48296.service: Deactivated successfully. Oct 28 04:41:58.743057 systemd[1]: session-20.scope: Deactivated successfully. Oct 28 04:41:58.747133 systemd-logind[1871]: Session 20 logged out. Waiting for processes to exit. Oct 28 04:41:58.771944 systemd[1]: Started sshd@20-172.31.30.14:22-147.75.109.163:48312.service - OpenSSH per-connection server daemon (147.75.109.163:48312). Oct 28 04:41:58.779104 systemd-logind[1871]: Removed session 20. Oct 28 04:41:58.962675 sshd[5698]: Accepted publickey for core from 147.75.109.163 port 48312 ssh2: RSA SHA256:n8I+mfZFO+vpjscdCCq4ICa9JhGSHCmaRNUJmvrCQJg Oct 28 04:41:58.965159 sshd-session[5698]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Oct 28 04:41:58.973904 systemd-logind[1871]: New session 21 of user core. Oct 28 04:41:58.980919 systemd[1]: Started session-21.scope - Session 21 of User core. Oct 28 04:41:59.166969 sshd[5701]: Connection closed by 147.75.109.163 port 48312 Oct 28 04:41:59.167910 sshd-session[5698]: pam_unix(sshd:session): session closed for user core Oct 28 04:41:59.175515 systemd-logind[1871]: Session 21 logged out. Waiting for processes to exit. Oct 28 04:41:59.177367 systemd[1]: sshd@20-172.31.30.14:22-147.75.109.163:48312.service: Deactivated successfully. Oct 28 04:41:59.184024 systemd[1]: session-21.scope: Deactivated successfully. Oct 28 04:41:59.187536 systemd-logind[1871]: Removed session 21. Oct 28 04:41:59.496919 kubelet[3230]: E1028 04:41:59.496750 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-kube-controllers\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found\"" pod="calico-system/calico-kube-controllers-56b4fb96c7-rtxd5" podUID="54edc01d-f226-4f67-826d-011b168afccb" Oct 28 04:42:00.499751 kubelet[3230]: E1028 04:42:00.499526 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"calico-csi\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ghcr.io/flatcar/calico/csi:v3.30.4: not found\", failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found\"]" pod="calico-system/csi-node-driver-jhrzl" podUID="c42b89c4-6ac3-4fdf-90fb-009bd174d781" Oct 28 04:42:02.079127 containerd[1890]: time="2025-10-28T04:42:02.078966811Z" level=info msg="TaskExit event in podsandbox handler container_id:\"15253a81462f5b0de8163beea82dd39695c0442c9740421204367d6d3be15501\" id:\"3cd63a3ad04d3d35fa57b2db4e9eb58bb5e1ffd7ce409868fa9eba7188523a3e\" pid:5725 exited_at:{seconds:1761626522 nanos:78482155}" Oct 28 04:42:02.503222 kubelet[3230]: E1028 04:42:02.503055 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-844c8ff9ff-822zr" podUID="4bc14ee4-24b8-46c1-8183-4ae1905b78dd" Oct 28 04:42:04.208719 systemd[1]: Started sshd@21-172.31.30.14:22-147.75.109.163:53824.service - OpenSSH per-connection server daemon (147.75.109.163:53824). Oct 28 04:42:04.412761 sshd[5739]: Accepted publickey for core from 147.75.109.163 port 53824 ssh2: RSA SHA256:n8I+mfZFO+vpjscdCCq4ICa9JhGSHCmaRNUJmvrCQJg Oct 28 04:42:04.416069 sshd-session[5739]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Oct 28 04:42:04.432162 systemd-logind[1871]: New session 22 of user core. Oct 28 04:42:04.438969 systemd[1]: Started session-22.scope - Session 22 of User core. Oct 28 04:42:04.713888 sshd[5742]: Connection closed by 147.75.109.163 port 53824 Oct 28 04:42:04.714438 sshd-session[5739]: pam_unix(sshd:session): session closed for user core Oct 28 04:42:04.726991 systemd[1]: sshd@21-172.31.30.14:22-147.75.109.163:53824.service: Deactivated successfully. Oct 28 04:42:04.734029 systemd[1]: session-22.scope: Deactivated successfully. Oct 28 04:42:04.741646 systemd-logind[1871]: Session 22 logged out. Waiting for processes to exit. Oct 28 04:42:04.744004 systemd-logind[1871]: Removed session 22. Oct 28 04:42:05.494752 kubelet[3230]: E1028 04:42:05.494334 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"goldmane\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found\"" pod="calico-system/goldmane-666569f655-nrkfh" podUID="d588ee10-7ecd-4970-b6a0-1f251568d2c6" Oct 28 04:42:05.494752 kubelet[3230]: E1028 04:42:05.494441 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-844c8ff9ff-trlfg" podUID="964233f5-181d-4a9e-b75e-ce5914393292" Oct 28 04:42:09.761506 systemd[1]: Started sshd@22-172.31.30.14:22-147.75.109.163:53836.service - OpenSSH per-connection server daemon (147.75.109.163:53836). Oct 28 04:42:10.003248 sshd[5761]: Accepted publickey for core from 147.75.109.163 port 53836 ssh2: RSA SHA256:n8I+mfZFO+vpjscdCCq4ICa9JhGSHCmaRNUJmvrCQJg Oct 28 04:42:10.006970 sshd-session[5761]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Oct 28 04:42:10.021790 systemd-logind[1871]: New session 23 of user core. Oct 28 04:42:10.029129 systemd[1]: Started session-23.scope - Session 23 of User core. Oct 28 04:42:10.286887 sshd[5764]: Connection closed by 147.75.109.163 port 53836 Oct 28 04:42:10.287896 sshd-session[5761]: pam_unix(sshd:session): session closed for user core Oct 28 04:42:10.296326 systemd[1]: sshd@22-172.31.30.14:22-147.75.109.163:53836.service: Deactivated successfully. Oct 28 04:42:10.303784 systemd[1]: session-23.scope: Deactivated successfully. Oct 28 04:42:10.309544 systemd-logind[1871]: Session 23 logged out. Waiting for processes to exit. Oct 28 04:42:10.313763 systemd-logind[1871]: Removed session 23. Oct 28 04:42:11.494839 kubelet[3230]: E1028 04:42:11.494425 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-kube-controllers\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found\"" pod="calico-system/calico-kube-controllers-56b4fb96c7-rtxd5" podUID="54edc01d-f226-4f67-826d-011b168afccb" Oct 28 04:42:11.496998 kubelet[3230]: E1028 04:42:11.496897 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"whisker\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found\", failed to \"StartContainer\" for \"whisker-backend\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found\"]" pod="calico-system/whisker-845cdb6746-r6n8l" podUID="e49e398f-1e35-4733-8a07-8164b21c4248" Oct 28 04:42:12.500686 kubelet[3230]: E1028 04:42:12.500336 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"calico-csi\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ghcr.io/flatcar/calico/csi:v3.30.4: not found\", failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found\"]" pod="calico-system/csi-node-driver-jhrzl" podUID="c42b89c4-6ac3-4fdf-90fb-009bd174d781" Oct 28 04:42:15.327298 systemd[1]: Started sshd@23-172.31.30.14:22-147.75.109.163:47210.service - OpenSSH per-connection server daemon (147.75.109.163:47210). Oct 28 04:42:15.528421 sshd[5778]: Accepted publickey for core from 147.75.109.163 port 47210 ssh2: RSA SHA256:n8I+mfZFO+vpjscdCCq4ICa9JhGSHCmaRNUJmvrCQJg Oct 28 04:42:15.531877 sshd-session[5778]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Oct 28 04:42:15.548404 systemd-logind[1871]: New session 24 of user core. Oct 28 04:42:15.555505 systemd[1]: Started session-24.scope - Session 24 of User core. Oct 28 04:42:15.815019 sshd[5781]: Connection closed by 147.75.109.163 port 47210 Oct 28 04:42:15.817688 sshd-session[5778]: pam_unix(sshd:session): session closed for user core Oct 28 04:42:15.829972 systemd[1]: sshd@23-172.31.30.14:22-147.75.109.163:47210.service: Deactivated successfully. Oct 28 04:42:15.837306 systemd[1]: session-24.scope: Deactivated successfully. Oct 28 04:42:15.842802 systemd-logind[1871]: Session 24 logged out. Waiting for processes to exit. Oct 28 04:42:15.848783 systemd-logind[1871]: Removed session 24. Oct 28 04:42:16.496619 kubelet[3230]: E1028 04:42:16.496540 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-844c8ff9ff-822zr" podUID="4bc14ee4-24b8-46c1-8183-4ae1905b78dd" Oct 28 04:42:19.494606 kubelet[3230]: E1028 04:42:19.494428 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"goldmane\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found\"" pod="calico-system/goldmane-666569f655-nrkfh" podUID="d588ee10-7ecd-4970-b6a0-1f251568d2c6" Oct 28 04:42:20.496996 kubelet[3230]: E1028 04:42:20.496934 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-844c8ff9ff-trlfg" podUID="964233f5-181d-4a9e-b75e-ce5914393292" Oct 28 04:42:20.861060 systemd[1]: Started sshd@24-172.31.30.14:22-147.75.109.163:60810.service - OpenSSH per-connection server daemon (147.75.109.163:60810). Oct 28 04:42:21.077153 sshd[5793]: Accepted publickey for core from 147.75.109.163 port 60810 ssh2: RSA SHA256:n8I+mfZFO+vpjscdCCq4ICa9JhGSHCmaRNUJmvrCQJg Oct 28 04:42:21.080416 sshd-session[5793]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Oct 28 04:42:21.089736 systemd-logind[1871]: New session 25 of user core. Oct 28 04:42:21.097380 systemd[1]: Started session-25.scope - Session 25 of User core. Oct 28 04:42:21.368720 sshd[5796]: Connection closed by 147.75.109.163 port 60810 Oct 28 04:42:21.393531 sshd-session[5793]: pam_unix(sshd:session): session closed for user core Oct 28 04:42:21.405006 systemd[1]: sshd@24-172.31.30.14:22-147.75.109.163:60810.service: Deactivated successfully. Oct 28 04:42:21.412634 systemd[1]: session-25.scope: Deactivated successfully. Oct 28 04:42:21.418182 systemd-logind[1871]: Session 25 logged out. Waiting for processes to exit. Oct 28 04:42:21.422744 systemd-logind[1871]: Removed session 25. Oct 28 04:42:23.494771 kubelet[3230]: E1028 04:42:23.494508 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-kube-controllers\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/kube-controllers:v3.30.4\\\": ghcr.io/flatcar/calico/kube-controllers:v3.30.4: not found\"" pod="calico-system/calico-kube-controllers-56b4fb96c7-rtxd5" podUID="54edc01d-f226-4f67-826d-011b168afccb" Oct 28 04:42:24.499329 kubelet[3230]: E1028 04:42:24.499193 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"whisker\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker:v3.30.4\\\": ghcr.io/flatcar/calico/whisker:v3.30.4: not found\", failed to \"StartContainer\" for \"whisker-backend\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/whisker-backend:v3.30.4\\\": ghcr.io/flatcar/calico/whisker-backend:v3.30.4: not found\"]" pod="calico-system/whisker-845cdb6746-r6n8l" podUID="e49e398f-1e35-4733-8a07-8164b21c4248" Oct 28 04:42:26.414145 systemd[1]: Started sshd@25-172.31.30.14:22-147.75.109.163:60826.service - OpenSSH per-connection server daemon (147.75.109.163:60826). Oct 28 04:42:26.618609 sshd[5814]: Accepted publickey for core from 147.75.109.163 port 60826 ssh2: RSA SHA256:n8I+mfZFO+vpjscdCCq4ICa9JhGSHCmaRNUJmvrCQJg Oct 28 04:42:26.621949 sshd-session[5814]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Oct 28 04:42:26.633803 systemd-logind[1871]: New session 26 of user core. Oct 28 04:42:26.642252 systemd[1]: Started session-26.scope - Session 26 of User core. Oct 28 04:42:26.866711 sshd[5817]: Connection closed by 147.75.109.163 port 60826 Oct 28 04:42:26.867967 sshd-session[5814]: pam_unix(sshd:session): session closed for user core Oct 28 04:42:26.883302 systemd[1]: sshd@25-172.31.30.14:22-147.75.109.163:60826.service: Deactivated successfully. Oct 28 04:42:26.890798 systemd[1]: session-26.scope: Deactivated successfully. Oct 28 04:42:26.893333 systemd-logind[1871]: Session 26 logged out. Waiting for processes to exit. Oct 28 04:42:26.898618 systemd-logind[1871]: Removed session 26. Oct 28 04:42:27.497061 kubelet[3230]: E1028 04:42:27.496958 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"calico-csi\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/csi:v3.30.4\\\": ghcr.io/flatcar/calico/csi:v3.30.4: not found\", failed to \"StartContainer\" for \"csi-node-driver-registrar\" with ImagePullBackOff: \"Back-off pulling image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4\\\": ghcr.io/flatcar/calico/node-driver-registrar:v3.30.4: not found\"]" pod="calico-system/csi-node-driver-jhrzl" podUID="c42b89c4-6ac3-4fdf-90fb-009bd174d781" Oct 28 04:42:30.496469 containerd[1890]: time="2025-10-28T04:42:30.495513901Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\"" Oct 28 04:42:30.762501 containerd[1890]: time="2025-10-28T04:42:30.762325358Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Oct 28 04:42:30.764882 containerd[1890]: time="2025-10-28T04:42:30.764808482Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" Oct 28 04:42:30.765051 containerd[1890]: time="2025-10-28T04:42:30.764944586Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/apiserver:v3.30.4: active requests=0, bytes read=77" Oct 28 04:42:30.765351 kubelet[3230]: E1028 04:42:30.765286 3230 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Oct 28 04:42:30.765878 kubelet[3230]: E1028 04:42:30.765364 3230 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Oct 28 04:42:30.765878 kubelet[3230]: E1028 04:42:30.765575 3230 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:calico-apiserver,Image:ghcr.io/flatcar/calico/apiserver:v3.30.4,Command:[],Args:[--secure-port=5443 --tls-private-key-file=/calico-apiserver-certs/tls.key --tls-cert-file=/calico-apiserver-certs/tls.crt],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:LOG_LEVEL,Value:info,ValueFrom:nil,},EnvVar{Name:MULTI_INTERFACE_MODE,Value:none,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:calico-apiserver-certs,ReadOnly:true,MountPath:/calico-apiserver-certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-275zr,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 5443 },Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-apiserver-844c8ff9ff-822zr_calico-apiserver(4bc14ee4-24b8-46c1-8183-4ae1905b78dd): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" logger="UnhandledError" Oct 28 04:42:30.767439 kubelet[3230]: E1028 04:42:30.767356 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-844c8ff9ff-822zr" podUID="4bc14ee4-24b8-46c1-8183-4ae1905b78dd" Oct 28 04:42:31.913333 systemd[1]: Started sshd@26-172.31.30.14:22-147.75.109.163:59716.service - OpenSSH per-connection server daemon (147.75.109.163:59716). Oct 28 04:42:32.118083 sshd[5852]: Accepted publickey for core from 147.75.109.163 port 59716 ssh2: RSA SHA256:n8I+mfZFO+vpjscdCCq4ICa9JhGSHCmaRNUJmvrCQJg Oct 28 04:42:32.121594 sshd-session[5852]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Oct 28 04:42:32.134332 systemd-logind[1871]: New session 27 of user core. Oct 28 04:42:32.147956 systemd[1]: Started session-27.scope - Session 27 of User core. Oct 28 04:42:32.193948 containerd[1890]: time="2025-10-28T04:42:32.193786621Z" level=info msg="TaskExit event in podsandbox handler container_id:\"15253a81462f5b0de8163beea82dd39695c0442c9740421204367d6d3be15501\" id:\"cd949171015faa40da7fa3d4747e04a5fbf4dc5689e0f383abb8b8c36ae3011d\" pid:5846 exited_at:{seconds:1761626552 nanos:190880437}" Oct 28 04:42:32.401318 sshd[5865]: Connection closed by 147.75.109.163 port 59716 Oct 28 04:42:32.401829 sshd-session[5852]: pam_unix(sshd:session): session closed for user core Oct 28 04:42:32.412575 systemd-logind[1871]: Session 27 logged out. Waiting for processes to exit. Oct 28 04:42:32.415202 systemd[1]: sshd@26-172.31.30.14:22-147.75.109.163:59716.service: Deactivated successfully. Oct 28 04:42:32.425761 systemd[1]: session-27.scope: Deactivated successfully. Oct 28 04:42:32.437501 systemd-logind[1871]: Removed session 27. Oct 28 04:42:33.494831 containerd[1890]: time="2025-10-28T04:42:33.494762583Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/goldmane:v3.30.4\"" Oct 28 04:42:33.778168 containerd[1890]: time="2025-10-28T04:42:33.777984017Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Oct 28 04:42:33.781116 containerd[1890]: time="2025-10-28T04:42:33.780935789Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/goldmane:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" Oct 28 04:42:33.781116 containerd[1890]: time="2025-10-28T04:42:33.780974009Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/goldmane:v3.30.4: active requests=0, bytes read=77" Oct 28 04:42:33.782244 kubelet[3230]: E1028 04:42:33.781830 3230 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" image="ghcr.io/flatcar/calico/goldmane:v3.30.4" Oct 28 04:42:33.784349 kubelet[3230]: E1028 04:42:33.782148 3230 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" image="ghcr.io/flatcar/calico/goldmane:v3.30.4" Oct 28 04:42:33.785860 kubelet[3230]: E1028 04:42:33.784965 3230 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:goldmane,Image:ghcr.io/flatcar/calico/goldmane:v3.30.4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOG_LEVEL,Value:INFO,ValueFrom:nil,},EnvVar{Name:PORT,Value:7443,ValueFrom:nil,},EnvVar{Name:SERVER_CERT_PATH,Value:/goldmane-key-pair/tls.crt,ValueFrom:nil,},EnvVar{Name:SERVER_KEY_PATH,Value:/goldmane-key-pair/tls.key,ValueFrom:nil,},EnvVar{Name:CA_CERT_PATH,Value:/etc/pki/tls/certs/tigera-ca-bundle.crt,ValueFrom:nil,},EnvVar{Name:PUSH_URL,Value:https://guardian.calico-system.svc.cluster.local:443/api/v1/flows/bulk,ValueFrom:nil,},EnvVar{Name:FILE_CONFIG_PATH,Value:/config/config.json,ValueFrom:nil,},EnvVar{Name:HEALTH_ENABLED,Value:true,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:config,ReadOnly:true,MountPath:/config,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:goldmane-ca-bundle,ReadOnly:true,MountPath:/etc/pki/tls/certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:goldmane-key-pair,ReadOnly:true,MountPath:/goldmane-key-pair,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-bxx4t,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/health -live],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:&ExecAction{Command:[/health -ready],},HTTPGet:nil,TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:30,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod goldmane-666569f655-nrkfh_calico-system(d588ee10-7ecd-4970-b6a0-1f251568d2c6): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/goldmane:v3.30.4\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found" logger="UnhandledError" Oct 28 04:42:33.787157 kubelet[3230]: E1028 04:42:33.787066 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"goldmane\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/goldmane:v3.30.4\\\": ghcr.io/flatcar/calico/goldmane:v3.30.4: not found\"" pod="calico-system/goldmane-666569f655-nrkfh" podUID="d588ee10-7ecd-4970-b6a0-1f251568d2c6" Oct 28 04:42:34.498304 containerd[1890]: time="2025-10-28T04:42:34.498240136Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\"" Oct 28 04:42:34.777858 containerd[1890]: time="2025-10-28T04:42:34.777628842Z" level=info msg="fetch failed after status: 404 Not Found" host=ghcr.io Oct 28 04:42:34.780327 containerd[1890]: time="2025-10-28T04:42:34.780135282Z" level=error msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.30.4\" failed" error="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" Oct 28 04:42:34.780327 containerd[1890]: time="2025-10-28T04:42:34.780182694Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/apiserver:v3.30.4: active requests=0, bytes read=77" Oct 28 04:42:34.781945 kubelet[3230]: E1028 04:42:34.781860 3230 log.go:32] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Oct 28 04:42:34.782300 kubelet[3230]: E1028 04:42:34.781940 3230 kuberuntime_image.go:42] "Failed to pull image" err="rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" image="ghcr.io/flatcar/calico/apiserver:v3.30.4" Oct 28 04:42:34.782300 kubelet[3230]: E1028 04:42:34.782192 3230 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:calico-apiserver,Image:ghcr.io/flatcar/calico/apiserver:v3.30.4,Command:[],Args:[--secure-port=5443 --tls-private-key-file=/calico-apiserver-certs/tls.key --tls-cert-file=/calico-apiserver-certs/tls.crt],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:DATASTORE_TYPE,Value:kubernetes,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:10.96.0.1,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:443,ValueFrom:nil,},EnvVar{Name:LOG_LEVEL,Value:info,ValueFrom:nil,},EnvVar{Name:MULTI_INTERFACE_MODE,Value:none,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:calico-apiserver-certs,ReadOnly:true,MountPath:/calico-apiserver-certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-rp64h,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 5443 },Host:,Scheme:HTTPS,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:0,TimeoutSeconds:5,PeriodSeconds:60,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:*false,SELinuxOptions:nil,RunAsUser:*10001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:*10001,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod calico-apiserver-844c8ff9ff-trlfg_calico-apiserver(964233f5-181d-4a9e-b75e-ce5914393292): ErrImagePull: rpc error: code = NotFound desc = failed to pull and unpack image \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": failed to resolve reference \"ghcr.io/flatcar/calico/apiserver:v3.30.4\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found" logger="UnhandledError" Oct 28 04:42:34.783770 kubelet[3230]: E1028 04:42:34.783434 3230 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"calico-apiserver\" with ErrImagePull: \"rpc error: code = NotFound desc = failed to pull and unpack image \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": failed to resolve reference \\\"ghcr.io/flatcar/calico/apiserver:v3.30.4\\\": ghcr.io/flatcar/calico/apiserver:v3.30.4: not found\"" pod="calico-apiserver/calico-apiserver-844c8ff9ff-trlfg" podUID="964233f5-181d-4a9e-b75e-ce5914393292"