Jan 13 20:07:29.170925 kernel: Booting Linux on physical CPU 0x0000000000 [0x410fd083] Jan 13 20:07:29.170969 kernel: Linux version 6.6.71-flatcar (build@pony-truck.infra.kinvolk.io) (aarch64-cros-linux-gnu-gcc (Gentoo Hardened 14.2.1_p20241116 p3) 14.2.1 20241116, GNU ld (Gentoo 2.42 p6) 2.42.0) #1 SMP PREEMPT Mon Jan 13 18:56:28 -00 2025 Jan 13 20:07:29.170995 kernel: KASLR disabled due to lack of seed Jan 13 20:07:29.171011 kernel: efi: EFI v2.7 by EDK II Jan 13 20:07:29.171028 kernel: efi: SMBIOS=0x7bed0000 SMBIOS 3.0=0x7beb0000 ACPI=0x786e0000 ACPI 2.0=0x786e0014 MEMATTR=0x7a736a98 MEMRESERVE=0x78557598 Jan 13 20:07:29.171043 kernel: secureboot: Secure boot disabled Jan 13 20:07:29.171061 kernel: ACPI: Early table checksum verification disabled Jan 13 20:07:29.171077 kernel: ACPI: RSDP 0x00000000786E0014 000024 (v02 AMAZON) Jan 13 20:07:29.171093 kernel: ACPI: XSDT 0x00000000786D00E8 000064 (v01 AMAZON AMZNFACP 00000001 01000013) Jan 13 20:07:29.171109 kernel: ACPI: FACP 0x00000000786B0000 000114 (v06 AMAZON AMZNFACP 00000001 AMZN 00000001) Jan 13 20:07:29.171165 kernel: ACPI: DSDT 0x0000000078640000 00159D (v02 AMAZON AMZNDSDT 00000001 INTL 20160527) Jan 13 20:07:29.171182 kernel: ACPI: APIC 0x00000000786C0000 000108 (v04 AMAZON AMZNAPIC 00000001 AMZN 00000001) Jan 13 20:07:29.171199 kernel: ACPI: SPCR 0x00000000786A0000 000050 (v02 AMAZON AMZNSPCR 00000001 AMZN 00000001) Jan 13 20:07:29.171215 kernel: ACPI: GTDT 0x0000000078690000 000060 (v02 AMAZON AMZNGTDT 00000001 AMZN 00000001) Jan 13 20:07:29.171234 kernel: ACPI: MCFG 0x0000000078680000 00003C (v02 AMAZON AMZNMCFG 00000001 AMZN 00000001) Jan 13 20:07:29.171266 kernel: ACPI: SLIT 0x0000000078670000 00002D (v01 AMAZON AMZNSLIT 00000001 AMZN 00000001) Jan 13 20:07:29.171287 kernel: ACPI: IORT 0x0000000078660000 000078 (v01 AMAZON AMZNIORT 00000001 AMZN 00000001) Jan 13 20:07:29.171305 kernel: ACPI: PPTT 0x0000000078650000 0000EC (v01 AMAZON AMZNPPTT 00000001 AMZN 00000001) Jan 13 20:07:29.171321 kernel: ACPI: SPCR: console: uart,mmio,0x90a0000,115200 Jan 13 20:07:29.171338 kernel: earlycon: uart0 at MMIO 0x00000000090a0000 (options '115200') Jan 13 20:07:29.171355 kernel: printk: bootconsole [uart0] enabled Jan 13 20:07:29.171371 kernel: NUMA: Failed to initialise from firmware Jan 13 20:07:29.171388 kernel: NUMA: Faking a node at [mem 0x0000000040000000-0x00000004b5ffffff] Jan 13 20:07:29.171406 kernel: NUMA: NODE_DATA [mem 0x4b583f800-0x4b5844fff] Jan 13 20:07:29.171422 kernel: Zone ranges: Jan 13 20:07:29.171439 kernel: DMA [mem 0x0000000040000000-0x00000000ffffffff] Jan 13 20:07:29.171461 kernel: DMA32 empty Jan 13 20:07:29.171478 kernel: Normal [mem 0x0000000100000000-0x00000004b5ffffff] Jan 13 20:07:29.171495 kernel: Movable zone start for each node Jan 13 20:07:29.171511 kernel: Early memory node ranges Jan 13 20:07:29.171528 kernel: node 0: [mem 0x0000000040000000-0x000000007862ffff] Jan 13 20:07:29.171544 kernel: node 0: [mem 0x0000000078630000-0x000000007863ffff] Jan 13 20:07:29.171561 kernel: node 0: [mem 0x0000000078640000-0x00000000786effff] Jan 13 20:07:29.171577 kernel: node 0: [mem 0x00000000786f0000-0x000000007872ffff] Jan 13 20:07:29.171594 kernel: node 0: [mem 0x0000000078730000-0x000000007bbfffff] Jan 13 20:07:29.171610 kernel: node 0: [mem 0x000000007bc00000-0x000000007bfdffff] Jan 13 20:07:29.171627 kernel: node 0: [mem 0x000000007bfe0000-0x000000007fffffff] Jan 13 20:07:29.171643 kernel: node 0: [mem 0x0000000400000000-0x00000004b5ffffff] Jan 13 20:07:29.171664 kernel: Initmem setup node 0 [mem 0x0000000040000000-0x00000004b5ffffff] Jan 13 20:07:29.171681 kernel: On node 0, zone Normal: 8192 pages in unavailable ranges Jan 13 20:07:29.171705 kernel: psci: probing for conduit method from ACPI. Jan 13 20:07:29.171722 kernel: psci: PSCIv1.0 detected in firmware. Jan 13 20:07:29.171740 kernel: psci: Using standard PSCI v0.2 function IDs Jan 13 20:07:29.171762 kernel: psci: Trusted OS migration not required Jan 13 20:07:29.171779 kernel: psci: SMC Calling Convention v1.1 Jan 13 20:07:29.171797 kernel: percpu: Embedded 31 pages/cpu s86696 r8192 d32088 u126976 Jan 13 20:07:29.171814 kernel: pcpu-alloc: s86696 r8192 d32088 u126976 alloc=31*4096 Jan 13 20:07:29.171833 kernel: pcpu-alloc: [0] 0 [0] 1 Jan 13 20:07:29.171850 kernel: Detected PIPT I-cache on CPU0 Jan 13 20:07:29.171867 kernel: CPU features: detected: GIC system register CPU interface Jan 13 20:07:29.171885 kernel: CPU features: detected: Spectre-v2 Jan 13 20:07:29.171902 kernel: CPU features: detected: Spectre-v3a Jan 13 20:07:29.171919 kernel: CPU features: detected: Spectre-BHB Jan 13 20:07:29.171936 kernel: CPU features: detected: ARM erratum 1742098 Jan 13 20:07:29.171954 kernel: CPU features: detected: ARM errata 1165522, 1319367, or 1530923 Jan 13 20:07:29.171976 kernel: alternatives: applying boot alternatives Jan 13 20:07:29.171995 kernel: Kernel command line: BOOT_IMAGE=/flatcar/vmlinuz-a mount.usr=/dev/mapper/usr verity.usr=PARTUUID=7130c94a-213a-4e5a-8e26-6cce9662f132 rootflags=rw mount.usrflags=ro consoleblank=0 root=LABEL=ROOT console=tty1 console=ttyS0,115200n8 earlycon flatcar.first_boot=detected acpi=force flatcar.oem.id=ec2 modprobe.blacklist=xen_fbfront net.ifnames=0 nvme_core.io_timeout=4294967295 verity.usrhash=9798117b3b15ef802e3d618077f87253cc08e0d5280b8fe28b307e7558b7ebcc Jan 13 20:07:29.172014 kernel: Unknown kernel command line parameters "BOOT_IMAGE=/flatcar/vmlinuz-a", will be passed to user space. Jan 13 20:07:29.172032 kernel: Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) Jan 13 20:07:29.172050 kernel: Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) Jan 13 20:07:29.172067 kernel: Fallback order for Node 0: 0 Jan 13 20:07:29.172084 kernel: Built 1 zonelists, mobility grouping on. Total pages: 991872 Jan 13 20:07:29.172102 kernel: Policy zone: Normal Jan 13 20:07:29.172145 kernel: mem auto-init: stack:off, heap alloc:off, heap free:off Jan 13 20:07:29.172166 kernel: software IO TLB: area num 2. Jan 13 20:07:29.172190 kernel: software IO TLB: mapped [mem 0x000000007c000000-0x0000000080000000] (64MB) Jan 13 20:07:29.172209 kernel: Memory: 3819640K/4030464K available (10304K kernel code, 2184K rwdata, 8092K rodata, 39936K init, 897K bss, 210824K reserved, 0K cma-reserved) Jan 13 20:07:29.172227 kernel: SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=2, Nodes=1 Jan 13 20:07:29.172244 kernel: rcu: Preemptible hierarchical RCU implementation. Jan 13 20:07:29.172263 kernel: rcu: RCU event tracing is enabled. Jan 13 20:07:29.172280 kernel: rcu: RCU restricting CPUs from NR_CPUS=512 to nr_cpu_ids=2. Jan 13 20:07:29.172298 kernel: Trampoline variant of Tasks RCU enabled. Jan 13 20:07:29.172316 kernel: Tracing variant of Tasks RCU enabled. Jan 13 20:07:29.172334 kernel: rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. Jan 13 20:07:29.172352 kernel: rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=2 Jan 13 20:07:29.172370 kernel: NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 Jan 13 20:07:29.172392 kernel: GICv3: 96 SPIs implemented Jan 13 20:07:29.172410 kernel: GICv3: 0 Extended SPIs implemented Jan 13 20:07:29.172428 kernel: Root IRQ handler: gic_handle_irq Jan 13 20:07:29.172446 kernel: GICv3: GICv3 features: 16 PPIs Jan 13 20:07:29.172464 kernel: GICv3: CPU0: found redistributor 0 region 0:0x0000000010200000 Jan 13 20:07:29.172482 kernel: ITS [mem 0x10080000-0x1009ffff] Jan 13 20:07:29.172500 kernel: ITS@0x0000000010080000: allocated 8192 Devices @4000b0000 (indirect, esz 8, psz 64K, shr 1) Jan 13 20:07:29.172518 kernel: ITS@0x0000000010080000: allocated 8192 Interrupt Collections @4000c0000 (flat, esz 8, psz 64K, shr 1) Jan 13 20:07:29.172536 kernel: GICv3: using LPI property table @0x00000004000d0000 Jan 13 20:07:29.172554 kernel: ITS: Using hypervisor restricted LPI range [128] Jan 13 20:07:29.172588 kernel: GICv3: CPU0: using allocated LPI pending table @0x00000004000e0000 Jan 13 20:07:29.172636 kernel: rcu: srcu_init: Setting srcu_struct sizes based on contention. Jan 13 20:07:29.172699 kernel: arch_timer: cp15 timer(s) running at 83.33MHz (virt). Jan 13 20:07:29.172722 kernel: clocksource: arch_sys_counter: mask: 0x1ffffffffffffff max_cycles: 0x13381ebeec, max_idle_ns: 440795203145 ns Jan 13 20:07:29.172743 kernel: sched_clock: 57 bits at 83MHz, resolution 12ns, wraps every 4398046511100ns Jan 13 20:07:29.172767 kernel: Console: colour dummy device 80x25 Jan 13 20:07:29.172786 kernel: printk: console [tty1] enabled Jan 13 20:07:29.172803 kernel: ACPI: Core revision 20230628 Jan 13 20:07:29.172822 kernel: Calibrating delay loop (skipped), value calculated using timer frequency.. 166.66 BogoMIPS (lpj=83333) Jan 13 20:07:29.172840 kernel: pid_max: default: 32768 minimum: 301 Jan 13 20:07:29.172858 kernel: LSM: initializing lsm=lockdown,capability,landlock,selinux,integrity Jan 13 20:07:29.172876 kernel: landlock: Up and running. Jan 13 20:07:29.172900 kernel: SELinux: Initializing. Jan 13 20:07:29.172918 kernel: Mount-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) Jan 13 20:07:29.172936 kernel: Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) Jan 13 20:07:29.172955 kernel: RCU Tasks: Setting shift to 1 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=2. Jan 13 20:07:29.172973 kernel: RCU Tasks Trace: Setting shift to 1 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=2. Jan 13 20:07:29.172991 kernel: rcu: Hierarchical SRCU implementation. Jan 13 20:07:29.173010 kernel: rcu: Max phase no-delay instances is 400. Jan 13 20:07:29.173028 kernel: Platform MSI: ITS@0x10080000 domain created Jan 13 20:07:29.173050 kernel: PCI/MSI: ITS@0x10080000 domain created Jan 13 20:07:29.173068 kernel: Remapping and enabling EFI services. Jan 13 20:07:29.173087 kernel: smp: Bringing up secondary CPUs ... Jan 13 20:07:29.173104 kernel: Detected PIPT I-cache on CPU1 Jan 13 20:07:29.173157 kernel: GICv3: CPU1: found redistributor 1 region 0:0x0000000010220000 Jan 13 20:07:29.173178 kernel: GICv3: CPU1: using allocated LPI pending table @0x00000004000f0000 Jan 13 20:07:29.173196 kernel: CPU1: Booted secondary processor 0x0000000001 [0x410fd083] Jan 13 20:07:29.173214 kernel: smp: Brought up 1 node, 2 CPUs Jan 13 20:07:29.173232 kernel: SMP: Total of 2 processors activated. Jan 13 20:07:29.173249 kernel: CPU features: detected: 32-bit EL0 Support Jan 13 20:07:29.173273 kernel: CPU features: detected: 32-bit EL1 Support Jan 13 20:07:29.173291 kernel: CPU features: detected: CRC32 instructions Jan 13 20:07:29.173320 kernel: CPU: All CPU(s) started at EL1 Jan 13 20:07:29.173343 kernel: alternatives: applying system-wide alternatives Jan 13 20:07:29.173361 kernel: devtmpfs: initialized Jan 13 20:07:29.173380 kernel: clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns Jan 13 20:07:29.173399 kernel: futex hash table entries: 512 (order: 3, 32768 bytes, linear) Jan 13 20:07:29.173417 kernel: pinctrl core: initialized pinctrl subsystem Jan 13 20:07:29.173436 kernel: SMBIOS 3.0.0 present. Jan 13 20:07:29.173459 kernel: DMI: Amazon EC2 a1.large/, BIOS 1.0 11/1/2018 Jan 13 20:07:29.173478 kernel: NET: Registered PF_NETLINK/PF_ROUTE protocol family Jan 13 20:07:29.173497 kernel: DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations Jan 13 20:07:29.173516 kernel: DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations Jan 13 20:07:29.173535 kernel: DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations Jan 13 20:07:29.173553 kernel: audit: initializing netlink subsys (disabled) Jan 13 20:07:29.173572 kernel: audit: type=2000 audit(0.221:1): state=initialized audit_enabled=0 res=1 Jan 13 20:07:29.173594 kernel: thermal_sys: Registered thermal governor 'step_wise' Jan 13 20:07:29.173613 kernel: cpuidle: using governor menu Jan 13 20:07:29.173632 kernel: hw-breakpoint: found 6 breakpoint and 4 watchpoint registers. Jan 13 20:07:29.173650 kernel: ASID allocator initialised with 65536 entries Jan 13 20:07:29.173669 kernel: acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 Jan 13 20:07:29.173687 kernel: Serial: AMBA PL011 UART driver Jan 13 20:07:29.173706 kernel: Modules: 17360 pages in range for non-PLT usage Jan 13 20:07:29.173724 kernel: Modules: 508880 pages in range for PLT usage Jan 13 20:07:29.173743 kernel: HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages Jan 13 20:07:29.173766 kernel: HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page Jan 13 20:07:29.173785 kernel: HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages Jan 13 20:07:29.173803 kernel: HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page Jan 13 20:07:29.173822 kernel: HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages Jan 13 20:07:29.173841 kernel: HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page Jan 13 20:07:29.173859 kernel: HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages Jan 13 20:07:29.173878 kernel: HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page Jan 13 20:07:29.173896 kernel: ACPI: Added _OSI(Module Device) Jan 13 20:07:29.173915 kernel: ACPI: Added _OSI(Processor Device) Jan 13 20:07:29.173938 kernel: ACPI: Added _OSI(3.0 _SCP Extensions) Jan 13 20:07:29.173957 kernel: ACPI: Added _OSI(Processor Aggregator Device) Jan 13 20:07:29.173975 kernel: ACPI: 1 ACPI AML tables successfully acquired and loaded Jan 13 20:07:29.174006 kernel: ACPI: Interpreter enabled Jan 13 20:07:29.174039 kernel: ACPI: Using GIC for interrupt routing Jan 13 20:07:29.174059 kernel: ACPI: MCFG table detected, 1 entries Jan 13 20:07:29.174078 kernel: ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-0f]) Jan 13 20:07:29.174418 kernel: acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] Jan 13 20:07:29.174638 kernel: acpi PNP0A08:00: _OSC: platform does not support [LTR] Jan 13 20:07:29.174848 kernel: acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME AER PCIeCapability] Jan 13 20:07:29.175051 kernel: acpi PNP0A08:00: ECAM area [mem 0x20000000-0x20ffffff] reserved by PNP0C02:00 Jan 13 20:07:29.175279 kernel: acpi PNP0A08:00: ECAM at [mem 0x20000000-0x20ffffff] for [bus 00-0f] Jan 13 20:07:29.175306 kernel: ACPI: Remapped I/O 0x000000001fff0000 to [io 0x0000-0xffff window] Jan 13 20:07:29.175325 kernel: acpiphp: Slot [1] registered Jan 13 20:07:29.175344 kernel: acpiphp: Slot [2] registered Jan 13 20:07:29.175363 kernel: acpiphp: Slot [3] registered Jan 13 20:07:29.175387 kernel: acpiphp: Slot [4] registered Jan 13 20:07:29.175406 kernel: acpiphp: Slot [5] registered Jan 13 20:07:29.175425 kernel: acpiphp: Slot [6] registered Jan 13 20:07:29.175444 kernel: acpiphp: Slot [7] registered Jan 13 20:07:29.175462 kernel: acpiphp: Slot [8] registered Jan 13 20:07:29.175480 kernel: acpiphp: Slot [9] registered Jan 13 20:07:29.175499 kernel: acpiphp: Slot [10] registered Jan 13 20:07:29.175517 kernel: acpiphp: Slot [11] registered Jan 13 20:07:29.175535 kernel: acpiphp: Slot [12] registered Jan 13 20:07:29.175554 kernel: acpiphp: Slot [13] registered Jan 13 20:07:29.175578 kernel: acpiphp: Slot [14] registered Jan 13 20:07:29.175596 kernel: acpiphp: Slot [15] registered Jan 13 20:07:29.175615 kernel: acpiphp: Slot [16] registered Jan 13 20:07:29.175634 kernel: acpiphp: Slot [17] registered Jan 13 20:07:29.175652 kernel: acpiphp: Slot [18] registered Jan 13 20:07:29.175671 kernel: acpiphp: Slot [19] registered Jan 13 20:07:29.175690 kernel: acpiphp: Slot [20] registered Jan 13 20:07:29.175708 kernel: acpiphp: Slot [21] registered Jan 13 20:07:29.175727 kernel: acpiphp: Slot [22] registered Jan 13 20:07:29.175750 kernel: acpiphp: Slot [23] registered Jan 13 20:07:29.175769 kernel: acpiphp: Slot [24] registered Jan 13 20:07:29.175789 kernel: acpiphp: Slot [25] registered Jan 13 20:07:29.175818 kernel: acpiphp: Slot [26] registered Jan 13 20:07:29.175837 kernel: acpiphp: Slot [27] registered Jan 13 20:07:29.175856 kernel: acpiphp: Slot [28] registered Jan 13 20:07:29.175875 kernel: acpiphp: Slot [29] registered Jan 13 20:07:29.175893 kernel: acpiphp: Slot [30] registered Jan 13 20:07:29.175912 kernel: acpiphp: Slot [31] registered Jan 13 20:07:29.175930 kernel: PCI host bridge to bus 0000:00 Jan 13 20:07:29.180312 kernel: pci_bus 0000:00: root bus resource [mem 0x80000000-0xffffffff window] Jan 13 20:07:29.180551 kernel: pci_bus 0000:00: root bus resource [io 0x0000-0xffff window] Jan 13 20:07:29.180739 kernel: pci_bus 0000:00: root bus resource [mem 0x400000000000-0x407fffffffff window] Jan 13 20:07:29.180923 kernel: pci_bus 0000:00: root bus resource [bus 00-0f] Jan 13 20:07:29.181214 kernel: pci 0000:00:00.0: [1d0f:0200] type 00 class 0x060000 Jan 13 20:07:29.181451 kernel: pci 0000:00:01.0: [1d0f:8250] type 00 class 0x070003 Jan 13 20:07:29.181674 kernel: pci 0000:00:01.0: reg 0x10: [mem 0x80118000-0x80118fff] Jan 13 20:07:29.181908 kernel: pci 0000:00:04.0: [1d0f:8061] type 00 class 0x010802 Jan 13 20:07:29.182112 kernel: pci 0000:00:04.0: reg 0x10: [mem 0x80114000-0x80117fff] Jan 13 20:07:29.182356 kernel: pci 0000:00:04.0: PME# supported from D0 D1 D2 D3hot D3cold Jan 13 20:07:29.182580 kernel: pci 0000:00:05.0: [1d0f:ec20] type 00 class 0x020000 Jan 13 20:07:29.182801 kernel: pci 0000:00:05.0: reg 0x10: [mem 0x80110000-0x80113fff] Jan 13 20:07:29.183015 kernel: pci 0000:00:05.0: reg 0x18: [mem 0x80000000-0x800fffff pref] Jan 13 20:07:29.183279 kernel: pci 0000:00:05.0: reg 0x20: [mem 0x80100000-0x8010ffff] Jan 13 20:07:29.183508 kernel: pci 0000:00:05.0: PME# supported from D0 D1 D2 D3hot D3cold Jan 13 20:07:29.183723 kernel: pci 0000:00:05.0: BAR 2: assigned [mem 0x80000000-0x800fffff pref] Jan 13 20:07:29.183935 kernel: pci 0000:00:05.0: BAR 4: assigned [mem 0x80100000-0x8010ffff] Jan 13 20:07:29.184185 kernel: pci 0000:00:04.0: BAR 0: assigned [mem 0x80110000-0x80113fff] Jan 13 20:07:29.184408 kernel: pci 0000:00:05.0: BAR 0: assigned [mem 0x80114000-0x80117fff] Jan 13 20:07:29.184627 kernel: pci 0000:00:01.0: BAR 0: assigned [mem 0x80118000-0x80118fff] Jan 13 20:07:29.184838 kernel: pci_bus 0000:00: resource 4 [mem 0x80000000-0xffffffff window] Jan 13 20:07:29.185030 kernel: pci_bus 0000:00: resource 5 [io 0x0000-0xffff window] Jan 13 20:07:29.185400 kernel: pci_bus 0000:00: resource 6 [mem 0x400000000000-0x407fffffffff window] Jan 13 20:07:29.188175 kernel: ACPI: PCI: Interrupt link GSI0 configured for IRQ 35 Jan 13 20:07:29.188200 kernel: ACPI: PCI: Interrupt link GSI1 configured for IRQ 36 Jan 13 20:07:29.188220 kernel: ACPI: PCI: Interrupt link GSI2 configured for IRQ 37 Jan 13 20:07:29.188240 kernel: ACPI: PCI: Interrupt link GSI3 configured for IRQ 38 Jan 13 20:07:29.188260 kernel: iommu: Default domain type: Translated Jan 13 20:07:29.188289 kernel: iommu: DMA domain TLB invalidation policy: strict mode Jan 13 20:07:29.188308 kernel: efivars: Registered efivars operations Jan 13 20:07:29.188327 kernel: vgaarb: loaded Jan 13 20:07:29.188346 kernel: clocksource: Switched to clocksource arch_sys_counter Jan 13 20:07:29.188365 kernel: VFS: Disk quotas dquot_6.6.0 Jan 13 20:07:29.188384 kernel: VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) Jan 13 20:07:29.188403 kernel: pnp: PnP ACPI init Jan 13 20:07:29.188651 kernel: system 00:00: [mem 0x20000000-0x2fffffff] could not be reserved Jan 13 20:07:29.188685 kernel: pnp: PnP ACPI: found 1 devices Jan 13 20:07:29.188705 kernel: NET: Registered PF_INET protocol family Jan 13 20:07:29.188724 kernel: IP idents hash table entries: 65536 (order: 7, 524288 bytes, linear) Jan 13 20:07:29.188743 kernel: tcp_listen_portaddr_hash hash table entries: 2048 (order: 3, 32768 bytes, linear) Jan 13 20:07:29.188762 kernel: Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) Jan 13 20:07:29.188781 kernel: TCP established hash table entries: 32768 (order: 6, 262144 bytes, linear) Jan 13 20:07:29.188800 kernel: TCP bind hash table entries: 32768 (order: 8, 1048576 bytes, linear) Jan 13 20:07:29.188819 kernel: TCP: Hash tables configured (established 32768 bind 32768) Jan 13 20:07:29.188838 kernel: UDP hash table entries: 2048 (order: 4, 65536 bytes, linear) Jan 13 20:07:29.188861 kernel: UDP-Lite hash table entries: 2048 (order: 4, 65536 bytes, linear) Jan 13 20:07:29.188880 kernel: NET: Registered PF_UNIX/PF_LOCAL protocol family Jan 13 20:07:29.188899 kernel: PCI: CLS 0 bytes, default 64 Jan 13 20:07:29.188917 kernel: kvm [1]: HYP mode not available Jan 13 20:07:29.188936 kernel: Initialise system trusted keyrings Jan 13 20:07:29.188955 kernel: workingset: timestamp_bits=39 max_order=20 bucket_order=0 Jan 13 20:07:29.188973 kernel: Key type asymmetric registered Jan 13 20:07:29.188992 kernel: Asymmetric key parser 'x509' registered Jan 13 20:07:29.189010 kernel: Block layer SCSI generic (bsg) driver version 0.4 loaded (major 250) Jan 13 20:07:29.189034 kernel: io scheduler mq-deadline registered Jan 13 20:07:29.189053 kernel: io scheduler kyber registered Jan 13 20:07:29.189071 kernel: io scheduler bfq registered Jan 13 20:07:29.189312 kernel: pl061_gpio ARMH0061:00: PL061 GPIO chip registered Jan 13 20:07:29.189341 kernel: input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 Jan 13 20:07:29.189360 kernel: ACPI: button: Power Button [PWRB] Jan 13 20:07:29.189379 kernel: input: Sleep Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0E:00/input/input1 Jan 13 20:07:29.189399 kernel: ACPI: button: Sleep Button [SLPB] Jan 13 20:07:29.189423 kernel: Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled Jan 13 20:07:29.189443 kernel: ACPI: \_SB_.PCI0.GSI2: Enabled at IRQ 37 Jan 13 20:07:29.189655 kernel: serial 0000:00:01.0: enabling device (0010 -> 0012) Jan 13 20:07:29.189682 kernel: printk: console [ttyS0] disabled Jan 13 20:07:29.189701 kernel: 0000:00:01.0: ttyS0 at MMIO 0x80118000 (irq = 14, base_baud = 115200) is a 16550A Jan 13 20:07:29.189720 kernel: printk: console [ttyS0] enabled Jan 13 20:07:29.189738 kernel: printk: bootconsole [uart0] disabled Jan 13 20:07:29.189757 kernel: thunder_xcv, ver 1.0 Jan 13 20:07:29.189775 kernel: thunder_bgx, ver 1.0 Jan 13 20:07:29.189794 kernel: nicpf, ver 1.0 Jan 13 20:07:29.189818 kernel: nicvf, ver 1.0 Jan 13 20:07:29.190040 kernel: rtc-efi rtc-efi.0: registered as rtc0 Jan 13 20:07:29.190355 kernel: rtc-efi rtc-efi.0: setting system clock to 2025-01-13T20:07:28 UTC (1736798848) Jan 13 20:07:29.190384 kernel: hid: raw HID events driver (C) Jiri Kosina Jan 13 20:07:29.190405 kernel: hw perfevents: enabled with armv8_pmuv3_0 PMU driver, 3 counters available Jan 13 20:07:29.190425 kernel: watchdog: Delayed init of the lockup detector failed: -19 Jan 13 20:07:29.190455 kernel: watchdog: Hard watchdog permanently disabled Jan 13 20:07:29.190485 kernel: NET: Registered PF_INET6 protocol family Jan 13 20:07:29.190505 kernel: Segment Routing with IPv6 Jan 13 20:07:29.190525 kernel: In-situ OAM (IOAM) with IPv6 Jan 13 20:07:29.190544 kernel: NET: Registered PF_PACKET protocol family Jan 13 20:07:29.190563 kernel: Key type dns_resolver registered Jan 13 20:07:29.190582 kernel: registered taskstats version 1 Jan 13 20:07:29.190601 kernel: Loading compiled-in X.509 certificates Jan 13 20:07:29.190620 kernel: Loaded X.509 cert 'Kinvolk GmbH: Module signing key for 6.6.71-flatcar: 46cb4d1b22f3a5974766fe7d7b651e2f296d4fe0' Jan 13 20:07:29.190639 kernel: Key type .fscrypt registered Jan 13 20:07:29.190658 kernel: Key type fscrypt-provisioning registered Jan 13 20:07:29.190681 kernel: ima: No TPM chip found, activating TPM-bypass! Jan 13 20:07:29.190700 kernel: ima: Allocated hash algorithm: sha1 Jan 13 20:07:29.190719 kernel: ima: No architecture policies found Jan 13 20:07:29.190737 kernel: alg: No test for fips(ansi_cprng) (fips_ansi_cprng) Jan 13 20:07:29.190757 kernel: clk: Disabling unused clocks Jan 13 20:07:29.190776 kernel: Freeing unused kernel memory: 39936K Jan 13 20:07:29.190795 kernel: Run /init as init process Jan 13 20:07:29.190813 kernel: with arguments: Jan 13 20:07:29.190832 kernel: /init Jan 13 20:07:29.190856 kernel: with environment: Jan 13 20:07:29.190874 kernel: HOME=/ Jan 13 20:07:29.190893 kernel: TERM=linux Jan 13 20:07:29.190912 kernel: BOOT_IMAGE=/flatcar/vmlinuz-a Jan 13 20:07:29.190936 systemd[1]: systemd 255 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL -ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY -P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK -XKBCOMMON +UTMP -SYSVINIT default-hierarchy=unified) Jan 13 20:07:29.193177 systemd[1]: Detected virtualization amazon. Jan 13 20:07:29.193212 systemd[1]: Detected architecture arm64. Jan 13 20:07:29.193243 systemd[1]: Running in initrd. Jan 13 20:07:29.193264 systemd[1]: No hostname configured, using default hostname. Jan 13 20:07:29.193285 systemd[1]: Hostname set to . Jan 13 20:07:29.193307 systemd[1]: Initializing machine ID from VM UUID. Jan 13 20:07:29.193327 systemd[1]: Queued start job for default target initrd.target. Jan 13 20:07:29.193347 systemd[1]: Started clevis-luks-askpass.path - Forward Password Requests to Clevis Directory Watch. Jan 13 20:07:29.193368 systemd[1]: Started systemd-ask-password-console.path - Dispatch Password Requests to Console Directory Watch. Jan 13 20:07:29.193390 systemd[1]: Expecting device dev-disk-by\x2dlabel-EFI\x2dSYSTEM.device - /dev/disk/by-label/EFI-SYSTEM... Jan 13 20:07:29.193415 systemd[1]: Expecting device dev-disk-by\x2dlabel-OEM.device - /dev/disk/by-label/OEM... Jan 13 20:07:29.193437 systemd[1]: Expecting device dev-disk-by\x2dlabel-ROOT.device - /dev/disk/by-label/ROOT... Jan 13 20:07:29.193458 systemd[1]: Expecting device dev-disk-by\x2dpartlabel-USR\x2dA.device - /dev/disk/by-partlabel/USR-A... Jan 13 20:07:29.193482 systemd[1]: Expecting device dev-disk-by\x2dpartuuid-7130c94a\x2d213a\x2d4e5a\x2d8e26\x2d6cce9662f132.device - /dev/disk/by-partuuid/7130c94a-213a-4e5a-8e26-6cce9662f132... Jan 13 20:07:29.193503 systemd[1]: Expecting device dev-mapper-usr.device - /dev/mapper/usr... Jan 13 20:07:29.193524 systemd[1]: Reached target cryptsetup-pre.target - Local Encrypted Volumes (Pre). Jan 13 20:07:29.193545 systemd[1]: Reached target cryptsetup.target - Local Encrypted Volumes. Jan 13 20:07:29.193569 systemd[1]: Reached target paths.target - Path Units. Jan 13 20:07:29.193590 systemd[1]: Reached target slices.target - Slice Units. Jan 13 20:07:29.193610 systemd[1]: Reached target swap.target - Swaps. Jan 13 20:07:29.193630 systemd[1]: Reached target timers.target - Timer Units. Jan 13 20:07:29.193650 systemd[1]: Listening on iscsid.socket - Open-iSCSI iscsid Socket. Jan 13 20:07:29.193671 systemd[1]: Listening on iscsiuio.socket - Open-iSCSI iscsiuio Socket. Jan 13 20:07:29.193691 systemd[1]: Listening on systemd-journald-dev-log.socket - Journal Socket (/dev/log). Jan 13 20:07:29.193712 systemd[1]: Listening on systemd-journald.socket - Journal Socket. Jan 13 20:07:29.193732 systemd[1]: Listening on systemd-networkd.socket - Network Service Netlink Socket. Jan 13 20:07:29.193756 systemd[1]: Listening on systemd-udevd-control.socket - udev Control Socket. Jan 13 20:07:29.193777 systemd[1]: Listening on systemd-udevd-kernel.socket - udev Kernel Socket. Jan 13 20:07:29.193797 systemd[1]: Reached target sockets.target - Socket Units. Jan 13 20:07:29.193817 systemd[1]: Starting ignition-setup-pre.service - Ignition env setup... Jan 13 20:07:29.193837 systemd[1]: Starting kmod-static-nodes.service - Create List of Static Device Nodes... Jan 13 20:07:29.193858 systemd[1]: Finished network-cleanup.service - Network Cleanup. Jan 13 20:07:29.193878 systemd[1]: Starting systemd-fsck-usr.service... Jan 13 20:07:29.193898 systemd[1]: Starting systemd-journald.service - Journal Service... Jan 13 20:07:29.193922 systemd[1]: Starting systemd-modules-load.service - Load Kernel Modules... Jan 13 20:07:29.193943 systemd[1]: Starting systemd-vconsole-setup.service - Virtual Console Setup... Jan 13 20:07:29.193963 systemd[1]: Finished ignition-setup-pre.service - Ignition env setup. Jan 13 20:07:29.193984 systemd[1]: Finished kmod-static-nodes.service - Create List of Static Device Nodes. Jan 13 20:07:29.194004 systemd[1]: Finished systemd-fsck-usr.service. Jan 13 20:07:29.194026 systemd[1]: Starting systemd-tmpfiles-setup-dev-early.service - Create Static Device Nodes in /dev gracefully... Jan 13 20:07:29.194095 systemd-journald[252]: Collecting audit messages is disabled. Jan 13 20:07:29.194162 kernel: bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this. Jan 13 20:07:29.194184 kernel: Bridge firewalling registered Jan 13 20:07:29.194212 systemd[1]: Finished systemd-modules-load.service - Load Kernel Modules. Jan 13 20:07:29.194234 systemd[1]: Finished systemd-vconsole-setup.service - Virtual Console Setup. Jan 13 20:07:29.194255 systemd-journald[252]: Journal started Jan 13 20:07:29.194301 systemd-journald[252]: Runtime Journal (/run/log/journal/ec28b0b92f52e4c12763d95a68d2750d) is 8.0M, max 75.3M, 67.3M free. Jan 13 20:07:29.140703 systemd-modules-load[253]: Inserted module 'overlay' Jan 13 20:07:29.198269 systemd[1]: Finished systemd-tmpfiles-setup-dev-early.service - Create Static Device Nodes in /dev gracefully. Jan 13 20:07:29.180240 systemd-modules-load[253]: Inserted module 'br_netfilter' Jan 13 20:07:29.203585 systemd[1]: Started systemd-journald.service - Journal Service. Jan 13 20:07:29.214466 systemd[1]: Starting dracut-cmdline-ask.service - dracut ask for additional cmdline parameters... Jan 13 20:07:29.219408 systemd[1]: Starting systemd-sysctl.service - Apply Kernel Variables... Jan 13 20:07:29.232408 systemd[1]: Starting systemd-tmpfiles-setup-dev.service - Create Static Device Nodes in /dev... Jan 13 20:07:29.249434 systemd[1]: Starting systemd-tmpfiles-setup.service - Create System Files and Directories... Jan 13 20:07:29.266549 systemd[1]: Finished systemd-tmpfiles-setup-dev.service - Create Static Device Nodes in /dev. Jan 13 20:07:29.275802 systemd[1]: Finished systemd-sysctl.service - Apply Kernel Variables. Jan 13 20:07:29.287196 systemd[1]: Finished systemd-tmpfiles-setup.service - Create System Files and Directories. Jan 13 20:07:29.308507 systemd[1]: Starting systemd-resolved.service - Network Name Resolution... Jan 13 20:07:29.312822 systemd[1]: Finished dracut-cmdline-ask.service - dracut ask for additional cmdline parameters. Jan 13 20:07:29.323500 systemd[1]: Starting dracut-cmdline.service - dracut cmdline hook... Jan 13 20:07:29.355236 dracut-cmdline[289]: dracut-dracut-053 Jan 13 20:07:29.361634 dracut-cmdline[289]: Using kernel command line parameters: rd.driver.pre=btrfs BOOT_IMAGE=/flatcar/vmlinuz-a mount.usr=/dev/mapper/usr verity.usr=PARTUUID=7130c94a-213a-4e5a-8e26-6cce9662f132 rootflags=rw mount.usrflags=ro consoleblank=0 root=LABEL=ROOT console=tty1 console=ttyS0,115200n8 earlycon flatcar.first_boot=detected acpi=force flatcar.oem.id=ec2 modprobe.blacklist=xen_fbfront net.ifnames=0 nvme_core.io_timeout=4294967295 verity.usrhash=9798117b3b15ef802e3d618077f87253cc08e0d5280b8fe28b307e7558b7ebcc Jan 13 20:07:29.382396 systemd-resolved[286]: Positive Trust Anchors: Jan 13 20:07:29.382424 systemd-resolved[286]: . IN DS 20326 8 2 e06d44b80b8f1d39a95c0b0d7c65d08458e880409bbc683457104237c7f8ec8d Jan 13 20:07:29.382483 systemd-resolved[286]: Negative trust anchors: home.arpa 10.in-addr.arpa 16.172.in-addr.arpa 17.172.in-addr.arpa 18.172.in-addr.arpa 19.172.in-addr.arpa 20.172.in-addr.arpa 21.172.in-addr.arpa 22.172.in-addr.arpa 23.172.in-addr.arpa 24.172.in-addr.arpa 25.172.in-addr.arpa 26.172.in-addr.arpa 27.172.in-addr.arpa 28.172.in-addr.arpa 29.172.in-addr.arpa 30.172.in-addr.arpa 31.172.in-addr.arpa 170.0.0.192.in-addr.arpa 171.0.0.192.in-addr.arpa 168.192.in-addr.arpa d.f.ip6.arpa ipv4only.arpa resolver.arpa corp home internal intranet lan local private test Jan 13 20:07:29.524157 kernel: SCSI subsystem initialized Jan 13 20:07:29.532155 kernel: Loading iSCSI transport class v2.0-870. Jan 13 20:07:29.544155 kernel: iscsi: registered transport (tcp) Jan 13 20:07:29.566151 kernel: iscsi: registered transport (qla4xxx) Jan 13 20:07:29.566224 kernel: QLogic iSCSI HBA Driver Jan 13 20:07:29.633154 kernel: random: crng init done Jan 13 20:07:29.633409 systemd-resolved[286]: Defaulting to hostname 'linux'. Jan 13 20:07:29.636301 systemd[1]: Started systemd-resolved.service - Network Name Resolution. Jan 13 20:07:29.638514 systemd[1]: Reached target nss-lookup.target - Host and Network Name Lookups. Jan 13 20:07:29.664441 systemd[1]: Finished dracut-cmdline.service - dracut cmdline hook. Jan 13 20:07:29.679346 systemd[1]: Starting dracut-pre-udev.service - dracut pre-udev hook... Jan 13 20:07:29.709161 kernel: device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. Jan 13 20:07:29.709252 kernel: device-mapper: uevent: version 1.0.3 Jan 13 20:07:29.709282 kernel: device-mapper: ioctl: 4.48.0-ioctl (2023-03-01) initialised: dm-devel@redhat.com Jan 13 20:07:29.776161 kernel: raid6: neonx8 gen() 6572 MB/s Jan 13 20:07:29.793148 kernel: raid6: neonx4 gen() 6515 MB/s Jan 13 20:07:29.810149 kernel: raid6: neonx2 gen() 5443 MB/s Jan 13 20:07:29.827148 kernel: raid6: neonx1 gen() 3940 MB/s Jan 13 20:07:29.844149 kernel: raid6: int64x8 gen() 3609 MB/s Jan 13 20:07:29.861148 kernel: raid6: int64x4 gen() 3704 MB/s Jan 13 20:07:29.878149 kernel: raid6: int64x2 gen() 3609 MB/s Jan 13 20:07:29.895892 kernel: raid6: int64x1 gen() 2765 MB/s Jan 13 20:07:29.895924 kernel: raid6: using algorithm neonx8 gen() 6572 MB/s Jan 13 20:07:29.913888 kernel: raid6: .... xor() 4818 MB/s, rmw enabled Jan 13 20:07:29.913925 kernel: raid6: using neon recovery algorithm Jan 13 20:07:29.921797 kernel: xor: measuring software checksum speed Jan 13 20:07:29.921841 kernel: 8regs : 12947 MB/sec Jan 13 20:07:29.922873 kernel: 32regs : 13038 MB/sec Jan 13 20:07:29.925007 kernel: arm64_neon : 8855 MB/sec Jan 13 20:07:29.925044 kernel: xor: using function: 32regs (13038 MB/sec) Jan 13 20:07:30.008170 kernel: Btrfs loaded, zoned=no, fsverity=no Jan 13 20:07:30.026397 systemd[1]: Finished dracut-pre-udev.service - dracut pre-udev hook. Jan 13 20:07:30.036423 systemd[1]: Starting systemd-udevd.service - Rule-based Manager for Device Events and Files... Jan 13 20:07:30.077189 systemd-udevd[470]: Using default interface naming scheme 'v255'. Jan 13 20:07:30.086154 systemd[1]: Started systemd-udevd.service - Rule-based Manager for Device Events and Files. Jan 13 20:07:30.104398 systemd[1]: Starting dracut-pre-trigger.service - dracut pre-trigger hook... Jan 13 20:07:30.141497 dracut-pre-trigger[478]: rd.md=0: removing MD RAID activation Jan 13 20:07:30.197178 systemd[1]: Finished dracut-pre-trigger.service - dracut pre-trigger hook. Jan 13 20:07:30.209437 systemd[1]: Starting systemd-udev-trigger.service - Coldplug All udev Devices... Jan 13 20:07:30.325158 systemd[1]: Finished systemd-udev-trigger.service - Coldplug All udev Devices. Jan 13 20:07:30.339419 systemd[1]: Starting dracut-initqueue.service - dracut initqueue hook... Jan 13 20:07:30.388514 systemd[1]: Finished dracut-initqueue.service - dracut initqueue hook. Jan 13 20:07:30.393631 systemd[1]: Reached target remote-fs-pre.target - Preparation for Remote File Systems. Jan 13 20:07:30.398639 systemd[1]: Reached target remote-cryptsetup.target - Remote Encrypted Volumes. Jan 13 20:07:30.420860 systemd[1]: Reached target remote-fs.target - Remote File Systems. Jan 13 20:07:30.436398 systemd[1]: Starting dracut-pre-mount.service - dracut pre-mount hook... Jan 13 20:07:30.469186 systemd[1]: Finished dracut-pre-mount.service - dracut pre-mount hook. Jan 13 20:07:30.525145 kernel: ACPI: \_SB_.PCI0.GSI1: Enabled at IRQ 36 Jan 13 20:07:30.525233 kernel: ena 0000:00:05.0: enabling device (0010 -> 0012) Jan 13 20:07:30.557404 kernel: ena 0000:00:05.0: ENA device version: 0.10 Jan 13 20:07:30.557684 kernel: ena 0000:00:05.0: ENA controller version: 0.0.1 implementation version 1 Jan 13 20:07:30.557941 kernel: ena 0000:00:05.0: Elastic Network Adapter (ENA) found at mem 80114000, mac addr 06:1e:21:81:df:6b Jan 13 20:07:30.530260 systemd[1]: dracut-cmdline-ask.service: Deactivated successfully. Jan 13 20:07:30.530514 systemd[1]: Stopped dracut-cmdline-ask.service - dracut ask for additional cmdline parameters. Jan 13 20:07:30.535845 systemd[1]: Stopping dracut-cmdline-ask.service - dracut ask for additional cmdline parameters... Jan 13 20:07:30.537956 systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. Jan 13 20:07:30.538254 systemd[1]: Stopped systemd-vconsole-setup.service - Virtual Console Setup. Jan 13 20:07:30.591113 kernel: ACPI: \_SB_.PCI0.GSI0: Enabled at IRQ 35 Jan 13 20:07:30.591169 kernel: nvme nvme0: pci function 0000:00:04.0 Jan 13 20:07:30.540506 systemd[1]: Stopping systemd-vconsole-setup.service - Virtual Console Setup... Jan 13 20:07:30.553800 systemd[1]: Starting systemd-vconsole-setup.service - Virtual Console Setup... Jan 13 20:07:30.565658 (udev-worker)[526]: Network interface NamePolicy= disabled on kernel command line. Jan 13 20:07:30.610176 kernel: nvme nvme0: 2/0/0 default/read/poll queues Jan 13 20:07:30.614768 kernel: GPT:Primary header thinks Alt. header is not at the end of the disk. Jan 13 20:07:30.614830 kernel: GPT:9289727 != 16777215 Jan 13 20:07:30.615110 systemd[1]: Finished systemd-vconsole-setup.service - Virtual Console Setup. Jan 13 20:07:30.623100 kernel: GPT:Alternate GPT header not at the end of the disk. Jan 13 20:07:30.623151 kernel: GPT:9289727 != 16777215 Jan 13 20:07:30.623179 kernel: GPT: Use GNU Parted to correct GPT errors. Jan 13 20:07:30.623204 kernel: nvme0n1: p1 p2 p3 p4 p6 p7 p9 Jan 13 20:07:30.632443 systemd[1]: Starting dracut-cmdline-ask.service - dracut ask for additional cmdline parameters... Jan 13 20:07:30.663326 systemd[1]: Finished dracut-cmdline-ask.service - dracut ask for additional cmdline parameters. Jan 13 20:07:30.766183 kernel: BTRFS: device label OEM devid 1 transid 14 /dev/nvme0n1p6 scanned by (udev-worker) (529) Jan 13 20:07:30.786086 systemd[1]: Found device dev-disk-by\x2dlabel-EFI\x2dSYSTEM.device - Amazon Elastic Block Store EFI-SYSTEM. Jan 13 20:07:30.803261 kernel: BTRFS: device fsid 2be7cc1c-29d4-4496-b29b-8561323213d2 devid 1 transid 38 /dev/nvme0n1p3 scanned by (udev-worker) (516) Jan 13 20:07:30.877957 systemd[1]: Found device dev-disk-by\x2dlabel-ROOT.device - Amazon Elastic Block Store ROOT. Jan 13 20:07:30.895528 systemd[1]: Found device dev-disk-by\x2dlabel-OEM.device - Amazon Elastic Block Store OEM. Jan 13 20:07:30.909621 systemd[1]: Found device dev-disk-by\x2dpartuuid-7130c94a\x2d213a\x2d4e5a\x2d8e26\x2d6cce9662f132.device - Amazon Elastic Block Store USR-A. Jan 13 20:07:30.909774 systemd[1]: Found device dev-disk-by\x2dpartlabel-USR\x2dA.device - Amazon Elastic Block Store USR-A. Jan 13 20:07:30.926486 systemd[1]: Starting disk-uuid.service - Generate new UUID for disk GPT if necessary... Jan 13 20:07:30.938179 disk-uuid[662]: Primary Header is updated. Jan 13 20:07:30.938179 disk-uuid[662]: Secondary Entries is updated. Jan 13 20:07:30.938179 disk-uuid[662]: Secondary Header is updated. Jan 13 20:07:30.946192 kernel: nvme0n1: p1 p2 p3 p4 p6 p7 p9 Jan 13 20:07:31.962684 kernel: nvme0n1: p1 p2 p3 p4 p6 p7 p9 Jan 13 20:07:31.963965 disk-uuid[663]: The operation has completed successfully. Jan 13 20:07:32.132220 systemd[1]: disk-uuid.service: Deactivated successfully. Jan 13 20:07:32.135543 systemd[1]: Finished disk-uuid.service - Generate new UUID for disk GPT if necessary. Jan 13 20:07:32.193436 systemd[1]: Starting verity-setup.service - Verity Setup for /dev/mapper/usr... Jan 13 20:07:32.204795 sh[923]: Success Jan 13 20:07:32.232168 kernel: device-mapper: verity: sha256 using implementation "sha256-ce" Jan 13 20:07:32.352932 systemd[1]: Found device dev-mapper-usr.device - /dev/mapper/usr. Jan 13 20:07:32.364424 systemd[1]: Mounting sysusr-usr.mount - /sysusr/usr... Jan 13 20:07:32.380974 systemd[1]: Finished verity-setup.service - Verity Setup for /dev/mapper/usr. Jan 13 20:07:32.400157 kernel: BTRFS info (device dm-0): first mount of filesystem 2be7cc1c-29d4-4496-b29b-8561323213d2 Jan 13 20:07:32.400218 kernel: BTRFS info (device dm-0): using crc32c (crc32c-generic) checksum algorithm Jan 13 20:07:32.400246 kernel: BTRFS warning (device dm-0): 'nologreplay' is deprecated, use 'rescue=nologreplay' instead Jan 13 20:07:32.403003 kernel: BTRFS info (device dm-0): disabling log replay at mount time Jan 13 20:07:32.403038 kernel: BTRFS info (device dm-0): using free space tree Jan 13 20:07:32.541153 kernel: BTRFS info (device dm-0): enabling ssd optimizations Jan 13 20:07:32.571073 systemd[1]: Mounted sysusr-usr.mount - /sysusr/usr. Jan 13 20:07:32.574919 systemd[1]: afterburn-network-kargs.service - Afterburn Initrd Setup Network Kernel Arguments was skipped because no trigger condition checks were met. Jan 13 20:07:32.588341 systemd[1]: Starting ignition-setup.service - Ignition (setup)... Jan 13 20:07:32.596465 systemd[1]: Starting parse-ip-for-networkd.service - Write systemd-networkd units from cmdline... Jan 13 20:07:32.614375 kernel: BTRFS info (device nvme0n1p6): first mount of filesystem 9f8ecb6c-ace6-4d16-8781-f4e964dc0779 Jan 13 20:07:32.614454 kernel: BTRFS info (device nvme0n1p6): using crc32c (crc32c-generic) checksum algorithm Jan 13 20:07:32.615658 kernel: BTRFS info (device nvme0n1p6): using free space tree Jan 13 20:07:32.622171 kernel: BTRFS info (device nvme0n1p6): enabling ssd optimizations Jan 13 20:07:32.640813 systemd[1]: mnt-oem.mount: Deactivated successfully. Jan 13 20:07:32.643057 kernel: BTRFS info (device nvme0n1p6): last unmount of filesystem 9f8ecb6c-ace6-4d16-8781-f4e964dc0779 Jan 13 20:07:32.669203 systemd[1]: Finished ignition-setup.service - Ignition (setup). Jan 13 20:07:32.680515 systemd[1]: Starting ignition-fetch-offline.service - Ignition (fetch-offline)... Jan 13 20:07:32.769358 systemd[1]: Finished parse-ip-for-networkd.service - Write systemd-networkd units from cmdline. Jan 13 20:07:32.779389 systemd[1]: Starting systemd-networkd.service - Network Configuration... Jan 13 20:07:32.833530 systemd-networkd[1115]: lo: Link UP Jan 13 20:07:32.833980 systemd-networkd[1115]: lo: Gained carrier Jan 13 20:07:32.836801 systemd-networkd[1115]: Enumeration completed Jan 13 20:07:32.837306 systemd[1]: Started systemd-networkd.service - Network Configuration. Jan 13 20:07:32.837766 systemd-networkd[1115]: eth0: found matching network '/usr/lib/systemd/network/zz-default.network', based on potentially unpredictable interface name. Jan 13 20:07:32.837772 systemd-networkd[1115]: eth0: Configuring with /usr/lib/systemd/network/zz-default.network. Jan 13 20:07:32.851561 systemd[1]: Reached target network.target - Network. Jan 13 20:07:32.855489 systemd-networkd[1115]: eth0: Link UP Jan 13 20:07:32.855502 systemd-networkd[1115]: eth0: Gained carrier Jan 13 20:07:32.855522 systemd-networkd[1115]: eth0: found matching network '/usr/lib/systemd/network/zz-default.network', based on potentially unpredictable interface name. Jan 13 20:07:32.868228 systemd-networkd[1115]: eth0: DHCPv4 address 172.31.28.23/20, gateway 172.31.16.1 acquired from 172.31.16.1 Jan 13 20:07:33.190413 ignition[1038]: Ignition 2.20.0 Jan 13 20:07:33.190770 ignition[1038]: Stage: fetch-offline Jan 13 20:07:33.191226 ignition[1038]: no configs at "/usr/lib/ignition/base.d" Jan 13 20:07:33.191250 ignition[1038]: no config dir at "/usr/lib/ignition/base.platform.d/aws" Jan 13 20:07:33.191691 ignition[1038]: Ignition finished successfully Jan 13 20:07:33.201211 systemd[1]: Finished ignition-fetch-offline.service - Ignition (fetch-offline). Jan 13 20:07:33.213511 systemd[1]: Starting ignition-fetch.service - Ignition (fetch)... Jan 13 20:07:33.234614 ignition[1124]: Ignition 2.20.0 Jan 13 20:07:33.234643 ignition[1124]: Stage: fetch Jan 13 20:07:33.236002 ignition[1124]: no configs at "/usr/lib/ignition/base.d" Jan 13 20:07:33.236028 ignition[1124]: no config dir at "/usr/lib/ignition/base.platform.d/aws" Jan 13 20:07:33.236257 ignition[1124]: PUT http://169.254.169.254/latest/api/token: attempt #1 Jan 13 20:07:33.245354 ignition[1124]: PUT result: OK Jan 13 20:07:33.248735 ignition[1124]: parsed url from cmdline: "" Jan 13 20:07:33.248751 ignition[1124]: no config URL provided Jan 13 20:07:33.248765 ignition[1124]: reading system config file "/usr/lib/ignition/user.ign" Jan 13 20:07:33.248790 ignition[1124]: no config at "/usr/lib/ignition/user.ign" Jan 13 20:07:33.248821 ignition[1124]: PUT http://169.254.169.254/latest/api/token: attempt #1 Jan 13 20:07:33.252938 ignition[1124]: PUT result: OK Jan 13 20:07:33.253095 ignition[1124]: GET http://169.254.169.254/2019-10-01/user-data: attempt #1 Jan 13 20:07:33.259258 ignition[1124]: GET result: OK Jan 13 20:07:33.260052 ignition[1124]: parsing config with SHA512: 4302c23a43be69c2f04526098324c5a6a1c363bbc4badeacd665f1d4d30c33b15e2869e8254a998d1870bc26fe4e49dc2366c3b4101ac33d1691cded1472c918 Jan 13 20:07:33.268897 unknown[1124]: fetched base config from "system" Jan 13 20:07:33.269157 unknown[1124]: fetched base config from "system" Jan 13 20:07:33.270073 ignition[1124]: fetch: fetch complete Jan 13 20:07:33.269171 unknown[1124]: fetched user config from "aws" Jan 13 20:07:33.270085 ignition[1124]: fetch: fetch passed Jan 13 20:07:33.270183 ignition[1124]: Ignition finished successfully Jan 13 20:07:33.278959 systemd[1]: Finished ignition-fetch.service - Ignition (fetch). Jan 13 20:07:33.296391 systemd[1]: Starting ignition-kargs.service - Ignition (kargs)... Jan 13 20:07:33.320546 ignition[1130]: Ignition 2.20.0 Jan 13 20:07:33.320575 ignition[1130]: Stage: kargs Jan 13 20:07:33.321222 ignition[1130]: no configs at "/usr/lib/ignition/base.d" Jan 13 20:07:33.321247 ignition[1130]: no config dir at "/usr/lib/ignition/base.platform.d/aws" Jan 13 20:07:33.321404 ignition[1130]: PUT http://169.254.169.254/latest/api/token: attempt #1 Jan 13 20:07:33.324001 ignition[1130]: PUT result: OK Jan 13 20:07:33.333598 ignition[1130]: kargs: kargs passed Jan 13 20:07:33.333880 ignition[1130]: Ignition finished successfully Jan 13 20:07:33.340171 systemd[1]: Finished ignition-kargs.service - Ignition (kargs). Jan 13 20:07:33.358509 systemd[1]: Starting ignition-disks.service - Ignition (disks)... Jan 13 20:07:33.380919 ignition[1136]: Ignition 2.20.0 Jan 13 20:07:33.380941 ignition[1136]: Stage: disks Jan 13 20:07:33.381572 ignition[1136]: no configs at "/usr/lib/ignition/base.d" Jan 13 20:07:33.381597 ignition[1136]: no config dir at "/usr/lib/ignition/base.platform.d/aws" Jan 13 20:07:33.381994 ignition[1136]: PUT http://169.254.169.254/latest/api/token: attempt #1 Jan 13 20:07:33.384270 ignition[1136]: PUT result: OK Jan 13 20:07:33.393858 ignition[1136]: disks: disks passed Jan 13 20:07:33.393954 ignition[1136]: Ignition finished successfully Jan 13 20:07:33.398173 systemd[1]: Finished ignition-disks.service - Ignition (disks). Jan 13 20:07:33.401087 systemd[1]: Reached target initrd-root-device.target - Initrd Root Device. Jan 13 20:07:33.401815 systemd[1]: Reached target local-fs-pre.target - Preparation for Local File Systems. Jan 13 20:07:33.402094 systemd[1]: Reached target local-fs.target - Local File Systems. Jan 13 20:07:33.402682 systemd[1]: Reached target sysinit.target - System Initialization. Jan 13 20:07:33.402981 systemd[1]: Reached target basic.target - Basic System. Jan 13 20:07:33.429536 systemd[1]: Starting systemd-fsck-root.service - File System Check on /dev/disk/by-label/ROOT... Jan 13 20:07:33.479262 systemd-fsck[1144]: ROOT: clean, 14/553520 files, 52654/553472 blocks Jan 13 20:07:33.488964 systemd[1]: Finished systemd-fsck-root.service - File System Check on /dev/disk/by-label/ROOT. Jan 13 20:07:33.503339 systemd[1]: Mounting sysroot.mount - /sysroot... Jan 13 20:07:33.579183 kernel: EXT4-fs (nvme0n1p9): mounted filesystem f9a95e53-2d63-4443-b523-cb2108fb48f6 r/w with ordered data mode. Quota mode: none. Jan 13 20:07:33.580137 systemd[1]: Mounted sysroot.mount - /sysroot. Jan 13 20:07:33.581497 systemd[1]: Reached target initrd-root-fs.target - Initrd Root File System. Jan 13 20:07:33.605279 systemd[1]: Mounting sysroot-oem.mount - /sysroot/oem... Jan 13 20:07:33.611598 systemd[1]: Mounting sysroot-usr.mount - /sysroot/usr... Jan 13 20:07:33.615579 systemd[1]: flatcar-metadata-hostname.service - Flatcar Metadata Hostname Agent was skipped because no trigger condition checks were met. Jan 13 20:07:33.616706 systemd[1]: ignition-remount-sysroot.service - Remount /sysroot read-write for Ignition was skipped because of an unmet condition check (ConditionPathIsReadWrite=!/sysroot). Jan 13 20:07:33.616759 systemd[1]: Reached target ignition-diskful.target - Ignition Boot Disk Setup. Jan 13 20:07:33.627859 kernel: BTRFS: device label OEM devid 1 transid 15 /dev/nvme0n1p6 scanned by mount (1163) Jan 13 20:07:33.634148 kernel: BTRFS info (device nvme0n1p6): first mount of filesystem 9f8ecb6c-ace6-4d16-8781-f4e964dc0779 Jan 13 20:07:33.634217 kernel: BTRFS info (device nvme0n1p6): using crc32c (crc32c-generic) checksum algorithm Jan 13 20:07:33.635379 kernel: BTRFS info (device nvme0n1p6): using free space tree Jan 13 20:07:33.640148 kernel: BTRFS info (device nvme0n1p6): enabling ssd optimizations Jan 13 20:07:33.642596 systemd[1]: Mounted sysroot-oem.mount - /sysroot/oem. Jan 13 20:07:33.649242 systemd[1]: Mounted sysroot-usr.mount - /sysroot/usr. Jan 13 20:07:33.662009 systemd[1]: Starting initrd-setup-root.service - Root filesystem setup... Jan 13 20:07:34.157253 systemd-networkd[1115]: eth0: Gained IPv6LL Jan 13 20:07:34.185536 initrd-setup-root[1187]: cut: /sysroot/etc/passwd: No such file or directory Jan 13 20:07:34.230020 initrd-setup-root[1194]: cut: /sysroot/etc/group: No such file or directory Jan 13 20:07:34.238668 initrd-setup-root[1201]: cut: /sysroot/etc/shadow: No such file or directory Jan 13 20:07:34.246243 initrd-setup-root[1208]: cut: /sysroot/etc/gshadow: No such file or directory Jan 13 20:07:34.640843 systemd[1]: Finished initrd-setup-root.service - Root filesystem setup. Jan 13 20:07:34.651322 systemd[1]: Starting ignition-mount.service - Ignition (mount)... Jan 13 20:07:34.661592 systemd[1]: Starting sysroot-boot.service - /sysroot/boot... Jan 13 20:07:34.676751 systemd[1]: sysroot-oem.mount: Deactivated successfully. Jan 13 20:07:34.679162 kernel: BTRFS info (device nvme0n1p6): last unmount of filesystem 9f8ecb6c-ace6-4d16-8781-f4e964dc0779 Jan 13 20:07:34.713768 systemd[1]: Finished sysroot-boot.service - /sysroot/boot. Jan 13 20:07:34.723985 ignition[1278]: INFO : Ignition 2.20.0 Jan 13 20:07:34.725826 ignition[1278]: INFO : Stage: mount Jan 13 20:07:34.727772 ignition[1278]: INFO : no configs at "/usr/lib/ignition/base.d" Jan 13 20:07:34.729806 ignition[1278]: INFO : no config dir at "/usr/lib/ignition/base.platform.d/aws" Jan 13 20:07:34.732035 ignition[1278]: INFO : PUT http://169.254.169.254/latest/api/token: attempt #1 Jan 13 20:07:34.735412 ignition[1278]: INFO : PUT result: OK Jan 13 20:07:34.740147 ignition[1278]: INFO : mount: mount passed Jan 13 20:07:34.740147 ignition[1278]: INFO : Ignition finished successfully Jan 13 20:07:34.743552 systemd[1]: Finished ignition-mount.service - Ignition (mount). Jan 13 20:07:34.763416 systemd[1]: Starting ignition-files.service - Ignition (files)... Jan 13 20:07:34.787437 systemd[1]: Mounting sysroot-oem.mount - /sysroot/oem... Jan 13 20:07:34.805157 kernel: BTRFS: device label OEM devid 1 transid 16 /dev/nvme0n1p6 scanned by mount (1288) Jan 13 20:07:34.809926 kernel: BTRFS info (device nvme0n1p6): first mount of filesystem 9f8ecb6c-ace6-4d16-8781-f4e964dc0779 Jan 13 20:07:34.809968 kernel: BTRFS info (device nvme0n1p6): using crc32c (crc32c-generic) checksum algorithm Jan 13 20:07:34.809995 kernel: BTRFS info (device nvme0n1p6): using free space tree Jan 13 20:07:34.815144 kernel: BTRFS info (device nvme0n1p6): enabling ssd optimizations Jan 13 20:07:34.817774 systemd[1]: Mounted sysroot-oem.mount - /sysroot/oem. Jan 13 20:07:34.852812 ignition[1305]: INFO : Ignition 2.20.0 Jan 13 20:07:34.852812 ignition[1305]: INFO : Stage: files Jan 13 20:07:34.856086 ignition[1305]: INFO : no configs at "/usr/lib/ignition/base.d" Jan 13 20:07:34.856086 ignition[1305]: INFO : no config dir at "/usr/lib/ignition/base.platform.d/aws" Jan 13 20:07:34.856086 ignition[1305]: INFO : PUT http://169.254.169.254/latest/api/token: attempt #1 Jan 13 20:07:34.864544 ignition[1305]: INFO : PUT result: OK Jan 13 20:07:34.869864 ignition[1305]: DEBUG : files: compiled without relabeling support, skipping Jan 13 20:07:34.887777 ignition[1305]: INFO : files: ensureUsers: op(1): [started] creating or modifying user "core" Jan 13 20:07:34.890362 ignition[1305]: DEBUG : files: ensureUsers: op(1): executing: "usermod" "--root" "/sysroot" "core" Jan 13 20:07:34.925331 ignition[1305]: INFO : files: ensureUsers: op(1): [finished] creating or modifying user "core" Jan 13 20:07:34.928204 ignition[1305]: INFO : files: ensureUsers: op(2): [started] adding ssh keys to user "core" Jan 13 20:07:34.930929 ignition[1305]: INFO : files: ensureUsers: op(2): [finished] adding ssh keys to user "core" Jan 13 20:07:34.930800 unknown[1305]: wrote ssh authorized keys file for user: core Jan 13 20:07:34.950930 ignition[1305]: INFO : files: createFilesystemsFiles: createFiles: op(3): [started] writing file "/sysroot/opt/helm-v3.13.2-linux-arm64.tar.gz" Jan 13 20:07:34.954952 ignition[1305]: INFO : files: createFilesystemsFiles: createFiles: op(3): GET https://get.helm.sh/helm-v3.13.2-linux-arm64.tar.gz: attempt #1 Jan 13 20:07:35.021490 ignition[1305]: INFO : files: createFilesystemsFiles: createFiles: op(3): GET result: OK Jan 13 20:07:35.272025 ignition[1305]: INFO : files: createFilesystemsFiles: createFiles: op(3): [finished] writing file "/sysroot/opt/helm-v3.13.2-linux-arm64.tar.gz" Jan 13 20:07:35.275597 ignition[1305]: INFO : files: createFilesystemsFiles: createFiles: op(4): [started] writing file "/sysroot/home/core/install.sh" Jan 13 20:07:35.278947 ignition[1305]: INFO : files: createFilesystemsFiles: createFiles: op(4): [finished] writing file "/sysroot/home/core/install.sh" Jan 13 20:07:35.282213 ignition[1305]: INFO : files: createFilesystemsFiles: createFiles: op(5): [started] writing file "/sysroot/home/core/nginx.yaml" Jan 13 20:07:35.282213 ignition[1305]: INFO : files: createFilesystemsFiles: createFiles: op(5): [finished] writing file "/sysroot/home/core/nginx.yaml" Jan 13 20:07:35.288566 ignition[1305]: INFO : files: createFilesystemsFiles: createFiles: op(6): [started] writing file "/sysroot/home/core/nfs-pod.yaml" Jan 13 20:07:35.288566 ignition[1305]: INFO : files: createFilesystemsFiles: createFiles: op(6): [finished] writing file "/sysroot/home/core/nfs-pod.yaml" Jan 13 20:07:35.288566 ignition[1305]: INFO : files: createFilesystemsFiles: createFiles: op(7): [started] writing file "/sysroot/home/core/nfs-pvc.yaml" Jan 13 20:07:35.297989 ignition[1305]: INFO : files: createFilesystemsFiles: createFiles: op(7): [finished] writing file "/sysroot/home/core/nfs-pvc.yaml" Jan 13 20:07:35.302159 ignition[1305]: INFO : files: createFilesystemsFiles: createFiles: op(8): [started] writing file "/sysroot/etc/flatcar/update.conf" Jan 13 20:07:35.302159 ignition[1305]: INFO : files: createFilesystemsFiles: createFiles: op(8): [finished] writing file "/sysroot/etc/flatcar/update.conf" Jan 13 20:07:35.302159 ignition[1305]: INFO : files: createFilesystemsFiles: createFiles: op(9): [started] writing link "/sysroot/etc/extensions/kubernetes.raw" -> "/opt/extensions/kubernetes/kubernetes-v1.29.2-arm64.raw" Jan 13 20:07:35.302159 ignition[1305]: INFO : files: createFilesystemsFiles: createFiles: op(9): [finished] writing link "/sysroot/etc/extensions/kubernetes.raw" -> "/opt/extensions/kubernetes/kubernetes-v1.29.2-arm64.raw" Jan 13 20:07:35.302159 ignition[1305]: INFO : files: createFilesystemsFiles: createFiles: op(a): [started] writing file "/sysroot/opt/extensions/kubernetes/kubernetes-v1.29.2-arm64.raw" Jan 13 20:07:35.302159 ignition[1305]: INFO : files: createFilesystemsFiles: createFiles: op(a): GET https://github.com/flatcar/sysext-bakery/releases/download/latest/kubernetes-v1.29.2-arm64.raw: attempt #1 Jan 13 20:07:35.768022 ignition[1305]: INFO : files: createFilesystemsFiles: createFiles: op(a): GET result: OK Jan 13 20:07:36.127892 ignition[1305]: INFO : files: createFilesystemsFiles: createFiles: op(a): [finished] writing file "/sysroot/opt/extensions/kubernetes/kubernetes-v1.29.2-arm64.raw" Jan 13 20:07:36.127892 ignition[1305]: INFO : files: op(b): [started] processing unit "prepare-helm.service" Jan 13 20:07:36.134784 ignition[1305]: INFO : files: op(b): op(c): [started] writing unit "prepare-helm.service" at "/sysroot/etc/systemd/system/prepare-helm.service" Jan 13 20:07:36.134784 ignition[1305]: INFO : files: op(b): op(c): [finished] writing unit "prepare-helm.service" at "/sysroot/etc/systemd/system/prepare-helm.service" Jan 13 20:07:36.134784 ignition[1305]: INFO : files: op(b): [finished] processing unit "prepare-helm.service" Jan 13 20:07:36.134784 ignition[1305]: INFO : files: op(d): [started] setting preset to enabled for "prepare-helm.service" Jan 13 20:07:36.134784 ignition[1305]: INFO : files: op(d): [finished] setting preset to enabled for "prepare-helm.service" Jan 13 20:07:36.134784 ignition[1305]: INFO : files: createResultFile: createFiles: op(e): [started] writing file "/sysroot/etc/.ignition-result.json" Jan 13 20:07:36.134784 ignition[1305]: INFO : files: createResultFile: createFiles: op(e): [finished] writing file "/sysroot/etc/.ignition-result.json" Jan 13 20:07:36.134784 ignition[1305]: INFO : files: files passed Jan 13 20:07:36.134784 ignition[1305]: INFO : Ignition finished successfully Jan 13 20:07:36.135213 systemd[1]: Finished ignition-files.service - Ignition (files). Jan 13 20:07:36.161028 systemd[1]: Starting ignition-quench.service - Ignition (record completion)... Jan 13 20:07:36.171946 systemd[1]: Starting initrd-setup-root-after-ignition.service - Root filesystem completion... Jan 13 20:07:36.188624 systemd[1]: ignition-quench.service: Deactivated successfully. Jan 13 20:07:36.190421 systemd[1]: Finished ignition-quench.service - Ignition (record completion). Jan 13 20:07:36.203913 initrd-setup-root-after-ignition[1334]: grep: /sysroot/etc/flatcar/enabled-sysext.conf: No such file or directory Jan 13 20:07:36.203913 initrd-setup-root-after-ignition[1334]: grep: /sysroot/usr/share/flatcar/enabled-sysext.conf: No such file or directory Jan 13 20:07:36.210241 initrd-setup-root-after-ignition[1338]: grep: /sysroot/etc/flatcar/enabled-sysext.conf: No such file or directory Jan 13 20:07:36.215326 systemd[1]: Finished initrd-setup-root-after-ignition.service - Root filesystem completion. Jan 13 20:07:36.218587 systemd[1]: Reached target ignition-complete.target - Ignition Complete. Jan 13 20:07:36.239400 systemd[1]: Starting initrd-parse-etc.service - Mountpoints Configured in the Real Root... Jan 13 20:07:36.291396 systemd[1]: initrd-parse-etc.service: Deactivated successfully. Jan 13 20:07:36.291590 systemd[1]: Finished initrd-parse-etc.service - Mountpoints Configured in the Real Root. Jan 13 20:07:36.295266 systemd[1]: Reached target initrd-fs.target - Initrd File Systems. Jan 13 20:07:36.301311 systemd[1]: Reached target initrd.target - Initrd Default Target. Jan 13 20:07:36.303259 systemd[1]: dracut-mount.service - dracut mount hook was skipped because no trigger condition checks were met. Jan 13 20:07:36.322621 systemd[1]: Starting dracut-pre-pivot.service - dracut pre-pivot and cleanup hook... Jan 13 20:07:36.361249 systemd[1]: Finished dracut-pre-pivot.service - dracut pre-pivot and cleanup hook. Jan 13 20:07:36.371519 systemd[1]: Starting initrd-cleanup.service - Cleaning Up and Shutting Down Daemons... Jan 13 20:07:36.398661 systemd[1]: Stopped target nss-lookup.target - Host and Network Name Lookups. Jan 13 20:07:36.401394 systemd[1]: Stopped target remote-cryptsetup.target - Remote Encrypted Volumes. Jan 13 20:07:36.405996 systemd[1]: Stopped target timers.target - Timer Units. Jan 13 20:07:36.409016 systemd[1]: dracut-pre-pivot.service: Deactivated successfully. Jan 13 20:07:36.409267 systemd[1]: Stopped dracut-pre-pivot.service - dracut pre-pivot and cleanup hook. Jan 13 20:07:36.417166 systemd[1]: Stopped target initrd.target - Initrd Default Target. Jan 13 20:07:36.419267 systemd[1]: Stopped target basic.target - Basic System. Jan 13 20:07:36.421976 systemd[1]: Stopped target ignition-complete.target - Ignition Complete. Jan 13 20:07:36.428729 systemd[1]: Stopped target ignition-diskful.target - Ignition Boot Disk Setup. Jan 13 20:07:36.431012 systemd[1]: Stopped target initrd-root-device.target - Initrd Root Device. Jan 13 20:07:36.433734 systemd[1]: Stopped target remote-fs.target - Remote File Systems. Jan 13 20:07:36.441016 systemd[1]: Stopped target remote-fs-pre.target - Preparation for Remote File Systems. Jan 13 20:07:36.443417 systemd[1]: Stopped target sysinit.target - System Initialization. Jan 13 20:07:36.445887 systemd[1]: Stopped target local-fs.target - Local File Systems. Jan 13 20:07:36.451751 systemd[1]: Stopped target swap.target - Swaps. Jan 13 20:07:36.453475 systemd[1]: dracut-pre-mount.service: Deactivated successfully. Jan 13 20:07:36.453710 systemd[1]: Stopped dracut-pre-mount.service - dracut pre-mount hook. Jan 13 20:07:36.462473 systemd[1]: Stopped target cryptsetup.target - Local Encrypted Volumes. Jan 13 20:07:36.464632 systemd[1]: Stopped target cryptsetup-pre.target - Local Encrypted Volumes (Pre). Jan 13 20:07:36.467462 systemd[1]: clevis-luks-askpass.path: Deactivated successfully. Jan 13 20:07:36.468690 systemd[1]: Stopped clevis-luks-askpass.path - Forward Password Requests to Clevis Directory Watch. Jan 13 20:07:36.474201 systemd[1]: dracut-initqueue.service: Deactivated successfully. Jan 13 20:07:36.474435 systemd[1]: Stopped dracut-initqueue.service - dracut initqueue hook. Jan 13 20:07:36.484550 systemd[1]: initrd-setup-root-after-ignition.service: Deactivated successfully. Jan 13 20:07:36.484949 systemd[1]: Stopped initrd-setup-root-after-ignition.service - Root filesystem completion. Jan 13 20:07:36.491298 systemd[1]: ignition-files.service: Deactivated successfully. Jan 13 20:07:36.491498 systemd[1]: Stopped ignition-files.service - Ignition (files). Jan 13 20:07:36.503455 systemd[1]: Stopping ignition-mount.service - Ignition (mount)... Jan 13 20:07:36.506515 systemd[1]: kmod-static-nodes.service: Deactivated successfully. Jan 13 20:07:36.506783 systemd[1]: Stopped kmod-static-nodes.service - Create List of Static Device Nodes. Jan 13 20:07:36.528421 systemd[1]: Stopping sysroot-boot.service - /sysroot/boot... Jan 13 20:07:36.537653 systemd[1]: systemd-udev-trigger.service: Deactivated successfully. Jan 13 20:07:36.539041 systemd[1]: Stopped systemd-udev-trigger.service - Coldplug All udev Devices. Jan 13 20:07:36.541671 systemd[1]: dracut-pre-trigger.service: Deactivated successfully. Jan 13 20:07:36.541888 systemd[1]: Stopped dracut-pre-trigger.service - dracut pre-trigger hook. Jan 13 20:07:36.558072 systemd[1]: initrd-cleanup.service: Deactivated successfully. Jan 13 20:07:36.560433 systemd[1]: Finished initrd-cleanup.service - Cleaning Up and Shutting Down Daemons. Jan 13 20:07:36.574274 systemd[1]: sysroot-boot.mount: Deactivated successfully. Jan 13 20:07:36.590003 ignition[1358]: INFO : Ignition 2.20.0 Jan 13 20:07:36.590003 ignition[1358]: INFO : Stage: umount Jan 13 20:07:36.590003 ignition[1358]: INFO : no configs at "/usr/lib/ignition/base.d" Jan 13 20:07:36.590003 ignition[1358]: INFO : no config dir at "/usr/lib/ignition/base.platform.d/aws" Jan 13 20:07:36.590003 ignition[1358]: INFO : PUT http://169.254.169.254/latest/api/token: attempt #1 Jan 13 20:07:36.599449 ignition[1358]: INFO : PUT result: OK Jan 13 20:07:36.604213 ignition[1358]: INFO : umount: umount passed Jan 13 20:07:36.604213 ignition[1358]: INFO : Ignition finished successfully Jan 13 20:07:36.609597 systemd[1]: ignition-mount.service: Deactivated successfully. Jan 13 20:07:36.610004 systemd[1]: Stopped ignition-mount.service - Ignition (mount). Jan 13 20:07:36.618029 systemd[1]: ignition-disks.service: Deactivated successfully. Jan 13 20:07:36.618174 systemd[1]: Stopped ignition-disks.service - Ignition (disks). Jan 13 20:07:36.621616 systemd[1]: ignition-kargs.service: Deactivated successfully. Jan 13 20:07:36.622019 systemd[1]: Stopped ignition-kargs.service - Ignition (kargs). Jan 13 20:07:36.625148 systemd[1]: ignition-fetch.service: Deactivated successfully. Jan 13 20:07:36.625226 systemd[1]: Stopped ignition-fetch.service - Ignition (fetch). Jan 13 20:07:36.627093 systemd[1]: Stopped target network.target - Network. Jan 13 20:07:36.628733 systemd[1]: ignition-fetch-offline.service: Deactivated successfully. Jan 13 20:07:36.628812 systemd[1]: Stopped ignition-fetch-offline.service - Ignition (fetch-offline). Jan 13 20:07:36.631388 systemd[1]: Stopped target paths.target - Path Units. Jan 13 20:07:36.633059 systemd[1]: systemd-ask-password-console.path: Deactivated successfully. Jan 13 20:07:36.640353 systemd[1]: Stopped systemd-ask-password-console.path - Dispatch Password Requests to Console Directory Watch. Jan 13 20:07:36.653722 systemd[1]: Stopped target slices.target - Slice Units. Jan 13 20:07:36.655395 systemd[1]: Stopped target sockets.target - Socket Units. Jan 13 20:07:36.657184 systemd[1]: iscsid.socket: Deactivated successfully. Jan 13 20:07:36.657416 systemd[1]: Closed iscsid.socket - Open-iSCSI iscsid Socket. Jan 13 20:07:36.660573 systemd[1]: iscsiuio.socket: Deactivated successfully. Jan 13 20:07:36.660638 systemd[1]: Closed iscsiuio.socket - Open-iSCSI iscsiuio Socket. Jan 13 20:07:36.662528 systemd[1]: ignition-setup.service: Deactivated successfully. Jan 13 20:07:36.662610 systemd[1]: Stopped ignition-setup.service - Ignition (setup). Jan 13 20:07:36.664665 systemd[1]: ignition-setup-pre.service: Deactivated successfully. Jan 13 20:07:36.664742 systemd[1]: Stopped ignition-setup-pre.service - Ignition env setup. Jan 13 20:07:36.668295 systemd[1]: Stopping systemd-networkd.service - Network Configuration... Jan 13 20:07:36.670496 systemd[1]: Stopping systemd-resolved.service - Network Name Resolution... Jan 13 20:07:36.691878 systemd-networkd[1115]: eth0: DHCPv6 lease lost Jan 13 20:07:36.695656 systemd[1]: systemd-networkd.service: Deactivated successfully. Jan 13 20:07:36.696958 systemd[1]: Stopped systemd-networkd.service - Network Configuration. Jan 13 20:07:36.715581 systemd[1]: systemd-networkd.socket: Deactivated successfully. Jan 13 20:07:36.715838 systemd[1]: Closed systemd-networkd.socket - Network Service Netlink Socket. Jan 13 20:07:36.731290 systemd[1]: Stopping network-cleanup.service - Network Cleanup... Jan 13 20:07:36.735869 systemd[1]: parse-ip-for-networkd.service: Deactivated successfully. Jan 13 20:07:36.735986 systemd[1]: Stopped parse-ip-for-networkd.service - Write systemd-networkd units from cmdline. Jan 13 20:07:36.739566 systemd[1]: Stopping systemd-udevd.service - Rule-based Manager for Device Events and Files... Jan 13 20:07:36.757286 systemd[1]: systemd-resolved.service: Deactivated successfully. Jan 13 20:07:36.757498 systemd[1]: Stopped systemd-resolved.service - Network Name Resolution. Jan 13 20:07:36.766757 systemd[1]: sysroot-boot.service: Deactivated successfully. Jan 13 20:07:36.767206 systemd[1]: Stopped sysroot-boot.service - /sysroot/boot. Jan 13 20:07:36.769664 systemd[1]: systemd-udevd.service: Deactivated successfully. Jan 13 20:07:36.771482 systemd[1]: Stopped systemd-udevd.service - Rule-based Manager for Device Events and Files. Jan 13 20:07:36.792665 systemd[1]: systemd-udevd-control.socket: Deactivated successfully. Jan 13 20:07:36.792807 systemd[1]: Closed systemd-udevd-control.socket - udev Control Socket. Jan 13 20:07:36.797092 systemd[1]: systemd-udevd-kernel.socket: Deactivated successfully. Jan 13 20:07:36.800968 systemd[1]: Closed systemd-udevd-kernel.socket - udev Kernel Socket. Jan 13 20:07:36.802944 systemd[1]: dracut-pre-udev.service: Deactivated successfully. Jan 13 20:07:36.803030 systemd[1]: Stopped dracut-pre-udev.service - dracut pre-udev hook. Jan 13 20:07:36.805234 systemd[1]: dracut-cmdline.service: Deactivated successfully. Jan 13 20:07:36.805313 systemd[1]: Stopped dracut-cmdline.service - dracut cmdline hook. Jan 13 20:07:36.815925 systemd[1]: dracut-cmdline-ask.service: Deactivated successfully. Jan 13 20:07:36.816015 systemd[1]: Stopped dracut-cmdline-ask.service - dracut ask for additional cmdline parameters. Jan 13 20:07:36.818856 systemd[1]: initrd-setup-root.service: Deactivated successfully. Jan 13 20:07:36.818942 systemd[1]: Stopped initrd-setup-root.service - Root filesystem setup. Jan 13 20:07:36.834519 systemd[1]: Starting initrd-udevadm-cleanup-db.service - Cleanup udev Database... Jan 13 20:07:36.838328 systemd[1]: systemd-sysctl.service: Deactivated successfully. Jan 13 20:07:36.838444 systemd[1]: Stopped systemd-sysctl.service - Apply Kernel Variables. Jan 13 20:07:36.841340 systemd[1]: systemd-modules-load.service: Deactivated successfully. Jan 13 20:07:36.841440 systemd[1]: Stopped systemd-modules-load.service - Load Kernel Modules. Jan 13 20:07:36.843557 systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. Jan 13 20:07:36.843647 systemd[1]: Stopped systemd-tmpfiles-setup-dev.service - Create Static Device Nodes in /dev. Jan 13 20:07:36.854565 systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. Jan 13 20:07:36.854665 systemd[1]: Stopped systemd-tmpfiles-setup.service - Create System Files and Directories. Jan 13 20:07:36.861302 systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. Jan 13 20:07:36.863407 systemd[1]: Stopped systemd-vconsole-setup.service - Virtual Console Setup. Jan 13 20:07:36.866276 systemd[1]: network-cleanup.service: Deactivated successfully. Jan 13 20:07:36.866557 systemd[1]: Stopped network-cleanup.service - Network Cleanup. Jan 13 20:07:36.893294 systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. Jan 13 20:07:36.893473 systemd[1]: Finished initrd-udevadm-cleanup-db.service - Cleanup udev Database. Jan 13 20:07:36.898069 systemd[1]: Reached target initrd-switch-root.target - Switch Root. Jan 13 20:07:36.914592 systemd[1]: Starting initrd-switch-root.service - Switch Root... Jan 13 20:07:36.934861 systemd[1]: Switching root. Jan 13 20:07:36.991262 systemd-journald[252]: Journal stopped Jan 13 20:07:40.224153 systemd-journald[252]: Received SIGTERM from PID 1 (systemd). Jan 13 20:07:40.224310 kernel: SELinux: policy capability network_peer_controls=1 Jan 13 20:07:40.224354 kernel: SELinux: policy capability open_perms=1 Jan 13 20:07:40.224386 kernel: SELinux: policy capability extended_socket_class=1 Jan 13 20:07:40.224424 kernel: SELinux: policy capability always_check_network=0 Jan 13 20:07:40.224454 kernel: SELinux: policy capability cgroup_seclabel=1 Jan 13 20:07:40.224495 kernel: SELinux: policy capability nnp_nosuid_transition=1 Jan 13 20:07:40.224524 kernel: SELinux: policy capability genfs_seclabel_symlinks=0 Jan 13 20:07:40.224555 kernel: SELinux: policy capability ioctl_skip_cloexec=0 Jan 13 20:07:40.224583 kernel: audit: type=1403 audit(1736798858.300:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 Jan 13 20:07:40.224624 systemd[1]: Successfully loaded SELinux policy in 94ms. Jan 13 20:07:40.224669 systemd[1]: Relabeled /dev, /dev/shm, /run, /sys/fs/cgroup in 23.033ms. Jan 13 20:07:40.224702 systemd[1]: systemd 255 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL -ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY -P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK -XKBCOMMON +UTMP -SYSVINIT default-hierarchy=unified) Jan 13 20:07:40.224734 systemd[1]: Detected virtualization amazon. Jan 13 20:07:40.224763 systemd[1]: Detected architecture arm64. Jan 13 20:07:40.224792 systemd[1]: Detected first boot. Jan 13 20:07:40.224823 systemd[1]: Initializing machine ID from VM UUID. Jan 13 20:07:40.224853 zram_generator::config[1401]: No configuration found. Jan 13 20:07:40.224892 systemd[1]: Populated /etc with preset unit settings. Jan 13 20:07:40.224922 systemd[1]: initrd-switch-root.service: Deactivated successfully. Jan 13 20:07:40.224953 systemd[1]: Stopped initrd-switch-root.service - Switch Root. Jan 13 20:07:40.224985 systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. Jan 13 20:07:40.225017 systemd[1]: Created slice system-addon\x2dconfig.slice - Slice /system/addon-config. Jan 13 20:07:40.225048 systemd[1]: Created slice system-addon\x2drun.slice - Slice /system/addon-run. Jan 13 20:07:40.225082 systemd[1]: Created slice system-getty.slice - Slice /system/getty. Jan 13 20:07:40.225111 systemd[1]: Created slice system-modprobe.slice - Slice /system/modprobe. Jan 13 20:07:40.225686 systemd[1]: Created slice system-serial\x2dgetty.slice - Slice /system/serial-getty. Jan 13 20:07:40.225727 systemd[1]: Created slice system-system\x2dcloudinit.slice - Slice /system/system-cloudinit. Jan 13 20:07:40.225757 systemd[1]: Created slice system-systemd\x2dfsck.slice - Slice /system/systemd-fsck. Jan 13 20:07:40.225788 systemd[1]: Created slice user.slice - User and Session Slice. Jan 13 20:07:40.227466 systemd[1]: Started clevis-luks-askpass.path - Forward Password Requests to Clevis Directory Watch. Jan 13 20:07:40.228601 systemd[1]: Started systemd-ask-password-console.path - Dispatch Password Requests to Console Directory Watch. Jan 13 20:07:40.230579 systemd[1]: Started systemd-ask-password-wall.path - Forward Password Requests to Wall Directory Watch. Jan 13 20:07:40.230615 systemd[1]: Set up automount boot.automount - Boot partition Automount Point. Jan 13 20:07:40.230647 systemd[1]: Set up automount proc-sys-fs-binfmt_misc.automount - Arbitrary Executable File Formats File System Automount Point. Jan 13 20:07:40.230687 systemd[1]: Expecting device dev-disk-by\x2dlabel-OEM.device - /dev/disk/by-label/OEM... Jan 13 20:07:40.230720 systemd[1]: Expecting device dev-ttyS0.device - /dev/ttyS0... Jan 13 20:07:40.230751 systemd[1]: Reached target cryptsetup-pre.target - Local Encrypted Volumes (Pre). Jan 13 20:07:40.230781 systemd[1]: Stopped target initrd-switch-root.target - Switch Root. Jan 13 20:07:40.230812 systemd[1]: Stopped target initrd-fs.target - Initrd File Systems. Jan 13 20:07:40.230842 systemd[1]: Stopped target initrd-root-fs.target - Initrd Root File System. Jan 13 20:07:40.230871 systemd[1]: Reached target integritysetup.target - Local Integrity Protected Volumes. Jan 13 20:07:40.230900 systemd[1]: Reached target remote-cryptsetup.target - Remote Encrypted Volumes. Jan 13 20:07:40.230934 systemd[1]: Reached target remote-fs.target - Remote File Systems. Jan 13 20:07:40.230965 systemd[1]: Reached target slices.target - Slice Units. Jan 13 20:07:40.230996 systemd[1]: Reached target swap.target - Swaps. Jan 13 20:07:40.231024 systemd[1]: Reached target veritysetup.target - Local Verity Protected Volumes. Jan 13 20:07:40.231058 systemd[1]: Listening on systemd-coredump.socket - Process Core Dump Socket. Jan 13 20:07:40.231090 systemd[1]: Listening on systemd-networkd.socket - Network Service Netlink Socket. Jan 13 20:07:40.231466 systemd[1]: Listening on systemd-udevd-control.socket - udev Control Socket. Jan 13 20:07:40.231513 systemd[1]: Listening on systemd-udevd-kernel.socket - udev Kernel Socket. Jan 13 20:07:40.231543 systemd[1]: Listening on systemd-userdbd.socket - User Database Manager Socket. Jan 13 20:07:40.231582 systemd[1]: Mounting dev-hugepages.mount - Huge Pages File System... Jan 13 20:07:40.231613 systemd[1]: Mounting dev-mqueue.mount - POSIX Message Queue File System... Jan 13 20:07:40.232084 systemd[1]: Mounting media.mount - External Media Directory... Jan 13 20:07:40.232875 systemd[1]: Mounting sys-kernel-debug.mount - Kernel Debug File System... Jan 13 20:07:40.232912 systemd[1]: Mounting sys-kernel-tracing.mount - Kernel Trace File System... Jan 13 20:07:40.232941 systemd[1]: Mounting tmp.mount - Temporary Directory /tmp... Jan 13 20:07:40.232970 systemd[1]: var-lib-machines.mount - Virtual Machine and Container Storage (Compatibility) was skipped because of an unmet condition check (ConditionPathExists=/var/lib/machines.raw). Jan 13 20:07:40.232999 systemd[1]: Reached target machines.target - Containers. Jan 13 20:07:40.233027 systemd[1]: Starting flatcar-tmpfiles.service - Create missing system files... Jan 13 20:07:40.233062 systemd[1]: ignition-delete-config.service - Ignition (delete config) was skipped because no trigger condition checks were met. Jan 13 20:07:40.233090 systemd[1]: Starting kmod-static-nodes.service - Create List of Static Device Nodes... Jan 13 20:07:40.233487 systemd[1]: Starting modprobe@configfs.service - Load Kernel Module configfs... Jan 13 20:07:40.233525 systemd[1]: Starting modprobe@dm_mod.service - Load Kernel Module dm_mod... Jan 13 20:07:40.233556 systemd[1]: Starting modprobe@drm.service - Load Kernel Module drm... Jan 13 20:07:40.233586 systemd[1]: Starting modprobe@efi_pstore.service - Load Kernel Module efi_pstore... Jan 13 20:07:40.233618 systemd[1]: Starting modprobe@fuse.service - Load Kernel Module fuse... Jan 13 20:07:40.233648 systemd[1]: Starting modprobe@loop.service - Load Kernel Module loop... Jan 13 20:07:40.233683 systemd[1]: setup-nsswitch.service - Create /etc/nsswitch.conf was skipped because of an unmet condition check (ConditionPathExists=!/etc/nsswitch.conf). Jan 13 20:07:40.233715 systemd[1]: systemd-fsck-root.service: Deactivated successfully. Jan 13 20:07:40.233745 systemd[1]: Stopped systemd-fsck-root.service - File System Check on Root Device. Jan 13 20:07:40.233774 systemd[1]: systemd-fsck-usr.service: Deactivated successfully. Jan 13 20:07:40.233801 systemd[1]: Stopped systemd-fsck-usr.service. Jan 13 20:07:40.233829 systemd[1]: Starting systemd-journald.service - Journal Service... Jan 13 20:07:40.233857 systemd[1]: Starting systemd-modules-load.service - Load Kernel Modules... Jan 13 20:07:40.233887 kernel: fuse: init (API version 7.39) Jan 13 20:07:40.233914 kernel: loop: module loaded Jan 13 20:07:40.233946 systemd[1]: Starting systemd-network-generator.service - Generate network units from Kernel command line... Jan 13 20:07:40.233979 systemd[1]: Starting systemd-remount-fs.service - Remount Root and Kernel File Systems... Jan 13 20:07:40.234009 systemd[1]: Starting systemd-udev-trigger.service - Coldplug All udev Devices... Jan 13 20:07:40.234039 systemd[1]: verity-setup.service: Deactivated successfully. Jan 13 20:07:40.234068 systemd[1]: Stopped verity-setup.service. Jan 13 20:07:40.234102 systemd[1]: Mounted dev-hugepages.mount - Huge Pages File System. Jan 13 20:07:40.236487 systemd[1]: Mounted dev-mqueue.mount - POSIX Message Queue File System. Jan 13 20:07:40.236529 kernel: ACPI: bus type drm_connector registered Jan 13 20:07:40.236558 systemd[1]: Mounted media.mount - External Media Directory. Jan 13 20:07:40.236595 systemd[1]: Mounted sys-kernel-debug.mount - Kernel Debug File System. Jan 13 20:07:40.236627 systemd[1]: Mounted sys-kernel-tracing.mount - Kernel Trace File System. Jan 13 20:07:40.236656 systemd[1]: Mounted tmp.mount - Temporary Directory /tmp. Jan 13 20:07:40.236685 systemd[1]: Finished kmod-static-nodes.service - Create List of Static Device Nodes. Jan 13 20:07:40.236713 systemd[1]: modprobe@configfs.service: Deactivated successfully. Jan 13 20:07:40.236745 systemd[1]: Finished modprobe@configfs.service - Load Kernel Module configfs. Jan 13 20:07:40.236776 systemd[1]: modprobe@dm_mod.service: Deactivated successfully. Jan 13 20:07:40.236807 systemd[1]: Finished modprobe@dm_mod.service - Load Kernel Module dm_mod. Jan 13 20:07:40.236836 systemd[1]: modprobe@drm.service: Deactivated successfully. Jan 13 20:07:40.236867 systemd[1]: Finished modprobe@drm.service - Load Kernel Module drm. Jan 13 20:07:40.236898 systemd[1]: modprobe@efi_pstore.service: Deactivated successfully. Jan 13 20:07:40.236927 systemd[1]: Finished modprobe@efi_pstore.service - Load Kernel Module efi_pstore. Jan 13 20:07:40.236955 systemd[1]: modprobe@fuse.service: Deactivated successfully. Jan 13 20:07:40.236988 systemd[1]: Finished modprobe@fuse.service - Load Kernel Module fuse. Jan 13 20:07:40.237017 systemd[1]: modprobe@loop.service: Deactivated successfully. Jan 13 20:07:40.237089 systemd-journald[1479]: Collecting audit messages is disabled. Jan 13 20:07:40.242239 systemd[1]: Finished modprobe@loop.service - Load Kernel Module loop. Jan 13 20:07:40.242309 systemd[1]: Finished systemd-modules-load.service - Load Kernel Modules. Jan 13 20:07:40.242351 systemd[1]: Finished systemd-network-generator.service - Generate network units from Kernel command line. Jan 13 20:07:40.242383 systemd[1]: Finished systemd-remount-fs.service - Remount Root and Kernel File Systems. Jan 13 20:07:40.242413 systemd[1]: Reached target network-pre.target - Preparation for Network. Jan 13 20:07:40.242444 systemd-journald[1479]: Journal started Jan 13 20:07:40.242502 systemd-journald[1479]: Runtime Journal (/run/log/journal/ec28b0b92f52e4c12763d95a68d2750d) is 8.0M, max 75.3M, 67.3M free. Jan 13 20:07:39.574045 systemd[1]: Queued start job for default target multi-user.target. Jan 13 20:07:39.661491 systemd[1]: Unnecessary job was removed for dev-nvme0n1p6.device - /dev/nvme0n1p6. Jan 13 20:07:39.662286 systemd[1]: systemd-journald.service: Deactivated successfully. Jan 13 20:07:40.254169 systemd[1]: Mounting sys-fs-fuse-connections.mount - FUSE Control File System... Jan 13 20:07:40.274218 systemd[1]: Mounting sys-kernel-config.mount - Kernel Configuration File System... Jan 13 20:07:40.274328 systemd[1]: remount-root.service - Remount Root File System was skipped because of an unmet condition check (ConditionPathIsReadWrite=!/). Jan 13 20:07:40.278933 systemd[1]: Reached target local-fs.target - Local File Systems. Jan 13 20:07:40.290154 systemd[1]: Listening on systemd-sysext.socket - System Extension Image Management (Varlink). Jan 13 20:07:40.304777 systemd[1]: Starting dracut-shutdown.service - Restore /run/initramfs on shutdown... Jan 13 20:07:40.316690 systemd[1]: Starting ldconfig.service - Rebuild Dynamic Linker Cache... Jan 13 20:07:40.321173 systemd[1]: systemd-binfmt.service - Set Up Additional Binary Formats was skipped because no trigger condition checks were met. Jan 13 20:07:40.334195 systemd[1]: Starting systemd-hwdb-update.service - Rebuild Hardware Database... Jan 13 20:07:40.334282 systemd[1]: systemd-pstore.service - Platform Persistent Storage Archival was skipped because of an unmet condition check (ConditionDirectoryNotEmpty=/sys/fs/pstore). Jan 13 20:07:40.350513 systemd[1]: Starting systemd-random-seed.service - Load/Save OS Random Seed... Jan 13 20:07:40.356174 systemd[1]: systemd-repart.service - Repartition Root Disk was skipped because no trigger condition checks were met. Jan 13 20:07:40.363204 systemd[1]: Starting systemd-sysctl.service - Apply Kernel Variables... Jan 13 20:07:40.374176 systemd[1]: Starting systemd-sysext.service - Merge System Extension Images into /usr/ and /opt/... Jan 13 20:07:40.379158 systemd[1]: Started systemd-journald.service - Journal Service. Jan 13 20:07:40.383228 systemd[1]: Finished flatcar-tmpfiles.service - Create missing system files. Jan 13 20:07:40.385912 systemd[1]: Mounted sys-fs-fuse-connections.mount - FUSE Control File System. Jan 13 20:07:40.389552 systemd[1]: Mounted sys-kernel-config.mount - Kernel Configuration File System. Jan 13 20:07:40.395678 systemd[1]: Finished dracut-shutdown.service - Restore /run/initramfs on shutdown. Jan 13 20:07:40.442043 systemd[1]: Finished systemd-random-seed.service - Load/Save OS Random Seed. Jan 13 20:07:40.445478 systemd[1]: Finished systemd-udev-trigger.service - Coldplug All udev Devices. Jan 13 20:07:40.459111 systemd[1]: Reached target first-boot-complete.target - First Boot Complete. Jan 13 20:07:40.467275 kernel: loop0: detected capacity change from 0 to 116784 Jan 13 20:07:40.471482 systemd[1]: Starting systemd-journal-flush.service - Flush Journal to Persistent Storage... Jan 13 20:07:40.483093 systemd[1]: Starting systemd-machine-id-commit.service - Commit a transient machine-id on disk... Jan 13 20:07:40.496535 systemd[1]: Starting systemd-sysusers.service - Create System Users... Jan 13 20:07:40.501461 systemd[1]: Starting systemd-udev-settle.service - Wait for udev To Complete Device Initialization... Jan 13 20:07:40.505167 systemd[1]: Finished systemd-sysctl.service - Apply Kernel Variables. Jan 13 20:07:40.532937 systemd[1]: etc-machine\x2did.mount: Deactivated successfully. Jan 13 20:07:40.534370 systemd[1]: Finished systemd-machine-id-commit.service - Commit a transient machine-id on disk. Jan 13 20:07:40.559882 systemd-journald[1479]: Time spent on flushing to /var/log/journal/ec28b0b92f52e4c12763d95a68d2750d is 45.772ms for 914 entries. Jan 13 20:07:40.559882 systemd-journald[1479]: System Journal (/var/log/journal/ec28b0b92f52e4c12763d95a68d2750d) is 8.0M, max 195.6M, 187.6M free. Jan 13 20:07:40.658902 systemd-journald[1479]: Received client request to flush runtime journal. Jan 13 20:07:40.658998 kernel: squashfs: version 4.0 (2009/01/31) Phillip Lougher Jan 13 20:07:40.659049 kernel: loop1: detected capacity change from 0 to 194512 Jan 13 20:07:40.562253 udevadm[1540]: systemd-udev-settle.service is deprecated. Please fix lvm2-activation.service, lvm2-activation-early.service not to pull it in. Jan 13 20:07:40.639210 systemd[1]: Finished systemd-sysusers.service - Create System Users. Jan 13 20:07:40.654973 systemd[1]: Starting systemd-tmpfiles-setup-dev.service - Create Static Device Nodes in /dev... Jan 13 20:07:40.672036 systemd[1]: Finished systemd-journal-flush.service - Flush Journal to Persistent Storage. Jan 13 20:07:40.716183 kernel: loop2: detected capacity change from 0 to 113552 Jan 13 20:07:40.758320 systemd-tmpfiles[1548]: ACLs are not supported, ignoring. Jan 13 20:07:40.759047 systemd-tmpfiles[1548]: ACLs are not supported, ignoring. Jan 13 20:07:40.770239 systemd[1]: Finished systemd-tmpfiles-setup-dev.service - Create Static Device Nodes in /dev. Jan 13 20:07:40.891469 kernel: loop3: detected capacity change from 0 to 53784 Jan 13 20:07:41.050185 kernel: loop4: detected capacity change from 0 to 116784 Jan 13 20:07:41.068228 kernel: loop5: detected capacity change from 0 to 194512 Jan 13 20:07:41.096307 kernel: loop6: detected capacity change from 0 to 113552 Jan 13 20:07:41.114676 kernel: loop7: detected capacity change from 0 to 53784 Jan 13 20:07:41.126876 (sd-merge)[1556]: Using extensions 'containerd-flatcar', 'docker-flatcar', 'kubernetes', 'oem-ami'. Jan 13 20:07:41.127840 (sd-merge)[1556]: Merged extensions into '/usr'. Jan 13 20:07:41.135464 systemd[1]: Reloading requested from client PID 1512 ('systemd-sysext') (unit systemd-sysext.service)... Jan 13 20:07:41.135495 systemd[1]: Reloading... Jan 13 20:07:41.321260 zram_generator::config[1582]: No configuration found. Jan 13 20:07:41.618971 systemd[1]: /usr/lib/systemd/system/docker.socket:6: ListenStream= references a path below legacy directory /var/run/, updating /var/run/docker.sock → /run/docker.sock; please update the unit file accordingly. Jan 13 20:07:41.732923 systemd[1]: Reloading finished in 595 ms. Jan 13 20:07:41.771240 systemd[1]: Finished systemd-hwdb-update.service - Rebuild Hardware Database. Jan 13 20:07:41.774065 systemd[1]: Finished systemd-sysext.service - Merge System Extension Images into /usr/ and /opt/. Jan 13 20:07:41.790461 systemd[1]: Starting ensure-sysext.service... Jan 13 20:07:41.798673 systemd[1]: Starting systemd-tmpfiles-setup.service - Create System Files and Directories... Jan 13 20:07:41.806469 systemd[1]: Starting systemd-udevd.service - Rule-based Manager for Device Events and Files... Jan 13 20:07:41.822394 systemd[1]: Reloading requested from client PID 1634 ('systemctl') (unit ensure-sysext.service)... Jan 13 20:07:41.822413 systemd[1]: Reloading... Jan 13 20:07:41.902733 systemd-tmpfiles[1635]: /usr/lib/tmpfiles.d/provision.conf:20: Duplicate line for path "/root", ignoring. Jan 13 20:07:41.905773 systemd-tmpfiles[1635]: /usr/lib/tmpfiles.d/systemd-flatcar.conf:6: Duplicate line for path "/var/log/journal", ignoring. Jan 13 20:07:41.911054 systemd-tmpfiles[1635]: /usr/lib/tmpfiles.d/systemd.conf:29: Duplicate line for path "/var/lib/systemd", ignoring. Jan 13 20:07:41.914826 systemd-tmpfiles[1635]: ACLs are not supported, ignoring. Jan 13 20:07:41.918398 systemd-tmpfiles[1635]: ACLs are not supported, ignoring. Jan 13 20:07:41.947631 systemd-udevd[1636]: Using default interface naming scheme 'v255'. Jan 13 20:07:41.949494 systemd-tmpfiles[1635]: Detected autofs mount point /boot during canonicalization of boot. Jan 13 20:07:41.949510 systemd-tmpfiles[1635]: Skipping /boot Jan 13 20:07:41.972153 zram_generator::config[1658]: No configuration found. Jan 13 20:07:42.009898 systemd-tmpfiles[1635]: Detected autofs mount point /boot during canonicalization of boot. Jan 13 20:07:42.009930 systemd-tmpfiles[1635]: Skipping /boot Jan 13 20:07:42.255972 (udev-worker)[1697]: Network interface NamePolicy= disabled on kernel command line. Jan 13 20:07:42.323086 systemd[1]: /usr/lib/systemd/system/docker.socket:6: ListenStream= references a path below legacy directory /var/run/, updating /var/run/docker.sock → /run/docker.sock; please update the unit file accordingly. Jan 13 20:07:42.328186 ldconfig[1508]: /sbin/ldconfig: /usr/lib/ld.so.conf is not an ELF file - it has the wrong magic bytes at the start. Jan 13 20:07:42.494569 systemd[1]: Condition check resulted in dev-ttyS0.device - /dev/ttyS0 being skipped. Jan 13 20:07:42.495968 systemd[1]: Reloading finished in 672 ms. Jan 13 20:07:42.532062 systemd[1]: Started systemd-udevd.service - Rule-based Manager for Device Events and Files. Jan 13 20:07:42.536693 systemd[1]: Finished ldconfig.service - Rebuild Dynamic Linker Cache. Jan 13 20:07:42.552213 systemd[1]: Finished systemd-tmpfiles-setup.service - Create System Files and Directories. Jan 13 20:07:42.598194 kernel: BTRFS warning: duplicate device /dev/nvme0n1p3 devid 1 generation 38 scanned by (udev-worker) (1724) Jan 13 20:07:42.606846 systemd[1]: Finished ensure-sysext.service. Jan 13 20:07:42.636317 systemd[1]: Starting audit-rules.service - Load Audit Rules... Jan 13 20:07:42.647232 systemd[1]: Starting clean-ca-certificates.service - Clean up broken links in /etc/ssl/certs... Jan 13 20:07:42.650579 systemd[1]: ignition-delete-config.service - Ignition (delete config) was skipped because no trigger condition checks were met. Jan 13 20:07:42.655489 systemd[1]: Starting modprobe@dm_mod.service - Load Kernel Module dm_mod... Jan 13 20:07:42.684850 systemd[1]: Starting modprobe@drm.service - Load Kernel Module drm... Jan 13 20:07:42.690472 systemd[1]: Starting modprobe@efi_pstore.service - Load Kernel Module efi_pstore... Jan 13 20:07:42.697402 systemd[1]: Starting modprobe@loop.service - Load Kernel Module loop... Jan 13 20:07:42.699662 systemd[1]: systemd-binfmt.service - Set Up Additional Binary Formats was skipped because no trigger condition checks were met. Jan 13 20:07:42.705897 systemd[1]: Starting systemd-journal-catalog-update.service - Rebuild Journal Catalog... Jan 13 20:07:42.715352 systemd[1]: Starting systemd-networkd.service - Network Configuration... Jan 13 20:07:42.725235 systemd[1]: Starting systemd-resolved.service - Network Name Resolution... Jan 13 20:07:42.727456 systemd[1]: Reached target time-set.target - System Time Set. Jan 13 20:07:42.733437 systemd[1]: Starting systemd-update-utmp.service - Record System Boot/Shutdown in UTMP... Jan 13 20:07:42.743393 systemd[1]: Starting systemd-vconsole-setup.service - Virtual Console Setup... Jan 13 20:07:42.746741 systemd[1]: modprobe@dm_mod.service: Deactivated successfully. Jan 13 20:07:42.747042 systemd[1]: Finished modprobe@dm_mod.service - Load Kernel Module dm_mod. Jan 13 20:07:42.749830 systemd[1]: modprobe@drm.service: Deactivated successfully. Jan 13 20:07:42.750155 systemd[1]: Finished modprobe@drm.service - Load Kernel Module drm. Jan 13 20:07:42.774239 systemd[1]: modprobe@efi_pstore.service: Deactivated successfully. Jan 13 20:07:42.775160 systemd[1]: Finished modprobe@efi_pstore.service - Load Kernel Module efi_pstore. Jan 13 20:07:42.777984 systemd[1]: systemd-pstore.service - Platform Persistent Storage Archival was skipped because of an unmet condition check (ConditionDirectoryNotEmpty=/sys/fs/pstore). Jan 13 20:07:42.802642 systemd[1]: Starting systemd-userdbd.service - User Database Manager... Jan 13 20:07:42.820290 systemd[1]: modprobe@loop.service: Deactivated successfully. Jan 13 20:07:42.820689 systemd[1]: Finished modprobe@loop.service - Load Kernel Module loop. Jan 13 20:07:42.824969 systemd[1]: systemd-repart.service - Repartition Root Disk was skipped because no trigger condition checks were met. Jan 13 20:07:42.877215 systemd[1]: Finished systemd-update-utmp.service - Record System Boot/Shutdown in UTMP. Jan 13 20:07:42.894467 systemd[1]: Finished systemd-journal-catalog-update.service - Rebuild Journal Catalog. Jan 13 20:07:42.918414 systemd[1]: Starting systemd-update-done.service - Update is Completed... Jan 13 20:07:42.952225 augenrules[1862]: No rules Jan 13 20:07:42.956544 systemd[1]: audit-rules.service: Deactivated successfully. Jan 13 20:07:42.958827 systemd[1]: Finished audit-rules.service - Load Audit Rules. Jan 13 20:07:42.982673 systemd[1]: Finished clean-ca-certificates.service - Clean up broken links in /etc/ssl/certs. Jan 13 20:07:42.986623 systemd[1]: Finished systemd-update-done.service - Update is Completed. Jan 13 20:07:42.990336 systemd[1]: update-ca-certificates.service - Update CA bundle at /etc/ssl/certs/ca-certificates.crt was skipped because of an unmet condition check (ConditionPathIsSymbolicLink=!/etc/ssl/certs/ca-certificates.crt). Jan 13 20:07:43.054207 systemd[1]: Found device dev-disk-by\x2dlabel-OEM.device - Amazon Elastic Block Store OEM. Jan 13 20:07:43.073558 systemd[1]: Starting systemd-fsck@dev-disk-by\x2dlabel-OEM.service - File System Check on /dev/disk/by-label/OEM... Jan 13 20:07:43.076402 systemd[1]: Started systemd-userdbd.service - User Database Manager. Jan 13 20:07:43.081891 systemd[1]: Finished systemd-udev-settle.service - Wait for udev To Complete Device Initialization. Jan 13 20:07:43.097607 systemd[1]: Starting lvm2-activation-early.service - Activation of LVM2 logical volumes... Jan 13 20:07:43.140325 systemd[1]: Finished systemd-vconsole-setup.service - Virtual Console Setup. Jan 13 20:07:43.161973 lvm[1887]: WARNING: Failed to connect to lvmetad. Falling back to device scanning. Jan 13 20:07:43.167208 systemd[1]: Finished systemd-fsck@dev-disk-by\x2dlabel-OEM.service - File System Check on /dev/disk/by-label/OEM. Jan 13 20:07:43.201403 systemd[1]: Finished lvm2-activation-early.service - Activation of LVM2 logical volumes. Jan 13 20:07:43.204319 systemd[1]: Reached target cryptsetup.target - Local Encrypted Volumes. Jan 13 20:07:43.218953 systemd[1]: Starting lvm2-activation.service - Activation of LVM2 logical volumes... Jan 13 20:07:43.235929 systemd-networkd[1804]: lo: Link UP Jan 13 20:07:43.236430 systemd-networkd[1804]: lo: Gained carrier Jan 13 20:07:43.239378 systemd-networkd[1804]: Enumeration completed Jan 13 20:07:43.239694 systemd[1]: Started systemd-networkd.service - Network Configuration. Jan 13 20:07:43.242980 systemd-networkd[1804]: eth0: found matching network '/usr/lib/systemd/network/zz-default.network', based on potentially unpredictable interface name. Jan 13 20:07:43.244984 systemd-networkd[1804]: eth0: Configuring with /usr/lib/systemd/network/zz-default.network. Jan 13 20:07:43.247248 systemd-networkd[1804]: eth0: Link UP Jan 13 20:07:43.247729 systemd-networkd[1804]: eth0: Gained carrier Jan 13 20:07:43.247768 systemd-networkd[1804]: eth0: found matching network '/usr/lib/systemd/network/zz-default.network', based on potentially unpredictable interface name. Jan 13 20:07:43.250453 systemd[1]: Starting systemd-networkd-wait-online.service - Wait for Network to be Configured... Jan 13 20:07:43.258233 systemd-networkd[1804]: eth0: DHCPv4 address 172.31.28.23/20, gateway 172.31.16.1 acquired from 172.31.16.1 Jan 13 20:07:43.259804 lvm[1895]: WARNING: Failed to connect to lvmetad. Falling back to device scanning. Jan 13 20:07:43.293692 systemd-resolved[1807]: Positive Trust Anchors: Jan 13 20:07:43.294216 systemd-resolved[1807]: . IN DS 20326 8 2 e06d44b80b8f1d39a95c0b0d7c65d08458e880409bbc683457104237c7f8ec8d Jan 13 20:07:43.294303 systemd-resolved[1807]: Negative trust anchors: home.arpa 10.in-addr.arpa 16.172.in-addr.arpa 17.172.in-addr.arpa 18.172.in-addr.arpa 19.172.in-addr.arpa 20.172.in-addr.arpa 21.172.in-addr.arpa 22.172.in-addr.arpa 23.172.in-addr.arpa 24.172.in-addr.arpa 25.172.in-addr.arpa 26.172.in-addr.arpa 27.172.in-addr.arpa 28.172.in-addr.arpa 29.172.in-addr.arpa 30.172.in-addr.arpa 31.172.in-addr.arpa 170.0.0.192.in-addr.arpa 171.0.0.192.in-addr.arpa 168.192.in-addr.arpa d.f.ip6.arpa ipv4only.arpa resolver.arpa corp home internal intranet lan local private test Jan 13 20:07:43.302971 systemd-resolved[1807]: Defaulting to hostname 'linux'. Jan 13 20:07:43.306079 systemd[1]: Started systemd-resolved.service - Network Name Resolution. Jan 13 20:07:43.308335 systemd[1]: Reached target network.target - Network. Jan 13 20:07:43.310029 systemd[1]: Reached target nss-lookup.target - Host and Network Name Lookups. Jan 13 20:07:43.312265 systemd[1]: Reached target sysinit.target - System Initialization. Jan 13 20:07:43.314387 systemd[1]: Started motdgen.path - Watch for update engine configuration changes. Jan 13 20:07:43.316688 systemd[1]: Started user-cloudinit@var-lib-flatcar\x2dinstall-user_data.path - Watch for a cloud-config at /var/lib/flatcar-install/user_data. Jan 13 20:07:43.319309 systemd[1]: Started logrotate.timer - Daily rotation of log files. Jan 13 20:07:43.321536 systemd[1]: Started mdadm.timer - Weekly check for MD array's redundancy information.. Jan 13 20:07:43.323864 systemd[1]: Started systemd-tmpfiles-clean.timer - Daily Cleanup of Temporary Directories. Jan 13 20:07:43.326144 systemd[1]: update-engine-stub.timer - Update Engine Stub Timer was skipped because of an unmet condition check (ConditionPathExists=/usr/.noupdate). Jan 13 20:07:43.326197 systemd[1]: Reached target paths.target - Path Units. Jan 13 20:07:43.327898 systemd[1]: Reached target timers.target - Timer Units. Jan 13 20:07:43.330857 systemd[1]: Listening on dbus.socket - D-Bus System Message Bus Socket. Jan 13 20:07:43.335625 systemd[1]: Starting docker.socket - Docker Socket for the API... Jan 13 20:07:43.350474 systemd[1]: Listening on sshd.socket - OpenSSH Server Socket. Jan 13 20:07:43.353827 systemd[1]: Finished lvm2-activation.service - Activation of LVM2 logical volumes. Jan 13 20:07:43.356555 systemd[1]: Listening on docker.socket - Docker Socket for the API. Jan 13 20:07:43.359745 systemd[1]: Reached target sockets.target - Socket Units. Jan 13 20:07:43.361786 systemd[1]: Reached target basic.target - Basic System. Jan 13 20:07:43.363784 systemd[1]: addon-config@oem.service - Configure Addon /oem was skipped because no trigger condition checks were met. Jan 13 20:07:43.363835 systemd[1]: addon-run@oem.service - Run Addon /oem was skipped because no trigger condition checks were met. Jan 13 20:07:43.369363 systemd[1]: Starting containerd.service - containerd container runtime... Jan 13 20:07:43.384579 systemd[1]: Starting coreos-metadata.service - Flatcar Metadata Agent... Jan 13 20:07:43.389452 systemd[1]: Starting dbus.service - D-Bus System Message Bus... Jan 13 20:07:43.394870 systemd[1]: Starting enable-oem-cloudinit.service - Enable cloudinit... Jan 13 20:07:43.412461 systemd[1]: Starting extend-filesystems.service - Extend Filesystems... Jan 13 20:07:43.414427 systemd[1]: flatcar-setup-environment.service - Modifies /etc/environment for CoreOS was skipped because of an unmet condition check (ConditionPathExists=/oem/bin/flatcar-setup-environment). Jan 13 20:07:43.418515 systemd[1]: Starting motdgen.service - Generate /run/flatcar/motd... Jan 13 20:07:43.424452 systemd[1]: Started ntpd.service - Network Time Service. Jan 13 20:07:43.430607 systemd[1]: Starting prepare-helm.service - Unpack helm to /opt/bin... Jan 13 20:07:43.434200 jq[1903]: false Jan 13 20:07:43.436624 systemd[1]: Starting setup-oem.service - Setup OEM... Jan 13 20:07:43.446515 systemd[1]: Starting ssh-key-proc-cmdline.service - Install an ssh key from /proc/cmdline... Jan 13 20:07:43.462451 systemd[1]: Starting sshd-keygen.service - Generate sshd host keys... Jan 13 20:07:43.474388 systemd[1]: Starting systemd-logind.service - User Login Management... Jan 13 20:07:43.478906 systemd[1]: tcsd.service - TCG Core Services Daemon was skipped because of an unmet condition check (ConditionPathExists=/dev/tpm0). Jan 13 20:07:43.479845 systemd[1]: cgroup compatibility translation between legacy and unified hierarchy settings activated. See cgroup-compat debug messages for details. Jan 13 20:07:43.484846 systemd[1]: Starting update-engine.service - Update Engine... Jan 13 20:07:43.492427 systemd[1]: Starting update-ssh-keys-after-ignition.service - Run update-ssh-keys once after Ignition... Jan 13 20:07:43.520008 systemd[1]: enable-oem-cloudinit.service: Skipped due to 'exec-condition'. Jan 13 20:07:43.521215 systemd[1]: Condition check resulted in enable-oem-cloudinit.service - Enable cloudinit being skipped. Jan 13 20:07:43.539174 jq[1915]: true Jan 13 20:07:43.601004 systemd[1]: ssh-key-proc-cmdline.service: Deactivated successfully. Jan 13 20:07:43.602583 systemd[1]: Finished ssh-key-proc-cmdline.service - Install an ssh key from /proc/cmdline. Jan 13 20:07:43.640026 update_engine[1914]: I20250113 20:07:43.639894 1914 main.cc:92] Flatcar Update Engine starting Jan 13 20:07:43.655105 ntpd[1906]: 13 Jan 20:07:43 ntpd[1906]: ntpd 4.2.8p17@1.4004-o Mon Jan 13 18:25:48 UTC 2025 (1): Starting Jan 13 20:07:43.655105 ntpd[1906]: 13 Jan 20:07:43 ntpd[1906]: Command line: /usr/sbin/ntpd -g -n -u ntp:ntp Jan 13 20:07:43.655105 ntpd[1906]: 13 Jan 20:07:43 ntpd[1906]: ---------------------------------------------------- Jan 13 20:07:43.655105 ntpd[1906]: 13 Jan 20:07:43 ntpd[1906]: ntp-4 is maintained by Network Time Foundation, Jan 13 20:07:43.655105 ntpd[1906]: 13 Jan 20:07:43 ntpd[1906]: Inc. (NTF), a non-profit 501(c)(3) public-benefit Jan 13 20:07:43.655105 ntpd[1906]: 13 Jan 20:07:43 ntpd[1906]: corporation. Support and training for ntp-4 are Jan 13 20:07:43.655105 ntpd[1906]: 13 Jan 20:07:43 ntpd[1906]: available at https://www.nwtime.org/support Jan 13 20:07:43.655105 ntpd[1906]: 13 Jan 20:07:43 ntpd[1906]: ---------------------------------------------------- Jan 13 20:07:43.653994 ntpd[1906]: ntpd 4.2.8p17@1.4004-o Mon Jan 13 18:25:48 UTC 2025 (1): Starting Jan 13 20:07:43.654043 ntpd[1906]: Command line: /usr/sbin/ntpd -g -n -u ntp:ntp Jan 13 20:07:43.654063 ntpd[1906]: ---------------------------------------------------- Jan 13 20:07:43.654081 ntpd[1906]: ntp-4 is maintained by Network Time Foundation, Jan 13 20:07:43.654103 ntpd[1906]: Inc. (NTF), a non-profit 501(c)(3) public-benefit Jan 13 20:07:43.654146 ntpd[1906]: corporation. Support and training for ntp-4 are Jan 13 20:07:43.654166 ntpd[1906]: available at https://www.nwtime.org/support Jan 13 20:07:43.654183 ntpd[1906]: ---------------------------------------------------- Jan 13 20:07:43.658652 (ntainerd)[1934]: containerd.service: Referenced but unset environment variable evaluates to an empty string: TORCX_IMAGEDIR, TORCX_UNPACKDIR Jan 13 20:07:43.659826 dbus-daemon[1902]: [system] SELinux support is enabled Jan 13 20:07:43.660106 systemd[1]: Started dbus.service - D-Bus System Message Bus. Jan 13 20:07:43.665289 ntpd[1906]: proto: precision = 0.096 usec (-23) Jan 13 20:07:43.666972 systemd[1]: system-cloudinit@usr-share-oem-cloud\x2dconfig.yml.service - Load cloud-config from /usr/share/oem/cloud-config.yml was skipped because of an unmet condition check (ConditionFileNotEmpty=/usr/share/oem/cloud-config.yml). Jan 13 20:07:43.672384 ntpd[1906]: 13 Jan 20:07:43 ntpd[1906]: proto: precision = 0.096 usec (-23) Jan 13 20:07:43.672384 ntpd[1906]: 13 Jan 20:07:43 ntpd[1906]: basedate set to 2025-01-01 Jan 13 20:07:43.672384 ntpd[1906]: 13 Jan 20:07:43 ntpd[1906]: gps base set to 2025-01-05 (week 2348) Jan 13 20:07:43.666043 ntpd[1906]: basedate set to 2025-01-01 Jan 13 20:07:43.667020 systemd[1]: Reached target system-config.target - Load system-provided cloud configs. Jan 13 20:07:43.666068 ntpd[1906]: gps base set to 2025-01-05 (week 2348) Jan 13 20:07:43.676523 ntpd[1906]: Listen and drop on 0 v6wildcard [::]:123 Jan 13 20:07:43.678303 ntpd[1906]: 13 Jan 20:07:43 ntpd[1906]: Listen and drop on 0 v6wildcard [::]:123 Jan 13 20:07:43.678303 ntpd[1906]: 13 Jan 20:07:43 ntpd[1906]: Listen and drop on 1 v4wildcard 0.0.0.0:123 Jan 13 20:07:43.678303 ntpd[1906]: 13 Jan 20:07:43 ntpd[1906]: Listen normally on 2 lo 127.0.0.1:123 Jan 13 20:07:43.678303 ntpd[1906]: 13 Jan 20:07:43 ntpd[1906]: Listen normally on 3 eth0 172.31.28.23:123 Jan 13 20:07:43.678303 ntpd[1906]: 13 Jan 20:07:43 ntpd[1906]: Listen normally on 4 lo [::1]:123 Jan 13 20:07:43.678303 ntpd[1906]: 13 Jan 20:07:43 ntpd[1906]: bind(21) AF_INET6 fe80::41e:21ff:fe81:df6b%2#123 flags 0x11 failed: Cannot assign requested address Jan 13 20:07:43.678303 ntpd[1906]: 13 Jan 20:07:43 ntpd[1906]: unable to create socket on eth0 (5) for fe80::41e:21ff:fe81:df6b%2#123 Jan 13 20:07:43.678303 ntpd[1906]: 13 Jan 20:07:43 ntpd[1906]: failed to init interface for address fe80::41e:21ff:fe81:df6b%2 Jan 13 20:07:43.678303 ntpd[1906]: 13 Jan 20:07:43 ntpd[1906]: Listening on routing socket on fd #21 for interface updates Jan 13 20:07:43.676618 ntpd[1906]: Listen and drop on 1 v4wildcard 0.0.0.0:123 Jan 13 20:07:43.676884 ntpd[1906]: Listen normally on 2 lo 127.0.0.1:123 Jan 13 20:07:43.676945 ntpd[1906]: Listen normally on 3 eth0 172.31.28.23:123 Jan 13 20:07:43.677011 ntpd[1906]: Listen normally on 4 lo [::1]:123 Jan 13 20:07:43.677079 ntpd[1906]: bind(21) AF_INET6 fe80::41e:21ff:fe81:df6b%2#123 flags 0x11 failed: Cannot assign requested address Jan 13 20:07:43.677137 ntpd[1906]: unable to create socket on eth0 (5) for fe80::41e:21ff:fe81:df6b%2#123 Jan 13 20:07:43.677168 ntpd[1906]: failed to init interface for address fe80::41e:21ff:fe81:df6b%2 Jan 13 20:07:43.677218 ntpd[1906]: Listening on routing socket on fd #21 for interface updates Jan 13 20:07:43.683693 ntpd[1906]: kernel reports TIME_ERROR: 0x41: Clock Unsynchronized Jan 13 20:07:43.684452 ntpd[1906]: 13 Jan 20:07:43 ntpd[1906]: kernel reports TIME_ERROR: 0x41: Clock Unsynchronized Jan 13 20:07:43.684452 ntpd[1906]: 13 Jan 20:07:43 ntpd[1906]: kernel reports TIME_ERROR: 0x41: Clock Unsynchronized Jan 13 20:07:43.683746 ntpd[1906]: kernel reports TIME_ERROR: 0x41: Clock Unsynchronized Jan 13 20:07:43.684517 systemd[1]: user-cloudinit-proc-cmdline.service - Load cloud-config from url defined in /proc/cmdline was skipped because of an unmet condition check (ConditionKernelCommandLine=cloud-config-url). Jan 13 20:07:43.684557 systemd[1]: Reached target user-config.target - Load user-provided cloud configs. Jan 13 20:07:43.695363 tar[1917]: linux-arm64/helm Jan 13 20:07:43.709592 jq[1925]: true Jan 13 20:07:43.727496 dbus-daemon[1902]: [system] Activating via systemd: service name='org.freedesktop.hostname1' unit='dbus-org.freedesktop.hostname1.service' requested by ':1.0' (uid=244 pid=1804 comm="/usr/lib/systemd/systemd-networkd" label="system_u:system_r:kernel_t:s0") Jan 13 20:07:43.737210 update_engine[1914]: I20250113 20:07:43.736915 1914 update_check_scheduler.cc:74] Next update check in 7m39s Jan 13 20:07:43.739480 systemd[1]: Started update-engine.service - Update Engine. Jan 13 20:07:43.745004 extend-filesystems[1904]: Found loop4 Jan 13 20:07:43.749537 extend-filesystems[1904]: Found loop5 Jan 13 20:07:43.749537 extend-filesystems[1904]: Found loop6 Jan 13 20:07:43.749537 extend-filesystems[1904]: Found loop7 Jan 13 20:07:43.749537 extend-filesystems[1904]: Found nvme0n1 Jan 13 20:07:43.749537 extend-filesystems[1904]: Found nvme0n1p1 Jan 13 20:07:43.749537 extend-filesystems[1904]: Found nvme0n1p2 Jan 13 20:07:43.749537 extend-filesystems[1904]: Found nvme0n1p3 Jan 13 20:07:43.749537 extend-filesystems[1904]: Found usr Jan 13 20:07:43.749537 extend-filesystems[1904]: Found nvme0n1p4 Jan 13 20:07:43.749537 extend-filesystems[1904]: Found nvme0n1p6 Jan 13 20:07:43.749537 extend-filesystems[1904]: Found nvme0n1p7 Jan 13 20:07:43.749537 extend-filesystems[1904]: Found nvme0n1p9 Jan 13 20:07:43.749537 extend-filesystems[1904]: Checking size of /dev/nvme0n1p9 Jan 13 20:07:43.751174 systemd[1]: Starting systemd-hostnamed.service - Hostname Service... Jan 13 20:07:43.776375 systemd[1]: Started locksmithd.service - Cluster reboot manager. Jan 13 20:07:43.784061 systemd[1]: motdgen.service: Deactivated successfully. Jan 13 20:07:43.784406 systemd[1]: Finished motdgen.service - Generate /run/flatcar/motd. Jan 13 20:07:43.891255 systemd[1]: Finished setup-oem.service - Setup OEM. Jan 13 20:07:43.892492 extend-filesystems[1904]: Resized partition /dev/nvme0n1p9 Jan 13 20:07:43.908333 extend-filesystems[1964]: resize2fs 1.47.1 (20-May-2024) Jan 13 20:07:43.939557 kernel: EXT4-fs (nvme0n1p9): resizing filesystem from 553472 to 1489915 blocks Jan 13 20:07:43.980726 systemd-logind[1912]: Watching system buttons on /dev/input/event0 (Power Button) Jan 13 20:07:43.981473 systemd-logind[1912]: Watching system buttons on /dev/input/event1 (Sleep Button) Jan 13 20:07:44.065917 coreos-metadata[1901]: Jan 13 20:07:44.012 INFO Putting http://169.254.169.254/latest/api/token: Attempt #1 Jan 13 20:07:44.065917 coreos-metadata[1901]: Jan 13 20:07:44.015 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/instance-id: Attempt #1 Jan 13 20:07:44.065917 coreos-metadata[1901]: Jan 13 20:07:44.017 INFO Fetch successful Jan 13 20:07:44.065917 coreos-metadata[1901]: Jan 13 20:07:44.017 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/instance-type: Attempt #1 Jan 13 20:07:44.065917 coreos-metadata[1901]: Jan 13 20:07:44.018 INFO Fetch successful Jan 13 20:07:44.065917 coreos-metadata[1901]: Jan 13 20:07:44.018 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/local-ipv4: Attempt #1 Jan 13 20:07:44.065917 coreos-metadata[1901]: Jan 13 20:07:44.019 INFO Fetch successful Jan 13 20:07:44.065917 coreos-metadata[1901]: Jan 13 20:07:44.020 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/public-ipv4: Attempt #1 Jan 13 20:07:44.065917 coreos-metadata[1901]: Jan 13 20:07:44.024 INFO Fetch successful Jan 13 20:07:44.065917 coreos-metadata[1901]: Jan 13 20:07:44.024 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/ipv6: Attempt #1 Jan 13 20:07:44.065917 coreos-metadata[1901]: Jan 13 20:07:44.030 INFO Fetch failed with 404: resource not found Jan 13 20:07:44.065917 coreos-metadata[1901]: Jan 13 20:07:44.030 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/placement/availability-zone: Attempt #1 Jan 13 20:07:44.065917 coreos-metadata[1901]: Jan 13 20:07:44.032 INFO Fetch successful Jan 13 20:07:44.065917 coreos-metadata[1901]: Jan 13 20:07:44.032 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/placement/availability-zone-id: Attempt #1 Jan 13 20:07:44.065917 coreos-metadata[1901]: Jan 13 20:07:44.034 INFO Fetch successful Jan 13 20:07:44.065917 coreos-metadata[1901]: Jan 13 20:07:44.034 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/hostname: Attempt #1 Jan 13 20:07:44.065917 coreos-metadata[1901]: Jan 13 20:07:44.036 INFO Fetch successful Jan 13 20:07:44.065917 coreos-metadata[1901]: Jan 13 20:07:44.036 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/public-hostname: Attempt #1 Jan 13 20:07:44.065917 coreos-metadata[1901]: Jan 13 20:07:44.040 INFO Fetch successful Jan 13 20:07:44.065917 coreos-metadata[1901]: Jan 13 20:07:44.040 INFO Fetching http://169.254.169.254/2021-01-03/dynamic/instance-identity/document: Attempt #1 Jan 13 20:07:44.065917 coreos-metadata[1901]: Jan 13 20:07:44.044 INFO Fetch successful Jan 13 20:07:44.110417 kernel: EXT4-fs (nvme0n1p9): resized filesystem to 1489915 Jan 13 20:07:43.983212 systemd-logind[1912]: New seat seat0. Jan 13 20:07:44.102777 dbus-daemon[1902]: [system] Successfully activated service 'org.freedesktop.hostname1' Jan 13 20:07:43.986883 systemd[1]: Started systemd-logind.service - User Login Management. Jan 13 20:07:44.105095 dbus-daemon[1902]: [system] Activating via systemd: service name='org.freedesktop.PolicyKit1' unit='polkit.service' requested by ':1.5' (uid=0 pid=1945 comm="/usr/lib/systemd/systemd-hostnamed" label="system_u:system_r:kernel_t:s0") Jan 13 20:07:44.103061 systemd[1]: Started systemd-hostnamed.service - Hostname Service. Jan 13 20:07:44.120964 extend-filesystems[1964]: Filesystem at /dev/nvme0n1p9 is mounted on /; on-line resizing required Jan 13 20:07:44.120964 extend-filesystems[1964]: old_desc_blocks = 1, new_desc_blocks = 1 Jan 13 20:07:44.120964 extend-filesystems[1964]: The filesystem on /dev/nvme0n1p9 is now 1489915 (4k) blocks long. Jan 13 20:07:44.128499 extend-filesystems[1904]: Resized filesystem in /dev/nvme0n1p9 Jan 13 20:07:44.141691 systemd[1]: Starting polkit.service - Authorization Manager... Jan 13 20:07:44.145200 systemd[1]: extend-filesystems.service: Deactivated successfully. Jan 13 20:07:44.147248 systemd[1]: Finished extend-filesystems.service - Extend Filesystems. Jan 13 20:07:44.159226 bash[1971]: Updated "/home/core/.ssh/authorized_keys" Jan 13 20:07:44.160260 systemd[1]: Finished update-ssh-keys-after-ignition.service - Run update-ssh-keys once after Ignition. Jan 13 20:07:44.177604 systemd[1]: Starting sshkeys.service... Jan 13 20:07:44.211901 polkitd[1985]: Started polkitd version 121 Jan 13 20:07:44.232874 systemd[1]: Finished coreos-metadata.service - Flatcar Metadata Agent. Jan 13 20:07:44.235670 systemd[1]: packet-phone-home.service - Report Success to Packet was skipped because no trigger condition checks were met. Jan 13 20:07:44.265190 systemd[1]: Created slice system-sshd.slice - Slice /system/sshd. Jan 13 20:07:44.271237 kernel: BTRFS warning: duplicate device /dev/nvme0n1p3 devid 1 generation 38 scanned by (udev-worker) (1724) Jan 13 20:07:44.273008 polkitd[1985]: Loading rules from directory /etc/polkit-1/rules.d Jan 13 20:07:44.276000 systemd[1]: Created slice system-coreos\x2dmetadata\x2dsshkeys.slice - Slice /system/coreos-metadata-sshkeys. Jan 13 20:07:44.282487 polkitd[1985]: Loading rules from directory /usr/share/polkit-1/rules.d Jan 13 20:07:44.282878 systemd[1]: Starting coreos-metadata-sshkeys@core.service - Flatcar Metadata Agent (SSH Keys)... Jan 13 20:07:44.291395 polkitd[1985]: Finished loading, compiling and executing 2 rules Jan 13 20:07:44.299810 dbus-daemon[1902]: [system] Successfully activated service 'org.freedesktop.PolicyKit1' Jan 13 20:07:44.300222 systemd[1]: Started polkit.service - Authorization Manager. Jan 13 20:07:44.307295 polkitd[1985]: Acquired the name org.freedesktop.PolicyKit1 on the system bus Jan 13 20:07:44.390519 systemd-hostnamed[1945]: Hostname set to (transient) Jan 13 20:07:44.390672 systemd-resolved[1807]: System hostname changed to 'ip-172-31-28-23'. Jan 13 20:07:44.513713 containerd[1934]: time="2025-01-13T20:07:44.512660255Z" level=info msg="starting containerd" revision=9b2ad7760328148397346d10c7b2004271249db4 version=v1.7.23 Jan 13 20:07:44.547524 locksmithd[1947]: locksmithd starting currentOperation="UPDATE_STATUS_IDLE" strategy="reboot" Jan 13 20:07:44.610728 coreos-metadata[2004]: Jan 13 20:07:44.609 INFO Putting http://169.254.169.254/latest/api/token: Attempt #1 Jan 13 20:07:44.611244 coreos-metadata[2004]: Jan 13 20:07:44.611 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/public-keys: Attempt #1 Jan 13 20:07:44.613729 coreos-metadata[2004]: Jan 13 20:07:44.612 INFO Fetch successful Jan 13 20:07:44.613729 coreos-metadata[2004]: Jan 13 20:07:44.612 INFO Fetching http://169.254.169.254/2021-01-03/meta-data/public-keys/0/openssh-key: Attempt #1 Jan 13 20:07:44.617734 coreos-metadata[2004]: Jan 13 20:07:44.616 INFO Fetch successful Jan 13 20:07:44.620428 unknown[2004]: wrote ssh authorized keys file for user: core Jan 13 20:07:44.654750 ntpd[1906]: bind(24) AF_INET6 fe80::41e:21ff:fe81:df6b%2#123 flags 0x11 failed: Cannot assign requested address Jan 13 20:07:44.698412 ntpd[1906]: 13 Jan 20:07:44 ntpd[1906]: bind(24) AF_INET6 fe80::41e:21ff:fe81:df6b%2#123 flags 0x11 failed: Cannot assign requested address Jan 13 20:07:44.698412 ntpd[1906]: 13 Jan 20:07:44 ntpd[1906]: unable to create socket on eth0 (6) for fe80::41e:21ff:fe81:df6b%2#123 Jan 13 20:07:44.698412 ntpd[1906]: 13 Jan 20:07:44 ntpd[1906]: failed to init interface for address fe80::41e:21ff:fe81:df6b%2 Jan 13 20:07:44.698596 containerd[1934]: time="2025-01-13T20:07:44.660538416Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.aufs\"..." type=io.containerd.snapshotter.v1 Jan 13 20:07:44.698596 containerd[1934]: time="2025-01-13T20:07:44.675930516Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.aufs\"..." error="aufs is not supported (modprobe aufs failed: exit status 1 \"modprobe: FATAL: Module aufs not found in directory /lib/modules/6.6.71-flatcar\\n\"): skip plugin" type=io.containerd.snapshotter.v1 Jan 13 20:07:44.698596 containerd[1934]: time="2025-01-13T20:07:44.675986928Z" level=info msg="loading plugin \"io.containerd.event.v1.exchange\"..." type=io.containerd.event.v1 Jan 13 20:07:44.698596 containerd[1934]: time="2025-01-13T20:07:44.676020768Z" level=info msg="loading plugin \"io.containerd.internal.v1.opt\"..." type=io.containerd.internal.v1 Jan 13 20:07:44.698596 containerd[1934]: time="2025-01-13T20:07:44.676327332Z" level=info msg="loading plugin \"io.containerd.warning.v1.deprecations\"..." type=io.containerd.warning.v1 Jan 13 20:07:44.698596 containerd[1934]: time="2025-01-13T20:07:44.676361460Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.blockfile\"..." type=io.containerd.snapshotter.v1 Jan 13 20:07:44.698596 containerd[1934]: time="2025-01-13T20:07:44.676480776Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.blockfile\"..." error="no scratch file generator: skip plugin" type=io.containerd.snapshotter.v1 Jan 13 20:07:44.698596 containerd[1934]: time="2025-01-13T20:07:44.676508328Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.btrfs\"..." type=io.containerd.snapshotter.v1 Jan 13 20:07:44.698596 containerd[1934]: time="2025-01-13T20:07:44.676782264Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.btrfs\"..." error="path /var/lib/containerd/io.containerd.snapshotter.v1.btrfs (ext4) must be a btrfs filesystem to be used with the btrfs snapshotter: skip plugin" type=io.containerd.snapshotter.v1 Jan 13 20:07:44.698596 containerd[1934]: time="2025-01-13T20:07:44.676813404Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.devmapper\"..." type=io.containerd.snapshotter.v1 Jan 13 20:07:44.698596 containerd[1934]: time="2025-01-13T20:07:44.676844448Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.devmapper\"..." error="devmapper not configured: skip plugin" type=io.containerd.snapshotter.v1 Jan 13 20:07:44.654808 ntpd[1906]: unable to create socket on eth0 (6) for fe80::41e:21ff:fe81:df6b%2#123 Jan 13 20:07:44.699538 containerd[1934]: time="2025-01-13T20:07:44.676868124Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.native\"..." type=io.containerd.snapshotter.v1 Jan 13 20:07:44.699538 containerd[1934]: time="2025-01-13T20:07:44.677014188Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.overlayfs\"..." type=io.containerd.snapshotter.v1 Jan 13 20:07:44.699538 containerd[1934]: time="2025-01-13T20:07:44.679330236Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.zfs\"..." type=io.containerd.snapshotter.v1 Jan 13 20:07:44.699538 containerd[1934]: time="2025-01-13T20:07:44.679555644Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.zfs\"..." error="path /var/lib/containerd/io.containerd.snapshotter.v1.zfs must be a zfs filesystem to be used with the zfs snapshotter: skip plugin" type=io.containerd.snapshotter.v1 Jan 13 20:07:44.699538 containerd[1934]: time="2025-01-13T20:07:44.679586676Z" level=info msg="loading plugin \"io.containerd.content.v1.content\"..." type=io.containerd.content.v1 Jan 13 20:07:44.699538 containerd[1934]: time="2025-01-13T20:07:44.679749624Z" level=info msg="loading plugin \"io.containerd.metadata.v1.bolt\"..." type=io.containerd.metadata.v1 Jan 13 20:07:44.699538 containerd[1934]: time="2025-01-13T20:07:44.679845204Z" level=info msg="metadata content store policy set" policy=shared Jan 13 20:07:44.654836 ntpd[1906]: failed to init interface for address fe80::41e:21ff:fe81:df6b%2 Jan 13 20:07:44.701644 containerd[1934]: time="2025-01-13T20:07:44.701019516Z" level=info msg="loading plugin \"io.containerd.gc.v1.scheduler\"..." type=io.containerd.gc.v1 Jan 13 20:07:44.701644 containerd[1934]: time="2025-01-13T20:07:44.701108880Z" level=info msg="loading plugin \"io.containerd.differ.v1.walking\"..." type=io.containerd.differ.v1 Jan 13 20:07:44.701644 containerd[1934]: time="2025-01-13T20:07:44.701203680Z" level=info msg="loading plugin \"io.containerd.lease.v1.manager\"..." type=io.containerd.lease.v1 Jan 13 20:07:44.701644 containerd[1934]: time="2025-01-13T20:07:44.701305032Z" level=info msg="loading plugin \"io.containerd.streaming.v1.manager\"..." type=io.containerd.streaming.v1 Jan 13 20:07:44.701644 containerd[1934]: time="2025-01-13T20:07:44.701343480Z" level=info msg="loading plugin \"io.containerd.runtime.v1.linux\"..." type=io.containerd.runtime.v1 Jan 13 20:07:44.701644 containerd[1934]: time="2025-01-13T20:07:44.701609112Z" level=info msg="loading plugin \"io.containerd.monitor.v1.cgroups\"..." type=io.containerd.monitor.v1 Jan 13 20:07:44.704661 containerd[1934]: time="2025-01-13T20:07:44.704586300Z" level=info msg="loading plugin \"io.containerd.runtime.v2.task\"..." type=io.containerd.runtime.v2 Jan 13 20:07:44.704924 containerd[1934]: time="2025-01-13T20:07:44.704861808Z" level=info msg="loading plugin \"io.containerd.runtime.v2.shim\"..." type=io.containerd.runtime.v2 Jan 13 20:07:44.704924 containerd[1934]: time="2025-01-13T20:07:44.704907840Z" level=info msg="loading plugin \"io.containerd.sandbox.store.v1.local\"..." type=io.containerd.sandbox.store.v1 Jan 13 20:07:44.705072 containerd[1934]: time="2025-01-13T20:07:44.704943024Z" level=info msg="loading plugin \"io.containerd.sandbox.controller.v1.local\"..." type=io.containerd.sandbox.controller.v1 Jan 13 20:07:44.705072 containerd[1934]: time="2025-01-13T20:07:44.704981412Z" level=info msg="loading plugin \"io.containerd.service.v1.containers-service\"..." type=io.containerd.service.v1 Jan 13 20:07:44.705072 containerd[1934]: time="2025-01-13T20:07:44.705012660Z" level=info msg="loading plugin \"io.containerd.service.v1.content-service\"..." type=io.containerd.service.v1 Jan 13 20:07:44.705072 containerd[1934]: time="2025-01-13T20:07:44.705043320Z" level=info msg="loading plugin \"io.containerd.service.v1.diff-service\"..." type=io.containerd.service.v1 Jan 13 20:07:44.705072 containerd[1934]: time="2025-01-13T20:07:44.705077268Z" level=info msg="loading plugin \"io.containerd.service.v1.images-service\"..." type=io.containerd.service.v1 Jan 13 20:07:44.708840 containerd[1934]: time="2025-01-13T20:07:44.705110028Z" level=info msg="loading plugin \"io.containerd.service.v1.introspection-service\"..." type=io.containerd.service.v1 Jan 13 20:07:44.708840 containerd[1934]: time="2025-01-13T20:07:44.706998624Z" level=info msg="loading plugin \"io.containerd.service.v1.namespaces-service\"..." type=io.containerd.service.v1 Jan 13 20:07:44.708840 containerd[1934]: time="2025-01-13T20:07:44.707064492Z" level=info msg="loading plugin \"io.containerd.service.v1.snapshots-service\"..." type=io.containerd.service.v1 Jan 13 20:07:44.708840 containerd[1934]: time="2025-01-13T20:07:44.707098512Z" level=info msg="loading plugin \"io.containerd.service.v1.tasks-service\"..." type=io.containerd.service.v1 Jan 13 20:07:44.708840 containerd[1934]: time="2025-01-13T20:07:44.707166456Z" level=info msg="loading plugin \"io.containerd.grpc.v1.containers\"..." type=io.containerd.grpc.v1 Jan 13 20:07:44.708840 containerd[1934]: time="2025-01-13T20:07:44.707282328Z" level=info msg="loading plugin \"io.containerd.grpc.v1.content\"..." type=io.containerd.grpc.v1 Jan 13 20:07:44.708840 containerd[1934]: time="2025-01-13T20:07:44.707318784Z" level=info msg="loading plugin \"io.containerd.grpc.v1.diff\"..." type=io.containerd.grpc.v1 Jan 13 20:07:44.708840 containerd[1934]: time="2025-01-13T20:07:44.707360568Z" level=info msg="loading plugin \"io.containerd.grpc.v1.events\"..." type=io.containerd.grpc.v1 Jan 13 20:07:44.708840 containerd[1934]: time="2025-01-13T20:07:44.707390688Z" level=info msg="loading plugin \"io.containerd.grpc.v1.images\"..." type=io.containerd.grpc.v1 Jan 13 20:07:44.708840 containerd[1934]: time="2025-01-13T20:07:44.707421816Z" level=info msg="loading plugin \"io.containerd.grpc.v1.introspection\"..." type=io.containerd.grpc.v1 Jan 13 20:07:44.708840 containerd[1934]: time="2025-01-13T20:07:44.707449716Z" level=info msg="loading plugin \"io.containerd.grpc.v1.leases\"..." type=io.containerd.grpc.v1 Jan 13 20:07:44.708840 containerd[1934]: time="2025-01-13T20:07:44.707484576Z" level=info msg="loading plugin \"io.containerd.grpc.v1.namespaces\"..." type=io.containerd.grpc.v1 Jan 13 20:07:44.708840 containerd[1934]: time="2025-01-13T20:07:44.707516580Z" level=info msg="loading plugin \"io.containerd.grpc.v1.sandbox-controllers\"..." type=io.containerd.grpc.v1 Jan 13 20:07:44.708840 containerd[1934]: time="2025-01-13T20:07:44.707554656Z" level=info msg="loading plugin \"io.containerd.grpc.v1.sandboxes\"..." type=io.containerd.grpc.v1 Jan 13 20:07:44.709522 containerd[1934]: time="2025-01-13T20:07:44.707582964Z" level=info msg="loading plugin \"io.containerd.grpc.v1.snapshots\"..." type=io.containerd.grpc.v1 Jan 13 20:07:44.709522 containerd[1934]: time="2025-01-13T20:07:44.707637072Z" level=info msg="loading plugin \"io.containerd.grpc.v1.streaming\"..." type=io.containerd.grpc.v1 Jan 13 20:07:44.709522 containerd[1934]: time="2025-01-13T20:07:44.707670024Z" level=info msg="loading plugin \"io.containerd.grpc.v1.tasks\"..." type=io.containerd.grpc.v1 Jan 13 20:07:44.709522 containerd[1934]: time="2025-01-13T20:07:44.707704200Z" level=info msg="loading plugin \"io.containerd.transfer.v1.local\"..." type=io.containerd.transfer.v1 Jan 13 20:07:44.709522 containerd[1934]: time="2025-01-13T20:07:44.707752824Z" level=info msg="loading plugin \"io.containerd.grpc.v1.transfer\"..." type=io.containerd.grpc.v1 Jan 13 20:07:44.709522 containerd[1934]: time="2025-01-13T20:07:44.707787564Z" level=info msg="loading plugin \"io.containerd.grpc.v1.version\"..." type=io.containerd.grpc.v1 Jan 13 20:07:44.709522 containerd[1934]: time="2025-01-13T20:07:44.707814828Z" level=info msg="loading plugin \"io.containerd.internal.v1.restart\"..." type=io.containerd.internal.v1 Jan 13 20:07:44.709522 containerd[1934]: time="2025-01-13T20:07:44.709338336Z" level=info msg="loading plugin \"io.containerd.tracing.processor.v1.otlp\"..." type=io.containerd.tracing.processor.v1 Jan 13 20:07:44.709522 containerd[1934]: time="2025-01-13T20:07:44.709397496Z" level=info msg="skip loading plugin \"io.containerd.tracing.processor.v1.otlp\"..." error="skip plugin: tracing endpoint not configured" type=io.containerd.tracing.processor.v1 Jan 13 20:07:44.709522 containerd[1934]: time="2025-01-13T20:07:44.709422984Z" level=info msg="loading plugin \"io.containerd.internal.v1.tracing\"..." type=io.containerd.internal.v1 Jan 13 20:07:44.709522 containerd[1934]: time="2025-01-13T20:07:44.709454892Z" level=info msg="skip loading plugin \"io.containerd.internal.v1.tracing\"..." error="skip plugin: tracing endpoint not configured" type=io.containerd.internal.v1 Jan 13 20:07:44.709522 containerd[1934]: time="2025-01-13T20:07:44.709479036Z" level=info msg="loading plugin \"io.containerd.grpc.v1.healthcheck\"..." type=io.containerd.grpc.v1 Jan 13 20:07:44.709522 containerd[1934]: time="2025-01-13T20:07:44.709521960Z" level=info msg="loading plugin \"io.containerd.nri.v1.nri\"..." type=io.containerd.nri.v1 Jan 13 20:07:44.710031 containerd[1934]: time="2025-01-13T20:07:44.709546908Z" level=info msg="NRI interface is disabled by configuration." Jan 13 20:07:44.710031 containerd[1934]: time="2025-01-13T20:07:44.709571376Z" level=info msg="loading plugin \"io.containerd.grpc.v1.cri\"..." type=io.containerd.grpc.v1 Jan 13 20:07:44.715692 containerd[1934]: time="2025-01-13T20:07:44.712363080Z" level=info msg="Start cri plugin with config {PluginConfig:{ContainerdConfig:{Snapshotter:overlayfs DefaultRuntimeName:runc DefaultRuntime:{Type: Path: Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:map[] PrivilegedWithoutHostDevices:false PrivilegedWithoutHostDevicesAllDevicesAllowed:false BaseRuntimeSpec: NetworkPluginConfDir: NetworkPluginMaxConfNum:0 Snapshotter: SandboxMode:} UntrustedWorkloadRuntime:{Type: Path: Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:map[] PrivilegedWithoutHostDevices:false PrivilegedWithoutHostDevicesAllDevicesAllowed:false BaseRuntimeSpec: NetworkPluginConfDir: NetworkPluginMaxConfNum:0 Snapshotter: SandboxMode:} Runtimes:map[runc:{Type:io.containerd.runc.v2 Path: Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:map[SystemdCgroup:true] PrivilegedWithoutHostDevices:false PrivilegedWithoutHostDevicesAllDevicesAllowed:false BaseRuntimeSpec: NetworkPluginConfDir: NetworkPluginMaxConfNum:0 Snapshotter: SandboxMode:podsandbox}] NoPivot:false DisableSnapshotAnnotations:true DiscardUnpackedLayers:false IgnoreBlockIONotEnabledErrors:false IgnoreRdtNotEnabledErrors:false} CniConfig:{NetworkPluginBinDir:/opt/cni/bin NetworkPluginConfDir:/etc/cni/net.d NetworkPluginMaxConfNum:1 NetworkPluginSetupSerially:false NetworkPluginConfTemplate: IPPreference:} Registry:{ConfigPath: Mirrors:map[] Configs:map[] Auths:map[] Headers:map[]} ImageDecryption:{KeyModel:node} DisableTCPService:true StreamServerAddress:127.0.0.1 StreamServerPort:0 StreamIdleTimeout:4h0m0s EnableSelinux:true SelinuxCategoryRange:1024 SandboxImage:registry.k8s.io/pause:3.8 StatsCollectPeriod:10 SystemdCgroup:false EnableTLSStreaming:false X509KeyPairStreaming:{TLSCertFile: TLSKeyFile:} MaxContainerLogLineSize:16384 DisableCgroup:false DisableApparmor:false RestrictOOMScoreAdj:false MaxConcurrentDownloads:3 DisableProcMount:false UnsetSeccompProfile: TolerateMissingHugetlbController:true DisableHugetlbController:true DeviceOwnershipFromSecurityContext:false IgnoreImageDefinedVolumes:false NetNSMountsUnderStateDir:false EnableUnprivilegedPorts:false EnableUnprivilegedICMP:false EnableCDI:false CDISpecDirs:[/etc/cdi /var/run/cdi] ImagePullProgressTimeout:5m0s DrainExecSyncIOTimeout:0s ImagePullWithSyncFs:false IgnoreDeprecationWarnings:[]} ContainerdRootDir:/var/lib/containerd ContainerdEndpoint:/run/containerd/containerd.sock RootDir:/var/lib/containerd/io.containerd.grpc.v1.cri StateDir:/run/containerd/io.containerd.grpc.v1.cri}" Jan 13 20:07:44.715692 containerd[1934]: time="2025-01-13T20:07:44.712493256Z" level=info msg="Connect containerd service" Jan 13 20:07:44.715692 containerd[1934]: time="2025-01-13T20:07:44.712576404Z" level=info msg="using legacy CRI server" Jan 13 20:07:44.715692 containerd[1934]: time="2025-01-13T20:07:44.712594968Z" level=info msg="using experimental NRI integration - disable nri plugin to prevent this" Jan 13 20:07:44.715692 containerd[1934]: time="2025-01-13T20:07:44.712847076Z" level=info msg="Get image filesystem path \"/var/lib/containerd/io.containerd.snapshotter.v1.overlayfs\"" Jan 13 20:07:44.716181 containerd[1934]: time="2025-01-13T20:07:44.715895568Z" level=error msg="failed to load cni during init, please check CRI plugin status before setting up network for pods" error="cni config load failed: no network config found in /etc/cni/net.d: cni plugin not initialized: failed to load cni config" Jan 13 20:07:44.717407 systemd-networkd[1804]: eth0: Gained IPv6LL Jan 13 20:07:44.722352 containerd[1934]: time="2025-01-13T20:07:44.718772052Z" level=info msg="Start subscribing containerd event" Jan 13 20:07:44.722352 containerd[1934]: time="2025-01-13T20:07:44.718854084Z" level=info msg="Start recovering state" Jan 13 20:07:44.722352 containerd[1934]: time="2025-01-13T20:07:44.718966644Z" level=info msg="Start event monitor" Jan 13 20:07:44.722352 containerd[1934]: time="2025-01-13T20:07:44.718994700Z" level=info msg="Start snapshots syncer" Jan 13 20:07:44.722352 containerd[1934]: time="2025-01-13T20:07:44.719017824Z" level=info msg="Start cni network conf syncer for default" Jan 13 20:07:44.722352 containerd[1934]: time="2025-01-13T20:07:44.719035908Z" level=info msg="Start streaming server" Jan 13 20:07:44.722352 containerd[1934]: time="2025-01-13T20:07:44.719676996Z" level=info msg=serving... address=/run/containerd/containerd.sock.ttrpc Jan 13 20:07:44.722352 containerd[1934]: time="2025-01-13T20:07:44.719777016Z" level=info msg=serving... address=/run/containerd/containerd.sock Jan 13 20:07:44.722352 containerd[1934]: time="2025-01-13T20:07:44.719883156Z" level=info msg="containerd successfully booted in 0.215813s" Jan 13 20:07:44.719996 systemd[1]: Started containerd.service - containerd container runtime. Jan 13 20:07:44.740172 update-ssh-keys[2068]: Updated "/home/core/.ssh/authorized_keys" Jan 13 20:07:44.724518 systemd[1]: Finished coreos-metadata-sshkeys@core.service - Flatcar Metadata Agent (SSH Keys). Jan 13 20:07:44.742059 systemd[1]: Finished sshkeys.service. Jan 13 20:07:44.747227 systemd[1]: Finished systemd-networkd-wait-online.service - Wait for Network to be Configured. Jan 13 20:07:44.776328 systemd[1]: Reached target network-online.target - Network is Online. Jan 13 20:07:44.821870 systemd[1]: Started amazon-ssm-agent.service - amazon-ssm-agent. Jan 13 20:07:44.839392 systemd[1]: Starting kubelet.service - kubelet: The Kubernetes Node Agent... Jan 13 20:07:44.853573 systemd[1]: Starting nvidia.service - NVIDIA Configure Service... Jan 13 20:07:44.935658 systemd[1]: Finished nvidia.service - NVIDIA Configure Service. Jan 13 20:07:45.015909 amazon-ssm-agent[2096]: Initializing new seelog logger Jan 13 20:07:45.015909 amazon-ssm-agent[2096]: New Seelog Logger Creation Complete Jan 13 20:07:45.015909 amazon-ssm-agent[2096]: 2025/01/13 20:07:45 Found config file at /etc/amazon/ssm/amazon-ssm-agent.json. Jan 13 20:07:45.015909 amazon-ssm-agent[2096]: Applying config override from /etc/amazon/ssm/amazon-ssm-agent.json. Jan 13 20:07:45.016516 amazon-ssm-agent[2096]: 2025/01/13 20:07:45 processing appconfig overrides Jan 13 20:07:45.016566 amazon-ssm-agent[2096]: 2025/01/13 20:07:45 Found config file at /etc/amazon/ssm/amazon-ssm-agent.json. Jan 13 20:07:45.016566 amazon-ssm-agent[2096]: Applying config override from /etc/amazon/ssm/amazon-ssm-agent.json. Jan 13 20:07:45.017197 amazon-ssm-agent[2096]: 2025/01/13 20:07:45 processing appconfig overrides Jan 13 20:07:45.019147 amazon-ssm-agent[2096]: 2025/01/13 20:07:45 Found config file at /etc/amazon/ssm/amazon-ssm-agent.json. Jan 13 20:07:45.019147 amazon-ssm-agent[2096]: Applying config override from /etc/amazon/ssm/amazon-ssm-agent.json. Jan 13 20:07:45.019147 amazon-ssm-agent[2096]: 2025/01/13 20:07:45 processing appconfig overrides Jan 13 20:07:45.019147 amazon-ssm-agent[2096]: 2025-01-13 20:07:45 INFO Proxy environment variables: Jan 13 20:07:45.023655 amazon-ssm-agent[2096]: 2025/01/13 20:07:45 Found config file at /etc/amazon/ssm/amazon-ssm-agent.json. Jan 13 20:07:45.023655 amazon-ssm-agent[2096]: Applying config override from /etc/amazon/ssm/amazon-ssm-agent.json. Jan 13 20:07:45.023969 amazon-ssm-agent[2096]: 2025/01/13 20:07:45 processing appconfig overrides Jan 13 20:07:45.118144 amazon-ssm-agent[2096]: 2025-01-13 20:07:45 INFO no_proxy: Jan 13 20:07:45.218485 amazon-ssm-agent[2096]: 2025-01-13 20:07:45 INFO https_proxy: Jan 13 20:07:45.320388 amazon-ssm-agent[2096]: 2025-01-13 20:07:45 INFO http_proxy: Jan 13 20:07:45.421298 amazon-ssm-agent[2096]: 2025-01-13 20:07:45 INFO Checking if agent identity type OnPrem can be assumed Jan 13 20:07:45.442538 sshd_keygen[1928]: ssh-keygen: generating new host keys: RSA ECDSA ED25519 Jan 13 20:07:45.488174 tar[1917]: linux-arm64/LICENSE Jan 13 20:07:45.488174 tar[1917]: linux-arm64/README.md Jan 13 20:07:45.504965 systemd[1]: Finished prepare-helm.service - Unpack helm to /opt/bin. Jan 13 20:07:45.519464 amazon-ssm-agent[2096]: 2025-01-13 20:07:45 INFO Checking if agent identity type EC2 can be assumed Jan 13 20:07:45.536455 systemd[1]: Finished sshd-keygen.service - Generate sshd host keys. Jan 13 20:07:45.548686 systemd[1]: Starting issuegen.service - Generate /run/issue... Jan 13 20:07:45.561603 systemd[1]: Started sshd@0-172.31.28.23:22-147.75.109.163:55228.service - OpenSSH per-connection server daemon (147.75.109.163:55228). Jan 13 20:07:45.586763 systemd[1]: issuegen.service: Deactivated successfully. Jan 13 20:07:45.587206 systemd[1]: Finished issuegen.service - Generate /run/issue. Jan 13 20:07:45.599853 systemd[1]: Starting systemd-user-sessions.service - Permit User Sessions... Jan 13 20:07:45.618821 amazon-ssm-agent[2096]: 2025-01-13 20:07:45 INFO Agent will take identity from EC2 Jan 13 20:07:45.641449 systemd[1]: Finished systemd-user-sessions.service - Permit User Sessions. Jan 13 20:07:45.653613 systemd[1]: Started getty@tty1.service - Getty on tty1. Jan 13 20:07:45.663687 systemd[1]: Started serial-getty@ttyS0.service - Serial Getty on ttyS0. Jan 13 20:07:45.666623 systemd[1]: Reached target getty.target - Login Prompts. Jan 13 20:07:45.718519 amazon-ssm-agent[2096]: 2025-01-13 20:07:45 INFO [amazon-ssm-agent] using named pipe channel for IPC Jan 13 20:07:45.818268 amazon-ssm-agent[2096]: 2025-01-13 20:07:45 INFO [amazon-ssm-agent] using named pipe channel for IPC Jan 13 20:07:45.918024 amazon-ssm-agent[2096]: 2025-01-13 20:07:45 INFO [amazon-ssm-agent] using named pipe channel for IPC Jan 13 20:07:45.926665 sshd[2138]: Accepted publickey for core from 147.75.109.163 port 55228 ssh2: RSA SHA256:IRHkteilZRLg/mCVEzdResksy7NfUBDRRywgALKaHg0 Jan 13 20:07:45.930474 sshd-session[2138]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Jan 13 20:07:45.962430 systemd-logind[1912]: New session 1 of user core. Jan 13 20:07:45.964487 systemd[1]: Created slice user-500.slice - User Slice of UID 500. Jan 13 20:07:45.978540 systemd[1]: Starting user-runtime-dir@500.service - User Runtime Directory /run/user/500... Jan 13 20:07:46.014543 systemd[1]: Finished user-runtime-dir@500.service - User Runtime Directory /run/user/500. Jan 13 20:07:46.023536 amazon-ssm-agent[2096]: 2025-01-13 20:07:45 INFO [amazon-ssm-agent] amazon-ssm-agent - v3.2.0.0 Jan 13 20:07:46.028643 systemd[1]: Starting user@500.service - User Manager for UID 500... Jan 13 20:07:46.052657 (systemd)[2149]: pam_unix(systemd-user:session): session opened for user core(uid=500) by (uid=0) Jan 13 20:07:46.120214 amazon-ssm-agent[2096]: 2025-01-13 20:07:45 INFO [amazon-ssm-agent] OS: linux, Arch: arm64 Jan 13 20:07:46.217797 amazon-ssm-agent[2096]: 2025-01-13 20:07:45 INFO [amazon-ssm-agent] Starting Core Agent Jan 13 20:07:46.264648 amazon-ssm-agent[2096]: 2025-01-13 20:07:45 INFO [amazon-ssm-agent] registrar detected. Attempting registration Jan 13 20:07:46.264648 amazon-ssm-agent[2096]: 2025-01-13 20:07:45 INFO [Registrar] Starting registrar module Jan 13 20:07:46.264648 amazon-ssm-agent[2096]: 2025-01-13 20:07:45 INFO [EC2Identity] no registration info found for ec2 instance, attempting registration Jan 13 20:07:46.264648 amazon-ssm-agent[2096]: 2025-01-13 20:07:46 INFO [EC2Identity] EC2 registration was successful. Jan 13 20:07:46.264648 amazon-ssm-agent[2096]: 2025-01-13 20:07:46 INFO [CredentialRefresher] credentialRefresher has started Jan 13 20:07:46.264648 amazon-ssm-agent[2096]: 2025-01-13 20:07:46 INFO [CredentialRefresher] Starting credentials refresher loop Jan 13 20:07:46.264648 amazon-ssm-agent[2096]: 2025-01-13 20:07:46 INFO EC2RoleProvider Successfully connected with instance profile role credentials Jan 13 20:07:46.317612 amazon-ssm-agent[2096]: 2025-01-13 20:07:46 INFO [CredentialRefresher] Next credential rotation will be in 31.683325106533335 minutes Jan 13 20:07:46.335942 systemd[2149]: Queued start job for default target default.target. Jan 13 20:07:46.343205 systemd[2149]: Created slice app.slice - User Application Slice. Jan 13 20:07:46.343265 systemd[2149]: Reached target paths.target - Paths. Jan 13 20:07:46.343297 systemd[2149]: Reached target timers.target - Timers. Jan 13 20:07:46.347362 systemd[2149]: Starting dbus.socket - D-Bus User Message Bus Socket... Jan 13 20:07:46.369682 systemd[2149]: Listening on dbus.socket - D-Bus User Message Bus Socket. Jan 13 20:07:46.369948 systemd[2149]: Reached target sockets.target - Sockets. Jan 13 20:07:46.369982 systemd[2149]: Reached target basic.target - Basic System. Jan 13 20:07:46.370066 systemd[2149]: Reached target default.target - Main User Target. Jan 13 20:07:46.370160 systemd[2149]: Startup finished in 298ms. Jan 13 20:07:46.370897 systemd[1]: Started user@500.service - User Manager for UID 500. Jan 13 20:07:46.381380 systemd[1]: Started session-1.scope - Session 1 of User core. Jan 13 20:07:46.468519 systemd[1]: Started kubelet.service - kubelet: The Kubernetes Node Agent. Jan 13 20:07:46.472091 systemd[1]: Reached target multi-user.target - Multi-User System. Jan 13 20:07:46.477386 systemd[1]: Startup finished in 1.072s (kernel) + 9.473s (initrd) + 8.269s (userspace) = 18.815s. Jan 13 20:07:46.498484 agetty[2144]: failed to open credentials directory Jan 13 20:07:46.506718 (kubelet)[2163]: kubelet.service: Referenced but unset environment variable evaluates to an empty string: KUBELET_EXTRA_ARGS, KUBELET_KUBEADM_ARGS Jan 13 20:07:46.508473 agetty[2145]: failed to open credentials directory Jan 13 20:07:46.543601 systemd[1]: Started sshd@1-172.31.28.23:22-147.75.109.163:55242.service - OpenSSH per-connection server daemon (147.75.109.163:55242). Jan 13 20:07:46.763957 sshd[2170]: Accepted publickey for core from 147.75.109.163 port 55242 ssh2: RSA SHA256:IRHkteilZRLg/mCVEzdResksy7NfUBDRRywgALKaHg0 Jan 13 20:07:46.766534 sshd-session[2170]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Jan 13 20:07:46.775446 systemd-logind[1912]: New session 2 of user core. Jan 13 20:07:46.781408 systemd[1]: Started session-2.scope - Session 2 of User core. Jan 13 20:07:46.909149 sshd[2176]: Connection closed by 147.75.109.163 port 55242 Jan 13 20:07:46.911390 sshd-session[2170]: pam_unix(sshd:session): session closed for user core Jan 13 20:07:46.917637 systemd[1]: sshd@1-172.31.28.23:22-147.75.109.163:55242.service: Deactivated successfully. Jan 13 20:07:46.922592 systemd[1]: session-2.scope: Deactivated successfully. Jan 13 20:07:46.924206 systemd-logind[1912]: Session 2 logged out. Waiting for processes to exit. Jan 13 20:07:46.926561 systemd-logind[1912]: Removed session 2. Jan 13 20:07:46.948953 systemd[1]: Started sshd@2-172.31.28.23:22-147.75.109.163:55258.service - OpenSSH per-connection server daemon (147.75.109.163:55258). Jan 13 20:07:47.135769 sshd[2181]: Accepted publickey for core from 147.75.109.163 port 55258 ssh2: RSA SHA256:IRHkteilZRLg/mCVEzdResksy7NfUBDRRywgALKaHg0 Jan 13 20:07:47.138472 sshd-session[2181]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Jan 13 20:07:47.149337 systemd-logind[1912]: New session 3 of user core. Jan 13 20:07:47.155416 systemd[1]: Started session-3.scope - Session 3 of User core. Jan 13 20:07:47.275669 sshd[2184]: Connection closed by 147.75.109.163 port 55258 Jan 13 20:07:47.276447 sshd-session[2181]: pam_unix(sshd:session): session closed for user core Jan 13 20:07:47.284934 systemd[1]: sshd@2-172.31.28.23:22-147.75.109.163:55258.service: Deactivated successfully. Jan 13 20:07:47.290064 systemd[1]: session-3.scope: Deactivated successfully. Jan 13 20:07:47.297328 amazon-ssm-agent[2096]: 2025-01-13 20:07:47 INFO [amazon-ssm-agent] [LongRunningWorkerContainer] [WorkerProvider] Worker ssm-agent-worker is not running, starting worker process Jan 13 20:07:47.298286 systemd-logind[1912]: Session 3 logged out. Waiting for processes to exit. Jan 13 20:07:47.319612 systemd[1]: Started sshd@3-172.31.28.23:22-147.75.109.163:50926.service - OpenSSH per-connection server daemon (147.75.109.163:50926). Jan 13 20:07:47.322339 systemd-logind[1912]: Removed session 3. Jan 13 20:07:47.396593 kubelet[2163]: E0113 20:07:47.396367 2163 run.go:74] "command failed" err="failed to load kubelet config file, path: /var/lib/kubelet/config.yaml, error: failed to load Kubelet config file /var/lib/kubelet/config.yaml, error failed to read kubelet config file \"/var/lib/kubelet/config.yaml\", error: open /var/lib/kubelet/config.yaml: no such file or directory" Jan 13 20:07:47.399326 amazon-ssm-agent[2096]: 2025-01-13 20:07:47 INFO [amazon-ssm-agent] [LongRunningWorkerContainer] [WorkerProvider] Worker ssm-agent-worker (pid:2190) started Jan 13 20:07:47.402180 systemd[1]: kubelet.service: Main process exited, code=exited, status=1/FAILURE Jan 13 20:07:47.403335 systemd[1]: kubelet.service: Failed with result 'exit-code'. Jan 13 20:07:47.405249 systemd[1]: kubelet.service: Consumed 1.305s CPU time. Jan 13 20:07:47.500095 amazon-ssm-agent[2096]: 2025-01-13 20:07:47 INFO [amazon-ssm-agent] [LongRunningWorkerContainer] Monitor long running worker health every 60 seconds Jan 13 20:07:47.535813 sshd[2192]: Accepted publickey for core from 147.75.109.163 port 50926 ssh2: RSA SHA256:IRHkteilZRLg/mCVEzdResksy7NfUBDRRywgALKaHg0 Jan 13 20:07:47.538756 sshd-session[2192]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Jan 13 20:07:47.546289 systemd-logind[1912]: New session 4 of user core. Jan 13 20:07:47.556381 systemd[1]: Started session-4.scope - Session 4 of User core. Jan 13 20:07:47.655577 ntpd[1906]: Listen normally on 7 eth0 [fe80::41e:21ff:fe81:df6b%2]:123 Jan 13 20:07:47.656265 ntpd[1906]: 13 Jan 20:07:47 ntpd[1906]: Listen normally on 7 eth0 [fe80::41e:21ff:fe81:df6b%2]:123 Jan 13 20:07:47.684367 sshd[2204]: Connection closed by 147.75.109.163 port 50926 Jan 13 20:07:47.683260 sshd-session[2192]: pam_unix(sshd:session): session closed for user core Jan 13 20:07:47.688366 systemd[1]: session-4.scope: Deactivated successfully. Jan 13 20:07:47.689657 systemd-logind[1912]: Session 4 logged out. Waiting for processes to exit. Jan 13 20:07:47.691068 systemd[1]: sshd@3-172.31.28.23:22-147.75.109.163:50926.service: Deactivated successfully. Jan 13 20:07:47.697601 systemd-logind[1912]: Removed session 4. Jan 13 20:07:47.720713 systemd[1]: Started sshd@4-172.31.28.23:22-147.75.109.163:50930.service - OpenSSH per-connection server daemon (147.75.109.163:50930). Jan 13 20:07:47.905532 sshd[2209]: Accepted publickey for core from 147.75.109.163 port 50930 ssh2: RSA SHA256:IRHkteilZRLg/mCVEzdResksy7NfUBDRRywgALKaHg0 Jan 13 20:07:47.907981 sshd-session[2209]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Jan 13 20:07:47.917459 systemd-logind[1912]: New session 5 of user core. Jan 13 20:07:47.923395 systemd[1]: Started session-5.scope - Session 5 of User core. Jan 13 20:07:48.089889 sudo[2212]: core : PWD=/home/core ; USER=root ; COMMAND=/usr/sbin/setenforce 1 Jan 13 20:07:48.091100 sudo[2212]: pam_unix(sudo:session): session opened for user root(uid=0) by core(uid=500) Jan 13 20:07:48.106722 sudo[2212]: pam_unix(sudo:session): session closed for user root Jan 13 20:07:48.132436 sshd[2211]: Connection closed by 147.75.109.163 port 50930 Jan 13 20:07:48.131040 sshd-session[2209]: pam_unix(sshd:session): session closed for user core Jan 13 20:07:48.137004 systemd[1]: sshd@4-172.31.28.23:22-147.75.109.163:50930.service: Deactivated successfully. Jan 13 20:07:48.140446 systemd[1]: session-5.scope: Deactivated successfully. Jan 13 20:07:48.141615 systemd-logind[1912]: Session 5 logged out. Waiting for processes to exit. Jan 13 20:07:48.143560 systemd-logind[1912]: Removed session 5. Jan 13 20:07:48.171659 systemd[1]: Started sshd@5-172.31.28.23:22-147.75.109.163:50932.service - OpenSSH per-connection server daemon (147.75.109.163:50932). Jan 13 20:07:48.351556 sshd[2218]: Accepted publickey for core from 147.75.109.163 port 50932 ssh2: RSA SHA256:IRHkteilZRLg/mCVEzdResksy7NfUBDRRywgALKaHg0 Jan 13 20:07:48.353999 sshd-session[2218]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Jan 13 20:07:48.362000 systemd-logind[1912]: New session 6 of user core. Jan 13 20:07:48.367382 systemd[1]: Started session-6.scope - Session 6 of User core. Jan 13 20:07:48.470672 sudo[2222]: core : PWD=/home/core ; USER=root ; COMMAND=/usr/sbin/rm -rf /etc/audit/rules.d/80-selinux.rules /etc/audit/rules.d/99-default.rules Jan 13 20:07:48.471353 sudo[2222]: pam_unix(sudo:session): session opened for user root(uid=0) by core(uid=500) Jan 13 20:07:48.477550 sudo[2222]: pam_unix(sudo:session): session closed for user root Jan 13 20:07:48.487325 sudo[2221]: core : PWD=/home/core ; USER=root ; COMMAND=/usr/sbin/systemctl restart audit-rules Jan 13 20:07:48.488391 sudo[2221]: pam_unix(sudo:session): session opened for user root(uid=0) by core(uid=500) Jan 13 20:07:48.509892 systemd[1]: Starting audit-rules.service - Load Audit Rules... Jan 13 20:07:48.568233 augenrules[2244]: No rules Jan 13 20:07:48.570957 systemd[1]: audit-rules.service: Deactivated successfully. Jan 13 20:07:48.571430 systemd[1]: Finished audit-rules.service - Load Audit Rules. Jan 13 20:07:48.573066 sudo[2221]: pam_unix(sudo:session): session closed for user root Jan 13 20:07:48.595836 sshd[2220]: Connection closed by 147.75.109.163 port 50932 Jan 13 20:07:48.596618 sshd-session[2218]: pam_unix(sshd:session): session closed for user core Jan 13 20:07:48.602962 systemd[1]: sshd@5-172.31.28.23:22-147.75.109.163:50932.service: Deactivated successfully. Jan 13 20:07:48.606560 systemd[1]: session-6.scope: Deactivated successfully. Jan 13 20:07:48.608363 systemd-logind[1912]: Session 6 logged out. Waiting for processes to exit. Jan 13 20:07:48.610185 systemd-logind[1912]: Removed session 6. Jan 13 20:07:48.633193 systemd[1]: Started sshd@6-172.31.28.23:22-147.75.109.163:50944.service - OpenSSH per-connection server daemon (147.75.109.163:50944). Jan 13 20:07:48.826521 sshd[2252]: Accepted publickey for core from 147.75.109.163 port 50944 ssh2: RSA SHA256:IRHkteilZRLg/mCVEzdResksy7NfUBDRRywgALKaHg0 Jan 13 20:07:48.828861 sshd-session[2252]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Jan 13 20:07:48.836002 systemd-logind[1912]: New session 7 of user core. Jan 13 20:07:48.847366 systemd[1]: Started session-7.scope - Session 7 of User core. Jan 13 20:07:48.951349 sudo[2255]: core : PWD=/home/core ; USER=root ; COMMAND=/home/core/install.sh Jan 13 20:07:48.951972 sudo[2255]: pam_unix(sudo:session): session opened for user root(uid=0) by core(uid=500) Jan 13 20:07:49.896621 systemd[1]: Starting docker.service - Docker Application Container Engine... Jan 13 20:07:49.900618 (dockerd)[2273]: docker.service: Referenced but unset environment variable evaluates to an empty string: DOCKER_CGROUPS, DOCKER_OPTS, DOCKER_OPT_BIP, DOCKER_OPT_IPMASQ, DOCKER_OPT_MTU Jan 13 20:07:50.464569 dockerd[2273]: time="2025-01-13T20:07:50.464109197Z" level=info msg="Starting up" Jan 13 20:07:50.956657 systemd-resolved[1807]: Clock change detected. Flushing caches. Jan 13 20:07:51.520275 dockerd[2273]: time="2025-01-13T20:07:51.520203150Z" level=info msg="Loading containers: start." Jan 13 20:07:51.827815 kernel: Initializing XFRM netlink socket Jan 13 20:07:51.859324 (udev-worker)[2296]: Network interface NamePolicy= disabled on kernel command line. Jan 13 20:07:51.951302 systemd-networkd[1804]: docker0: Link UP Jan 13 20:07:51.990078 dockerd[2273]: time="2025-01-13T20:07:51.990007449Z" level=info msg="Loading containers: done." Jan 13 20:07:52.011975 systemd[1]: var-lib-docker-overlay2-opaque\x2dbug\x2dcheck1960453419-merged.mount: Deactivated successfully. Jan 13 20:07:52.020539 dockerd[2273]: time="2025-01-13T20:07:52.020396069Z" level=warning msg="Not using native diff for overlay2, this may cause degraded performance for building images: kernel has CONFIG_OVERLAY_FS_REDIRECT_DIR enabled" storage-driver=overlay2 Jan 13 20:07:52.020539 dockerd[2273]: time="2025-01-13T20:07:52.020533517Z" level=info msg="Docker daemon" commit=41ca978a0a5400cc24b274137efa9f25517fcc0b containerd-snapshotter=false storage-driver=overlay2 version=27.3.1 Jan 13 20:07:52.020952 dockerd[2273]: time="2025-01-13T20:07:52.020914265Z" level=info msg="Daemon has completed initialization" Jan 13 20:07:52.089367 dockerd[2273]: time="2025-01-13T20:07:52.089269541Z" level=info msg="API listen on /run/docker.sock" Jan 13 20:07:52.089609 systemd[1]: Started docker.service - Docker Application Container Engine. Jan 13 20:07:53.862737 containerd[1934]: time="2025-01-13T20:07:53.862348378Z" level=info msg="PullImage \"registry.k8s.io/kube-apiserver:v1.29.12\"" Jan 13 20:07:54.554504 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount1591159374.mount: Deactivated successfully. Jan 13 20:07:56.589679 containerd[1934]: time="2025-01-13T20:07:56.589017983Z" level=info msg="ImageCreate event name:\"registry.k8s.io/kube-apiserver:v1.29.12\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Jan 13 20:07:56.590401 containerd[1934]: time="2025-01-13T20:07:56.590329223Z" level=info msg="stop pulling image registry.k8s.io/kube-apiserver:v1.29.12: active requests=0, bytes read=32201250" Jan 13 20:07:56.592735 containerd[1934]: time="2025-01-13T20:07:56.592645943Z" level=info msg="ImageCreate event name:\"sha256:50c86b7f73fdd28bacd4abf45260c9d3abc3b57eb038fa61fc45b5d0f2763e6f\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Jan 13 20:07:56.599350 containerd[1934]: time="2025-01-13T20:07:56.599278404Z" level=info msg="ImageCreate event name:\"registry.k8s.io/kube-apiserver@sha256:2804b1e7b9e08f3a3468f8fd2f6487c55968b9293ee51b9efb865b3298acfa26\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Jan 13 20:07:56.602247 containerd[1934]: time="2025-01-13T20:07:56.602201448Z" level=info msg="Pulled image \"registry.k8s.io/kube-apiserver:v1.29.12\" with image id \"sha256:50c86b7f73fdd28bacd4abf45260c9d3abc3b57eb038fa61fc45b5d0f2763e6f\", repo tag \"registry.k8s.io/kube-apiserver:v1.29.12\", repo digest \"registry.k8s.io/kube-apiserver@sha256:2804b1e7b9e08f3a3468f8fd2f6487c55968b9293ee51b9efb865b3298acfa26\", size \"32198050\" in 2.739788798s" Jan 13 20:07:56.602581 containerd[1934]: time="2025-01-13T20:07:56.602387436Z" level=info msg="PullImage \"registry.k8s.io/kube-apiserver:v1.29.12\" returns image reference \"sha256:50c86b7f73fdd28bacd4abf45260c9d3abc3b57eb038fa61fc45b5d0f2763e6f\"" Jan 13 20:07:56.641236 containerd[1934]: time="2025-01-13T20:07:56.641183808Z" level=info msg="PullImage \"registry.k8s.io/kube-controller-manager:v1.29.12\"" Jan 13 20:07:57.916200 systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 1. Jan 13 20:07:57.927100 systemd[1]: Starting kubelet.service - kubelet: The Kubernetes Node Agent... Jan 13 20:07:58.488302 systemd[1]: Started kubelet.service - kubelet: The Kubernetes Node Agent. Jan 13 20:07:58.498693 (kubelet)[2540]: kubelet.service: Referenced but unset environment variable evaluates to an empty string: KUBELET_EXTRA_ARGS, KUBELET_KUBEADM_ARGS Jan 13 20:07:58.622436 kubelet[2540]: E0113 20:07:58.622341 2540 run.go:74] "command failed" err="failed to load kubelet config file, path: /var/lib/kubelet/config.yaml, error: failed to load Kubelet config file /var/lib/kubelet/config.yaml, error failed to read kubelet config file \"/var/lib/kubelet/config.yaml\", error: open /var/lib/kubelet/config.yaml: no such file or directory" Jan 13 20:07:58.632158 systemd[1]: kubelet.service: Main process exited, code=exited, status=1/FAILURE Jan 13 20:07:58.632512 systemd[1]: kubelet.service: Failed with result 'exit-code'. Jan 13 20:07:59.483952 containerd[1934]: time="2025-01-13T20:07:59.483866618Z" level=info msg="ImageCreate event name:\"registry.k8s.io/kube-controller-manager:v1.29.12\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Jan 13 20:07:59.486478 containerd[1934]: time="2025-01-13T20:07:59.486063530Z" level=info msg="stop pulling image registry.k8s.io/kube-controller-manager:v1.29.12: active requests=0, bytes read=29381297" Jan 13 20:07:59.489805 containerd[1934]: time="2025-01-13T20:07:59.488126558Z" level=info msg="ImageCreate event name:\"sha256:2d47abaa6ccc533f84ef74fff6d509de10bb040317351b45afe95a8021a1ddf7\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Jan 13 20:07:59.495246 containerd[1934]: time="2025-01-13T20:07:59.495182006Z" level=info msg="ImageCreate event name:\"registry.k8s.io/kube-controller-manager@sha256:e2f26a3f5ef3fd01f6330cab8b078cf303cfb6d36911a210d0915d535910e412\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Jan 13 20:07:59.497583 containerd[1934]: time="2025-01-13T20:07:59.497526374Z" level=info msg="Pulled image \"registry.k8s.io/kube-controller-manager:v1.29.12\" with image id \"sha256:2d47abaa6ccc533f84ef74fff6d509de10bb040317351b45afe95a8021a1ddf7\", repo tag \"registry.k8s.io/kube-controller-manager:v1.29.12\", repo digest \"registry.k8s.io/kube-controller-manager@sha256:e2f26a3f5ef3fd01f6330cab8b078cf303cfb6d36911a210d0915d535910e412\", size \"30783618\" in 2.856284414s" Jan 13 20:07:59.497753 containerd[1934]: time="2025-01-13T20:07:59.497723954Z" level=info msg="PullImage \"registry.k8s.io/kube-controller-manager:v1.29.12\" returns image reference \"sha256:2d47abaa6ccc533f84ef74fff6d509de10bb040317351b45afe95a8021a1ddf7\"" Jan 13 20:07:59.546799 containerd[1934]: time="2025-01-13T20:07:59.546718190Z" level=info msg="PullImage \"registry.k8s.io/kube-scheduler:v1.29.12\"" Jan 13 20:08:01.085050 containerd[1934]: time="2025-01-13T20:08:01.083474894Z" level=info msg="ImageCreate event name:\"registry.k8s.io/kube-scheduler:v1.29.12\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Jan 13 20:08:01.086372 containerd[1934]: time="2025-01-13T20:08:01.086302202Z" level=info msg="stop pulling image registry.k8s.io/kube-scheduler:v1.29.12: active requests=0, bytes read=15765640" Jan 13 20:08:01.088652 containerd[1934]: time="2025-01-13T20:08:01.088605362Z" level=info msg="ImageCreate event name:\"sha256:ae633c52a23907b58f7a7867d2cccf3d3f5ebd8977beb6788e20fbecd3f446db\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Jan 13 20:08:01.095807 containerd[1934]: time="2025-01-13T20:08:01.093735326Z" level=info msg="ImageCreate event name:\"registry.k8s.io/kube-scheduler@sha256:ed66e2102f4705d45de7513decf3ac61879704984409323779d19e98b970568c\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Jan 13 20:08:01.096197 containerd[1934]: time="2025-01-13T20:08:01.096020798Z" level=info msg="Pulled image \"registry.k8s.io/kube-scheduler:v1.29.12\" with image id \"sha256:ae633c52a23907b58f7a7867d2cccf3d3f5ebd8977beb6788e20fbecd3f446db\", repo tag \"registry.k8s.io/kube-scheduler:v1.29.12\", repo digest \"registry.k8s.io/kube-scheduler@sha256:ed66e2102f4705d45de7513decf3ac61879704984409323779d19e98b970568c\", size \"17167979\" in 1.54921856s" Jan 13 20:08:01.096197 containerd[1934]: time="2025-01-13T20:08:01.096072962Z" level=info msg="PullImage \"registry.k8s.io/kube-scheduler:v1.29.12\" returns image reference \"sha256:ae633c52a23907b58f7a7867d2cccf3d3f5ebd8977beb6788e20fbecd3f446db\"" Jan 13 20:08:01.134713 containerd[1934]: time="2025-01-13T20:08:01.134668934Z" level=info msg="PullImage \"registry.k8s.io/kube-proxy:v1.29.12\"" Jan 13 20:08:02.556559 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount1394698209.mount: Deactivated successfully. Jan 13 20:08:03.026699 containerd[1934]: time="2025-01-13T20:08:03.025372803Z" level=info msg="ImageCreate event name:\"registry.k8s.io/kube-proxy:v1.29.12\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Jan 13 20:08:03.027878 containerd[1934]: time="2025-01-13T20:08:03.027797871Z" level=info msg="stop pulling image registry.k8s.io/kube-proxy:v1.29.12: active requests=0, bytes read=25273977" Jan 13 20:08:03.029655 containerd[1934]: time="2025-01-13T20:08:03.029582703Z" level=info msg="ImageCreate event name:\"sha256:768ee8cfd9311233d038d18430c18136e1ae4dd2e6de40fcf1c670bba2da6d06\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Jan 13 20:08:03.033685 containerd[1934]: time="2025-01-13T20:08:03.033607947Z" level=info msg="ImageCreate event name:\"registry.k8s.io/kube-proxy@sha256:bc761494b78fa152a759457f42bc9b86ee9d18f5929bb127bd5f72f8e2112c39\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Jan 13 20:08:03.035558 containerd[1934]: time="2025-01-13T20:08:03.035367027Z" level=info msg="Pulled image \"registry.k8s.io/kube-proxy:v1.29.12\" with image id \"sha256:768ee8cfd9311233d038d18430c18136e1ae4dd2e6de40fcf1c670bba2da6d06\", repo tag \"registry.k8s.io/kube-proxy:v1.29.12\", repo digest \"registry.k8s.io/kube-proxy@sha256:bc761494b78fa152a759457f42bc9b86ee9d18f5929bb127bd5f72f8e2112c39\", size \"25272996\" in 1.900471857s" Jan 13 20:08:03.035558 containerd[1934]: time="2025-01-13T20:08:03.035421567Z" level=info msg="PullImage \"registry.k8s.io/kube-proxy:v1.29.12\" returns image reference \"sha256:768ee8cfd9311233d038d18430c18136e1ae4dd2e6de40fcf1c670bba2da6d06\"" Jan 13 20:08:03.074933 containerd[1934]: time="2025-01-13T20:08:03.074847448Z" level=info msg="PullImage \"registry.k8s.io/coredns/coredns:v1.11.1\"" Jan 13 20:08:03.709878 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount4110321996.mount: Deactivated successfully. Jan 13 20:08:05.162940 containerd[1934]: time="2025-01-13T20:08:05.162859290Z" level=info msg="ImageCreate event name:\"registry.k8s.io/coredns/coredns:v1.11.1\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Jan 13 20:08:05.172248 containerd[1934]: time="2025-01-13T20:08:05.172168722Z" level=info msg="stop pulling image registry.k8s.io/coredns/coredns:v1.11.1: active requests=0, bytes read=16485381" Jan 13 20:08:05.174006 containerd[1934]: time="2025-01-13T20:08:05.173917398Z" level=info msg="ImageCreate event name:\"sha256:2437cf762177702dec2dfe99a09c37427a15af6d9a57c456b65352667c223d93\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Jan 13 20:08:05.179946 containerd[1934]: time="2025-01-13T20:08:05.179867190Z" level=info msg="ImageCreate event name:\"registry.k8s.io/coredns/coredns@sha256:1eeb4c7316bacb1d4c8ead65571cd92dd21e27359f0d4917f1a5822a73b75db1\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Jan 13 20:08:05.182223 containerd[1934]: time="2025-01-13T20:08:05.182022222Z" level=info msg="Pulled image \"registry.k8s.io/coredns/coredns:v1.11.1\" with image id \"sha256:2437cf762177702dec2dfe99a09c37427a15af6d9a57c456b65352667c223d93\", repo tag \"registry.k8s.io/coredns/coredns:v1.11.1\", repo digest \"registry.k8s.io/coredns/coredns@sha256:1eeb4c7316bacb1d4c8ead65571cd92dd21e27359f0d4917f1a5822a73b75db1\", size \"16482581\" in 2.107117498s" Jan 13 20:08:05.182223 containerd[1934]: time="2025-01-13T20:08:05.182080422Z" level=info msg="PullImage \"registry.k8s.io/coredns/coredns:v1.11.1\" returns image reference \"sha256:2437cf762177702dec2dfe99a09c37427a15af6d9a57c456b65352667c223d93\"" Jan 13 20:08:05.222220 containerd[1934]: time="2025-01-13T20:08:05.222161430Z" level=info msg="PullImage \"registry.k8s.io/pause:3.9\"" Jan 13 20:08:05.759876 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount4062019415.mount: Deactivated successfully. Jan 13 20:08:05.770308 containerd[1934]: time="2025-01-13T20:08:05.770255289Z" level=info msg="ImageCreate event name:\"registry.k8s.io/pause:3.9\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Jan 13 20:08:05.772165 containerd[1934]: time="2025-01-13T20:08:05.772061817Z" level=info msg="stop pulling image registry.k8s.io/pause:3.9: active requests=0, bytes read=268821" Jan 13 20:08:05.774820 containerd[1934]: time="2025-01-13T20:08:05.773745657Z" level=info msg="ImageCreate event name:\"sha256:829e9de338bd5fdd3f16f68f83a9fb288fbc8453e881e5d5cfd0f6f2ff72b43e\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Jan 13 20:08:05.780644 containerd[1934]: time="2025-01-13T20:08:05.780592125Z" level=info msg="ImageCreate event name:\"registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Jan 13 20:08:05.781909 containerd[1934]: time="2025-01-13T20:08:05.781871061Z" level=info msg="Pulled image \"registry.k8s.io/pause:3.9\" with image id \"sha256:829e9de338bd5fdd3f16f68f83a9fb288fbc8453e881e5d5cfd0f6f2ff72b43e\", repo tag \"registry.k8s.io/pause:3.9\", repo digest \"registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097\", size \"268051\" in 559.650363ms" Jan 13 20:08:05.782079 containerd[1934]: time="2025-01-13T20:08:05.782050377Z" level=info msg="PullImage \"registry.k8s.io/pause:3.9\" returns image reference \"sha256:829e9de338bd5fdd3f16f68f83a9fb288fbc8453e881e5d5cfd0f6f2ff72b43e\"" Jan 13 20:08:05.819402 containerd[1934]: time="2025-01-13T20:08:05.819357933Z" level=info msg="PullImage \"registry.k8s.io/etcd:3.5.10-0\"" Jan 13 20:08:06.403048 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount2409938474.mount: Deactivated successfully. Jan 13 20:08:08.666987 systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 2. Jan 13 20:08:08.676182 systemd[1]: Starting kubelet.service - kubelet: The Kubernetes Node Agent... Jan 13 20:08:09.547300 containerd[1934]: time="2025-01-13T20:08:09.547228392Z" level=info msg="ImageCreate event name:\"registry.k8s.io/etcd:3.5.10-0\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Jan 13 20:08:09.570350 containerd[1934]: time="2025-01-13T20:08:09.570247248Z" level=info msg="stop pulling image registry.k8s.io/etcd:3.5.10-0: active requests=0, bytes read=65200786" Jan 13 20:08:09.619465 containerd[1934]: time="2025-01-13T20:08:09.619377264Z" level=info msg="ImageCreate event name:\"sha256:79f8d13ae8b8839cadfb2f83416935f5184206d386028e2d1263577f0ab3620b\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Jan 13 20:08:09.657381 containerd[1934]: time="2025-01-13T20:08:09.656935056Z" level=info msg="ImageCreate event name:\"registry.k8s.io/etcd@sha256:22f892d7672adc0b9c86df67792afdb8b2dc08880f49f669eaaa59c47d7908c2\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Jan 13 20:08:09.659594 containerd[1934]: time="2025-01-13T20:08:09.659397756Z" level=info msg="Pulled image \"registry.k8s.io/etcd:3.5.10-0\" with image id \"sha256:79f8d13ae8b8839cadfb2f83416935f5184206d386028e2d1263577f0ab3620b\", repo tag \"registry.k8s.io/etcd:3.5.10-0\", repo digest \"registry.k8s.io/etcd@sha256:22f892d7672adc0b9c86df67792afdb8b2dc08880f49f669eaaa59c47d7908c2\", size \"65198393\" in 3.839761819s" Jan 13 20:08:09.659594 containerd[1934]: time="2025-01-13T20:08:09.659454912Z" level=info msg="PullImage \"registry.k8s.io/etcd:3.5.10-0\" returns image reference \"sha256:79f8d13ae8b8839cadfb2f83416935f5184206d386028e2d1263577f0ab3620b\"" Jan 13 20:08:09.744234 systemd[1]: Started kubelet.service - kubelet: The Kubernetes Node Agent. Jan 13 20:08:09.751523 (kubelet)[2694]: kubelet.service: Referenced but unset environment variable evaluates to an empty string: KUBELET_EXTRA_ARGS, KUBELET_KUBEADM_ARGS Jan 13 20:08:09.853324 kubelet[2694]: E0113 20:08:09.853165 2694 run.go:74] "command failed" err="failed to load kubelet config file, path: /var/lib/kubelet/config.yaml, error: failed to load Kubelet config file /var/lib/kubelet/config.yaml, error failed to read kubelet config file \"/var/lib/kubelet/config.yaml\", error: open /var/lib/kubelet/config.yaml: no such file or directory" Jan 13 20:08:09.857492 systemd[1]: kubelet.service: Main process exited, code=exited, status=1/FAILURE Jan 13 20:08:09.858002 systemd[1]: kubelet.service: Failed with result 'exit-code'. Jan 13 20:08:14.729557 systemd[1]: systemd-hostnamed.service: Deactivated successfully. Jan 13 20:08:17.661718 systemd[1]: Stopped kubelet.service - kubelet: The Kubernetes Node Agent. Jan 13 20:08:17.670345 systemd[1]: Starting kubelet.service - kubelet: The Kubernetes Node Agent... Jan 13 20:08:17.711930 systemd[1]: Reloading requested from client PID 2761 ('systemctl') (unit session-7.scope)... Jan 13 20:08:17.711963 systemd[1]: Reloading... Jan 13 20:08:17.881809 zram_generator::config[2801]: No configuration found. Jan 13 20:08:18.113533 systemd[1]: /usr/lib/systemd/system/docker.socket:6: ListenStream= references a path below legacy directory /var/run/, updating /var/run/docker.sock → /run/docker.sock; please update the unit file accordingly. Jan 13 20:08:18.282324 systemd[1]: Reloading finished in 569 ms. Jan 13 20:08:18.429979 systemd[1]: kubelet.service: Control process exited, code=killed, status=15/TERM Jan 13 20:08:18.430171 systemd[1]: kubelet.service: Failed with result 'signal'. Jan 13 20:08:18.430656 systemd[1]: Stopped kubelet.service - kubelet: The Kubernetes Node Agent. Jan 13 20:08:18.439450 systemd[1]: Starting kubelet.service - kubelet: The Kubernetes Node Agent... Jan 13 20:08:19.797510 systemd[1]: Started kubelet.service - kubelet: The Kubernetes Node Agent. Jan 13 20:08:19.814297 (kubelet)[2861]: kubelet.service: Referenced but unset environment variable evaluates to an empty string: KUBELET_EXTRA_ARGS Jan 13 20:08:19.891586 kubelet[2861]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jan 13 20:08:19.891586 kubelet[2861]: Flag --pod-infra-container-image has been deprecated, will be removed in a future release. Image garbage collector will get sandbox image information from CRI. Jan 13 20:08:19.891586 kubelet[2861]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jan 13 20:08:19.892184 kubelet[2861]: I0113 20:08:19.891675 2861 server.go:204] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jan 13 20:08:21.781804 kubelet[2861]: I0113 20:08:21.780672 2861 server.go:487] "Kubelet version" kubeletVersion="v1.29.2" Jan 13 20:08:21.781804 kubelet[2861]: I0113 20:08:21.780719 2861 server.go:489] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jan 13 20:08:21.781804 kubelet[2861]: I0113 20:08:21.781060 2861 server.go:919] "Client rotation is on, will bootstrap in background" Jan 13 20:08:21.810548 kubelet[2861]: I0113 20:08:21.810507 2861 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" Jan 13 20:08:21.812846 kubelet[2861]: E0113 20:08:21.812797 2861 certificate_manager.go:562] kubernetes.io/kube-apiserver-client-kubelet: Failed while requesting a signed certificate from the control plane: cannot create certificate signing request: Post "https://172.31.28.23:6443/apis/certificates.k8s.io/v1/certificatesigningrequests": dial tcp 172.31.28.23:6443: connect: connection refused Jan 13 20:08:21.829623 kubelet[2861]: I0113 20:08:21.829158 2861 server.go:745] "--cgroups-per-qos enabled, but --cgroup-root was not specified. defaulting to /" Jan 13 20:08:21.832313 kubelet[2861]: I0113 20:08:21.832279 2861 container_manager_linux.go:265] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jan 13 20:08:21.832756 kubelet[2861]: I0113 20:08:21.832726 2861 container_manager_linux.go:270] "Creating Container Manager object based on Node Config" nodeConfig={"RuntimeCgroupsName":"","SystemCgroupsName":"","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":false,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":null,"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"ExperimentalMemoryManagerPolicy":"None","ExperimentalMemoryManagerReservedMemory":null,"PodPidsLimit":-1,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null} Jan 13 20:08:21.833029 kubelet[2861]: I0113 20:08:21.833006 2861 topology_manager.go:138] "Creating topology manager with none policy" Jan 13 20:08:21.833135 kubelet[2861]: I0113 20:08:21.833116 2861 container_manager_linux.go:301] "Creating device plugin manager" Jan 13 20:08:21.837260 kubelet[2861]: I0113 20:08:21.837227 2861 state_mem.go:36] "Initialized new in-memory state store" Jan 13 20:08:21.841674 kubelet[2861]: I0113 20:08:21.841638 2861 kubelet.go:396] "Attempting to sync node with API server" Jan 13 20:08:21.841869 kubelet[2861]: I0113 20:08:21.841846 2861 kubelet.go:301] "Adding static pod path" path="/etc/kubernetes/manifests" Jan 13 20:08:21.842007 kubelet[2861]: I0113 20:08:21.841988 2861 kubelet.go:312] "Adding apiserver pod source" Jan 13 20:08:21.842317 kubelet[2861]: I0113 20:08:21.842095 2861 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jan 13 20:08:21.844667 kubelet[2861]: W0113 20:08:21.844588 2861 reflector.go:539] vendor/k8s.io/client-go/informers/factory.go:159: failed to list *v1.Node: Get "https://172.31.28.23:6443/api/v1/nodes?fieldSelector=metadata.name%3Dip-172-31-28-23&limit=500&resourceVersion=0": dial tcp 172.31.28.23:6443: connect: connection refused Jan 13 20:08:21.845589 kubelet[2861]: E0113 20:08:21.844872 2861 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:159: Failed to watch *v1.Node: failed to list *v1.Node: Get "https://172.31.28.23:6443/api/v1/nodes?fieldSelector=metadata.name%3Dip-172-31-28-23&limit=500&resourceVersion=0": dial tcp 172.31.28.23:6443: connect: connection refused Jan 13 20:08:21.845589 kubelet[2861]: W0113 20:08:21.845445 2861 reflector.go:539] vendor/k8s.io/client-go/informers/factory.go:159: failed to list *v1.Service: Get "https://172.31.28.23:6443/api/v1/services?limit=500&resourceVersion=0": dial tcp 172.31.28.23:6443: connect: connection refused Jan 13 20:08:21.845589 kubelet[2861]: E0113 20:08:21.845507 2861 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:159: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://172.31.28.23:6443/api/v1/services?limit=500&resourceVersion=0": dial tcp 172.31.28.23:6443: connect: connection refused Jan 13 20:08:21.846031 kubelet[2861]: I0113 20:08:21.846004 2861 kuberuntime_manager.go:258] "Container runtime initialized" containerRuntime="containerd" version="v1.7.23" apiVersion="v1" Jan 13 20:08:21.846633 kubelet[2861]: I0113 20:08:21.846608 2861 kubelet.go:809] "Not starting ClusterTrustBundle informer because we are in static kubelet mode" Jan 13 20:08:21.847912 kubelet[2861]: W0113 20:08:21.847868 2861 probe.go:268] Flexvolume plugin directory at /opt/libexec/kubernetes/kubelet-plugins/volume/exec/ does not exist. Recreating. Jan 13 20:08:21.849168 kubelet[2861]: I0113 20:08:21.849132 2861 server.go:1256] "Started kubelet" Jan 13 20:08:21.850748 kubelet[2861]: I0113 20:08:21.850700 2861 server.go:162] "Starting to listen" address="0.0.0.0" port=10250 Jan 13 20:08:21.852112 kubelet[2861]: I0113 20:08:21.852062 2861 server.go:461] "Adding debug handlers to kubelet server" Jan 13 20:08:21.856062 kubelet[2861]: I0113 20:08:21.855426 2861 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jan 13 20:08:21.856062 kubelet[2861]: I0113 20:08:21.855866 2861 server.go:233] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jan 13 20:08:21.856236 kubelet[2861]: I0113 20:08:21.856172 2861 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jan 13 20:08:21.862596 kubelet[2861]: E0113 20:08:21.862545 2861 event.go:355] "Unable to write event (may retry after sleeping)" err="Post \"https://172.31.28.23:6443/api/v1/namespaces/default/events\": dial tcp 172.31.28.23:6443: connect: connection refused" event="&Event{ObjectMeta:{ip-172-31-28-23.181a59663700e4c5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-172-31-28-23,UID:ip-172-31-28-23,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-172-31-28-23,},FirstTimestamp:2025-01-13 20:08:21.849089221 +0000 UTC m=+2.027843807,LastTimestamp:2025-01-13 20:08:21.849089221 +0000 UTC m=+2.027843807,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-172-31-28-23,}" Jan 13 20:08:21.866058 kubelet[2861]: I0113 20:08:21.866004 2861 volume_manager.go:291] "Starting Kubelet Volume Manager" Jan 13 20:08:21.869087 kubelet[2861]: E0113 20:08:21.869051 2861 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://172.31.28.23:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-172-31-28-23?timeout=10s\": dial tcp 172.31.28.23:6443: connect: connection refused" interval="200ms" Jan 13 20:08:21.869609 kubelet[2861]: I0113 20:08:21.869582 2861 factory.go:221] Registration of the systemd container factory successfully Jan 13 20:08:21.869902 kubelet[2861]: I0113 20:08:21.869872 2861 factory.go:219] Registration of the crio container factory failed: Get "http://%2Fvar%2Frun%2Fcrio%2Fcrio.sock/info": dial unix /var/run/crio/crio.sock: connect: no such file or directory Jan 13 20:08:21.872050 kubelet[2861]: I0113 20:08:21.871699 2861 desired_state_of_world_populator.go:151] "Desired state populator starts to run" Jan 13 20:08:21.872050 kubelet[2861]: I0113 20:08:21.871867 2861 reconciler_new.go:29] "Reconciler: start to sync state" Jan 13 20:08:21.873207 kubelet[2861]: W0113 20:08:21.873141 2861 reflector.go:539] vendor/k8s.io/client-go/informers/factory.go:159: failed to list *v1.CSIDriver: Get "https://172.31.28.23:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": dial tcp 172.31.28.23:6443: connect: connection refused Jan 13 20:08:21.873420 kubelet[2861]: E0113 20:08:21.873397 2861 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:159: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: Get "https://172.31.28.23:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": dial tcp 172.31.28.23:6443: connect: connection refused Jan 13 20:08:21.874839 kubelet[2861]: I0113 20:08:21.873768 2861 factory.go:221] Registration of the containerd container factory successfully Jan 13 20:08:21.885501 kubelet[2861]: I0113 20:08:21.885442 2861 kubelet_network_linux.go:50] "Initialized iptables rules." protocol="IPv4" Jan 13 20:08:21.887522 kubelet[2861]: I0113 20:08:21.887469 2861 kubelet_network_linux.go:50] "Initialized iptables rules." protocol="IPv6" Jan 13 20:08:21.887522 kubelet[2861]: I0113 20:08:21.887516 2861 status_manager.go:217] "Starting to sync pod status with apiserver" Jan 13 20:08:21.887736 kubelet[2861]: I0113 20:08:21.887552 2861 kubelet.go:2329] "Starting kubelet main sync loop" Jan 13 20:08:21.887736 kubelet[2861]: E0113 20:08:21.887630 2861 kubelet.go:2353] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Jan 13 20:08:21.899974 kubelet[2861]: E0113 20:08:21.899916 2861 kubelet.go:1462] "Image garbage collection failed once. Stats initialization may not have completed yet" err="invalid capacity 0 on image filesystem" Jan 13 20:08:21.903415 kubelet[2861]: W0113 20:08:21.903326 2861 reflector.go:539] vendor/k8s.io/client-go/informers/factory.go:159: failed to list *v1.RuntimeClass: Get "https://172.31.28.23:6443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0": dial tcp 172.31.28.23:6443: connect: connection refused Jan 13 20:08:21.903561 kubelet[2861]: E0113 20:08:21.903423 2861 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:159: Failed to watch *v1.RuntimeClass: failed to list *v1.RuntimeClass: Get "https://172.31.28.23:6443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0": dial tcp 172.31.28.23:6443: connect: connection refused Jan 13 20:08:21.913212 kubelet[2861]: I0113 20:08:21.913172 2861 cpu_manager.go:214] "Starting CPU manager" policy="none" Jan 13 20:08:21.913376 kubelet[2861]: I0113 20:08:21.913358 2861 cpu_manager.go:215] "Reconciling" reconcilePeriod="10s" Jan 13 20:08:21.913512 kubelet[2861]: I0113 20:08:21.913493 2861 state_mem.go:36] "Initialized new in-memory state store" Jan 13 20:08:21.926978 kubelet[2861]: I0113 20:08:21.926934 2861 policy_none.go:49] "None policy: Start" Jan 13 20:08:21.928520 kubelet[2861]: I0113 20:08:21.928472 2861 memory_manager.go:170] "Starting memorymanager" policy="None" Jan 13 20:08:21.928620 kubelet[2861]: I0113 20:08:21.928543 2861 state_mem.go:35] "Initializing new in-memory state store" Jan 13 20:08:21.937850 systemd[1]: Created slice kubepods.slice - libcontainer container kubepods.slice. Jan 13 20:08:21.954247 systemd[1]: Created slice kubepods-burstable.slice - libcontainer container kubepods-burstable.slice. Jan 13 20:08:21.961254 systemd[1]: Created slice kubepods-besteffort.slice - libcontainer container kubepods-besteffort.slice. Jan 13 20:08:21.968943 kubelet[2861]: I0113 20:08:21.968897 2861 kubelet_node_status.go:73] "Attempting to register node" node="ip-172-31-28-23" Jan 13 20:08:21.969434 kubelet[2861]: E0113 20:08:21.969402 2861 kubelet_node_status.go:96] "Unable to register node with API server" err="Post \"https://172.31.28.23:6443/api/v1/nodes\": dial tcp 172.31.28.23:6443: connect: connection refused" node="ip-172-31-28-23" Jan 13 20:08:21.973323 kubelet[2861]: I0113 20:08:21.972576 2861 manager.go:479] "Failed to read data from checkpoint" checkpoint="kubelet_internal_checkpoint" err="checkpoint is not found" Jan 13 20:08:21.973323 kubelet[2861]: I0113 20:08:21.973015 2861 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jan 13 20:08:21.977501 kubelet[2861]: E0113 20:08:21.977454 2861 eviction_manager.go:282] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-172-31-28-23\" not found" Jan 13 20:08:21.988007 kubelet[2861]: I0113 20:08:21.987972 2861 topology_manager.go:215] "Topology Admit Handler" podUID="aa2befc06a3b5e77b94f13cb549148be" podNamespace="kube-system" podName="kube-apiserver-ip-172-31-28-23" Jan 13 20:08:21.990539 kubelet[2861]: I0113 20:08:21.990500 2861 topology_manager.go:215] "Topology Admit Handler" podUID="953bf73f36535ef27535481403c5a71a" podNamespace="kube-system" podName="kube-controller-manager-ip-172-31-28-23" Jan 13 20:08:21.992995 kubelet[2861]: I0113 20:08:21.992551 2861 topology_manager.go:215] "Topology Admit Handler" podUID="e769643076fe2baa7d08f0d1161dd673" podNamespace="kube-system" podName="kube-scheduler-ip-172-31-28-23" Jan 13 20:08:22.005445 systemd[1]: Created slice kubepods-burstable-podaa2befc06a3b5e77b94f13cb549148be.slice - libcontainer container kubepods-burstable-podaa2befc06a3b5e77b94f13cb549148be.slice. Jan 13 20:08:22.027706 systemd[1]: Created slice kubepods-burstable-pod953bf73f36535ef27535481403c5a71a.slice - libcontainer container kubepods-burstable-pod953bf73f36535ef27535481403c5a71a.slice. Jan 13 20:08:22.044072 systemd[1]: Created slice kubepods-burstable-pode769643076fe2baa7d08f0d1161dd673.slice - libcontainer container kubepods-burstable-pode769643076fe2baa7d08f0d1161dd673.slice. Jan 13 20:08:22.070219 kubelet[2861]: E0113 20:08:22.070172 2861 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://172.31.28.23:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-172-31-28-23?timeout=10s\": dial tcp 172.31.28.23:6443: connect: connection refused" interval="400ms" Jan 13 20:08:22.172379 kubelet[2861]: I0113 20:08:22.172321 2861 kubelet_node_status.go:73] "Attempting to register node" node="ip-172-31-28-23" Jan 13 20:08:22.172979 kubelet[2861]: I0113 20:08:22.172937 2861 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"flexvolume-dir\" (UniqueName: \"kubernetes.io/host-path/953bf73f36535ef27535481403c5a71a-flexvolume-dir\") pod \"kube-controller-manager-ip-172-31-28-23\" (UID: \"953bf73f36535ef27535481403c5a71a\") " pod="kube-system/kube-controller-manager-ip-172-31-28-23" Jan 13 20:08:22.173083 kubelet[2861]: I0113 20:08:22.173008 2861 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"k8s-certs\" (UniqueName: \"kubernetes.io/host-path/953bf73f36535ef27535481403c5a71a-k8s-certs\") pod \"kube-controller-manager-ip-172-31-28-23\" (UID: \"953bf73f36535ef27535481403c5a71a\") " pod="kube-system/kube-controller-manager-ip-172-31-28-23" Jan 13 20:08:22.173083 kubelet[2861]: I0113 20:08:22.173066 2861 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeconfig\" (UniqueName: \"kubernetes.io/host-path/953bf73f36535ef27535481403c5a71a-kubeconfig\") pod \"kube-controller-manager-ip-172-31-28-23\" (UID: \"953bf73f36535ef27535481403c5a71a\") " pod="kube-system/kube-controller-manager-ip-172-31-28-23" Jan 13 20:08:22.173185 kubelet[2861]: I0113 20:08:22.173116 2861 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-share-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/953bf73f36535ef27535481403c5a71a-usr-share-ca-certificates\") pod \"kube-controller-manager-ip-172-31-28-23\" (UID: \"953bf73f36535ef27535481403c5a71a\") " pod="kube-system/kube-controller-manager-ip-172-31-28-23" Jan 13 20:08:22.173185 kubelet[2861]: I0113 20:08:22.173166 2861 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-certs\" (UniqueName: \"kubernetes.io/host-path/aa2befc06a3b5e77b94f13cb549148be-ca-certs\") pod \"kube-apiserver-ip-172-31-28-23\" (UID: \"aa2befc06a3b5e77b94f13cb549148be\") " pod="kube-system/kube-apiserver-ip-172-31-28-23" Jan 13 20:08:22.173297 kubelet[2861]: I0113 20:08:22.173209 2861 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"k8s-certs\" (UniqueName: \"kubernetes.io/host-path/aa2befc06a3b5e77b94f13cb549148be-k8s-certs\") pod \"kube-apiserver-ip-172-31-28-23\" (UID: \"aa2befc06a3b5e77b94f13cb549148be\") " pod="kube-system/kube-apiserver-ip-172-31-28-23" Jan 13 20:08:22.173297 kubelet[2861]: I0113 20:08:22.173252 2861 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-certs\" (UniqueName: \"kubernetes.io/host-path/953bf73f36535ef27535481403c5a71a-ca-certs\") pod \"kube-controller-manager-ip-172-31-28-23\" (UID: \"953bf73f36535ef27535481403c5a71a\") " pod="kube-system/kube-controller-manager-ip-172-31-28-23" Jan 13 20:08:22.173400 kubelet[2861]: I0113 20:08:22.173334 2861 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-share-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/aa2befc06a3b5e77b94f13cb549148be-usr-share-ca-certificates\") pod \"kube-apiserver-ip-172-31-28-23\" (UID: \"aa2befc06a3b5e77b94f13cb549148be\") " pod="kube-system/kube-apiserver-ip-172-31-28-23" Jan 13 20:08:22.173400 kubelet[2861]: I0113 20:08:22.173383 2861 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeconfig\" (UniqueName: \"kubernetes.io/host-path/e769643076fe2baa7d08f0d1161dd673-kubeconfig\") pod \"kube-scheduler-ip-172-31-28-23\" (UID: \"e769643076fe2baa7d08f0d1161dd673\") " pod="kube-system/kube-scheduler-ip-172-31-28-23" Jan 13 20:08:22.173745 kubelet[2861]: E0113 20:08:22.173546 2861 kubelet_node_status.go:96] "Unable to register node with API server" err="Post \"https://172.31.28.23:6443/api/v1/nodes\": dial tcp 172.31.28.23:6443: connect: connection refused" node="ip-172-31-28-23" Jan 13 20:08:22.324887 containerd[1934]: time="2025-01-13T20:08:22.324710735Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-apiserver-ip-172-31-28-23,Uid:aa2befc06a3b5e77b94f13cb549148be,Namespace:kube-system,Attempt:0,}" Jan 13 20:08:22.340574 containerd[1934]: time="2025-01-13T20:08:22.340406651Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-controller-manager-ip-172-31-28-23,Uid:953bf73f36535ef27535481403c5a71a,Namespace:kube-system,Attempt:0,}" Jan 13 20:08:22.350897 containerd[1934]: time="2025-01-13T20:08:22.350756987Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-scheduler-ip-172-31-28-23,Uid:e769643076fe2baa7d08f0d1161dd673,Namespace:kube-system,Attempt:0,}" Jan 13 20:08:22.471362 kubelet[2861]: E0113 20:08:22.471298 2861 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://172.31.28.23:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-172-31-28-23?timeout=10s\": dial tcp 172.31.28.23:6443: connect: connection refused" interval="800ms" Jan 13 20:08:22.576199 kubelet[2861]: I0113 20:08:22.575822 2861 kubelet_node_status.go:73] "Attempting to register node" node="ip-172-31-28-23" Jan 13 20:08:22.576343 kubelet[2861]: E0113 20:08:22.576292 2861 kubelet_node_status.go:96] "Unable to register node with API server" err="Post \"https://172.31.28.23:6443/api/v1/nodes\": dial tcp 172.31.28.23:6443: connect: connection refused" node="ip-172-31-28-23" Jan 13 20:08:22.855676 kubelet[2861]: W0113 20:08:22.855435 2861 reflector.go:539] vendor/k8s.io/client-go/informers/factory.go:159: failed to list *v1.CSIDriver: Get "https://172.31.28.23:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": dial tcp 172.31.28.23:6443: connect: connection refused Jan 13 20:08:22.855676 kubelet[2861]: E0113 20:08:22.855525 2861 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:159: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: Get "https://172.31.28.23:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": dial tcp 172.31.28.23:6443: connect: connection refused Jan 13 20:08:22.886157 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount3497231435.mount: Deactivated successfully. Jan 13 20:08:22.897443 containerd[1934]: time="2025-01-13T20:08:22.897367850Z" level=info msg="ImageCreate event name:\"registry.k8s.io/pause:3.8\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"} labels:{key:\"io.cri-containerd.pinned\" value:\"pinned\"}" Jan 13 20:08:22.901147 containerd[1934]: time="2025-01-13T20:08:22.901078286Z" level=info msg="ImageUpdate event name:\"registry.k8s.io/pause:3.8\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"} labels:{key:\"io.cri-containerd.pinned\" value:\"pinned\"}" Jan 13 20:08:22.904885 containerd[1934]: time="2025-01-13T20:08:22.904808918Z" level=info msg="stop pulling image registry.k8s.io/pause:3.8: active requests=0, bytes read=269173" Jan 13 20:08:22.906517 containerd[1934]: time="2025-01-13T20:08:22.906456086Z" level=info msg="stop pulling image registry.k8s.io/pause:3.8: active requests=0, bytes read=0" Jan 13 20:08:22.911800 containerd[1934]: time="2025-01-13T20:08:22.910446842Z" level=info msg="ImageCreate event name:\"sha256:4e42fb3c9d90ed7895bc04a9d96fe3102a65b521f485cc5a4f3dd818afef9cef\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"} labels:{key:\"io.cri-containerd.pinned\" value:\"pinned\"}" Jan 13 20:08:22.918359 containerd[1934]: time="2025-01-13T20:08:22.918272042Z" level=info msg="stop pulling image registry.k8s.io/pause:3.8: active requests=0, bytes read=0" Jan 13 20:08:22.918824 containerd[1934]: time="2025-01-13T20:08:22.918756974Z" level=info msg="ImageUpdate event name:\"registry.k8s.io/pause:3.8\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"} labels:{key:\"io.cri-containerd.pinned\" value:\"pinned\"}" Jan 13 20:08:22.923154 kubelet[2861]: W0113 20:08:22.923071 2861 reflector.go:539] vendor/k8s.io/client-go/informers/factory.go:159: failed to list *v1.RuntimeClass: Get "https://172.31.28.23:6443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0": dial tcp 172.31.28.23:6443: connect: connection refused Jan 13 20:08:22.923358 kubelet[2861]: E0113 20:08:22.923335 2861 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:159: Failed to watch *v1.RuntimeClass: failed to list *v1.RuntimeClass: Get "https://172.31.28.23:6443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0": dial tcp 172.31.28.23:6443: connect: connection refused Jan 13 20:08:22.926114 containerd[1934]: time="2025-01-13T20:08:22.926057306Z" level=info msg="Pulled image \"registry.k8s.io/pause:3.8\" with image id \"sha256:4e42fb3c9d90ed7895bc04a9d96fe3102a65b521f485cc5a4f3dd818afef9cef\", repo tag \"registry.k8s.io/pause:3.8\", repo digest \"registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d\", size \"268403\" in 585.534315ms" Jan 13 20:08:22.930315 containerd[1934]: time="2025-01-13T20:08:22.930259586Z" level=info msg="ImageCreate event name:\"registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"} labels:{key:\"io.cri-containerd.pinned\" value:\"pinned\"}" Jan 13 20:08:22.934470 containerd[1934]: time="2025-01-13T20:08:22.934419098Z" level=info msg="Pulled image \"registry.k8s.io/pause:3.8\" with image id \"sha256:4e42fb3c9d90ed7895bc04a9d96fe3102a65b521f485cc5a4f3dd818afef9cef\", repo tag \"registry.k8s.io/pause:3.8\", repo digest \"registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d\", size \"268403\" in 583.341327ms" Jan 13 20:08:22.975511 containerd[1934]: time="2025-01-13T20:08:22.975450675Z" level=info msg="Pulled image \"registry.k8s.io/pause:3.8\" with image id \"sha256:4e42fb3c9d90ed7895bc04a9d96fe3102a65b521f485cc5a4f3dd818afef9cef\", repo tag \"registry.k8s.io/pause:3.8\", repo digest \"registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d\", size \"268403\" in 650.613832ms" Jan 13 20:08:22.997738 kubelet[2861]: W0113 20:08:22.997554 2861 reflector.go:539] vendor/k8s.io/client-go/informers/factory.go:159: failed to list *v1.Node: Get "https://172.31.28.23:6443/api/v1/nodes?fieldSelector=metadata.name%3Dip-172-31-28-23&limit=500&resourceVersion=0": dial tcp 172.31.28.23:6443: connect: connection refused Jan 13 20:08:22.998403 kubelet[2861]: E0113 20:08:22.997956 2861 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:159: Failed to watch *v1.Node: failed to list *v1.Node: Get "https://172.31.28.23:6443/api/v1/nodes?fieldSelector=metadata.name%3Dip-172-31-28-23&limit=500&resourceVersion=0": dial tcp 172.31.28.23:6443: connect: connection refused Jan 13 20:08:23.264180 containerd[1934]: time="2025-01-13T20:08:23.263607576Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1 Jan 13 20:08:23.264180 containerd[1934]: time="2025-01-13T20:08:23.263745180Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1 Jan 13 20:08:23.264180 containerd[1934]: time="2025-01-13T20:08:23.263811048Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Jan 13 20:08:23.266512 containerd[1934]: time="2025-01-13T20:08:23.265356072Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Jan 13 20:08:23.266512 containerd[1934]: time="2025-01-13T20:08:23.265251312Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1 Jan 13 20:08:23.266512 containerd[1934]: time="2025-01-13T20:08:23.265354788Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1 Jan 13 20:08:23.266512 containerd[1934]: time="2025-01-13T20:08:23.265383780Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Jan 13 20:08:23.266512 containerd[1934]: time="2025-01-13T20:08:23.265529556Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Jan 13 20:08:23.272744 kubelet[2861]: E0113 20:08:23.272509 2861 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://172.31.28.23:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-172-31-28-23?timeout=10s\": dial tcp 172.31.28.23:6443: connect: connection refused" interval="1.6s" Jan 13 20:08:23.272983 containerd[1934]: time="2025-01-13T20:08:23.271395492Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1 Jan 13 20:08:23.273334 containerd[1934]: time="2025-01-13T20:08:23.273254616Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1 Jan 13 20:08:23.274029 containerd[1934]: time="2025-01-13T20:08:23.273915144Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Jan 13 20:08:23.274439 containerd[1934]: time="2025-01-13T20:08:23.274312536Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Jan 13 20:08:23.320612 systemd[1]: Started cri-containerd-5dd34a8292ea64434f46c227f187a310b55b72b0487bc667bfbd5e72ec90837e.scope - libcontainer container 5dd34a8292ea64434f46c227f187a310b55b72b0487bc667bfbd5e72ec90837e. Jan 13 20:08:23.333426 systemd[1]: Started cri-containerd-3cb75f8a193fd6abef22e65f05a47f78d74c7a6d8b18b7c1f22fe9b7453330c3.scope - libcontainer container 3cb75f8a193fd6abef22e65f05a47f78d74c7a6d8b18b7c1f22fe9b7453330c3. Jan 13 20:08:23.351126 systemd[1]: Started cri-containerd-318a2542690705542b8d89d24b702d775fc8d84c651bb9102b1b24ffdcbccb5b.scope - libcontainer container 318a2542690705542b8d89d24b702d775fc8d84c651bb9102b1b24ffdcbccb5b. Jan 13 20:08:23.379908 kubelet[2861]: I0113 20:08:23.379806 2861 kubelet_node_status.go:73] "Attempting to register node" node="ip-172-31-28-23" Jan 13 20:08:23.381167 kubelet[2861]: E0113 20:08:23.381135 2861 kubelet_node_status.go:96] "Unable to register node with API server" err="Post \"https://172.31.28.23:6443/api/v1/nodes\": dial tcp 172.31.28.23:6443: connect: connection refused" node="ip-172-31-28-23" Jan 13 20:08:23.383678 kubelet[2861]: W0113 20:08:23.383517 2861 reflector.go:539] vendor/k8s.io/client-go/informers/factory.go:159: failed to list *v1.Service: Get "https://172.31.28.23:6443/api/v1/services?limit=500&resourceVersion=0": dial tcp 172.31.28.23:6443: connect: connection refused Jan 13 20:08:23.383878 kubelet[2861]: E0113 20:08:23.383635 2861 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:159: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://172.31.28.23:6443/api/v1/services?limit=500&resourceVersion=0": dial tcp 172.31.28.23:6443: connect: connection refused Jan 13 20:08:23.455175 containerd[1934]: time="2025-01-13T20:08:23.454854301Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-apiserver-ip-172-31-28-23,Uid:aa2befc06a3b5e77b94f13cb549148be,Namespace:kube-system,Attempt:0,} returns sandbox id \"3cb75f8a193fd6abef22e65f05a47f78d74c7a6d8b18b7c1f22fe9b7453330c3\"" Jan 13 20:08:23.469356 containerd[1934]: time="2025-01-13T20:08:23.468246457Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-controller-manager-ip-172-31-28-23,Uid:953bf73f36535ef27535481403c5a71a,Namespace:kube-system,Attempt:0,} returns sandbox id \"5dd34a8292ea64434f46c227f187a310b55b72b0487bc667bfbd5e72ec90837e\"" Jan 13 20:08:23.472659 containerd[1934]: time="2025-01-13T20:08:23.472504177Z" level=info msg="CreateContainer within sandbox \"3cb75f8a193fd6abef22e65f05a47f78d74c7a6d8b18b7c1f22fe9b7453330c3\" for container &ContainerMetadata{Name:kube-apiserver,Attempt:0,}" Jan 13 20:08:23.476350 containerd[1934]: time="2025-01-13T20:08:23.475966177Z" level=info msg="CreateContainer within sandbox \"5dd34a8292ea64434f46c227f187a310b55b72b0487bc667bfbd5e72ec90837e\" for container &ContainerMetadata{Name:kube-controller-manager,Attempt:0,}" Jan 13 20:08:23.481689 containerd[1934]: time="2025-01-13T20:08:23.481619917Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-scheduler-ip-172-31-28-23,Uid:e769643076fe2baa7d08f0d1161dd673,Namespace:kube-system,Attempt:0,} returns sandbox id \"318a2542690705542b8d89d24b702d775fc8d84c651bb9102b1b24ffdcbccb5b\"" Jan 13 20:08:23.487998 containerd[1934]: time="2025-01-13T20:08:23.487924729Z" level=info msg="CreateContainer within sandbox \"318a2542690705542b8d89d24b702d775fc8d84c651bb9102b1b24ffdcbccb5b\" for container &ContainerMetadata{Name:kube-scheduler,Attempt:0,}" Jan 13 20:08:23.515133 containerd[1934]: time="2025-01-13T20:08:23.514813657Z" level=info msg="CreateContainer within sandbox \"5dd34a8292ea64434f46c227f187a310b55b72b0487bc667bfbd5e72ec90837e\" for &ContainerMetadata{Name:kube-controller-manager,Attempt:0,} returns container id \"243df600eb5b014384d703fd7d77d9eb3ac06229ac41df1e6c4268d4fc57ae1a\"" Jan 13 20:08:23.516410 containerd[1934]: time="2025-01-13T20:08:23.515895361Z" level=info msg="StartContainer for \"243df600eb5b014384d703fd7d77d9eb3ac06229ac41df1e6c4268d4fc57ae1a\"" Jan 13 20:08:23.522881 containerd[1934]: time="2025-01-13T20:08:23.522657001Z" level=info msg="CreateContainer within sandbox \"318a2542690705542b8d89d24b702d775fc8d84c651bb9102b1b24ffdcbccb5b\" for &ContainerMetadata{Name:kube-scheduler,Attempt:0,} returns container id \"babf7591257aab51901e37366009eaa3f9725094668988092d63ebe315506cc7\"" Jan 13 20:08:23.525434 containerd[1934]: time="2025-01-13T20:08:23.523578325Z" level=info msg="StartContainer for \"babf7591257aab51901e37366009eaa3f9725094668988092d63ebe315506cc7\"" Jan 13 20:08:23.562892 containerd[1934]: time="2025-01-13T20:08:23.562824745Z" level=info msg="CreateContainer within sandbox \"3cb75f8a193fd6abef22e65f05a47f78d74c7a6d8b18b7c1f22fe9b7453330c3\" for &ContainerMetadata{Name:kube-apiserver,Attempt:0,} returns container id \"7d7bebf9b554b1c11e2f1acf97f7a6f75bfac61954bd415df19c46894303880b\"" Jan 13 20:08:23.563631 containerd[1934]: time="2025-01-13T20:08:23.563588485Z" level=info msg="StartContainer for \"7d7bebf9b554b1c11e2f1acf97f7a6f75bfac61954bd415df19c46894303880b\"" Jan 13 20:08:23.564415 systemd[1]: Started cri-containerd-243df600eb5b014384d703fd7d77d9eb3ac06229ac41df1e6c4268d4fc57ae1a.scope - libcontainer container 243df600eb5b014384d703fd7d77d9eb3ac06229ac41df1e6c4268d4fc57ae1a. Jan 13 20:08:23.605604 systemd[1]: Started cri-containerd-babf7591257aab51901e37366009eaa3f9725094668988092d63ebe315506cc7.scope - libcontainer container babf7591257aab51901e37366009eaa3f9725094668988092d63ebe315506cc7. Jan 13 20:08:23.655145 systemd[1]: Started cri-containerd-7d7bebf9b554b1c11e2f1acf97f7a6f75bfac61954bd415df19c46894303880b.scope - libcontainer container 7d7bebf9b554b1c11e2f1acf97f7a6f75bfac61954bd415df19c46894303880b. Jan 13 20:08:23.692651 containerd[1934]: time="2025-01-13T20:08:23.692589338Z" level=info msg="StartContainer for \"243df600eb5b014384d703fd7d77d9eb3ac06229ac41df1e6c4268d4fc57ae1a\" returns successfully" Jan 13 20:08:23.747698 containerd[1934]: time="2025-01-13T20:08:23.747649358Z" level=info msg="StartContainer for \"7d7bebf9b554b1c11e2f1acf97f7a6f75bfac61954bd415df19c46894303880b\" returns successfully" Jan 13 20:08:23.771391 containerd[1934]: time="2025-01-13T20:08:23.771184010Z" level=info msg="StartContainer for \"babf7591257aab51901e37366009eaa3f9725094668988092d63ebe315506cc7\" returns successfully" Jan 13 20:08:24.984095 kubelet[2861]: I0113 20:08:24.984047 2861 kubelet_node_status.go:73] "Attempting to register node" node="ip-172-31-28-23" Jan 13 20:08:27.010199 kubelet[2861]: E0113 20:08:27.010135 2861 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-172-31-28-23\" not found" node="ip-172-31-28-23" Jan 13 20:08:27.049075 kubelet[2861]: I0113 20:08:27.049007 2861 kubelet_node_status.go:76] "Successfully registered node" node="ip-172-31-28-23" Jan 13 20:08:27.113035 kubelet[2861]: E0113 20:08:27.112985 2861 event.go:346] "Server rejected event (will not retry!)" err="namespaces \"default\" not found" event="&Event{ObjectMeta:{ip-172-31-28-23.181a59663700e4c5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-172-31-28-23,UID:ip-172-31-28-23,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-172-31-28-23,},FirstTimestamp:2025-01-13 20:08:21.849089221 +0000 UTC m=+2.027843807,LastTimestamp:2025-01-13 20:08:21.849089221 +0000 UTC m=+2.027843807,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-172-31-28-23,}" Jan 13 20:08:27.847913 kubelet[2861]: I0113 20:08:27.847783 2861 apiserver.go:52] "Watching apiserver" Jan 13 20:08:27.872318 kubelet[2861]: I0113 20:08:27.872166 2861 desired_state_of_world_populator.go:159] "Finished populating initial desired state of world" Jan 13 20:08:28.965827 update_engine[1914]: I20250113 20:08:28.964792 1914 update_attempter.cc:509] Updating boot flags... Jan 13 20:08:29.073949 kernel: BTRFS warning: duplicate device /dev/nvme0n1p3 devid 1 generation 38 scanned by (udev-worker) (3154) Jan 13 20:08:29.437800 kernel: BTRFS warning: duplicate device /dev/nvme0n1p3 devid 1 generation 38 scanned by (udev-worker) (3153) Jan 13 20:08:30.012254 systemd[1]: Reloading requested from client PID 3323 ('systemctl') (unit session-7.scope)... Jan 13 20:08:30.012695 systemd[1]: Reloading... Jan 13 20:08:30.178839 zram_generator::config[3363]: No configuration found. Jan 13 20:08:30.413293 systemd[1]: /usr/lib/systemd/system/docker.socket:6: ListenStream= references a path below legacy directory /var/run/, updating /var/run/docker.sock → /run/docker.sock; please update the unit file accordingly. Jan 13 20:08:30.633410 systemd[1]: Reloading finished in 619 ms. Jan 13 20:08:30.718955 systemd[1]: Stopping kubelet.service - kubelet: The Kubernetes Node Agent... Jan 13 20:08:30.719442 kubelet[2861]: I0113 20:08:30.719388 2861 dynamic_cafile_content.go:171] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" Jan 13 20:08:30.740316 systemd[1]: kubelet.service: Deactivated successfully. Jan 13 20:08:30.742324 systemd[1]: Stopped kubelet.service - kubelet: The Kubernetes Node Agent. Jan 13 20:08:30.742566 systemd[1]: kubelet.service: Consumed 2.771s CPU time, 114.3M memory peak, 0B memory swap peak. Jan 13 20:08:30.753342 systemd[1]: Starting kubelet.service - kubelet: The Kubernetes Node Agent... Jan 13 20:08:31.564895 systemd[1]: Started kubelet.service - kubelet: The Kubernetes Node Agent. Jan 13 20:08:31.584767 (kubelet)[3423]: kubelet.service: Referenced but unset environment variable evaluates to an empty string: KUBELET_EXTRA_ARGS Jan 13 20:08:31.700535 kubelet[3423]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jan 13 20:08:31.700535 kubelet[3423]: Flag --pod-infra-container-image has been deprecated, will be removed in a future release. Image garbage collector will get sandbox image information from CRI. Jan 13 20:08:31.700535 kubelet[3423]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jan 13 20:08:31.702447 kubelet[3423]: I0113 20:08:31.701219 3423 server.go:204] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jan 13 20:08:31.709408 kubelet[3423]: I0113 20:08:31.709364 3423 server.go:487] "Kubelet version" kubeletVersion="v1.29.2" Jan 13 20:08:31.709649 kubelet[3423]: I0113 20:08:31.709628 3423 server.go:489] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jan 13 20:08:31.710218 kubelet[3423]: I0113 20:08:31.710185 3423 server.go:919] "Client rotation is on, will bootstrap in background" Jan 13 20:08:31.713391 kubelet[3423]: I0113 20:08:31.713350 3423 certificate_store.go:130] Loading cert/key pair from "/var/lib/kubelet/pki/kubelet-client-current.pem". Jan 13 20:08:31.717225 kubelet[3423]: I0113 20:08:31.717187 3423 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt" Jan 13 20:08:31.738003 kubelet[3423]: I0113 20:08:31.737932 3423 server.go:745] "--cgroups-per-qos enabled, but --cgroup-root was not specified. defaulting to /" Jan 13 20:08:31.738494 kubelet[3423]: I0113 20:08:31.738455 3423 container_manager_linux.go:265] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jan 13 20:08:31.738842 kubelet[3423]: I0113 20:08:31.738739 3423 container_manager_linux.go:270] "Creating Container Manager object based on Node Config" nodeConfig={"RuntimeCgroupsName":"","SystemCgroupsName":"","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":false,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":null,"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"ExperimentalMemoryManagerPolicy":"None","ExperimentalMemoryManagerReservedMemory":null,"PodPidsLimit":-1,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null} Jan 13 20:08:31.739068 kubelet[3423]: I0113 20:08:31.738888 3423 topology_manager.go:138] "Creating topology manager with none policy" Jan 13 20:08:31.739068 kubelet[3423]: I0113 20:08:31.738915 3423 container_manager_linux.go:301] "Creating device plugin manager" Jan 13 20:08:31.739068 kubelet[3423]: I0113 20:08:31.738978 3423 state_mem.go:36] "Initialized new in-memory state store" Jan 13 20:08:31.739229 kubelet[3423]: I0113 20:08:31.739175 3423 kubelet.go:396] "Attempting to sync node with API server" Jan 13 20:08:31.739229 kubelet[3423]: I0113 20:08:31.739199 3423 kubelet.go:301] "Adding static pod path" path="/etc/kubernetes/manifests" Jan 13 20:08:31.742559 kubelet[3423]: I0113 20:08:31.740333 3423 kubelet.go:312] "Adding apiserver pod source" Jan 13 20:08:31.742559 kubelet[3423]: I0113 20:08:31.741621 3423 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jan 13 20:08:31.743462 kubelet[3423]: I0113 20:08:31.743394 3423 kuberuntime_manager.go:258] "Container runtime initialized" containerRuntime="containerd" version="v1.7.23" apiVersion="v1" Jan 13 20:08:31.744970 kubelet[3423]: I0113 20:08:31.743816 3423 kubelet.go:809] "Not starting ClusterTrustBundle informer because we are in static kubelet mode" Jan 13 20:08:31.744970 kubelet[3423]: I0113 20:08:31.744470 3423 server.go:1256] "Started kubelet" Jan 13 20:08:31.751193 kubelet[3423]: I0113 20:08:31.751135 3423 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jan 13 20:08:31.756576 kubelet[3423]: I0113 20:08:31.755838 3423 server.go:162] "Starting to listen" address="0.0.0.0" port=10250 Jan 13 20:08:31.757654 kubelet[3423]: I0113 20:08:31.757158 3423 server.go:461] "Adding debug handlers to kubelet server" Jan 13 20:08:31.759269 kubelet[3423]: I0113 20:08:31.759221 3423 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jan 13 20:08:31.759819 kubelet[3423]: I0113 20:08:31.759532 3423 server.go:233] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jan 13 20:08:31.762842 kubelet[3423]: I0113 20:08:31.762676 3423 volume_manager.go:291] "Starting Kubelet Volume Manager" Jan 13 20:08:31.763488 kubelet[3423]: I0113 20:08:31.763443 3423 desired_state_of_world_populator.go:151] "Desired state populator starts to run" Jan 13 20:08:31.763761 kubelet[3423]: I0113 20:08:31.763728 3423 reconciler_new.go:29] "Reconciler: start to sync state" Jan 13 20:08:31.778179 kubelet[3423]: I0113 20:08:31.777739 3423 factory.go:221] Registration of the systemd container factory successfully Jan 13 20:08:31.778179 kubelet[3423]: I0113 20:08:31.778059 3423 factory.go:219] Registration of the crio container factory failed: Get "http://%2Fvar%2Frun%2Fcrio%2Fcrio.sock/info": dial unix /var/run/crio/crio.sock: connect: no such file or directory Jan 13 20:08:31.795043 kubelet[3423]: E0113 20:08:31.794994 3423 kubelet.go:1462] "Image garbage collection failed once. Stats initialization may not have completed yet" err="invalid capacity 0 on image filesystem" Jan 13 20:08:31.795260 kubelet[3423]: I0113 20:08:31.795224 3423 factory.go:221] Registration of the containerd container factory successfully Jan 13 20:08:31.813550 kubelet[3423]: I0113 20:08:31.813251 3423 kubelet_network_linux.go:50] "Initialized iptables rules." protocol="IPv4" Jan 13 20:08:31.836583 kubelet[3423]: I0113 20:08:31.836424 3423 kubelet_network_linux.go:50] "Initialized iptables rules." protocol="IPv6" Jan 13 20:08:31.839604 kubelet[3423]: I0113 20:08:31.836733 3423 status_manager.go:217] "Starting to sync pod status with apiserver" Jan 13 20:08:31.839849 kubelet[3423]: I0113 20:08:31.839819 3423 kubelet.go:2329] "Starting kubelet main sync loop" Jan 13 20:08:31.840030 kubelet[3423]: E0113 20:08:31.840009 3423 kubelet.go:2353] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Jan 13 20:08:31.899373 kubelet[3423]: I0113 20:08:31.899303 3423 kubelet_node_status.go:73] "Attempting to register node" node="ip-172-31-28-23" Jan 13 20:08:31.913315 kubelet[3423]: I0113 20:08:31.913276 3423 kubelet_node_status.go:112] "Node was previously registered" node="ip-172-31-28-23" Jan 13 20:08:31.913663 kubelet[3423]: I0113 20:08:31.913639 3423 kubelet_node_status.go:76] "Successfully registered node" node="ip-172-31-28-23" Jan 13 20:08:31.942959 kubelet[3423]: E0113 20:08:31.942917 3423 kubelet.go:2353] "Skipping pod synchronization" err="container runtime status check may not have completed yet" Jan 13 20:08:31.972298 kubelet[3423]: I0113 20:08:31.972249 3423 cpu_manager.go:214] "Starting CPU manager" policy="none" Jan 13 20:08:31.972298 kubelet[3423]: I0113 20:08:31.972291 3423 cpu_manager.go:215] "Reconciling" reconcilePeriod="10s" Jan 13 20:08:31.972464 kubelet[3423]: I0113 20:08:31.972327 3423 state_mem.go:36] "Initialized new in-memory state store" Jan 13 20:08:31.972594 kubelet[3423]: I0113 20:08:31.972562 3423 state_mem.go:88] "Updated default CPUSet" cpuSet="" Jan 13 20:08:31.972652 kubelet[3423]: I0113 20:08:31.972614 3423 state_mem.go:96] "Updated CPUSet assignments" assignments={} Jan 13 20:08:31.972652 kubelet[3423]: I0113 20:08:31.972632 3423 policy_none.go:49] "None policy: Start" Jan 13 20:08:31.974110 kubelet[3423]: I0113 20:08:31.974067 3423 memory_manager.go:170] "Starting memorymanager" policy="None" Jan 13 20:08:31.974254 kubelet[3423]: I0113 20:08:31.974124 3423 state_mem.go:35] "Initializing new in-memory state store" Jan 13 20:08:31.974598 kubelet[3423]: I0113 20:08:31.974561 3423 state_mem.go:75] "Updated machine memory state" Jan 13 20:08:31.985949 kubelet[3423]: I0113 20:08:31.985726 3423 manager.go:479] "Failed to read data from checkpoint" checkpoint="kubelet_internal_checkpoint" err="checkpoint is not found" Jan 13 20:08:31.989127 kubelet[3423]: I0113 20:08:31.989086 3423 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jan 13 20:08:32.144249 kubelet[3423]: I0113 20:08:32.143764 3423 topology_manager.go:215] "Topology Admit Handler" podUID="aa2befc06a3b5e77b94f13cb549148be" podNamespace="kube-system" podName="kube-apiserver-ip-172-31-28-23" Jan 13 20:08:32.144249 kubelet[3423]: I0113 20:08:32.143903 3423 topology_manager.go:215] "Topology Admit Handler" podUID="953bf73f36535ef27535481403c5a71a" podNamespace="kube-system" podName="kube-controller-manager-ip-172-31-28-23" Jan 13 20:08:32.144249 kubelet[3423]: I0113 20:08:32.144019 3423 topology_manager.go:215] "Topology Admit Handler" podUID="e769643076fe2baa7d08f0d1161dd673" podNamespace="kube-system" podName="kube-scheduler-ip-172-31-28-23" Jan 13 20:08:32.156537 kubelet[3423]: E0113 20:08:32.156479 3423 kubelet.go:1921] "Failed creating a mirror pod for" err="pods \"kube-scheduler-ip-172-31-28-23\" already exists" pod="kube-system/kube-scheduler-ip-172-31-28-23" Jan 13 20:08:32.178474 kubelet[3423]: I0113 20:08:32.178412 3423 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-certs\" (UniqueName: \"kubernetes.io/host-path/953bf73f36535ef27535481403c5a71a-ca-certs\") pod \"kube-controller-manager-ip-172-31-28-23\" (UID: \"953bf73f36535ef27535481403c5a71a\") " pod="kube-system/kube-controller-manager-ip-172-31-28-23" Jan 13 20:08:32.178632 kubelet[3423]: I0113 20:08:32.178493 3423 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"k8s-certs\" (UniqueName: \"kubernetes.io/host-path/953bf73f36535ef27535481403c5a71a-k8s-certs\") pod \"kube-controller-manager-ip-172-31-28-23\" (UID: \"953bf73f36535ef27535481403c5a71a\") " pod="kube-system/kube-controller-manager-ip-172-31-28-23" Jan 13 20:08:32.178632 kubelet[3423]: I0113 20:08:32.178546 3423 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeconfig\" (UniqueName: \"kubernetes.io/host-path/953bf73f36535ef27535481403c5a71a-kubeconfig\") pod \"kube-controller-manager-ip-172-31-28-23\" (UID: \"953bf73f36535ef27535481403c5a71a\") " pod="kube-system/kube-controller-manager-ip-172-31-28-23" Jan 13 20:08:32.178632 kubelet[3423]: I0113 20:08:32.178596 3423 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-share-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/953bf73f36535ef27535481403c5a71a-usr-share-ca-certificates\") pod \"kube-controller-manager-ip-172-31-28-23\" (UID: \"953bf73f36535ef27535481403c5a71a\") " pod="kube-system/kube-controller-manager-ip-172-31-28-23" Jan 13 20:08:32.178632 kubelet[3423]: I0113 20:08:32.178639 3423 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-certs\" (UniqueName: \"kubernetes.io/host-path/aa2befc06a3b5e77b94f13cb549148be-ca-certs\") pod \"kube-apiserver-ip-172-31-28-23\" (UID: \"aa2befc06a3b5e77b94f13cb549148be\") " pod="kube-system/kube-apiserver-ip-172-31-28-23" Jan 13 20:08:32.178890 kubelet[3423]: I0113 20:08:32.178684 3423 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"flexvolume-dir\" (UniqueName: \"kubernetes.io/host-path/953bf73f36535ef27535481403c5a71a-flexvolume-dir\") pod \"kube-controller-manager-ip-172-31-28-23\" (UID: \"953bf73f36535ef27535481403c5a71a\") " pod="kube-system/kube-controller-manager-ip-172-31-28-23" Jan 13 20:08:32.178890 kubelet[3423]: I0113 20:08:32.178728 3423 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeconfig\" (UniqueName: \"kubernetes.io/host-path/e769643076fe2baa7d08f0d1161dd673-kubeconfig\") pod \"kube-scheduler-ip-172-31-28-23\" (UID: \"e769643076fe2baa7d08f0d1161dd673\") " pod="kube-system/kube-scheduler-ip-172-31-28-23" Jan 13 20:08:32.178890 kubelet[3423]: I0113 20:08:32.178792 3423 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"k8s-certs\" (UniqueName: \"kubernetes.io/host-path/aa2befc06a3b5e77b94f13cb549148be-k8s-certs\") pod \"kube-apiserver-ip-172-31-28-23\" (UID: \"aa2befc06a3b5e77b94f13cb549148be\") " pod="kube-system/kube-apiserver-ip-172-31-28-23" Jan 13 20:08:32.178890 kubelet[3423]: I0113 20:08:32.178848 3423 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-share-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/aa2befc06a3b5e77b94f13cb549148be-usr-share-ca-certificates\") pod \"kube-apiserver-ip-172-31-28-23\" (UID: \"aa2befc06a3b5e77b94f13cb549148be\") " pod="kube-system/kube-apiserver-ip-172-31-28-23" Jan 13 20:08:32.742525 kubelet[3423]: I0113 20:08:32.742468 3423 apiserver.go:52] "Watching apiserver" Jan 13 20:08:32.764505 kubelet[3423]: I0113 20:08:32.764395 3423 desired_state_of_world_populator.go:159] "Finished populating initial desired state of world" Jan 13 20:08:33.085094 kubelet[3423]: I0113 20:08:33.084659 3423 pod_startup_latency_tracker.go:102] "Observed pod startup duration" pod="kube-system/kube-scheduler-ip-172-31-28-23" podStartSLOduration=5.084592653 podStartE2EDuration="5.084592653s" podCreationTimestamp="2025-01-13 20:08:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-01-13 20:08:33.033653528 +0000 UTC m=+1.439235032" watchObservedRunningTime="2025-01-13 20:08:33.084592653 +0000 UTC m=+1.490174133" Jan 13 20:08:33.142228 kubelet[3423]: I0113 20:08:33.142170 3423 pod_startup_latency_tracker.go:102] "Observed pod startup duration" pod="kube-system/kube-apiserver-ip-172-31-28-23" podStartSLOduration=1.142111785 podStartE2EDuration="1.142111785s" podCreationTimestamp="2025-01-13 20:08:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-01-13 20:08:33.089438109 +0000 UTC m=+1.495019613" watchObservedRunningTime="2025-01-13 20:08:33.142111785 +0000 UTC m=+1.547693265" Jan 13 20:08:33.879397 kubelet[3423]: I0113 20:08:33.879323 3423 pod_startup_latency_tracker.go:102] "Observed pod startup duration" pod="kube-system/kube-controller-manager-ip-172-31-28-23" podStartSLOduration=1.8792636169999999 podStartE2EDuration="1.879263617s" podCreationTimestamp="2025-01-13 20:08:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-01-13 20:08:33.144589545 +0000 UTC m=+1.550171037" watchObservedRunningTime="2025-01-13 20:08:33.879263617 +0000 UTC m=+2.284845109" Jan 13 20:08:38.668844 sudo[2255]: pam_unix(sudo:session): session closed for user root Jan 13 20:08:38.691875 sshd[2254]: Connection closed by 147.75.109.163 port 50944 Jan 13 20:08:38.692724 sshd-session[2252]: pam_unix(sshd:session): session closed for user core Jan 13 20:08:38.698267 systemd[1]: sshd@6-172.31.28.23:22-147.75.109.163:50944.service: Deactivated successfully. Jan 13 20:08:38.702988 systemd[1]: session-7.scope: Deactivated successfully. Jan 13 20:08:38.703799 systemd[1]: session-7.scope: Consumed 11.540s CPU time, 186.4M memory peak, 0B memory swap peak. Jan 13 20:08:38.705371 systemd-logind[1912]: Session 7 logged out. Waiting for processes to exit. Jan 13 20:08:38.709547 systemd-logind[1912]: Removed session 7. Jan 13 20:08:43.793684 kubelet[3423]: I0113 20:08:43.793608 3423 kuberuntime_manager.go:1529] "Updating runtime config through cri with podcidr" CIDR="192.168.0.0/24" Jan 13 20:08:43.795001 containerd[1934]: time="2025-01-13T20:08:43.794804434Z" level=info msg="No cni config template is specified, wait for other system components to drop the config." Jan 13 20:08:43.795907 kubelet[3423]: I0113 20:08:43.795764 3423 kubelet_network.go:61] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="192.168.0.0/24" Jan 13 20:08:44.386758 kubelet[3423]: I0113 20:08:44.386250 3423 topology_manager.go:215] "Topology Admit Handler" podUID="d2777c2c-46ce-4b47-a22a-4dd4a28b5613" podNamespace="kube-system" podName="kube-proxy-fhqlw" Jan 13 20:08:44.413870 systemd[1]: Created slice kubepods-besteffort-podd2777c2c_46ce_4b47_a22a_4dd4a28b5613.slice - libcontainer container kubepods-besteffort-podd2777c2c_46ce_4b47_a22a_4dd4a28b5613.slice. Jan 13 20:08:44.455497 kubelet[3423]: I0113 20:08:44.455382 3423 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-proxy\" (UniqueName: \"kubernetes.io/configmap/d2777c2c-46ce-4b47-a22a-4dd4a28b5613-kube-proxy\") pod \"kube-proxy-fhqlw\" (UID: \"d2777c2c-46ce-4b47-a22a-4dd4a28b5613\") " pod="kube-system/kube-proxy-fhqlw" Jan 13 20:08:44.455497 kubelet[3423]: I0113 20:08:44.455463 3423 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vblgb\" (UniqueName: \"kubernetes.io/projected/d2777c2c-46ce-4b47-a22a-4dd4a28b5613-kube-api-access-vblgb\") pod \"kube-proxy-fhqlw\" (UID: \"d2777c2c-46ce-4b47-a22a-4dd4a28b5613\") " pod="kube-system/kube-proxy-fhqlw" Jan 13 20:08:44.456039 kubelet[3423]: I0113 20:08:44.455513 3423 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/d2777c2c-46ce-4b47-a22a-4dd4a28b5613-xtables-lock\") pod \"kube-proxy-fhqlw\" (UID: \"d2777c2c-46ce-4b47-a22a-4dd4a28b5613\") " pod="kube-system/kube-proxy-fhqlw" Jan 13 20:08:44.456039 kubelet[3423]: I0113 20:08:44.455559 3423 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d2777c2c-46ce-4b47-a22a-4dd4a28b5613-lib-modules\") pod \"kube-proxy-fhqlw\" (UID: \"d2777c2c-46ce-4b47-a22a-4dd4a28b5613\") " pod="kube-system/kube-proxy-fhqlw" Jan 13 20:08:44.727051 containerd[1934]: time="2025-01-13T20:08:44.726978491Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-proxy-fhqlw,Uid:d2777c2c-46ce-4b47-a22a-4dd4a28b5613,Namespace:kube-system,Attempt:0,}" Jan 13 20:08:44.783901 containerd[1934]: time="2025-01-13T20:08:44.783660275Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1 Jan 13 20:08:44.784118 containerd[1934]: time="2025-01-13T20:08:44.783916475Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1 Jan 13 20:08:44.784118 containerd[1934]: time="2025-01-13T20:08:44.784031267Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Jan 13 20:08:44.784572 containerd[1934]: time="2025-01-13T20:08:44.784246727Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Jan 13 20:08:44.823497 systemd[1]: run-containerd-runc-k8s.io-0cb4de1dcc40eee90ea1b39cf02f53d7c6670c3b606ba3c1be5464a4bac6c29f-runc.VBHWrf.mount: Deactivated successfully. Jan 13 20:08:44.839140 systemd[1]: Started cri-containerd-0cb4de1dcc40eee90ea1b39cf02f53d7c6670c3b606ba3c1be5464a4bac6c29f.scope - libcontainer container 0cb4de1dcc40eee90ea1b39cf02f53d7c6670c3b606ba3c1be5464a4bac6c29f. Jan 13 20:08:44.855482 kubelet[3423]: I0113 20:08:44.854305 3423 topology_manager.go:215] "Topology Admit Handler" podUID="68b1ab75-5aa0-430b-b6e7-0b4737b8d9b6" podNamespace="tigera-operator" podName="tigera-operator-c7ccbd65-m24zq" Jan 13 20:08:44.870044 kubelet[3423]: W0113 20:08:44.869985 3423 reflector.go:539] object-"tigera-operator"/"kubernetes-services-endpoint": failed to list *v1.ConfigMap: configmaps "kubernetes-services-endpoint" is forbidden: User "system:node:ip-172-31-28-23" cannot list resource "configmaps" in API group "" in the namespace "tigera-operator": no relationship found between node 'ip-172-31-28-23' and this object Jan 13 20:08:44.870044 kubelet[3423]: E0113 20:08:44.870049 3423 reflector.go:147] object-"tigera-operator"/"kubernetes-services-endpoint": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kubernetes-services-endpoint" is forbidden: User "system:node:ip-172-31-28-23" cannot list resource "configmaps" in API group "" in the namespace "tigera-operator": no relationship found between node 'ip-172-31-28-23' and this object Jan 13 20:08:44.875236 systemd[1]: Created slice kubepods-besteffort-pod68b1ab75_5aa0_430b_b6e7_0b4737b8d9b6.slice - libcontainer container kubepods-besteffort-pod68b1ab75_5aa0_430b_b6e7_0b4737b8d9b6.slice. Jan 13 20:08:44.961262 kubelet[3423]: I0113 20:08:44.961184 3423 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmcsz\" (UniqueName: \"kubernetes.io/projected/68b1ab75-5aa0-430b-b6e7-0b4737b8d9b6-kube-api-access-cmcsz\") pod \"tigera-operator-c7ccbd65-m24zq\" (UID: \"68b1ab75-5aa0-430b-b6e7-0b4737b8d9b6\") " pod="tigera-operator/tigera-operator-c7ccbd65-m24zq" Jan 13 20:08:44.961685 kubelet[3423]: I0113 20:08:44.961413 3423 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-calico\" (UniqueName: \"kubernetes.io/host-path/68b1ab75-5aa0-430b-b6e7-0b4737b8d9b6-var-lib-calico\") pod \"tigera-operator-c7ccbd65-m24zq\" (UID: \"68b1ab75-5aa0-430b-b6e7-0b4737b8d9b6\") " pod="tigera-operator/tigera-operator-c7ccbd65-m24zq" Jan 13 20:08:44.969855 containerd[1934]: time="2025-01-13T20:08:44.969730764Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:kube-proxy-fhqlw,Uid:d2777c2c-46ce-4b47-a22a-4dd4a28b5613,Namespace:kube-system,Attempt:0,} returns sandbox id \"0cb4de1dcc40eee90ea1b39cf02f53d7c6670c3b606ba3c1be5464a4bac6c29f\"" Jan 13 20:08:44.977813 containerd[1934]: time="2025-01-13T20:08:44.977143344Z" level=info msg="CreateContainer within sandbox \"0cb4de1dcc40eee90ea1b39cf02f53d7c6670c3b606ba3c1be5464a4bac6c29f\" for container &ContainerMetadata{Name:kube-proxy,Attempt:0,}" Jan 13 20:08:45.003392 containerd[1934]: time="2025-01-13T20:08:45.003200432Z" level=info msg="CreateContainer within sandbox \"0cb4de1dcc40eee90ea1b39cf02f53d7c6670c3b606ba3c1be5464a4bac6c29f\" for &ContainerMetadata{Name:kube-proxy,Attempt:0,} returns container id \"4572019510176b0dcf41195259c24a93c08dff430575066c35560ba7dd334b7e\"" Jan 13 20:08:45.006200 containerd[1934]: time="2025-01-13T20:08:45.005254196Z" level=info msg="StartContainer for \"4572019510176b0dcf41195259c24a93c08dff430575066c35560ba7dd334b7e\"" Jan 13 20:08:45.056340 systemd[1]: Started cri-containerd-4572019510176b0dcf41195259c24a93c08dff430575066c35560ba7dd334b7e.scope - libcontainer container 4572019510176b0dcf41195259c24a93c08dff430575066c35560ba7dd334b7e. Jan 13 20:08:45.139425 containerd[1934]: time="2025-01-13T20:08:45.139328685Z" level=info msg="StartContainer for \"4572019510176b0dcf41195259c24a93c08dff430575066c35560ba7dd334b7e\" returns successfully" Jan 13 20:08:45.184608 containerd[1934]: time="2025-01-13T20:08:45.184545717Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:tigera-operator-c7ccbd65-m24zq,Uid:68b1ab75-5aa0-430b-b6e7-0b4737b8d9b6,Namespace:tigera-operator,Attempt:0,}" Jan 13 20:08:45.239082 containerd[1934]: time="2025-01-13T20:08:45.238620273Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1 Jan 13 20:08:45.240666 containerd[1934]: time="2025-01-13T20:08:45.239485041Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1 Jan 13 20:08:45.240666 containerd[1934]: time="2025-01-13T20:08:45.239535585Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Jan 13 20:08:45.240666 containerd[1934]: time="2025-01-13T20:08:45.239703645Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Jan 13 20:08:45.295127 systemd[1]: Started cri-containerd-bb3d236ec0067ae548302b8574a3752adb5d128e13bf5ddf15d6c06e888c9d5a.scope - libcontainer container bb3d236ec0067ae548302b8574a3752adb5d128e13bf5ddf15d6c06e888c9d5a. Jan 13 20:08:45.354623 containerd[1934]: time="2025-01-13T20:08:45.354505834Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:tigera-operator-c7ccbd65-m24zq,Uid:68b1ab75-5aa0-430b-b6e7-0b4737b8d9b6,Namespace:tigera-operator,Attempt:0,} returns sandbox id \"bb3d236ec0067ae548302b8574a3752adb5d128e13bf5ddf15d6c06e888c9d5a\"" Jan 13 20:08:45.359517 containerd[1934]: time="2025-01-13T20:08:45.359411674Z" level=info msg="PullImage \"quay.io/tigera/operator:v1.36.2\"" Jan 13 20:08:45.977603 kubelet[3423]: I0113 20:08:45.977049 3423 pod_startup_latency_tracker.go:102] "Observed pod startup duration" pod="kube-system/kube-proxy-fhqlw" podStartSLOduration=1.9769861450000001 podStartE2EDuration="1.976986145s" podCreationTimestamp="2025-01-13 20:08:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-01-13 20:08:45.976644061 +0000 UTC m=+14.382225553" watchObservedRunningTime="2025-01-13 20:08:45.976986145 +0000 UTC m=+14.382567637" Jan 13 20:08:59.114665 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount2706020360.mount: Deactivated successfully. Jan 13 20:08:59.842810 containerd[1934]: time="2025-01-13T20:08:59.841405970Z" level=info msg="ImageCreate event name:\"quay.io/tigera/operator:v1.36.2\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Jan 13 20:08:59.844077 containerd[1934]: time="2025-01-13T20:08:59.843998258Z" level=info msg="stop pulling image quay.io/tigera/operator:v1.36.2: active requests=0, bytes read=19125372" Jan 13 20:08:59.847682 containerd[1934]: time="2025-01-13T20:08:59.847394594Z" level=info msg="ImageCreate event name:\"sha256:30d521e4e84764b396aacbb2a373ca7a573f84571e3955b34329652acccfb73c\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Jan 13 20:08:59.853197 containerd[1934]: time="2025-01-13T20:08:59.853108970Z" level=info msg="ImageCreate event name:\"quay.io/tigera/operator@sha256:fc9ea45f2475fd99db1b36d2ff180a50017b1a5ea0e82a171c6b439b3a620764\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Jan 13 20:08:59.854908 containerd[1934]: time="2025-01-13T20:08:59.854668694Z" level=info msg="Pulled image \"quay.io/tigera/operator:v1.36.2\" with image id \"sha256:30d521e4e84764b396aacbb2a373ca7a573f84571e3955b34329652acccfb73c\", repo tag \"quay.io/tigera/operator:v1.36.2\", repo digest \"quay.io/tigera/operator@sha256:fc9ea45f2475fd99db1b36d2ff180a50017b1a5ea0e82a171c6b439b3a620764\", size \"19120155\" in 14.49516126s" Jan 13 20:08:59.854908 containerd[1934]: time="2025-01-13T20:08:59.854721914Z" level=info msg="PullImage \"quay.io/tigera/operator:v1.36.2\" returns image reference \"sha256:30d521e4e84764b396aacbb2a373ca7a573f84571e3955b34329652acccfb73c\"" Jan 13 20:08:59.860058 containerd[1934]: time="2025-01-13T20:08:59.860000150Z" level=info msg="CreateContainer within sandbox \"bb3d236ec0067ae548302b8574a3752adb5d128e13bf5ddf15d6c06e888c9d5a\" for container &ContainerMetadata{Name:tigera-operator,Attempt:0,}" Jan 13 20:08:59.886690 containerd[1934]: time="2025-01-13T20:08:59.886527806Z" level=info msg="CreateContainer within sandbox \"bb3d236ec0067ae548302b8574a3752adb5d128e13bf5ddf15d6c06e888c9d5a\" for &ContainerMetadata{Name:tigera-operator,Attempt:0,} returns container id \"e50ffdf5d100932a565029f8d2d170e58bb0efc1e1b83f5c3036734e34e7ce69\"" Jan 13 20:08:59.887864 containerd[1934]: time="2025-01-13T20:08:59.887450582Z" level=info msg="StartContainer for \"e50ffdf5d100932a565029f8d2d170e58bb0efc1e1b83f5c3036734e34e7ce69\"" Jan 13 20:08:59.943087 systemd[1]: Started cri-containerd-e50ffdf5d100932a565029f8d2d170e58bb0efc1e1b83f5c3036734e34e7ce69.scope - libcontainer container e50ffdf5d100932a565029f8d2d170e58bb0efc1e1b83f5c3036734e34e7ce69. Jan 13 20:08:59.987349 containerd[1934]: time="2025-01-13T20:08:59.987223274Z" level=info msg="StartContainer for \"e50ffdf5d100932a565029f8d2d170e58bb0efc1e1b83f5c3036734e34e7ce69\" returns successfully" Jan 13 20:09:06.172730 kubelet[3423]: I0113 20:09:06.172601 3423 pod_startup_latency_tracker.go:102] "Observed pod startup duration" pod="tigera-operator/tigera-operator-c7ccbd65-m24zq" podStartSLOduration=7.674331893 podStartE2EDuration="22.172372577s" podCreationTimestamp="2025-01-13 20:08:44 +0000 UTC" firstStartedPulling="2025-01-13 20:08:45.357322546 +0000 UTC m=+13.762904026" lastFinishedPulling="2025-01-13 20:08:59.855363242 +0000 UTC m=+28.260944710" observedRunningTime="2025-01-13 20:09:00.022819739 +0000 UTC m=+28.428401231" watchObservedRunningTime="2025-01-13 20:09:06.172372577 +0000 UTC m=+34.577954069" Jan 13 20:09:06.174440 kubelet[3423]: I0113 20:09:06.173704 3423 topology_manager.go:215] "Topology Admit Handler" podUID="b2fcf70b-da42-463d-93f0-ca41480c8b97" podNamespace="calico-system" podName="calico-typha-6ff768558c-55h2x" Jan 13 20:09:06.183171 kubelet[3423]: I0113 20:09:06.182608 3423 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tigera-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2fcf70b-da42-463d-93f0-ca41480c8b97-tigera-ca-bundle\") pod \"calico-typha-6ff768558c-55h2x\" (UID: \"b2fcf70b-da42-463d-93f0-ca41480c8b97\") " pod="calico-system/calico-typha-6ff768558c-55h2x" Jan 13 20:09:06.183171 kubelet[3423]: I0113 20:09:06.182832 3423 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"typha-certs\" (UniqueName: \"kubernetes.io/secret/b2fcf70b-da42-463d-93f0-ca41480c8b97-typha-certs\") pod \"calico-typha-6ff768558c-55h2x\" (UID: \"b2fcf70b-da42-463d-93f0-ca41480c8b97\") " pod="calico-system/calico-typha-6ff768558c-55h2x" Jan 13 20:09:06.183171 kubelet[3423]: I0113 20:09:06.182892 3423 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf6kj\" (UniqueName: \"kubernetes.io/projected/b2fcf70b-da42-463d-93f0-ca41480c8b97-kube-api-access-jf6kj\") pod \"calico-typha-6ff768558c-55h2x\" (UID: \"b2fcf70b-da42-463d-93f0-ca41480c8b97\") " pod="calico-system/calico-typha-6ff768558c-55h2x" Jan 13 20:09:06.194479 systemd[1]: Created slice kubepods-besteffort-podb2fcf70b_da42_463d_93f0_ca41480c8b97.slice - libcontainer container kubepods-besteffort-podb2fcf70b_da42_463d_93f0_ca41480c8b97.slice. Jan 13 20:09:06.397762 kubelet[3423]: I0113 20:09:06.395856 3423 topology_manager.go:215] "Topology Admit Handler" podUID="9a202e1a-8be0-491d-b630-51953352dca5" podNamespace="calico-system" podName="calico-node-mwzfc" Jan 13 20:09:06.414273 systemd[1]: Created slice kubepods-besteffort-pod9a202e1a_8be0_491d_b630_51953352dca5.slice - libcontainer container kubepods-besteffort-pod9a202e1a_8be0_491d_b630_51953352dca5.slice. Jan 13 20:09:06.487001 kubelet[3423]: I0113 20:09:06.486467 3423 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-certs\" (UniqueName: \"kubernetes.io/secret/9a202e1a-8be0-491d-b630-51953352dca5-node-certs\") pod \"calico-node-mwzfc\" (UID: \"9a202e1a-8be0-491d-b630-51953352dca5\") " pod="calico-system/calico-node-mwzfc" Jan 13 20:09:06.487001 kubelet[3423]: I0113 20:09:06.486558 3423 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-net-dir\" (UniqueName: \"kubernetes.io/host-path/9a202e1a-8be0-491d-b630-51953352dca5-cni-net-dir\") pod \"calico-node-mwzfc\" (UID: \"9a202e1a-8be0-491d-b630-51953352dca5\") " pod="calico-system/calico-node-mwzfc" Jan 13 20:09:06.487001 kubelet[3423]: I0113 20:09:06.486624 3423 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-calico\" (UniqueName: \"kubernetes.io/host-path/9a202e1a-8be0-491d-b630-51953352dca5-var-lib-calico\") pod \"calico-node-mwzfc\" (UID: \"9a202e1a-8be0-491d-b630-51953352dca5\") " pod="calico-system/calico-node-mwzfc" Jan 13 20:09:06.487001 kubelet[3423]: I0113 20:09:06.486755 3423 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-log-dir\" (UniqueName: \"kubernetes.io/host-path/9a202e1a-8be0-491d-b630-51953352dca5-cni-log-dir\") pod \"calico-node-mwzfc\" (UID: \"9a202e1a-8be0-491d-b630-51953352dca5\") " pod="calico-system/calico-node-mwzfc" Jan 13 20:09:06.487803 kubelet[3423]: I0113 20:09:06.487432 3423 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"policysync\" (UniqueName: \"kubernetes.io/host-path/9a202e1a-8be0-491d-b630-51953352dca5-policysync\") pod \"calico-node-mwzfc\" (UID: \"9a202e1a-8be0-491d-b630-51953352dca5\") " pod="calico-system/calico-node-mwzfc" Jan 13 20:09:06.487803 kubelet[3423]: I0113 20:09:06.487582 3423 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-run-calico\" (UniqueName: \"kubernetes.io/host-path/9a202e1a-8be0-491d-b630-51953352dca5-var-run-calico\") pod \"calico-node-mwzfc\" (UID: \"9a202e1a-8be0-491d-b630-51953352dca5\") " pod="calico-system/calico-node-mwzfc" Jan 13 20:09:06.487803 kubelet[3423]: I0113 20:09:06.487677 3423 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-bin-dir\" (UniqueName: \"kubernetes.io/host-path/9a202e1a-8be0-491d-b630-51953352dca5-cni-bin-dir\") pod \"calico-node-mwzfc\" (UID: \"9a202e1a-8be0-491d-b630-51953352dca5\") " pod="calico-system/calico-node-mwzfc" Jan 13 20:09:06.487803 kubelet[3423]: I0113 20:09:06.487731 3423 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"flexvol-driver-host\" (UniqueName: \"kubernetes.io/host-path/9a202e1a-8be0-491d-b630-51953352dca5-flexvol-driver-host\") pod \"calico-node-mwzfc\" (UID: \"9a202e1a-8be0-491d-b630-51953352dca5\") " pod="calico-system/calico-node-mwzfc" Jan 13 20:09:06.488608 kubelet[3423]: I0113 20:09:06.488116 3423 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9a202e1a-8be0-491d-b630-51953352dca5-lib-modules\") pod \"calico-node-mwzfc\" (UID: \"9a202e1a-8be0-491d-b630-51953352dca5\") " pod="calico-system/calico-node-mwzfc" Jan 13 20:09:06.488608 kubelet[3423]: I0113 20:09:06.488439 3423 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/9a202e1a-8be0-491d-b630-51953352dca5-xtables-lock\") pod \"calico-node-mwzfc\" (UID: \"9a202e1a-8be0-491d-b630-51953352dca5\") " pod="calico-system/calico-node-mwzfc" Jan 13 20:09:06.488884 kubelet[3423]: I0113 20:09:06.488670 3423 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tigera-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a202e1a-8be0-491d-b630-51953352dca5-tigera-ca-bundle\") pod \"calico-node-mwzfc\" (UID: \"9a202e1a-8be0-491d-b630-51953352dca5\") " pod="calico-system/calico-node-mwzfc" Jan 13 20:09:06.489138 kubelet[3423]: I0113 20:09:06.488999 3423 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cldjq\" (UniqueName: \"kubernetes.io/projected/9a202e1a-8be0-491d-b630-51953352dca5-kube-api-access-cldjq\") pod \"calico-node-mwzfc\" (UID: \"9a202e1a-8be0-491d-b630-51953352dca5\") " pod="calico-system/calico-node-mwzfc" Jan 13 20:09:06.506820 containerd[1934]: time="2025-01-13T20:09:06.506710927Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-typha-6ff768558c-55h2x,Uid:b2fcf70b-da42-463d-93f0-ca41480c8b97,Namespace:calico-system,Attempt:0,}" Jan 13 20:09:06.559468 kubelet[3423]: I0113 20:09:06.559383 3423 topology_manager.go:215] "Topology Admit Handler" podUID="d47fc662-eff9-4473-83da-b6f0b896d81f" podNamespace="calico-system" podName="csi-node-driver-wq54r" Jan 13 20:09:06.560970 kubelet[3423]: E0113 20:09:06.559898 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized" pod="calico-system/csi-node-driver-wq54r" podUID="d47fc662-eff9-4473-83da-b6f0b896d81f" Jan 13 20:09:06.569733 containerd[1934]: time="2025-01-13T20:09:06.568591675Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1 Jan 13 20:09:06.569733 containerd[1934]: time="2025-01-13T20:09:06.569452603Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1 Jan 13 20:09:06.569733 containerd[1934]: time="2025-01-13T20:09:06.569483587Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Jan 13 20:09:06.570238 containerd[1934]: time="2025-01-13T20:09:06.569653891Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Jan 13 20:09:06.590239 kubelet[3423]: I0113 20:09:06.589950 3423 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d47fc662-eff9-4473-83da-b6f0b896d81f-registration-dir\") pod \"csi-node-driver-wq54r\" (UID: \"d47fc662-eff9-4473-83da-b6f0b896d81f\") " pod="calico-system/csi-node-driver-wq54r" Jan 13 20:09:06.591242 kubelet[3423]: I0113 20:09:06.590209 3423 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsfln\" (UniqueName: \"kubernetes.io/projected/d47fc662-eff9-4473-83da-b6f0b896d81f-kube-api-access-qsfln\") pod \"csi-node-driver-wq54r\" (UID: \"d47fc662-eff9-4473-83da-b6f0b896d81f\") " pod="calico-system/csi-node-driver-wq54r" Jan 13 20:09:06.591242 kubelet[3423]: I0113 20:09:06.590967 3423 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"varrun\" (UniqueName: \"kubernetes.io/host-path/d47fc662-eff9-4473-83da-b6f0b896d81f-varrun\") pod \"csi-node-driver-wq54r\" (UID: \"d47fc662-eff9-4473-83da-b6f0b896d81f\") " pod="calico-system/csi-node-driver-wq54r" Jan 13 20:09:06.591906 kubelet[3423]: I0113 20:09:06.591455 3423 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d47fc662-eff9-4473-83da-b6f0b896d81f-kubelet-dir\") pod \"csi-node-driver-wq54r\" (UID: \"d47fc662-eff9-4473-83da-b6f0b896d81f\") " pod="calico-system/csi-node-driver-wq54r" Jan 13 20:09:06.591906 kubelet[3423]: I0113 20:09:06.591538 3423 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d47fc662-eff9-4473-83da-b6f0b896d81f-socket-dir\") pod \"csi-node-driver-wq54r\" (UID: \"d47fc662-eff9-4473-83da-b6f0b896d81f\") " pod="calico-system/csi-node-driver-wq54r" Jan 13 20:09:06.595339 kubelet[3423]: E0113 20:09:06.594859 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.595339 kubelet[3423]: W0113 20:09:06.594895 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.595339 kubelet[3423]: E0113 20:09:06.594958 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.598446 kubelet[3423]: E0113 20:09:06.597333 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.598446 kubelet[3423]: W0113 20:09:06.598058 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.598446 kubelet[3423]: E0113 20:09:06.598152 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.599012 kubelet[3423]: E0113 20:09:06.598854 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.599012 kubelet[3423]: W0113 20:09:06.598880 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.599012 kubelet[3423]: E0113 20:09:06.598926 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.601859 kubelet[3423]: E0113 20:09:06.600548 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.601859 kubelet[3423]: W0113 20:09:06.600605 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.601859 kubelet[3423]: E0113 20:09:06.600659 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.602136 kubelet[3423]: E0113 20:09:06.601877 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.602136 kubelet[3423]: W0113 20:09:06.601909 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.602136 kubelet[3423]: E0113 20:09:06.601961 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.603072 kubelet[3423]: E0113 20:09:06.603027 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.603515 kubelet[3423]: W0113 20:09:06.603061 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.603920 kubelet[3423]: E0113 20:09:06.603638 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.604099 kubelet[3423]: E0113 20:09:06.604057 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.604099 kubelet[3423]: W0113 20:09:06.604078 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.604599 kubelet[3423]: E0113 20:09:06.604146 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.605608 kubelet[3423]: E0113 20:09:06.605563 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.605608 kubelet[3423]: W0113 20:09:06.605598 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.605996 kubelet[3423]: E0113 20:09:06.605918 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.606337 kubelet[3423]: E0113 20:09:06.606085 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.606337 kubelet[3423]: W0113 20:09:06.606310 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.608596 kubelet[3423]: E0113 20:09:06.607961 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.608596 kubelet[3423]: E0113 20:09:06.608031 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.608596 kubelet[3423]: W0113 20:09:06.608050 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.608596 kubelet[3423]: E0113 20:09:06.608433 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.608596 kubelet[3423]: W0113 20:09:06.608452 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.611053 kubelet[3423]: E0113 20:09:06.609397 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.611053 kubelet[3423]: E0113 20:09:06.609462 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.611053 kubelet[3423]: E0113 20:09:06.610819 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.611053 kubelet[3423]: W0113 20:09:06.610846 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.611484 kubelet[3423]: E0113 20:09:06.611454 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.611803 kubelet[3423]: E0113 20:09:06.611689 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.611803 kubelet[3423]: W0113 20:09:06.611712 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.611965 kubelet[3423]: E0113 20:09:06.611838 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.614810 kubelet[3423]: E0113 20:09:06.613043 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.614810 kubelet[3423]: W0113 20:09:06.613075 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.614810 kubelet[3423]: E0113 20:09:06.613172 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.617436 kubelet[3423]: E0113 20:09:06.617217 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.617436 kubelet[3423]: W0113 20:09:06.617251 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.617436 kubelet[3423]: E0113 20:09:06.617326 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.618015 kubelet[3423]: E0113 20:09:06.617840 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.618015 kubelet[3423]: W0113 20:09:06.617865 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.618015 kubelet[3423]: E0113 20:09:06.617940 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.620040 kubelet[3423]: E0113 20:09:06.618794 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.620040 kubelet[3423]: W0113 20:09:06.618823 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.620040 kubelet[3423]: E0113 20:09:06.618895 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.621909 kubelet[3423]: E0113 20:09:06.621320 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.621909 kubelet[3423]: W0113 20:09:06.621734 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.622119 kubelet[3423]: E0113 20:09:06.621917 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.625810 kubelet[3423]: E0113 20:09:06.622831 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.625810 kubelet[3423]: W0113 20:09:06.622861 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.625810 kubelet[3423]: E0113 20:09:06.622938 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.628653 kubelet[3423]: E0113 20:09:06.628402 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.628653 kubelet[3423]: W0113 20:09:06.628437 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.628653 kubelet[3423]: E0113 20:09:06.628521 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.629291 kubelet[3423]: E0113 20:09:06.629232 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.629291 kubelet[3423]: W0113 20:09:06.629257 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.631735 kubelet[3423]: E0113 20:09:06.631107 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.631735 kubelet[3423]: E0113 20:09:06.631354 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.631735 kubelet[3423]: W0113 20:09:06.631373 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.633101 kubelet[3423]: E0113 20:09:06.632766 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.633101 kubelet[3423]: W0113 20:09:06.632813 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.634208 kubelet[3423]: E0113 20:09:06.633875 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.634208 kubelet[3423]: W0113 20:09:06.633906 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.635738 kubelet[3423]: E0113 20:09:06.635039 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.635738 kubelet[3423]: W0113 20:09:06.635082 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.636807 kubelet[3423]: E0113 20:09:06.636281 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.636807 kubelet[3423]: W0113 20:09:06.636322 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.636807 kubelet[3423]: E0113 20:09:06.636352 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.636807 kubelet[3423]: E0113 20:09:06.636405 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.636807 kubelet[3423]: E0113 20:09:06.636715 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.636807 kubelet[3423]: E0113 20:09:06.636759 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.637211 kubelet[3423]: E0113 20:09:06.636191 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.637871 kubelet[3423]: E0113 20:09:06.637752 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.637871 kubelet[3423]: W0113 20:09:06.637804 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.637871 kubelet[3423]: E0113 20:09:06.637836 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.638933 kubelet[3423]: E0113 20:09:06.638671 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.638933 kubelet[3423]: W0113 20:09:06.638729 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.638933 kubelet[3423]: E0113 20:09:06.638759 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.644222 systemd[1]: Started cri-containerd-636986403e8720083393f86e05bee8883726adc3e62c7a57593d9310043ce387.scope - libcontainer container 636986403e8720083393f86e05bee8883726adc3e62c7a57593d9310043ce387. Jan 13 20:09:06.666661 kubelet[3423]: E0113 20:09:06.666613 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.666661 kubelet[3423]: W0113 20:09:06.666649 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.666973 kubelet[3423]: E0113 20:09:06.666687 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.688279 kubelet[3423]: E0113 20:09:06.688146 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.688279 kubelet[3423]: W0113 20:09:06.688179 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.688279 kubelet[3423]: E0113 20:09:06.688220 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.693223 kubelet[3423]: E0113 20:09:06.692863 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.693223 kubelet[3423]: W0113 20:09:06.692897 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.693223 kubelet[3423]: E0113 20:09:06.692930 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.694525 kubelet[3423]: E0113 20:09:06.694238 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.694525 kubelet[3423]: W0113 20:09:06.694271 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.694525 kubelet[3423]: E0113 20:09:06.694327 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.695752 kubelet[3423]: E0113 20:09:06.695272 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.695752 kubelet[3423]: W0113 20:09:06.695308 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.695752 kubelet[3423]: E0113 20:09:06.695380 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.696985 kubelet[3423]: E0113 20:09:06.696911 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.696985 kubelet[3423]: W0113 20:09:06.696944 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.697593 kubelet[3423]: E0113 20:09:06.697202 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.698743 kubelet[3423]: E0113 20:09:06.698349 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.698743 kubelet[3423]: W0113 20:09:06.698380 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.698743 kubelet[3423]: E0113 20:09:06.698429 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.700024 kubelet[3423]: E0113 20:09:06.699871 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.700024 kubelet[3423]: W0113 20:09:06.699905 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.700024 kubelet[3423]: E0113 20:09:06.699984 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.701240 kubelet[3423]: E0113 20:09:06.700612 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.701240 kubelet[3423]: W0113 20:09:06.700640 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.701240 kubelet[3423]: E0113 20:09:06.700729 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.702640 kubelet[3423]: E0113 20:09:06.701737 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.702640 kubelet[3423]: W0113 20:09:06.701768 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.702640 kubelet[3423]: E0113 20:09:06.701890 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.703338 kubelet[3423]: E0113 20:09:06.703310 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.703592 kubelet[3423]: W0113 20:09:06.703461 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.703592 kubelet[3423]: E0113 20:09:06.703564 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.704290 kubelet[3423]: E0113 20:09:06.704089 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.704290 kubelet[3423]: W0113 20:09:06.704114 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.705427 kubelet[3423]: E0113 20:09:06.704854 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.705427 kubelet[3423]: E0113 20:09:06.705143 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.705427 kubelet[3423]: W0113 20:09:06.705162 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.706044 kubelet[3423]: E0113 20:09:06.705869 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.706836 kubelet[3423]: E0113 20:09:06.706521 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.706836 kubelet[3423]: W0113 20:09:06.706550 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.706836 kubelet[3423]: E0113 20:09:06.706634 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.707565 kubelet[3423]: E0113 20:09:06.707414 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.707565 kubelet[3423]: W0113 20:09:06.707440 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.708318 kubelet[3423]: E0113 20:09:06.708145 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.708318 kubelet[3423]: W0113 20:09:06.708173 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.708979 kubelet[3423]: E0113 20:09:06.708697 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.708979 kubelet[3423]: E0113 20:09:06.708888 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.708979 kubelet[3423]: W0113 20:09:06.708921 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.709301 kubelet[3423]: E0113 20:09:06.708891 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.709301 kubelet[3423]: E0113 20:09:06.709116 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.709743 kubelet[3423]: E0113 20:09:06.709665 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.709743 kubelet[3423]: W0113 20:09:06.709696 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.710682 kubelet[3423]: E0113 20:09:06.709897 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.712194 kubelet[3423]: E0113 20:09:06.712123 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.712194 kubelet[3423]: W0113 20:09:06.712171 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.712575 kubelet[3423]: E0113 20:09:06.712223 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.712675 kubelet[3423]: E0113 20:09:06.712596 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.712675 kubelet[3423]: W0113 20:09:06.712614 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.712675 kubelet[3423]: E0113 20:09:06.712641 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.713318 kubelet[3423]: E0113 20:09:06.713002 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.713318 kubelet[3423]: W0113 20:09:06.713021 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.713318 kubelet[3423]: E0113 20:09:06.713078 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.714127 kubelet[3423]: E0113 20:09:06.714082 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.714127 kubelet[3423]: W0113 20:09:06.714118 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.714462 kubelet[3423]: E0113 20:09:06.714261 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.715003 kubelet[3423]: E0113 20:09:06.714960 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.715003 kubelet[3423]: W0113 20:09:06.714995 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.715651 kubelet[3423]: E0113 20:09:06.715441 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.716134 kubelet[3423]: E0113 20:09:06.716095 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.716134 kubelet[3423]: W0113 20:09:06.716127 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.716406 kubelet[3423]: E0113 20:09:06.716262 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.719177 kubelet[3423]: E0113 20:09:06.719128 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.719177 kubelet[3423]: W0113 20:09:06.719165 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.719709 kubelet[3423]: E0113 20:09:06.719349 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.719709 kubelet[3423]: E0113 20:09:06.719600 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.719709 kubelet[3423]: W0113 20:09:06.719619 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.719709 kubelet[3423]: E0113 20:09:06.719659 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.720495 kubelet[3423]: E0113 20:09:06.720067 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.720495 kubelet[3423]: W0113 20:09:06.720086 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.720495 kubelet[3423]: E0113 20:09:06.720113 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.722852 containerd[1934]: time="2025-01-13T20:09:06.722063492Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-node-mwzfc,Uid:9a202e1a-8be0-491d-b630-51953352dca5,Namespace:calico-system,Attempt:0,}" Jan 13 20:09:06.763039 kubelet[3423]: E0113 20:09:06.762904 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:06.763319 kubelet[3423]: W0113 20:09:06.763188 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:06.763319 kubelet[3423]: E0113 20:09:06.763230 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:06.804721 containerd[1934]: time="2025-01-13T20:09:06.804076280Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1 Jan 13 20:09:06.804721 containerd[1934]: time="2025-01-13T20:09:06.804186716Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1 Jan 13 20:09:06.804721 containerd[1934]: time="2025-01-13T20:09:06.804238064Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Jan 13 20:09:06.804721 containerd[1934]: time="2025-01-13T20:09:06.804381416Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Jan 13 20:09:06.856115 systemd[1]: Started cri-containerd-1da5f8e217f8d8914413b2f1e2f6fc0151b465145dd0ee54001de8e77e8df94b.scope - libcontainer container 1da5f8e217f8d8914413b2f1e2f6fc0151b465145dd0ee54001de8e77e8df94b. Jan 13 20:09:06.896709 containerd[1934]: time="2025-01-13T20:09:06.896642013Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-typha-6ff768558c-55h2x,Uid:b2fcf70b-da42-463d-93f0-ca41480c8b97,Namespace:calico-system,Attempt:0,} returns sandbox id \"636986403e8720083393f86e05bee8883726adc3e62c7a57593d9310043ce387\"" Jan 13 20:09:06.904093 containerd[1934]: time="2025-01-13T20:09:06.903836373Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/typha:v3.29.1\"" Jan 13 20:09:06.962224 containerd[1934]: time="2025-01-13T20:09:06.962131917Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-node-mwzfc,Uid:9a202e1a-8be0-491d-b630-51953352dca5,Namespace:calico-system,Attempt:0,} returns sandbox id \"1da5f8e217f8d8914413b2f1e2f6fc0151b465145dd0ee54001de8e77e8df94b\"" Jan 13 20:09:07.842711 kubelet[3423]: E0113 20:09:07.840744 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized" pod="calico-system/csi-node-driver-wq54r" podUID="d47fc662-eff9-4473-83da-b6f0b896d81f" Jan 13 20:09:08.255079 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount354693754.mount: Deactivated successfully. Jan 13 20:09:09.171862 containerd[1934]: time="2025-01-13T20:09:09.171808244Z" level=info msg="ImageCreate event name:\"ghcr.io/flatcar/calico/typha:v3.29.1\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Jan 13 20:09:09.174147 containerd[1934]: time="2025-01-13T20:09:09.174069704Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/typha:v3.29.1: active requests=0, bytes read=29231308" Jan 13 20:09:09.177921 containerd[1934]: time="2025-01-13T20:09:09.177585668Z" level=info msg="ImageCreate event name:\"sha256:1d1fc316829ae1650b0b1629b54232520f297e7c3b1444eecd290ae088902a28\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Jan 13 20:09:09.184155 containerd[1934]: time="2025-01-13T20:09:09.184058720Z" level=info msg="ImageCreate event name:\"ghcr.io/flatcar/calico/typha@sha256:768a194e1115c73bcbf35edb7afd18a63e16e08d940c79993565b6a3cca2da7c\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Jan 13 20:09:09.185821 containerd[1934]: time="2025-01-13T20:09:09.185563412Z" level=info msg="Pulled image \"ghcr.io/flatcar/calico/typha:v3.29.1\" with image id \"sha256:1d1fc316829ae1650b0b1629b54232520f297e7c3b1444eecd290ae088902a28\", repo tag \"ghcr.io/flatcar/calico/typha:v3.29.1\", repo digest \"ghcr.io/flatcar/calico/typha@sha256:768a194e1115c73bcbf35edb7afd18a63e16e08d940c79993565b6a3cca2da7c\", size \"29231162\" in 2.281108187s" Jan 13 20:09:09.185821 containerd[1934]: time="2025-01-13T20:09:09.185613704Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/typha:v3.29.1\" returns image reference \"sha256:1d1fc316829ae1650b0b1629b54232520f297e7c3b1444eecd290ae088902a28\"" Jan 13 20:09:09.188203 containerd[1934]: time="2025-01-13T20:09:09.187866920Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/pod2daemon-flexvol:v3.29.1\"" Jan 13 20:09:09.208572 containerd[1934]: time="2025-01-13T20:09:09.208055696Z" level=info msg="CreateContainer within sandbox \"636986403e8720083393f86e05bee8883726adc3e62c7a57593d9310043ce387\" for container &ContainerMetadata{Name:calico-typha,Attempt:0,}" Jan 13 20:09:09.242952 containerd[1934]: time="2025-01-13T20:09:09.242878184Z" level=info msg="CreateContainer within sandbox \"636986403e8720083393f86e05bee8883726adc3e62c7a57593d9310043ce387\" for &ContainerMetadata{Name:calico-typha,Attempt:0,} returns container id \"7c6386262af389269772571fd755fd366bbebb78c0de7f25c4ebd1ebcde16018\"" Jan 13 20:09:09.244929 containerd[1934]: time="2025-01-13T20:09:09.243871340Z" level=info msg="StartContainer for \"7c6386262af389269772571fd755fd366bbebb78c0de7f25c4ebd1ebcde16018\"" Jan 13 20:09:09.299082 systemd[1]: Started cri-containerd-7c6386262af389269772571fd755fd366bbebb78c0de7f25c4ebd1ebcde16018.scope - libcontainer container 7c6386262af389269772571fd755fd366bbebb78c0de7f25c4ebd1ebcde16018. Jan 13 20:09:09.396175 containerd[1934]: time="2025-01-13T20:09:09.396120789Z" level=info msg="StartContainer for \"7c6386262af389269772571fd755fd366bbebb78c0de7f25c4ebd1ebcde16018\" returns successfully" Jan 13 20:09:09.840840 kubelet[3423]: E0113 20:09:09.840509 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized" pod="calico-system/csi-node-driver-wq54r" podUID="d47fc662-eff9-4473-83da-b6f0b896d81f" Jan 13 20:09:10.067907 kubelet[3423]: I0113 20:09:10.067384 3423 pod_startup_latency_tracker.go:102] "Observed pod startup duration" pod="calico-system/calico-typha-6ff768558c-55h2x" podStartSLOduration=1.7822248090000001 podStartE2EDuration="4.067328624s" podCreationTimestamp="2025-01-13 20:09:06 +0000 UTC" firstStartedPulling="2025-01-13 20:09:06.901218681 +0000 UTC m=+35.306800149" lastFinishedPulling="2025-01-13 20:09:09.186322436 +0000 UTC m=+37.591903964" observedRunningTime="2025-01-13 20:09:10.067187384 +0000 UTC m=+38.472768888" watchObservedRunningTime="2025-01-13 20:09:10.067328624 +0000 UTC m=+38.472910152" Jan 13 20:09:10.107379 kubelet[3423]: E0113 20:09:10.107228 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:10.107379 kubelet[3423]: W0113 20:09:10.107267 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:10.107379 kubelet[3423]: E0113 20:09:10.107304 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:10.107942 kubelet[3423]: E0113 20:09:10.107874 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:10.107942 kubelet[3423]: W0113 20:09:10.107894 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:10.107942 kubelet[3423]: E0113 20:09:10.107923 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:10.108696 kubelet[3423]: E0113 20:09:10.108649 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:10.108807 kubelet[3423]: W0113 20:09:10.108681 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:10.108807 kubelet[3423]: E0113 20:09:10.108741 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:10.110405 kubelet[3423]: E0113 20:09:10.110349 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:10.110405 kubelet[3423]: W0113 20:09:10.110422 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:10.111065 kubelet[3423]: E0113 20:09:10.110459 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:10.111065 kubelet[3423]: E0113 20:09:10.110907 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:10.111065 kubelet[3423]: W0113 20:09:10.110926 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:10.111065 kubelet[3423]: E0113 20:09:10.110953 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:10.112087 kubelet[3423]: E0113 20:09:10.111836 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:10.112087 kubelet[3423]: W0113 20:09:10.111863 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:10.112087 kubelet[3423]: E0113 20:09:10.111909 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:10.113119 kubelet[3423]: E0113 20:09:10.112590 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:10.113119 kubelet[3423]: W0113 20:09:10.112615 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:10.113119 kubelet[3423]: E0113 20:09:10.112648 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:10.114315 kubelet[3423]: E0113 20:09:10.113430 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:10.114315 kubelet[3423]: W0113 20:09:10.113454 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:10.114315 kubelet[3423]: E0113 20:09:10.113489 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:10.114315 kubelet[3423]: E0113 20:09:10.114292 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:10.114315 kubelet[3423]: W0113 20:09:10.114316 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:10.114614 kubelet[3423]: E0113 20:09:10.114347 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:10.115136 kubelet[3423]: E0113 20:09:10.114722 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:10.115136 kubelet[3423]: W0113 20:09:10.114739 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:10.115136 kubelet[3423]: E0113 20:09:10.114816 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:10.115790 kubelet[3423]: E0113 20:09:10.115241 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:10.115790 kubelet[3423]: W0113 20:09:10.115261 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:10.115790 kubelet[3423]: E0113 20:09:10.115288 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:10.115790 kubelet[3423]: E0113 20:09:10.115589 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:10.115790 kubelet[3423]: W0113 20:09:10.115604 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:10.115790 kubelet[3423]: E0113 20:09:10.115628 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:10.116721 kubelet[3423]: E0113 20:09:10.115988 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:10.116721 kubelet[3423]: W0113 20:09:10.116006 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:10.116721 kubelet[3423]: E0113 20:09:10.116032 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:10.116721 kubelet[3423]: E0113 20:09:10.116320 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:10.116721 kubelet[3423]: W0113 20:09:10.116335 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:10.116721 kubelet[3423]: E0113 20:09:10.116361 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:10.116721 kubelet[3423]: E0113 20:09:10.116647 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:10.116721 kubelet[3423]: W0113 20:09:10.116664 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:10.116721 kubelet[3423]: E0113 20:09:10.116688 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:10.137540 kubelet[3423]: E0113 20:09:10.137310 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:10.137540 kubelet[3423]: W0113 20:09:10.137342 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:10.137540 kubelet[3423]: E0113 20:09:10.137374 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:10.138444 kubelet[3423]: E0113 20:09:10.138401 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:10.138444 kubelet[3423]: W0113 20:09:10.138436 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:10.138444 kubelet[3423]: E0113 20:09:10.138481 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:10.139099 kubelet[3423]: E0113 20:09:10.139074 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:10.139199 kubelet[3423]: W0113 20:09:10.139177 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:10.139450 kubelet[3423]: E0113 20:09:10.139296 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:10.139869 kubelet[3423]: E0113 20:09:10.139634 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:10.139869 kubelet[3423]: W0113 20:09:10.139655 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:10.139869 kubelet[3423]: E0113 20:09:10.139697 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:10.140153 kubelet[3423]: E0113 20:09:10.140133 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:10.140247 kubelet[3423]: W0113 20:09:10.140226 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:10.140384 kubelet[3423]: E0113 20:09:10.140351 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:10.140769 kubelet[3423]: E0113 20:09:10.140748 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:10.141074 kubelet[3423]: W0113 20:09:10.140916 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:10.141074 kubelet[3423]: E0113 20:09:10.140972 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:10.141301 kubelet[3423]: E0113 20:09:10.141282 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:10.141403 kubelet[3423]: W0113 20:09:10.141381 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:10.141575 kubelet[3423]: E0113 20:09:10.141517 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:10.142126 kubelet[3423]: E0113 20:09:10.142102 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:10.142387 kubelet[3423]: W0113 20:09:10.142224 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:10.142387 kubelet[3423]: E0113 20:09:10.142280 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:10.143127 kubelet[3423]: E0113 20:09:10.142938 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:10.143127 kubelet[3423]: W0113 20:09:10.142966 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:10.143127 kubelet[3423]: E0113 20:09:10.143016 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:10.143763 kubelet[3423]: E0113 20:09:10.143719 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:10.144757 kubelet[3423]: W0113 20:09:10.144081 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:10.144757 kubelet[3423]: E0113 20:09:10.144276 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:10.145452 kubelet[3423]: E0113 20:09:10.145403 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:10.145673 kubelet[3423]: W0113 20:09:10.145592 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:10.145999 kubelet[3423]: E0113 20:09:10.145818 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:10.146599 kubelet[3423]: E0113 20:09:10.146415 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:10.146599 kubelet[3423]: W0113 20:09:10.146440 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:10.146599 kubelet[3423]: E0113 20:09:10.146491 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:10.146941 kubelet[3423]: E0113 20:09:10.146912 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:10.147001 kubelet[3423]: W0113 20:09:10.146940 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:10.147001 kubelet[3423]: E0113 20:09:10.146977 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:10.147468 kubelet[3423]: E0113 20:09:10.147422 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:10.147468 kubelet[3423]: W0113 20:09:10.147451 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:10.147624 kubelet[3423]: E0113 20:09:10.147503 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:10.148130 kubelet[3423]: E0113 20:09:10.148102 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:10.148130 kubelet[3423]: W0113 20:09:10.148127 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:10.148351 kubelet[3423]: E0113 20:09:10.148238 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:10.148507 kubelet[3423]: E0113 20:09:10.148481 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:10.148507 kubelet[3423]: W0113 20:09:10.148506 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:10.148507 kubelet[3423]: E0113 20:09:10.148535 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:10.148924 kubelet[3423]: E0113 20:09:10.148898 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:10.149024 kubelet[3423]: W0113 20:09:10.148922 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:10.149024 kubelet[3423]: E0113 20:09:10.148949 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:10.154109 kubelet[3423]: E0113 20:09:10.153559 3423 driver-call.go:262] Failed to unmarshal output for command: init, output: "", error: unexpected end of JSON input Jan 13 20:09:10.154109 kubelet[3423]: W0113 20:09:10.153595 3423 driver-call.go:149] FlexVolume: driver call failed: executable: /opt/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds/uds, args: [init], error: executable file not found in $PATH, output: "" Jan 13 20:09:10.154109 kubelet[3423]: E0113 20:09:10.153642 3423 plugins.go:730] "Error dynamically probing plugins" err="error creating Flexvolume plugin from directory nodeagent~uds, skipping. Error: unexpected end of JSON input" Jan 13 20:09:10.641705 containerd[1934]: time="2025-01-13T20:09:10.640877615Z" level=info msg="ImageCreate event name:\"ghcr.io/flatcar/calico/pod2daemon-flexvol:v3.29.1\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Jan 13 20:09:10.643228 containerd[1934]: time="2025-01-13T20:09:10.643152743Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/pod2daemon-flexvol:v3.29.1: active requests=0, bytes read=5117811" Jan 13 20:09:10.645369 containerd[1934]: time="2025-01-13T20:09:10.645269447Z" level=info msg="ImageCreate event name:\"sha256:ece9bca32e64e726de8bbfc9e175a3ca91e0881cd40352bfcd1d107411f4f348\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Jan 13 20:09:10.649640 containerd[1934]: time="2025-01-13T20:09:10.649494959Z" level=info msg="ImageCreate event name:\"ghcr.io/flatcar/calico/pod2daemon-flexvol@sha256:a63f8b4ff531912d12d143664eb263fdbc6cd7b3ff4aa777dfb6e318a090462c\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Jan 13 20:09:10.655493 containerd[1934]: time="2025-01-13T20:09:10.654213167Z" level=info msg="Pulled image \"ghcr.io/flatcar/calico/pod2daemon-flexvol:v3.29.1\" with image id \"sha256:ece9bca32e64e726de8bbfc9e175a3ca91e0881cd40352bfcd1d107411f4f348\", repo tag \"ghcr.io/flatcar/calico/pod2daemon-flexvol:v3.29.1\", repo digest \"ghcr.io/flatcar/calico/pod2daemon-flexvol@sha256:a63f8b4ff531912d12d143664eb263fdbc6cd7b3ff4aa777dfb6e318a090462c\", size \"6487425\" in 1.466268163s" Jan 13 20:09:10.655493 containerd[1934]: time="2025-01-13T20:09:10.654327539Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/pod2daemon-flexvol:v3.29.1\" returns image reference \"sha256:ece9bca32e64e726de8bbfc9e175a3ca91e0881cd40352bfcd1d107411f4f348\"" Jan 13 20:09:10.667144 containerd[1934]: time="2025-01-13T20:09:10.665944499Z" level=info msg="CreateContainer within sandbox \"1da5f8e217f8d8914413b2f1e2f6fc0151b465145dd0ee54001de8e77e8df94b\" for container &ContainerMetadata{Name:flexvol-driver,Attempt:0,}" Jan 13 20:09:10.695911 containerd[1934]: time="2025-01-13T20:09:10.695739684Z" level=info msg="CreateContainer within sandbox \"1da5f8e217f8d8914413b2f1e2f6fc0151b465145dd0ee54001de8e77e8df94b\" for &ContainerMetadata{Name:flexvol-driver,Attempt:0,} returns container id \"e6c96a1c75084663fbd11bbdd75da135327aca99b3818ddebab9cca1386bd622\"" Jan 13 20:09:10.698415 containerd[1934]: time="2025-01-13T20:09:10.698329884Z" level=info msg="StartContainer for \"e6c96a1c75084663fbd11bbdd75da135327aca99b3818ddebab9cca1386bd622\"" Jan 13 20:09:10.766049 systemd[1]: Started cri-containerd-e6c96a1c75084663fbd11bbdd75da135327aca99b3818ddebab9cca1386bd622.scope - libcontainer container e6c96a1c75084663fbd11bbdd75da135327aca99b3818ddebab9cca1386bd622. Jan 13 20:09:10.856240 containerd[1934]: time="2025-01-13T20:09:10.855191364Z" level=info msg="StartContainer for \"e6c96a1c75084663fbd11bbdd75da135327aca99b3818ddebab9cca1386bd622\" returns successfully" Jan 13 20:09:10.876256 systemd[1]: cri-containerd-e6c96a1c75084663fbd11bbdd75da135327aca99b3818ddebab9cca1386bd622.scope: Deactivated successfully. Jan 13 20:09:10.923084 systemd[1]: run-containerd-io.containerd.runtime.v2.task-k8s.io-e6c96a1c75084663fbd11bbdd75da135327aca99b3818ddebab9cca1386bd622-rootfs.mount: Deactivated successfully. Jan 13 20:09:11.843094 kubelet[3423]: E0113 20:09:11.841383 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized" pod="calico-system/csi-node-driver-wq54r" podUID="d47fc662-eff9-4473-83da-b6f0b896d81f" Jan 13 20:09:12.168182 containerd[1934]: time="2025-01-13T20:09:12.168096179Z" level=info msg="shim disconnected" id=e6c96a1c75084663fbd11bbdd75da135327aca99b3818ddebab9cca1386bd622 namespace=k8s.io Jan 13 20:09:12.168182 containerd[1934]: time="2025-01-13T20:09:12.168167915Z" level=warning msg="cleaning up after shim disconnected" id=e6c96a1c75084663fbd11bbdd75da135327aca99b3818ddebab9cca1386bd622 namespace=k8s.io Jan 13 20:09:12.168835 containerd[1934]: time="2025-01-13T20:09:12.168191363Z" level=info msg="cleaning up dead shim" namespace=k8s.io Jan 13 20:09:12.188607 containerd[1934]: time="2025-01-13T20:09:12.188448527Z" level=warning msg="cleanup warnings time=\"2025-01-13T20:09:12Z\" level=warning msg=\"failed to remove runc container\" error=\"runc did not terminate successfully: exit status 255: \" runtime=io.containerd.runc.v2\n" namespace=k8s.io Jan 13 20:09:13.060332 containerd[1934]: time="2025-01-13T20:09:13.060262571Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/cni:v3.29.1\"" Jan 13 20:09:13.723342 systemd[1]: Started sshd@7-172.31.28.23:22-147.75.109.163:56428.service - OpenSSH per-connection server daemon (147.75.109.163:56428). Jan 13 20:09:13.840973 kubelet[3423]: E0113 20:09:13.840935 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized" pod="calico-system/csi-node-driver-wq54r" podUID="d47fc662-eff9-4473-83da-b6f0b896d81f" Jan 13 20:09:13.914310 sshd[4113]: Accepted publickey for core from 147.75.109.163 port 56428 ssh2: RSA SHA256:IRHkteilZRLg/mCVEzdResksy7NfUBDRRywgALKaHg0 Jan 13 20:09:13.916884 sshd-session[4113]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Jan 13 20:09:13.927108 systemd-logind[1912]: New session 8 of user core. Jan 13 20:09:13.934027 systemd[1]: Started session-8.scope - Session 8 of User core. Jan 13 20:09:14.208147 sshd[4115]: Connection closed by 147.75.109.163 port 56428 Jan 13 20:09:14.209288 sshd-session[4113]: pam_unix(sshd:session): session closed for user core Jan 13 20:09:14.216386 systemd[1]: sshd@7-172.31.28.23:22-147.75.109.163:56428.service: Deactivated successfully. Jan 13 20:09:14.220698 systemd[1]: session-8.scope: Deactivated successfully. Jan 13 20:09:14.223300 systemd-logind[1912]: Session 8 logged out. Waiting for processes to exit. Jan 13 20:09:14.225948 systemd-logind[1912]: Removed session 8. Jan 13 20:09:15.840739 kubelet[3423]: E0113 20:09:15.840684 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized" pod="calico-system/csi-node-driver-wq54r" podUID="d47fc662-eff9-4473-83da-b6f0b896d81f" Jan 13 20:09:17.417029 containerd[1934]: time="2025-01-13T20:09:17.416952521Z" level=info msg="ImageCreate event name:\"ghcr.io/flatcar/calico/cni:v3.29.1\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Jan 13 20:09:17.418576 containerd[1934]: time="2025-01-13T20:09:17.418491521Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/cni:v3.29.1: active requests=0, bytes read=89703123" Jan 13 20:09:17.420820 containerd[1934]: time="2025-01-13T20:09:17.420753293Z" level=info msg="ImageCreate event name:\"sha256:e5ca62af4ff61b88f55fe4e0d7723151103d3f6a470fd4ebb311a2de27a9597f\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Jan 13 20:09:17.425286 containerd[1934]: time="2025-01-13T20:09:17.425190737Z" level=info msg="ImageCreate event name:\"ghcr.io/flatcar/calico/cni@sha256:21e759d51c90dfb34fc1397dc180dd3a3fb564c2b0580d2f61ffe108f2a3c94b\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Jan 13 20:09:17.428161 containerd[1934]: time="2025-01-13T20:09:17.426743861Z" level=info msg="Pulled image \"ghcr.io/flatcar/calico/cni:v3.29.1\" with image id \"sha256:e5ca62af4ff61b88f55fe4e0d7723151103d3f6a470fd4ebb311a2de27a9597f\", repo tag \"ghcr.io/flatcar/calico/cni:v3.29.1\", repo digest \"ghcr.io/flatcar/calico/cni@sha256:21e759d51c90dfb34fc1397dc180dd3a3fb564c2b0580d2f61ffe108f2a3c94b\", size \"91072777\" in 4.366423918s" Jan 13 20:09:17.428161 containerd[1934]: time="2025-01-13T20:09:17.426833909Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/cni:v3.29.1\" returns image reference \"sha256:e5ca62af4ff61b88f55fe4e0d7723151103d3f6a470fd4ebb311a2de27a9597f\"" Jan 13 20:09:17.430433 containerd[1934]: time="2025-01-13T20:09:17.430248881Z" level=info msg="CreateContainer within sandbox \"1da5f8e217f8d8914413b2f1e2f6fc0151b465145dd0ee54001de8e77e8df94b\" for container &ContainerMetadata{Name:install-cni,Attempt:0,}" Jan 13 20:09:17.459063 containerd[1934]: time="2025-01-13T20:09:17.458987177Z" level=info msg="CreateContainer within sandbox \"1da5f8e217f8d8914413b2f1e2f6fc0151b465145dd0ee54001de8e77e8df94b\" for &ContainerMetadata{Name:install-cni,Attempt:0,} returns container id \"c6671d4d4ccf75ed6a36608d5f403d829c505bd3514e5cce24eb8186faa8842b\"" Jan 13 20:09:17.460253 containerd[1934]: time="2025-01-13T20:09:17.460204037Z" level=info msg="StartContainer for \"c6671d4d4ccf75ed6a36608d5f403d829c505bd3514e5cce24eb8186faa8842b\"" Jan 13 20:09:17.520122 systemd[1]: Started cri-containerd-c6671d4d4ccf75ed6a36608d5f403d829c505bd3514e5cce24eb8186faa8842b.scope - libcontainer container c6671d4d4ccf75ed6a36608d5f403d829c505bd3514e5cce24eb8186faa8842b. Jan 13 20:09:17.600045 containerd[1934]: time="2025-01-13T20:09:17.599925882Z" level=info msg="StartContainer for \"c6671d4d4ccf75ed6a36608d5f403d829c505bd3514e5cce24eb8186faa8842b\" returns successfully" Jan 13 20:09:17.842207 kubelet[3423]: E0113 20:09:17.840356 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized" pod="calico-system/csi-node-driver-wq54r" podUID="d47fc662-eff9-4473-83da-b6f0b896d81f" Jan 13 20:09:19.249342 systemd[1]: Started sshd@8-172.31.28.23:22-147.75.109.163:33270.service - OpenSSH per-connection server daemon (147.75.109.163:33270). Jan 13 20:09:19.443683 sshd[4170]: Accepted publickey for core from 147.75.109.163 port 33270 ssh2: RSA SHA256:IRHkteilZRLg/mCVEzdResksy7NfUBDRRywgALKaHg0 Jan 13 20:09:19.448108 sshd-session[4170]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Jan 13 20:09:19.461229 systemd-logind[1912]: New session 9 of user core. Jan 13 20:09:19.471105 systemd[1]: Started session-9.scope - Session 9 of User core. Jan 13 20:09:19.740687 sshd[4172]: Connection closed by 147.75.109.163 port 33270 Jan 13 20:09:19.741646 sshd-session[4170]: pam_unix(sshd:session): session closed for user core Jan 13 20:09:19.748581 systemd[1]: sshd@8-172.31.28.23:22-147.75.109.163:33270.service: Deactivated successfully. Jan 13 20:09:19.753548 systemd[1]: session-9.scope: Deactivated successfully. Jan 13 20:09:19.755262 systemd-logind[1912]: Session 9 logged out. Waiting for processes to exit. Jan 13 20:09:19.759213 systemd-logind[1912]: Removed session 9. Jan 13 20:09:19.841433 kubelet[3423]: E0113 20:09:19.840970 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized" pod="calico-system/csi-node-driver-wq54r" podUID="d47fc662-eff9-4473-83da-b6f0b896d81f" Jan 13 20:09:19.957443 containerd[1934]: time="2025-01-13T20:09:19.957359842Z" level=error msg="failed to reload cni configuration after receiving fs change event(WRITE \"/etc/cni/net.d/calico-kubeconfig\")" error="cni config load failed: no network config found in /etc/cni/net.d: cni plugin not initialized: failed to load cni config" Jan 13 20:09:19.962218 systemd[1]: cri-containerd-c6671d4d4ccf75ed6a36608d5f403d829c505bd3514e5cce24eb8186faa8842b.scope: Deactivated successfully. Jan 13 20:09:20.002103 systemd[1]: run-containerd-io.containerd.runtime.v2.task-k8s.io-c6671d4d4ccf75ed6a36608d5f403d829c505bd3514e5cce24eb8186faa8842b-rootfs.mount: Deactivated successfully. Jan 13 20:09:20.028839 kubelet[3423]: I0113 20:09:20.028040 3423 kubelet_node_status.go:497] "Fast updating node status as it just became ready" Jan 13 20:09:20.073711 kubelet[3423]: I0113 20:09:20.073628 3423 topology_manager.go:215] "Topology Admit Handler" podUID="396e30c8-d221-410a-89fe-e353ba8cddbf" podNamespace="kube-system" podName="coredns-76f75df574-mkr2l" Jan 13 20:09:20.078945 kubelet[3423]: I0113 20:09:20.078085 3423 topology_manager.go:215] "Topology Admit Handler" podUID="87115657-f395-40ec-89ea-3d7835119c3a" podNamespace="kube-system" podName="coredns-76f75df574-8wp6k" Jan 13 20:09:20.091850 kubelet[3423]: I0113 20:09:20.088728 3423 topology_manager.go:215] "Topology Admit Handler" podUID="8f72f896-c0ba-4b07-9a22-acc5c8ca3697" podNamespace="calico-apiserver" podName="calico-apiserver-7fbffcd8cd-pxvdr" Jan 13 20:09:20.099919 systemd[1]: Created slice kubepods-burstable-pod396e30c8_d221_410a_89fe_e353ba8cddbf.slice - libcontainer container kubepods-burstable-pod396e30c8_d221_410a_89fe_e353ba8cddbf.slice. Jan 13 20:09:20.109895 kubelet[3423]: I0113 20:09:20.109447 3423 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq8qv\" (UniqueName: \"kubernetes.io/projected/8f72f896-c0ba-4b07-9a22-acc5c8ca3697-kube-api-access-tq8qv\") pod \"calico-apiserver-7fbffcd8cd-pxvdr\" (UID: \"8f72f896-c0ba-4b07-9a22-acc5c8ca3697\") " pod="calico-apiserver/calico-apiserver-7fbffcd8cd-pxvdr" Jan 13 20:09:20.109895 kubelet[3423]: I0113 20:09:20.109526 3423 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/396e30c8-d221-410a-89fe-e353ba8cddbf-config-volume\") pod \"coredns-76f75df574-mkr2l\" (UID: \"396e30c8-d221-410a-89fe-e353ba8cddbf\") " pod="kube-system/coredns-76f75df574-mkr2l" Jan 13 20:09:20.109895 kubelet[3423]: I0113 20:09:20.109577 3423 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/87115657-f395-40ec-89ea-3d7835119c3a-config-volume\") pod \"coredns-76f75df574-8wp6k\" (UID: \"87115657-f395-40ec-89ea-3d7835119c3a\") " pod="kube-system/coredns-76f75df574-8wp6k" Jan 13 20:09:20.109895 kubelet[3423]: I0113 20:09:20.109629 3423 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8scp\" (UniqueName: \"kubernetes.io/projected/87115657-f395-40ec-89ea-3d7835119c3a-kube-api-access-s8scp\") pod \"coredns-76f75df574-8wp6k\" (UID: \"87115657-f395-40ec-89ea-3d7835119c3a\") " pod="kube-system/coredns-76f75df574-8wp6k" Jan 13 20:09:20.109895 kubelet[3423]: I0113 20:09:20.109682 3423 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qfsj\" (UniqueName: \"kubernetes.io/projected/396e30c8-d221-410a-89fe-e353ba8cddbf-kube-api-access-4qfsj\") pod \"coredns-76f75df574-mkr2l\" (UID: \"396e30c8-d221-410a-89fe-e353ba8cddbf\") " pod="kube-system/coredns-76f75df574-mkr2l" Jan 13 20:09:20.110294 kubelet[3423]: I0113 20:09:20.109738 3423 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"calico-apiserver-certs\" (UniqueName: \"kubernetes.io/secret/8f72f896-c0ba-4b07-9a22-acc5c8ca3697-calico-apiserver-certs\") pod \"calico-apiserver-7fbffcd8cd-pxvdr\" (UID: \"8f72f896-c0ba-4b07-9a22-acc5c8ca3697\") " pod="calico-apiserver/calico-apiserver-7fbffcd8cd-pxvdr" Jan 13 20:09:20.117887 kubelet[3423]: I0113 20:09:20.117674 3423 topology_manager.go:215] "Topology Admit Handler" podUID="2be21c11-9c2d-4b9a-81a5-0e73daba31c1" podNamespace="calico-system" podName="calico-kube-controllers-68f76c7ddf-lh8nj" Jan 13 20:09:20.119203 kubelet[3423]: I0113 20:09:20.118914 3423 topology_manager.go:215] "Topology Admit Handler" podUID="ad79c041-eaf1-4d57-9fb4-c3fb08680cb8" podNamespace="calico-apiserver" podName="calico-apiserver-7fbffcd8cd-wszl7" Jan 13 20:09:20.130682 systemd[1]: Created slice kubepods-burstable-pod87115657_f395_40ec_89ea_3d7835119c3a.slice - libcontainer container kubepods-burstable-pod87115657_f395_40ec_89ea_3d7835119c3a.slice. Jan 13 20:09:20.155141 systemd[1]: Created slice kubepods-besteffort-pod8f72f896_c0ba_4b07_9a22_acc5c8ca3697.slice - libcontainer container kubepods-besteffort-pod8f72f896_c0ba_4b07_9a22_acc5c8ca3697.slice. Jan 13 20:09:20.171520 systemd[1]: Created slice kubepods-besteffort-podad79c041_eaf1_4d57_9fb4_c3fb08680cb8.slice - libcontainer container kubepods-besteffort-podad79c041_eaf1_4d57_9fb4_c3fb08680cb8.slice. Jan 13 20:09:20.185925 systemd[1]: Created slice kubepods-besteffort-pod2be21c11_9c2d_4b9a_81a5_0e73daba31c1.slice - libcontainer container kubepods-besteffort-pod2be21c11_9c2d_4b9a_81a5_0e73daba31c1.slice. Jan 13 20:09:20.212022 kubelet[3423]: I0113 20:09:20.210710 3423 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2qml\" (UniqueName: \"kubernetes.io/projected/2be21c11-9c2d-4b9a-81a5-0e73daba31c1-kube-api-access-s2qml\") pod \"calico-kube-controllers-68f76c7ddf-lh8nj\" (UID: \"2be21c11-9c2d-4b9a-81a5-0e73daba31c1\") " pod="calico-system/calico-kube-controllers-68f76c7ddf-lh8nj" Jan 13 20:09:20.212022 kubelet[3423]: I0113 20:09:20.211851 3423 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tigera-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2be21c11-9c2d-4b9a-81a5-0e73daba31c1-tigera-ca-bundle\") pod \"calico-kube-controllers-68f76c7ddf-lh8nj\" (UID: \"2be21c11-9c2d-4b9a-81a5-0e73daba31c1\") " pod="calico-system/calico-kube-controllers-68f76c7ddf-lh8nj" Jan 13 20:09:20.212022 kubelet[3423]: I0113 20:09:20.211959 3423 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"calico-apiserver-certs\" (UniqueName: \"kubernetes.io/secret/ad79c041-eaf1-4d57-9fb4-c3fb08680cb8-calico-apiserver-certs\") pod \"calico-apiserver-7fbffcd8cd-wszl7\" (UID: \"ad79c041-eaf1-4d57-9fb4-c3fb08680cb8\") " pod="calico-apiserver/calico-apiserver-7fbffcd8cd-wszl7" Jan 13 20:09:20.212887 kubelet[3423]: I0113 20:09:20.212510 3423 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfwh9\" (UniqueName: \"kubernetes.io/projected/ad79c041-eaf1-4d57-9fb4-c3fb08680cb8-kube-api-access-lfwh9\") pod \"calico-apiserver-7fbffcd8cd-wszl7\" (UID: \"ad79c041-eaf1-4d57-9fb4-c3fb08680cb8\") " pod="calico-apiserver/calico-apiserver-7fbffcd8cd-wszl7" Jan 13 20:09:20.423812 containerd[1934]: time="2025-01-13T20:09:20.423721328Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-76f75df574-mkr2l,Uid:396e30c8-d221-410a-89fe-e353ba8cddbf,Namespace:kube-system,Attempt:0,}" Jan 13 20:09:20.442283 containerd[1934]: time="2025-01-13T20:09:20.442136408Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-76f75df574-8wp6k,Uid:87115657-f395-40ec-89ea-3d7835119c3a,Namespace:kube-system,Attempt:0,}" Jan 13 20:09:20.462170 containerd[1934]: time="2025-01-13T20:09:20.462097688Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-7fbffcd8cd-pxvdr,Uid:8f72f896-c0ba-4b07-9a22-acc5c8ca3697,Namespace:calico-apiserver,Attempt:0,}" Jan 13 20:09:20.479692 containerd[1934]: time="2025-01-13T20:09:20.479463956Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-7fbffcd8cd-wszl7,Uid:ad79c041-eaf1-4d57-9fb4-c3fb08680cb8,Namespace:calico-apiserver,Attempt:0,}" Jan 13 20:09:20.495078 containerd[1934]: time="2025-01-13T20:09:20.495003092Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-kube-controllers-68f76c7ddf-lh8nj,Uid:2be21c11-9c2d-4b9a-81a5-0e73daba31c1,Namespace:calico-system,Attempt:0,}" Jan 13 20:09:21.832526 containerd[1934]: time="2025-01-13T20:09:21.832323011Z" level=info msg="shim disconnected" id=c6671d4d4ccf75ed6a36608d5f403d829c505bd3514e5cce24eb8186faa8842b namespace=k8s.io Jan 13 20:09:21.832526 containerd[1934]: time="2025-01-13T20:09:21.832398863Z" level=warning msg="cleaning up after shim disconnected" id=c6671d4d4ccf75ed6a36608d5f403d829c505bd3514e5cce24eb8186faa8842b namespace=k8s.io Jan 13 20:09:21.832526 containerd[1934]: time="2025-01-13T20:09:21.832418111Z" level=info msg="cleaning up dead shim" namespace=k8s.io Jan 13 20:09:21.890349 systemd[1]: Created slice kubepods-besteffort-podd47fc662_eff9_4473_83da_b6f0b896d81f.slice - libcontainer container kubepods-besteffort-podd47fc662_eff9_4473_83da_b6f0b896d81f.slice. Jan 13 20:09:21.915932 containerd[1934]: time="2025-01-13T20:09:21.915871043Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:csi-node-driver-wq54r,Uid:d47fc662-eff9-4473-83da-b6f0b896d81f,Namespace:calico-system,Attempt:0,}" Jan 13 20:09:22.106276 containerd[1934]: time="2025-01-13T20:09:22.105924128Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/node:v3.29.1\"" Jan 13 20:09:22.298560 containerd[1934]: time="2025-01-13T20:09:22.298038933Z" level=error msg="Failed to destroy network for sandbox \"fb565334446e5f8a46a1bd1f7f902b79f435864e841478f2f0a155d44cd33b41\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:22.308102 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-fb565334446e5f8a46a1bd1f7f902b79f435864e841478f2f0a155d44cd33b41-shm.mount: Deactivated successfully. Jan 13 20:09:22.311579 containerd[1934]: time="2025-01-13T20:09:22.311508369Z" level=error msg="Failed to destroy network for sandbox \"f5e883fc61f95c31957335ed367bbb8d4c07a9c5470ee6e51fca5c2bde0bfb8c\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:22.314285 containerd[1934]: time="2025-01-13T20:09:22.313270017Z" level=error msg="encountered an error cleaning up failed sandbox \"f5e883fc61f95c31957335ed367bbb8d4c07a9c5470ee6e51fca5c2bde0bfb8c\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:22.314285 containerd[1934]: time="2025-01-13T20:09:22.313397517Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-76f75df574-8wp6k,Uid:87115657-f395-40ec-89ea-3d7835119c3a,Namespace:kube-system,Attempt:0,} failed, error" error="failed to setup network for sandbox \"f5e883fc61f95c31957335ed367bbb8d4c07a9c5470ee6e51fca5c2bde0bfb8c\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:22.316622 kubelet[3423]: E0113 20:09:22.316491 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"f5e883fc61f95c31957335ed367bbb8d4c07a9c5470ee6e51fca5c2bde0bfb8c\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:22.316622 kubelet[3423]: E0113 20:09:22.316587 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"f5e883fc61f95c31957335ed367bbb8d4c07a9c5470ee6e51fca5c2bde0bfb8c\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-76f75df574-8wp6k" Jan 13 20:09:22.316622 kubelet[3423]: E0113 20:09:22.316630 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"f5e883fc61f95c31957335ed367bbb8d4c07a9c5470ee6e51fca5c2bde0bfb8c\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-76f75df574-8wp6k" Jan 13 20:09:22.320381 kubelet[3423]: E0113 20:09:22.317088 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-76f75df574-8wp6k_kube-system(87115657-f395-40ec-89ea-3d7835119c3a)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-76f75df574-8wp6k_kube-system(87115657-f395-40ec-89ea-3d7835119c3a)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"f5e883fc61f95c31957335ed367bbb8d4c07a9c5470ee6e51fca5c2bde0bfb8c\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="kube-system/coredns-76f75df574-8wp6k" podUID="87115657-f395-40ec-89ea-3d7835119c3a" Jan 13 20:09:22.320381 kubelet[3423]: E0113 20:09:22.317932 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"fb565334446e5f8a46a1bd1f7f902b79f435864e841478f2f0a155d44cd33b41\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:22.320381 kubelet[3423]: E0113 20:09:22.318000 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"fb565334446e5f8a46a1bd1f7f902b79f435864e841478f2f0a155d44cd33b41\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-wszl7" Jan 13 20:09:22.320702 containerd[1934]: time="2025-01-13T20:09:22.317515473Z" level=error msg="encountered an error cleaning up failed sandbox \"fb565334446e5f8a46a1bd1f7f902b79f435864e841478f2f0a155d44cd33b41\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:22.320702 containerd[1934]: time="2025-01-13T20:09:22.317621169Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-7fbffcd8cd-wszl7,Uid:ad79c041-eaf1-4d57-9fb4-c3fb08680cb8,Namespace:calico-apiserver,Attempt:0,} failed, error" error="failed to setup network for sandbox \"fb565334446e5f8a46a1bd1f7f902b79f435864e841478f2f0a155d44cd33b41\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:22.323058 kubelet[3423]: E0113 20:09:22.318037 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"fb565334446e5f8a46a1bd1f7f902b79f435864e841478f2f0a155d44cd33b41\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-wszl7" Jan 13 20:09:22.323058 kubelet[3423]: E0113 20:09:22.318114 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"calico-apiserver-7fbffcd8cd-wszl7_calico-apiserver(ad79c041-eaf1-4d57-9fb4-c3fb08680cb8)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"calico-apiserver-7fbffcd8cd-wszl7_calico-apiserver(ad79c041-eaf1-4d57-9fb4-c3fb08680cb8)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"fb565334446e5f8a46a1bd1f7f902b79f435864e841478f2f0a155d44cd33b41\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-wszl7" podUID="ad79c041-eaf1-4d57-9fb4-c3fb08680cb8" Jan 13 20:09:22.321190 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-f5e883fc61f95c31957335ed367bbb8d4c07a9c5470ee6e51fca5c2bde0bfb8c-shm.mount: Deactivated successfully. Jan 13 20:09:22.356902 containerd[1934]: time="2025-01-13T20:09:22.355386477Z" level=error msg="Failed to destroy network for sandbox \"899dac68c4a2c7ede7e6073b33ab156f86e32973795b4e68f426b199aa5486a9\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:22.356902 containerd[1934]: time="2025-01-13T20:09:22.355689177Z" level=error msg="Failed to destroy network for sandbox \"c787f8945e5c1c02a132aebe2ce54537e8efb76054bd3d61620dd081ac229a87\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:22.356902 containerd[1934]: time="2025-01-13T20:09:22.356148741Z" level=error msg="encountered an error cleaning up failed sandbox \"899dac68c4a2c7ede7e6073b33ab156f86e32973795b4e68f426b199aa5486a9\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:22.359838 containerd[1934]: time="2025-01-13T20:09:22.359579014Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-76f75df574-mkr2l,Uid:396e30c8-d221-410a-89fe-e353ba8cddbf,Namespace:kube-system,Attempt:0,} failed, error" error="failed to setup network for sandbox \"899dac68c4a2c7ede7e6073b33ab156f86e32973795b4e68f426b199aa5486a9\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:22.363713 kubelet[3423]: E0113 20:09:22.362895 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"899dac68c4a2c7ede7e6073b33ab156f86e32973795b4e68f426b199aa5486a9\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:22.363713 kubelet[3423]: E0113 20:09:22.363060 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"899dac68c4a2c7ede7e6073b33ab156f86e32973795b4e68f426b199aa5486a9\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-76f75df574-mkr2l" Jan 13 20:09:22.363609 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-899dac68c4a2c7ede7e6073b33ab156f86e32973795b4e68f426b199aa5486a9-shm.mount: Deactivated successfully. Jan 13 20:09:22.366117 kubelet[3423]: E0113 20:09:22.363099 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"899dac68c4a2c7ede7e6073b33ab156f86e32973795b4e68f426b199aa5486a9\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-76f75df574-mkr2l" Jan 13 20:09:22.368573 kubelet[3423]: E0113 20:09:22.366862 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-76f75df574-mkr2l_kube-system(396e30c8-d221-410a-89fe-e353ba8cddbf)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-76f75df574-mkr2l_kube-system(396e30c8-d221-410a-89fe-e353ba8cddbf)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"899dac68c4a2c7ede7e6073b33ab156f86e32973795b4e68f426b199aa5486a9\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="kube-system/coredns-76f75df574-mkr2l" podUID="396e30c8-d221-410a-89fe-e353ba8cddbf" Jan 13 20:09:22.368573 kubelet[3423]: E0113 20:09:22.368456 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"c787f8945e5c1c02a132aebe2ce54537e8efb76054bd3d61620dd081ac229a87\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:22.368573 kubelet[3423]: E0113 20:09:22.368565 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"c787f8945e5c1c02a132aebe2ce54537e8efb76054bd3d61620dd081ac229a87\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-pxvdr" Jan 13 20:09:22.368921 containerd[1934]: time="2025-01-13T20:09:22.367992874Z" level=error msg="encountered an error cleaning up failed sandbox \"c787f8945e5c1c02a132aebe2ce54537e8efb76054bd3d61620dd081ac229a87\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:22.368921 containerd[1934]: time="2025-01-13T20:09:22.368098282Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-7fbffcd8cd-pxvdr,Uid:8f72f896-c0ba-4b07-9a22-acc5c8ca3697,Namespace:calico-apiserver,Attempt:0,} failed, error" error="failed to setup network for sandbox \"c787f8945e5c1c02a132aebe2ce54537e8efb76054bd3d61620dd081ac229a87\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:22.369090 kubelet[3423]: E0113 20:09:22.368611 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"c787f8945e5c1c02a132aebe2ce54537e8efb76054bd3d61620dd081ac229a87\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-pxvdr" Jan 13 20:09:22.369090 kubelet[3423]: E0113 20:09:22.368689 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"calico-apiserver-7fbffcd8cd-pxvdr_calico-apiserver(8f72f896-c0ba-4b07-9a22-acc5c8ca3697)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"calico-apiserver-7fbffcd8cd-pxvdr_calico-apiserver(8f72f896-c0ba-4b07-9a22-acc5c8ca3697)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"c787f8945e5c1c02a132aebe2ce54537e8efb76054bd3d61620dd081ac229a87\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-pxvdr" podUID="8f72f896-c0ba-4b07-9a22-acc5c8ca3697" Jan 13 20:09:22.376295 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-c787f8945e5c1c02a132aebe2ce54537e8efb76054bd3d61620dd081ac229a87-shm.mount: Deactivated successfully. Jan 13 20:09:22.382874 containerd[1934]: time="2025-01-13T20:09:22.382543714Z" level=error msg="Failed to destroy network for sandbox \"57f3ef7b6cf66ed3ed7b779c226fa67874c55496cae0804a70bff6ecec1ef212\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:22.384393 containerd[1934]: time="2025-01-13T20:09:22.384207166Z" level=error msg="encountered an error cleaning up failed sandbox \"57f3ef7b6cf66ed3ed7b779c226fa67874c55496cae0804a70bff6ecec1ef212\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:22.384602 containerd[1934]: time="2025-01-13T20:09:22.384545938Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-kube-controllers-68f76c7ddf-lh8nj,Uid:2be21c11-9c2d-4b9a-81a5-0e73daba31c1,Namespace:calico-system,Attempt:0,} failed, error" error="failed to setup network for sandbox \"57f3ef7b6cf66ed3ed7b779c226fa67874c55496cae0804a70bff6ecec1ef212\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:22.385214 kubelet[3423]: E0113 20:09:22.385167 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"57f3ef7b6cf66ed3ed7b779c226fa67874c55496cae0804a70bff6ecec1ef212\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:22.385312 kubelet[3423]: E0113 20:09:22.385247 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"57f3ef7b6cf66ed3ed7b779c226fa67874c55496cae0804a70bff6ecec1ef212\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/calico-kube-controllers-68f76c7ddf-lh8nj" Jan 13 20:09:22.385312 kubelet[3423]: E0113 20:09:22.385286 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"57f3ef7b6cf66ed3ed7b779c226fa67874c55496cae0804a70bff6ecec1ef212\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/calico-kube-controllers-68f76c7ddf-lh8nj" Jan 13 20:09:22.385463 kubelet[3423]: E0113 20:09:22.385379 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"calico-kube-controllers-68f76c7ddf-lh8nj_calico-system(2be21c11-9c2d-4b9a-81a5-0e73daba31c1)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"calico-kube-controllers-68f76c7ddf-lh8nj_calico-system(2be21c11-9c2d-4b9a-81a5-0e73daba31c1)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"57f3ef7b6cf66ed3ed7b779c226fa67874c55496cae0804a70bff6ecec1ef212\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-system/calico-kube-controllers-68f76c7ddf-lh8nj" podUID="2be21c11-9c2d-4b9a-81a5-0e73daba31c1" Jan 13 20:09:22.400747 containerd[1934]: time="2025-01-13T20:09:22.400628566Z" level=error msg="Failed to destroy network for sandbox \"ccf56aafff1edbddd69e830448606d1ed364723341b141ed6867e7ed4d6b5f89\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:22.401221 containerd[1934]: time="2025-01-13T20:09:22.401169766Z" level=error msg="encountered an error cleaning up failed sandbox \"ccf56aafff1edbddd69e830448606d1ed364723341b141ed6867e7ed4d6b5f89\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:22.401367 containerd[1934]: time="2025-01-13T20:09:22.401269498Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:csi-node-driver-wq54r,Uid:d47fc662-eff9-4473-83da-b6f0b896d81f,Namespace:calico-system,Attempt:0,} failed, error" error="failed to setup network for sandbox \"ccf56aafff1edbddd69e830448606d1ed364723341b141ed6867e7ed4d6b5f89\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:22.401798 kubelet[3423]: E0113 20:09:22.401743 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"ccf56aafff1edbddd69e830448606d1ed364723341b141ed6867e7ed4d6b5f89\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:22.401894 kubelet[3423]: E0113 20:09:22.401839 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"ccf56aafff1edbddd69e830448606d1ed364723341b141ed6867e7ed4d6b5f89\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/csi-node-driver-wq54r" Jan 13 20:09:22.401951 kubelet[3423]: E0113 20:09:22.401912 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"ccf56aafff1edbddd69e830448606d1ed364723341b141ed6867e7ed4d6b5f89\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/csi-node-driver-wq54r" Jan 13 20:09:22.402087 kubelet[3423]: E0113 20:09:22.402052 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"csi-node-driver-wq54r_calico-system(d47fc662-eff9-4473-83da-b6f0b896d81f)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"csi-node-driver-wq54r_calico-system(d47fc662-eff9-4473-83da-b6f0b896d81f)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"ccf56aafff1edbddd69e830448606d1ed364723341b141ed6867e7ed4d6b5f89\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-system/csi-node-driver-wq54r" podUID="d47fc662-eff9-4473-83da-b6f0b896d81f" Jan 13 20:09:23.002060 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-ccf56aafff1edbddd69e830448606d1ed364723341b141ed6867e7ed4d6b5f89-shm.mount: Deactivated successfully. Jan 13 20:09:23.002223 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-57f3ef7b6cf66ed3ed7b779c226fa67874c55496cae0804a70bff6ecec1ef212-shm.mount: Deactivated successfully. Jan 13 20:09:23.104186 kubelet[3423]: I0113 20:09:23.103848 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f5e883fc61f95c31957335ed367bbb8d4c07a9c5470ee6e51fca5c2bde0bfb8c" Jan 13 20:09:23.108075 containerd[1934]: time="2025-01-13T20:09:23.105035181Z" level=info msg="StopPodSandbox for \"f5e883fc61f95c31957335ed367bbb8d4c07a9c5470ee6e51fca5c2bde0bfb8c\"" Jan 13 20:09:23.108075 containerd[1934]: time="2025-01-13T20:09:23.105310125Z" level=info msg="Ensure that sandbox f5e883fc61f95c31957335ed367bbb8d4c07a9c5470ee6e51fca5c2bde0bfb8c in task-service has been cleanup successfully" Jan 13 20:09:23.110109 containerd[1934]: time="2025-01-13T20:09:23.110003181Z" level=info msg="TearDown network for sandbox \"f5e883fc61f95c31957335ed367bbb8d4c07a9c5470ee6e51fca5c2bde0bfb8c\" successfully" Jan 13 20:09:23.110344 containerd[1934]: time="2025-01-13T20:09:23.110312289Z" level=info msg="StopPodSandbox for \"f5e883fc61f95c31957335ed367bbb8d4c07a9c5470ee6e51fca5c2bde0bfb8c\" returns successfully" Jan 13 20:09:23.113311 systemd[1]: run-netns-cni\x2dcfb27392\x2dd29d\x2dc3f8\x2d433b\x2d83d71dc8f7aa.mount: Deactivated successfully. Jan 13 20:09:23.114675 containerd[1934]: time="2025-01-13T20:09:23.113673465Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-76f75df574-8wp6k,Uid:87115657-f395-40ec-89ea-3d7835119c3a,Namespace:kube-system,Attempt:1,}" Jan 13 20:09:23.116144 kubelet[3423]: I0113 20:09:23.115503 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fb565334446e5f8a46a1bd1f7f902b79f435864e841478f2f0a155d44cd33b41" Jan 13 20:09:23.119506 containerd[1934]: time="2025-01-13T20:09:23.119441337Z" level=info msg="StopPodSandbox for \"fb565334446e5f8a46a1bd1f7f902b79f435864e841478f2f0a155d44cd33b41\"" Jan 13 20:09:23.121596 containerd[1934]: time="2025-01-13T20:09:23.120881493Z" level=info msg="Ensure that sandbox fb565334446e5f8a46a1bd1f7f902b79f435864e841478f2f0a155d44cd33b41 in task-service has been cleanup successfully" Jan 13 20:09:23.122257 kubelet[3423]: I0113 20:09:23.121981 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c787f8945e5c1c02a132aebe2ce54537e8efb76054bd3d61620dd081ac229a87" Jan 13 20:09:23.128807 containerd[1934]: time="2025-01-13T20:09:23.126175797Z" level=info msg="StopPodSandbox for \"c787f8945e5c1c02a132aebe2ce54537e8efb76054bd3d61620dd081ac229a87\"" Jan 13 20:09:23.128807 containerd[1934]: time="2025-01-13T20:09:23.126227313Z" level=info msg="TearDown network for sandbox \"fb565334446e5f8a46a1bd1f7f902b79f435864e841478f2f0a155d44cd33b41\" successfully" Jan 13 20:09:23.128807 containerd[1934]: time="2025-01-13T20:09:23.126289185Z" level=info msg="StopPodSandbox for \"fb565334446e5f8a46a1bd1f7f902b79f435864e841478f2f0a155d44cd33b41\" returns successfully" Jan 13 20:09:23.128807 containerd[1934]: time="2025-01-13T20:09:23.126501777Z" level=info msg="Ensure that sandbox c787f8945e5c1c02a132aebe2ce54537e8efb76054bd3d61620dd081ac229a87 in task-service has been cleanup successfully" Jan 13 20:09:23.128676 systemd[1]: run-netns-cni\x2d146127bd\x2dbdc8\x2d25c4\x2de7c6\x2d8722644ce0bb.mount: Deactivated successfully. Jan 13 20:09:23.129467 containerd[1934]: time="2025-01-13T20:09:23.129381177Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-7fbffcd8cd-wszl7,Uid:ad79c041-eaf1-4d57-9fb4-c3fb08680cb8,Namespace:calico-apiserver,Attempt:1,}" Jan 13 20:09:23.131695 containerd[1934]: time="2025-01-13T20:09:23.130505037Z" level=info msg="TearDown network for sandbox \"c787f8945e5c1c02a132aebe2ce54537e8efb76054bd3d61620dd081ac229a87\" successfully" Jan 13 20:09:23.132025 containerd[1934]: time="2025-01-13T20:09:23.131944641Z" level=info msg="StopPodSandbox for \"c787f8945e5c1c02a132aebe2ce54537e8efb76054bd3d61620dd081ac229a87\" returns successfully" Jan 13 20:09:23.142081 containerd[1934]: time="2025-01-13T20:09:23.141890505Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-7fbffcd8cd-pxvdr,Uid:8f72f896-c0ba-4b07-9a22-acc5c8ca3697,Namespace:calico-apiserver,Attempt:1,}" Jan 13 20:09:23.148890 kubelet[3423]: I0113 20:09:23.144752 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ccf56aafff1edbddd69e830448606d1ed364723341b141ed6867e7ed4d6b5f89" Jan 13 20:09:23.145768 systemd[1]: run-netns-cni\x2d03f66330\x2d6060\x2d01eb\x2d8012\x2d575f3e1000c5.mount: Deactivated successfully. Jan 13 20:09:23.150141 containerd[1934]: time="2025-01-13T20:09:23.146449245Z" level=info msg="StopPodSandbox for \"ccf56aafff1edbddd69e830448606d1ed364723341b141ed6867e7ed4d6b5f89\"" Jan 13 20:09:23.150141 containerd[1934]: time="2025-01-13T20:09:23.149806233Z" level=info msg="Ensure that sandbox ccf56aafff1edbddd69e830448606d1ed364723341b141ed6867e7ed4d6b5f89 in task-service has been cleanup successfully" Jan 13 20:09:23.157257 containerd[1934]: time="2025-01-13T20:09:23.157179561Z" level=info msg="TearDown network for sandbox \"ccf56aafff1edbddd69e830448606d1ed364723341b141ed6867e7ed4d6b5f89\" successfully" Jan 13 20:09:23.157257 containerd[1934]: time="2025-01-13T20:09:23.157237965Z" level=info msg="StopPodSandbox for \"ccf56aafff1edbddd69e830448606d1ed364723341b141ed6867e7ed4d6b5f89\" returns successfully" Jan 13 20:09:23.158725 systemd[1]: run-netns-cni\x2dec362ba9\x2d986c\x2dc1bb\x2dcc44\x2d1820d931368f.mount: Deactivated successfully. Jan 13 20:09:23.161466 containerd[1934]: time="2025-01-13T20:09:23.159761241Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:csi-node-driver-wq54r,Uid:d47fc662-eff9-4473-83da-b6f0b896d81f,Namespace:calico-system,Attempt:1,}" Jan 13 20:09:23.161560 kubelet[3423]: I0113 20:09:23.160417 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="57f3ef7b6cf66ed3ed7b779c226fa67874c55496cae0804a70bff6ecec1ef212" Jan 13 20:09:23.165628 containerd[1934]: time="2025-01-13T20:09:23.165488722Z" level=info msg="StopPodSandbox for \"57f3ef7b6cf66ed3ed7b779c226fa67874c55496cae0804a70bff6ecec1ef212\"" Jan 13 20:09:23.166923 containerd[1934]: time="2025-01-13T20:09:23.166391710Z" level=info msg="Ensure that sandbox 57f3ef7b6cf66ed3ed7b779c226fa67874c55496cae0804a70bff6ecec1ef212 in task-service has been cleanup successfully" Jan 13 20:09:23.167817 kubelet[3423]: I0113 20:09:23.167588 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="899dac68c4a2c7ede7e6073b33ab156f86e32973795b4e68f426b199aa5486a9" Jan 13 20:09:23.168263 containerd[1934]: time="2025-01-13T20:09:23.168184174Z" level=info msg="TearDown network for sandbox \"57f3ef7b6cf66ed3ed7b779c226fa67874c55496cae0804a70bff6ecec1ef212\" successfully" Jan 13 20:09:23.168437 containerd[1934]: time="2025-01-13T20:09:23.168407698Z" level=info msg="StopPodSandbox for \"57f3ef7b6cf66ed3ed7b779c226fa67874c55496cae0804a70bff6ecec1ef212\" returns successfully" Jan 13 20:09:23.169648 containerd[1934]: time="2025-01-13T20:09:23.169553650Z" level=info msg="StopPodSandbox for \"899dac68c4a2c7ede7e6073b33ab156f86e32973795b4e68f426b199aa5486a9\"" Jan 13 20:09:23.170834 containerd[1934]: time="2025-01-13T20:09:23.169935118Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-kube-controllers-68f76c7ddf-lh8nj,Uid:2be21c11-9c2d-4b9a-81a5-0e73daba31c1,Namespace:calico-system,Attempt:1,}" Jan 13 20:09:23.170834 containerd[1934]: time="2025-01-13T20:09:23.170116882Z" level=info msg="Ensure that sandbox 899dac68c4a2c7ede7e6073b33ab156f86e32973795b4e68f426b199aa5486a9 in task-service has been cleanup successfully" Jan 13 20:09:23.171834 containerd[1934]: time="2025-01-13T20:09:23.171672130Z" level=info msg="TearDown network for sandbox \"899dac68c4a2c7ede7e6073b33ab156f86e32973795b4e68f426b199aa5486a9\" successfully" Jan 13 20:09:23.172992 containerd[1934]: time="2025-01-13T20:09:23.172840210Z" level=info msg="StopPodSandbox for \"899dac68c4a2c7ede7e6073b33ab156f86e32973795b4e68f426b199aa5486a9\" returns successfully" Jan 13 20:09:23.174073 containerd[1934]: time="2025-01-13T20:09:23.174014518Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-76f75df574-mkr2l,Uid:396e30c8-d221-410a-89fe-e353ba8cddbf,Namespace:kube-system,Attempt:1,}" Jan 13 20:09:23.585160 containerd[1934]: time="2025-01-13T20:09:23.585086160Z" level=error msg="Failed to destroy network for sandbox \"eed11d015ff645b963130f5ad956d107f391cbaba3451e015229fc4082c60951\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:23.587604 containerd[1934]: time="2025-01-13T20:09:23.587537184Z" level=error msg="encountered an error cleaning up failed sandbox \"eed11d015ff645b963130f5ad956d107f391cbaba3451e015229fc4082c60951\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:23.590188 containerd[1934]: time="2025-01-13T20:09:23.590118276Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-76f75df574-8wp6k,Uid:87115657-f395-40ec-89ea-3d7835119c3a,Namespace:kube-system,Attempt:1,} failed, error" error="failed to setup network for sandbox \"eed11d015ff645b963130f5ad956d107f391cbaba3451e015229fc4082c60951\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:23.590820 kubelet[3423]: E0113 20:09:23.590706 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"eed11d015ff645b963130f5ad956d107f391cbaba3451e015229fc4082c60951\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:23.590820 kubelet[3423]: E0113 20:09:23.590819 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"eed11d015ff645b963130f5ad956d107f391cbaba3451e015229fc4082c60951\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-76f75df574-8wp6k" Jan 13 20:09:23.593902 kubelet[3423]: E0113 20:09:23.590859 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"eed11d015ff645b963130f5ad956d107f391cbaba3451e015229fc4082c60951\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-76f75df574-8wp6k" Jan 13 20:09:23.593902 kubelet[3423]: E0113 20:09:23.590957 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-76f75df574-8wp6k_kube-system(87115657-f395-40ec-89ea-3d7835119c3a)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-76f75df574-8wp6k_kube-system(87115657-f395-40ec-89ea-3d7835119c3a)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"eed11d015ff645b963130f5ad956d107f391cbaba3451e015229fc4082c60951\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="kube-system/coredns-76f75df574-8wp6k" podUID="87115657-f395-40ec-89ea-3d7835119c3a" Jan 13 20:09:23.638495 containerd[1934]: time="2025-01-13T20:09:23.638371248Z" level=error msg="Failed to destroy network for sandbox \"cfa6ddb68ab8a55e2b4406871b279f8198e9a43957ec335f7facbf57b86881a3\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:23.640031 containerd[1934]: time="2025-01-13T20:09:23.639522660Z" level=error msg="encountered an error cleaning up failed sandbox \"cfa6ddb68ab8a55e2b4406871b279f8198e9a43957ec335f7facbf57b86881a3\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:23.641116 containerd[1934]: time="2025-01-13T20:09:23.639680844Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-7fbffcd8cd-wszl7,Uid:ad79c041-eaf1-4d57-9fb4-c3fb08680cb8,Namespace:calico-apiserver,Attempt:1,} failed, error" error="failed to setup network for sandbox \"cfa6ddb68ab8a55e2b4406871b279f8198e9a43957ec335f7facbf57b86881a3\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:23.642114 kubelet[3423]: E0113 20:09:23.642057 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"cfa6ddb68ab8a55e2b4406871b279f8198e9a43957ec335f7facbf57b86881a3\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:23.642278 kubelet[3423]: E0113 20:09:23.642149 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"cfa6ddb68ab8a55e2b4406871b279f8198e9a43957ec335f7facbf57b86881a3\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-wszl7" Jan 13 20:09:23.642278 kubelet[3423]: E0113 20:09:23.642188 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"cfa6ddb68ab8a55e2b4406871b279f8198e9a43957ec335f7facbf57b86881a3\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-wszl7" Jan 13 20:09:23.645620 kubelet[3423]: E0113 20:09:23.642340 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"calico-apiserver-7fbffcd8cd-wszl7_calico-apiserver(ad79c041-eaf1-4d57-9fb4-c3fb08680cb8)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"calico-apiserver-7fbffcd8cd-wszl7_calico-apiserver(ad79c041-eaf1-4d57-9fb4-c3fb08680cb8)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"cfa6ddb68ab8a55e2b4406871b279f8198e9a43957ec335f7facbf57b86881a3\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-wszl7" podUID="ad79c041-eaf1-4d57-9fb4-c3fb08680cb8" Jan 13 20:09:23.650426 containerd[1934]: time="2025-01-13T20:09:23.650217516Z" level=error msg="Failed to destroy network for sandbox \"2accd017db7708cc1fa5c6da328b2f1c3f1c063e1b4b76d232d0c4e3cdca6a6d\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:23.652797 containerd[1934]: time="2025-01-13T20:09:23.652716936Z" level=error msg="encountered an error cleaning up failed sandbox \"2accd017db7708cc1fa5c6da328b2f1c3f1c063e1b4b76d232d0c4e3cdca6a6d\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:23.653935 containerd[1934]: time="2025-01-13T20:09:23.653876904Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-7fbffcd8cd-pxvdr,Uid:8f72f896-c0ba-4b07-9a22-acc5c8ca3697,Namespace:calico-apiserver,Attempt:1,} failed, error" error="failed to setup network for sandbox \"2accd017db7708cc1fa5c6da328b2f1c3f1c063e1b4b76d232d0c4e3cdca6a6d\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:23.654822 kubelet[3423]: E0113 20:09:23.654475 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"2accd017db7708cc1fa5c6da328b2f1c3f1c063e1b4b76d232d0c4e3cdca6a6d\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:23.654822 kubelet[3423]: E0113 20:09:23.654563 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"2accd017db7708cc1fa5c6da328b2f1c3f1c063e1b4b76d232d0c4e3cdca6a6d\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-pxvdr" Jan 13 20:09:23.654822 kubelet[3423]: E0113 20:09:23.654607 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"2accd017db7708cc1fa5c6da328b2f1c3f1c063e1b4b76d232d0c4e3cdca6a6d\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-pxvdr" Jan 13 20:09:23.656862 kubelet[3423]: E0113 20:09:23.654689 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"calico-apiserver-7fbffcd8cd-pxvdr_calico-apiserver(8f72f896-c0ba-4b07-9a22-acc5c8ca3697)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"calico-apiserver-7fbffcd8cd-pxvdr_calico-apiserver(8f72f896-c0ba-4b07-9a22-acc5c8ca3697)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"2accd017db7708cc1fa5c6da328b2f1c3f1c063e1b4b76d232d0c4e3cdca6a6d\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-pxvdr" podUID="8f72f896-c0ba-4b07-9a22-acc5c8ca3697" Jan 13 20:09:23.678034 containerd[1934]: time="2025-01-13T20:09:23.677198832Z" level=error msg="Failed to destroy network for sandbox \"7d3190834f7286fc68261319021ff89fa2267e8e4a2bc44b60cdc8ec3736f03b\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:23.679174 containerd[1934]: time="2025-01-13T20:09:23.678938964Z" level=error msg="encountered an error cleaning up failed sandbox \"7d3190834f7286fc68261319021ff89fa2267e8e4a2bc44b60cdc8ec3736f03b\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:23.679852 containerd[1934]: time="2025-01-13T20:09:23.679045512Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-76f75df574-mkr2l,Uid:396e30c8-d221-410a-89fe-e353ba8cddbf,Namespace:kube-system,Attempt:1,} failed, error" error="failed to setup network for sandbox \"7d3190834f7286fc68261319021ff89fa2267e8e4a2bc44b60cdc8ec3736f03b\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:23.681435 kubelet[3423]: E0113 20:09:23.680329 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"7d3190834f7286fc68261319021ff89fa2267e8e4a2bc44b60cdc8ec3736f03b\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:23.681435 kubelet[3423]: E0113 20:09:23.680418 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"7d3190834f7286fc68261319021ff89fa2267e8e4a2bc44b60cdc8ec3736f03b\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-76f75df574-mkr2l" Jan 13 20:09:23.681435 kubelet[3423]: E0113 20:09:23.680464 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"7d3190834f7286fc68261319021ff89fa2267e8e4a2bc44b60cdc8ec3736f03b\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-76f75df574-mkr2l" Jan 13 20:09:23.681666 kubelet[3423]: E0113 20:09:23.680553 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-76f75df574-mkr2l_kube-system(396e30c8-d221-410a-89fe-e353ba8cddbf)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-76f75df574-mkr2l_kube-system(396e30c8-d221-410a-89fe-e353ba8cddbf)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"7d3190834f7286fc68261319021ff89fa2267e8e4a2bc44b60cdc8ec3736f03b\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="kube-system/coredns-76f75df574-mkr2l" podUID="396e30c8-d221-410a-89fe-e353ba8cddbf" Jan 13 20:09:23.692323 containerd[1934]: time="2025-01-13T20:09:23.692087304Z" level=error msg="Failed to destroy network for sandbox \"a86b825795730ba2f9f58fb14a41879f6cdba9ae4550e62d02a587d4dd982d06\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:23.693983 containerd[1934]: time="2025-01-13T20:09:23.693438996Z" level=error msg="encountered an error cleaning up failed sandbox \"a86b825795730ba2f9f58fb14a41879f6cdba9ae4550e62d02a587d4dd982d06\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:23.696210 containerd[1934]: time="2025-01-13T20:09:23.695753280Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-kube-controllers-68f76c7ddf-lh8nj,Uid:2be21c11-9c2d-4b9a-81a5-0e73daba31c1,Namespace:calico-system,Attempt:1,} failed, error" error="failed to setup network for sandbox \"a86b825795730ba2f9f58fb14a41879f6cdba9ae4550e62d02a587d4dd982d06\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:23.697726 kubelet[3423]: E0113 20:09:23.697562 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a86b825795730ba2f9f58fb14a41879f6cdba9ae4550e62d02a587d4dd982d06\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:23.697726 kubelet[3423]: E0113 20:09:23.697646 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a86b825795730ba2f9f58fb14a41879f6cdba9ae4550e62d02a587d4dd982d06\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/calico-kube-controllers-68f76c7ddf-lh8nj" Jan 13 20:09:23.697726 kubelet[3423]: E0113 20:09:23.697687 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a86b825795730ba2f9f58fb14a41879f6cdba9ae4550e62d02a587d4dd982d06\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/calico-kube-controllers-68f76c7ddf-lh8nj" Jan 13 20:09:23.699122 kubelet[3423]: E0113 20:09:23.697794 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"calico-kube-controllers-68f76c7ddf-lh8nj_calico-system(2be21c11-9c2d-4b9a-81a5-0e73daba31c1)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"calico-kube-controllers-68f76c7ddf-lh8nj_calico-system(2be21c11-9c2d-4b9a-81a5-0e73daba31c1)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"a86b825795730ba2f9f58fb14a41879f6cdba9ae4550e62d02a587d4dd982d06\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-system/calico-kube-controllers-68f76c7ddf-lh8nj" podUID="2be21c11-9c2d-4b9a-81a5-0e73daba31c1" Jan 13 20:09:23.712829 containerd[1934]: time="2025-01-13T20:09:23.712284792Z" level=error msg="Failed to destroy network for sandbox \"af4b04b9175c96b5f57bdaa5d05b254cb086cf984792052f87e1249b6c2e75f9\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:23.713227 containerd[1934]: time="2025-01-13T20:09:23.713172384Z" level=error msg="encountered an error cleaning up failed sandbox \"af4b04b9175c96b5f57bdaa5d05b254cb086cf984792052f87e1249b6c2e75f9\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:23.713481 containerd[1934]: time="2025-01-13T20:09:23.713437020Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:csi-node-driver-wq54r,Uid:d47fc662-eff9-4473-83da-b6f0b896d81f,Namespace:calico-system,Attempt:1,} failed, error" error="failed to setup network for sandbox \"af4b04b9175c96b5f57bdaa5d05b254cb086cf984792052f87e1249b6c2e75f9\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:23.714757 kubelet[3423]: E0113 20:09:23.714718 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"af4b04b9175c96b5f57bdaa5d05b254cb086cf984792052f87e1249b6c2e75f9\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:23.715341 kubelet[3423]: E0113 20:09:23.715138 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"af4b04b9175c96b5f57bdaa5d05b254cb086cf984792052f87e1249b6c2e75f9\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/csi-node-driver-wq54r" Jan 13 20:09:23.715341 kubelet[3423]: E0113 20:09:23.715210 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"af4b04b9175c96b5f57bdaa5d05b254cb086cf984792052f87e1249b6c2e75f9\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/csi-node-driver-wq54r" Jan 13 20:09:23.715978 kubelet[3423]: E0113 20:09:23.715657 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"csi-node-driver-wq54r_calico-system(d47fc662-eff9-4473-83da-b6f0b896d81f)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"csi-node-driver-wq54r_calico-system(d47fc662-eff9-4473-83da-b6f0b896d81f)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"af4b04b9175c96b5f57bdaa5d05b254cb086cf984792052f87e1249b6c2e75f9\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-system/csi-node-driver-wq54r" podUID="d47fc662-eff9-4473-83da-b6f0b896d81f" Jan 13 20:09:24.012190 systemd[1]: run-netns-cni\x2dffdb970f\x2d790c\x2d0f8d\x2d4b4b\x2d5f3ce44b8471.mount: Deactivated successfully. Jan 13 20:09:24.012371 systemd[1]: run-netns-cni\x2d4dcd5c33\x2d7a61\x2dfe9d\x2d36f3\x2d1381e7a97064.mount: Deactivated successfully. Jan 13 20:09:24.182874 kubelet[3423]: I0113 20:09:24.182835 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2accd017db7708cc1fa5c6da328b2f1c3f1c063e1b4b76d232d0c4e3cdca6a6d" Jan 13 20:09:24.191811 containerd[1934]: time="2025-01-13T20:09:24.189376427Z" level=info msg="StopPodSandbox for \"2accd017db7708cc1fa5c6da328b2f1c3f1c063e1b4b76d232d0c4e3cdca6a6d\"" Jan 13 20:09:24.191811 containerd[1934]: time="2025-01-13T20:09:24.189678563Z" level=info msg="Ensure that sandbox 2accd017db7708cc1fa5c6da328b2f1c3f1c063e1b4b76d232d0c4e3cdca6a6d in task-service has been cleanup successfully" Jan 13 20:09:24.205267 containerd[1934]: time="2025-01-13T20:09:24.199889639Z" level=info msg="TearDown network for sandbox \"2accd017db7708cc1fa5c6da328b2f1c3f1c063e1b4b76d232d0c4e3cdca6a6d\" successfully" Jan 13 20:09:24.205267 containerd[1934]: time="2025-01-13T20:09:24.199944431Z" level=info msg="StopPodSandbox for \"2accd017db7708cc1fa5c6da328b2f1c3f1c063e1b4b76d232d0c4e3cdca6a6d\" returns successfully" Jan 13 20:09:24.202972 systemd[1]: run-netns-cni\x2dc9b90c8f\x2d127a\x2d62fc\x2d7899\x2d025014f6c50b.mount: Deactivated successfully. Jan 13 20:09:24.205615 kubelet[3423]: I0113 20:09:24.201836 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="af4b04b9175c96b5f57bdaa5d05b254cb086cf984792052f87e1249b6c2e75f9" Jan 13 20:09:24.209894 containerd[1934]: time="2025-01-13T20:09:24.208270643Z" level=info msg="StopPodSandbox for \"c787f8945e5c1c02a132aebe2ce54537e8efb76054bd3d61620dd081ac229a87\"" Jan 13 20:09:24.209894 containerd[1934]: time="2025-01-13T20:09:24.208584959Z" level=info msg="TearDown network for sandbox \"c787f8945e5c1c02a132aebe2ce54537e8efb76054bd3d61620dd081ac229a87\" successfully" Jan 13 20:09:24.211009 containerd[1934]: time="2025-01-13T20:09:24.208611227Z" level=info msg="StopPodSandbox for \"c787f8945e5c1c02a132aebe2ce54537e8efb76054bd3d61620dd081ac229a87\" returns successfully" Jan 13 20:09:24.219818 containerd[1934]: time="2025-01-13T20:09:24.216411011Z" level=info msg="StopPodSandbox for \"af4b04b9175c96b5f57bdaa5d05b254cb086cf984792052f87e1249b6c2e75f9\"" Jan 13 20:09:24.219818 containerd[1934]: time="2025-01-13T20:09:24.216715127Z" level=info msg="Ensure that sandbox af4b04b9175c96b5f57bdaa5d05b254cb086cf984792052f87e1249b6c2e75f9 in task-service has been cleanup successfully" Jan 13 20:09:24.226516 systemd[1]: run-netns-cni\x2d0d2c4f38\x2df8f7\x2dfb28\x2dcc95\x2db43b7b756ba2.mount: Deactivated successfully. Jan 13 20:09:24.227370 containerd[1934]: time="2025-01-13T20:09:24.227321063Z" level=info msg="TearDown network for sandbox \"af4b04b9175c96b5f57bdaa5d05b254cb086cf984792052f87e1249b6c2e75f9\" successfully" Jan 13 20:09:24.228935 containerd[1934]: time="2025-01-13T20:09:24.227666219Z" level=info msg="StopPodSandbox for \"af4b04b9175c96b5f57bdaa5d05b254cb086cf984792052f87e1249b6c2e75f9\" returns successfully" Jan 13 20:09:24.231557 containerd[1934]: time="2025-01-13T20:09:24.229435583Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-7fbffcd8cd-pxvdr,Uid:8f72f896-c0ba-4b07-9a22-acc5c8ca3697,Namespace:calico-apiserver,Attempt:2,}" Jan 13 20:09:24.237116 containerd[1934]: time="2025-01-13T20:09:24.237049823Z" level=info msg="StopPodSandbox for \"ccf56aafff1edbddd69e830448606d1ed364723341b141ed6867e7ed4d6b5f89\"" Jan 13 20:09:24.237116 containerd[1934]: time="2025-01-13T20:09:24.237225851Z" level=info msg="TearDown network for sandbox \"ccf56aafff1edbddd69e830448606d1ed364723341b141ed6867e7ed4d6b5f89\" successfully" Jan 13 20:09:24.237436 containerd[1934]: time="2025-01-13T20:09:24.237249335Z" level=info msg="StopPodSandbox for \"ccf56aafff1edbddd69e830448606d1ed364723341b141ed6867e7ed4d6b5f89\" returns successfully" Jan 13 20:09:24.243189 kubelet[3423]: I0113 20:09:24.242518 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a86b825795730ba2f9f58fb14a41879f6cdba9ae4550e62d02a587d4dd982d06" Jan 13 20:09:24.243988 containerd[1934]: time="2025-01-13T20:09:24.243862835Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:csi-node-driver-wq54r,Uid:d47fc662-eff9-4473-83da-b6f0b896d81f,Namespace:calico-system,Attempt:2,}" Jan 13 20:09:24.252403 containerd[1934]: time="2025-01-13T20:09:24.251649875Z" level=info msg="StopPodSandbox for \"a86b825795730ba2f9f58fb14a41879f6cdba9ae4550e62d02a587d4dd982d06\"" Jan 13 20:09:24.252403 containerd[1934]: time="2025-01-13T20:09:24.251958443Z" level=info msg="Ensure that sandbox a86b825795730ba2f9f58fb14a41879f6cdba9ae4550e62d02a587d4dd982d06 in task-service has been cleanup successfully" Jan 13 20:09:24.259682 systemd[1]: run-netns-cni\x2db779fa09\x2d0111\x2df011\x2daf8a\x2dce22d0dde286.mount: Deactivated successfully. Jan 13 20:09:24.278593 kubelet[3423]: I0113 20:09:24.265643 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7d3190834f7286fc68261319021ff89fa2267e8e4a2bc44b60cdc8ec3736f03b" Jan 13 20:09:24.278698 containerd[1934]: time="2025-01-13T20:09:24.257638475Z" level=info msg="TearDown network for sandbox \"a86b825795730ba2f9f58fb14a41879f6cdba9ae4550e62d02a587d4dd982d06\" successfully" Jan 13 20:09:24.278698 containerd[1934]: time="2025-01-13T20:09:24.257686007Z" level=info msg="StopPodSandbox for \"a86b825795730ba2f9f58fb14a41879f6cdba9ae4550e62d02a587d4dd982d06\" returns successfully" Jan 13 20:09:24.278698 containerd[1934]: time="2025-01-13T20:09:24.261996683Z" level=info msg="StopPodSandbox for \"57f3ef7b6cf66ed3ed7b779c226fa67874c55496cae0804a70bff6ecec1ef212\"" Jan 13 20:09:24.278698 containerd[1934]: time="2025-01-13T20:09:24.265740095Z" level=info msg="TearDown network for sandbox \"57f3ef7b6cf66ed3ed7b779c226fa67874c55496cae0804a70bff6ecec1ef212\" successfully" Jan 13 20:09:24.278698 containerd[1934]: time="2025-01-13T20:09:24.266219123Z" level=info msg="StopPodSandbox for \"57f3ef7b6cf66ed3ed7b779c226fa67874c55496cae0804a70bff6ecec1ef212\" returns successfully" Jan 13 20:09:24.278698 containerd[1934]: time="2025-01-13T20:09:24.267858131Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-kube-controllers-68f76c7ddf-lh8nj,Uid:2be21c11-9c2d-4b9a-81a5-0e73daba31c1,Namespace:calico-system,Attempt:2,}" Jan 13 20:09:24.278698 containerd[1934]: time="2025-01-13T20:09:24.270328007Z" level=info msg="StopPodSandbox for \"7d3190834f7286fc68261319021ff89fa2267e8e4a2bc44b60cdc8ec3736f03b\"" Jan 13 20:09:24.278698 containerd[1934]: time="2025-01-13T20:09:24.270617303Z" level=info msg="Ensure that sandbox 7d3190834f7286fc68261319021ff89fa2267e8e4a2bc44b60cdc8ec3736f03b in task-service has been cleanup successfully" Jan 13 20:09:24.278698 containerd[1934]: time="2025-01-13T20:09:24.272890379Z" level=info msg="TearDown network for sandbox \"7d3190834f7286fc68261319021ff89fa2267e8e4a2bc44b60cdc8ec3736f03b\" successfully" Jan 13 20:09:24.278698 containerd[1934]: time="2025-01-13T20:09:24.272935607Z" level=info msg="StopPodSandbox for \"7d3190834f7286fc68261319021ff89fa2267e8e4a2bc44b60cdc8ec3736f03b\" returns successfully" Jan 13 20:09:24.279299 containerd[1934]: time="2025-01-13T20:09:24.279168347Z" level=info msg="StopPodSandbox for \"899dac68c4a2c7ede7e6073b33ab156f86e32973795b4e68f426b199aa5486a9\"" Jan 13 20:09:24.279354 containerd[1934]: time="2025-01-13T20:09:24.279313115Z" level=info msg="TearDown network for sandbox \"899dac68c4a2c7ede7e6073b33ab156f86e32973795b4e68f426b199aa5486a9\" successfully" Jan 13 20:09:24.279354 containerd[1934]: time="2025-01-13T20:09:24.279334943Z" level=info msg="StopPodSandbox for \"899dac68c4a2c7ede7e6073b33ab156f86e32973795b4e68f426b199aa5486a9\" returns successfully" Jan 13 20:09:24.281673 systemd[1]: run-netns-cni\x2d8323234d\x2d74bd\x2dff01\x2dbcd7\x2daff5a00909b2.mount: Deactivated successfully. Jan 13 20:09:24.283424 containerd[1934]: time="2025-01-13T20:09:24.282646367Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-76f75df574-mkr2l,Uid:396e30c8-d221-410a-89fe-e353ba8cddbf,Namespace:kube-system,Attempt:2,}" Jan 13 20:09:24.283546 kubelet[3423]: I0113 20:09:24.283054 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cfa6ddb68ab8a55e2b4406871b279f8198e9a43957ec335f7facbf57b86881a3" Jan 13 20:09:24.288056 containerd[1934]: time="2025-01-13T20:09:24.287997467Z" level=info msg="StopPodSandbox for \"cfa6ddb68ab8a55e2b4406871b279f8198e9a43957ec335f7facbf57b86881a3\"" Jan 13 20:09:24.288341 containerd[1934]: time="2025-01-13T20:09:24.288295091Z" level=info msg="Ensure that sandbox cfa6ddb68ab8a55e2b4406871b279f8198e9a43957ec335f7facbf57b86881a3 in task-service has been cleanup successfully" Jan 13 20:09:24.289046 containerd[1934]: time="2025-01-13T20:09:24.288596459Z" level=info msg="TearDown network for sandbox \"cfa6ddb68ab8a55e2b4406871b279f8198e9a43957ec335f7facbf57b86881a3\" successfully" Jan 13 20:09:24.289046 containerd[1934]: time="2025-01-13T20:09:24.288649487Z" level=info msg="StopPodSandbox for \"cfa6ddb68ab8a55e2b4406871b279f8198e9a43957ec335f7facbf57b86881a3\" returns successfully" Jan 13 20:09:24.290267 containerd[1934]: time="2025-01-13T20:09:24.290134475Z" level=info msg="StopPodSandbox for \"fb565334446e5f8a46a1bd1f7f902b79f435864e841478f2f0a155d44cd33b41\"" Jan 13 20:09:24.290378 containerd[1934]: time="2025-01-13T20:09:24.290326967Z" level=info msg="TearDown network for sandbox \"fb565334446e5f8a46a1bd1f7f902b79f435864e841478f2f0a155d44cd33b41\" successfully" Jan 13 20:09:24.290378 containerd[1934]: time="2025-01-13T20:09:24.290350799Z" level=info msg="StopPodSandbox for \"fb565334446e5f8a46a1bd1f7f902b79f435864e841478f2f0a155d44cd33b41\" returns successfully" Jan 13 20:09:24.293254 containerd[1934]: time="2025-01-13T20:09:24.293173067Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-7fbffcd8cd-wszl7,Uid:ad79c041-eaf1-4d57-9fb4-c3fb08680cb8,Namespace:calico-apiserver,Attempt:2,}" Jan 13 20:09:24.294401 kubelet[3423]: I0113 20:09:24.294348 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eed11d015ff645b963130f5ad956d107f391cbaba3451e015229fc4082c60951" Jan 13 20:09:24.296819 containerd[1934]: time="2025-01-13T20:09:24.296725811Z" level=info msg="StopPodSandbox for \"eed11d015ff645b963130f5ad956d107f391cbaba3451e015229fc4082c60951\"" Jan 13 20:09:24.298141 containerd[1934]: time="2025-01-13T20:09:24.297937967Z" level=info msg="Ensure that sandbox eed11d015ff645b963130f5ad956d107f391cbaba3451e015229fc4082c60951 in task-service has been cleanup successfully" Jan 13 20:09:24.298997 containerd[1934]: time="2025-01-13T20:09:24.298933475Z" level=info msg="TearDown network for sandbox \"eed11d015ff645b963130f5ad956d107f391cbaba3451e015229fc4082c60951\" successfully" Jan 13 20:09:24.298997 containerd[1934]: time="2025-01-13T20:09:24.298983599Z" level=info msg="StopPodSandbox for \"eed11d015ff645b963130f5ad956d107f391cbaba3451e015229fc4082c60951\" returns successfully" Jan 13 20:09:24.300821 containerd[1934]: time="2025-01-13T20:09:24.300525887Z" level=info msg="StopPodSandbox for \"f5e883fc61f95c31957335ed367bbb8d4c07a9c5470ee6e51fca5c2bde0bfb8c\"" Jan 13 20:09:24.301184 containerd[1934]: time="2025-01-13T20:09:24.301119191Z" level=info msg="TearDown network for sandbox \"f5e883fc61f95c31957335ed367bbb8d4c07a9c5470ee6e51fca5c2bde0bfb8c\" successfully" Jan 13 20:09:24.301516 containerd[1934]: time="2025-01-13T20:09:24.301157363Z" level=info msg="StopPodSandbox for \"f5e883fc61f95c31957335ed367bbb8d4c07a9c5470ee6e51fca5c2bde0bfb8c\" returns successfully" Jan 13 20:09:24.303240 containerd[1934]: time="2025-01-13T20:09:24.303040643Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-76f75df574-8wp6k,Uid:87115657-f395-40ec-89ea-3d7835119c3a,Namespace:kube-system,Attempt:2,}" Jan 13 20:09:24.782998 systemd[1]: Started sshd@9-172.31.28.23:22-147.75.109.163:33282.service - OpenSSH per-connection server daemon (147.75.109.163:33282). Jan 13 20:09:24.978818 sshd[4578]: Accepted publickey for core from 147.75.109.163 port 33282 ssh2: RSA SHA256:IRHkteilZRLg/mCVEzdResksy7NfUBDRRywgALKaHg0 Jan 13 20:09:24.980003 sshd-session[4578]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Jan 13 20:09:24.987988 systemd-logind[1912]: New session 10 of user core. Jan 13 20:09:24.998030 systemd[1]: Started session-10.scope - Session 10 of User core. Jan 13 20:09:25.007222 systemd[1]: run-netns-cni\x2d5cd5ea35\x2d8821\x2d01b6\x2d4226\x2df23b000f319e.mount: Deactivated successfully. Jan 13 20:09:25.007588 systemd[1]: run-netns-cni\x2d6a43380c\x2dee75\x2ded7d\x2d737e\x2db9224f5cceb7.mount: Deactivated successfully. Jan 13 20:09:25.254571 sshd[4580]: Connection closed by 147.75.109.163 port 33282 Jan 13 20:09:25.255526 sshd-session[4578]: pam_unix(sshd:session): session closed for user core Jan 13 20:09:25.261491 systemd[1]: sshd@9-172.31.28.23:22-147.75.109.163:33282.service: Deactivated successfully. Jan 13 20:09:25.265191 systemd[1]: session-10.scope: Deactivated successfully. Jan 13 20:09:25.266729 systemd-logind[1912]: Session 10 logged out. Waiting for processes to exit. Jan 13 20:09:25.269659 systemd-logind[1912]: Removed session 10. Jan 13 20:09:25.295277 systemd[1]: Started sshd@10-172.31.28.23:22-147.75.109.163:33298.service - OpenSSH per-connection server daemon (147.75.109.163:33298). Jan 13 20:09:25.492593 sshd[4592]: Accepted publickey for core from 147.75.109.163 port 33298 ssh2: RSA SHA256:IRHkteilZRLg/mCVEzdResksy7NfUBDRRywgALKaHg0 Jan 13 20:09:25.495103 sshd-session[4592]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Jan 13 20:09:25.503086 systemd-logind[1912]: New session 11 of user core. Jan 13 20:09:25.513060 systemd[1]: Started session-11.scope - Session 11 of User core. Jan 13 20:09:25.977971 sshd[4594]: Connection closed by 147.75.109.163 port 33298 Jan 13 20:09:25.980265 sshd-session[4592]: pam_unix(sshd:session): session closed for user core Jan 13 20:09:25.993172 systemd[1]: sshd@10-172.31.28.23:22-147.75.109.163:33298.service: Deactivated successfully. Jan 13 20:09:26.044552 systemd[1]: session-11.scope: Deactivated successfully. Jan 13 20:09:26.071354 systemd-logind[1912]: Session 11 logged out. Waiting for processes to exit. Jan 13 20:09:26.088277 systemd[1]: Started sshd@11-172.31.28.23:22-147.75.109.163:33302.service - OpenSSH per-connection server daemon (147.75.109.163:33302). Jan 13 20:09:26.098279 systemd-logind[1912]: Removed session 11. Jan 13 20:09:26.326887 sshd[4675]: Accepted publickey for core from 147.75.109.163 port 33302 ssh2: RSA SHA256:IRHkteilZRLg/mCVEzdResksy7NfUBDRRywgALKaHg0 Jan 13 20:09:26.330646 sshd-session[4675]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Jan 13 20:09:26.347693 systemd-logind[1912]: New session 12 of user core. Jan 13 20:09:26.353244 systemd[1]: Started session-12.scope - Session 12 of User core. Jan 13 20:09:26.367020 containerd[1934]: time="2025-01-13T20:09:26.366813085Z" level=error msg="Failed to destroy network for sandbox \"3999268688ddddddb7ec9df611d8146f50072274600306787cd56688f110d548\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:26.372817 containerd[1934]: time="2025-01-13T20:09:26.370336513Z" level=error msg="encountered an error cleaning up failed sandbox \"3999268688ddddddb7ec9df611d8146f50072274600306787cd56688f110d548\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:26.376766 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-3999268688ddddddb7ec9df611d8146f50072274600306787cd56688f110d548-shm.mount: Deactivated successfully. Jan 13 20:09:26.384147 containerd[1934]: time="2025-01-13T20:09:26.383950153Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-kube-controllers-68f76c7ddf-lh8nj,Uid:2be21c11-9c2d-4b9a-81a5-0e73daba31c1,Namespace:calico-system,Attempt:2,} failed, error" error="failed to setup network for sandbox \"3999268688ddddddb7ec9df611d8146f50072274600306787cd56688f110d548\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:26.384634 kubelet[3423]: E0113 20:09:26.384329 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"3999268688ddddddb7ec9df611d8146f50072274600306787cd56688f110d548\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:26.384634 kubelet[3423]: E0113 20:09:26.384409 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"3999268688ddddddb7ec9df611d8146f50072274600306787cd56688f110d548\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/calico-kube-controllers-68f76c7ddf-lh8nj" Jan 13 20:09:26.384634 kubelet[3423]: E0113 20:09:26.384450 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"3999268688ddddddb7ec9df611d8146f50072274600306787cd56688f110d548\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/calico-kube-controllers-68f76c7ddf-lh8nj" Jan 13 20:09:26.387227 kubelet[3423]: E0113 20:09:26.384539 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"calico-kube-controllers-68f76c7ddf-lh8nj_calico-system(2be21c11-9c2d-4b9a-81a5-0e73daba31c1)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"calico-kube-controllers-68f76c7ddf-lh8nj_calico-system(2be21c11-9c2d-4b9a-81a5-0e73daba31c1)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"3999268688ddddddb7ec9df611d8146f50072274600306787cd56688f110d548\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-system/calico-kube-controllers-68f76c7ddf-lh8nj" podUID="2be21c11-9c2d-4b9a-81a5-0e73daba31c1" Jan 13 20:09:26.419878 containerd[1934]: time="2025-01-13T20:09:26.418851422Z" level=error msg="Failed to destroy network for sandbox \"e31eca7a421d12ab04696c6ee4fefbcfc3ab887e88d76deb901fc6a512e76618\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:26.423982 containerd[1934]: time="2025-01-13T20:09:26.423917654Z" level=error msg="encountered an error cleaning up failed sandbox \"e31eca7a421d12ab04696c6ee4fefbcfc3ab887e88d76deb901fc6a512e76618\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:26.426348 containerd[1934]: time="2025-01-13T20:09:26.426281810Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-7fbffcd8cd-pxvdr,Uid:8f72f896-c0ba-4b07-9a22-acc5c8ca3697,Namespace:calico-apiserver,Attempt:2,} failed, error" error="failed to setup network for sandbox \"e31eca7a421d12ab04696c6ee4fefbcfc3ab887e88d76deb901fc6a512e76618\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:26.432507 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-e31eca7a421d12ab04696c6ee4fefbcfc3ab887e88d76deb901fc6a512e76618-shm.mount: Deactivated successfully. Jan 13 20:09:26.437433 kubelet[3423]: E0113 20:09:26.437378 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e31eca7a421d12ab04696c6ee4fefbcfc3ab887e88d76deb901fc6a512e76618\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:26.437732 kubelet[3423]: E0113 20:09:26.437470 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e31eca7a421d12ab04696c6ee4fefbcfc3ab887e88d76deb901fc6a512e76618\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-pxvdr" Jan 13 20:09:26.437732 kubelet[3423]: E0113 20:09:26.437516 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e31eca7a421d12ab04696c6ee4fefbcfc3ab887e88d76deb901fc6a512e76618\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-pxvdr" Jan 13 20:09:26.439995 kubelet[3423]: E0113 20:09:26.439913 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"calico-apiserver-7fbffcd8cd-pxvdr_calico-apiserver(8f72f896-c0ba-4b07-9a22-acc5c8ca3697)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"calico-apiserver-7fbffcd8cd-pxvdr_calico-apiserver(8f72f896-c0ba-4b07-9a22-acc5c8ca3697)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"e31eca7a421d12ab04696c6ee4fefbcfc3ab887e88d76deb901fc6a512e76618\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-pxvdr" podUID="8f72f896-c0ba-4b07-9a22-acc5c8ca3697" Jan 13 20:09:26.446538 containerd[1934]: time="2025-01-13T20:09:26.446476574Z" level=error msg="Failed to destroy network for sandbox \"d029da1857cffbc9aea56a8ec883ba4e1da56eae06a46e2e4ba0629832693cb0\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:26.450400 containerd[1934]: time="2025-01-13T20:09:26.450133106Z" level=error msg="encountered an error cleaning up failed sandbox \"d029da1857cffbc9aea56a8ec883ba4e1da56eae06a46e2e4ba0629832693cb0\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:26.450400 containerd[1934]: time="2025-01-13T20:09:26.450243134Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-7fbffcd8cd-wszl7,Uid:ad79c041-eaf1-4d57-9fb4-c3fb08680cb8,Namespace:calico-apiserver,Attempt:2,} failed, error" error="failed to setup network for sandbox \"d029da1857cffbc9aea56a8ec883ba4e1da56eae06a46e2e4ba0629832693cb0\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:26.452918 kubelet[3423]: E0113 20:09:26.450922 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"d029da1857cffbc9aea56a8ec883ba4e1da56eae06a46e2e4ba0629832693cb0\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:26.452918 kubelet[3423]: E0113 20:09:26.451004 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"d029da1857cffbc9aea56a8ec883ba4e1da56eae06a46e2e4ba0629832693cb0\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-wszl7" Jan 13 20:09:26.452918 kubelet[3423]: E0113 20:09:26.451048 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"d029da1857cffbc9aea56a8ec883ba4e1da56eae06a46e2e4ba0629832693cb0\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-wszl7" Jan 13 20:09:26.453192 kubelet[3423]: E0113 20:09:26.451149 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"calico-apiserver-7fbffcd8cd-wszl7_calico-apiserver(ad79c041-eaf1-4d57-9fb4-c3fb08680cb8)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"calico-apiserver-7fbffcd8cd-wszl7_calico-apiserver(ad79c041-eaf1-4d57-9fb4-c3fb08680cb8)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"d029da1857cffbc9aea56a8ec883ba4e1da56eae06a46e2e4ba0629832693cb0\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-wszl7" podUID="ad79c041-eaf1-4d57-9fb4-c3fb08680cb8" Jan 13 20:09:26.458424 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-d029da1857cffbc9aea56a8ec883ba4e1da56eae06a46e2e4ba0629832693cb0-shm.mount: Deactivated successfully. Jan 13 20:09:26.465660 containerd[1934]: time="2025-01-13T20:09:26.465571154Z" level=error msg="Failed to destroy network for sandbox \"aeb47e19302f9c839c5fa002c506a56722057a24b2c06c5082b07dd07a783384\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:26.472715 containerd[1934]: time="2025-01-13T20:09:26.468944534Z" level=error msg="encountered an error cleaning up failed sandbox \"aeb47e19302f9c839c5fa002c506a56722057a24b2c06c5082b07dd07a783384\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:26.474208 containerd[1934]: time="2025-01-13T20:09:26.473069810Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:csi-node-driver-wq54r,Uid:d47fc662-eff9-4473-83da-b6f0b896d81f,Namespace:calico-system,Attempt:2,} failed, error" error="failed to setup network for sandbox \"aeb47e19302f9c839c5fa002c506a56722057a24b2c06c5082b07dd07a783384\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:26.474208 containerd[1934]: time="2025-01-13T20:09:26.473524658Z" level=error msg="Failed to destroy network for sandbox \"bac2fe516cc564552b8be0fbca65a9d04eaace09e824ed2a17d9c03e83edae58\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:26.474438 kubelet[3423]: E0113 20:09:26.473384 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"aeb47e19302f9c839c5fa002c506a56722057a24b2c06c5082b07dd07a783384\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:26.474438 kubelet[3423]: E0113 20:09:26.473470 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"aeb47e19302f9c839c5fa002c506a56722057a24b2c06c5082b07dd07a783384\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/csi-node-driver-wq54r" Jan 13 20:09:26.474438 kubelet[3423]: E0113 20:09:26.473519 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"aeb47e19302f9c839c5fa002c506a56722057a24b2c06c5082b07dd07a783384\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/csi-node-driver-wq54r" Jan 13 20:09:26.474614 kubelet[3423]: E0113 20:09:26.473635 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"csi-node-driver-wq54r_calico-system(d47fc662-eff9-4473-83da-b6f0b896d81f)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"csi-node-driver-wq54r_calico-system(d47fc662-eff9-4473-83da-b6f0b896d81f)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"aeb47e19302f9c839c5fa002c506a56722057a24b2c06c5082b07dd07a783384\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-system/csi-node-driver-wq54r" podUID="d47fc662-eff9-4473-83da-b6f0b896d81f" Jan 13 20:09:26.476605 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-aeb47e19302f9c839c5fa002c506a56722057a24b2c06c5082b07dd07a783384-shm.mount: Deactivated successfully. Jan 13 20:09:26.482768 containerd[1934]: time="2025-01-13T20:09:26.482685266Z" level=error msg="encountered an error cleaning up failed sandbox \"bac2fe516cc564552b8be0fbca65a9d04eaace09e824ed2a17d9c03e83edae58\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:26.482964 containerd[1934]: time="2025-01-13T20:09:26.482908070Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-76f75df574-mkr2l,Uid:396e30c8-d221-410a-89fe-e353ba8cddbf,Namespace:kube-system,Attempt:2,} failed, error" error="failed to setup network for sandbox \"bac2fe516cc564552b8be0fbca65a9d04eaace09e824ed2a17d9c03e83edae58\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:26.483304 kubelet[3423]: E0113 20:09:26.483240 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"bac2fe516cc564552b8be0fbca65a9d04eaace09e824ed2a17d9c03e83edae58\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:26.483461 kubelet[3423]: E0113 20:09:26.483322 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"bac2fe516cc564552b8be0fbca65a9d04eaace09e824ed2a17d9c03e83edae58\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-76f75df574-mkr2l" Jan 13 20:09:26.483461 kubelet[3423]: E0113 20:09:26.483359 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"bac2fe516cc564552b8be0fbca65a9d04eaace09e824ed2a17d9c03e83edae58\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-76f75df574-mkr2l" Jan 13 20:09:26.483632 kubelet[3423]: E0113 20:09:26.483464 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-76f75df574-mkr2l_kube-system(396e30c8-d221-410a-89fe-e353ba8cddbf)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-76f75df574-mkr2l_kube-system(396e30c8-d221-410a-89fe-e353ba8cddbf)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"bac2fe516cc564552b8be0fbca65a9d04eaace09e824ed2a17d9c03e83edae58\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="kube-system/coredns-76f75df574-mkr2l" podUID="396e30c8-d221-410a-89fe-e353ba8cddbf" Jan 13 20:09:26.511552 containerd[1934]: time="2025-01-13T20:09:26.511490330Z" level=error msg="Failed to destroy network for sandbox \"8c0c460fc82d1c51ed146afb77bb0cdfb42636cd5b1ebd0d7d108e8d75eb9610\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:26.512931 containerd[1934]: time="2025-01-13T20:09:26.512696294Z" level=error msg="encountered an error cleaning up failed sandbox \"8c0c460fc82d1c51ed146afb77bb0cdfb42636cd5b1ebd0d7d108e8d75eb9610\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:26.513921 containerd[1934]: time="2025-01-13T20:09:26.513701342Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-76f75df574-8wp6k,Uid:87115657-f395-40ec-89ea-3d7835119c3a,Namespace:kube-system,Attempt:2,} failed, error" error="failed to setup network for sandbox \"8c0c460fc82d1c51ed146afb77bb0cdfb42636cd5b1ebd0d7d108e8d75eb9610\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:26.514435 kubelet[3423]: E0113 20:09:26.514294 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"8c0c460fc82d1c51ed146afb77bb0cdfb42636cd5b1ebd0d7d108e8d75eb9610\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:26.514435 kubelet[3423]: E0113 20:09:26.514375 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"8c0c460fc82d1c51ed146afb77bb0cdfb42636cd5b1ebd0d7d108e8d75eb9610\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-76f75df574-8wp6k" Jan 13 20:09:26.514435 kubelet[3423]: E0113 20:09:26.514416 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"8c0c460fc82d1c51ed146afb77bb0cdfb42636cd5b1ebd0d7d108e8d75eb9610\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-76f75df574-8wp6k" Jan 13 20:09:26.514931 kubelet[3423]: E0113 20:09:26.514493 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-76f75df574-8wp6k_kube-system(87115657-f395-40ec-89ea-3d7835119c3a)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-76f75df574-8wp6k_kube-system(87115657-f395-40ec-89ea-3d7835119c3a)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"8c0c460fc82d1c51ed146afb77bb0cdfb42636cd5b1ebd0d7d108e8d75eb9610\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="kube-system/coredns-76f75df574-8wp6k" podUID="87115657-f395-40ec-89ea-3d7835119c3a" Jan 13 20:09:26.731050 sshd[4783]: Connection closed by 147.75.109.163 port 33302 Jan 13 20:09:26.731521 sshd-session[4675]: pam_unix(sshd:session): session closed for user core Jan 13 20:09:26.740024 systemd[1]: sshd@11-172.31.28.23:22-147.75.109.163:33302.service: Deactivated successfully. Jan 13 20:09:26.748252 systemd[1]: session-12.scope: Deactivated successfully. Jan 13 20:09:26.752895 systemd-logind[1912]: Session 12 logged out. Waiting for processes to exit. Jan 13 20:09:26.757244 systemd-logind[1912]: Removed session 12. Jan 13 20:09:27.008026 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-8c0c460fc82d1c51ed146afb77bb0cdfb42636cd5b1ebd0d7d108e8d75eb9610-shm.mount: Deactivated successfully. Jan 13 20:09:27.008567 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-bac2fe516cc564552b8be0fbca65a9d04eaace09e824ed2a17d9c03e83edae58-shm.mount: Deactivated successfully. Jan 13 20:09:27.315516 kubelet[3423]: I0113 20:09:27.315184 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bac2fe516cc564552b8be0fbca65a9d04eaace09e824ed2a17d9c03e83edae58" Jan 13 20:09:27.318247 containerd[1934]: time="2025-01-13T20:09:27.316555442Z" level=info msg="StopPodSandbox for \"bac2fe516cc564552b8be0fbca65a9d04eaace09e824ed2a17d9c03e83edae58\"" Jan 13 20:09:27.318247 containerd[1934]: time="2025-01-13T20:09:27.316858286Z" level=info msg="Ensure that sandbox bac2fe516cc564552b8be0fbca65a9d04eaace09e824ed2a17d9c03e83edae58 in task-service has been cleanup successfully" Jan 13 20:09:27.324415 containerd[1934]: time="2025-01-13T20:09:27.324348542Z" level=info msg="TearDown network for sandbox \"bac2fe516cc564552b8be0fbca65a9d04eaace09e824ed2a17d9c03e83edae58\" successfully" Jan 13 20:09:27.324575 containerd[1934]: time="2025-01-13T20:09:27.324401330Z" level=info msg="StopPodSandbox for \"bac2fe516cc564552b8be0fbca65a9d04eaace09e824ed2a17d9c03e83edae58\" returns successfully" Jan 13 20:09:27.326580 containerd[1934]: time="2025-01-13T20:09:27.325842470Z" level=info msg="StopPodSandbox for \"7d3190834f7286fc68261319021ff89fa2267e8e4a2bc44b60cdc8ec3736f03b\"" Jan 13 20:09:27.326580 containerd[1934]: time="2025-01-13T20:09:27.326306594Z" level=info msg="TearDown network for sandbox \"7d3190834f7286fc68261319021ff89fa2267e8e4a2bc44b60cdc8ec3736f03b\" successfully" Jan 13 20:09:27.326831 containerd[1934]: time="2025-01-13T20:09:27.326595050Z" level=info msg="StopPodSandbox for \"7d3190834f7286fc68261319021ff89fa2267e8e4a2bc44b60cdc8ec3736f03b\" returns successfully" Jan 13 20:09:27.326979 systemd[1]: run-netns-cni\x2de789e527\x2dd2f7\x2d5f54\x2d0246\x2db87b8f850c9a.mount: Deactivated successfully. Jan 13 20:09:27.330953 containerd[1934]: time="2025-01-13T20:09:27.328363250Z" level=info msg="StopPodSandbox for \"899dac68c4a2c7ede7e6073b33ab156f86e32973795b4e68f426b199aa5486a9\"" Jan 13 20:09:27.331364 containerd[1934]: time="2025-01-13T20:09:27.331244126Z" level=info msg="TearDown network for sandbox \"899dac68c4a2c7ede7e6073b33ab156f86e32973795b4e68f426b199aa5486a9\" successfully" Jan 13 20:09:27.331866 containerd[1934]: time="2025-01-13T20:09:27.331531046Z" level=info msg="StopPodSandbox for \"899dac68c4a2c7ede7e6073b33ab156f86e32973795b4e68f426b199aa5486a9\" returns successfully" Jan 13 20:09:27.333182 containerd[1934]: time="2025-01-13T20:09:27.333117530Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-76f75df574-mkr2l,Uid:396e30c8-d221-410a-89fe-e353ba8cddbf,Namespace:kube-system,Attempt:3,}" Jan 13 20:09:27.334401 kubelet[3423]: I0113 20:09:27.334301 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d029da1857cffbc9aea56a8ec883ba4e1da56eae06a46e2e4ba0629832693cb0" Jan 13 20:09:27.336824 containerd[1934]: time="2025-01-13T20:09:27.336549302Z" level=info msg="StopPodSandbox for \"d029da1857cffbc9aea56a8ec883ba4e1da56eae06a46e2e4ba0629832693cb0\"" Jan 13 20:09:27.340898 containerd[1934]: time="2025-01-13T20:09:27.340847654Z" level=info msg="Ensure that sandbox d029da1857cffbc9aea56a8ec883ba4e1da56eae06a46e2e4ba0629832693cb0 in task-service has been cleanup successfully" Jan 13 20:09:27.346267 containerd[1934]: time="2025-01-13T20:09:27.346124714Z" level=info msg="TearDown network for sandbox \"d029da1857cffbc9aea56a8ec883ba4e1da56eae06a46e2e4ba0629832693cb0\" successfully" Jan 13 20:09:27.346267 containerd[1934]: time="2025-01-13T20:09:27.346177058Z" level=info msg="StopPodSandbox for \"d029da1857cffbc9aea56a8ec883ba4e1da56eae06a46e2e4ba0629832693cb0\" returns successfully" Jan 13 20:09:27.351948 containerd[1934]: time="2025-01-13T20:09:27.349838282Z" level=info msg="StopPodSandbox for \"cfa6ddb68ab8a55e2b4406871b279f8198e9a43957ec335f7facbf57b86881a3\"" Jan 13 20:09:27.351948 containerd[1934]: time="2025-01-13T20:09:27.350015474Z" level=info msg="TearDown network for sandbox \"cfa6ddb68ab8a55e2b4406871b279f8198e9a43957ec335f7facbf57b86881a3\" successfully" Jan 13 20:09:27.351948 containerd[1934]: time="2025-01-13T20:09:27.350038382Z" level=info msg="StopPodSandbox for \"cfa6ddb68ab8a55e2b4406871b279f8198e9a43957ec335f7facbf57b86881a3\" returns successfully" Jan 13 20:09:27.379978 kubelet[3423]: I0113 20:09:27.351328 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8c0c460fc82d1c51ed146afb77bb0cdfb42636cd5b1ebd0d7d108e8d75eb9610" Jan 13 20:09:27.353925 systemd[1]: run-netns-cni\x2de0d1d810\x2d1c8f\x2d6d10\x2da091\x2d6147c27c49e2.mount: Deactivated successfully. Jan 13 20:09:27.380380 containerd[1934]: time="2025-01-13T20:09:27.353953838Z" level=info msg="StopPodSandbox for \"8c0c460fc82d1c51ed146afb77bb0cdfb42636cd5b1ebd0d7d108e8d75eb9610\"" Jan 13 20:09:27.380380 containerd[1934]: time="2025-01-13T20:09:27.354235994Z" level=info msg="Ensure that sandbox 8c0c460fc82d1c51ed146afb77bb0cdfb42636cd5b1ebd0d7d108e8d75eb9610 in task-service has been cleanup successfully" Jan 13 20:09:27.380380 containerd[1934]: time="2025-01-13T20:09:27.358211990Z" level=info msg="TearDown network for sandbox \"8c0c460fc82d1c51ed146afb77bb0cdfb42636cd5b1ebd0d7d108e8d75eb9610\" successfully" Jan 13 20:09:27.380380 containerd[1934]: time="2025-01-13T20:09:27.358261382Z" level=info msg="StopPodSandbox for \"8c0c460fc82d1c51ed146afb77bb0cdfb42636cd5b1ebd0d7d108e8d75eb9610\" returns successfully" Jan 13 20:09:27.380380 containerd[1934]: time="2025-01-13T20:09:27.358421882Z" level=info msg="StopPodSandbox for \"fb565334446e5f8a46a1bd1f7f902b79f435864e841478f2f0a155d44cd33b41\"" Jan 13 20:09:27.380380 containerd[1934]: time="2025-01-13T20:09:27.358569002Z" level=info msg="TearDown network for sandbox \"fb565334446e5f8a46a1bd1f7f902b79f435864e841478f2f0a155d44cd33b41\" successfully" Jan 13 20:09:27.380380 containerd[1934]: time="2025-01-13T20:09:27.358591130Z" level=info msg="StopPodSandbox for \"fb565334446e5f8a46a1bd1f7f902b79f435864e841478f2f0a155d44cd33b41\" returns successfully" Jan 13 20:09:27.380380 containerd[1934]: time="2025-01-13T20:09:27.362855270Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-7fbffcd8cd-wszl7,Uid:ad79c041-eaf1-4d57-9fb4-c3fb08680cb8,Namespace:calico-apiserver,Attempt:3,}" Jan 13 20:09:27.380380 containerd[1934]: time="2025-01-13T20:09:27.364444142Z" level=info msg="StopPodSandbox for \"eed11d015ff645b963130f5ad956d107f391cbaba3451e015229fc4082c60951\"" Jan 13 20:09:27.380380 containerd[1934]: time="2025-01-13T20:09:27.365989370Z" level=info msg="TearDown network for sandbox \"eed11d015ff645b963130f5ad956d107f391cbaba3451e015229fc4082c60951\" successfully" Jan 13 20:09:27.380380 containerd[1934]: time="2025-01-13T20:09:27.366032726Z" level=info msg="StopPodSandbox for \"eed11d015ff645b963130f5ad956d107f391cbaba3451e015229fc4082c60951\" returns successfully" Jan 13 20:09:27.380380 containerd[1934]: time="2025-01-13T20:09:27.369607634Z" level=info msg="StopPodSandbox for \"f5e883fc61f95c31957335ed367bbb8d4c07a9c5470ee6e51fca5c2bde0bfb8c\"" Jan 13 20:09:27.380380 containerd[1934]: time="2025-01-13T20:09:27.370191386Z" level=info msg="TearDown network for sandbox \"f5e883fc61f95c31957335ed367bbb8d4c07a9c5470ee6e51fca5c2bde0bfb8c\" successfully" Jan 13 20:09:27.380380 containerd[1934]: time="2025-01-13T20:09:27.370223318Z" level=info msg="StopPodSandbox for \"f5e883fc61f95c31957335ed367bbb8d4c07a9c5470ee6e51fca5c2bde0bfb8c\" returns successfully" Jan 13 20:09:27.380380 containerd[1934]: time="2025-01-13T20:09:27.372374354Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-76f75df574-8wp6k,Uid:87115657-f395-40ec-89ea-3d7835119c3a,Namespace:kube-system,Attempt:3,}" Jan 13 20:09:27.366331 systemd[1]: run-netns-cni\x2d17720da7\x2dbef9\x2dd4cd\x2d4720\x2d80762b8915f2.mount: Deactivated successfully. Jan 13 20:09:27.383092 kubelet[3423]: I0113 20:09:27.382564 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e31eca7a421d12ab04696c6ee4fefbcfc3ab887e88d76deb901fc6a512e76618" Jan 13 20:09:27.386244 containerd[1934]: time="2025-01-13T20:09:27.385654778Z" level=info msg="StopPodSandbox for \"e31eca7a421d12ab04696c6ee4fefbcfc3ab887e88d76deb901fc6a512e76618\"" Jan 13 20:09:27.387506 containerd[1934]: time="2025-01-13T20:09:27.387191330Z" level=info msg="Ensure that sandbox e31eca7a421d12ab04696c6ee4fefbcfc3ab887e88d76deb901fc6a512e76618 in task-service has been cleanup successfully" Jan 13 20:09:27.390675 containerd[1934]: time="2025-01-13T20:09:27.390585110Z" level=info msg="TearDown network for sandbox \"e31eca7a421d12ab04696c6ee4fefbcfc3ab887e88d76deb901fc6a512e76618\" successfully" Jan 13 20:09:27.390675 containerd[1934]: time="2025-01-13T20:09:27.390662678Z" level=info msg="StopPodSandbox for \"e31eca7a421d12ab04696c6ee4fefbcfc3ab887e88d76deb901fc6a512e76618\" returns successfully" Jan 13 20:09:27.393246 containerd[1934]: time="2025-01-13T20:09:27.393189591Z" level=info msg="StopPodSandbox for \"2accd017db7708cc1fa5c6da328b2f1c3f1c063e1b4b76d232d0c4e3cdca6a6d\"" Jan 13 20:09:27.393602 containerd[1934]: time="2025-01-13T20:09:27.393550251Z" level=info msg="TearDown network for sandbox \"2accd017db7708cc1fa5c6da328b2f1c3f1c063e1b4b76d232d0c4e3cdca6a6d\" successfully" Jan 13 20:09:27.393751 containerd[1934]: time="2025-01-13T20:09:27.393722799Z" level=info msg="StopPodSandbox for \"2accd017db7708cc1fa5c6da328b2f1c3f1c063e1b4b76d232d0c4e3cdca6a6d\" returns successfully" Jan 13 20:09:27.397687 systemd[1]: run-netns-cni\x2de8fc6353\x2ddacd\x2d55cf\x2deca5\x2d8c9b6c007dc4.mount: Deactivated successfully. Jan 13 20:09:27.401547 containerd[1934]: time="2025-01-13T20:09:27.401480727Z" level=info msg="StopPodSandbox for \"c787f8945e5c1c02a132aebe2ce54537e8efb76054bd3d61620dd081ac229a87\"" Jan 13 20:09:27.401735 containerd[1934]: time="2025-01-13T20:09:27.401694651Z" level=info msg="TearDown network for sandbox \"c787f8945e5c1c02a132aebe2ce54537e8efb76054bd3d61620dd081ac229a87\" successfully" Jan 13 20:09:27.401925 containerd[1934]: time="2025-01-13T20:09:27.401730027Z" level=info msg="StopPodSandbox for \"c787f8945e5c1c02a132aebe2ce54537e8efb76054bd3d61620dd081ac229a87\" returns successfully" Jan 13 20:09:27.405216 containerd[1934]: time="2025-01-13T20:09:27.405158691Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-7fbffcd8cd-pxvdr,Uid:8f72f896-c0ba-4b07-9a22-acc5c8ca3697,Namespace:calico-apiserver,Attempt:3,}" Jan 13 20:09:27.407106 kubelet[3423]: I0113 20:09:27.407066 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aeb47e19302f9c839c5fa002c506a56722057a24b2c06c5082b07dd07a783384" Jan 13 20:09:27.410481 containerd[1934]: time="2025-01-13T20:09:27.410385699Z" level=info msg="StopPodSandbox for \"aeb47e19302f9c839c5fa002c506a56722057a24b2c06c5082b07dd07a783384\"" Jan 13 20:09:27.411002 containerd[1934]: time="2025-01-13T20:09:27.410949579Z" level=info msg="Ensure that sandbox aeb47e19302f9c839c5fa002c506a56722057a24b2c06c5082b07dd07a783384 in task-service has been cleanup successfully" Jan 13 20:09:27.413716 containerd[1934]: time="2025-01-13T20:09:27.411270675Z" level=info msg="TearDown network for sandbox \"aeb47e19302f9c839c5fa002c506a56722057a24b2c06c5082b07dd07a783384\" successfully" Jan 13 20:09:27.413716 containerd[1934]: time="2025-01-13T20:09:27.411299487Z" level=info msg="StopPodSandbox for \"aeb47e19302f9c839c5fa002c506a56722057a24b2c06c5082b07dd07a783384\" returns successfully" Jan 13 20:09:27.418976 containerd[1934]: time="2025-01-13T20:09:27.418880067Z" level=info msg="StopPodSandbox for \"af4b04b9175c96b5f57bdaa5d05b254cb086cf984792052f87e1249b6c2e75f9\"" Jan 13 20:09:27.419101 containerd[1934]: time="2025-01-13T20:09:27.419065551Z" level=info msg="TearDown network for sandbox \"af4b04b9175c96b5f57bdaa5d05b254cb086cf984792052f87e1249b6c2e75f9\" successfully" Jan 13 20:09:27.419101 containerd[1934]: time="2025-01-13T20:09:27.419089155Z" level=info msg="StopPodSandbox for \"af4b04b9175c96b5f57bdaa5d05b254cb086cf984792052f87e1249b6c2e75f9\" returns successfully" Jan 13 20:09:27.422804 containerd[1934]: time="2025-01-13T20:09:27.422550891Z" level=info msg="StopPodSandbox for \"ccf56aafff1edbddd69e830448606d1ed364723341b141ed6867e7ed4d6b5f89\"" Jan 13 20:09:27.422804 containerd[1934]: time="2025-01-13T20:09:27.422712135Z" level=info msg="TearDown network for sandbox \"ccf56aafff1edbddd69e830448606d1ed364723341b141ed6867e7ed4d6b5f89\" successfully" Jan 13 20:09:27.422804 containerd[1934]: time="2025-01-13T20:09:27.422735559Z" level=info msg="StopPodSandbox for \"ccf56aafff1edbddd69e830448606d1ed364723341b141ed6867e7ed4d6b5f89\" returns successfully" Jan 13 20:09:27.426225 containerd[1934]: time="2025-01-13T20:09:27.426057195Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:csi-node-driver-wq54r,Uid:d47fc662-eff9-4473-83da-b6f0b896d81f,Namespace:calico-system,Attempt:3,}" Jan 13 20:09:27.427524 kubelet[3423]: I0113 20:09:27.427470 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3999268688ddddddb7ec9df611d8146f50072274600306787cd56688f110d548" Jan 13 20:09:27.442659 containerd[1934]: time="2025-01-13T20:09:27.441690267Z" level=info msg="StopPodSandbox for \"3999268688ddddddb7ec9df611d8146f50072274600306787cd56688f110d548\"" Jan 13 20:09:27.442659 containerd[1934]: time="2025-01-13T20:09:27.442240383Z" level=info msg="Ensure that sandbox 3999268688ddddddb7ec9df611d8146f50072274600306787cd56688f110d548 in task-service has been cleanup successfully" Jan 13 20:09:27.442914 containerd[1934]: time="2025-01-13T20:09:27.442620087Z" level=info msg="TearDown network for sandbox \"3999268688ddddddb7ec9df611d8146f50072274600306787cd56688f110d548\" successfully" Jan 13 20:09:27.442914 containerd[1934]: time="2025-01-13T20:09:27.442694787Z" level=info msg="StopPodSandbox for \"3999268688ddddddb7ec9df611d8146f50072274600306787cd56688f110d548\" returns successfully" Jan 13 20:09:27.444272 containerd[1934]: time="2025-01-13T20:09:27.444198663Z" level=info msg="StopPodSandbox for \"a86b825795730ba2f9f58fb14a41879f6cdba9ae4550e62d02a587d4dd982d06\"" Jan 13 20:09:27.444520 containerd[1934]: time="2025-01-13T20:09:27.444480351Z" level=info msg="TearDown network for sandbox \"a86b825795730ba2f9f58fb14a41879f6cdba9ae4550e62d02a587d4dd982d06\" successfully" Jan 13 20:09:27.444934 containerd[1934]: time="2025-01-13T20:09:27.444520083Z" level=info msg="StopPodSandbox for \"a86b825795730ba2f9f58fb14a41879f6cdba9ae4550e62d02a587d4dd982d06\" returns successfully" Jan 13 20:09:27.447665 containerd[1934]: time="2025-01-13T20:09:27.447579111Z" level=info msg="StopPodSandbox for \"57f3ef7b6cf66ed3ed7b779c226fa67874c55496cae0804a70bff6ecec1ef212\"" Jan 13 20:09:27.447999 containerd[1934]: time="2025-01-13T20:09:27.447953763Z" level=info msg="TearDown network for sandbox \"57f3ef7b6cf66ed3ed7b779c226fa67874c55496cae0804a70bff6ecec1ef212\" successfully" Jan 13 20:09:27.447999 containerd[1934]: time="2025-01-13T20:09:27.447988767Z" level=info msg="StopPodSandbox for \"57f3ef7b6cf66ed3ed7b779c226fa67874c55496cae0804a70bff6ecec1ef212\" returns successfully" Jan 13 20:09:27.452040 containerd[1934]: time="2025-01-13T20:09:27.451974087Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-kube-controllers-68f76c7ddf-lh8nj,Uid:2be21c11-9c2d-4b9a-81a5-0e73daba31c1,Namespace:calico-system,Attempt:3,}" Jan 13 20:09:27.718426 containerd[1934]: time="2025-01-13T20:09:27.718355260Z" level=error msg="Failed to destroy network for sandbox \"ce26f7c56a292d1c5e76ccbca54d688912ff4e1c7e33ef8e71e3b8766f463517\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:27.721091 containerd[1934]: time="2025-01-13T20:09:27.721027324Z" level=error msg="encountered an error cleaning up failed sandbox \"ce26f7c56a292d1c5e76ccbca54d688912ff4e1c7e33ef8e71e3b8766f463517\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:27.723684 containerd[1934]: time="2025-01-13T20:09:27.723622912Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-76f75df574-mkr2l,Uid:396e30c8-d221-410a-89fe-e353ba8cddbf,Namespace:kube-system,Attempt:3,} failed, error" error="failed to setup network for sandbox \"ce26f7c56a292d1c5e76ccbca54d688912ff4e1c7e33ef8e71e3b8766f463517\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:27.724411 kubelet[3423]: E0113 20:09:27.724352 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"ce26f7c56a292d1c5e76ccbca54d688912ff4e1c7e33ef8e71e3b8766f463517\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:27.724555 kubelet[3423]: E0113 20:09:27.724476 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"ce26f7c56a292d1c5e76ccbca54d688912ff4e1c7e33ef8e71e3b8766f463517\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-76f75df574-mkr2l" Jan 13 20:09:27.724555 kubelet[3423]: E0113 20:09:27.724515 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"ce26f7c56a292d1c5e76ccbca54d688912ff4e1c7e33ef8e71e3b8766f463517\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-76f75df574-mkr2l" Jan 13 20:09:27.724657 kubelet[3423]: E0113 20:09:27.724597 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-76f75df574-mkr2l_kube-system(396e30c8-d221-410a-89fe-e353ba8cddbf)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-76f75df574-mkr2l_kube-system(396e30c8-d221-410a-89fe-e353ba8cddbf)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"ce26f7c56a292d1c5e76ccbca54d688912ff4e1c7e33ef8e71e3b8766f463517\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="kube-system/coredns-76f75df574-mkr2l" podUID="396e30c8-d221-410a-89fe-e353ba8cddbf" Jan 13 20:09:27.924604 containerd[1934]: time="2025-01-13T20:09:27.924317201Z" level=error msg="Failed to destroy network for sandbox \"a37a24fcb9897952ccabcc8cb7045bb7b0ef0fe4b98a8ca3b53ea6f6cf157017\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:27.927037 containerd[1934]: time="2025-01-13T20:09:27.926818673Z" level=error msg="encountered an error cleaning up failed sandbox \"a37a24fcb9897952ccabcc8cb7045bb7b0ef0fe4b98a8ca3b53ea6f6cf157017\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:27.927037 containerd[1934]: time="2025-01-13T20:09:27.926945921Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-7fbffcd8cd-pxvdr,Uid:8f72f896-c0ba-4b07-9a22-acc5c8ca3697,Namespace:calico-apiserver,Attempt:3,} failed, error" error="failed to setup network for sandbox \"a37a24fcb9897952ccabcc8cb7045bb7b0ef0fe4b98a8ca3b53ea6f6cf157017\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:27.927843 kubelet[3423]: E0113 20:09:27.927465 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a37a24fcb9897952ccabcc8cb7045bb7b0ef0fe4b98a8ca3b53ea6f6cf157017\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:27.927843 kubelet[3423]: E0113 20:09:27.927590 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a37a24fcb9897952ccabcc8cb7045bb7b0ef0fe4b98a8ca3b53ea6f6cf157017\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-pxvdr" Jan 13 20:09:27.927843 kubelet[3423]: E0113 20:09:27.927759 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a37a24fcb9897952ccabcc8cb7045bb7b0ef0fe4b98a8ca3b53ea6f6cf157017\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-pxvdr" Jan 13 20:09:27.928567 kubelet[3423]: E0113 20:09:27.928430 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"calico-apiserver-7fbffcd8cd-pxvdr_calico-apiserver(8f72f896-c0ba-4b07-9a22-acc5c8ca3697)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"calico-apiserver-7fbffcd8cd-pxvdr_calico-apiserver(8f72f896-c0ba-4b07-9a22-acc5c8ca3697)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"a37a24fcb9897952ccabcc8cb7045bb7b0ef0fe4b98a8ca3b53ea6f6cf157017\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-pxvdr" podUID="8f72f896-c0ba-4b07-9a22-acc5c8ca3697" Jan 13 20:09:27.946909 containerd[1934]: time="2025-01-13T20:09:27.946713881Z" level=error msg="Failed to destroy network for sandbox \"d179e7ae754d81c958ff901cb7c596dc225e5822f67938ade6bc971cc1e73234\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:27.948522 containerd[1934]: time="2025-01-13T20:09:27.948253637Z" level=error msg="encountered an error cleaning up failed sandbox \"d179e7ae754d81c958ff901cb7c596dc225e5822f67938ade6bc971cc1e73234\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:27.948522 containerd[1934]: time="2025-01-13T20:09:27.948369725Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-76f75df574-8wp6k,Uid:87115657-f395-40ec-89ea-3d7835119c3a,Namespace:kube-system,Attempt:3,} failed, error" error="failed to setup network for sandbox \"d179e7ae754d81c958ff901cb7c596dc225e5822f67938ade6bc971cc1e73234\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:27.948847 kubelet[3423]: E0113 20:09:27.948734 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"d179e7ae754d81c958ff901cb7c596dc225e5822f67938ade6bc971cc1e73234\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:27.949078 kubelet[3423]: E0113 20:09:27.948852 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"d179e7ae754d81c958ff901cb7c596dc225e5822f67938ade6bc971cc1e73234\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-76f75df574-8wp6k" Jan 13 20:09:27.949078 kubelet[3423]: E0113 20:09:27.948911 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"d179e7ae754d81c958ff901cb7c596dc225e5822f67938ade6bc971cc1e73234\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-76f75df574-8wp6k" Jan 13 20:09:27.949078 kubelet[3423]: E0113 20:09:27.949005 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-76f75df574-8wp6k_kube-system(87115657-f395-40ec-89ea-3d7835119c3a)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-76f75df574-8wp6k_kube-system(87115657-f395-40ec-89ea-3d7835119c3a)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"d179e7ae754d81c958ff901cb7c596dc225e5822f67938ade6bc971cc1e73234\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="kube-system/coredns-76f75df574-8wp6k" podUID="87115657-f395-40ec-89ea-3d7835119c3a" Jan 13 20:09:27.957415 containerd[1934]: time="2025-01-13T20:09:27.956923541Z" level=error msg="Failed to destroy network for sandbox \"f25c71afbdf54c9739bfb9dedd7783f76e2a8415e053a98227128ef3211d4a56\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:27.958135 containerd[1934]: time="2025-01-13T20:09:27.958077929Z" level=error msg="encountered an error cleaning up failed sandbox \"f25c71afbdf54c9739bfb9dedd7783f76e2a8415e053a98227128ef3211d4a56\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:27.958238 containerd[1934]: time="2025-01-13T20:09:27.958188149Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-7fbffcd8cd-wszl7,Uid:ad79c041-eaf1-4d57-9fb4-c3fb08680cb8,Namespace:calico-apiserver,Attempt:3,} failed, error" error="failed to setup network for sandbox \"f25c71afbdf54c9739bfb9dedd7783f76e2a8415e053a98227128ef3211d4a56\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:27.958710 kubelet[3423]: E0113 20:09:27.958608 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"f25c71afbdf54c9739bfb9dedd7783f76e2a8415e053a98227128ef3211d4a56\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:27.958710 kubelet[3423]: E0113 20:09:27.958686 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"f25c71afbdf54c9739bfb9dedd7783f76e2a8415e053a98227128ef3211d4a56\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-wszl7" Jan 13 20:09:27.959067 kubelet[3423]: E0113 20:09:27.958723 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"f25c71afbdf54c9739bfb9dedd7783f76e2a8415e053a98227128ef3211d4a56\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-wszl7" Jan 13 20:09:27.959067 kubelet[3423]: E0113 20:09:27.958829 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"calico-apiserver-7fbffcd8cd-wszl7_calico-apiserver(ad79c041-eaf1-4d57-9fb4-c3fb08680cb8)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"calico-apiserver-7fbffcd8cd-wszl7_calico-apiserver(ad79c041-eaf1-4d57-9fb4-c3fb08680cb8)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"f25c71afbdf54c9739bfb9dedd7783f76e2a8415e053a98227128ef3211d4a56\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-wszl7" podUID="ad79c041-eaf1-4d57-9fb4-c3fb08680cb8" Jan 13 20:09:27.981049 containerd[1934]: time="2025-01-13T20:09:27.980559953Z" level=error msg="Failed to destroy network for sandbox \"955f9fe6553205f6e71b94a6922fdece40d5d1a8c6a343e9a0aa0f4bf2abbb69\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:27.984033 containerd[1934]: time="2025-01-13T20:09:27.982485377Z" level=error msg="encountered an error cleaning up failed sandbox \"955f9fe6553205f6e71b94a6922fdece40d5d1a8c6a343e9a0aa0f4bf2abbb69\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:27.984033 containerd[1934]: time="2025-01-13T20:09:27.982595873Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:csi-node-driver-wq54r,Uid:d47fc662-eff9-4473-83da-b6f0b896d81f,Namespace:calico-system,Attempt:3,} failed, error" error="failed to setup network for sandbox \"955f9fe6553205f6e71b94a6922fdece40d5d1a8c6a343e9a0aa0f4bf2abbb69\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:27.984251 kubelet[3423]: E0113 20:09:27.983886 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"955f9fe6553205f6e71b94a6922fdece40d5d1a8c6a343e9a0aa0f4bf2abbb69\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:27.984251 kubelet[3423]: E0113 20:09:27.983986 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"955f9fe6553205f6e71b94a6922fdece40d5d1a8c6a343e9a0aa0f4bf2abbb69\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/csi-node-driver-wq54r" Jan 13 20:09:27.984911 kubelet[3423]: E0113 20:09:27.984341 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"955f9fe6553205f6e71b94a6922fdece40d5d1a8c6a343e9a0aa0f4bf2abbb69\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/csi-node-driver-wq54r" Jan 13 20:09:27.984911 kubelet[3423]: E0113 20:09:27.984460 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"csi-node-driver-wq54r_calico-system(d47fc662-eff9-4473-83da-b6f0b896d81f)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"csi-node-driver-wq54r_calico-system(d47fc662-eff9-4473-83da-b6f0b896d81f)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"955f9fe6553205f6e71b94a6922fdece40d5d1a8c6a343e9a0aa0f4bf2abbb69\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-system/csi-node-driver-wq54r" podUID="d47fc662-eff9-4473-83da-b6f0b896d81f" Jan 13 20:09:27.997925 containerd[1934]: time="2025-01-13T20:09:27.997105590Z" level=error msg="Failed to destroy network for sandbox \"bb64b66507a4d3948827c99dee10022276bd2b85dcce58713749456b89a5723b\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:27.997925 containerd[1934]: time="2025-01-13T20:09:27.997603866Z" level=error msg="encountered an error cleaning up failed sandbox \"bb64b66507a4d3948827c99dee10022276bd2b85dcce58713749456b89a5723b\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:27.997925 containerd[1934]: time="2025-01-13T20:09:27.997681854Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-kube-controllers-68f76c7ddf-lh8nj,Uid:2be21c11-9c2d-4b9a-81a5-0e73daba31c1,Namespace:calico-system,Attempt:3,} failed, error" error="failed to setup network for sandbox \"bb64b66507a4d3948827c99dee10022276bd2b85dcce58713749456b89a5723b\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:27.998361 kubelet[3423]: E0113 20:09:27.998031 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"bb64b66507a4d3948827c99dee10022276bd2b85dcce58713749456b89a5723b\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:27.998361 kubelet[3423]: E0113 20:09:27.998118 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"bb64b66507a4d3948827c99dee10022276bd2b85dcce58713749456b89a5723b\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/calico-kube-controllers-68f76c7ddf-lh8nj" Jan 13 20:09:27.998361 kubelet[3423]: E0113 20:09:27.998156 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"bb64b66507a4d3948827c99dee10022276bd2b85dcce58713749456b89a5723b\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/calico-kube-controllers-68f76c7ddf-lh8nj" Jan 13 20:09:27.998976 kubelet[3423]: E0113 20:09:27.998242 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"calico-kube-controllers-68f76c7ddf-lh8nj_calico-system(2be21c11-9c2d-4b9a-81a5-0e73daba31c1)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"calico-kube-controllers-68f76c7ddf-lh8nj_calico-system(2be21c11-9c2d-4b9a-81a5-0e73daba31c1)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"bb64b66507a4d3948827c99dee10022276bd2b85dcce58713749456b89a5723b\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-system/calico-kube-controllers-68f76c7ddf-lh8nj" podUID="2be21c11-9c2d-4b9a-81a5-0e73daba31c1" Jan 13 20:09:28.016006 systemd[1]: run-netns-cni\x2d409f1d17\x2d16d7\x2df672\x2d7bf1\x2d705788e27f00.mount: Deactivated successfully. Jan 13 20:09:28.016172 systemd[1]: run-netns-cni\x2d1ae16f65\x2d717e\x2d751a\x2d22c8\x2d6a79d989e0a9.mount: Deactivated successfully. Jan 13 20:09:28.433905 kubelet[3423]: I0113 20:09:28.433852 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a37a24fcb9897952ccabcc8cb7045bb7b0ef0fe4b98a8ca3b53ea6f6cf157017" Jan 13 20:09:28.436205 containerd[1934]: time="2025-01-13T20:09:28.434976388Z" level=info msg="StopPodSandbox for \"a37a24fcb9897952ccabcc8cb7045bb7b0ef0fe4b98a8ca3b53ea6f6cf157017\"" Jan 13 20:09:28.436205 containerd[1934]: time="2025-01-13T20:09:28.435305728Z" level=info msg="Ensure that sandbox a37a24fcb9897952ccabcc8cb7045bb7b0ef0fe4b98a8ca3b53ea6f6cf157017 in task-service has been cleanup successfully" Jan 13 20:09:28.442563 containerd[1934]: time="2025-01-13T20:09:28.441313300Z" level=info msg="TearDown network for sandbox \"a37a24fcb9897952ccabcc8cb7045bb7b0ef0fe4b98a8ca3b53ea6f6cf157017\" successfully" Jan 13 20:09:28.442563 containerd[1934]: time="2025-01-13T20:09:28.441365440Z" level=info msg="StopPodSandbox for \"a37a24fcb9897952ccabcc8cb7045bb7b0ef0fe4b98a8ca3b53ea6f6cf157017\" returns successfully" Jan 13 20:09:28.442563 containerd[1934]: time="2025-01-13T20:09:28.442517140Z" level=info msg="StopPodSandbox for \"e31eca7a421d12ab04696c6ee4fefbcfc3ab887e88d76deb901fc6a512e76618\"" Jan 13 20:09:28.442850 containerd[1934]: time="2025-01-13T20:09:28.442728460Z" level=info msg="TearDown network for sandbox \"e31eca7a421d12ab04696c6ee4fefbcfc3ab887e88d76deb901fc6a512e76618\" successfully" Jan 13 20:09:28.442850 containerd[1934]: time="2025-01-13T20:09:28.442753720Z" level=info msg="StopPodSandbox for \"e31eca7a421d12ab04696c6ee4fefbcfc3ab887e88d76deb901fc6a512e76618\" returns successfully" Jan 13 20:09:28.446980 containerd[1934]: time="2025-01-13T20:09:28.446869852Z" level=info msg="StopPodSandbox for \"2accd017db7708cc1fa5c6da328b2f1c3f1c063e1b4b76d232d0c4e3cdca6a6d\"" Jan 13 20:09:28.447226 containerd[1934]: time="2025-01-13T20:09:28.447043156Z" level=info msg="TearDown network for sandbox \"2accd017db7708cc1fa5c6da328b2f1c3f1c063e1b4b76d232d0c4e3cdca6a6d\" successfully" Jan 13 20:09:28.447226 containerd[1934]: time="2025-01-13T20:09:28.447068212Z" level=info msg="StopPodSandbox for \"2accd017db7708cc1fa5c6da328b2f1c3f1c063e1b4b76d232d0c4e3cdca6a6d\" returns successfully" Jan 13 20:09:28.447480 systemd[1]: run-netns-cni\x2d0d989100\x2d4a42\x2dcd29\x2dc09a\x2d0cc95b3c4fd6.mount: Deactivated successfully. Jan 13 20:09:28.450696 containerd[1934]: time="2025-01-13T20:09:28.450498088Z" level=info msg="StopPodSandbox for \"c787f8945e5c1c02a132aebe2ce54537e8efb76054bd3d61620dd081ac229a87\"" Jan 13 20:09:28.450696 containerd[1934]: time="2025-01-13T20:09:28.450676048Z" level=info msg="TearDown network for sandbox \"c787f8945e5c1c02a132aebe2ce54537e8efb76054bd3d61620dd081ac229a87\" successfully" Jan 13 20:09:28.450873 containerd[1934]: time="2025-01-13T20:09:28.450699832Z" level=info msg="StopPodSandbox for \"c787f8945e5c1c02a132aebe2ce54537e8efb76054bd3d61620dd081ac229a87\" returns successfully" Jan 13 20:09:28.452453 containerd[1934]: time="2025-01-13T20:09:28.452244928Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-7fbffcd8cd-pxvdr,Uid:8f72f896-c0ba-4b07-9a22-acc5c8ca3697,Namespace:calico-apiserver,Attempt:4,}" Jan 13 20:09:28.455678 kubelet[3423]: I0113 20:09:28.455493 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="955f9fe6553205f6e71b94a6922fdece40d5d1a8c6a343e9a0aa0f4bf2abbb69" Jan 13 20:09:28.459446 containerd[1934]: time="2025-01-13T20:09:28.459243904Z" level=info msg="StopPodSandbox for \"955f9fe6553205f6e71b94a6922fdece40d5d1a8c6a343e9a0aa0f4bf2abbb69\"" Jan 13 20:09:28.461594 containerd[1934]: time="2025-01-13T20:09:28.461376676Z" level=info msg="Ensure that sandbox 955f9fe6553205f6e71b94a6922fdece40d5d1a8c6a343e9a0aa0f4bf2abbb69 in task-service has been cleanup successfully" Jan 13 20:09:28.463802 containerd[1934]: time="2025-01-13T20:09:28.463002340Z" level=info msg="TearDown network for sandbox \"955f9fe6553205f6e71b94a6922fdece40d5d1a8c6a343e9a0aa0f4bf2abbb69\" successfully" Jan 13 20:09:28.463802 containerd[1934]: time="2025-01-13T20:09:28.463047424Z" level=info msg="StopPodSandbox for \"955f9fe6553205f6e71b94a6922fdece40d5d1a8c6a343e9a0aa0f4bf2abbb69\" returns successfully" Jan 13 20:09:28.467090 containerd[1934]: time="2025-01-13T20:09:28.466500316Z" level=info msg="StopPodSandbox for \"aeb47e19302f9c839c5fa002c506a56722057a24b2c06c5082b07dd07a783384\"" Jan 13 20:09:28.467090 containerd[1934]: time="2025-01-13T20:09:28.466680868Z" level=info msg="TearDown network for sandbox \"aeb47e19302f9c839c5fa002c506a56722057a24b2c06c5082b07dd07a783384\" successfully" Jan 13 20:09:28.467090 containerd[1934]: time="2025-01-13T20:09:28.466704040Z" level=info msg="StopPodSandbox for \"aeb47e19302f9c839c5fa002c506a56722057a24b2c06c5082b07dd07a783384\" returns successfully" Jan 13 20:09:28.473317 containerd[1934]: time="2025-01-13T20:09:28.470234260Z" level=info msg="StopPodSandbox for \"af4b04b9175c96b5f57bdaa5d05b254cb086cf984792052f87e1249b6c2e75f9\"" Jan 13 20:09:28.473317 containerd[1934]: time="2025-01-13T20:09:28.470408344Z" level=info msg="TearDown network for sandbox \"af4b04b9175c96b5f57bdaa5d05b254cb086cf984792052f87e1249b6c2e75f9\" successfully" Jan 13 20:09:28.473317 containerd[1934]: time="2025-01-13T20:09:28.470431204Z" level=info msg="StopPodSandbox for \"af4b04b9175c96b5f57bdaa5d05b254cb086cf984792052f87e1249b6c2e75f9\" returns successfully" Jan 13 20:09:28.470907 systemd[1]: run-netns-cni\x2d0425aa3b\x2d8737\x2d113f\x2da76b\x2d95cef92849cf.mount: Deactivated successfully. Jan 13 20:09:28.473627 containerd[1934]: time="2025-01-13T20:09:28.473403544Z" level=info msg="StopPodSandbox for \"ccf56aafff1edbddd69e830448606d1ed364723341b141ed6867e7ed4d6b5f89\"" Jan 13 20:09:28.473627 containerd[1934]: time="2025-01-13T20:09:28.473555896Z" level=info msg="TearDown network for sandbox \"ccf56aafff1edbddd69e830448606d1ed364723341b141ed6867e7ed4d6b5f89\" successfully" Jan 13 20:09:28.473627 containerd[1934]: time="2025-01-13T20:09:28.473580220Z" level=info msg="StopPodSandbox for \"ccf56aafff1edbddd69e830448606d1ed364723341b141ed6867e7ed4d6b5f89\" returns successfully" Jan 13 20:09:28.474976 kubelet[3423]: I0113 20:09:28.474925 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bb64b66507a4d3948827c99dee10022276bd2b85dcce58713749456b89a5723b" Jan 13 20:09:28.476608 containerd[1934]: time="2025-01-13T20:09:28.476560360Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:csi-node-driver-wq54r,Uid:d47fc662-eff9-4473-83da-b6f0b896d81f,Namespace:calico-system,Attempt:4,}" Jan 13 20:09:28.478671 containerd[1934]: time="2025-01-13T20:09:28.478372720Z" level=info msg="StopPodSandbox for \"bb64b66507a4d3948827c99dee10022276bd2b85dcce58713749456b89a5723b\"" Jan 13 20:09:28.480004 containerd[1934]: time="2025-01-13T20:09:28.479735572Z" level=info msg="Ensure that sandbox bb64b66507a4d3948827c99dee10022276bd2b85dcce58713749456b89a5723b in task-service has been cleanup successfully" Jan 13 20:09:28.490305 systemd[1]: run-netns-cni\x2d4f9720c6\x2d9c3d\x2ddce9\x2ddbe5\x2dd3670c750e62.mount: Deactivated successfully. Jan 13 20:09:28.495265 kubelet[3423]: I0113 20:09:28.495228 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ce26f7c56a292d1c5e76ccbca54d688912ff4e1c7e33ef8e71e3b8766f463517" Jan 13 20:09:28.504911 containerd[1934]: time="2025-01-13T20:09:28.504857236Z" level=info msg="StopPodSandbox for \"ce26f7c56a292d1c5e76ccbca54d688912ff4e1c7e33ef8e71e3b8766f463517\"" Jan 13 20:09:28.506503 containerd[1934]: time="2025-01-13T20:09:28.506390872Z" level=info msg="TearDown network for sandbox \"bb64b66507a4d3948827c99dee10022276bd2b85dcce58713749456b89a5723b\" successfully" Jan 13 20:09:28.506503 containerd[1934]: time="2025-01-13T20:09:28.506437780Z" level=info msg="StopPodSandbox for \"bb64b66507a4d3948827c99dee10022276bd2b85dcce58713749456b89a5723b\" returns successfully" Jan 13 20:09:28.509155 containerd[1934]: time="2025-01-13T20:09:28.508923832Z" level=info msg="Ensure that sandbox ce26f7c56a292d1c5e76ccbca54d688912ff4e1c7e33ef8e71e3b8766f463517 in task-service has been cleanup successfully" Jan 13 20:09:28.512499 containerd[1934]: time="2025-01-13T20:09:28.511937956Z" level=info msg="TearDown network for sandbox \"ce26f7c56a292d1c5e76ccbca54d688912ff4e1c7e33ef8e71e3b8766f463517\" successfully" Jan 13 20:09:28.512499 containerd[1934]: time="2025-01-13T20:09:28.511989352Z" level=info msg="StopPodSandbox for \"ce26f7c56a292d1c5e76ccbca54d688912ff4e1c7e33ef8e71e3b8766f463517\" returns successfully" Jan 13 20:09:28.513528 containerd[1934]: time="2025-01-13T20:09:28.513483244Z" level=info msg="StopPodSandbox for \"bac2fe516cc564552b8be0fbca65a9d04eaace09e824ed2a17d9c03e83edae58\"" Jan 13 20:09:28.514592 containerd[1934]: time="2025-01-13T20:09:28.514351984Z" level=info msg="TearDown network for sandbox \"bac2fe516cc564552b8be0fbca65a9d04eaace09e824ed2a17d9c03e83edae58\" successfully" Jan 13 20:09:28.514592 containerd[1934]: time="2025-01-13T20:09:28.514515268Z" level=info msg="StopPodSandbox for \"bac2fe516cc564552b8be0fbca65a9d04eaace09e824ed2a17d9c03e83edae58\" returns successfully" Jan 13 20:09:28.516748 containerd[1934]: time="2025-01-13T20:09:28.516582820Z" level=info msg="StopPodSandbox for \"3999268688ddddddb7ec9df611d8146f50072274600306787cd56688f110d548\"" Jan 13 20:09:28.518588 containerd[1934]: time="2025-01-13T20:09:28.518091136Z" level=info msg="TearDown network for sandbox \"3999268688ddddddb7ec9df611d8146f50072274600306787cd56688f110d548\" successfully" Jan 13 20:09:28.518588 containerd[1934]: time="2025-01-13T20:09:28.518139316Z" level=info msg="StopPodSandbox for \"3999268688ddddddb7ec9df611d8146f50072274600306787cd56688f110d548\" returns successfully" Jan 13 20:09:28.521023 containerd[1934]: time="2025-01-13T20:09:28.520820296Z" level=info msg="StopPodSandbox for \"a86b825795730ba2f9f58fb14a41879f6cdba9ae4550e62d02a587d4dd982d06\"" Jan 13 20:09:28.521023 containerd[1934]: time="2025-01-13T20:09:28.520987840Z" level=info msg="TearDown network for sandbox \"a86b825795730ba2f9f58fb14a41879f6cdba9ae4550e62d02a587d4dd982d06\" successfully" Jan 13 20:09:28.521023 containerd[1934]: time="2025-01-13T20:09:28.521010856Z" level=info msg="StopPodSandbox for \"a86b825795730ba2f9f58fb14a41879f6cdba9ae4550e62d02a587d4dd982d06\" returns successfully" Jan 13 20:09:28.521272 containerd[1934]: time="2025-01-13T20:09:28.520820524Z" level=info msg="StopPodSandbox for \"7d3190834f7286fc68261319021ff89fa2267e8e4a2bc44b60cdc8ec3736f03b\"" Jan 13 20:09:28.521272 containerd[1934]: time="2025-01-13T20:09:28.521179120Z" level=info msg="TearDown network for sandbox \"7d3190834f7286fc68261319021ff89fa2267e8e4a2bc44b60cdc8ec3736f03b\" successfully" Jan 13 20:09:28.521272 containerd[1934]: time="2025-01-13T20:09:28.521199364Z" level=info msg="StopPodSandbox for \"7d3190834f7286fc68261319021ff89fa2267e8e4a2bc44b60cdc8ec3736f03b\" returns successfully" Jan 13 20:09:28.522826 containerd[1934]: time="2025-01-13T20:09:28.522472900Z" level=info msg="StopPodSandbox for \"899dac68c4a2c7ede7e6073b33ab156f86e32973795b4e68f426b199aa5486a9\"" Jan 13 20:09:28.522826 containerd[1934]: time="2025-01-13T20:09:28.522633724Z" level=info msg="TearDown network for sandbox \"899dac68c4a2c7ede7e6073b33ab156f86e32973795b4e68f426b199aa5486a9\" successfully" Jan 13 20:09:28.522826 containerd[1934]: time="2025-01-13T20:09:28.522654988Z" level=info msg="StopPodSandbox for \"899dac68c4a2c7ede7e6073b33ab156f86e32973795b4e68f426b199aa5486a9\" returns successfully" Jan 13 20:09:28.523396 containerd[1934]: time="2025-01-13T20:09:28.523320772Z" level=info msg="StopPodSandbox for \"57f3ef7b6cf66ed3ed7b779c226fa67874c55496cae0804a70bff6ecec1ef212\"" Jan 13 20:09:28.523860 containerd[1934]: time="2025-01-13T20:09:28.523825696Z" level=info msg="TearDown network for sandbox \"57f3ef7b6cf66ed3ed7b779c226fa67874c55496cae0804a70bff6ecec1ef212\" successfully" Jan 13 20:09:28.524046 containerd[1934]: time="2025-01-13T20:09:28.524015524Z" level=info msg="StopPodSandbox for \"57f3ef7b6cf66ed3ed7b779c226fa67874c55496cae0804a70bff6ecec1ef212\" returns successfully" Jan 13 20:09:28.526569 containerd[1934]: time="2025-01-13T20:09:28.526424320Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-kube-controllers-68f76c7ddf-lh8nj,Uid:2be21c11-9c2d-4b9a-81a5-0e73daba31c1,Namespace:calico-system,Attempt:4,}" Jan 13 20:09:28.526967 containerd[1934]: time="2025-01-13T20:09:28.526876804Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-76f75df574-mkr2l,Uid:396e30c8-d221-410a-89fe-e353ba8cddbf,Namespace:kube-system,Attempt:4,}" Jan 13 20:09:28.529185 kubelet[3423]: I0113 20:09:28.528951 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f25c71afbdf54c9739bfb9dedd7783f76e2a8415e053a98227128ef3211d4a56" Jan 13 20:09:28.537052 containerd[1934]: time="2025-01-13T20:09:28.536906284Z" level=info msg="StopPodSandbox for \"f25c71afbdf54c9739bfb9dedd7783f76e2a8415e053a98227128ef3211d4a56\"" Jan 13 20:09:28.538140 containerd[1934]: time="2025-01-13T20:09:28.537946588Z" level=info msg="Ensure that sandbox f25c71afbdf54c9739bfb9dedd7783f76e2a8415e053a98227128ef3211d4a56 in task-service has been cleanup successfully" Jan 13 20:09:28.542926 containerd[1934]: time="2025-01-13T20:09:28.542672380Z" level=info msg="TearDown network for sandbox \"f25c71afbdf54c9739bfb9dedd7783f76e2a8415e053a98227128ef3211d4a56\" successfully" Jan 13 20:09:28.542926 containerd[1934]: time="2025-01-13T20:09:28.542721028Z" level=info msg="StopPodSandbox for \"f25c71afbdf54c9739bfb9dedd7783f76e2a8415e053a98227128ef3211d4a56\" returns successfully" Jan 13 20:09:28.546673 containerd[1934]: time="2025-01-13T20:09:28.546389176Z" level=info msg="StopPodSandbox for \"d029da1857cffbc9aea56a8ec883ba4e1da56eae06a46e2e4ba0629832693cb0\"" Jan 13 20:09:28.546673 containerd[1934]: time="2025-01-13T20:09:28.546548908Z" level=info msg="TearDown network for sandbox \"d029da1857cffbc9aea56a8ec883ba4e1da56eae06a46e2e4ba0629832693cb0\" successfully" Jan 13 20:09:28.546673 containerd[1934]: time="2025-01-13T20:09:28.546571852Z" level=info msg="StopPodSandbox for \"d029da1857cffbc9aea56a8ec883ba4e1da56eae06a46e2e4ba0629832693cb0\" returns successfully" Jan 13 20:09:28.552378 containerd[1934]: time="2025-01-13T20:09:28.552238300Z" level=info msg="StopPodSandbox for \"cfa6ddb68ab8a55e2b4406871b279f8198e9a43957ec335f7facbf57b86881a3\"" Jan 13 20:09:28.553543 containerd[1934]: time="2025-01-13T20:09:28.553411084Z" level=info msg="TearDown network for sandbox \"cfa6ddb68ab8a55e2b4406871b279f8198e9a43957ec335f7facbf57b86881a3\" successfully" Jan 13 20:09:28.553543 containerd[1934]: time="2025-01-13T20:09:28.553478644Z" level=info msg="StopPodSandbox for \"cfa6ddb68ab8a55e2b4406871b279f8198e9a43957ec335f7facbf57b86881a3\" returns successfully" Jan 13 20:09:28.557711 containerd[1934]: time="2025-01-13T20:09:28.557507344Z" level=info msg="StopPodSandbox for \"fb565334446e5f8a46a1bd1f7f902b79f435864e841478f2f0a155d44cd33b41\"" Jan 13 20:09:28.558982 containerd[1934]: time="2025-01-13T20:09:28.558923260Z" level=info msg="TearDown network for sandbox \"fb565334446e5f8a46a1bd1f7f902b79f435864e841478f2f0a155d44cd33b41\" successfully" Jan 13 20:09:28.559525 containerd[1934]: time="2025-01-13T20:09:28.559455184Z" level=info msg="StopPodSandbox for \"fb565334446e5f8a46a1bd1f7f902b79f435864e841478f2f0a155d44cd33b41\" returns successfully" Jan 13 20:09:28.562864 kubelet[3423]: I0113 20:09:28.561817 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d179e7ae754d81c958ff901cb7c596dc225e5822f67938ade6bc971cc1e73234" Jan 13 20:09:28.563626 containerd[1934]: time="2025-01-13T20:09:28.563574676Z" level=info msg="StopPodSandbox for \"d179e7ae754d81c958ff901cb7c596dc225e5822f67938ade6bc971cc1e73234\"" Jan 13 20:09:28.564480 containerd[1934]: time="2025-01-13T20:09:28.564419272Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-7fbffcd8cd-wszl7,Uid:ad79c041-eaf1-4d57-9fb4-c3fb08680cb8,Namespace:calico-apiserver,Attempt:4,}" Jan 13 20:09:28.564976 containerd[1934]: time="2025-01-13T20:09:28.564921628Z" level=info msg="Ensure that sandbox d179e7ae754d81c958ff901cb7c596dc225e5822f67938ade6bc971cc1e73234 in task-service has been cleanup successfully" Jan 13 20:09:28.565911 containerd[1934]: time="2025-01-13T20:09:28.565860652Z" level=info msg="TearDown network for sandbox \"d179e7ae754d81c958ff901cb7c596dc225e5822f67938ade6bc971cc1e73234\" successfully" Jan 13 20:09:28.566070 containerd[1934]: time="2025-01-13T20:09:28.566041816Z" level=info msg="StopPodSandbox for \"d179e7ae754d81c958ff901cb7c596dc225e5822f67938ade6bc971cc1e73234\" returns successfully" Jan 13 20:09:28.567232 containerd[1934]: time="2025-01-13T20:09:28.566869480Z" level=info msg="StopPodSandbox for \"8c0c460fc82d1c51ed146afb77bb0cdfb42636cd5b1ebd0d7d108e8d75eb9610\"" Jan 13 20:09:28.567232 containerd[1934]: time="2025-01-13T20:09:28.567041716Z" level=info msg="TearDown network for sandbox \"8c0c460fc82d1c51ed146afb77bb0cdfb42636cd5b1ebd0d7d108e8d75eb9610\" successfully" Jan 13 20:09:28.567232 containerd[1934]: time="2025-01-13T20:09:28.567064168Z" level=info msg="StopPodSandbox for \"8c0c460fc82d1c51ed146afb77bb0cdfb42636cd5b1ebd0d7d108e8d75eb9610\" returns successfully" Jan 13 20:09:28.568631 containerd[1934]: time="2025-01-13T20:09:28.568568776Z" level=info msg="StopPodSandbox for \"eed11d015ff645b963130f5ad956d107f391cbaba3451e015229fc4082c60951\"" Jan 13 20:09:28.570108 containerd[1934]: time="2025-01-13T20:09:28.570036508Z" level=info msg="TearDown network for sandbox \"eed11d015ff645b963130f5ad956d107f391cbaba3451e015229fc4082c60951\" successfully" Jan 13 20:09:28.570336 containerd[1934]: time="2025-01-13T20:09:28.570262612Z" level=info msg="StopPodSandbox for \"eed11d015ff645b963130f5ad956d107f391cbaba3451e015229fc4082c60951\" returns successfully" Jan 13 20:09:28.572660 containerd[1934]: time="2025-01-13T20:09:28.571742296Z" level=info msg="StopPodSandbox for \"f5e883fc61f95c31957335ed367bbb8d4c07a9c5470ee6e51fca5c2bde0bfb8c\"" Jan 13 20:09:28.572660 containerd[1934]: time="2025-01-13T20:09:28.571931080Z" level=info msg="TearDown network for sandbox \"f5e883fc61f95c31957335ed367bbb8d4c07a9c5470ee6e51fca5c2bde0bfb8c\" successfully" Jan 13 20:09:28.572660 containerd[1934]: time="2025-01-13T20:09:28.571954132Z" level=info msg="StopPodSandbox for \"f5e883fc61f95c31957335ed367bbb8d4c07a9c5470ee6e51fca5c2bde0bfb8c\" returns successfully" Jan 13 20:09:28.573682 containerd[1934]: time="2025-01-13T20:09:28.573606556Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-76f75df574-8wp6k,Uid:87115657-f395-40ec-89ea-3d7835119c3a,Namespace:kube-system,Attempt:4,}" Jan 13 20:09:28.866200 containerd[1934]: time="2025-01-13T20:09:28.866020338Z" level=error msg="Failed to destroy network for sandbox \"a7aac01fa45d89b04a7cb486ede3be4574f65135e039463be287ff48831441a8\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:28.877766 containerd[1934]: time="2025-01-13T20:09:28.877587186Z" level=error msg="encountered an error cleaning up failed sandbox \"a7aac01fa45d89b04a7cb486ede3be4574f65135e039463be287ff48831441a8\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:28.877766 containerd[1934]: time="2025-01-13T20:09:28.877710474Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-7fbffcd8cd-pxvdr,Uid:8f72f896-c0ba-4b07-9a22-acc5c8ca3697,Namespace:calico-apiserver,Attempt:4,} failed, error" error="failed to setup network for sandbox \"a7aac01fa45d89b04a7cb486ede3be4574f65135e039463be287ff48831441a8\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:28.880520 kubelet[3423]: E0113 20:09:28.879987 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a7aac01fa45d89b04a7cb486ede3be4574f65135e039463be287ff48831441a8\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:28.880520 kubelet[3423]: E0113 20:09:28.880068 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a7aac01fa45d89b04a7cb486ede3be4574f65135e039463be287ff48831441a8\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-pxvdr" Jan 13 20:09:28.880520 kubelet[3423]: E0113 20:09:28.880107 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a7aac01fa45d89b04a7cb486ede3be4574f65135e039463be287ff48831441a8\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-pxvdr" Jan 13 20:09:28.880837 kubelet[3423]: E0113 20:09:28.880190 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"calico-apiserver-7fbffcd8cd-pxvdr_calico-apiserver(8f72f896-c0ba-4b07-9a22-acc5c8ca3697)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"calico-apiserver-7fbffcd8cd-pxvdr_calico-apiserver(8f72f896-c0ba-4b07-9a22-acc5c8ca3697)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"a7aac01fa45d89b04a7cb486ede3be4574f65135e039463be287ff48831441a8\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-pxvdr" podUID="8f72f896-c0ba-4b07-9a22-acc5c8ca3697" Jan 13 20:09:28.942708 containerd[1934]: time="2025-01-13T20:09:28.942401814Z" level=error msg="Failed to destroy network for sandbox \"a04750e9fc31e16c9110301f495a11a345e09ad202ac48d631cc7f81772e7ec2\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:28.944300 containerd[1934]: time="2025-01-13T20:09:28.944226906Z" level=error msg="encountered an error cleaning up failed sandbox \"a04750e9fc31e16c9110301f495a11a345e09ad202ac48d631cc7f81772e7ec2\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:28.944457 containerd[1934]: time="2025-01-13T20:09:28.944340690Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:csi-node-driver-wq54r,Uid:d47fc662-eff9-4473-83da-b6f0b896d81f,Namespace:calico-system,Attempt:4,} failed, error" error="failed to setup network for sandbox \"a04750e9fc31e16c9110301f495a11a345e09ad202ac48d631cc7f81772e7ec2\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:28.945420 kubelet[3423]: E0113 20:09:28.944700 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a04750e9fc31e16c9110301f495a11a345e09ad202ac48d631cc7f81772e7ec2\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:28.945420 kubelet[3423]: E0113 20:09:28.945165 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a04750e9fc31e16c9110301f495a11a345e09ad202ac48d631cc7f81772e7ec2\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/csi-node-driver-wq54r" Jan 13 20:09:28.945420 kubelet[3423]: E0113 20:09:28.945217 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a04750e9fc31e16c9110301f495a11a345e09ad202ac48d631cc7f81772e7ec2\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/csi-node-driver-wq54r" Jan 13 20:09:28.945917 kubelet[3423]: E0113 20:09:28.945698 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"csi-node-driver-wq54r_calico-system(d47fc662-eff9-4473-83da-b6f0b896d81f)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"csi-node-driver-wq54r_calico-system(d47fc662-eff9-4473-83da-b6f0b896d81f)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"a04750e9fc31e16c9110301f495a11a345e09ad202ac48d631cc7f81772e7ec2\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-system/csi-node-driver-wq54r" podUID="d47fc662-eff9-4473-83da-b6f0b896d81f" Jan 13 20:09:29.029894 containerd[1934]: time="2025-01-13T20:09:29.028292811Z" level=error msg="Failed to destroy network for sandbox \"e23a3567ec1b1a99aef5dba9eb89530d0582fb85108483f9212aaff1d6ab3bc3\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:29.030267 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-a7aac01fa45d89b04a7cb486ede3be4574f65135e039463be287ff48831441a8-shm.mount: Deactivated successfully. Jan 13 20:09:29.030468 systemd[1]: run-netns-cni\x2df3363c67\x2dcf01\x2d4fa4\x2daf8c\x2d510b6cbbfe22.mount: Deactivated successfully. Jan 13 20:09:29.030596 systemd[1]: run-netns-cni\x2de3a1dc67\x2d4d12\x2da79d\x2d0bee\x2d72478cd02e8a.mount: Deactivated successfully. Jan 13 20:09:29.030718 systemd[1]: run-netns-cni\x2de47a9082\x2d0797\x2d12be\x2d0c9a\x2de6651894a463.mount: Deactivated successfully. Jan 13 20:09:29.046189 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-e23a3567ec1b1a99aef5dba9eb89530d0582fb85108483f9212aaff1d6ab3bc3-shm.mount: Deactivated successfully. Jan 13 20:09:29.049625 containerd[1934]: time="2025-01-13T20:09:29.047185431Z" level=error msg="encountered an error cleaning up failed sandbox \"e23a3567ec1b1a99aef5dba9eb89530d0582fb85108483f9212aaff1d6ab3bc3\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:29.049625 containerd[1934]: time="2025-01-13T20:09:29.047305791Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-76f75df574-mkr2l,Uid:396e30c8-d221-410a-89fe-e353ba8cddbf,Namespace:kube-system,Attempt:4,} failed, error" error="failed to setup network for sandbox \"e23a3567ec1b1a99aef5dba9eb89530d0582fb85108483f9212aaff1d6ab3bc3\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:29.049931 kubelet[3423]: E0113 20:09:29.049083 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e23a3567ec1b1a99aef5dba9eb89530d0582fb85108483f9212aaff1d6ab3bc3\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:29.049931 kubelet[3423]: E0113 20:09:29.049157 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e23a3567ec1b1a99aef5dba9eb89530d0582fb85108483f9212aaff1d6ab3bc3\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-76f75df574-mkr2l" Jan 13 20:09:29.049931 kubelet[3423]: E0113 20:09:29.049195 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e23a3567ec1b1a99aef5dba9eb89530d0582fb85108483f9212aaff1d6ab3bc3\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-76f75df574-mkr2l" Jan 13 20:09:29.050127 kubelet[3423]: E0113 20:09:29.049302 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-76f75df574-mkr2l_kube-system(396e30c8-d221-410a-89fe-e353ba8cddbf)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-76f75df574-mkr2l_kube-system(396e30c8-d221-410a-89fe-e353ba8cddbf)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"e23a3567ec1b1a99aef5dba9eb89530d0582fb85108483f9212aaff1d6ab3bc3\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="kube-system/coredns-76f75df574-mkr2l" podUID="396e30c8-d221-410a-89fe-e353ba8cddbf" Jan 13 20:09:29.057876 containerd[1934]: time="2025-01-13T20:09:29.057354951Z" level=error msg="Failed to destroy network for sandbox \"37e8d359f609f540d9e2f49bc83e7f3d5e4296810bef7cdacf10f479884043e5\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:29.063221 containerd[1934]: time="2025-01-13T20:09:29.062930343Z" level=error msg="encountered an error cleaning up failed sandbox \"37e8d359f609f540d9e2f49bc83e7f3d5e4296810bef7cdacf10f479884043e5\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:29.064877 containerd[1934]: time="2025-01-13T20:09:29.064011975Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-kube-controllers-68f76c7ddf-lh8nj,Uid:2be21c11-9c2d-4b9a-81a5-0e73daba31c1,Namespace:calico-system,Attempt:4,} failed, error" error="failed to setup network for sandbox \"37e8d359f609f540d9e2f49bc83e7f3d5e4296810bef7cdacf10f479884043e5\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:29.065369 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-37e8d359f609f540d9e2f49bc83e7f3d5e4296810bef7cdacf10f479884043e5-shm.mount: Deactivated successfully. Jan 13 20:09:29.067201 kubelet[3423]: E0113 20:09:29.067019 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"37e8d359f609f540d9e2f49bc83e7f3d5e4296810bef7cdacf10f479884043e5\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:29.067201 kubelet[3423]: E0113 20:09:29.067107 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"37e8d359f609f540d9e2f49bc83e7f3d5e4296810bef7cdacf10f479884043e5\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/calico-kube-controllers-68f76c7ddf-lh8nj" Jan 13 20:09:29.067201 kubelet[3423]: E0113 20:09:29.067146 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"37e8d359f609f540d9e2f49bc83e7f3d5e4296810bef7cdacf10f479884043e5\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/calico-kube-controllers-68f76c7ddf-lh8nj" Jan 13 20:09:29.068128 kubelet[3423]: E0113 20:09:29.067237 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"calico-kube-controllers-68f76c7ddf-lh8nj_calico-system(2be21c11-9c2d-4b9a-81a5-0e73daba31c1)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"calico-kube-controllers-68f76c7ddf-lh8nj_calico-system(2be21c11-9c2d-4b9a-81a5-0e73daba31c1)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"37e8d359f609f540d9e2f49bc83e7f3d5e4296810bef7cdacf10f479884043e5\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-system/calico-kube-controllers-68f76c7ddf-lh8nj" podUID="2be21c11-9c2d-4b9a-81a5-0e73daba31c1" Jan 13 20:09:29.115098 containerd[1934]: time="2025-01-13T20:09:29.114974127Z" level=error msg="Failed to destroy network for sandbox \"c8d12cba52fd60ec08cc5638f4d4379aae8d673464810205dafbb978080837b3\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:29.118584 containerd[1934]: time="2025-01-13T20:09:29.118249443Z" level=error msg="encountered an error cleaning up failed sandbox \"c8d12cba52fd60ec08cc5638f4d4379aae8d673464810205dafbb978080837b3\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:29.118584 containerd[1934]: time="2025-01-13T20:09:29.118533303Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-76f75df574-8wp6k,Uid:87115657-f395-40ec-89ea-3d7835119c3a,Namespace:kube-system,Attempt:4,} failed, error" error="failed to setup network for sandbox \"c8d12cba52fd60ec08cc5638f4d4379aae8d673464810205dafbb978080837b3\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:29.120382 kubelet[3423]: E0113 20:09:29.118961 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"c8d12cba52fd60ec08cc5638f4d4379aae8d673464810205dafbb978080837b3\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:29.120382 kubelet[3423]: E0113 20:09:29.119049 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"c8d12cba52fd60ec08cc5638f4d4379aae8d673464810205dafbb978080837b3\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-76f75df574-8wp6k" Jan 13 20:09:29.120382 kubelet[3423]: E0113 20:09:29.119091 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"c8d12cba52fd60ec08cc5638f4d4379aae8d673464810205dafbb978080837b3\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-76f75df574-8wp6k" Jan 13 20:09:29.120741 kubelet[3423]: E0113 20:09:29.119178 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-76f75df574-8wp6k_kube-system(87115657-f395-40ec-89ea-3d7835119c3a)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-76f75df574-8wp6k_kube-system(87115657-f395-40ec-89ea-3d7835119c3a)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"c8d12cba52fd60ec08cc5638f4d4379aae8d673464810205dafbb978080837b3\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="kube-system/coredns-76f75df574-8wp6k" podUID="87115657-f395-40ec-89ea-3d7835119c3a" Jan 13 20:09:29.123369 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-c8d12cba52fd60ec08cc5638f4d4379aae8d673464810205dafbb978080837b3-shm.mount: Deactivated successfully. Jan 13 20:09:29.145397 containerd[1934]: time="2025-01-13T20:09:29.144989115Z" level=error msg="Failed to destroy network for sandbox \"e8d14d51164c0f7461d019f7892fb139ae5f1525115e3ca06b0affcaae9c0d5e\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:29.150950 containerd[1934]: time="2025-01-13T20:09:29.149434515Z" level=error msg="encountered an error cleaning up failed sandbox \"e8d14d51164c0f7461d019f7892fb139ae5f1525115e3ca06b0affcaae9c0d5e\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:29.150950 containerd[1934]: time="2025-01-13T20:09:29.149541627Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-7fbffcd8cd-wszl7,Uid:ad79c041-eaf1-4d57-9fb4-c3fb08680cb8,Namespace:calico-apiserver,Attempt:4,} failed, error" error="failed to setup network for sandbox \"e8d14d51164c0f7461d019f7892fb139ae5f1525115e3ca06b0affcaae9c0d5e\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:29.150714 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-e8d14d51164c0f7461d019f7892fb139ae5f1525115e3ca06b0affcaae9c0d5e-shm.mount: Deactivated successfully. Jan 13 20:09:29.154040 kubelet[3423]: E0113 20:09:29.152882 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e8d14d51164c0f7461d019f7892fb139ae5f1525115e3ca06b0affcaae9c0d5e\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:29.154040 kubelet[3423]: E0113 20:09:29.153017 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e8d14d51164c0f7461d019f7892fb139ae5f1525115e3ca06b0affcaae9c0d5e\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-wszl7" Jan 13 20:09:29.154040 kubelet[3423]: E0113 20:09:29.153058 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e8d14d51164c0f7461d019f7892fb139ae5f1525115e3ca06b0affcaae9c0d5e\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-wszl7" Jan 13 20:09:29.154319 kubelet[3423]: E0113 20:09:29.153190 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"calico-apiserver-7fbffcd8cd-wszl7_calico-apiserver(ad79c041-eaf1-4d57-9fb4-c3fb08680cb8)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"calico-apiserver-7fbffcd8cd-wszl7_calico-apiserver(ad79c041-eaf1-4d57-9fb4-c3fb08680cb8)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"e8d14d51164c0f7461d019f7892fb139ae5f1525115e3ca06b0affcaae9c0d5e\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-wszl7" podUID="ad79c041-eaf1-4d57-9fb4-c3fb08680cb8" Jan 13 20:09:29.583627 kubelet[3423]: I0113 20:09:29.583085 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e23a3567ec1b1a99aef5dba9eb89530d0582fb85108483f9212aaff1d6ab3bc3" Jan 13 20:09:29.588586 containerd[1934]: time="2025-01-13T20:09:29.586581077Z" level=info msg="StopPodSandbox for \"e23a3567ec1b1a99aef5dba9eb89530d0582fb85108483f9212aaff1d6ab3bc3\"" Jan 13 20:09:29.589547 containerd[1934]: time="2025-01-13T20:09:29.589500629Z" level=info msg="Ensure that sandbox e23a3567ec1b1a99aef5dba9eb89530d0582fb85108483f9212aaff1d6ab3bc3 in task-service has been cleanup successfully" Jan 13 20:09:29.593354 containerd[1934]: time="2025-01-13T20:09:29.592425449Z" level=info msg="TearDown network for sandbox \"e23a3567ec1b1a99aef5dba9eb89530d0582fb85108483f9212aaff1d6ab3bc3\" successfully" Jan 13 20:09:29.593354 containerd[1934]: time="2025-01-13T20:09:29.592594901Z" level=info msg="StopPodSandbox for \"e23a3567ec1b1a99aef5dba9eb89530d0582fb85108483f9212aaff1d6ab3bc3\" returns successfully" Jan 13 20:09:29.595631 containerd[1934]: time="2025-01-13T20:09:29.594764237Z" level=info msg="StopPodSandbox for \"ce26f7c56a292d1c5e76ccbca54d688912ff4e1c7e33ef8e71e3b8766f463517\"" Jan 13 20:09:29.596052 containerd[1934]: time="2025-01-13T20:09:29.596012273Z" level=info msg="TearDown network for sandbox \"ce26f7c56a292d1c5e76ccbca54d688912ff4e1c7e33ef8e71e3b8766f463517\" successfully" Jan 13 20:09:29.596624 containerd[1934]: time="2025-01-13T20:09:29.596503169Z" level=info msg="StopPodSandbox for \"ce26f7c56a292d1c5e76ccbca54d688912ff4e1c7e33ef8e71e3b8766f463517\" returns successfully" Jan 13 20:09:29.598540 containerd[1934]: time="2025-01-13T20:09:29.597796553Z" level=info msg="StopPodSandbox for \"bac2fe516cc564552b8be0fbca65a9d04eaace09e824ed2a17d9c03e83edae58\"" Jan 13 20:09:29.599300 kubelet[3423]: I0113 20:09:29.599247 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c8d12cba52fd60ec08cc5638f4d4379aae8d673464810205dafbb978080837b3" Jan 13 20:09:29.601427 containerd[1934]: time="2025-01-13T20:09:29.599717837Z" level=info msg="TearDown network for sandbox \"bac2fe516cc564552b8be0fbca65a9d04eaace09e824ed2a17d9c03e83edae58\" successfully" Jan 13 20:09:29.601427 containerd[1934]: time="2025-01-13T20:09:29.600806129Z" level=info msg="StopPodSandbox for \"bac2fe516cc564552b8be0fbca65a9d04eaace09e824ed2a17d9c03e83edae58\" returns successfully" Jan 13 20:09:29.601427 containerd[1934]: time="2025-01-13T20:09:29.601098449Z" level=info msg="StopPodSandbox for \"c8d12cba52fd60ec08cc5638f4d4379aae8d673464810205dafbb978080837b3\"" Jan 13 20:09:29.603456 containerd[1934]: time="2025-01-13T20:09:29.603348965Z" level=info msg="Ensure that sandbox c8d12cba52fd60ec08cc5638f4d4379aae8d673464810205dafbb978080837b3 in task-service has been cleanup successfully" Jan 13 20:09:29.604955 containerd[1934]: time="2025-01-13T20:09:29.604868093Z" level=info msg="TearDown network for sandbox \"c8d12cba52fd60ec08cc5638f4d4379aae8d673464810205dafbb978080837b3\" successfully" Jan 13 20:09:29.604955 containerd[1934]: time="2025-01-13T20:09:29.604944293Z" level=info msg="StopPodSandbox for \"c8d12cba52fd60ec08cc5638f4d4379aae8d673464810205dafbb978080837b3\" returns successfully" Jan 13 20:09:29.606813 containerd[1934]: time="2025-01-13T20:09:29.606109601Z" level=info msg="StopPodSandbox for \"7d3190834f7286fc68261319021ff89fa2267e8e4a2bc44b60cdc8ec3736f03b\"" Jan 13 20:09:29.606813 containerd[1934]: time="2025-01-13T20:09:29.606292337Z" level=info msg="TearDown network for sandbox \"7d3190834f7286fc68261319021ff89fa2267e8e4a2bc44b60cdc8ec3736f03b\" successfully" Jan 13 20:09:29.606813 containerd[1934]: time="2025-01-13T20:09:29.606388769Z" level=info msg="StopPodSandbox for \"7d3190834f7286fc68261319021ff89fa2267e8e4a2bc44b60cdc8ec3736f03b\" returns successfully" Jan 13 20:09:29.606813 containerd[1934]: time="2025-01-13T20:09:29.606605753Z" level=info msg="StopPodSandbox for \"d179e7ae754d81c958ff901cb7c596dc225e5822f67938ade6bc971cc1e73234\"" Jan 13 20:09:29.607946 containerd[1934]: time="2025-01-13T20:09:29.607841334Z" level=info msg="StopPodSandbox for \"899dac68c4a2c7ede7e6073b33ab156f86e32973795b4e68f426b199aa5486a9\"" Jan 13 20:09:29.608342 containerd[1934]: time="2025-01-13T20:09:29.608139090Z" level=info msg="TearDown network for sandbox \"899dac68c4a2c7ede7e6073b33ab156f86e32973795b4e68f426b199aa5486a9\" successfully" Jan 13 20:09:29.608342 containerd[1934]: time="2025-01-13T20:09:29.608221782Z" level=info msg="StopPodSandbox for \"899dac68c4a2c7ede7e6073b33ab156f86e32973795b4e68f426b199aa5486a9\" returns successfully" Jan 13 20:09:29.610432 containerd[1934]: time="2025-01-13T20:09:29.609946146Z" level=info msg="TearDown network for sandbox \"d179e7ae754d81c958ff901cb7c596dc225e5822f67938ade6bc971cc1e73234\" successfully" Jan 13 20:09:29.610432 containerd[1934]: time="2025-01-13T20:09:29.609989970Z" level=info msg="StopPodSandbox for \"d179e7ae754d81c958ff901cb7c596dc225e5822f67938ade6bc971cc1e73234\" returns successfully" Jan 13 20:09:29.610432 containerd[1934]: time="2025-01-13T20:09:29.610060026Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-76f75df574-mkr2l,Uid:396e30c8-d221-410a-89fe-e353ba8cddbf,Namespace:kube-system,Attempt:5,}" Jan 13 20:09:29.611852 containerd[1934]: time="2025-01-13T20:09:29.611809086Z" level=info msg="StopPodSandbox for \"8c0c460fc82d1c51ed146afb77bb0cdfb42636cd5b1ebd0d7d108e8d75eb9610\"" Jan 13 20:09:29.614141 containerd[1934]: time="2025-01-13T20:09:29.613892742Z" level=info msg="TearDown network for sandbox \"8c0c460fc82d1c51ed146afb77bb0cdfb42636cd5b1ebd0d7d108e8d75eb9610\" successfully" Jan 13 20:09:29.614141 containerd[1934]: time="2025-01-13T20:09:29.614024058Z" level=info msg="StopPodSandbox for \"8c0c460fc82d1c51ed146afb77bb0cdfb42636cd5b1ebd0d7d108e8d75eb9610\" returns successfully" Jan 13 20:09:29.615324 containerd[1934]: time="2025-01-13T20:09:29.615038130Z" level=info msg="StopPodSandbox for \"eed11d015ff645b963130f5ad956d107f391cbaba3451e015229fc4082c60951\"" Jan 13 20:09:29.615324 containerd[1934]: time="2025-01-13T20:09:29.615283446Z" level=info msg="TearDown network for sandbox \"eed11d015ff645b963130f5ad956d107f391cbaba3451e015229fc4082c60951\" successfully" Jan 13 20:09:29.615324 containerd[1934]: time="2025-01-13T20:09:29.615307494Z" level=info msg="StopPodSandbox for \"eed11d015ff645b963130f5ad956d107f391cbaba3451e015229fc4082c60951\" returns successfully" Jan 13 20:09:29.616273 containerd[1934]: time="2025-01-13T20:09:29.616218642Z" level=info msg="StopPodSandbox for \"f5e883fc61f95c31957335ed367bbb8d4c07a9c5470ee6e51fca5c2bde0bfb8c\"" Jan 13 20:09:29.616357 kubelet[3423]: I0113 20:09:29.615840 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e8d14d51164c0f7461d019f7892fb139ae5f1525115e3ca06b0affcaae9c0d5e" Jan 13 20:09:29.618552 containerd[1934]: time="2025-01-13T20:09:29.618202098Z" level=info msg="TearDown network for sandbox \"f5e883fc61f95c31957335ed367bbb8d4c07a9c5470ee6e51fca5c2bde0bfb8c\" successfully" Jan 13 20:09:29.618552 containerd[1934]: time="2025-01-13T20:09:29.618285810Z" level=info msg="StopPodSandbox for \"f5e883fc61f95c31957335ed367bbb8d4c07a9c5470ee6e51fca5c2bde0bfb8c\" returns successfully" Jan 13 20:09:29.624815 containerd[1934]: time="2025-01-13T20:09:29.624612306Z" level=info msg="StopPodSandbox for \"e8d14d51164c0f7461d019f7892fb139ae5f1525115e3ca06b0affcaae9c0d5e\"" Jan 13 20:09:29.625803 containerd[1934]: time="2025-01-13T20:09:29.625578150Z" level=info msg="Ensure that sandbox e8d14d51164c0f7461d019f7892fb139ae5f1525115e3ca06b0affcaae9c0d5e in task-service has been cleanup successfully" Jan 13 20:09:29.625989 containerd[1934]: time="2025-01-13T20:09:29.625891434Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-76f75df574-8wp6k,Uid:87115657-f395-40ec-89ea-3d7835119c3a,Namespace:kube-system,Attempt:5,}" Jan 13 20:09:29.626283 containerd[1934]: time="2025-01-13T20:09:29.626250150Z" level=info msg="TearDown network for sandbox \"e8d14d51164c0f7461d019f7892fb139ae5f1525115e3ca06b0affcaae9c0d5e\" successfully" Jan 13 20:09:29.626539 containerd[1934]: time="2025-01-13T20:09:29.626378166Z" level=info msg="StopPodSandbox for \"e8d14d51164c0f7461d019f7892fb139ae5f1525115e3ca06b0affcaae9c0d5e\" returns successfully" Jan 13 20:09:29.628190 containerd[1934]: time="2025-01-13T20:09:29.627757254Z" level=info msg="StopPodSandbox for \"f25c71afbdf54c9739bfb9dedd7783f76e2a8415e053a98227128ef3211d4a56\"" Jan 13 20:09:29.628190 containerd[1934]: time="2025-01-13T20:09:29.628064070Z" level=info msg="TearDown network for sandbox \"f25c71afbdf54c9739bfb9dedd7783f76e2a8415e053a98227128ef3211d4a56\" successfully" Jan 13 20:09:29.628190 containerd[1934]: time="2025-01-13T20:09:29.628116450Z" level=info msg="StopPodSandbox for \"f25c71afbdf54c9739bfb9dedd7783f76e2a8415e053a98227128ef3211d4a56\" returns successfully" Jan 13 20:09:29.629865 containerd[1934]: time="2025-01-13T20:09:29.629390574Z" level=info msg="StopPodSandbox for \"d029da1857cffbc9aea56a8ec883ba4e1da56eae06a46e2e4ba0629832693cb0\"" Jan 13 20:09:29.629865 containerd[1934]: time="2025-01-13T20:09:29.629694486Z" level=info msg="TearDown network for sandbox \"d029da1857cffbc9aea56a8ec883ba4e1da56eae06a46e2e4ba0629832693cb0\" successfully" Jan 13 20:09:29.629865 containerd[1934]: time="2025-01-13T20:09:29.629718666Z" level=info msg="StopPodSandbox for \"d029da1857cffbc9aea56a8ec883ba4e1da56eae06a46e2e4ba0629832693cb0\" returns successfully" Jan 13 20:09:29.630842 containerd[1934]: time="2025-01-13T20:09:29.630593178Z" level=info msg="StopPodSandbox for \"cfa6ddb68ab8a55e2b4406871b279f8198e9a43957ec335f7facbf57b86881a3\"" Jan 13 20:09:29.630842 containerd[1934]: time="2025-01-13T20:09:29.630759426Z" level=info msg="TearDown network for sandbox \"cfa6ddb68ab8a55e2b4406871b279f8198e9a43957ec335f7facbf57b86881a3\" successfully" Jan 13 20:09:29.632450 containerd[1934]: time="2025-01-13T20:09:29.631679682Z" level=info msg="StopPodSandbox for \"cfa6ddb68ab8a55e2b4406871b279f8198e9a43957ec335f7facbf57b86881a3\" returns successfully" Jan 13 20:09:29.633378 containerd[1934]: time="2025-01-13T20:09:29.633336126Z" level=info msg="StopPodSandbox for \"fb565334446e5f8a46a1bd1f7f902b79f435864e841478f2f0a155d44cd33b41\"" Jan 13 20:09:29.636891 containerd[1934]: time="2025-01-13T20:09:29.636843942Z" level=info msg="TearDown network for sandbox \"fb565334446e5f8a46a1bd1f7f902b79f435864e841478f2f0a155d44cd33b41\" successfully" Jan 13 20:09:29.637044 kubelet[3423]: I0113 20:09:29.636947 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a7aac01fa45d89b04a7cb486ede3be4574f65135e039463be287ff48831441a8" Jan 13 20:09:29.638498 containerd[1934]: time="2025-01-13T20:09:29.638289894Z" level=info msg="StopPodSandbox for \"fb565334446e5f8a46a1bd1f7f902b79f435864e841478f2f0a155d44cd33b41\" returns successfully" Jan 13 20:09:29.640232 containerd[1934]: time="2025-01-13T20:09:29.640149642Z" level=info msg="StopPodSandbox for \"a7aac01fa45d89b04a7cb486ede3be4574f65135e039463be287ff48831441a8\"" Jan 13 20:09:29.641103 containerd[1934]: time="2025-01-13T20:09:29.640480386Z" level=info msg="Ensure that sandbox a7aac01fa45d89b04a7cb486ede3be4574f65135e039463be287ff48831441a8 in task-service has been cleanup successfully" Jan 13 20:09:29.641894 containerd[1934]: time="2025-01-13T20:09:29.641799726Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-7fbffcd8cd-wszl7,Uid:ad79c041-eaf1-4d57-9fb4-c3fb08680cb8,Namespace:calico-apiserver,Attempt:5,}" Jan 13 20:09:29.642924 containerd[1934]: time="2025-01-13T20:09:29.642351258Z" level=info msg="TearDown network for sandbox \"a7aac01fa45d89b04a7cb486ede3be4574f65135e039463be287ff48831441a8\" successfully" Jan 13 20:09:29.642924 containerd[1934]: time="2025-01-13T20:09:29.642393186Z" level=info msg="StopPodSandbox for \"a7aac01fa45d89b04a7cb486ede3be4574f65135e039463be287ff48831441a8\" returns successfully" Jan 13 20:09:29.644633 containerd[1934]: time="2025-01-13T20:09:29.644256126Z" level=info msg="StopPodSandbox for \"a37a24fcb9897952ccabcc8cb7045bb7b0ef0fe4b98a8ca3b53ea6f6cf157017\"" Jan 13 20:09:29.644865 containerd[1934]: time="2025-01-13T20:09:29.644765646Z" level=info msg="TearDown network for sandbox \"a37a24fcb9897952ccabcc8cb7045bb7b0ef0fe4b98a8ca3b53ea6f6cf157017\" successfully" Jan 13 20:09:29.644865 containerd[1934]: time="2025-01-13T20:09:29.644832546Z" level=info msg="StopPodSandbox for \"a37a24fcb9897952ccabcc8cb7045bb7b0ef0fe4b98a8ca3b53ea6f6cf157017\" returns successfully" Jan 13 20:09:29.648262 containerd[1934]: time="2025-01-13T20:09:29.647142522Z" level=info msg="StopPodSandbox for \"e31eca7a421d12ab04696c6ee4fefbcfc3ab887e88d76deb901fc6a512e76618\"" Jan 13 20:09:29.648262 containerd[1934]: time="2025-01-13T20:09:29.647688246Z" level=info msg="TearDown network for sandbox \"e31eca7a421d12ab04696c6ee4fefbcfc3ab887e88d76deb901fc6a512e76618\" successfully" Jan 13 20:09:29.648262 containerd[1934]: time="2025-01-13T20:09:29.647719050Z" level=info msg="StopPodSandbox for \"e31eca7a421d12ab04696c6ee4fefbcfc3ab887e88d76deb901fc6a512e76618\" returns successfully" Jan 13 20:09:29.650002 containerd[1934]: time="2025-01-13T20:09:29.649943694Z" level=info msg="StopPodSandbox for \"2accd017db7708cc1fa5c6da328b2f1c3f1c063e1b4b76d232d0c4e3cdca6a6d\"" Jan 13 20:09:29.650453 containerd[1934]: time="2025-01-13T20:09:29.650323398Z" level=info msg="TearDown network for sandbox \"2accd017db7708cc1fa5c6da328b2f1c3f1c063e1b4b76d232d0c4e3cdca6a6d\" successfully" Jan 13 20:09:29.650453 containerd[1934]: time="2025-01-13T20:09:29.650349474Z" level=info msg="StopPodSandbox for \"2accd017db7708cc1fa5c6da328b2f1c3f1c063e1b4b76d232d0c4e3cdca6a6d\" returns successfully" Jan 13 20:09:29.652181 containerd[1934]: time="2025-01-13T20:09:29.652024506Z" level=info msg="StopPodSandbox for \"c787f8945e5c1c02a132aebe2ce54537e8efb76054bd3d61620dd081ac229a87\"" Jan 13 20:09:29.680921 containerd[1934]: time="2025-01-13T20:09:29.652284558Z" level=info msg="TearDown network for sandbox \"c787f8945e5c1c02a132aebe2ce54537e8efb76054bd3d61620dd081ac229a87\" successfully" Jan 13 20:09:29.680921 containerd[1934]: time="2025-01-13T20:09:29.652334742Z" level=info msg="StopPodSandbox for \"c787f8945e5c1c02a132aebe2ce54537e8efb76054bd3d61620dd081ac229a87\" returns successfully" Jan 13 20:09:29.680921 containerd[1934]: time="2025-01-13T20:09:29.654414078Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-7fbffcd8cd-pxvdr,Uid:8f72f896-c0ba-4b07-9a22-acc5c8ca3697,Namespace:calico-apiserver,Attempt:5,}" Jan 13 20:09:29.680921 containerd[1934]: time="2025-01-13T20:09:29.661378086Z" level=info msg="StopPodSandbox for \"a04750e9fc31e16c9110301f495a11a345e09ad202ac48d631cc7f81772e7ec2\"" Jan 13 20:09:29.680921 containerd[1934]: time="2025-01-13T20:09:29.661654230Z" level=info msg="Ensure that sandbox a04750e9fc31e16c9110301f495a11a345e09ad202ac48d631cc7f81772e7ec2 in task-service has been cleanup successfully" Jan 13 20:09:29.680921 containerd[1934]: time="2025-01-13T20:09:29.662869302Z" level=info msg="TearDown network for sandbox \"a04750e9fc31e16c9110301f495a11a345e09ad202ac48d631cc7f81772e7ec2\" successfully" Jan 13 20:09:29.680921 containerd[1934]: time="2025-01-13T20:09:29.662903646Z" level=info msg="StopPodSandbox for \"a04750e9fc31e16c9110301f495a11a345e09ad202ac48d631cc7f81772e7ec2\" returns successfully" Jan 13 20:09:29.680921 containerd[1934]: time="2025-01-13T20:09:29.663632082Z" level=info msg="StopPodSandbox for \"955f9fe6553205f6e71b94a6922fdece40d5d1a8c6a343e9a0aa0f4bf2abbb69\"" Jan 13 20:09:29.680921 containerd[1934]: time="2025-01-13T20:09:29.663789294Z" level=info msg="TearDown network for sandbox \"955f9fe6553205f6e71b94a6922fdece40d5d1a8c6a343e9a0aa0f4bf2abbb69\" successfully" Jan 13 20:09:29.680921 containerd[1934]: time="2025-01-13T20:09:29.663813726Z" level=info msg="StopPodSandbox for \"955f9fe6553205f6e71b94a6922fdece40d5d1a8c6a343e9a0aa0f4bf2abbb69\" returns successfully" Jan 13 20:09:29.680921 containerd[1934]: time="2025-01-13T20:09:29.664434282Z" level=info msg="StopPodSandbox for \"aeb47e19302f9c839c5fa002c506a56722057a24b2c06c5082b07dd07a783384\"" Jan 13 20:09:29.680921 containerd[1934]: time="2025-01-13T20:09:29.664611402Z" level=info msg="TearDown network for sandbox \"aeb47e19302f9c839c5fa002c506a56722057a24b2c06c5082b07dd07a783384\" successfully" Jan 13 20:09:29.680921 containerd[1934]: time="2025-01-13T20:09:29.664634154Z" level=info msg="StopPodSandbox for \"aeb47e19302f9c839c5fa002c506a56722057a24b2c06c5082b07dd07a783384\" returns successfully" Jan 13 20:09:29.680921 containerd[1934]: time="2025-01-13T20:09:29.667262130Z" level=info msg="StopPodSandbox for \"af4b04b9175c96b5f57bdaa5d05b254cb086cf984792052f87e1249b6c2e75f9\"" Jan 13 20:09:29.680921 containerd[1934]: time="2025-01-13T20:09:29.667511466Z" level=info msg="TearDown network for sandbox \"af4b04b9175c96b5f57bdaa5d05b254cb086cf984792052f87e1249b6c2e75f9\" successfully" Jan 13 20:09:29.680921 containerd[1934]: time="2025-01-13T20:09:29.667536342Z" level=info msg="StopPodSandbox for \"af4b04b9175c96b5f57bdaa5d05b254cb086cf984792052f87e1249b6c2e75f9\" returns successfully" Jan 13 20:09:29.680921 containerd[1934]: time="2025-01-13T20:09:29.670526646Z" level=info msg="StopPodSandbox for \"ccf56aafff1edbddd69e830448606d1ed364723341b141ed6867e7ed4d6b5f89\"" Jan 13 20:09:29.680921 containerd[1934]: time="2025-01-13T20:09:29.670687710Z" level=info msg="TearDown network for sandbox \"ccf56aafff1edbddd69e830448606d1ed364723341b141ed6867e7ed4d6b5f89\" successfully" Jan 13 20:09:29.680921 containerd[1934]: time="2025-01-13T20:09:29.670715442Z" level=info msg="StopPodSandbox for \"ccf56aafff1edbddd69e830448606d1ed364723341b141ed6867e7ed4d6b5f89\" returns successfully" Jan 13 20:09:29.680921 containerd[1934]: time="2025-01-13T20:09:29.672917922Z" level=info msg="StopPodSandbox for \"37e8d359f609f540d9e2f49bc83e7f3d5e4296810bef7cdacf10f479884043e5\"" Jan 13 20:09:29.680921 containerd[1934]: time="2025-01-13T20:09:29.673235130Z" level=info msg="Ensure that sandbox 37e8d359f609f540d9e2f49bc83e7f3d5e4296810bef7cdacf10f479884043e5 in task-service has been cleanup successfully" Jan 13 20:09:29.680921 containerd[1934]: time="2025-01-13T20:09:29.673574526Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:csi-node-driver-wq54r,Uid:d47fc662-eff9-4473-83da-b6f0b896d81f,Namespace:calico-system,Attempt:5,}" Jan 13 20:09:29.680921 containerd[1934]: time="2025-01-13T20:09:29.674064858Z" level=info msg="TearDown network for sandbox \"37e8d359f609f540d9e2f49bc83e7f3d5e4296810bef7cdacf10f479884043e5\" successfully" Jan 13 20:09:29.680921 containerd[1934]: time="2025-01-13T20:09:29.674098974Z" level=info msg="StopPodSandbox for \"37e8d359f609f540d9e2f49bc83e7f3d5e4296810bef7cdacf10f479884043e5\" returns successfully" Jan 13 20:09:29.680921 containerd[1934]: time="2025-01-13T20:09:29.675229986Z" level=info msg="StopPodSandbox for \"bb64b66507a4d3948827c99dee10022276bd2b85dcce58713749456b89a5723b\"" Jan 13 20:09:29.680921 containerd[1934]: time="2025-01-13T20:09:29.675433146Z" level=info msg="TearDown network for sandbox \"bb64b66507a4d3948827c99dee10022276bd2b85dcce58713749456b89a5723b\" successfully" Jan 13 20:09:29.680921 containerd[1934]: time="2025-01-13T20:09:29.675457950Z" level=info msg="StopPodSandbox for \"bb64b66507a4d3948827c99dee10022276bd2b85dcce58713749456b89a5723b\" returns successfully" Jan 13 20:09:29.680921 containerd[1934]: time="2025-01-13T20:09:29.677763642Z" level=info msg="StopPodSandbox for \"3999268688ddddddb7ec9df611d8146f50072274600306787cd56688f110d548\"" Jan 13 20:09:29.680921 containerd[1934]: time="2025-01-13T20:09:29.678966726Z" level=info msg="TearDown network for sandbox \"3999268688ddddddb7ec9df611d8146f50072274600306787cd56688f110d548\" successfully" Jan 13 20:09:29.680921 containerd[1934]: time="2025-01-13T20:09:29.679078794Z" level=info msg="StopPodSandbox for \"3999268688ddddddb7ec9df611d8146f50072274600306787cd56688f110d548\" returns successfully" Jan 13 20:09:29.680921 containerd[1934]: time="2025-01-13T20:09:29.680182410Z" level=info msg="StopPodSandbox for \"a86b825795730ba2f9f58fb14a41879f6cdba9ae4550e62d02a587d4dd982d06\"" Jan 13 20:09:29.680921 containerd[1934]: time="2025-01-13T20:09:29.680342958Z" level=info msg="TearDown network for sandbox \"a86b825795730ba2f9f58fb14a41879f6cdba9ae4550e62d02a587d4dd982d06\" successfully" Jan 13 20:09:29.680921 containerd[1934]: time="2025-01-13T20:09:29.680365794Z" level=info msg="StopPodSandbox for \"a86b825795730ba2f9f58fb14a41879f6cdba9ae4550e62d02a587d4dd982d06\" returns successfully" Jan 13 20:09:29.684086 kubelet[3423]: I0113 20:09:29.657299 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a04750e9fc31e16c9110301f495a11a345e09ad202ac48d631cc7f81772e7ec2" Jan 13 20:09:29.684086 kubelet[3423]: I0113 20:09:29.671590 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="37e8d359f609f540d9e2f49bc83e7f3d5e4296810bef7cdacf10f479884043e5" Jan 13 20:09:29.685503 containerd[1934]: time="2025-01-13T20:09:29.684335958Z" level=info msg="StopPodSandbox for \"57f3ef7b6cf66ed3ed7b779c226fa67874c55496cae0804a70bff6ecec1ef212\"" Jan 13 20:09:29.685503 containerd[1934]: time="2025-01-13T20:09:29.684495990Z" level=info msg="TearDown network for sandbox \"57f3ef7b6cf66ed3ed7b779c226fa67874c55496cae0804a70bff6ecec1ef212\" successfully" Jan 13 20:09:29.685503 containerd[1934]: time="2025-01-13T20:09:29.684517242Z" level=info msg="StopPodSandbox for \"57f3ef7b6cf66ed3ed7b779c226fa67874c55496cae0804a70bff6ecec1ef212\" returns successfully" Jan 13 20:09:29.687121 containerd[1934]: time="2025-01-13T20:09:29.686884122Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-kube-controllers-68f76c7ddf-lh8nj,Uid:2be21c11-9c2d-4b9a-81a5-0e73daba31c1,Namespace:calico-system,Attempt:5,}" Jan 13 20:09:30.033647 systemd[1]: run-netns-cni\x2ddfd7459a\x2d7636\x2db553\x2dd24c\x2dd4885c02d997.mount: Deactivated successfully. Jan 13 20:09:30.034363 systemd[1]: run-netns-cni\x2d6fea54e6\x2df4c7\x2d52d9\x2df09c\x2d4533c5d8bab0.mount: Deactivated successfully. Jan 13 20:09:30.034488 systemd[1]: run-netns-cni\x2d0841ba81\x2dd65d\x2d778b\x2d7cd8\x2dafb36ad506b4.mount: Deactivated successfully. Jan 13 20:09:30.034606 systemd[1]: run-netns-cni\x2d473a521c\x2d68f1\x2d7018\x2d9772\x2d88dd4ef627b6.mount: Deactivated successfully. Jan 13 20:09:30.034724 systemd[1]: run-netns-cni\x2de4904cbf\x2d64d9\x2d4fad\x2d3a22\x2d5e067cb31179.mount: Deactivated successfully. Jan 13 20:09:30.034886 systemd[1]: run-netns-cni\x2d3ac84abf\x2d176e\x2d89aa\x2d20f8\x2d6ed10bd039a6.mount: Deactivated successfully. Jan 13 20:09:30.175306 containerd[1934]: time="2025-01-13T20:09:30.173904916Z" level=error msg="Failed to destroy network for sandbox \"d368cfe07aba1c933544e6c62373b36a99071e5ffe92916bbd3e8ef7d96b68f2\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:30.181729 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-d368cfe07aba1c933544e6c62373b36a99071e5ffe92916bbd3e8ef7d96b68f2-shm.mount: Deactivated successfully. Jan 13 20:09:30.192194 containerd[1934]: time="2025-01-13T20:09:30.188740396Z" level=error msg="encountered an error cleaning up failed sandbox \"d368cfe07aba1c933544e6c62373b36a99071e5ffe92916bbd3e8ef7d96b68f2\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:30.192353 containerd[1934]: time="2025-01-13T20:09:30.192261940Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-76f75df574-mkr2l,Uid:396e30c8-d221-410a-89fe-e353ba8cddbf,Namespace:kube-system,Attempt:5,} failed, error" error="failed to setup network for sandbox \"d368cfe07aba1c933544e6c62373b36a99071e5ffe92916bbd3e8ef7d96b68f2\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:30.193420 kubelet[3423]: E0113 20:09:30.193370 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"d368cfe07aba1c933544e6c62373b36a99071e5ffe92916bbd3e8ef7d96b68f2\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:30.193579 kubelet[3423]: E0113 20:09:30.193485 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"d368cfe07aba1c933544e6c62373b36a99071e5ffe92916bbd3e8ef7d96b68f2\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-76f75df574-mkr2l" Jan 13 20:09:30.193579 kubelet[3423]: E0113 20:09:30.193552 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"d368cfe07aba1c933544e6c62373b36a99071e5ffe92916bbd3e8ef7d96b68f2\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-76f75df574-mkr2l" Jan 13 20:09:30.194811 kubelet[3423]: E0113 20:09:30.194723 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-76f75df574-mkr2l_kube-system(396e30c8-d221-410a-89fe-e353ba8cddbf)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-76f75df574-mkr2l_kube-system(396e30c8-d221-410a-89fe-e353ba8cddbf)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"d368cfe07aba1c933544e6c62373b36a99071e5ffe92916bbd3e8ef7d96b68f2\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="kube-system/coredns-76f75df574-mkr2l" podUID="396e30c8-d221-410a-89fe-e353ba8cddbf" Jan 13 20:09:30.265847 containerd[1934]: time="2025-01-13T20:09:30.265719425Z" level=error msg="Failed to destroy network for sandbox \"538f604b05684d3571dee3d0a58795500745c5ecc1a4cabbf340ef00fa2e3044\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:30.272468 containerd[1934]: time="2025-01-13T20:09:30.272356421Z" level=error msg="encountered an error cleaning up failed sandbox \"538f604b05684d3571dee3d0a58795500745c5ecc1a4cabbf340ef00fa2e3044\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:30.272862 containerd[1934]: time="2025-01-13T20:09:30.272483405Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-kube-controllers-68f76c7ddf-lh8nj,Uid:2be21c11-9c2d-4b9a-81a5-0e73daba31c1,Namespace:calico-system,Attempt:5,} failed, error" error="failed to setup network for sandbox \"538f604b05684d3571dee3d0a58795500745c5ecc1a4cabbf340ef00fa2e3044\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:30.273146 kubelet[3423]: E0113 20:09:30.272870 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"538f604b05684d3571dee3d0a58795500745c5ecc1a4cabbf340ef00fa2e3044\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:30.273146 kubelet[3423]: E0113 20:09:30.272967 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"538f604b05684d3571dee3d0a58795500745c5ecc1a4cabbf340ef00fa2e3044\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/calico-kube-controllers-68f76c7ddf-lh8nj" Jan 13 20:09:30.273146 kubelet[3423]: E0113 20:09:30.273006 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"538f604b05684d3571dee3d0a58795500745c5ecc1a4cabbf340ef00fa2e3044\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/calico-kube-controllers-68f76c7ddf-lh8nj" Jan 13 20:09:30.273336 kubelet[3423]: E0113 20:09:30.273158 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"calico-kube-controllers-68f76c7ddf-lh8nj_calico-system(2be21c11-9c2d-4b9a-81a5-0e73daba31c1)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"calico-kube-controllers-68f76c7ddf-lh8nj_calico-system(2be21c11-9c2d-4b9a-81a5-0e73daba31c1)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"538f604b05684d3571dee3d0a58795500745c5ecc1a4cabbf340ef00fa2e3044\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-system/calico-kube-controllers-68f76c7ddf-lh8nj" podUID="2be21c11-9c2d-4b9a-81a5-0e73daba31c1" Jan 13 20:09:30.275208 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-538f604b05684d3571dee3d0a58795500745c5ecc1a4cabbf340ef00fa2e3044-shm.mount: Deactivated successfully. Jan 13 20:09:30.306405 containerd[1934]: time="2025-01-13T20:09:30.306213857Z" level=error msg="Failed to destroy network for sandbox \"eede6c995fce264cd780e29e58a08fa68b4c54baafa60c3289b9cd92b98c7c6c\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:30.310824 containerd[1934]: time="2025-01-13T20:09:30.308368709Z" level=error msg="encountered an error cleaning up failed sandbox \"eede6c995fce264cd780e29e58a08fa68b4c54baafa60c3289b9cd92b98c7c6c\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:30.310824 containerd[1934]: time="2025-01-13T20:09:30.308480297Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-76f75df574-8wp6k,Uid:87115657-f395-40ec-89ea-3d7835119c3a,Namespace:kube-system,Attempt:5,} failed, error" error="failed to setup network for sandbox \"eede6c995fce264cd780e29e58a08fa68b4c54baafa60c3289b9cd92b98c7c6c\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:30.311029 kubelet[3423]: E0113 20:09:30.308837 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"eede6c995fce264cd780e29e58a08fa68b4c54baafa60c3289b9cd92b98c7c6c\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:30.311029 kubelet[3423]: E0113 20:09:30.308916 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"eede6c995fce264cd780e29e58a08fa68b4c54baafa60c3289b9cd92b98c7c6c\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-76f75df574-8wp6k" Jan 13 20:09:30.311029 kubelet[3423]: E0113 20:09:30.308958 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"eede6c995fce264cd780e29e58a08fa68b4c54baafa60c3289b9cd92b98c7c6c\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-76f75df574-8wp6k" Jan 13 20:09:30.311200 kubelet[3423]: E0113 20:09:30.309039 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-76f75df574-8wp6k_kube-system(87115657-f395-40ec-89ea-3d7835119c3a)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-76f75df574-8wp6k_kube-system(87115657-f395-40ec-89ea-3d7835119c3a)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"eede6c995fce264cd780e29e58a08fa68b4c54baafa60c3289b9cd92b98c7c6c\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="kube-system/coredns-76f75df574-8wp6k" podUID="87115657-f395-40ec-89ea-3d7835119c3a" Jan 13 20:09:30.315568 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-eede6c995fce264cd780e29e58a08fa68b4c54baafa60c3289b9cd92b98c7c6c-shm.mount: Deactivated successfully. Jan 13 20:09:30.344492 containerd[1934]: time="2025-01-13T20:09:30.344404001Z" level=error msg="Failed to destroy network for sandbox \"3738e8149db8a55a4134f2d90b1a13f28ee725b71b142d59f0f32a083d31ab02\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:30.347395 containerd[1934]: time="2025-01-13T20:09:30.347200865Z" level=error msg="encountered an error cleaning up failed sandbox \"3738e8149db8a55a4134f2d90b1a13f28ee725b71b142d59f0f32a083d31ab02\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:30.347395 containerd[1934]: time="2025-01-13T20:09:30.347322425Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-7fbffcd8cd-pxvdr,Uid:8f72f896-c0ba-4b07-9a22-acc5c8ca3697,Namespace:calico-apiserver,Attempt:5,} failed, error" error="failed to setup network for sandbox \"3738e8149db8a55a4134f2d90b1a13f28ee725b71b142d59f0f32a083d31ab02\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:30.350432 kubelet[3423]: E0113 20:09:30.348279 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"3738e8149db8a55a4134f2d90b1a13f28ee725b71b142d59f0f32a083d31ab02\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:30.350432 kubelet[3423]: E0113 20:09:30.348358 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"3738e8149db8a55a4134f2d90b1a13f28ee725b71b142d59f0f32a083d31ab02\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-pxvdr" Jan 13 20:09:30.350432 kubelet[3423]: E0113 20:09:30.348395 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"3738e8149db8a55a4134f2d90b1a13f28ee725b71b142d59f0f32a083d31ab02\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-pxvdr" Jan 13 20:09:30.350753 kubelet[3423]: E0113 20:09:30.348475 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"calico-apiserver-7fbffcd8cd-pxvdr_calico-apiserver(8f72f896-c0ba-4b07-9a22-acc5c8ca3697)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"calico-apiserver-7fbffcd8cd-pxvdr_calico-apiserver(8f72f896-c0ba-4b07-9a22-acc5c8ca3697)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"3738e8149db8a55a4134f2d90b1a13f28ee725b71b142d59f0f32a083d31ab02\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-pxvdr" podUID="8f72f896-c0ba-4b07-9a22-acc5c8ca3697" Jan 13 20:09:30.355596 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-3738e8149db8a55a4134f2d90b1a13f28ee725b71b142d59f0f32a083d31ab02-shm.mount: Deactivated successfully. Jan 13 20:09:30.366755 containerd[1934]: time="2025-01-13T20:09:30.365526881Z" level=error msg="Failed to destroy network for sandbox \"8615086423d6201ef85384f1854ecd8c82e04e1edced15a3499ba0b0b99f7588\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:30.366755 containerd[1934]: time="2025-01-13T20:09:30.366426521Z" level=error msg="encountered an error cleaning up failed sandbox \"8615086423d6201ef85384f1854ecd8c82e04e1edced15a3499ba0b0b99f7588\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:30.366755 containerd[1934]: time="2025-01-13T20:09:30.366574025Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:csi-node-driver-wq54r,Uid:d47fc662-eff9-4473-83da-b6f0b896d81f,Namespace:calico-system,Attempt:5,} failed, error" error="failed to setup network for sandbox \"8615086423d6201ef85384f1854ecd8c82e04e1edced15a3499ba0b0b99f7588\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:30.367733 containerd[1934]: time="2025-01-13T20:09:30.367658969Z" level=error msg="Failed to destroy network for sandbox \"034a1f3cd65e356f264d6b6a21d8604cdd13f23a1add7bf41ab327c6991d4011\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:30.368015 kubelet[3423]: E0113 20:09:30.367672 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"8615086423d6201ef85384f1854ecd8c82e04e1edced15a3499ba0b0b99f7588\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:30.368015 kubelet[3423]: E0113 20:09:30.367767 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"8615086423d6201ef85384f1854ecd8c82e04e1edced15a3499ba0b0b99f7588\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/csi-node-driver-wq54r" Jan 13 20:09:30.368015 kubelet[3423]: E0113 20:09:30.367853 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"8615086423d6201ef85384f1854ecd8c82e04e1edced15a3499ba0b0b99f7588\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/csi-node-driver-wq54r" Jan 13 20:09:30.368522 kubelet[3423]: E0113 20:09:30.368204 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"csi-node-driver-wq54r_calico-system(d47fc662-eff9-4473-83da-b6f0b896d81f)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"csi-node-driver-wq54r_calico-system(d47fc662-eff9-4473-83da-b6f0b896d81f)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"8615086423d6201ef85384f1854ecd8c82e04e1edced15a3499ba0b0b99f7588\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-system/csi-node-driver-wq54r" podUID="d47fc662-eff9-4473-83da-b6f0b896d81f" Jan 13 20:09:30.371817 containerd[1934]: time="2025-01-13T20:09:30.370412753Z" level=error msg="encountered an error cleaning up failed sandbox \"034a1f3cd65e356f264d6b6a21d8604cdd13f23a1add7bf41ab327c6991d4011\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:30.372408 containerd[1934]: time="2025-01-13T20:09:30.372235217Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-7fbffcd8cd-wszl7,Uid:ad79c041-eaf1-4d57-9fb4-c3fb08680cb8,Namespace:calico-apiserver,Attempt:5,} failed, error" error="failed to setup network for sandbox \"034a1f3cd65e356f264d6b6a21d8604cdd13f23a1add7bf41ab327c6991d4011\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:30.373235 kubelet[3423]: E0113 20:09:30.372988 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"034a1f3cd65e356f264d6b6a21d8604cdd13f23a1add7bf41ab327c6991d4011\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:30.373358 kubelet[3423]: E0113 20:09:30.373322 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"034a1f3cd65e356f264d6b6a21d8604cdd13f23a1add7bf41ab327c6991d4011\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-wszl7" Jan 13 20:09:30.373751 kubelet[3423]: E0113 20:09:30.373718 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"034a1f3cd65e356f264d6b6a21d8604cdd13f23a1add7bf41ab327c6991d4011\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-wszl7" Jan 13 20:09:30.374062 kubelet[3423]: E0113 20:09:30.373911 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"calico-apiserver-7fbffcd8cd-wszl7_calico-apiserver(ad79c041-eaf1-4d57-9fb4-c3fb08680cb8)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"calico-apiserver-7fbffcd8cd-wszl7_calico-apiserver(ad79c041-eaf1-4d57-9fb4-c3fb08680cb8)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"034a1f3cd65e356f264d6b6a21d8604cdd13f23a1add7bf41ab327c6991d4011\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-wszl7" podUID="ad79c041-eaf1-4d57-9fb4-c3fb08680cb8" Jan 13 20:09:30.682378 kubelet[3423]: I0113 20:09:30.681686 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d368cfe07aba1c933544e6c62373b36a99071e5ffe92916bbd3e8ef7d96b68f2" Jan 13 20:09:30.686240 containerd[1934]: time="2025-01-13T20:09:30.685513183Z" level=info msg="StopPodSandbox for \"d368cfe07aba1c933544e6c62373b36a99071e5ffe92916bbd3e8ef7d96b68f2\"" Jan 13 20:09:30.690013 containerd[1934]: time="2025-01-13T20:09:30.686835139Z" level=info msg="Ensure that sandbox d368cfe07aba1c933544e6c62373b36a99071e5ffe92916bbd3e8ef7d96b68f2 in task-service has been cleanup successfully" Jan 13 20:09:30.690013 containerd[1934]: time="2025-01-13T20:09:30.688338151Z" level=info msg="TearDown network for sandbox \"d368cfe07aba1c933544e6c62373b36a99071e5ffe92916bbd3e8ef7d96b68f2\" successfully" Jan 13 20:09:30.690013 containerd[1934]: time="2025-01-13T20:09:30.688416463Z" level=info msg="StopPodSandbox for \"d368cfe07aba1c933544e6c62373b36a99071e5ffe92916bbd3e8ef7d96b68f2\" returns successfully" Jan 13 20:09:30.695016 containerd[1934]: time="2025-01-13T20:09:30.694160431Z" level=info msg="StopPodSandbox for \"e23a3567ec1b1a99aef5dba9eb89530d0582fb85108483f9212aaff1d6ab3bc3\"" Jan 13 20:09:30.695938 containerd[1934]: time="2025-01-13T20:09:30.695765083Z" level=info msg="TearDown network for sandbox \"e23a3567ec1b1a99aef5dba9eb89530d0582fb85108483f9212aaff1d6ab3bc3\" successfully" Jan 13 20:09:30.696384 containerd[1934]: time="2025-01-13T20:09:30.695928439Z" level=info msg="StopPodSandbox for \"e23a3567ec1b1a99aef5dba9eb89530d0582fb85108483f9212aaff1d6ab3bc3\" returns successfully" Jan 13 20:09:30.701664 containerd[1934]: time="2025-01-13T20:09:30.700581799Z" level=info msg="StopPodSandbox for \"ce26f7c56a292d1c5e76ccbca54d688912ff4e1c7e33ef8e71e3b8766f463517\"" Jan 13 20:09:30.701664 containerd[1934]: time="2025-01-13T20:09:30.701323183Z" level=info msg="TearDown network for sandbox \"ce26f7c56a292d1c5e76ccbca54d688912ff4e1c7e33ef8e71e3b8766f463517\" successfully" Jan 13 20:09:30.701664 containerd[1934]: time="2025-01-13T20:09:30.701423275Z" level=info msg="StopPodSandbox for \"ce26f7c56a292d1c5e76ccbca54d688912ff4e1c7e33ef8e71e3b8766f463517\" returns successfully" Jan 13 20:09:30.704199 containerd[1934]: time="2025-01-13T20:09:30.704139031Z" level=info msg="StopPodSandbox for \"bac2fe516cc564552b8be0fbca65a9d04eaace09e824ed2a17d9c03e83edae58\"" Jan 13 20:09:30.704417 containerd[1934]: time="2025-01-13T20:09:30.704376367Z" level=info msg="TearDown network for sandbox \"bac2fe516cc564552b8be0fbca65a9d04eaace09e824ed2a17d9c03e83edae58\" successfully" Jan 13 20:09:30.704492 containerd[1934]: time="2025-01-13T20:09:30.704411995Z" level=info msg="StopPodSandbox for \"bac2fe516cc564552b8be0fbca65a9d04eaace09e824ed2a17d9c03e83edae58\" returns successfully" Jan 13 20:09:30.706224 containerd[1934]: time="2025-01-13T20:09:30.706154083Z" level=info msg="StopPodSandbox for \"7d3190834f7286fc68261319021ff89fa2267e8e4a2bc44b60cdc8ec3736f03b\"" Jan 13 20:09:30.706413 containerd[1934]: time="2025-01-13T20:09:30.706372555Z" level=info msg="TearDown network for sandbox \"7d3190834f7286fc68261319021ff89fa2267e8e4a2bc44b60cdc8ec3736f03b\" successfully" Jan 13 20:09:30.706522 containerd[1934]: time="2025-01-13T20:09:30.706408159Z" level=info msg="StopPodSandbox for \"7d3190834f7286fc68261319021ff89fa2267e8e4a2bc44b60cdc8ec3736f03b\" returns successfully" Jan 13 20:09:30.709882 containerd[1934]: time="2025-01-13T20:09:30.709363819Z" level=info msg="StopPodSandbox for \"899dac68c4a2c7ede7e6073b33ab156f86e32973795b4e68f426b199aa5486a9\"" Jan 13 20:09:30.709882 containerd[1934]: time="2025-01-13T20:09:30.709567519Z" level=info msg="TearDown network for sandbox \"899dac68c4a2c7ede7e6073b33ab156f86e32973795b4e68f426b199aa5486a9\" successfully" Jan 13 20:09:30.709882 containerd[1934]: time="2025-01-13T20:09:30.709609015Z" level=info msg="StopPodSandbox for \"899dac68c4a2c7ede7e6073b33ab156f86e32973795b4e68f426b199aa5486a9\" returns successfully" Jan 13 20:09:30.711495 containerd[1934]: time="2025-01-13T20:09:30.711428095Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-76f75df574-mkr2l,Uid:396e30c8-d221-410a-89fe-e353ba8cddbf,Namespace:kube-system,Attempt:6,}" Jan 13 20:09:30.715130 kubelet[3423]: I0113 20:09:30.714183 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8615086423d6201ef85384f1854ecd8c82e04e1edced15a3499ba0b0b99f7588" Jan 13 20:09:30.718459 containerd[1934]: time="2025-01-13T20:09:30.717751795Z" level=info msg="StopPodSandbox for \"8615086423d6201ef85384f1854ecd8c82e04e1edced15a3499ba0b0b99f7588\"" Jan 13 20:09:30.718459 containerd[1934]: time="2025-01-13T20:09:30.718184659Z" level=info msg="Ensure that sandbox 8615086423d6201ef85384f1854ecd8c82e04e1edced15a3499ba0b0b99f7588 in task-service has been cleanup successfully" Jan 13 20:09:30.719026 containerd[1934]: time="2025-01-13T20:09:30.718905379Z" level=info msg="TearDown network for sandbox \"8615086423d6201ef85384f1854ecd8c82e04e1edced15a3499ba0b0b99f7588\" successfully" Jan 13 20:09:30.719187 containerd[1934]: time="2025-01-13T20:09:30.719159035Z" level=info msg="StopPodSandbox for \"8615086423d6201ef85384f1854ecd8c82e04e1edced15a3499ba0b0b99f7588\" returns successfully" Jan 13 20:09:30.724191 containerd[1934]: time="2025-01-13T20:09:30.724143835Z" level=info msg="StopPodSandbox for \"a04750e9fc31e16c9110301f495a11a345e09ad202ac48d631cc7f81772e7ec2\"" Jan 13 20:09:30.724598 containerd[1934]: time="2025-01-13T20:09:30.724546267Z" level=info msg="TearDown network for sandbox \"a04750e9fc31e16c9110301f495a11a345e09ad202ac48d631cc7f81772e7ec2\" successfully" Jan 13 20:09:30.724747 containerd[1934]: time="2025-01-13T20:09:30.724718371Z" level=info msg="StopPodSandbox for \"a04750e9fc31e16c9110301f495a11a345e09ad202ac48d631cc7f81772e7ec2\" returns successfully" Jan 13 20:09:30.727256 containerd[1934]: time="2025-01-13T20:09:30.727205743Z" level=info msg="StopPodSandbox for \"955f9fe6553205f6e71b94a6922fdece40d5d1a8c6a343e9a0aa0f4bf2abbb69\"" Jan 13 20:09:30.727706 containerd[1934]: time="2025-01-13T20:09:30.727558771Z" level=info msg="TearDown network for sandbox \"955f9fe6553205f6e71b94a6922fdece40d5d1a8c6a343e9a0aa0f4bf2abbb69\" successfully" Jan 13 20:09:30.727706 containerd[1934]: time="2025-01-13T20:09:30.727592383Z" level=info msg="StopPodSandbox for \"955f9fe6553205f6e71b94a6922fdece40d5d1a8c6a343e9a0aa0f4bf2abbb69\" returns successfully" Jan 13 20:09:30.732820 containerd[1934]: time="2025-01-13T20:09:30.732392719Z" level=info msg="StopPodSandbox for \"aeb47e19302f9c839c5fa002c506a56722057a24b2c06c5082b07dd07a783384\"" Jan 13 20:09:30.732820 containerd[1934]: time="2025-01-13T20:09:30.732568231Z" level=info msg="TearDown network for sandbox \"aeb47e19302f9c839c5fa002c506a56722057a24b2c06c5082b07dd07a783384\" successfully" Jan 13 20:09:30.732820 containerd[1934]: time="2025-01-13T20:09:30.732591055Z" level=info msg="StopPodSandbox for \"aeb47e19302f9c839c5fa002c506a56722057a24b2c06c5082b07dd07a783384\" returns successfully" Jan 13 20:09:30.734699 containerd[1934]: time="2025-01-13T20:09:30.734642215Z" level=info msg="StopPodSandbox for \"af4b04b9175c96b5f57bdaa5d05b254cb086cf984792052f87e1249b6c2e75f9\"" Jan 13 20:09:30.735082 containerd[1934]: time="2025-01-13T20:09:30.735049435Z" level=info msg="TearDown network for sandbox \"af4b04b9175c96b5f57bdaa5d05b254cb086cf984792052f87e1249b6c2e75f9\" successfully" Jan 13 20:09:30.735353 containerd[1934]: time="2025-01-13T20:09:30.735175123Z" level=info msg="StopPodSandbox for \"af4b04b9175c96b5f57bdaa5d05b254cb086cf984792052f87e1249b6c2e75f9\" returns successfully" Jan 13 20:09:30.738649 containerd[1934]: time="2025-01-13T20:09:30.738574399Z" level=info msg="StopPodSandbox for \"ccf56aafff1edbddd69e830448606d1ed364723341b141ed6867e7ed4d6b5f89\"" Jan 13 20:09:30.739217 containerd[1934]: time="2025-01-13T20:09:30.739001743Z" level=info msg="TearDown network for sandbox \"ccf56aafff1edbddd69e830448606d1ed364723341b141ed6867e7ed4d6b5f89\" successfully" Jan 13 20:09:30.739217 containerd[1934]: time="2025-01-13T20:09:30.739067107Z" level=info msg="StopPodSandbox for \"ccf56aafff1edbddd69e830448606d1ed364723341b141ed6867e7ed4d6b5f89\" returns successfully" Jan 13 20:09:30.740831 containerd[1934]: time="2025-01-13T20:09:30.740451655Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:csi-node-driver-wq54r,Uid:d47fc662-eff9-4473-83da-b6f0b896d81f,Namespace:calico-system,Attempt:6,}" Jan 13 20:09:30.744280 kubelet[3423]: I0113 20:09:30.744141 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="034a1f3cd65e356f264d6b6a21d8604cdd13f23a1add7bf41ab327c6991d4011" Jan 13 20:09:30.746560 containerd[1934]: time="2025-01-13T20:09:30.746017579Z" level=info msg="StopPodSandbox for \"034a1f3cd65e356f264d6b6a21d8604cdd13f23a1add7bf41ab327c6991d4011\"" Jan 13 20:09:30.746560 containerd[1934]: time="2025-01-13T20:09:30.746306059Z" level=info msg="Ensure that sandbox 034a1f3cd65e356f264d6b6a21d8604cdd13f23a1add7bf41ab327c6991d4011 in task-service has been cleanup successfully" Jan 13 20:09:30.749558 containerd[1934]: time="2025-01-13T20:09:30.749507611Z" level=info msg="TearDown network for sandbox \"034a1f3cd65e356f264d6b6a21d8604cdd13f23a1add7bf41ab327c6991d4011\" successfully" Jan 13 20:09:30.749868 containerd[1934]: time="2025-01-13T20:09:30.749812135Z" level=info msg="StopPodSandbox for \"034a1f3cd65e356f264d6b6a21d8604cdd13f23a1add7bf41ab327c6991d4011\" returns successfully" Jan 13 20:09:30.752394 containerd[1934]: time="2025-01-13T20:09:30.752345035Z" level=info msg="StopPodSandbox for \"e8d14d51164c0f7461d019f7892fb139ae5f1525115e3ca06b0affcaae9c0d5e\"" Jan 13 20:09:30.753309 containerd[1934]: time="2025-01-13T20:09:30.752865619Z" level=info msg="TearDown network for sandbox \"e8d14d51164c0f7461d019f7892fb139ae5f1525115e3ca06b0affcaae9c0d5e\" successfully" Jan 13 20:09:30.753309 containerd[1934]: time="2025-01-13T20:09:30.752901559Z" level=info msg="StopPodSandbox for \"e8d14d51164c0f7461d019f7892fb139ae5f1525115e3ca06b0affcaae9c0d5e\" returns successfully" Jan 13 20:09:30.756150 containerd[1934]: time="2025-01-13T20:09:30.755801455Z" level=info msg="StopPodSandbox for \"f25c71afbdf54c9739bfb9dedd7783f76e2a8415e053a98227128ef3211d4a56\"" Jan 13 20:09:30.758496 containerd[1934]: time="2025-01-13T20:09:30.758164483Z" level=info msg="TearDown network for sandbox \"f25c71afbdf54c9739bfb9dedd7783f76e2a8415e053a98227128ef3211d4a56\" successfully" Jan 13 20:09:30.758496 containerd[1934]: time="2025-01-13T20:09:30.758209651Z" level=info msg="StopPodSandbox for \"f25c71afbdf54c9739bfb9dedd7783f76e2a8415e053a98227128ef3211d4a56\" returns successfully" Jan 13 20:09:30.761451 containerd[1934]: time="2025-01-13T20:09:30.761367127Z" level=info msg="StopPodSandbox for \"d029da1857cffbc9aea56a8ec883ba4e1da56eae06a46e2e4ba0629832693cb0\"" Jan 13 20:09:30.763166 containerd[1934]: time="2025-01-13T20:09:30.762860695Z" level=info msg="TearDown network for sandbox \"d029da1857cffbc9aea56a8ec883ba4e1da56eae06a46e2e4ba0629832693cb0\" successfully" Jan 13 20:09:30.763166 containerd[1934]: time="2025-01-13T20:09:30.763105579Z" level=info msg="StopPodSandbox for \"d029da1857cffbc9aea56a8ec883ba4e1da56eae06a46e2e4ba0629832693cb0\" returns successfully" Jan 13 20:09:30.766425 containerd[1934]: time="2025-01-13T20:09:30.765975295Z" level=info msg="StopPodSandbox for \"cfa6ddb68ab8a55e2b4406871b279f8198e9a43957ec335f7facbf57b86881a3\"" Jan 13 20:09:30.766750 containerd[1934]: time="2025-01-13T20:09:30.766642411Z" level=info msg="TearDown network for sandbox \"cfa6ddb68ab8a55e2b4406871b279f8198e9a43957ec335f7facbf57b86881a3\" successfully" Jan 13 20:09:30.766750 containerd[1934]: time="2025-01-13T20:09:30.766679335Z" level=info msg="StopPodSandbox for \"cfa6ddb68ab8a55e2b4406871b279f8198e9a43957ec335f7facbf57b86881a3\" returns successfully" Jan 13 20:09:30.767873 containerd[1934]: time="2025-01-13T20:09:30.767834479Z" level=info msg="StopPodSandbox for \"fb565334446e5f8a46a1bd1f7f902b79f435864e841478f2f0a155d44cd33b41\"" Jan 13 20:09:30.768359 containerd[1934]: time="2025-01-13T20:09:30.768291307Z" level=info msg="TearDown network for sandbox \"fb565334446e5f8a46a1bd1f7f902b79f435864e841478f2f0a155d44cd33b41\" successfully" Jan 13 20:09:30.768695 containerd[1934]: time="2025-01-13T20:09:30.768457855Z" level=info msg="StopPodSandbox for \"fb565334446e5f8a46a1bd1f7f902b79f435864e841478f2f0a155d44cd33b41\" returns successfully" Jan 13 20:09:30.770622 kubelet[3423]: I0113 20:09:30.770055 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eede6c995fce264cd780e29e58a08fa68b4c54baafa60c3289b9cd92b98c7c6c" Jan 13 20:09:30.771533 containerd[1934]: time="2025-01-13T20:09:30.771070423Z" level=info msg="StopPodSandbox for \"eede6c995fce264cd780e29e58a08fa68b4c54baafa60c3289b9cd92b98c7c6c\"" Jan 13 20:09:30.771533 containerd[1934]: time="2025-01-13T20:09:30.771357103Z" level=info msg="Ensure that sandbox eede6c995fce264cd780e29e58a08fa68b4c54baafa60c3289b9cd92b98c7c6c in task-service has been cleanup successfully" Jan 13 20:09:30.772184 containerd[1934]: time="2025-01-13T20:09:30.772125571Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-7fbffcd8cd-wszl7,Uid:ad79c041-eaf1-4d57-9fb4-c3fb08680cb8,Namespace:calico-apiserver,Attempt:6,}" Jan 13 20:09:30.774821 containerd[1934]: time="2025-01-13T20:09:30.774696271Z" level=info msg="TearDown network for sandbox \"eede6c995fce264cd780e29e58a08fa68b4c54baafa60c3289b9cd92b98c7c6c\" successfully" Jan 13 20:09:30.775004 containerd[1934]: time="2025-01-13T20:09:30.774973711Z" level=info msg="StopPodSandbox for \"eede6c995fce264cd780e29e58a08fa68b4c54baafa60c3289b9cd92b98c7c6c\" returns successfully" Jan 13 20:09:30.776456 containerd[1934]: time="2025-01-13T20:09:30.776405803Z" level=info msg="StopPodSandbox for \"c8d12cba52fd60ec08cc5638f4d4379aae8d673464810205dafbb978080837b3\"" Jan 13 20:09:30.777190 containerd[1934]: time="2025-01-13T20:09:30.777028519Z" level=info msg="TearDown network for sandbox \"c8d12cba52fd60ec08cc5638f4d4379aae8d673464810205dafbb978080837b3\" successfully" Jan 13 20:09:30.777190 containerd[1934]: time="2025-01-13T20:09:30.777065479Z" level=info msg="StopPodSandbox for \"c8d12cba52fd60ec08cc5638f4d4379aae8d673464810205dafbb978080837b3\" returns successfully" Jan 13 20:09:30.779406 containerd[1934]: time="2025-01-13T20:09:30.779253571Z" level=info msg="StopPodSandbox for \"d179e7ae754d81c958ff901cb7c596dc225e5822f67938ade6bc971cc1e73234\"" Jan 13 20:09:30.779562 containerd[1934]: time="2025-01-13T20:09:30.779463079Z" level=info msg="TearDown network for sandbox \"d179e7ae754d81c958ff901cb7c596dc225e5822f67938ade6bc971cc1e73234\" successfully" Jan 13 20:09:30.779562 containerd[1934]: time="2025-01-13T20:09:30.779487391Z" level=info msg="StopPodSandbox for \"d179e7ae754d81c958ff901cb7c596dc225e5822f67938ade6bc971cc1e73234\" returns successfully" Jan 13 20:09:30.781540 containerd[1934]: time="2025-01-13T20:09:30.780885799Z" level=info msg="StopPodSandbox for \"8c0c460fc82d1c51ed146afb77bb0cdfb42636cd5b1ebd0d7d108e8d75eb9610\"" Jan 13 20:09:30.781540 containerd[1934]: time="2025-01-13T20:09:30.781075891Z" level=info msg="TearDown network for sandbox \"8c0c460fc82d1c51ed146afb77bb0cdfb42636cd5b1ebd0d7d108e8d75eb9610\" successfully" Jan 13 20:09:30.781540 containerd[1934]: time="2025-01-13T20:09:30.781130071Z" level=info msg="StopPodSandbox for \"8c0c460fc82d1c51ed146afb77bb0cdfb42636cd5b1ebd0d7d108e8d75eb9610\" returns successfully" Jan 13 20:09:30.783344 containerd[1934]: time="2025-01-13T20:09:30.783284083Z" level=info msg="StopPodSandbox for \"eed11d015ff645b963130f5ad956d107f391cbaba3451e015229fc4082c60951\"" Jan 13 20:09:30.784857 containerd[1934]: time="2025-01-13T20:09:30.784761979Z" level=info msg="TearDown network for sandbox \"eed11d015ff645b963130f5ad956d107f391cbaba3451e015229fc4082c60951\" successfully" Jan 13 20:09:30.784857 containerd[1934]: time="2025-01-13T20:09:30.784834927Z" level=info msg="StopPodSandbox for \"eed11d015ff645b963130f5ad956d107f391cbaba3451e015229fc4082c60951\" returns successfully" Jan 13 20:09:30.786008 containerd[1934]: time="2025-01-13T20:09:30.785966647Z" level=info msg="StopPodSandbox for \"f5e883fc61f95c31957335ed367bbb8d4c07a9c5470ee6e51fca5c2bde0bfb8c\"" Jan 13 20:09:30.786317 containerd[1934]: time="2025-01-13T20:09:30.786289327Z" level=info msg="TearDown network for sandbox \"f5e883fc61f95c31957335ed367bbb8d4c07a9c5470ee6e51fca5c2bde0bfb8c\" successfully" Jan 13 20:09:30.787103 containerd[1934]: time="2025-01-13T20:09:30.787018435Z" level=info msg="StopPodSandbox for \"f5e883fc61f95c31957335ed367bbb8d4c07a9c5470ee6e51fca5c2bde0bfb8c\" returns successfully" Jan 13 20:09:30.790374 containerd[1934]: time="2025-01-13T20:09:30.789074287Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-76f75df574-8wp6k,Uid:87115657-f395-40ec-89ea-3d7835119c3a,Namespace:kube-system,Attempt:6,}" Jan 13 20:09:30.794141 kubelet[3423]: I0113 20:09:30.793943 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3738e8149db8a55a4134f2d90b1a13f28ee725b71b142d59f0f32a083d31ab02" Jan 13 20:09:30.797369 containerd[1934]: time="2025-01-13T20:09:30.797315395Z" level=info msg="StopPodSandbox for \"3738e8149db8a55a4134f2d90b1a13f28ee725b71b142d59f0f32a083d31ab02\"" Jan 13 20:09:30.798569 containerd[1934]: time="2025-01-13T20:09:30.798490399Z" level=info msg="Ensure that sandbox 3738e8149db8a55a4134f2d90b1a13f28ee725b71b142d59f0f32a083d31ab02 in task-service has been cleanup successfully" Jan 13 20:09:30.802992 containerd[1934]: time="2025-01-13T20:09:30.802827787Z" level=info msg="TearDown network for sandbox \"3738e8149db8a55a4134f2d90b1a13f28ee725b71b142d59f0f32a083d31ab02\" successfully" Jan 13 20:09:30.802992 containerd[1934]: time="2025-01-13T20:09:30.802877515Z" level=info msg="StopPodSandbox for \"3738e8149db8a55a4134f2d90b1a13f28ee725b71b142d59f0f32a083d31ab02\" returns successfully" Jan 13 20:09:30.807820 containerd[1934]: time="2025-01-13T20:09:30.807446707Z" level=info msg="StopPodSandbox for \"a7aac01fa45d89b04a7cb486ede3be4574f65135e039463be287ff48831441a8\"" Jan 13 20:09:30.807820 containerd[1934]: time="2025-01-13T20:09:30.807602719Z" level=info msg="TearDown network for sandbox \"a7aac01fa45d89b04a7cb486ede3be4574f65135e039463be287ff48831441a8\" successfully" Jan 13 20:09:30.807820 containerd[1934]: time="2025-01-13T20:09:30.807624439Z" level=info msg="StopPodSandbox for \"a7aac01fa45d89b04a7cb486ede3be4574f65135e039463be287ff48831441a8\" returns successfully" Jan 13 20:09:30.810322 containerd[1934]: time="2025-01-13T20:09:30.810272107Z" level=info msg="StopPodSandbox for \"a37a24fcb9897952ccabcc8cb7045bb7b0ef0fe4b98a8ca3b53ea6f6cf157017\"" Jan 13 20:09:30.810868 containerd[1934]: time="2025-01-13T20:09:30.810741943Z" level=info msg="TearDown network for sandbox \"a37a24fcb9897952ccabcc8cb7045bb7b0ef0fe4b98a8ca3b53ea6f6cf157017\" successfully" Jan 13 20:09:30.810868 containerd[1934]: time="2025-01-13T20:09:30.810805411Z" level=info msg="StopPodSandbox for \"a37a24fcb9897952ccabcc8cb7045bb7b0ef0fe4b98a8ca3b53ea6f6cf157017\" returns successfully" Jan 13 20:09:30.813991 containerd[1934]: time="2025-01-13T20:09:30.813941911Z" level=info msg="StopPodSandbox for \"e31eca7a421d12ab04696c6ee4fefbcfc3ab887e88d76deb901fc6a512e76618\"" Jan 13 20:09:30.814838 containerd[1934]: time="2025-01-13T20:09:30.814514707Z" level=info msg="TearDown network for sandbox \"e31eca7a421d12ab04696c6ee4fefbcfc3ab887e88d76deb901fc6a512e76618\" successfully" Jan 13 20:09:30.814838 containerd[1934]: time="2025-01-13T20:09:30.814548367Z" level=info msg="StopPodSandbox for \"e31eca7a421d12ab04696c6ee4fefbcfc3ab887e88d76deb901fc6a512e76618\" returns successfully" Jan 13 20:09:30.816552 containerd[1934]: time="2025-01-13T20:09:30.816484340Z" level=info msg="StopPodSandbox for \"2accd017db7708cc1fa5c6da328b2f1c3f1c063e1b4b76d232d0c4e3cdca6a6d\"" Jan 13 20:09:30.816790 containerd[1934]: time="2025-01-13T20:09:30.816731384Z" level=info msg="TearDown network for sandbox \"2accd017db7708cc1fa5c6da328b2f1c3f1c063e1b4b76d232d0c4e3cdca6a6d\" successfully" Jan 13 20:09:30.816877 containerd[1934]: time="2025-01-13T20:09:30.816766616Z" level=info msg="StopPodSandbox for \"2accd017db7708cc1fa5c6da328b2f1c3f1c063e1b4b76d232d0c4e3cdca6a6d\" returns successfully" Jan 13 20:09:30.819044 containerd[1934]: time="2025-01-13T20:09:30.818712752Z" level=info msg="StopPodSandbox for \"c787f8945e5c1c02a132aebe2ce54537e8efb76054bd3d61620dd081ac229a87\"" Jan 13 20:09:30.821258 containerd[1934]: time="2025-01-13T20:09:30.821197028Z" level=info msg="TearDown network for sandbox \"c787f8945e5c1c02a132aebe2ce54537e8efb76054bd3d61620dd081ac229a87\" successfully" Jan 13 20:09:30.821258 containerd[1934]: time="2025-01-13T20:09:30.821244092Z" level=info msg="StopPodSandbox for \"c787f8945e5c1c02a132aebe2ce54537e8efb76054bd3d61620dd081ac229a87\" returns successfully" Jan 13 20:09:30.822797 kubelet[3423]: I0113 20:09:30.821984 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="538f604b05684d3571dee3d0a58795500745c5ecc1a4cabbf340ef00fa2e3044" Jan 13 20:09:30.828305 containerd[1934]: time="2025-01-13T20:09:30.827856056Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-7fbffcd8cd-pxvdr,Uid:8f72f896-c0ba-4b07-9a22-acc5c8ca3697,Namespace:calico-apiserver,Attempt:6,}" Jan 13 20:09:30.845341 containerd[1934]: time="2025-01-13T20:09:30.829664312Z" level=info msg="StopPodSandbox for \"538f604b05684d3571dee3d0a58795500745c5ecc1a4cabbf340ef00fa2e3044\"" Jan 13 20:09:30.845341 containerd[1934]: time="2025-01-13T20:09:30.835237376Z" level=info msg="Ensure that sandbox 538f604b05684d3571dee3d0a58795500745c5ecc1a4cabbf340ef00fa2e3044 in task-service has been cleanup successfully" Jan 13 20:09:30.845341 containerd[1934]: time="2025-01-13T20:09:30.840592172Z" level=info msg="TearDown network for sandbox \"538f604b05684d3571dee3d0a58795500745c5ecc1a4cabbf340ef00fa2e3044\" successfully" Jan 13 20:09:30.845341 containerd[1934]: time="2025-01-13T20:09:30.840638120Z" level=info msg="StopPodSandbox for \"538f604b05684d3571dee3d0a58795500745c5ecc1a4cabbf340ef00fa2e3044\" returns successfully" Jan 13 20:09:30.845341 containerd[1934]: time="2025-01-13T20:09:30.842109248Z" level=info msg="StopPodSandbox for \"37e8d359f609f540d9e2f49bc83e7f3d5e4296810bef7cdacf10f479884043e5\"" Jan 13 20:09:30.845341 containerd[1934]: time="2025-01-13T20:09:30.842276216Z" level=info msg="TearDown network for sandbox \"37e8d359f609f540d9e2f49bc83e7f3d5e4296810bef7cdacf10f479884043e5\" successfully" Jan 13 20:09:30.845341 containerd[1934]: time="2025-01-13T20:09:30.842299364Z" level=info msg="StopPodSandbox for \"37e8d359f609f540d9e2f49bc83e7f3d5e4296810bef7cdacf10f479884043e5\" returns successfully" Jan 13 20:09:30.845341 containerd[1934]: time="2025-01-13T20:09:30.845013296Z" level=info msg="StopPodSandbox for \"bb64b66507a4d3948827c99dee10022276bd2b85dcce58713749456b89a5723b\"" Jan 13 20:09:30.845932 containerd[1934]: time="2025-01-13T20:09:30.845893280Z" level=info msg="TearDown network for sandbox \"bb64b66507a4d3948827c99dee10022276bd2b85dcce58713749456b89a5723b\" successfully" Jan 13 20:09:30.846046 containerd[1934]: time="2025-01-13T20:09:30.846019268Z" level=info msg="StopPodSandbox for \"bb64b66507a4d3948827c99dee10022276bd2b85dcce58713749456b89a5723b\" returns successfully" Jan 13 20:09:30.847854 containerd[1934]: time="2025-01-13T20:09:30.847798520Z" level=info msg="StopPodSandbox for \"3999268688ddddddb7ec9df611d8146f50072274600306787cd56688f110d548\"" Jan 13 20:09:30.848693 containerd[1934]: time="2025-01-13T20:09:30.848656136Z" level=info msg="TearDown network for sandbox \"3999268688ddddddb7ec9df611d8146f50072274600306787cd56688f110d548\" successfully" Jan 13 20:09:30.850923 containerd[1934]: time="2025-01-13T20:09:30.850867112Z" level=info msg="StopPodSandbox for \"3999268688ddddddb7ec9df611d8146f50072274600306787cd56688f110d548\" returns successfully" Jan 13 20:09:30.852799 containerd[1934]: time="2025-01-13T20:09:30.852172916Z" level=info msg="StopPodSandbox for \"a86b825795730ba2f9f58fb14a41879f6cdba9ae4550e62d02a587d4dd982d06\"" Jan 13 20:09:30.852799 containerd[1934]: time="2025-01-13T20:09:30.852341132Z" level=info msg="TearDown network for sandbox \"a86b825795730ba2f9f58fb14a41879f6cdba9ae4550e62d02a587d4dd982d06\" successfully" Jan 13 20:09:30.852799 containerd[1934]: time="2025-01-13T20:09:30.852363380Z" level=info msg="StopPodSandbox for \"a86b825795730ba2f9f58fb14a41879f6cdba9ae4550e62d02a587d4dd982d06\" returns successfully" Jan 13 20:09:30.855340 containerd[1934]: time="2025-01-13T20:09:30.855285980Z" level=info msg="StopPodSandbox for \"57f3ef7b6cf66ed3ed7b779c226fa67874c55496cae0804a70bff6ecec1ef212\"" Jan 13 20:09:30.857040 containerd[1934]: time="2025-01-13T20:09:30.856983236Z" level=info msg="TearDown network for sandbox \"57f3ef7b6cf66ed3ed7b779c226fa67874c55496cae0804a70bff6ecec1ef212\" successfully" Jan 13 20:09:30.857214 containerd[1934]: time="2025-01-13T20:09:30.857185748Z" level=info msg="StopPodSandbox for \"57f3ef7b6cf66ed3ed7b779c226fa67874c55496cae0804a70bff6ecec1ef212\" returns successfully" Jan 13 20:09:30.859254 containerd[1934]: time="2025-01-13T20:09:30.859182404Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-kube-controllers-68f76c7ddf-lh8nj,Uid:2be21c11-9c2d-4b9a-81a5-0e73daba31c1,Namespace:calico-system,Attempt:6,}" Jan 13 20:09:31.046388 systemd[1]: run-netns-cni\x2d66d8bb81\x2d23ad\x2d5c60\x2d4519\x2d0256d7d3b142.mount: Deactivated successfully. Jan 13 20:09:31.046561 systemd[1]: run-netns-cni\x2d3afc5d50\x2d3c4f\x2d47c3\x2decd1\x2d83347d688521.mount: Deactivated successfully. Jan 13 20:09:31.046693 systemd[1]: run-netns-cni\x2db7583de0\x2d55c6\x2dffde\x2d5f21\x2df9fa19870bd8.mount: Deactivated successfully. Jan 13 20:09:31.046840 systemd[1]: run-netns-cni\x2da35a0071\x2da480\x2dd051\x2dd3fb\x2d128db3ab1a02.mount: Deactivated successfully. Jan 13 20:09:31.046969 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-8615086423d6201ef85384f1854ecd8c82e04e1edced15a3499ba0b0b99f7588-shm.mount: Deactivated successfully. Jan 13 20:09:31.047096 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-034a1f3cd65e356f264d6b6a21d8604cdd13f23a1add7bf41ab327c6991d4011-shm.mount: Deactivated successfully. Jan 13 20:09:31.047224 systemd[1]: run-netns-cni\x2d42515964\x2dd16f\x2d8421\x2da91b\x2d9357a375a13d.mount: Deactivated successfully. Jan 13 20:09:31.047347 systemd[1]: run-netns-cni\x2d29da8f5a\x2d6ebf\x2d5967\x2df335\x2d606ce8cee1ae.mount: Deactivated successfully. Jan 13 20:09:31.238908 containerd[1934]: time="2025-01-13T20:09:31.234444294Z" level=error msg="Failed to destroy network for sandbox \"2f9666670aab61aa1c36a5c18b2c6e8e3d08bf1cfc3f42fb8cc1ef7244f4257c\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:31.242024 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-2f9666670aab61aa1c36a5c18b2c6e8e3d08bf1cfc3f42fb8cc1ef7244f4257c-shm.mount: Deactivated successfully. Jan 13 20:09:31.246281 containerd[1934]: time="2025-01-13T20:09:31.246209886Z" level=error msg="encountered an error cleaning up failed sandbox \"2f9666670aab61aa1c36a5c18b2c6e8e3d08bf1cfc3f42fb8cc1ef7244f4257c\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:31.246432 containerd[1934]: time="2025-01-13T20:09:31.246320682Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-76f75df574-mkr2l,Uid:396e30c8-d221-410a-89fe-e353ba8cddbf,Namespace:kube-system,Attempt:6,} failed, error" error="failed to setup network for sandbox \"2f9666670aab61aa1c36a5c18b2c6e8e3d08bf1cfc3f42fb8cc1ef7244f4257c\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:31.249899 kubelet[3423]: E0113 20:09:31.249838 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"2f9666670aab61aa1c36a5c18b2c6e8e3d08bf1cfc3f42fb8cc1ef7244f4257c\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:31.250478 kubelet[3423]: E0113 20:09:31.250107 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"2f9666670aab61aa1c36a5c18b2c6e8e3d08bf1cfc3f42fb8cc1ef7244f4257c\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-76f75df574-mkr2l" Jan 13 20:09:31.250478 kubelet[3423]: E0113 20:09:31.250281 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"2f9666670aab61aa1c36a5c18b2c6e8e3d08bf1cfc3f42fb8cc1ef7244f4257c\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-76f75df574-mkr2l" Jan 13 20:09:31.250856 kubelet[3423]: E0113 20:09:31.250521 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-76f75df574-mkr2l_kube-system(396e30c8-d221-410a-89fe-e353ba8cddbf)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-76f75df574-mkr2l_kube-system(396e30c8-d221-410a-89fe-e353ba8cddbf)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"2f9666670aab61aa1c36a5c18b2c6e8e3d08bf1cfc3f42fb8cc1ef7244f4257c\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="kube-system/coredns-76f75df574-mkr2l" podUID="396e30c8-d221-410a-89fe-e353ba8cddbf" Jan 13 20:09:31.273642 containerd[1934]: time="2025-01-13T20:09:31.273387006Z" level=error msg="Failed to destroy network for sandbox \"dfb5cc6aa8ee548a0817f76e636f6ba17a9915fccdeb0f77deba61f58d7154ee\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:31.280258 containerd[1934]: time="2025-01-13T20:09:31.279398802Z" level=error msg="encountered an error cleaning up failed sandbox \"dfb5cc6aa8ee548a0817f76e636f6ba17a9915fccdeb0f77deba61f58d7154ee\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:31.280258 containerd[1934]: time="2025-01-13T20:09:31.279507426Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:csi-node-driver-wq54r,Uid:d47fc662-eff9-4473-83da-b6f0b896d81f,Namespace:calico-system,Attempt:6,} failed, error" error="failed to setup network for sandbox \"dfb5cc6aa8ee548a0817f76e636f6ba17a9915fccdeb0f77deba61f58d7154ee\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:31.280473 kubelet[3423]: E0113 20:09:31.279851 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"dfb5cc6aa8ee548a0817f76e636f6ba17a9915fccdeb0f77deba61f58d7154ee\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:31.280473 kubelet[3423]: E0113 20:09:31.279937 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"dfb5cc6aa8ee548a0817f76e636f6ba17a9915fccdeb0f77deba61f58d7154ee\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/csi-node-driver-wq54r" Jan 13 20:09:31.280473 kubelet[3423]: E0113 20:09:31.279978 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"dfb5cc6aa8ee548a0817f76e636f6ba17a9915fccdeb0f77deba61f58d7154ee\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/csi-node-driver-wq54r" Jan 13 20:09:31.280647 kubelet[3423]: E0113 20:09:31.280062 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"csi-node-driver-wq54r_calico-system(d47fc662-eff9-4473-83da-b6f0b896d81f)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"csi-node-driver-wq54r_calico-system(d47fc662-eff9-4473-83da-b6f0b896d81f)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"dfb5cc6aa8ee548a0817f76e636f6ba17a9915fccdeb0f77deba61f58d7154ee\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-system/csi-node-driver-wq54r" podUID="d47fc662-eff9-4473-83da-b6f0b896d81f" Jan 13 20:09:31.284511 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-dfb5cc6aa8ee548a0817f76e636f6ba17a9915fccdeb0f77deba61f58d7154ee-shm.mount: Deactivated successfully. Jan 13 20:09:31.315259 containerd[1934]: time="2025-01-13T20:09:31.314650422Z" level=error msg="Failed to destroy network for sandbox \"fe203c0f7fc44f83207d781bd972b7ee26dab60b101be6081c8e7f2c82858f26\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:31.324179 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-fe203c0f7fc44f83207d781bd972b7ee26dab60b101be6081c8e7f2c82858f26-shm.mount: Deactivated successfully. Jan 13 20:09:31.328276 containerd[1934]: time="2025-01-13T20:09:31.328197318Z" level=error msg="encountered an error cleaning up failed sandbox \"fe203c0f7fc44f83207d781bd972b7ee26dab60b101be6081c8e7f2c82858f26\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:31.328960 containerd[1934]: time="2025-01-13T20:09:31.328315830Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-7fbffcd8cd-wszl7,Uid:ad79c041-eaf1-4d57-9fb4-c3fb08680cb8,Namespace:calico-apiserver,Attempt:6,} failed, error" error="failed to setup network for sandbox \"fe203c0f7fc44f83207d781bd972b7ee26dab60b101be6081c8e7f2c82858f26\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:31.330495 kubelet[3423]: E0113 20:09:31.328625 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"fe203c0f7fc44f83207d781bd972b7ee26dab60b101be6081c8e7f2c82858f26\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:31.330495 kubelet[3423]: E0113 20:09:31.328957 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"fe203c0f7fc44f83207d781bd972b7ee26dab60b101be6081c8e7f2c82858f26\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-wszl7" Jan 13 20:09:31.330495 kubelet[3423]: E0113 20:09:31.329038 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"fe203c0f7fc44f83207d781bd972b7ee26dab60b101be6081c8e7f2c82858f26\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-wszl7" Jan 13 20:09:31.331041 kubelet[3423]: E0113 20:09:31.329537 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"calico-apiserver-7fbffcd8cd-wszl7_calico-apiserver(ad79c041-eaf1-4d57-9fb4-c3fb08680cb8)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"calico-apiserver-7fbffcd8cd-wszl7_calico-apiserver(ad79c041-eaf1-4d57-9fb4-c3fb08680cb8)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"fe203c0f7fc44f83207d781bd972b7ee26dab60b101be6081c8e7f2c82858f26\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-wszl7" podUID="ad79c041-eaf1-4d57-9fb4-c3fb08680cb8" Jan 13 20:09:31.445090 containerd[1934]: time="2025-01-13T20:09:31.444998863Z" level=error msg="Failed to destroy network for sandbox \"871bb94da403609229c4f8c4907a3c7c7ff537ef7b689806a251f0915d567eea\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:31.449805 containerd[1934]: time="2025-01-13T20:09:31.448900483Z" level=error msg="encountered an error cleaning up failed sandbox \"871bb94da403609229c4f8c4907a3c7c7ff537ef7b689806a251f0915d567eea\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:31.452863 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-871bb94da403609229c4f8c4907a3c7c7ff537ef7b689806a251f0915d567eea-shm.mount: Deactivated successfully. Jan 13 20:09:31.455837 containerd[1934]: time="2025-01-13T20:09:31.455758087Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-76f75df574-8wp6k,Uid:87115657-f395-40ec-89ea-3d7835119c3a,Namespace:kube-system,Attempt:6,} failed, error" error="failed to setup network for sandbox \"871bb94da403609229c4f8c4907a3c7c7ff537ef7b689806a251f0915d567eea\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:31.456797 kubelet[3423]: E0113 20:09:31.456571 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"871bb94da403609229c4f8c4907a3c7c7ff537ef7b689806a251f0915d567eea\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:31.456797 kubelet[3423]: E0113 20:09:31.456657 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"871bb94da403609229c4f8c4907a3c7c7ff537ef7b689806a251f0915d567eea\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-76f75df574-8wp6k" Jan 13 20:09:31.456797 kubelet[3423]: E0113 20:09:31.456702 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"871bb94da403609229c4f8c4907a3c7c7ff537ef7b689806a251f0915d567eea\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-76f75df574-8wp6k" Jan 13 20:09:31.459004 kubelet[3423]: E0113 20:09:31.458896 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-76f75df574-8wp6k_kube-system(87115657-f395-40ec-89ea-3d7835119c3a)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-76f75df574-8wp6k_kube-system(87115657-f395-40ec-89ea-3d7835119c3a)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"871bb94da403609229c4f8c4907a3c7c7ff537ef7b689806a251f0915d567eea\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="kube-system/coredns-76f75df574-8wp6k" podUID="87115657-f395-40ec-89ea-3d7835119c3a" Jan 13 20:09:31.469477 containerd[1934]: time="2025-01-13T20:09:31.469166059Z" level=error msg="Failed to destroy network for sandbox \"4a448ddaae657a72707e2505e7b6329129c1ea98f60de221b826b6b205a6ff6b\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:31.471241 containerd[1934]: time="2025-01-13T20:09:31.470818087Z" level=error msg="encountered an error cleaning up failed sandbox \"4a448ddaae657a72707e2505e7b6329129c1ea98f60de221b826b6b205a6ff6b\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:31.471241 containerd[1934]: time="2025-01-13T20:09:31.470929435Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-7fbffcd8cd-pxvdr,Uid:8f72f896-c0ba-4b07-9a22-acc5c8ca3697,Namespace:calico-apiserver,Attempt:6,} failed, error" error="failed to setup network for sandbox \"4a448ddaae657a72707e2505e7b6329129c1ea98f60de221b826b6b205a6ff6b\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:31.471601 kubelet[3423]: E0113 20:09:31.471414 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"4a448ddaae657a72707e2505e7b6329129c1ea98f60de221b826b6b205a6ff6b\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:31.471601 kubelet[3423]: E0113 20:09:31.471487 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"4a448ddaae657a72707e2505e7b6329129c1ea98f60de221b826b6b205a6ff6b\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-pxvdr" Jan 13 20:09:31.471601 kubelet[3423]: E0113 20:09:31.471526 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"4a448ddaae657a72707e2505e7b6329129c1ea98f60de221b826b6b205a6ff6b\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-pxvdr" Jan 13 20:09:31.472099 kubelet[3423]: E0113 20:09:31.471628 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"calico-apiserver-7fbffcd8cd-pxvdr_calico-apiserver(8f72f896-c0ba-4b07-9a22-acc5c8ca3697)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"calico-apiserver-7fbffcd8cd-pxvdr_calico-apiserver(8f72f896-c0ba-4b07-9a22-acc5c8ca3697)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"4a448ddaae657a72707e2505e7b6329129c1ea98f60de221b826b6b205a6ff6b\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-pxvdr" podUID="8f72f896-c0ba-4b07-9a22-acc5c8ca3697" Jan 13 20:09:31.478527 containerd[1934]: time="2025-01-13T20:09:31.478462711Z" level=error msg="Failed to destroy network for sandbox \"4d3ce37a9c40510fd9d66de0b8c2ac5802b7067c8efb617b93564f6bfe5a5223\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:31.480728 containerd[1934]: time="2025-01-13T20:09:31.479812879Z" level=error msg="encountered an error cleaning up failed sandbox \"4d3ce37a9c40510fd9d66de0b8c2ac5802b7067c8efb617b93564f6bfe5a5223\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:31.480728 containerd[1934]: time="2025-01-13T20:09:31.479925943Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-kube-controllers-68f76c7ddf-lh8nj,Uid:2be21c11-9c2d-4b9a-81a5-0e73daba31c1,Namespace:calico-system,Attempt:6,} failed, error" error="failed to setup network for sandbox \"4d3ce37a9c40510fd9d66de0b8c2ac5802b7067c8efb617b93564f6bfe5a5223\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:31.481328 kubelet[3423]: E0113 20:09:31.480304 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"4d3ce37a9c40510fd9d66de0b8c2ac5802b7067c8efb617b93564f6bfe5a5223\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:31.481328 kubelet[3423]: E0113 20:09:31.480386 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"4d3ce37a9c40510fd9d66de0b8c2ac5802b7067c8efb617b93564f6bfe5a5223\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/calico-kube-controllers-68f76c7ddf-lh8nj" Jan 13 20:09:31.481328 kubelet[3423]: E0113 20:09:31.480427 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"4d3ce37a9c40510fd9d66de0b8c2ac5802b7067c8efb617b93564f6bfe5a5223\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/calico-kube-controllers-68f76c7ddf-lh8nj" Jan 13 20:09:31.481543 kubelet[3423]: E0113 20:09:31.480514 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"calico-kube-controllers-68f76c7ddf-lh8nj_calico-system(2be21c11-9c2d-4b9a-81a5-0e73daba31c1)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"calico-kube-controllers-68f76c7ddf-lh8nj_calico-system(2be21c11-9c2d-4b9a-81a5-0e73daba31c1)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"4d3ce37a9c40510fd9d66de0b8c2ac5802b7067c8efb617b93564f6bfe5a5223\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-system/calico-kube-controllers-68f76c7ddf-lh8nj" podUID="2be21c11-9c2d-4b9a-81a5-0e73daba31c1" Jan 13 20:09:31.778389 systemd[1]: Started sshd@12-172.31.28.23:22-147.75.109.163:40178.service - OpenSSH per-connection server daemon (147.75.109.163:40178). Jan 13 20:09:31.800980 containerd[1934]: time="2025-01-13T20:09:31.800922740Z" level=info msg="StopPodSandbox for \"899dac68c4a2c7ede7e6073b33ab156f86e32973795b4e68f426b199aa5486a9\"" Jan 13 20:09:31.803112 containerd[1934]: time="2025-01-13T20:09:31.802549040Z" level=info msg="TearDown network for sandbox \"899dac68c4a2c7ede7e6073b33ab156f86e32973795b4e68f426b199aa5486a9\" successfully" Jan 13 20:09:31.803243 containerd[1934]: time="2025-01-13T20:09:31.803201936Z" level=info msg="StopPodSandbox for \"899dac68c4a2c7ede7e6073b33ab156f86e32973795b4e68f426b199aa5486a9\" returns successfully" Jan 13 20:09:31.807439 containerd[1934]: time="2025-01-13T20:09:31.805905272Z" level=info msg="RemovePodSandbox for \"899dac68c4a2c7ede7e6073b33ab156f86e32973795b4e68f426b199aa5486a9\"" Jan 13 20:09:31.807439 containerd[1934]: time="2025-01-13T20:09:31.805963976Z" level=info msg="Forcibly stopping sandbox \"899dac68c4a2c7ede7e6073b33ab156f86e32973795b4e68f426b199aa5486a9\"" Jan 13 20:09:31.807439 containerd[1934]: time="2025-01-13T20:09:31.806095196Z" level=info msg="TearDown network for sandbox \"899dac68c4a2c7ede7e6073b33ab156f86e32973795b4e68f426b199aa5486a9\" successfully" Jan 13 20:09:31.840542 containerd[1934]: time="2025-01-13T20:09:31.840169461Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"899dac68c4a2c7ede7e6073b33ab156f86e32973795b4e68f426b199aa5486a9\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:09:31.840542 containerd[1934]: time="2025-01-13T20:09:31.840260289Z" level=info msg="RemovePodSandbox \"899dac68c4a2c7ede7e6073b33ab156f86e32973795b4e68f426b199aa5486a9\" returns successfully" Jan 13 20:09:31.844946 containerd[1934]: time="2025-01-13T20:09:31.844897905Z" level=info msg="StopPodSandbox for \"7d3190834f7286fc68261319021ff89fa2267e8e4a2bc44b60cdc8ec3736f03b\"" Jan 13 20:09:31.845953 containerd[1934]: time="2025-01-13T20:09:31.845912349Z" level=info msg="TearDown network for sandbox \"7d3190834f7286fc68261319021ff89fa2267e8e4a2bc44b60cdc8ec3736f03b\" successfully" Jan 13 20:09:31.846191 containerd[1934]: time="2025-01-13T20:09:31.846113337Z" level=info msg="StopPodSandbox for \"7d3190834f7286fc68261319021ff89fa2267e8e4a2bc44b60cdc8ec3736f03b\" returns successfully" Jan 13 20:09:31.850130 containerd[1934]: time="2025-01-13T20:09:31.850072617Z" level=info msg="RemovePodSandbox for \"7d3190834f7286fc68261319021ff89fa2267e8e4a2bc44b60cdc8ec3736f03b\"" Jan 13 20:09:31.851133 containerd[1934]: time="2025-01-13T20:09:31.851079237Z" level=info msg="Forcibly stopping sandbox \"7d3190834f7286fc68261319021ff89fa2267e8e4a2bc44b60cdc8ec3736f03b\"" Jan 13 20:09:31.851287 containerd[1934]: time="2025-01-13T20:09:31.851238537Z" level=info msg="TearDown network for sandbox \"7d3190834f7286fc68261319021ff89fa2267e8e4a2bc44b60cdc8ec3736f03b\" successfully" Jan 13 20:09:31.856754 kubelet[3423]: I0113 20:09:31.855419 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4d3ce37a9c40510fd9d66de0b8c2ac5802b7067c8efb617b93564f6bfe5a5223" Jan 13 20:09:31.861247 containerd[1934]: time="2025-01-13T20:09:31.858941625Z" level=info msg="StopPodSandbox for \"4d3ce37a9c40510fd9d66de0b8c2ac5802b7067c8efb617b93564f6bfe5a5223\"" Jan 13 20:09:31.861247 containerd[1934]: time="2025-01-13T20:09:31.859222293Z" level=info msg="Ensure that sandbox 4d3ce37a9c40510fd9d66de0b8c2ac5802b7067c8efb617b93564f6bfe5a5223 in task-service has been cleanup successfully" Jan 13 20:09:31.861986 containerd[1934]: time="2025-01-13T20:09:31.861653229Z" level=info msg="TearDown network for sandbox \"4d3ce37a9c40510fd9d66de0b8c2ac5802b7067c8efb617b93564f6bfe5a5223\" successfully" Jan 13 20:09:31.861986 containerd[1934]: time="2025-01-13T20:09:31.861692313Z" level=info msg="StopPodSandbox for \"4d3ce37a9c40510fd9d66de0b8c2ac5802b7067c8efb617b93564f6bfe5a5223\" returns successfully" Jan 13 20:09:31.863650 containerd[1934]: time="2025-01-13T20:09:31.863540385Z" level=info msg="StopPodSandbox for \"538f604b05684d3571dee3d0a58795500745c5ecc1a4cabbf340ef00fa2e3044\"" Jan 13 20:09:31.864652 containerd[1934]: time="2025-01-13T20:09:31.863698653Z" level=info msg="TearDown network for sandbox \"538f604b05684d3571dee3d0a58795500745c5ecc1a4cabbf340ef00fa2e3044\" successfully" Jan 13 20:09:31.864652 containerd[1934]: time="2025-01-13T20:09:31.863723601Z" level=info msg="StopPodSandbox for \"538f604b05684d3571dee3d0a58795500745c5ecc1a4cabbf340ef00fa2e3044\" returns successfully" Jan 13 20:09:31.864652 containerd[1934]: time="2025-01-13T20:09:31.864527985Z" level=info msg="StopPodSandbox for \"37e8d359f609f540d9e2f49bc83e7f3d5e4296810bef7cdacf10f479884043e5\"" Jan 13 20:09:31.865905 containerd[1934]: time="2025-01-13T20:09:31.864674241Z" level=info msg="TearDown network for sandbox \"37e8d359f609f540d9e2f49bc83e7f3d5e4296810bef7cdacf10f479884043e5\" successfully" Jan 13 20:09:31.865905 containerd[1934]: time="2025-01-13T20:09:31.864696549Z" level=info msg="StopPodSandbox for \"37e8d359f609f540d9e2f49bc83e7f3d5e4296810bef7cdacf10f479884043e5\" returns successfully" Jan 13 20:09:31.866409 containerd[1934]: time="2025-01-13T20:09:31.866101293Z" level=info msg="StopPodSandbox for \"bb64b66507a4d3948827c99dee10022276bd2b85dcce58713749456b89a5723b\"" Jan 13 20:09:31.866409 containerd[1934]: time="2025-01-13T20:09:31.866256753Z" level=info msg="TearDown network for sandbox \"bb64b66507a4d3948827c99dee10022276bd2b85dcce58713749456b89a5723b\" successfully" Jan 13 20:09:31.866409 containerd[1934]: time="2025-01-13T20:09:31.866277693Z" level=info msg="StopPodSandbox for \"bb64b66507a4d3948827c99dee10022276bd2b85dcce58713749456b89a5723b\" returns successfully" Jan 13 20:09:31.867910 containerd[1934]: time="2025-01-13T20:09:31.867703929Z" level=info msg="StopPodSandbox for \"3999268688ddddddb7ec9df611d8146f50072274600306787cd56688f110d548\"" Jan 13 20:09:31.868179 kubelet[3423]: I0113 20:09:31.868061 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2f9666670aab61aa1c36a5c18b2c6e8e3d08bf1cfc3f42fb8cc1ef7244f4257c" Jan 13 20:09:31.869601 containerd[1934]: time="2025-01-13T20:09:31.869526621Z" level=info msg="TearDown network for sandbox \"3999268688ddddddb7ec9df611d8146f50072274600306787cd56688f110d548\" successfully" Jan 13 20:09:31.869601 containerd[1934]: time="2025-01-13T20:09:31.869575185Z" level=info msg="StopPodSandbox for \"3999268688ddddddb7ec9df611d8146f50072274600306787cd56688f110d548\" returns successfully" Jan 13 20:09:31.872291 containerd[1934]: time="2025-01-13T20:09:31.872075265Z" level=info msg="StopPodSandbox for \"2f9666670aab61aa1c36a5c18b2c6e8e3d08bf1cfc3f42fb8cc1ef7244f4257c\"" Jan 13 20:09:31.872291 containerd[1934]: time="2025-01-13T20:09:31.872498613Z" level=info msg="StopPodSandbox for \"a86b825795730ba2f9f58fb14a41879f6cdba9ae4550e62d02a587d4dd982d06\"" Jan 13 20:09:31.872291 containerd[1934]: time="2025-01-13T20:09:31.872642253Z" level=info msg="TearDown network for sandbox \"a86b825795730ba2f9f58fb14a41879f6cdba9ae4550e62d02a587d4dd982d06\" successfully" Jan 13 20:09:31.872291 containerd[1934]: time="2025-01-13T20:09:31.872664777Z" level=info msg="StopPodSandbox for \"a86b825795730ba2f9f58fb14a41879f6cdba9ae4550e62d02a587d4dd982d06\" returns successfully" Jan 13 20:09:31.874085 containerd[1934]: time="2025-01-13T20:09:31.873816333Z" level=info msg="StopPodSandbox for \"57f3ef7b6cf66ed3ed7b779c226fa67874c55496cae0804a70bff6ecec1ef212\"" Jan 13 20:09:31.874143 containerd[1934]: time="2025-01-13T20:09:31.874071993Z" level=info msg="TearDown network for sandbox \"57f3ef7b6cf66ed3ed7b779c226fa67874c55496cae0804a70bff6ecec1ef212\" successfully" Jan 13 20:09:31.874143 containerd[1934]: time="2025-01-13T20:09:31.874121397Z" level=info msg="StopPodSandbox for \"57f3ef7b6cf66ed3ed7b779c226fa67874c55496cae0804a70bff6ecec1ef212\" returns successfully" Jan 13 20:09:31.877048 containerd[1934]: time="2025-01-13T20:09:31.876360021Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-kube-controllers-68f76c7ddf-lh8nj,Uid:2be21c11-9c2d-4b9a-81a5-0e73daba31c1,Namespace:calico-system,Attempt:7,}" Jan 13 20:09:31.877486 containerd[1934]: time="2025-01-13T20:09:31.877428381Z" level=info msg="Ensure that sandbox 2f9666670aab61aa1c36a5c18b2c6e8e3d08bf1cfc3f42fb8cc1ef7244f4257c in task-service has been cleanup successfully" Jan 13 20:09:31.878106 containerd[1934]: time="2025-01-13T20:09:31.878038341Z" level=info msg="TearDown network for sandbox \"2f9666670aab61aa1c36a5c18b2c6e8e3d08bf1cfc3f42fb8cc1ef7244f4257c\" successfully" Jan 13 20:09:31.878106 containerd[1934]: time="2025-01-13T20:09:31.878096625Z" level=info msg="StopPodSandbox for \"2f9666670aab61aa1c36a5c18b2c6e8e3d08bf1cfc3f42fb8cc1ef7244f4257c\" returns successfully" Jan 13 20:09:31.879619 containerd[1934]: time="2025-01-13T20:09:31.879344733Z" level=info msg="StopPodSandbox for \"d368cfe07aba1c933544e6c62373b36a99071e5ffe92916bbd3e8ef7d96b68f2\"" Jan 13 20:09:31.879619 containerd[1934]: time="2025-01-13T20:09:31.879594609Z" level=info msg="TearDown network for sandbox \"d368cfe07aba1c933544e6c62373b36a99071e5ffe92916bbd3e8ef7d96b68f2\" successfully" Jan 13 20:09:31.879619 containerd[1934]: time="2025-01-13T20:09:31.879618693Z" level=info msg="StopPodSandbox for \"d368cfe07aba1c933544e6c62373b36a99071e5ffe92916bbd3e8ef7d96b68f2\" returns successfully" Jan 13 20:09:31.881815 containerd[1934]: time="2025-01-13T20:09:31.881575341Z" level=info msg="StopPodSandbox for \"e23a3567ec1b1a99aef5dba9eb89530d0582fb85108483f9212aaff1d6ab3bc3\"" Jan 13 20:09:31.881815 containerd[1934]: time="2025-01-13T20:09:31.881726157Z" level=info msg="TearDown network for sandbox \"e23a3567ec1b1a99aef5dba9eb89530d0582fb85108483f9212aaff1d6ab3bc3\" successfully" Jan 13 20:09:31.881815 containerd[1934]: time="2025-01-13T20:09:31.881749353Z" level=info msg="StopPodSandbox for \"e23a3567ec1b1a99aef5dba9eb89530d0582fb85108483f9212aaff1d6ab3bc3\" returns successfully" Jan 13 20:09:31.884570 containerd[1934]: time="2025-01-13T20:09:31.884444001Z" level=info msg="StopPodSandbox for \"ce26f7c56a292d1c5e76ccbca54d688912ff4e1c7e33ef8e71e3b8766f463517\"" Jan 13 20:09:31.884943 containerd[1934]: time="2025-01-13T20:09:31.884914989Z" level=info msg="TearDown network for sandbox \"ce26f7c56a292d1c5e76ccbca54d688912ff4e1c7e33ef8e71e3b8766f463517\" successfully" Jan 13 20:09:31.885198 containerd[1934]: time="2025-01-13T20:09:31.885104637Z" level=info msg="StopPodSandbox for \"ce26f7c56a292d1c5e76ccbca54d688912ff4e1c7e33ef8e71e3b8766f463517\" returns successfully" Jan 13 20:09:31.887580 kubelet[3423]: I0113 20:09:31.886082 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fe203c0f7fc44f83207d781bd972b7ee26dab60b101be6081c8e7f2c82858f26" Jan 13 20:09:31.893877 containerd[1934]: time="2025-01-13T20:09:31.891410013Z" level=info msg="StopPodSandbox for \"fe203c0f7fc44f83207d781bd972b7ee26dab60b101be6081c8e7f2c82858f26\"" Jan 13 20:09:31.893877 containerd[1934]: time="2025-01-13T20:09:31.891707457Z" level=info msg="Ensure that sandbox fe203c0f7fc44f83207d781bd972b7ee26dab60b101be6081c8e7f2c82858f26 in task-service has been cleanup successfully" Jan 13 20:09:31.893877 containerd[1934]: time="2025-01-13T20:09:31.892125837Z" level=info msg="StopPodSandbox for \"bac2fe516cc564552b8be0fbca65a9d04eaace09e824ed2a17d9c03e83edae58\"" Jan 13 20:09:31.893877 containerd[1934]: time="2025-01-13T20:09:31.892323969Z" level=info msg="TearDown network for sandbox \"bac2fe516cc564552b8be0fbca65a9d04eaace09e824ed2a17d9c03e83edae58\" successfully" Jan 13 20:09:31.893877 containerd[1934]: time="2025-01-13T20:09:31.892348197Z" level=info msg="StopPodSandbox for \"bac2fe516cc564552b8be0fbca65a9d04eaace09e824ed2a17d9c03e83edae58\" returns successfully" Jan 13 20:09:31.896289 containerd[1934]: time="2025-01-13T20:09:31.896237289Z" level=info msg="StopPodSandbox for \"7d3190834f7286fc68261319021ff89fa2267e8e4a2bc44b60cdc8ec3736f03b\"" Jan 13 20:09:31.896677 containerd[1934]: time="2025-01-13T20:09:31.896643093Z" level=info msg="TearDown network for sandbox \"7d3190834f7286fc68261319021ff89fa2267e8e4a2bc44b60cdc8ec3736f03b\" successfully" Jan 13 20:09:31.896828 containerd[1934]: time="2025-01-13T20:09:31.896797329Z" level=info msg="StopPodSandbox for \"7d3190834f7286fc68261319021ff89fa2267e8e4a2bc44b60cdc8ec3736f03b\" returns successfully" Jan 13 20:09:31.898338 containerd[1934]: time="2025-01-13T20:09:31.898271409Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"7d3190834f7286fc68261319021ff89fa2267e8e4a2bc44b60cdc8ec3736f03b\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:09:31.898489 containerd[1934]: time="2025-01-13T20:09:31.898355301Z" level=info msg="RemovePodSandbox \"7d3190834f7286fc68261319021ff89fa2267e8e4a2bc44b60cdc8ec3736f03b\" returns successfully" Jan 13 20:09:31.899804 containerd[1934]: time="2025-01-13T20:09:31.898897113Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-76f75df574-mkr2l,Uid:396e30c8-d221-410a-89fe-e353ba8cddbf,Namespace:kube-system,Attempt:7,}" Jan 13 20:09:31.899804 containerd[1934]: time="2025-01-13T20:09:31.899692005Z" level=info msg="StopPodSandbox for \"bac2fe516cc564552b8be0fbca65a9d04eaace09e824ed2a17d9c03e83edae58\"" Jan 13 20:09:31.900056 containerd[1934]: time="2025-01-13T20:09:31.900012573Z" level=info msg="TearDown network for sandbox \"bac2fe516cc564552b8be0fbca65a9d04eaace09e824ed2a17d9c03e83edae58\" successfully" Jan 13 20:09:31.900124 containerd[1934]: time="2025-01-13T20:09:31.900048729Z" level=info msg="StopPodSandbox for \"bac2fe516cc564552b8be0fbca65a9d04eaace09e824ed2a17d9c03e83edae58\" returns successfully" Jan 13 20:09:31.900447 containerd[1934]: time="2025-01-13T20:09:31.900415821Z" level=info msg="TearDown network for sandbox \"fe203c0f7fc44f83207d781bd972b7ee26dab60b101be6081c8e7f2c82858f26\" successfully" Jan 13 20:09:31.900581 containerd[1934]: time="2025-01-13T20:09:31.900552189Z" level=info msg="StopPodSandbox for \"fe203c0f7fc44f83207d781bd972b7ee26dab60b101be6081c8e7f2c82858f26\" returns successfully" Jan 13 20:09:31.905827 containerd[1934]: time="2025-01-13T20:09:31.904069893Z" level=info msg="StopPodSandbox for \"034a1f3cd65e356f264d6b6a21d8604cdd13f23a1add7bf41ab327c6991d4011\"" Jan 13 20:09:31.906565 containerd[1934]: time="2025-01-13T20:09:31.906525489Z" level=info msg="TearDown network for sandbox \"034a1f3cd65e356f264d6b6a21d8604cdd13f23a1add7bf41ab327c6991d4011\" successfully" Jan 13 20:09:31.907286 containerd[1934]: time="2025-01-13T20:09:31.904543437Z" level=info msg="RemovePodSandbox for \"bac2fe516cc564552b8be0fbca65a9d04eaace09e824ed2a17d9c03e83edae58\"" Jan 13 20:09:31.907625 containerd[1934]: time="2025-01-13T20:09:31.907591917Z" level=info msg="Forcibly stopping sandbox \"bac2fe516cc564552b8be0fbca65a9d04eaace09e824ed2a17d9c03e83edae58\"" Jan 13 20:09:31.907841 containerd[1934]: time="2025-01-13T20:09:31.907454181Z" level=info msg="StopPodSandbox for \"034a1f3cd65e356f264d6b6a21d8604cdd13f23a1add7bf41ab327c6991d4011\" returns successfully" Jan 13 20:09:31.909072 containerd[1934]: time="2025-01-13T20:09:31.909025749Z" level=info msg="TearDown network for sandbox \"bac2fe516cc564552b8be0fbca65a9d04eaace09e824ed2a17d9c03e83edae58\" successfully" Jan 13 20:09:31.910666 containerd[1934]: time="2025-01-13T20:09:31.909619473Z" level=info msg="StopPodSandbox for \"e8d14d51164c0f7461d019f7892fb139ae5f1525115e3ca06b0affcaae9c0d5e\"" Jan 13 20:09:31.911016 containerd[1934]: time="2025-01-13T20:09:31.910983597Z" level=info msg="TearDown network for sandbox \"e8d14d51164c0f7461d019f7892fb139ae5f1525115e3ca06b0affcaae9c0d5e\" successfully" Jan 13 20:09:31.911742 containerd[1934]: time="2025-01-13T20:09:31.911650161Z" level=info msg="StopPodSandbox for \"e8d14d51164c0f7461d019f7892fb139ae5f1525115e3ca06b0affcaae9c0d5e\" returns successfully" Jan 13 20:09:31.913665 containerd[1934]: time="2025-01-13T20:09:31.913613169Z" level=info msg="StopPodSandbox for \"f25c71afbdf54c9739bfb9dedd7783f76e2a8415e053a98227128ef3211d4a56\"" Jan 13 20:09:31.914882 containerd[1934]: time="2025-01-13T20:09:31.914844321Z" level=info msg="TearDown network for sandbox \"f25c71afbdf54c9739bfb9dedd7783f76e2a8415e053a98227128ef3211d4a56\" successfully" Jan 13 20:09:31.915435 containerd[1934]: time="2025-01-13T20:09:31.915019209Z" level=info msg="StopPodSandbox for \"f25c71afbdf54c9739bfb9dedd7783f76e2a8415e053a98227128ef3211d4a56\" returns successfully" Jan 13 20:09:31.915546 kubelet[3423]: I0113 20:09:31.915074 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="871bb94da403609229c4f8c4907a3c7c7ff537ef7b689806a251f0915d567eea" Jan 13 20:09:31.918132 containerd[1934]: time="2025-01-13T20:09:31.918062889Z" level=info msg="StopPodSandbox for \"d029da1857cffbc9aea56a8ec883ba4e1da56eae06a46e2e4ba0629832693cb0\"" Jan 13 20:09:31.919691 containerd[1934]: time="2025-01-13T20:09:31.919642521Z" level=info msg="TearDown network for sandbox \"d029da1857cffbc9aea56a8ec883ba4e1da56eae06a46e2e4ba0629832693cb0\" successfully" Jan 13 20:09:31.920563 containerd[1934]: time="2025-01-13T20:09:31.920503953Z" level=info msg="StopPodSandbox for \"d029da1857cffbc9aea56a8ec883ba4e1da56eae06a46e2e4ba0629832693cb0\" returns successfully" Jan 13 20:09:31.920963 containerd[1934]: time="2025-01-13T20:09:31.920021709Z" level=info msg="StopPodSandbox for \"871bb94da403609229c4f8c4907a3c7c7ff537ef7b689806a251f0915d567eea\"" Jan 13 20:09:31.924375 containerd[1934]: time="2025-01-13T20:09:31.922319757Z" level=info msg="Ensure that sandbox 871bb94da403609229c4f8c4907a3c7c7ff537ef7b689806a251f0915d567eea in task-service has been cleanup successfully" Jan 13 20:09:31.924938 containerd[1934]: time="2025-01-13T20:09:31.924896577Z" level=info msg="TearDown network for sandbox \"871bb94da403609229c4f8c4907a3c7c7ff537ef7b689806a251f0915d567eea\" successfully" Jan 13 20:09:31.926199 containerd[1934]: time="2025-01-13T20:09:31.926152113Z" level=info msg="StopPodSandbox for \"871bb94da403609229c4f8c4907a3c7c7ff537ef7b689806a251f0915d567eea\" returns successfully" Jan 13 20:09:31.928659 containerd[1934]: time="2025-01-13T20:09:31.928606737Z" level=info msg="StopPodSandbox for \"cfa6ddb68ab8a55e2b4406871b279f8198e9a43957ec335f7facbf57b86881a3\"" Jan 13 20:09:31.929712 containerd[1934]: time="2025-01-13T20:09:31.929354745Z" level=info msg="TearDown network for sandbox \"cfa6ddb68ab8a55e2b4406871b279f8198e9a43957ec335f7facbf57b86881a3\" successfully" Jan 13 20:09:31.929712 containerd[1934]: time="2025-01-13T20:09:31.929403741Z" level=info msg="StopPodSandbox for \"cfa6ddb68ab8a55e2b4406871b279f8198e9a43957ec335f7facbf57b86881a3\" returns successfully" Jan 13 20:09:31.929712 containerd[1934]: time="2025-01-13T20:09:31.929174073Z" level=info msg="StopPodSandbox for \"eede6c995fce264cd780e29e58a08fa68b4c54baafa60c3289b9cd92b98c7c6c\"" Jan 13 20:09:31.929712 containerd[1934]: time="2025-01-13T20:09:31.929593629Z" level=info msg="TearDown network for sandbox \"eede6c995fce264cd780e29e58a08fa68b4c54baafa60c3289b9cd92b98c7c6c\" successfully" Jan 13 20:09:31.929712 containerd[1934]: time="2025-01-13T20:09:31.929615037Z" level=info msg="StopPodSandbox for \"eede6c995fce264cd780e29e58a08fa68b4c54baafa60c3289b9cd92b98c7c6c\" returns successfully" Jan 13 20:09:31.931714 containerd[1934]: time="2025-01-13T20:09:31.931315761Z" level=info msg="StopPodSandbox for \"c8d12cba52fd60ec08cc5638f4d4379aae8d673464810205dafbb978080837b3\"" Jan 13 20:09:31.931714 containerd[1934]: time="2025-01-13T20:09:31.931509753Z" level=info msg="TearDown network for sandbox \"c8d12cba52fd60ec08cc5638f4d4379aae8d673464810205dafbb978080837b3\" successfully" Jan 13 20:09:31.931714 containerd[1934]: time="2025-01-13T20:09:31.931534989Z" level=info msg="StopPodSandbox for \"c8d12cba52fd60ec08cc5638f4d4379aae8d673464810205dafbb978080837b3\" returns successfully" Jan 13 20:09:31.932668 containerd[1934]: time="2025-01-13T20:09:31.931873377Z" level=info msg="StopPodSandbox for \"fb565334446e5f8a46a1bd1f7f902b79f435864e841478f2f0a155d44cd33b41\"" Jan 13 20:09:31.932981 containerd[1934]: time="2025-01-13T20:09:31.932742633Z" level=info msg="TearDown network for sandbox \"fb565334446e5f8a46a1bd1f7f902b79f435864e841478f2f0a155d44cd33b41\" successfully" Jan 13 20:09:31.932981 containerd[1934]: time="2025-01-13T20:09:31.932953629Z" level=info msg="StopPodSandbox for \"fb565334446e5f8a46a1bd1f7f902b79f435864e841478f2f0a155d44cd33b41\" returns successfully" Jan 13 20:09:31.936324 containerd[1934]: time="2025-01-13T20:09:31.936152805Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-7fbffcd8cd-wszl7,Uid:ad79c041-eaf1-4d57-9fb4-c3fb08680cb8,Namespace:calico-apiserver,Attempt:7,}" Jan 13 20:09:31.936493 containerd[1934]: time="2025-01-13T20:09:31.936399477Z" level=info msg="StopPodSandbox for \"d179e7ae754d81c958ff901cb7c596dc225e5822f67938ade6bc971cc1e73234\"" Jan 13 20:09:31.937469 containerd[1934]: time="2025-01-13T20:09:31.937234617Z" level=info msg="TearDown network for sandbox \"d179e7ae754d81c958ff901cb7c596dc225e5822f67938ade6bc971cc1e73234\" successfully" Jan 13 20:09:31.937469 containerd[1934]: time="2025-01-13T20:09:31.937271673Z" level=info msg="StopPodSandbox for \"d179e7ae754d81c958ff901cb7c596dc225e5822f67938ade6bc971cc1e73234\" returns successfully" Jan 13 20:09:31.939572 containerd[1934]: time="2025-01-13T20:09:31.939139509Z" level=info msg="StopPodSandbox for \"8c0c460fc82d1c51ed146afb77bb0cdfb42636cd5b1ebd0d7d108e8d75eb9610\"" Jan 13 20:09:31.939572 containerd[1934]: time="2025-01-13T20:09:31.939312273Z" level=info msg="TearDown network for sandbox \"8c0c460fc82d1c51ed146afb77bb0cdfb42636cd5b1ebd0d7d108e8d75eb9610\" successfully" Jan 13 20:09:31.939572 containerd[1934]: time="2025-01-13T20:09:31.939334665Z" level=info msg="StopPodSandbox for \"8c0c460fc82d1c51ed146afb77bb0cdfb42636cd5b1ebd0d7d108e8d75eb9610\" returns successfully" Jan 13 20:09:31.941853 containerd[1934]: time="2025-01-13T20:09:31.941437257Z" level=info msg="StopPodSandbox for \"eed11d015ff645b963130f5ad956d107f391cbaba3451e015229fc4082c60951\"" Jan 13 20:09:31.941853 containerd[1934]: time="2025-01-13T20:09:31.941607957Z" level=info msg="TearDown network for sandbox \"eed11d015ff645b963130f5ad956d107f391cbaba3451e015229fc4082c60951\" successfully" Jan 13 20:09:31.941853 containerd[1934]: time="2025-01-13T20:09:31.941629545Z" level=info msg="StopPodSandbox for \"eed11d015ff645b963130f5ad956d107f391cbaba3451e015229fc4082c60951\" returns successfully" Jan 13 20:09:31.943602 kubelet[3423]: I0113 20:09:31.943541 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4a448ddaae657a72707e2505e7b6329129c1ea98f60de221b826b6b205a6ff6b" Jan 13 20:09:31.945663 containerd[1934]: time="2025-01-13T20:09:31.945452553Z" level=info msg="StopPodSandbox for \"f5e883fc61f95c31957335ed367bbb8d4c07a9c5470ee6e51fca5c2bde0bfb8c\"" Jan 13 20:09:31.945663 containerd[1934]: time="2025-01-13T20:09:31.945618609Z" level=info msg="TearDown network for sandbox \"f5e883fc61f95c31957335ed367bbb8d4c07a9c5470ee6e51fca5c2bde0bfb8c\" successfully" Jan 13 20:09:31.947027 containerd[1934]: time="2025-01-13T20:09:31.946560789Z" level=info msg="StopPodSandbox for \"f5e883fc61f95c31957335ed367bbb8d4c07a9c5470ee6e51fca5c2bde0bfb8c\" returns successfully" Jan 13 20:09:31.947027 containerd[1934]: time="2025-01-13T20:09:31.946926561Z" level=info msg="StopPodSandbox for \"4a448ddaae657a72707e2505e7b6329129c1ea98f60de221b826b6b205a6ff6b\"" Jan 13 20:09:31.949255 containerd[1934]: time="2025-01-13T20:09:31.949184073Z" level=info msg="Ensure that sandbox 4a448ddaae657a72707e2505e7b6329129c1ea98f60de221b826b6b205a6ff6b in task-service has been cleanup successfully" Jan 13 20:09:31.950341 containerd[1934]: time="2025-01-13T20:09:31.949519737Z" level=info msg="TearDown network for sandbox \"4a448ddaae657a72707e2505e7b6329129c1ea98f60de221b826b6b205a6ff6b\" successfully" Jan 13 20:09:31.950341 containerd[1934]: time="2025-01-13T20:09:31.949579221Z" level=info msg="StopPodSandbox for \"4a448ddaae657a72707e2505e7b6329129c1ea98f60de221b826b6b205a6ff6b\" returns successfully" Jan 13 20:09:31.950341 containerd[1934]: time="2025-01-13T20:09:31.950031345Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-76f75df574-8wp6k,Uid:87115657-f395-40ec-89ea-3d7835119c3a,Namespace:kube-system,Attempt:7,}" Jan 13 20:09:31.952292 containerd[1934]: time="2025-01-13T20:09:31.951549921Z" level=info msg="StopPodSandbox for \"3738e8149db8a55a4134f2d90b1a13f28ee725b71b142d59f0f32a083d31ab02\"" Jan 13 20:09:31.952866 containerd[1934]: time="2025-01-13T20:09:31.952826217Z" level=info msg="TearDown network for sandbox \"3738e8149db8a55a4134f2d90b1a13f28ee725b71b142d59f0f32a083d31ab02\" successfully" Jan 13 20:09:31.953823 containerd[1934]: time="2025-01-13T20:09:31.953562249Z" level=info msg="StopPodSandbox for \"3738e8149db8a55a4134f2d90b1a13f28ee725b71b142d59f0f32a083d31ab02\" returns successfully" Jan 13 20:09:31.957195 containerd[1934]: time="2025-01-13T20:09:31.956936745Z" level=info msg="StopPodSandbox for \"a7aac01fa45d89b04a7cb486ede3be4574f65135e039463be287ff48831441a8\"" Jan 13 20:09:31.959196 containerd[1934]: time="2025-01-13T20:09:31.958303521Z" level=info msg="TearDown network for sandbox \"a7aac01fa45d89b04a7cb486ede3be4574f65135e039463be287ff48831441a8\" successfully" Jan 13 20:09:31.959196 containerd[1934]: time="2025-01-13T20:09:31.958368705Z" level=info msg="StopPodSandbox for \"a7aac01fa45d89b04a7cb486ede3be4574f65135e039463be287ff48831441a8\" returns successfully" Jan 13 20:09:31.961001 containerd[1934]: time="2025-01-13T20:09:31.960953577Z" level=info msg="StopPodSandbox for \"a37a24fcb9897952ccabcc8cb7045bb7b0ef0fe4b98a8ca3b53ea6f6cf157017\"" Jan 13 20:09:31.962210 containerd[1934]: time="2025-01-13T20:09:31.961565205Z" level=info msg="TearDown network for sandbox \"a37a24fcb9897952ccabcc8cb7045bb7b0ef0fe4b98a8ca3b53ea6f6cf157017\" successfully" Jan 13 20:09:31.962210 containerd[1934]: time="2025-01-13T20:09:31.961598913Z" level=info msg="StopPodSandbox for \"a37a24fcb9897952ccabcc8cb7045bb7b0ef0fe4b98a8ca3b53ea6f6cf157017\" returns successfully" Jan 13 20:09:31.964614 containerd[1934]: time="2025-01-13T20:09:31.964465941Z" level=info msg="StopPodSandbox for \"e31eca7a421d12ab04696c6ee4fefbcfc3ab887e88d76deb901fc6a512e76618\"" Jan 13 20:09:31.965096 containerd[1934]: time="2025-01-13T20:09:31.964908069Z" level=info msg="TearDown network for sandbox \"e31eca7a421d12ab04696c6ee4fefbcfc3ab887e88d76deb901fc6a512e76618\" successfully" Jan 13 20:09:31.965096 containerd[1934]: time="2025-01-13T20:09:31.964942653Z" level=info msg="StopPodSandbox for \"e31eca7a421d12ab04696c6ee4fefbcfc3ab887e88d76deb901fc6a512e76618\" returns successfully" Jan 13 20:09:31.965372 kubelet[3423]: I0113 20:09:31.964885 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dfb5cc6aa8ee548a0817f76e636f6ba17a9915fccdeb0f77deba61f58d7154ee" Jan 13 20:09:31.969875 containerd[1934]: time="2025-01-13T20:09:31.968965881Z" level=info msg="StopPodSandbox for \"2accd017db7708cc1fa5c6da328b2f1c3f1c063e1b4b76d232d0c4e3cdca6a6d\"" Jan 13 20:09:31.969875 containerd[1934]: time="2025-01-13T20:09:31.969135105Z" level=info msg="TearDown network for sandbox \"2accd017db7708cc1fa5c6da328b2f1c3f1c063e1b4b76d232d0c4e3cdca6a6d\" successfully" Jan 13 20:09:31.969875 containerd[1934]: time="2025-01-13T20:09:31.969157965Z" level=info msg="StopPodSandbox for \"2accd017db7708cc1fa5c6da328b2f1c3f1c063e1b4b76d232d0c4e3cdca6a6d\" returns successfully" Jan 13 20:09:31.978573 containerd[1934]: time="2025-01-13T20:09:31.977906829Z" level=info msg="StopPodSandbox for \"dfb5cc6aa8ee548a0817f76e636f6ba17a9915fccdeb0f77deba61f58d7154ee\"" Jan 13 20:09:31.979472 containerd[1934]: time="2025-01-13T20:09:31.979403013Z" level=info msg="Ensure that sandbox dfb5cc6aa8ee548a0817f76e636f6ba17a9915fccdeb0f77deba61f58d7154ee in task-service has been cleanup successfully" Jan 13 20:09:31.982109 containerd[1934]: time="2025-01-13T20:09:31.982050345Z" level=info msg="StopPodSandbox for \"c787f8945e5c1c02a132aebe2ce54537e8efb76054bd3d61620dd081ac229a87\"" Jan 13 20:09:31.982266 containerd[1934]: time="2025-01-13T20:09:31.982230249Z" level=info msg="TearDown network for sandbox \"c787f8945e5c1c02a132aebe2ce54537e8efb76054bd3d61620dd081ac229a87\" successfully" Jan 13 20:09:31.982266 containerd[1934]: time="2025-01-13T20:09:31.982253901Z" level=info msg="StopPodSandbox for \"c787f8945e5c1c02a132aebe2ce54537e8efb76054bd3d61620dd081ac229a87\" returns successfully" Jan 13 20:09:31.983176 containerd[1934]: time="2025-01-13T20:09:31.982899621Z" level=info msg="TearDown network for sandbox \"dfb5cc6aa8ee548a0817f76e636f6ba17a9915fccdeb0f77deba61f58d7154ee\" successfully" Jan 13 20:09:31.983176 containerd[1934]: time="2025-01-13T20:09:31.982937925Z" level=info msg="StopPodSandbox for \"dfb5cc6aa8ee548a0817f76e636f6ba17a9915fccdeb0f77deba61f58d7154ee\" returns successfully" Jan 13 20:09:31.988801 containerd[1934]: time="2025-01-13T20:09:31.988495737Z" level=info msg="StopPodSandbox for \"8615086423d6201ef85384f1854ecd8c82e04e1edced15a3499ba0b0b99f7588\"" Jan 13 20:09:31.988801 containerd[1934]: time="2025-01-13T20:09:31.988666653Z" level=info msg="TearDown network for sandbox \"8615086423d6201ef85384f1854ecd8c82e04e1edced15a3499ba0b0b99f7588\" successfully" Jan 13 20:09:31.988801 containerd[1934]: time="2025-01-13T20:09:31.988689105Z" level=info msg="StopPodSandbox for \"8615086423d6201ef85384f1854ecd8c82e04e1edced15a3499ba0b0b99f7588\" returns successfully" Jan 13 20:09:31.992808 containerd[1934]: time="2025-01-13T20:09:31.991448121Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-7fbffcd8cd-pxvdr,Uid:8f72f896-c0ba-4b07-9a22-acc5c8ca3697,Namespace:calico-apiserver,Attempt:7,}" Jan 13 20:09:31.996890 containerd[1934]: time="2025-01-13T20:09:31.996839121Z" level=info msg="StopPodSandbox for \"a04750e9fc31e16c9110301f495a11a345e09ad202ac48d631cc7f81772e7ec2\"" Jan 13 20:09:31.997789 containerd[1934]: time="2025-01-13T20:09:31.997734009Z" level=info msg="TearDown network for sandbox \"a04750e9fc31e16c9110301f495a11a345e09ad202ac48d631cc7f81772e7ec2\" successfully" Jan 13 20:09:31.998284 containerd[1934]: time="2025-01-13T20:09:31.998237457Z" level=info msg="StopPodSandbox for \"a04750e9fc31e16c9110301f495a11a345e09ad202ac48d631cc7f81772e7ec2\" returns successfully" Jan 13 20:09:32.004000 containerd[1934]: time="2025-01-13T20:09:32.003935741Z" level=info msg="StopPodSandbox for \"955f9fe6553205f6e71b94a6922fdece40d5d1a8c6a343e9a0aa0f4bf2abbb69\"" Jan 13 20:09:32.004166 containerd[1934]: time="2025-01-13T20:09:32.004110617Z" level=info msg="TearDown network for sandbox \"955f9fe6553205f6e71b94a6922fdece40d5d1a8c6a343e9a0aa0f4bf2abbb69\" successfully" Jan 13 20:09:32.004166 containerd[1934]: time="2025-01-13T20:09:32.004133621Z" level=info msg="StopPodSandbox for \"955f9fe6553205f6e71b94a6922fdece40d5d1a8c6a343e9a0aa0f4bf2abbb69\" returns successfully" Jan 13 20:09:32.008027 systemd[1]: run-netns-cni\x2de08ac969\x2dc1f9\x2d4a85\x2dc7e4\x2da5feff79638d.mount: Deactivated successfully. Jan 13 20:09:32.008266 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-4d3ce37a9c40510fd9d66de0b8c2ac5802b7067c8efb617b93564f6bfe5a5223-shm.mount: Deactivated successfully. Jan 13 20:09:32.008418 systemd[1]: run-netns-cni\x2d5d09c255\x2d5ae8\x2dc7e1\x2d545f\x2d51cda52ff3b4.mount: Deactivated successfully. Jan 13 20:09:32.008552 systemd[1]: run-netns-cni\x2d3da5ff69\x2d7905\x2daec0\x2d5570\x2d6666614fd803.mount: Deactivated successfully. Jan 13 20:09:32.008678 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-4a448ddaae657a72707e2505e7b6329129c1ea98f60de221b826b6b205a6ff6b-shm.mount: Deactivated successfully. Jan 13 20:09:32.008856 systemd[1]: run-netns-cni\x2d341354de\x2daa2f\x2d2b06\x2dafa7\x2d0957623621b6.mount: Deactivated successfully. Jan 13 20:09:32.008993 systemd[1]: run-netns-cni\x2d9d0a7ae2\x2d2e1a\x2dfc95\x2d37d0\x2d914655c2e713.mount: Deactivated successfully. Jan 13 20:09:32.009115 systemd[1]: run-netns-cni\x2d759b0963\x2d4514\x2d44e0\x2dfacd\x2dde06062a1a50.mount: Deactivated successfully. Jan 13 20:09:32.026813 containerd[1934]: time="2025-01-13T20:09:32.025845042Z" level=info msg="StopPodSandbox for \"aeb47e19302f9c839c5fa002c506a56722057a24b2c06c5082b07dd07a783384\"" Jan 13 20:09:32.030318 sshd[5521]: Accepted publickey for core from 147.75.109.163 port 40178 ssh2: RSA SHA256:IRHkteilZRLg/mCVEzdResksy7NfUBDRRywgALKaHg0 Jan 13 20:09:32.039904 sshd-session[5521]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Jan 13 20:09:32.051934 containerd[1934]: time="2025-01-13T20:09:32.051200334Z" level=info msg="TearDown network for sandbox \"aeb47e19302f9c839c5fa002c506a56722057a24b2c06c5082b07dd07a783384\" successfully" Jan 13 20:09:32.051934 containerd[1934]: time="2025-01-13T20:09:32.051246810Z" level=info msg="StopPodSandbox for \"aeb47e19302f9c839c5fa002c506a56722057a24b2c06c5082b07dd07a783384\" returns successfully" Jan 13 20:09:32.056541 containerd[1934]: time="2025-01-13T20:09:32.056371674Z" level=info msg="StopPodSandbox for \"af4b04b9175c96b5f57bdaa5d05b254cb086cf984792052f87e1249b6c2e75f9\"" Jan 13 20:09:32.060882 systemd-logind[1912]: New session 13 of user core. Jan 13 20:09:32.064966 containerd[1934]: time="2025-01-13T20:09:32.064441866Z" level=info msg="TearDown network for sandbox \"af4b04b9175c96b5f57bdaa5d05b254cb086cf984792052f87e1249b6c2e75f9\" successfully" Jan 13 20:09:32.064966 containerd[1934]: time="2025-01-13T20:09:32.064507038Z" level=info msg="StopPodSandbox for \"af4b04b9175c96b5f57bdaa5d05b254cb086cf984792052f87e1249b6c2e75f9\" returns successfully" Jan 13 20:09:32.067233 containerd[1934]: time="2025-01-13T20:09:32.065532186Z" level=info msg="StopPodSandbox for \"ccf56aafff1edbddd69e830448606d1ed364723341b141ed6867e7ed4d6b5f89\"" Jan 13 20:09:32.067233 containerd[1934]: time="2025-01-13T20:09:32.065724474Z" level=info msg="TearDown network for sandbox \"ccf56aafff1edbddd69e830448606d1ed364723341b141ed6867e7ed4d6b5f89\" successfully" Jan 13 20:09:32.066150 systemd[1]: Started session-13.scope - Session 13 of User core. Jan 13 20:09:32.068249 containerd[1934]: time="2025-01-13T20:09:32.065748618Z" level=info msg="StopPodSandbox for \"ccf56aafff1edbddd69e830448606d1ed364723341b141ed6867e7ed4d6b5f89\" returns successfully" Jan 13 20:09:32.072664 containerd[1934]: time="2025-01-13T20:09:32.072582198Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:csi-node-driver-wq54r,Uid:d47fc662-eff9-4473-83da-b6f0b896d81f,Namespace:calico-system,Attempt:7,}" Jan 13 20:09:32.112547 containerd[1934]: time="2025-01-13T20:09:32.112471890Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"bac2fe516cc564552b8be0fbca65a9d04eaace09e824ed2a17d9c03e83edae58\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:09:32.112792 containerd[1934]: time="2025-01-13T20:09:32.112560762Z" level=info msg="RemovePodSandbox \"bac2fe516cc564552b8be0fbca65a9d04eaace09e824ed2a17d9c03e83edae58\" returns successfully" Jan 13 20:09:32.114374 containerd[1934]: time="2025-01-13T20:09:32.114173454Z" level=info msg="StopPodSandbox for \"ce26f7c56a292d1c5e76ccbca54d688912ff4e1c7e33ef8e71e3b8766f463517\"" Jan 13 20:09:32.115342 containerd[1934]: time="2025-01-13T20:09:32.115175034Z" level=info msg="TearDown network for sandbox \"ce26f7c56a292d1c5e76ccbca54d688912ff4e1c7e33ef8e71e3b8766f463517\" successfully" Jan 13 20:09:32.115342 containerd[1934]: time="2025-01-13T20:09:32.115217574Z" level=info msg="StopPodSandbox for \"ce26f7c56a292d1c5e76ccbca54d688912ff4e1c7e33ef8e71e3b8766f463517\" returns successfully" Jan 13 20:09:32.116109 containerd[1934]: time="2025-01-13T20:09:32.116054022Z" level=info msg="RemovePodSandbox for \"ce26f7c56a292d1c5e76ccbca54d688912ff4e1c7e33ef8e71e3b8766f463517\"" Jan 13 20:09:32.116234 containerd[1934]: time="2025-01-13T20:09:32.116131686Z" level=info msg="Forcibly stopping sandbox \"ce26f7c56a292d1c5e76ccbca54d688912ff4e1c7e33ef8e71e3b8766f463517\"" Jan 13 20:09:32.116532 containerd[1934]: time="2025-01-13T20:09:32.116334546Z" level=info msg="TearDown network for sandbox \"ce26f7c56a292d1c5e76ccbca54d688912ff4e1c7e33ef8e71e3b8766f463517\" successfully" Jan 13 20:09:32.190688 containerd[1934]: time="2025-01-13T20:09:32.190616334Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"ce26f7c56a292d1c5e76ccbca54d688912ff4e1c7e33ef8e71e3b8766f463517\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:09:32.191862 containerd[1934]: time="2025-01-13T20:09:32.190704138Z" level=info msg="RemovePodSandbox \"ce26f7c56a292d1c5e76ccbca54d688912ff4e1c7e33ef8e71e3b8766f463517\" returns successfully" Jan 13 20:09:32.194764 containerd[1934]: time="2025-01-13T20:09:32.194699310Z" level=info msg="StopPodSandbox for \"e23a3567ec1b1a99aef5dba9eb89530d0582fb85108483f9212aaff1d6ab3bc3\"" Jan 13 20:09:32.197657 containerd[1934]: time="2025-01-13T20:09:32.197568642Z" level=info msg="TearDown network for sandbox \"e23a3567ec1b1a99aef5dba9eb89530d0582fb85108483f9212aaff1d6ab3bc3\" successfully" Jan 13 20:09:32.197657 containerd[1934]: time="2025-01-13T20:09:32.197645190Z" level=info msg="StopPodSandbox for \"e23a3567ec1b1a99aef5dba9eb89530d0582fb85108483f9212aaff1d6ab3bc3\" returns successfully" Jan 13 20:09:32.204799 containerd[1934]: time="2025-01-13T20:09:32.203950230Z" level=info msg="RemovePodSandbox for \"e23a3567ec1b1a99aef5dba9eb89530d0582fb85108483f9212aaff1d6ab3bc3\"" Jan 13 20:09:32.204799 containerd[1934]: time="2025-01-13T20:09:32.204013422Z" level=info msg="Forcibly stopping sandbox \"e23a3567ec1b1a99aef5dba9eb89530d0582fb85108483f9212aaff1d6ab3bc3\"" Jan 13 20:09:32.204799 containerd[1934]: time="2025-01-13T20:09:32.204148146Z" level=info msg="TearDown network for sandbox \"e23a3567ec1b1a99aef5dba9eb89530d0582fb85108483f9212aaff1d6ab3bc3\" successfully" Jan 13 20:09:32.311920 containerd[1934]: time="2025-01-13T20:09:32.310601071Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"e23a3567ec1b1a99aef5dba9eb89530d0582fb85108483f9212aaff1d6ab3bc3\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:09:32.311920 containerd[1934]: time="2025-01-13T20:09:32.311157211Z" level=info msg="RemovePodSandbox \"e23a3567ec1b1a99aef5dba9eb89530d0582fb85108483f9212aaff1d6ab3bc3\" returns successfully" Jan 13 20:09:32.320288 containerd[1934]: time="2025-01-13T20:09:32.319596127Z" level=info msg="StopPodSandbox for \"d368cfe07aba1c933544e6c62373b36a99071e5ffe92916bbd3e8ef7d96b68f2\"" Jan 13 20:09:32.325981 containerd[1934]: time="2025-01-13T20:09:32.323913763Z" level=info msg="TearDown network for sandbox \"d368cfe07aba1c933544e6c62373b36a99071e5ffe92916bbd3e8ef7d96b68f2\" successfully" Jan 13 20:09:32.325981 containerd[1934]: time="2025-01-13T20:09:32.324257935Z" level=info msg="StopPodSandbox for \"d368cfe07aba1c933544e6c62373b36a99071e5ffe92916bbd3e8ef7d96b68f2\" returns successfully" Jan 13 20:09:32.328705 containerd[1934]: time="2025-01-13T20:09:32.328196659Z" level=info msg="RemovePodSandbox for \"d368cfe07aba1c933544e6c62373b36a99071e5ffe92916bbd3e8ef7d96b68f2\"" Jan 13 20:09:32.328705 containerd[1934]: time="2025-01-13T20:09:32.328263367Z" level=info msg="Forcibly stopping sandbox \"d368cfe07aba1c933544e6c62373b36a99071e5ffe92916bbd3e8ef7d96b68f2\"" Jan 13 20:09:32.328705 containerd[1934]: time="2025-01-13T20:09:32.328405327Z" level=info msg="TearDown network for sandbox \"d368cfe07aba1c933544e6c62373b36a99071e5ffe92916bbd3e8ef7d96b68f2\" successfully" Jan 13 20:09:32.441157 containerd[1934]: time="2025-01-13T20:09:32.440962592Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"d368cfe07aba1c933544e6c62373b36a99071e5ffe92916bbd3e8ef7d96b68f2\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:09:32.441157 containerd[1934]: time="2025-01-13T20:09:32.441039212Z" level=info msg="RemovePodSandbox \"d368cfe07aba1c933544e6c62373b36a99071e5ffe92916bbd3e8ef7d96b68f2\" returns successfully" Jan 13 20:09:32.443498 containerd[1934]: time="2025-01-13T20:09:32.442979900Z" level=info msg="StopPodSandbox for \"f5e883fc61f95c31957335ed367bbb8d4c07a9c5470ee6e51fca5c2bde0bfb8c\"" Jan 13 20:09:32.443498 containerd[1934]: time="2025-01-13T20:09:32.443335376Z" level=info msg="TearDown network for sandbox \"f5e883fc61f95c31957335ed367bbb8d4c07a9c5470ee6e51fca5c2bde0bfb8c\" successfully" Jan 13 20:09:32.443498 containerd[1934]: time="2025-01-13T20:09:32.443377700Z" level=info msg="StopPodSandbox for \"f5e883fc61f95c31957335ed367bbb8d4c07a9c5470ee6e51fca5c2bde0bfb8c\" returns successfully" Jan 13 20:09:32.445058 containerd[1934]: time="2025-01-13T20:09:32.444886844Z" level=info msg="RemovePodSandbox for \"f5e883fc61f95c31957335ed367bbb8d4c07a9c5470ee6e51fca5c2bde0bfb8c\"" Jan 13 20:09:32.445058 containerd[1934]: time="2025-01-13T20:09:32.444938984Z" level=info msg="Forcibly stopping sandbox \"f5e883fc61f95c31957335ed367bbb8d4c07a9c5470ee6e51fca5c2bde0bfb8c\"" Jan 13 20:09:32.446064 containerd[1934]: time="2025-01-13T20:09:32.445826420Z" level=info msg="TearDown network for sandbox \"f5e883fc61f95c31957335ed367bbb8d4c07a9c5470ee6e51fca5c2bde0bfb8c\" successfully" Jan 13 20:09:32.448698 sshd[5525]: Connection closed by 147.75.109.163 port 40178 Jan 13 20:09:32.449847 sshd-session[5521]: pam_unix(sshd:session): session closed for user core Jan 13 20:09:32.459500 systemd[1]: sshd@12-172.31.28.23:22-147.75.109.163:40178.service: Deactivated successfully. Jan 13 20:09:32.467517 containerd[1934]: time="2025-01-13T20:09:32.467427128Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"f5e883fc61f95c31957335ed367bbb8d4c07a9c5470ee6e51fca5c2bde0bfb8c\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:09:32.469807 containerd[1934]: time="2025-01-13T20:09:32.468308384Z" level=info msg="RemovePodSandbox \"f5e883fc61f95c31957335ed367bbb8d4c07a9c5470ee6e51fca5c2bde0bfb8c\" returns successfully" Jan 13 20:09:32.469653 systemd[1]: session-13.scope: Deactivated successfully. Jan 13 20:09:32.474632 systemd-logind[1912]: Session 13 logged out. Waiting for processes to exit. Jan 13 20:09:32.478603 systemd-logind[1912]: Removed session 13. Jan 13 20:09:32.485528 containerd[1934]: time="2025-01-13T20:09:32.483083348Z" level=info msg="StopPodSandbox for \"eed11d015ff645b963130f5ad956d107f391cbaba3451e015229fc4082c60951\"" Jan 13 20:09:32.488619 containerd[1934]: time="2025-01-13T20:09:32.487675700Z" level=info msg="TearDown network for sandbox \"eed11d015ff645b963130f5ad956d107f391cbaba3451e015229fc4082c60951\" successfully" Jan 13 20:09:32.490311 containerd[1934]: time="2025-01-13T20:09:32.488609180Z" level=info msg="StopPodSandbox for \"eed11d015ff645b963130f5ad956d107f391cbaba3451e015229fc4082c60951\" returns successfully" Jan 13 20:09:32.496492 containerd[1934]: time="2025-01-13T20:09:32.496421768Z" level=info msg="RemovePodSandbox for \"eed11d015ff645b963130f5ad956d107f391cbaba3451e015229fc4082c60951\"" Jan 13 20:09:32.496656 containerd[1934]: time="2025-01-13T20:09:32.496495796Z" level=info msg="Forcibly stopping sandbox \"eed11d015ff645b963130f5ad956d107f391cbaba3451e015229fc4082c60951\"" Jan 13 20:09:32.496656 containerd[1934]: time="2025-01-13T20:09:32.496638236Z" level=info msg="TearDown network for sandbox \"eed11d015ff645b963130f5ad956d107f391cbaba3451e015229fc4082c60951\" successfully" Jan 13 20:09:32.517682 containerd[1934]: time="2025-01-13T20:09:32.517611404Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"eed11d015ff645b963130f5ad956d107f391cbaba3451e015229fc4082c60951\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:09:32.518096 containerd[1934]: time="2025-01-13T20:09:32.518033324Z" level=info msg="RemovePodSandbox \"eed11d015ff645b963130f5ad956d107f391cbaba3451e015229fc4082c60951\" returns successfully" Jan 13 20:09:32.518961 containerd[1934]: time="2025-01-13T20:09:32.518890580Z" level=info msg="StopPodSandbox for \"8c0c460fc82d1c51ed146afb77bb0cdfb42636cd5b1ebd0d7d108e8d75eb9610\"" Jan 13 20:09:32.519400 containerd[1934]: time="2025-01-13T20:09:32.519349472Z" level=info msg="TearDown network for sandbox \"8c0c460fc82d1c51ed146afb77bb0cdfb42636cd5b1ebd0d7d108e8d75eb9610\" successfully" Jan 13 20:09:32.519885 containerd[1934]: time="2025-01-13T20:09:32.519503348Z" level=info msg="StopPodSandbox for \"8c0c460fc82d1c51ed146afb77bb0cdfb42636cd5b1ebd0d7d108e8d75eb9610\" returns successfully" Jan 13 20:09:32.520627 containerd[1934]: time="2025-01-13T20:09:32.520112768Z" level=info msg="RemovePodSandbox for \"8c0c460fc82d1c51ed146afb77bb0cdfb42636cd5b1ebd0d7d108e8d75eb9610\"" Jan 13 20:09:32.520627 containerd[1934]: time="2025-01-13T20:09:32.520169012Z" level=info msg="Forcibly stopping sandbox \"8c0c460fc82d1c51ed146afb77bb0cdfb42636cd5b1ebd0d7d108e8d75eb9610\"" Jan 13 20:09:32.520627 containerd[1934]: time="2025-01-13T20:09:32.520296812Z" level=info msg="TearDown network for sandbox \"8c0c460fc82d1c51ed146afb77bb0cdfb42636cd5b1ebd0d7d108e8d75eb9610\" successfully" Jan 13 20:09:32.572742 containerd[1934]: time="2025-01-13T20:09:32.572575232Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"8c0c460fc82d1c51ed146afb77bb0cdfb42636cd5b1ebd0d7d108e8d75eb9610\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:09:32.576023 containerd[1934]: time="2025-01-13T20:09:32.574261748Z" level=info msg="RemovePodSandbox \"8c0c460fc82d1c51ed146afb77bb0cdfb42636cd5b1ebd0d7d108e8d75eb9610\" returns successfully" Jan 13 20:09:32.585064 containerd[1934]: time="2025-01-13T20:09:32.584361692Z" level=info msg="StopPodSandbox for \"d179e7ae754d81c958ff901cb7c596dc225e5822f67938ade6bc971cc1e73234\"" Jan 13 20:09:32.591812 containerd[1934]: time="2025-01-13T20:09:32.591299516Z" level=info msg="TearDown network for sandbox \"d179e7ae754d81c958ff901cb7c596dc225e5822f67938ade6bc971cc1e73234\" successfully" Jan 13 20:09:32.591812 containerd[1934]: time="2025-01-13T20:09:32.591575936Z" level=info msg="StopPodSandbox for \"d179e7ae754d81c958ff901cb7c596dc225e5822f67938ade6bc971cc1e73234\" returns successfully" Jan 13 20:09:32.594087 containerd[1934]: time="2025-01-13T20:09:32.594022760Z" level=info msg="RemovePodSandbox for \"d179e7ae754d81c958ff901cb7c596dc225e5822f67938ade6bc971cc1e73234\"" Jan 13 20:09:32.594087 containerd[1934]: time="2025-01-13T20:09:32.594084404Z" level=info msg="Forcibly stopping sandbox \"d179e7ae754d81c958ff901cb7c596dc225e5822f67938ade6bc971cc1e73234\"" Jan 13 20:09:32.594300 containerd[1934]: time="2025-01-13T20:09:32.594223940Z" level=info msg="TearDown network for sandbox \"d179e7ae754d81c958ff901cb7c596dc225e5822f67938ade6bc971cc1e73234\" successfully" Jan 13 20:09:32.629184 containerd[1934]: time="2025-01-13T20:09:32.628915113Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"d179e7ae754d81c958ff901cb7c596dc225e5822f67938ade6bc971cc1e73234\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:09:32.629184 containerd[1934]: time="2025-01-13T20:09:32.629008797Z" level=info msg="RemovePodSandbox \"d179e7ae754d81c958ff901cb7c596dc225e5822f67938ade6bc971cc1e73234\" returns successfully" Jan 13 20:09:32.630633 containerd[1934]: time="2025-01-13T20:09:32.630191469Z" level=info msg="StopPodSandbox for \"c8d12cba52fd60ec08cc5638f4d4379aae8d673464810205dafbb978080837b3\"" Jan 13 20:09:32.630633 containerd[1934]: time="2025-01-13T20:09:32.630376713Z" level=info msg="TearDown network for sandbox \"c8d12cba52fd60ec08cc5638f4d4379aae8d673464810205dafbb978080837b3\" successfully" Jan 13 20:09:32.630633 containerd[1934]: time="2025-01-13T20:09:32.630399657Z" level=info msg="StopPodSandbox for \"c8d12cba52fd60ec08cc5638f4d4379aae8d673464810205dafbb978080837b3\" returns successfully" Jan 13 20:09:32.631688 containerd[1934]: time="2025-01-13T20:09:32.631640085Z" level=info msg="RemovePodSandbox for \"c8d12cba52fd60ec08cc5638f4d4379aae8d673464810205dafbb978080837b3\"" Jan 13 20:09:32.634148 containerd[1934]: time="2025-01-13T20:09:32.634075221Z" level=info msg="Forcibly stopping sandbox \"c8d12cba52fd60ec08cc5638f4d4379aae8d673464810205dafbb978080837b3\"" Jan 13 20:09:32.634272 containerd[1934]: time="2025-01-13T20:09:32.634252101Z" level=info msg="TearDown network for sandbox \"c8d12cba52fd60ec08cc5638f4d4379aae8d673464810205dafbb978080837b3\" successfully" Jan 13 20:09:32.679439 containerd[1934]: time="2025-01-13T20:09:32.678866229Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"c8d12cba52fd60ec08cc5638f4d4379aae8d673464810205dafbb978080837b3\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:09:32.679439 containerd[1934]: time="2025-01-13T20:09:32.678954057Z" level=info msg="RemovePodSandbox \"c8d12cba52fd60ec08cc5638f4d4379aae8d673464810205dafbb978080837b3\" returns successfully" Jan 13 20:09:32.681966 containerd[1934]: time="2025-01-13T20:09:32.681290481Z" level=info msg="StopPodSandbox for \"eede6c995fce264cd780e29e58a08fa68b4c54baafa60c3289b9cd92b98c7c6c\"" Jan 13 20:09:32.681966 containerd[1934]: time="2025-01-13T20:09:32.681466893Z" level=info msg="TearDown network for sandbox \"eede6c995fce264cd780e29e58a08fa68b4c54baafa60c3289b9cd92b98c7c6c\" successfully" Jan 13 20:09:32.681966 containerd[1934]: time="2025-01-13T20:09:32.681491889Z" level=info msg="StopPodSandbox for \"eede6c995fce264cd780e29e58a08fa68b4c54baafa60c3289b9cd92b98c7c6c\" returns successfully" Jan 13 20:09:32.699813 containerd[1934]: time="2025-01-13T20:09:32.698699541Z" level=info msg="RemovePodSandbox for \"eede6c995fce264cd780e29e58a08fa68b4c54baafa60c3289b9cd92b98c7c6c\"" Jan 13 20:09:32.699813 containerd[1934]: time="2025-01-13T20:09:32.698762037Z" level=info msg="Forcibly stopping sandbox \"eede6c995fce264cd780e29e58a08fa68b4c54baafa60c3289b9cd92b98c7c6c\"" Jan 13 20:09:32.699813 containerd[1934]: time="2025-01-13T20:09:32.698926785Z" level=info msg="TearDown network for sandbox \"eede6c995fce264cd780e29e58a08fa68b4c54baafa60c3289b9cd92b98c7c6c\" successfully" Jan 13 20:09:32.734220 containerd[1934]: time="2025-01-13T20:09:32.733726221Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"eede6c995fce264cd780e29e58a08fa68b4c54baafa60c3289b9cd92b98c7c6c\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:09:32.735193 containerd[1934]: time="2025-01-13T20:09:32.735119457Z" level=info msg="RemovePodSandbox \"eede6c995fce264cd780e29e58a08fa68b4c54baafa60c3289b9cd92b98c7c6c\" returns successfully" Jan 13 20:09:32.741086 containerd[1934]: time="2025-01-13T20:09:32.739056237Z" level=info msg="StopPodSandbox for \"57f3ef7b6cf66ed3ed7b779c226fa67874c55496cae0804a70bff6ecec1ef212\"" Jan 13 20:09:32.744153 containerd[1934]: time="2025-01-13T20:09:32.742966509Z" level=info msg="TearDown network for sandbox \"57f3ef7b6cf66ed3ed7b779c226fa67874c55496cae0804a70bff6ecec1ef212\" successfully" Jan 13 20:09:32.748321 containerd[1934]: time="2025-01-13T20:09:32.748248393Z" level=info msg="StopPodSandbox for \"57f3ef7b6cf66ed3ed7b779c226fa67874c55496cae0804a70bff6ecec1ef212\" returns successfully" Jan 13 20:09:32.750912 containerd[1934]: time="2025-01-13T20:09:32.750794565Z" level=info msg="RemovePodSandbox for \"57f3ef7b6cf66ed3ed7b779c226fa67874c55496cae0804a70bff6ecec1ef212\"" Jan 13 20:09:32.750912 containerd[1934]: time="2025-01-13T20:09:32.750853389Z" level=info msg="Forcibly stopping sandbox \"57f3ef7b6cf66ed3ed7b779c226fa67874c55496cae0804a70bff6ecec1ef212\"" Jan 13 20:09:32.751082 containerd[1934]: time="2025-01-13T20:09:32.750998013Z" level=info msg="TearDown network for sandbox \"57f3ef7b6cf66ed3ed7b779c226fa67874c55496cae0804a70bff6ecec1ef212\" successfully" Jan 13 20:09:32.791242 containerd[1934]: time="2025-01-13T20:09:32.790945929Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"57f3ef7b6cf66ed3ed7b779c226fa67874c55496cae0804a70bff6ecec1ef212\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:09:32.791242 containerd[1934]: time="2025-01-13T20:09:32.791040981Z" level=info msg="RemovePodSandbox \"57f3ef7b6cf66ed3ed7b779c226fa67874c55496cae0804a70bff6ecec1ef212\" returns successfully" Jan 13 20:09:32.802465 containerd[1934]: time="2025-01-13T20:09:32.802122405Z" level=info msg="StopPodSandbox for \"a86b825795730ba2f9f58fb14a41879f6cdba9ae4550e62d02a587d4dd982d06\"" Jan 13 20:09:32.802465 containerd[1934]: time="2025-01-13T20:09:32.802318737Z" level=info msg="TearDown network for sandbox \"a86b825795730ba2f9f58fb14a41879f6cdba9ae4550e62d02a587d4dd982d06\" successfully" Jan 13 20:09:32.802465 containerd[1934]: time="2025-01-13T20:09:32.802343685Z" level=info msg="StopPodSandbox for \"a86b825795730ba2f9f58fb14a41879f6cdba9ae4550e62d02a587d4dd982d06\" returns successfully" Jan 13 20:09:32.807536 containerd[1934]: time="2025-01-13T20:09:32.806702025Z" level=info msg="RemovePodSandbox for \"a86b825795730ba2f9f58fb14a41879f6cdba9ae4550e62d02a587d4dd982d06\"" Jan 13 20:09:32.807536 containerd[1934]: time="2025-01-13T20:09:32.807123657Z" level=info msg="Forcibly stopping sandbox \"a86b825795730ba2f9f58fb14a41879f6cdba9ae4550e62d02a587d4dd982d06\"" Jan 13 20:09:32.810275 containerd[1934]: time="2025-01-13T20:09:32.809522361Z" level=info msg="TearDown network for sandbox \"a86b825795730ba2f9f58fb14a41879f6cdba9ae4550e62d02a587d4dd982d06\" successfully" Jan 13 20:09:32.847868 containerd[1934]: time="2025-01-13T20:09:32.846582418Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"a86b825795730ba2f9f58fb14a41879f6cdba9ae4550e62d02a587d4dd982d06\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:09:32.847868 containerd[1934]: time="2025-01-13T20:09:32.846667162Z" level=info msg="RemovePodSandbox \"a86b825795730ba2f9f58fb14a41879f6cdba9ae4550e62d02a587d4dd982d06\" returns successfully" Jan 13 20:09:32.859083 containerd[1934]: time="2025-01-13T20:09:32.859015858Z" level=info msg="StopPodSandbox for \"3999268688ddddddb7ec9df611d8146f50072274600306787cd56688f110d548\"" Jan 13 20:09:32.859229 containerd[1934]: time="2025-01-13T20:09:32.859208338Z" level=info msg="TearDown network for sandbox \"3999268688ddddddb7ec9df611d8146f50072274600306787cd56688f110d548\" successfully" Jan 13 20:09:32.859331 containerd[1934]: time="2025-01-13T20:09:32.859231606Z" level=info msg="StopPodSandbox for \"3999268688ddddddb7ec9df611d8146f50072274600306787cd56688f110d548\" returns successfully" Jan 13 20:09:32.864137 containerd[1934]: time="2025-01-13T20:09:32.864067846Z" level=info msg="RemovePodSandbox for \"3999268688ddddddb7ec9df611d8146f50072274600306787cd56688f110d548\"" Jan 13 20:09:32.864137 containerd[1934]: time="2025-01-13T20:09:32.864138838Z" level=info msg="Forcibly stopping sandbox \"3999268688ddddddb7ec9df611d8146f50072274600306787cd56688f110d548\"" Jan 13 20:09:32.864322 containerd[1934]: time="2025-01-13T20:09:32.864297190Z" level=info msg="TearDown network for sandbox \"3999268688ddddddb7ec9df611d8146f50072274600306787cd56688f110d548\" successfully" Jan 13 20:09:32.871249 containerd[1934]: time="2025-01-13T20:09:32.871181734Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"3999268688ddddddb7ec9df611d8146f50072274600306787cd56688f110d548\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:09:32.871403 containerd[1934]: time="2025-01-13T20:09:32.871274422Z" level=info msg="RemovePodSandbox \"3999268688ddddddb7ec9df611d8146f50072274600306787cd56688f110d548\" returns successfully" Jan 13 20:09:32.873712 containerd[1934]: time="2025-01-13T20:09:32.873276502Z" level=info msg="StopPodSandbox for \"bb64b66507a4d3948827c99dee10022276bd2b85dcce58713749456b89a5723b\"" Jan 13 20:09:32.874945 containerd[1934]: time="2025-01-13T20:09:32.874422970Z" level=info msg="TearDown network for sandbox \"bb64b66507a4d3948827c99dee10022276bd2b85dcce58713749456b89a5723b\" successfully" Jan 13 20:09:32.874945 containerd[1934]: time="2025-01-13T20:09:32.874840522Z" level=info msg="StopPodSandbox for \"bb64b66507a4d3948827c99dee10022276bd2b85dcce58713749456b89a5723b\" returns successfully" Jan 13 20:09:32.877318 containerd[1934]: time="2025-01-13T20:09:32.877115638Z" level=info msg="RemovePodSandbox for \"bb64b66507a4d3948827c99dee10022276bd2b85dcce58713749456b89a5723b\"" Jan 13 20:09:32.877318 containerd[1934]: time="2025-01-13T20:09:32.877176970Z" level=info msg="Forcibly stopping sandbox \"bb64b66507a4d3948827c99dee10022276bd2b85dcce58713749456b89a5723b\"" Jan 13 20:09:32.883826 containerd[1934]: time="2025-01-13T20:09:32.882838462Z" level=info msg="TearDown network for sandbox \"bb64b66507a4d3948827c99dee10022276bd2b85dcce58713749456b89a5723b\" successfully" Jan 13 20:09:32.899651 containerd[1934]: time="2025-01-13T20:09:32.899544526Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"bb64b66507a4d3948827c99dee10022276bd2b85dcce58713749456b89a5723b\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:09:32.899809 containerd[1934]: time="2025-01-13T20:09:32.899680462Z" level=info msg="RemovePodSandbox \"bb64b66507a4d3948827c99dee10022276bd2b85dcce58713749456b89a5723b\" returns successfully" Jan 13 20:09:32.901535 containerd[1934]: time="2025-01-13T20:09:32.901487170Z" level=info msg="StopPodSandbox for \"37e8d359f609f540d9e2f49bc83e7f3d5e4296810bef7cdacf10f479884043e5\"" Jan 13 20:09:32.905854 containerd[1934]: time="2025-01-13T20:09:32.904580182Z" level=info msg="TearDown network for sandbox \"37e8d359f609f540d9e2f49bc83e7f3d5e4296810bef7cdacf10f479884043e5\" successfully" Jan 13 20:09:32.906240 containerd[1934]: time="2025-01-13T20:09:32.906178714Z" level=info msg="StopPodSandbox for \"37e8d359f609f540d9e2f49bc83e7f3d5e4296810bef7cdacf10f479884043e5\" returns successfully" Jan 13 20:09:32.907654 containerd[1934]: time="2025-01-13T20:09:32.907605310Z" level=info msg="RemovePodSandbox for \"37e8d359f609f540d9e2f49bc83e7f3d5e4296810bef7cdacf10f479884043e5\"" Jan 13 20:09:32.907933 containerd[1934]: time="2025-01-13T20:09:32.907901194Z" level=info msg="Forcibly stopping sandbox \"37e8d359f609f540d9e2f49bc83e7f3d5e4296810bef7cdacf10f479884043e5\"" Jan 13 20:09:32.909403 containerd[1934]: time="2025-01-13T20:09:32.909350230Z" level=info msg="TearDown network for sandbox \"37e8d359f609f540d9e2f49bc83e7f3d5e4296810bef7cdacf10f479884043e5\" successfully" Jan 13 20:09:32.941678 containerd[1934]: time="2025-01-13T20:09:32.941542366Z" level=error msg="Failed to destroy network for sandbox \"41f52017578a2719bea2c9934c17ea164adf7cb7d5ed2c0dd11787fd25b06487\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:32.942648 containerd[1934]: time="2025-01-13T20:09:32.942517378Z" level=error msg="encountered an error cleaning up failed sandbox \"41f52017578a2719bea2c9934c17ea164adf7cb7d5ed2c0dd11787fd25b06487\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:32.942648 containerd[1934]: time="2025-01-13T20:09:32.942628066Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-kube-controllers-68f76c7ddf-lh8nj,Uid:2be21c11-9c2d-4b9a-81a5-0e73daba31c1,Namespace:calico-system,Attempt:7,} failed, error" error="failed to setup network for sandbox \"41f52017578a2719bea2c9934c17ea164adf7cb7d5ed2c0dd11787fd25b06487\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:32.944127 containerd[1934]: time="2025-01-13T20:09:32.942943474Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"37e8d359f609f540d9e2f49bc83e7f3d5e4296810bef7cdacf10f479884043e5\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:09:32.944127 containerd[1934]: time="2025-01-13T20:09:32.943028758Z" level=info msg="RemovePodSandbox \"37e8d359f609f540d9e2f49bc83e7f3d5e4296810bef7cdacf10f479884043e5\" returns successfully" Jan 13 20:09:32.944276 kubelet[3423]: E0113 20:09:32.943110 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"41f52017578a2719bea2c9934c17ea164adf7cb7d5ed2c0dd11787fd25b06487\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:32.944276 kubelet[3423]: E0113 20:09:32.943424 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"41f52017578a2719bea2c9934c17ea164adf7cb7d5ed2c0dd11787fd25b06487\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/calico-kube-controllers-68f76c7ddf-lh8nj" Jan 13 20:09:32.944276 kubelet[3423]: E0113 20:09:32.943477 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"41f52017578a2719bea2c9934c17ea164adf7cb7d5ed2c0dd11787fd25b06487\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/calico-kube-controllers-68f76c7ddf-lh8nj" Jan 13 20:09:32.947176 kubelet[3423]: E0113 20:09:32.943566 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"calico-kube-controllers-68f76c7ddf-lh8nj_calico-system(2be21c11-9c2d-4b9a-81a5-0e73daba31c1)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"calico-kube-controllers-68f76c7ddf-lh8nj_calico-system(2be21c11-9c2d-4b9a-81a5-0e73daba31c1)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"41f52017578a2719bea2c9934c17ea164adf7cb7d5ed2c0dd11787fd25b06487\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-system/calico-kube-controllers-68f76c7ddf-lh8nj" podUID="2be21c11-9c2d-4b9a-81a5-0e73daba31c1" Jan 13 20:09:32.947315 containerd[1934]: time="2025-01-13T20:09:32.946453306Z" level=info msg="StopPodSandbox for \"538f604b05684d3571dee3d0a58795500745c5ecc1a4cabbf340ef00fa2e3044\"" Jan 13 20:09:32.949521 containerd[1934]: time="2025-01-13T20:09:32.948867106Z" level=info msg="TearDown network for sandbox \"538f604b05684d3571dee3d0a58795500745c5ecc1a4cabbf340ef00fa2e3044\" successfully" Jan 13 20:09:32.950538 containerd[1934]: time="2025-01-13T20:09:32.949305682Z" level=info msg="StopPodSandbox for \"538f604b05684d3571dee3d0a58795500745c5ecc1a4cabbf340ef00fa2e3044\" returns successfully" Jan 13 20:09:32.953493 containerd[1934]: time="2025-01-13T20:09:32.953307454Z" level=error msg="Failed to destroy network for sandbox \"6ca554906e8aff3cb9eab87b291894d187892c2a6910248683c6fe51f5efa9c4\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:32.954473 containerd[1934]: time="2025-01-13T20:09:32.954232666Z" level=info msg="RemovePodSandbox for \"538f604b05684d3571dee3d0a58795500745c5ecc1a4cabbf340ef00fa2e3044\"" Jan 13 20:09:32.954473 containerd[1934]: time="2025-01-13T20:09:32.954294874Z" level=info msg="Forcibly stopping sandbox \"538f604b05684d3571dee3d0a58795500745c5ecc1a4cabbf340ef00fa2e3044\"" Jan 13 20:09:32.954473 containerd[1934]: time="2025-01-13T20:09:32.954442402Z" level=info msg="TearDown network for sandbox \"538f604b05684d3571dee3d0a58795500745c5ecc1a4cabbf340ef00fa2e3044\" successfully" Jan 13 20:09:32.955830 containerd[1934]: time="2025-01-13T20:09:32.955610458Z" level=error msg="encountered an error cleaning up failed sandbox \"6ca554906e8aff3cb9eab87b291894d187892c2a6910248683c6fe51f5efa9c4\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:32.955830 containerd[1934]: time="2025-01-13T20:09:32.955724698Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:csi-node-driver-wq54r,Uid:d47fc662-eff9-4473-83da-b6f0b896d81f,Namespace:calico-system,Attempt:7,} failed, error" error="failed to setup network for sandbox \"6ca554906e8aff3cb9eab87b291894d187892c2a6910248683c6fe51f5efa9c4\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:32.956667 kubelet[3423]: E0113 20:09:32.956045 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"6ca554906e8aff3cb9eab87b291894d187892c2a6910248683c6fe51f5efa9c4\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:32.956667 kubelet[3423]: E0113 20:09:32.956119 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"6ca554906e8aff3cb9eab87b291894d187892c2a6910248683c6fe51f5efa9c4\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/csi-node-driver-wq54r" Jan 13 20:09:32.956667 kubelet[3423]: E0113 20:09:32.956155 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"6ca554906e8aff3cb9eab87b291894d187892c2a6910248683c6fe51f5efa9c4\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/csi-node-driver-wq54r" Jan 13 20:09:32.957923 kubelet[3423]: E0113 20:09:32.957525 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"csi-node-driver-wq54r_calico-system(d47fc662-eff9-4473-83da-b6f0b896d81f)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"csi-node-driver-wq54r_calico-system(d47fc662-eff9-4473-83da-b6f0b896d81f)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"6ca554906e8aff3cb9eab87b291894d187892c2a6910248683c6fe51f5efa9c4\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-system/csi-node-driver-wq54r" podUID="d47fc662-eff9-4473-83da-b6f0b896d81f" Jan 13 20:09:32.972100 containerd[1934]: time="2025-01-13T20:09:32.971973034Z" level=error msg="Failed to destroy network for sandbox \"e4f3782869a95e1724e7fed0918f96150403f3af79725f813cf600d13dab0323\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:32.976809 containerd[1934]: time="2025-01-13T20:09:32.976551814Z" level=error msg="encountered an error cleaning up failed sandbox \"e4f3782869a95e1724e7fed0918f96150403f3af79725f813cf600d13dab0323\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:32.976809 containerd[1934]: time="2025-01-13T20:09:32.976664650Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-7fbffcd8cd-pxvdr,Uid:8f72f896-c0ba-4b07-9a22-acc5c8ca3697,Namespace:calico-apiserver,Attempt:7,} failed, error" error="failed to setup network for sandbox \"e4f3782869a95e1724e7fed0918f96150403f3af79725f813cf600d13dab0323\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:32.977472 kubelet[3423]: E0113 20:09:32.977430 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e4f3782869a95e1724e7fed0918f96150403f3af79725f813cf600d13dab0323\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:32.977591 kubelet[3423]: E0113 20:09:32.977513 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e4f3782869a95e1724e7fed0918f96150403f3af79725f813cf600d13dab0323\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-pxvdr" Jan 13 20:09:32.977591 kubelet[3423]: E0113 20:09:32.977554 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e4f3782869a95e1724e7fed0918f96150403f3af79725f813cf600d13dab0323\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-pxvdr" Jan 13 20:09:32.977720 kubelet[3423]: E0113 20:09:32.977636 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"calico-apiserver-7fbffcd8cd-pxvdr_calico-apiserver(8f72f896-c0ba-4b07-9a22-acc5c8ca3697)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"calico-apiserver-7fbffcd8cd-pxvdr_calico-apiserver(8f72f896-c0ba-4b07-9a22-acc5c8ca3697)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"e4f3782869a95e1724e7fed0918f96150403f3af79725f813cf600d13dab0323\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-pxvdr" podUID="8f72f896-c0ba-4b07-9a22-acc5c8ca3697" Jan 13 20:09:32.979470 containerd[1934]: time="2025-01-13T20:09:32.979175578Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"538f604b05684d3571dee3d0a58795500745c5ecc1a4cabbf340ef00fa2e3044\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:09:32.979470 containerd[1934]: time="2025-01-13T20:09:32.979267990Z" level=info msg="RemovePodSandbox \"538f604b05684d3571dee3d0a58795500745c5ecc1a4cabbf340ef00fa2e3044\" returns successfully" Jan 13 20:09:32.985006 containerd[1934]: time="2025-01-13T20:09:32.984316630Z" level=info msg="StopPodSandbox for \"c787f8945e5c1c02a132aebe2ce54537e8efb76054bd3d61620dd081ac229a87\"" Jan 13 20:09:32.985867 containerd[1934]: time="2025-01-13T20:09:32.985808962Z" level=info msg="TearDown network for sandbox \"c787f8945e5c1c02a132aebe2ce54537e8efb76054bd3d61620dd081ac229a87\" successfully" Jan 13 20:09:32.985867 containerd[1934]: time="2025-01-13T20:09:32.985856854Z" level=info msg="StopPodSandbox for \"c787f8945e5c1c02a132aebe2ce54537e8efb76054bd3d61620dd081ac229a87\" returns successfully" Jan 13 20:09:32.987147 containerd[1934]: time="2025-01-13T20:09:32.987071542Z" level=info msg="RemovePodSandbox for \"c787f8945e5c1c02a132aebe2ce54537e8efb76054bd3d61620dd081ac229a87\"" Jan 13 20:09:32.987481 containerd[1934]: time="2025-01-13T20:09:32.987386854Z" level=info msg="Forcibly stopping sandbox \"c787f8945e5c1c02a132aebe2ce54537e8efb76054bd3d61620dd081ac229a87\"" Jan 13 20:09:32.988087 containerd[1934]: time="2025-01-13T20:09:32.987930034Z" level=info msg="TearDown network for sandbox \"c787f8945e5c1c02a132aebe2ce54537e8efb76054bd3d61620dd081ac229a87\" successfully" Jan 13 20:09:33.000485 kubelet[3423]: I0113 20:09:33.000391 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6ca554906e8aff3cb9eab87b291894d187892c2a6910248683c6fe51f5efa9c4" Jan 13 20:09:33.004400 containerd[1934]: time="2025-01-13T20:09:33.003947994Z" level=info msg="StopPodSandbox for \"6ca554906e8aff3cb9eab87b291894d187892c2a6910248683c6fe51f5efa9c4\"" Jan 13 20:09:33.004400 containerd[1934]: time="2025-01-13T20:09:33.004354734Z" level=info msg="Ensure that sandbox 6ca554906e8aff3cb9eab87b291894d187892c2a6910248683c6fe51f5efa9c4 in task-service has been cleanup successfully" Jan 13 20:09:33.019545 containerd[1934]: time="2025-01-13T20:09:33.019419846Z" level=info msg="TearDown network for sandbox \"6ca554906e8aff3cb9eab87b291894d187892c2a6910248683c6fe51f5efa9c4\" successfully" Jan 13 20:09:33.019545 containerd[1934]: time="2025-01-13T20:09:33.019464786Z" level=info msg="StopPodSandbox for \"6ca554906e8aff3cb9eab87b291894d187892c2a6910248683c6fe51f5efa9c4\" returns successfully" Jan 13 20:09:33.026830 containerd[1934]: time="2025-01-13T20:09:33.023396682Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"c787f8945e5c1c02a132aebe2ce54537e8efb76054bd3d61620dd081ac229a87\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:09:33.026830 containerd[1934]: time="2025-01-13T20:09:33.023605290Z" level=info msg="RemovePodSandbox \"c787f8945e5c1c02a132aebe2ce54537e8efb76054bd3d61620dd081ac229a87\" returns successfully" Jan 13 20:09:33.028714 containerd[1934]: time="2025-01-13T20:09:33.028227690Z" level=info msg="StopPodSandbox for \"dfb5cc6aa8ee548a0817f76e636f6ba17a9915fccdeb0f77deba61f58d7154ee\"" Jan 13 20:09:33.028714 containerd[1934]: time="2025-01-13T20:09:33.028394442Z" level=info msg="TearDown network for sandbox \"dfb5cc6aa8ee548a0817f76e636f6ba17a9915fccdeb0f77deba61f58d7154ee\" successfully" Jan 13 20:09:33.028714 containerd[1934]: time="2025-01-13T20:09:33.028417650Z" level=info msg="StopPodSandbox for \"dfb5cc6aa8ee548a0817f76e636f6ba17a9915fccdeb0f77deba61f58d7154ee\" returns successfully" Jan 13 20:09:33.029055 containerd[1934]: time="2025-01-13T20:09:33.029009010Z" level=info msg="StopPodSandbox for \"2accd017db7708cc1fa5c6da328b2f1c3f1c063e1b4b76d232d0c4e3cdca6a6d\"" Jan 13 20:09:33.029194 containerd[1934]: time="2025-01-13T20:09:33.029156850Z" level=info msg="TearDown network for sandbox \"2accd017db7708cc1fa5c6da328b2f1c3f1c063e1b4b76d232d0c4e3cdca6a6d\" successfully" Jan 13 20:09:33.029254 containerd[1934]: time="2025-01-13T20:09:33.029188987Z" level=info msg="StopPodSandbox for \"2accd017db7708cc1fa5c6da328b2f1c3f1c063e1b4b76d232d0c4e3cdca6a6d\" returns successfully" Jan 13 20:09:33.030118 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-41f52017578a2719bea2c9934c17ea164adf7cb7d5ed2c0dd11787fd25b06487-shm.mount: Deactivated successfully. Jan 13 20:09:33.034644 containerd[1934]: time="2025-01-13T20:09:33.034591195Z" level=info msg="StopPodSandbox for \"8615086423d6201ef85384f1854ecd8c82e04e1edced15a3499ba0b0b99f7588\"" Jan 13 20:09:33.037209 containerd[1934]: time="2025-01-13T20:09:33.035263555Z" level=info msg="RemovePodSandbox for \"2accd017db7708cc1fa5c6da328b2f1c3f1c063e1b4b76d232d0c4e3cdca6a6d\"" Jan 13 20:09:33.038518 containerd[1934]: time="2025-01-13T20:09:33.038382595Z" level=info msg="Forcibly stopping sandbox \"2accd017db7708cc1fa5c6da328b2f1c3f1c063e1b4b76d232d0c4e3cdca6a6d\"" Jan 13 20:09:33.039312 containerd[1934]: time="2025-01-13T20:09:33.039178567Z" level=info msg="TearDown network for sandbox \"8615086423d6201ef85384f1854ecd8c82e04e1edced15a3499ba0b0b99f7588\" successfully" Jan 13 20:09:33.039312 containerd[1934]: time="2025-01-13T20:09:33.039230911Z" level=info msg="StopPodSandbox for \"8615086423d6201ef85384f1854ecd8c82e04e1edced15a3499ba0b0b99f7588\" returns successfully" Jan 13 20:09:33.040851 kubelet[3423]: I0113 20:09:33.040131 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="41f52017578a2719bea2c9934c17ea164adf7cb7d5ed2c0dd11787fd25b06487" Jan 13 20:09:33.043627 containerd[1934]: time="2025-01-13T20:09:33.043466359Z" level=info msg="TearDown network for sandbox \"2accd017db7708cc1fa5c6da328b2f1c3f1c063e1b4b76d232d0c4e3cdca6a6d\" successfully" Jan 13 20:09:33.044648 systemd[1]: run-netns-cni\x2d465966da\x2dabb4\x2deb11\x2d4f48\x2dc76fd1dedf9e.mount: Deactivated successfully. Jan 13 20:09:33.049551 containerd[1934]: time="2025-01-13T20:09:33.049488103Z" level=info msg="StopPodSandbox for \"a04750e9fc31e16c9110301f495a11a345e09ad202ac48d631cc7f81772e7ec2\"" Jan 13 20:09:33.049918 containerd[1934]: time="2025-01-13T20:09:33.045927523Z" level=info msg="StopPodSandbox for \"41f52017578a2719bea2c9934c17ea164adf7cb7d5ed2c0dd11787fd25b06487\"" Jan 13 20:09:33.049918 containerd[1934]: time="2025-01-13T20:09:33.049665475Z" level=info msg="TearDown network for sandbox \"a04750e9fc31e16c9110301f495a11a345e09ad202ac48d631cc7f81772e7ec2\" successfully" Jan 13 20:09:33.049918 containerd[1934]: time="2025-01-13T20:09:33.049690771Z" level=info msg="StopPodSandbox for \"a04750e9fc31e16c9110301f495a11a345e09ad202ac48d631cc7f81772e7ec2\" returns successfully" Jan 13 20:09:33.055398 containerd[1934]: time="2025-01-13T20:09:33.055045147Z" level=info msg="Ensure that sandbox 41f52017578a2719bea2c9934c17ea164adf7cb7d5ed2c0dd11787fd25b06487 in task-service has been cleanup successfully" Jan 13 20:09:33.057752 containerd[1934]: time="2025-01-13T20:09:33.057679747Z" level=info msg="StopPodSandbox for \"955f9fe6553205f6e71b94a6922fdece40d5d1a8c6a343e9a0aa0f4bf2abbb69\"" Jan 13 20:09:33.058138 containerd[1934]: time="2025-01-13T20:09:33.057900607Z" level=info msg="TearDown network for sandbox \"955f9fe6553205f6e71b94a6922fdece40d5d1a8c6a343e9a0aa0f4bf2abbb69\" successfully" Jan 13 20:09:33.058138 containerd[1934]: time="2025-01-13T20:09:33.057925171Z" level=info msg="StopPodSandbox for \"955f9fe6553205f6e71b94a6922fdece40d5d1a8c6a343e9a0aa0f4bf2abbb69\" returns successfully" Jan 13 20:09:33.066464 systemd[1]: run-netns-cni\x2d607d526b\x2d6839\x2d9f2b\x2d3e37\x2d85d3356def5c.mount: Deactivated successfully. Jan 13 20:09:33.070141 containerd[1934]: time="2025-01-13T20:09:33.068713975Z" level=info msg="TearDown network for sandbox \"41f52017578a2719bea2c9934c17ea164adf7cb7d5ed2c0dd11787fd25b06487\" successfully" Jan 13 20:09:33.070141 containerd[1934]: time="2025-01-13T20:09:33.069938371Z" level=info msg="StopPodSandbox for \"41f52017578a2719bea2c9934c17ea164adf7cb7d5ed2c0dd11787fd25b06487\" returns successfully" Jan 13 20:09:33.080653 containerd[1934]: time="2025-01-13T20:09:33.080531575Z" level=info msg="StopPodSandbox for \"aeb47e19302f9c839c5fa002c506a56722057a24b2c06c5082b07dd07a783384\"" Jan 13 20:09:33.088306 containerd[1934]: time="2025-01-13T20:09:33.088010443Z" level=info msg="TearDown network for sandbox \"aeb47e19302f9c839c5fa002c506a56722057a24b2c06c5082b07dd07a783384\" successfully" Jan 13 20:09:33.089034 containerd[1934]: time="2025-01-13T20:09:33.088835527Z" level=info msg="StopPodSandbox for \"aeb47e19302f9c839c5fa002c506a56722057a24b2c06c5082b07dd07a783384\" returns successfully" Jan 13 20:09:33.092825 containerd[1934]: time="2025-01-13T20:09:33.091635367Z" level=error msg="Failed to destroy network for sandbox \"00e76c628c150112006f3b23d6e74781e4d42e1b9aecfc0a92d42b780e86d031\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:33.096166 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-00e76c628c150112006f3b23d6e74781e4d42e1b9aecfc0a92d42b780e86d031-shm.mount: Deactivated successfully. Jan 13 20:09:33.109188 containerd[1934]: time="2025-01-13T20:09:33.109110811Z" level=error msg="encountered an error cleaning up failed sandbox \"00e76c628c150112006f3b23d6e74781e4d42e1b9aecfc0a92d42b780e86d031\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:33.109339 containerd[1934]: time="2025-01-13T20:09:33.109241923Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-7fbffcd8cd-wszl7,Uid:ad79c041-eaf1-4d57-9fb4-c3fb08680cb8,Namespace:calico-apiserver,Attempt:7,} failed, error" error="failed to setup network for sandbox \"00e76c628c150112006f3b23d6e74781e4d42e1b9aecfc0a92d42b780e86d031\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:33.113038 containerd[1934]: time="2025-01-13T20:09:33.112930843Z" level=info msg="StopPodSandbox for \"af4b04b9175c96b5f57bdaa5d05b254cb086cf984792052f87e1249b6c2e75f9\"" Jan 13 20:09:33.113166 containerd[1934]: time="2025-01-13T20:09:33.113116879Z" level=info msg="TearDown network for sandbox \"af4b04b9175c96b5f57bdaa5d05b254cb086cf984792052f87e1249b6c2e75f9\" successfully" Jan 13 20:09:33.113166 containerd[1934]: time="2025-01-13T20:09:33.113142295Z" level=info msg="StopPodSandbox for \"af4b04b9175c96b5f57bdaa5d05b254cb086cf984792052f87e1249b6c2e75f9\" returns successfully" Jan 13 20:09:33.114115 containerd[1934]: time="2025-01-13T20:09:33.113598331Z" level=info msg="StopPodSandbox for \"4d3ce37a9c40510fd9d66de0b8c2ac5802b7067c8efb617b93564f6bfe5a5223\"" Jan 13 20:09:33.114115 containerd[1934]: time="2025-01-13T20:09:33.113765347Z" level=info msg="TearDown network for sandbox \"4d3ce37a9c40510fd9d66de0b8c2ac5802b7067c8efb617b93564f6bfe5a5223\" successfully" Jan 13 20:09:33.114115 containerd[1934]: time="2025-01-13T20:09:33.113822707Z" level=info msg="StopPodSandbox for \"4d3ce37a9c40510fd9d66de0b8c2ac5802b7067c8efb617b93564f6bfe5a5223\" returns successfully" Jan 13 20:09:33.115535 containerd[1934]: time="2025-01-13T20:09:33.115460491Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"2accd017db7708cc1fa5c6da328b2f1c3f1c063e1b4b76d232d0c4e3cdca6a6d\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:09:33.115669 containerd[1934]: time="2025-01-13T20:09:33.115551559Z" level=info msg="RemovePodSandbox \"2accd017db7708cc1fa5c6da328b2f1c3f1c063e1b4b76d232d0c4e3cdca6a6d\" returns successfully" Jan 13 20:09:33.117867 kubelet[3423]: E0113 20:09:33.116592 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"00e76c628c150112006f3b23d6e74781e4d42e1b9aecfc0a92d42b780e86d031\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:33.117867 kubelet[3423]: E0113 20:09:33.116669 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"00e76c628c150112006f3b23d6e74781e4d42e1b9aecfc0a92d42b780e86d031\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-wszl7" Jan 13 20:09:33.117867 kubelet[3423]: E0113 20:09:33.116712 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"00e76c628c150112006f3b23d6e74781e4d42e1b9aecfc0a92d42b780e86d031\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-wszl7" Jan 13 20:09:33.118217 kubelet[3423]: E0113 20:09:33.116826 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"calico-apiserver-7fbffcd8cd-wszl7_calico-apiserver(ad79c041-eaf1-4d57-9fb4-c3fb08680cb8)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"calico-apiserver-7fbffcd8cd-wszl7_calico-apiserver(ad79c041-eaf1-4d57-9fb4-c3fb08680cb8)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"00e76c628c150112006f3b23d6e74781e4d42e1b9aecfc0a92d42b780e86d031\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-wszl7" podUID="ad79c041-eaf1-4d57-9fb4-c3fb08680cb8" Jan 13 20:09:33.119762 containerd[1934]: time="2025-01-13T20:09:33.118951567Z" level=info msg="StopPodSandbox for \"ccf56aafff1edbddd69e830448606d1ed364723341b141ed6867e7ed4d6b5f89\"" Jan 13 20:09:33.119762 containerd[1934]: time="2025-01-13T20:09:33.119127067Z" level=info msg="TearDown network for sandbox \"ccf56aafff1edbddd69e830448606d1ed364723341b141ed6867e7ed4d6b5f89\" successfully" Jan 13 20:09:33.119762 containerd[1934]: time="2025-01-13T20:09:33.119150011Z" level=info msg="StopPodSandbox for \"ccf56aafff1edbddd69e830448606d1ed364723341b141ed6867e7ed4d6b5f89\" returns successfully" Jan 13 20:09:33.120222 containerd[1934]: time="2025-01-13T20:09:33.120097087Z" level=info msg="StopPodSandbox for \"e31eca7a421d12ab04696c6ee4fefbcfc3ab887e88d76deb901fc6a512e76618\"" Jan 13 20:09:33.120279 containerd[1934]: time="2025-01-13T20:09:33.120258019Z" level=info msg="TearDown network for sandbox \"e31eca7a421d12ab04696c6ee4fefbcfc3ab887e88d76deb901fc6a512e76618\" successfully" Jan 13 20:09:33.120331 containerd[1934]: time="2025-01-13T20:09:33.120279619Z" level=info msg="StopPodSandbox for \"e31eca7a421d12ab04696c6ee4fefbcfc3ab887e88d76deb901fc6a512e76618\" returns successfully" Jan 13 20:09:33.121342 containerd[1934]: time="2025-01-13T20:09:33.120429355Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-kube-controllers-68f76c7ddf-lh8nj,Uid:2be21c11-9c2d-4b9a-81a5-0e73daba31c1,Namespace:calico-system,Attempt:8,}" Jan 13 20:09:33.127252 containerd[1934]: time="2025-01-13T20:09:33.127180123Z" level=info msg="RemovePodSandbox for \"e31eca7a421d12ab04696c6ee4fefbcfc3ab887e88d76deb901fc6a512e76618\"" Jan 13 20:09:33.127252 containerd[1934]: time="2025-01-13T20:09:33.127246735Z" level=info msg="Forcibly stopping sandbox \"e31eca7a421d12ab04696c6ee4fefbcfc3ab887e88d76deb901fc6a512e76618\"" Jan 13 20:09:33.128795 containerd[1934]: time="2025-01-13T20:09:33.128704147Z" level=info msg="TearDown network for sandbox \"e31eca7a421d12ab04696c6ee4fefbcfc3ab887e88d76deb901fc6a512e76618\" successfully" Jan 13 20:09:33.130211 containerd[1934]: time="2025-01-13T20:09:33.130139107Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:csi-node-driver-wq54r,Uid:d47fc662-eff9-4473-83da-b6f0b896d81f,Namespace:calico-system,Attempt:8,}" Jan 13 20:09:33.143862 containerd[1934]: time="2025-01-13T20:09:33.143755855Z" level=error msg="Failed to destroy network for sandbox \"5eeccd24bcd272ceac794541253f4c8a557a6e36ba0959e6db5a98b61fca47a2\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:33.145971 containerd[1934]: time="2025-01-13T20:09:33.144594091Z" level=error msg="encountered an error cleaning up failed sandbox \"5eeccd24bcd272ceac794541253f4c8a557a6e36ba0959e6db5a98b61fca47a2\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:33.145971 containerd[1934]: time="2025-01-13T20:09:33.144735547Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-76f75df574-mkr2l,Uid:396e30c8-d221-410a-89fe-e353ba8cddbf,Namespace:kube-system,Attempt:7,} failed, error" error="failed to setup network for sandbox \"5eeccd24bcd272ceac794541253f4c8a557a6e36ba0959e6db5a98b61fca47a2\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:33.149141 kubelet[3423]: E0113 20:09:33.148248 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"5eeccd24bcd272ceac794541253f4c8a557a6e36ba0959e6db5a98b61fca47a2\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:33.149141 kubelet[3423]: E0113 20:09:33.148882 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"5eeccd24bcd272ceac794541253f4c8a557a6e36ba0959e6db5a98b61fca47a2\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-76f75df574-mkr2l" Jan 13 20:09:33.149952 kubelet[3423]: E0113 20:09:33.149071 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"5eeccd24bcd272ceac794541253f4c8a557a6e36ba0959e6db5a98b61fca47a2\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-76f75df574-mkr2l" Jan 13 20:09:33.150015 kubelet[3423]: E0113 20:09:33.149959 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-76f75df574-mkr2l_kube-system(396e30c8-d221-410a-89fe-e353ba8cddbf)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-76f75df574-mkr2l_kube-system(396e30c8-d221-410a-89fe-e353ba8cddbf)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"5eeccd24bcd272ceac794541253f4c8a557a6e36ba0959e6db5a98b61fca47a2\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="kube-system/coredns-76f75df574-mkr2l" podUID="396e30c8-d221-410a-89fe-e353ba8cddbf" Jan 13 20:09:33.151189 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-5eeccd24bcd272ceac794541253f4c8a557a6e36ba0959e6db5a98b61fca47a2-shm.mount: Deactivated successfully. Jan 13 20:09:33.158015 containerd[1934]: time="2025-01-13T20:09:33.157954507Z" level=error msg="Failed to destroy network for sandbox \"0c85ca62eb94f4e10d7b4154d1085f14ea6b6363ce2b9a48f55a28836e3adb05\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:33.165863 containerd[1934]: time="2025-01-13T20:09:33.165546799Z" level=error msg="encountered an error cleaning up failed sandbox \"0c85ca62eb94f4e10d7b4154d1085f14ea6b6363ce2b9a48f55a28836e3adb05\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:33.165863 containerd[1934]: time="2025-01-13T20:09:33.165661819Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-76f75df574-8wp6k,Uid:87115657-f395-40ec-89ea-3d7835119c3a,Namespace:kube-system,Attempt:7,} failed, error" error="failed to setup network for sandbox \"0c85ca62eb94f4e10d7b4154d1085f14ea6b6363ce2b9a48f55a28836e3adb05\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:33.166707 kubelet[3423]: E0113 20:09:33.166661 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"0c85ca62eb94f4e10d7b4154d1085f14ea6b6363ce2b9a48f55a28836e3adb05\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:33.166909 kubelet[3423]: E0113 20:09:33.166876 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"0c85ca62eb94f4e10d7b4154d1085f14ea6b6363ce2b9a48f55a28836e3adb05\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-76f75df574-8wp6k" Jan 13 20:09:33.167107 kubelet[3423]: E0113 20:09:33.167071 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"0c85ca62eb94f4e10d7b4154d1085f14ea6b6363ce2b9a48f55a28836e3adb05\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-76f75df574-8wp6k" Jan 13 20:09:33.167247 kubelet[3423]: E0113 20:09:33.167194 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-76f75df574-8wp6k_kube-system(87115657-f395-40ec-89ea-3d7835119c3a)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-76f75df574-8wp6k_kube-system(87115657-f395-40ec-89ea-3d7835119c3a)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"0c85ca62eb94f4e10d7b4154d1085f14ea6b6363ce2b9a48f55a28836e3adb05\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="kube-system/coredns-76f75df574-8wp6k" podUID="87115657-f395-40ec-89ea-3d7835119c3a" Jan 13 20:09:33.189624 containerd[1934]: time="2025-01-13T20:09:33.189569683Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"e31eca7a421d12ab04696c6ee4fefbcfc3ab887e88d76deb901fc6a512e76618\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:09:33.190042 containerd[1934]: time="2025-01-13T20:09:33.189878623Z" level=info msg="RemovePodSandbox \"e31eca7a421d12ab04696c6ee4fefbcfc3ab887e88d76deb901fc6a512e76618\" returns successfully" Jan 13 20:09:33.191381 containerd[1934]: time="2025-01-13T20:09:33.191231155Z" level=info msg="StopPodSandbox for \"a37a24fcb9897952ccabcc8cb7045bb7b0ef0fe4b98a8ca3b53ea6f6cf157017\"" Jan 13 20:09:33.192069 containerd[1934]: time="2025-01-13T20:09:33.191952883Z" level=info msg="TearDown network for sandbox \"a37a24fcb9897952ccabcc8cb7045bb7b0ef0fe4b98a8ca3b53ea6f6cf157017\" successfully" Jan 13 20:09:33.192439 containerd[1934]: time="2025-01-13T20:09:33.192045043Z" level=info msg="StopPodSandbox for \"a37a24fcb9897952ccabcc8cb7045bb7b0ef0fe4b98a8ca3b53ea6f6cf157017\" returns successfully" Jan 13 20:09:33.193557 containerd[1934]: time="2025-01-13T20:09:33.193444543Z" level=info msg="RemovePodSandbox for \"a37a24fcb9897952ccabcc8cb7045bb7b0ef0fe4b98a8ca3b53ea6f6cf157017\"" Jan 13 20:09:33.193557 containerd[1934]: time="2025-01-13T20:09:33.193519267Z" level=info msg="Forcibly stopping sandbox \"a37a24fcb9897952ccabcc8cb7045bb7b0ef0fe4b98a8ca3b53ea6f6cf157017\"" Jan 13 20:09:33.194834 containerd[1934]: time="2025-01-13T20:09:33.194038087Z" level=info msg="TearDown network for sandbox \"a37a24fcb9897952ccabcc8cb7045bb7b0ef0fe4b98a8ca3b53ea6f6cf157017\" successfully" Jan 13 20:09:33.208397 containerd[1934]: time="2025-01-13T20:09:33.208344943Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"a37a24fcb9897952ccabcc8cb7045bb7b0ef0fe4b98a8ca3b53ea6f6cf157017\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:09:33.208999 containerd[1934]: time="2025-01-13T20:09:33.208952083Z" level=info msg="RemovePodSandbox \"a37a24fcb9897952ccabcc8cb7045bb7b0ef0fe4b98a8ca3b53ea6f6cf157017\" returns successfully" Jan 13 20:09:33.209739 containerd[1934]: time="2025-01-13T20:09:33.209699239Z" level=info msg="StopPodSandbox for \"a7aac01fa45d89b04a7cb486ede3be4574f65135e039463be287ff48831441a8\"" Jan 13 20:09:33.210929 containerd[1934]: time="2025-01-13T20:09:33.210884227Z" level=info msg="TearDown network for sandbox \"a7aac01fa45d89b04a7cb486ede3be4574f65135e039463be287ff48831441a8\" successfully" Jan 13 20:09:33.211137 containerd[1934]: time="2025-01-13T20:09:33.211091899Z" level=info msg="StopPodSandbox for \"a7aac01fa45d89b04a7cb486ede3be4574f65135e039463be287ff48831441a8\" returns successfully" Jan 13 20:09:33.212891 containerd[1934]: time="2025-01-13T20:09:33.212843683Z" level=info msg="RemovePodSandbox for \"a7aac01fa45d89b04a7cb486ede3be4574f65135e039463be287ff48831441a8\"" Jan 13 20:09:33.213725 containerd[1934]: time="2025-01-13T20:09:33.213054451Z" level=info msg="Forcibly stopping sandbox \"a7aac01fa45d89b04a7cb486ede3be4574f65135e039463be287ff48831441a8\"" Jan 13 20:09:33.213725 containerd[1934]: time="2025-01-13T20:09:33.213187099Z" level=info msg="TearDown network for sandbox \"a7aac01fa45d89b04a7cb486ede3be4574f65135e039463be287ff48831441a8\" successfully" Jan 13 20:09:33.229355 containerd[1934]: time="2025-01-13T20:09:33.228849667Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"a7aac01fa45d89b04a7cb486ede3be4574f65135e039463be287ff48831441a8\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:09:33.234575 containerd[1934]: time="2025-01-13T20:09:33.234521684Z" level=info msg="RemovePodSandbox \"a7aac01fa45d89b04a7cb486ede3be4574f65135e039463be287ff48831441a8\" returns successfully" Jan 13 20:09:33.236471 containerd[1934]: time="2025-01-13T20:09:33.236166296Z" level=info msg="StopPodSandbox for \"3738e8149db8a55a4134f2d90b1a13f28ee725b71b142d59f0f32a083d31ab02\"" Jan 13 20:09:33.236471 containerd[1934]: time="2025-01-13T20:09:33.236428340Z" level=info msg="TearDown network for sandbox \"3738e8149db8a55a4134f2d90b1a13f28ee725b71b142d59f0f32a083d31ab02\" successfully" Jan 13 20:09:33.236471 containerd[1934]: time="2025-01-13T20:09:33.236452640Z" level=info msg="StopPodSandbox for \"3738e8149db8a55a4134f2d90b1a13f28ee725b71b142d59f0f32a083d31ab02\" returns successfully" Jan 13 20:09:33.238202 containerd[1934]: time="2025-01-13T20:09:33.238154072Z" level=info msg="RemovePodSandbox for \"3738e8149db8a55a4134f2d90b1a13f28ee725b71b142d59f0f32a083d31ab02\"" Jan 13 20:09:33.238729 containerd[1934]: time="2025-01-13T20:09:33.238374080Z" level=info msg="Forcibly stopping sandbox \"3738e8149db8a55a4134f2d90b1a13f28ee725b71b142d59f0f32a083d31ab02\"" Jan 13 20:09:33.238729 containerd[1934]: time="2025-01-13T20:09:33.238557524Z" level=info msg="TearDown network for sandbox \"3738e8149db8a55a4134f2d90b1a13f28ee725b71b142d59f0f32a083d31ab02\" successfully" Jan 13 20:09:33.252009 containerd[1934]: time="2025-01-13T20:09:33.251951852Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"3738e8149db8a55a4134f2d90b1a13f28ee725b71b142d59f0f32a083d31ab02\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:09:33.252524 containerd[1934]: time="2025-01-13T20:09:33.252484160Z" level=info msg="RemovePodSandbox \"3738e8149db8a55a4134f2d90b1a13f28ee725b71b142d59f0f32a083d31ab02\" returns successfully" Jan 13 20:09:33.253729 containerd[1934]: time="2025-01-13T20:09:33.253672028Z" level=info msg="StopPodSandbox for \"ccf56aafff1edbddd69e830448606d1ed364723341b141ed6867e7ed4d6b5f89\"" Jan 13 20:09:33.257869 containerd[1934]: time="2025-01-13T20:09:33.257560328Z" level=info msg="TearDown network for sandbox \"ccf56aafff1edbddd69e830448606d1ed364723341b141ed6867e7ed4d6b5f89\" successfully" Jan 13 20:09:33.257869 containerd[1934]: time="2025-01-13T20:09:33.257607272Z" level=info msg="StopPodSandbox for \"ccf56aafff1edbddd69e830448606d1ed364723341b141ed6867e7ed4d6b5f89\" returns successfully" Jan 13 20:09:33.265506 containerd[1934]: time="2025-01-13T20:09:33.263616644Z" level=info msg="RemovePodSandbox for \"ccf56aafff1edbddd69e830448606d1ed364723341b141ed6867e7ed4d6b5f89\"" Jan 13 20:09:33.265506 containerd[1934]: time="2025-01-13T20:09:33.263677400Z" level=info msg="Forcibly stopping sandbox \"ccf56aafff1edbddd69e830448606d1ed364723341b141ed6867e7ed4d6b5f89\"" Jan 13 20:09:33.266990 containerd[1934]: time="2025-01-13T20:09:33.265969328Z" level=info msg="TearDown network for sandbox \"ccf56aafff1edbddd69e830448606d1ed364723341b141ed6867e7ed4d6b5f89\" successfully" Jan 13 20:09:33.290327 containerd[1934]: time="2025-01-13T20:09:33.290062676Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"ccf56aafff1edbddd69e830448606d1ed364723341b141ed6867e7ed4d6b5f89\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:09:33.293031 containerd[1934]: time="2025-01-13T20:09:33.292749332Z" level=info msg="RemovePodSandbox \"ccf56aafff1edbddd69e830448606d1ed364723341b141ed6867e7ed4d6b5f89\" returns successfully" Jan 13 20:09:33.296822 containerd[1934]: time="2025-01-13T20:09:33.296553104Z" level=info msg="StopPodSandbox for \"af4b04b9175c96b5f57bdaa5d05b254cb086cf984792052f87e1249b6c2e75f9\"" Jan 13 20:09:33.298175 containerd[1934]: time="2025-01-13T20:09:33.298127360Z" level=info msg="TearDown network for sandbox \"af4b04b9175c96b5f57bdaa5d05b254cb086cf984792052f87e1249b6c2e75f9\" successfully" Jan 13 20:09:33.298862 containerd[1934]: time="2025-01-13T20:09:33.298821332Z" level=info msg="StopPodSandbox for \"af4b04b9175c96b5f57bdaa5d05b254cb086cf984792052f87e1249b6c2e75f9\" returns successfully" Jan 13 20:09:33.300111 containerd[1934]: time="2025-01-13T20:09:33.300055112Z" level=info msg="RemovePodSandbox for \"af4b04b9175c96b5f57bdaa5d05b254cb086cf984792052f87e1249b6c2e75f9\"" Jan 13 20:09:33.300235 containerd[1934]: time="2025-01-13T20:09:33.300115856Z" level=info msg="Forcibly stopping sandbox \"af4b04b9175c96b5f57bdaa5d05b254cb086cf984792052f87e1249b6c2e75f9\"" Jan 13 20:09:33.300289 containerd[1934]: time="2025-01-13T20:09:33.300257144Z" level=info msg="TearDown network for sandbox \"af4b04b9175c96b5f57bdaa5d05b254cb086cf984792052f87e1249b6c2e75f9\" successfully" Jan 13 20:09:33.320950 containerd[1934]: time="2025-01-13T20:09:33.320890304Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"af4b04b9175c96b5f57bdaa5d05b254cb086cf984792052f87e1249b6c2e75f9\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:09:33.321607 containerd[1934]: time="2025-01-13T20:09:33.321565196Z" level=info msg="RemovePodSandbox \"af4b04b9175c96b5f57bdaa5d05b254cb086cf984792052f87e1249b6c2e75f9\" returns successfully" Jan 13 20:09:33.323178 containerd[1934]: time="2025-01-13T20:09:33.323007188Z" level=info msg="StopPodSandbox for \"aeb47e19302f9c839c5fa002c506a56722057a24b2c06c5082b07dd07a783384\"" Jan 13 20:09:33.324575 containerd[1934]: time="2025-01-13T20:09:33.324530084Z" level=info msg="TearDown network for sandbox \"aeb47e19302f9c839c5fa002c506a56722057a24b2c06c5082b07dd07a783384\" successfully" Jan 13 20:09:33.325284 containerd[1934]: time="2025-01-13T20:09:33.325142132Z" level=info msg="StopPodSandbox for \"aeb47e19302f9c839c5fa002c506a56722057a24b2c06c5082b07dd07a783384\" returns successfully" Jan 13 20:09:33.326421 containerd[1934]: time="2025-01-13T20:09:33.326359196Z" level=info msg="RemovePodSandbox for \"aeb47e19302f9c839c5fa002c506a56722057a24b2c06c5082b07dd07a783384\"" Jan 13 20:09:33.326886 containerd[1934]: time="2025-01-13T20:09:33.326671196Z" level=info msg="Forcibly stopping sandbox \"aeb47e19302f9c839c5fa002c506a56722057a24b2c06c5082b07dd07a783384\"" Jan 13 20:09:33.327677 containerd[1934]: time="2025-01-13T20:09:33.327633272Z" level=info msg="TearDown network for sandbox \"aeb47e19302f9c839c5fa002c506a56722057a24b2c06c5082b07dd07a783384\" successfully" Jan 13 20:09:33.340268 containerd[1934]: time="2025-01-13T20:09:33.340210628Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"aeb47e19302f9c839c5fa002c506a56722057a24b2c06c5082b07dd07a783384\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:09:33.340743 containerd[1934]: time="2025-01-13T20:09:33.340607144Z" level=info msg="RemovePodSandbox \"aeb47e19302f9c839c5fa002c506a56722057a24b2c06c5082b07dd07a783384\" returns successfully" Jan 13 20:09:33.342024 containerd[1934]: time="2025-01-13T20:09:33.341371976Z" level=info msg="StopPodSandbox for \"955f9fe6553205f6e71b94a6922fdece40d5d1a8c6a343e9a0aa0f4bf2abbb69\"" Jan 13 20:09:33.342024 containerd[1934]: time="2025-01-13T20:09:33.341554712Z" level=info msg="TearDown network for sandbox \"955f9fe6553205f6e71b94a6922fdece40d5d1a8c6a343e9a0aa0f4bf2abbb69\" successfully" Jan 13 20:09:33.342024 containerd[1934]: time="2025-01-13T20:09:33.341577776Z" level=info msg="StopPodSandbox for \"955f9fe6553205f6e71b94a6922fdece40d5d1a8c6a343e9a0aa0f4bf2abbb69\" returns successfully" Jan 13 20:09:33.344161 containerd[1934]: time="2025-01-13T20:09:33.344110052Z" level=info msg="RemovePodSandbox for \"955f9fe6553205f6e71b94a6922fdece40d5d1a8c6a343e9a0aa0f4bf2abbb69\"" Jan 13 20:09:33.344923 containerd[1934]: time="2025-01-13T20:09:33.344850308Z" level=info msg="Forcibly stopping sandbox \"955f9fe6553205f6e71b94a6922fdece40d5d1a8c6a343e9a0aa0f4bf2abbb69\"" Jan 13 20:09:33.345073 containerd[1934]: time="2025-01-13T20:09:33.345034064Z" level=info msg="TearDown network for sandbox \"955f9fe6553205f6e71b94a6922fdece40d5d1a8c6a343e9a0aa0f4bf2abbb69\" successfully" Jan 13 20:09:33.356832 containerd[1934]: time="2025-01-13T20:09:33.356665436Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"955f9fe6553205f6e71b94a6922fdece40d5d1a8c6a343e9a0aa0f4bf2abbb69\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:09:33.359492 containerd[1934]: time="2025-01-13T20:09:33.359311244Z" level=info msg="RemovePodSandbox \"955f9fe6553205f6e71b94a6922fdece40d5d1a8c6a343e9a0aa0f4bf2abbb69\" returns successfully" Jan 13 20:09:33.364487 containerd[1934]: time="2025-01-13T20:09:33.363740564Z" level=info msg="StopPodSandbox for \"a04750e9fc31e16c9110301f495a11a345e09ad202ac48d631cc7f81772e7ec2\"" Jan 13 20:09:33.364487 containerd[1934]: time="2025-01-13T20:09:33.363954536Z" level=info msg="TearDown network for sandbox \"a04750e9fc31e16c9110301f495a11a345e09ad202ac48d631cc7f81772e7ec2\" successfully" Jan 13 20:09:33.364487 containerd[1934]: time="2025-01-13T20:09:33.363978596Z" level=info msg="StopPodSandbox for \"a04750e9fc31e16c9110301f495a11a345e09ad202ac48d631cc7f81772e7ec2\" returns successfully" Jan 13 20:09:33.365136 containerd[1934]: time="2025-01-13T20:09:33.364960508Z" level=info msg="RemovePodSandbox for \"a04750e9fc31e16c9110301f495a11a345e09ad202ac48d631cc7f81772e7ec2\"" Jan 13 20:09:33.365307 containerd[1934]: time="2025-01-13T20:09:33.365139512Z" level=info msg="Forcibly stopping sandbox \"a04750e9fc31e16c9110301f495a11a345e09ad202ac48d631cc7f81772e7ec2\"" Jan 13 20:09:33.366120 containerd[1934]: time="2025-01-13T20:09:33.365951780Z" level=info msg="TearDown network for sandbox \"a04750e9fc31e16c9110301f495a11a345e09ad202ac48d631cc7f81772e7ec2\" successfully" Jan 13 20:09:33.381982 containerd[1934]: time="2025-01-13T20:09:33.381890048Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"a04750e9fc31e16c9110301f495a11a345e09ad202ac48d631cc7f81772e7ec2\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:09:33.381982 containerd[1934]: time="2025-01-13T20:09:33.381979112Z" level=info msg="RemovePodSandbox \"a04750e9fc31e16c9110301f495a11a345e09ad202ac48d631cc7f81772e7ec2\" returns successfully" Jan 13 20:09:33.383188 containerd[1934]: time="2025-01-13T20:09:33.383144480Z" level=info msg="StopPodSandbox for \"8615086423d6201ef85384f1854ecd8c82e04e1edced15a3499ba0b0b99f7588\"" Jan 13 20:09:33.384269 containerd[1934]: time="2025-01-13T20:09:33.384127292Z" level=info msg="TearDown network for sandbox \"8615086423d6201ef85384f1854ecd8c82e04e1edced15a3499ba0b0b99f7588\" successfully" Jan 13 20:09:33.384515 containerd[1934]: time="2025-01-13T20:09:33.384445724Z" level=info msg="StopPodSandbox for \"8615086423d6201ef85384f1854ecd8c82e04e1edced15a3499ba0b0b99f7588\" returns successfully" Jan 13 20:09:33.386387 containerd[1934]: time="2025-01-13T20:09:33.386242028Z" level=info msg="RemovePodSandbox for \"8615086423d6201ef85384f1854ecd8c82e04e1edced15a3499ba0b0b99f7588\"" Jan 13 20:09:33.386387 containerd[1934]: time="2025-01-13T20:09:33.386300300Z" level=info msg="Forcibly stopping sandbox \"8615086423d6201ef85384f1854ecd8c82e04e1edced15a3499ba0b0b99f7588\"" Jan 13 20:09:33.386553 containerd[1934]: time="2025-01-13T20:09:33.386438552Z" level=info msg="TearDown network for sandbox \"8615086423d6201ef85384f1854ecd8c82e04e1edced15a3499ba0b0b99f7588\" successfully" Jan 13 20:09:33.399710 containerd[1934]: time="2025-01-13T20:09:33.399127748Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"8615086423d6201ef85384f1854ecd8c82e04e1edced15a3499ba0b0b99f7588\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:09:33.399710 containerd[1934]: time="2025-01-13T20:09:33.399211964Z" level=info msg="RemovePodSandbox \"8615086423d6201ef85384f1854ecd8c82e04e1edced15a3499ba0b0b99f7588\" returns successfully" Jan 13 20:09:33.400380 containerd[1934]: time="2025-01-13T20:09:33.400326044Z" level=info msg="StopPodSandbox for \"fb565334446e5f8a46a1bd1f7f902b79f435864e841478f2f0a155d44cd33b41\"" Jan 13 20:09:33.400722 containerd[1934]: time="2025-01-13T20:09:33.400498820Z" level=info msg="TearDown network for sandbox \"fb565334446e5f8a46a1bd1f7f902b79f435864e841478f2f0a155d44cd33b41\" successfully" Jan 13 20:09:33.400722 containerd[1934]: time="2025-01-13T20:09:33.400530032Z" level=info msg="StopPodSandbox for \"fb565334446e5f8a46a1bd1f7f902b79f435864e841478f2f0a155d44cd33b41\" returns successfully" Jan 13 20:09:33.402134 containerd[1934]: time="2025-01-13T20:09:33.401934656Z" level=info msg="RemovePodSandbox for \"fb565334446e5f8a46a1bd1f7f902b79f435864e841478f2f0a155d44cd33b41\"" Jan 13 20:09:33.403171 containerd[1934]: time="2025-01-13T20:09:33.403120376Z" level=info msg="Forcibly stopping sandbox \"fb565334446e5f8a46a1bd1f7f902b79f435864e841478f2f0a155d44cd33b41\"" Jan 13 20:09:33.404280 containerd[1934]: time="2025-01-13T20:09:33.403970624Z" level=info msg="TearDown network for sandbox \"fb565334446e5f8a46a1bd1f7f902b79f435864e841478f2f0a155d44cd33b41\" successfully" Jan 13 20:09:33.416465 containerd[1934]: time="2025-01-13T20:09:33.416399744Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"fb565334446e5f8a46a1bd1f7f902b79f435864e841478f2f0a155d44cd33b41\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:09:33.416745 containerd[1934]: time="2025-01-13T20:09:33.416693528Z" level=info msg="RemovePodSandbox \"fb565334446e5f8a46a1bd1f7f902b79f435864e841478f2f0a155d44cd33b41\" returns successfully" Jan 13 20:09:33.418446 containerd[1934]: time="2025-01-13T20:09:33.418317176Z" level=info msg="StopPodSandbox for \"cfa6ddb68ab8a55e2b4406871b279f8198e9a43957ec335f7facbf57b86881a3\"" Jan 13 20:09:33.419903 containerd[1934]: time="2025-01-13T20:09:33.419847668Z" level=info msg="TearDown network for sandbox \"cfa6ddb68ab8a55e2b4406871b279f8198e9a43957ec335f7facbf57b86881a3\" successfully" Jan 13 20:09:33.420350 containerd[1934]: time="2025-01-13T20:09:33.420211640Z" level=info msg="StopPodSandbox for \"cfa6ddb68ab8a55e2b4406871b279f8198e9a43957ec335f7facbf57b86881a3\" returns successfully" Jan 13 20:09:33.421972 containerd[1934]: time="2025-01-13T20:09:33.421573232Z" level=info msg="RemovePodSandbox for \"cfa6ddb68ab8a55e2b4406871b279f8198e9a43957ec335f7facbf57b86881a3\"" Jan 13 20:09:33.421972 containerd[1934]: time="2025-01-13T20:09:33.421932224Z" level=info msg="Forcibly stopping sandbox \"cfa6ddb68ab8a55e2b4406871b279f8198e9a43957ec335f7facbf57b86881a3\"" Jan 13 20:09:33.423041 containerd[1934]: time="2025-01-13T20:09:33.422868884Z" level=info msg="TearDown network for sandbox \"cfa6ddb68ab8a55e2b4406871b279f8198e9a43957ec335f7facbf57b86881a3\" successfully" Jan 13 20:09:33.435198 containerd[1934]: time="2025-01-13T20:09:33.434936745Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"cfa6ddb68ab8a55e2b4406871b279f8198e9a43957ec335f7facbf57b86881a3\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:09:33.435930 containerd[1934]: time="2025-01-13T20:09:33.435688329Z" level=info msg="RemovePodSandbox \"cfa6ddb68ab8a55e2b4406871b279f8198e9a43957ec335f7facbf57b86881a3\" returns successfully" Jan 13 20:09:33.437023 containerd[1934]: time="2025-01-13T20:09:33.436978701Z" level=info msg="StopPodSandbox for \"d029da1857cffbc9aea56a8ec883ba4e1da56eae06a46e2e4ba0629832693cb0\"" Jan 13 20:09:33.438195 containerd[1934]: time="2025-01-13T20:09:33.438022221Z" level=info msg="TearDown network for sandbox \"d029da1857cffbc9aea56a8ec883ba4e1da56eae06a46e2e4ba0629832693cb0\" successfully" Jan 13 20:09:33.438195 containerd[1934]: time="2025-01-13T20:09:33.438063645Z" level=info msg="StopPodSandbox for \"d029da1857cffbc9aea56a8ec883ba4e1da56eae06a46e2e4ba0629832693cb0\" returns successfully" Jan 13 20:09:33.439814 containerd[1934]: time="2025-01-13T20:09:33.439604517Z" level=info msg="RemovePodSandbox for \"d029da1857cffbc9aea56a8ec883ba4e1da56eae06a46e2e4ba0629832693cb0\"" Jan 13 20:09:33.439814 containerd[1934]: time="2025-01-13T20:09:33.439670265Z" level=info msg="Forcibly stopping sandbox \"d029da1857cffbc9aea56a8ec883ba4e1da56eae06a46e2e4ba0629832693cb0\"" Jan 13 20:09:33.440045 containerd[1934]: time="2025-01-13T20:09:33.439843161Z" level=info msg="TearDown network for sandbox \"d029da1857cffbc9aea56a8ec883ba4e1da56eae06a46e2e4ba0629832693cb0\" successfully" Jan 13 20:09:33.451919 containerd[1934]: time="2025-01-13T20:09:33.451645281Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"d029da1857cffbc9aea56a8ec883ba4e1da56eae06a46e2e4ba0629832693cb0\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:09:33.451919 containerd[1934]: time="2025-01-13T20:09:33.451731933Z" level=info msg="RemovePodSandbox \"d029da1857cffbc9aea56a8ec883ba4e1da56eae06a46e2e4ba0629832693cb0\" returns successfully" Jan 13 20:09:33.452727 containerd[1934]: time="2025-01-13T20:09:33.452671821Z" level=info msg="StopPodSandbox for \"f25c71afbdf54c9739bfb9dedd7783f76e2a8415e053a98227128ef3211d4a56\"" Jan 13 20:09:33.453256 containerd[1934]: time="2025-01-13T20:09:33.452862597Z" level=info msg="TearDown network for sandbox \"f25c71afbdf54c9739bfb9dedd7783f76e2a8415e053a98227128ef3211d4a56\" successfully" Jan 13 20:09:33.453256 containerd[1934]: time="2025-01-13T20:09:33.452898105Z" level=info msg="StopPodSandbox for \"f25c71afbdf54c9739bfb9dedd7783f76e2a8415e053a98227128ef3211d4a56\" returns successfully" Jan 13 20:09:33.454816 containerd[1934]: time="2025-01-13T20:09:33.454626777Z" level=info msg="RemovePodSandbox for \"f25c71afbdf54c9739bfb9dedd7783f76e2a8415e053a98227128ef3211d4a56\"" Jan 13 20:09:33.454816 containerd[1934]: time="2025-01-13T20:09:33.454689285Z" level=info msg="Forcibly stopping sandbox \"f25c71afbdf54c9739bfb9dedd7783f76e2a8415e053a98227128ef3211d4a56\"" Jan 13 20:09:33.457079 containerd[1934]: time="2025-01-13T20:09:33.456093561Z" level=info msg="TearDown network for sandbox \"f25c71afbdf54c9739bfb9dedd7783f76e2a8415e053a98227128ef3211d4a56\" successfully" Jan 13 20:09:33.473974 containerd[1934]: time="2025-01-13T20:09:33.473904813Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"f25c71afbdf54c9739bfb9dedd7783f76e2a8415e053a98227128ef3211d4a56\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:09:33.475741 containerd[1934]: time="2025-01-13T20:09:33.475285197Z" level=info msg="RemovePodSandbox \"f25c71afbdf54c9739bfb9dedd7783f76e2a8415e053a98227128ef3211d4a56\" returns successfully" Jan 13 20:09:33.477495 containerd[1934]: time="2025-01-13T20:09:33.476919045Z" level=info msg="StopPodSandbox for \"e8d14d51164c0f7461d019f7892fb139ae5f1525115e3ca06b0affcaae9c0d5e\"" Jan 13 20:09:33.478606 containerd[1934]: time="2025-01-13T20:09:33.478420905Z" level=info msg="TearDown network for sandbox \"e8d14d51164c0f7461d019f7892fb139ae5f1525115e3ca06b0affcaae9c0d5e\" successfully" Jan 13 20:09:33.478606 containerd[1934]: time="2025-01-13T20:09:33.478467801Z" level=info msg="StopPodSandbox for \"e8d14d51164c0f7461d019f7892fb139ae5f1525115e3ca06b0affcaae9c0d5e\" returns successfully" Jan 13 20:09:33.479546 containerd[1934]: time="2025-01-13T20:09:33.479300337Z" level=info msg="RemovePodSandbox for \"e8d14d51164c0f7461d019f7892fb139ae5f1525115e3ca06b0affcaae9c0d5e\"" Jan 13 20:09:33.479546 containerd[1934]: time="2025-01-13T20:09:33.479374269Z" level=info msg="Forcibly stopping sandbox \"e8d14d51164c0f7461d019f7892fb139ae5f1525115e3ca06b0affcaae9c0d5e\"" Jan 13 20:09:33.479546 containerd[1934]: time="2025-01-13T20:09:33.479517945Z" level=info msg="TearDown network for sandbox \"e8d14d51164c0f7461d019f7892fb139ae5f1525115e3ca06b0affcaae9c0d5e\" successfully" Jan 13 20:09:33.493211 containerd[1934]: time="2025-01-13T20:09:33.492985029Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"e8d14d51164c0f7461d019f7892fb139ae5f1525115e3ca06b0affcaae9c0d5e\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:09:33.493211 containerd[1934]: time="2025-01-13T20:09:33.493071897Z" level=info msg="RemovePodSandbox \"e8d14d51164c0f7461d019f7892fb139ae5f1525115e3ca06b0affcaae9c0d5e\" returns successfully" Jan 13 20:09:33.494536 containerd[1934]: time="2025-01-13T20:09:33.494271357Z" level=info msg="StopPodSandbox for \"034a1f3cd65e356f264d6b6a21d8604cdd13f23a1add7bf41ab327c6991d4011\"" Jan 13 20:09:33.495639 containerd[1934]: time="2025-01-13T20:09:33.495511233Z" level=info msg="TearDown network for sandbox \"034a1f3cd65e356f264d6b6a21d8604cdd13f23a1add7bf41ab327c6991d4011\" successfully" Jan 13 20:09:33.495639 containerd[1934]: time="2025-01-13T20:09:33.495562617Z" level=info msg="StopPodSandbox for \"034a1f3cd65e356f264d6b6a21d8604cdd13f23a1add7bf41ab327c6991d4011\" returns successfully" Jan 13 20:09:33.497377 containerd[1934]: time="2025-01-13T20:09:33.497079489Z" level=info msg="RemovePodSandbox for \"034a1f3cd65e356f264d6b6a21d8604cdd13f23a1add7bf41ab327c6991d4011\"" Jan 13 20:09:33.497377 containerd[1934]: time="2025-01-13T20:09:33.497136249Z" level=info msg="Forcibly stopping sandbox \"034a1f3cd65e356f264d6b6a21d8604cdd13f23a1add7bf41ab327c6991d4011\"" Jan 13 20:09:33.497377 containerd[1934]: time="2025-01-13T20:09:33.497269701Z" level=info msg="TearDown network for sandbox \"034a1f3cd65e356f264d6b6a21d8604cdd13f23a1add7bf41ab327c6991d4011\" successfully" Jan 13 20:09:33.497607 containerd[1934]: time="2025-01-13T20:09:33.497390085Z" level=error msg="Failed to destroy network for sandbox \"caa6547227a1620b7a4197c3897d843edd199256b9961ceb916b76e9c94fcc3f\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:33.502283 containerd[1934]: time="2025-01-13T20:09:33.502226049Z" level=error msg="Failed to destroy network for sandbox \"ec48cd1dd8723b80be1e1659222057350fc66ef8fc805243c67fca1b079b3aae\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:33.503106 containerd[1934]: time="2025-01-13T20:09:33.502282341Z" level=error msg="encountered an error cleaning up failed sandbox \"caa6547227a1620b7a4197c3897d843edd199256b9961ceb916b76e9c94fcc3f\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:33.503106 containerd[1934]: time="2025-01-13T20:09:33.503018337Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-kube-controllers-68f76c7ddf-lh8nj,Uid:2be21c11-9c2d-4b9a-81a5-0e73daba31c1,Namespace:calico-system,Attempt:8,} failed, error" error="failed to setup network for sandbox \"caa6547227a1620b7a4197c3897d843edd199256b9961ceb916b76e9c94fcc3f\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:33.504635 containerd[1934]: time="2025-01-13T20:09:33.504346521Z" level=error msg="encountered an error cleaning up failed sandbox \"ec48cd1dd8723b80be1e1659222057350fc66ef8fc805243c67fca1b079b3aae\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:33.504635 containerd[1934]: time="2025-01-13T20:09:33.504447945Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:csi-node-driver-wq54r,Uid:d47fc662-eff9-4473-83da-b6f0b896d81f,Namespace:calico-system,Attempt:8,} failed, error" error="failed to setup network for sandbox \"ec48cd1dd8723b80be1e1659222057350fc66ef8fc805243c67fca1b079b3aae\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:33.505424 kubelet[3423]: E0113 20:09:33.504836 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"caa6547227a1620b7a4197c3897d843edd199256b9961ceb916b76e9c94fcc3f\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:33.505424 kubelet[3423]: E0113 20:09:33.504897 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"ec48cd1dd8723b80be1e1659222057350fc66ef8fc805243c67fca1b079b3aae\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:33.505424 kubelet[3423]: E0113 20:09:33.504934 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"caa6547227a1620b7a4197c3897d843edd199256b9961ceb916b76e9c94fcc3f\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/calico-kube-controllers-68f76c7ddf-lh8nj" Jan 13 20:09:33.505424 kubelet[3423]: E0113 20:09:33.504970 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"ec48cd1dd8723b80be1e1659222057350fc66ef8fc805243c67fca1b079b3aae\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/csi-node-driver-wq54r" Jan 13 20:09:33.506166 kubelet[3423]: E0113 20:09:33.505009 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"ec48cd1dd8723b80be1e1659222057350fc66ef8fc805243c67fca1b079b3aae\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/csi-node-driver-wq54r" Jan 13 20:09:33.506166 kubelet[3423]: E0113 20:09:33.504973 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"caa6547227a1620b7a4197c3897d843edd199256b9961ceb916b76e9c94fcc3f\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/calico-kube-controllers-68f76c7ddf-lh8nj" Jan 13 20:09:33.506166 kubelet[3423]: E0113 20:09:33.505141 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"calico-kube-controllers-68f76c7ddf-lh8nj_calico-system(2be21c11-9c2d-4b9a-81a5-0e73daba31c1)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"calico-kube-controllers-68f76c7ddf-lh8nj_calico-system(2be21c11-9c2d-4b9a-81a5-0e73daba31c1)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"caa6547227a1620b7a4197c3897d843edd199256b9961ceb916b76e9c94fcc3f\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-system/calico-kube-controllers-68f76c7ddf-lh8nj" podUID="2be21c11-9c2d-4b9a-81a5-0e73daba31c1" Jan 13 20:09:33.508288 kubelet[3423]: E0113 20:09:33.505140 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"csi-node-driver-wq54r_calico-system(d47fc662-eff9-4473-83da-b6f0b896d81f)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"csi-node-driver-wq54r_calico-system(d47fc662-eff9-4473-83da-b6f0b896d81f)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"ec48cd1dd8723b80be1e1659222057350fc66ef8fc805243c67fca1b079b3aae\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-system/csi-node-driver-wq54r" podUID="d47fc662-eff9-4473-83da-b6f0b896d81f" Jan 13 20:09:33.509115 containerd[1934]: time="2025-01-13T20:09:33.509055357Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"034a1f3cd65e356f264d6b6a21d8604cdd13f23a1add7bf41ab327c6991d4011\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:09:33.509309 containerd[1934]: time="2025-01-13T20:09:33.509142489Z" level=info msg="RemovePodSandbox \"034a1f3cd65e356f264d6b6a21d8604cdd13f23a1add7bf41ab327c6991d4011\" returns successfully" Jan 13 20:09:34.009921 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-0c85ca62eb94f4e10d7b4154d1085f14ea6b6363ce2b9a48f55a28836e3adb05-shm.mount: Deactivated successfully. Jan 13 20:09:34.134946 kubelet[3423]: I0113 20:09:34.133095 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="caa6547227a1620b7a4197c3897d843edd199256b9961ceb916b76e9c94fcc3f" Jan 13 20:09:34.139305 containerd[1934]: time="2025-01-13T20:09:34.133985960Z" level=info msg="StopPodSandbox for \"caa6547227a1620b7a4197c3897d843edd199256b9961ceb916b76e9c94fcc3f\"" Jan 13 20:09:34.139305 containerd[1934]: time="2025-01-13T20:09:34.134538296Z" level=info msg="Ensure that sandbox caa6547227a1620b7a4197c3897d843edd199256b9961ceb916b76e9c94fcc3f in task-service has been cleanup successfully" Jan 13 20:09:34.139305 containerd[1934]: time="2025-01-13T20:09:34.135264020Z" level=info msg="TearDown network for sandbox \"caa6547227a1620b7a4197c3897d843edd199256b9961ceb916b76e9c94fcc3f\" successfully" Jan 13 20:09:34.139305 containerd[1934]: time="2025-01-13T20:09:34.135302720Z" level=info msg="StopPodSandbox for \"caa6547227a1620b7a4197c3897d843edd199256b9961ceb916b76e9c94fcc3f\" returns successfully" Jan 13 20:09:34.139305 containerd[1934]: time="2025-01-13T20:09:34.138544904Z" level=info msg="StopPodSandbox for \"41f52017578a2719bea2c9934c17ea164adf7cb7d5ed2c0dd11787fd25b06487\"" Jan 13 20:09:34.139305 containerd[1934]: time="2025-01-13T20:09:34.138700508Z" level=info msg="TearDown network for sandbox \"41f52017578a2719bea2c9934c17ea164adf7cb7d5ed2c0dd11787fd25b06487\" successfully" Jan 13 20:09:34.139305 containerd[1934]: time="2025-01-13T20:09:34.138721976Z" level=info msg="StopPodSandbox for \"41f52017578a2719bea2c9934c17ea164adf7cb7d5ed2c0dd11787fd25b06487\" returns successfully" Jan 13 20:09:34.140162 containerd[1934]: time="2025-01-13T20:09:34.139607456Z" level=info msg="StopPodSandbox for \"4d3ce37a9c40510fd9d66de0b8c2ac5802b7067c8efb617b93564f6bfe5a5223\"" Jan 13 20:09:34.140162 containerd[1934]: time="2025-01-13T20:09:34.139759268Z" level=info msg="TearDown network for sandbox \"4d3ce37a9c40510fd9d66de0b8c2ac5802b7067c8efb617b93564f6bfe5a5223\" successfully" Jan 13 20:09:34.140162 containerd[1934]: time="2025-01-13T20:09:34.139806320Z" level=info msg="StopPodSandbox for \"4d3ce37a9c40510fd9d66de0b8c2ac5802b7067c8efb617b93564f6bfe5a5223\" returns successfully" Jan 13 20:09:34.147817 kubelet[3423]: I0113 20:09:34.141116 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5eeccd24bcd272ceac794541253f4c8a557a6e36ba0959e6db5a98b61fca47a2" Jan 13 20:09:34.147942 containerd[1934]: time="2025-01-13T20:09:34.142005956Z" level=info msg="StopPodSandbox for \"5eeccd24bcd272ceac794541253f4c8a557a6e36ba0959e6db5a98b61fca47a2\"" Jan 13 20:09:34.147942 containerd[1934]: time="2025-01-13T20:09:34.142270640Z" level=info msg="Ensure that sandbox 5eeccd24bcd272ceac794541253f4c8a557a6e36ba0959e6db5a98b61fca47a2 in task-service has been cleanup successfully" Jan 13 20:09:34.147942 containerd[1934]: time="2025-01-13T20:09:34.144273188Z" level=info msg="TearDown network for sandbox \"5eeccd24bcd272ceac794541253f4c8a557a6e36ba0959e6db5a98b61fca47a2\" successfully" Jan 13 20:09:34.147942 containerd[1934]: time="2025-01-13T20:09:34.144318752Z" level=info msg="StopPodSandbox for \"5eeccd24bcd272ceac794541253f4c8a557a6e36ba0959e6db5a98b61fca47a2\" returns successfully" Jan 13 20:09:34.147942 containerd[1934]: time="2025-01-13T20:09:34.144540764Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-kube-controllers-68f76c7ddf-lh8nj,Uid:2be21c11-9c2d-4b9a-81a5-0e73daba31c1,Namespace:calico-system,Attempt:9,}" Jan 13 20:09:34.149115 systemd[1]: run-netns-cni\x2dc5c702ee\x2de92d\x2d51e7\x2d232d\x2d1d017aaf7023.mount: Deactivated successfully. Jan 13 20:09:34.157718 systemd[1]: run-netns-cni\x2d59981202\x2d83f8\x2d3484\x2d07e1\x2d9e5aa247ad07.mount: Deactivated successfully. Jan 13 20:09:34.159872 containerd[1934]: time="2025-01-13T20:09:34.158118332Z" level=info msg="StopPodSandbox for \"2f9666670aab61aa1c36a5c18b2c6e8e3d08bf1cfc3f42fb8cc1ef7244f4257c\"" Jan 13 20:09:34.159872 containerd[1934]: time="2025-01-13T20:09:34.158639300Z" level=info msg="TearDown network for sandbox \"2f9666670aab61aa1c36a5c18b2c6e8e3d08bf1cfc3f42fb8cc1ef7244f4257c\" successfully" Jan 13 20:09:34.159872 containerd[1934]: time="2025-01-13T20:09:34.158670884Z" level=info msg="StopPodSandbox for \"2f9666670aab61aa1c36a5c18b2c6e8e3d08bf1cfc3f42fb8cc1ef7244f4257c\" returns successfully" Jan 13 20:09:34.161595 containerd[1934]: time="2025-01-13T20:09:34.161545592Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-76f75df574-mkr2l,Uid:396e30c8-d221-410a-89fe-e353ba8cddbf,Namespace:kube-system,Attempt:8,}" Jan 13 20:09:34.164416 kubelet[3423]: I0113 20:09:34.164357 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="00e76c628c150112006f3b23d6e74781e4d42e1b9aecfc0a92d42b780e86d031" Jan 13 20:09:34.165567 containerd[1934]: time="2025-01-13T20:09:34.165507032Z" level=info msg="StopPodSandbox for \"00e76c628c150112006f3b23d6e74781e4d42e1b9aecfc0a92d42b780e86d031\"" Jan 13 20:09:34.170813 containerd[1934]: time="2025-01-13T20:09:34.168143780Z" level=info msg="Ensure that sandbox 00e76c628c150112006f3b23d6e74781e4d42e1b9aecfc0a92d42b780e86d031 in task-service has been cleanup successfully" Jan 13 20:09:34.171065 containerd[1934]: time="2025-01-13T20:09:34.170993684Z" level=info msg="TearDown network for sandbox \"00e76c628c150112006f3b23d6e74781e4d42e1b9aecfc0a92d42b780e86d031\" successfully" Jan 13 20:09:34.171149 containerd[1934]: time="2025-01-13T20:09:34.171079496Z" level=info msg="StopPodSandbox for \"00e76c628c150112006f3b23d6e74781e4d42e1b9aecfc0a92d42b780e86d031\" returns successfully" Jan 13 20:09:34.174807 systemd[1]: run-netns-cni\x2dbde7a57f\x2d0688\x2d0b26\x2dd708\x2df8f214b9f26f.mount: Deactivated successfully. Jan 13 20:09:34.182993 containerd[1934]: time="2025-01-13T20:09:34.182931404Z" level=info msg="StopPodSandbox for \"fe203c0f7fc44f83207d781bd972b7ee26dab60b101be6081c8e7f2c82858f26\"" Jan 13 20:09:34.183178 containerd[1934]: time="2025-01-13T20:09:34.183136280Z" level=info msg="TearDown network for sandbox \"fe203c0f7fc44f83207d781bd972b7ee26dab60b101be6081c8e7f2c82858f26\" successfully" Jan 13 20:09:34.183242 containerd[1934]: time="2025-01-13T20:09:34.183170444Z" level=info msg="StopPodSandbox for \"fe203c0f7fc44f83207d781bd972b7ee26dab60b101be6081c8e7f2c82858f26\" returns successfully" Jan 13 20:09:34.185726 containerd[1934]: time="2025-01-13T20:09:34.185663696Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-7fbffcd8cd-wszl7,Uid:ad79c041-eaf1-4d57-9fb4-c3fb08680cb8,Namespace:calico-apiserver,Attempt:8,}" Jan 13 20:09:34.187798 kubelet[3423]: I0113 20:09:34.187738 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0c85ca62eb94f4e10d7b4154d1085f14ea6b6363ce2b9a48f55a28836e3adb05" Jan 13 20:09:34.198800 containerd[1934]: time="2025-01-13T20:09:34.198150296Z" level=info msg="StopPodSandbox for \"0c85ca62eb94f4e10d7b4154d1085f14ea6b6363ce2b9a48f55a28836e3adb05\"" Jan 13 20:09:34.199544 containerd[1934]: time="2025-01-13T20:09:34.199500500Z" level=info msg="Ensure that sandbox 0c85ca62eb94f4e10d7b4154d1085f14ea6b6363ce2b9a48f55a28836e3adb05 in task-service has been cleanup successfully" Jan 13 20:09:34.202137 containerd[1934]: time="2025-01-13T20:09:34.202076276Z" level=info msg="TearDown network for sandbox \"0c85ca62eb94f4e10d7b4154d1085f14ea6b6363ce2b9a48f55a28836e3adb05\" successfully" Jan 13 20:09:34.202448 containerd[1934]: time="2025-01-13T20:09:34.202397564Z" level=info msg="StopPodSandbox for \"0c85ca62eb94f4e10d7b4154d1085f14ea6b6363ce2b9a48f55a28836e3adb05\" returns successfully" Jan 13 20:09:34.207328 containerd[1934]: time="2025-01-13T20:09:34.207280232Z" level=info msg="StopPodSandbox for \"871bb94da403609229c4f8c4907a3c7c7ff537ef7b689806a251f0915d567eea\"" Jan 13 20:09:34.207853 containerd[1934]: time="2025-01-13T20:09:34.207657392Z" level=info msg="TearDown network for sandbox \"871bb94da403609229c4f8c4907a3c7c7ff537ef7b689806a251f0915d567eea\" successfully" Jan 13 20:09:34.207853 containerd[1934]: time="2025-01-13T20:09:34.207685880Z" level=info msg="StopPodSandbox for \"871bb94da403609229c4f8c4907a3c7c7ff537ef7b689806a251f0915d567eea\" returns successfully" Jan 13 20:09:34.212961 containerd[1934]: time="2025-01-13T20:09:34.212888240Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-76f75df574-8wp6k,Uid:87115657-f395-40ec-89ea-3d7835119c3a,Namespace:kube-system,Attempt:8,}" Jan 13 20:09:34.222160 kubelet[3423]: I0113 20:09:34.221148 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e4f3782869a95e1724e7fed0918f96150403f3af79725f813cf600d13dab0323" Jan 13 20:09:34.227515 containerd[1934]: time="2025-01-13T20:09:34.227371364Z" level=info msg="StopPodSandbox for \"e4f3782869a95e1724e7fed0918f96150403f3af79725f813cf600d13dab0323\"" Jan 13 20:09:34.229462 containerd[1934]: time="2025-01-13T20:09:34.229408172Z" level=info msg="Ensure that sandbox e4f3782869a95e1724e7fed0918f96150403f3af79725f813cf600d13dab0323 in task-service has been cleanup successfully" Jan 13 20:09:34.234544 containerd[1934]: time="2025-01-13T20:09:34.234487472Z" level=info msg="TearDown network for sandbox \"e4f3782869a95e1724e7fed0918f96150403f3af79725f813cf600d13dab0323\" successfully" Jan 13 20:09:34.234849 containerd[1934]: time="2025-01-13T20:09:34.234692492Z" level=info msg="StopPodSandbox for \"e4f3782869a95e1724e7fed0918f96150403f3af79725f813cf600d13dab0323\" returns successfully" Jan 13 20:09:34.243225 containerd[1934]: time="2025-01-13T20:09:34.243171417Z" level=info msg="StopPodSandbox for \"4a448ddaae657a72707e2505e7b6329129c1ea98f60de221b826b6b205a6ff6b\"" Jan 13 20:09:34.243825 containerd[1934]: time="2025-01-13T20:09:34.243534825Z" level=info msg="TearDown network for sandbox \"4a448ddaae657a72707e2505e7b6329129c1ea98f60de221b826b6b205a6ff6b\" successfully" Jan 13 20:09:34.243825 containerd[1934]: time="2025-01-13T20:09:34.243565821Z" level=info msg="StopPodSandbox for \"4a448ddaae657a72707e2505e7b6329129c1ea98f60de221b826b6b205a6ff6b\" returns successfully" Jan 13 20:09:34.248677 containerd[1934]: time="2025-01-13T20:09:34.248380101Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-7fbffcd8cd-pxvdr,Uid:8f72f896-c0ba-4b07-9a22-acc5c8ca3697,Namespace:calico-apiserver,Attempt:8,}" Jan 13 20:09:34.263899 kubelet[3423]: I0113 20:09:34.263760 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ec48cd1dd8723b80be1e1659222057350fc66ef8fc805243c67fca1b079b3aae" Jan 13 20:09:34.272710 containerd[1934]: time="2025-01-13T20:09:34.272086785Z" level=info msg="StopPodSandbox for \"ec48cd1dd8723b80be1e1659222057350fc66ef8fc805243c67fca1b079b3aae\"" Jan 13 20:09:34.272710 containerd[1934]: time="2025-01-13T20:09:34.272451813Z" level=info msg="Ensure that sandbox ec48cd1dd8723b80be1e1659222057350fc66ef8fc805243c67fca1b079b3aae in task-service has been cleanup successfully" Jan 13 20:09:34.273019 containerd[1934]: time="2025-01-13T20:09:34.272963637Z" level=info msg="TearDown network for sandbox \"ec48cd1dd8723b80be1e1659222057350fc66ef8fc805243c67fca1b079b3aae\" successfully" Jan 13 20:09:34.273132 containerd[1934]: time="2025-01-13T20:09:34.273103221Z" level=info msg="StopPodSandbox for \"ec48cd1dd8723b80be1e1659222057350fc66ef8fc805243c67fca1b079b3aae\" returns successfully" Jan 13 20:09:34.293142 containerd[1934]: time="2025-01-13T20:09:34.293089785Z" level=info msg="StopPodSandbox for \"6ca554906e8aff3cb9eab87b291894d187892c2a6910248683c6fe51f5efa9c4\"" Jan 13 20:09:34.295743 containerd[1934]: time="2025-01-13T20:09:34.295678881Z" level=info msg="TearDown network for sandbox \"6ca554906e8aff3cb9eab87b291894d187892c2a6910248683c6fe51f5efa9c4\" successfully" Jan 13 20:09:34.295743 containerd[1934]: time="2025-01-13T20:09:34.295728609Z" level=info msg="StopPodSandbox for \"6ca554906e8aff3cb9eab87b291894d187892c2a6910248683c6fe51f5efa9c4\" returns successfully" Jan 13 20:09:34.302791 containerd[1934]: time="2025-01-13T20:09:34.302319321Z" level=info msg="StopPodSandbox for \"dfb5cc6aa8ee548a0817f76e636f6ba17a9915fccdeb0f77deba61f58d7154ee\"" Jan 13 20:09:34.304021 containerd[1934]: time="2025-01-13T20:09:34.303653337Z" level=info msg="TearDown network for sandbox \"dfb5cc6aa8ee548a0817f76e636f6ba17a9915fccdeb0f77deba61f58d7154ee\" successfully" Jan 13 20:09:34.304021 containerd[1934]: time="2025-01-13T20:09:34.303944985Z" level=info msg="StopPodSandbox for \"dfb5cc6aa8ee548a0817f76e636f6ba17a9915fccdeb0f77deba61f58d7154ee\" returns successfully" Jan 13 20:09:34.307918 containerd[1934]: time="2025-01-13T20:09:34.307305441Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:csi-node-driver-wq54r,Uid:d47fc662-eff9-4473-83da-b6f0b896d81f,Namespace:calico-system,Attempt:9,}" Jan 13 20:09:34.598219 containerd[1934]: time="2025-01-13T20:09:34.598058950Z" level=error msg="Failed to destroy network for sandbox \"5cd26e99c4b74ae9d61483798457a99584070c404b0f9be16defa2c0bdb11350\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:34.612544 containerd[1934]: time="2025-01-13T20:09:34.612466510Z" level=error msg="encountered an error cleaning up failed sandbox \"5cd26e99c4b74ae9d61483798457a99584070c404b0f9be16defa2c0bdb11350\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:34.612701 containerd[1934]: time="2025-01-13T20:09:34.612576562Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-kube-controllers-68f76c7ddf-lh8nj,Uid:2be21c11-9c2d-4b9a-81a5-0e73daba31c1,Namespace:calico-system,Attempt:9,} failed, error" error="failed to setup network for sandbox \"5cd26e99c4b74ae9d61483798457a99584070c404b0f9be16defa2c0bdb11350\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:34.617528 kubelet[3423]: E0113 20:09:34.616871 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"5cd26e99c4b74ae9d61483798457a99584070c404b0f9be16defa2c0bdb11350\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:34.617528 kubelet[3423]: E0113 20:09:34.616961 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"5cd26e99c4b74ae9d61483798457a99584070c404b0f9be16defa2c0bdb11350\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/calico-kube-controllers-68f76c7ddf-lh8nj" Jan 13 20:09:34.617528 kubelet[3423]: E0113 20:09:34.616999 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"5cd26e99c4b74ae9d61483798457a99584070c404b0f9be16defa2c0bdb11350\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/calico-kube-controllers-68f76c7ddf-lh8nj" Jan 13 20:09:34.619208 kubelet[3423]: E0113 20:09:34.617100 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"calico-kube-controllers-68f76c7ddf-lh8nj_calico-system(2be21c11-9c2d-4b9a-81a5-0e73daba31c1)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"calico-kube-controllers-68f76c7ddf-lh8nj_calico-system(2be21c11-9c2d-4b9a-81a5-0e73daba31c1)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"5cd26e99c4b74ae9d61483798457a99584070c404b0f9be16defa2c0bdb11350\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-system/calico-kube-controllers-68f76c7ddf-lh8nj" podUID="2be21c11-9c2d-4b9a-81a5-0e73daba31c1" Jan 13 20:09:34.815823 containerd[1934]: time="2025-01-13T20:09:34.814874027Z" level=error msg="Failed to destroy network for sandbox \"7923d55515294cf3728cfef254022ed5f094d697790fafcc5064fca07c9e6e58\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:34.819285 containerd[1934]: time="2025-01-13T20:09:34.819186911Z" level=error msg="encountered an error cleaning up failed sandbox \"7923d55515294cf3728cfef254022ed5f094d697790fafcc5064fca07c9e6e58\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:34.819867 containerd[1934]: time="2025-01-13T20:09:34.819298619Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-76f75df574-mkr2l,Uid:396e30c8-d221-410a-89fe-e353ba8cddbf,Namespace:kube-system,Attempt:8,} failed, error" error="failed to setup network for sandbox \"7923d55515294cf3728cfef254022ed5f094d697790fafcc5064fca07c9e6e58\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:34.821992 kubelet[3423]: E0113 20:09:34.821916 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"7923d55515294cf3728cfef254022ed5f094d697790fafcc5064fca07c9e6e58\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:34.822183 kubelet[3423]: E0113 20:09:34.822059 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"7923d55515294cf3728cfef254022ed5f094d697790fafcc5064fca07c9e6e58\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-76f75df574-mkr2l" Jan 13 20:09:34.822258 kubelet[3423]: E0113 20:09:34.822213 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"7923d55515294cf3728cfef254022ed5f094d697790fafcc5064fca07c9e6e58\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-76f75df574-mkr2l" Jan 13 20:09:34.825214 kubelet[3423]: E0113 20:09:34.823992 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-76f75df574-mkr2l_kube-system(396e30c8-d221-410a-89fe-e353ba8cddbf)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-76f75df574-mkr2l_kube-system(396e30c8-d221-410a-89fe-e353ba8cddbf)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"7923d55515294cf3728cfef254022ed5f094d697790fafcc5064fca07c9e6e58\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="kube-system/coredns-76f75df574-mkr2l" podUID="396e30c8-d221-410a-89fe-e353ba8cddbf" Jan 13 20:09:34.864853 containerd[1934]: time="2025-01-13T20:09:34.863631912Z" level=error msg="Failed to destroy network for sandbox \"b9dad2faee8703ada2153172211cd7c9c21998773d8f3d149c73e589c95a0df9\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:34.868912 containerd[1934]: time="2025-01-13T20:09:34.868831380Z" level=error msg="encountered an error cleaning up failed sandbox \"b9dad2faee8703ada2153172211cd7c9c21998773d8f3d149c73e589c95a0df9\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:34.869614 containerd[1934]: time="2025-01-13T20:09:34.868947132Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-7fbffcd8cd-pxvdr,Uid:8f72f896-c0ba-4b07-9a22-acc5c8ca3697,Namespace:calico-apiserver,Attempt:8,} failed, error" error="failed to setup network for sandbox \"b9dad2faee8703ada2153172211cd7c9c21998773d8f3d149c73e589c95a0df9\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:34.869808 kubelet[3423]: E0113 20:09:34.869307 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b9dad2faee8703ada2153172211cd7c9c21998773d8f3d149c73e589c95a0df9\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:34.869808 kubelet[3423]: E0113 20:09:34.869386 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b9dad2faee8703ada2153172211cd7c9c21998773d8f3d149c73e589c95a0df9\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-pxvdr" Jan 13 20:09:34.869808 kubelet[3423]: E0113 20:09:34.869427 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b9dad2faee8703ada2153172211cd7c9c21998773d8f3d149c73e589c95a0df9\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-pxvdr" Jan 13 20:09:34.870323 kubelet[3423]: E0113 20:09:34.869518 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"calico-apiserver-7fbffcd8cd-pxvdr_calico-apiserver(8f72f896-c0ba-4b07-9a22-acc5c8ca3697)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"calico-apiserver-7fbffcd8cd-pxvdr_calico-apiserver(8f72f896-c0ba-4b07-9a22-acc5c8ca3697)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"b9dad2faee8703ada2153172211cd7c9c21998773d8f3d149c73e589c95a0df9\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-pxvdr" podUID="8f72f896-c0ba-4b07-9a22-acc5c8ca3697" Jan 13 20:09:34.897025 containerd[1934]: time="2025-01-13T20:09:34.896949048Z" level=error msg="Failed to destroy network for sandbox \"759f8831ea7d7e5c0dc8d9495100af5070a0a535616a4fce422e9b8c07fb0a84\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:34.901808 containerd[1934]: time="2025-01-13T20:09:34.897558636Z" level=error msg="encountered an error cleaning up failed sandbox \"759f8831ea7d7e5c0dc8d9495100af5070a0a535616a4fce422e9b8c07fb0a84\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:34.901808 containerd[1934]: time="2025-01-13T20:09:34.897704232Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-7fbffcd8cd-wszl7,Uid:ad79c041-eaf1-4d57-9fb4-c3fb08680cb8,Namespace:calico-apiserver,Attempt:8,} failed, error" error="failed to setup network for sandbox \"759f8831ea7d7e5c0dc8d9495100af5070a0a535616a4fce422e9b8c07fb0a84\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:34.902093 kubelet[3423]: E0113 20:09:34.898120 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"759f8831ea7d7e5c0dc8d9495100af5070a0a535616a4fce422e9b8c07fb0a84\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:34.902093 kubelet[3423]: E0113 20:09:34.898189 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"759f8831ea7d7e5c0dc8d9495100af5070a0a535616a4fce422e9b8c07fb0a84\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-wszl7" Jan 13 20:09:34.902093 kubelet[3423]: E0113 20:09:34.898227 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"759f8831ea7d7e5c0dc8d9495100af5070a0a535616a4fce422e9b8c07fb0a84\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-wszl7" Jan 13 20:09:34.902284 kubelet[3423]: E0113 20:09:34.898318 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"calico-apiserver-7fbffcd8cd-wszl7_calico-apiserver(ad79c041-eaf1-4d57-9fb4-c3fb08680cb8)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"calico-apiserver-7fbffcd8cd-wszl7_calico-apiserver(ad79c041-eaf1-4d57-9fb4-c3fb08680cb8)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"759f8831ea7d7e5c0dc8d9495100af5070a0a535616a4fce422e9b8c07fb0a84\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-wszl7" podUID="ad79c041-eaf1-4d57-9fb4-c3fb08680cb8" Jan 13 20:09:34.931310 containerd[1934]: time="2025-01-13T20:09:34.930921768Z" level=error msg="Failed to destroy network for sandbox \"a6e568904495292ebcaa2ddc464d5ea9ff23223173598373960a2371d9378c10\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:34.932806 containerd[1934]: time="2025-01-13T20:09:34.932376240Z" level=error msg="encountered an error cleaning up failed sandbox \"a6e568904495292ebcaa2ddc464d5ea9ff23223173598373960a2371d9378c10\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:34.934224 containerd[1934]: time="2025-01-13T20:09:34.934167600Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:csi-node-driver-wq54r,Uid:d47fc662-eff9-4473-83da-b6f0b896d81f,Namespace:calico-system,Attempt:9,} failed, error" error="failed to setup network for sandbox \"a6e568904495292ebcaa2ddc464d5ea9ff23223173598373960a2371d9378c10\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:34.936465 kubelet[3423]: E0113 20:09:34.935399 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a6e568904495292ebcaa2ddc464d5ea9ff23223173598373960a2371d9378c10\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:34.936465 kubelet[3423]: E0113 20:09:34.935488 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a6e568904495292ebcaa2ddc464d5ea9ff23223173598373960a2371d9378c10\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/csi-node-driver-wq54r" Jan 13 20:09:34.936465 kubelet[3423]: E0113 20:09:34.935526 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"a6e568904495292ebcaa2ddc464d5ea9ff23223173598373960a2371d9378c10\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/csi-node-driver-wq54r" Jan 13 20:09:34.937587 kubelet[3423]: E0113 20:09:34.935628 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"csi-node-driver-wq54r_calico-system(d47fc662-eff9-4473-83da-b6f0b896d81f)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"csi-node-driver-wq54r_calico-system(d47fc662-eff9-4473-83da-b6f0b896d81f)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"a6e568904495292ebcaa2ddc464d5ea9ff23223173598373960a2371d9378c10\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-system/csi-node-driver-wq54r" podUID="d47fc662-eff9-4473-83da-b6f0b896d81f" Jan 13 20:09:34.967879 containerd[1934]: time="2025-01-13T20:09:34.967461600Z" level=error msg="Failed to destroy network for sandbox \"8a99e8dc861e2951c12b20cfbc8fc211a864308d3e40d113adbf589f6bee301f\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:34.970801 containerd[1934]: time="2025-01-13T20:09:34.970720548Z" level=error msg="encountered an error cleaning up failed sandbox \"8a99e8dc861e2951c12b20cfbc8fc211a864308d3e40d113adbf589f6bee301f\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:34.971587 containerd[1934]: time="2025-01-13T20:09:34.971533848Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-76f75df574-8wp6k,Uid:87115657-f395-40ec-89ea-3d7835119c3a,Namespace:kube-system,Attempt:8,} failed, error" error="failed to setup network for sandbox \"8a99e8dc861e2951c12b20cfbc8fc211a864308d3e40d113adbf589f6bee301f\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:34.972569 kubelet[3423]: E0113 20:09:34.972515 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"8a99e8dc861e2951c12b20cfbc8fc211a864308d3e40d113adbf589f6bee301f\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:34.972720 kubelet[3423]: E0113 20:09:34.972602 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"8a99e8dc861e2951c12b20cfbc8fc211a864308d3e40d113adbf589f6bee301f\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-76f75df574-8wp6k" Jan 13 20:09:34.972720 kubelet[3423]: E0113 20:09:34.972640 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"8a99e8dc861e2951c12b20cfbc8fc211a864308d3e40d113adbf589f6bee301f\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-76f75df574-8wp6k" Jan 13 20:09:34.972890 kubelet[3423]: E0113 20:09:34.972719 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-76f75df574-8wp6k_kube-system(87115657-f395-40ec-89ea-3d7835119c3a)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-76f75df574-8wp6k_kube-system(87115657-f395-40ec-89ea-3d7835119c3a)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"8a99e8dc861e2951c12b20cfbc8fc211a864308d3e40d113adbf589f6bee301f\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="kube-system/coredns-76f75df574-8wp6k" podUID="87115657-f395-40ec-89ea-3d7835119c3a" Jan 13 20:09:35.017544 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-5cd26e99c4b74ae9d61483798457a99584070c404b0f9be16defa2c0bdb11350-shm.mount: Deactivated successfully. Jan 13 20:09:35.017735 systemd[1]: run-netns-cni\x2d175688ff\x2dd5cd\x2dfd73\x2df385\x2d88c48b4f56a3.mount: Deactivated successfully. Jan 13 20:09:35.017895 systemd[1]: run-netns-cni\x2dd16ffd1f\x2de5fe\x2db5b9\x2de27a\x2dc474ce7ad514.mount: Deactivated successfully. Jan 13 20:09:35.018015 systemd[1]: run-netns-cni\x2da435679c\x2d58a8\x2d2c69\x2dcebf\x2d66363ce49e65.mount: Deactivated successfully. Jan 13 20:09:35.279711 kubelet[3423]: I0113 20:09:35.277647 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7923d55515294cf3728cfef254022ed5f094d697790fafcc5064fca07c9e6e58" Jan 13 20:09:35.281553 containerd[1934]: time="2025-01-13T20:09:35.280029022Z" level=info msg="StopPodSandbox for \"7923d55515294cf3728cfef254022ed5f094d697790fafcc5064fca07c9e6e58\"" Jan 13 20:09:35.281553 containerd[1934]: time="2025-01-13T20:09:35.280309786Z" level=info msg="Ensure that sandbox 7923d55515294cf3728cfef254022ed5f094d697790fafcc5064fca07c9e6e58 in task-service has been cleanup successfully" Jan 13 20:09:35.289089 containerd[1934]: time="2025-01-13T20:09:35.288039238Z" level=info msg="TearDown network for sandbox \"7923d55515294cf3728cfef254022ed5f094d697790fafcc5064fca07c9e6e58\" successfully" Jan 13 20:09:35.289089 containerd[1934]: time="2025-01-13T20:09:35.288091390Z" level=info msg="StopPodSandbox for \"7923d55515294cf3728cfef254022ed5f094d697790fafcc5064fca07c9e6e58\" returns successfully" Jan 13 20:09:35.292736 systemd[1]: run-netns-cni\x2d931736da\x2dcbe4\x2dff3d\x2d8390\x2d70c876a1ae20.mount: Deactivated successfully. Jan 13 20:09:35.296743 containerd[1934]: time="2025-01-13T20:09:35.293016346Z" level=info msg="StopPodSandbox for \"5eeccd24bcd272ceac794541253f4c8a557a6e36ba0959e6db5a98b61fca47a2\"" Jan 13 20:09:35.296743 containerd[1934]: time="2025-01-13T20:09:35.293189326Z" level=info msg="TearDown network for sandbox \"5eeccd24bcd272ceac794541253f4c8a557a6e36ba0959e6db5a98b61fca47a2\" successfully" Jan 13 20:09:35.296743 containerd[1934]: time="2025-01-13T20:09:35.293211922Z" level=info msg="StopPodSandbox for \"5eeccd24bcd272ceac794541253f4c8a557a6e36ba0959e6db5a98b61fca47a2\" returns successfully" Jan 13 20:09:35.296743 containerd[1934]: time="2025-01-13T20:09:35.295414798Z" level=info msg="StopPodSandbox for \"2f9666670aab61aa1c36a5c18b2c6e8e3d08bf1cfc3f42fb8cc1ef7244f4257c\"" Jan 13 20:09:35.296743 containerd[1934]: time="2025-01-13T20:09:35.295590934Z" level=info msg="TearDown network for sandbox \"2f9666670aab61aa1c36a5c18b2c6e8e3d08bf1cfc3f42fb8cc1ef7244f4257c\" successfully" Jan 13 20:09:35.296743 containerd[1934]: time="2025-01-13T20:09:35.295613926Z" level=info msg="StopPodSandbox for \"2f9666670aab61aa1c36a5c18b2c6e8e3d08bf1cfc3f42fb8cc1ef7244f4257c\" returns successfully" Jan 13 20:09:35.299850 containerd[1934]: time="2025-01-13T20:09:35.298628998Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-76f75df574-mkr2l,Uid:396e30c8-d221-410a-89fe-e353ba8cddbf,Namespace:kube-system,Attempt:9,}" Jan 13 20:09:35.308874 kubelet[3423]: I0113 20:09:35.307435 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a6e568904495292ebcaa2ddc464d5ea9ff23223173598373960a2371d9378c10" Jan 13 20:09:35.309145 containerd[1934]: time="2025-01-13T20:09:35.309067342Z" level=info msg="StopPodSandbox for \"a6e568904495292ebcaa2ddc464d5ea9ff23223173598373960a2371d9378c10\"" Jan 13 20:09:35.309447 containerd[1934]: time="2025-01-13T20:09:35.309364702Z" level=info msg="Ensure that sandbox a6e568904495292ebcaa2ddc464d5ea9ff23223173598373960a2371d9378c10 in task-service has been cleanup successfully" Jan 13 20:09:35.318403 containerd[1934]: time="2025-01-13T20:09:35.317000266Z" level=info msg="TearDown network for sandbox \"a6e568904495292ebcaa2ddc464d5ea9ff23223173598373960a2371d9378c10\" successfully" Jan 13 20:09:35.318190 systemd[1]: run-netns-cni\x2ddd608784\x2d1e37\x2d7b53\x2dc863\x2df2bb61aa6846.mount: Deactivated successfully. Jan 13 20:09:35.318662 containerd[1934]: time="2025-01-13T20:09:35.318410590Z" level=info msg="StopPodSandbox for \"a6e568904495292ebcaa2ddc464d5ea9ff23223173598373960a2371d9378c10\" returns successfully" Jan 13 20:09:35.327472 containerd[1934]: time="2025-01-13T20:09:35.326624482Z" level=info msg="StopPodSandbox for \"ec48cd1dd8723b80be1e1659222057350fc66ef8fc805243c67fca1b079b3aae\"" Jan 13 20:09:35.329945 containerd[1934]: time="2025-01-13T20:09:35.329856502Z" level=info msg="TearDown network for sandbox \"ec48cd1dd8723b80be1e1659222057350fc66ef8fc805243c67fca1b079b3aae\" successfully" Jan 13 20:09:35.329945 containerd[1934]: time="2025-01-13T20:09:35.329910178Z" level=info msg="StopPodSandbox for \"ec48cd1dd8723b80be1e1659222057350fc66ef8fc805243c67fca1b079b3aae\" returns successfully" Jan 13 20:09:35.336020 containerd[1934]: time="2025-01-13T20:09:35.335962510Z" level=info msg="StopPodSandbox for \"6ca554906e8aff3cb9eab87b291894d187892c2a6910248683c6fe51f5efa9c4\"" Jan 13 20:09:35.336179 containerd[1934]: time="2025-01-13T20:09:35.336136234Z" level=info msg="TearDown network for sandbox \"6ca554906e8aff3cb9eab87b291894d187892c2a6910248683c6fe51f5efa9c4\" successfully" Jan 13 20:09:35.336179 containerd[1934]: time="2025-01-13T20:09:35.336159898Z" level=info msg="StopPodSandbox for \"6ca554906e8aff3cb9eab87b291894d187892c2a6910248683c6fe51f5efa9c4\" returns successfully" Jan 13 20:09:35.340046 containerd[1934]: time="2025-01-13T20:09:35.339014410Z" level=info msg="StopPodSandbox for \"dfb5cc6aa8ee548a0817f76e636f6ba17a9915fccdeb0f77deba61f58d7154ee\"" Jan 13 20:09:35.340046 containerd[1934]: time="2025-01-13T20:09:35.339192166Z" level=info msg="TearDown network for sandbox \"dfb5cc6aa8ee548a0817f76e636f6ba17a9915fccdeb0f77deba61f58d7154ee\" successfully" Jan 13 20:09:35.340046 containerd[1934]: time="2025-01-13T20:09:35.339218566Z" level=info msg="StopPodSandbox for \"dfb5cc6aa8ee548a0817f76e636f6ba17a9915fccdeb0f77deba61f58d7154ee\" returns successfully" Jan 13 20:09:35.342931 containerd[1934]: time="2025-01-13T20:09:35.342721342Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:csi-node-driver-wq54r,Uid:d47fc662-eff9-4473-83da-b6f0b896d81f,Namespace:calico-system,Attempt:10,}" Jan 13 20:09:35.343703 kubelet[3423]: I0113 20:09:35.343656 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="759f8831ea7d7e5c0dc8d9495100af5070a0a535616a4fce422e9b8c07fb0a84" Jan 13 20:09:35.346464 containerd[1934]: time="2025-01-13T20:09:35.345557026Z" level=info msg="StopPodSandbox for \"759f8831ea7d7e5c0dc8d9495100af5070a0a535616a4fce422e9b8c07fb0a84\"" Jan 13 20:09:35.346948 containerd[1934]: time="2025-01-13T20:09:35.346857982Z" level=info msg="Ensure that sandbox 759f8831ea7d7e5c0dc8d9495100af5070a0a535616a4fce422e9b8c07fb0a84 in task-service has been cleanup successfully" Jan 13 20:09:35.355262 containerd[1934]: time="2025-01-13T20:09:35.355198366Z" level=info msg="TearDown network for sandbox \"759f8831ea7d7e5c0dc8d9495100af5070a0a535616a4fce422e9b8c07fb0a84\" successfully" Jan 13 20:09:35.355262 containerd[1934]: time="2025-01-13T20:09:35.355250686Z" level=info msg="StopPodSandbox for \"759f8831ea7d7e5c0dc8d9495100af5070a0a535616a4fce422e9b8c07fb0a84\" returns successfully" Jan 13 20:09:35.357147 systemd[1]: run-netns-cni\x2d24e13c74\x2dc939\x2d5839\x2d0736\x2d35cfaa3953f2.mount: Deactivated successfully. Jan 13 20:09:35.361133 containerd[1934]: time="2025-01-13T20:09:35.359842498Z" level=info msg="StopPodSandbox for \"00e76c628c150112006f3b23d6e74781e4d42e1b9aecfc0a92d42b780e86d031\"" Jan 13 20:09:35.361133 containerd[1934]: time="2025-01-13T20:09:35.360030274Z" level=info msg="TearDown network for sandbox \"00e76c628c150112006f3b23d6e74781e4d42e1b9aecfc0a92d42b780e86d031\" successfully" Jan 13 20:09:35.361133 containerd[1934]: time="2025-01-13T20:09:35.360053950Z" level=info msg="StopPodSandbox for \"00e76c628c150112006f3b23d6e74781e4d42e1b9aecfc0a92d42b780e86d031\" returns successfully" Jan 13 20:09:35.364701 containerd[1934]: time="2025-01-13T20:09:35.364420078Z" level=info msg="StopPodSandbox for \"fe203c0f7fc44f83207d781bd972b7ee26dab60b101be6081c8e7f2c82858f26\"" Jan 13 20:09:35.366590 containerd[1934]: time="2025-01-13T20:09:35.366526186Z" level=info msg="TearDown network for sandbox \"fe203c0f7fc44f83207d781bd972b7ee26dab60b101be6081c8e7f2c82858f26\" successfully" Jan 13 20:09:35.366590 containerd[1934]: time="2025-01-13T20:09:35.366580318Z" level=info msg="StopPodSandbox for \"fe203c0f7fc44f83207d781bd972b7ee26dab60b101be6081c8e7f2c82858f26\" returns successfully" Jan 13 20:09:35.369702 containerd[1934]: time="2025-01-13T20:09:35.369617722Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-7fbffcd8cd-wszl7,Uid:ad79c041-eaf1-4d57-9fb4-c3fb08680cb8,Namespace:calico-apiserver,Attempt:9,}" Jan 13 20:09:35.370657 kubelet[3423]: I0113 20:09:35.370625 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8a99e8dc861e2951c12b20cfbc8fc211a864308d3e40d113adbf589f6bee301f" Jan 13 20:09:35.374267 containerd[1934]: time="2025-01-13T20:09:35.374201062Z" level=info msg="StopPodSandbox for \"8a99e8dc861e2951c12b20cfbc8fc211a864308d3e40d113adbf589f6bee301f\"" Jan 13 20:09:35.377951 containerd[1934]: time="2025-01-13T20:09:35.377881366Z" level=info msg="Ensure that sandbox 8a99e8dc861e2951c12b20cfbc8fc211a864308d3e40d113adbf589f6bee301f in task-service has been cleanup successfully" Jan 13 20:09:35.382925 containerd[1934]: time="2025-01-13T20:09:35.382865374Z" level=info msg="TearDown network for sandbox \"8a99e8dc861e2951c12b20cfbc8fc211a864308d3e40d113adbf589f6bee301f\" successfully" Jan 13 20:09:35.382925 containerd[1934]: time="2025-01-13T20:09:35.382911286Z" level=info msg="StopPodSandbox for \"8a99e8dc861e2951c12b20cfbc8fc211a864308d3e40d113adbf589f6bee301f\" returns successfully" Jan 13 20:09:35.389814 systemd[1]: run-netns-cni\x2d78df7c4a\x2df2d1\x2dd2a3\x2dc88e\x2d196456053be7.mount: Deactivated successfully. Jan 13 20:09:35.391141 containerd[1934]: time="2025-01-13T20:09:35.390989770Z" level=info msg="StopPodSandbox for \"0c85ca62eb94f4e10d7b4154d1085f14ea6b6363ce2b9a48f55a28836e3adb05\"" Jan 13 20:09:35.398247 containerd[1934]: time="2025-01-13T20:09:35.398181298Z" level=info msg="TearDown network for sandbox \"0c85ca62eb94f4e10d7b4154d1085f14ea6b6363ce2b9a48f55a28836e3adb05\" successfully" Jan 13 20:09:35.398247 containerd[1934]: time="2025-01-13T20:09:35.398236522Z" level=info msg="StopPodSandbox for \"0c85ca62eb94f4e10d7b4154d1085f14ea6b6363ce2b9a48f55a28836e3adb05\" returns successfully" Jan 13 20:09:35.400635 containerd[1934]: time="2025-01-13T20:09:35.400516234Z" level=info msg="StopPodSandbox for \"871bb94da403609229c4f8c4907a3c7c7ff537ef7b689806a251f0915d567eea\"" Jan 13 20:09:35.401487 containerd[1934]: time="2025-01-13T20:09:35.401082514Z" level=info msg="TearDown network for sandbox \"871bb94da403609229c4f8c4907a3c7c7ff537ef7b689806a251f0915d567eea\" successfully" Jan 13 20:09:35.401487 containerd[1934]: time="2025-01-13T20:09:35.401117482Z" level=info msg="StopPodSandbox for \"871bb94da403609229c4f8c4907a3c7c7ff537ef7b689806a251f0915d567eea\" returns successfully" Jan 13 20:09:35.401667 kubelet[3423]: I0113 20:09:35.401343 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b9dad2faee8703ada2153172211cd7c9c21998773d8f3d149c73e589c95a0df9" Jan 13 20:09:35.404087 containerd[1934]: time="2025-01-13T20:09:35.403358254Z" level=info msg="StopPodSandbox for \"b9dad2faee8703ada2153172211cd7c9c21998773d8f3d149c73e589c95a0df9\"" Jan 13 20:09:35.409410 containerd[1934]: time="2025-01-13T20:09:35.409325290Z" level=info msg="Ensure that sandbox b9dad2faee8703ada2153172211cd7c9c21998773d8f3d149c73e589c95a0df9 in task-service has been cleanup successfully" Jan 13 20:09:35.412301 containerd[1934]: time="2025-01-13T20:09:35.412227982Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-76f75df574-8wp6k,Uid:87115657-f395-40ec-89ea-3d7835119c3a,Namespace:kube-system,Attempt:9,}" Jan 13 20:09:35.415472 containerd[1934]: time="2025-01-13T20:09:35.415300810Z" level=info msg="TearDown network for sandbox \"b9dad2faee8703ada2153172211cd7c9c21998773d8f3d149c73e589c95a0df9\" successfully" Jan 13 20:09:35.415472 containerd[1934]: time="2025-01-13T20:09:35.415359322Z" level=info msg="StopPodSandbox for \"b9dad2faee8703ada2153172211cd7c9c21998773d8f3d149c73e589c95a0df9\" returns successfully" Jan 13 20:09:35.419803 containerd[1934]: time="2025-01-13T20:09:35.418390498Z" level=info msg="StopPodSandbox for \"e4f3782869a95e1724e7fed0918f96150403f3af79725f813cf600d13dab0323\"" Jan 13 20:09:35.421918 containerd[1934]: time="2025-01-13T20:09:35.421865230Z" level=info msg="TearDown network for sandbox \"e4f3782869a95e1724e7fed0918f96150403f3af79725f813cf600d13dab0323\" successfully" Jan 13 20:09:35.421918 containerd[1934]: time="2025-01-13T20:09:35.421912414Z" level=info msg="StopPodSandbox for \"e4f3782869a95e1724e7fed0918f96150403f3af79725f813cf600d13dab0323\" returns successfully" Jan 13 20:09:35.423909 containerd[1934]: time="2025-01-13T20:09:35.423711994Z" level=info msg="StopPodSandbox for \"4a448ddaae657a72707e2505e7b6329129c1ea98f60de221b826b6b205a6ff6b\"" Jan 13 20:09:35.424116 containerd[1934]: time="2025-01-13T20:09:35.423912514Z" level=info msg="TearDown network for sandbox \"4a448ddaae657a72707e2505e7b6329129c1ea98f60de221b826b6b205a6ff6b\" successfully" Jan 13 20:09:35.424116 containerd[1934]: time="2025-01-13T20:09:35.423937138Z" level=info msg="StopPodSandbox for \"4a448ddaae657a72707e2505e7b6329129c1ea98f60de221b826b6b205a6ff6b\" returns successfully" Jan 13 20:09:35.424116 containerd[1934]: time="2025-01-13T20:09:35.425280958Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-7fbffcd8cd-pxvdr,Uid:8f72f896-c0ba-4b07-9a22-acc5c8ca3697,Namespace:calico-apiserver,Attempt:9,}" Jan 13 20:09:35.424116 containerd[1934]: time="2025-01-13T20:09:35.425714674Z" level=info msg="StopPodSandbox for \"5cd26e99c4b74ae9d61483798457a99584070c404b0f9be16defa2c0bdb11350\"" Jan 13 20:09:35.424116 containerd[1934]: time="2025-01-13T20:09:35.426006682Z" level=info msg="Ensure that sandbox 5cd26e99c4b74ae9d61483798457a99584070c404b0f9be16defa2c0bdb11350 in task-service has been cleanup successfully" Jan 13 20:09:35.426669 containerd[1934]: time="2025-01-13T20:09:35.426440830Z" level=info msg="TearDown network for sandbox \"5cd26e99c4b74ae9d61483798457a99584070c404b0f9be16defa2c0bdb11350\" successfully" Jan 13 20:09:35.426669 containerd[1934]: time="2025-01-13T20:09:35.426472678Z" level=info msg="StopPodSandbox for \"5cd26e99c4b74ae9d61483798457a99584070c404b0f9be16defa2c0bdb11350\" returns successfully" Jan 13 20:09:35.426843 kubelet[3423]: I0113 20:09:35.424274 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5cd26e99c4b74ae9d61483798457a99584070c404b0f9be16defa2c0bdb11350" Jan 13 20:09:35.428849 containerd[1934]: time="2025-01-13T20:09:35.428390038Z" level=info msg="StopPodSandbox for \"caa6547227a1620b7a4197c3897d843edd199256b9961ceb916b76e9c94fcc3f\"" Jan 13 20:09:35.428849 containerd[1934]: time="2025-01-13T20:09:35.428600938Z" level=info msg="TearDown network for sandbox \"caa6547227a1620b7a4197c3897d843edd199256b9961ceb916b76e9c94fcc3f\" successfully" Jan 13 20:09:35.428849 containerd[1934]: time="2025-01-13T20:09:35.428625946Z" level=info msg="StopPodSandbox for \"caa6547227a1620b7a4197c3897d843edd199256b9961ceb916b76e9c94fcc3f\" returns successfully" Jan 13 20:09:35.431919 containerd[1934]: time="2025-01-13T20:09:35.431739646Z" level=info msg="StopPodSandbox for \"41f52017578a2719bea2c9934c17ea164adf7cb7d5ed2c0dd11787fd25b06487\"" Jan 13 20:09:35.432465 containerd[1934]: time="2025-01-13T20:09:35.432180502Z" level=info msg="TearDown network for sandbox \"41f52017578a2719bea2c9934c17ea164adf7cb7d5ed2c0dd11787fd25b06487\" successfully" Jan 13 20:09:35.432465 containerd[1934]: time="2025-01-13T20:09:35.432223018Z" level=info msg="StopPodSandbox for \"41f52017578a2719bea2c9934c17ea164adf7cb7d5ed2c0dd11787fd25b06487\" returns successfully" Jan 13 20:09:35.435015 containerd[1934]: time="2025-01-13T20:09:35.433985314Z" level=info msg="StopPodSandbox for \"4d3ce37a9c40510fd9d66de0b8c2ac5802b7067c8efb617b93564f6bfe5a5223\"" Jan 13 20:09:35.435520 containerd[1934]: time="2025-01-13T20:09:35.435439342Z" level=info msg="TearDown network for sandbox \"4d3ce37a9c40510fd9d66de0b8c2ac5802b7067c8efb617b93564f6bfe5a5223\" successfully" Jan 13 20:09:35.436264 containerd[1934]: time="2025-01-13T20:09:35.435475150Z" level=info msg="StopPodSandbox for \"4d3ce37a9c40510fd9d66de0b8c2ac5802b7067c8efb617b93564f6bfe5a5223\" returns successfully" Jan 13 20:09:35.437711 containerd[1934]: time="2025-01-13T20:09:35.437399638Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-kube-controllers-68f76c7ddf-lh8nj,Uid:2be21c11-9c2d-4b9a-81a5-0e73daba31c1,Namespace:calico-system,Attempt:10,}" Jan 13 20:09:35.586449 containerd[1934]: time="2025-01-13T20:09:35.586267835Z" level=error msg="Failed to destroy network for sandbox \"77152f189a6575845e406c6b88f4c5ab02cd6b3300ee242fe45d39a9e4f1b8a0\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:35.588653 containerd[1934]: time="2025-01-13T20:09:35.588256067Z" level=error msg="encountered an error cleaning up failed sandbox \"77152f189a6575845e406c6b88f4c5ab02cd6b3300ee242fe45d39a9e4f1b8a0\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:35.588653 containerd[1934]: time="2025-01-13T20:09:35.588359495Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-76f75df574-mkr2l,Uid:396e30c8-d221-410a-89fe-e353ba8cddbf,Namespace:kube-system,Attempt:9,} failed, error" error="failed to setup network for sandbox \"77152f189a6575845e406c6b88f4c5ab02cd6b3300ee242fe45d39a9e4f1b8a0\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:35.589993 kubelet[3423]: E0113 20:09:35.589833 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"77152f189a6575845e406c6b88f4c5ab02cd6b3300ee242fe45d39a9e4f1b8a0\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:35.589993 kubelet[3423]: E0113 20:09:35.589917 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"77152f189a6575845e406c6b88f4c5ab02cd6b3300ee242fe45d39a9e4f1b8a0\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-76f75df574-mkr2l" Jan 13 20:09:35.589993 kubelet[3423]: E0113 20:09:35.589955 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"77152f189a6575845e406c6b88f4c5ab02cd6b3300ee242fe45d39a9e4f1b8a0\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-76f75df574-mkr2l" Jan 13 20:09:35.591713 kubelet[3423]: E0113 20:09:35.591531 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-76f75df574-mkr2l_kube-system(396e30c8-d221-410a-89fe-e353ba8cddbf)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-76f75df574-mkr2l_kube-system(396e30c8-d221-410a-89fe-e353ba8cddbf)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"77152f189a6575845e406c6b88f4c5ab02cd6b3300ee242fe45d39a9e4f1b8a0\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="kube-system/coredns-76f75df574-mkr2l" podUID="396e30c8-d221-410a-89fe-e353ba8cddbf" Jan 13 20:09:36.006591 systemd[1]: run-netns-cni\x2de1d524eb\x2db69c\x2d02f1\x2d7aaa\x2d5a17c6d7c27a.mount: Deactivated successfully. Jan 13 20:09:36.006976 systemd[1]: run-netns-cni\x2d6dd9f109\x2ddfb5\x2d1643\x2d98c5\x2d26c7f04b075f.mount: Deactivated successfully. Jan 13 20:09:36.007221 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount2537323411.mount: Deactivated successfully. Jan 13 20:09:36.293074 containerd[1934]: time="2025-01-13T20:09:36.292929167Z" level=info msg="ImageCreate event name:\"ghcr.io/flatcar/calico/node:v3.29.1\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Jan 13 20:09:36.310744 containerd[1934]: time="2025-01-13T20:09:36.310578311Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/node:v3.29.1: active requests=0, bytes read=137671762" Jan 13 20:09:36.323805 containerd[1934]: time="2025-01-13T20:09:36.323169659Z" level=info msg="ImageCreate event name:\"sha256:680b8c280812d12c035ca9f0deedea7c761afe0f1cc65109ea2f96bf63801758\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Jan 13 20:09:36.361931 containerd[1934]: time="2025-01-13T20:09:36.361861247Z" level=info msg="ImageCreate event name:\"ghcr.io/flatcar/calico/node@sha256:99c3917516efe1f807a0cfdf2d14b628b7c5cc6bd8a9ee5a253154f31756bea1\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Jan 13 20:09:36.365810 containerd[1934]: time="2025-01-13T20:09:36.365732339Z" level=info msg="Pulled image \"ghcr.io/flatcar/calico/node:v3.29.1\" with image id \"sha256:680b8c280812d12c035ca9f0deedea7c761afe0f1cc65109ea2f96bf63801758\", repo tag \"ghcr.io/flatcar/calico/node:v3.29.1\", repo digest \"ghcr.io/flatcar/calico/node@sha256:99c3917516efe1f807a0cfdf2d14b628b7c5cc6bd8a9ee5a253154f31756bea1\", size \"137671624\" in 14.259726215s" Jan 13 20:09:36.366151 containerd[1934]: time="2025-01-13T20:09:36.366106019Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/node:v3.29.1\" returns image reference \"sha256:680b8c280812d12c035ca9f0deedea7c761afe0f1cc65109ea2f96bf63801758\"" Jan 13 20:09:36.463804 kubelet[3423]: I0113 20:09:36.462477 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="77152f189a6575845e406c6b88f4c5ab02cd6b3300ee242fe45d39a9e4f1b8a0" Jan 13 20:09:36.467506 containerd[1934]: time="2025-01-13T20:09:36.465962844Z" level=info msg="StopPodSandbox for \"77152f189a6575845e406c6b88f4c5ab02cd6b3300ee242fe45d39a9e4f1b8a0\"" Jan 13 20:09:36.467506 containerd[1934]: time="2025-01-13T20:09:36.465975072Z" level=info msg="CreateContainer within sandbox \"1da5f8e217f8d8914413b2f1e2f6fc0151b465145dd0ee54001de8e77e8df94b\" for container &ContainerMetadata{Name:calico-node,Attempt:0,}" Jan 13 20:09:36.470730 containerd[1934]: time="2025-01-13T20:09:36.470656584Z" level=info msg="Ensure that sandbox 77152f189a6575845e406c6b88f4c5ab02cd6b3300ee242fe45d39a9e4f1b8a0 in task-service has been cleanup successfully" Jan 13 20:09:36.482203 containerd[1934]: time="2025-01-13T20:09:36.480425544Z" level=info msg="TearDown network for sandbox \"77152f189a6575845e406c6b88f4c5ab02cd6b3300ee242fe45d39a9e4f1b8a0\" successfully" Jan 13 20:09:36.485213 containerd[1934]: time="2025-01-13T20:09:36.482200596Z" level=info msg="StopPodSandbox for \"77152f189a6575845e406c6b88f4c5ab02cd6b3300ee242fe45d39a9e4f1b8a0\" returns successfully" Jan 13 20:09:36.487470 containerd[1934]: time="2025-01-13T20:09:36.487151004Z" level=info msg="StopPodSandbox for \"7923d55515294cf3728cfef254022ed5f094d697790fafcc5064fca07c9e6e58\"" Jan 13 20:09:36.487470 containerd[1934]: time="2025-01-13T20:09:36.487313220Z" level=info msg="TearDown network for sandbox \"7923d55515294cf3728cfef254022ed5f094d697790fafcc5064fca07c9e6e58\" successfully" Jan 13 20:09:36.487470 containerd[1934]: time="2025-01-13T20:09:36.487353228Z" level=info msg="StopPodSandbox for \"7923d55515294cf3728cfef254022ed5f094d697790fafcc5064fca07c9e6e58\" returns successfully" Jan 13 20:09:36.499142 containerd[1934]: time="2025-01-13T20:09:36.499092768Z" level=info msg="StopPodSandbox for \"5eeccd24bcd272ceac794541253f4c8a557a6e36ba0959e6db5a98b61fca47a2\"" Jan 13 20:09:36.499657 containerd[1934]: time="2025-01-13T20:09:36.499473192Z" level=info msg="TearDown network for sandbox \"5eeccd24bcd272ceac794541253f4c8a557a6e36ba0959e6db5a98b61fca47a2\" successfully" Jan 13 20:09:36.499657 containerd[1934]: time="2025-01-13T20:09:36.499514196Z" level=info msg="StopPodSandbox for \"5eeccd24bcd272ceac794541253f4c8a557a6e36ba0959e6db5a98b61fca47a2\" returns successfully" Jan 13 20:09:36.504386 containerd[1934]: time="2025-01-13T20:09:36.504069228Z" level=info msg="StopPodSandbox for \"2f9666670aab61aa1c36a5c18b2c6e8e3d08bf1cfc3f42fb8cc1ef7244f4257c\"" Jan 13 20:09:36.504386 containerd[1934]: time="2025-01-13T20:09:36.504246372Z" level=info msg="TearDown network for sandbox \"2f9666670aab61aa1c36a5c18b2c6e8e3d08bf1cfc3f42fb8cc1ef7244f4257c\" successfully" Jan 13 20:09:36.504386 containerd[1934]: time="2025-01-13T20:09:36.504268488Z" level=info msg="StopPodSandbox for \"2f9666670aab61aa1c36a5c18b2c6e8e3d08bf1cfc3f42fb8cc1ef7244f4257c\" returns successfully" Jan 13 20:09:36.518437 containerd[1934]: time="2025-01-13T20:09:36.518082960Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-76f75df574-mkr2l,Uid:396e30c8-d221-410a-89fe-e353ba8cddbf,Namespace:kube-system,Attempt:10,}" Jan 13 20:09:36.640473 containerd[1934]: time="2025-01-13T20:09:36.640066080Z" level=info msg="CreateContainer within sandbox \"1da5f8e217f8d8914413b2f1e2f6fc0151b465145dd0ee54001de8e77e8df94b\" for &ContainerMetadata{Name:calico-node,Attempt:0,} returns container id \"9c4eed7d481a9f7fa2fbae3f8f85b6c61e0f9353ac5d4029b762a08ba1bff870\"" Jan 13 20:09:36.643503 containerd[1934]: time="2025-01-13T20:09:36.643437168Z" level=info msg="StartContainer for \"9c4eed7d481a9f7fa2fbae3f8f85b6c61e0f9353ac5d4029b762a08ba1bff870\"" Jan 13 20:09:36.767765 containerd[1934]: time="2025-01-13T20:09:36.767631685Z" level=error msg="Failed to destroy network for sandbox \"67fcc7567928ea411025d344ddf2c1047093ecdfa4752e1c7d8144d30ac99273\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:36.770867 containerd[1934]: time="2025-01-13T20:09:36.769500577Z" level=error msg="encountered an error cleaning up failed sandbox \"67fcc7567928ea411025d344ddf2c1047093ecdfa4752e1c7d8144d30ac99273\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:36.770867 containerd[1934]: time="2025-01-13T20:09:36.769606057Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:csi-node-driver-wq54r,Uid:d47fc662-eff9-4473-83da-b6f0b896d81f,Namespace:calico-system,Attempt:10,} failed, error" error="failed to setup network for sandbox \"67fcc7567928ea411025d344ddf2c1047093ecdfa4752e1c7d8144d30ac99273\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:36.771144 kubelet[3423]: E0113 20:09:36.770223 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"67fcc7567928ea411025d344ddf2c1047093ecdfa4752e1c7d8144d30ac99273\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:36.771144 kubelet[3423]: E0113 20:09:36.770301 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"67fcc7567928ea411025d344ddf2c1047093ecdfa4752e1c7d8144d30ac99273\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/csi-node-driver-wq54r" Jan 13 20:09:36.771144 kubelet[3423]: E0113 20:09:36.770340 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"67fcc7567928ea411025d344ddf2c1047093ecdfa4752e1c7d8144d30ac99273\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/csi-node-driver-wq54r" Jan 13 20:09:36.771468 kubelet[3423]: E0113 20:09:36.770421 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"csi-node-driver-wq54r_calico-system(d47fc662-eff9-4473-83da-b6f0b896d81f)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"csi-node-driver-wq54r_calico-system(d47fc662-eff9-4473-83da-b6f0b896d81f)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"67fcc7567928ea411025d344ddf2c1047093ecdfa4752e1c7d8144d30ac99273\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-system/csi-node-driver-wq54r" podUID="d47fc662-eff9-4473-83da-b6f0b896d81f" Jan 13 20:09:36.892194 systemd[1]: Started cri-containerd-9c4eed7d481a9f7fa2fbae3f8f85b6c61e0f9353ac5d4029b762a08ba1bff870.scope - libcontainer container 9c4eed7d481a9f7fa2fbae3f8f85b6c61e0f9353ac5d4029b762a08ba1bff870. Jan 13 20:09:36.909813 containerd[1934]: time="2025-01-13T20:09:36.909716834Z" level=error msg="Failed to destroy network for sandbox \"4ac0c7a43c6ee6bd4379d05f01c7bbee6cac7bc86c5982e2f97659e6e018f24c\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:36.918946 containerd[1934]: time="2025-01-13T20:09:36.918860834Z" level=error msg="encountered an error cleaning up failed sandbox \"4ac0c7a43c6ee6bd4379d05f01c7bbee6cac7bc86c5982e2f97659e6e018f24c\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:36.920478 containerd[1934]: time="2025-01-13T20:09:36.920052146Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-7fbffcd8cd-wszl7,Uid:ad79c041-eaf1-4d57-9fb4-c3fb08680cb8,Namespace:calico-apiserver,Attempt:9,} failed, error" error="failed to setup network for sandbox \"4ac0c7a43c6ee6bd4379d05f01c7bbee6cac7bc86c5982e2f97659e6e018f24c\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:36.920748 kubelet[3423]: E0113 20:09:36.920636 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"4ac0c7a43c6ee6bd4379d05f01c7bbee6cac7bc86c5982e2f97659e6e018f24c\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:36.920748 kubelet[3423]: E0113 20:09:36.920733 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"4ac0c7a43c6ee6bd4379d05f01c7bbee6cac7bc86c5982e2f97659e6e018f24c\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-wszl7" Jan 13 20:09:36.920949 kubelet[3423]: E0113 20:09:36.920821 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"4ac0c7a43c6ee6bd4379d05f01c7bbee6cac7bc86c5982e2f97659e6e018f24c\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-wszl7" Jan 13 20:09:36.923197 kubelet[3423]: E0113 20:09:36.921047 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"calico-apiserver-7fbffcd8cd-wszl7_calico-apiserver(ad79c041-eaf1-4d57-9fb4-c3fb08680cb8)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"calico-apiserver-7fbffcd8cd-wszl7_calico-apiserver(ad79c041-eaf1-4d57-9fb4-c3fb08680cb8)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"4ac0c7a43c6ee6bd4379d05f01c7bbee6cac7bc86c5982e2f97659e6e018f24c\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-wszl7" podUID="ad79c041-eaf1-4d57-9fb4-c3fb08680cb8" Jan 13 20:09:36.978628 containerd[1934]: time="2025-01-13T20:09:36.978158534Z" level=error msg="Failed to destroy network for sandbox \"f61266732570b1ffd19ff06a0bf2f4eddbc7ebeabca7bbec643cd8ab64f4d6bb\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:36.981797 containerd[1934]: time="2025-01-13T20:09:36.980890898Z" level=error msg="encountered an error cleaning up failed sandbox \"f61266732570b1ffd19ff06a0bf2f4eddbc7ebeabca7bbec643cd8ab64f4d6bb\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:36.982758 containerd[1934]: time="2025-01-13T20:09:36.982296338Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-7fbffcd8cd-pxvdr,Uid:8f72f896-c0ba-4b07-9a22-acc5c8ca3697,Namespace:calico-apiserver,Attempt:9,} failed, error" error="failed to setup network for sandbox \"f61266732570b1ffd19ff06a0bf2f4eddbc7ebeabca7bbec643cd8ab64f4d6bb\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:36.984330 kubelet[3423]: E0113 20:09:36.984208 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"f61266732570b1ffd19ff06a0bf2f4eddbc7ebeabca7bbec643cd8ab64f4d6bb\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:36.986264 kubelet[3423]: E0113 20:09:36.984943 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"f61266732570b1ffd19ff06a0bf2f4eddbc7ebeabca7bbec643cd8ab64f4d6bb\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-pxvdr" Jan 13 20:09:36.986264 kubelet[3423]: E0113 20:09:36.985007 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"f61266732570b1ffd19ff06a0bf2f4eddbc7ebeabca7bbec643cd8ab64f4d6bb\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-pxvdr" Jan 13 20:09:36.986264 kubelet[3423]: E0113 20:09:36.985102 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"calico-apiserver-7fbffcd8cd-pxvdr_calico-apiserver(8f72f896-c0ba-4b07-9a22-acc5c8ca3697)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"calico-apiserver-7fbffcd8cd-pxvdr_calico-apiserver(8f72f896-c0ba-4b07-9a22-acc5c8ca3697)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"f61266732570b1ffd19ff06a0bf2f4eddbc7ebeabca7bbec643cd8ab64f4d6bb\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-pxvdr" podUID="8f72f896-c0ba-4b07-9a22-acc5c8ca3697" Jan 13 20:09:37.040908 containerd[1934]: time="2025-01-13T20:09:37.040131346Z" level=error msg="Failed to destroy network for sandbox \"c5843741cfbc56669be6f2c02c9dc5041d7f20ca6acda74c9a7725511ea41cc7\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:37.043811 containerd[1934]: time="2025-01-13T20:09:37.043125274Z" level=error msg="encountered an error cleaning up failed sandbox \"c5843741cfbc56669be6f2c02c9dc5041d7f20ca6acda74c9a7725511ea41cc7\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:37.043811 containerd[1934]: time="2025-01-13T20:09:37.043243246Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-kube-controllers-68f76c7ddf-lh8nj,Uid:2be21c11-9c2d-4b9a-81a5-0e73daba31c1,Namespace:calico-system,Attempt:10,} failed, error" error="failed to setup network for sandbox \"c5843741cfbc56669be6f2c02c9dc5041d7f20ca6acda74c9a7725511ea41cc7\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:37.048162 kubelet[3423]: E0113 20:09:37.045411 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"c5843741cfbc56669be6f2c02c9dc5041d7f20ca6acda74c9a7725511ea41cc7\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:37.048162 kubelet[3423]: E0113 20:09:37.045493 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"c5843741cfbc56669be6f2c02c9dc5041d7f20ca6acda74c9a7725511ea41cc7\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/calico-kube-controllers-68f76c7ddf-lh8nj" Jan 13 20:09:37.048162 kubelet[3423]: E0113 20:09:37.045532 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"c5843741cfbc56669be6f2c02c9dc5041d7f20ca6acda74c9a7725511ea41cc7\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="calico-system/calico-kube-controllers-68f76c7ddf-lh8nj" Jan 13 20:09:37.048507 kubelet[3423]: E0113 20:09:37.045621 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"calico-kube-controllers-68f76c7ddf-lh8nj_calico-system(2be21c11-9c2d-4b9a-81a5-0e73daba31c1)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"calico-kube-controllers-68f76c7ddf-lh8nj_calico-system(2be21c11-9c2d-4b9a-81a5-0e73daba31c1)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"c5843741cfbc56669be6f2c02c9dc5041d7f20ca6acda74c9a7725511ea41cc7\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="calico-system/calico-kube-controllers-68f76c7ddf-lh8nj" podUID="2be21c11-9c2d-4b9a-81a5-0e73daba31c1" Jan 13 20:09:37.049111 containerd[1934]: time="2025-01-13T20:09:37.048768046Z" level=error msg="Failed to destroy network for sandbox \"d7e007aaa7201b1cd3bba3d23f191a2156d907bb777d56434218f91e8693db69\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:37.051667 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-4ac0c7a43c6ee6bd4379d05f01c7bbee6cac7bc86c5982e2f97659e6e018f24c-shm.mount: Deactivated successfully. Jan 13 20:09:37.053505 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-67fcc7567928ea411025d344ddf2c1047093ecdfa4752e1c7d8144d30ac99273-shm.mount: Deactivated successfully. Jan 13 20:09:37.053678 systemd[1]: run-netns-cni\x2d0f517d55\x2d0002\x2d2ec9\x2d7f70\x2df0999d7895b1.mount: Deactivated successfully. Jan 13 20:09:37.055723 containerd[1934]: time="2025-01-13T20:09:37.054647590Z" level=error msg="encountered an error cleaning up failed sandbox \"d7e007aaa7201b1cd3bba3d23f191a2156d907bb777d56434218f91e8693db69\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:37.055723 containerd[1934]: time="2025-01-13T20:09:37.054765286Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-76f75df574-8wp6k,Uid:87115657-f395-40ec-89ea-3d7835119c3a,Namespace:kube-system,Attempt:9,} failed, error" error="failed to setup network for sandbox \"d7e007aaa7201b1cd3bba3d23f191a2156d907bb777d56434218f91e8693db69\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:37.057619 kubelet[3423]: E0113 20:09:37.057234 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"d7e007aaa7201b1cd3bba3d23f191a2156d907bb777d56434218f91e8693db69\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:37.057619 kubelet[3423]: E0113 20:09:37.057318 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"d7e007aaa7201b1cd3bba3d23f191a2156d907bb777d56434218f91e8693db69\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-76f75df574-8wp6k" Jan 13 20:09:37.057619 kubelet[3423]: E0113 20:09:37.057362 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"d7e007aaa7201b1cd3bba3d23f191a2156d907bb777d56434218f91e8693db69\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-76f75df574-8wp6k" Jan 13 20:09:37.058420 kubelet[3423]: E0113 20:09:37.057453 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-76f75df574-8wp6k_kube-system(87115657-f395-40ec-89ea-3d7835119c3a)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-76f75df574-8wp6k_kube-system(87115657-f395-40ec-89ea-3d7835119c3a)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"d7e007aaa7201b1cd3bba3d23f191a2156d907bb777d56434218f91e8693db69\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="kube-system/coredns-76f75df574-8wp6k" podUID="87115657-f395-40ec-89ea-3d7835119c3a" Jan 13 20:09:37.074841 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-c5843741cfbc56669be6f2c02c9dc5041d7f20ca6acda74c9a7725511ea41cc7-shm.mount: Deactivated successfully. Jan 13 20:09:37.075072 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-d7e007aaa7201b1cd3bba3d23f191a2156d907bb777d56434218f91e8693db69-shm.mount: Deactivated successfully. Jan 13 20:09:37.128588 containerd[1934]: time="2025-01-13T20:09:37.128482991Z" level=error msg="Failed to destroy network for sandbox \"dec83f53d2791c9f727bb49f34c2c033d903e826c66acd0aceb404182efb08ed\"" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:37.133428 containerd[1934]: time="2025-01-13T20:09:37.132893339Z" level=error msg="encountered an error cleaning up failed sandbox \"dec83f53d2791c9f727bb49f34c2c033d903e826c66acd0aceb404182efb08ed\", marking sandbox state as SANDBOX_UNKNOWN" error="plugin type=\"calico\" failed (delete): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:37.134023 containerd[1934]: time="2025-01-13T20:09:37.133947143Z" level=error msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-76f75df574-mkr2l,Uid:396e30c8-d221-410a-89fe-e353ba8cddbf,Namespace:kube-system,Attempt:10,} failed, error" error="failed to setup network for sandbox \"dec83f53d2791c9f727bb49f34c2c033d903e826c66acd0aceb404182efb08ed\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:37.134657 kubelet[3423]: E0113 20:09:37.134342 3423 remote_runtime.go:193] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"dec83f53d2791c9f727bb49f34c2c033d903e826c66acd0aceb404182efb08ed\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" Jan 13 20:09:37.136813 kubelet[3423]: E0113 20:09:37.135313 3423 kuberuntime_sandbox.go:72] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"dec83f53d2791c9f727bb49f34c2c033d903e826c66acd0aceb404182efb08ed\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-76f75df574-mkr2l" Jan 13 20:09:37.136813 kubelet[3423]: E0113 20:09:37.135386 3423 kuberuntime_manager.go:1172] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"dec83f53d2791c9f727bb49f34c2c033d903e826c66acd0aceb404182efb08ed\": plugin type=\"calico\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/" pod="kube-system/coredns-76f75df574-mkr2l" Jan 13 20:09:37.136813 kubelet[3423]: E0113 20:09:37.135489 3423 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-76f75df574-mkr2l_kube-system(396e30c8-d221-410a-89fe-e353ba8cddbf)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-76f75df574-mkr2l_kube-system(396e30c8-d221-410a-89fe-e353ba8cddbf)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"dec83f53d2791c9f727bb49f34c2c033d903e826c66acd0aceb404182efb08ed\\\": plugin type=\\\"calico\\\" failed (add): stat /var/lib/calico/nodename: no such file or directory: check that the calico/node container is running and has mounted /var/lib/calico/\"" pod="kube-system/coredns-76f75df574-mkr2l" podUID="396e30c8-d221-410a-89fe-e353ba8cddbf" Jan 13 20:09:37.139412 containerd[1934]: time="2025-01-13T20:09:37.139297739Z" level=info msg="StartContainer for \"9c4eed7d481a9f7fa2fbae3f8f85b6c61e0f9353ac5d4029b762a08ba1bff870\" returns successfully" Jan 13 20:09:37.141947 systemd[1]: run-containerd-io.containerd.grpc.v1.cri-sandboxes-dec83f53d2791c9f727bb49f34c2c033d903e826c66acd0aceb404182efb08ed-shm.mount: Deactivated successfully. Jan 13 20:09:37.327405 kernel: wireguard: WireGuard 1.0.0 loaded. See www.wireguard.com for information. Jan 13 20:09:37.327564 kernel: wireguard: Copyright (C) 2015-2019 Jason A. Donenfeld . All Rights Reserved. Jan 13 20:09:37.472808 kubelet[3423]: I0113 20:09:37.472730 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4ac0c7a43c6ee6bd4379d05f01c7bbee6cac7bc86c5982e2f97659e6e018f24c" Jan 13 20:09:37.481042 containerd[1934]: time="2025-01-13T20:09:37.477030613Z" level=info msg="StopPodSandbox for \"4ac0c7a43c6ee6bd4379d05f01c7bbee6cac7bc86c5982e2f97659e6e018f24c\"" Jan 13 20:09:37.481042 containerd[1934]: time="2025-01-13T20:09:37.477320509Z" level=info msg="Ensure that sandbox 4ac0c7a43c6ee6bd4379d05f01c7bbee6cac7bc86c5982e2f97659e6e018f24c in task-service has been cleanup successfully" Jan 13 20:09:37.481042 containerd[1934]: time="2025-01-13T20:09:37.479895601Z" level=info msg="TearDown network for sandbox \"4ac0c7a43c6ee6bd4379d05f01c7bbee6cac7bc86c5982e2f97659e6e018f24c\" successfully" Jan 13 20:09:37.481042 containerd[1934]: time="2025-01-13T20:09:37.479939533Z" level=info msg="StopPodSandbox for \"4ac0c7a43c6ee6bd4379d05f01c7bbee6cac7bc86c5982e2f97659e6e018f24c\" returns successfully" Jan 13 20:09:37.485700 containerd[1934]: time="2025-01-13T20:09:37.483523381Z" level=info msg="StopPodSandbox for \"759f8831ea7d7e5c0dc8d9495100af5070a0a535616a4fce422e9b8c07fb0a84\"" Jan 13 20:09:37.485700 containerd[1934]: time="2025-01-13T20:09:37.483912241Z" level=info msg="TearDown network for sandbox \"759f8831ea7d7e5c0dc8d9495100af5070a0a535616a4fce422e9b8c07fb0a84\" successfully" Jan 13 20:09:37.485700 containerd[1934]: time="2025-01-13T20:09:37.483942697Z" level=info msg="StopPodSandbox for \"759f8831ea7d7e5c0dc8d9495100af5070a0a535616a4fce422e9b8c07fb0a84\" returns successfully" Jan 13 20:09:37.487609 containerd[1934]: time="2025-01-13T20:09:37.487545001Z" level=info msg="StopPodSandbox for \"00e76c628c150112006f3b23d6e74781e4d42e1b9aecfc0a92d42b780e86d031\"" Jan 13 20:09:37.487750 containerd[1934]: time="2025-01-13T20:09:37.487716013Z" level=info msg="TearDown network for sandbox \"00e76c628c150112006f3b23d6e74781e4d42e1b9aecfc0a92d42b780e86d031\" successfully" Jan 13 20:09:37.487750 containerd[1934]: time="2025-01-13T20:09:37.487738657Z" level=info msg="StopPodSandbox for \"00e76c628c150112006f3b23d6e74781e4d42e1b9aecfc0a92d42b780e86d031\" returns successfully" Jan 13 20:09:37.490300 containerd[1934]: time="2025-01-13T20:09:37.490153717Z" level=info msg="StopPodSandbox for \"fe203c0f7fc44f83207d781bd972b7ee26dab60b101be6081c8e7f2c82858f26\"" Jan 13 20:09:37.490631 containerd[1934]: time="2025-01-13T20:09:37.490327153Z" level=info msg="TearDown network for sandbox \"fe203c0f7fc44f83207d781bd972b7ee26dab60b101be6081c8e7f2c82858f26\" successfully" Jan 13 20:09:37.490631 containerd[1934]: time="2025-01-13T20:09:37.490350973Z" level=info msg="StopPodSandbox for \"fe203c0f7fc44f83207d781bd972b7ee26dab60b101be6081c8e7f2c82858f26\" returns successfully" Jan 13 20:09:37.492009 kubelet[3423]: I0113 20:09:37.491747 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d7e007aaa7201b1cd3bba3d23f191a2156d907bb777d56434218f91e8693db69" Jan 13 20:09:37.493418 containerd[1934]: time="2025-01-13T20:09:37.491638477Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-7fbffcd8cd-wszl7,Uid:ad79c041-eaf1-4d57-9fb4-c3fb08680cb8,Namespace:calico-apiserver,Attempt:10,}" Jan 13 20:09:37.497500 systemd[1]: run-netns-cni\x2d4eaeb0ca\x2d3d92\x2d4d00\x2df1f5\x2d9fd0cf88d80d.mount: Deactivated successfully. Jan 13 20:09:37.498612 containerd[1934]: time="2025-01-13T20:09:37.498500413Z" level=info msg="StopPodSandbox for \"d7e007aaa7201b1cd3bba3d23f191a2156d907bb777d56434218f91e8693db69\"" Jan 13 20:09:37.499147 containerd[1934]: time="2025-01-13T20:09:37.498834853Z" level=info msg="Ensure that sandbox d7e007aaa7201b1cd3bba3d23f191a2156d907bb777d56434218f91e8693db69 in task-service has been cleanup successfully" Jan 13 20:09:37.505350 containerd[1934]: time="2025-01-13T20:09:37.505275733Z" level=info msg="TearDown network for sandbox \"d7e007aaa7201b1cd3bba3d23f191a2156d907bb777d56434218f91e8693db69\" successfully" Jan 13 20:09:37.505350 containerd[1934]: time="2025-01-13T20:09:37.505341325Z" level=info msg="StopPodSandbox for \"d7e007aaa7201b1cd3bba3d23f191a2156d907bb777d56434218f91e8693db69\" returns successfully" Jan 13 20:09:37.510978 containerd[1934]: time="2025-01-13T20:09:37.508872925Z" level=info msg="StopPodSandbox for \"8a99e8dc861e2951c12b20cfbc8fc211a864308d3e40d113adbf589f6bee301f\"" Jan 13 20:09:37.510978 containerd[1934]: time="2025-01-13T20:09:37.509403385Z" level=info msg="TearDown network for sandbox \"8a99e8dc861e2951c12b20cfbc8fc211a864308d3e40d113adbf589f6bee301f\" successfully" Jan 13 20:09:37.510978 containerd[1934]: time="2025-01-13T20:09:37.509627749Z" level=info msg="StopPodSandbox for \"8a99e8dc861e2951c12b20cfbc8fc211a864308d3e40d113adbf589f6bee301f\" returns successfully" Jan 13 20:09:37.509594 systemd[1]: run-netns-cni\x2dc73df507\x2d8ffd\x2d2470\x2dd549\x2d5c29b0f5a1f8.mount: Deactivated successfully. Jan 13 20:09:37.516075 containerd[1934]: time="2025-01-13T20:09:37.516007837Z" level=info msg="StopPodSandbox for \"0c85ca62eb94f4e10d7b4154d1085f14ea6b6363ce2b9a48f55a28836e3adb05\"" Jan 13 20:09:37.516685 containerd[1934]: time="2025-01-13T20:09:37.516189373Z" level=info msg="TearDown network for sandbox \"0c85ca62eb94f4e10d7b4154d1085f14ea6b6363ce2b9a48f55a28836e3adb05\" successfully" Jan 13 20:09:37.516685 containerd[1934]: time="2025-01-13T20:09:37.516222505Z" level=info msg="StopPodSandbox for \"0c85ca62eb94f4e10d7b4154d1085f14ea6b6363ce2b9a48f55a28836e3adb05\" returns successfully" Jan 13 20:09:37.520575 containerd[1934]: time="2025-01-13T20:09:37.520337617Z" level=info msg="StopPodSandbox for \"871bb94da403609229c4f8c4907a3c7c7ff537ef7b689806a251f0915d567eea\"" Jan 13 20:09:37.521302 containerd[1934]: time="2025-01-13T20:09:37.521242993Z" level=info msg="TearDown network for sandbox \"871bb94da403609229c4f8c4907a3c7c7ff537ef7b689806a251f0915d567eea\" successfully" Jan 13 20:09:37.523925 containerd[1934]: time="2025-01-13T20:09:37.521292721Z" level=info msg="StopPodSandbox for \"871bb94da403609229c4f8c4907a3c7c7ff537ef7b689806a251f0915d567eea\" returns successfully" Jan 13 20:09:37.523925 containerd[1934]: time="2025-01-13T20:09:37.523286389Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-76f75df574-8wp6k,Uid:87115657-f395-40ec-89ea-3d7835119c3a,Namespace:kube-system,Attempt:10,}" Jan 13 20:09:37.527707 systemd[1]: Started sshd@13-172.31.28.23:22-147.75.109.163:40684.service - OpenSSH per-connection server daemon (147.75.109.163:40684). Jan 13 20:09:37.560224 kubelet[3423]: I0113 20:09:37.559756 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f61266732570b1ffd19ff06a0bf2f4eddbc7ebeabca7bbec643cd8ab64f4d6bb" Jan 13 20:09:37.566198 containerd[1934]: time="2025-01-13T20:09:37.566140801Z" level=info msg="StopPodSandbox for \"f61266732570b1ffd19ff06a0bf2f4eddbc7ebeabca7bbec643cd8ab64f4d6bb\"" Jan 13 20:09:37.566667 containerd[1934]: time="2025-01-13T20:09:37.566630713Z" level=info msg="Ensure that sandbox f61266732570b1ffd19ff06a0bf2f4eddbc7ebeabca7bbec643cd8ab64f4d6bb in task-service has been cleanup successfully" Jan 13 20:09:37.571170 containerd[1934]: time="2025-01-13T20:09:37.571045165Z" level=info msg="TearDown network for sandbox \"f61266732570b1ffd19ff06a0bf2f4eddbc7ebeabca7bbec643cd8ab64f4d6bb\" successfully" Jan 13 20:09:37.571429 containerd[1934]: time="2025-01-13T20:09:37.571397329Z" level=info msg="StopPodSandbox for \"f61266732570b1ffd19ff06a0bf2f4eddbc7ebeabca7bbec643cd8ab64f4d6bb\" returns successfully" Jan 13 20:09:37.573420 containerd[1934]: time="2025-01-13T20:09:37.573367405Z" level=info msg="StopPodSandbox for \"b9dad2faee8703ada2153172211cd7c9c21998773d8f3d149c73e589c95a0df9\"" Jan 13 20:09:37.574480 containerd[1934]: time="2025-01-13T20:09:37.574324837Z" level=info msg="TearDown network for sandbox \"b9dad2faee8703ada2153172211cd7c9c21998773d8f3d149c73e589c95a0df9\" successfully" Jan 13 20:09:37.574480 containerd[1934]: time="2025-01-13T20:09:37.574367329Z" level=info msg="StopPodSandbox for \"b9dad2faee8703ada2153172211cd7c9c21998773d8f3d149c73e589c95a0df9\" returns successfully" Jan 13 20:09:37.575757 containerd[1934]: time="2025-01-13T20:09:37.575513629Z" level=info msg="StopPodSandbox for \"e4f3782869a95e1724e7fed0918f96150403f3af79725f813cf600d13dab0323\"" Jan 13 20:09:37.577969 containerd[1934]: time="2025-01-13T20:09:37.576599581Z" level=info msg="TearDown network for sandbox \"e4f3782869a95e1724e7fed0918f96150403f3af79725f813cf600d13dab0323\" successfully" Jan 13 20:09:37.580756 containerd[1934]: time="2025-01-13T20:09:37.580689421Z" level=info msg="StopPodSandbox for \"e4f3782869a95e1724e7fed0918f96150403f3af79725f813cf600d13dab0323\" returns successfully" Jan 13 20:09:37.589530 containerd[1934]: time="2025-01-13T20:09:37.589478929Z" level=info msg="StopPodSandbox for \"4a448ddaae657a72707e2505e7b6329129c1ea98f60de221b826b6b205a6ff6b\"" Jan 13 20:09:37.589891 containerd[1934]: time="2025-01-13T20:09:37.589857853Z" level=info msg="TearDown network for sandbox \"4a448ddaae657a72707e2505e7b6329129c1ea98f60de221b826b6b205a6ff6b\" successfully" Jan 13 20:09:37.590152 containerd[1934]: time="2025-01-13T20:09:37.590081545Z" level=info msg="StopPodSandbox for \"4a448ddaae657a72707e2505e7b6329129c1ea98f60de221b826b6b205a6ff6b\" returns successfully" Jan 13 20:09:37.610260 kubelet[3423]: I0113 20:09:37.609579 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c5843741cfbc56669be6f2c02c9dc5041d7f20ca6acda74c9a7725511ea41cc7" Jan 13 20:09:37.614859 kubelet[3423]: I0113 20:09:37.609257 3423 pod_startup_latency_tracker.go:102] "Observed pod startup duration" pod="calico-system/calico-node-mwzfc" podStartSLOduration=2.204343495 podStartE2EDuration="31.606651697s" podCreationTimestamp="2025-01-13 20:09:06 +0000 UTC" firstStartedPulling="2025-01-13 20:09:06.966034101 +0000 UTC m=+35.371615593" lastFinishedPulling="2025-01-13 20:09:36.368342315 +0000 UTC m=+64.773923795" observedRunningTime="2025-01-13 20:09:37.603349237 +0000 UTC m=+66.008930729" watchObservedRunningTime="2025-01-13 20:09:37.606651697 +0000 UTC m=+66.012233201" Jan 13 20:09:37.627295 containerd[1934]: time="2025-01-13T20:09:37.627225721Z" level=info msg="StopPodSandbox for \"c5843741cfbc56669be6f2c02c9dc5041d7f20ca6acda74c9a7725511ea41cc7\"" Jan 13 20:09:37.633130 containerd[1934]: time="2025-01-13T20:09:37.633024649Z" level=info msg="Ensure that sandbox c5843741cfbc56669be6f2c02c9dc5041d7f20ca6acda74c9a7725511ea41cc7 in task-service has been cleanup successfully" Jan 13 20:09:37.634676 containerd[1934]: time="2025-01-13T20:09:37.634147621Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-7fbffcd8cd-pxvdr,Uid:8f72f896-c0ba-4b07-9a22-acc5c8ca3697,Namespace:calico-apiserver,Attempt:10,}" Jan 13 20:09:37.639731 kubelet[3423]: I0113 20:09:37.639677 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dec83f53d2791c9f727bb49f34c2c033d903e826c66acd0aceb404182efb08ed" Jan 13 20:09:37.646548 containerd[1934]: time="2025-01-13T20:09:37.634528237Z" level=info msg="TearDown network for sandbox \"c5843741cfbc56669be6f2c02c9dc5041d7f20ca6acda74c9a7725511ea41cc7\" successfully" Jan 13 20:09:37.646548 containerd[1934]: time="2025-01-13T20:09:37.645058585Z" level=info msg="StopPodSandbox for \"c5843741cfbc56669be6f2c02c9dc5041d7f20ca6acda74c9a7725511ea41cc7\" returns successfully" Jan 13 20:09:37.649256 containerd[1934]: time="2025-01-13T20:09:37.649107469Z" level=info msg="StopPodSandbox for \"5cd26e99c4b74ae9d61483798457a99584070c404b0f9be16defa2c0bdb11350\"" Jan 13 20:09:37.649384 containerd[1934]: time="2025-01-13T20:09:37.649296049Z" level=info msg="TearDown network for sandbox \"5cd26e99c4b74ae9d61483798457a99584070c404b0f9be16defa2c0bdb11350\" successfully" Jan 13 20:09:37.649384 containerd[1934]: time="2025-01-13T20:09:37.649319821Z" level=info msg="StopPodSandbox for \"5cd26e99c4b74ae9d61483798457a99584070c404b0f9be16defa2c0bdb11350\" returns successfully" Jan 13 20:09:37.649532 containerd[1934]: time="2025-01-13T20:09:37.649413781Z" level=info msg="StopPodSandbox for \"dec83f53d2791c9f727bb49f34c2c033d903e826c66acd0aceb404182efb08ed\"" Jan 13 20:09:37.653733 containerd[1934]: time="2025-01-13T20:09:37.652628977Z" level=info msg="StopPodSandbox for \"caa6547227a1620b7a4197c3897d843edd199256b9961ceb916b76e9c94fcc3f\"" Jan 13 20:09:37.653733 containerd[1934]: time="2025-01-13T20:09:37.652867345Z" level=info msg="TearDown network for sandbox \"caa6547227a1620b7a4197c3897d843edd199256b9961ceb916b76e9c94fcc3f\" successfully" Jan 13 20:09:37.653733 containerd[1934]: time="2025-01-13T20:09:37.652891453Z" level=info msg="StopPodSandbox for \"caa6547227a1620b7a4197c3897d843edd199256b9961ceb916b76e9c94fcc3f\" returns successfully" Jan 13 20:09:37.653733 containerd[1934]: time="2025-01-13T20:09:37.653673337Z" level=info msg="Ensure that sandbox dec83f53d2791c9f727bb49f34c2c033d903e826c66acd0aceb404182efb08ed in task-service has been cleanup successfully" Jan 13 20:09:37.655437 containerd[1934]: time="2025-01-13T20:09:37.654146701Z" level=info msg="TearDown network for sandbox \"dec83f53d2791c9f727bb49f34c2c033d903e826c66acd0aceb404182efb08ed\" successfully" Jan 13 20:09:37.655437 containerd[1934]: time="2025-01-13T20:09:37.654184237Z" level=info msg="StopPodSandbox for \"dec83f53d2791c9f727bb49f34c2c033d903e826c66acd0aceb404182efb08ed\" returns successfully" Jan 13 20:09:37.655764 containerd[1934]: time="2025-01-13T20:09:37.655656157Z" level=info msg="StopPodSandbox for \"77152f189a6575845e406c6b88f4c5ab02cd6b3300ee242fe45d39a9e4f1b8a0\"" Jan 13 20:09:37.655873 containerd[1934]: time="2025-01-13T20:09:37.655845769Z" level=info msg="TearDown network for sandbox \"77152f189a6575845e406c6b88f4c5ab02cd6b3300ee242fe45d39a9e4f1b8a0\" successfully" Jan 13 20:09:37.655929 containerd[1934]: time="2025-01-13T20:09:37.655868785Z" level=info msg="StopPodSandbox for \"77152f189a6575845e406c6b88f4c5ab02cd6b3300ee242fe45d39a9e4f1b8a0\" returns successfully" Jan 13 20:09:37.656026 containerd[1934]: time="2025-01-13T20:09:37.655987045Z" level=info msg="StopPodSandbox for \"41f52017578a2719bea2c9934c17ea164adf7cb7d5ed2c0dd11787fd25b06487\"" Jan 13 20:09:37.656151 containerd[1934]: time="2025-01-13T20:09:37.656112985Z" level=info msg="TearDown network for sandbox \"41f52017578a2719bea2c9934c17ea164adf7cb7d5ed2c0dd11787fd25b06487\" successfully" Jan 13 20:09:37.656678 containerd[1934]: time="2025-01-13T20:09:37.656144269Z" level=info msg="StopPodSandbox for \"41f52017578a2719bea2c9934c17ea164adf7cb7d5ed2c0dd11787fd25b06487\" returns successfully" Jan 13 20:09:37.657668 containerd[1934]: time="2025-01-13T20:09:37.657192373Z" level=info msg="StopPodSandbox for \"4d3ce37a9c40510fd9d66de0b8c2ac5802b7067c8efb617b93564f6bfe5a5223\"" Jan 13 20:09:37.657668 containerd[1934]: time="2025-01-13T20:09:37.657377473Z" level=info msg="TearDown network for sandbox \"4d3ce37a9c40510fd9d66de0b8c2ac5802b7067c8efb617b93564f6bfe5a5223\" successfully" Jan 13 20:09:37.657668 containerd[1934]: time="2025-01-13T20:09:37.657400933Z" level=info msg="StopPodSandbox for \"4d3ce37a9c40510fd9d66de0b8c2ac5802b7067c8efb617b93564f6bfe5a5223\" returns successfully" Jan 13 20:09:37.657668 containerd[1934]: time="2025-01-13T20:09:37.657624805Z" level=info msg="StopPodSandbox for \"7923d55515294cf3728cfef254022ed5f094d697790fafcc5064fca07c9e6e58\"" Jan 13 20:09:37.657668 containerd[1934]: time="2025-01-13T20:09:37.657746713Z" level=info msg="TearDown network for sandbox \"7923d55515294cf3728cfef254022ed5f094d697790fafcc5064fca07c9e6e58\" successfully" Jan 13 20:09:37.657668 containerd[1934]: time="2025-01-13T20:09:37.657767833Z" level=info msg="StopPodSandbox for \"7923d55515294cf3728cfef254022ed5f094d697790fafcc5064fca07c9e6e58\" returns successfully" Jan 13 20:09:37.659802 containerd[1934]: time="2025-01-13T20:09:37.659021629Z" level=info msg="StopPodSandbox for \"5eeccd24bcd272ceac794541253f4c8a557a6e36ba0959e6db5a98b61fca47a2\"" Jan 13 20:09:37.659802 containerd[1934]: time="2025-01-13T20:09:37.659230777Z" level=info msg="TearDown network for sandbox \"5eeccd24bcd272ceac794541253f4c8a557a6e36ba0959e6db5a98b61fca47a2\" successfully" Jan 13 20:09:37.659802 containerd[1934]: time="2025-01-13T20:09:37.659253661Z" level=info msg="StopPodSandbox for \"5eeccd24bcd272ceac794541253f4c8a557a6e36ba0959e6db5a98b61fca47a2\" returns successfully" Jan 13 20:09:37.659802 containerd[1934]: time="2025-01-13T20:09:37.659465509Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-kube-controllers-68f76c7ddf-lh8nj,Uid:2be21c11-9c2d-4b9a-81a5-0e73daba31c1,Namespace:calico-system,Attempt:11,}" Jan 13 20:09:37.662809 containerd[1934]: time="2025-01-13T20:09:37.662451626Z" level=info msg="StopPodSandbox for \"2f9666670aab61aa1c36a5c18b2c6e8e3d08bf1cfc3f42fb8cc1ef7244f4257c\"" Jan 13 20:09:37.663622 kubelet[3423]: I0113 20:09:37.663174 3423 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="67fcc7567928ea411025d344ddf2c1047093ecdfa4752e1c7d8144d30ac99273" Jan 13 20:09:37.663769 containerd[1934]: time="2025-01-13T20:09:37.663639482Z" level=info msg="TearDown network for sandbox \"2f9666670aab61aa1c36a5c18b2c6e8e3d08bf1cfc3f42fb8cc1ef7244f4257c\" successfully" Jan 13 20:09:37.663769 containerd[1934]: time="2025-01-13T20:09:37.663678974Z" level=info msg="StopPodSandbox for \"2f9666670aab61aa1c36a5c18b2c6e8e3d08bf1cfc3f42fb8cc1ef7244f4257c\" returns successfully" Jan 13 20:09:37.674961 containerd[1934]: time="2025-01-13T20:09:37.674400746Z" level=info msg="StopPodSandbox for \"67fcc7567928ea411025d344ddf2c1047093ecdfa4752e1c7d8144d30ac99273\"" Jan 13 20:09:37.674961 containerd[1934]: time="2025-01-13T20:09:37.674693666Z" level=info msg="Ensure that sandbox 67fcc7567928ea411025d344ddf2c1047093ecdfa4752e1c7d8144d30ac99273 in task-service has been cleanup successfully" Jan 13 20:09:37.677138 containerd[1934]: time="2025-01-13T20:09:37.677049554Z" level=info msg="TearDown network for sandbox \"67fcc7567928ea411025d344ddf2c1047093ecdfa4752e1c7d8144d30ac99273\" successfully" Jan 13 20:09:37.677138 containerd[1934]: time="2025-01-13T20:09:37.677101922Z" level=info msg="StopPodSandbox for \"67fcc7567928ea411025d344ddf2c1047093ecdfa4752e1c7d8144d30ac99273\" returns successfully" Jan 13 20:09:37.679466 containerd[1934]: time="2025-01-13T20:09:37.678434018Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-76f75df574-mkr2l,Uid:396e30c8-d221-410a-89fe-e353ba8cddbf,Namespace:kube-system,Attempt:11,}" Jan 13 20:09:37.682349 containerd[1934]: time="2025-01-13T20:09:37.681991514Z" level=info msg="StopPodSandbox for \"a6e568904495292ebcaa2ddc464d5ea9ff23223173598373960a2371d9378c10\"" Jan 13 20:09:37.682349 containerd[1934]: time="2025-01-13T20:09:37.682174010Z" level=info msg="TearDown network for sandbox \"a6e568904495292ebcaa2ddc464d5ea9ff23223173598373960a2371d9378c10\" successfully" Jan 13 20:09:37.682349 containerd[1934]: time="2025-01-13T20:09:37.682197266Z" level=info msg="StopPodSandbox for \"a6e568904495292ebcaa2ddc464d5ea9ff23223173598373960a2371d9378c10\" returns successfully" Jan 13 20:09:37.685488 containerd[1934]: time="2025-01-13T20:09:37.685183490Z" level=info msg="StopPodSandbox for \"ec48cd1dd8723b80be1e1659222057350fc66ef8fc805243c67fca1b079b3aae\"" Jan 13 20:09:37.688605 containerd[1934]: time="2025-01-13T20:09:37.688131266Z" level=info msg="TearDown network for sandbox \"ec48cd1dd8723b80be1e1659222057350fc66ef8fc805243c67fca1b079b3aae\" successfully" Jan 13 20:09:37.688605 containerd[1934]: time="2025-01-13T20:09:37.688211330Z" level=info msg="StopPodSandbox for \"ec48cd1dd8723b80be1e1659222057350fc66ef8fc805243c67fca1b079b3aae\" returns successfully" Jan 13 20:09:37.699575 containerd[1934]: time="2025-01-13T20:09:37.699054674Z" level=info msg="StopPodSandbox for \"6ca554906e8aff3cb9eab87b291894d187892c2a6910248683c6fe51f5efa9c4\"" Jan 13 20:09:37.699575 containerd[1934]: time="2025-01-13T20:09:37.699343622Z" level=info msg="TearDown network for sandbox \"6ca554906e8aff3cb9eab87b291894d187892c2a6910248683c6fe51f5efa9c4\" successfully" Jan 13 20:09:37.699575 containerd[1934]: time="2025-01-13T20:09:37.699373010Z" level=info msg="StopPodSandbox for \"6ca554906e8aff3cb9eab87b291894d187892c2a6910248683c6fe51f5efa9c4\" returns successfully" Jan 13 20:09:37.705817 containerd[1934]: time="2025-01-13T20:09:37.704076122Z" level=info msg="StopPodSandbox for \"dfb5cc6aa8ee548a0817f76e636f6ba17a9915fccdeb0f77deba61f58d7154ee\"" Jan 13 20:09:37.706150 containerd[1934]: time="2025-01-13T20:09:37.706101638Z" level=info msg="TearDown network for sandbox \"dfb5cc6aa8ee548a0817f76e636f6ba17a9915fccdeb0f77deba61f58d7154ee\" successfully" Jan 13 20:09:37.706292 containerd[1934]: time="2025-01-13T20:09:37.706262702Z" level=info msg="StopPodSandbox for \"dfb5cc6aa8ee548a0817f76e636f6ba17a9915fccdeb0f77deba61f58d7154ee\" returns successfully" Jan 13 20:09:37.710372 containerd[1934]: time="2025-01-13T20:09:37.710198774Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:csi-node-driver-wq54r,Uid:d47fc662-eff9-4473-83da-b6f0b896d81f,Namespace:calico-system,Attempt:11,}" Jan 13 20:09:37.834953 sshd[6214]: Accepted publickey for core from 147.75.109.163 port 40684 ssh2: RSA SHA256:IRHkteilZRLg/mCVEzdResksy7NfUBDRRywgALKaHg0 Jan 13 20:09:37.861150 sshd-session[6214]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Jan 13 20:09:37.910236 systemd-logind[1912]: New session 14 of user core. Jan 13 20:09:37.928115 systemd[1]: Started session-14.scope - Session 14 of User core. Jan 13 20:09:38.049550 systemd[1]: run-netns-cni\x2d5e0c8749\x2d8d56\x2de8c9\x2d8246\x2d3f546934fe15.mount: Deactivated successfully. Jan 13 20:09:38.050123 systemd[1]: run-netns-cni\x2ddf3372c6\x2dcafb\x2dc197\x2d359f\x2d898a6d26765c.mount: Deactivated successfully. Jan 13 20:09:38.050250 systemd[1]: run-netns-cni\x2d8398dd3f\x2d43c5\x2db943\x2d6117\x2d7aadf58dd2bb.mount: Deactivated successfully. Jan 13 20:09:38.050371 systemd[1]: run-netns-cni\x2d4b54d45e\x2d3e95\x2dc9db\x2d77d0\x2d604af920f97c.mount: Deactivated successfully. Jan 13 20:09:38.449306 sshd[6289]: Connection closed by 147.75.109.163 port 40684 Jan 13 20:09:38.451874 sshd-session[6214]: pam_unix(sshd:session): session closed for user core Jan 13 20:09:38.470892 systemd[1]: sshd@13-172.31.28.23:22-147.75.109.163:40684.service: Deactivated successfully. Jan 13 20:09:38.479109 systemd[1]: session-14.scope: Deactivated successfully. Jan 13 20:09:38.492797 systemd-logind[1912]: Session 14 logged out. Waiting for processes to exit. Jan 13 20:09:38.499181 systemd-logind[1912]: Removed session 14. Jan 13 20:09:38.830206 (udev-worker)[6200]: Network interface NamePolicy= disabled on kernel command line. Jan 13 20:09:38.835573 systemd-networkd[1804]: cali0f4ccef88b3: Link UP Jan 13 20:09:38.838908 systemd-networkd[1804]: cali0f4ccef88b3: Gained carrier Jan 13 20:09:38.902318 containerd[1934]: 2025-01-13 20:09:37.934 [INFO][6220] cni-plugin/utils.go 100: File /var/lib/calico/mtu does not exist Jan 13 20:09:38.902318 containerd[1934]: 2025-01-13 20:09:38.205 [INFO][6220] cni-plugin/plugin.go 325: Calico CNI found existing endpoint: &{{WorkloadEndpoint projectcalico.org/v3} {ip--172--31--28--23-k8s-calico--apiserver--7fbffcd8cd--wszl7-eth0 calico-apiserver-7fbffcd8cd- calico-apiserver ad79c041-eaf1-4d57-9fb4-c3fb08680cb8 794 0 2025-01-13 20:09:05 +0000 UTC map[apiserver:true app.kubernetes.io/name:calico-apiserver k8s-app:calico-apiserver pod-template-hash:7fbffcd8cd projectcalico.org/namespace:calico-apiserver projectcalico.org/orchestrator:k8s projectcalico.org/serviceaccount:calico-apiserver] map[] [] [] []} {k8s ip-172-31-28-23 calico-apiserver-7fbffcd8cd-wszl7 eth0 calico-apiserver [] [] [kns.calico-apiserver ksa.calico-apiserver.calico-apiserver] cali0f4ccef88b3 [] []}} ContainerID="98b2148f179f527ed06a30e4a81178bc222ffda23d6ad0a11ad6187295bf0f5b" Namespace="calico-apiserver" Pod="calico-apiserver-7fbffcd8cd-wszl7" WorkloadEndpoint="ip--172--31--28--23-k8s-calico--apiserver--7fbffcd8cd--wszl7-" Jan 13 20:09:38.902318 containerd[1934]: 2025-01-13 20:09:38.205 [INFO][6220] cni-plugin/k8s.go 77: Extracted identifiers for CmdAddK8s ContainerID="98b2148f179f527ed06a30e4a81178bc222ffda23d6ad0a11ad6187295bf0f5b" Namespace="calico-apiserver" Pod="calico-apiserver-7fbffcd8cd-wszl7" WorkloadEndpoint="ip--172--31--28--23-k8s-calico--apiserver--7fbffcd8cd--wszl7-eth0" Jan 13 20:09:38.902318 containerd[1934]: 2025-01-13 20:09:38.566 [INFO][6315] ipam/ipam_plugin.go 225: Calico CNI IPAM request count IPv4=1 IPv6=0 ContainerID="98b2148f179f527ed06a30e4a81178bc222ffda23d6ad0a11ad6187295bf0f5b" HandleID="k8s-pod-network.98b2148f179f527ed06a30e4a81178bc222ffda23d6ad0a11ad6187295bf0f5b" Workload="ip--172--31--28--23-k8s-calico--apiserver--7fbffcd8cd--wszl7-eth0" Jan 13 20:09:38.902318 containerd[1934]: 2025-01-13 20:09:38.623 [INFO][6315] ipam/ipam_plugin.go 265: Auto assigning IP ContainerID="98b2148f179f527ed06a30e4a81178bc222ffda23d6ad0a11ad6187295bf0f5b" HandleID="k8s-pod-network.98b2148f179f527ed06a30e4a81178bc222ffda23d6ad0a11ad6187295bf0f5b" Workload="ip--172--31--28--23-k8s-calico--apiserver--7fbffcd8cd--wszl7-eth0" assignArgs=ipam.AutoAssignArgs{Num4:1, Num6:0, HandleID:(*string)(0x400030e110), Attrs:map[string]string{"namespace":"calico-apiserver", "node":"ip-172-31-28-23", "pod":"calico-apiserver-7fbffcd8cd-wszl7", "timestamp":"2025-01-13 20:09:38.566056322 +0000 UTC"}, Hostname:"ip-172-31-28-23", IPv4Pools:[]net.IPNet{}, IPv6Pools:[]net.IPNet{}, MaxBlocksPerHost:0, HostReservedAttrIPv4s:(*ipam.HostReservedAttr)(nil), HostReservedAttrIPv6s:(*ipam.HostReservedAttr)(nil), IntendedUse:"Workload"} Jan 13 20:09:38.902318 containerd[1934]: 2025-01-13 20:09:38.624 [INFO][6315] ipam/ipam_plugin.go 353: About to acquire host-wide IPAM lock. Jan 13 20:09:38.902318 containerd[1934]: 2025-01-13 20:09:38.625 [INFO][6315] ipam/ipam_plugin.go 368: Acquired host-wide IPAM lock. Jan 13 20:09:38.902318 containerd[1934]: 2025-01-13 20:09:38.625 [INFO][6315] ipam/ipam.go 107: Auto-assign 1 ipv4, 0 ipv6 addrs for host 'ip-172-31-28-23' Jan 13 20:09:38.902318 containerd[1934]: 2025-01-13 20:09:38.634 [INFO][6315] ipam/ipam.go 660: Looking up existing affinities for host handle="k8s-pod-network.98b2148f179f527ed06a30e4a81178bc222ffda23d6ad0a11ad6187295bf0f5b" host="ip-172-31-28-23" Jan 13 20:09:38.902318 containerd[1934]: 2025-01-13 20:09:38.650 [INFO][6315] ipam/ipam.go 372: Looking up existing affinities for host host="ip-172-31-28-23" Jan 13 20:09:38.902318 containerd[1934]: 2025-01-13 20:09:38.677 [INFO][6315] ipam/ipam.go 489: Trying affinity for 192.168.83.128/26 host="ip-172-31-28-23" Jan 13 20:09:38.902318 containerd[1934]: 2025-01-13 20:09:38.696 [INFO][6315] ipam/ipam.go 155: Attempting to load block cidr=192.168.83.128/26 host="ip-172-31-28-23" Jan 13 20:09:38.902318 containerd[1934]: 2025-01-13 20:09:38.720 [INFO][6315] ipam/ipam.go 232: Affinity is confirmed and block has been loaded cidr=192.168.83.128/26 host="ip-172-31-28-23" Jan 13 20:09:38.902318 containerd[1934]: 2025-01-13 20:09:38.735 [INFO][6315] ipam/ipam.go 1180: Attempting to assign 1 addresses from block block=192.168.83.128/26 handle="k8s-pod-network.98b2148f179f527ed06a30e4a81178bc222ffda23d6ad0a11ad6187295bf0f5b" host="ip-172-31-28-23" Jan 13 20:09:38.902318 containerd[1934]: 2025-01-13 20:09:38.751 [INFO][6315] ipam/ipam.go 1685: Creating new handle: k8s-pod-network.98b2148f179f527ed06a30e4a81178bc222ffda23d6ad0a11ad6187295bf0f5b Jan 13 20:09:38.902318 containerd[1934]: 2025-01-13 20:09:38.767 [INFO][6315] ipam/ipam.go 1203: Writing block in order to claim IPs block=192.168.83.128/26 handle="k8s-pod-network.98b2148f179f527ed06a30e4a81178bc222ffda23d6ad0a11ad6187295bf0f5b" host="ip-172-31-28-23" Jan 13 20:09:38.902318 containerd[1934]: 2025-01-13 20:09:38.789 [INFO][6315] ipam/ipam.go 1216: Successfully claimed IPs: [192.168.83.129/26] block=192.168.83.128/26 handle="k8s-pod-network.98b2148f179f527ed06a30e4a81178bc222ffda23d6ad0a11ad6187295bf0f5b" host="ip-172-31-28-23" Jan 13 20:09:38.902318 containerd[1934]: 2025-01-13 20:09:38.790 [INFO][6315] ipam/ipam.go 847: Auto-assigned 1 out of 1 IPv4s: [192.168.83.129/26] handle="k8s-pod-network.98b2148f179f527ed06a30e4a81178bc222ffda23d6ad0a11ad6187295bf0f5b" host="ip-172-31-28-23" Jan 13 20:09:38.902318 containerd[1934]: 2025-01-13 20:09:38.791 [INFO][6315] ipam/ipam_plugin.go 374: Released host-wide IPAM lock. Jan 13 20:09:38.902318 containerd[1934]: 2025-01-13 20:09:38.791 [INFO][6315] ipam/ipam_plugin.go 283: Calico CNI IPAM assigned addresses IPv4=[192.168.83.129/26] IPv6=[] ContainerID="98b2148f179f527ed06a30e4a81178bc222ffda23d6ad0a11ad6187295bf0f5b" HandleID="k8s-pod-network.98b2148f179f527ed06a30e4a81178bc222ffda23d6ad0a11ad6187295bf0f5b" Workload="ip--172--31--28--23-k8s-calico--apiserver--7fbffcd8cd--wszl7-eth0" Jan 13 20:09:38.907594 containerd[1934]: 2025-01-13 20:09:38.808 [INFO][6220] cni-plugin/k8s.go 386: Populated endpoint ContainerID="98b2148f179f527ed06a30e4a81178bc222ffda23d6ad0a11ad6187295bf0f5b" Namespace="calico-apiserver" Pod="calico-apiserver-7fbffcd8cd-wszl7" WorkloadEndpoint="ip--172--31--28--23-k8s-calico--apiserver--7fbffcd8cd--wszl7-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--28--23-k8s-calico--apiserver--7fbffcd8cd--wszl7-eth0", GenerateName:"calico-apiserver-7fbffcd8cd-", Namespace:"calico-apiserver", SelfLink:"", UID:"ad79c041-eaf1-4d57-9fb4-c3fb08680cb8", ResourceVersion:"794", Generation:0, CreationTimestamp:time.Date(2025, time.January, 13, 20, 9, 5, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"apiserver":"true", "app.kubernetes.io/name":"calico-apiserver", "k8s-app":"calico-apiserver", "pod-template-hash":"7fbffcd8cd", "projectcalico.org/namespace":"calico-apiserver", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"calico-apiserver"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-28-23", ContainerID:"", Pod:"calico-apiserver-7fbffcd8cd-wszl7", Endpoint:"eth0", ServiceAccountName:"calico-apiserver", IPNetworks:[]string{"192.168.83.129/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-apiserver", "ksa.calico-apiserver.calico-apiserver"}, InterfaceName:"cali0f4ccef88b3", MAC:"", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil)}} Jan 13 20:09:38.907594 containerd[1934]: 2025-01-13 20:09:38.810 [INFO][6220] cni-plugin/k8s.go 387: Calico CNI using IPs: [192.168.83.129/32] ContainerID="98b2148f179f527ed06a30e4a81178bc222ffda23d6ad0a11ad6187295bf0f5b" Namespace="calico-apiserver" Pod="calico-apiserver-7fbffcd8cd-wszl7" WorkloadEndpoint="ip--172--31--28--23-k8s-calico--apiserver--7fbffcd8cd--wszl7-eth0" Jan 13 20:09:38.907594 containerd[1934]: 2025-01-13 20:09:38.810 [INFO][6220] cni-plugin/dataplane_linux.go 69: Setting the host side veth name to cali0f4ccef88b3 ContainerID="98b2148f179f527ed06a30e4a81178bc222ffda23d6ad0a11ad6187295bf0f5b" Namespace="calico-apiserver" Pod="calico-apiserver-7fbffcd8cd-wszl7" WorkloadEndpoint="ip--172--31--28--23-k8s-calico--apiserver--7fbffcd8cd--wszl7-eth0" Jan 13 20:09:38.907594 containerd[1934]: 2025-01-13 20:09:38.844 [INFO][6220] cni-plugin/dataplane_linux.go 508: Disabling IPv4 forwarding ContainerID="98b2148f179f527ed06a30e4a81178bc222ffda23d6ad0a11ad6187295bf0f5b" Namespace="calico-apiserver" Pod="calico-apiserver-7fbffcd8cd-wszl7" WorkloadEndpoint="ip--172--31--28--23-k8s-calico--apiserver--7fbffcd8cd--wszl7-eth0" Jan 13 20:09:38.907594 containerd[1934]: 2025-01-13 20:09:38.845 [INFO][6220] cni-plugin/k8s.go 414: Added Mac, interface name, and active container ID to endpoint ContainerID="98b2148f179f527ed06a30e4a81178bc222ffda23d6ad0a11ad6187295bf0f5b" Namespace="calico-apiserver" Pod="calico-apiserver-7fbffcd8cd-wszl7" WorkloadEndpoint="ip--172--31--28--23-k8s-calico--apiserver--7fbffcd8cd--wszl7-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--28--23-k8s-calico--apiserver--7fbffcd8cd--wszl7-eth0", GenerateName:"calico-apiserver-7fbffcd8cd-", Namespace:"calico-apiserver", SelfLink:"", UID:"ad79c041-eaf1-4d57-9fb4-c3fb08680cb8", ResourceVersion:"794", Generation:0, CreationTimestamp:time.Date(2025, time.January, 13, 20, 9, 5, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"apiserver":"true", "app.kubernetes.io/name":"calico-apiserver", "k8s-app":"calico-apiserver", "pod-template-hash":"7fbffcd8cd", "projectcalico.org/namespace":"calico-apiserver", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"calico-apiserver"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-28-23", ContainerID:"98b2148f179f527ed06a30e4a81178bc222ffda23d6ad0a11ad6187295bf0f5b", Pod:"calico-apiserver-7fbffcd8cd-wszl7", Endpoint:"eth0", ServiceAccountName:"calico-apiserver", IPNetworks:[]string{"192.168.83.129/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-apiserver", "ksa.calico-apiserver.calico-apiserver"}, InterfaceName:"cali0f4ccef88b3", MAC:"72:8f:e4:2b:d1:30", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil)}} Jan 13 20:09:38.907594 containerd[1934]: 2025-01-13 20:09:38.893 [INFO][6220] cni-plugin/k8s.go 500: Wrote updated endpoint to datastore ContainerID="98b2148f179f527ed06a30e4a81178bc222ffda23d6ad0a11ad6187295bf0f5b" Namespace="calico-apiserver" Pod="calico-apiserver-7fbffcd8cd-wszl7" WorkloadEndpoint="ip--172--31--28--23-k8s-calico--apiserver--7fbffcd8cd--wszl7-eth0" Jan 13 20:09:38.935594 systemd-networkd[1804]: calic75cf53e955: Link UP Jan 13 20:09:38.941190 systemd-networkd[1804]: calic75cf53e955: Gained carrier Jan 13 20:09:38.985401 containerd[1934]: 2025-01-13 20:09:37.918 [INFO][6229] cni-plugin/utils.go 100: File /var/lib/calico/mtu does not exist Jan 13 20:09:38.985401 containerd[1934]: 2025-01-13 20:09:38.205 [INFO][6229] cni-plugin/plugin.go 325: Calico CNI found existing endpoint: &{{WorkloadEndpoint projectcalico.org/v3} {ip--172--31--28--23-k8s-coredns--76f75df574--8wp6k-eth0 coredns-76f75df574- kube-system 87115657-f395-40ec-89ea-3d7835119c3a 792 0 2025-01-13 20:08:44 +0000 UTC map[k8s-app:kube-dns pod-template-hash:76f75df574 projectcalico.org/namespace:kube-system projectcalico.org/orchestrator:k8s projectcalico.org/serviceaccount:coredns] map[] [] [] []} {k8s ip-172-31-28-23 coredns-76f75df574-8wp6k eth0 coredns [] [] [kns.kube-system ksa.kube-system.coredns] calic75cf53e955 [{dns UDP 53 0 } {dns-tcp TCP 53 0 } {metrics TCP 9153 0 }] []}} ContainerID="e833d2506996e35fb87ff0ca7879ff2165ff0ef66d6acb92e961f47ee12eab64" Namespace="kube-system" Pod="coredns-76f75df574-8wp6k" WorkloadEndpoint="ip--172--31--28--23-k8s-coredns--76f75df574--8wp6k-" Jan 13 20:09:38.985401 containerd[1934]: 2025-01-13 20:09:38.205 [INFO][6229] cni-plugin/k8s.go 77: Extracted identifiers for CmdAddK8s ContainerID="e833d2506996e35fb87ff0ca7879ff2165ff0ef66d6acb92e961f47ee12eab64" Namespace="kube-system" Pod="coredns-76f75df574-8wp6k" WorkloadEndpoint="ip--172--31--28--23-k8s-coredns--76f75df574--8wp6k-eth0" Jan 13 20:09:38.985401 containerd[1934]: 2025-01-13 20:09:38.561 [INFO][6326] ipam/ipam_plugin.go 225: Calico CNI IPAM request count IPv4=1 IPv6=0 ContainerID="e833d2506996e35fb87ff0ca7879ff2165ff0ef66d6acb92e961f47ee12eab64" HandleID="k8s-pod-network.e833d2506996e35fb87ff0ca7879ff2165ff0ef66d6acb92e961f47ee12eab64" Workload="ip--172--31--28--23-k8s-coredns--76f75df574--8wp6k-eth0" Jan 13 20:09:38.985401 containerd[1934]: 2025-01-13 20:09:38.638 [INFO][6326] ipam/ipam_plugin.go 265: Auto assigning IP ContainerID="e833d2506996e35fb87ff0ca7879ff2165ff0ef66d6acb92e961f47ee12eab64" HandleID="k8s-pod-network.e833d2506996e35fb87ff0ca7879ff2165ff0ef66d6acb92e961f47ee12eab64" Workload="ip--172--31--28--23-k8s-coredns--76f75df574--8wp6k-eth0" assignArgs=ipam.AutoAssignArgs{Num4:1, Num6:0, HandleID:(*string)(0x400011a650), Attrs:map[string]string{"namespace":"kube-system", "node":"ip-172-31-28-23", "pod":"coredns-76f75df574-8wp6k", "timestamp":"2025-01-13 20:09:38.561469646 +0000 UTC"}, Hostname:"ip-172-31-28-23", IPv4Pools:[]net.IPNet{}, IPv6Pools:[]net.IPNet{}, MaxBlocksPerHost:0, HostReservedAttrIPv4s:(*ipam.HostReservedAttr)(nil), HostReservedAttrIPv6s:(*ipam.HostReservedAttr)(nil), IntendedUse:"Workload"} Jan 13 20:09:38.985401 containerd[1934]: 2025-01-13 20:09:38.639 [INFO][6326] ipam/ipam_plugin.go 353: About to acquire host-wide IPAM lock. Jan 13 20:09:38.985401 containerd[1934]: 2025-01-13 20:09:38.791 [INFO][6326] ipam/ipam_plugin.go 368: Acquired host-wide IPAM lock. Jan 13 20:09:38.985401 containerd[1934]: 2025-01-13 20:09:38.793 [INFO][6326] ipam/ipam.go 107: Auto-assign 1 ipv4, 0 ipv6 addrs for host 'ip-172-31-28-23' Jan 13 20:09:38.985401 containerd[1934]: 2025-01-13 20:09:38.801 [INFO][6326] ipam/ipam.go 660: Looking up existing affinities for host handle="k8s-pod-network.e833d2506996e35fb87ff0ca7879ff2165ff0ef66d6acb92e961f47ee12eab64" host="ip-172-31-28-23" Jan 13 20:09:38.985401 containerd[1934]: 2025-01-13 20:09:38.815 [INFO][6326] ipam/ipam.go 372: Looking up existing affinities for host host="ip-172-31-28-23" Jan 13 20:09:38.985401 containerd[1934]: 2025-01-13 20:09:38.830 [INFO][6326] ipam/ipam.go 489: Trying affinity for 192.168.83.128/26 host="ip-172-31-28-23" Jan 13 20:09:38.985401 containerd[1934]: 2025-01-13 20:09:38.838 [INFO][6326] ipam/ipam.go 155: Attempting to load block cidr=192.168.83.128/26 host="ip-172-31-28-23" Jan 13 20:09:38.985401 containerd[1934]: 2025-01-13 20:09:38.851 [INFO][6326] ipam/ipam.go 232: Affinity is confirmed and block has been loaded cidr=192.168.83.128/26 host="ip-172-31-28-23" Jan 13 20:09:38.985401 containerd[1934]: 2025-01-13 20:09:38.852 [INFO][6326] ipam/ipam.go 1180: Attempting to assign 1 addresses from block block=192.168.83.128/26 handle="k8s-pod-network.e833d2506996e35fb87ff0ca7879ff2165ff0ef66d6acb92e961f47ee12eab64" host="ip-172-31-28-23" Jan 13 20:09:38.985401 containerd[1934]: 2025-01-13 20:09:38.858 [INFO][6326] ipam/ipam.go 1685: Creating new handle: k8s-pod-network.e833d2506996e35fb87ff0ca7879ff2165ff0ef66d6acb92e961f47ee12eab64 Jan 13 20:09:38.985401 containerd[1934]: 2025-01-13 20:09:38.875 [INFO][6326] ipam/ipam.go 1203: Writing block in order to claim IPs block=192.168.83.128/26 handle="k8s-pod-network.e833d2506996e35fb87ff0ca7879ff2165ff0ef66d6acb92e961f47ee12eab64" host="ip-172-31-28-23" Jan 13 20:09:38.985401 containerd[1934]: 2025-01-13 20:09:38.895 [INFO][6326] ipam/ipam.go 1216: Successfully claimed IPs: [192.168.83.130/26] block=192.168.83.128/26 handle="k8s-pod-network.e833d2506996e35fb87ff0ca7879ff2165ff0ef66d6acb92e961f47ee12eab64" host="ip-172-31-28-23" Jan 13 20:09:38.985401 containerd[1934]: 2025-01-13 20:09:38.895 [INFO][6326] ipam/ipam.go 847: Auto-assigned 1 out of 1 IPv4s: [192.168.83.130/26] handle="k8s-pod-network.e833d2506996e35fb87ff0ca7879ff2165ff0ef66d6acb92e961f47ee12eab64" host="ip-172-31-28-23" Jan 13 20:09:38.985401 containerd[1934]: 2025-01-13 20:09:38.895 [INFO][6326] ipam/ipam_plugin.go 374: Released host-wide IPAM lock. Jan 13 20:09:38.985401 containerd[1934]: 2025-01-13 20:09:38.895 [INFO][6326] ipam/ipam_plugin.go 283: Calico CNI IPAM assigned addresses IPv4=[192.168.83.130/26] IPv6=[] ContainerID="e833d2506996e35fb87ff0ca7879ff2165ff0ef66d6acb92e961f47ee12eab64" HandleID="k8s-pod-network.e833d2506996e35fb87ff0ca7879ff2165ff0ef66d6acb92e961f47ee12eab64" Workload="ip--172--31--28--23-k8s-coredns--76f75df574--8wp6k-eth0" Jan 13 20:09:38.988392 containerd[1934]: 2025-01-13 20:09:38.906 [INFO][6229] cni-plugin/k8s.go 386: Populated endpoint ContainerID="e833d2506996e35fb87ff0ca7879ff2165ff0ef66d6acb92e961f47ee12eab64" Namespace="kube-system" Pod="coredns-76f75df574-8wp6k" WorkloadEndpoint="ip--172--31--28--23-k8s-coredns--76f75df574--8wp6k-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--28--23-k8s-coredns--76f75df574--8wp6k-eth0", GenerateName:"coredns-76f75df574-", Namespace:"kube-system", SelfLink:"", UID:"87115657-f395-40ec-89ea-3d7835119c3a", ResourceVersion:"792", Generation:0, CreationTimestamp:time.Date(2025, time.January, 13, 20, 8, 44, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-dns", "pod-template-hash":"76f75df574", "projectcalico.org/namespace":"kube-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"coredns"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-28-23", ContainerID:"", Pod:"coredns-76f75df574-8wp6k", Endpoint:"eth0", ServiceAccountName:"coredns", IPNetworks:[]string{"192.168.83.130/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.kube-system", "ksa.kube-system.coredns"}, InterfaceName:"calic75cf53e955", MAC:"", Ports:[]v3.WorkloadEndpointPort{v3.WorkloadEndpointPort{Name:"dns", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"UDP"}, Port:0x35, HostPort:0x0, HostIP:""}, v3.WorkloadEndpointPort{Name:"dns-tcp", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"TCP"}, Port:0x35, HostPort:0x0, HostIP:""}, v3.WorkloadEndpointPort{Name:"metrics", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"TCP"}, Port:0x23c1, HostPort:0x0, HostIP:""}}, AllowSpoofedSourcePrefixes:[]string(nil)}} Jan 13 20:09:38.988392 containerd[1934]: 2025-01-13 20:09:38.908 [INFO][6229] cni-plugin/k8s.go 387: Calico CNI using IPs: [192.168.83.130/32] ContainerID="e833d2506996e35fb87ff0ca7879ff2165ff0ef66d6acb92e961f47ee12eab64" Namespace="kube-system" Pod="coredns-76f75df574-8wp6k" WorkloadEndpoint="ip--172--31--28--23-k8s-coredns--76f75df574--8wp6k-eth0" Jan 13 20:09:38.988392 containerd[1934]: 2025-01-13 20:09:38.911 [INFO][6229] cni-plugin/dataplane_linux.go 69: Setting the host side veth name to calic75cf53e955 ContainerID="e833d2506996e35fb87ff0ca7879ff2165ff0ef66d6acb92e961f47ee12eab64" Namespace="kube-system" Pod="coredns-76f75df574-8wp6k" WorkloadEndpoint="ip--172--31--28--23-k8s-coredns--76f75df574--8wp6k-eth0" Jan 13 20:09:38.988392 containerd[1934]: 2025-01-13 20:09:38.940 [INFO][6229] cni-plugin/dataplane_linux.go 508: Disabling IPv4 forwarding ContainerID="e833d2506996e35fb87ff0ca7879ff2165ff0ef66d6acb92e961f47ee12eab64" Namespace="kube-system" Pod="coredns-76f75df574-8wp6k" WorkloadEndpoint="ip--172--31--28--23-k8s-coredns--76f75df574--8wp6k-eth0" Jan 13 20:09:38.988392 containerd[1934]: 2025-01-13 20:09:38.945 [INFO][6229] cni-plugin/k8s.go 414: Added Mac, interface name, and active container ID to endpoint ContainerID="e833d2506996e35fb87ff0ca7879ff2165ff0ef66d6acb92e961f47ee12eab64" Namespace="kube-system" Pod="coredns-76f75df574-8wp6k" WorkloadEndpoint="ip--172--31--28--23-k8s-coredns--76f75df574--8wp6k-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--28--23-k8s-coredns--76f75df574--8wp6k-eth0", GenerateName:"coredns-76f75df574-", Namespace:"kube-system", SelfLink:"", UID:"87115657-f395-40ec-89ea-3d7835119c3a", ResourceVersion:"792", Generation:0, CreationTimestamp:time.Date(2025, time.January, 13, 20, 8, 44, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-dns", "pod-template-hash":"76f75df574", "projectcalico.org/namespace":"kube-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"coredns"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-28-23", ContainerID:"e833d2506996e35fb87ff0ca7879ff2165ff0ef66d6acb92e961f47ee12eab64", Pod:"coredns-76f75df574-8wp6k", Endpoint:"eth0", ServiceAccountName:"coredns", IPNetworks:[]string{"192.168.83.130/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.kube-system", "ksa.kube-system.coredns"}, InterfaceName:"calic75cf53e955", MAC:"ee:6b:9d:e1:ed:12", Ports:[]v3.WorkloadEndpointPort{v3.WorkloadEndpointPort{Name:"dns", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"UDP"}, Port:0x35, HostPort:0x0, HostIP:""}, v3.WorkloadEndpointPort{Name:"dns-tcp", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"TCP"}, Port:0x35, HostPort:0x0, HostIP:""}, v3.WorkloadEndpointPort{Name:"metrics", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"TCP"}, Port:0x23c1, HostPort:0x0, HostIP:""}}, AllowSpoofedSourcePrefixes:[]string(nil)}} Jan 13 20:09:38.988392 containerd[1934]: 2025-01-13 20:09:38.968 [INFO][6229] cni-plugin/k8s.go 500: Wrote updated endpoint to datastore ContainerID="e833d2506996e35fb87ff0ca7879ff2165ff0ef66d6acb92e961f47ee12eab64" Namespace="kube-system" Pod="coredns-76f75df574-8wp6k" WorkloadEndpoint="ip--172--31--28--23-k8s-coredns--76f75df574--8wp6k-eth0" Jan 13 20:09:39.044736 containerd[1934]: time="2025-01-13T20:09:39.044567604Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1 Jan 13 20:09:39.044736 containerd[1934]: time="2025-01-13T20:09:39.044689908Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1 Jan 13 20:09:39.045055 containerd[1934]: time="2025-01-13T20:09:39.044728296Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Jan 13 20:09:39.049307 containerd[1934]: time="2025-01-13T20:09:39.046497456Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Jan 13 20:09:39.083179 systemd-networkd[1804]: cali3fb46b06e86: Link UP Jan 13 20:09:39.085938 systemd-networkd[1804]: cali3fb46b06e86: Gained carrier Jan 13 20:09:39.095970 containerd[1934]: time="2025-01-13T20:09:39.095063065Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1 Jan 13 20:09:39.095970 containerd[1934]: time="2025-01-13T20:09:39.095150473Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1 Jan 13 20:09:39.095970 containerd[1934]: time="2025-01-13T20:09:39.095179489Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Jan 13 20:09:39.095970 containerd[1934]: time="2025-01-13T20:09:39.095339797Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Jan 13 20:09:39.146305 containerd[1934]: 2025-01-13 20:09:38.079 [INFO][6251] cni-plugin/utils.go 100: File /var/lib/calico/mtu does not exist Jan 13 20:09:39.146305 containerd[1934]: 2025-01-13 20:09:38.212 [INFO][6251] cni-plugin/plugin.go 325: Calico CNI found existing endpoint: &{{WorkloadEndpoint projectcalico.org/v3} {ip--172--31--28--23-k8s-calico--apiserver--7fbffcd8cd--pxvdr-eth0 calico-apiserver-7fbffcd8cd- calico-apiserver 8f72f896-c0ba-4b07-9a22-acc5c8ca3697 795 0 2025-01-13 20:09:05 +0000 UTC map[apiserver:true app.kubernetes.io/name:calico-apiserver k8s-app:calico-apiserver pod-template-hash:7fbffcd8cd projectcalico.org/namespace:calico-apiserver projectcalico.org/orchestrator:k8s projectcalico.org/serviceaccount:calico-apiserver] map[] [] [] []} {k8s ip-172-31-28-23 calico-apiserver-7fbffcd8cd-pxvdr eth0 calico-apiserver [] [] [kns.calico-apiserver ksa.calico-apiserver.calico-apiserver] cali3fb46b06e86 [] []}} ContainerID="b692d302c089fa9e6922c88c202828a18c9972e1a1d1472fd1f7c6f39007b2f3" Namespace="calico-apiserver" Pod="calico-apiserver-7fbffcd8cd-pxvdr" WorkloadEndpoint="ip--172--31--28--23-k8s-calico--apiserver--7fbffcd8cd--pxvdr-" Jan 13 20:09:39.146305 containerd[1934]: 2025-01-13 20:09:38.212 [INFO][6251] cni-plugin/k8s.go 77: Extracted identifiers for CmdAddK8s ContainerID="b692d302c089fa9e6922c88c202828a18c9972e1a1d1472fd1f7c6f39007b2f3" Namespace="calico-apiserver" Pod="calico-apiserver-7fbffcd8cd-pxvdr" WorkloadEndpoint="ip--172--31--28--23-k8s-calico--apiserver--7fbffcd8cd--pxvdr-eth0" Jan 13 20:09:39.146305 containerd[1934]: 2025-01-13 20:09:38.659 [INFO][6320] ipam/ipam_plugin.go 225: Calico CNI IPAM request count IPv4=1 IPv6=0 ContainerID="b692d302c089fa9e6922c88c202828a18c9972e1a1d1472fd1f7c6f39007b2f3" HandleID="k8s-pod-network.b692d302c089fa9e6922c88c202828a18c9972e1a1d1472fd1f7c6f39007b2f3" Workload="ip--172--31--28--23-k8s-calico--apiserver--7fbffcd8cd--pxvdr-eth0" Jan 13 20:09:39.146305 containerd[1934]: 2025-01-13 20:09:38.750 [INFO][6320] ipam/ipam_plugin.go 265: Auto assigning IP ContainerID="b692d302c089fa9e6922c88c202828a18c9972e1a1d1472fd1f7c6f39007b2f3" HandleID="k8s-pod-network.b692d302c089fa9e6922c88c202828a18c9972e1a1d1472fd1f7c6f39007b2f3" Workload="ip--172--31--28--23-k8s-calico--apiserver--7fbffcd8cd--pxvdr-eth0" assignArgs=ipam.AutoAssignArgs{Num4:1, Num6:0, HandleID:(*string)(0x40004142c0), Attrs:map[string]string{"namespace":"calico-apiserver", "node":"ip-172-31-28-23", "pod":"calico-apiserver-7fbffcd8cd-pxvdr", "timestamp":"2025-01-13 20:09:38.659174126 +0000 UTC"}, Hostname:"ip-172-31-28-23", IPv4Pools:[]net.IPNet{}, IPv6Pools:[]net.IPNet{}, MaxBlocksPerHost:0, HostReservedAttrIPv4s:(*ipam.HostReservedAttr)(nil), HostReservedAttrIPv6s:(*ipam.HostReservedAttr)(nil), IntendedUse:"Workload"} Jan 13 20:09:39.146305 containerd[1934]: 2025-01-13 20:09:38.750 [INFO][6320] ipam/ipam_plugin.go 353: About to acquire host-wide IPAM lock. Jan 13 20:09:39.146305 containerd[1934]: 2025-01-13 20:09:38.897 [INFO][6320] ipam/ipam_plugin.go 368: Acquired host-wide IPAM lock. Jan 13 20:09:39.146305 containerd[1934]: 2025-01-13 20:09:38.897 [INFO][6320] ipam/ipam.go 107: Auto-assign 1 ipv4, 0 ipv6 addrs for host 'ip-172-31-28-23' Jan 13 20:09:39.146305 containerd[1934]: 2025-01-13 20:09:38.910 [INFO][6320] ipam/ipam.go 660: Looking up existing affinities for host handle="k8s-pod-network.b692d302c089fa9e6922c88c202828a18c9972e1a1d1472fd1f7c6f39007b2f3" host="ip-172-31-28-23" Jan 13 20:09:39.146305 containerd[1934]: 2025-01-13 20:09:38.936 [INFO][6320] ipam/ipam.go 372: Looking up existing affinities for host host="ip-172-31-28-23" Jan 13 20:09:39.146305 containerd[1934]: 2025-01-13 20:09:38.964 [INFO][6320] ipam/ipam.go 489: Trying affinity for 192.168.83.128/26 host="ip-172-31-28-23" Jan 13 20:09:39.146305 containerd[1934]: 2025-01-13 20:09:38.980 [INFO][6320] ipam/ipam.go 155: Attempting to load block cidr=192.168.83.128/26 host="ip-172-31-28-23" Jan 13 20:09:39.146305 containerd[1934]: 2025-01-13 20:09:38.996 [INFO][6320] ipam/ipam.go 232: Affinity is confirmed and block has been loaded cidr=192.168.83.128/26 host="ip-172-31-28-23" Jan 13 20:09:39.146305 containerd[1934]: 2025-01-13 20:09:38.997 [INFO][6320] ipam/ipam.go 1180: Attempting to assign 1 addresses from block block=192.168.83.128/26 handle="k8s-pod-network.b692d302c089fa9e6922c88c202828a18c9972e1a1d1472fd1f7c6f39007b2f3" host="ip-172-31-28-23" Jan 13 20:09:39.146305 containerd[1934]: 2025-01-13 20:09:39.005 [INFO][6320] ipam/ipam.go 1685: Creating new handle: k8s-pod-network.b692d302c089fa9e6922c88c202828a18c9972e1a1d1472fd1f7c6f39007b2f3 Jan 13 20:09:39.146305 containerd[1934]: 2025-01-13 20:09:39.028 [INFO][6320] ipam/ipam.go 1203: Writing block in order to claim IPs block=192.168.83.128/26 handle="k8s-pod-network.b692d302c089fa9e6922c88c202828a18c9972e1a1d1472fd1f7c6f39007b2f3" host="ip-172-31-28-23" Jan 13 20:09:39.146305 containerd[1934]: 2025-01-13 20:09:39.048 [INFO][6320] ipam/ipam.go 1216: Successfully claimed IPs: [192.168.83.131/26] block=192.168.83.128/26 handle="k8s-pod-network.b692d302c089fa9e6922c88c202828a18c9972e1a1d1472fd1f7c6f39007b2f3" host="ip-172-31-28-23" Jan 13 20:09:39.146305 containerd[1934]: 2025-01-13 20:09:39.048 [INFO][6320] ipam/ipam.go 847: Auto-assigned 1 out of 1 IPv4s: [192.168.83.131/26] handle="k8s-pod-network.b692d302c089fa9e6922c88c202828a18c9972e1a1d1472fd1f7c6f39007b2f3" host="ip-172-31-28-23" Jan 13 20:09:39.146305 containerd[1934]: 2025-01-13 20:09:39.049 [INFO][6320] ipam/ipam_plugin.go 374: Released host-wide IPAM lock. Jan 13 20:09:39.146305 containerd[1934]: 2025-01-13 20:09:39.049 [INFO][6320] ipam/ipam_plugin.go 283: Calico CNI IPAM assigned addresses IPv4=[192.168.83.131/26] IPv6=[] ContainerID="b692d302c089fa9e6922c88c202828a18c9972e1a1d1472fd1f7c6f39007b2f3" HandleID="k8s-pod-network.b692d302c089fa9e6922c88c202828a18c9972e1a1d1472fd1f7c6f39007b2f3" Workload="ip--172--31--28--23-k8s-calico--apiserver--7fbffcd8cd--pxvdr-eth0" Jan 13 20:09:39.148664 containerd[1934]: 2025-01-13 20:09:39.059 [INFO][6251] cni-plugin/k8s.go 386: Populated endpoint ContainerID="b692d302c089fa9e6922c88c202828a18c9972e1a1d1472fd1f7c6f39007b2f3" Namespace="calico-apiserver" Pod="calico-apiserver-7fbffcd8cd-pxvdr" WorkloadEndpoint="ip--172--31--28--23-k8s-calico--apiserver--7fbffcd8cd--pxvdr-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--28--23-k8s-calico--apiserver--7fbffcd8cd--pxvdr-eth0", GenerateName:"calico-apiserver-7fbffcd8cd-", Namespace:"calico-apiserver", SelfLink:"", UID:"8f72f896-c0ba-4b07-9a22-acc5c8ca3697", ResourceVersion:"795", Generation:0, CreationTimestamp:time.Date(2025, time.January, 13, 20, 9, 5, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"apiserver":"true", "app.kubernetes.io/name":"calico-apiserver", "k8s-app":"calico-apiserver", "pod-template-hash":"7fbffcd8cd", "projectcalico.org/namespace":"calico-apiserver", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"calico-apiserver"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-28-23", ContainerID:"", Pod:"calico-apiserver-7fbffcd8cd-pxvdr", Endpoint:"eth0", ServiceAccountName:"calico-apiserver", IPNetworks:[]string{"192.168.83.131/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-apiserver", "ksa.calico-apiserver.calico-apiserver"}, InterfaceName:"cali3fb46b06e86", MAC:"", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil)}} Jan 13 20:09:39.148664 containerd[1934]: 2025-01-13 20:09:39.060 [INFO][6251] cni-plugin/k8s.go 387: Calico CNI using IPs: [192.168.83.131/32] ContainerID="b692d302c089fa9e6922c88c202828a18c9972e1a1d1472fd1f7c6f39007b2f3" Namespace="calico-apiserver" Pod="calico-apiserver-7fbffcd8cd-pxvdr" WorkloadEndpoint="ip--172--31--28--23-k8s-calico--apiserver--7fbffcd8cd--pxvdr-eth0" Jan 13 20:09:39.148664 containerd[1934]: 2025-01-13 20:09:39.060 [INFO][6251] cni-plugin/dataplane_linux.go 69: Setting the host side veth name to cali3fb46b06e86 ContainerID="b692d302c089fa9e6922c88c202828a18c9972e1a1d1472fd1f7c6f39007b2f3" Namespace="calico-apiserver" Pod="calico-apiserver-7fbffcd8cd-pxvdr" WorkloadEndpoint="ip--172--31--28--23-k8s-calico--apiserver--7fbffcd8cd--pxvdr-eth0" Jan 13 20:09:39.148664 containerd[1934]: 2025-01-13 20:09:39.086 [INFO][6251] cni-plugin/dataplane_linux.go 508: Disabling IPv4 forwarding ContainerID="b692d302c089fa9e6922c88c202828a18c9972e1a1d1472fd1f7c6f39007b2f3" Namespace="calico-apiserver" Pod="calico-apiserver-7fbffcd8cd-pxvdr" WorkloadEndpoint="ip--172--31--28--23-k8s-calico--apiserver--7fbffcd8cd--pxvdr-eth0" Jan 13 20:09:39.148664 containerd[1934]: 2025-01-13 20:09:39.091 [INFO][6251] cni-plugin/k8s.go 414: Added Mac, interface name, and active container ID to endpoint ContainerID="b692d302c089fa9e6922c88c202828a18c9972e1a1d1472fd1f7c6f39007b2f3" Namespace="calico-apiserver" Pod="calico-apiserver-7fbffcd8cd-pxvdr" WorkloadEndpoint="ip--172--31--28--23-k8s-calico--apiserver--7fbffcd8cd--pxvdr-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--28--23-k8s-calico--apiserver--7fbffcd8cd--pxvdr-eth0", GenerateName:"calico-apiserver-7fbffcd8cd-", Namespace:"calico-apiserver", SelfLink:"", UID:"8f72f896-c0ba-4b07-9a22-acc5c8ca3697", ResourceVersion:"795", Generation:0, CreationTimestamp:time.Date(2025, time.January, 13, 20, 9, 5, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"apiserver":"true", "app.kubernetes.io/name":"calico-apiserver", "k8s-app":"calico-apiserver", "pod-template-hash":"7fbffcd8cd", "projectcalico.org/namespace":"calico-apiserver", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"calico-apiserver"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-28-23", ContainerID:"b692d302c089fa9e6922c88c202828a18c9972e1a1d1472fd1f7c6f39007b2f3", Pod:"calico-apiserver-7fbffcd8cd-pxvdr", Endpoint:"eth0", ServiceAccountName:"calico-apiserver", IPNetworks:[]string{"192.168.83.131/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-apiserver", "ksa.calico-apiserver.calico-apiserver"}, InterfaceName:"cali3fb46b06e86", MAC:"5a:b7:8f:4a:9d:fc", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil)}} Jan 13 20:09:39.148664 containerd[1934]: 2025-01-13 20:09:39.130 [INFO][6251] cni-plugin/k8s.go 500: Wrote updated endpoint to datastore ContainerID="b692d302c089fa9e6922c88c202828a18c9972e1a1d1472fd1f7c6f39007b2f3" Namespace="calico-apiserver" Pod="calico-apiserver-7fbffcd8cd-pxvdr" WorkloadEndpoint="ip--172--31--28--23-k8s-calico--apiserver--7fbffcd8cd--pxvdr-eth0" Jan 13 20:09:39.195135 systemd[1]: Started cri-containerd-e833d2506996e35fb87ff0ca7879ff2165ff0ef66d6acb92e961f47ee12eab64.scope - libcontainer container e833d2506996e35fb87ff0ca7879ff2165ff0ef66d6acb92e961f47ee12eab64. Jan 13 20:09:39.230149 systemd[1]: Started cri-containerd-98b2148f179f527ed06a30e4a81178bc222ffda23d6ad0a11ad6187295bf0f5b.scope - libcontainer container 98b2148f179f527ed06a30e4a81178bc222ffda23d6ad0a11ad6187295bf0f5b. Jan 13 20:09:39.263346 systemd-networkd[1804]: cali2b48a0390e0: Link UP Jan 13 20:09:39.265264 systemd-networkd[1804]: cali2b48a0390e0: Gained carrier Jan 13 20:09:39.316541 containerd[1934]: 2025-01-13 20:09:38.006 [INFO][6260] cni-plugin/utils.go 100: File /var/lib/calico/mtu does not exist Jan 13 20:09:39.316541 containerd[1934]: 2025-01-13 20:09:38.205 [INFO][6260] cni-plugin/plugin.go 325: Calico CNI found existing endpoint: &{{WorkloadEndpoint projectcalico.org/v3} {ip--172--31--28--23-k8s-calico--kube--controllers--68f76c7ddf--lh8nj-eth0 calico-kube-controllers-68f76c7ddf- calico-system 2be21c11-9c2d-4b9a-81a5-0e73daba31c1 793 0 2025-01-13 20:09:06 +0000 UTC map[app.kubernetes.io/name:calico-kube-controllers k8s-app:calico-kube-controllers pod-template-hash:68f76c7ddf projectcalico.org/namespace:calico-system projectcalico.org/orchestrator:k8s projectcalico.org/serviceaccount:calico-kube-controllers] map[] [] [] []} {k8s ip-172-31-28-23 calico-kube-controllers-68f76c7ddf-lh8nj eth0 calico-kube-controllers [] [] [kns.calico-system ksa.calico-system.calico-kube-controllers] cali2b48a0390e0 [] []}} ContainerID="0e75aaa0753893d7d7adef9b7ea941a9a377d4cf79b12b271802261abc39b658" Namespace="calico-system" Pod="calico-kube-controllers-68f76c7ddf-lh8nj" WorkloadEndpoint="ip--172--31--28--23-k8s-calico--kube--controllers--68f76c7ddf--lh8nj-" Jan 13 20:09:39.316541 containerd[1934]: 2025-01-13 20:09:38.208 [INFO][6260] cni-plugin/k8s.go 77: Extracted identifiers for CmdAddK8s ContainerID="0e75aaa0753893d7d7adef9b7ea941a9a377d4cf79b12b271802261abc39b658" Namespace="calico-system" Pod="calico-kube-controllers-68f76c7ddf-lh8nj" WorkloadEndpoint="ip--172--31--28--23-k8s-calico--kube--controllers--68f76c7ddf--lh8nj-eth0" Jan 13 20:09:39.316541 containerd[1934]: 2025-01-13 20:09:38.659 [INFO][6319] ipam/ipam_plugin.go 225: Calico CNI IPAM request count IPv4=1 IPv6=0 ContainerID="0e75aaa0753893d7d7adef9b7ea941a9a377d4cf79b12b271802261abc39b658" HandleID="k8s-pod-network.0e75aaa0753893d7d7adef9b7ea941a9a377d4cf79b12b271802261abc39b658" Workload="ip--172--31--28--23-k8s-calico--kube--controllers--68f76c7ddf--lh8nj-eth0" Jan 13 20:09:39.316541 containerd[1934]: 2025-01-13 20:09:38.771 [INFO][6319] ipam/ipam_plugin.go 265: Auto assigning IP ContainerID="0e75aaa0753893d7d7adef9b7ea941a9a377d4cf79b12b271802261abc39b658" HandleID="k8s-pod-network.0e75aaa0753893d7d7adef9b7ea941a9a377d4cf79b12b271802261abc39b658" Workload="ip--172--31--28--23-k8s-calico--kube--controllers--68f76c7ddf--lh8nj-eth0" assignArgs=ipam.AutoAssignArgs{Num4:1, Num6:0, HandleID:(*string)(0x400011a900), Attrs:map[string]string{"namespace":"calico-system", "node":"ip-172-31-28-23", "pod":"calico-kube-controllers-68f76c7ddf-lh8nj", "timestamp":"2025-01-13 20:09:38.659131226 +0000 UTC"}, Hostname:"ip-172-31-28-23", IPv4Pools:[]net.IPNet{}, IPv6Pools:[]net.IPNet{}, MaxBlocksPerHost:0, HostReservedAttrIPv4s:(*ipam.HostReservedAttr)(nil), HostReservedAttrIPv6s:(*ipam.HostReservedAttr)(nil), IntendedUse:"Workload"} Jan 13 20:09:39.316541 containerd[1934]: 2025-01-13 20:09:38.771 [INFO][6319] ipam/ipam_plugin.go 353: About to acquire host-wide IPAM lock. Jan 13 20:09:39.316541 containerd[1934]: 2025-01-13 20:09:39.049 [INFO][6319] ipam/ipam_plugin.go 368: Acquired host-wide IPAM lock. Jan 13 20:09:39.316541 containerd[1934]: 2025-01-13 20:09:39.050 [INFO][6319] ipam/ipam.go 107: Auto-assign 1 ipv4, 0 ipv6 addrs for host 'ip-172-31-28-23' Jan 13 20:09:39.316541 containerd[1934]: 2025-01-13 20:09:39.059 [INFO][6319] ipam/ipam.go 660: Looking up existing affinities for host handle="k8s-pod-network.0e75aaa0753893d7d7adef9b7ea941a9a377d4cf79b12b271802261abc39b658" host="ip-172-31-28-23" Jan 13 20:09:39.316541 containerd[1934]: 2025-01-13 20:09:39.108 [INFO][6319] ipam/ipam.go 372: Looking up existing affinities for host host="ip-172-31-28-23" Jan 13 20:09:39.316541 containerd[1934]: 2025-01-13 20:09:39.137 [INFO][6319] ipam/ipam.go 489: Trying affinity for 192.168.83.128/26 host="ip-172-31-28-23" Jan 13 20:09:39.316541 containerd[1934]: 2025-01-13 20:09:39.145 [INFO][6319] ipam/ipam.go 155: Attempting to load block cidr=192.168.83.128/26 host="ip-172-31-28-23" Jan 13 20:09:39.316541 containerd[1934]: 2025-01-13 20:09:39.155 [INFO][6319] ipam/ipam.go 232: Affinity is confirmed and block has been loaded cidr=192.168.83.128/26 host="ip-172-31-28-23" Jan 13 20:09:39.316541 containerd[1934]: 2025-01-13 20:09:39.155 [INFO][6319] ipam/ipam.go 1180: Attempting to assign 1 addresses from block block=192.168.83.128/26 handle="k8s-pod-network.0e75aaa0753893d7d7adef9b7ea941a9a377d4cf79b12b271802261abc39b658" host="ip-172-31-28-23" Jan 13 20:09:39.316541 containerd[1934]: 2025-01-13 20:09:39.164 [INFO][6319] ipam/ipam.go 1685: Creating new handle: k8s-pod-network.0e75aaa0753893d7d7adef9b7ea941a9a377d4cf79b12b271802261abc39b658 Jan 13 20:09:39.316541 containerd[1934]: 2025-01-13 20:09:39.199 [INFO][6319] ipam/ipam.go 1203: Writing block in order to claim IPs block=192.168.83.128/26 handle="k8s-pod-network.0e75aaa0753893d7d7adef9b7ea941a9a377d4cf79b12b271802261abc39b658" host="ip-172-31-28-23" Jan 13 20:09:39.316541 containerd[1934]: 2025-01-13 20:09:39.234 [INFO][6319] ipam/ipam.go 1216: Successfully claimed IPs: [192.168.83.132/26] block=192.168.83.128/26 handle="k8s-pod-network.0e75aaa0753893d7d7adef9b7ea941a9a377d4cf79b12b271802261abc39b658" host="ip-172-31-28-23" Jan 13 20:09:39.316541 containerd[1934]: 2025-01-13 20:09:39.237 [INFO][6319] ipam/ipam.go 847: Auto-assigned 1 out of 1 IPv4s: [192.168.83.132/26] handle="k8s-pod-network.0e75aaa0753893d7d7adef9b7ea941a9a377d4cf79b12b271802261abc39b658" host="ip-172-31-28-23" Jan 13 20:09:39.316541 containerd[1934]: 2025-01-13 20:09:39.237 [INFO][6319] ipam/ipam_plugin.go 374: Released host-wide IPAM lock. Jan 13 20:09:39.316541 containerd[1934]: 2025-01-13 20:09:39.238 [INFO][6319] ipam/ipam_plugin.go 283: Calico CNI IPAM assigned addresses IPv4=[192.168.83.132/26] IPv6=[] ContainerID="0e75aaa0753893d7d7adef9b7ea941a9a377d4cf79b12b271802261abc39b658" HandleID="k8s-pod-network.0e75aaa0753893d7d7adef9b7ea941a9a377d4cf79b12b271802261abc39b658" Workload="ip--172--31--28--23-k8s-calico--kube--controllers--68f76c7ddf--lh8nj-eth0" Jan 13 20:09:39.320103 containerd[1934]: 2025-01-13 20:09:39.250 [INFO][6260] cni-plugin/k8s.go 386: Populated endpoint ContainerID="0e75aaa0753893d7d7adef9b7ea941a9a377d4cf79b12b271802261abc39b658" Namespace="calico-system" Pod="calico-kube-controllers-68f76c7ddf-lh8nj" WorkloadEndpoint="ip--172--31--28--23-k8s-calico--kube--controllers--68f76c7ddf--lh8nj-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--28--23-k8s-calico--kube--controllers--68f76c7ddf--lh8nj-eth0", GenerateName:"calico-kube-controllers-68f76c7ddf-", Namespace:"calico-system", SelfLink:"", UID:"2be21c11-9c2d-4b9a-81a5-0e73daba31c1", ResourceVersion:"793", Generation:0, CreationTimestamp:time.Date(2025, time.January, 13, 20, 9, 6, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app.kubernetes.io/name":"calico-kube-controllers", "k8s-app":"calico-kube-controllers", "pod-template-hash":"68f76c7ddf", "projectcalico.org/namespace":"calico-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"calico-kube-controllers"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-28-23", ContainerID:"", Pod:"calico-kube-controllers-68f76c7ddf-lh8nj", Endpoint:"eth0", ServiceAccountName:"calico-kube-controllers", IPNetworks:[]string{"192.168.83.132/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-system", "ksa.calico-system.calico-kube-controllers"}, InterfaceName:"cali2b48a0390e0", MAC:"", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil)}} Jan 13 20:09:39.320103 containerd[1934]: 2025-01-13 20:09:39.250 [INFO][6260] cni-plugin/k8s.go 387: Calico CNI using IPs: [192.168.83.132/32] ContainerID="0e75aaa0753893d7d7adef9b7ea941a9a377d4cf79b12b271802261abc39b658" Namespace="calico-system" Pod="calico-kube-controllers-68f76c7ddf-lh8nj" WorkloadEndpoint="ip--172--31--28--23-k8s-calico--kube--controllers--68f76c7ddf--lh8nj-eth0" Jan 13 20:09:39.320103 containerd[1934]: 2025-01-13 20:09:39.251 [INFO][6260] cni-plugin/dataplane_linux.go 69: Setting the host side veth name to cali2b48a0390e0 ContainerID="0e75aaa0753893d7d7adef9b7ea941a9a377d4cf79b12b271802261abc39b658" Namespace="calico-system" Pod="calico-kube-controllers-68f76c7ddf-lh8nj" WorkloadEndpoint="ip--172--31--28--23-k8s-calico--kube--controllers--68f76c7ddf--lh8nj-eth0" Jan 13 20:09:39.320103 containerd[1934]: 2025-01-13 20:09:39.265 [INFO][6260] cni-plugin/dataplane_linux.go 508: Disabling IPv4 forwarding ContainerID="0e75aaa0753893d7d7adef9b7ea941a9a377d4cf79b12b271802261abc39b658" Namespace="calico-system" Pod="calico-kube-controllers-68f76c7ddf-lh8nj" WorkloadEndpoint="ip--172--31--28--23-k8s-calico--kube--controllers--68f76c7ddf--lh8nj-eth0" Jan 13 20:09:39.320103 containerd[1934]: 2025-01-13 20:09:39.269 [INFO][6260] cni-plugin/k8s.go 414: Added Mac, interface name, and active container ID to endpoint ContainerID="0e75aaa0753893d7d7adef9b7ea941a9a377d4cf79b12b271802261abc39b658" Namespace="calico-system" Pod="calico-kube-controllers-68f76c7ddf-lh8nj" WorkloadEndpoint="ip--172--31--28--23-k8s-calico--kube--controllers--68f76c7ddf--lh8nj-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--28--23-k8s-calico--kube--controllers--68f76c7ddf--lh8nj-eth0", GenerateName:"calico-kube-controllers-68f76c7ddf-", Namespace:"calico-system", SelfLink:"", UID:"2be21c11-9c2d-4b9a-81a5-0e73daba31c1", ResourceVersion:"793", Generation:0, CreationTimestamp:time.Date(2025, time.January, 13, 20, 9, 6, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app.kubernetes.io/name":"calico-kube-controllers", "k8s-app":"calico-kube-controllers", "pod-template-hash":"68f76c7ddf", "projectcalico.org/namespace":"calico-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"calico-kube-controllers"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-28-23", ContainerID:"0e75aaa0753893d7d7adef9b7ea941a9a377d4cf79b12b271802261abc39b658", Pod:"calico-kube-controllers-68f76c7ddf-lh8nj", Endpoint:"eth0", ServiceAccountName:"calico-kube-controllers", IPNetworks:[]string{"192.168.83.132/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-system", "ksa.calico-system.calico-kube-controllers"}, InterfaceName:"cali2b48a0390e0", MAC:"9a:16:fb:f9:57:6e", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil)}} Jan 13 20:09:39.320103 containerd[1934]: 2025-01-13 20:09:39.306 [INFO][6260] cni-plugin/k8s.go 500: Wrote updated endpoint to datastore ContainerID="0e75aaa0753893d7d7adef9b7ea941a9a377d4cf79b12b271802261abc39b658" Namespace="calico-system" Pod="calico-kube-controllers-68f76c7ddf-lh8nj" WorkloadEndpoint="ip--172--31--28--23-k8s-calico--kube--controllers--68f76c7ddf--lh8nj-eth0" Jan 13 20:09:39.344737 containerd[1934]: time="2025-01-13T20:09:39.342630362Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1 Jan 13 20:09:39.344737 containerd[1934]: time="2025-01-13T20:09:39.342874730Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1 Jan 13 20:09:39.344737 containerd[1934]: time="2025-01-13T20:09:39.342917870Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Jan 13 20:09:39.344737 containerd[1934]: time="2025-01-13T20:09:39.343518542Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Jan 13 20:09:39.463053 systemd-networkd[1804]: cali4e98ae0f161: Link UP Jan 13 20:09:39.498367 systemd-networkd[1804]: cali4e98ae0f161: Gained carrier Jan 13 20:09:39.531448 containerd[1934]: time="2025-01-13T20:09:39.531189927Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-76f75df574-8wp6k,Uid:87115657-f395-40ec-89ea-3d7835119c3a,Namespace:kube-system,Attempt:10,} returns sandbox id \"e833d2506996e35fb87ff0ca7879ff2165ff0ef66d6acb92e961f47ee12eab64\"" Jan 13 20:09:39.560716 containerd[1934]: time="2025-01-13T20:09:39.559260315Z" level=info msg="CreateContainer within sandbox \"e833d2506996e35fb87ff0ca7879ff2165ff0ef66d6acb92e961f47ee12eab64\" for container &ContainerMetadata{Name:coredns,Attempt:0,}" Jan 13 20:09:39.559723 systemd[1]: Started cri-containerd-b692d302c089fa9e6922c88c202828a18c9972e1a1d1472fd1f7c6f39007b2f3.scope - libcontainer container b692d302c089fa9e6922c88c202828a18c9972e1a1d1472fd1f7c6f39007b2f3. Jan 13 20:09:39.579616 containerd[1934]: 2025-01-13 20:09:38.140 [INFO][6274] cni-plugin/utils.go 100: File /var/lib/calico/mtu does not exist Jan 13 20:09:39.579616 containerd[1934]: 2025-01-13 20:09:38.280 [INFO][6274] cni-plugin/plugin.go 325: Calico CNI found existing endpoint: &{{WorkloadEndpoint projectcalico.org/v3} {ip--172--31--28--23-k8s-coredns--76f75df574--mkr2l-eth0 coredns-76f75df574- kube-system 396e30c8-d221-410a-89fe-e353ba8cddbf 791 0 2025-01-13 20:08:44 +0000 UTC map[k8s-app:kube-dns pod-template-hash:76f75df574 projectcalico.org/namespace:kube-system projectcalico.org/orchestrator:k8s projectcalico.org/serviceaccount:coredns] map[] [] [] []} {k8s ip-172-31-28-23 coredns-76f75df574-mkr2l eth0 coredns [] [] [kns.kube-system ksa.kube-system.coredns] cali4e98ae0f161 [{dns UDP 53 0 } {dns-tcp TCP 53 0 } {metrics TCP 9153 0 }] []}} ContainerID="c3f52203f6560b2c8f7e82f87a7613af2871e81b52fd7c1e83123731a5e1713f" Namespace="kube-system" Pod="coredns-76f75df574-mkr2l" WorkloadEndpoint="ip--172--31--28--23-k8s-coredns--76f75df574--mkr2l-" Jan 13 20:09:39.579616 containerd[1934]: 2025-01-13 20:09:38.280 [INFO][6274] cni-plugin/k8s.go 77: Extracted identifiers for CmdAddK8s ContainerID="c3f52203f6560b2c8f7e82f87a7613af2871e81b52fd7c1e83123731a5e1713f" Namespace="kube-system" Pod="coredns-76f75df574-mkr2l" WorkloadEndpoint="ip--172--31--28--23-k8s-coredns--76f75df574--mkr2l-eth0" Jan 13 20:09:39.579616 containerd[1934]: 2025-01-13 20:09:38.746 [INFO][6333] ipam/ipam_plugin.go 225: Calico CNI IPAM request count IPv4=1 IPv6=0 ContainerID="c3f52203f6560b2c8f7e82f87a7613af2871e81b52fd7c1e83123731a5e1713f" HandleID="k8s-pod-network.c3f52203f6560b2c8f7e82f87a7613af2871e81b52fd7c1e83123731a5e1713f" Workload="ip--172--31--28--23-k8s-coredns--76f75df574--mkr2l-eth0" Jan 13 20:09:39.579616 containerd[1934]: 2025-01-13 20:09:38.795 [INFO][6333] ipam/ipam_plugin.go 265: Auto assigning IP ContainerID="c3f52203f6560b2c8f7e82f87a7613af2871e81b52fd7c1e83123731a5e1713f" HandleID="k8s-pod-network.c3f52203f6560b2c8f7e82f87a7613af2871e81b52fd7c1e83123731a5e1713f" Workload="ip--172--31--28--23-k8s-coredns--76f75df574--mkr2l-eth0" assignArgs=ipam.AutoAssignArgs{Num4:1, Num6:0, HandleID:(*string)(0x40003acfb0), Attrs:map[string]string{"namespace":"kube-system", "node":"ip-172-31-28-23", "pod":"coredns-76f75df574-mkr2l", "timestamp":"2025-01-13 20:09:38.746709639 +0000 UTC"}, Hostname:"ip-172-31-28-23", IPv4Pools:[]net.IPNet{}, IPv6Pools:[]net.IPNet{}, MaxBlocksPerHost:0, HostReservedAttrIPv4s:(*ipam.HostReservedAttr)(nil), HostReservedAttrIPv6s:(*ipam.HostReservedAttr)(nil), IntendedUse:"Workload"} Jan 13 20:09:39.579616 containerd[1934]: 2025-01-13 20:09:38.795 [INFO][6333] ipam/ipam_plugin.go 353: About to acquire host-wide IPAM lock. Jan 13 20:09:39.579616 containerd[1934]: 2025-01-13 20:09:39.243 [INFO][6333] ipam/ipam_plugin.go 368: Acquired host-wide IPAM lock. Jan 13 20:09:39.579616 containerd[1934]: 2025-01-13 20:09:39.244 [INFO][6333] ipam/ipam.go 107: Auto-assign 1 ipv4, 0 ipv6 addrs for host 'ip-172-31-28-23' Jan 13 20:09:39.579616 containerd[1934]: 2025-01-13 20:09:39.256 [INFO][6333] ipam/ipam.go 660: Looking up existing affinities for host handle="k8s-pod-network.c3f52203f6560b2c8f7e82f87a7613af2871e81b52fd7c1e83123731a5e1713f" host="ip-172-31-28-23" Jan 13 20:09:39.579616 containerd[1934]: 2025-01-13 20:09:39.285 [INFO][6333] ipam/ipam.go 372: Looking up existing affinities for host host="ip-172-31-28-23" Jan 13 20:09:39.579616 containerd[1934]: 2025-01-13 20:09:39.301 [INFO][6333] ipam/ipam.go 489: Trying affinity for 192.168.83.128/26 host="ip-172-31-28-23" Jan 13 20:09:39.579616 containerd[1934]: 2025-01-13 20:09:39.322 [INFO][6333] ipam/ipam.go 155: Attempting to load block cidr=192.168.83.128/26 host="ip-172-31-28-23" Jan 13 20:09:39.579616 containerd[1934]: 2025-01-13 20:09:39.335 [INFO][6333] ipam/ipam.go 232: Affinity is confirmed and block has been loaded cidr=192.168.83.128/26 host="ip-172-31-28-23" Jan 13 20:09:39.579616 containerd[1934]: 2025-01-13 20:09:39.335 [INFO][6333] ipam/ipam.go 1180: Attempting to assign 1 addresses from block block=192.168.83.128/26 handle="k8s-pod-network.c3f52203f6560b2c8f7e82f87a7613af2871e81b52fd7c1e83123731a5e1713f" host="ip-172-31-28-23" Jan 13 20:09:39.579616 containerd[1934]: 2025-01-13 20:09:39.348 [INFO][6333] ipam/ipam.go 1685: Creating new handle: k8s-pod-network.c3f52203f6560b2c8f7e82f87a7613af2871e81b52fd7c1e83123731a5e1713f Jan 13 20:09:39.579616 containerd[1934]: 2025-01-13 20:09:39.401 [INFO][6333] ipam/ipam.go 1203: Writing block in order to claim IPs block=192.168.83.128/26 handle="k8s-pod-network.c3f52203f6560b2c8f7e82f87a7613af2871e81b52fd7c1e83123731a5e1713f" host="ip-172-31-28-23" Jan 13 20:09:39.579616 containerd[1934]: 2025-01-13 20:09:39.433 [INFO][6333] ipam/ipam.go 1216: Successfully claimed IPs: [192.168.83.133/26] block=192.168.83.128/26 handle="k8s-pod-network.c3f52203f6560b2c8f7e82f87a7613af2871e81b52fd7c1e83123731a5e1713f" host="ip-172-31-28-23" Jan 13 20:09:39.579616 containerd[1934]: 2025-01-13 20:09:39.434 [INFO][6333] ipam/ipam.go 847: Auto-assigned 1 out of 1 IPv4s: [192.168.83.133/26] handle="k8s-pod-network.c3f52203f6560b2c8f7e82f87a7613af2871e81b52fd7c1e83123731a5e1713f" host="ip-172-31-28-23" Jan 13 20:09:39.579616 containerd[1934]: 2025-01-13 20:09:39.434 [INFO][6333] ipam/ipam_plugin.go 374: Released host-wide IPAM lock. Jan 13 20:09:39.579616 containerd[1934]: 2025-01-13 20:09:39.434 [INFO][6333] ipam/ipam_plugin.go 283: Calico CNI IPAM assigned addresses IPv4=[192.168.83.133/26] IPv6=[] ContainerID="c3f52203f6560b2c8f7e82f87a7613af2871e81b52fd7c1e83123731a5e1713f" HandleID="k8s-pod-network.c3f52203f6560b2c8f7e82f87a7613af2871e81b52fd7c1e83123731a5e1713f" Workload="ip--172--31--28--23-k8s-coredns--76f75df574--mkr2l-eth0" Jan 13 20:09:39.583980 containerd[1934]: 2025-01-13 20:09:39.440 [INFO][6274] cni-plugin/k8s.go 386: Populated endpoint ContainerID="c3f52203f6560b2c8f7e82f87a7613af2871e81b52fd7c1e83123731a5e1713f" Namespace="kube-system" Pod="coredns-76f75df574-mkr2l" WorkloadEndpoint="ip--172--31--28--23-k8s-coredns--76f75df574--mkr2l-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--28--23-k8s-coredns--76f75df574--mkr2l-eth0", GenerateName:"coredns-76f75df574-", Namespace:"kube-system", SelfLink:"", UID:"396e30c8-d221-410a-89fe-e353ba8cddbf", ResourceVersion:"791", Generation:0, CreationTimestamp:time.Date(2025, time.January, 13, 20, 8, 44, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-dns", "pod-template-hash":"76f75df574", "projectcalico.org/namespace":"kube-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"coredns"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-28-23", ContainerID:"", Pod:"coredns-76f75df574-mkr2l", Endpoint:"eth0", ServiceAccountName:"coredns", IPNetworks:[]string{"192.168.83.133/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.kube-system", "ksa.kube-system.coredns"}, InterfaceName:"cali4e98ae0f161", MAC:"", Ports:[]v3.WorkloadEndpointPort{v3.WorkloadEndpointPort{Name:"dns", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"UDP"}, Port:0x35, HostPort:0x0, HostIP:""}, v3.WorkloadEndpointPort{Name:"dns-tcp", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"TCP"}, Port:0x35, HostPort:0x0, HostIP:""}, v3.WorkloadEndpointPort{Name:"metrics", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"TCP"}, Port:0x23c1, HostPort:0x0, HostIP:""}}, AllowSpoofedSourcePrefixes:[]string(nil)}} Jan 13 20:09:39.583980 containerd[1934]: 2025-01-13 20:09:39.440 [INFO][6274] cni-plugin/k8s.go 387: Calico CNI using IPs: [192.168.83.133/32] ContainerID="c3f52203f6560b2c8f7e82f87a7613af2871e81b52fd7c1e83123731a5e1713f" Namespace="kube-system" Pod="coredns-76f75df574-mkr2l" WorkloadEndpoint="ip--172--31--28--23-k8s-coredns--76f75df574--mkr2l-eth0" Jan 13 20:09:39.583980 containerd[1934]: 2025-01-13 20:09:39.441 [INFO][6274] cni-plugin/dataplane_linux.go 69: Setting the host side veth name to cali4e98ae0f161 ContainerID="c3f52203f6560b2c8f7e82f87a7613af2871e81b52fd7c1e83123731a5e1713f" Namespace="kube-system" Pod="coredns-76f75df574-mkr2l" WorkloadEndpoint="ip--172--31--28--23-k8s-coredns--76f75df574--mkr2l-eth0" Jan 13 20:09:39.583980 containerd[1934]: 2025-01-13 20:09:39.522 [INFO][6274] cni-plugin/dataplane_linux.go 508: Disabling IPv4 forwarding ContainerID="c3f52203f6560b2c8f7e82f87a7613af2871e81b52fd7c1e83123731a5e1713f" Namespace="kube-system" Pod="coredns-76f75df574-mkr2l" WorkloadEndpoint="ip--172--31--28--23-k8s-coredns--76f75df574--mkr2l-eth0" Jan 13 20:09:39.583980 containerd[1934]: 2025-01-13 20:09:39.524 [INFO][6274] cni-plugin/k8s.go 414: Added Mac, interface name, and active container ID to endpoint ContainerID="c3f52203f6560b2c8f7e82f87a7613af2871e81b52fd7c1e83123731a5e1713f" Namespace="kube-system" Pod="coredns-76f75df574-mkr2l" WorkloadEndpoint="ip--172--31--28--23-k8s-coredns--76f75df574--mkr2l-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--28--23-k8s-coredns--76f75df574--mkr2l-eth0", GenerateName:"coredns-76f75df574-", Namespace:"kube-system", SelfLink:"", UID:"396e30c8-d221-410a-89fe-e353ba8cddbf", ResourceVersion:"791", Generation:0, CreationTimestamp:time.Date(2025, time.January, 13, 20, 8, 44, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-dns", "pod-template-hash":"76f75df574", "projectcalico.org/namespace":"kube-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"coredns"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-28-23", ContainerID:"c3f52203f6560b2c8f7e82f87a7613af2871e81b52fd7c1e83123731a5e1713f", Pod:"coredns-76f75df574-mkr2l", Endpoint:"eth0", ServiceAccountName:"coredns", IPNetworks:[]string{"192.168.83.133/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.kube-system", "ksa.kube-system.coredns"}, InterfaceName:"cali4e98ae0f161", MAC:"2e:da:47:65:8a:4d", Ports:[]v3.WorkloadEndpointPort{v3.WorkloadEndpointPort{Name:"dns", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"UDP"}, Port:0x35, HostPort:0x0, HostIP:""}, v3.WorkloadEndpointPort{Name:"dns-tcp", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"TCP"}, Port:0x35, HostPort:0x0, HostIP:""}, v3.WorkloadEndpointPort{Name:"metrics", Protocol:numorstring.Protocol{Type:1, NumVal:0x0, StrVal:"TCP"}, Port:0x23c1, HostPort:0x0, HostIP:""}}, AllowSpoofedSourcePrefixes:[]string(nil)}} Jan 13 20:09:39.583980 containerd[1934]: 2025-01-13 20:09:39.572 [INFO][6274] cni-plugin/k8s.go 500: Wrote updated endpoint to datastore ContainerID="c3f52203f6560b2c8f7e82f87a7613af2871e81b52fd7c1e83123731a5e1713f" Namespace="kube-system" Pod="coredns-76f75df574-mkr2l" WorkloadEndpoint="ip--172--31--28--23-k8s-coredns--76f75df574--mkr2l-eth0" Jan 13 20:09:39.602882 containerd[1934]: time="2025-01-13T20:09:39.601525515Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1 Jan 13 20:09:39.602882 containerd[1934]: time="2025-01-13T20:09:39.602534751Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1 Jan 13 20:09:39.606044 containerd[1934]: time="2025-01-13T20:09:39.604937331Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Jan 13 20:09:39.615464 containerd[1934]: time="2025-01-13T20:09:39.607400871Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Jan 13 20:09:39.661193 systemd[1]: Started cri-containerd-0e75aaa0753893d7d7adef9b7ea941a9a377d4cf79b12b271802261abc39b658.scope - libcontainer container 0e75aaa0753893d7d7adef9b7ea941a9a377d4cf79b12b271802261abc39b658. Jan 13 20:09:39.697613 containerd[1934]: time="2025-01-13T20:09:39.696564412Z" level=info msg="CreateContainer within sandbox \"e833d2506996e35fb87ff0ca7879ff2165ff0ef66d6acb92e961f47ee12eab64\" for &ContainerMetadata{Name:coredns,Attempt:0,} returns container id \"3807286ca7e77b2e15c0203e6a52af4c1859901f88895c137b30514a621b0308\"" Jan 13 20:09:39.708817 containerd[1934]: time="2025-01-13T20:09:39.704259172Z" level=info msg="StartContainer for \"3807286ca7e77b2e15c0203e6a52af4c1859901f88895c137b30514a621b0308\"" Jan 13 20:09:39.707240 systemd-networkd[1804]: cali926eef7d1a9: Link UP Jan 13 20:09:39.707696 systemd-networkd[1804]: cali926eef7d1a9: Gained carrier Jan 13 20:09:39.772652 containerd[1934]: 2025-01-13 20:09:38.373 [INFO][6286] cni-plugin/utils.go 100: File /var/lib/calico/mtu does not exist Jan 13 20:09:39.772652 containerd[1934]: 2025-01-13 20:09:38.529 [INFO][6286] cni-plugin/plugin.go 325: Calico CNI found existing endpoint: &{{WorkloadEndpoint projectcalico.org/v3} {ip--172--31--28--23-k8s-csi--node--driver--wq54r-eth0 csi-node-driver- calico-system d47fc662-eff9-4473-83da-b6f0b896d81f 646 0 2025-01-13 20:09:06 +0000 UTC map[app.kubernetes.io/name:csi-node-driver controller-revision-hash:55b695c467 k8s-app:csi-node-driver name:csi-node-driver pod-template-generation:1 projectcalico.org/namespace:calico-system projectcalico.org/orchestrator:k8s projectcalico.org/serviceaccount:csi-node-driver] map[] [] [] []} {k8s ip-172-31-28-23 csi-node-driver-wq54r eth0 csi-node-driver [] [] [kns.calico-system ksa.calico-system.csi-node-driver] cali926eef7d1a9 [] []}} ContainerID="7e02f8d5186f2e48a411f12daf97b8da0b78e93e92ffcc5c423fc9a7cd727c14" Namespace="calico-system" Pod="csi-node-driver-wq54r" WorkloadEndpoint="ip--172--31--28--23-k8s-csi--node--driver--wq54r-" Jan 13 20:09:39.772652 containerd[1934]: 2025-01-13 20:09:38.529 [INFO][6286] cni-plugin/k8s.go 77: Extracted identifiers for CmdAddK8s ContainerID="7e02f8d5186f2e48a411f12daf97b8da0b78e93e92ffcc5c423fc9a7cd727c14" Namespace="calico-system" Pod="csi-node-driver-wq54r" WorkloadEndpoint="ip--172--31--28--23-k8s-csi--node--driver--wq54r-eth0" Jan 13 20:09:39.772652 containerd[1934]: 2025-01-13 20:09:38.759 [INFO][6344] ipam/ipam_plugin.go 225: Calico CNI IPAM request count IPv4=1 IPv6=0 ContainerID="7e02f8d5186f2e48a411f12daf97b8da0b78e93e92ffcc5c423fc9a7cd727c14" HandleID="k8s-pod-network.7e02f8d5186f2e48a411f12daf97b8da0b78e93e92ffcc5c423fc9a7cd727c14" Workload="ip--172--31--28--23-k8s-csi--node--driver--wq54r-eth0" Jan 13 20:09:39.772652 containerd[1934]: 2025-01-13 20:09:38.801 [INFO][6344] ipam/ipam_plugin.go 265: Auto assigning IP ContainerID="7e02f8d5186f2e48a411f12daf97b8da0b78e93e92ffcc5c423fc9a7cd727c14" HandleID="k8s-pod-network.7e02f8d5186f2e48a411f12daf97b8da0b78e93e92ffcc5c423fc9a7cd727c14" Workload="ip--172--31--28--23-k8s-csi--node--driver--wq54r-eth0" assignArgs=ipam.AutoAssignArgs{Num4:1, Num6:0, HandleID:(*string)(0x400004cc70), Attrs:map[string]string{"namespace":"calico-system", "node":"ip-172-31-28-23", "pod":"csi-node-driver-wq54r", "timestamp":"2025-01-13 20:09:38.758847399 +0000 UTC"}, Hostname:"ip-172-31-28-23", IPv4Pools:[]net.IPNet{}, IPv6Pools:[]net.IPNet{}, MaxBlocksPerHost:0, HostReservedAttrIPv4s:(*ipam.HostReservedAttr)(nil), HostReservedAttrIPv6s:(*ipam.HostReservedAttr)(nil), IntendedUse:"Workload"} Jan 13 20:09:39.772652 containerd[1934]: 2025-01-13 20:09:38.802 [INFO][6344] ipam/ipam_plugin.go 353: About to acquire host-wide IPAM lock. Jan 13 20:09:39.772652 containerd[1934]: 2025-01-13 20:09:39.434 [INFO][6344] ipam/ipam_plugin.go 368: Acquired host-wide IPAM lock. Jan 13 20:09:39.772652 containerd[1934]: 2025-01-13 20:09:39.436 [INFO][6344] ipam/ipam.go 107: Auto-assign 1 ipv4, 0 ipv6 addrs for host 'ip-172-31-28-23' Jan 13 20:09:39.772652 containerd[1934]: 2025-01-13 20:09:39.445 [INFO][6344] ipam/ipam.go 660: Looking up existing affinities for host handle="k8s-pod-network.7e02f8d5186f2e48a411f12daf97b8da0b78e93e92ffcc5c423fc9a7cd727c14" host="ip-172-31-28-23" Jan 13 20:09:39.772652 containerd[1934]: 2025-01-13 20:09:39.474 [INFO][6344] ipam/ipam.go 372: Looking up existing affinities for host host="ip-172-31-28-23" Jan 13 20:09:39.772652 containerd[1934]: 2025-01-13 20:09:39.537 [INFO][6344] ipam/ipam.go 489: Trying affinity for 192.168.83.128/26 host="ip-172-31-28-23" Jan 13 20:09:39.772652 containerd[1934]: 2025-01-13 20:09:39.568 [INFO][6344] ipam/ipam.go 155: Attempting to load block cidr=192.168.83.128/26 host="ip-172-31-28-23" Jan 13 20:09:39.772652 containerd[1934]: 2025-01-13 20:09:39.585 [INFO][6344] ipam/ipam.go 232: Affinity is confirmed and block has been loaded cidr=192.168.83.128/26 host="ip-172-31-28-23" Jan 13 20:09:39.772652 containerd[1934]: 2025-01-13 20:09:39.586 [INFO][6344] ipam/ipam.go 1180: Attempting to assign 1 addresses from block block=192.168.83.128/26 handle="k8s-pod-network.7e02f8d5186f2e48a411f12daf97b8da0b78e93e92ffcc5c423fc9a7cd727c14" host="ip-172-31-28-23" Jan 13 20:09:39.772652 containerd[1934]: 2025-01-13 20:09:39.593 [INFO][6344] ipam/ipam.go 1685: Creating new handle: k8s-pod-network.7e02f8d5186f2e48a411f12daf97b8da0b78e93e92ffcc5c423fc9a7cd727c14 Jan 13 20:09:39.772652 containerd[1934]: 2025-01-13 20:09:39.622 [INFO][6344] ipam/ipam.go 1203: Writing block in order to claim IPs block=192.168.83.128/26 handle="k8s-pod-network.7e02f8d5186f2e48a411f12daf97b8da0b78e93e92ffcc5c423fc9a7cd727c14" host="ip-172-31-28-23" Jan 13 20:09:39.772652 containerd[1934]: 2025-01-13 20:09:39.645 [INFO][6344] ipam/ipam.go 1216: Successfully claimed IPs: [192.168.83.134/26] block=192.168.83.128/26 handle="k8s-pod-network.7e02f8d5186f2e48a411f12daf97b8da0b78e93e92ffcc5c423fc9a7cd727c14" host="ip-172-31-28-23" Jan 13 20:09:39.772652 containerd[1934]: 2025-01-13 20:09:39.645 [INFO][6344] ipam/ipam.go 847: Auto-assigned 1 out of 1 IPv4s: [192.168.83.134/26] handle="k8s-pod-network.7e02f8d5186f2e48a411f12daf97b8da0b78e93e92ffcc5c423fc9a7cd727c14" host="ip-172-31-28-23" Jan 13 20:09:39.772652 containerd[1934]: 2025-01-13 20:09:39.645 [INFO][6344] ipam/ipam_plugin.go 374: Released host-wide IPAM lock. Jan 13 20:09:39.772652 containerd[1934]: 2025-01-13 20:09:39.645 [INFO][6344] ipam/ipam_plugin.go 283: Calico CNI IPAM assigned addresses IPv4=[192.168.83.134/26] IPv6=[] ContainerID="7e02f8d5186f2e48a411f12daf97b8da0b78e93e92ffcc5c423fc9a7cd727c14" HandleID="k8s-pod-network.7e02f8d5186f2e48a411f12daf97b8da0b78e93e92ffcc5c423fc9a7cd727c14" Workload="ip--172--31--28--23-k8s-csi--node--driver--wq54r-eth0" Jan 13 20:09:39.774292 containerd[1934]: 2025-01-13 20:09:39.670 [INFO][6286] cni-plugin/k8s.go 386: Populated endpoint ContainerID="7e02f8d5186f2e48a411f12daf97b8da0b78e93e92ffcc5c423fc9a7cd727c14" Namespace="calico-system" Pod="csi-node-driver-wq54r" WorkloadEndpoint="ip--172--31--28--23-k8s-csi--node--driver--wq54r-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--28--23-k8s-csi--node--driver--wq54r-eth0", GenerateName:"csi-node-driver-", Namespace:"calico-system", SelfLink:"", UID:"d47fc662-eff9-4473-83da-b6f0b896d81f", ResourceVersion:"646", Generation:0, CreationTimestamp:time.Date(2025, time.January, 13, 20, 9, 6, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app.kubernetes.io/name":"csi-node-driver", "controller-revision-hash":"55b695c467", "k8s-app":"csi-node-driver", "name":"csi-node-driver", "pod-template-generation":"1", "projectcalico.org/namespace":"calico-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"csi-node-driver"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-28-23", ContainerID:"", Pod:"csi-node-driver-wq54r", Endpoint:"eth0", ServiceAccountName:"csi-node-driver", IPNetworks:[]string{"192.168.83.134/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-system", "ksa.calico-system.csi-node-driver"}, InterfaceName:"cali926eef7d1a9", MAC:"", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil)}} Jan 13 20:09:39.774292 containerd[1934]: 2025-01-13 20:09:39.693 [INFO][6286] cni-plugin/k8s.go 387: Calico CNI using IPs: [192.168.83.134/32] ContainerID="7e02f8d5186f2e48a411f12daf97b8da0b78e93e92ffcc5c423fc9a7cd727c14" Namespace="calico-system" Pod="csi-node-driver-wq54r" WorkloadEndpoint="ip--172--31--28--23-k8s-csi--node--driver--wq54r-eth0" Jan 13 20:09:39.774292 containerd[1934]: 2025-01-13 20:09:39.694 [INFO][6286] cni-plugin/dataplane_linux.go 69: Setting the host side veth name to cali926eef7d1a9 ContainerID="7e02f8d5186f2e48a411f12daf97b8da0b78e93e92ffcc5c423fc9a7cd727c14" Namespace="calico-system" Pod="csi-node-driver-wq54r" WorkloadEndpoint="ip--172--31--28--23-k8s-csi--node--driver--wq54r-eth0" Jan 13 20:09:39.774292 containerd[1934]: 2025-01-13 20:09:39.708 [INFO][6286] cni-plugin/dataplane_linux.go 508: Disabling IPv4 forwarding ContainerID="7e02f8d5186f2e48a411f12daf97b8da0b78e93e92ffcc5c423fc9a7cd727c14" Namespace="calico-system" Pod="csi-node-driver-wq54r" WorkloadEndpoint="ip--172--31--28--23-k8s-csi--node--driver--wq54r-eth0" Jan 13 20:09:39.774292 containerd[1934]: 2025-01-13 20:09:39.712 [INFO][6286] cni-plugin/k8s.go 414: Added Mac, interface name, and active container ID to endpoint ContainerID="7e02f8d5186f2e48a411f12daf97b8da0b78e93e92ffcc5c423fc9a7cd727c14" Namespace="calico-system" Pod="csi-node-driver-wq54r" WorkloadEndpoint="ip--172--31--28--23-k8s-csi--node--driver--wq54r-eth0" endpoint=&v3.WorkloadEndpoint{TypeMeta:v1.TypeMeta{Kind:"WorkloadEndpoint", APIVersion:"projectcalico.org/v3"}, ObjectMeta:v1.ObjectMeta{Name:"ip--172--31--28--23-k8s-csi--node--driver--wq54r-eth0", GenerateName:"csi-node-driver-", Namespace:"calico-system", SelfLink:"", UID:"d47fc662-eff9-4473-83da-b6f0b896d81f", ResourceVersion:"646", Generation:0, CreationTimestamp:time.Date(2025, time.January, 13, 20, 9, 6, 0, time.Local), DeletionTimestamp:, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app.kubernetes.io/name":"csi-node-driver", "controller-revision-hash":"55b695c467", "k8s-app":"csi-node-driver", "name":"csi-node-driver", "pod-template-generation":"1", "projectcalico.org/namespace":"calico-system", "projectcalico.org/orchestrator":"k8s", "projectcalico.org/serviceaccount":"csi-node-driver"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v3.WorkloadEndpointSpec{Orchestrator:"k8s", Workload:"", Node:"ip-172-31-28-23", ContainerID:"7e02f8d5186f2e48a411f12daf97b8da0b78e93e92ffcc5c423fc9a7cd727c14", Pod:"csi-node-driver-wq54r", Endpoint:"eth0", ServiceAccountName:"csi-node-driver", IPNetworks:[]string{"192.168.83.134/32"}, IPNATs:[]v3.IPNAT(nil), IPv4Gateway:"", IPv6Gateway:"", Profiles:[]string{"kns.calico-system", "ksa.calico-system.csi-node-driver"}, InterfaceName:"cali926eef7d1a9", MAC:"ba:eb:35:1b:e5:b1", Ports:[]v3.WorkloadEndpointPort(nil), AllowSpoofedSourcePrefixes:[]string(nil)}} Jan 13 20:09:39.774292 containerd[1934]: 2025-01-13 20:09:39.758 [INFO][6286] cni-plugin/k8s.go 500: Wrote updated endpoint to datastore ContainerID="7e02f8d5186f2e48a411f12daf97b8da0b78e93e92ffcc5c423fc9a7cd727c14" Namespace="calico-system" Pod="csi-node-driver-wq54r" WorkloadEndpoint="ip--172--31--28--23-k8s-csi--node--driver--wq54r-eth0" Jan 13 20:09:39.805579 containerd[1934]: time="2025-01-13T20:09:39.805094272Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1 Jan 13 20:09:39.805579 containerd[1934]: time="2025-01-13T20:09:39.805189276Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1 Jan 13 20:09:39.805579 containerd[1934]: time="2025-01-13T20:09:39.805250140Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Jan 13 20:09:39.805579 containerd[1934]: time="2025-01-13T20:09:39.805430152Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Jan 13 20:09:39.859106 systemd[1]: Started cri-containerd-3807286ca7e77b2e15c0203e6a52af4c1859901f88895c137b30514a621b0308.scope - libcontainer container 3807286ca7e77b2e15c0203e6a52af4c1859901f88895c137b30514a621b0308. Jan 13 20:09:39.890154 systemd[1]: Started cri-containerd-c3f52203f6560b2c8f7e82f87a7613af2871e81b52fd7c1e83123731a5e1713f.scope - libcontainer container c3f52203f6560b2c8f7e82f87a7613af2871e81b52fd7c1e83123731a5e1713f. Jan 13 20:09:39.911812 containerd[1934]: time="2025-01-13T20:09:39.908455109Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1 Jan 13 20:09:39.911812 containerd[1934]: time="2025-01-13T20:09:39.908561069Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1 Jan 13 20:09:39.911812 containerd[1934]: time="2025-01-13T20:09:39.908588477Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Jan 13 20:09:39.912910 containerd[1934]: time="2025-01-13T20:09:39.912726869Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Jan 13 20:09:39.974106 systemd[1]: Started cri-containerd-7e02f8d5186f2e48a411f12daf97b8da0b78e93e92ffcc5c423fc9a7cd727c14.scope - libcontainer container 7e02f8d5186f2e48a411f12daf97b8da0b78e93e92ffcc5c423fc9a7cd727c14. Jan 13 20:09:40.107250 containerd[1934]: time="2025-01-13T20:09:40.107181422Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:coredns-76f75df574-mkr2l,Uid:396e30c8-d221-410a-89fe-e353ba8cddbf,Namespace:kube-system,Attempt:11,} returns sandbox id \"c3f52203f6560b2c8f7e82f87a7613af2871e81b52fd7c1e83123731a5e1713f\"" Jan 13 20:09:40.120945 containerd[1934]: time="2025-01-13T20:09:40.120434714Z" level=info msg="CreateContainer within sandbox \"c3f52203f6560b2c8f7e82f87a7613af2871e81b52fd7c1e83123731a5e1713f\" for container &ContainerMetadata{Name:coredns,Attempt:0,}" Jan 13 20:09:40.174102 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount3053283187.mount: Deactivated successfully. Jan 13 20:09:40.192549 containerd[1934]: time="2025-01-13T20:09:40.192395234Z" level=info msg="StartContainer for \"3807286ca7e77b2e15c0203e6a52af4c1859901f88895c137b30514a621b0308\" returns successfully" Jan 13 20:09:40.217246 containerd[1934]: time="2025-01-13T20:09:40.217172534Z" level=info msg="CreateContainer within sandbox \"c3f52203f6560b2c8f7e82f87a7613af2871e81b52fd7c1e83123731a5e1713f\" for &ContainerMetadata{Name:coredns,Attempt:0,} returns container id \"801742bdf4a5d8ad3b0b72bb7c642713914c63b6ebe187a5f6b216a574f9f2b0\"" Jan 13 20:09:40.221149 containerd[1934]: time="2025-01-13T20:09:40.219088490Z" level=info msg="StartContainer for \"801742bdf4a5d8ad3b0b72bb7c642713914c63b6ebe187a5f6b216a574f9f2b0\"" Jan 13 20:09:40.220572 systemd-networkd[1804]: calic75cf53e955: Gained IPv6LL Jan 13 20:09:40.334963 containerd[1934]: time="2025-01-13T20:09:40.334894539Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-7fbffcd8cd-pxvdr,Uid:8f72f896-c0ba-4b07-9a22-acc5c8ca3697,Namespace:calico-apiserver,Attempt:10,} returns sandbox id \"b692d302c089fa9e6922c88c202828a18c9972e1a1d1472fd1f7c6f39007b2f3\"" Jan 13 20:09:40.347358 systemd-networkd[1804]: cali3fb46b06e86: Gained IPv6LL Jan 13 20:09:40.349907 containerd[1934]: time="2025-01-13T20:09:40.348626667Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.29.1\"" Jan 13 20:09:40.364203 containerd[1934]: time="2025-01-13T20:09:40.363946731Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-apiserver-7fbffcd8cd-wszl7,Uid:ad79c041-eaf1-4d57-9fb4-c3fb08680cb8,Namespace:calico-apiserver,Attempt:10,} returns sandbox id \"98b2148f179f527ed06a30e4a81178bc222ffda23d6ad0a11ad6187295bf0f5b\"" Jan 13 20:09:40.387540 systemd[1]: Started cri-containerd-801742bdf4a5d8ad3b0b72bb7c642713914c63b6ebe187a5f6b216a574f9f2b0.scope - libcontainer container 801742bdf4a5d8ad3b0b72bb7c642713914c63b6ebe187a5f6b216a574f9f2b0. Jan 13 20:09:40.502960 containerd[1934]: time="2025-01-13T20:09:40.502398052Z" level=info msg="StartContainer for \"801742bdf4a5d8ad3b0b72bb7c642713914c63b6ebe187a5f6b216a574f9f2b0\" returns successfully" Jan 13 20:09:40.572798 containerd[1934]: time="2025-01-13T20:09:40.572630860Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:calico-kube-controllers-68f76c7ddf-lh8nj,Uid:2be21c11-9c2d-4b9a-81a5-0e73daba31c1,Namespace:calico-system,Attempt:11,} returns sandbox id \"0e75aaa0753893d7d7adef9b7ea941a9a377d4cf79b12b271802261abc39b658\"" Jan 13 20:09:40.603342 systemd-networkd[1804]: cali2b48a0390e0: Gained IPv6LL Jan 13 20:09:40.634555 containerd[1934]: time="2025-01-13T20:09:40.634492156Z" level=info msg="RunPodSandbox for &PodSandboxMetadata{Name:csi-node-driver-wq54r,Uid:d47fc662-eff9-4473-83da-b6f0b896d81f,Namespace:calico-system,Attempt:11,} returns sandbox id \"7e02f8d5186f2e48a411f12daf97b8da0b78e93e92ffcc5c423fc9a7cd727c14\"" Jan 13 20:09:40.731740 systemd-networkd[1804]: cali0f4ccef88b3: Gained IPv6LL Jan 13 20:09:40.833392 kubelet[3423]: I0113 20:09:40.833311 3423 pod_startup_latency_tracker.go:102] "Observed pod startup duration" pod="kube-system/coredns-76f75df574-8wp6k" podStartSLOduration=56.833245409 podStartE2EDuration="56.833245409s" podCreationTimestamp="2025-01-13 20:08:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-01-13 20:09:40.828992969 +0000 UTC m=+69.234574449" watchObservedRunningTime="2025-01-13 20:09:40.833245409 +0000 UTC m=+69.238826889" Jan 13 20:09:40.906466 kubelet[3423]: I0113 20:09:40.906397 3423 pod_startup_latency_tracker.go:102] "Observed pod startup duration" pod="kube-system/coredns-76f75df574-mkr2l" podStartSLOduration=56.90634017 podStartE2EDuration="56.90634017s" podCreationTimestamp="2025-01-13 20:08:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-01-13 20:09:40.900983466 +0000 UTC m=+69.306564970" watchObservedRunningTime="2025-01-13 20:09:40.90634017 +0000 UTC m=+69.311921650" Jan 13 20:09:41.308838 systemd-networkd[1804]: cali4e98ae0f161: Gained IPv6LL Jan 13 20:09:41.499897 systemd-networkd[1804]: cali926eef7d1a9: Gained IPv6LL Jan 13 20:09:41.735837 kernel: bpftool[6902]: memfd_create() called without MFD_EXEC or MFD_NOEXEC_SEAL set Jan 13 20:09:42.091106 systemd-networkd[1804]: vxlan.calico: Link UP Jan 13 20:09:42.091121 systemd-networkd[1804]: vxlan.calico: Gained carrier Jan 13 20:09:42.154888 (udev-worker)[6199]: Network interface NamePolicy= disabled on kernel command line. Jan 13 20:09:43.163294 systemd-networkd[1804]: vxlan.calico: Gained IPv6LL Jan 13 20:09:43.494582 systemd[1]: Started sshd@14-172.31.28.23:22-147.75.109.163:40696.service - OpenSSH per-connection server daemon (147.75.109.163:40696). Jan 13 20:09:43.711608 sshd[6984]: Accepted publickey for core from 147.75.109.163 port 40696 ssh2: RSA SHA256:IRHkteilZRLg/mCVEzdResksy7NfUBDRRywgALKaHg0 Jan 13 20:09:43.714596 sshd-session[6984]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Jan 13 20:09:43.731699 systemd-logind[1912]: New session 15 of user core. Jan 13 20:09:43.738162 systemd[1]: Started session-15.scope - Session 15 of User core. Jan 13 20:09:44.110682 sshd[6986]: Connection closed by 147.75.109.163 port 40696 Jan 13 20:09:44.110289 sshd-session[6984]: pam_unix(sshd:session): session closed for user core Jan 13 20:09:44.120507 systemd[1]: sshd@14-172.31.28.23:22-147.75.109.163:40696.service: Deactivated successfully. Jan 13 20:09:44.130262 systemd[1]: session-15.scope: Deactivated successfully. Jan 13 20:09:44.134298 systemd-logind[1912]: Session 15 logged out. Waiting for processes to exit. Jan 13 20:09:44.158190 systemd[1]: Started sshd@15-172.31.28.23:22-147.75.109.163:40706.service - OpenSSH per-connection server daemon (147.75.109.163:40706). Jan 13 20:09:44.160727 systemd-logind[1912]: Removed session 15. Jan 13 20:09:44.375919 sshd[6997]: Accepted publickey for core from 147.75.109.163 port 40706 ssh2: RSA SHA256:IRHkteilZRLg/mCVEzdResksy7NfUBDRRywgALKaHg0 Jan 13 20:09:44.379501 sshd-session[6997]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Jan 13 20:09:44.387809 systemd-logind[1912]: New session 16 of user core. Jan 13 20:09:44.395083 systemd[1]: Started session-16.scope - Session 16 of User core. Jan 13 20:09:44.451748 containerd[1934]: time="2025-01-13T20:09:44.451672723Z" level=info msg="ImageCreate event name:\"ghcr.io/flatcar/calico/apiserver:v3.29.1\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Jan 13 20:09:44.453452 containerd[1934]: time="2025-01-13T20:09:44.453279835Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/apiserver:v3.29.1: active requests=0, bytes read=39298409" Jan 13 20:09:44.456229 containerd[1934]: time="2025-01-13T20:09:44.456124243Z" level=info msg="ImageCreate event name:\"sha256:5451b31bd8d0784796fa1204c4ec22975a270e21feadf2c5095fe41a38524c6c\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Jan 13 20:09:44.461959 containerd[1934]: time="2025-01-13T20:09:44.461861875Z" level=info msg="ImageCreate event name:\"ghcr.io/flatcar/calico/apiserver@sha256:b8c43e264fe52e0c327b0bf3ac882a0224b33bdd7f4ff58a74242da7d9b00486\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Jan 13 20:09:44.463665 containerd[1934]: time="2025-01-13T20:09:44.463417951Z" level=info msg="Pulled image \"ghcr.io/flatcar/calico/apiserver:v3.29.1\" with image id \"sha256:5451b31bd8d0784796fa1204c4ec22975a270e21feadf2c5095fe41a38524c6c\", repo tag \"ghcr.io/flatcar/calico/apiserver:v3.29.1\", repo digest \"ghcr.io/flatcar/calico/apiserver@sha256:b8c43e264fe52e0c327b0bf3ac882a0224b33bdd7f4ff58a74242da7d9b00486\", size \"40668079\" in 4.114733588s" Jan 13 20:09:44.463665 containerd[1934]: time="2025-01-13T20:09:44.463473451Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.29.1\" returns image reference \"sha256:5451b31bd8d0784796fa1204c4ec22975a270e21feadf2c5095fe41a38524c6c\"" Jan 13 20:09:44.465089 containerd[1934]: time="2025-01-13T20:09:44.464524771Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.29.1\"" Jan 13 20:09:44.467239 containerd[1934]: time="2025-01-13T20:09:44.467133175Z" level=info msg="CreateContainer within sandbox \"b692d302c089fa9e6922c88c202828a18c9972e1a1d1472fd1f7c6f39007b2f3\" for container &ContainerMetadata{Name:calico-apiserver,Attempt:0,}" Jan 13 20:09:44.491314 containerd[1934]: time="2025-01-13T20:09:44.491227723Z" level=info msg="CreateContainer within sandbox \"b692d302c089fa9e6922c88c202828a18c9972e1a1d1472fd1f7c6f39007b2f3\" for &ContainerMetadata{Name:calico-apiserver,Attempt:0,} returns container id \"c2c8b8166ae474380b383e49287f6ac1a539ab004b7a4d44f30fb5eba80b1e8e\"" Jan 13 20:09:44.495826 containerd[1934]: time="2025-01-13T20:09:44.493525843Z" level=info msg="StartContainer for \"c2c8b8166ae474380b383e49287f6ac1a539ab004b7a4d44f30fb5eba80b1e8e\"" Jan 13 20:09:44.577703 systemd[1]: run-containerd-runc-k8s.io-c2c8b8166ae474380b383e49287f6ac1a539ab004b7a4d44f30fb5eba80b1e8e-runc.aKANbp.mount: Deactivated successfully. Jan 13 20:09:44.588118 systemd[1]: Started cri-containerd-c2c8b8166ae474380b383e49287f6ac1a539ab004b7a4d44f30fb5eba80b1e8e.scope - libcontainer container c2c8b8166ae474380b383e49287f6ac1a539ab004b7a4d44f30fb5eba80b1e8e. Jan 13 20:09:44.686168 containerd[1934]: time="2025-01-13T20:09:44.685984304Z" level=info msg="StartContainer for \"c2c8b8166ae474380b383e49287f6ac1a539ab004b7a4d44f30fb5eba80b1e8e\" returns successfully" Jan 13 20:09:44.797217 containerd[1934]: time="2025-01-13T20:09:44.797141973Z" level=info msg="ImageUpdate event name:\"ghcr.io/flatcar/calico/apiserver:v3.29.1\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Jan 13 20:09:44.800754 containerd[1934]: time="2025-01-13T20:09:44.799388577Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/apiserver:v3.29.1: active requests=0, bytes read=77" Jan 13 20:09:44.805454 containerd[1934]: time="2025-01-13T20:09:44.805384761Z" level=info msg="Pulled image \"ghcr.io/flatcar/calico/apiserver:v3.29.1\" with image id \"sha256:5451b31bd8d0784796fa1204c4ec22975a270e21feadf2c5095fe41a38524c6c\", repo tag \"ghcr.io/flatcar/calico/apiserver:v3.29.1\", repo digest \"ghcr.io/flatcar/calico/apiserver@sha256:b8c43e264fe52e0c327b0bf3ac882a0224b33bdd7f4ff58a74242da7d9b00486\", size \"40668079\" in 340.529978ms" Jan 13 20:09:44.805454 containerd[1934]: time="2025-01-13T20:09:44.805449609Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/apiserver:v3.29.1\" returns image reference \"sha256:5451b31bd8d0784796fa1204c4ec22975a270e21feadf2c5095fe41a38524c6c\"" Jan 13 20:09:44.808390 containerd[1934]: time="2025-01-13T20:09:44.808082409Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/kube-controllers:v3.29.1\"" Jan 13 20:09:44.812866 containerd[1934]: time="2025-01-13T20:09:44.812623353Z" level=info msg="CreateContainer within sandbox \"98b2148f179f527ed06a30e4a81178bc222ffda23d6ad0a11ad6187295bf0f5b\" for container &ContainerMetadata{Name:calico-apiserver,Attempt:0,}" Jan 13 20:09:44.839517 containerd[1934]: time="2025-01-13T20:09:44.839448717Z" level=info msg="CreateContainer within sandbox \"98b2148f179f527ed06a30e4a81178bc222ffda23d6ad0a11ad6187295bf0f5b\" for &ContainerMetadata{Name:calico-apiserver,Attempt:0,} returns container id \"5313b6a71fcb3984a9e9c7d59b1800f7eca9afa50837d65104f3b41313e10d0a\"" Jan 13 20:09:44.842603 containerd[1934]: time="2025-01-13T20:09:44.842538585Z" level=info msg="StartContainer for \"5313b6a71fcb3984a9e9c7d59b1800f7eca9afa50837d65104f3b41313e10d0a\"" Jan 13 20:09:44.960147 kubelet[3423]: I0113 20:09:44.956045 3423 pod_startup_latency_tracker.go:102] "Observed pod startup duration" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-pxvdr" podStartSLOduration=35.835823046 podStartE2EDuration="39.955929562s" podCreationTimestamp="2025-01-13 20:09:05 +0000 UTC" firstStartedPulling="2025-01-13 20:09:40.344145303 +0000 UTC m=+68.749726783" lastFinishedPulling="2025-01-13 20:09:44.464251819 +0000 UTC m=+72.869833299" observedRunningTime="2025-01-13 20:09:44.954310786 +0000 UTC m=+73.359892290" watchObservedRunningTime="2025-01-13 20:09:44.955929562 +0000 UTC m=+73.361511066" Jan 13 20:09:44.957224 systemd[1]: Started cri-containerd-5313b6a71fcb3984a9e9c7d59b1800f7eca9afa50837d65104f3b41313e10d0a.scope - libcontainer container 5313b6a71fcb3984a9e9c7d59b1800f7eca9afa50837d65104f3b41313e10d0a. Jan 13 20:09:45.068292 sshd[6999]: Connection closed by 147.75.109.163 port 40706 Jan 13 20:09:45.069414 sshd-session[6997]: pam_unix(sshd:session): session closed for user core Jan 13 20:09:45.080175 systemd[1]: sshd@15-172.31.28.23:22-147.75.109.163:40706.service: Deactivated successfully. Jan 13 20:09:45.088466 systemd[1]: session-16.scope: Deactivated successfully. Jan 13 20:09:45.097098 systemd-logind[1912]: Session 16 logged out. Waiting for processes to exit. Jan 13 20:09:45.119325 systemd[1]: Started sshd@16-172.31.28.23:22-147.75.109.163:40712.service - OpenSSH per-connection server daemon (147.75.109.163:40712). Jan 13 20:09:45.123015 systemd-logind[1912]: Removed session 16. Jan 13 20:09:45.164934 containerd[1934]: time="2025-01-13T20:09:45.164263903Z" level=info msg="StartContainer for \"5313b6a71fcb3984a9e9c7d59b1800f7eca9afa50837d65104f3b41313e10d0a\" returns successfully" Jan 13 20:09:45.353285 sshd[7074]: Accepted publickey for core from 147.75.109.163 port 40712 ssh2: RSA SHA256:IRHkteilZRLg/mCVEzdResksy7NfUBDRRywgALKaHg0 Jan 13 20:09:45.358003 sshd-session[7074]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Jan 13 20:09:45.368495 systemd-logind[1912]: New session 17 of user core. Jan 13 20:09:45.376062 systemd[1]: Started session-17.scope - Session 17 of User core. Jan 13 20:09:45.959254 ntpd[1906]: Listen normally on 8 vxlan.calico 192.168.83.128:123 Jan 13 20:09:45.959403 ntpd[1906]: Listen normally on 9 cali0f4ccef88b3 [fe80::ecee:eeff:feee:eeee%4]:123 Jan 13 20:09:45.960108 ntpd[1906]: 13 Jan 20:09:45 ntpd[1906]: Listen normally on 8 vxlan.calico 192.168.83.128:123 Jan 13 20:09:45.960108 ntpd[1906]: 13 Jan 20:09:45 ntpd[1906]: Listen normally on 9 cali0f4ccef88b3 [fe80::ecee:eeff:feee:eeee%4]:123 Jan 13 20:09:45.960108 ntpd[1906]: 13 Jan 20:09:45 ntpd[1906]: Listen normally on 10 calic75cf53e955 [fe80::ecee:eeff:feee:eeee%5]:123 Jan 13 20:09:45.960108 ntpd[1906]: 13 Jan 20:09:45 ntpd[1906]: Listen normally on 11 cali3fb46b06e86 [fe80::ecee:eeff:feee:eeee%6]:123 Jan 13 20:09:45.960108 ntpd[1906]: 13 Jan 20:09:45 ntpd[1906]: Listen normally on 12 cali2b48a0390e0 [fe80::ecee:eeff:feee:eeee%7]:123 Jan 13 20:09:45.960108 ntpd[1906]: 13 Jan 20:09:45 ntpd[1906]: Listen normally on 13 cali4e98ae0f161 [fe80::ecee:eeff:feee:eeee%8]:123 Jan 13 20:09:45.960108 ntpd[1906]: 13 Jan 20:09:45 ntpd[1906]: Listen normally on 14 cali926eef7d1a9 [fe80::ecee:eeff:feee:eeee%9]:123 Jan 13 20:09:45.960108 ntpd[1906]: 13 Jan 20:09:45 ntpd[1906]: Listen normally on 15 vxlan.calico [fe80::64c5:a1ff:fe77:3f56%10]:123 Jan 13 20:09:45.959484 ntpd[1906]: Listen normally on 10 calic75cf53e955 [fe80::ecee:eeff:feee:eeee%5]:123 Jan 13 20:09:45.959552 ntpd[1906]: Listen normally on 11 cali3fb46b06e86 [fe80::ecee:eeff:feee:eeee%6]:123 Jan 13 20:09:45.959622 ntpd[1906]: Listen normally on 12 cali2b48a0390e0 [fe80::ecee:eeff:feee:eeee%7]:123 Jan 13 20:09:45.959716 ntpd[1906]: Listen normally on 13 cali4e98ae0f161 [fe80::ecee:eeff:feee:eeee%8]:123 Jan 13 20:09:45.959815 ntpd[1906]: Listen normally on 14 cali926eef7d1a9 [fe80::ecee:eeff:feee:eeee%9]:123 Jan 13 20:09:45.959890 ntpd[1906]: Listen normally on 15 vxlan.calico [fe80::64c5:a1ff:fe77:3f56%10]:123 Jan 13 20:09:45.998151 kubelet[3423]: I0113 20:09:45.998091 3423 pod_startup_latency_tracker.go:102] "Observed pod startup duration" pod="calico-apiserver/calico-apiserver-7fbffcd8cd-wszl7" podStartSLOduration=36.562103093 podStartE2EDuration="40.998000759s" podCreationTimestamp="2025-01-13 20:09:05 +0000 UTC" firstStartedPulling="2025-01-13 20:09:40.370086987 +0000 UTC m=+68.775668467" lastFinishedPulling="2025-01-13 20:09:44.805984665 +0000 UTC m=+73.211566133" observedRunningTime="2025-01-13 20:09:45.994842899 +0000 UTC m=+74.400424391" watchObservedRunningTime="2025-01-13 20:09:45.998000759 +0000 UTC m=+74.403582239" Jan 13 20:09:46.951997 kubelet[3423]: I0113 20:09:46.950370 3423 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jan 13 20:09:47.431503 containerd[1934]: time="2025-01-13T20:09:47.430951114Z" level=info msg="ImageCreate event name:\"ghcr.io/flatcar/calico/kube-controllers:v3.29.1\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Jan 13 20:09:47.433963 containerd[1934]: time="2025-01-13T20:09:47.432616534Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/kube-controllers:v3.29.1: active requests=0, bytes read=31953828" Jan 13 20:09:47.435826 containerd[1934]: time="2025-01-13T20:09:47.434965966Z" level=info msg="ImageCreate event name:\"sha256:32c335fdb9d757e7ba6a76a9cfa8d292a5a229101ae7ea37b42f53c28adf2db1\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Jan 13 20:09:47.445130 containerd[1934]: time="2025-01-13T20:09:47.445068538Z" level=info msg="ImageCreate event name:\"ghcr.io/flatcar/calico/kube-controllers@sha256:1072d6a98167a14ca361e9ce757733f9bae36d1f1c6a9621ea10934b6b1e10d9\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Jan 13 20:09:47.447755 containerd[1934]: time="2025-01-13T20:09:47.446628178Z" level=info msg="Pulled image \"ghcr.io/flatcar/calico/kube-controllers:v3.29.1\" with image id \"sha256:32c335fdb9d757e7ba6a76a9cfa8d292a5a229101ae7ea37b42f53c28adf2db1\", repo tag \"ghcr.io/flatcar/calico/kube-controllers:v3.29.1\", repo digest \"ghcr.io/flatcar/calico/kube-controllers@sha256:1072d6a98167a14ca361e9ce757733f9bae36d1f1c6a9621ea10934b6b1e10d9\", size \"33323450\" in 2.638486261s" Jan 13 20:09:47.447755 containerd[1934]: time="2025-01-13T20:09:47.446691034Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/kube-controllers:v3.29.1\" returns image reference \"sha256:32c335fdb9d757e7ba6a76a9cfa8d292a5a229101ae7ea37b42f53c28adf2db1\"" Jan 13 20:09:47.450386 containerd[1934]: time="2025-01-13T20:09:47.450126586Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/csi:v3.29.1\"" Jan 13 20:09:47.479342 containerd[1934]: time="2025-01-13T20:09:47.478891762Z" level=info msg="CreateContainer within sandbox \"0e75aaa0753893d7d7adef9b7ea941a9a377d4cf79b12b271802261abc39b658\" for container &ContainerMetadata{Name:calico-kube-controllers,Attempt:0,}" Jan 13 20:09:47.511759 containerd[1934]: time="2025-01-13T20:09:47.509605822Z" level=info msg="CreateContainer within sandbox \"0e75aaa0753893d7d7adef9b7ea941a9a377d4cf79b12b271802261abc39b658\" for &ContainerMetadata{Name:calico-kube-controllers,Attempt:0,} returns container id \"0037a3f13d7ff07d30e17561b4865bb603e98343c98a5a3e57b659a69aeb4e7e\"" Jan 13 20:09:47.511759 containerd[1934]: time="2025-01-13T20:09:47.510584902Z" level=info msg="StartContainer for \"0037a3f13d7ff07d30e17561b4865bb603e98343c98a5a3e57b659a69aeb4e7e\"" Jan 13 20:09:47.596143 systemd[1]: Started cri-containerd-0037a3f13d7ff07d30e17561b4865bb603e98343c98a5a3e57b659a69aeb4e7e.scope - libcontainer container 0037a3f13d7ff07d30e17561b4865bb603e98343c98a5a3e57b659a69aeb4e7e. Jan 13 20:09:47.975743 containerd[1934]: time="2025-01-13T20:09:47.975674917Z" level=info msg="StartContainer for \"0037a3f13d7ff07d30e17561b4865bb603e98343c98a5a3e57b659a69aeb4e7e\" returns successfully" Jan 13 20:09:49.028166 kubelet[3423]: I0113 20:09:49.027938 3423 pod_startup_latency_tracker.go:102] "Observed pod startup duration" pod="calico-system/calico-kube-controllers-68f76c7ddf-lh8nj" podStartSLOduration=36.154437256 podStartE2EDuration="43.02633077s" podCreationTimestamp="2025-01-13 20:09:06 +0000 UTC" firstStartedPulling="2025-01-13 20:09:40.57524158 +0000 UTC m=+68.980823060" lastFinishedPulling="2025-01-13 20:09:47.447135106 +0000 UTC m=+75.852716574" observedRunningTime="2025-01-13 20:09:49.024181774 +0000 UTC m=+77.429763278" watchObservedRunningTime="2025-01-13 20:09:49.02633077 +0000 UTC m=+77.431912358" Jan 13 20:09:49.514514 containerd[1934]: time="2025-01-13T20:09:49.514434792Z" level=info msg="ImageCreate event name:\"ghcr.io/flatcar/calico/csi:v3.29.1\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Jan 13 20:09:49.521100 containerd[1934]: time="2025-01-13T20:09:49.521009628Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/csi:v3.29.1: active requests=0, bytes read=7464730" Jan 13 20:09:49.525500 containerd[1934]: time="2025-01-13T20:09:49.525425340Z" level=info msg="ImageCreate event name:\"sha256:3c11734f3001b7070e7e2b5e64938f89891cf8c44f8997e86aa23c5d5bf70163\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Jan 13 20:09:49.538511 containerd[1934]: time="2025-01-13T20:09:49.538436197Z" level=info msg="Pulled image \"ghcr.io/flatcar/calico/csi:v3.29.1\" with image id \"sha256:3c11734f3001b7070e7e2b5e64938f89891cf8c44f8997e86aa23c5d5bf70163\", repo tag \"ghcr.io/flatcar/calico/csi:v3.29.1\", repo digest \"ghcr.io/flatcar/calico/csi@sha256:eaa7e01fb16b603c155a67b81f16992281db7f831684c7b2081d3434587a7ff3\", size \"8834384\" in 2.087707283s" Jan 13 20:09:49.538511 containerd[1934]: time="2025-01-13T20:09:49.538502233Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/csi:v3.29.1\" returns image reference \"sha256:3c11734f3001b7070e7e2b5e64938f89891cf8c44f8997e86aa23c5d5bf70163\"" Jan 13 20:09:49.539828 containerd[1934]: time="2025-01-13T20:09:49.539501857Z" level=info msg="ImageCreate event name:\"ghcr.io/flatcar/calico/csi@sha256:eaa7e01fb16b603c155a67b81f16992281db7f831684c7b2081d3434587a7ff3\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Jan 13 20:09:49.548036 containerd[1934]: time="2025-01-13T20:09:49.547974217Z" level=info msg="CreateContainer within sandbox \"7e02f8d5186f2e48a411f12daf97b8da0b78e93e92ffcc5c423fc9a7cd727c14\" for container &ContainerMetadata{Name:calico-csi,Attempt:0,}" Jan 13 20:09:49.605152 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount2047718098.mount: Deactivated successfully. Jan 13 20:09:49.625081 containerd[1934]: time="2025-01-13T20:09:49.625001317Z" level=info msg="CreateContainer within sandbox \"7e02f8d5186f2e48a411f12daf97b8da0b78e93e92ffcc5c423fc9a7cd727c14\" for &ContainerMetadata{Name:calico-csi,Attempt:0,} returns container id \"85c436d969137c25a6edae635299d930d79769e33c585431c140d8d2ec48d57f\"" Jan 13 20:09:49.627999 containerd[1934]: time="2025-01-13T20:09:49.625993285Z" level=info msg="StartContainer for \"85c436d969137c25a6edae635299d930d79769e33c585431c140d8d2ec48d57f\"" Jan 13 20:09:49.842167 systemd[1]: Started cri-containerd-85c436d969137c25a6edae635299d930d79769e33c585431c140d8d2ec48d57f.scope - libcontainer container 85c436d969137c25a6edae635299d930d79769e33c585431c140d8d2ec48d57f. Jan 13 20:09:50.070380 containerd[1934]: time="2025-01-13T20:09:50.070152227Z" level=info msg="StartContainer for \"85c436d969137c25a6edae635299d930d79769e33c585431c140d8d2ec48d57f\" returns successfully" Jan 13 20:09:50.073653 containerd[1934]: time="2025-01-13T20:09:50.073534187Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/node-driver-registrar:v3.29.1\"" Jan 13 20:09:50.121308 systemd[1]: run-containerd-runc-k8s.io-85c436d969137c25a6edae635299d930d79769e33c585431c140d8d2ec48d57f-runc.y7z9rV.mount: Deactivated successfully. Jan 13 20:09:50.213867 sshd[7090]: Connection closed by 147.75.109.163 port 40712 Jan 13 20:09:50.215332 sshd-session[7074]: pam_unix(sshd:session): session closed for user core Jan 13 20:09:50.228213 systemd[1]: sshd@16-172.31.28.23:22-147.75.109.163:40712.service: Deactivated successfully. Jan 13 20:09:50.235698 systemd[1]: session-17.scope: Deactivated successfully. Jan 13 20:09:50.238270 systemd[1]: session-17.scope: Consumed 1.030s CPU time. Jan 13 20:09:50.243613 systemd-logind[1912]: Session 17 logged out. Waiting for processes to exit. Jan 13 20:09:50.263896 systemd-logind[1912]: Removed session 17. Jan 13 20:09:50.273281 systemd[1]: Started sshd@17-172.31.28.23:22-147.75.109.163:48606.service - OpenSSH per-connection server daemon (147.75.109.163:48606). Jan 13 20:09:50.504803 sshd[7223]: Accepted publickey for core from 147.75.109.163 port 48606 ssh2: RSA SHA256:IRHkteilZRLg/mCVEzdResksy7NfUBDRRywgALKaHg0 Jan 13 20:09:50.514862 sshd-session[7223]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Jan 13 20:09:50.528102 systemd-logind[1912]: New session 18 of user core. Jan 13 20:09:50.536310 systemd[1]: Started session-18.scope - Session 18 of User core. Jan 13 20:09:51.193879 sshd[7235]: Connection closed by 147.75.109.163 port 48606 Jan 13 20:09:51.195511 sshd-session[7223]: pam_unix(sshd:session): session closed for user core Jan 13 20:09:51.207615 systemd[1]: sshd@17-172.31.28.23:22-147.75.109.163:48606.service: Deactivated successfully. Jan 13 20:09:51.214850 systemd[1]: session-18.scope: Deactivated successfully. Jan 13 20:09:51.217679 systemd-logind[1912]: Session 18 logged out. Waiting for processes to exit. Jan 13 20:09:51.238326 systemd[1]: Started sshd@18-172.31.28.23:22-147.75.109.163:48608.service - OpenSSH per-connection server daemon (147.75.109.163:48608). Jan 13 20:09:51.241928 systemd-logind[1912]: Removed session 18. Jan 13 20:09:51.438150 sshd[7254]: Accepted publickey for core from 147.75.109.163 port 48608 ssh2: RSA SHA256:IRHkteilZRLg/mCVEzdResksy7NfUBDRRywgALKaHg0 Jan 13 20:09:51.440589 sshd-session[7254]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Jan 13 20:09:51.454136 systemd-logind[1912]: New session 19 of user core. Jan 13 20:09:51.465114 systemd[1]: Started session-19.scope - Session 19 of User core. Jan 13 20:09:51.845009 sshd[7257]: Connection closed by 147.75.109.163 port 48608 Jan 13 20:09:51.848500 sshd-session[7254]: pam_unix(sshd:session): session closed for user core Jan 13 20:09:51.862943 systemd-logind[1912]: Session 19 logged out. Waiting for processes to exit. Jan 13 20:09:51.864393 systemd[1]: sshd@18-172.31.28.23:22-147.75.109.163:48608.service: Deactivated successfully. Jan 13 20:09:51.869614 systemd[1]: session-19.scope: Deactivated successfully. Jan 13 20:09:51.874171 systemd-logind[1912]: Removed session 19. Jan 13 20:09:51.988803 containerd[1934]: time="2025-01-13T20:09:51.988715981Z" level=info msg="ImageCreate event name:\"ghcr.io/flatcar/calico/node-driver-registrar:v3.29.1\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Jan 13 20:09:51.991459 containerd[1934]: time="2025-01-13T20:09:51.991351109Z" level=info msg="stop pulling image ghcr.io/flatcar/calico/node-driver-registrar:v3.29.1: active requests=0, bytes read=9883368" Jan 13 20:09:51.994825 containerd[1934]: time="2025-01-13T20:09:51.993392573Z" level=info msg="ImageCreate event name:\"sha256:3eb557f7694f230afd24a75a691bcda4c0a7bfe87a981386dcd4ecf2b0701349\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Jan 13 20:09:51.998211 containerd[1934]: time="2025-01-13T20:09:51.998154401Z" level=info msg="ImageCreate event name:\"ghcr.io/flatcar/calico/node-driver-registrar@sha256:a338da9488cbaa83c78457c3d7354d84149969c0480e88dd768e036632ff5b76\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}" Jan 13 20:09:52.000045 containerd[1934]: time="2025-01-13T20:09:51.999312149Z" level=info msg="Pulled image \"ghcr.io/flatcar/calico/node-driver-registrar:v3.29.1\" with image id \"sha256:3eb557f7694f230afd24a75a691bcda4c0a7bfe87a981386dcd4ecf2b0701349\", repo tag \"ghcr.io/flatcar/calico/node-driver-registrar:v3.29.1\", repo digest \"ghcr.io/flatcar/calico/node-driver-registrar@sha256:a338da9488cbaa83c78457c3d7354d84149969c0480e88dd768e036632ff5b76\", size \"11252974\" in 1.92571297s" Jan 13 20:09:52.000840 containerd[1934]: time="2025-01-13T20:09:52.000800437Z" level=info msg="PullImage \"ghcr.io/flatcar/calico/node-driver-registrar:v3.29.1\" returns image reference \"sha256:3eb557f7694f230afd24a75a691bcda4c0a7bfe87a981386dcd4ecf2b0701349\"" Jan 13 20:09:52.004357 containerd[1934]: time="2025-01-13T20:09:52.004308241Z" level=info msg="CreateContainer within sandbox \"7e02f8d5186f2e48a411f12daf97b8da0b78e93e92ffcc5c423fc9a7cd727c14\" for container &ContainerMetadata{Name:csi-node-driver-registrar,Attempt:0,}" Jan 13 20:09:52.036013 containerd[1934]: time="2025-01-13T20:09:52.035954269Z" level=info msg="CreateContainer within sandbox \"7e02f8d5186f2e48a411f12daf97b8da0b78e93e92ffcc5c423fc9a7cd727c14\" for &ContainerMetadata{Name:csi-node-driver-registrar,Attempt:0,} returns container id \"2f45f1d3ec076368bb5e4679eb63afa5d70d93a4d41c102338d7f907d101e36e\"" Jan 13 20:09:52.036860 containerd[1934]: time="2025-01-13T20:09:52.036820393Z" level=info msg="StartContainer for \"2f45f1d3ec076368bb5e4679eb63afa5d70d93a4d41c102338d7f907d101e36e\"" Jan 13 20:09:52.148663 systemd[1]: Started cri-containerd-2f45f1d3ec076368bb5e4679eb63afa5d70d93a4d41c102338d7f907d101e36e.scope - libcontainer container 2f45f1d3ec076368bb5e4679eb63afa5d70d93a4d41c102338d7f907d101e36e. Jan 13 20:09:52.317549 containerd[1934]: time="2025-01-13T20:09:52.317320994Z" level=info msg="StartContainer for \"2f45f1d3ec076368bb5e4679eb63afa5d70d93a4d41c102338d7f907d101e36e\" returns successfully" Jan 13 20:09:53.055100 kubelet[3423]: I0113 20:09:53.055052 3423 csi_plugin.go:99] kubernetes.io/csi: Trying to validate a new CSI Driver with name: csi.tigera.io endpoint: /var/lib/kubelet/plugins/csi.tigera.io/csi.sock versions: 1.0.0 Jan 13 20:09:53.055100 kubelet[3423]: I0113 20:09:53.055116 3423 csi_plugin.go:112] kubernetes.io/csi: Register new plugin with name: csi.tigera.io at endpoint: /var/lib/kubelet/plugins/csi.tigera.io/csi.sock Jan 13 20:09:56.884338 systemd[1]: Started sshd@19-172.31.28.23:22-147.75.109.163:48614.service - OpenSSH per-connection server daemon (147.75.109.163:48614). Jan 13 20:09:57.087271 sshd[7324]: Accepted publickey for core from 147.75.109.163 port 48614 ssh2: RSA SHA256:IRHkteilZRLg/mCVEzdResksy7NfUBDRRywgALKaHg0 Jan 13 20:09:57.090510 sshd-session[7324]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Jan 13 20:09:57.099310 systemd-logind[1912]: New session 20 of user core. Jan 13 20:09:57.112059 systemd[1]: Started session-20.scope - Session 20 of User core. Jan 13 20:09:57.410337 sshd[7329]: Connection closed by 147.75.109.163 port 48614 Jan 13 20:09:57.412449 sshd-session[7324]: pam_unix(sshd:session): session closed for user core Jan 13 20:09:57.423191 systemd[1]: sshd@19-172.31.28.23:22-147.75.109.163:48614.service: Deactivated successfully. Jan 13 20:09:57.431141 systemd[1]: session-20.scope: Deactivated successfully. Jan 13 20:09:57.433850 systemd-logind[1912]: Session 20 logged out. Waiting for processes to exit. Jan 13 20:09:57.438705 systemd-logind[1912]: Removed session 20. Jan 13 20:10:02.449319 systemd[1]: Started sshd@20-172.31.28.23:22-147.75.109.163:39806.service - OpenSSH per-connection server daemon (147.75.109.163:39806). Jan 13 20:10:02.643373 sshd[7341]: Accepted publickey for core from 147.75.109.163 port 39806 ssh2: RSA SHA256:IRHkteilZRLg/mCVEzdResksy7NfUBDRRywgALKaHg0 Jan 13 20:10:02.647050 sshd-session[7341]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Jan 13 20:10:02.657097 systemd-logind[1912]: New session 21 of user core. Jan 13 20:10:02.670066 systemd[1]: Started session-21.scope - Session 21 of User core. Jan 13 20:10:02.916455 sshd[7349]: Connection closed by 147.75.109.163 port 39806 Jan 13 20:10:02.916334 sshd-session[7341]: pam_unix(sshd:session): session closed for user core Jan 13 20:10:02.922067 systemd-logind[1912]: Session 21 logged out. Waiting for processes to exit. Jan 13 20:10:02.922629 systemd[1]: sshd@20-172.31.28.23:22-147.75.109.163:39806.service: Deactivated successfully. Jan 13 20:10:02.927714 systemd[1]: session-21.scope: Deactivated successfully. Jan 13 20:10:02.932876 systemd-logind[1912]: Removed session 21. Jan 13 20:10:06.913535 kubelet[3423]: I0113 20:10:06.912875 3423 pod_startup_latency_tracker.go:102] "Observed pod startup duration" pod="calico-system/csi-node-driver-wq54r" podStartSLOduration=49.550027806 podStartE2EDuration="1m0.912747151s" podCreationTimestamp="2025-01-13 20:09:06 +0000 UTC" firstStartedPulling="2025-01-13 20:09:40.638554828 +0000 UTC m=+69.044136308" lastFinishedPulling="2025-01-13 20:09:52.001274185 +0000 UTC m=+80.406855653" observedRunningTime="2025-01-13 20:09:53.124343738 +0000 UTC m=+81.529925242" watchObservedRunningTime="2025-01-13 20:10:06.912747151 +0000 UTC m=+95.318328631" Jan 13 20:10:07.958345 systemd[1]: Started sshd@21-172.31.28.23:22-147.75.109.163:38766.service - OpenSSH per-connection server daemon (147.75.109.163:38766). Jan 13 20:10:08.196757 sshd[7384]: Accepted publickey for core from 147.75.109.163 port 38766 ssh2: RSA SHA256:IRHkteilZRLg/mCVEzdResksy7NfUBDRRywgALKaHg0 Jan 13 20:10:08.200204 sshd-session[7384]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Jan 13 20:10:08.211023 systemd-logind[1912]: New session 22 of user core. Jan 13 20:10:08.217070 systemd[1]: Started session-22.scope - Session 22 of User core. Jan 13 20:10:08.469685 sshd[7386]: Connection closed by 147.75.109.163 port 38766 Jan 13 20:10:08.472178 sshd-session[7384]: pam_unix(sshd:session): session closed for user core Jan 13 20:10:08.478702 systemd-logind[1912]: Session 22 logged out. Waiting for processes to exit. Jan 13 20:10:08.479920 systemd[1]: sshd@21-172.31.28.23:22-147.75.109.163:38766.service: Deactivated successfully. Jan 13 20:10:08.486720 systemd[1]: session-22.scope: Deactivated successfully. Jan 13 20:10:08.494151 systemd-logind[1912]: Removed session 22. Jan 13 20:10:13.514346 systemd[1]: Started sshd@22-172.31.28.23:22-147.75.109.163:38776.service - OpenSSH per-connection server daemon (147.75.109.163:38776). Jan 13 20:10:13.705091 sshd[7398]: Accepted publickey for core from 147.75.109.163 port 38776 ssh2: RSA SHA256:IRHkteilZRLg/mCVEzdResksy7NfUBDRRywgALKaHg0 Jan 13 20:10:13.709507 sshd-session[7398]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Jan 13 20:10:13.721888 systemd-logind[1912]: New session 23 of user core. Jan 13 20:10:13.727039 systemd[1]: Started session-23.scope - Session 23 of User core. Jan 13 20:10:14.009504 sshd[7400]: Connection closed by 147.75.109.163 port 38776 Jan 13 20:10:14.011800 sshd-session[7398]: pam_unix(sshd:session): session closed for user core Jan 13 20:10:14.020092 systemd[1]: sshd@22-172.31.28.23:22-147.75.109.163:38776.service: Deactivated successfully. Jan 13 20:10:14.026141 systemd[1]: session-23.scope: Deactivated successfully. Jan 13 20:10:14.034525 systemd-logind[1912]: Session 23 logged out. Waiting for processes to exit. Jan 13 20:10:14.041299 systemd-logind[1912]: Removed session 23. Jan 13 20:10:19.051376 systemd[1]: Started sshd@23-172.31.28.23:22-147.75.109.163:39788.service - OpenSSH per-connection server daemon (147.75.109.163:39788). Jan 13 20:10:19.254532 sshd[7413]: Accepted publickey for core from 147.75.109.163 port 39788 ssh2: RSA SHA256:IRHkteilZRLg/mCVEzdResksy7NfUBDRRywgALKaHg0 Jan 13 20:10:19.258215 sshd-session[7413]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Jan 13 20:10:19.270445 systemd-logind[1912]: New session 24 of user core. Jan 13 20:10:19.282076 systemd[1]: Started session-24.scope - Session 24 of User core. Jan 13 20:10:19.544266 sshd[7415]: Connection closed by 147.75.109.163 port 39788 Jan 13 20:10:19.546157 sshd-session[7413]: pam_unix(sshd:session): session closed for user core Jan 13 20:10:19.551200 systemd[1]: sshd@23-172.31.28.23:22-147.75.109.163:39788.service: Deactivated successfully. Jan 13 20:10:19.558396 systemd[1]: session-24.scope: Deactivated successfully. Jan 13 20:10:19.565374 systemd-logind[1912]: Session 24 logged out. Waiting for processes to exit. Jan 13 20:10:19.567978 systemd-logind[1912]: Removed session 24. Jan 13 20:10:24.588366 systemd[1]: Started sshd@24-172.31.28.23:22-147.75.109.163:39798.service - OpenSSH per-connection server daemon (147.75.109.163:39798). Jan 13 20:10:24.779717 sshd[7453]: Accepted publickey for core from 147.75.109.163 port 39798 ssh2: RSA SHA256:IRHkteilZRLg/mCVEzdResksy7NfUBDRRywgALKaHg0 Jan 13 20:10:24.782269 sshd-session[7453]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Jan 13 20:10:24.789826 systemd-logind[1912]: New session 25 of user core. Jan 13 20:10:24.798054 systemd[1]: Started session-25.scope - Session 25 of User core. Jan 13 20:10:25.042234 sshd[7455]: Connection closed by 147.75.109.163 port 39798 Jan 13 20:10:25.043143 sshd-session[7453]: pam_unix(sshd:session): session closed for user core Jan 13 20:10:25.050207 systemd-logind[1912]: Session 25 logged out. Waiting for processes to exit. Jan 13 20:10:25.052979 systemd[1]: sshd@24-172.31.28.23:22-147.75.109.163:39798.service: Deactivated successfully. Jan 13 20:10:25.060072 systemd[1]: session-25.scope: Deactivated successfully. Jan 13 20:10:25.063346 systemd-logind[1912]: Removed session 25. Jan 13 20:10:30.082331 systemd[1]: Started sshd@25-172.31.28.23:22-147.75.109.163:55258.service - OpenSSH per-connection server daemon (147.75.109.163:55258). Jan 13 20:10:30.269367 sshd[7466]: Accepted publickey for core from 147.75.109.163 port 55258 ssh2: RSA SHA256:IRHkteilZRLg/mCVEzdResksy7NfUBDRRywgALKaHg0 Jan 13 20:10:30.271964 sshd-session[7466]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Jan 13 20:10:30.279990 systemd-logind[1912]: New session 26 of user core. Jan 13 20:10:30.287041 systemd[1]: Started session-26.scope - Session 26 of User core. Jan 13 20:10:30.543107 sshd[7468]: Connection closed by 147.75.109.163 port 55258 Jan 13 20:10:30.544429 sshd-session[7466]: pam_unix(sshd:session): session closed for user core Jan 13 20:10:30.551193 systemd-logind[1912]: Session 26 logged out. Waiting for processes to exit. Jan 13 20:10:30.552103 systemd[1]: sshd@25-172.31.28.23:22-147.75.109.163:55258.service: Deactivated successfully. Jan 13 20:10:30.557753 systemd[1]: session-26.scope: Deactivated successfully. Jan 13 20:10:30.560975 systemd-logind[1912]: Removed session 26. Jan 13 20:10:33.516998 containerd[1934]: time="2025-01-13T20:10:33.516847879Z" level=info msg="StopPodSandbox for \"fe203c0f7fc44f83207d781bd972b7ee26dab60b101be6081c8e7f2c82858f26\"" Jan 13 20:10:33.517616 containerd[1934]: time="2025-01-13T20:10:33.517034311Z" level=info msg="TearDown network for sandbox \"fe203c0f7fc44f83207d781bd972b7ee26dab60b101be6081c8e7f2c82858f26\" successfully" Jan 13 20:10:33.517616 containerd[1934]: time="2025-01-13T20:10:33.517060555Z" level=info msg="StopPodSandbox for \"fe203c0f7fc44f83207d781bd972b7ee26dab60b101be6081c8e7f2c82858f26\" returns successfully" Jan 13 20:10:33.518015 containerd[1934]: time="2025-01-13T20:10:33.517952875Z" level=info msg="RemovePodSandbox for \"fe203c0f7fc44f83207d781bd972b7ee26dab60b101be6081c8e7f2c82858f26\"" Jan 13 20:10:33.518158 containerd[1934]: time="2025-01-13T20:10:33.518015035Z" level=info msg="Forcibly stopping sandbox \"fe203c0f7fc44f83207d781bd972b7ee26dab60b101be6081c8e7f2c82858f26\"" Jan 13 20:10:33.518221 containerd[1934]: time="2025-01-13T20:10:33.518165851Z" level=info msg="TearDown network for sandbox \"fe203c0f7fc44f83207d781bd972b7ee26dab60b101be6081c8e7f2c82858f26\" successfully" Jan 13 20:10:33.523789 containerd[1934]: time="2025-01-13T20:10:33.523707895Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"fe203c0f7fc44f83207d781bd972b7ee26dab60b101be6081c8e7f2c82858f26\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:10:33.524068 containerd[1934]: time="2025-01-13T20:10:33.523835371Z" level=info msg="RemovePodSandbox \"fe203c0f7fc44f83207d781bd972b7ee26dab60b101be6081c8e7f2c82858f26\" returns successfully" Jan 13 20:10:33.524854 containerd[1934]: time="2025-01-13T20:10:33.524578459Z" level=info msg="StopPodSandbox for \"00e76c628c150112006f3b23d6e74781e4d42e1b9aecfc0a92d42b780e86d031\"" Jan 13 20:10:33.524854 containerd[1934]: time="2025-01-13T20:10:33.524736907Z" level=info msg="TearDown network for sandbox \"00e76c628c150112006f3b23d6e74781e4d42e1b9aecfc0a92d42b780e86d031\" successfully" Jan 13 20:10:33.525444 containerd[1934]: time="2025-01-13T20:10:33.524758243Z" level=info msg="StopPodSandbox for \"00e76c628c150112006f3b23d6e74781e4d42e1b9aecfc0a92d42b780e86d031\" returns successfully" Jan 13 20:10:33.525668 containerd[1934]: time="2025-01-13T20:10:33.525627091Z" level=info msg="RemovePodSandbox for \"00e76c628c150112006f3b23d6e74781e4d42e1b9aecfc0a92d42b780e86d031\"" Jan 13 20:10:33.525734 containerd[1934]: time="2025-01-13T20:10:33.525676087Z" level=info msg="Forcibly stopping sandbox \"00e76c628c150112006f3b23d6e74781e4d42e1b9aecfc0a92d42b780e86d031\"" Jan 13 20:10:33.525914 containerd[1934]: time="2025-01-13T20:10:33.525839167Z" level=info msg="TearDown network for sandbox \"00e76c628c150112006f3b23d6e74781e4d42e1b9aecfc0a92d42b780e86d031\" successfully" Jan 13 20:10:33.531342 containerd[1934]: time="2025-01-13T20:10:33.531275815Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"00e76c628c150112006f3b23d6e74781e4d42e1b9aecfc0a92d42b780e86d031\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:10:33.531466 containerd[1934]: time="2025-01-13T20:10:33.531378967Z" level=info msg="RemovePodSandbox \"00e76c628c150112006f3b23d6e74781e4d42e1b9aecfc0a92d42b780e86d031\" returns successfully" Jan 13 20:10:33.532209 containerd[1934]: time="2025-01-13T20:10:33.531977695Z" level=info msg="StopPodSandbox for \"759f8831ea7d7e5c0dc8d9495100af5070a0a535616a4fce422e9b8c07fb0a84\"" Jan 13 20:10:33.532209 containerd[1934]: time="2025-01-13T20:10:33.532150171Z" level=info msg="TearDown network for sandbox \"759f8831ea7d7e5c0dc8d9495100af5070a0a535616a4fce422e9b8c07fb0a84\" successfully" Jan 13 20:10:33.532209 containerd[1934]: time="2025-01-13T20:10:33.532174675Z" level=info msg="StopPodSandbox for \"759f8831ea7d7e5c0dc8d9495100af5070a0a535616a4fce422e9b8c07fb0a84\" returns successfully" Jan 13 20:10:33.533346 containerd[1934]: time="2025-01-13T20:10:33.533023903Z" level=info msg="RemovePodSandbox for \"759f8831ea7d7e5c0dc8d9495100af5070a0a535616a4fce422e9b8c07fb0a84\"" Jan 13 20:10:33.533346 containerd[1934]: time="2025-01-13T20:10:33.533068279Z" level=info msg="Forcibly stopping sandbox \"759f8831ea7d7e5c0dc8d9495100af5070a0a535616a4fce422e9b8c07fb0a84\"" Jan 13 20:10:33.534533 containerd[1934]: time="2025-01-13T20:10:33.533545867Z" level=info msg="TearDown network for sandbox \"759f8831ea7d7e5c0dc8d9495100af5070a0a535616a4fce422e9b8c07fb0a84\" successfully" Jan 13 20:10:33.539118 containerd[1934]: time="2025-01-13T20:10:33.539062159Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"759f8831ea7d7e5c0dc8d9495100af5070a0a535616a4fce422e9b8c07fb0a84\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:10:33.539351 containerd[1934]: time="2025-01-13T20:10:33.539320591Z" level=info msg="RemovePodSandbox \"759f8831ea7d7e5c0dc8d9495100af5070a0a535616a4fce422e9b8c07fb0a84\" returns successfully" Jan 13 20:10:33.540117 containerd[1934]: time="2025-01-13T20:10:33.540044419Z" level=info msg="StopPodSandbox for \"4ac0c7a43c6ee6bd4379d05f01c7bbee6cac7bc86c5982e2f97659e6e018f24c\"" Jan 13 20:10:33.540412 containerd[1934]: time="2025-01-13T20:10:33.540383743Z" level=info msg="TearDown network for sandbox \"4ac0c7a43c6ee6bd4379d05f01c7bbee6cac7bc86c5982e2f97659e6e018f24c\" successfully" Jan 13 20:10:33.540563 containerd[1934]: time="2025-01-13T20:10:33.540535747Z" level=info msg="StopPodSandbox for \"4ac0c7a43c6ee6bd4379d05f01c7bbee6cac7bc86c5982e2f97659e6e018f24c\" returns successfully" Jan 13 20:10:33.541243 containerd[1934]: time="2025-01-13T20:10:33.541199887Z" level=info msg="RemovePodSandbox for \"4ac0c7a43c6ee6bd4379d05f01c7bbee6cac7bc86c5982e2f97659e6e018f24c\"" Jan 13 20:10:33.541367 containerd[1934]: time="2025-01-13T20:10:33.541248811Z" level=info msg="Forcibly stopping sandbox \"4ac0c7a43c6ee6bd4379d05f01c7bbee6cac7bc86c5982e2f97659e6e018f24c\"" Jan 13 20:10:33.541430 containerd[1934]: time="2025-01-13T20:10:33.541396723Z" level=info msg="TearDown network for sandbox \"4ac0c7a43c6ee6bd4379d05f01c7bbee6cac7bc86c5982e2f97659e6e018f24c\" successfully" Jan 13 20:10:33.547577 containerd[1934]: time="2025-01-13T20:10:33.547029775Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"4ac0c7a43c6ee6bd4379d05f01c7bbee6cac7bc86c5982e2f97659e6e018f24c\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:10:33.547577 containerd[1934]: time="2025-01-13T20:10:33.547134151Z" level=info msg="RemovePodSandbox \"4ac0c7a43c6ee6bd4379d05f01c7bbee6cac7bc86c5982e2f97659e6e018f24c\" returns successfully" Jan 13 20:10:33.548117 containerd[1934]: time="2025-01-13T20:10:33.547959223Z" level=info msg="StopPodSandbox for \"871bb94da403609229c4f8c4907a3c7c7ff537ef7b689806a251f0915d567eea\"" Jan 13 20:10:33.548208 containerd[1934]: time="2025-01-13T20:10:33.548131099Z" level=info msg="TearDown network for sandbox \"871bb94da403609229c4f8c4907a3c7c7ff537ef7b689806a251f0915d567eea\" successfully" Jan 13 20:10:33.548208 containerd[1934]: time="2025-01-13T20:10:33.548153623Z" level=info msg="StopPodSandbox for \"871bb94da403609229c4f8c4907a3c7c7ff537ef7b689806a251f0915d567eea\" returns successfully" Jan 13 20:10:33.549259 containerd[1934]: time="2025-01-13T20:10:33.548724919Z" level=info msg="RemovePodSandbox for \"871bb94da403609229c4f8c4907a3c7c7ff537ef7b689806a251f0915d567eea\"" Jan 13 20:10:33.549259 containerd[1934]: time="2025-01-13T20:10:33.548768743Z" level=info msg="Forcibly stopping sandbox \"871bb94da403609229c4f8c4907a3c7c7ff537ef7b689806a251f0915d567eea\"" Jan 13 20:10:33.549259 containerd[1934]: time="2025-01-13T20:10:33.548981995Z" level=info msg="TearDown network for sandbox \"871bb94da403609229c4f8c4907a3c7c7ff537ef7b689806a251f0915d567eea\" successfully" Jan 13 20:10:33.554258 containerd[1934]: time="2025-01-13T20:10:33.554200459Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"871bb94da403609229c4f8c4907a3c7c7ff537ef7b689806a251f0915d567eea\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:10:33.554550 containerd[1934]: time="2025-01-13T20:10:33.554298451Z" level=info msg="RemovePodSandbox \"871bb94da403609229c4f8c4907a3c7c7ff537ef7b689806a251f0915d567eea\" returns successfully" Jan 13 20:10:33.555583 containerd[1934]: time="2025-01-13T20:10:33.555085627Z" level=info msg="StopPodSandbox for \"0c85ca62eb94f4e10d7b4154d1085f14ea6b6363ce2b9a48f55a28836e3adb05\"" Jan 13 20:10:33.555583 containerd[1934]: time="2025-01-13T20:10:33.555248587Z" level=info msg="TearDown network for sandbox \"0c85ca62eb94f4e10d7b4154d1085f14ea6b6363ce2b9a48f55a28836e3adb05\" successfully" Jan 13 20:10:33.555583 containerd[1934]: time="2025-01-13T20:10:33.555270115Z" level=info msg="StopPodSandbox for \"0c85ca62eb94f4e10d7b4154d1085f14ea6b6363ce2b9a48f55a28836e3adb05\" returns successfully" Jan 13 20:10:33.556568 containerd[1934]: time="2025-01-13T20:10:33.556212019Z" level=info msg="RemovePodSandbox for \"0c85ca62eb94f4e10d7b4154d1085f14ea6b6363ce2b9a48f55a28836e3adb05\"" Jan 13 20:10:33.556568 containerd[1934]: time="2025-01-13T20:10:33.556256275Z" level=info msg="Forcibly stopping sandbox \"0c85ca62eb94f4e10d7b4154d1085f14ea6b6363ce2b9a48f55a28836e3adb05\"" Jan 13 20:10:33.556568 containerd[1934]: time="2025-01-13T20:10:33.556380787Z" level=info msg="TearDown network for sandbox \"0c85ca62eb94f4e10d7b4154d1085f14ea6b6363ce2b9a48f55a28836e3adb05\" successfully" Jan 13 20:10:33.562189 containerd[1934]: time="2025-01-13T20:10:33.562123099Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"0c85ca62eb94f4e10d7b4154d1085f14ea6b6363ce2b9a48f55a28836e3adb05\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:10:33.562334 containerd[1934]: time="2025-01-13T20:10:33.562221511Z" level=info msg="RemovePodSandbox \"0c85ca62eb94f4e10d7b4154d1085f14ea6b6363ce2b9a48f55a28836e3adb05\" returns successfully" Jan 13 20:10:33.563214 containerd[1934]: time="2025-01-13T20:10:33.562915183Z" level=info msg="StopPodSandbox for \"8a99e8dc861e2951c12b20cfbc8fc211a864308d3e40d113adbf589f6bee301f\"" Jan 13 20:10:33.563214 containerd[1934]: time="2025-01-13T20:10:33.563101747Z" level=info msg="TearDown network for sandbox \"8a99e8dc861e2951c12b20cfbc8fc211a864308d3e40d113adbf589f6bee301f\" successfully" Jan 13 20:10:33.563214 containerd[1934]: time="2025-01-13T20:10:33.563124283Z" level=info msg="StopPodSandbox for \"8a99e8dc861e2951c12b20cfbc8fc211a864308d3e40d113adbf589f6bee301f\" returns successfully" Jan 13 20:10:33.564137 containerd[1934]: time="2025-01-13T20:10:33.563899963Z" level=info msg="RemovePodSandbox for \"8a99e8dc861e2951c12b20cfbc8fc211a864308d3e40d113adbf589f6bee301f\"" Jan 13 20:10:33.564137 containerd[1934]: time="2025-01-13T20:10:33.563947183Z" level=info msg="Forcibly stopping sandbox \"8a99e8dc861e2951c12b20cfbc8fc211a864308d3e40d113adbf589f6bee301f\"" Jan 13 20:10:33.564137 containerd[1934]: time="2025-01-13T20:10:33.564075043Z" level=info msg="TearDown network for sandbox \"8a99e8dc861e2951c12b20cfbc8fc211a864308d3e40d113adbf589f6bee301f\" successfully" Jan 13 20:10:33.570565 containerd[1934]: time="2025-01-13T20:10:33.570487891Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"8a99e8dc861e2951c12b20cfbc8fc211a864308d3e40d113adbf589f6bee301f\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:10:33.570739 containerd[1934]: time="2025-01-13T20:10:33.570585331Z" level=info msg="RemovePodSandbox \"8a99e8dc861e2951c12b20cfbc8fc211a864308d3e40d113adbf589f6bee301f\" returns successfully" Jan 13 20:10:33.571715 containerd[1934]: time="2025-01-13T20:10:33.571592083Z" level=info msg="StopPodSandbox for \"d7e007aaa7201b1cd3bba3d23f191a2156d907bb777d56434218f91e8693db69\"" Jan 13 20:10:33.571971 containerd[1934]: time="2025-01-13T20:10:33.571767283Z" level=info msg="TearDown network for sandbox \"d7e007aaa7201b1cd3bba3d23f191a2156d907bb777d56434218f91e8693db69\" successfully" Jan 13 20:10:33.571971 containerd[1934]: time="2025-01-13T20:10:33.571848463Z" level=info msg="StopPodSandbox for \"d7e007aaa7201b1cd3bba3d23f191a2156d907bb777d56434218f91e8693db69\" returns successfully" Jan 13 20:10:33.573391 containerd[1934]: time="2025-01-13T20:10:33.573345391Z" level=info msg="RemovePodSandbox for \"d7e007aaa7201b1cd3bba3d23f191a2156d907bb777d56434218f91e8693db69\"" Jan 13 20:10:33.573502 containerd[1934]: time="2025-01-13T20:10:33.573400771Z" level=info msg="Forcibly stopping sandbox \"d7e007aaa7201b1cd3bba3d23f191a2156d907bb777d56434218f91e8693db69\"" Jan 13 20:10:33.573581 containerd[1934]: time="2025-01-13T20:10:33.573542299Z" level=info msg="TearDown network for sandbox \"d7e007aaa7201b1cd3bba3d23f191a2156d907bb777d56434218f91e8693db69\" successfully" Jan 13 20:10:33.579914 containerd[1934]: time="2025-01-13T20:10:33.579838447Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"d7e007aaa7201b1cd3bba3d23f191a2156d907bb777d56434218f91e8693db69\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:10:33.580071 containerd[1934]: time="2025-01-13T20:10:33.579940699Z" level=info msg="RemovePodSandbox \"d7e007aaa7201b1cd3bba3d23f191a2156d907bb777d56434218f91e8693db69\" returns successfully" Jan 13 20:10:33.580958 containerd[1934]: time="2025-01-13T20:10:33.580913179Z" level=info msg="StopPodSandbox for \"4d3ce37a9c40510fd9d66de0b8c2ac5802b7067c8efb617b93564f6bfe5a5223\"" Jan 13 20:10:33.581123 containerd[1934]: time="2025-01-13T20:10:33.581089291Z" level=info msg="TearDown network for sandbox \"4d3ce37a9c40510fd9d66de0b8c2ac5802b7067c8efb617b93564f6bfe5a5223\" successfully" Jan 13 20:10:33.581196 containerd[1934]: time="2025-01-13T20:10:33.581122219Z" level=info msg="StopPodSandbox for \"4d3ce37a9c40510fd9d66de0b8c2ac5802b7067c8efb617b93564f6bfe5a5223\" returns successfully" Jan 13 20:10:33.582138 containerd[1934]: time="2025-01-13T20:10:33.581843311Z" level=info msg="RemovePodSandbox for \"4d3ce37a9c40510fd9d66de0b8c2ac5802b7067c8efb617b93564f6bfe5a5223\"" Jan 13 20:10:33.582138 containerd[1934]: time="2025-01-13T20:10:33.581887759Z" level=info msg="Forcibly stopping sandbox \"4d3ce37a9c40510fd9d66de0b8c2ac5802b7067c8efb617b93564f6bfe5a5223\"" Jan 13 20:10:33.582138 containerd[1934]: time="2025-01-13T20:10:33.582020059Z" level=info msg="TearDown network for sandbox \"4d3ce37a9c40510fd9d66de0b8c2ac5802b7067c8efb617b93564f6bfe5a5223\" successfully" Jan 13 20:10:33.587686 containerd[1934]: time="2025-01-13T20:10:33.587620843Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"4d3ce37a9c40510fd9d66de0b8c2ac5802b7067c8efb617b93564f6bfe5a5223\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:10:33.588022 containerd[1934]: time="2025-01-13T20:10:33.587720647Z" level=info msg="RemovePodSandbox \"4d3ce37a9c40510fd9d66de0b8c2ac5802b7067c8efb617b93564f6bfe5a5223\" returns successfully" Jan 13 20:10:33.588832 containerd[1934]: time="2025-01-13T20:10:33.588624847Z" level=info msg="StopPodSandbox for \"41f52017578a2719bea2c9934c17ea164adf7cb7d5ed2c0dd11787fd25b06487\"" Jan 13 20:10:33.589240 containerd[1934]: time="2025-01-13T20:10:33.589114351Z" level=info msg="TearDown network for sandbox \"41f52017578a2719bea2c9934c17ea164adf7cb7d5ed2c0dd11787fd25b06487\" successfully" Jan 13 20:10:33.589746 containerd[1934]: time="2025-01-13T20:10:33.589389607Z" level=info msg="StopPodSandbox for \"41f52017578a2719bea2c9934c17ea164adf7cb7d5ed2c0dd11787fd25b06487\" returns successfully" Jan 13 20:10:33.590334 containerd[1934]: time="2025-01-13T20:10:33.590274619Z" level=info msg="RemovePodSandbox for \"41f52017578a2719bea2c9934c17ea164adf7cb7d5ed2c0dd11787fd25b06487\"" Jan 13 20:10:33.590426 containerd[1934]: time="2025-01-13T20:10:33.590354563Z" level=info msg="Forcibly stopping sandbox \"41f52017578a2719bea2c9934c17ea164adf7cb7d5ed2c0dd11787fd25b06487\"" Jan 13 20:10:33.590522 containerd[1934]: time="2025-01-13T20:10:33.590489683Z" level=info msg="TearDown network for sandbox \"41f52017578a2719bea2c9934c17ea164adf7cb7d5ed2c0dd11787fd25b06487\" successfully" Jan 13 20:10:33.596953 containerd[1934]: time="2025-01-13T20:10:33.596886079Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"41f52017578a2719bea2c9934c17ea164adf7cb7d5ed2c0dd11787fd25b06487\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:10:33.597115 containerd[1934]: time="2025-01-13T20:10:33.596978047Z" level=info msg="RemovePodSandbox \"41f52017578a2719bea2c9934c17ea164adf7cb7d5ed2c0dd11787fd25b06487\" returns successfully" Jan 13 20:10:33.597686 containerd[1934]: time="2025-01-13T20:10:33.597649423Z" level=info msg="StopPodSandbox for \"caa6547227a1620b7a4197c3897d843edd199256b9961ceb916b76e9c94fcc3f\"" Jan 13 20:10:33.598427 containerd[1934]: time="2025-01-13T20:10:33.598149667Z" level=info msg="TearDown network for sandbox \"caa6547227a1620b7a4197c3897d843edd199256b9961ceb916b76e9c94fcc3f\" successfully" Jan 13 20:10:33.598427 containerd[1934]: time="2025-01-13T20:10:33.598179055Z" level=info msg="StopPodSandbox for \"caa6547227a1620b7a4197c3897d843edd199256b9961ceb916b76e9c94fcc3f\" returns successfully" Jan 13 20:10:33.599208 containerd[1934]: time="2025-01-13T20:10:33.598873147Z" level=info msg="RemovePodSandbox for \"caa6547227a1620b7a4197c3897d843edd199256b9961ceb916b76e9c94fcc3f\"" Jan 13 20:10:33.599208 containerd[1934]: time="2025-01-13T20:10:33.598918207Z" level=info msg="Forcibly stopping sandbox \"caa6547227a1620b7a4197c3897d843edd199256b9961ceb916b76e9c94fcc3f\"" Jan 13 20:10:33.599208 containerd[1934]: time="2025-01-13T20:10:33.599067799Z" level=info msg="TearDown network for sandbox \"caa6547227a1620b7a4197c3897d843edd199256b9961ceb916b76e9c94fcc3f\" successfully" Jan 13 20:10:33.605326 containerd[1934]: time="2025-01-13T20:10:33.605253583Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"caa6547227a1620b7a4197c3897d843edd199256b9961ceb916b76e9c94fcc3f\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:10:33.605476 containerd[1934]: time="2025-01-13T20:10:33.605355955Z" level=info msg="RemovePodSandbox \"caa6547227a1620b7a4197c3897d843edd199256b9961ceb916b76e9c94fcc3f\" returns successfully" Jan 13 20:10:33.606103 containerd[1934]: time="2025-01-13T20:10:33.606034111Z" level=info msg="StopPodSandbox for \"5cd26e99c4b74ae9d61483798457a99584070c404b0f9be16defa2c0bdb11350\"" Jan 13 20:10:33.606500 containerd[1934]: time="2025-01-13T20:10:33.606366211Z" level=info msg="TearDown network for sandbox \"5cd26e99c4b74ae9d61483798457a99584070c404b0f9be16defa2c0bdb11350\" successfully" Jan 13 20:10:33.606500 containerd[1934]: time="2025-01-13T20:10:33.606394039Z" level=info msg="StopPodSandbox for \"5cd26e99c4b74ae9d61483798457a99584070c404b0f9be16defa2c0bdb11350\" returns successfully" Jan 13 20:10:33.607060 containerd[1934]: time="2025-01-13T20:10:33.606962167Z" level=info msg="RemovePodSandbox for \"5cd26e99c4b74ae9d61483798457a99584070c404b0f9be16defa2c0bdb11350\"" Jan 13 20:10:33.607060 containerd[1934]: time="2025-01-13T20:10:33.607043071Z" level=info msg="Forcibly stopping sandbox \"5cd26e99c4b74ae9d61483798457a99584070c404b0f9be16defa2c0bdb11350\"" Jan 13 20:10:33.607220 containerd[1934]: time="2025-01-13T20:10:33.607182427Z" level=info msg="TearDown network for sandbox \"5cd26e99c4b74ae9d61483798457a99584070c404b0f9be16defa2c0bdb11350\" successfully" Jan 13 20:10:33.613228 containerd[1934]: time="2025-01-13T20:10:33.613129819Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"5cd26e99c4b74ae9d61483798457a99584070c404b0f9be16defa2c0bdb11350\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:10:33.613422 containerd[1934]: time="2025-01-13T20:10:33.613238683Z" level=info msg="RemovePodSandbox \"5cd26e99c4b74ae9d61483798457a99584070c404b0f9be16defa2c0bdb11350\" returns successfully" Jan 13 20:10:33.614599 containerd[1934]: time="2025-01-13T20:10:33.614246515Z" level=info msg="StopPodSandbox for \"c5843741cfbc56669be6f2c02c9dc5041d7f20ca6acda74c9a7725511ea41cc7\"" Jan 13 20:10:33.614599 containerd[1934]: time="2025-01-13T20:10:33.614429263Z" level=info msg="TearDown network for sandbox \"c5843741cfbc56669be6f2c02c9dc5041d7f20ca6acda74c9a7725511ea41cc7\" successfully" Jan 13 20:10:33.614599 containerd[1934]: time="2025-01-13T20:10:33.614452987Z" level=info msg="StopPodSandbox for \"c5843741cfbc56669be6f2c02c9dc5041d7f20ca6acda74c9a7725511ea41cc7\" returns successfully" Jan 13 20:10:33.615119 containerd[1934]: time="2025-01-13T20:10:33.615083131Z" level=info msg="RemovePodSandbox for \"c5843741cfbc56669be6f2c02c9dc5041d7f20ca6acda74c9a7725511ea41cc7\"" Jan 13 20:10:33.615809 containerd[1934]: time="2025-01-13T20:10:33.615222439Z" level=info msg="Forcibly stopping sandbox \"c5843741cfbc56669be6f2c02c9dc5041d7f20ca6acda74c9a7725511ea41cc7\"" Jan 13 20:10:33.615809 containerd[1934]: time="2025-01-13T20:10:33.615365035Z" level=info msg="TearDown network for sandbox \"c5843741cfbc56669be6f2c02c9dc5041d7f20ca6acda74c9a7725511ea41cc7\" successfully" Jan 13 20:10:33.621070 containerd[1934]: time="2025-01-13T20:10:33.621000415Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"c5843741cfbc56669be6f2c02c9dc5041d7f20ca6acda74c9a7725511ea41cc7\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:10:33.621192 containerd[1934]: time="2025-01-13T20:10:33.621130483Z" level=info msg="RemovePodSandbox \"c5843741cfbc56669be6f2c02c9dc5041d7f20ca6acda74c9a7725511ea41cc7\" returns successfully" Jan 13 20:10:33.622485 containerd[1934]: time="2025-01-13T20:10:33.621950359Z" level=info msg="StopPodSandbox for \"dfb5cc6aa8ee548a0817f76e636f6ba17a9915fccdeb0f77deba61f58d7154ee\"" Jan 13 20:10:33.622485 containerd[1934]: time="2025-01-13T20:10:33.622121875Z" level=info msg="TearDown network for sandbox \"dfb5cc6aa8ee548a0817f76e636f6ba17a9915fccdeb0f77deba61f58d7154ee\" successfully" Jan 13 20:10:33.622485 containerd[1934]: time="2025-01-13T20:10:33.622143595Z" level=info msg="StopPodSandbox for \"dfb5cc6aa8ee548a0817f76e636f6ba17a9915fccdeb0f77deba61f58d7154ee\" returns successfully" Jan 13 20:10:33.623519 containerd[1934]: time="2025-01-13T20:10:33.623367511Z" level=info msg="RemovePodSandbox for \"dfb5cc6aa8ee548a0817f76e636f6ba17a9915fccdeb0f77deba61f58d7154ee\"" Jan 13 20:10:33.623519 containerd[1934]: time="2025-01-13T20:10:33.623472703Z" level=info msg="Forcibly stopping sandbox \"dfb5cc6aa8ee548a0817f76e636f6ba17a9915fccdeb0f77deba61f58d7154ee\"" Jan 13 20:10:33.624060 containerd[1934]: time="2025-01-13T20:10:33.623891275Z" level=info msg="TearDown network for sandbox \"dfb5cc6aa8ee548a0817f76e636f6ba17a9915fccdeb0f77deba61f58d7154ee\" successfully" Jan 13 20:10:33.630865 containerd[1934]: time="2025-01-13T20:10:33.630707552Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"dfb5cc6aa8ee548a0817f76e636f6ba17a9915fccdeb0f77deba61f58d7154ee\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:10:33.631030 containerd[1934]: time="2025-01-13T20:10:33.630891992Z" level=info msg="RemovePodSandbox \"dfb5cc6aa8ee548a0817f76e636f6ba17a9915fccdeb0f77deba61f58d7154ee\" returns successfully" Jan 13 20:10:33.631713 containerd[1934]: time="2025-01-13T20:10:33.631655276Z" level=info msg="StopPodSandbox for \"6ca554906e8aff3cb9eab87b291894d187892c2a6910248683c6fe51f5efa9c4\"" Jan 13 20:10:33.632310 containerd[1934]: time="2025-01-13T20:10:33.631855544Z" level=info msg="TearDown network for sandbox \"6ca554906e8aff3cb9eab87b291894d187892c2a6910248683c6fe51f5efa9c4\" successfully" Jan 13 20:10:33.632310 containerd[1934]: time="2025-01-13T20:10:33.631904636Z" level=info msg="StopPodSandbox for \"6ca554906e8aff3cb9eab87b291894d187892c2a6910248683c6fe51f5efa9c4\" returns successfully" Jan 13 20:10:33.633034 containerd[1934]: time="2025-01-13T20:10:33.632681564Z" level=info msg="RemovePodSandbox for \"6ca554906e8aff3cb9eab87b291894d187892c2a6910248683c6fe51f5efa9c4\"" Jan 13 20:10:33.633034 containerd[1934]: time="2025-01-13T20:10:33.632742872Z" level=info msg="Forcibly stopping sandbox \"6ca554906e8aff3cb9eab87b291894d187892c2a6910248683c6fe51f5efa9c4\"" Jan 13 20:10:33.633034 containerd[1934]: time="2025-01-13T20:10:33.632920664Z" level=info msg="TearDown network for sandbox \"6ca554906e8aff3cb9eab87b291894d187892c2a6910248683c6fe51f5efa9c4\" successfully" Jan 13 20:10:33.638624 containerd[1934]: time="2025-01-13T20:10:33.638554796Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"6ca554906e8aff3cb9eab87b291894d187892c2a6910248683c6fe51f5efa9c4\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:10:33.638768 containerd[1934]: time="2025-01-13T20:10:33.638651396Z" level=info msg="RemovePodSandbox \"6ca554906e8aff3cb9eab87b291894d187892c2a6910248683c6fe51f5efa9c4\" returns successfully" Jan 13 20:10:33.639640 containerd[1934]: time="2025-01-13T20:10:33.639604580Z" level=info msg="StopPodSandbox for \"ec48cd1dd8723b80be1e1659222057350fc66ef8fc805243c67fca1b079b3aae\"" Jan 13 20:10:33.640037 containerd[1934]: time="2025-01-13T20:10:33.639895172Z" level=info msg="TearDown network for sandbox \"ec48cd1dd8723b80be1e1659222057350fc66ef8fc805243c67fca1b079b3aae\" successfully" Jan 13 20:10:33.640037 containerd[1934]: time="2025-01-13T20:10:33.639923300Z" level=info msg="StopPodSandbox for \"ec48cd1dd8723b80be1e1659222057350fc66ef8fc805243c67fca1b079b3aae\" returns successfully" Jan 13 20:10:33.640437 containerd[1934]: time="2025-01-13T20:10:33.640388876Z" level=info msg="RemovePodSandbox for \"ec48cd1dd8723b80be1e1659222057350fc66ef8fc805243c67fca1b079b3aae\"" Jan 13 20:10:33.640437 containerd[1934]: time="2025-01-13T20:10:33.640426640Z" level=info msg="Forcibly stopping sandbox \"ec48cd1dd8723b80be1e1659222057350fc66ef8fc805243c67fca1b079b3aae\"" Jan 13 20:10:33.640590 containerd[1934]: time="2025-01-13T20:10:33.640549652Z" level=info msg="TearDown network for sandbox \"ec48cd1dd8723b80be1e1659222057350fc66ef8fc805243c67fca1b079b3aae\" successfully" Jan 13 20:10:33.646465 containerd[1934]: time="2025-01-13T20:10:33.646398968Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"ec48cd1dd8723b80be1e1659222057350fc66ef8fc805243c67fca1b079b3aae\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:10:33.646746 containerd[1934]: time="2025-01-13T20:10:33.646494968Z" level=info msg="RemovePodSandbox \"ec48cd1dd8723b80be1e1659222057350fc66ef8fc805243c67fca1b079b3aae\" returns successfully" Jan 13 20:10:33.647654 containerd[1934]: time="2025-01-13T20:10:33.647517212Z" level=info msg="StopPodSandbox for \"a6e568904495292ebcaa2ddc464d5ea9ff23223173598373960a2371d9378c10\"" Jan 13 20:10:33.648291 containerd[1934]: time="2025-01-13T20:10:33.647859044Z" level=info msg="TearDown network for sandbox \"a6e568904495292ebcaa2ddc464d5ea9ff23223173598373960a2371d9378c10\" successfully" Jan 13 20:10:33.648291 containerd[1934]: time="2025-01-13T20:10:33.647887784Z" level=info msg="StopPodSandbox for \"a6e568904495292ebcaa2ddc464d5ea9ff23223173598373960a2371d9378c10\" returns successfully" Jan 13 20:10:33.648693 containerd[1934]: time="2025-01-13T20:10:33.648653960Z" level=info msg="RemovePodSandbox for \"a6e568904495292ebcaa2ddc464d5ea9ff23223173598373960a2371d9378c10\"" Jan 13 20:10:33.648796 containerd[1934]: time="2025-01-13T20:10:33.648702944Z" level=info msg="Forcibly stopping sandbox \"a6e568904495292ebcaa2ddc464d5ea9ff23223173598373960a2371d9378c10\"" Jan 13 20:10:33.648904 containerd[1934]: time="2025-01-13T20:10:33.648864476Z" level=info msg="TearDown network for sandbox \"a6e568904495292ebcaa2ddc464d5ea9ff23223173598373960a2371d9378c10\" successfully" Jan 13 20:10:33.654630 containerd[1934]: time="2025-01-13T20:10:33.654561392Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"a6e568904495292ebcaa2ddc464d5ea9ff23223173598373960a2371d9378c10\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:10:33.654815 containerd[1934]: time="2025-01-13T20:10:33.654656420Z" level=info msg="RemovePodSandbox \"a6e568904495292ebcaa2ddc464d5ea9ff23223173598373960a2371d9378c10\" returns successfully" Jan 13 20:10:33.655470 containerd[1934]: time="2025-01-13T20:10:33.655412216Z" level=info msg="StopPodSandbox for \"67fcc7567928ea411025d344ddf2c1047093ecdfa4752e1c7d8144d30ac99273\"" Jan 13 20:10:33.655621 containerd[1934]: time="2025-01-13T20:10:33.655585784Z" level=info msg="TearDown network for sandbox \"67fcc7567928ea411025d344ddf2c1047093ecdfa4752e1c7d8144d30ac99273\" successfully" Jan 13 20:10:33.655703 containerd[1934]: time="2025-01-13T20:10:33.655620020Z" level=info msg="StopPodSandbox for \"67fcc7567928ea411025d344ddf2c1047093ecdfa4752e1c7d8144d30ac99273\" returns successfully" Jan 13 20:10:33.656613 containerd[1934]: time="2025-01-13T20:10:33.656555576Z" level=info msg="RemovePodSandbox for \"67fcc7567928ea411025d344ddf2c1047093ecdfa4752e1c7d8144d30ac99273\"" Jan 13 20:10:33.656732 containerd[1934]: time="2025-01-13T20:10:33.656608436Z" level=info msg="Forcibly stopping sandbox \"67fcc7567928ea411025d344ddf2c1047093ecdfa4752e1c7d8144d30ac99273\"" Jan 13 20:10:33.656835 containerd[1934]: time="2025-01-13T20:10:33.656737040Z" level=info msg="TearDown network for sandbox \"67fcc7567928ea411025d344ddf2c1047093ecdfa4752e1c7d8144d30ac99273\" successfully" Jan 13 20:10:33.662613 containerd[1934]: time="2025-01-13T20:10:33.662549600Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"67fcc7567928ea411025d344ddf2c1047093ecdfa4752e1c7d8144d30ac99273\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:10:33.662761 containerd[1934]: time="2025-01-13T20:10:33.662641580Z" level=info msg="RemovePodSandbox \"67fcc7567928ea411025d344ddf2c1047093ecdfa4752e1c7d8144d30ac99273\" returns successfully" Jan 13 20:10:33.663937 containerd[1934]: time="2025-01-13T20:10:33.663545552Z" level=info msg="StopPodSandbox for \"2f9666670aab61aa1c36a5c18b2c6e8e3d08bf1cfc3f42fb8cc1ef7244f4257c\"" Jan 13 20:10:33.663937 containerd[1934]: time="2025-01-13T20:10:33.663724604Z" level=info msg="TearDown network for sandbox \"2f9666670aab61aa1c36a5c18b2c6e8e3d08bf1cfc3f42fb8cc1ef7244f4257c\" successfully" Jan 13 20:10:33.663937 containerd[1934]: time="2025-01-13T20:10:33.663747908Z" level=info msg="StopPodSandbox for \"2f9666670aab61aa1c36a5c18b2c6e8e3d08bf1cfc3f42fb8cc1ef7244f4257c\" returns successfully" Jan 13 20:10:33.664615 containerd[1934]: time="2025-01-13T20:10:33.664572812Z" level=info msg="RemovePodSandbox for \"2f9666670aab61aa1c36a5c18b2c6e8e3d08bf1cfc3f42fb8cc1ef7244f4257c\"" Jan 13 20:10:33.664736 containerd[1934]: time="2025-01-13T20:10:33.664620872Z" level=info msg="Forcibly stopping sandbox \"2f9666670aab61aa1c36a5c18b2c6e8e3d08bf1cfc3f42fb8cc1ef7244f4257c\"" Jan 13 20:10:33.664819 containerd[1934]: time="2025-01-13T20:10:33.664757156Z" level=info msg="TearDown network for sandbox \"2f9666670aab61aa1c36a5c18b2c6e8e3d08bf1cfc3f42fb8cc1ef7244f4257c\" successfully" Jan 13 20:10:33.670624 containerd[1934]: time="2025-01-13T20:10:33.670556660Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"2f9666670aab61aa1c36a5c18b2c6e8e3d08bf1cfc3f42fb8cc1ef7244f4257c\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:10:33.670918 containerd[1934]: time="2025-01-13T20:10:33.670655456Z" level=info msg="RemovePodSandbox \"2f9666670aab61aa1c36a5c18b2c6e8e3d08bf1cfc3f42fb8cc1ef7244f4257c\" returns successfully" Jan 13 20:10:33.671663 containerd[1934]: time="2025-01-13T20:10:33.671519972Z" level=info msg="StopPodSandbox for \"5eeccd24bcd272ceac794541253f4c8a557a6e36ba0959e6db5a98b61fca47a2\"" Jan 13 20:10:33.671869 containerd[1934]: time="2025-01-13T20:10:33.671678060Z" level=info msg="TearDown network for sandbox \"5eeccd24bcd272ceac794541253f4c8a557a6e36ba0959e6db5a98b61fca47a2\" successfully" Jan 13 20:10:33.671869 containerd[1934]: time="2025-01-13T20:10:33.671700092Z" level=info msg="StopPodSandbox for \"5eeccd24bcd272ceac794541253f4c8a557a6e36ba0959e6db5a98b61fca47a2\" returns successfully" Jan 13 20:10:33.672960 containerd[1934]: time="2025-01-13T20:10:33.672359528Z" level=info msg="RemovePodSandbox for \"5eeccd24bcd272ceac794541253f4c8a557a6e36ba0959e6db5a98b61fca47a2\"" Jan 13 20:10:33.672960 containerd[1934]: time="2025-01-13T20:10:33.672406736Z" level=info msg="Forcibly stopping sandbox \"5eeccd24bcd272ceac794541253f4c8a557a6e36ba0959e6db5a98b61fca47a2\"" Jan 13 20:10:33.672960 containerd[1934]: time="2025-01-13T20:10:33.672530264Z" level=info msg="TearDown network for sandbox \"5eeccd24bcd272ceac794541253f4c8a557a6e36ba0959e6db5a98b61fca47a2\" successfully" Jan 13 20:10:33.678523 containerd[1934]: time="2025-01-13T20:10:33.678456476Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"5eeccd24bcd272ceac794541253f4c8a557a6e36ba0959e6db5a98b61fca47a2\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:10:33.678668 containerd[1934]: time="2025-01-13T20:10:33.678570956Z" level=info msg="RemovePodSandbox \"5eeccd24bcd272ceac794541253f4c8a557a6e36ba0959e6db5a98b61fca47a2\" returns successfully" Jan 13 20:10:33.679840 containerd[1934]: time="2025-01-13T20:10:33.679590128Z" level=info msg="StopPodSandbox for \"7923d55515294cf3728cfef254022ed5f094d697790fafcc5064fca07c9e6e58\"" Jan 13 20:10:33.679840 containerd[1934]: time="2025-01-13T20:10:33.679755176Z" level=info msg="TearDown network for sandbox \"7923d55515294cf3728cfef254022ed5f094d697790fafcc5064fca07c9e6e58\" successfully" Jan 13 20:10:33.680107 containerd[1934]: time="2025-01-13T20:10:33.679872140Z" level=info msg="StopPodSandbox for \"7923d55515294cf3728cfef254022ed5f094d697790fafcc5064fca07c9e6e58\" returns successfully" Jan 13 20:10:33.680638 containerd[1934]: time="2025-01-13T20:10:33.680594636Z" level=info msg="RemovePodSandbox for \"7923d55515294cf3728cfef254022ed5f094d697790fafcc5064fca07c9e6e58\"" Jan 13 20:10:33.680728 containerd[1934]: time="2025-01-13T20:10:33.680668664Z" level=info msg="Forcibly stopping sandbox \"7923d55515294cf3728cfef254022ed5f094d697790fafcc5064fca07c9e6e58\"" Jan 13 20:10:33.680855 containerd[1934]: time="2025-01-13T20:10:33.680821616Z" level=info msg="TearDown network for sandbox \"7923d55515294cf3728cfef254022ed5f094d697790fafcc5064fca07c9e6e58\" successfully" Jan 13 20:10:33.687285 containerd[1934]: time="2025-01-13T20:10:33.687165908Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"7923d55515294cf3728cfef254022ed5f094d697790fafcc5064fca07c9e6e58\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:10:33.687424 containerd[1934]: time="2025-01-13T20:10:33.687354236Z" level=info msg="RemovePodSandbox \"7923d55515294cf3728cfef254022ed5f094d697790fafcc5064fca07c9e6e58\" returns successfully" Jan 13 20:10:33.688375 containerd[1934]: time="2025-01-13T20:10:33.688261076Z" level=info msg="StopPodSandbox for \"77152f189a6575845e406c6b88f4c5ab02cd6b3300ee242fe45d39a9e4f1b8a0\"" Jan 13 20:10:33.688561 containerd[1934]: time="2025-01-13T20:10:33.688525976Z" level=info msg="TearDown network for sandbox \"77152f189a6575845e406c6b88f4c5ab02cd6b3300ee242fe45d39a9e4f1b8a0\" successfully" Jan 13 20:10:33.688956 containerd[1934]: time="2025-01-13T20:10:33.688559768Z" level=info msg="StopPodSandbox for \"77152f189a6575845e406c6b88f4c5ab02cd6b3300ee242fe45d39a9e4f1b8a0\" returns successfully" Jan 13 20:10:33.689293 containerd[1934]: time="2025-01-13T20:10:33.689251832Z" level=info msg="RemovePodSandbox for \"77152f189a6575845e406c6b88f4c5ab02cd6b3300ee242fe45d39a9e4f1b8a0\"" Jan 13 20:10:33.689395 containerd[1934]: time="2025-01-13T20:10:33.689303540Z" level=info msg="Forcibly stopping sandbox \"77152f189a6575845e406c6b88f4c5ab02cd6b3300ee242fe45d39a9e4f1b8a0\"" Jan 13 20:10:33.689511 containerd[1934]: time="2025-01-13T20:10:33.689455268Z" level=info msg="TearDown network for sandbox \"77152f189a6575845e406c6b88f4c5ab02cd6b3300ee242fe45d39a9e4f1b8a0\" successfully" Jan 13 20:10:33.695173 containerd[1934]: time="2025-01-13T20:10:33.695101616Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"77152f189a6575845e406c6b88f4c5ab02cd6b3300ee242fe45d39a9e4f1b8a0\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:10:33.695301 containerd[1934]: time="2025-01-13T20:10:33.695202476Z" level=info msg="RemovePodSandbox \"77152f189a6575845e406c6b88f4c5ab02cd6b3300ee242fe45d39a9e4f1b8a0\" returns successfully" Jan 13 20:10:33.696169 containerd[1934]: time="2025-01-13T20:10:33.695915888Z" level=info msg="StopPodSandbox for \"dec83f53d2791c9f727bb49f34c2c033d903e826c66acd0aceb404182efb08ed\"" Jan 13 20:10:33.696169 containerd[1934]: time="2025-01-13T20:10:33.696071768Z" level=info msg="TearDown network for sandbox \"dec83f53d2791c9f727bb49f34c2c033d903e826c66acd0aceb404182efb08ed\" successfully" Jan 13 20:10:33.696169 containerd[1934]: time="2025-01-13T20:10:33.696093200Z" level=info msg="StopPodSandbox for \"dec83f53d2791c9f727bb49f34c2c033d903e826c66acd0aceb404182efb08ed\" returns successfully" Jan 13 20:10:33.697313 containerd[1934]: time="2025-01-13T20:10:33.697227992Z" level=info msg="RemovePodSandbox for \"dec83f53d2791c9f727bb49f34c2c033d903e826c66acd0aceb404182efb08ed\"" Jan 13 20:10:33.697313 containerd[1934]: time="2025-01-13T20:10:33.697272512Z" level=info msg="Forcibly stopping sandbox \"dec83f53d2791c9f727bb49f34c2c033d903e826c66acd0aceb404182efb08ed\"" Jan 13 20:10:33.697494 containerd[1934]: time="2025-01-13T20:10:33.697405796Z" level=info msg="TearDown network for sandbox \"dec83f53d2791c9f727bb49f34c2c033d903e826c66acd0aceb404182efb08ed\" successfully" Jan 13 20:10:33.703504 containerd[1934]: time="2025-01-13T20:10:33.703427288Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"dec83f53d2791c9f727bb49f34c2c033d903e826c66acd0aceb404182efb08ed\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:10:33.703859 containerd[1934]: time="2025-01-13T20:10:33.703524872Z" level=info msg="RemovePodSandbox \"dec83f53d2791c9f727bb49f34c2c033d903e826c66acd0aceb404182efb08ed\" returns successfully" Jan 13 20:10:33.704197 containerd[1934]: time="2025-01-13T20:10:33.704149376Z" level=info msg="StopPodSandbox for \"4a448ddaae657a72707e2505e7b6329129c1ea98f60de221b826b6b205a6ff6b\"" Jan 13 20:10:33.704380 containerd[1934]: time="2025-01-13T20:10:33.704335520Z" level=info msg="TearDown network for sandbox \"4a448ddaae657a72707e2505e7b6329129c1ea98f60de221b826b6b205a6ff6b\" successfully" Jan 13 20:10:33.704380 containerd[1934]: time="2025-01-13T20:10:33.704368592Z" level=info msg="StopPodSandbox for \"4a448ddaae657a72707e2505e7b6329129c1ea98f60de221b826b6b205a6ff6b\" returns successfully" Jan 13 20:10:33.705222 containerd[1934]: time="2025-01-13T20:10:33.704928092Z" level=info msg="RemovePodSandbox for \"4a448ddaae657a72707e2505e7b6329129c1ea98f60de221b826b6b205a6ff6b\"" Jan 13 20:10:33.705222 containerd[1934]: time="2025-01-13T20:10:33.704971640Z" level=info msg="Forcibly stopping sandbox \"4a448ddaae657a72707e2505e7b6329129c1ea98f60de221b826b6b205a6ff6b\"" Jan 13 20:10:33.705222 containerd[1934]: time="2025-01-13T20:10:33.705108704Z" level=info msg="TearDown network for sandbox \"4a448ddaae657a72707e2505e7b6329129c1ea98f60de221b826b6b205a6ff6b\" successfully" Jan 13 20:10:33.720214 containerd[1934]: time="2025-01-13T20:10:33.720146132Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"4a448ddaae657a72707e2505e7b6329129c1ea98f60de221b826b6b205a6ff6b\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:10:33.720817 containerd[1934]: time="2025-01-13T20:10:33.720243080Z" level=info msg="RemovePodSandbox \"4a448ddaae657a72707e2505e7b6329129c1ea98f60de221b826b6b205a6ff6b\" returns successfully" Jan 13 20:10:33.721461 containerd[1934]: time="2025-01-13T20:10:33.721276568Z" level=info msg="StopPodSandbox for \"e4f3782869a95e1724e7fed0918f96150403f3af79725f813cf600d13dab0323\"" Jan 13 20:10:33.721727 containerd[1934]: time="2025-01-13T20:10:33.721616168Z" level=info msg="TearDown network for sandbox \"e4f3782869a95e1724e7fed0918f96150403f3af79725f813cf600d13dab0323\" successfully" Jan 13 20:10:33.721727 containerd[1934]: time="2025-01-13T20:10:33.721667540Z" level=info msg="StopPodSandbox for \"e4f3782869a95e1724e7fed0918f96150403f3af79725f813cf600d13dab0323\" returns successfully" Jan 13 20:10:33.722838 containerd[1934]: time="2025-01-13T20:10:33.722559056Z" level=info msg="RemovePodSandbox for \"e4f3782869a95e1724e7fed0918f96150403f3af79725f813cf600d13dab0323\"" Jan 13 20:10:33.722838 containerd[1934]: time="2025-01-13T20:10:33.722601296Z" level=info msg="Forcibly stopping sandbox \"e4f3782869a95e1724e7fed0918f96150403f3af79725f813cf600d13dab0323\"" Jan 13 20:10:33.722838 containerd[1934]: time="2025-01-13T20:10:33.722733020Z" level=info msg="TearDown network for sandbox \"e4f3782869a95e1724e7fed0918f96150403f3af79725f813cf600d13dab0323\" successfully" Jan 13 20:10:33.728767 containerd[1934]: time="2025-01-13T20:10:33.728690096Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"e4f3782869a95e1724e7fed0918f96150403f3af79725f813cf600d13dab0323\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:10:33.729102 containerd[1934]: time="2025-01-13T20:10:33.728819828Z" level=info msg="RemovePodSandbox \"e4f3782869a95e1724e7fed0918f96150403f3af79725f813cf600d13dab0323\" returns successfully" Jan 13 20:10:33.729846 containerd[1934]: time="2025-01-13T20:10:33.729671876Z" level=info msg="StopPodSandbox for \"b9dad2faee8703ada2153172211cd7c9c21998773d8f3d149c73e589c95a0df9\"" Jan 13 20:10:33.730504 containerd[1934]: time="2025-01-13T20:10:33.730307708Z" level=info msg="TearDown network for sandbox \"b9dad2faee8703ada2153172211cd7c9c21998773d8f3d149c73e589c95a0df9\" successfully" Jan 13 20:10:33.730504 containerd[1934]: time="2025-01-13T20:10:33.730342340Z" level=info msg="StopPodSandbox for \"b9dad2faee8703ada2153172211cd7c9c21998773d8f3d149c73e589c95a0df9\" returns successfully" Jan 13 20:10:33.731352 containerd[1934]: time="2025-01-13T20:10:33.731307860Z" level=info msg="RemovePodSandbox for \"b9dad2faee8703ada2153172211cd7c9c21998773d8f3d149c73e589c95a0df9\"" Jan 13 20:10:33.731478 containerd[1934]: time="2025-01-13T20:10:33.731359712Z" level=info msg="Forcibly stopping sandbox \"b9dad2faee8703ada2153172211cd7c9c21998773d8f3d149c73e589c95a0df9\"" Jan 13 20:10:33.731696 containerd[1934]: time="2025-01-13T20:10:33.731489312Z" level=info msg="TearDown network for sandbox \"b9dad2faee8703ada2153172211cd7c9c21998773d8f3d149c73e589c95a0df9\" successfully" Jan 13 20:10:33.741420 containerd[1934]: time="2025-01-13T20:10:33.741338828Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"b9dad2faee8703ada2153172211cd7c9c21998773d8f3d149c73e589c95a0df9\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:10:33.741588 containerd[1934]: time="2025-01-13T20:10:33.741505556Z" level=info msg="RemovePodSandbox \"b9dad2faee8703ada2153172211cd7c9c21998773d8f3d149c73e589c95a0df9\" returns successfully" Jan 13 20:10:33.745016 containerd[1934]: time="2025-01-13T20:10:33.744424592Z" level=info msg="StopPodSandbox for \"f61266732570b1ffd19ff06a0bf2f4eddbc7ebeabca7bbec643cd8ab64f4d6bb\"" Jan 13 20:10:33.745016 containerd[1934]: time="2025-01-13T20:10:33.744609812Z" level=info msg="TearDown network for sandbox \"f61266732570b1ffd19ff06a0bf2f4eddbc7ebeabca7bbec643cd8ab64f4d6bb\" successfully" Jan 13 20:10:33.745016 containerd[1934]: time="2025-01-13T20:10:33.744632948Z" level=info msg="StopPodSandbox for \"f61266732570b1ffd19ff06a0bf2f4eddbc7ebeabca7bbec643cd8ab64f4d6bb\" returns successfully" Jan 13 20:10:33.745745 containerd[1934]: time="2025-01-13T20:10:33.745681628Z" level=info msg="RemovePodSandbox for \"f61266732570b1ffd19ff06a0bf2f4eddbc7ebeabca7bbec643cd8ab64f4d6bb\"" Jan 13 20:10:33.745994 containerd[1934]: time="2025-01-13T20:10:33.745820756Z" level=info msg="Forcibly stopping sandbox \"f61266732570b1ffd19ff06a0bf2f4eddbc7ebeabca7bbec643cd8ab64f4d6bb\"" Jan 13 20:10:33.746392 containerd[1934]: time="2025-01-13T20:10:33.746182040Z" level=info msg="TearDown network for sandbox \"f61266732570b1ffd19ff06a0bf2f4eddbc7ebeabca7bbec643cd8ab64f4d6bb\" successfully" Jan 13 20:10:33.753009 containerd[1934]: time="2025-01-13T20:10:33.752895500Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"f61266732570b1ffd19ff06a0bf2f4eddbc7ebeabca7bbec643cd8ab64f4d6bb\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus." Jan 13 20:10:33.753263 containerd[1934]: time="2025-01-13T20:10:33.753015080Z" level=info msg="RemovePodSandbox \"f61266732570b1ffd19ff06a0bf2f4eddbc7ebeabca7bbec643cd8ab64f4d6bb\" returns successfully" Jan 13 20:10:44.290486 kubelet[3423]: E0113 20:10:44.290253 3423 controller.go:195] "Failed to update lease" err="Put \"https://172.31.28.23:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-172-31-28-23?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Jan 13 20:10:45.376089 systemd[1]: cri-containerd-243df600eb5b014384d703fd7d77d9eb3ac06229ac41df1e6c4268d4fc57ae1a.scope: Deactivated successfully. Jan 13 20:10:45.376601 systemd[1]: cri-containerd-243df600eb5b014384d703fd7d77d9eb3ac06229ac41df1e6c4268d4fc57ae1a.scope: Consumed 4.770s CPU time, 24.3M memory peak, 0B memory swap peak. Jan 13 20:10:45.421861 containerd[1934]: time="2025-01-13T20:10:45.419370990Z" level=info msg="shim disconnected" id=243df600eb5b014384d703fd7d77d9eb3ac06229ac41df1e6c4268d4fc57ae1a namespace=k8s.io Jan 13 20:10:45.421861 containerd[1934]: time="2025-01-13T20:10:45.419454702Z" level=warning msg="cleaning up after shim disconnected" id=243df600eb5b014384d703fd7d77d9eb3ac06229ac41df1e6c4268d4fc57ae1a namespace=k8s.io Jan 13 20:10:45.421861 containerd[1934]: time="2025-01-13T20:10:45.419476062Z" level=info msg="cleaning up dead shim" namespace=k8s.io Jan 13 20:10:45.430659 systemd[1]: run-containerd-io.containerd.runtime.v2.task-k8s.io-243df600eb5b014384d703fd7d77d9eb3ac06229ac41df1e6c4268d4fc57ae1a-rootfs.mount: Deactivated successfully. Jan 13 20:10:45.443999 containerd[1934]: time="2025-01-13T20:10:45.443923230Z" level=warning msg="cleanup warnings time=\"2025-01-13T20:10:45Z\" level=warning msg=\"failed to remove runc container\" error=\"runc did not terminate successfully: exit status 255: \" runtime=io.containerd.runc.v2\n" namespace=k8s.io Jan 13 20:10:45.521747 systemd[1]: cri-containerd-e50ffdf5d100932a565029f8d2d170e58bb0efc1e1b83f5c3036734e34e7ce69.scope: Deactivated successfully. Jan 13 20:10:45.523270 systemd[1]: cri-containerd-e50ffdf5d100932a565029f8d2d170e58bb0efc1e1b83f5c3036734e34e7ce69.scope: Consumed 7.498s CPU time. Jan 13 20:10:45.566111 containerd[1934]: time="2025-01-13T20:10:45.564021199Z" level=info msg="shim disconnected" id=e50ffdf5d100932a565029f8d2d170e58bb0efc1e1b83f5c3036734e34e7ce69 namespace=k8s.io Jan 13 20:10:45.566111 containerd[1934]: time="2025-01-13T20:10:45.564154687Z" level=warning msg="cleaning up after shim disconnected" id=e50ffdf5d100932a565029f8d2d170e58bb0efc1e1b83f5c3036734e34e7ce69 namespace=k8s.io Jan 13 20:10:45.566111 containerd[1934]: time="2025-01-13T20:10:45.564177103Z" level=info msg="cleaning up dead shim" namespace=k8s.io Jan 13 20:10:45.564687 systemd[1]: run-containerd-io.containerd.runtime.v2.task-k8s.io-e50ffdf5d100932a565029f8d2d170e58bb0efc1e1b83f5c3036734e34e7ce69-rootfs.mount: Deactivated successfully. Jan 13 20:10:46.292994 kubelet[3423]: I0113 20:10:46.292942 3423 scope.go:117] "RemoveContainer" containerID="243df600eb5b014384d703fd7d77d9eb3ac06229ac41df1e6c4268d4fc57ae1a" Jan 13 20:10:46.293909 kubelet[3423]: I0113 20:10:46.293420 3423 scope.go:117] "RemoveContainer" containerID="e50ffdf5d100932a565029f8d2d170e58bb0efc1e1b83f5c3036734e34e7ce69" Jan 13 20:10:46.297376 containerd[1934]: time="2025-01-13T20:10:46.297054210Z" level=info msg="CreateContainer within sandbox \"bb3d236ec0067ae548302b8574a3752adb5d128e13bf5ddf15d6c06e888c9d5a\" for container &ContainerMetadata{Name:tigera-operator,Attempt:1,}" Jan 13 20:10:46.299678 containerd[1934]: time="2025-01-13T20:10:46.299627070Z" level=info msg="CreateContainer within sandbox \"5dd34a8292ea64434f46c227f187a310b55b72b0487bc667bfbd5e72ec90837e\" for container &ContainerMetadata{Name:kube-controller-manager,Attempt:1,}" Jan 13 20:10:46.348296 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount3451643927.mount: Deactivated successfully. Jan 13 20:10:46.385162 containerd[1934]: time="2025-01-13T20:10:46.385045219Z" level=info msg="CreateContainer within sandbox \"bb3d236ec0067ae548302b8574a3752adb5d128e13bf5ddf15d6c06e888c9d5a\" for &ContainerMetadata{Name:tigera-operator,Attempt:1,} returns container id \"6f551d2381d9f209d342c19253c5d830c49f8a8b5548bc93c3739abefd745ddc\"" Jan 13 20:10:46.385932 containerd[1934]: time="2025-01-13T20:10:46.385866475Z" level=info msg="StartContainer for \"6f551d2381d9f209d342c19253c5d830c49f8a8b5548bc93c3739abefd745ddc\"" Jan 13 20:10:46.391842 containerd[1934]: time="2025-01-13T20:10:46.391756267Z" level=info msg="CreateContainer within sandbox \"5dd34a8292ea64434f46c227f187a310b55b72b0487bc667bfbd5e72ec90837e\" for &ContainerMetadata{Name:kube-controller-manager,Attempt:1,} returns container id \"82ce3aeaedce56f6bef033eba2d63e0f0a1cf33d23d6bf8c4411e39985408051\"" Jan 13 20:10:46.393397 containerd[1934]: time="2025-01-13T20:10:46.393066343Z" level=info msg="StartContainer for \"82ce3aeaedce56f6bef033eba2d63e0f0a1cf33d23d6bf8c4411e39985408051\"" Jan 13 20:10:46.435238 systemd[1]: var-lib-containerd-tmpmounts-containerd\x2dmount2658119076.mount: Deactivated successfully. Jan 13 20:10:46.471380 systemd[1]: Started cri-containerd-6f551d2381d9f209d342c19253c5d830c49f8a8b5548bc93c3739abefd745ddc.scope - libcontainer container 6f551d2381d9f209d342c19253c5d830c49f8a8b5548bc93c3739abefd745ddc. Jan 13 20:10:46.499994 systemd[1]: run-containerd-runc-k8s.io-82ce3aeaedce56f6bef033eba2d63e0f0a1cf33d23d6bf8c4411e39985408051-runc.MgJaYK.mount: Deactivated successfully. Jan 13 20:10:46.517097 systemd[1]: Started cri-containerd-82ce3aeaedce56f6bef033eba2d63e0f0a1cf33d23d6bf8c4411e39985408051.scope - libcontainer container 82ce3aeaedce56f6bef033eba2d63e0f0a1cf33d23d6bf8c4411e39985408051. Jan 13 20:10:46.558628 containerd[1934]: time="2025-01-13T20:10:46.556469444Z" level=info msg="StartContainer for \"6f551d2381d9f209d342c19253c5d830c49f8a8b5548bc93c3739abefd745ddc\" returns successfully" Jan 13 20:10:46.613792 containerd[1934]: time="2025-01-13T20:10:46.613673036Z" level=info msg="StartContainer for \"82ce3aeaedce56f6bef033eba2d63e0f0a1cf33d23d6bf8c4411e39985408051\" returns successfully" Jan 13 20:10:49.867749 systemd[1]: cri-containerd-babf7591257aab51901e37366009eaa3f9725094668988092d63ebe315506cc7.scope: Deactivated successfully. Jan 13 20:10:49.868224 systemd[1]: cri-containerd-babf7591257aab51901e37366009eaa3f9725094668988092d63ebe315506cc7.scope: Consumed 3.649s CPU time, 16.0M memory peak, 0B memory swap peak. Jan 13 20:10:49.910799 containerd[1934]: time="2025-01-13T20:10:49.908975592Z" level=info msg="shim disconnected" id=babf7591257aab51901e37366009eaa3f9725094668988092d63ebe315506cc7 namespace=k8s.io Jan 13 20:10:49.912116 containerd[1934]: time="2025-01-13T20:10:49.911414136Z" level=warning msg="cleaning up after shim disconnected" id=babf7591257aab51901e37366009eaa3f9725094668988092d63ebe315506cc7 namespace=k8s.io Jan 13 20:10:49.912116 containerd[1934]: time="2025-01-13T20:10:49.911457396Z" level=info msg="cleaning up dead shim" namespace=k8s.io Jan 13 20:10:49.911524 systemd[1]: run-containerd-io.containerd.runtime.v2.task-k8s.io-babf7591257aab51901e37366009eaa3f9725094668988092d63ebe315506cc7-rootfs.mount: Deactivated successfully. Jan 13 20:10:50.313998 kubelet[3423]: I0113 20:10:50.313926 3423 scope.go:117] "RemoveContainer" containerID="babf7591257aab51901e37366009eaa3f9725094668988092d63ebe315506cc7" Jan 13 20:10:50.317646 containerd[1934]: time="2025-01-13T20:10:50.317545990Z" level=info msg="CreateContainer within sandbox \"318a2542690705542b8d89d24b702d775fc8d84c651bb9102b1b24ffdcbccb5b\" for container &ContainerMetadata{Name:kube-scheduler,Attempt:1,}" Jan 13 20:10:50.341887 containerd[1934]: time="2025-01-13T20:10:50.341819039Z" level=info msg="CreateContainer within sandbox \"318a2542690705542b8d89d24b702d775fc8d84c651bb9102b1b24ffdcbccb5b\" for &ContainerMetadata{Name:kube-scheduler,Attempt:1,} returns container id \"1dcacb806e1c63d925247497966ad2b37ed671dabe71f007ee47c6d6e583b66b\"" Jan 13 20:10:50.343186 containerd[1934]: time="2025-01-13T20:10:50.343141199Z" level=info msg="StartContainer for \"1dcacb806e1c63d925247497966ad2b37ed671dabe71f007ee47c6d6e583b66b\"" Jan 13 20:10:50.401126 systemd[1]: Started cri-containerd-1dcacb806e1c63d925247497966ad2b37ed671dabe71f007ee47c6d6e583b66b.scope - libcontainer container 1dcacb806e1c63d925247497966ad2b37ed671dabe71f007ee47c6d6e583b66b. Jan 13 20:10:50.471232 containerd[1934]: time="2025-01-13T20:10:50.471170375Z" level=info msg="StartContainer for \"1dcacb806e1c63d925247497966ad2b37ed671dabe71f007ee47c6d6e583b66b\" returns successfully" Jan 13 20:10:54.290847 kubelet[3423]: E0113 20:10:54.290796 3423 controller.go:195] "Failed to update lease" err="Put \"https://172.31.28.23:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-172-31-28-23?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Jan 13 20:11:04.291685 kubelet[3423]: E0113 20:11:04.291502 3423 controller.go:195] "Failed to update lease" err="Put \"https://172.31.28.23:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-172-31-28-23?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"