Jun 20 19:47:41.947622 kernel: Linux version 6.12.34-flatcar (build@pony-truck.infra.kinvolk.io) (x86_64-cros-linux-gnu-gcc (Gentoo Hardened 14.2.1_p20241221 p7) 14.2.1 20241221, GNU ld (Gentoo 2.44 p1) 2.44.0) #1 SMP PREEMPT_DYNAMIC Fri Jun 20 17:06:39 -00 2025 Jun 20 19:47:41.947646 kernel: Command line: BOOT_IMAGE=/flatcar/vmlinuz-a mount.usr=/dev/mapper/usr verity.usr=PARTUUID=7130c94a-213a-4e5a-8e26-6cce9662f132 rootflags=rw mount.usrflags=ro consoleblank=0 root=LABEL=ROOT console=ttyS0,115200n8 console=tty0 flatcar.first_boot=detected flatcar.oem.id=openstack flatcar.autologin verity.usrhash=b7bb3b1ced9c5d47870a8b74c6c30075189c27e25d75251cfa7215e4bbff75ea Jun 20 19:47:41.947656 kernel: BIOS-provided physical RAM map: Jun 20 19:47:41.947666 kernel: BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable Jun 20 19:47:41.947674 kernel: BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved Jun 20 19:47:41.947681 kernel: BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved Jun 20 19:47:41.947690 kernel: BIOS-e820: [mem 0x0000000000100000-0x00000000bffdcfff] usable Jun 20 19:47:41.947698 kernel: BIOS-e820: [mem 0x00000000bffdd000-0x00000000bfffffff] reserved Jun 20 19:47:41.947705 kernel: BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved Jun 20 19:47:41.947713 kernel: BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved Jun 20 19:47:41.947721 kernel: BIOS-e820: [mem 0x0000000100000000-0x000000013fffffff] usable Jun 20 19:47:41.947729 kernel: BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved Jun 20 19:47:41.947738 kernel: NX (Execute Disable) protection: active Jun 20 19:47:41.947746 kernel: APIC: Static calls initialized Jun 20 19:47:41.947755 kernel: SMBIOS 3.0.0 present. Jun 20 19:47:41.947763 kernel: DMI: OpenStack Foundation OpenStack Nova, BIOS 1.16.3-debian-1.16.3-2 04/01/2014 Jun 20 19:47:41.947771 kernel: DMI: Memory slots populated: 1/1 Jun 20 19:47:41.947781 kernel: Hypervisor detected: KVM Jun 20 19:47:41.947789 kernel: kvm-clock: Using msrs 4b564d01 and 4b564d00 Jun 20 19:47:41.947797 kernel: kvm-clock: using sched offset of 4818625266 cycles Jun 20 19:47:41.947805 kernel: clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns Jun 20 19:47:41.947814 kernel: tsc: Detected 1996.249 MHz processor Jun 20 19:47:41.947822 kernel: e820: update [mem 0x00000000-0x00000fff] usable ==> reserved Jun 20 19:47:41.947831 kernel: e820: remove [mem 0x000a0000-0x000fffff] usable Jun 20 19:47:41.947839 kernel: last_pfn = 0x140000 max_arch_pfn = 0x400000000 Jun 20 19:47:41.947848 kernel: MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs Jun 20 19:47:41.947858 kernel: x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT Jun 20 19:47:41.947866 kernel: last_pfn = 0xbffdd max_arch_pfn = 0x400000000 Jun 20 19:47:41.947875 kernel: ACPI: Early table checksum verification disabled Jun 20 19:47:41.947883 kernel: ACPI: RSDP 0x00000000000F51E0 000014 (v00 BOCHS ) Jun 20 19:47:41.947891 kernel: ACPI: RSDT 0x00000000BFFE1B65 000030 (v01 BOCHS BXPC 00000001 BXPC 00000001) Jun 20 19:47:41.947899 kernel: ACPI: FACP 0x00000000BFFE1A49 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) Jun 20 19:47:41.947907 kernel: ACPI: DSDT 0x00000000BFFE0040 001A09 (v01 BOCHS BXPC 00000001 BXPC 00000001) Jun 20 19:47:41.947915 kernel: ACPI: FACS 0x00000000BFFE0000 000040 Jun 20 19:47:41.947924 kernel: ACPI: APIC 0x00000000BFFE1ABD 000080 (v03 BOCHS BXPC 00000001 BXPC 00000001) Jun 20 19:47:41.947934 kernel: ACPI: WAET 0x00000000BFFE1B3D 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) Jun 20 19:47:41.947942 kernel: ACPI: Reserving FACP table memory at [mem 0xbffe1a49-0xbffe1abc] Jun 20 19:47:41.947950 kernel: ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe1a48] Jun 20 19:47:41.947958 kernel: ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] Jun 20 19:47:41.947967 kernel: ACPI: Reserving APIC table memory at [mem 0xbffe1abd-0xbffe1b3c] Jun 20 19:47:41.947978 kernel: ACPI: Reserving WAET table memory at [mem 0xbffe1b3d-0xbffe1b64] Jun 20 19:47:41.947986 kernel: No NUMA configuration found Jun 20 19:47:41.947996 kernel: Faking a node at [mem 0x0000000000000000-0x000000013fffffff] Jun 20 19:47:41.948005 kernel: NODE_DATA(0) allocated [mem 0x13fff5dc0-0x13fffcfff] Jun 20 19:47:41.948013 kernel: Zone ranges: Jun 20 19:47:41.948022 kernel: DMA [mem 0x0000000000001000-0x0000000000ffffff] Jun 20 19:47:41.948030 kernel: DMA32 [mem 0x0000000001000000-0x00000000ffffffff] Jun 20 19:47:41.948039 kernel: Normal [mem 0x0000000100000000-0x000000013fffffff] Jun 20 19:47:41.948047 kernel: Device empty Jun 20 19:47:41.948056 kernel: Movable zone start for each node Jun 20 19:47:41.948066 kernel: Early memory node ranges Jun 20 19:47:41.948074 kernel: node 0: [mem 0x0000000000001000-0x000000000009efff] Jun 20 19:47:41.948082 kernel: node 0: [mem 0x0000000000100000-0x00000000bffdcfff] Jun 20 19:47:41.948091 kernel: node 0: [mem 0x0000000100000000-0x000000013fffffff] Jun 20 19:47:41.948100 kernel: Initmem setup node 0 [mem 0x0000000000001000-0x000000013fffffff] Jun 20 19:47:41.948108 kernel: On node 0, zone DMA: 1 pages in unavailable ranges Jun 20 19:47:41.948117 kernel: On node 0, zone DMA: 97 pages in unavailable ranges Jun 20 19:47:41.948125 kernel: On node 0, zone Normal: 35 pages in unavailable ranges Jun 20 19:47:41.948134 kernel: ACPI: PM-Timer IO Port: 0x608 Jun 20 19:47:41.948144 kernel: ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) Jun 20 19:47:41.948153 kernel: IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 Jun 20 19:47:41.948162 kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) Jun 20 19:47:41.948170 kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) Jun 20 19:47:41.948179 kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) Jun 20 19:47:41.948187 kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) Jun 20 19:47:41.948196 kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) Jun 20 19:47:41.948204 kernel: ACPI: Using ACPI (MADT) for SMP configuration information Jun 20 19:47:41.948213 kernel: CPU topo: Max. logical packages: 2 Jun 20 19:47:41.948223 kernel: CPU topo: Max. logical dies: 2 Jun 20 19:47:41.948231 kernel: CPU topo: Max. dies per package: 1 Jun 20 19:47:41.948240 kernel: CPU topo: Max. threads per core: 1 Jun 20 19:47:41.948248 kernel: CPU topo: Num. cores per package: 1 Jun 20 19:47:41.948256 kernel: CPU topo: Num. threads per package: 1 Jun 20 19:47:41.948265 kernel: CPU topo: Allowing 2 present CPUs plus 0 hotplug CPUs Jun 20 19:47:41.948273 kernel: kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() Jun 20 19:47:41.948282 kernel: [mem 0xc0000000-0xfeffbfff] available for PCI devices Jun 20 19:47:41.948290 kernel: Booting paravirtualized kernel on KVM Jun 20 19:47:41.948301 kernel: clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns Jun 20 19:47:41.948309 kernel: setup_percpu: NR_CPUS:512 nr_cpumask_bits:2 nr_cpu_ids:2 nr_node_ids:1 Jun 20 19:47:41.948318 kernel: percpu: Embedded 60 pages/cpu s207832 r8192 d29736 u1048576 Jun 20 19:47:41.948326 kernel: pcpu-alloc: s207832 r8192 d29736 u1048576 alloc=1*2097152 Jun 20 19:47:41.948334 kernel: pcpu-alloc: [0] 0 1 Jun 20 19:47:41.948343 kernel: kvm-guest: PV spinlocks disabled, no host support Jun 20 19:47:41.948352 kernel: Kernel command line: rootflags=rw mount.usrflags=ro BOOT_IMAGE=/flatcar/vmlinuz-a mount.usr=/dev/mapper/usr verity.usr=PARTUUID=7130c94a-213a-4e5a-8e26-6cce9662f132 rootflags=rw mount.usrflags=ro consoleblank=0 root=LABEL=ROOT console=ttyS0,115200n8 console=tty0 flatcar.first_boot=detected flatcar.oem.id=openstack flatcar.autologin verity.usrhash=b7bb3b1ced9c5d47870a8b74c6c30075189c27e25d75251cfa7215e4bbff75ea Jun 20 19:47:41.948361 kernel: Unknown kernel command line parameters "BOOT_IMAGE=/flatcar/vmlinuz-a", will be passed to user space. Jun 20 19:47:41.948371 kernel: Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) Jun 20 19:47:41.948380 kernel: Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) Jun 20 19:47:41.948389 kernel: Fallback order for Node 0: 0 Jun 20 19:47:41.948397 kernel: Built 1 zonelists, mobility grouping on. Total pages: 1048443 Jun 20 19:47:41.948405 kernel: Policy zone: Normal Jun 20 19:47:41.948414 kernel: mem auto-init: stack:off, heap alloc:off, heap free:off Jun 20 19:47:41.948422 kernel: software IO TLB: area num 2. Jun 20 19:47:41.948431 kernel: SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=2, Nodes=1 Jun 20 19:47:41.948439 kernel: ftrace: allocating 40093 entries in 157 pages Jun 20 19:47:41.948449 kernel: ftrace: allocated 157 pages with 5 groups Jun 20 19:47:41.948458 kernel: Dynamic Preempt: voluntary Jun 20 19:47:41.948466 kernel: rcu: Preemptible hierarchical RCU implementation. Jun 20 19:47:41.948475 kernel: rcu: RCU event tracing is enabled. Jun 20 19:47:41.948484 kernel: rcu: RCU restricting CPUs from NR_CPUS=512 to nr_cpu_ids=2. Jun 20 19:47:41.948493 kernel: Trampoline variant of Tasks RCU enabled. Jun 20 19:47:41.948502 kernel: Rude variant of Tasks RCU enabled. Jun 20 19:47:41.948510 kernel: Tracing variant of Tasks RCU enabled. Jun 20 19:47:41.948519 kernel: rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. Jun 20 19:47:41.948527 kernel: rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=2 Jun 20 19:47:41.948538 kernel: RCU Tasks: Setting shift to 1 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=2. Jun 20 19:47:41.948547 kernel: RCU Tasks Rude: Setting shift to 1 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=2. Jun 20 19:47:41.948556 kernel: RCU Tasks Trace: Setting shift to 1 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=2. Jun 20 19:47:41.948579 kernel: NR_IRQS: 33024, nr_irqs: 440, preallocated irqs: 16 Jun 20 19:47:41.950215 kernel: rcu: srcu_init: Setting srcu_struct sizes based on contention. Jun 20 19:47:41.950226 kernel: Console: colour VGA+ 80x25 Jun 20 19:47:41.950235 kernel: printk: legacy console [tty0] enabled Jun 20 19:47:41.950245 kernel: printk: legacy console [ttyS0] enabled Jun 20 19:47:41.950258 kernel: ACPI: Core revision 20240827 Jun 20 19:47:41.950267 kernel: APIC: Switch to symmetric I/O mode setup Jun 20 19:47:41.950277 kernel: x2apic enabled Jun 20 19:47:41.950286 kernel: APIC: Switched APIC routing to: physical x2apic Jun 20 19:47:41.950295 kernel: ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 Jun 20 19:47:41.950305 kernel: tsc: Marking TSC unstable due to TSCs unsynchronized Jun 20 19:47:41.950320 kernel: Calibrating delay loop (skipped) preset value.. 3992.49 BogoMIPS (lpj=1996249) Jun 20 19:47:41.950331 kernel: Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 Jun 20 19:47:41.950341 kernel: Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0 Jun 20 19:47:41.950351 kernel: Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization Jun 20 19:47:41.950361 kernel: Spectre V2 : Mitigation: Retpolines Jun 20 19:47:41.950371 kernel: Spectre V2 : Spectre v2 / SpectreRSB: Filling RSB on context switch and VMEXIT Jun 20 19:47:41.950382 kernel: Speculative Store Bypass: Vulnerable Jun 20 19:47:41.950392 kernel: x86/fpu: x87 FPU will use FXSAVE Jun 20 19:47:41.950401 kernel: Freeing SMP alternatives memory: 32K Jun 20 19:47:41.950411 kernel: pid_max: default: 32768 minimum: 301 Jun 20 19:47:41.950421 kernel: LSM: initializing lsm=lockdown,capability,landlock,selinux,ima Jun 20 19:47:41.950432 kernel: landlock: Up and running. Jun 20 19:47:41.950441 kernel: SELinux: Initializing. Jun 20 19:47:41.950451 kernel: Mount-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) Jun 20 19:47:41.950461 kernel: Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) Jun 20 19:47:41.950471 kernel: smpboot: CPU0: AMD Intel Core i7 9xx (Nehalem Class Core i7) (family: 0x6, model: 0x1a, stepping: 0x3) Jun 20 19:47:41.950481 kernel: Performance Events: AMD PMU driver. Jun 20 19:47:41.950490 kernel: ... version: 0 Jun 20 19:47:41.950500 kernel: ... bit width: 48 Jun 20 19:47:41.950510 kernel: ... generic registers: 4 Jun 20 19:47:41.950521 kernel: ... value mask: 0000ffffffffffff Jun 20 19:47:41.950531 kernel: ... max period: 00007fffffffffff Jun 20 19:47:41.950540 kernel: ... fixed-purpose events: 0 Jun 20 19:47:41.950550 kernel: ... event mask: 000000000000000f Jun 20 19:47:41.950559 kernel: signal: max sigframe size: 1440 Jun 20 19:47:41.950598 kernel: rcu: Hierarchical SRCU implementation. Jun 20 19:47:41.950609 kernel: rcu: Max phase no-delay instances is 400. Jun 20 19:47:41.950618 kernel: Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level Jun 20 19:47:41.950628 kernel: smp: Bringing up secondary CPUs ... Jun 20 19:47:41.950641 kernel: smpboot: x86: Booting SMP configuration: Jun 20 19:47:41.950650 kernel: .... node #0, CPUs: #1 Jun 20 19:47:41.950660 kernel: smp: Brought up 1 node, 2 CPUs Jun 20 19:47:41.950670 kernel: smpboot: Total of 2 processors activated (7984.99 BogoMIPS) Jun 20 19:47:41.950680 kernel: Memory: 3961272K/4193772K available (14336K kernel code, 2430K rwdata, 9956K rodata, 54424K init, 2544K bss, 227296K reserved, 0K cma-reserved) Jun 20 19:47:41.950690 kernel: devtmpfs: initialized Jun 20 19:47:41.950699 kernel: x86/mm: Memory block size: 128MB Jun 20 19:47:41.950709 kernel: clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns Jun 20 19:47:41.950719 kernel: futex hash table entries: 512 (order: 3, 32768 bytes, linear) Jun 20 19:47:41.950730 kernel: pinctrl core: initialized pinctrl subsystem Jun 20 19:47:41.950740 kernel: NET: Registered PF_NETLINK/PF_ROUTE protocol family Jun 20 19:47:41.950750 kernel: audit: initializing netlink subsys (disabled) Jun 20 19:47:41.950760 kernel: audit: type=2000 audit(1750448857.961:1): state=initialized audit_enabled=0 res=1 Jun 20 19:47:41.950769 kernel: thermal_sys: Registered thermal governor 'step_wise' Jun 20 19:47:41.950779 kernel: thermal_sys: Registered thermal governor 'user_space' Jun 20 19:47:41.950789 kernel: cpuidle: using governor menu Jun 20 19:47:41.950798 kernel: acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 Jun 20 19:47:41.950808 kernel: dca service started, version 1.12.1 Jun 20 19:47:41.950819 kernel: PCI: Using configuration type 1 for base access Jun 20 19:47:41.950829 kernel: kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. Jun 20 19:47:41.950839 kernel: HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages Jun 20 19:47:41.950848 kernel: HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page Jun 20 19:47:41.950858 kernel: ACPI: Added _OSI(Module Device) Jun 20 19:47:41.950868 kernel: ACPI: Added _OSI(Processor Device) Jun 20 19:47:41.950877 kernel: ACPI: Added _OSI(Processor Aggregator Device) Jun 20 19:47:41.950887 kernel: ACPI: 1 ACPI AML tables successfully acquired and loaded Jun 20 19:47:41.950896 kernel: ACPI: Interpreter enabled Jun 20 19:47:41.950908 kernel: ACPI: PM: (supports S0 S3 S5) Jun 20 19:47:41.950917 kernel: ACPI: Using IOAPIC for interrupt routing Jun 20 19:47:41.950927 kernel: PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug Jun 20 19:47:41.950937 kernel: PCI: Using E820 reservations for host bridge windows Jun 20 19:47:41.950946 kernel: ACPI: Enabled 2 GPEs in block 00 to 0F Jun 20 19:47:41.950956 kernel: ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) Jun 20 19:47:41.951100 kernel: acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI HPX-Type3] Jun 20 19:47:41.951196 kernel: acpi PNP0A03:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI] Jun 20 19:47:41.951291 kernel: acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended configuration space under this bridge Jun 20 19:47:41.951306 kernel: acpiphp: Slot [3] registered Jun 20 19:47:41.951316 kernel: acpiphp: Slot [4] registered Jun 20 19:47:41.951326 kernel: acpiphp: Slot [5] registered Jun 20 19:47:41.951336 kernel: acpiphp: Slot [6] registered Jun 20 19:47:41.951346 kernel: acpiphp: Slot [7] registered Jun 20 19:47:41.951357 kernel: acpiphp: Slot [8] registered Jun 20 19:47:41.951366 kernel: acpiphp: Slot [9] registered Jun 20 19:47:41.951375 kernel: acpiphp: Slot [10] registered Jun 20 19:47:41.951387 kernel: acpiphp: Slot [11] registered Jun 20 19:47:41.951396 kernel: acpiphp: Slot [12] registered Jun 20 19:47:41.951405 kernel: acpiphp: Slot [13] registered Jun 20 19:47:41.951414 kernel: acpiphp: Slot [14] registered Jun 20 19:47:41.951423 kernel: acpiphp: Slot [15] registered Jun 20 19:47:41.951432 kernel: acpiphp: Slot [16] registered Jun 20 19:47:41.951441 kernel: acpiphp: Slot [17] registered Jun 20 19:47:41.951450 kernel: acpiphp: Slot [18] registered Jun 20 19:47:41.951459 kernel: acpiphp: Slot [19] registered Jun 20 19:47:41.951470 kernel: acpiphp: Slot [20] registered Jun 20 19:47:41.951479 kernel: acpiphp: Slot [21] registered Jun 20 19:47:41.951488 kernel: acpiphp: Slot [22] registered Jun 20 19:47:41.951497 kernel: acpiphp: Slot [23] registered Jun 20 19:47:41.951505 kernel: acpiphp: Slot [24] registered Jun 20 19:47:41.951514 kernel: acpiphp: Slot [25] registered Jun 20 19:47:41.951523 kernel: acpiphp: Slot [26] registered Jun 20 19:47:41.951532 kernel: acpiphp: Slot [27] registered Jun 20 19:47:41.951541 kernel: acpiphp: Slot [28] registered Jun 20 19:47:41.951550 kernel: acpiphp: Slot [29] registered Jun 20 19:47:41.951561 kernel: acpiphp: Slot [30] registered Jun 20 19:47:41.953408 kernel: acpiphp: Slot [31] registered Jun 20 19:47:41.953419 kernel: PCI host bridge to bus 0000:00 Jun 20 19:47:41.953529 kernel: pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] Jun 20 19:47:41.953692 kernel: pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] Jun 20 19:47:41.953795 kernel: pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] Jun 20 19:47:41.953878 kernel: pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] Jun 20 19:47:41.953964 kernel: pci_bus 0000:00: root bus resource [mem 0xc000000000-0xc07fffffff window] Jun 20 19:47:41.954044 kernel: pci_bus 0000:00: root bus resource [bus 00-ff] Jun 20 19:47:41.954157 kernel: pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint Jun 20 19:47:41.954265 kernel: pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint Jun 20 19:47:41.954368 kernel: pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint Jun 20 19:47:41.954462 kernel: pci 0000:00:01.1: BAR 4 [io 0xc120-0xc12f] Jun 20 19:47:41.955794 kernel: pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk Jun 20 19:47:41.955901 kernel: pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk Jun 20 19:47:41.955990 kernel: pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk Jun 20 19:47:41.956076 kernel: pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk Jun 20 19:47:41.956172 kernel: pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint Jun 20 19:47:41.956258 kernel: pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI Jun 20 19:47:41.956343 kernel: pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB Jun 20 19:47:41.956445 kernel: pci 0000:00:02.0: [1af4:1050] type 00 class 0x030000 conventional PCI endpoint Jun 20 19:47:41.956536 kernel: pci 0000:00:02.0: BAR 0 [mem 0xfe000000-0xfe7fffff pref] Jun 20 19:47:41.957712 kernel: pci 0000:00:02.0: BAR 2 [mem 0xc000000000-0xc000003fff 64bit pref] Jun 20 19:47:41.957816 kernel: pci 0000:00:02.0: BAR 4 [mem 0xfeb90000-0xfeb90fff] Jun 20 19:47:41.957905 kernel: pci 0000:00:02.0: ROM [mem 0xfeb80000-0xfeb8ffff pref] Jun 20 19:47:41.957992 kernel: pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] Jun 20 19:47:41.958086 kernel: pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint Jun 20 19:47:41.958180 kernel: pci 0000:00:03.0: BAR 0 [io 0xc080-0xc0bf] Jun 20 19:47:41.958268 kernel: pci 0000:00:03.0: BAR 1 [mem 0xfeb91000-0xfeb91fff] Jun 20 19:47:41.958354 kernel: pci 0000:00:03.0: BAR 4 [mem 0xc000004000-0xc000007fff 64bit pref] Jun 20 19:47:41.958440 kernel: pci 0000:00:03.0: ROM [mem 0xfeb00000-0xfeb7ffff pref] Jun 20 19:47:41.958533 kernel: pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint Jun 20 19:47:41.959671 kernel: pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] Jun 20 19:47:41.959769 kernel: pci 0000:00:04.0: BAR 1 [mem 0xfeb92000-0xfeb92fff] Jun 20 19:47:41.959856 kernel: pci 0000:00:04.0: BAR 4 [mem 0xc000008000-0xc00000bfff 64bit pref] Jun 20 19:47:41.959950 kernel: pci 0000:00:05.0: [1af4:1002] type 00 class 0x00ff00 conventional PCI endpoint Jun 20 19:47:41.960037 kernel: pci 0000:00:05.0: BAR 0 [io 0xc0c0-0xc0ff] Jun 20 19:47:41.960123 kernel: pci 0000:00:05.0: BAR 4 [mem 0xc00000c000-0xc00000ffff 64bit pref] Jun 20 19:47:41.960220 kernel: pci 0000:00:06.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint Jun 20 19:47:41.960308 kernel: pci 0000:00:06.0: BAR 0 [io 0xc100-0xc11f] Jun 20 19:47:41.960398 kernel: pci 0000:00:06.0: BAR 1 [mem 0xfeb93000-0xfeb93fff] Jun 20 19:47:41.960484 kernel: pci 0000:00:06.0: BAR 4 [mem 0xc000010000-0xc000013fff 64bit pref] Jun 20 19:47:41.960498 kernel: ACPI: PCI: Interrupt link LNKA configured for IRQ 10 Jun 20 19:47:41.960507 kernel: ACPI: PCI: Interrupt link LNKB configured for IRQ 10 Jun 20 19:47:41.960517 kernel: ACPI: PCI: Interrupt link LNKC configured for IRQ 11 Jun 20 19:47:41.960527 kernel: ACPI: PCI: Interrupt link LNKD configured for IRQ 11 Jun 20 19:47:41.960536 kernel: ACPI: PCI: Interrupt link LNKS configured for IRQ 9 Jun 20 19:47:41.960545 kernel: iommu: Default domain type: Translated Jun 20 19:47:41.960555 kernel: iommu: DMA domain TLB invalidation policy: lazy mode Jun 20 19:47:41.962597 kernel: PCI: Using ACPI for IRQ routing Jun 20 19:47:41.962610 kernel: PCI: pci_cache_line_size set to 64 bytes Jun 20 19:47:41.962620 kernel: e820: reserve RAM buffer [mem 0x0009fc00-0x0009ffff] Jun 20 19:47:41.962631 kernel: e820: reserve RAM buffer [mem 0xbffdd000-0xbfffffff] Jun 20 19:47:41.962737 kernel: pci 0000:00:02.0: vgaarb: setting as boot VGA device Jun 20 19:47:41.962832 kernel: pci 0000:00:02.0: vgaarb: bridge control possible Jun 20 19:47:41.962926 kernel: pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none Jun 20 19:47:41.962941 kernel: vgaarb: loaded Jun 20 19:47:41.962951 kernel: clocksource: Switched to clocksource kvm-clock Jun 20 19:47:41.962965 kernel: VFS: Disk quotas dquot_6.6.0 Jun 20 19:47:41.962975 kernel: VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) Jun 20 19:47:41.962985 kernel: pnp: PnP ACPI init Jun 20 19:47:41.963077 kernel: pnp 00:03: [dma 2] Jun 20 19:47:41.963092 kernel: pnp: PnP ACPI: found 5 devices Jun 20 19:47:41.963103 kernel: clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns Jun 20 19:47:41.963113 kernel: NET: Registered PF_INET protocol family Jun 20 19:47:41.963123 kernel: IP idents hash table entries: 65536 (order: 7, 524288 bytes, linear) Jun 20 19:47:41.963136 kernel: tcp_listen_portaddr_hash hash table entries: 2048 (order: 3, 32768 bytes, linear) Jun 20 19:47:41.963146 kernel: Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) Jun 20 19:47:41.963155 kernel: TCP established hash table entries: 32768 (order: 6, 262144 bytes, linear) Jun 20 19:47:41.963165 kernel: TCP bind hash table entries: 32768 (order: 8, 1048576 bytes, linear) Jun 20 19:47:41.963175 kernel: TCP: Hash tables configured (established 32768 bind 32768) Jun 20 19:47:41.963185 kernel: UDP hash table entries: 2048 (order: 4, 65536 bytes, linear) Jun 20 19:47:41.963195 kernel: UDP-Lite hash table entries: 2048 (order: 4, 65536 bytes, linear) Jun 20 19:47:41.963205 kernel: NET: Registered PF_UNIX/PF_LOCAL protocol family Jun 20 19:47:41.963214 kernel: NET: Registered PF_XDP protocol family Jun 20 19:47:41.963297 kernel: pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] Jun 20 19:47:41.963379 kernel: pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] Jun 20 19:47:41.963452 kernel: pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] Jun 20 19:47:41.963526 kernel: pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] Jun 20 19:47:41.963622 kernel: pci_bus 0000:00: resource 8 [mem 0xc000000000-0xc07fffffff window] Jun 20 19:47:41.963713 kernel: pci 0000:00:01.0: PIIX3: Enabling Passive Release Jun 20 19:47:41.963801 kernel: pci 0000:00:00.0: Limiting direct PCI/PCI transfers Jun 20 19:47:41.963815 kernel: PCI: CLS 0 bytes, default 64 Jun 20 19:47:41.963829 kernel: PCI-DMA: Using software bounce buffering for IO (SWIOTLB) Jun 20 19:47:41.963838 kernel: software IO TLB: mapped [mem 0x00000000bbfdd000-0x00000000bffdd000] (64MB) Jun 20 19:47:41.963847 kernel: Initialise system trusted keyrings Jun 20 19:47:41.963856 kernel: workingset: timestamp_bits=39 max_order=20 bucket_order=0 Jun 20 19:47:41.963866 kernel: Key type asymmetric registered Jun 20 19:47:41.963874 kernel: Asymmetric key parser 'x509' registered Jun 20 19:47:41.963884 kernel: Block layer SCSI generic (bsg) driver version 0.4 loaded (major 250) Jun 20 19:47:41.963893 kernel: io scheduler mq-deadline registered Jun 20 19:47:41.963904 kernel: io scheduler kyber registered Jun 20 19:47:41.963913 kernel: io scheduler bfq registered Jun 20 19:47:41.963922 kernel: ioatdma: Intel(R) QuickData Technology Driver 5.00 Jun 20 19:47:41.963932 kernel: ACPI: \_SB_.LNKB: Enabled at IRQ 10 Jun 20 19:47:41.963941 kernel: ACPI: \_SB_.LNKC: Enabled at IRQ 11 Jun 20 19:47:41.963950 kernel: ACPI: \_SB_.LNKD: Enabled at IRQ 11 Jun 20 19:47:41.963960 kernel: ACPI: \_SB_.LNKA: Enabled at IRQ 10 Jun 20 19:47:41.963969 kernel: Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled Jun 20 19:47:41.963978 kernel: 00:00: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A Jun 20 19:47:41.963987 kernel: random: crng init done Jun 20 19:47:41.963998 kernel: i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 Jun 20 19:47:41.964007 kernel: serio: i8042 KBD port at 0x60,0x64 irq 1 Jun 20 19:47:41.964016 kernel: serio: i8042 AUX port at 0x60,0x64 irq 12 Jun 20 19:47:41.964101 kernel: rtc_cmos 00:04: RTC can wake from S4 Jun 20 19:47:41.964116 kernel: input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 Jun 20 19:47:41.964191 kernel: rtc_cmos 00:04: registered as rtc0 Jun 20 19:47:41.964268 kernel: rtc_cmos 00:04: setting system clock to 2025-06-20T19:47:41 UTC (1750448861) Jun 20 19:47:41.964346 kernel: rtc_cmos 00:04: alarms up to one day, y3k, 242 bytes nvram Jun 20 19:47:41.964363 kernel: amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled Jun 20 19:47:41.964372 kernel: NET: Registered PF_INET6 protocol family Jun 20 19:47:41.964381 kernel: Segment Routing with IPv6 Jun 20 19:47:41.964390 kernel: In-situ OAM (IOAM) with IPv6 Jun 20 19:47:41.964399 kernel: NET: Registered PF_PACKET protocol family Jun 20 19:47:41.964408 kernel: Key type dns_resolver registered Jun 20 19:47:41.964417 kernel: IPI shorthand broadcast: enabled Jun 20 19:47:41.964426 kernel: sched_clock: Marking stable (3612008142, 183978298)->(3830430461, -34444021) Jun 20 19:47:41.964437 kernel: registered taskstats version 1 Jun 20 19:47:41.964446 kernel: Loading compiled-in X.509 certificates Jun 20 19:47:41.964455 kernel: Loaded X.509 cert 'Kinvolk GmbH: Module signing key for 6.12.34-flatcar: 9a085d119111c823c157514215d0379e3a2f1b94' Jun 20 19:47:41.964464 kernel: Demotion targets for Node 0: null Jun 20 19:47:41.964473 kernel: Key type .fscrypt registered Jun 20 19:47:41.964482 kernel: Key type fscrypt-provisioning registered Jun 20 19:47:41.964492 kernel: ima: No TPM chip found, activating TPM-bypass! Jun 20 19:47:41.964501 kernel: ima: Allocated hash algorithm: sha1 Jun 20 19:47:41.964510 kernel: ima: No architecture policies found Jun 20 19:47:41.964520 kernel: clk: Disabling unused clocks Jun 20 19:47:41.964529 kernel: Warning: unable to open an initial console. Jun 20 19:47:41.964538 kernel: Freeing unused kernel image (initmem) memory: 54424K Jun 20 19:47:41.964548 kernel: Write protecting the kernel read-only data: 24576k Jun 20 19:47:41.964557 kernel: Freeing unused kernel image (rodata/data gap) memory: 284K Jun 20 19:47:41.965615 kernel: Run /init as init process Jun 20 19:47:41.965627 kernel: with arguments: Jun 20 19:47:41.965636 kernel: /init Jun 20 19:47:41.965645 kernel: with environment: Jun 20 19:47:41.965657 kernel: HOME=/ Jun 20 19:47:41.965666 kernel: TERM=linux Jun 20 19:47:41.965675 kernel: BOOT_IMAGE=/flatcar/vmlinuz-a Jun 20 19:47:41.965686 systemd[1]: Successfully made /usr/ read-only. Jun 20 19:47:41.965699 systemd[1]: systemd 256.8 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP -GCRYPT -GNUTLS +OPENSSL -ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 -PWQUALITY -P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK -XKBCOMMON +UTMP -SYSVINIT +LIBARCHIVE) Jun 20 19:47:41.965710 systemd[1]: Detected virtualization kvm. Jun 20 19:47:41.965720 systemd[1]: Detected architecture x86-64. Jun 20 19:47:41.965737 systemd[1]: Running in initrd. Jun 20 19:47:41.965749 systemd[1]: No hostname configured, using default hostname. Jun 20 19:47:41.965769 systemd[1]: Hostname set to . Jun 20 19:47:41.965981 systemd[1]: Initializing machine ID from VM UUID. Jun 20 19:47:41.965998 systemd[1]: Queued start job for default target initrd.target. Jun 20 19:47:41.966008 systemd[1]: Started clevis-luks-askpass.path - Forward Password Requests to Clevis Directory Watch. Jun 20 19:47:41.966022 systemd[1]: Started systemd-ask-password-console.path - Dispatch Password Requests to Console Directory Watch. Jun 20 19:47:41.966033 systemd[1]: Expecting device dev-disk-by\x2dlabel-EFI\x2dSYSTEM.device - /dev/disk/by-label/EFI-SYSTEM... Jun 20 19:47:41.966044 systemd[1]: Expecting device dev-disk-by\x2dlabel-OEM.device - /dev/disk/by-label/OEM... Jun 20 19:47:41.966054 systemd[1]: Expecting device dev-disk-by\x2dlabel-ROOT.device - /dev/disk/by-label/ROOT... Jun 20 19:47:41.966065 systemd[1]: Expecting device dev-disk-by\x2dpartlabel-USR\x2dA.device - /dev/disk/by-partlabel/USR-A... Jun 20 19:47:41.966077 systemd[1]: Expecting device dev-disk-by\x2dpartuuid-7130c94a\x2d213a\x2d4e5a\x2d8e26\x2d6cce9662f132.device - /dev/disk/by-partuuid/7130c94a-213a-4e5a-8e26-6cce9662f132... Jun 20 19:47:41.966087 systemd[1]: Expecting device dev-mapper-usr.device - /dev/mapper/usr... Jun 20 19:47:41.966099 systemd[1]: Reached target cryptsetup-pre.target - Local Encrypted Volumes (Pre). Jun 20 19:47:41.966109 systemd[1]: Reached target cryptsetup.target - Local Encrypted Volumes. Jun 20 19:47:41.966120 systemd[1]: Reached target paths.target - Path Units. Jun 20 19:47:41.966130 systemd[1]: Reached target slices.target - Slice Units. Jun 20 19:47:41.966140 systemd[1]: Reached target swap.target - Swaps. Jun 20 19:47:41.966150 systemd[1]: Reached target timers.target - Timer Units. Jun 20 19:47:41.966160 systemd[1]: Listening on iscsid.socket - Open-iSCSI iscsid Socket. Jun 20 19:47:41.966170 systemd[1]: Listening on iscsiuio.socket - Open-iSCSI iscsiuio Socket. Jun 20 19:47:41.966180 systemd[1]: Listening on systemd-journald-dev-log.socket - Journal Socket (/dev/log). Jun 20 19:47:41.966193 systemd[1]: Listening on systemd-journald.socket - Journal Sockets. Jun 20 19:47:41.966203 systemd[1]: Listening on systemd-networkd.socket - Network Service Netlink Socket. Jun 20 19:47:41.966213 systemd[1]: Listening on systemd-udevd-control.socket - udev Control Socket. Jun 20 19:47:41.966224 systemd[1]: Listening on systemd-udevd-kernel.socket - udev Kernel Socket. Jun 20 19:47:41.966234 systemd[1]: Reached target sockets.target - Socket Units. Jun 20 19:47:41.966244 systemd[1]: Starting ignition-setup-pre.service - Ignition env setup... Jun 20 19:47:41.966254 systemd[1]: Starting kmod-static-nodes.service - Create List of Static Device Nodes... Jun 20 19:47:41.966264 systemd[1]: Finished network-cleanup.service - Network Cleanup. Jun 20 19:47:41.966277 systemd[1]: systemd-battery-check.service - Check battery level during early boot was skipped because of an unmet condition check (ConditionDirectoryNotEmpty=/sys/class/power_supply). Jun 20 19:47:41.966287 systemd[1]: Starting systemd-fsck-usr.service... Jun 20 19:47:41.966299 systemd[1]: Starting systemd-journald.service - Journal Service... Jun 20 19:47:41.966309 systemd[1]: Starting systemd-modules-load.service - Load Kernel Modules... Jun 20 19:47:41.966320 systemd[1]: Starting systemd-vconsole-setup.service - Virtual Console Setup... Jun 20 19:47:41.966332 systemd[1]: Finished ignition-setup-pre.service - Ignition env setup. Jun 20 19:47:41.966343 systemd[1]: Finished kmod-static-nodes.service - Create List of Static Device Nodes. Jun 20 19:47:41.966353 systemd[1]: Finished systemd-fsck-usr.service. Jun 20 19:47:41.966363 systemd[1]: Starting systemd-tmpfiles-setup-dev-early.service - Create Static Device Nodes in /dev gracefully... Jun 20 19:47:41.966394 systemd-journald[211]: Collecting audit messages is disabled. Jun 20 19:47:41.966424 systemd[1]: Finished systemd-tmpfiles-setup-dev-early.service - Create Static Device Nodes in /dev gracefully. Jun 20 19:47:41.966435 systemd-journald[211]: Journal started Jun 20 19:47:41.966459 systemd-journald[211]: Runtime Journal (/run/log/journal/7c6d7721993141c792f03ec9fb239232) is 8M, max 78.5M, 70.5M free. Jun 20 19:47:41.948901 systemd-modules-load[214]: Inserted module 'overlay' Jun 20 19:47:42.007213 kernel: bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this. Jun 20 19:47:42.007238 kernel: Bridge firewalling registered Jun 20 19:47:41.987889 systemd-modules-load[214]: Inserted module 'br_netfilter' Jun 20 19:47:42.010640 systemd[1]: Started systemd-journald.service - Journal Service. Jun 20 19:47:42.011358 systemd[1]: Finished systemd-modules-load.service - Load Kernel Modules. Jun 20 19:47:42.012070 systemd[1]: Finished systemd-vconsole-setup.service - Virtual Console Setup. Jun 20 19:47:42.015534 systemd[1]: Starting dracut-cmdline-ask.service - dracut ask for additional cmdline parameters... Jun 20 19:47:42.017691 systemd[1]: Starting systemd-sysctl.service - Apply Kernel Variables... Jun 20 19:47:42.020990 systemd[1]: Starting systemd-tmpfiles-setup-dev.service - Create Static Device Nodes in /dev... Jun 20 19:47:42.026720 systemd[1]: Starting systemd-tmpfiles-setup.service - Create System Files and Directories... Jun 20 19:47:42.039128 systemd[1]: Finished systemd-sysctl.service - Apply Kernel Variables. Jun 20 19:47:42.042178 systemd-tmpfiles[233]: /usr/lib/tmpfiles.d/var.conf:14: Duplicate line for path "/var/log", ignoring. Jun 20 19:47:42.043814 systemd[1]: Finished systemd-tmpfiles-setup-dev.service - Create Static Device Nodes in /dev. Jun 20 19:47:42.045902 systemd[1]: Finished systemd-tmpfiles-setup.service - Create System Files and Directories. Jun 20 19:47:42.049198 systemd[1]: Starting systemd-resolved.service - Network Name Resolution... Jun 20 19:47:42.052123 systemd[1]: Finished dracut-cmdline-ask.service - dracut ask for additional cmdline parameters. Jun 20 19:47:42.054261 systemd[1]: Starting dracut-cmdline.service - dracut cmdline hook... Jun 20 19:47:42.068096 dracut-cmdline[251]: Using kernel command line parameters: rd.driver.pre=btrfs SYSTEMD_SULOGIN_FORCE=1 rootflags=rw mount.usrflags=ro BOOT_IMAGE=/flatcar/vmlinuz-a mount.usr=/dev/mapper/usr verity.usr=PARTUUID=7130c94a-213a-4e5a-8e26-6cce9662f132 rootflags=rw mount.usrflags=ro consoleblank=0 root=LABEL=ROOT console=ttyS0,115200n8 console=tty0 flatcar.first_boot=detected flatcar.oem.id=openstack flatcar.autologin verity.usrhash=b7bb3b1ced9c5d47870a8b74c6c30075189c27e25d75251cfa7215e4bbff75ea Jun 20 19:47:42.090081 systemd-resolved[250]: Positive Trust Anchors: Jun 20 19:47:42.090778 systemd-resolved[250]: . IN DS 20326 8 2 e06d44b80b8f1d39a95c0b0d7c65d08458e880409bbc683457104237c7f8ec8d Jun 20 19:47:42.090823 systemd-resolved[250]: Negative trust anchors: home.arpa 10.in-addr.arpa 16.172.in-addr.arpa 17.172.in-addr.arpa 18.172.in-addr.arpa 19.172.in-addr.arpa 20.172.in-addr.arpa 21.172.in-addr.arpa 22.172.in-addr.arpa 23.172.in-addr.arpa 24.172.in-addr.arpa 25.172.in-addr.arpa 26.172.in-addr.arpa 27.172.in-addr.arpa 28.172.in-addr.arpa 29.172.in-addr.arpa 30.172.in-addr.arpa 31.172.in-addr.arpa 170.0.0.192.in-addr.arpa 171.0.0.192.in-addr.arpa 168.192.in-addr.arpa d.f.ip6.arpa ipv4only.arpa resolver.arpa corp home internal intranet lan local private test Jun 20 19:47:42.096548 systemd-resolved[250]: Defaulting to hostname 'linux'. Jun 20 19:47:42.097443 systemd[1]: Started systemd-resolved.service - Network Name Resolution. Jun 20 19:47:42.098262 systemd[1]: Reached target nss-lookup.target - Host and Network Name Lookups. Jun 20 19:47:42.137629 kernel: SCSI subsystem initialized Jun 20 19:47:42.148609 kernel: Loading iSCSI transport class v2.0-870. Jun 20 19:47:42.161640 kernel: iscsi: registered transport (tcp) Jun 20 19:47:42.184754 kernel: iscsi: registered transport (qla4xxx) Jun 20 19:47:42.184817 kernel: QLogic iSCSI HBA Driver Jun 20 19:47:42.207530 systemd[1]: Starting systemd-network-generator.service - Generate network units from Kernel command line... Jun 20 19:47:42.231400 systemd[1]: Finished systemd-network-generator.service - Generate network units from Kernel command line. Jun 20 19:47:42.233867 systemd[1]: Reached target network-pre.target - Preparation for Network. Jun 20 19:47:42.298093 systemd[1]: Finished dracut-cmdline.service - dracut cmdline hook. Jun 20 19:47:42.303286 systemd[1]: Starting dracut-pre-udev.service - dracut pre-udev hook... Jun 20 19:47:42.365691 kernel: raid6: sse2x4 gen() 13019 MB/s Jun 20 19:47:42.383622 kernel: raid6: sse2x2 gen() 14932 MB/s Jun 20 19:47:42.401918 kernel: raid6: sse2x1 gen() 10098 MB/s Jun 20 19:47:42.401981 kernel: raid6: using algorithm sse2x2 gen() 14932 MB/s Jun 20 19:47:42.421030 kernel: raid6: .... xor() 9252 MB/s, rmw enabled Jun 20 19:47:42.421093 kernel: raid6: using ssse3x2 recovery algorithm Jun 20 19:47:42.444105 kernel: xor: measuring software checksum speed Jun 20 19:47:42.444169 kernel: prefetch64-sse : 17291 MB/sec Jun 20 19:47:42.445326 kernel: generic_sse : 15723 MB/sec Jun 20 19:47:42.445376 kernel: xor: using function: prefetch64-sse (17291 MB/sec) Jun 20 19:47:42.646041 kernel: Btrfs loaded, zoned=no, fsverity=no Jun 20 19:47:42.653876 systemd[1]: Finished dracut-pre-udev.service - dracut pre-udev hook. Jun 20 19:47:42.657924 systemd[1]: Starting systemd-udevd.service - Rule-based Manager for Device Events and Files... Jun 20 19:47:42.684595 systemd-udevd[462]: Using default interface naming scheme 'v255'. Jun 20 19:47:42.689985 systemd[1]: Started systemd-udevd.service - Rule-based Manager for Device Events and Files. Jun 20 19:47:42.697521 systemd[1]: Starting dracut-pre-trigger.service - dracut pre-trigger hook... Jun 20 19:47:42.738057 dracut-pre-trigger[472]: rd.md=0: removing MD RAID activation Jun 20 19:47:42.792807 systemd[1]: Finished dracut-pre-trigger.service - dracut pre-trigger hook. Jun 20 19:47:42.797112 systemd[1]: Starting systemd-udev-trigger.service - Coldplug All udev Devices... Jun 20 19:47:42.875498 systemd[1]: Finished systemd-udev-trigger.service - Coldplug All udev Devices. Jun 20 19:47:42.885405 systemd[1]: Starting dracut-initqueue.service - dracut initqueue hook... Jun 20 19:47:42.973587 kernel: virtio_blk virtio2: 2/0/0 default/read/poll queues Jun 20 19:47:42.980596 kernel: virtio_blk virtio2: [vda] 20971520 512-byte logical blocks (10.7 GB/10.0 GiB) Jun 20 19:47:42.984313 systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. Jun 20 19:47:42.986004 systemd[1]: Stopped systemd-vconsole-setup.service - Virtual Console Setup. Jun 20 19:47:43.002217 kernel: GPT:Primary header thinks Alt. header is not at the end of the disk. Jun 20 19:47:43.002241 kernel: GPT:17805311 != 20971519 Jun 20 19:47:43.002255 kernel: GPT:Alternate GPT header not at the end of the disk. Jun 20 19:47:43.002267 kernel: GPT:17805311 != 20971519 Jun 20 19:47:43.002280 kernel: GPT: Use GNU Parted to correct GPT errors. Jun 20 19:47:43.002292 kernel: vda: vda1 vda2 vda3 vda4 vda6 vda7 vda9 Jun 20 19:47:43.002304 kernel: input: ImExPS/2 Generic Explorer Mouse as /devices/platform/i8042/serio1/input/input2 Jun 20 19:47:42.990787 systemd[1]: Stopping systemd-vconsole-setup.service - Virtual Console Setup... Jun 20 19:47:43.005647 systemd[1]: Starting systemd-vconsole-setup.service - Virtual Console Setup... Jun 20 19:47:43.010383 systemd[1]: run-credentials-systemd\x2dvconsole\x2dsetup.service.mount: Deactivated successfully. Jun 20 19:47:43.053585 kernel: libata version 3.00 loaded. Jun 20 19:47:43.066591 kernel: ata_piix 0000:00:01.1: version 2.13 Jun 20 19:47:43.073323 kernel: scsi host0: ata_piix Jun 20 19:47:43.073462 kernel: scsi host1: ata_piix Jun 20 19:47:43.073296 systemd[1]: Found device dev-disk-by\x2dlabel-EFI\x2dSYSTEM.device - /dev/disk/by-label/EFI-SYSTEM. Jun 20 19:47:43.097541 kernel: ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc120 irq 14 lpm-pol 0 Jun 20 19:47:43.097559 kernel: ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc128 irq 15 lpm-pol 0 Jun 20 19:47:43.097072 systemd[1]: Finished systemd-vconsole-setup.service - Virtual Console Setup. Jun 20 19:47:43.108785 systemd[1]: Found device dev-disk-by\x2dlabel-ROOT.device - /dev/disk/by-label/ROOT. Jun 20 19:47:43.133151 systemd[1]: Found device dev-disk-by\x2dlabel-OEM.device - /dev/disk/by-label/OEM. Jun 20 19:47:43.141533 systemd[1]: Found device dev-disk-by\x2dpartuuid-7130c94a\x2d213a\x2d4e5a\x2d8e26\x2d6cce9662f132.device - /dev/disk/by-partuuid/7130c94a-213a-4e5a-8e26-6cce9662f132. Jun 20 19:47:43.142165 systemd[1]: Found device dev-disk-by\x2dpartlabel-USR\x2dA.device - /dev/disk/by-partlabel/USR-A. Jun 20 19:47:43.146662 systemd[1]: Starting disk-uuid.service - Generate new UUID for disk GPT if necessary... Jun 20 19:47:43.173200 disk-uuid[558]: Primary Header is updated. Jun 20 19:47:43.173200 disk-uuid[558]: Secondary Entries is updated. Jun 20 19:47:43.173200 disk-uuid[558]: Secondary Header is updated. Jun 20 19:47:43.184672 kernel: vda: vda1 vda2 vda3 vda4 vda6 vda7 vda9 Jun 20 19:47:43.311578 systemd[1]: Finished dracut-initqueue.service - dracut initqueue hook. Jun 20 19:47:43.326649 systemd[1]: Reached target remote-fs-pre.target - Preparation for Remote File Systems. Jun 20 19:47:43.327235 systemd[1]: Reached target remote-cryptsetup.target - Remote Encrypted Volumes. Jun 20 19:47:43.328554 systemd[1]: Reached target remote-fs.target - Remote File Systems. Jun 20 19:47:43.332670 systemd[1]: Starting dracut-pre-mount.service - dracut pre-mount hook... Jun 20 19:47:43.366016 systemd[1]: Finished dracut-pre-mount.service - dracut pre-mount hook. Jun 20 19:47:44.205650 kernel: vda: vda1 vda2 vda3 vda4 vda6 vda7 vda9 Jun 20 19:47:44.206536 disk-uuid[559]: The operation has completed successfully. Jun 20 19:47:44.283323 systemd[1]: disk-uuid.service: Deactivated successfully. Jun 20 19:47:44.283436 systemd[1]: Finished disk-uuid.service - Generate new UUID for disk GPT if necessary. Jun 20 19:47:44.329355 systemd[1]: Starting verity-setup.service - Verity Setup for /dev/mapper/usr... Jun 20 19:47:44.349600 sh[584]: Success Jun 20 19:47:44.373585 kernel: device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. Jun 20 19:47:44.377009 kernel: device-mapper: uevent: version 1.0.3 Jun 20 19:47:44.377035 kernel: device-mapper: ioctl: 4.48.0-ioctl (2023-03-01) initialised: dm-devel@lists.linux.dev Jun 20 19:47:44.399613 kernel: device-mapper: verity: sha256 using shash "sha256-ssse3" Jun 20 19:47:44.494290 systemd[1]: Found device dev-mapper-usr.device - /dev/mapper/usr. Jun 20 19:47:44.498277 systemd[1]: Mounting sysusr-usr.mount - /sysusr/usr... Jun 20 19:47:44.506892 systemd[1]: Finished verity-setup.service - Verity Setup for /dev/mapper/usr. Jun 20 19:47:44.542672 kernel: BTRFS info: 'norecovery' is for compatibility only, recommended to use 'rescue=nologreplay' Jun 20 19:47:44.542761 kernel: BTRFS: device fsid 048b924a-9f97-43f5-98d6-0fff18874966 devid 1 transid 41 /dev/mapper/usr (253:0) scanned by mount (596) Jun 20 19:47:44.561623 kernel: BTRFS info (device dm-0): first mount of filesystem 048b924a-9f97-43f5-98d6-0fff18874966 Jun 20 19:47:44.561703 kernel: BTRFS info (device dm-0): using crc32c (crc32c-intel) checksum algorithm Jun 20 19:47:44.561746 kernel: BTRFS info (device dm-0): using free-space-tree Jun 20 19:47:44.582239 systemd[1]: Mounted sysusr-usr.mount - /sysusr/usr. Jun 20 19:47:44.584201 systemd[1]: Reached target initrd-usr-fs.target - Initrd /usr File System. Jun 20 19:47:44.586198 systemd[1]: afterburn-network-kargs.service - Afterburn Initrd Setup Network Kernel Arguments was skipped because no trigger condition checks were met. Jun 20 19:47:44.587890 systemd[1]: Starting ignition-setup.service - Ignition (setup)... Jun 20 19:47:44.595793 systemd[1]: Starting parse-ip-for-networkd.service - Write systemd-networkd units from cmdline... Jun 20 19:47:44.646642 kernel: BTRFS: device label OEM devid 1 transid 15 /dev/vda6 (254:6) scanned by mount (632) Jun 20 19:47:44.654631 kernel: BTRFS info (device vda6): first mount of filesystem 40288228-7b4b-4005-945b-574c4c10ab32 Jun 20 19:47:44.654695 kernel: BTRFS info (device vda6): using crc32c (crc32c-intel) checksum algorithm Jun 20 19:47:44.659628 kernel: BTRFS info (device vda6): using free-space-tree Jun 20 19:47:44.679688 kernel: BTRFS info (device vda6): last unmount of filesystem 40288228-7b4b-4005-945b-574c4c10ab32 Jun 20 19:47:44.683416 systemd[1]: Finished ignition-setup.service - Ignition (setup). Jun 20 19:47:44.686953 systemd[1]: Starting ignition-fetch-offline.service - Ignition (fetch-offline)... Jun 20 19:47:44.723200 systemd[1]: Finished parse-ip-for-networkd.service - Write systemd-networkd units from cmdline. Jun 20 19:47:44.726043 systemd[1]: Starting systemd-networkd.service - Network Configuration... Jun 20 19:47:44.761971 systemd-networkd[765]: lo: Link UP Jun 20 19:47:44.762685 systemd-networkd[765]: lo: Gained carrier Jun 20 19:47:44.764063 systemd-networkd[765]: Enumeration completed Jun 20 19:47:44.764334 systemd[1]: Started systemd-networkd.service - Network Configuration. Jun 20 19:47:44.764655 systemd-networkd[765]: eth0: found matching network '/usr/lib/systemd/network/zz-default.network', based on potentially unpredictable interface name. Jun 20 19:47:44.764660 systemd-networkd[765]: eth0: Configuring with /usr/lib/systemd/network/zz-default.network. Jun 20 19:47:44.765718 systemd[1]: Reached target network.target - Network. Jun 20 19:47:44.766037 systemd-networkd[765]: eth0: Link UP Jun 20 19:47:44.766041 systemd-networkd[765]: eth0: Gained carrier Jun 20 19:47:44.766050 systemd-networkd[765]: eth0: found matching network '/usr/lib/systemd/network/zz-default.network', based on potentially unpredictable interface name. Jun 20 19:47:44.778633 systemd-networkd[765]: eth0: DHCPv4 address 172.24.4.18/24, gateway 172.24.4.1 acquired from 172.24.4.1 Jun 20 19:47:44.894325 ignition[710]: Ignition 2.21.0 Jun 20 19:47:44.894338 ignition[710]: Stage: fetch-offline Jun 20 19:47:44.894369 ignition[710]: no configs at "/usr/lib/ignition/base.d" Jun 20 19:47:44.894377 ignition[710]: no config dir at "/usr/lib/ignition/base.platform.d/openstack" Jun 20 19:47:44.894458 ignition[710]: parsed url from cmdline: "" Jun 20 19:47:44.894462 ignition[710]: no config URL provided Jun 20 19:47:44.894467 ignition[710]: reading system config file "/usr/lib/ignition/user.ign" Jun 20 19:47:44.894474 ignition[710]: no config at "/usr/lib/ignition/user.ign" Jun 20 19:47:44.894478 ignition[710]: failed to fetch config: resource requires networking Jun 20 19:47:44.898989 systemd[1]: Finished ignition-fetch-offline.service - Ignition (fetch-offline). Jun 20 19:47:44.895407 ignition[710]: Ignition finished successfully Jun 20 19:47:44.899095 systemd-resolved[250]: Detected conflict on linux IN A 172.24.4.18 Jun 20 19:47:44.899103 systemd-resolved[250]: Hostname conflict, changing published hostname from 'linux' to 'linux9'. Jun 20 19:47:44.902810 systemd[1]: Starting ignition-fetch.service - Ignition (fetch)... Jun 20 19:47:44.930392 ignition[775]: Ignition 2.21.0 Jun 20 19:47:44.930406 ignition[775]: Stage: fetch Jun 20 19:47:44.930542 ignition[775]: no configs at "/usr/lib/ignition/base.d" Jun 20 19:47:44.930552 ignition[775]: no config dir at "/usr/lib/ignition/base.platform.d/openstack" Jun 20 19:47:44.930647 ignition[775]: parsed url from cmdline: "" Jun 20 19:47:44.930651 ignition[775]: no config URL provided Jun 20 19:47:44.930656 ignition[775]: reading system config file "/usr/lib/ignition/user.ign" Jun 20 19:47:44.930665 ignition[775]: no config at "/usr/lib/ignition/user.ign" Jun 20 19:47:44.930751 ignition[775]: GET http://169.254.169.254/openstack/latest/user_data: attempt #1 Jun 20 19:47:44.930839 ignition[775]: config drive ("/dev/disk/by-label/config-2") not found. Waiting... Jun 20 19:47:44.930933 ignition[775]: config drive ("/dev/disk/by-label/CONFIG-2") not found. Waiting... Jun 20 19:47:45.065131 ignition[775]: GET result: OK Jun 20 19:47:45.065189 ignition[775]: parsing config with SHA512: 89161694e097ebaf291c4ce77a72929e17e3e2a592dad64a6abe6af2edd47426c578741340d8aa2d14b324fb6d27f9d58aa0c333b0780db484c01fbc0c657a4a Jun 20 19:47:45.070978 unknown[775]: fetched base config from "system" Jun 20 19:47:45.070993 unknown[775]: fetched base config from "system" Jun 20 19:47:45.071195 ignition[775]: fetch: fetch complete Jun 20 19:47:45.070999 unknown[775]: fetched user config from "openstack" Jun 20 19:47:45.071201 ignition[775]: fetch: fetch passed Jun 20 19:47:45.073310 systemd[1]: Finished ignition-fetch.service - Ignition (fetch). Jun 20 19:47:45.071239 ignition[775]: Ignition finished successfully Jun 20 19:47:45.076704 systemd[1]: Starting ignition-kargs.service - Ignition (kargs)... Jun 20 19:47:45.103135 ignition[782]: Ignition 2.21.0 Jun 20 19:47:45.103153 ignition[782]: Stage: kargs Jun 20 19:47:45.103298 ignition[782]: no configs at "/usr/lib/ignition/base.d" Jun 20 19:47:45.103309 ignition[782]: no config dir at "/usr/lib/ignition/base.platform.d/openstack" Jun 20 19:47:45.106176 systemd[1]: Finished ignition-kargs.service - Ignition (kargs). Jun 20 19:47:45.103876 ignition[782]: kargs: kargs passed Jun 20 19:47:45.103915 ignition[782]: Ignition finished successfully Jun 20 19:47:45.110843 systemd[1]: Starting ignition-disks.service - Ignition (disks)... Jun 20 19:47:45.138494 ignition[788]: Ignition 2.21.0 Jun 20 19:47:45.139310 ignition[788]: Stage: disks Jun 20 19:47:45.139889 ignition[788]: no configs at "/usr/lib/ignition/base.d" Jun 20 19:47:45.139899 ignition[788]: no config dir at "/usr/lib/ignition/base.platform.d/openstack" Jun 20 19:47:45.144483 ignition[788]: disks: disks passed Jun 20 19:47:45.144999 ignition[788]: Ignition finished successfully Jun 20 19:47:45.147078 systemd[1]: Finished ignition-disks.service - Ignition (disks). Jun 20 19:47:45.149678 systemd[1]: Reached target initrd-root-device.target - Initrd Root Device. Jun 20 19:47:45.151133 systemd[1]: Reached target local-fs-pre.target - Preparation for Local File Systems. Jun 20 19:47:45.153116 systemd[1]: Reached target local-fs.target - Local File Systems. Jun 20 19:47:45.155500 systemd[1]: Reached target sysinit.target - System Initialization. Jun 20 19:47:45.157720 systemd[1]: Reached target basic.target - Basic System. Jun 20 19:47:45.162082 systemd[1]: Starting systemd-fsck-root.service - File System Check on /dev/disk/by-label/ROOT... Jun 20 19:47:45.222834 systemd-fsck[796]: ROOT: clean, 15/1628000 files, 120826/1617920 blocks Jun 20 19:47:45.234676 systemd[1]: Finished systemd-fsck-root.service - File System Check on /dev/disk/by-label/ROOT. Jun 20 19:47:45.239273 systemd[1]: Mounting sysroot.mount - /sysroot... Jun 20 19:47:45.465645 kernel: EXT4-fs (vda9): mounted filesystem 6290a154-3512-46a6-a5f5-a7fb62c65caa r/w with ordered data mode. Quota mode: none. Jun 20 19:47:45.467834 systemd[1]: Mounted sysroot.mount - /sysroot. Jun 20 19:47:45.471419 systemd[1]: Reached target initrd-root-fs.target - Initrd Root File System. Jun 20 19:47:45.486940 systemd[1]: Mounting sysroot-oem.mount - /sysroot/oem... Jun 20 19:47:45.491297 systemd[1]: Mounting sysroot-usr.mount - /sysroot/usr... Jun 20 19:47:45.496875 systemd[1]: flatcar-metadata-hostname.service - Flatcar Metadata Hostname Agent was skipped because no trigger condition checks were met. Jun 20 19:47:45.502966 systemd[1]: Starting flatcar-openstack-hostname.service - Flatcar OpenStack Metadata Hostname Agent... Jun 20 19:47:45.507771 systemd[1]: ignition-remount-sysroot.service - Remount /sysroot read-write for Ignition was skipped because of an unmet condition check (ConditionPathIsReadWrite=!/sysroot). Jun 20 19:47:45.509778 systemd[1]: Reached target ignition-diskful.target - Ignition Boot Disk Setup. Jun 20 19:47:45.519251 systemd[1]: Mounted sysroot-usr.mount - /sysroot/usr. Jun 20 19:47:45.525461 systemd[1]: Starting initrd-setup-root.service - Root filesystem setup... Jun 20 19:47:45.562556 kernel: BTRFS: device label OEM devid 1 transid 15 /dev/vda6 (254:6) scanned by mount (804) Jun 20 19:47:45.562654 kernel: BTRFS info (device vda6): first mount of filesystem 40288228-7b4b-4005-945b-574c4c10ab32 Jun 20 19:47:45.562687 kernel: BTRFS info (device vda6): using crc32c (crc32c-intel) checksum algorithm Jun 20 19:47:45.562717 kernel: BTRFS info (device vda6): using free-space-tree Jun 20 19:47:45.563489 systemd[1]: Mounted sysroot-oem.mount - /sysroot/oem. Jun 20 19:47:45.650644 kernel: /dev/disk/by-label/config-2: Can't lookup blockdev Jun 20 19:47:45.678626 initrd-setup-root[833]: cut: /sysroot/etc/passwd: No such file or directory Jun 20 19:47:45.688751 initrd-setup-root[840]: cut: /sysroot/etc/group: No such file or directory Jun 20 19:47:45.695526 initrd-setup-root[847]: cut: /sysroot/etc/shadow: No such file or directory Jun 20 19:47:45.701859 initrd-setup-root[854]: cut: /sysroot/etc/gshadow: No such file or directory Jun 20 19:47:45.865555 systemd[1]: Finished initrd-setup-root.service - Root filesystem setup. Jun 20 19:47:45.870035 systemd[1]: Starting ignition-mount.service - Ignition (mount)... Jun 20 19:47:45.872855 systemd[1]: Starting sysroot-boot.service - /sysroot/boot... Jun 20 19:47:45.905856 systemd[1]: sysroot-oem.mount: Deactivated successfully. Jun 20 19:47:45.913827 kernel: BTRFS info (device vda6): last unmount of filesystem 40288228-7b4b-4005-945b-574c4c10ab32 Jun 20 19:47:45.939941 systemd[1]: Finished sysroot-boot.service - /sysroot/boot. Jun 20 19:47:45.960328 ignition[923]: INFO : Ignition 2.21.0 Jun 20 19:47:45.960328 ignition[923]: INFO : Stage: mount Jun 20 19:47:45.961560 ignition[923]: INFO : no configs at "/usr/lib/ignition/base.d" Jun 20 19:47:45.961560 ignition[923]: INFO : no config dir at "/usr/lib/ignition/base.platform.d/openstack" Jun 20 19:47:45.961560 ignition[923]: INFO : mount: mount passed Jun 20 19:47:45.961560 ignition[923]: INFO : Ignition finished successfully Jun 20 19:47:45.962376 systemd[1]: Finished ignition-mount.service - Ignition (mount). Jun 20 19:47:46.511988 systemd-networkd[765]: eth0: Gained IPv6LL Jun 20 19:47:46.700630 kernel: /dev/disk/by-label/config-2: Can't lookup blockdev Jun 20 19:47:48.712813 kernel: /dev/disk/by-label/config-2: Can't lookup blockdev Jun 20 19:47:52.723656 kernel: /dev/disk/by-label/config-2: Can't lookup blockdev Jun 20 19:47:52.732937 coreos-metadata[806]: Jun 20 19:47:52.732 WARN failed to locate config-drive, using the metadata service API instead Jun 20 19:47:52.773623 coreos-metadata[806]: Jun 20 19:47:52.773 INFO Fetching http://169.254.169.254/latest/meta-data/hostname: Attempt #1 Jun 20 19:47:52.789810 coreos-metadata[806]: Jun 20 19:47:52.789 INFO Fetch successful Jun 20 19:47:52.789810 coreos-metadata[806]: Jun 20 19:47:52.789 INFO wrote hostname ci-4344-1-0-0-f744bc33cd.novalocal to /sysroot/etc/hostname Jun 20 19:47:52.793870 systemd[1]: flatcar-openstack-hostname.service: Deactivated successfully. Jun 20 19:47:52.794121 systemd[1]: Finished flatcar-openstack-hostname.service - Flatcar OpenStack Metadata Hostname Agent. Jun 20 19:47:52.800949 systemd[1]: Starting ignition-files.service - Ignition (files)... Jun 20 19:47:52.835057 systemd[1]: Mounting sysroot-oem.mount - /sysroot/oem... Jun 20 19:47:52.875689 kernel: BTRFS: device label OEM devid 1 transid 15 /dev/vda6 (254:6) scanned by mount (939) Jun 20 19:47:52.887540 kernel: BTRFS info (device vda6): first mount of filesystem 40288228-7b4b-4005-945b-574c4c10ab32 Jun 20 19:47:52.887661 kernel: BTRFS info (device vda6): using crc32c (crc32c-intel) checksum algorithm Jun 20 19:47:52.887713 kernel: BTRFS info (device vda6): using free-space-tree Jun 20 19:47:52.902561 systemd[1]: Mounted sysroot-oem.mount - /sysroot/oem. Jun 20 19:47:52.957726 ignition[957]: INFO : Ignition 2.21.0 Jun 20 19:47:52.957726 ignition[957]: INFO : Stage: files Jun 20 19:47:52.961344 ignition[957]: INFO : no configs at "/usr/lib/ignition/base.d" Jun 20 19:47:52.961344 ignition[957]: INFO : no config dir at "/usr/lib/ignition/base.platform.d/openstack" Jun 20 19:47:52.961344 ignition[957]: DEBUG : files: compiled without relabeling support, skipping Jun 20 19:47:52.970146 ignition[957]: INFO : files: ensureUsers: op(1): [started] creating or modifying user "core" Jun 20 19:47:52.970146 ignition[957]: DEBUG : files: ensureUsers: op(1): executing: "usermod" "--root" "/sysroot" "core" Jun 20 19:47:52.970146 ignition[957]: INFO : files: ensureUsers: op(1): [finished] creating or modifying user "core" Jun 20 19:47:52.970146 ignition[957]: INFO : files: ensureUsers: op(2): [started] adding ssh keys to user "core" Jun 20 19:47:52.970146 ignition[957]: INFO : files: ensureUsers: op(2): [finished] adding ssh keys to user "core" Jun 20 19:47:52.969870 unknown[957]: wrote ssh authorized keys file for user: core Jun 20 19:47:52.984946 ignition[957]: INFO : files: createFilesystemsFiles: createFiles: op(3): [started] writing file "/sysroot/etc/flatcar/update.conf" Jun 20 19:47:52.984946 ignition[957]: INFO : files: createFilesystemsFiles: createFiles: op(3): [finished] writing file "/sysroot/etc/flatcar/update.conf" Jun 20 19:47:52.984946 ignition[957]: INFO : files: op(4): [started] processing unit "coreos-metadata.service" Jun 20 19:47:52.990776 ignition[957]: INFO : files: op(4): op(5): [started] writing systemd drop-in "20-clct-provider-override.conf" at "/sysroot/etc/systemd/system/coreos-metadata.service.d/20-clct-provider-override.conf" Jun 20 19:47:53.003128 ignition[957]: INFO : files: op(4): op(5): [finished] writing systemd drop-in "20-clct-provider-override.conf" at "/sysroot/etc/systemd/system/coreos-metadata.service.d/20-clct-provider-override.conf" Jun 20 19:47:53.003128 ignition[957]: INFO : files: op(4): [finished] processing unit "coreos-metadata.service" Jun 20 19:47:53.003128 ignition[957]: INFO : files: op(6): [started] processing unit "coreos-metadata-sshkeys@.service" Jun 20 19:47:53.006624 ignition[957]: INFO : files: op(6): op(7): [started] writing systemd drop-in "20-clct-provider-override.conf" at "/sysroot/etc/systemd/system/coreos-metadata-sshkeys@.service.d/20-clct-provider-override.conf" Jun 20 19:47:53.006624 ignition[957]: INFO : files: op(6): op(7): [finished] writing systemd drop-in "20-clct-provider-override.conf" at "/sysroot/etc/systemd/system/coreos-metadata-sshkeys@.service.d/20-clct-provider-override.conf" Jun 20 19:47:53.006624 ignition[957]: INFO : files: op(6): [finished] processing unit "coreos-metadata-sshkeys@.service" Jun 20 19:47:53.006624 ignition[957]: INFO : files: op(8): [started] processing unit "etcd-member.service" Jun 20 19:47:53.006624 ignition[957]: INFO : files: op(8): op(9): [started] writing systemd drop-in "20-clct-etcd-member.conf" at "/sysroot/etc/systemd/system/etcd-member.service.d/20-clct-etcd-member.conf" Jun 20 19:47:53.006624 ignition[957]: INFO : files: op(8): op(9): [finished] writing systemd drop-in "20-clct-etcd-member.conf" at "/sysroot/etc/systemd/system/etcd-member.service.d/20-clct-etcd-member.conf" Jun 20 19:47:53.006624 ignition[957]: INFO : files: op(8): [finished] processing unit "etcd-member.service" Jun 20 19:47:53.006624 ignition[957]: INFO : files: op(a): [started] setting preset to enabled for "coreos-metadata-sshkeys@.service " Jun 20 19:47:53.006624 ignition[957]: INFO : files: op(a): [finished] setting preset to enabled for "coreos-metadata-sshkeys@.service " Jun 20 19:47:53.006624 ignition[957]: INFO : files: op(b): [started] setting preset to enabled for "etcd-member.service" Jun 20 19:47:53.006624 ignition[957]: INFO : files: op(b): [finished] setting preset to enabled for "etcd-member.service" Jun 20 19:47:53.022265 ignition[957]: INFO : files: createResultFile: createFiles: op(c): [started] writing file "/sysroot/etc/.ignition-result.json" Jun 20 19:47:53.022265 ignition[957]: INFO : files: createResultFile: createFiles: op(c): [finished] writing file "/sysroot/etc/.ignition-result.json" Jun 20 19:47:53.022265 ignition[957]: INFO : files: files passed Jun 20 19:47:53.022265 ignition[957]: INFO : Ignition finished successfully Jun 20 19:47:53.015126 systemd[1]: Finished ignition-files.service - Ignition (files). Jun 20 19:47:53.019216 systemd[1]: Starting ignition-quench.service - Ignition (record completion)... Jun 20 19:47:53.022735 systemd[1]: Starting initrd-setup-root-after-ignition.service - Root filesystem completion... Jun 20 19:47:53.039060 systemd[1]: ignition-quench.service: Deactivated successfully. Jun 20 19:47:53.040077 systemd[1]: Finished ignition-quench.service - Ignition (record completion). Jun 20 19:47:53.051944 initrd-setup-root-after-ignition[987]: grep: /sysroot/etc/flatcar/enabled-sysext.conf: No such file or directory Jun 20 19:47:53.051944 initrd-setup-root-after-ignition[987]: grep: /sysroot/usr/share/flatcar/enabled-sysext.conf: No such file or directory Jun 20 19:47:53.055651 initrd-setup-root-after-ignition[991]: grep: /sysroot/etc/flatcar/enabled-sysext.conf: No such file or directory Jun 20 19:47:53.054741 systemd[1]: Finished initrd-setup-root-after-ignition.service - Root filesystem completion. Jun 20 19:47:53.056799 systemd[1]: Reached target ignition-complete.target - Ignition Complete. Jun 20 19:47:53.059281 systemd[1]: Starting initrd-parse-etc.service - Mountpoints Configured in the Real Root... Jun 20 19:47:53.131886 systemd[1]: initrd-parse-etc.service: Deactivated successfully. Jun 20 19:47:53.132211 systemd[1]: Finished initrd-parse-etc.service - Mountpoints Configured in the Real Root. Jun 20 19:47:53.136091 systemd[1]: Reached target initrd-fs.target - Initrd File Systems. Jun 20 19:47:53.138661 systemd[1]: Reached target initrd.target - Initrd Default Target. Jun 20 19:47:53.141768 systemd[1]: dracut-mount.service - dracut mount hook was skipped because no trigger condition checks were met. Jun 20 19:47:53.144196 systemd[1]: Starting dracut-pre-pivot.service - dracut pre-pivot and cleanup hook... Jun 20 19:47:53.201041 systemd[1]: Finished dracut-pre-pivot.service - dracut pre-pivot and cleanup hook. Jun 20 19:47:53.207743 systemd[1]: Starting initrd-cleanup.service - Cleaning Up and Shutting Down Daemons... Jun 20 19:47:53.268383 systemd[1]: Stopped target nss-lookup.target - Host and Network Name Lookups. Jun 20 19:47:53.271832 systemd[1]: Stopped target remote-cryptsetup.target - Remote Encrypted Volumes. Jun 20 19:47:53.275243 systemd[1]: Stopped target timers.target - Timer Units. Jun 20 19:47:53.276981 systemd[1]: dracut-pre-pivot.service: Deactivated successfully. Jun 20 19:47:53.277394 systemd[1]: Stopped dracut-pre-pivot.service - dracut pre-pivot and cleanup hook. Jun 20 19:47:53.280835 systemd[1]: Stopped target initrd.target - Initrd Default Target. Jun 20 19:47:53.283090 systemd[1]: Stopped target basic.target - Basic System. Jun 20 19:47:53.286011 systemd[1]: Stopped target ignition-complete.target - Ignition Complete. Jun 20 19:47:53.288911 systemd[1]: Stopped target ignition-diskful.target - Ignition Boot Disk Setup. Jun 20 19:47:53.291644 systemd[1]: Stopped target initrd-root-device.target - Initrd Root Device. Jun 20 19:47:53.294558 systemd[1]: Stopped target initrd-usr-fs.target - Initrd /usr File System. Jun 20 19:47:53.298018 systemd[1]: Stopped target remote-fs.target - Remote File Systems. Jun 20 19:47:53.301153 systemd[1]: Stopped target remote-fs-pre.target - Preparation for Remote File Systems. Jun 20 19:47:53.304425 systemd[1]: Stopped target sysinit.target - System Initialization. Jun 20 19:47:53.307279 systemd[1]: Stopped target local-fs.target - Local File Systems. Jun 20 19:47:53.310252 systemd[1]: Stopped target swap.target - Swaps. Jun 20 19:47:53.312803 systemd[1]: dracut-pre-mount.service: Deactivated successfully. Jun 20 19:47:53.313183 systemd[1]: Stopped dracut-pre-mount.service - dracut pre-mount hook. Jun 20 19:47:53.316096 systemd[1]: Stopped target cryptsetup.target - Local Encrypted Volumes. Jun 20 19:47:53.318074 systemd[1]: Stopped target cryptsetup-pre.target - Local Encrypted Volumes (Pre). Jun 20 19:47:53.320301 systemd[1]: clevis-luks-askpass.path: Deactivated successfully. Jun 20 19:47:53.320550 systemd[1]: Stopped clevis-luks-askpass.path - Forward Password Requests to Clevis Directory Watch. Jun 20 19:47:53.323275 systemd[1]: dracut-initqueue.service: Deactivated successfully. Jun 20 19:47:53.323663 systemd[1]: Stopped dracut-initqueue.service - dracut initqueue hook. Jun 20 19:47:53.327094 systemd[1]: initrd-setup-root-after-ignition.service: Deactivated successfully. Jun 20 19:47:53.327487 systemd[1]: Stopped initrd-setup-root-after-ignition.service - Root filesystem completion. Jun 20 19:47:53.330473 systemd[1]: ignition-files.service: Deactivated successfully. Jun 20 19:47:53.330868 systemd[1]: Stopped ignition-files.service - Ignition (files). Jun 20 19:47:53.335959 systemd[1]: Stopping ignition-mount.service - Ignition (mount)... Jun 20 19:47:53.342481 systemd[1]: kmod-static-nodes.service: Deactivated successfully. Jun 20 19:47:53.342936 systemd[1]: Stopped kmod-static-nodes.service - Create List of Static Device Nodes. Jun 20 19:47:53.351795 systemd[1]: Stopping sysroot-boot.service - /sysroot/boot... Jun 20 19:47:53.353349 systemd[1]: systemd-udev-trigger.service: Deactivated successfully. Jun 20 19:47:53.355782 systemd[1]: Stopped systemd-udev-trigger.service - Coldplug All udev Devices. Jun 20 19:47:53.357897 systemd[1]: dracut-pre-trigger.service: Deactivated successfully. Jun 20 19:47:53.358788 systemd[1]: Stopped dracut-pre-trigger.service - dracut pre-trigger hook. Jun 20 19:47:53.367924 systemd[1]: initrd-cleanup.service: Deactivated successfully. Jun 20 19:47:53.368025 systemd[1]: Finished initrd-cleanup.service - Cleaning Up and Shutting Down Daemons. Jun 20 19:47:53.386194 systemd[1]: sysroot-boot.mount: Deactivated successfully. Jun 20 19:47:53.390132 ignition[1011]: INFO : Ignition 2.21.0 Jun 20 19:47:53.390132 ignition[1011]: INFO : Stage: umount Jun 20 19:47:53.391442 ignition[1011]: INFO : no configs at "/usr/lib/ignition/base.d" Jun 20 19:47:53.391442 ignition[1011]: INFO : no config dir at "/usr/lib/ignition/base.platform.d/openstack" Jun 20 19:47:53.391442 ignition[1011]: INFO : umount: umount passed Jun 20 19:47:53.391442 ignition[1011]: INFO : Ignition finished successfully Jun 20 19:47:53.392008 systemd[1]: ignition-mount.service: Deactivated successfully. Jun 20 19:47:53.392133 systemd[1]: Stopped ignition-mount.service - Ignition (mount). Jun 20 19:47:53.393062 systemd[1]: ignition-disks.service: Deactivated successfully. Jun 20 19:47:53.393132 systemd[1]: Stopped ignition-disks.service - Ignition (disks). Jun 20 19:47:53.394158 systemd[1]: ignition-kargs.service: Deactivated successfully. Jun 20 19:47:53.394200 systemd[1]: Stopped ignition-kargs.service - Ignition (kargs). Jun 20 19:47:53.395291 systemd[1]: ignition-fetch.service: Deactivated successfully. Jun 20 19:47:53.395331 systemd[1]: Stopped ignition-fetch.service - Ignition (fetch). Jun 20 19:47:53.396610 systemd[1]: Stopped target network.target - Network. Jun 20 19:47:53.399911 systemd[1]: ignition-fetch-offline.service: Deactivated successfully. Jun 20 19:47:53.399968 systemd[1]: Stopped ignition-fetch-offline.service - Ignition (fetch-offline). Jun 20 19:47:53.400997 systemd[1]: Stopped target paths.target - Path Units. Jun 20 19:47:53.401974 systemd[1]: systemd-ask-password-console.path: Deactivated successfully. Jun 20 19:47:53.402211 systemd[1]: Stopped systemd-ask-password-console.path - Dispatch Password Requests to Console Directory Watch. Jun 20 19:47:53.403020 systemd[1]: Stopped target slices.target - Slice Units. Jun 20 19:47:53.403994 systemd[1]: Stopped target sockets.target - Socket Units. Jun 20 19:47:53.404992 systemd[1]: iscsid.socket: Deactivated successfully. Jun 20 19:47:53.405025 systemd[1]: Closed iscsid.socket - Open-iSCSI iscsid Socket. Jun 20 19:47:53.405999 systemd[1]: iscsiuio.socket: Deactivated successfully. Jun 20 19:47:53.406029 systemd[1]: Closed iscsiuio.socket - Open-iSCSI iscsiuio Socket. Jun 20 19:47:53.406954 systemd[1]: ignition-setup.service: Deactivated successfully. Jun 20 19:47:53.406999 systemd[1]: Stopped ignition-setup.service - Ignition (setup). Jun 20 19:47:53.408098 systemd[1]: ignition-setup-pre.service: Deactivated successfully. Jun 20 19:47:53.408139 systemd[1]: Stopped ignition-setup-pre.service - Ignition env setup. Jun 20 19:47:53.409392 systemd[1]: Stopping systemd-networkd.service - Network Configuration... Jun 20 19:47:53.410641 systemd[1]: Stopping systemd-resolved.service - Network Name Resolution... Jun 20 19:47:53.412099 systemd[1]: sysroot-boot.service: Deactivated successfully. Jun 20 19:47:53.412186 systemd[1]: Stopped sysroot-boot.service - /sysroot/boot. Jun 20 19:47:53.413475 systemd[1]: initrd-setup-root.service: Deactivated successfully. Jun 20 19:47:53.413546 systemd[1]: Stopped initrd-setup-root.service - Root filesystem setup. Jun 20 19:47:53.419155 systemd[1]: systemd-resolved.service: Deactivated successfully. Jun 20 19:47:53.419249 systemd[1]: Stopped systemd-resolved.service - Network Name Resolution. Jun 20 19:47:53.422370 systemd[1]: run-credentials-systemd\x2dresolved.service.mount: Deactivated successfully. Jun 20 19:47:53.422542 systemd[1]: systemd-networkd.service: Deactivated successfully. Jun 20 19:47:53.422871 systemd[1]: Stopped systemd-networkd.service - Network Configuration. Jun 20 19:47:53.424912 systemd[1]: run-credentials-systemd\x2dnetworkd.service.mount: Deactivated successfully. Jun 20 19:47:53.425383 systemd[1]: Stopped target network-pre.target - Preparation for Network. Jun 20 19:47:53.429772 systemd[1]: systemd-networkd.socket: Deactivated successfully. Jun 20 19:47:53.429810 systemd[1]: Closed systemd-networkd.socket - Network Service Netlink Socket. Jun 20 19:47:53.431749 systemd[1]: Stopping network-cleanup.service - Network Cleanup... Jun 20 19:47:53.433666 systemd[1]: parse-ip-for-networkd.service: Deactivated successfully. Jun 20 19:47:53.433717 systemd[1]: Stopped parse-ip-for-networkd.service - Write systemd-networkd units from cmdline. Jun 20 19:47:53.435044 systemd[1]: systemd-sysctl.service: Deactivated successfully. Jun 20 19:47:53.435086 systemd[1]: Stopped systemd-sysctl.service - Apply Kernel Variables. Jun 20 19:47:53.437657 systemd[1]: systemd-modules-load.service: Deactivated successfully. Jun 20 19:47:53.437703 systemd[1]: Stopped systemd-modules-load.service - Load Kernel Modules. Jun 20 19:47:53.438892 systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. Jun 20 19:47:53.438933 systemd[1]: Stopped systemd-tmpfiles-setup.service - Create System Files and Directories. Jun 20 19:47:53.440452 systemd[1]: Stopping systemd-udevd.service - Rule-based Manager for Device Events and Files... Jun 20 19:47:53.442430 systemd[1]: run-credentials-systemd\x2dsysctl.service.mount: Deactivated successfully. Jun 20 19:47:53.442489 systemd[1]: run-credentials-systemd\x2dtmpfiles\x2dsetup.service.mount: Deactivated successfully. Jun 20 19:47:53.455118 systemd[1]: systemd-udevd.service: Deactivated successfully. Jun 20 19:47:53.456805 systemd[1]: Stopped systemd-udevd.service - Rule-based Manager for Device Events and Files. Jun 20 19:47:53.459179 systemd[1]: network-cleanup.service: Deactivated successfully. Jun 20 19:47:53.459331 systemd[1]: Stopped network-cleanup.service - Network Cleanup. Jun 20 19:47:53.461132 systemd[1]: systemd-udevd-control.socket: Deactivated successfully. Jun 20 19:47:53.461205 systemd[1]: Closed systemd-udevd-control.socket - udev Control Socket. Jun 20 19:47:53.462645 systemd[1]: systemd-udevd-kernel.socket: Deactivated successfully. Jun 20 19:47:53.462688 systemd[1]: Closed systemd-udevd-kernel.socket - udev Kernel Socket. Jun 20 19:47:53.463817 systemd[1]: dracut-pre-udev.service: Deactivated successfully. Jun 20 19:47:53.463871 systemd[1]: Stopped dracut-pre-udev.service - dracut pre-udev hook. Jun 20 19:47:53.465554 systemd[1]: dracut-cmdline.service: Deactivated successfully. Jun 20 19:47:53.465623 systemd[1]: Stopped dracut-cmdline.service - dracut cmdline hook. Jun 20 19:47:53.466778 systemd[1]: dracut-cmdline-ask.service: Deactivated successfully. Jun 20 19:47:53.466833 systemd[1]: Stopped dracut-cmdline-ask.service - dracut ask for additional cmdline parameters. Jun 20 19:47:53.469042 systemd[1]: Starting initrd-udevadm-cleanup-db.service - Cleanup udev Database... Jun 20 19:47:53.470918 systemd[1]: systemd-network-generator.service: Deactivated successfully. Jun 20 19:47:53.470979 systemd[1]: Stopped systemd-network-generator.service - Generate network units from Kernel command line. Jun 20 19:47:53.474462 systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. Jun 20 19:47:53.474512 systemd[1]: Stopped systemd-tmpfiles-setup-dev.service - Create Static Device Nodes in /dev. Jun 20 19:47:53.475661 systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. Jun 20 19:47:53.475711 systemd[1]: Stopped systemd-vconsole-setup.service - Virtual Console Setup. Jun 20 19:47:53.486889 systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. Jun 20 19:47:53.487016 systemd[1]: Finished initrd-udevadm-cleanup-db.service - Cleanup udev Database. Jun 20 19:47:53.488657 systemd[1]: Reached target initrd-switch-root.target - Switch Root. Jun 20 19:47:53.491773 systemd[1]: Starting initrd-switch-root.service - Switch Root... Jun 20 19:47:53.514767 systemd[1]: Switching root. Jun 20 19:47:53.571354 systemd-journald[211]: Journal stopped Jun 20 19:47:54.945466 systemd-journald[211]: Received SIGTERM from PID 1 (systemd). Jun 20 19:47:54.945523 kernel: SELinux: policy capability network_peer_controls=1 Jun 20 19:47:54.945540 kernel: SELinux: policy capability open_perms=1 Jun 20 19:47:54.945554 kernel: SELinux: policy capability extended_socket_class=1 Jun 20 19:47:54.945981 kernel: SELinux: policy capability always_check_network=0 Jun 20 19:47:54.945999 kernel: SELinux: policy capability cgroup_seclabel=1 Jun 20 19:47:54.946012 kernel: SELinux: policy capability nnp_nosuid_transition=1 Jun 20 19:47:54.946024 kernel: SELinux: policy capability genfs_seclabel_symlinks=0 Jun 20 19:47:54.946038 kernel: SELinux: policy capability ioctl_skip_cloexec=0 Jun 20 19:47:54.946050 kernel: SELinux: policy capability userspace_initial_context=0 Jun 20 19:47:54.946061 kernel: audit: type=1403 audit(1750448873.790:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 Jun 20 19:47:54.946075 systemd[1]: Successfully loaded SELinux policy in 97.640ms. Jun 20 19:47:54.946092 systemd[1]: Relabeled /dev/, /dev/shm/, /run/ in 25.715ms. Jun 20 19:47:54.946106 systemd[1]: systemd 256.8 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP -GCRYPT -GNUTLS +OPENSSL -ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 -PWQUALITY -P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK -XKBCOMMON +UTMP -SYSVINIT +LIBARCHIVE) Jun 20 19:47:54.946122 systemd[1]: Detected virtualization kvm. Jun 20 19:47:54.946135 systemd[1]: Detected architecture x86-64. Jun 20 19:47:54.946147 systemd[1]: Detected first boot. Jun 20 19:47:54.946162 systemd[1]: Hostname set to . Jun 20 19:47:54.946175 systemd[1]: Initializing machine ID from VM UUID. Jun 20 19:47:54.946188 zram_generator::config[1055]: No configuration found. Jun 20 19:47:54.946201 kernel: Guest personality initialized and is inactive Jun 20 19:47:54.946212 kernel: VMCI host device registered (name=vmci, major=10, minor=125) Jun 20 19:47:54.946223 kernel: Initialized host personality Jun 20 19:47:54.946235 kernel: NET: Registered PF_VSOCK protocol family Jun 20 19:47:54.946247 systemd[1]: Populated /etc with preset unit settings. Jun 20 19:47:54.946265 systemd[1]: run-credentials-systemd\x2djournald.service.mount: Deactivated successfully. Jun 20 19:47:54.946278 systemd[1]: initrd-switch-root.service: Deactivated successfully. Jun 20 19:47:54.946291 systemd[1]: Stopped initrd-switch-root.service - Switch Root. Jun 20 19:47:54.946303 systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. Jun 20 19:47:54.946317 systemd[1]: Created slice system-addon\x2dconfig.slice - Slice /system/addon-config. Jun 20 19:47:54.946329 systemd[1]: Created slice system-addon\x2drun.slice - Slice /system/addon-run. Jun 20 19:47:54.946343 systemd[1]: Created slice system-coreos\x2dmetadata\x2dsshkeys.slice - Slice /system/coreos-metadata-sshkeys. Jun 20 19:47:54.946355 systemd[1]: Created slice system-getty.slice - Slice /system/getty. Jun 20 19:47:54.946368 systemd[1]: Created slice system-modprobe.slice - Slice /system/modprobe. Jun 20 19:47:54.946382 systemd[1]: Created slice system-serial\x2dgetty.slice - Slice /system/serial-getty. Jun 20 19:47:54.946396 systemd[1]: Created slice system-system\x2dcloudinit.slice - Slice /system/system-cloudinit. Jun 20 19:47:54.946409 systemd[1]: Created slice system-systemd\x2dfsck.slice - Slice /system/systemd-fsck. Jun 20 19:47:54.946422 systemd[1]: Created slice user.slice - User and Session Slice. Jun 20 19:47:54.946435 systemd[1]: Started clevis-luks-askpass.path - Forward Password Requests to Clevis Directory Watch. Jun 20 19:47:54.946447 systemd[1]: Started systemd-ask-password-console.path - Dispatch Password Requests to Console Directory Watch. Jun 20 19:47:54.946460 systemd[1]: Started systemd-ask-password-wall.path - Forward Password Requests to Wall Directory Watch. Jun 20 19:47:54.946475 systemd[1]: Set up automount boot.automount - Boot partition Automount Point. Jun 20 19:47:54.946488 systemd[1]: Set up automount proc-sys-fs-binfmt_misc.automount - Arbitrary Executable File Formats File System Automount Point. Jun 20 19:47:54.946501 systemd[1]: Expecting device dev-disk-by\x2dlabel-OEM.device - /dev/disk/by-label/OEM... Jun 20 19:47:54.946514 systemd[1]: Expecting device dev-ttyS0.device - /dev/ttyS0... Jun 20 19:47:54.946527 systemd[1]: Reached target cryptsetup-pre.target - Local Encrypted Volumes (Pre). Jun 20 19:47:54.946540 systemd[1]: Reached target cryptsetup.target - Local Encrypted Volumes. Jun 20 19:47:54.946552 systemd[1]: Stopped target initrd-switch-root.target - Switch Root. Jun 20 19:47:54.946919 systemd[1]: Stopped target initrd-fs.target - Initrd File Systems. Jun 20 19:47:54.946940 systemd[1]: Stopped target initrd-root-fs.target - Initrd Root File System. Jun 20 19:47:54.946953 systemd[1]: Reached target integritysetup.target - Local Integrity Protected Volumes. Jun 20 19:47:54.946968 systemd[1]: Reached target remote-cryptsetup.target - Remote Encrypted Volumes. Jun 20 19:47:54.946980 systemd[1]: Reached target remote-fs.target - Remote File Systems. Jun 20 19:47:54.946993 systemd[1]: Reached target slices.target - Slice Units. Jun 20 19:47:54.947005 systemd[1]: Reached target swap.target - Swaps. Jun 20 19:47:54.947018 systemd[1]: Reached target veritysetup.target - Local Verity Protected Volumes. Jun 20 19:47:54.947031 systemd[1]: Listening on systemd-coredump.socket - Process Core Dump Socket. Jun 20 19:47:54.947043 systemd[1]: Listening on systemd-creds.socket - Credential Encryption/Decryption. Jun 20 19:47:54.947062 systemd[1]: Listening on systemd-networkd.socket - Network Service Netlink Socket. Jun 20 19:47:54.947075 systemd[1]: Listening on systemd-udevd-control.socket - udev Control Socket. Jun 20 19:47:54.947088 systemd[1]: Listening on systemd-udevd-kernel.socket - udev Kernel Socket. Jun 20 19:47:54.947100 systemd[1]: Listening on systemd-userdbd.socket - User Database Manager Socket. Jun 20 19:47:54.947113 systemd[1]: Mounting dev-hugepages.mount - Huge Pages File System... Jun 20 19:47:54.947126 systemd[1]: Mounting dev-mqueue.mount - POSIX Message Queue File System... Jun 20 19:47:54.947139 systemd[1]: Mounting media.mount - External Media Directory... Jun 20 19:47:54.947152 systemd[1]: proc-xen.mount - /proc/xen was skipped because of an unmet condition check (ConditionVirtualization=xen). Jun 20 19:47:54.947165 systemd[1]: Mounting sys-kernel-debug.mount - Kernel Debug File System... Jun 20 19:47:54.947179 systemd[1]: Mounting sys-kernel-tracing.mount - Kernel Trace File System... Jun 20 19:47:54.947192 systemd[1]: Mounting tmp.mount - Temporary Directory /tmp... Jun 20 19:47:54.947206 systemd[1]: var-lib-machines.mount - Virtual Machine and Container Storage (Compatibility) was skipped because of an unmet condition check (ConditionPathExists=/var/lib/machines.raw). Jun 20 19:47:54.947219 systemd[1]: Reached target machines.target - Containers. Jun 20 19:47:54.947232 systemd[1]: Starting flatcar-tmpfiles.service - Create missing system files... Jun 20 19:47:54.947246 systemd[1]: ignition-delete-config.service - Ignition (delete config) was skipped because no trigger condition checks were met. Jun 20 19:47:54.947258 systemd[1]: Starting kmod-static-nodes.service - Create List of Static Device Nodes... Jun 20 19:47:54.947271 systemd[1]: Starting modprobe@configfs.service - Load Kernel Module configfs... Jun 20 19:47:54.947286 systemd[1]: Starting modprobe@dm_mod.service - Load Kernel Module dm_mod... Jun 20 19:47:54.947298 systemd[1]: Starting modprobe@drm.service - Load Kernel Module drm... Jun 20 19:47:54.947311 systemd[1]: Starting modprobe@efi_pstore.service - Load Kernel Module efi_pstore... Jun 20 19:47:54.947324 systemd[1]: Starting modprobe@fuse.service - Load Kernel Module fuse... Jun 20 19:47:54.947336 systemd[1]: Starting modprobe@loop.service - Load Kernel Module loop... Jun 20 19:47:54.947349 systemd[1]: setup-nsswitch.service - Create /etc/nsswitch.conf was skipped because of an unmet condition check (ConditionPathExists=!/etc/nsswitch.conf). Jun 20 19:47:54.947362 systemd[1]: systemd-fsck-root.service: Deactivated successfully. Jun 20 19:47:54.947374 systemd[1]: Stopped systemd-fsck-root.service - File System Check on Root Device. Jun 20 19:47:54.947389 systemd[1]: systemd-fsck-usr.service: Deactivated successfully. Jun 20 19:47:54.947401 systemd[1]: Stopped systemd-fsck-usr.service. Jun 20 19:47:54.947415 systemd[1]: systemd-hibernate-clear.service - Clear Stale Hibernate Storage Info was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67). Jun 20 19:47:54.947428 systemd[1]: Starting systemd-journald.service - Journal Service... Jun 20 19:47:54.947441 systemd[1]: Starting systemd-modules-load.service - Load Kernel Modules... Jun 20 19:47:54.947454 systemd[1]: Starting systemd-network-generator.service - Generate network units from Kernel command line... Jun 20 19:47:54.947469 systemd[1]: Starting systemd-remount-fs.service - Remount Root and Kernel File Systems... Jun 20 19:47:54.947481 systemd[1]: Starting systemd-udev-load-credentials.service - Load udev Rules from Credentials... Jun 20 19:47:54.947494 systemd[1]: Starting systemd-udev-trigger.service - Coldplug All udev Devices... Jun 20 19:47:54.947509 systemd[1]: verity-setup.service: Deactivated successfully. Jun 20 19:47:54.947523 systemd[1]: Stopped verity-setup.service. Jun 20 19:47:54.947538 systemd[1]: xenserver-pv-version.service - Set fake PV driver version for XenServer was skipped because of an unmet condition check (ConditionVirtualization=xen). Jun 20 19:47:54.947551 systemd[1]: Mounted dev-hugepages.mount - Huge Pages File System. Jun 20 19:47:54.947585 systemd[1]: Mounted dev-mqueue.mount - POSIX Message Queue File System. Jun 20 19:47:54.947600 systemd[1]: Mounted media.mount - External Media Directory. Jun 20 19:47:54.947613 systemd[1]: Mounted sys-kernel-debug.mount - Kernel Debug File System. Jun 20 19:47:54.947626 systemd[1]: Mounted sys-kernel-tracing.mount - Kernel Trace File System. Jun 20 19:47:54.947661 systemd-journald[1138]: Collecting audit messages is disabled. Jun 20 19:47:54.947688 systemd[1]: Mounted tmp.mount - Temporary Directory /tmp. Jun 20 19:47:54.947702 systemd[1]: Finished kmod-static-nodes.service - Create List of Static Device Nodes. Jun 20 19:47:54.947715 systemd-journald[1138]: Journal started Jun 20 19:47:54.947741 systemd-journald[1138]: Runtime Journal (/run/log/journal/7c6d7721993141c792f03ec9fb239232) is 8M, max 78.5M, 70.5M free. Jun 20 19:47:54.605349 systemd[1]: Queued start job for default target multi-user.target. Jun 20 19:47:54.624674 systemd[1]: Unnecessary job was removed for dev-vda6.device - /dev/vda6. Jun 20 19:47:54.625072 systemd[1]: systemd-journald.service: Deactivated successfully. Jun 20 19:47:54.952944 systemd[1]: Started systemd-journald.service - Journal Service. Jun 20 19:47:54.954774 kernel: loop: module loaded Jun 20 19:47:54.956481 systemd[1]: modprobe@configfs.service: Deactivated successfully. Jun 20 19:47:54.957362 systemd[1]: Finished modprobe@configfs.service - Load Kernel Module configfs. Jun 20 19:47:54.958171 systemd[1]: modprobe@dm_mod.service: Deactivated successfully. Jun 20 19:47:54.958382 systemd[1]: Finished modprobe@dm_mod.service - Load Kernel Module dm_mod. Jun 20 19:47:54.959874 systemd[1]: modprobe@efi_pstore.service: Deactivated successfully. Jun 20 19:47:54.960055 systemd[1]: Finished modprobe@efi_pstore.service - Load Kernel Module efi_pstore. Jun 20 19:47:54.960957 systemd[1]: Finished systemd-modules-load.service - Load Kernel Modules. Jun 20 19:47:54.961752 systemd[1]: Finished systemd-remount-fs.service - Remount Root and Kernel File Systems. Jun 20 19:47:54.966214 systemd[1]: modprobe@loop.service: Deactivated successfully. Jun 20 19:47:54.966381 systemd[1]: Finished modprobe@loop.service - Load Kernel Module loop. Jun 20 19:47:54.976169 systemd[1]: Mounting sys-kernel-config.mount - Kernel Configuration File System... Jun 20 19:47:54.976810 systemd[1]: remount-root.service - Remount Root File System was skipped because of an unmet condition check (ConditionPathIsReadWrite=!/). Jun 20 19:47:54.976838 systemd[1]: Reached target local-fs.target - Local File Systems. Jun 20 19:47:54.978519 systemd[1]: Listening on systemd-sysext.socket - System Extension Image Management. Jun 20 19:47:54.980768 systemd[1]: Starting ldconfig.service - Rebuild Dynamic Linker Cache... Jun 20 19:47:54.981397 systemd[1]: systemd-binfmt.service - Set Up Additional Binary Formats was skipped because no trigger condition checks were met. Jun 20 19:47:54.984734 systemd[1]: Starting systemd-hwdb-update.service - Rebuild Hardware Database... Jun 20 19:47:54.990135 systemd[1]: Starting systemd-journal-flush.service - Flush Journal to Persistent Storage... Jun 20 19:47:54.992625 systemd[1]: systemd-pstore.service - Platform Persistent Storage Archival was skipped because of an unmet condition check (ConditionDirectoryNotEmpty=/sys/fs/pstore). Jun 20 19:47:54.995177 systemd[1]: Starting systemd-random-seed.service - Load/Save OS Random Seed... Jun 20 19:47:54.995877 systemd[1]: systemd-repart.service - Repartition Root Disk was skipped because no trigger condition checks were met. Jun 20 19:47:55.000783 systemd[1]: Starting systemd-sysctl.service - Apply Kernel Variables... Jun 20 19:47:55.013619 kernel: fuse: init (API version 7.41) Jun 20 19:47:55.012294 systemd[1]: Starting systemd-sysext.service - Merge System Extension Images into /usr/ and /opt/... Jun 20 19:47:55.019062 systemd[1]: Finished flatcar-tmpfiles.service - Create missing system files. Jun 20 19:47:55.019983 systemd[1]: modprobe@fuse.service: Deactivated successfully. Jun 20 19:47:55.020183 systemd[1]: Finished modprobe@fuse.service - Load Kernel Module fuse. Jun 20 19:47:55.021054 systemd[1]: Finished systemd-network-generator.service - Generate network units from Kernel command line. Jun 20 19:47:55.023045 systemd[1]: Finished systemd-udev-load-credentials.service - Load udev Rules from Credentials. Jun 20 19:47:55.023902 systemd[1]: Mounted sys-kernel-config.mount - Kernel Configuration File System. Jun 20 19:47:55.028382 systemd[1]: Reached target network-pre.target - Preparation for Network. Jun 20 19:47:55.031959 systemd[1]: Mounting sys-fs-fuse-connections.mount - FUSE Control File System... Jun 20 19:47:55.045605 systemd-journald[1138]: Time spent on flushing to /var/log/journal/7c6d7721993141c792f03ec9fb239232 is 22.424ms for 958 entries. Jun 20 19:47:55.045605 systemd-journald[1138]: System Journal (/var/log/journal/7c6d7721993141c792f03ec9fb239232) is 8M, max 584.8M, 576.8M free. Jun 20 19:47:55.107810 systemd-journald[1138]: Received client request to flush runtime journal. Jun 20 19:47:55.107852 kernel: ACPI: bus type drm_connector registered Jun 20 19:47:55.107869 kernel: loop0: detected capacity change from 0 to 113872 Jun 20 19:47:55.057714 systemd[1]: Starting systemd-sysusers.service - Create System Users... Jun 20 19:47:55.060017 systemd[1]: Finished systemd-random-seed.service - Load/Save OS Random Seed. Jun 20 19:47:55.062885 systemd[1]: Mounted sys-fs-fuse-connections.mount - FUSE Control File System. Jun 20 19:47:55.065121 systemd[1]: Reached target first-boot-complete.target - First Boot Complete. Jun 20 19:47:55.075344 systemd[1]: Starting systemd-machine-id-commit.service - Save Transient machine-id to Disk... Jun 20 19:47:55.092550 systemd[1]: modprobe@drm.service: Deactivated successfully. Jun 20 19:47:55.109701 systemd[1]: Finished modprobe@drm.service - Load Kernel Module drm. Jun 20 19:47:55.111391 systemd[1]: Finished systemd-journal-flush.service - Flush Journal to Persistent Storage. Jun 20 19:47:55.112699 systemd[1]: Finished systemd-sysctl.service - Apply Kernel Variables. Jun 20 19:47:55.166363 systemd[1]: Finished systemd-machine-id-commit.service - Save Transient machine-id to Disk. Jun 20 19:47:55.167594 kernel: squashfs: version 4.0 (2009/01/31) Phillip Lougher Jun 20 19:47:55.189595 kernel: loop1: detected capacity change from 0 to 8 Jun 20 19:47:55.204306 systemd[1]: Finished systemd-udev-trigger.service - Coldplug All udev Devices. Jun 20 19:47:55.211744 systemd[1]: Finished systemd-sysusers.service - Create System Users. Jun 20 19:47:55.215598 kernel: loop2: detected capacity change from 0 to 146240 Jun 20 19:47:55.216160 systemd[1]: Starting systemd-tmpfiles-setup-dev.service - Create Static Device Nodes in /dev... Jun 20 19:47:55.261873 systemd-tmpfiles[1211]: ACLs are not supported, ignoring. Jun 20 19:47:55.261893 systemd-tmpfiles[1211]: ACLs are not supported, ignoring. Jun 20 19:47:55.268603 kernel: loop3: detected capacity change from 0 to 113872 Jun 20 19:47:55.273505 systemd[1]: Finished systemd-tmpfiles-setup-dev.service - Create Static Device Nodes in /dev. Jun 20 19:47:55.299738 kernel: loop4: detected capacity change from 0 to 8 Jun 20 19:47:55.302605 kernel: loop5: detected capacity change from 0 to 146240 Jun 20 19:47:55.395114 (sd-merge)[1214]: Using extensions 'containerd-flatcar', 'docker-flatcar', 'oem-openstack'. Jun 20 19:47:55.396244 (sd-merge)[1214]: Merged extensions into '/usr'. Jun 20 19:47:55.399325 systemd[1]: Finished systemd-sysext.service - Merge System Extension Images into /usr/ and /opt/. Jun 20 19:47:55.403149 systemd[1]: Starting ensure-sysext.service... Jun 20 19:47:55.407321 systemd[1]: Starting systemd-tmpfiles-setup.service - Create System Files and Directories... Jun 20 19:47:55.436670 systemd[1]: Reload requested from client PID 1217 ('systemctl') (unit ensure-sysext.service)... Jun 20 19:47:55.436684 systemd[1]: Reloading... Jun 20 19:47:55.442342 systemd-tmpfiles[1218]: /usr/lib/tmpfiles.d/nfs-utils.conf:6: Duplicate line for path "/var/lib/nfs/sm", ignoring. Jun 20 19:47:55.442397 systemd-tmpfiles[1218]: /usr/lib/tmpfiles.d/nfs-utils.conf:7: Duplicate line for path "/var/lib/nfs/sm.bak", ignoring. Jun 20 19:47:55.442862 systemd-tmpfiles[1218]: /usr/lib/tmpfiles.d/provision.conf:20: Duplicate line for path "/root", ignoring. Jun 20 19:47:55.444846 systemd-tmpfiles[1218]: /usr/lib/tmpfiles.d/systemd-flatcar.conf:6: Duplicate line for path "/var/log/journal", ignoring. Jun 20 19:47:55.446339 systemd-tmpfiles[1218]: /usr/lib/tmpfiles.d/systemd.conf:29: Duplicate line for path "/var/lib/systemd", ignoring. Jun 20 19:47:55.446884 systemd-tmpfiles[1218]: ACLs are not supported, ignoring. Jun 20 19:47:55.446989 systemd-tmpfiles[1218]: ACLs are not supported, ignoring. Jun 20 19:47:55.457119 systemd-tmpfiles[1218]: Detected autofs mount point /boot during canonicalization of boot. Jun 20 19:47:55.457137 systemd-tmpfiles[1218]: Skipping /boot Jun 20 19:47:55.487820 systemd-tmpfiles[1218]: Detected autofs mount point /boot during canonicalization of boot. Jun 20 19:47:55.487832 systemd-tmpfiles[1218]: Skipping /boot Jun 20 19:47:55.535697 zram_generator::config[1246]: No configuration found. Jun 20 19:47:55.673365 systemd[1]: /usr/lib/systemd/system/docker.socket:6: ListenStream= references a path below legacy directory /var/run/, updating /var/run/docker.sock → /run/docker.sock; please update the unit file accordingly. Jun 20 19:47:55.782946 systemd[1]: etc-machine\x2did.mount: Deactivated successfully. Jun 20 19:47:55.783276 systemd[1]: Reloading finished in 346 ms. Jun 20 19:47:55.824743 systemd[1]: Finished systemd-tmpfiles-setup.service - Create System Files and Directories. Jun 20 19:47:55.834730 systemd[1]: Starting audit-rules.service - Load Audit Rules... Jun 20 19:47:55.838769 systemd[1]: Starting clean-ca-certificates.service - Clean up broken links in /etc/ssl/certs... Jun 20 19:47:55.845471 systemd[1]: Starting systemd-journal-catalog-update.service - Rebuild Journal Catalog... Jun 20 19:47:55.852720 systemd[1]: Starting systemd-resolved.service - Network Name Resolution... Jun 20 19:47:55.856111 systemd[1]: Starting systemd-update-utmp.service - Record System Boot/Shutdown in UTMP... Jun 20 19:47:55.866239 systemd[1]: proc-xen.mount - /proc/xen was skipped because of an unmet condition check (ConditionVirtualization=xen). Jun 20 19:47:55.866436 systemd[1]: ignition-delete-config.service - Ignition (delete config) was skipped because no trigger condition checks were met. Jun 20 19:47:55.871835 systemd[1]: Starting modprobe@dm_mod.service - Load Kernel Module dm_mod... Jun 20 19:47:55.878688 systemd[1]: Starting modprobe@efi_pstore.service - Load Kernel Module efi_pstore... Jun 20 19:47:55.888651 systemd[1]: Starting modprobe@loop.service - Load Kernel Module loop... Jun 20 19:47:55.889738 systemd[1]: systemd-binfmt.service - Set Up Additional Binary Formats was skipped because no trigger condition checks were met. Jun 20 19:47:55.890663 systemd[1]: systemd-hibernate-clear.service - Clear Stale Hibernate Storage Info was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67). Jun 20 19:47:55.890798 systemd[1]: xenserver-pv-version.service - Set fake PV driver version for XenServer was skipped because of an unmet condition check (ConditionVirtualization=xen). Jun 20 19:47:55.893629 systemd[1]: modprobe@efi_pstore.service: Deactivated successfully. Jun 20 19:47:55.893832 systemd[1]: Finished modprobe@efi_pstore.service - Load Kernel Module efi_pstore. Jun 20 19:47:55.894885 systemd[1]: modprobe@dm_mod.service: Deactivated successfully. Jun 20 19:47:55.895625 systemd[1]: Finished modprobe@dm_mod.service - Load Kernel Module dm_mod. Jun 20 19:47:55.904654 systemd[1]: proc-xen.mount - /proc/xen was skipped because of an unmet condition check (ConditionVirtualization=xen). Jun 20 19:47:55.904840 systemd[1]: ignition-delete-config.service - Ignition (delete config) was skipped because no trigger condition checks were met. Jun 20 19:47:55.908187 systemd[1]: Starting modprobe@dm_mod.service - Load Kernel Module dm_mod... Jun 20 19:47:55.911343 systemd[1]: Starting modprobe@efi_pstore.service - Load Kernel Module efi_pstore... Jun 20 19:47:55.912720 systemd[1]: systemd-binfmt.service - Set Up Additional Binary Formats was skipped because no trigger condition checks were met. Jun 20 19:47:55.912846 systemd[1]: systemd-hibernate-clear.service - Clear Stale Hibernate Storage Info was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67). Jun 20 19:47:55.927440 systemd[1]: Starting systemd-userdbd.service - User Database Manager... Jun 20 19:47:55.928609 systemd[1]: xenserver-pv-version.service - Set fake PV driver version for XenServer was skipped because of an unmet condition check (ConditionVirtualization=xen). Jun 20 19:47:55.930537 systemd[1]: modprobe@loop.service: Deactivated successfully. Jun 20 19:47:55.930842 systemd[1]: Finished modprobe@loop.service - Load Kernel Module loop. Jun 20 19:47:55.931990 systemd[1]: modprobe@dm_mod.service: Deactivated successfully. Jun 20 19:47:55.936951 systemd[1]: Finished modprobe@dm_mod.service - Load Kernel Module dm_mod. Jun 20 19:47:55.940190 systemd[1]: modprobe@efi_pstore.service: Deactivated successfully. Jun 20 19:47:55.940360 systemd[1]: Finished modprobe@efi_pstore.service - Load Kernel Module efi_pstore. Jun 20 19:47:55.951960 systemd[1]: systemd-pstore.service - Platform Persistent Storage Archival was skipped because of an unmet condition check (ConditionDirectoryNotEmpty=/sys/fs/pstore). Jun 20 19:47:55.952182 systemd[1]: systemd-repart.service - Repartition Root Disk was skipped because no trigger condition checks were met. Jun 20 19:47:55.955093 systemd[1]: Finished systemd-update-utmp.service - Record System Boot/Shutdown in UTMP. Jun 20 19:47:55.967062 systemd[1]: Finished systemd-journal-catalog-update.service - Rebuild Journal Catalog. Jun 20 19:47:55.970162 systemd[1]: proc-xen.mount - /proc/xen was skipped because of an unmet condition check (ConditionVirtualization=xen). Jun 20 19:47:55.974910 systemd[1]: ignition-delete-config.service - Ignition (delete config) was skipped because no trigger condition checks were met. Jun 20 19:47:55.976528 systemd[1]: Starting modprobe@dm_mod.service - Load Kernel Module dm_mod... Jun 20 19:47:55.983021 systemd[1]: Starting modprobe@drm.service - Load Kernel Module drm... Jun 20 19:47:55.987169 systemd[1]: Starting modprobe@efi_pstore.service - Load Kernel Module efi_pstore... Jun 20 19:47:55.991125 systemd[1]: Starting modprobe@loop.service - Load Kernel Module loop... Jun 20 19:47:55.991908 systemd[1]: systemd-binfmt.service - Set Up Additional Binary Formats was skipped because no trigger condition checks were met. Jun 20 19:47:55.991957 systemd[1]: systemd-hibernate-clear.service - Clear Stale Hibernate Storage Info was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67). Jun 20 19:47:55.992066 systemd[1]: xenserver-pv-version.service - Set fake PV driver version for XenServer was skipped because of an unmet condition check (ConditionVirtualization=xen). Jun 20 19:47:55.993201 systemd[1]: Finished ensure-sysext.service. Jun 20 19:47:56.001169 systemd[1]: Starting systemd-timesyncd.service - Network Time Synchronization... Jun 20 19:47:56.021030 systemd[1]: modprobe@dm_mod.service: Deactivated successfully. Jun 20 19:47:56.021277 systemd[1]: Finished modprobe@dm_mod.service - Load Kernel Module dm_mod. Jun 20 19:47:56.026737 systemd[1]: Finished clean-ca-certificates.service - Clean up broken links in /etc/ssl/certs. Jun 20 19:47:56.028915 systemd[1]: modprobe@efi_pstore.service: Deactivated successfully. Jun 20 19:47:56.031763 systemd[1]: Finished modprobe@efi_pstore.service - Load Kernel Module efi_pstore. Jun 20 19:47:56.033158 systemd[1]: systemd-pstore.service - Platform Persistent Storage Archival was skipped because of an unmet condition check (ConditionDirectoryNotEmpty=/sys/fs/pstore). Jun 20 19:47:56.033203 systemd[1]: update-ca-certificates.service - Update CA bundle at /etc/ssl/certs/ca-certificates.crt was skipped because of an unmet condition check (ConditionPathIsSymbolicLink=!/etc/ssl/certs/ca-certificates.crt). Jun 20 19:47:56.034409 systemd[1]: modprobe@loop.service: Deactivated successfully. Jun 20 19:47:56.035964 systemd[1]: Finished modprobe@loop.service - Load Kernel Module loop. Jun 20 19:47:56.036880 systemd[1]: modprobe@drm.service: Deactivated successfully. Jun 20 19:47:56.037112 systemd[1]: Finished modprobe@drm.service - Load Kernel Module drm. Jun 20 19:47:56.038383 systemd[1]: systemd-repart.service - Repartition Root Disk was skipped because no trigger condition checks were met. Jun 20 19:47:56.051605 augenrules[1352]: No rules Jun 20 19:47:56.052479 systemd[1]: audit-rules.service: Deactivated successfully. Jun 20 19:47:56.052858 systemd[1]: Finished audit-rules.service - Load Audit Rules. Jun 20 19:47:56.081067 systemd[1]: Started systemd-userdbd.service - User Database Manager. Jun 20 19:47:56.222544 systemd[1]: Started systemd-timesyncd.service - Network Time Synchronization. Jun 20 19:47:56.223404 systemd[1]: Reached target time-set.target - System Time Set. Jun 20 19:47:56.232611 systemd-resolved[1306]: Positive Trust Anchors: Jun 20 19:47:56.232623 systemd-resolved[1306]: . IN DS 20326 8 2 e06d44b80b8f1d39a95c0b0d7c65d08458e880409bbc683457104237c7f8ec8d Jun 20 19:47:56.232667 systemd-resolved[1306]: Negative trust anchors: home.arpa 10.in-addr.arpa 16.172.in-addr.arpa 17.172.in-addr.arpa 18.172.in-addr.arpa 19.172.in-addr.arpa 20.172.in-addr.arpa 21.172.in-addr.arpa 22.172.in-addr.arpa 23.172.in-addr.arpa 24.172.in-addr.arpa 25.172.in-addr.arpa 26.172.in-addr.arpa 27.172.in-addr.arpa 28.172.in-addr.arpa 29.172.in-addr.arpa 30.172.in-addr.arpa 31.172.in-addr.arpa 170.0.0.192.in-addr.arpa 171.0.0.192.in-addr.arpa 168.192.in-addr.arpa d.f.ip6.arpa ipv4only.arpa resolver.arpa corp home internal intranet lan local private test Jun 20 19:47:56.241542 systemd-resolved[1306]: Using system hostname 'ci-4344-1-0-0-f744bc33cd.novalocal'. Jun 20 19:47:56.242996 systemd[1]: Started systemd-resolved.service - Network Name Resolution. Jun 20 19:47:56.243700 systemd[1]: Reached target nss-lookup.target - Host and Network Name Lookups. Jun 20 19:47:56.421452 systemd[1]: Finished systemd-hwdb-update.service - Rebuild Hardware Database. Jun 20 19:47:56.436285 systemd[1]: Starting systemd-udevd.service - Rule-based Manager for Device Events and Files... Jun 20 19:47:56.473378 systemd-udevd[1367]: Using default interface naming scheme 'v255'. Jun 20 19:47:56.490974 ldconfig[1182]: /sbin/ldconfig: /usr/lib/ld.so.conf is not an ELF file - it has the wrong magic bytes at the start. Jun 20 19:47:56.502912 systemd[1]: Finished ldconfig.service - Rebuild Dynamic Linker Cache. Jun 20 19:47:56.507692 systemd[1]: Starting systemd-update-done.service - Update is Completed... Jun 20 19:47:56.523943 systemd[1]: Started systemd-udevd.service - Rule-based Manager for Device Events and Files. Jun 20 19:47:56.529776 systemd[1]: Starting systemd-networkd.service - Network Configuration... Jun 20 19:47:56.541931 systemd[1]: Finished systemd-update-done.service - Update is Completed. Jun 20 19:47:56.542755 systemd[1]: Reached target sysinit.target - System Initialization. Jun 20 19:47:56.543360 systemd[1]: Started motdgen.path - Watch for update engine configuration changes. Jun 20 19:47:56.543963 systemd[1]: Started user-cloudinit@var-lib-flatcar\x2dinstall-user_data.path - Watch for a cloud-config at /var/lib/flatcar-install/user_data. Jun 20 19:47:56.544517 systemd[1]: Started google-oslogin-cache.timer - NSS cache refresh timer. Jun 20 19:47:56.545356 systemd[1]: Started logrotate.timer - Daily rotation of log files. Jun 20 19:47:56.545974 systemd[1]: Started mdadm.timer - Weekly check for MD array's redundancy information.. Jun 20 19:47:56.547228 systemd[1]: Started systemd-tmpfiles-clean.timer - Daily Cleanup of Temporary Directories. Jun 20 19:47:56.547840 systemd[1]: update-engine-stub.timer - Update Engine Stub Timer was skipped because of an unmet condition check (ConditionPathExists=/usr/.noupdate). Jun 20 19:47:56.547878 systemd[1]: Reached target paths.target - Path Units. Jun 20 19:47:56.548646 systemd[1]: Reached target timers.target - Timer Units. Jun 20 19:47:56.551054 systemd[1]: Listening on dbus.socket - D-Bus System Message Bus Socket. Jun 20 19:47:56.553972 systemd[1]: Starting docker.socket - Docker Socket for the API... Jun 20 19:47:56.560318 systemd[1]: Listening on sshd-unix-local.socket - OpenSSH Server Socket (systemd-ssh-generator, AF_UNIX Local). Jun 20 19:47:56.562071 systemd[1]: Listening on sshd-vsock.socket - OpenSSH Server Socket (systemd-ssh-generator, AF_VSOCK). Jun 20 19:47:56.562673 systemd[1]: Reached target ssh-access.target - SSH Access Available. Jun 20 19:47:56.570506 systemd[1]: Listening on sshd.socket - OpenSSH Server Socket. Jun 20 19:47:56.572635 systemd[1]: Listening on systemd-hostnamed.socket - Hostname Service Socket. Jun 20 19:47:56.574029 systemd[1]: Listening on docker.socket - Docker Socket for the API. Jun 20 19:47:56.578069 systemd[1]: Reached target sockets.target - Socket Units. Jun 20 19:47:56.578769 systemd[1]: Reached target basic.target - Basic System. Jun 20 19:47:56.579726 systemd[1]: addon-config@oem.service - Configure Addon /oem was skipped because no trigger condition checks were met. Jun 20 19:47:56.579758 systemd[1]: addon-run@oem.service - Run Addon /oem was skipped because no trigger condition checks were met. Jun 20 19:47:56.583876 systemd[1]: Starting coreos-metadata-sshkeys@core.service - Flatcar Metadata Agent (SSH Keys)... Jun 20 19:47:56.587301 systemd[1]: Starting coreos-metadata.service - Flatcar Metadata Agent... Jun 20 19:47:56.591064 systemd[1]: Starting dbus.service - D-Bus System Message Bus... Jun 20 19:47:56.593153 systemd[1]: Starting dracut-shutdown.service - Restore /run/initramfs on shutdown... Jun 20 19:47:56.595098 systemd[1]: Starting enable-oem-cloudinit.service - Enable cloudinit... Jun 20 19:47:56.606117 systemd[1]: Starting extend-filesystems.service - Extend Filesystems... Jun 20 19:47:56.606747 systemd[1]: flatcar-setup-environment.service - Modifies /etc/environment for CoreOS was skipped because of an unmet condition check (ConditionPathExists=/oem/bin/flatcar-setup-environment). Jun 20 19:47:56.607771 systemd[1]: Starting google-oslogin-cache.service - NSS cache refresh... Jun 20 19:47:56.612868 systemd[1]: Starting motdgen.service - Generate /run/flatcar/motd... Jun 20 19:47:56.618769 systemd[1]: Starting ssh-key-proc-cmdline.service - Install an ssh key from /proc/cmdline... Jun 20 19:47:56.619825 jq[1403]: false Jun 20 19:47:56.628834 systemd[1]: Starting sshd-keygen.service - Generate sshd host keys... Jun 20 19:47:56.639933 systemd[1]: Starting systemd-logind.service - User Login Management... Jun 20 19:47:56.641360 systemd[1]: tcsd.service - TCG Core Services Daemon was skipped because of an unmet condition check (ConditionPathExists=/dev/tpm0). Jun 20 19:47:56.642825 systemd[1]: cgroup compatibility translation between legacy and unified hierarchy settings activated. See cgroup-compat debug messages for details. Jun 20 19:47:56.652716 google_oslogin_nss_cache[1405]: oslogin_cache_refresh[1405]: Refreshing passwd entry cache Jun 20 19:47:56.650599 systemd[1]: Starting update-engine.service - Update Engine... Jun 20 19:47:56.649624 oslogin_cache_refresh[1405]: Refreshing passwd entry cache Jun 20 19:47:56.653203 google_oslogin_nss_cache[1405]: oslogin_cache_refresh[1405]: Failure getting users, quitting Jun 20 19:47:56.653203 google_oslogin_nss_cache[1405]: oslogin_cache_refresh[1405]: Produced empty passwd cache file, removing /etc/oslogin_passwd.cache.bak. Jun 20 19:47:56.653203 google_oslogin_nss_cache[1405]: oslogin_cache_refresh[1405]: Refreshing group entry cache Jun 20 19:47:56.652996 oslogin_cache_refresh[1405]: Failure getting users, quitting Jun 20 19:47:56.653011 oslogin_cache_refresh[1405]: Produced empty passwd cache file, removing /etc/oslogin_passwd.cache.bak. Jun 20 19:47:56.653048 oslogin_cache_refresh[1405]: Refreshing group entry cache Jun 20 19:47:56.653530 google_oslogin_nss_cache[1405]: oslogin_cache_refresh[1405]: Failure getting groups, quitting Jun 20 19:47:56.653530 google_oslogin_nss_cache[1405]: oslogin_cache_refresh[1405]: Produced empty group cache file, removing /etc/oslogin_group.cache.bak. Jun 20 19:47:56.653519 oslogin_cache_refresh[1405]: Failure getting groups, quitting Jun 20 19:47:56.653527 oslogin_cache_refresh[1405]: Produced empty group cache file, removing /etc/oslogin_group.cache.bak. Jun 20 19:47:56.657870 systemd[1]: Starting update-ssh-keys-after-ignition.service - Run update-ssh-keys once after Ignition... Jun 20 19:47:56.671481 coreos-metadata[1399]: Jun 20 19:47:56.671 INFO Fetching http://169.254.169.254/openstack/2012-08-10/meta_data.json: Attempt #1 Jun 20 19:47:56.672283 coreos-metadata[1399]: Jun 20 19:47:56.671 INFO Failed to fetch: error sending request for url (http://169.254.169.254/openstack/2012-08-10/meta_data.json) Jun 20 19:47:56.676880 systemd[1]: Finished dracut-shutdown.service - Restore /run/initramfs on shutdown. Jun 20 19:47:56.677774 systemd[1]: enable-oem-cloudinit.service: Skipped due to 'exec-condition'. Jun 20 19:47:56.677937 systemd[1]: Condition check resulted in enable-oem-cloudinit.service - Enable cloudinit being skipped. Jun 20 19:47:56.678162 systemd[1]: google-oslogin-cache.service: Deactivated successfully. Jun 20 19:47:56.678313 systemd[1]: Finished google-oslogin-cache.service - NSS cache refresh. Jun 20 19:47:56.679100 systemd[1]: ssh-key-proc-cmdline.service: Deactivated successfully. Jun 20 19:47:56.679268 systemd[1]: Finished ssh-key-proc-cmdline.service - Install an ssh key from /proc/cmdline. Jun 20 19:47:56.707273 jq[1416]: true Jun 20 19:47:56.718044 extend-filesystems[1404]: Found /dev/vda6 Jun 20 19:47:56.723992 systemd[1]: motdgen.service: Deactivated successfully. Jun 20 19:47:56.724189 systemd[1]: Finished motdgen.service - Generate /run/flatcar/motd. Jun 20 19:47:56.727059 update_engine[1415]: I20250620 19:47:56.726996 1415 main.cc:92] Flatcar Update Engine starting Jun 20 19:47:56.731191 jq[1436]: true Jun 20 19:47:56.731734 extend-filesystems[1404]: Found /dev/vda9 Jun 20 19:47:56.733308 coreos-metadata[1398]: Jun 20 19:47:56.733 INFO Fetching http://169.254.169.254/latest/meta-data/public-keys: Attempt #1 Jun 20 19:47:56.733308 coreos-metadata[1398]: Jun 20 19:47:56.733 INFO Failed to fetch: error sending request for url (http://169.254.169.254/latest/meta-data/public-keys) Jun 20 19:47:56.742157 extend-filesystems[1404]: Checking size of /dev/vda9 Jun 20 19:47:56.745485 dbus-daemon[1401]: [system] SELinux support is enabled Jun 20 19:47:56.745667 systemd[1]: Started dbus.service - D-Bus System Message Bus. Jun 20 19:47:56.749019 update_engine[1415]: I20250620 19:47:56.748723 1415 update_check_scheduler.cc:74] Next update check in 7m37s Jun 20 19:47:56.749292 systemd[1]: system-cloudinit@usr-share-oem-cloud\x2dconfig.yml.service - Load cloud-config from /usr/share/oem/cloud-config.yml was skipped because of an unmet condition check (ConditionFileNotEmpty=/usr/share/oem/cloud-config.yml). Jun 20 19:47:56.749323 systemd[1]: Reached target system-config.target - Load system-provided cloud configs. Jun 20 19:47:56.750820 systemd[1]: user-cloudinit-proc-cmdline.service - Load cloud-config from url defined in /proc/cmdline was skipped because of an unmet condition check (ConditionKernelCommandLine=cloud-config-url). Jun 20 19:47:56.750835 systemd[1]: Reached target user-config.target - Load user-provided cloud configs. Jun 20 19:47:56.751505 systemd[1]: Started update-engine.service - Update Engine. Jun 20 19:47:56.755008 systemd[1]: Started locksmithd.service - Cluster reboot manager. Jun 20 19:47:56.780873 extend-filesystems[1404]: Resized partition /dev/vda9 Jun 20 19:47:56.790868 extend-filesystems[1458]: resize2fs 1.47.2 (1-Jan-2025) Jun 20 19:47:56.808601 kernel: EXT4-fs (vda9): resizing filesystem from 1617920 to 2014203 blocks Jun 20 19:47:56.812113 systemd[1]: Condition check resulted in dev-ttyS0.device - /dev/ttyS0 being skipped. Jun 20 19:47:56.816725 kernel: EXT4-fs (vda9): resized filesystem to 2014203 Jun 20 19:47:56.845772 extend-filesystems[1458]: Filesystem at /dev/vda9 is mounted on /; on-line resizing required Jun 20 19:47:56.845772 extend-filesystems[1458]: old_desc_blocks = 1, new_desc_blocks = 1 Jun 20 19:47:56.845772 extend-filesystems[1458]: The filesystem on /dev/vda9 is now 2014203 (4k) blocks long. Jun 20 19:47:56.850725 extend-filesystems[1404]: Resized filesystem in /dev/vda9 Jun 20 19:47:56.847827 systemd[1]: extend-filesystems.service: Deactivated successfully. Jun 20 19:47:56.848008 systemd[1]: Finished extend-filesystems.service - Extend Filesystems. Jun 20 19:47:56.857393 bash[1464]: Updated "/home/core/.ssh/authorized_keys" Jun 20 19:47:56.859922 systemd[1]: Finished update-ssh-keys-after-ignition.service - Run update-ssh-keys once after Ignition. Jun 20 19:47:56.863747 systemd[1]: Starting sshkeys.service... Jun 20 19:47:56.990326 systemd-networkd[1373]: lo: Link UP Jun 20 19:47:56.990335 systemd-networkd[1373]: lo: Gained carrier Jun 20 19:47:56.992544 systemd-networkd[1373]: Enumeration completed Jun 20 19:47:56.992672 systemd[1]: Started systemd-networkd.service - Network Configuration. Jun 20 19:47:56.994016 systemd[1]: Reached target network.target - Network. Jun 20 19:47:56.997067 systemd[1]: Starting containerd.service - containerd container runtime... Jun 20 19:47:57.004625 systemd[1]: Starting systemd-networkd-persistent-storage.service - Enable Persistent Storage in systemd-networkd... Jun 20 19:47:57.007885 systemd[1]: Starting systemd-networkd-wait-online.service - Wait for Network to be Configured... Jun 20 19:47:57.028701 systemd-logind[1414]: New seat seat0. Jun 20 19:47:57.030937 systemd[1]: Started systemd-logind.service - User Login Management. Jun 20 19:47:57.046024 systemd[1]: Finished systemd-networkd-persistent-storage.service - Enable Persistent Storage in systemd-networkd. Jun 20 19:47:57.069947 (ntainerd)[1486]: containerd.service: Referenced but unset environment variable evaluates to an empty string: TORCX_IMAGEDIR, TORCX_UNPACKDIR Jun 20 19:47:57.086047 systemd[1]: Found device dev-disk-by\x2dlabel-OEM.device - /dev/disk/by-label/OEM. Jun 20 19:47:57.095926 locksmithd[1446]: locksmithd starting currentOperation="UPDATE_STATUS_IDLE" strategy="reboot" Jun 20 19:47:57.096095 systemd[1]: Starting systemd-fsck@dev-disk-by\x2dlabel-OEM.service - File System Check on /dev/disk/by-label/OEM... Jun 20 19:47:57.110484 systemd-networkd[1373]: eth0: found matching network '/usr/lib/systemd/network/zz-default.network', based on potentially unpredictable interface name. Jun 20 19:47:57.111812 systemd-networkd[1373]: eth0: Configuring with /usr/lib/systemd/network/zz-default.network. Jun 20 19:47:57.114791 systemd-networkd[1373]: eth0: Link UP Jun 20 19:47:57.114971 systemd-networkd[1373]: eth0: Gained carrier Jun 20 19:47:57.114987 systemd-networkd[1373]: eth0: found matching network '/usr/lib/systemd/network/zz-default.network', based on potentially unpredictable interface name. Jun 20 19:47:57.137635 systemd-networkd[1373]: eth0: DHCPv4 address 172.24.4.18/24, gateway 172.24.4.1 acquired from 172.24.4.1 Jun 20 19:47:57.142200 systemd-timesyncd[1343]: Network configuration changed, trying to establish connection. Jun 20 19:47:57.157125 systemd[1]: Finished systemd-fsck@dev-disk-by\x2dlabel-OEM.service - File System Check on /dev/disk/by-label/OEM. Jun 20 19:47:57.166603 kernel: mousedev: PS/2 mouse device common for all mice Jun 20 19:47:57.188697 kernel: input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 Jun 20 19:47:57.196307 kernel: ACPI: button: Power Button [PWRF] Jun 20 19:47:57.214426 kernel: piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 Jun 20 19:47:57.214734 kernel: i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD Jun 20 19:47:57.379017 kernel: [drm] pci: virtio-vga detected at 0000:00:02.0 Jun 20 19:47:57.379071 kernel: virtio-pci 0000:00:02.0: vgaarb: deactivate vga console Jun 20 19:47:57.390606 kernel: Console: switching to colour dummy device 80x25 Jun 20 19:47:57.391705 kernel: [drm] features: -virgl +edid -resource_blob -host_visible Jun 20 19:47:57.391756 kernel: [drm] features: -context_init Jun 20 19:47:57.416781 systemd[1]: Starting systemd-vconsole-setup.service - Virtual Console Setup... Jun 20 19:47:57.435207 systemd-logind[1414]: Watching system buttons on /dev/input/event2 (Power Button) Jun 20 19:47:57.441712 systemd-logind[1414]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) Jun 20 19:47:57.450753 containerd[1486]: time="2025-06-20T19:47:57Z" level=warning msg="Ignoring unknown key in TOML" column=1 error="strict mode: fields in the document are missing in the target struct" file=/usr/share/containerd/config.toml key=subreaper row=8 Jun 20 19:47:57.456506 containerd[1486]: time="2025-06-20T19:47:57.455905867Z" level=info msg="starting containerd" revision=06b99ca80cdbfbc6cc8bd567021738c9af2b36ce version=v2.0.4 Jun 20 19:47:57.470857 systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. Jun 20 19:47:57.472617 systemd[1]: Stopped systemd-vconsole-setup.service - Virtual Console Setup. Jun 20 19:47:57.475423 systemd[1]: run-credentials-systemd\x2dvconsole\x2dsetup.service.mount: Deactivated successfully. Jun 20 19:47:57.485972 systemd[1]: Starting systemd-vconsole-setup.service - Virtual Console Setup... Jun 20 19:47:57.501592 kernel: [drm] number of scanouts: 1 Jun 20 19:47:57.519604 kernel: [drm] number of cap sets: 0 Jun 20 19:47:57.524811 kernel: [drm] Initialized virtio_gpu 0.1.0 for 0000:00:02.0 on minor 0 Jun 20 19:47:57.547893 containerd[1486]: time="2025-06-20T19:47:57.547313993Z" level=warning msg="Configuration migrated from version 2, use `containerd config migrate` to avoid migration" t="10.86µs" Jun 20 19:47:57.547893 containerd[1486]: time="2025-06-20T19:47:57.547351574Z" level=info msg="loading plugin" id=io.containerd.image-verifier.v1.bindir type=io.containerd.image-verifier.v1 Jun 20 19:47:57.547893 containerd[1486]: time="2025-06-20T19:47:57.547372132Z" level=info msg="loading plugin" id=io.containerd.internal.v1.opt type=io.containerd.internal.v1 Jun 20 19:47:57.547893 containerd[1486]: time="2025-06-20T19:47:57.547522284Z" level=info msg="loading plugin" id=io.containerd.warning.v1.deprecations type=io.containerd.warning.v1 Jun 20 19:47:57.547893 containerd[1486]: time="2025-06-20T19:47:57.547539456Z" level=info msg="loading plugin" id=io.containerd.content.v1.content type=io.containerd.content.v1 Jun 20 19:47:57.547893 containerd[1486]: time="2025-06-20T19:47:57.547591684Z" level=info msg="loading plugin" id=io.containerd.snapshotter.v1.blockfile type=io.containerd.snapshotter.v1 Jun 20 19:47:57.547893 containerd[1486]: time="2025-06-20T19:47:57.547658219Z" level=info msg="skip loading plugin" error="no scratch file generator: skip plugin" id=io.containerd.snapshotter.v1.blockfile type=io.containerd.snapshotter.v1 Jun 20 19:47:57.547893 containerd[1486]: time="2025-06-20T19:47:57.547672014Z" level=info msg="loading plugin" id=io.containerd.snapshotter.v1.btrfs type=io.containerd.snapshotter.v1 Jun 20 19:47:57.547893 containerd[1486]: time="2025-06-20T19:47:57.547875256Z" level=info msg="skip loading plugin" error="path /var/lib/containerd/io.containerd.snapshotter.v1.btrfs (ext4) must be a btrfs filesystem to be used with the btrfs snapshotter: skip plugin" id=io.containerd.snapshotter.v1.btrfs type=io.containerd.snapshotter.v1 Jun 20 19:47:57.547893 containerd[1486]: time="2025-06-20T19:47:57.547892889Z" level=info msg="loading plugin" id=io.containerd.snapshotter.v1.devmapper type=io.containerd.snapshotter.v1 Jun 20 19:47:57.548151 containerd[1486]: time="2025-06-20T19:47:57.547905272Z" level=info msg="skip loading plugin" error="devmapper not configured: skip plugin" id=io.containerd.snapshotter.v1.devmapper type=io.containerd.snapshotter.v1 Jun 20 19:47:57.548151 containerd[1486]: time="2025-06-20T19:47:57.547914730Z" level=info msg="loading plugin" id=io.containerd.snapshotter.v1.native type=io.containerd.snapshotter.v1 Jun 20 19:47:57.548151 containerd[1486]: time="2025-06-20T19:47:57.547994690Z" level=info msg="loading plugin" id=io.containerd.snapshotter.v1.overlayfs type=io.containerd.snapshotter.v1 Jun 20 19:47:57.548217 containerd[1486]: time="2025-06-20T19:47:57.548184696Z" level=info msg="loading plugin" id=io.containerd.snapshotter.v1.zfs type=io.containerd.snapshotter.v1 Jun 20 19:47:57.548239 containerd[1486]: time="2025-06-20T19:47:57.548214893Z" level=info msg="skip loading plugin" error="lstat /var/lib/containerd/io.containerd.snapshotter.v1.zfs: no such file or directory: skip plugin" id=io.containerd.snapshotter.v1.zfs type=io.containerd.snapshotter.v1 Jun 20 19:47:57.548239 containerd[1486]: time="2025-06-20T19:47:57.548227106Z" level=info msg="loading plugin" id=io.containerd.event.v1.exchange type=io.containerd.event.v1 Jun 20 19:47:57.548279 containerd[1486]: time="2025-06-20T19:47:57.548250409Z" level=info msg="loading plugin" id=io.containerd.monitor.task.v1.cgroups type=io.containerd.monitor.task.v1 Jun 20 19:47:57.548787 containerd[1486]: time="2025-06-20T19:47:57.548460573Z" level=info msg="loading plugin" id=io.containerd.metadata.v1.bolt type=io.containerd.metadata.v1 Jun 20 19:47:57.548787 containerd[1486]: time="2025-06-20T19:47:57.548524704Z" level=info msg="metadata content store policy set" policy=shared Jun 20 19:47:57.560886 containerd[1486]: time="2025-06-20T19:47:57.559490300Z" level=info msg="loading plugin" id=io.containerd.gc.v1.scheduler type=io.containerd.gc.v1 Jun 20 19:47:57.560886 containerd[1486]: time="2025-06-20T19:47:57.559531226Z" level=info msg="loading plugin" id=io.containerd.differ.v1.walking type=io.containerd.differ.v1 Jun 20 19:47:57.560886 containerd[1486]: time="2025-06-20T19:47:57.559546926Z" level=info msg="loading plugin" id=io.containerd.lease.v1.manager type=io.containerd.lease.v1 Jun 20 19:47:57.560886 containerd[1486]: time="2025-06-20T19:47:57.559560541Z" level=info msg="loading plugin" id=io.containerd.service.v1.containers-service type=io.containerd.service.v1 Jun 20 19:47:57.560886 containerd[1486]: time="2025-06-20T19:47:57.559589245Z" level=info msg="loading plugin" id=io.containerd.service.v1.content-service type=io.containerd.service.v1 Jun 20 19:47:57.560886 containerd[1486]: time="2025-06-20T19:47:57.559600687Z" level=info msg="loading plugin" id=io.containerd.service.v1.diff-service type=io.containerd.service.v1 Jun 20 19:47:57.560886 containerd[1486]: time="2025-06-20T19:47:57.559615785Z" level=info msg="loading plugin" id=io.containerd.service.v1.images-service type=io.containerd.service.v1 Jun 20 19:47:57.560886 containerd[1486]: time="2025-06-20T19:47:57.559629030Z" level=info msg="loading plugin" id=io.containerd.service.v1.introspection-service type=io.containerd.service.v1 Jun 20 19:47:57.560886 containerd[1486]: time="2025-06-20T19:47:57.559640201Z" level=info msg="loading plugin" id=io.containerd.service.v1.namespaces-service type=io.containerd.service.v1 Jun 20 19:47:57.560886 containerd[1486]: time="2025-06-20T19:47:57.559650741Z" level=info msg="loading plugin" id=io.containerd.service.v1.snapshots-service type=io.containerd.service.v1 Jun 20 19:47:57.560886 containerd[1486]: time="2025-06-20T19:47:57.559662422Z" level=info msg="loading plugin" id=io.containerd.shim.v1.manager type=io.containerd.shim.v1 Jun 20 19:47:57.560886 containerd[1486]: time="2025-06-20T19:47:57.559684344Z" level=info msg="loading plugin" id=io.containerd.runtime.v2.task type=io.containerd.runtime.v2 Jun 20 19:47:57.560886 containerd[1486]: time="2025-06-20T19:47:57.559771657Z" level=info msg="loading plugin" id=io.containerd.service.v1.tasks-service type=io.containerd.service.v1 Jun 20 19:47:57.560886 containerd[1486]: time="2025-06-20T19:47:57.559794280Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.containers type=io.containerd.grpc.v1 Jun 20 19:47:57.561205 containerd[1486]: time="2025-06-20T19:47:57.559811662Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.content type=io.containerd.grpc.v1 Jun 20 19:47:57.561205 containerd[1486]: time="2025-06-20T19:47:57.559823044Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.diff type=io.containerd.grpc.v1 Jun 20 19:47:57.561205 containerd[1486]: time="2025-06-20T19:47:57.559834836Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.events type=io.containerd.grpc.v1 Jun 20 19:47:57.561205 containerd[1486]: time="2025-06-20T19:47:57.559846017Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.images type=io.containerd.grpc.v1 Jun 20 19:47:57.561205 containerd[1486]: time="2025-06-20T19:47:57.559864241Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.introspection type=io.containerd.grpc.v1 Jun 20 19:47:57.561205 containerd[1486]: time="2025-06-20T19:47:57.559876173Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.leases type=io.containerd.grpc.v1 Jun 20 19:47:57.561205 containerd[1486]: time="2025-06-20T19:47:57.559888006Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.namespaces type=io.containerd.grpc.v1 Jun 20 19:47:57.561205 containerd[1486]: time="2025-06-20T19:47:57.559899517Z" level=info msg="loading plugin" id=io.containerd.sandbox.store.v1.local type=io.containerd.sandbox.store.v1 Jun 20 19:47:57.561205 containerd[1486]: time="2025-06-20T19:47:57.559912211Z" level=info msg="loading plugin" id=io.containerd.cri.v1.images type=io.containerd.cri.v1 Jun 20 19:47:57.561205 containerd[1486]: time="2025-06-20T19:47:57.559966503Z" level=info msg="Get image filesystem path \"/var/lib/containerd/io.containerd.snapshotter.v1.overlayfs\" for snapshotter \"overlayfs\"" Jun 20 19:47:57.561205 containerd[1486]: time="2025-06-20T19:47:57.559980900Z" level=info msg="Start snapshots syncer" Jun 20 19:47:57.561205 containerd[1486]: time="2025-06-20T19:47:57.560000467Z" level=info msg="loading plugin" id=io.containerd.cri.v1.runtime type=io.containerd.cri.v1 Jun 20 19:47:57.561515 containerd[1486]: time="2025-06-20T19:47:57.560242651Z" level=info msg="starting cri plugin" config="{\"containerd\":{\"defaultRuntimeName\":\"runc\",\"runtimes\":{\"runc\":{\"runtimeType\":\"io.containerd.runc.v2\",\"runtimePath\":\"\",\"PodAnnotations\":null,\"ContainerAnnotations\":null,\"options\":{\"BinaryName\":\"\",\"CriuImagePath\":\"\",\"CriuWorkPath\":\"\",\"IoGid\":0,\"IoUid\":0,\"NoNewKeyring\":false,\"Root\":\"\",\"ShimCgroup\":\"\",\"SystemdCgroup\":true},\"privileged_without_host_devices\":false,\"privileged_without_host_devices_all_devices_allowed\":false,\"baseRuntimeSpec\":\"\",\"cniConfDir\":\"\",\"cniMaxConfNum\":0,\"snapshotter\":\"\",\"sandboxer\":\"podsandbox\",\"io_type\":\"\"}},\"ignoreBlockIONotEnabledErrors\":false,\"ignoreRdtNotEnabledErrors\":false},\"cni\":{\"binDir\":\"/opt/cni/bin\",\"confDir\":\"/etc/cni/net.d\",\"maxConfNum\":1,\"setupSerially\":false,\"confTemplate\":\"\",\"ipPref\":\"\",\"useInternalLoopback\":false},\"enableSelinux\":true,\"selinuxCategoryRange\":1024,\"maxContainerLogSize\":16384,\"disableApparmor\":false,\"restrictOOMScoreAdj\":false,\"disableProcMount\":false,\"unsetSeccompProfile\":\"\",\"tolerateMissingHugetlbController\":true,\"disableHugetlbController\":true,\"device_ownership_from_security_context\":false,\"ignoreImageDefinedVolumes\":false,\"netnsMountsUnderStateDir\":false,\"enableUnprivilegedPorts\":true,\"enableUnprivilegedICMP\":true,\"enableCDI\":true,\"cdiSpecDirs\":[\"/etc/cdi\",\"/var/run/cdi\"],\"drainExecSyncIOTimeout\":\"0s\",\"ignoreDeprecationWarnings\":null,\"containerdRootDir\":\"/var/lib/containerd\",\"containerdEndpoint\":\"/run/containerd/containerd.sock\",\"rootDir\":\"/var/lib/containerd/io.containerd.grpc.v1.cri\",\"stateDir\":\"/run/containerd/io.containerd.grpc.v1.cri\"}" Jun 20 19:47:57.561515 containerd[1486]: time="2025-06-20T19:47:57.560294438Z" level=info msg="loading plugin" id=io.containerd.podsandbox.controller.v1.podsandbox type=io.containerd.podsandbox.controller.v1 Jun 20 19:47:57.561671 containerd[1486]: time="2025-06-20T19:47:57.561597782Z" level=info msg="loading plugin" id=io.containerd.sandbox.controller.v1.shim type=io.containerd.sandbox.controller.v1 Jun 20 19:47:57.561699 containerd[1486]: time="2025-06-20T19:47:57.561684615Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.sandbox-controllers type=io.containerd.grpc.v1 Jun 20 19:47:57.561744 containerd[1486]: time="2025-06-20T19:47:57.561707728Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.sandboxes type=io.containerd.grpc.v1 Jun 20 19:47:57.561744 containerd[1486]: time="2025-06-20T19:47:57.561729890Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.snapshots type=io.containerd.grpc.v1 Jun 20 19:47:57.561797 containerd[1486]: time="2025-06-20T19:47:57.561743576Z" level=info msg="loading plugin" id=io.containerd.streaming.v1.manager type=io.containerd.streaming.v1 Jun 20 19:47:57.561797 containerd[1486]: time="2025-06-20T19:47:57.561756370Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.streaming type=io.containerd.grpc.v1 Jun 20 19:47:57.561797 containerd[1486]: time="2025-06-20T19:47:57.561772530Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.tasks type=io.containerd.grpc.v1 Jun 20 19:47:57.561797 containerd[1486]: time="2025-06-20T19:47:57.561784553Z" level=info msg="loading plugin" id=io.containerd.transfer.v1.local type=io.containerd.transfer.v1 Jun 20 19:47:57.561882 containerd[1486]: time="2025-06-20T19:47:57.561811984Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.transfer type=io.containerd.grpc.v1 Jun 20 19:47:57.561882 containerd[1486]: time="2025-06-20T19:47:57.561825209Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.version type=io.containerd.grpc.v1 Jun 20 19:47:57.561882 containerd[1486]: time="2025-06-20T19:47:57.561852029Z" level=info msg="loading plugin" id=io.containerd.monitor.container.v1.restart type=io.containerd.monitor.container.v1 Jun 20 19:47:57.566960 containerd[1486]: time="2025-06-20T19:47:57.562413813Z" level=info msg="loading plugin" id=io.containerd.tracing.processor.v1.otlp type=io.containerd.tracing.processor.v1 Jun 20 19:47:57.566960 containerd[1486]: time="2025-06-20T19:47:57.562443388Z" level=info msg="skip loading plugin" error="skip plugin: tracing endpoint not configured" id=io.containerd.tracing.processor.v1.otlp type=io.containerd.tracing.processor.v1 Jun 20 19:47:57.566960 containerd[1486]: time="2025-06-20T19:47:57.562453868Z" level=info msg="loading plugin" id=io.containerd.internal.v1.tracing type=io.containerd.internal.v1 Jun 20 19:47:57.566960 containerd[1486]: time="2025-06-20T19:47:57.562464868Z" level=info msg="skip loading plugin" error="skip plugin: tracing endpoint not configured" id=io.containerd.internal.v1.tracing type=io.containerd.internal.v1 Jun 20 19:47:57.566960 containerd[1486]: time="2025-06-20T19:47:57.562474206Z" level=info msg="loading plugin" id=io.containerd.ttrpc.v1.otelttrpc type=io.containerd.ttrpc.v1 Jun 20 19:47:57.566960 containerd[1486]: time="2025-06-20T19:47:57.562484215Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.healthcheck type=io.containerd.grpc.v1 Jun 20 19:47:57.566960 containerd[1486]: time="2025-06-20T19:47:57.562494795Z" level=info msg="loading plugin" id=io.containerd.nri.v1.nri type=io.containerd.nri.v1 Jun 20 19:47:57.566960 containerd[1486]: time="2025-06-20T19:47:57.562510835Z" level=info msg="runtime interface created" Jun 20 19:47:57.566960 containerd[1486]: time="2025-06-20T19:47:57.562516245Z" level=info msg="created NRI interface" Jun 20 19:47:57.566960 containerd[1486]: time="2025-06-20T19:47:57.562524621Z" level=info msg="loading plugin" id=io.containerd.grpc.v1.cri type=io.containerd.grpc.v1 Jun 20 19:47:57.566960 containerd[1486]: time="2025-06-20T19:47:57.562536132Z" level=info msg="Connect containerd service" Jun 20 19:47:57.566960 containerd[1486]: time="2025-06-20T19:47:57.562561219Z" level=info msg="using experimental NRI integration - disable nri plugin to prevent this" Jun 20 19:47:57.566960 containerd[1486]: time="2025-06-20T19:47:57.563155714Z" level=error msg="failed to load cni during init, please check CRI plugin status before setting up network for pods" error="cni config load failed: no network config found in /etc/cni/net.d: cni plugin not initialized: failed to load cni config" Jun 20 19:47:57.672644 coreos-metadata[1399]: Jun 20 19:47:57.671 INFO Fetching http://169.254.169.254/openstack/2012-08-10/meta_data.json: Attempt #2 Jun 20 19:47:57.675954 systemd[1]: Finished systemd-vconsole-setup.service - Virtual Console Setup. Jun 20 19:47:57.692127 coreos-metadata[1399]: Jun 20 19:47:57.692 INFO Fetch successful Jun 20 19:47:57.692205 coreos-metadata[1399]: Jun 20 19:47:57.692 INFO Fetching http://169.254.169.254/latest/meta-data/hostname: Attempt #1 Jun 20 19:47:57.706590 coreos-metadata[1399]: Jun 20 19:47:57.705 INFO Fetch successful Jun 20 19:47:57.706590 coreos-metadata[1399]: Jun 20 19:47:57.705 INFO Fetching http://169.254.169.254/latest/meta-data/instance-id: Attempt #1 Jun 20 19:47:57.717836 coreos-metadata[1399]: Jun 20 19:47:57.717 INFO Fetch successful Jun 20 19:47:57.717836 coreos-metadata[1399]: Jun 20 19:47:57.717 INFO Fetching http://169.254.169.254/latest/meta-data/instance-type: Attempt #1 Jun 20 19:47:57.726525 coreos-metadata[1399]: Jun 20 19:47:57.726 INFO Fetch successful Jun 20 19:47:57.726525 coreos-metadata[1399]: Jun 20 19:47:57.726 INFO Fetching http://169.254.169.254/latest/meta-data/local-ipv4: Attempt #1 Jun 20 19:47:57.734130 coreos-metadata[1398]: Jun 20 19:47:57.733 INFO Fetching http://169.254.169.254/latest/meta-data/public-keys: Attempt #2 Jun 20 19:47:57.737682 coreos-metadata[1399]: Jun 20 19:47:57.736 INFO Fetch successful Jun 20 19:47:57.737682 coreos-metadata[1399]: Jun 20 19:47:57.736 INFO Fetching http://169.254.169.254/latest/meta-data/public-ipv4: Attempt #1 Jun 20 19:47:57.747339 coreos-metadata[1398]: Jun 20 19:47:57.747 INFO Fetch successful Jun 20 19:47:57.747339 coreos-metadata[1398]: Jun 20 19:47:57.747 INFO Fetching http://169.254.169.254/latest/meta-data/public-keys/0/openssh-key: Attempt #1 Jun 20 19:47:57.750531 coreos-metadata[1399]: Jun 20 19:47:57.749 INFO Fetch successful Jun 20 19:47:57.757485 coreos-metadata[1398]: Jun 20 19:47:57.757 INFO Fetch successful Jun 20 19:47:57.772014 unknown[1398]: wrote ssh authorized keys file for user: core Jun 20 19:47:57.775108 containerd[1486]: time="2025-06-20T19:47:57.775020967Z" level=info msg="Start subscribing containerd event" Jun 20 19:47:57.775183 containerd[1486]: time="2025-06-20T19:47:57.775150280Z" level=info msg="Start recovering state" Jun 20 19:47:57.775476 containerd[1486]: time="2025-06-20T19:47:57.775444963Z" level=info msg="Start event monitor" Jun 20 19:47:57.775476 containerd[1486]: time="2025-06-20T19:47:57.775468928Z" level=info msg="Start cni network conf syncer for default" Jun 20 19:47:57.775555 containerd[1486]: time="2025-06-20T19:47:57.775483565Z" level=info msg="Start streaming server" Jun 20 19:47:57.779114 containerd[1486]: time="2025-06-20T19:47:57.775498954Z" level=info msg="Registered namespace \"k8s.io\" with NRI" Jun 20 19:47:57.779114 containerd[1486]: time="2025-06-20T19:47:57.778833848Z" level=info msg="runtime interface starting up..." Jun 20 19:47:57.779114 containerd[1486]: time="2025-06-20T19:47:57.778845270Z" level=info msg="starting plugins..." Jun 20 19:47:57.779114 containerd[1486]: time="2025-06-20T19:47:57.778862713Z" level=info msg="Synchronizing NRI (plugin) with current runtime state" Jun 20 19:47:57.779114 containerd[1486]: time="2025-06-20T19:47:57.778738991Z" level=info msg=serving... address=/run/containerd/containerd.sock.ttrpc Jun 20 19:47:57.779114 containerd[1486]: time="2025-06-20T19:47:57.778988408Z" level=info msg=serving... address=/run/containerd/containerd.sock Jun 20 19:47:57.779644 containerd[1486]: time="2025-06-20T19:47:57.779615815Z" level=info msg="containerd successfully booted in 0.329219s" Jun 20 19:47:57.779732 systemd[1]: Started containerd.service - containerd container runtime. Jun 20 19:47:57.808561 systemd[1]: Finished coreos-metadata.service - Flatcar Metadata Agent. Jun 20 19:47:57.809506 systemd[1]: packet-phone-home.service - Report Success to Packet was skipped because no trigger condition checks were met. Jun 20 19:47:57.823094 update-ssh-keys[1538]: Updated "/home/core/.ssh/authorized_keys" Jun 20 19:47:57.824516 systemd[1]: Finished coreos-metadata-sshkeys@core.service - Flatcar Metadata Agent (SSH Keys). Jun 20 19:47:57.827731 systemd[1]: Finished sshkeys.service. Jun 20 19:47:57.837206 sshd_keygen[1439]: ssh-keygen: generating new host keys: RSA ECDSA ED25519 Jun 20 19:47:57.858318 systemd[1]: Finished sshd-keygen.service - Generate sshd host keys. Jun 20 19:47:57.860706 systemd[1]: Starting issuegen.service - Generate /run/issue... Jun 20 19:47:57.876335 systemd[1]: issuegen.service: Deactivated successfully. Jun 20 19:47:57.876626 systemd[1]: Finished issuegen.service - Generate /run/issue. Jun 20 19:47:57.878325 systemd[1]: Starting systemd-user-sessions.service - Permit User Sessions... Jun 20 19:47:57.901310 systemd[1]: Finished systemd-user-sessions.service - Permit User Sessions. Jun 20 19:47:57.903927 systemd[1]: Started getty@tty1.service - Getty on tty1. Jun 20 19:47:57.905920 systemd[1]: Started serial-getty@ttyS0.service - Serial Getty on ttyS0. Jun 20 19:47:57.906207 systemd[1]: Reached target getty.target - Login Prompts. Jun 20 19:47:58.118555 systemd[1]: Created slice system-sshd.slice - Slice /system/sshd. Jun 20 19:47:58.121927 systemd[1]: Started sshd@0-172.24.4.18:22-172.24.4.1:44296.service - OpenSSH per-connection server daemon (172.24.4.1:44296). Jun 20 19:47:58.863877 systemd-networkd[1373]: eth0: Gained IPv6LL Jun 20 19:47:58.864550 systemd-timesyncd[1343]: Network configuration changed, trying to establish connection. Jun 20 19:47:58.866333 systemd[1]: Finished systemd-networkd-wait-online.service - Wait for Network to be Configured. Jun 20 19:47:58.869183 systemd[1]: Reached target network-online.target - Network is Online. Jun 20 19:47:58.873043 systemd[1]: Starting etcd-member.service - etcd (System Application Container)... Jun 20 19:47:58.877022 systemd[1]: Starting nvidia.service - NVIDIA Configure Service... Jun 20 19:47:58.889332 (-wrapper)[1562]: etcd-member.service: Referenced but unset environment variable evaluates to an empty string: ETCD_OPTS Jun 20 19:47:58.916729 systemd[1]: Finished nvidia.service - NVIDIA Configure Service. Jun 20 19:47:59.207259 systemd[1]: Starting docker.service - Docker Application Container Engine... Jun 20 19:47:59.214617 sshd[1559]: Accepted publickey for core from 172.24.4.1 port 44296 ssh2: RSA SHA256:LYn+fusd8YWkzHw8aAHCykt0zs9fuaIug0oT7GKHECY Jun 20 19:47:59.214844 (dockerd)[1581]: docker.service: Referenced but unset environment variable evaluates to an empty string: DOCKER_CGROUPS, DOCKER_OPTS, DOCKER_OPT_BIP, DOCKER_OPT_IPMASQ, DOCKER_OPT_MTU Jun 20 19:47:59.219143 sshd-session[1559]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Jun 20 19:47:59.234383 systemd[1]: Created slice user-500.slice - User Slice of UID 500. Jun 20 19:47:59.237115 systemd[1]: Starting user-runtime-dir@500.service - User Runtime Directory /run/user/500... Jun 20 19:47:59.259597 systemd-logind[1414]: New session 1 of user core. Jun 20 19:47:59.284141 systemd[1]: Finished user-runtime-dir@500.service - User Runtime Directory /run/user/500. Jun 20 19:47:59.290225 systemd[1]: Starting user@500.service - User Manager for UID 500... Jun 20 19:47:59.310899 (systemd)[1584]: pam_unix(systemd-user:session): session opened for user core(uid=500) by (uid=0) Jun 20 19:47:59.315049 systemd-logind[1414]: New session c1 of user core. Jun 20 19:47:59.486677 systemd[1584]: Queued start job for default target default.target. Jun 20 19:47:59.491470 systemd[1584]: Created slice app.slice - User Application Slice. Jun 20 19:47:59.491497 systemd[1584]: Reached target paths.target - Paths. Jun 20 19:47:59.491538 systemd[1584]: Reached target timers.target - Timers. Jun 20 19:47:59.495256 systemd[1584]: Starting dbus.socket - D-Bus User Message Bus Socket... Jun 20 19:47:59.504656 systemd[1584]: Listening on dbus.socket - D-Bus User Message Bus Socket. Jun 20 19:47:59.506085 systemd[1584]: Reached target sockets.target - Sockets. Jun 20 19:47:59.506237 systemd[1584]: Reached target basic.target - Basic System. Jun 20 19:47:59.506344 systemd[1584]: Reached target default.target - Main User Target. Jun 20 19:47:59.506361 systemd[1]: Started user@500.service - User Manager for UID 500. Jun 20 19:47:59.506495 systemd[1584]: Startup finished in 184ms. Jun 20 19:47:59.515740 systemd[1]: Started session-1.scope - Session 1 of User core. Jun 20 19:47:59.614371 dockerd[1581]: time="2025-06-20T19:47:59.614287802Z" level=info msg="Starting up" Jun 20 19:47:59.615931 dockerd[1581]: time="2025-06-20T19:47:59.615036967Z" level=info msg="OTEL tracing is not configured, using no-op tracer provider" Jun 20 19:47:59.665616 systemd[1]: var-lib-docker-check\x2doverlayfs\x2dsupport970988158-merged.mount: Deactivated successfully. Jun 20 19:47:59.739210 dockerd[1581]: time="2025-06-20T19:47:59.738830191Z" level=info msg="Loading containers: start." Jun 20 19:47:59.761642 kernel: Initializing XFRM netlink socket Jun 20 19:47:59.988348 systemd[1]: Started sshd@1-172.24.4.18:22-172.24.4.1:44306.service - OpenSSH per-connection server daemon (172.24.4.1:44306). Jun 20 19:48:00.053886 systemd-timesyncd[1343]: Network configuration changed, trying to establish connection. Jun 20 19:48:00.057675 systemd-timesyncd[1343]: Network configuration changed, trying to establish connection. Jun 20 19:48:00.063500 systemd-timesyncd[1343]: Network configuration changed, trying to establish connection. Jun 20 19:48:00.121634 systemd-networkd[1373]: docker0: Link UP Jun 20 19:48:00.122506 systemd-timesyncd[1343]: Network configuration changed, trying to establish connection. Jun 20 19:48:00.130057 dockerd[1581]: time="2025-06-20T19:48:00.129952912Z" level=info msg="Loading containers: done." Jun 20 19:48:00.166306 dockerd[1581]: time="2025-06-20T19:48:00.166136504Z" level=warning msg="Not using native diff for overlay2, this may cause degraded performance for building images: kernel has CONFIG_OVERLAY_FS_REDIRECT_DIR enabled" storage-driver=overlay2 Jun 20 19:48:00.166515 dockerd[1581]: time="2025-06-20T19:48:00.166337711Z" level=info msg="Docker daemon" commit=bbd0a17ccc67e48d4a69393287b7fcc4f0578683 containerd-snapshotter=false storage-driver=overlay2 version=28.0.1 Jun 20 19:48:00.166515 dockerd[1581]: time="2025-06-20T19:48:00.166500897Z" level=info msg="Initializing buildkit" Jun 20 19:48:00.202885 dockerd[1581]: time="2025-06-20T19:48:00.202821567Z" level=info msg="Completed buildkit initialization" Jun 20 19:48:00.212841 dockerd[1581]: time="2025-06-20T19:48:00.212755247Z" level=info msg="Daemon has completed initialization" Jun 20 19:48:00.213129 dockerd[1581]: time="2025-06-20T19:48:00.212883618Z" level=info msg="API listen on /run/docker.sock" Jun 20 19:48:00.214037 systemd[1]: Started docker.service - Docker Application Container Engine. Jun 20 19:48:00.217057 etcd-wrapper[1570]: Error response from daemon: No such container: etcd-member Jun 20 19:48:00.247318 etcd-wrapper[1783]: Error response from daemon: No such container: etcd-member Jun 20 19:48:00.310105 etcd-wrapper[1803]: Unable to find image 'quay.io/coreos/etcd:v3.5.16' locally Jun 20 19:48:01.411728 sshd[1684]: Accepted publickey for core from 172.24.4.1 port 44306 ssh2: RSA SHA256:LYn+fusd8YWkzHw8aAHCykt0zs9fuaIug0oT7GKHECY Jun 20 19:48:01.414366 sshd-session[1684]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Jun 20 19:48:01.426670 systemd-logind[1414]: New session 2 of user core. Jun 20 19:48:01.437877 systemd[1]: Started session-2.scope - Session 2 of User core. Jun 20 19:48:01.752915 etcd-wrapper[1803]: v3.5.16: Pulling from coreos/etcd Jun 20 19:48:02.117526 etcd-wrapper[1803]: 804c8aba2cc6: Pulling fs layer Jun 20 19:48:02.118182 etcd-wrapper[1803]: 2ae710cd8bfe: Pulling fs layer Jun 20 19:48:02.118182 etcd-wrapper[1803]: d462aa345367: Pulling fs layer Jun 20 19:48:02.118182 etcd-wrapper[1803]: 0f8b424aa0b9: Pulling fs layer Jun 20 19:48:02.118182 etcd-wrapper[1803]: d557676654e5: Pulling fs layer Jun 20 19:48:02.118182 etcd-wrapper[1803]: c8022d07192e: Pulling fs layer Jun 20 19:48:02.118182 etcd-wrapper[1803]: d858cbc252ad: Pulling fs layer Jun 20 19:48:02.118182 etcd-wrapper[1803]: 1069fc2daed1: Pulling fs layer Jun 20 19:48:02.118607 etcd-wrapper[1803]: b40161cd83fc: Pulling fs layer Jun 20 19:48:02.118607 etcd-wrapper[1803]: 5318d93a3a65: Pulling fs layer Jun 20 19:48:02.118607 etcd-wrapper[1803]: 307c1adadb60: Pulling fs layer Jun 20 19:48:02.118607 etcd-wrapper[1803]: fbb01d9e9dc9: Pulling fs layer Jun 20 19:48:02.118840 etcd-wrapper[1803]: fbfea02ac3cf: Pulling fs layer Jun 20 19:48:02.119765 etcd-wrapper[1803]: 8c26e4bf18e2: Pulling fs layer Jun 20 19:48:02.119765 etcd-wrapper[1803]: 1e59a65f8816: Pulling fs layer Jun 20 19:48:02.119765 etcd-wrapper[1803]: ffbd4ca5f0bd: Pulling fs layer Jun 20 19:48:02.119765 etcd-wrapper[1803]: b40161cd83fc: Waiting Jun 20 19:48:02.119765 etcd-wrapper[1803]: 5318d93a3a65: Waiting Jun 20 19:48:02.119765 etcd-wrapper[1803]: 307c1adadb60: Waiting Jun 20 19:48:02.119765 etcd-wrapper[1803]: fbb01d9e9dc9: Waiting Jun 20 19:48:02.119765 etcd-wrapper[1803]: fbfea02ac3cf: Waiting Jun 20 19:48:02.119765 etcd-wrapper[1803]: 8c26e4bf18e2: Waiting Jun 20 19:48:02.119765 etcd-wrapper[1803]: 1e59a65f8816: Waiting Jun 20 19:48:02.119765 etcd-wrapper[1803]: ffbd4ca5f0bd: Waiting Jun 20 19:48:02.119765 etcd-wrapper[1803]: c8022d07192e: Waiting Jun 20 19:48:02.119765 etcd-wrapper[1803]: d858cbc252ad: Waiting Jun 20 19:48:02.119765 etcd-wrapper[1803]: 1069fc2daed1: Waiting Jun 20 19:48:02.119765 etcd-wrapper[1803]: 0f8b424aa0b9: Waiting Jun 20 19:48:02.119765 etcd-wrapper[1803]: d557676654e5: Waiting Jun 20 19:48:02.131626 sshd[1811]: Connection closed by 172.24.4.1 port 44306 Jun 20 19:48:02.132935 sshd-session[1684]: pam_unix(sshd:session): session closed for user core Jun 20 19:48:02.147352 systemd[1]: sshd@1-172.24.4.18:22-172.24.4.1:44306.service: Deactivated successfully. Jun 20 19:48:02.150784 systemd[1]: session-2.scope: Deactivated successfully. Jun 20 19:48:02.152625 systemd-logind[1414]: Session 2 logged out. Waiting for processes to exit. Jun 20 19:48:02.158345 systemd[1]: Started sshd@2-172.24.4.18:22-172.24.4.1:44314.service - OpenSSH per-connection server daemon (172.24.4.1:44314). Jun 20 19:48:02.161238 systemd-logind[1414]: Removed session 2. Jun 20 19:48:02.461170 etcd-wrapper[1803]: 804c8aba2cc6: Verifying Checksum Jun 20 19:48:02.461170 etcd-wrapper[1803]: 804c8aba2cc6: Download complete Jun 20 19:48:02.467240 etcd-wrapper[1803]: d462aa345367: Verifying Checksum Jun 20 19:48:02.469138 etcd-wrapper[1803]: d462aa345367: Download complete Jun 20 19:48:02.522283 etcd-wrapper[1803]: 2ae710cd8bfe: Verifying Checksum Jun 20 19:48:02.522455 etcd-wrapper[1803]: 2ae710cd8bfe: Download complete Jun 20 19:48:02.546008 etcd-wrapper[1803]: 804c8aba2cc6: Pull complete Jun 20 19:48:02.594745 systemd[1]: var-lib-docker-overlay2-854f7b3cdc9010952e86915d1a5605a2284462aa3950f7013d1a18e4935fb702-merged.mount: Deactivated successfully. Jun 20 19:48:02.652751 etcd-wrapper[1803]: 2ae710cd8bfe: Pull complete Jun 20 19:48:02.738197 etcd-wrapper[1803]: d557676654e5: Verifying Checksum Jun 20 19:48:02.738503 etcd-wrapper[1803]: d557676654e5: Download complete Jun 20 19:48:02.744720 etcd-wrapper[1803]: 0f8b424aa0b9: Verifying Checksum Jun 20 19:48:02.745128 etcd-wrapper[1803]: 0f8b424aa0b9: Download complete Jun 20 19:48:02.811686 etcd-wrapper[1803]: c8022d07192e: Verifying Checksum Jun 20 19:48:02.811686 etcd-wrapper[1803]: c8022d07192e: Download complete Jun 20 19:48:02.946246 login[1556]: pam_unix(login:session): session opened for user core(uid=500) by LOGIN(uid=0) Jun 20 19:48:02.946641 login[1557]: pam_unix(login:session): session opened for user core(uid=500) by LOGIN(uid=0) Jun 20 19:48:02.951847 systemd-logind[1414]: New session 4 of user core. Jun 20 19:48:02.956752 systemd[1]: Started session-4.scope - Session 4 of User core. Jun 20 19:48:02.960368 systemd-logind[1414]: New session 3 of user core. Jun 20 19:48:02.962003 systemd[1]: Started session-3.scope - Session 3 of User core. Jun 20 19:48:03.030740 etcd-wrapper[1803]: d858cbc252ad: Verifying Checksum Jun 20 19:48:03.030740 etcd-wrapper[1803]: d858cbc252ad: Download complete Jun 20 19:48:03.039972 etcd-wrapper[1803]: 1069fc2daed1: Verifying Checksum Jun 20 19:48:03.040074 etcd-wrapper[1803]: 1069fc2daed1: Download complete Jun 20 19:48:03.133642 etcd-wrapper[1803]: b40161cd83fc: Verifying Checksum Jun 20 19:48:03.133884 etcd-wrapper[1803]: b40161cd83fc: Download complete Jun 20 19:48:03.229020 etcd-wrapper[1803]: d462aa345367: Pull complete Jun 20 19:48:03.278436 etcd-wrapper[1803]: 0f8b424aa0b9: Pull complete Jun 20 19:48:03.319944 etcd-wrapper[1803]: 5318d93a3a65: Download complete Jun 20 19:48:03.328374 etcd-wrapper[1803]: d557676654e5: Pull complete Jun 20 19:48:03.337502 etcd-wrapper[1803]: 307c1adadb60: Verifying Checksum Jun 20 19:48:03.338155 etcd-wrapper[1803]: 307c1adadb60: Download complete Jun 20 19:48:03.382143 etcd-wrapper[1803]: c8022d07192e: Pull complete Jun 20 19:48:03.444228 etcd-wrapper[1803]: d858cbc252ad: Pull complete Jun 20 19:48:03.493686 etcd-wrapper[1803]: 1069fc2daed1: Pull complete Jun 20 19:48:03.544187 etcd-wrapper[1803]: b40161cd83fc: Pull complete Jun 20 19:48:03.575161 systemd[1]: var-lib-docker-overlay2-c7799ca8d57b6180bb424c0cce0734bca6732ac45d5772f5c03f54edca08e5b9-merged.mount: Deactivated successfully. Jun 20 19:48:03.600465 etcd-wrapper[1803]: 5318d93a3a65: Pull complete Jun 20 19:48:03.653806 systemd[1]: var-lib-docker-overlay2-e71b91ac4dd046ae4d8e83a7e8c801de9e39ba928b2c7f96fcc95de4b3b18058-merged.mount: Deactivated successfully. Jun 20 19:48:03.685932 sshd[1817]: Accepted publickey for core from 172.24.4.1 port 44314 ssh2: RSA SHA256:LYn+fusd8YWkzHw8aAHCykt0zs9fuaIug0oT7GKHECY Jun 20 19:48:03.687074 sshd-session[1817]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Jun 20 19:48:03.693644 systemd-logind[1414]: New session 5 of user core. Jun 20 19:48:03.698708 systemd[1]: Started session-5.scope - Session 5 of User core. Jun 20 19:48:03.707155 etcd-wrapper[1803]: 307c1adadb60: Pull complete Jun 20 19:48:03.818715 etcd-wrapper[1803]: fbb01d9e9dc9: Verifying Checksum Jun 20 19:48:03.819810 etcd-wrapper[1803]: fbb01d9e9dc9: Download complete Jun 20 19:48:03.853486 etcd-wrapper[1803]: 8c26e4bf18e2: Verifying Checksum Jun 20 19:48:03.853486 etcd-wrapper[1803]: 8c26e4bf18e2: Download complete Jun 20 19:48:03.856434 etcd-wrapper[1803]: fbfea02ac3cf: Verifying Checksum Jun 20 19:48:03.856487 etcd-wrapper[1803]: fbfea02ac3cf: Download complete Jun 20 19:48:04.080496 systemd[1]: var-lib-docker-overlay2-605d69937997420813ee1b6790482e44ef3c62b12177246c5d9d10850e4f82e1-merged.mount: Deactivated successfully. Jun 20 19:48:04.153283 etcd-wrapper[1803]: 1e59a65f8816: Verifying Checksum Jun 20 19:48:04.153283 etcd-wrapper[1803]: 1e59a65f8816: Download complete Jun 20 19:48:04.153283 etcd-wrapper[1803]: ffbd4ca5f0bd: Verifying Checksum Jun 20 19:48:04.153283 etcd-wrapper[1803]: ffbd4ca5f0bd: Download complete Jun 20 19:48:04.246358 etcd-wrapper[1803]: fbb01d9e9dc9: Pull complete Jun 20 19:48:04.541277 sshd[1902]: Connection closed by 172.24.4.1 port 44314 Jun 20 19:48:04.542668 sshd-session[1817]: pam_unix(sshd:session): session closed for user core Jun 20 19:48:04.547790 systemd[1]: sshd@2-172.24.4.18:22-172.24.4.1:44314.service: Deactivated successfully. Jun 20 19:48:04.550456 systemd[1]: session-5.scope: Deactivated successfully. Jun 20 19:48:04.551626 systemd-logind[1414]: Session 5 logged out. Waiting for processes to exit. Jun 20 19:48:04.553637 systemd-logind[1414]: Removed session 5. Jun 20 19:48:04.561866 etcd-wrapper[1803]: fbfea02ac3cf: Pull complete Jun 20 19:48:04.746947 systemd[1]: var-lib-docker-overlay2-28157d424489e8311b5ff111f13949a3d385ce9f3094a2a7a3f48bcc2e21512d-merged.mount: Deactivated successfully. Jun 20 19:48:04.837606 etcd-wrapper[1803]: 8c26e4bf18e2: Pull complete Jun 20 19:48:04.874217 systemd[1]: var-lib-docker-overlay2-e928eb4157fa5373e83622b25623c0422ae70996f2e6397865bb0d02af16d72a-merged.mount: Deactivated successfully. Jun 20 19:48:04.900225 etcd-wrapper[1803]: 1e59a65f8816: Pull complete Jun 20 19:48:04.950871 etcd-wrapper[1803]: ffbd4ca5f0bd: Pull complete Jun 20 19:48:04.967946 etcd-wrapper[1803]: Digest: sha256:d967d98a12dc220a1a290794711dba7eba04b8ce465e12b02383d1bfbb33e159 Jun 20 19:48:04.974291 etcd-wrapper[1803]: Status: Downloaded newer image for quay.io/coreos/etcd:v3.5.16 Jun 20 19:48:05.073859 containerd[1486]: time="2025-06-20T19:48:05.073798002Z" level=info msg="connecting to shim 638b247ad27a7ca5782858f5d227f4e616ff912335e82ebdc0a246e9fa21bbe3" address="unix:///run/containerd/s/7e59741e326f322ed6244be5ee13d0aed437fac26424a21b9c9beac7424a35fa" namespace=moby protocol=ttrpc version=3 Jun 20 19:48:05.123868 systemd[1]: Started docker-638b247ad27a7ca5782858f5d227f4e616ff912335e82ebdc0a246e9fa21bbe3.scope - libcontainer container 638b247ad27a7ca5782858f5d227f4e616ff912335e82ebdc0a246e9fa21bbe3. Jun 20 19:48:05.239693 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:48:05.238793Z","caller":"flags/flag.go:113","msg":"recognized and used environment variable","variable-name":"ETCD_DATA_DIR","variable-value":"/var/lib/etcd"} Jun 20 19:48:05.239693 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:48:05.238906Z","caller":"flags/flag.go:113","msg":"recognized and used environment variable","variable-name":"ETCD_NAME","variable-value":"7c6d7721993141c792f03ec9fb239232"} Jun 20 19:48:05.239693 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:48:05.238939Z","caller":"flags/flag.go:93","msg":"unrecognized environment variable","environment-variable":"ETCD_IMAGE_URL=quay.io/coreos/etcd"} Jun 20 19:48:05.239693 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:48:05.238947Z","caller":"flags/flag.go:93","msg":"unrecognized environment variable","environment-variable":"ETCD_IMAGE_TAG=v3.5.16"} Jun 20 19:48:05.239693 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:48:05.238958Z","caller":"flags/flag.go:93","msg":"unrecognized environment variable","environment-variable":"ETCD_USER=etcd"} Jun 20 19:48:05.239693 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:48:05.238964Z","caller":"flags/flag.go:93","msg":"unrecognized environment variable","environment-variable":"ETCD_SSL_DIR=/etc/ssl/certs"} Jun 20 19:48:05.241861 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:48:05.240697Z","caller":"embed/config.go:689","msg":"Running http and grpc server on single port. This is not recommended for production."} Jun 20 19:48:05.241861 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:48:05.240727Z","caller":"etcdmain/etcd.go:73","msg":"Running: ","args":["/usr/local/bin/etcd","--listen-client-urls=http://0.0.0.0:2379","--advertise-client-urls=http://172.24.4.18:2379"]} Jun 20 19:48:05.241861 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:48:05.240823Z","caller":"embed/config.go:689","msg":"Running http and grpc server on single port. This is not recommended for production."} Jun 20 19:48:05.241861 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:48:05.240836Z","caller":"embed/etcd.go:128","msg":"configuring peer listeners","listen-peer-urls":["http://localhost:2380"]} Jun 20 19:48:05.241861 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:48:05.241283Z","caller":"embed/etcd.go:136","msg":"configuring client listeners","listen-client-urls":["http://0.0.0.0:2379"]} Jun 20 19:48:05.242272 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:48:05.241383Z","caller":"embed/etcd.go:311","msg":"starting an etcd server","etcd-version":"3.5.16","git-sha":"f20bbad","go-version":"go1.22.7","go-os":"linux","go-arch":"amd64","max-cpu-set":2,"max-cpu-available":2,"member-initialized":false,"name":"7c6d7721993141c792f03ec9fb239232","data-dir":"/var/lib/etcd","wal-dir":"","wal-dir-dedicated":"","member-dir":"/var/lib/etcd/member","force-new-cluster":false,"heartbeat-interval":"100ms","election-timeout":"1s","initial-election-tick-advance":true,"snapshot-count":100000,"max-wals":5,"max-snapshots":5,"snapshot-catchup-entries":5000,"initial-advertise-peer-urls":["http://localhost:2380"],"listen-peer-urls":["http://localhost:2380"],"advertise-client-urls":["http://172.24.4.18:2379"],"listen-client-urls":["http://0.0.0.0:2379"],"listen-metrics-urls":[],"cors":["*"],"host-whitelist":["*"],"initial-cluster":"7c6d7721993141c792f03ec9fb239232=http://localhost:2380","initial-cluster-state":"new","initial-cluster-token":"etcd-cluster","quota-backend-bytes":2147483648,"max-request-bytes":1572864,"max-concurrent-streams":4294967295,"pre-vote":true,"initial-corrupt-check":false,"corrupt-check-time-interval":"0s","compact-check-time-enabled":false,"compact-check-time-interval":"1m0s","auto-compaction-mode":"periodic","auto-compaction-retention":"0s","auto-compaction-interval":"0s","discovery-url":"","discovery-proxy":"","downgrade-check-interval":"5s"} Jun 20 19:48:05.246011 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:48:05.245875Z","caller":"etcdserver/backend.go:81","msg":"opened backend db","path":"/var/lib/etcd/member/snap/db","took":"3.913941ms"} Jun 20 19:48:05.251688 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:48:05.251522Z","caller":"etcdserver/raft.go:505","msg":"starting local member","local-member-id":"8e9e05c52164694d","cluster-id":"cdf818194e3a8c32"} Jun 20 19:48:05.251894 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:48:05.251737Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d switched to configuration voters=()"} Jun 20 19:48:05.252085 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:48:05.251923Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d became follower at term 0"} Jun 20 19:48:05.252387 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:48:05.252076Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"newRaft 8e9e05c52164694d [peers: [], term: 0, commit: 0, applied: 0, lastindex: 0, lastterm: 0]"} Jun 20 19:48:05.252387 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:48:05.252204Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d became follower at term 1"} Jun 20 19:48:05.252636 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:48:05.252380Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d switched to configuration voters=(10276657743932975437)"} Jun 20 19:48:05.259033 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:48:05.258877Z","caller":"auth/store.go:1241","msg":"simple token is not cryptographically signed"} Jun 20 19:48:05.260513 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:48:05.260332Z","caller":"mvcc/kvstore.go:423","msg":"kvstore restored","current-rev":1} Jun 20 19:48:05.261942 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:48:05.261805Z","caller":"etcdserver/quota.go:94","msg":"enabled backend quota with default value","quota-name":"v3-applier","quota-size-bytes":2147483648,"quota-size":"2.1 GB"} Jun 20 19:48:05.264621 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:48:05.264368Z","caller":"etcdserver/server.go:873","msg":"starting etcd server","local-member-id":"8e9e05c52164694d","local-server-version":"3.5.16","cluster-version":"to_be_decided"} Jun 20 19:48:05.265489 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:48:05.265144Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"} Jun 20 19:48:05.265771 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:48:05.265581Z","caller":"etcdserver/server.go:757","msg":"started as single-node; fast-forwarding election ticks","local-member-id":"8e9e05c52164694d","forward-ticks":9,"forward-duration":"900ms","election-ticks":10,"election-timeout":"1s"} Jun 20 19:48:05.266732 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:48:05.265945Z","caller":"fileutil/purge.go:50","msg":"started to purge file","dir":"/var/lib/etcd/member/snap","suffix":"snap.db","max":5,"interval":"30s"} Jun 20 19:48:05.266953 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:48:05.266843Z","caller":"fileutil/purge.go:50","msg":"started to purge file","dir":"/var/lib/etcd/member/snap","suffix":"snap","max":5,"interval":"30s"} Jun 20 19:48:05.267169 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:48:05.267037Z","caller":"fileutil/purge.go:50","msg":"started to purge file","dir":"/var/lib/etcd/member/wal","suffix":"wal","max":5,"interval":"30s"} Jun 20 19:48:05.267400 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:48:05.266132Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d switched to configuration voters=(10276657743932975437)"} Jun 20 19:48:05.267827 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:48:05.267627Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"cdf818194e3a8c32","local-member-id":"8e9e05c52164694d","added-peer-id":"8e9e05c52164694d","added-peer-peer-urls":["http://localhost:2380"]} Jun 20 19:48:05.269245 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:48:05.269076Z","caller":"embed/etcd.go:600","msg":"serving peer traffic","address":"127.0.0.1:2380"} Jun 20 19:48:05.269423 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:48:05.269137Z","caller":"embed/etcd.go:572","msg":"cmux::serve","address":"127.0.0.1:2380"} Jun 20 19:48:05.269423 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:48:05.269250Z","caller":"embed/etcd.go:280","msg":"now serving peer/client/metrics","local-member-id":"8e9e05c52164694d","initial-advertise-peer-urls":["http://localhost:2380"],"listen-peer-urls":["http://localhost:2380"],"advertise-client-urls":["http://172.24.4.18:2379"],"listen-client-urls":["http://0.0.0.0:2379"],"listen-metrics-urls":[]} Jun 20 19:48:05.954361 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:48:05.953462Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d is starting a new election at term 1"} Jun 20 19:48:05.954361 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:48:05.953513Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d became pre-candidate at term 1"} Jun 20 19:48:05.954361 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:48:05.953610Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d received MsgPreVoteResp from 8e9e05c52164694d at term 1"} Jun 20 19:48:05.954361 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:48:05.953633Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d became candidate at term 2"} Jun 20 19:48:05.954361 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:48:05.953645Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d received MsgVoteResp from 8e9e05c52164694d at term 2"} Jun 20 19:48:05.954361 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:48:05.953819Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d became leader at term 2"} Jun 20 19:48:05.954361 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:48:05.953838Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: 8e9e05c52164694d elected leader 8e9e05c52164694d at term 2"} Jun 20 19:48:05.956032 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:48:05.955250Z","caller":"etcdserver/server.go:2140","msg":"published local member to cluster through raft","local-member-id":"8e9e05c52164694d","local-member-attributes":"{Name:7c6d7721993141c792f03ec9fb239232 ClientURLs:[http://172.24.4.18:2379]}","request-path":"/0/members/8e9e05c52164694d/attributes","cluster-id":"cdf818194e3a8c32","publish-timeout":"7s"} Jun 20 19:48:05.956032 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:48:05.955322Z","caller":"etcdserver/server.go:2651","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"} Jun 20 19:48:05.956032 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:48:05.955523Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"} Jun 20 19:48:05.957050 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:48:05.956512Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"cdf818194e3a8c32","local-member-id":"8e9e05c52164694d","cluster-version":"3.5"} Jun 20 19:48:05.957050 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:48:05.956726Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"} Jun 20 19:48:05.957500 systemd[1]: Started etcd-member.service - etcd (System Application Container). Jun 20 19:48:05.959142 systemd[1]: Reached target multi-user.target - Multi-User System. Jun 20 19:48:05.959906 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:48:05.957022Z","caller":"etcdserver/server.go:2675","msg":"cluster version is updated","cluster-version":"3.5"} Jun 20 19:48:05.959906 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:48:05.956543Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"} Jun 20 19:48:05.959906 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:48:05.957271Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"} Jun 20 19:48:05.959906 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:48:05.958495Z","caller":"embed/serve.go:187","msg":"serving client traffic insecurely; this is strongly discouraged!","traffic":"grpc+http","address":"[::]:2379"} Jun 20 19:48:05.959906 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:48:05.958665Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"} Jun 20 19:48:05.959970 systemd[1]: Startup finished in 3.751s (kernel) + 12.041s (initrd) + 12.264s (userspace) = 28.057s. Jun 20 19:48:14.566912 systemd[1]: Started sshd@3-172.24.4.18:22-172.24.4.1:52590.service - OpenSSH per-connection server daemon (172.24.4.1:52590). Jun 20 19:48:15.860624 sshd[1985]: Accepted publickey for core from 172.24.4.1 port 52590 ssh2: RSA SHA256:LYn+fusd8YWkzHw8aAHCykt0zs9fuaIug0oT7GKHECY Jun 20 19:48:15.863748 sshd-session[1985]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Jun 20 19:48:15.875560 systemd-logind[1414]: New session 6 of user core. Jun 20 19:48:15.889919 systemd[1]: Started session-6.scope - Session 6 of User core. Jun 20 19:48:16.620897 sshd[1987]: Connection closed by 172.24.4.1 port 52590 Jun 20 19:48:16.622527 sshd-session[1985]: pam_unix(sshd:session): session closed for user core Jun 20 19:48:16.635871 systemd[1]: sshd@3-172.24.4.18:22-172.24.4.1:52590.service: Deactivated successfully. Jun 20 19:48:16.638765 systemd[1]: session-6.scope: Deactivated successfully. Jun 20 19:48:16.640441 systemd-logind[1414]: Session 6 logged out. Waiting for processes to exit. Jun 20 19:48:16.644971 systemd[1]: Started sshd@4-172.24.4.18:22-172.24.4.1:52600.service - OpenSSH per-connection server daemon (172.24.4.1:52600). Jun 20 19:48:16.647203 systemd-logind[1414]: Removed session 6. Jun 20 19:48:17.766094 sshd[1993]: Accepted publickey for core from 172.24.4.1 port 52600 ssh2: RSA SHA256:LYn+fusd8YWkzHw8aAHCykt0zs9fuaIug0oT7GKHECY Jun 20 19:48:17.768643 sshd-session[1993]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Jun 20 19:48:17.779109 systemd-logind[1414]: New session 7 of user core. Jun 20 19:48:17.786854 systemd[1]: Started session-7.scope - Session 7 of User core. Jun 20 19:48:18.493371 sshd[1995]: Connection closed by 172.24.4.1 port 52600 Jun 20 19:48:18.494444 sshd-session[1993]: pam_unix(sshd:session): session closed for user core Jun 20 19:48:18.510996 systemd[1]: sshd@4-172.24.4.18:22-172.24.4.1:52600.service: Deactivated successfully. Jun 20 19:48:18.514430 systemd[1]: session-7.scope: Deactivated successfully. Jun 20 19:48:18.517744 systemd-logind[1414]: Session 7 logged out. Waiting for processes to exit. Jun 20 19:48:18.522816 systemd[1]: Started sshd@5-172.24.4.18:22-172.24.4.1:52608.service - OpenSSH per-connection server daemon (172.24.4.1:52608). Jun 20 19:48:18.526199 systemd-logind[1414]: Removed session 7. Jun 20 19:48:19.964108 sshd[2001]: Accepted publickey for core from 172.24.4.1 port 52608 ssh2: RSA SHA256:LYn+fusd8YWkzHw8aAHCykt0zs9fuaIug0oT7GKHECY Jun 20 19:48:19.967315 sshd-session[2001]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Jun 20 19:48:19.979871 systemd-logind[1414]: New session 8 of user core. Jun 20 19:48:19.999163 systemd[1]: Started session-8.scope - Session 8 of User core. Jun 20 19:48:20.733614 sshd[2003]: Connection closed by 172.24.4.1 port 52608 Jun 20 19:48:20.734618 sshd-session[2001]: pam_unix(sshd:session): session closed for user core Jun 20 19:48:20.748103 systemd[1]: sshd@5-172.24.4.18:22-172.24.4.1:52608.service: Deactivated successfully. Jun 20 19:48:20.751545 systemd[1]: session-8.scope: Deactivated successfully. Jun 20 19:48:20.753913 systemd-logind[1414]: Session 8 logged out. Waiting for processes to exit. Jun 20 19:48:20.757791 systemd-logind[1414]: Removed session 8. Jun 20 19:48:20.760263 systemd[1]: Started sshd@6-172.24.4.18:22-172.24.4.1:52622.service - OpenSSH per-connection server daemon (172.24.4.1:52622). Jun 20 19:48:22.086391 sshd[2009]: Accepted publickey for core from 172.24.4.1 port 52622 ssh2: RSA SHA256:LYn+fusd8YWkzHw8aAHCykt0zs9fuaIug0oT7GKHECY Jun 20 19:48:22.089649 sshd-session[2009]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Jun 20 19:48:22.102696 systemd-logind[1414]: New session 9 of user core. Jun 20 19:48:22.109007 systemd[1]: Started session-9.scope - Session 9 of User core. Jun 20 19:48:22.530553 sudo[2012]: core : PWD=/home/core ; USER=root ; COMMAND=/usr/sbin/setenforce 1 Jun 20 19:48:22.531202 sudo[2012]: pam_unix(sudo:session): session opened for user root(uid=0) by core(uid=500) Jun 20 19:48:22.548269 sudo[2012]: pam_unix(sudo:session): session closed for user root Jun 20 19:48:22.734388 sshd[2011]: Connection closed by 172.24.4.1 port 52622 Jun 20 19:48:22.735384 sshd-session[2009]: pam_unix(sshd:session): session closed for user core Jun 20 19:48:22.748649 systemd[1]: sshd@6-172.24.4.18:22-172.24.4.1:52622.service: Deactivated successfully. Jun 20 19:48:22.751541 systemd[1]: session-9.scope: Deactivated successfully. Jun 20 19:48:22.753419 systemd-logind[1414]: Session 9 logged out. Waiting for processes to exit. Jun 20 19:48:22.758445 systemd[1]: Started sshd@7-172.24.4.18:22-172.24.4.1:52638.service - OpenSSH per-connection server daemon (172.24.4.1:52638). Jun 20 19:48:22.762672 systemd-logind[1414]: Removed session 9. Jun 20 19:48:23.764594 sshd[2018]: Accepted publickey for core from 172.24.4.1 port 52638 ssh2: RSA SHA256:LYn+fusd8YWkzHw8aAHCykt0zs9fuaIug0oT7GKHECY Jun 20 19:48:23.767282 sshd-session[2018]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Jun 20 19:48:23.778157 systemd-logind[1414]: New session 10 of user core. Jun 20 19:48:23.787856 systemd[1]: Started session-10.scope - Session 10 of User core. Jun 20 19:48:24.231317 sudo[2022]: core : PWD=/home/core ; USER=root ; COMMAND=/usr/sbin/rm -rf /etc/audit/rules.d/80-selinux.rules /etc/audit/rules.d/99-default.rules Jun 20 19:48:24.231943 sudo[2022]: pam_unix(sudo:session): session opened for user root(uid=0) by core(uid=500) Jun 20 19:48:24.243311 sudo[2022]: pam_unix(sudo:session): session closed for user root Jun 20 19:48:24.254305 sudo[2021]: core : PWD=/home/core ; USER=root ; COMMAND=/usr/sbin/systemctl restart audit-rules Jun 20 19:48:24.255492 sudo[2021]: pam_unix(sudo:session): session opened for user root(uid=0) by core(uid=500) Jun 20 19:48:24.275794 systemd[1]: Starting audit-rules.service - Load Audit Rules... Jun 20 19:48:24.345202 augenrules[2044]: No rules Jun 20 19:48:24.346356 systemd[1]: audit-rules.service: Deactivated successfully. Jun 20 19:48:24.346864 systemd[1]: Finished audit-rules.service - Load Audit Rules. Jun 20 19:48:24.348966 sudo[2021]: pam_unix(sudo:session): session closed for user root Jun 20 19:48:24.493461 sshd[2020]: Connection closed by 172.24.4.1 port 52638 Jun 20 19:48:24.493185 sshd-session[2018]: pam_unix(sshd:session): session closed for user core Jun 20 19:48:24.508008 systemd[1]: sshd@7-172.24.4.18:22-172.24.4.1:52638.service: Deactivated successfully. Jun 20 19:48:24.511420 systemd[1]: session-10.scope: Deactivated successfully. Jun 20 19:48:24.513341 systemd-logind[1414]: Session 10 logged out. Waiting for processes to exit. Jun 20 19:48:24.518052 systemd[1]: Started sshd@8-172.24.4.18:22-172.24.4.1:60656.service - OpenSSH per-connection server daemon (172.24.4.1:60656). Jun 20 19:48:24.522036 systemd-logind[1414]: Removed session 10. Jun 20 19:48:25.608209 sshd[2053]: Accepted publickey for core from 172.24.4.1 port 60656 ssh2: RSA SHA256:LYn+fusd8YWkzHw8aAHCykt0zs9fuaIug0oT7GKHECY Jun 20 19:48:25.611347 sshd-session[2053]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Jun 20 19:48:25.622693 systemd-logind[1414]: New session 11 of user core. Jun 20 19:48:25.630843 systemd[1]: Started session-11.scope - Session 11 of User core. Jun 20 19:48:26.244077 sshd[2055]: Connection closed by 172.24.4.1 port 60656 Jun 20 19:48:26.245035 sshd-session[2053]: pam_unix(sshd:session): session closed for user core Jun 20 19:48:26.261165 systemd[1]: sshd@8-172.24.4.18:22-172.24.4.1:60656.service: Deactivated successfully. Jun 20 19:48:26.264539 systemd[1]: session-11.scope: Deactivated successfully. Jun 20 19:48:26.266657 systemd-logind[1414]: Session 11 logged out. Waiting for processes to exit. Jun 20 19:48:26.271987 systemd[1]: Started sshd@9-172.24.4.18:22-172.24.4.1:60670.service - OpenSSH per-connection server daemon (172.24.4.1:60670). Jun 20 19:48:26.274246 systemd-logind[1414]: Removed session 11. Jun 20 19:48:27.397432 sshd[2063]: Accepted publickey for core from 172.24.4.1 port 60670 ssh2: RSA SHA256:LYn+fusd8YWkzHw8aAHCykt0zs9fuaIug0oT7GKHECY Jun 20 19:48:27.400165 sshd-session[2063]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Jun 20 19:48:27.412680 systemd-logind[1414]: New session 12 of user core. Jun 20 19:48:27.419881 systemd[1]: Started session-12.scope - Session 12 of User core. Jun 20 19:48:28.263948 sshd[2065]: Connection closed by 172.24.4.1 port 60670 Jun 20 19:48:28.263763 sshd-session[2063]: pam_unix(sshd:session): session closed for user core Jun 20 19:48:28.271863 systemd[1]: sshd@9-172.24.4.18:22-172.24.4.1:60670.service: Deactivated successfully. Jun 20 19:48:28.275955 systemd[1]: session-12.scope: Deactivated successfully. Jun 20 19:48:28.278855 systemd-logind[1414]: Session 12 logged out. Waiting for processes to exit. Jun 20 19:48:28.282655 systemd-logind[1414]: Removed session 12. Jun 20 19:48:30.476328 systemd-timesyncd[1343]: Contacted time server 216.229.0.50:123 (2.flatcar.pool.ntp.org). Jun 20 19:48:30.477017 systemd-timesyncd[1343]: Initial clock synchronization to Fri 2025-06-20 19:48:30.487588 UTC. Jun 20 19:48:41.909489 update_engine[1415]: I20250620 19:48:41.908667 1415 update_attempter.cc:509] Updating boot flags... Jun 20 19:50:16.244541 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:50:16.241021Z","caller":"traceutil/trace.go:171","msg":"trace[808285186] transaction","detail":"{read_only:false; response_revision:116; number_of_response:1; }","duration":"127.27375ms","start":"2025-06-20T19:50:16.113650Z","end":"2025-06-20T19:50:16.240924Z","steps":["trace[808285186] 'process raft request' (duration: 55.604078ms)","trace[808285186] 'compare' (duration: 71.481027ms)"],"step_count":2} Jun 20 19:50:16.425902 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:50:16.423108Z","caller":"traceutil/trace.go:171","msg":"trace[1906582886] transaction","detail":"{read_only:false; response_revision:117; number_of_response:1; }","duration":"186.236753ms","start":"2025-06-20T19:50:16.236806Z","end":"2025-06-20T19:50:16.423042Z","steps":["trace[1906582886] 'process raft request' (duration: 158.151839ms)","trace[1906582886] 'compare' (duration: 27.887434ms)"],"step_count":2} Jun 20 19:50:16.425902 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:50:16.423384Z","caller":"traceutil/trace.go:171","msg":"trace[2022093164] linearizableReadLoop","detail":"{readStateIndex:123; appliedIndex:121; }","duration":"178.909086ms","start":"2025-06-20T19:50:16.244438Z","end":"2025-06-20T19:50:16.423347Z","steps":["trace[2022093164] 'read index received' (duration: 150.656416ms)","trace[2022093164] 'applied index is now lower than readState.Index' (duration: 28.250015ms)"],"step_count":2} Jun 20 19:50:16.425902 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:50:16.423737Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"179.047695ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/clusterroles/system:controller:ephemeral-volume-controller\" limit:1 ","response":"range_response_count:0 size:4"} Jun 20 19:50:16.425902 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:50:16.424730Z","caller":"traceutil/trace.go:171","msg":"trace[1190954364] range","detail":"{range_begin:/registry/clusterroles/system:controller:ephemeral-volume-controller; range_end:; response_count:0; response_revision:119; }","duration":"180.147581ms","start":"2025-06-20T19:50:16.244395Z","end":"2025-06-20T19:50:16.424543Z","steps":["trace[1190954364] 'agreement among raft nodes before linearized reading' (duration: 179.046693ms)"],"step_count":1} Jun 20 19:50:16.426863 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:50:16.423888Z","caller":"traceutil/trace.go:171","msg":"trace[1874339718] transaction","detail":"{read_only:false; response_revision:118; number_of_response:1; }","duration":"187.049119ms","start":"2025-06-20T19:50:16.236824Z","end":"2025-06-20T19:50:16.423873Z","steps":["trace[1874339718] 'process raft request' (duration: 186.409539ms)"],"step_count":1} Jun 20 19:50:47.696091 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:50:47.688409Z","caller":"traceutil/trace.go:171","msg":"trace[589621603] linearizableReadLoop","detail":"{readStateIndex:816; appliedIndex:815; }","duration":"194.797847ms","start":"2025-06-20T19:50:47.493528Z","end":"2025-06-20T19:50:47.688326Z","steps":["trace[589621603] 'read index received' (duration: 194.562125ms)","trace[589621603] 'applied index is now lower than readState.Index' (duration: 234.79µs)"],"step_count":2} Jun 20 19:50:47.696091 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:50:47.688963Z","caller":"traceutil/trace.go:171","msg":"trace[83300015] transaction","detail":"{read_only:false; response_revision:794; number_of_response:1; }","duration":"311.424314ms","start":"2025-06-20T19:50:47.377430Z","end":"2025-06-20T19:50:47.688854Z","steps":["trace[83300015] 'process raft request' (duration: 310.7238ms)"],"step_count":1} Jun 20 19:50:47.696091 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:50:47.689442Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"195.573242ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/masterleases/172.24.4.123\" limit:1 ","response":"range_response_count:1 size:131"} Jun 20 19:50:47.696091 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:50:47.689550Z","caller":"traceutil/trace.go:171","msg":"trace[1948158686] range","detail":"{range_begin:/registry/masterleases/172.24.4.123; range_end:; response_count:1; response_revision:794; }","duration":"196.022015ms","start":"2025-06-20T19:50:47.493502Z","end":"2025-06-20T19:50:47.689524Z","steps":["trace[1948158686] 'agreement among raft nodes before linearized reading' (duration: 195.408423ms)"],"step_count":1} Jun 20 19:50:47.703135 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:50:47.693607Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:50:47.377385Z","time spent":"311.727253ms","remote":"172.24.4.123:60136","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":14537,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jun 20 19:50:47.704250 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:50:47.703184Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"173.289221ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/rolebindings/calico-system/tigera-operator-secrets\" limit:1 ","response":"range_response_count:1 size:663"} Jun 20 19:50:47.704729 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:50:47.703642Z","caller":"traceutil/trace.go:171","msg":"trace[332198683] range","detail":"{range_begin:/registry/rolebindings/calico-system/tigera-operator-secrets; range_end:; response_count:1; response_revision:795; }","duration":"173.462406ms","start":"2025-06-20T19:50:47.529821Z","end":"2025-06-20T19:50:47.703283Z","steps":["trace[332198683] 'agreement among raft nodes before linearized reading' (duration: 172.82557ms)"],"step_count":1} Jun 20 19:50:51.837497 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:50:51.834803Z","caller":"traceutil/trace.go:171","msg":"trace[1241492598] linearizableReadLoop","detail":"{readStateIndex:831; appliedIndex:830; }","duration":"105.340732ms","start":"2025-06-20T19:50:51.729365Z","end":"2025-06-20T19:50:51.834706Z","steps":["trace[1241492598] 'read index received' (duration: 105.003659ms)","trace[1241492598] 'applied index is now lower than readState.Index' (duration: 336.101µs)"],"step_count":2} Jun 20 19:50:51.837497 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:50:51.835254Z","caller":"traceutil/trace.go:171","msg":"trace[1124671583] transaction","detail":"{read_only:false; response_revision:808; number_of_response:1; }","duration":"115.376787ms","start":"2025-06-20T19:50:51.719794Z","end":"2025-06-20T19:50:51.835171Z","steps":["trace[1124671583] 'process raft request' (duration: 114.703253ms)"],"step_count":1} Jun 20 19:50:51.837497 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:50:51.835474Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"105.915861ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/goldmanes/default\" limit:1 ","response":"range_response_count:1 size:729"} Jun 20 19:50:51.837497 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:50:51.835546Z","caller":"traceutil/trace.go:171","msg":"trace[2078979611] range","detail":"{range_begin:/registry/operator.tigera.io/goldmanes/default; range_end:; response_count:1; response_revision:808; }","duration":"106.194373ms","start":"2025-06-20T19:50:51.729329Z","end":"2025-06-20T19:50:51.835524Z","steps":["trace[2078979611] 'agreement among raft nodes before linearized reading' (duration: 105.905541ms)"],"step_count":1} Jun 20 19:50:54.698078 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:50:54.697466Z","caller":"traceutil/trace.go:171","msg":"trace[545422771] transaction","detail":"{read_only:false; response_revision:819; number_of_response:1; }","duration":"103.605939ms","start":"2025-06-20T19:50:54.593836Z","end":"2025-06-20T19:50:54.697442Z","steps":["trace[545422771] 'process raft request' (duration: 103.137952ms)"],"step_count":1} Jun 20 19:50:56.556737 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:50:56.554909Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"164.112105ms","expected-duration":"100ms","prefix":"","request":"header: txn: success:> failure: >>","response":"size:16"} Jun 20 19:50:56.556737 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:50:56.555054Z","caller":"traceutil/trace.go:171","msg":"trace[1839597857] linearizableReadLoop","detail":"{readStateIndex:849; appliedIndex:848; }","duration":"198.77845ms","start":"2025-06-20T19:50:56.356254Z","end":"2025-06-20T19:50:56.555032Z","steps":["trace[1839597857] 'read index received' (duration: 33.413453ms)","trace[1839597857] 'applied index is now lower than readState.Index' (duration: 165.362983ms)"],"step_count":2} Jun 20 19:50:56.556737 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:50:56.555111Z","caller":"traceutil/trace.go:171","msg":"trace[408477615] transaction","detail":"{read_only:false; response_revision:825; number_of_response:1; }","duration":"356.654073ms","start":"2025-06-20T19:50:56.198400Z","end":"2025-06-20T19:50:56.555054Z","steps":["trace[408477615] 'process raft request' (duration: 191.345232ms)","trace[408477615] 'compare' (duration: 163.946975ms)"],"step_count":2} Jun 20 19:50:56.558292 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:50:56.555272Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:50:56.198370Z","time spent":"356.815867ms","remote":"172.24.4.123:60130","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":4456,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jun 20 19:50:56.558292 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:50:56.555292Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"199.028158ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/apiservers/default\" limit:1 ","response":"range_response_count:1 size:1504"} Jun 20 19:50:56.558292 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:50:56.555339Z","caller":"traceutil/trace.go:171","msg":"trace[1989877252] range","detail":"{range_begin:/registry/operator.tigera.io/apiservers/default; range_end:; response_count:1; response_revision:825; }","duration":"199.157581ms","start":"2025-06-20T19:50:56.356166Z","end":"2025-06-20T19:50:56.555324Z","steps":["trace[1989877252] 'agreement among raft nodes before linearized reading' (duration: 198.940504ms)"],"step_count":1} Jun 20 19:50:56.948163 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:50:56.944434Z","caller":"traceutil/trace.go:171","msg":"trace[1841830750] transaction","detail":"{read_only:false; response_revision:838; number_of_response:1; }","duration":"142.57143ms","start":"2025-06-20T19:50:56.801770Z","end":"2025-06-20T19:50:56.944341Z","steps":["trace[1841830750] 'process raft request' (duration: 104.013843ms)","trace[1841830750] 'compare' (duration: 38.287119ms)"],"step_count":2} Jun 20 19:51:20.067702 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:51:20.062950Z","caller":"traceutil/trace.go:171","msg":"trace[1767092970] transaction","detail":"{read_only:false; response_revision:984; number_of_response:1; }","duration":"160.38777ms","start":"2025-06-20T19:51:19.902391Z","end":"2025-06-20T19:51:20.062779Z","steps":["trace[1767092970] 'process raft request' (duration: 79.597987ms)","trace[1767092970] 'compare' (duration: 80.416113ms)"],"step_count":2} Jun 20 19:51:39.762285 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:51:39.757312Z","caller":"traceutil/trace.go:171","msg":"trace[1722234744] transaction","detail":"{read_only:false; number_of_response:0; response_revision:1104; }","duration":"124.023934ms","start":"2025-06-20T19:51:39.633205Z","end":"2025-06-20T19:51:39.757229Z","steps":["trace[1722234744] 'process raft request' (duration: 123.827917ms)"],"step_count":1} Jun 20 19:51:39.762285 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:51:39.757311Z","caller":"traceutil/trace.go:171","msg":"trace[1849756255] linearizableReadLoop","detail":"{readStateIndex:1311; appliedIndex:1310; }","duration":"123.137342ms","start":"2025-06-20T19:51:39.634055Z","end":"2025-06-20T19:51:39.757192Z","steps":["trace[1849756255] 'read index received' (duration: 122.924423ms)","trace[1849756255] 'applied index is now lower than readState.Index' (duration: 211.977µs)"],"step_count":2} Jun 20 19:51:39.762285 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:51:39.757923Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"123.581065ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/poddisruptionbudgets/calico-apiserver/calico-apiserver\" limit:1 ","response":"range_response_count:1 size:993"} Jun 20 19:51:39.762285 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:51:39.758032Z","caller":"traceutil/trace.go:171","msg":"trace[1298926321] range","detail":"{range_begin:/registry/poddisruptionbudgets/calico-apiserver/calico-apiserver; range_end:; response_count:1; response_revision:1104; }","duration":"123.985544ms","start":"2025-06-20T19:51:39.634020Z","end":"2025-06-20T19:51:39.758005Z","steps":["trace[1298926321] 'agreement among raft nodes before linearized reading' (duration: 123.468665ms)"],"step_count":1} Jun 20 19:51:39.762285 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:51:39.758080Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"105.546406ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/clusterinformations/default\" limit:1 ","response":"range_response_count:1 size:886"} Jun 20 19:51:39.770886 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:51:39.758140Z","caller":"traceutil/trace.go:171","msg":"trace[1295690235] range","detail":"{range_begin:/registry/crd.projectcalico.org/clusterinformations/default; range_end:; response_count:1; response_revision:1104; }","duration":"105.668705ms","start":"2025-06-20T19:51:39.652442Z","end":"2025-06-20T19:51:39.758111Z","steps":["trace[1295690235] 'agreement among raft nodes before linearized reading' (duration: 105.523613ms)"],"step_count":1} Jun 20 19:51:44.513954 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:51:44.511886Z","caller":"traceutil/trace.go:171","msg":"trace[272742806] transaction","detail":"{read_only:false; response_revision:1128; number_of_response:1; }","duration":"103.480211ms","start":"2025-06-20T19:51:44.408312Z","end":"2025-06-20T19:51:44.511792Z","steps":["trace[272742806] 'process raft request' (duration: 103.307394ms)"],"step_count":1} Jun 20 19:51:45.333723 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:51:45.332202Z","caller":"traceutil/trace.go:171","msg":"trace[1104053149] linearizableReadLoop","detail":"{readStateIndex:1379; appliedIndex:1378; }","duration":"139.9492ms","start":"2025-06-20T19:51:45.192153Z","end":"2025-06-20T19:51:45.332102Z","steps":["trace[1104053149] 'read index received' (duration: 139.492546ms)","trace[1104053149] 'applied index is now lower than readState.Index' (duration: 455.502µs)"],"step_count":2} Jun 20 19:51:45.333723 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:51:45.332771Z","caller":"traceutil/trace.go:171","msg":"trace[1547543474] transaction","detail":"{read_only:false; response_revision:1131; number_of_response:1; }","duration":"145.506561ms","start":"2025-06-20T19:51:45.187235Z","end":"2025-06-20T19:51:45.332742Z","steps":["trace[1547543474] 'process raft request' (duration: 144.512894ms)"],"step_count":1} Jun 20 19:51:45.335483 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:51:45.334647Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"140.963296ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/clusterrolebindings/calico-apiserver-webhook-reader\" limit:1 ","response":"range_response_count:1 size:663"} Jun 20 19:51:45.335483 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:51:45.334783Z","caller":"traceutil/trace.go:171","msg":"trace[1500775722] range","detail":"{range_begin:/registry/clusterrolebindings/calico-apiserver-webhook-reader; range_end:; response_count:1; response_revision:1131; }","duration":"142.638742ms","start":"2025-06-20T19:51:45.192114Z","end":"2025-06-20T19:51:45.334753Z","steps":["trace[1500775722] 'agreement among raft nodes before linearized reading' (duration: 140.336331ms)"],"step_count":1} Jun 20 19:51:45.356335 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:51:45.355694Z","caller":"traceutil/trace.go:171","msg":"trace[560630577] transaction","detail":"{read_only:false; response_revision:1132; number_of_response:1; }","duration":"125.006475ms","start":"2025-06-20T19:51:45.230662Z","end":"2025-06-20T19:51:45.355668Z","steps":["trace[560630577] 'process raft request' (duration: 124.849618ms)"],"step_count":1} Jun 20 19:51:45.724252 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:51:45.722842Z","caller":"traceutil/trace.go:171","msg":"trace[934143495] transaction","detail":"{read_only:false; response_revision:1152; number_of_response:1; }","duration":"177.57715ms","start":"2025-06-20T19:51:45.545223Z","end":"2025-06-20T19:51:45.722800Z","steps":["trace[934143495] 'process raft request' (duration: 117.84891ms)","trace[934143495] 'compare' (duration: 59.491282ms)"],"step_count":2} Jun 20 19:51:45.726161 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:51:45.724355Z","caller":"traceutil/trace.go:171","msg":"trace[1119539209] linearizableReadLoop","detail":"{readStateIndex:1403; appliedIndex:1400; }","duration":"172.003478ms","start":"2025-06-20T19:51:45.552325Z","end":"2025-06-20T19:51:45.724328Z","steps":["trace[1119539209] 'read index received' (duration: 110.755157ms)","trace[1119539209] 'applied index is now lower than readState.Index' (duration: 61.247169ms)"],"step_count":2} Jun 20 19:51:45.726161 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:51:45.724508Z","caller":"traceutil/trace.go:171","msg":"trace[513808424] transaction","detail":"{read_only:false; response_revision:1153; number_of_response:1; }","duration":"178.046445ms","start":"2025-06-20T19:51:45.546439Z","end":"2025-06-20T19:51:45.724486Z","steps":["trace[513808424] 'process raft request' (duration: 177.499372ms)"],"step_count":1} Jun 20 19:51:45.726161 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:51:45.724866Z","caller":"traceutil/trace.go:171","msg":"trace[2073783631] transaction","detail":"{read_only:false; response_revision:1154; number_of_response:1; }","duration":"175.792767ms","start":"2025-06-20T19:51:45.549020Z","end":"2025-06-20T19:51:45.724813Z","steps":["trace[2073783631] 'process raft request' (duration: 175.069651ms)"],"step_count":1} Jun 20 19:51:45.726161 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:51:45.725378Z","caller":"traceutil/trace.go:171","msg":"trace[1980751151] transaction","detail":"{read_only:false; response_revision:1155; number_of_response:1; }","duration":"172.990222ms","start":"2025-06-20T19:51:45.552341Z","end":"2025-06-20T19:51:45.725331Z","steps":["trace[1980751151] 'process raft request' (duration: 171.846791ms)"],"step_count":1} Jun 20 19:51:45.727986 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:51:45.726475Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"173.22752ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/deployments/calico-apiserver/calico-apiserver\" limit:1 ","response":"range_response_count:1 size:4856"} Jun 20 19:51:45.728360 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:51:45.727816Z","caller":"traceutil/trace.go:171","msg":"trace[1912936088] range","detail":"{range_begin:/registry/deployments/calico-apiserver/calico-apiserver; range_end:; response_count:1; response_revision:1155; }","duration":"175.476832ms","start":"2025-06-20T19:51:45.552291Z","end":"2025-06-20T19:51:45.727768Z","steps":["trace[1912936088] 'agreement among raft nodes before linearized reading' (duration: 173.223744ms)"],"step_count":1} Jun 20 19:51:45.740457 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:51:45.739965Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"111.060584ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/services/endpoints/calico-system/calico-typha\" limit:1 ","response":"range_response_count:1 size:788"} Jun 20 19:51:45.741414 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:51:45.740351Z","caller":"traceutil/trace.go:171","msg":"trace[1559395535] range","detail":"{range_begin:/registry/services/endpoints/calico-system/calico-typha; range_end:; response_count:1; response_revision:1156; }","duration":"111.49741ms","start":"2025-06-20T19:51:45.628831Z","end":"2025-06-20T19:51:45.740328Z","steps":["trace[1559395535] 'agreement among raft nodes before linearized reading' (duration: 110.881886ms)"],"step_count":1} Jun 20 19:51:47.614812 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:51:47.613752Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"118.004291ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/masterleases/172.24.4.123\" limit:1 ","response":"range_response_count:1 size:131"} Jun 20 19:51:47.614812 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:51:47.613832Z","caller":"traceutil/trace.go:171","msg":"trace[657254737] range","detail":"{range_begin:/registry/masterleases/172.24.4.123; range_end:; response_count:1; response_revision:1202; }","duration":"118.125429ms","start":"2025-06-20T19:51:47.495690Z","end":"2025-06-20T19:51:47.613815Z","steps":["trace[657254737] 'range keys from in-memory index tree' (duration: 117.863866ms)"],"step_count":1} Jun 20 19:51:47.614812 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:51:47.613787Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"167.505065ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/whiskers/default\" limit:1 ","response":"range_response_count:1 size:948"} Jun 20 19:51:47.614812 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:51:47.613909Z","caller":"traceutil/trace.go:171","msg":"trace[1775672683] range","detail":"{range_begin:/registry/operator.tigera.io/whiskers/default; range_end:; response_count:1; response_revision:1202; }","duration":"167.66604ms","start":"2025-06-20T19:51:47.446221Z","end":"2025-06-20T19:51:47.613887Z","steps":["trace[1775672683] 'range keys from in-memory index tree' (duration: 167.130598ms)"],"step_count":1} Jun 20 19:51:47.614812 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:51:47.614026Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"168.781167ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/clusterroles/calico-crds\" limit:1 ","response":"range_response_count:1 size:1255"} Jun 20 19:51:47.616092 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:51:47.614060Z","caller":"traceutil/trace.go:171","msg":"trace[2033140027] range","detail":"{range_begin:/registry/clusterroles/calico-crds; range_end:; response_count:1; response_revision:1202; }","duration":"168.844707ms","start":"2025-06-20T19:51:47.445205Z","end":"2025-06-20T19:51:47.614050Z","steps":["trace[2033140027] 'range keys from in-memory index tree' (duration: 168.674905ms)"],"step_count":1} Jun 20 19:51:47.943168 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:51:47.941129Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"227.572685ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/serviceaccounts/calico-system/whisker\" limit:1 ","response":"range_response_count:1 size:426"} Jun 20 19:51:47.943168 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:51:47.941239Z","caller":"traceutil/trace.go:171","msg":"trace[941273237] range","detail":"{range_begin:/registry/serviceaccounts/calico-system/whisker; range_end:; response_count:1; response_revision:1203; }","duration":"227.856672ms","start":"2025-06-20T19:51:47.713355Z","end":"2025-06-20T19:51:47.941212Z","steps":["trace[941273237] 'range keys from in-memory index tree' (duration: 227.294639ms)"],"step_count":1} Jun 20 19:51:47.943168 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:51:47.941362Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"195.653214ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/clusterinformations/default\" limit:1 ","response":"range_response_count:1 size:886"} Jun 20 19:51:47.943168 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:51:47.941460Z","caller":"traceutil/trace.go:171","msg":"trace[230687007] range","detail":"{range_begin:/registry/crd.projectcalico.org/clusterinformations/default; range_end:; response_count:1; response_revision:1203; }","duration":"195.785533ms","start":"2025-06-20T19:51:47.745646Z","end":"2025-06-20T19:51:47.941431Z","steps":["trace[230687007] 'range keys from in-memory index tree' (duration: 195.503902ms)"],"step_count":1} Jun 20 19:51:47.943168 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:51:47.942396Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"227.13055ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/clusterroles/calico-extension-apiserver-auth-access\" limit:1 ","response":"range_response_count:1 size:690"} Jun 20 19:51:47.945333 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:51:47.942862Z","caller":"traceutil/trace.go:171","msg":"trace[1619552193] range","detail":"{range_begin:/registry/clusterroles/calico-extension-apiserver-auth-access; range_end:; response_count:1; response_revision:1203; }","duration":"227.62268ms","start":"2025-06-20T19:51:47.715216Z","end":"2025-06-20T19:51:47.942838Z","steps":["trace[1619552193] 'range keys from in-memory index tree' (duration: 226.814092ms)"],"step_count":1} Jun 20 19:51:48.102168 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:51:48.100743Z","caller":"traceutil/trace.go:171","msg":"trace[787323939] linearizableReadLoop","detail":"{readStateIndex:1457; appliedIndex:1456; }","duration":"112.857373ms","start":"2025-06-20T19:51:47.987860Z","end":"2025-06-20T19:51:48.100717Z","steps":["trace[787323939] 'read index received' (duration: 31.331431ms)","trace[787323939] 'applied index is now lower than readState.Index' (duration: 81.518508ms)"],"step_count":2} Jun 20 19:51:48.102168 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:51:48.100882Z","caller":"traceutil/trace.go:171","msg":"trace[536741607] transaction","detail":"{read_only:false; number_of_response:0; response_revision:1204; }","duration":"113.242219ms","start":"2025-06-20T19:51:47.987621Z","end":"2025-06-20T19:51:48.100863Z","steps":["trace[536741607] 'process raft request' (duration: 113.013347ms)"],"step_count":1} Jun 20 19:51:48.102503 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:51:48.101360Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"109.369092ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/networkpolicies/calico-system/whisker\" limit:1 ","response":"range_response_count:1 size:739"} Jun 20 19:51:48.102503 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:51:48.101430Z","caller":"traceutil/trace.go:171","msg":"trace[699598237] range","detail":"{range_begin:/registry/networkpolicies/calico-system/whisker; range_end:; response_count:1; response_revision:1204; }","duration":"109.525258ms","start":"2025-06-20T19:51:47.991889Z","end":"2025-06-20T19:51:48.101414Z","steps":["trace[699598237] 'agreement among raft nodes before linearized reading' (duration: 109.309259ms)"],"step_count":1} Jun 20 19:51:48.102503 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:51:48.101633Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"113.762242ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/rolebindings/kube-system/calico-apiserver-auth-reader\" limit:1 ","response":"range_response_count:1 size:679"} Jun 20 19:51:48.102503 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:51:48.101691Z","caller":"traceutil/trace.go:171","msg":"trace[322625901] range","detail":"{range_begin:/registry/rolebindings/kube-system/calico-apiserver-auth-reader; range_end:; response_count:1; response_revision:1204; }","duration":"113.848004ms","start":"2025-06-20T19:51:47.987829Z","end":"2025-06-20T19:51:48.101677Z","steps":["trace[322625901] 'agreement among raft nodes before linearized reading' (duration: 113.706045ms)"],"step_count":1} Jun 20 19:51:56.825998 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:51:56.821316Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"174.877529ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/gatewayapis.operator.tigera.io\" limit:1 ","response":"range_response_count:1 size:138254"} Jun 20 19:51:56.825998 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:51:56.821810Z","caller":"traceutil/trace.go:171","msg":"trace[1087585325] range","detail":"{range_begin:/registry/apiextensions.k8s.io/customresourcedefinitions/gatewayapis.operator.tigera.io; range_end:; response_count:1; response_revision:1259; }","duration":"175.522929ms","start":"2025-06-20T19:51:56.646154Z","end":"2025-06-20T19:51:56.821677Z","steps":["trace[1087585325] 'range keys from in-memory index tree' (duration: 174.208387ms)"],"step_count":1} Jun 20 19:51:57.697255 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:51:57.695273Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"115.748835ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/serviceaccounts/calico-system/calico-node\" limit:1 ","response":"range_response_count:1 size:525"} Jun 20 19:51:57.697255 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:51:57.695414Z","caller":"traceutil/trace.go:171","msg":"trace[455134348] range","detail":"{range_begin:/registry/serviceaccounts/calico-system/calico-node; range_end:; response_count:1; response_revision:1265; }","duration":"115.905982ms","start":"2025-06-20T19:51:57.579452Z","end":"2025-06-20T19:51:57.695358Z","steps":["trace[455134348] 'range keys from in-memory index tree' (duration: 115.543248ms)"],"step_count":1} Jun 20 19:52:13.776857 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:52:13.770107Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"138.27331ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jun 20 19:52:13.776857 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:52:13.770277Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"132.257026ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/gatewayapis.operator.tigera.io\" limit:1 ","response":"range_response_count:1 size:138254"} Jun 20 19:52:13.776857 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:52:13.771016Z","caller":"traceutil/trace.go:171","msg":"trace[15908110] range","detail":"{range_begin:/registry/apiextensions.k8s.io/customresourcedefinitions/gatewayapis.operator.tigera.io; range_end:; response_count:1; response_revision:1366; }","duration":"132.951758ms","start":"2025-06-20T19:52:13.637936Z","end":"2025-06-20T19:52:13.770888Z","steps":["trace[15908110] 'range keys from in-memory index tree' (duration: 131.851823ms)"],"step_count":1} Jun 20 19:52:13.782700 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:52:13.772516Z","caller":"traceutil/trace.go:171","msg":"trace[1454706156] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1366; }","duration":"140.993588ms","start":"2025-06-20T19:52:13.631459Z","end":"2025-06-20T19:52:13.772452Z","steps":["trace[1454706156] 'range keys from in-memory index tree' (duration: 138.000295ms)"],"step_count":1} Jun 20 19:52:14.854525 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:52:14.852613Z","caller":"traceutil/trace.go:171","msg":"trace[1064792528] linearizableReadLoop","detail":"{readStateIndex:1705; appliedIndex:1704; }","duration":"158.48677ms","start":"2025-06-20T19:52:14.693984Z","end":"2025-06-20T19:52:14.852471Z","steps":["trace[1064792528] 'read index received' (duration: 158.459218ms)","trace[1064792528] 'applied index is now lower than readState.Index' (duration: 26.049µs)"],"step_count":2} Jun 20 19:52:14.854525 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:52:14.852827Z","caller":"traceutil/trace.go:171","msg":"trace[648955251] transaction","detail":"{read_only:false; response_revision:1371; number_of_response:1; }","duration":"163.962965ms","start":"2025-06-20T19:52:14.688840Z","end":"2025-06-20T19:52:14.852803Z","steps":["trace[648955251] 'process raft request' (duration: 163.456249ms)"],"step_count":1} Jun 20 19:52:14.854525 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:52:14.852938Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"158.914656ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/globalnetworksets.crd.projectcalico.org\" limit:1 ","response":"range_response_count:1 size:3407"} Jun 20 19:52:14.854525 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:52:14.853039Z","caller":"traceutil/trace.go:171","msg":"trace[1636595835] range","detail":"{range_begin:/registry/apiextensions.k8s.io/customresourcedefinitions/globalnetworksets.crd.projectcalico.org; range_end:; response_count:1; response_revision:1371; }","duration":"159.077513ms","start":"2025-06-20T19:52:14.693908Z","end":"2025-06-20T19:52:14.852985Z","steps":["trace[1636595835] 'agreement among raft nodes before linearized reading' (duration: 158.936638ms)"],"step_count":1} Jun 20 19:52:14.879880 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:52:14.878218Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"169.376288ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/minions\" limit:1 ","response":"range_response_count:0 size:5"} Jun 20 19:52:14.879880 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:52:14.878330Z","caller":"traceutil/trace.go:171","msg":"trace[1106178219] range","detail":"{range_begin:/registry/minions; range_end:; response_count:0; response_revision:1372; }","duration":"169.536601ms","start":"2025-06-20T19:52:14.708765Z","end":"2025-06-20T19:52:14.878302Z","steps":["trace[1106178219] 'agreement among raft nodes before linearized reading' (duration: 169.380658ms)"],"step_count":1} Jun 20 19:52:14.879880 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:52:14.878761Z","caller":"traceutil/trace.go:171","msg":"trace[2064144779] transaction","detail":"{read_only:false; response_revision:1372; number_of_response:1; }","duration":"143.996603ms","start":"2025-06-20T19:52:14.734505Z","end":"2025-06-20T19:52:14.878502Z","steps":["trace[2064144779] 'process raft request' (duration: 143.405419ms)"],"step_count":1} Jun 20 19:52:29.969337 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:52:29.955950Z","caller":"traceutil/trace.go:171","msg":"trace[2090155275] transaction","detail":"{read_only:false; response_revision:1436; number_of_response:1; }","duration":"155.731601ms","start":"2025-06-20T19:52:29.799741Z","end":"2025-06-20T19:52:29.955473Z","steps":["trace[2090155275] 'process raft request' (duration: 104.117008ms)","trace[2090155275] 'compare' (duration: 42.550169ms)"],"step_count":2} Jun 20 19:52:29.969337 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:52:29.956966Z","caller":"traceutil/trace.go:171","msg":"trace[1976244714] transaction","detail":"{read_only:false; response_revision:1437; number_of_response:1; }","duration":"144.241908ms","start":"2025-06-20T19:52:29.812648Z","end":"2025-06-20T19:52:29.956890Z","steps":["trace[1976244714] 'process raft request' (duration: 134.34187ms)"],"step_count":1} Jun 20 19:52:49.565473 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:52:49.560863Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127077508,"retry-timeout":"500ms"} Jun 20 19:52:50.063893 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:52:50.063229Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127077508,"retry-timeout":"500ms"} Jun 20 19:52:50.484955 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:52:50.484213Z","caller":"wal/wal.go:805","msg":"slow fdatasync","took":"1.425833432s","expected-duration":"1s"} Jun 20 19:52:50.485879 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:52:50.485421Z","caller":"traceutil/trace.go:171","msg":"trace[606774214] transaction","detail":"{read_only:false; response_revision:1495; number_of_response:1; }","duration":"1.427063547s","start":"2025-06-20T19:52:49.057890Z","end":"2025-06-20T19:52:50.484953Z","steps":["trace[606774214] 'process raft request' (duration: 1.426660769s)"],"step_count":1} Jun 20 19:52:50.486762 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:52:50.486336Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:52:49.057861Z","time spent":"1.427761139s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":489,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jun 20 19:52:51.100086 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:52:51.097823Z","caller":"traceutil/trace.go:171","msg":"trace[1243963376] transaction","detail":"{read_only:false; response_revision:1496; number_of_response:1; }","duration":"1.879110203s","start":"2025-06-20T19:52:49.218686Z","end":"2025-06-20T19:52:51.097796Z","steps":["trace[1243963376] 'process raft request' (duration: 1.874953179s)"],"step_count":1} Jun 20 19:52:51.100086 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:52:51.097978Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:52:49.218634Z","time spent":"1.87926817s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":536,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jun 20 19:52:51.102212 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:52:51.098273Z","caller":"traceutil/trace.go:171","msg":"trace[1585326098] transaction","detail":"{read_only:false; response_revision:1497; number_of_response:1; }","duration":"1.003744923s","start":"2025-06-20T19:52:50.094516Z","end":"2025-06-20T19:52:51.098261Z","steps":["trace[1585326098] 'process raft request' (duration: 1.003029336s)"],"step_count":1} Jun 20 19:52:51.102212 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:52:51.098340Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:52:50.094464Z","time spent":"1.003846673s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":489,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jun 20 19:52:51.102212 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:52:51.098314Z","caller":"traceutil/trace.go:171","msg":"trace[220577363] transaction","detail":"{read_only:false; response_revision:1498; number_of_response:1; }","duration":"335.805077ms","start":"2025-06-20T19:52:50.762056Z","end":"2025-06-20T19:52:51.097861Z","steps":["trace[220577363] 'process raft request' (duration: 335.689048ms)"],"step_count":1} Jun 20 19:52:51.102212 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:52:51.098443Z","caller":"traceutil/trace.go:171","msg":"trace[842732715] linearizableReadLoop","detail":"{readStateIndex:1850; appliedIndex:1848; }","duration":"2.038364244s","start":"2025-06-20T19:52:49.060054Z","end":"2025-06-20T19:52:51.098418Z","steps":["trace[842732715] 'read index received' (duration: 1.424774148s)","trace[842732715] 'applied index is now lower than readState.Index' (duration: 613.589144ms)"],"step_count":2} Jun 20 19:52:51.102939 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:52:51.098494Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:52:50.761976Z","time spent":"336.427446ms","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":517,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jun 20 19:52:51.102939 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:52:51.098701Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.038588816s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/secrets/calico-system/typha-certs\" limit:1 ","response":"range_response_count:1 size:4582"} Jun 20 19:52:51.102939 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:52:51.098803Z","caller":"traceutil/trace.go:171","msg":"trace[482978595] range","detail":"{range_begin:/registry/secrets/calico-system/typha-certs; range_end:; response_count:1; response_revision:1498; }","duration":"2.038729271s","start":"2025-06-20T19:52:49.060024Z","end":"2025-06-20T19:52:51.098753Z","steps":["trace[482978595] 'agreement among raft nodes before linearized reading' (duration: 2.038489048s)"],"step_count":1} Jun 20 19:52:51.102939 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:52:51.098839Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:52:49.060010Z","time spent":"2.038816484s","remote":"172.24.4.123:60024","response type":"/etcdserverpb.KV/Range","request count":0,"request size":47,"response count":1,"response size":4606,"request content":"key:\"/registry/secrets/calico-system/typha-certs\" limit:1 "} Jun 20 19:52:51.103230 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:52:51.098807Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.741407022s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/bgpfilters/\" range_end:\"/registry/crd.projectcalico.org/bgpfilters0\" count_only:true ","response":"range_response_count:0 size:5"} Jun 20 19:52:51.103230 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:52:51.098927Z","caller":"traceutil/trace.go:171","msg":"trace[35524240] range","detail":"{range_begin:/registry/crd.projectcalico.org/bgpfilters/; range_end:/registry/crd.projectcalico.org/bgpfilters0; response_count:0; response_revision:1498; }","duration":"1.741601156s","start":"2025-06-20T19:52:49.357305Z","end":"2025-06-20T19:52:51.098906Z","steps":["trace[35524240] 'agreement among raft nodes before linearized reading' (duration: 1.741406539s)"],"step_count":1} Jun 20 19:52:51.103230 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:52:51.099013Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:52:49.357281Z","time spent":"1.741708557s","remote":"172.24.4.123:40122","response type":"/etcdserverpb.KV/Range","request count":0,"request size":92,"response count":0,"response size":29,"request content":"key:\"/registry/crd.projectcalico.org/bgpfilters/\" range_end:\"/registry/crd.projectcalico.org/bgpfilters0\" count_only:true "} Jun 20 19:52:51.103230 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:52:51.099052Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"819.784415ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/horizontalpodautoscalers/\" range_end:\"/registry/horizontalpodautoscalers0\" count_only:true ","response":"range_response_count:0 size:5"} Jun 20 19:52:51.103523 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:52:51.099130Z","caller":"traceutil/trace.go:171","msg":"trace[388758297] range","detail":"{range_begin:/registry/horizontalpodautoscalers/; range_end:/registry/horizontalpodautoscalers0; response_count:0; response_revision:1498; }","duration":"819.950338ms","start":"2025-06-20T19:52:50.279168Z","end":"2025-06-20T19:52:51.099119Z","steps":["trace[388758297] 'agreement among raft nodes before linearized reading' (duration: 819.83499ms)"],"step_count":1} Jun 20 19:52:51.103523 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:52:51.099210Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:52:50.279140Z","time spent":"820.045858ms","remote":"172.24.4.123:60168","response type":"/etcdserverpb.KV/Range","request count":0,"request size":76,"response count":0,"response size":29,"request content":"key:\"/registry/horizontalpodautoscalers/\" range_end:\"/registry/horizontalpodautoscalers0\" count_only:true "} Jun 20 19:52:51.103523 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:52:51.099263Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.423410732s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/services/endpoints/calico-system/calico-typha\" limit:1 ","response":"range_response_count:1 size:788"} Jun 20 19:52:51.103523 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:52:51.099316Z","caller":"traceutil/trace.go:171","msg":"trace[190792901] range","detail":"{range_begin:/registry/services/endpoints/calico-system/calico-typha; range_end:; response_count:1; response_revision:1498; }","duration":"1.423521151s","start":"2025-06-20T19:52:49.675778Z","end":"2025-06-20T19:52:51.099299Z","steps":["trace[190792901] 'agreement among raft nodes before linearized reading' (duration: 1.423353114s)"],"step_count":1} Jun 20 19:52:51.103794 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:52:51.099392Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:52:49.675759Z","time spent":"1.423590111s","remote":"172.24.4.123:60126","response type":"/etcdserverpb.KV/Range","request count":0,"request size":59,"response count":1,"response size":812,"request content":"key:\"/registry/services/endpoints/calico-system/calico-typha\" limit:1 "} Jun 20 19:52:51.103794 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:52:51.099475Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"123.12256ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/clusterinformations/default\" limit:1 ","response":"range_response_count:1 size:886"} Jun 20 19:52:51.103794 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:52:51.099505Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.456623149s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jun 20 19:52:51.103794 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:52:51.101108Z","caller":"traceutil/trace.go:171","msg":"trace[1993248587] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1498; }","duration":"1.458261313s","start":"2025-06-20T19:52:49.642834Z","end":"2025-06-20T19:52:51.101095Z","steps":["trace[1993248587] 'agreement among raft nodes before linearized reading' (duration: 1.456643788s)"],"step_count":1} Jun 20 19:52:51.103794 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:52:51.099791Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"613.52882ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/stagedglobalnetworkpolicies/\" range_end:\"/registry/crd.projectcalico.org/stagedglobalnetworkpolicies0\" count_only:true ","response":"range_response_count:0 size:5"} Jun 20 19:52:51.104057 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:52:51.101256Z","caller":"traceutil/trace.go:171","msg":"trace[1718182323] range","detail":"{range_begin:/registry/crd.projectcalico.org/stagedglobalnetworkpolicies/; range_end:/registry/crd.projectcalico.org/stagedglobalnetworkpolicies0; response_count:0; response_revision:1498; }","duration":"615.029524ms","start":"2025-06-20T19:52:50.486215Z","end":"2025-06-20T19:52:51.101245Z","steps":["trace[1718182323] 'agreement among raft nodes before linearized reading' (duration: 613.43862ms)"],"step_count":1} Jun 20 19:52:51.104057 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:52:51.101345Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:52:49.642808Z","time spent":"1.458374646s","remote":"172.24.4.123:59934","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":29,"request content":"key:\"/registry/health\" "} Jun 20 19:52:51.104057 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:52:51.099505Z","caller":"traceutil/trace.go:171","msg":"trace[1707354752] range","detail":"{range_begin:/registry/crd.projectcalico.org/clusterinformations/default; range_end:; response_count:1; response_revision:1498; }","duration":"123.196009ms","start":"2025-06-20T19:52:50.976300Z","end":"2025-06-20T19:52:51.099496Z","steps":["trace[1707354752] 'agreement among raft nodes before linearized reading' (duration: 123.008757ms)"],"step_count":1} Jun 20 19:52:51.104057 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:52:51.101444Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:52:50.486135Z","time spent":"615.253966ms","remote":"172.24.4.123:40092","response type":"/etcdserverpb.KV/Range","request count":0,"request size":126,"response count":0,"response size":29,"request content":"key:\"/registry/crd.projectcalico.org/stagedglobalnetworkpolicies/\" range_end:\"/registry/crd.projectcalico.org/stagedglobalnetworkpolicies0\" count_only:true "} Jun 20 19:52:53.133787 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:52:53.126848Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127077583,"retry-timeout":"500ms"} Jun 20 19:52:53.628773 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:52:53.627930Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127077583,"retry-timeout":"500ms"} Jun 20 19:52:53.900019 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:52:53.898184Z","caller":"wal/wal.go:805","msg":"slow fdatasync","took":"1.404965083s","expected-duration":"1s"} Jun 20 19:52:53.900524 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:52:53.899130Z","caller":"traceutil/trace.go:171","msg":"trace[1325049883] transaction","detail":"{read_only:false; response_revision:1499; number_of_response:1; }","duration":"1.405982968s","start":"2025-06-20T19:52:52.493101Z","end":"2025-06-20T19:52:53.899084Z","steps":["trace[1325049883] 'process raft request' (duration: 1.405659169s)"],"step_count":1} Jun 20 19:52:53.900524 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:52:53.899272Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:52:52.493073Z","time spent":"1.406119817s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":490,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jun 20 19:52:54.628068 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:52:54.626839Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.000408782s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context deadline exceeded"} Jun 20 19:52:54.628068 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:52:54.627024Z","caller":"traceutil/trace.go:171","msg":"trace[1140247530] range","detail":"{range_begin:/registry/health; range_end:; }","duration":"2.000680944s","start":"2025-06-20T19:52:52.626322Z","end":"2025-06-20T19:52:54.627003Z","steps":["trace[1140247530] 'agreement among raft nodes before linearized reading' (duration: 2.000477661s)"],"step_count":1} Jun 20 19:52:54.628068 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:52:54.627165Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:52:52.626299Z","time spent":"2.000847637s","remote":"172.24.4.123:59934","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "} Jun 20 19:52:54.900495 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:52:54.896388Z","caller":"traceutil/trace.go:171","msg":"trace[696479128] transaction","detail":"{read_only:false; response_revision:1500; number_of_response:1; }","duration":"2.329942916s","start":"2025-06-20T19:52:52.566309Z","end":"2025-06-20T19:52:54.896252Z","steps":["trace[696479128] 'process raft request' (duration: 2.329483281s)"],"step_count":1} Jun 20 19:52:54.900495 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:52:54.897784Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:52:52.566255Z","time spent":"2.33112519s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":625,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jun 20 19:52:55.042627 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:52:55.041837Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"145.581178ms","expected-duration":"100ms","prefix":"","request":"header: lease_revoke:","response":"size:29"} Jun 20 19:52:55.044410 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:52:55.043129Z","caller":"traceutil/trace.go:171","msg":"trace[565168369] transaction","detail":"{read_only:false; response_revision:1501; number_of_response:1; }","duration":"1.928034526s","start":"2025-06-20T19:52:53.115066Z","end":"2025-06-20T19:52:55.043101Z","steps":["trace[565168369] 'process raft request' (duration: 1.926875926s)"],"step_count":1} Jun 20 19:52:55.044410 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:52:55.043327Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:52:53.115029Z","time spent":"1.928217732s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":516,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jun 20 19:52:55.045423 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:52:55.043985Z","caller":"traceutil/trace.go:171","msg":"trace[645768317] linearizableReadLoop","detail":"{readStateIndex:1860; appliedIndex:1856; }","duration":"2.417528145s","start":"2025-06-20T19:52:52.626434Z","end":"2025-06-20T19:52:55.043962Z","steps":["trace[645768317] 'read index received' (duration: 1.273603803s)","trace[645768317] 'applied index is now lower than readState.Index' (duration: 1.143921748s)"],"step_count":2} Jun 20 19:52:55.045423 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:52:55.044555Z","caller":"traceutil/trace.go:171","msg":"trace[1630174808] transaction","detail":"{read_only:false; response_revision:1502; number_of_response:1; }","duration":"1.918504341s","start":"2025-06-20T19:52:53.126028Z","end":"2025-06-20T19:52:55.044532Z","steps":["trace[1630174808] 'process raft request' (duration: 1.917018836s)"],"step_count":1} Jun 20 19:52:55.048371 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:52:55.045361Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:52:53.125969Z","time spent":"1.918775992s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":489,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jun 20 19:52:55.048371 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:52:55.046903Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"120.618135ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jun 20 19:52:55.048371 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:52:55.046993Z","caller":"traceutil/trace.go:171","msg":"trace[1730162066] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1502; }","duration":"120.754051ms","start":"2025-06-20T19:52:54.926217Z","end":"2025-06-20T19:52:55.046971Z","steps":["trace[1730162066] 'agreement among raft nodes before linearized reading' (duration: 120.516945ms)"],"step_count":1} Jun 20 19:52:55.050805 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:52:55.047749Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"419.542633ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jun 20 19:52:55.050805 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:52:55.048164Z","caller":"traceutil/trace.go:171","msg":"trace[1858239398] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1502; }","duration":"420.061299ms","start":"2025-06-20T19:52:54.628027Z","end":"2025-06-20T19:52:55.048089Z","steps":["trace[1858239398] 'agreement among raft nodes before linearized reading' (duration: 419.614779ms)"],"step_count":1} Jun 20 19:52:55.050805 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:52:55.048507Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:52:54.628005Z","time spent":"420.477712ms","remote":"172.24.4.123:59944","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":29,"request content":"key:\"/registry/health\" "} Jun 20 19:52:55.051763 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:52:55.050855Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.411948493s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/ippools/\" range_end:\"/registry/crd.projectcalico.org/ippools0\" count_only:true ","response":"range_response_count:0 size:7"} Jun 20 19:52:55.052340 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:52:55.051352Z","caller":"traceutil/trace.go:171","msg":"trace[913654790] range","detail":"{range_begin:/registry/crd.projectcalico.org/ippools/; range_end:/registry/crd.projectcalico.org/ippools0; response_count:0; response_revision:1502; }","duration":"2.412484141s","start":"2025-06-20T19:52:52.638659Z","end":"2025-06-20T19:52:55.051143Z","steps":["trace[913654790] 'agreement among raft nodes before linearized reading' (duration: 2.411805484s)"],"step_count":1} Jun 20 19:52:55.052340 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:52:55.051818Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:52:52.638641Z","time spent":"2.412973832s","remote":"172.24.4.123:46764","response type":"/etcdserverpb.KV/Range","request count":0,"request size":86,"response count":1,"response size":31,"request content":"key:\"/registry/crd.projectcalico.org/ippools/\" range_end:\"/registry/crd.projectcalico.org/ippools0\" count_only:true "} Jun 20 19:52:55.053392 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:52:55.053077Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.423991336s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/installations.operator.tigera.io\" limit:1 ","response":"range_response_count:1 size:630504"} Jun 20 19:52:55.055271 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:52:55.053151Z","caller":"traceutil/trace.go:171","msg":"trace[790422450] range","detail":"{range_begin:/registry/apiextensions.k8s.io/customresourcedefinitions/installations.operator.tigera.io; range_end:; response_count:1; response_revision:1502; }","duration":"2.424099169s","start":"2025-06-20T19:52:52.629035Z","end":"2025-06-20T19:52:55.053135Z","steps":["trace[790422450] 'agreement among raft nodes before linearized reading' (duration: 2.416108744s)"],"step_count":1} Jun 20 19:52:55.055271 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:52:55.053895Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:52:52.629022Z","time spent":"2.424836627s","remote":"172.24.4.123:59980","response type":"/etcdserverpb.KV/Range","request count":0,"request size":93,"response count":1,"response size":630528,"request content":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/installations.operator.tigera.io\" limit:1 "} Jun 20 19:52:55.527006 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:52:55.526377Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"157.862068ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/felixconfigurations/default\" limit:1 ","response":"range_response_count:1 size:1727"} Jun 20 19:52:55.527006 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:52:55.526469Z","caller":"traceutil/trace.go:171","msg":"trace[1667728048] range","detail":"{range_begin:/registry/crd.projectcalico.org/felixconfigurations/default; range_end:; response_count:1; response_revision:1502; }","duration":"157.982667ms","start":"2025-06-20T19:52:55.368450Z","end":"2025-06-20T19:52:55.526432Z","steps":["trace[1667728048] 'range keys from in-memory index tree' (duration: 157.535275ms)"],"step_count":1} Jun 20 19:52:59.585899 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:52:59.582030Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127077769,"retry-timeout":"500ms"} Jun 20 19:53:00.084516 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:00.083607Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127077769,"retry-timeout":"500ms"} Jun 20 19:53:00.101756 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:00.100118Z","caller":"wal/wal.go:805","msg":"slow fdatasync","took":"1.022583354s","expected-duration":"1s"} Jun 20 19:53:00.102368 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:00.101209Z","caller":"traceutil/trace.go:171","msg":"trace[811203834] transaction","detail":"{read_only:false; response_revision:1512; number_of_response:1; }","duration":"1.023698492s","start":"2025-06-20T19:52:59.077391Z","end":"2025-06-20T19:53:00.101089Z","steps":["trace[811203834] 'process raft request' (duration: 1.02305967s)"],"step_count":1} Jun 20 19:53:00.104106 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:00.102934Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:52:59.077368Z","time spent":"1.023976576s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":516,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jun 20 19:53:00.231964 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:00.229906Z","caller":"traceutil/trace.go:171","msg":"trace[515154058] transaction","detail":"{read_only:false; response_revision:1513; number_of_response:1; }","duration":"1.150633169s","start":"2025-06-20T19:52:59.079234Z","end":"2025-06-20T19:53:00.229867Z","steps":["trace[515154058] 'process raft request' (duration: 1.146879878s)"],"step_count":1} Jun 20 19:53:00.231964 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:00.230140Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:52:59.079211Z","time spent":"1.150810673s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":489,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jun 20 19:53:00.231964 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:00.231002Z","caller":"traceutil/trace.go:171","msg":"trace[571506709] linearizableReadLoop","detail":"{readStateIndex:1873; appliedIndex:1870; }","duration":"1.148887817s","start":"2025-06-20T19:52:59.081753Z","end":"2025-06-20T19:53:00.230641Z","steps":["trace[571506709] 'read index received' (duration: 1.019251887s)","trace[571506709] 'applied index is now lower than readState.Index' (duration: 129.630119ms)"],"step_count":2} Jun 20 19:53:00.233187 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:00.231883Z","caller":"traceutil/trace.go:171","msg":"trace[969652126] transaction","detail":"{read_only:false; response_revision:1514; number_of_response:1; }","duration":"303.037923ms","start":"2025-06-20T19:52:59.928382Z","end":"2025-06-20T19:53:00.231420Z","steps":["trace[969652126] 'process raft request' (duration: 301.365256ms)"],"step_count":1} Jun 20 19:53:00.233187 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:00.231877Z","caller":"traceutil/trace.go:171","msg":"trace[561806847] transaction","detail":"{read_only:false; response_revision:1515; number_of_response:1; }","duration":"142.790117ms","start":"2025-06-20T19:53:00.088881Z","end":"2025-06-20T19:53:00.231671Z","steps":["trace[561806847] 'process raft request' (duration: 141.355647ms)"],"step_count":1} Jun 20 19:53:00.234722 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:00.232260Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:52:59.928341Z","time spent":"303.820254ms","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":490,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jun 20 19:53:00.234722 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:00.233326Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"599.178641ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jun 20 19:53:00.234722 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:00.233454Z","caller":"traceutil/trace.go:171","msg":"trace[220009832] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1515; }","duration":"599.33715ms","start":"2025-06-20T19:52:59.634081Z","end":"2025-06-20T19:53:00.233418Z","steps":["trace[220009832] 'agreement among raft nodes before linearized reading' (duration: 599.177209ms)"],"step_count":1} Jun 20 19:53:00.234722 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:00.233557Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:52:59.634051Z","time spent":"599.483787ms","remote":"172.24.4.123:59934","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":29,"request content":"key:\"/registry/health\" "} Jun 20 19:53:00.236335 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:00.234876Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"252.555004ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/controllers/\" range_end:\"/registry/controllers0\" count_only:true ","response":"range_response_count:0 size:5"} Jun 20 19:53:00.236335 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:00.235201Z","caller":"traceutil/trace.go:171","msg":"trace[1340669251] range","detail":"{range_begin:/registry/controllers/; range_end:/registry/controllers0; response_count:0; response_revision:1515; }","duration":"252.985834ms","start":"2025-06-20T19:52:59.982192Z","end":"2025-06-20T19:53:00.235178Z","steps":["trace[1340669251] 'agreement among raft nodes before linearized reading' (duration: 252.566355ms)"],"step_count":1} Jun 20 19:53:00.237112 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:00.235748Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.153894045s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/clusterroles/calico-typha\" limit:1 ","response":"range_response_count:1 size:1668"} Jun 20 19:53:00.237112 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:00.235968Z","caller":"traceutil/trace.go:171","msg":"trace[1162772242] range","detail":"{range_begin:/registry/clusterroles/calico-typha; range_end:; response_count:1; response_revision:1515; }","duration":"1.154128276s","start":"2025-06-20T19:52:59.081716Z","end":"2025-06-20T19:53:00.235845Z","steps":["trace[1162772242] 'agreement among raft nodes before linearized reading' (duration: 1.152638263s)"],"step_count":1} Jun 20 19:53:00.237112 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:00.236289Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:52:59.081667Z","time spent":"1.15458741s","remote":"172.24.4.123:60300","response type":"/etcdserverpb.KV/Range","request count":0,"request size":39,"response count":1,"response size":1692,"request content":"key:\"/registry/clusterroles/calico-typha\" limit:1 "} Jun 20 19:53:05.972847 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:05.971623Z","caller":"traceutil/trace.go:171","msg":"trace[997498335] transaction","detail":"{read_only:false; response_revision:1554; number_of_response:1; }","duration":"207.223351ms","start":"2025-06-20T19:53:05.764281Z","end":"2025-06-20T19:53:05.971504Z","steps":["trace[997498335] 'process raft request' (duration: 148.150001ms)","trace[997498335] 'compare' (duration: 58.920774ms)"],"step_count":2} Jun 20 19:53:05.987318 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:05.986211Z","caller":"traceutil/trace.go:171","msg":"trace[849968466] linearizableReadLoop","detail":"{readStateIndex:1918; appliedIndex:1916; }","duration":"163.656249ms","start":"2025-06-20T19:53:05.822530Z","end":"2025-06-20T19:53:05.986186Z","steps":["trace[849968466] 'read index received' (duration: 89.908023ms)","trace[849968466] 'applied index is now lower than readState.Index' (duration: 73.747204ms)"],"step_count":2} Jun 20 19:53:05.987318 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:05.986286Z","caller":"traceutil/trace.go:171","msg":"trace[2035383278] transaction","detail":"{read_only:false; response_revision:1555; number_of_response:1; }","duration":"221.901382ms","start":"2025-06-20T19:53:05.764353Z","end":"2025-06-20T19:53:05.986254Z","steps":["trace[2035383278] 'process raft request' (duration: 221.691087ms)"],"step_count":1} Jun 20 19:53:05.988369 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:05.987028Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"164.287657ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/felixconfigurations/default\" limit:1 ","response":"range_response_count:1 size:1727"} Jun 20 19:53:05.988678 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:05.987764Z","caller":"traceutil/trace.go:171","msg":"trace[1614249722] range","detail":"{range_begin:/registry/crd.projectcalico.org/felixconfigurations/default; range_end:; response_count:1; response_revision:1555; }","duration":"165.242031ms","start":"2025-06-20T19:53:05.822496Z","end":"2025-06-20T19:53:05.987738Z","steps":["trace[1614249722] 'agreement among raft nodes before linearized reading' (duration: 163.882956ms)"],"step_count":1} Jun 20 19:53:06.020391 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:06.019641Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"142.411146ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/serviceaccounts/kube-system/persistent-volume-binder\" limit:1 ","response":"range_response_count:1 size:214"} Jun 20 19:53:06.020391 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:06.019726Z","caller":"traceutil/trace.go:171","msg":"trace[1676800990] range","detail":"{range_begin:/registry/serviceaccounts/kube-system/persistent-volume-binder; range_end:; response_count:1; response_revision:1556; }","duration":"142.536341ms","start":"2025-06-20T19:53:05.877168Z","end":"2025-06-20T19:53:06.019704Z","steps":["trace[1676800990] 'agreement among raft nodes before linearized reading' (duration: 142.184169ms)"],"step_count":1} Jun 20 19:53:06.232208 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:06.230717Z","caller":"traceutil/trace.go:171","msg":"trace[930587958] transaction","detail":"{read_only:false; response_revision:1557; number_of_response:1; }","duration":"236.418217ms","start":"2025-06-20T19:53:05.994266Z","end":"2025-06-20T19:53:06.230685Z","steps":["trace[930587958] 'process raft request' (duration: 233.919557ms)"],"step_count":1} Jun 20 19:53:06.233742 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:06.230927Z","caller":"traceutil/trace.go:171","msg":"trace[1288390383] linearizableReadLoop","detail":"{readStateIndex:1920; appliedIndex:1919; }","duration":"211.49181ms","start":"2025-06-20T19:53:06.019327Z","end":"2025-06-20T19:53:06.230819Z","steps":["trace[1288390383] 'read index received' (duration: 208.896527ms)","trace[1288390383] 'applied index is now lower than readState.Index' (duration: 2.594221ms)"],"step_count":2} Jun 20 19:53:06.233742 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:06.231866Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"203.3741ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/serviceaccounts/kube-system/persistent-volume-binder\" limit:1 ","response":"range_response_count:1 size:214"} Jun 20 19:53:06.233742 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:06.231933Z","caller":"traceutil/trace.go:171","msg":"trace[83681128] range","detail":"{range_begin:/registry/serviceaccounts/kube-system/persistent-volume-binder; range_end:; response_count:1; response_revision:1558; }","duration":"203.576842ms","start":"2025-06-20T19:53:06.028339Z","end":"2025-06-20T19:53:06.231916Z","steps":["trace[83681128] 'agreement among raft nodes before linearized reading' (duration: 203.410449ms)"],"step_count":1} Jun 20 19:53:06.233742 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:06.232124Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"232.111506ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/namespaces/calico-system\" limit:1 ","response":"range_response_count:1 size:764"} Jun 20 19:53:06.234418 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:06.232166Z","caller":"traceutil/trace.go:171","msg":"trace[874342228] range","detail":"{range_begin:/registry/namespaces/calico-system; range_end:; response_count:1; response_revision:1558; }","duration":"232.186246ms","start":"2025-06-20T19:53:05.999967Z","end":"2025-06-20T19:53:06.232153Z","steps":["trace[874342228] 'agreement among raft nodes before linearized reading' (duration: 231.543897ms)"],"step_count":1} Jun 20 19:53:08.814708 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:08.812704Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078209,"retry-timeout":"500ms"} Jun 20 19:53:09.314047 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:09.313432Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078209,"retry-timeout":"500ms"} Jun 20 19:53:09.814919 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:09.814375Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078209,"retry-timeout":"500ms"} Jun 20 19:53:10.315197 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:10.314771Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078209,"retry-timeout":"500ms"} Jun 20 19:53:10.634145 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:10.633552Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.000342741s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context deadline exceeded"} Jun 20 19:53:10.634145 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:10.633654Z","caller":"traceutil/trace.go:171","msg":"trace[2106426644] range","detail":"{range_begin:/registry/health; range_end:; }","duration":"2.000526317s","start":"2025-06-20T19:53:08.633109Z","end":"2025-06-20T19:53:10.633636Z","steps":["trace[2106426644] 'agreement among raft nodes before linearized reading' (duration: 2.000365704s)"],"step_count":1} Jun 20 19:53:10.634145 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:10.633740Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:08.633090Z","time spent":"2.000630613s","remote":"172.24.4.123:59934","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "} Jun 20 19:53:10.816561 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:10.815869Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078209,"retry-timeout":"500ms"} Jun 20 19:53:11.317171 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:11.316792Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078209,"retry-timeout":"500ms"} Jun 20 19:53:11.818922 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:11.818517Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078209,"retry-timeout":"500ms"} Jun 20 19:53:31.430476 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:12.319080Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078209,"retry-timeout":"500ms"} Jun 20 19:53:31.430476 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:12.634435Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.000053523s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context deadline exceeded"} Jun 20 19:53:31.430476 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:12.634508Z","caller":"traceutil/trace.go:171","msg":"trace[825142765] range","detail":"{range_begin:/registry/health; range_end:; }","duration":"2.000277344s","start":"2025-06-20T19:53:10.634213Z","end":"2025-06-20T19:53:12.634490Z","steps":["trace[825142765] 'agreement among raft nodes before linearized reading' (duration: 2.000174831s)"],"step_count":1} Jun 20 19:53:31.430476 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:12.634638Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:10.634200Z","time spent":"2.000359067s","remote":"172.24.4.123:59944","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "} Jun 20 19:53:31.430476 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:12.820077Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078209,"retry-timeout":"500ms"} Jun 20 19:53:31.430476 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:13.299386Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:08.300436Z","time spent":"4.9989104s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jun 20 19:53:31.432619 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:13.312538Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:08.313465Z","time spent":"4.999068886s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jun 20 19:53:31.432619 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:13.321002Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078209,"retry-timeout":"500ms"} Jun 20 19:53:31.432619 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:13.821271Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078209,"retry-timeout":"500ms"} Jun 20 19:53:31.432619 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:14.322023Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078209,"retry-timeout":"500ms"} Jun 20 19:53:31.432619 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:14.822510Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078209,"retry-timeout":"500ms"} Jun 20 19:53:31.432619 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:15.270464Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:10.272943Z","time spent":"4.997513753s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jun 20 19:53:31.432619 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:15.312806Z","caller":"etcdserver/v3_server.go:932","msg":"timed out waiting for read index response (local node might have slow network)","timeout":"7s"} Jun 20 19:53:31.432958 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:15.313018Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"7.000834086s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/globalnetworkpolicies.crd.projectcalico.org\" limit:1 ","response":"","error":"etcdserver: request timed out"} Jun 20 19:53:31.432958 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:15.313077Z","caller":"traceutil/trace.go:171","msg":"trace[1166919415] range","detail":"{range_begin:/registry/apiextensions.k8s.io/customresourcedefinitions/globalnetworkpolicies.crd.projectcalico.org; range_end:; }","duration":"7.000957008s","start":"2025-06-20T19:53:08.312102Z","end":"2025-06-20T19:53:15.313059Z","steps":["trace[1166919415] 'agreement among raft nodes before linearized reading' (duration: 7.000871847s)"],"step_count":1} Jun 20 19:53:31.432958 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:15.313143Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:08.312080Z","time spent":"7.001044993s","remote":"172.24.4.123:59980","response type":"/etcdserverpb.KV/Range","request count":0,"request size":104,"response count":0,"response size":0,"request content":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/globalnetworkpolicies.crd.projectcalico.org\" limit:1 "} Jun 20 19:53:31.432958 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:15.637249Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:08.636361Z","time spent":"7.000879835s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jun 20 19:53:31.432958 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:15.813509Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078215,"retry-timeout":"500ms"} Jun 20 19:53:31.433183 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:16.318459Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078215,"retry-timeout":"500ms"} Jun 20 19:53:31.433183 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:16.823395Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078215,"retry-timeout":"500ms"} Jun 20 19:53:31.433183 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:17.324258Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078215,"retry-timeout":"500ms"} Jun 20 19:53:31.433183 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:17.668756Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"6.306965631s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/clusterinformations/default\" limit:1 ","response":"","error":"context canceled"} Jun 20 19:53:31.433183 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:17.668882Z","caller":"traceutil/trace.go:171","msg":"trace[640817375] range","detail":"{range_begin:/registry/crd.projectcalico.org/clusterinformations/default; range_end:; }","duration":"6.307155758s","start":"2025-06-20T19:53:11.361700Z","end":"2025-06-20T19:53:17.668856Z","steps":["trace[640817375] 'agreement among raft nodes before linearized reading' (duration: 6.307001889s)"],"step_count":1} Jun 20 19:53:31.433183 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:17.669010Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:11.361683Z","time spent":"6.307303056s","remote":"172.24.4.123:46740","response type":"/etcdserverpb.KV/Range","request count":0,"request size":63,"response count":0,"response size":0,"request content":"key:\"/registry/crd.projectcalico.org/clusterinformations/default\" limit:1 "} Jun 20 19:53:31.433453 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:17.825423Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078215,"retry-timeout":"500ms"} Jun 20 19:53:31.433453 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:18.301045Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"632.697679ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/leases/kube-system/kube-scheduler\" limit:1 ","response":"","error":"context canceled"} Jun 20 19:53:31.433453 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:18.301204Z","caller":"traceutil/trace.go:171","msg":"trace[1058803787] range","detail":"{range_begin:/registry/leases/kube-system/kube-scheduler; range_end:; }","duration":"632.893066ms","start":"2025-06-20T19:53:17.668291Z","end":"2025-06-20T19:53:18.301184Z","steps":["trace[1058803787] 'agreement among raft nodes before linearized reading' (duration: 632.694954ms)"],"step_count":1} Jun 20 19:53:31.433453 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:18.301665Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:17.668252Z","time spent":"633.010276ms","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Range","request count":0,"request size":47,"response count":0,"response size":0,"request content":"key:\"/registry/leases/kube-system/kube-scheduler\" limit:1 "} Jun 20 19:53:31.433453 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:18.326773Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078215,"retry-timeout":"500ms"} Jun 20 19:53:31.433453 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:18.648969Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:11.647968Z","time spent":"7.000989631s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jun 20 19:53:31.433895 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:18.827335Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078215,"retry-timeout":"500ms"} Jun 20 19:53:31.433895 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:19.327823Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078215,"retry-timeout":"500ms"} Jun 20 19:53:31.433895 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:19.655274Z","caller":"etcdserver/server.go:1237","msg":"Failed to check current member's leadership","error":"context deadline exceeded"} Jun 20 19:53:31.433895 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:19.655678Z","caller":"etcdserver/server.go:1177","msg":"Ignore the lease revoking request because current member isn't a leader","local-member-id":10276657743932975437} Jun 20 19:53:31.433895 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:19.828608Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078215,"retry-timeout":"500ms"} Jun 20 19:53:31.433895 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:20.287479Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.619303453s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/leases/kube-system/kube-controller-manager\" limit:1 ","response":"","error":"context canceled"} Jun 20 19:53:31.433895 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:20.287654Z","caller":"traceutil/trace.go:171","msg":"trace[2062161939] range","detail":"{range_begin:/registry/leases/kube-system/kube-controller-manager; range_end:; }","duration":"2.61949853s","start":"2025-06-20T19:53:17.668064Z","end":"2025-06-20T19:53:20.287563Z","steps":["trace[2062161939] 'agreement among raft nodes before linearized reading' (duration: 2.619352104s)"],"step_count":1} Jun 20 19:53:31.434393 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:20.287770Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:17.668027Z","time spent":"2.619717461s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Range","request count":0,"request size":56,"response count":0,"response size":0,"request content":"key:\"/registry/leases/kube-system/kube-controller-manager\" limit:1 "} Jun 20 19:53:31.434393 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:20.329111Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078215,"retry-timeout":"500ms"} Jun 20 19:53:31.434393 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:20.829814Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078215,"retry-timeout":"500ms"} Jun 20 19:53:31.434393 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:21.330121Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078215,"retry-timeout":"500ms"} Jun 20 19:53:31.434393 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:21.831232Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078215,"retry-timeout":"500ms"} Jun 20 19:53:31.434393 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:22.313480Z","caller":"etcdserver/v3_server.go:932","msg":"timed out waiting for read index response (local node might have slow network)","timeout":"7s"} Jun 20 19:53:31.434393 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:22.313778Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"9.195871527s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/minions/ci-4344-1-0-0-4524070979.novalocal\" limit:1 ","response":"","error":"etcdserver: request timed out"} Jun 20 19:53:31.434761 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:22.313847Z","caller":"traceutil/trace.go:171","msg":"trace[322007151] range","detail":"{range_begin:/registry/minions/ci-4344-1-0-0-4524070979.novalocal; range_end:; }","duration":"9.196001411s","start":"2025-06-20T19:53:13.117824Z","end":"2025-06-20T19:53:22.313825Z","steps":["trace[322007151] 'agreement among raft nodes before linearized reading' (duration: 9.195900872s)"],"step_count":1} Jun 20 19:53:31.434761 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:22.313875Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"11.940966593s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/hostendpoints/\" range_end:\"/registry/crd.projectcalico.org/hostendpoints0\" count_only:true ","response":"","error":"etcdserver: request timed out"} Jun 20 19:53:31.434761 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:22.313916Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:13.117807Z","time spent":"9.196084759s","remote":"172.24.4.123:60130","response type":"/etcdserverpb.KV/Range","request count":0,"request size":56,"response count":0,"response size":0,"request content":"key:\"/registry/minions/ci-4344-1-0-0-4524070979.novalocal\" limit:1 "} Jun 20 19:53:31.434761 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:22.313973Z","caller":"traceutil/trace.go:171","msg":"trace[119619793] range","detail":"{range_begin:/registry/crd.projectcalico.org/hostendpoints/; range_end:/registry/crd.projectcalico.org/hostendpoints0; }","duration":"11.941125573s","start":"2025-06-20T19:53:10.372824Z","end":"2025-06-20T19:53:22.313949Z","steps":["trace[119619793] 'agreement among raft nodes before linearized reading' (duration: 11.940981191s)"],"step_count":1} Jun 20 19:53:31.434986 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:22.314073Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:10.372806Z","time spent":"11.941244105s","remote":"172.24.4.123:40014","response type":"/etcdserverpb.KV/Range","request count":0,"request size":98,"response count":0,"response size":0,"request content":"key:\"/registry/crd.projectcalico.org/hostendpoints/\" range_end:\"/registry/crd.projectcalico.org/hostendpoints0\" count_only:true "} Jun 20 19:53:31.434986 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:22.314111Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"13.995624423s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/events/default/test-dynamic-volume-claim.184ad842baff0a9c\" limit:1 ","response":"","error":"etcdserver: request timed out"} Jun 20 19:53:31.434986 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:22.314150Z","caller":"traceutil/trace.go:171","msg":"trace[963625157] range","detail":"{range_begin:/registry/events/default/test-dynamic-volume-claim.184ad842baff0a9c; range_end:; }","duration":"13.995695777s","start":"2025-06-20T19:53:08.318441Z","end":"2025-06-20T19:53:22.314137Z","steps":["trace[963625157] 'agreement among raft nodes before linearized reading' (duration: 13.995659239s)"],"step_count":1} Jun 20 19:53:31.434986 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:22.314175Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"9.253089026s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/ipamconfigs/\" range_end:\"/registry/crd.projectcalico.org/ipamconfigs0\" count_only:true ","response":"","error":"etcdserver: request timed out"} Jun 20 19:53:31.435154 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:22.314189Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:08.318422Z","time spent":"13.995752615s","remote":"172.24.4.123:60016","response type":"/etcdserverpb.KV/Range","request count":0,"request size":71,"response count":0,"response size":0,"request content":"key:\"/registry/events/default/test-dynamic-volume-claim.184ad842baff0a9c\" limit:1 "} Jun 20 19:53:31.435154 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:22.314219Z","caller":"traceutil/trace.go:171","msg":"trace[958793896] range","detail":"{range_begin:/registry/crd.projectcalico.org/ipamconfigs/; range_end:/registry/crd.projectcalico.org/ipamconfigs0; }","duration":"9.253156914s","start":"2025-06-20T19:53:13.061045Z","end":"2025-06-20T19:53:22.314202Z","steps":["trace[958793896] 'agreement among raft nodes before linearized reading' (duration: 9.253117039s)"],"step_count":1} Jun 20 19:53:31.435154 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:22.314288Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:13.060994Z","time spent":"9.253252503s","remote":"172.24.4.123:44292","response type":"/etcdserverpb.KV/Range","request count":0,"request size":94,"response count":0,"response size":0,"request content":"key:\"/registry/crd.projectcalico.org/ipamconfigs/\" range_end:\"/registry/crd.projectcalico.org/ipamconfigs0\" count_only:true "} Jun 20 19:53:31.435154 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:22.314355Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"9.321440132s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/ingress/\" range_end:\"/registry/ingress0\" count_only:true ","response":"","error":"etcdserver: request timed out"} Jun 20 19:53:31.435325 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:22.314074Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"13.791213553s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/\" range_end:\"/registry/apiextensions.k8s.io/customresourcedefinitions0\" count_only:true ","response":"","error":"etcdserver: request timed out"} Jun 20 19:53:31.435325 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:22.314386Z","caller":"traceutil/trace.go:171","msg":"trace[248381962] range","detail":"{range_begin:/registry/ingress/; range_end:/registry/ingress0; }","duration":"9.32149778s","start":"2025-06-20T19:53:12.992878Z","end":"2025-06-20T19:53:22.314375Z","steps":["trace[248381962] 'agreement among raft nodes before linearized reading' (duration: 9.321464147s)"],"step_count":1} Jun 20 19:53:31.435325 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:22.314422Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:12.992859Z","time spent":"9.321550329s","remote":"172.24.4.123:60238","response type":"/etcdserverpb.KV/Range","request count":0,"request size":42,"response count":0,"response size":0,"request content":"key:\"/registry/ingress/\" range_end:\"/registry/ingress0\" count_only:true "} Jun 20 19:53:31.435325 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:22.314422Z","caller":"traceutil/trace.go:171","msg":"trace[1664761812] range","detail":"{range_begin:/registry/apiextensions.k8s.io/customresourcedefinitions/; range_end:/registry/apiextensions.k8s.io/customresourcedefinitions0; }","duration":"13.791642029s","start":"2025-06-20T19:53:08.522762Z","end":"2025-06-20T19:53:22.314404Z","steps":["trace[1664761812] 'agreement among raft nodes before linearized reading' (duration: 13.791259269s)"],"step_count":1} Jun 20 19:53:31.435508 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:22.314505Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:08.522745Z","time spent":"13.791740153s","remote":"172.24.4.123:59980","response type":"/etcdserverpb.KV/Range","request count":0,"request size":120,"response count":0,"response size":0,"request content":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/\" range_end:\"/registry/apiextensions.k8s.io/customresourcedefinitions0\" count_only:true "} Jun 20 19:53:31.435508 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:22.698402Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"5.000121195s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/leases/tigera-operator/operator-lock\" limit:1 ","response":"","error":"context deadline exceeded"} Jun 20 19:53:31.435508 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:22.698524Z","caller":"traceutil/trace.go:171","msg":"trace[1819520040] range","detail":"{range_begin:/registry/leases/tigera-operator/operator-lock; range_end:; }","duration":"5.000297707s","start":"2025-06-20T19:53:17.698193Z","end":"2025-06-20T19:53:22.698491Z","steps":["trace[1819520040] 'agreement among raft nodes before linearized reading' (duration: 5.00014497s)"],"step_count":1} Jun 20 19:53:31.435508 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:22.698665Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:17.698177Z","time spent":"5.000461675s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Range","request count":0,"request size":50,"response count":0,"response size":0,"request content":"key:\"/registry/leases/tigera-operator/operator-lock\" limit:1 "} Jun 20 19:53:31.435508 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:22.814222Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078221,"retry-timeout":"500ms"} Jun 20 19:53:31.435758 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:23.304150Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:18.307314Z","time spent":"4.996825721s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jun 20 19:53:31.435758 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:23.315296Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078221,"retry-timeout":"500ms"} Jun 20 19:53:31.435758 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:23.815850Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078221,"retry-timeout":"500ms"} Jun 20 19:53:31.435758 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:24.316356Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078221,"retry-timeout":"500ms"} Jun 20 19:53:31.435758 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:24.670877Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:17.670706Z","time spent":"7.000159169s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jun 20 19:53:31.435758 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:24.704506Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:17.703253Z","time spent":"7.001236998s","remote":"172.24.4.123:46688","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jun 20 19:53:31.435758 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:24.713534Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:20.302181Z","time spent":"4.411322901s","remote":"172.24.4.123:60016","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jun 20 19:53:31.436094 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:24.748408Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"7.05206204s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/installations/default\" limit:1 ","response":"","error":"context canceled"} Jun 20 19:53:31.436094 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:24.748716Z","caller":"traceutil/trace.go:171","msg":"trace[52807585] range","detail":"{range_begin:/registry/operator.tigera.io/installations/default; range_end:; }","duration":"7.052416918s","start":"2025-06-20T19:53:17.696254Z","end":"2025-06-20T19:53:24.748671Z","steps":["trace[52807585] 'agreement among raft nodes before linearized reading' (duration: 7.052092548s)"],"step_count":1} Jun 20 19:53:31.436094 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:24.748800Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:17.696232Z","time spent":"7.052542854s","remote":"172.24.4.123:46726","response type":"/etcdserverpb.KV/Range","request count":0,"request size":54,"response count":0,"response size":0,"request content":"key:\"/registry/operator.tigera.io/installations/default\" limit:1 "} Jun 20 19:53:31.436094 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:24.817309Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078221,"retry-timeout":"500ms"} Jun 20 19:53:31.436094 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:25.318533Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078221,"retry-timeout":"500ms"} Jun 20 19:53:31.436094 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:25.659259Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:18.658464Z","time spent":"7.000783612s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jun 20 19:53:31.436354 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:25.819209Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078221,"retry-timeout":"500ms"} Jun 20 19:53:31.436354 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:26.320322Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078221,"retry-timeout":"500ms"} Jun 20 19:53:31.436354 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:26.664067Z","caller":"etcdserver/server.go:1237","msg":"Failed to check current member's leadership","error":"context deadline exceeded"} Jun 20 19:53:31.436354 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:26.664174Z","caller":"etcdserver/server.go:1177","msg":"Ignore the lease revoking request because current member isn't a leader","local-member-id":10276657743932975437} Jun 20 19:53:31.436354 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:26.821360Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078221,"retry-timeout":"500ms"} Jun 20 19:53:31.436354 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:27.322378Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078221,"retry-timeout":"500ms"} Jun 20 19:53:31.436354 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:27.822817Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078221,"retry-timeout":"500ms"} Jun 20 19:53:31.436354 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:28.444372Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078221,"retry-timeout":"500ms"} Jun 20 19:53:31.436354 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:28.944584Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078221,"retry-timeout":"500ms"} Jun 20 19:53:31.436788 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:29.445108Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078221,"retry-timeout":"500ms"} Jun 20 19:53:31.436788 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:29.946107Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078221,"retry-timeout":"500ms"} Jun 20 19:53:31.436788 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:30.211764Z","caller":"wal/wal.go:805","msg":"slow fdatasync","took":"21.911205943s","expected-duration":"1s"} Jun 20 19:53:31.436788 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:30.225084Z","caller":"etcdserver/server.go:1237","msg":"Failed to check current member's leadership","error":"context deadline exceeded"} Jun 20 19:53:31.436788 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:30.225370Z","caller":"etcdserver/server.go:1177","msg":"Ignore the lease revoking request because current member isn't a leader","local-member-id":10276657743932975437} Jun 20 19:53:31.710101 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:31.709048Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:24.708371Z","time spent":"7.000663373s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jun 20 19:53:32.223651 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:32.222866Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.997994686s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context canceled"} Jun 20 19:53:32.223651 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:32.222980Z","caller":"traceutil/trace.go:171","msg":"trace[1194751256] range","detail":"{range_begin:/registry/health; range_end:; }","duration":"1.998210621s","start":"2025-06-20T19:53:30.224744Z","end":"2025-06-20T19:53:32.222954Z","steps":["trace[1194751256] 'agreement among raft nodes before linearized reading' (duration: 1.99807178s)"],"step_count":1} Jun 20 19:53:32.223651 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:32.223052Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:30.224715Z","time spent":"1.998317252s","remote":"172.24.4.123:59934","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "} Jun 20 19:53:32.450356 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:32.448972Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:29.207138Z","time spent":"3.241803s","remote":"172.24.4.123:40276","response type":"/etcdserverpb.Maintenance/Status","request count":-1,"request size":-1,"response count":-1,"response size":-1,"request content":""} Jun 20 19:53:32.450356 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:32.449170Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.224673269s","expected-duration":"100ms","prefix":"","request":"header: txn: success:> failure:<>>","response":"size:16"} Jun 20 19:53:33.140127 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:32.668093Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:25.667628Z","time spent":"7.000452567s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jun 20 19:53:33.673859 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:33.673196Z","caller":"etcdserver/server.go:1237","msg":"Failed to check current member's leadership","error":"context deadline exceeded"} Jun 20 19:53:33.673859 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:33.673324Z","caller":"etcdserver/server.go:1177","msg":"Ignore the lease revoking request because current member isn't a leader","local-member-id":10276657743932975437} Jun 20 19:53:36.676155 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:36.675265Z","caller":"etcdserver/server.go:1237","msg":"Failed to check current member's leadership","error":"context deadline exceeded"} Jun 20 19:53:36.676155 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:36.675423Z","caller":"etcdserver/server.go:1177","msg":"Ignore the lease revoking request because current member isn't a leader","local-member-id":10276657743932975437} Jun 20 19:53:37.863417 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.862106Z","caller":"wal/wal.go:805","msg":"slow fdatasync","took":"6.432259011s","expected-duration":"1s"} Jun 20 19:53:37.904307 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:37.903451Z","caller":"traceutil/trace.go:171","msg":"trace[1955478534] linearizableReadLoop","detail":"{readStateIndex:1941; appliedIndex:1929; }","duration":"15.589751073s","start":"2025-06-20T19:53:22.313683Z","end":"2025-06-20T19:53:37.903434Z","steps":["trace[1955478534] 'read index received' (duration: 7.910523944s)","trace[1955478534] 'applied index is now lower than readState.Index' (duration: 7.679226488s)"],"step_count":2} Jun 20 19:53:37.904706 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.904041Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"16.636675627s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/services/endpoints/calico-system/calico-typha\" limit:1 ","response":"range_response_count:1 size:788"} Jun 20 19:53:37.904706 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:37.904085Z","caller":"traceutil/trace.go:171","msg":"trace[474022187] range","detail":"{range_begin:/registry/services/endpoints/calico-system/calico-typha; range_end:; response_count:1; response_revision:1572; }","duration":"16.636727605s","start":"2025-06-20T19:53:21.267344Z","end":"2025-06-20T19:53:37.904072Z","steps":["trace[474022187] 'agreement among raft nodes before linearized reading' (duration: 16.636189643s)"],"step_count":1} Jun 20 19:53:37.904706 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.904122Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:21.267315Z","time spent":"16.63679419s","remote":"172.24.4.123:60126","response type":"/etcdserverpb.KV/Range","request count":0,"request size":59,"response count":1,"response size":812,"request content":"key:\"/registry/services/endpoints/calico-system/calico-typha\" limit:1 "} Jun 20 19:53:37.905943 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.904756Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"16.894441512s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/events/\" range_end:\"/registry/events0\" count_only:true ","response":"range_response_count:0 size:8"} Jun 20 19:53:37.905943 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:37.904789Z","caller":"traceutil/trace.go:171","msg":"trace[564855696] range","detail":"{range_begin:/registry/events/; range_end:/registry/events0; response_count:0; response_revision:1572; }","duration":"16.894527325s","start":"2025-06-20T19:53:21.010254Z","end":"2025-06-20T19:53:37.904781Z","steps":["trace[564855696] 'agreement among raft nodes before linearized reading' (duration: 16.89429069s)"],"step_count":1} Jun 20 19:53:37.905943 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.904811Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:21.010225Z","time spent":"16.89457823s","remote":"172.24.4.123:60016","response type":"/etcdserverpb.KV/Range","request count":0,"request size":40,"response count":220,"response size":32,"request content":"key:\"/registry/events/\" range_end:\"/registry/events0\" count_only:true "} Jun 20 19:53:37.905943 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.904907Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"18.560943314s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/resourcequotas/\" range_end:\"/registry/resourcequotas0\" count_only:true ","response":"range_response_count:0 size:5"} Jun 20 19:53:37.905943 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:37.904927Z","caller":"traceutil/trace.go:171","msg":"trace[645814651] range","detail":"{range_begin:/registry/resourcequotas/; range_end:/registry/resourcequotas0; response_count:0; response_revision:1572; }","duration":"18.561013245s","start":"2025-06-20T19:53:19.343908Z","end":"2025-06-20T19:53:37.904921Z","steps":["trace[645814651] 'agreement among raft nodes before linearized reading' (duration: 18.560983028s)"],"step_count":1} Jun 20 19:53:37.906402 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.904954Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:19.343878Z","time spent":"18.561068608s","remote":"172.24.4.123:60018","response type":"/etcdserverpb.KV/Range","request count":0,"request size":56,"response count":0,"response size":29,"request content":"key:\"/registry/resourcequotas/\" range_end:\"/registry/resourcequotas0\" count_only:true "} Jun 20 19:53:37.906402 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.905016Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"18.763067921s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/services/specs/\" range_end:\"/registry/services/specs0\" count_only:true ","response":"range_response_count:0 size:7"} Jun 20 19:53:37.906402 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:37.905034Z","caller":"traceutil/trace.go:171","msg":"trace[1786969675] range","detail":"{range_begin:/registry/services/specs/; range_end:/registry/services/specs0; response_count:0; response_revision:1572; }","duration":"18.763113077s","start":"2025-06-20T19:53:19.141915Z","end":"2025-06-20T19:53:37.905029Z","steps":["trace[1786969675] 'agreement among raft nodes before linearized reading' (duration: 18.763084472s)"],"step_count":1} Jun 20 19:53:37.906402 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.905052Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:19.141821Z","time spent":"18.763223866s","remote":"172.24.4.123:60146","response type":"/etcdserverpb.KV/Range","request count":0,"request size":56,"response count":8,"response size":31,"request content":"key:\"/registry/services/specs/\" range_end:\"/registry/services/specs0\" count_only:true "} Jun 20 19:53:37.907281 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.905136Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"20.205468008s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/prioritylevelconfigurations/\" range_end:\"/registry/prioritylevelconfigurations0\" count_only:true ","response":"range_response_count:0 size:7"} Jun 20 19:53:37.907281 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:37.905160Z","caller":"traceutil/trace.go:171","msg":"trace[1335477249] range","detail":"{range_begin:/registry/prioritylevelconfigurations/; range_end:/registry/prioritylevelconfigurations0; response_count:0; response_revision:1572; }","duration":"20.205625414s","start":"2025-06-20T19:53:17.699528Z","end":"2025-06-20T19:53:37.905153Z","steps":["trace[1335477249] 'agreement among raft nodes before linearized reading' (duration: 20.205590178s)"],"step_count":1} Jun 20 19:53:37.907281 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.905179Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:17.699514Z","time spent":"20.205657935s","remote":"172.24.4.123:60388","response type":"/etcdserverpb.KV/Range","request count":0,"request size":82,"response count":8,"response size":31,"request content":"key:\"/registry/prioritylevelconfigurations/\" range_end:\"/registry/prioritylevelconfigurations0\" count_only:true "} Jun 20 19:53:37.907281 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.905275Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"20.23687076s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/replicasets/\" range_end:\"/registry/replicasets0\" count_only:true ","response":"range_response_count:0 size:7"} Jun 20 19:53:37.907897 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:37.905298Z","caller":"traceutil/trace.go:171","msg":"trace[1840126202] range","detail":"{range_begin:/registry/replicasets/; range_end:/registry/replicasets0; response_count:0; response_revision:1572; }","duration":"20.236918712s","start":"2025-06-20T19:53:17.668374Z","end":"2025-06-20T19:53:37.905292Z","steps":["trace[1840126202] 'agreement among raft nodes before linearized reading' (duration: 20.236875399s)"],"step_count":1} Jun 20 19:53:37.907897 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.905321Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:17.668364Z","time spent":"20.236946093s","remote":"172.24.4.123:60434","response type":"/etcdserverpb.KV/Range","request count":0,"request size":50,"response count":11,"response size":31,"request content":"key:\"/registry/replicasets/\" range_end:\"/registry/replicasets0\" count_only:true "} Jun 20 19:53:37.907897 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.905399Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"20.239440303s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/tigerastatuses/\" range_end:\"/registry/operator.tigera.io/tigerastatuses0\" count_only:true ","response":"range_response_count:0 size:7"} Jun 20 19:53:37.907897 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:37.905418Z","caller":"traceutil/trace.go:171","msg":"trace[96147487] range","detail":"{range_begin:/registry/operator.tigera.io/tigerastatuses/; range_end:/registry/operator.tigera.io/tigerastatuses0; response_count:0; response_revision:1572; }","duration":"20.239460841s","start":"2025-06-20T19:53:17.665951Z","end":"2025-06-20T19:53:37.905412Z","steps":["trace[96147487] 'agreement among raft nodes before linearized reading' (duration: 20.239431847s)"],"step_count":1} Jun 20 19:53:37.908530 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.905885Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:17.665936Z","time spent":"20.239492972s","remote":"172.24.4.123:46688","response type":"/etcdserverpb.KV/Range","request count":0,"request size":94,"response count":5,"response size":31,"request content":"key:\"/registry/operator.tigera.io/tigerastatuses/\" range_end:\"/registry/operator.tigera.io/tigerastatuses0\" count_only:true "} Jun 20 19:53:37.908530 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.906010Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"20.240539971s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/rolebindings/\" range_end:\"/registry/rolebindings0\" count_only:true ","response":"range_response_count:0 size:7"} Jun 20 19:53:37.908530 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:37.906062Z","caller":"traceutil/trace.go:171","msg":"trace[606743008] range","detail":"{range_begin:/registry/rolebindings/; range_end:/registry/rolebindings0; response_count:0; response_revision:1572; }","duration":"20.240610583s","start":"2025-06-20T19:53:17.665440Z","end":"2025-06-20T19:53:37.906051Z","steps":["trace[606743008] 'agreement among raft nodes before linearized reading' (duration: 20.240546382s)"],"step_count":1} Jun 20 19:53:37.908530 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.906086Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:17.665430Z","time spent":"20.240646139s","remote":"172.24.4.123:60292","response type":"/etcdserverpb.KV/Range","request count":0,"request size":52,"response count":16,"response size":31,"request content":"key:\"/registry/rolebindings/\" range_end:\"/registry/rolebindings0\" count_only:true "} Jun 20 19:53:37.908530 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.906212Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"20.240828162s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/ranges/servicenodeports\" limit:1 ","response":"range_response_count:1 size:118"} Jun 20 19:53:37.909051 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:37.906233Z","caller":"traceutil/trace.go:171","msg":"trace[1114694481] range","detail":"{range_begin:/registry/ranges/servicenodeports; range_end:; response_count:1; response_revision:1572; }","duration":"20.24087995s","start":"2025-06-20T19:53:17.665347Z","end":"2025-06-20T19:53:37.906227Z","steps":["trace[1114694481] 'agreement among raft nodes before linearized reading' (duration: 20.240807393s)"],"step_count":1} Jun 20 19:53:37.909051 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.906251Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:17.665328Z","time spent":"20.24091731s","remote":"172.24.4.123:60004","response type":"/etcdserverpb.KV/Range","request count":0,"request size":37,"response count":1,"response size":142,"request content":"key:\"/registry/ranges/servicenodeports\" limit:1 "} Jun 20 19:53:37.909051 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.906359Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"20.2532975s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/masterleases/172.24.4.123\" limit:1 ","response":"range_response_count:1 size:131"} Jun 20 19:53:37.909051 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:37.906379Z","caller":"traceutil/trace.go:171","msg":"trace[13486563] range","detail":"{range_begin:/registry/masterleases/172.24.4.123; range_end:; response_count:1; response_revision:1572; }","duration":"20.253415151s","start":"2025-06-20T19:53:17.652958Z","end":"2025-06-20T19:53:37.906373Z","steps":["trace[13486563] 'agreement among raft nodes before linearized reading' (duration: 20.253359527s)"],"step_count":1} Jun 20 19:53:37.909051 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.906397Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:17.652930Z","time spent":"20.253459915s","remote":"172.24.4.123:59956","response type":"/etcdserverpb.KV/Range","request count":0,"request size":39,"response count":1,"response size":155,"request content":"key:\"/registry/masterleases/172.24.4.123\" limit:1 "} Jun 20 19:53:37.926864 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:37.926310Z","caller":"traceutil/trace.go:171","msg":"trace[1749197720] transaction","detail":"{read_only:false; number_of_response:1; response_revision:1572; }","duration":"6.202245466s","start":"2025-06-20T19:53:31.724039Z","end":"2025-06-20T19:53:37.926285Z","steps":["trace[1749197720] 'process raft request' (duration: 6.202028578s)"],"step_count":1} Jun 20 19:53:37.928622 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.927011Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:31.724003Z","time spent":"6.202382632s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":69,"response count":0,"response size":748,"request content":"compare: success:> failure: >"} Jun 20 19:53:37.930198 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.927799Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"4.272300891s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/kubecontrollersconfigurations/\" range_end:\"/registry/crd.projectcalico.org/kubecontrollersconfigurations0\" count_only:true ","response":"range_response_count:0 size:7"} Jun 20 19:53:37.930198 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:37.927851Z","caller":"traceutil/trace.go:171","msg":"trace[1640216739] range","detail":"{range_begin:/registry/crd.projectcalico.org/kubecontrollersconfigurations/; range_end:/registry/crd.projectcalico.org/kubecontrollersconfigurations0; response_count:0; response_revision:1572; }","duration":"4.272417519s","start":"2025-06-20T19:53:33.655421Z","end":"2025-06-20T19:53:37.927839Z","steps":["trace[1640216739] 'agreement among raft nodes before linearized reading' (duration: 4.272068294s)"],"step_count":1} Jun 20 19:53:37.930198 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.927888Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:33.655401Z","time spent":"4.27247598s","remote":"172.24.4.123:46796","response type":"/etcdserverpb.KV/Range","request count":0,"request size":130,"response count":1,"response size":31,"request content":"key:\"/registry/crd.projectcalico.org/kubecontrollersconfigurations/\" range_end:\"/registry/crd.projectcalico.org/kubecontrollersconfigurations0\" count_only:true "} Jun 20 19:53:37.930198 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:37.927957Z","caller":"traceutil/trace.go:171","msg":"trace[1574945295] transaction","detail":"{read_only:false; number_of_response:1; response_revision:1572; }","duration":"5.248309505s","start":"2025-06-20T19:53:32.679637Z","end":"2025-06-20T19:53:37.927947Z","steps":["trace[1574945295] 'process raft request' (duration: 5.247628595s)"],"step_count":1} Jun 20 19:53:37.931393 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.928010Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:32.679548Z","time spent":"5.248428187s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":49,"response count":0,"response size":587,"request content":"compare: success:> failure: >"} Jun 20 19:53:37.931393 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.928036Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"4.276266296s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/daemonsets/\" range_end:\"/registry/daemonsets0\" count_only:true ","response":"range_response_count:0 size:7"} Jun 20 19:53:37.931393 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.928102Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"815.175801ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/persistentvolumeclaims/\" range_end:\"/registry/persistentvolumeclaims0\" count_only:true ","response":"range_response_count:0 size:7"} Jun 20 19:53:37.931393 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:37.928129Z","caller":"traceutil/trace.go:171","msg":"trace[564442276] range","detail":"{range_begin:/registry/persistentvolumeclaims/; range_end:/registry/persistentvolumeclaims0; response_count:0; response_revision:1572; }","duration":"815.257805ms","start":"2025-06-20T19:53:37.112863Z","end":"2025-06-20T19:53:37.928120Z","steps":["trace[564442276] 'agreement among raft nodes before linearized reading' (duration: 815.218742ms)"],"step_count":1} Jun 20 19:53:37.931926 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.928155Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:37.112830Z","time spent":"815.315254ms","remote":"172.24.4.123:60110","response type":"/etcdserverpb.KV/Range","request count":0,"request size":72,"response count":1,"response size":31,"request content":"key:\"/registry/persistentvolumeclaims/\" range_end:\"/registry/persistentvolumeclaims0\" count_only:true "} Jun 20 19:53:37.931926 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.928259Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"5.492680288s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/imagesets/\" range_end:\"/registry/operator.tigera.io/imagesets0\" count_only:true ","response":"range_response_count:0 size:5"} Jun 20 19:53:37.931926 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:37.928305Z","caller":"traceutil/trace.go:171","msg":"trace[1277198465] range","detail":"{range_begin:/registry/operator.tigera.io/imagesets/; range_end:/registry/operator.tigera.io/imagesets0; response_count:0; response_revision:1572; }","duration":"5.49277675s","start":"2025-06-20T19:53:32.435514Z","end":"2025-06-20T19:53:37.928291Z","steps":["trace[1277198465] 'agreement among raft nodes before linearized reading' (duration: 5.492661784s)"],"step_count":1} Jun 20 19:53:37.931926 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.928363Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.692707055s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/services/endpoints/\" range_end:\"/registry/services/endpoints0\" count_only:true ","response":"range_response_count:0 size:7"} Jun 20 19:53:37.932347 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.928363Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:32.435484Z","time spent":"5.492853786s","remote":"172.24.4.123:46700","response type":"/etcdserverpb.KV/Range","request count":0,"request size":84,"response count":0,"response size":29,"request content":"key:\"/registry/operator.tigera.io/imagesets/\" range_end:\"/registry/operator.tigera.io/imagesets0\" count_only:true "} Jun 20 19:53:37.932347 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:37.928393Z","caller":"traceutil/trace.go:171","msg":"trace[1775930197] range","detail":"{range_begin:/registry/services/endpoints/; range_end:/registry/services/endpoints0; response_count:0; response_revision:1572; }","duration":"2.692868218s","start":"2025-06-20T19:53:35.235517Z","end":"2025-06-20T19:53:37.928385Z","steps":["trace[1775930197] 'agreement among raft nodes before linearized reading' (duration: 2.692799319s)"],"step_count":1} Jun 20 19:53:37.932347 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.928430Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:35.235488Z","time spent":"2.692923342s","remote":"172.24.4.123:60126","response type":"/etcdserverpb.KV/Range","request count":0,"request size":64,"response count":8,"response size":31,"request content":"key:\"/registry/services/endpoints/\" range_end:\"/registry/services/endpoints0\" count_only:true "} Jun 20 19:53:37.932347 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.928486Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.940454893s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/volumeattachments/\" range_end:\"/registry/volumeattachments0\" count_only:true ","response":"range_response_count:0 size:5"} Jun 20 19:53:37.934867 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:37.928513Z","caller":"traceutil/trace.go:171","msg":"trace[1508904771] range","detail":"{range_begin:/registry/volumeattachments/; range_end:/registry/volumeattachments0; response_count:0; response_revision:1572; }","duration":"2.940483166s","start":"2025-06-20T19:53:34.988022Z","end":"2025-06-20T19:53:37.928505Z","steps":["trace[1508904771] 'agreement among raft nodes before linearized reading' (duration: 2.940447849s)"],"step_count":1} Jun 20 19:53:37.934867 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.928543Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:34.987994Z","time spent":"2.940540253s","remote":"172.24.4.123:60336","response type":"/etcdserverpb.KV/Range","request count":0,"request size":62,"response count":0,"response size":29,"request content":"key:\"/registry/volumeattachments/\" range_end:\"/registry/volumeattachments0\" count_only:true "} Jun 20 19:53:37.934867 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.928634Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"3.213851134s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/globalnetworkpolicies/\" range_end:\"/registry/crd.projectcalico.org/globalnetworkpolicies0\" count_only:true ","response":"range_response_count:0 size:5"} Jun 20 19:53:37.934867 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:37.928676Z","caller":"traceutil/trace.go:171","msg":"trace[971773167] range","detail":"{range_begin:/registry/crd.projectcalico.org/globalnetworkpolicies/; range_end:/registry/crd.projectcalico.org/globalnetworkpolicies0; response_count:0; response_revision:1572; }","duration":"3.213919682s","start":"2025-06-20T19:53:34.714734Z","end":"2025-06-20T19:53:37.928654Z","steps":["trace[971773167] 'agreement among raft nodes before linearized reading' (duration: 3.213879988s)"],"step_count":1} Jun 20 19:53:37.935736 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.928709Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:34.714705Z","time spent":"3.213993221s","remote":"172.24.4.123:39998","response type":"/etcdserverpb.KV/Range","request count":0,"request size":114,"response count":0,"response size":29,"request content":"key:\"/registry/crd.projectcalico.org/globalnetworkpolicies/\" range_end:\"/registry/crd.projectcalico.org/globalnetworkpolicies0\" count_only:true "} Jun 20 19:53:37.935736 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.928766Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"3.825082289s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/roles/\" range_end:\"/registry/roles0\" count_only:true ","response":"range_response_count:0 size:7"} Jun 20 19:53:37.935736 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:37.928787Z","caller":"traceutil/trace.go:171","msg":"trace[345726224] range","detail":"{range_begin:/registry/roles/; range_end:/registry/roles0; response_count:0; response_revision:1572; }","duration":"3.825105473s","start":"2025-06-20T19:53:34.103675Z","end":"2025-06-20T19:53:37.928780Z","steps":["trace[345726224] 'agreement among raft nodes before linearized reading' (duration: 3.825069395s)"],"step_count":1} Jun 20 19:53:37.935736 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.928820Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:34.103474Z","time spent":"3.825329385s","remote":"172.24.4.123:60286","response type":"/etcdserverpb.KV/Range","request count":0,"request size":38,"response count":12,"response size":31,"request content":"key:\"/registry/roles/\" range_end:\"/registry/roles0\" count_only:true "} Jun 20 19:53:37.935736 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.928887Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"4.008562857s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/csidrivers/\" range_end:\"/registry/csidrivers0\" count_only:true ","response":"range_response_count:0 size:7"} Jun 20 19:53:37.937055 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:37.928909Z","caller":"traceutil/trace.go:171","msg":"trace[1188419856] range","detail":"{range_begin:/registry/csidrivers/; range_end:/registry/csidrivers0; response_count:0; response_revision:1572; }","duration":"4.008637657s","start":"2025-06-20T19:53:33.920264Z","end":"2025-06-20T19:53:37.928902Z","steps":["trace[1188419856] 'agreement among raft nodes before linearized reading' (duration: 4.008606369s)"],"step_count":1} Jun 20 19:53:37.937055 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.928994Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:33.920233Z","time spent":"4.008744097s","remote":"172.24.4.123:60360","response type":"/etcdserverpb.KV/Range","request count":0,"request size":48,"response count":1,"response size":31,"request content":"key:\"/registry/csidrivers/\" range_end:\"/registry/csidrivers0\" count_only:true "} Jun 20 19:53:37.937055 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.929761Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"10.797617658s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/csinodes/\" range_end:\"/registry/csinodes0\" count_only:true ","response":"range_response_count:0 size:7"} Jun 20 19:53:37.937055 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.929910Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"4.177092912s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/clusterinformations/\" range_end:\"/registry/crd.projectcalico.org/clusterinformations0\" count_only:true ","response":"range_response_count:0 size:7"} Jun 20 19:53:37.937399 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:37.929976Z","caller":"traceutil/trace.go:171","msg":"trace[2083295625] range","detail":"{range_begin:/registry/crd.projectcalico.org/clusterinformations/; range_end:/registry/crd.projectcalico.org/clusterinformations0; response_count:0; response_revision:1572; }","duration":"4.177159538s","start":"2025-06-20T19:53:33.752804Z","end":"2025-06-20T19:53:37.929964Z","steps":["trace[2083295625] 'agreement among raft nodes before linearized reading' (duration: 4.177081631s)"],"step_count":1} Jun 20 19:53:37.937399 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:37.929949Z","caller":"traceutil/trace.go:171","msg":"trace[1844932446] range","detail":"{range_begin:/registry/csinodes/; range_end:/registry/csinodes0; response_count:0; response_revision:1572; }","duration":"10.797840206s","start":"2025-06-20T19:53:27.132089Z","end":"2025-06-20T19:53:37.929930Z","steps":["trace[1844932446] 'agreement among raft nodes before linearized reading' (duration: 10.797651361s)"],"step_count":1} Jun 20 19:53:37.937399 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.930087Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"4.225385286s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/apiservers/\" range_end:\"/registry/operator.tigera.io/apiservers0\" count_only:true ","response":"range_response_count:0 size:7"} Jun 20 19:53:37.937399 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:37.930238Z","caller":"traceutil/trace.go:171","msg":"trace[937146586] range","detail":"{range_begin:/registry/operator.tigera.io/apiservers/; range_end:/registry/operator.tigera.io/apiservers0; response_count:0; response_revision:1572; }","duration":"4.225463282s","start":"2025-06-20T19:53:33.704649Z","end":"2025-06-20T19:53:37.930112Z","steps":["trace[937146586] 'agreement among raft nodes before linearized reading' (duration: 4.225414651s)"],"step_count":1} Jun 20 19:53:37.937930 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.930319Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:33.704620Z","time spent":"4.225672536s","remote":"172.24.4.123:46794","response type":"/etcdserverpb.KV/Range","request count":0,"request size":86,"response count":1,"response size":31,"request content":"key:\"/registry/operator.tigera.io/apiservers/\" range_end:\"/registry/operator.tigera.io/apiservers0\" count_only:true "} Jun 20 19:53:37.937930 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:37.928124Z","caller":"traceutil/trace.go:171","msg":"trace[1513493817] range","detail":"{range_begin:/registry/daemonsets/; range_end:/registry/daemonsets0; response_count:0; response_revision:1572; }","duration":"4.276433149s","start":"2025-06-20T19:53:33.651666Z","end":"2025-06-20T19:53:37.928099Z","steps":["trace[1513493817] 'agreement among raft nodes before linearized reading' (duration: 4.275838471s)"],"step_count":1} Jun 20 19:53:37.937930 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.930691Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:33.651638Z","time spent":"4.279038406s","remote":"172.24.4.123:60418","response type":"/etcdserverpb.KV/Range","request count":0,"request size":48,"response count":3,"response size":31,"request content":"key:\"/registry/daemonsets/\" range_end:\"/registry/daemonsets0\" count_only:true "} Jun 20 19:53:37.937930 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.929174Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"5.904713123s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/events/\" range_end:\"/registry/events0\" count_only:true ","response":"range_response_count:0 size:8"} Jun 20 19:53:37.938260 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:37.931002Z","caller":"traceutil/trace.go:171","msg":"trace[1792686411] range","detail":"{range_begin:/registry/events/; range_end:/registry/events0; response_count:0; response_revision:1572; }","duration":"5.906533725s","start":"2025-06-20T19:53:32.024392Z","end":"2025-06-20T19:53:37.930926Z","steps":["trace[1792686411] 'agreement among raft nodes before linearized reading' (duration: 5.904151837s)"],"step_count":1} Jun 20 19:53:37.938260 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.931076Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:32.024362Z","time spent":"5.906698766s","remote":"172.24.4.123:60488","response type":"/etcdserverpb.KV/Range","request count":0,"request size":40,"response count":220,"response size":32,"request content":"key:\"/registry/events/\" range_end:\"/registry/events0\" count_only:true "} Jun 20 19:53:37.938260 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.929342Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"7.920215486s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/minions/172.24.4.126\" limit:1 ","response":"range_response_count:1 size:4430"} Jun 20 19:53:37.938260 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:37.931177Z","caller":"traceutil/trace.go:171","msg":"trace[157387249] range","detail":"{range_begin:/registry/minions/172.24.4.126; range_end:; response_count:1; response_revision:1572; }","duration":"7.922085942s","start":"2025-06-20T19:53:30.009082Z","end":"2025-06-20T19:53:37.931168Z","steps":["trace[157387249] 'agreement among raft nodes before linearized reading' (duration: 7.92012765s)"],"step_count":1} Jun 20 19:53:37.938260 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.931237Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:30.009057Z","time spent":"7.922141826s","remote":"172.24.4.123:60130","response type":"/etcdserverpb.KV/Range","request count":0,"request size":34,"response count":1,"response size":4454,"request content":"key:\"/registry/minions/172.24.4.126\" limit:1 "} Jun 20 19:53:37.938825 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.929416Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"9.327194597s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/flowschemas/\" range_end:\"/registry/flowschemas0\" count_only:true ","response":"range_response_count:0 size:7"} Jun 20 19:53:37.938825 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:37.931432Z","caller":"traceutil/trace.go:171","msg":"trace[650588172] range","detail":"{range_begin:/registry/flowschemas/; range_end:/registry/flowschemas0; response_count:0; response_revision:1572; }","duration":"9.329214625s","start":"2025-06-20T19:53:28.602172Z","end":"2025-06-20T19:53:37.931387Z","steps":["trace[650588172] 'agreement among raft nodes before linearized reading' (duration: 9.327215737s)"],"step_count":1} Jun 20 19:53:37.938825 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.931468Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:28.602150Z","time spent":"9.329305895s","remote":"172.24.4.123:60380","response type":"/etcdserverpb.KV/Range","request count":0,"request size":50,"response count":13,"response size":31,"request content":"key:\"/registry/flowschemas/\" range_end:\"/registry/flowschemas0\" count_only:true "} Jun 20 19:53:37.938825 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.929536Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"9.690469993s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/endpointslices/\" range_end:\"/registry/endpointslices0\" count_only:true ","response":"range_response_count:0 size:7"} Jun 20 19:53:37.939149 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:37.931636Z","caller":"traceutil/trace.go:171","msg":"trace[59056677] range","detail":"{range_begin:/registry/endpointslices/; range_end:/registry/endpointslices0; response_count:0; response_revision:1572; }","duration":"9.692608564s","start":"2025-06-20T19:53:28.239012Z","end":"2025-06-20T19:53:37.931621Z","steps":["trace[59056677] 'agreement among raft nodes before linearized reading' (duration: 9.690421172s)"],"step_count":1} Jun 20 19:53:37.939149 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.931695Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:28.238989Z","time spent":"9.692692471s","remote":"172.24.4.123:60220","response type":"/etcdserverpb.KV/Range","request count":0,"request size":56,"response count":8,"response size":31,"request content":"key:\"/registry/endpointslices/\" range_end:\"/registry/endpointslices0\" count_only:true "} Jun 20 19:53:37.939149 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.929715Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"10.311060899s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/ipreservations/\" range_end:\"/registry/crd.projectcalico.org/ipreservations0\" count_only:true ","response":"range_response_count:0 size:5"} Jun 20 19:53:37.939149 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:37.931833Z","caller":"traceutil/trace.go:171","msg":"trace[927738243] range","detail":"{range_begin:/registry/crd.projectcalico.org/ipreservations/; range_end:/registry/crd.projectcalico.org/ipreservations0; response_count:0; response_revision:1572; }","duration":"10.313179952s","start":"2025-06-20T19:53:27.618628Z","end":"2025-06-20T19:53:37.931808Z","steps":["trace[927738243] 'agreement among raft nodes before linearized reading' (duration: 10.310932358s)"],"step_count":1} Jun 20 19:53:37.939446 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.931918Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:27.618522Z","time spent":"10.313362085s","remote":"172.24.4.123:44316","response type":"/etcdserverpb.KV/Range","request count":0,"request size":100,"response count":0,"response size":29,"request content":"key:\"/registry/crd.projectcalico.org/ipreservations/\" range_end:\"/registry/crd.projectcalico.org/ipreservations0\" count_only:true "} Jun 20 19:53:37.939446 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.930171Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:27.132061Z","time spent":"10.798038148s","remote":"172.24.4.123:60348","response type":"/etcdserverpb.KV/Range","request count":0,"request size":44,"response count":2,"response size":31,"request content":"key:\"/registry/csinodes/\" range_end:\"/registry/csinodes0\" count_only:true "} Jun 20 19:53:37.939446 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.933108Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"10.883561269s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/deployments/\" range_end:\"/registry/deployments0\" count_only:true ","response":"range_response_count:0 size:7"} Jun 20 19:53:37.939446 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:37.933163Z","caller":"traceutil/trace.go:171","msg":"trace[1715917974] range","detail":"{range_begin:/registry/deployments/; range_end:/registry/deployments0; response_count:0; response_revision:1572; }","duration":"10.883621833s","start":"2025-06-20T19:53:27.049525Z","end":"2025-06-20T19:53:37.933147Z","steps":["trace[1715917974] 'agreement among raft nodes before linearized reading' (duration: 10.883531403s)"],"step_count":1} Jun 20 19:53:37.940086 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.933209Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:27.049440Z","time spent":"10.883751636s","remote":"172.24.4.123:60392","response type":"/etcdserverpb.KV/Range","request count":0,"request size":50,"response count":8,"response size":31,"request content":"key:\"/registry/deployments/\" range_end:\"/registry/deployments0\" count_only:true "} Jun 20 19:53:37.940086 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.933807Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"13.17950634s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/validatingadmissionpolicies/\" range_end:\"/registry/validatingadmissionpolicies0\" count_only:true ","response":"range_response_count:0 size:5"} Jun 20 19:53:37.940086 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:37.933936Z","caller":"traceutil/trace.go:171","msg":"trace[332233503] range","detail":"{range_begin:/registry/validatingadmissionpolicies/; range_end:/registry/validatingadmissionpolicies0; response_count:0; response_revision:1572; }","duration":"13.179909487s","start":"2025-06-20T19:53:24.754007Z","end":"2025-06-20T19:53:37.933916Z","steps":["trace[332233503] 'agreement among raft nodes before linearized reading' (duration: 13.179532659s)"],"step_count":1} Jun 20 19:53:37.940086 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.934043Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:24.753981Z","time spent":"13.180031536s","remote":"172.24.4.123:60468","response type":"/etcdserverpb.KV/Range","request count":0,"request size":82,"response count":0,"response size":29,"request content":"key:\"/registry/validatingadmissionpolicies/\" range_end:\"/registry/validatingadmissionpolicies0\" count_only:true "} Jun 20 19:53:37.940514 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.930010Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:33.752663Z","time spent":"4.17733605s","remote":"172.24.4.123:46740","response type":"/etcdserverpb.KV/Range","request count":0,"request size":110,"response count":1,"response size":31,"request content":"key:\"/registry/crd.projectcalico.org/clusterinformations/\" range_end:\"/registry/crd.projectcalico.org/clusterinformations0\" count_only:true "} Jun 20 19:53:37.940514 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.934393Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"14.031700511s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/podtemplates/\" range_end:\"/registry/podtemplates0\" count_only:true ","response":"range_response_count:0 size:5"} Jun 20 19:53:37.940514 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:37.934738Z","caller":"traceutil/trace.go:171","msg":"trace[603783178] range","detail":"{range_begin:/registry/podtemplates/; range_end:/registry/podtemplates0; response_count:0; response_revision:1572; }","duration":"14.032095594s","start":"2025-06-20T19:53:23.902630Z","end":"2025-06-20T19:53:37.934725Z","steps":["trace[603783178] 'agreement among raft nodes before linearized reading' (duration: 14.031722161s)"],"step_count":1} Jun 20 19:53:37.940514 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.934855Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:23.902559Z","time spent":"14.032280942s","remote":"172.24.4.123:60074","response type":"/etcdserverpb.KV/Range","request count":0,"request size":52,"response count":0,"response size":29,"request content":"key:\"/registry/podtemplates/\" range_end:\"/registry/podtemplates0\" count_only:true "} Jun 20 19:53:37.940862 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.934529Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"14.652841735s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/validatingadmissionpolicybindings/\" range_end:\"/registry/validatingadmissionpolicybindings0\" count_only:true ","response":"range_response_count:0 size:5"} Jun 20 19:53:37.940862 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:37.935125Z","caller":"traceutil/trace.go:171","msg":"trace[1115726805] range","detail":"{range_begin:/registry/validatingadmissionpolicybindings/; range_end:/registry/validatingadmissionpolicybindings0; response_count:0; response_revision:1572; }","duration":"14.65357317s","start":"2025-06-20T19:53:23.281540Z","end":"2025-06-20T19:53:37.935113Z","steps":["trace[1115726805] 'agreement among raft nodes before linearized reading' (duration: 14.652946393s)"],"step_count":1} Jun 20 19:53:37.940862 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:37.935171Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:23.281509Z","time spent":"14.653649144s","remote":"172.24.4.123:60476","response type":"/etcdserverpb.KV/Range","request count":0,"request size":94,"response count":0,"response size":29,"request content":"key:\"/registry/validatingadmissionpolicybindings/\" range_end:\"/registry/validatingadmissionpolicybindings0\" count_only:true "} Jun 20 19:53:38.125708 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:38.123505Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"124.7157ms","expected-duration":"100ms","prefix":"","request":"header: lease_revoke:","response":"size:29"} Jun 20 19:53:38.200292 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:38.197914Z","caller":"traceutil/trace.go:171","msg":"trace[1646957632] linearizableReadLoop","detail":"{readStateIndex:1946; appliedIndex:1944; }","duration":"255.010689ms","start":"2025-06-20T19:53:37.942863Z","end":"2025-06-20T19:53:38.197874Z","steps":["trace[1646957632] 'read index received' (duration: 56.214529ms)","trace[1646957632] 'applied index is now lower than readState.Index' (duration: 198.792663ms)"],"step_count":2} Jun 20 19:53:38.200292 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:38.199185Z","caller":"traceutil/trace.go:171","msg":"trace[77244454] transaction","detail":"{read_only:false; number_of_response:1; response_revision:1573; }","duration":"253.8367ms","start":"2025-06-20T19:53:37.945318Z","end":"2025-06-20T19:53:38.199155Z","steps":["trace[77244454] 'process raft request' (duration: 252.455093ms)"],"step_count":1} Jun 20 19:53:38.200292 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:38.199382Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"259.663434ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/leases/kube-node-lease/172.24.4.126\" limit:1 ","response":"range_response_count:1 size:552"} Jun 20 19:53:38.200292 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:38.199534Z","caller":"traceutil/trace.go:171","msg":"trace[635374660] range","detail":"{range_begin:/registry/leases/kube-node-lease/172.24.4.126; range_end:; response_count:1; response_revision:1573; }","duration":"260.052816ms","start":"2025-06-20T19:53:37.939461Z","end":"2025-06-20T19:53:38.199514Z","steps":["trace[635374660] 'agreement among raft nodes before linearized reading' (duration: 258.780013ms)"],"step_count":1} Jun 20 19:53:38.202530 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:38.200218Z","caller":"traceutil/trace.go:171","msg":"trace[770684123] transaction","detail":"{read_only:false; response_revision:1574; number_of_response:1; }","duration":"232.129696ms","start":"2025-06-20T19:53:37.968064Z","end":"2025-06-20T19:53:38.200194Z","steps":["trace[770684123] 'process raft request' (duration: 230.598408ms)"],"step_count":1} Jun 20 19:53:38.202530 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:38.200872Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"268.314956ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/leases/kube-system/apiserver-lehofg5mhkmdr3ocdysxo4wrly\" limit:1 ","response":"range_response_count:1 size:713"} Jun 20 19:53:38.202530 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:38.201135Z","caller":"traceutil/trace.go:171","msg":"trace[909107612] range","detail":"{range_begin:/registry/leases/kube-system/apiserver-lehofg5mhkmdr3ocdysxo4wrly; range_end:; response_count:1; response_revision:1573; }","duration":"268.594542ms","start":"2025-06-20T19:53:37.932519Z","end":"2025-06-20T19:53:38.201114Z","steps":["trace[909107612] 'agreement among raft nodes before linearized reading' (duration: 266.956533ms)"],"step_count":1} Jun 20 19:53:38.235106 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:38.234497Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"291.595778ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/minions/172.24.4.126\" limit:1 ","response":"range_response_count:1 size:4430"} Jun 20 19:53:38.235106 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:38.234631Z","caller":"traceutil/trace.go:171","msg":"trace[388757527] range","detail":"{range_begin:/registry/minions/172.24.4.126; range_end:; response_count:1; response_revision:1575; }","duration":"291.770767ms","start":"2025-06-20T19:53:37.942838Z","end":"2025-06-20T19:53:38.234609Z","steps":["trace[388757527] 'agreement among raft nodes before linearized reading' (duration: 291.058798ms)"],"step_count":1} Jun 20 19:53:38.236332 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:38.235650Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"155.960431ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jun 20 19:53:38.236332 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:38.235729Z","caller":"traceutil/trace.go:171","msg":"trace[1480503697] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1575; }","duration":"156.834573ms","start":"2025-06-20T19:53:38.078871Z","end":"2025-06-20T19:53:38.235706Z","steps":["trace[1480503697] 'agreement among raft nodes before linearized reading' (duration: 155.979316ms)"],"step_count":1} Jun 20 19:53:38.236332 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:38.235526Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"278.295677ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/ranges/servicenodeports\" limit:1 ","response":"range_response_count:1 size:118"} Jun 20 19:53:38.236332 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:38.235812Z","caller":"traceutil/trace.go:171","msg":"trace[1011873086] range","detail":"{range_begin:/registry/ranges/servicenodeports; range_end:; response_count:1; response_revision:1575; }","duration":"278.623013ms","start":"2025-06-20T19:53:37.957162Z","end":"2025-06-20T19:53:38.235785Z","steps":["trace[1011873086] 'agreement among raft nodes before linearized reading' (duration: 278.278865ms)"],"step_count":1} Jun 20 19:53:38.541291 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:38.539894Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"236.774909ms","expected-duration":"100ms","prefix":"","request":"header: txn: success:> failure: >>","response":"size:16"} Jun 20 19:53:38.541291 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:38.540206Z","caller":"traceutil/trace.go:171","msg":"trace[415745465] transaction","detail":"{read_only:false; response_revision:1580; number_of_response:1; }","duration":"109.087151ms","start":"2025-06-20T19:53:38.431101Z","end":"2025-06-20T19:53:38.540188Z","steps":["trace[415745465] 'process raft request' (duration: 108.943953ms)"],"step_count":1} Jun 20 19:53:38.541291 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:38.540207Z","caller":"traceutil/trace.go:171","msg":"trace[980389751] transaction","detail":"{read_only:false; response_revision:1579; number_of_response:1; }","duration":"266.10519ms","start":"2025-06-20T19:53:38.274064Z","end":"2025-06-20T19:53:38.540170Z","steps":["trace[980389751] 'process raft request' (duration: 28.937804ms)","trace[980389751] 'compare' (duration: 236.399062ms)"],"step_count":2} Jun 20 19:53:38.992678 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:38.991346Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"245.061383ms","expected-duration":"100ms","prefix":"","request":"header: txn: success:> failure:<>>","response":"size:16"} Jun 20 19:53:38.994161 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:38.992384Z","caller":"traceutil/trace.go:171","msg":"trace[1159661056] transaction","detail":"{read_only:false; response_revision:1582; number_of_response:1; }","duration":"425.675057ms","start":"2025-06-20T19:53:38.566612Z","end":"2025-06-20T19:53:38.992287Z","steps":["trace[1159661056] 'process raft request' (duration: 179.567396ms)","trace[1159661056] 'compare' (duration: 244.449444ms)"],"step_count":2} Jun 20 19:53:38.994161 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:38.993383Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:38.566559Z","time spent":"426.308497ms","remote":"172.24.4.123:60016","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":943,"response count":0,"response size":40,"request content":"compare: success:> failure:<>"} Jun 20 19:53:38.997157 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:38.995179Z","caller":"traceutil/trace.go:171","msg":"trace[1816678088] linearizableReadLoop","detail":"{readStateIndex:1959; appliedIndex:1957; }","duration":"394.770104ms","start":"2025-06-20T19:53:38.600368Z","end":"2025-06-20T19:53:38.995138Z","steps":["trace[1816678088] 'read index received' (duration: 145.960574ms)","trace[1816678088] 'applied index is now lower than readState.Index' (duration: 248.806013ms)"],"step_count":2} Jun 20 19:53:38.997157 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:38.996205Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:38.567562Z","time spent":"428.632255ms","remote":"172.24.4.123:59956","response type":"/etcdserverpb.Lease/LeaseGrant","request count":-1,"request size":-1,"response count":-1,"response size":-1,"request content":""} Jun 20 19:53:38.998316 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:38.995545Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"395.144667ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/default/test-pod-1\" limit:1 ","response":"range_response_count:1 size:2344"} Jun 20 19:53:38.999155 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:38.997785Z","caller":"traceutil/trace.go:171","msg":"trace[435647899] range","detail":"{range_begin:/registry/pods/default/test-pod-1; range_end:; response_count:1; response_revision:1582; }","duration":"397.456053ms","start":"2025-06-20T19:53:38.600299Z","end":"2025-06-20T19:53:38.997755Z","steps":["trace[435647899] 'agreement among raft nodes before linearized reading' (duration: 395.030303ms)"],"step_count":1} Jun 20 19:53:39.000106 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:38.999403Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:38.600274Z","time spent":"399.086867ms","remote":"172.24.4.123:60136","response type":"/etcdserverpb.KV/Range","request count":0,"request size":37,"response count":1,"response size":2368,"request content":"key:\"/registry/pods/default/test-pod-1\" limit:1 "} Jun 20 19:53:39.294557 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:39.293315Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"174.742158ms","expected-duration":"100ms","prefix":"","request":"header: txn: success:> failure: >>","response":"size:16"} Jun 20 19:53:39.294557 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:39.293725Z","caller":"traceutil/trace.go:171","msg":"trace[1034096203] transaction","detail":"{read_only:false; response_revision:1584; number_of_response:1; }","duration":"288.791434ms","start":"2025-06-20T19:53:39.004754Z","end":"2025-06-20T19:53:39.293545Z","steps":["trace[1034096203] 'process raft request' (duration: 288.705011ms)"],"step_count":1} Jun 20 19:53:39.295627 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:39.293923Z","caller":"traceutil/trace.go:171","msg":"trace[1540582752] transaction","detail":"{read_only:false; response_revision:1583; number_of_response:1; }","duration":"293.442286ms","start":"2025-06-20T19:53:39.000445Z","end":"2025-06-20T19:53:39.293887Z","steps":["trace[1540582752] 'process raft request' (duration: 117.998459ms)","trace[1540582752] 'compare' (duration: 174.428579ms)"],"step_count":2} Jun 20 19:53:39.295627 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:39.295114Z","caller":"traceutil/trace.go:171","msg":"trace[1187143482] linearizableReadLoop","detail":"{readStateIndex:1960; appliedIndex:1959; }","duration":"290.358069ms","start":"2025-06-20T19:53:39.004733Z","end":"2025-06-20T19:53:39.295092Z","steps":["trace[1187143482] 'read index received' (duration: 113.728793ms)","trace[1187143482] 'applied index is now lower than readState.Index' (duration: 176.627533ms)"],"step_count":2} Jun 20 19:53:39.297029 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:39.295943Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"291.184813ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/kube-system/kube-scheduler-ci-4344-1-0-0-4524070979.novalocal\" limit:1 ","response":"range_response_count:1 size:4676"} Jun 20 19:53:39.297029 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:39.296056Z","caller":"traceutil/trace.go:171","msg":"trace[2023375810] range","detail":"{range_begin:/registry/pods/kube-system/kube-scheduler-ci-4344-1-0-0-4524070979.novalocal; range_end:; response_count:1; response_revision:1584; }","duration":"291.312964ms","start":"2025-06-20T19:53:39.004721Z","end":"2025-06-20T19:53:39.296034Z","steps":["trace[2023375810] 'agreement among raft nodes before linearized reading' (duration: 290.452115ms)"],"step_count":1} Jun 20 19:53:39.834088 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:39.833655Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078265,"retry-timeout":"500ms"} Jun 20 19:53:40.004238 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:40.003287Z","caller":"traceutil/trace.go:171","msg":"trace[652863565] linearizableReadLoop","detail":"{readStateIndex:1963; appliedIndex:1962; }","duration":"669.813634ms","start":"2025-06-20T19:53:39.333441Z","end":"2025-06-20T19:53:40.003254Z","steps":["trace[652863565] 'read index received' (duration: 655.233718ms)","trace[652863565] 'applied index is now lower than readState.Index' (duration: 14.578183ms)"],"step_count":2} Jun 20 19:53:40.004238 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:40.003473Z","caller":"traceutil/trace.go:171","msg":"trace[1722259079] transaction","detail":"{read_only:false; response_revision:1586; number_of_response:1; }","duration":"683.267152ms","start":"2025-06-20T19:53:39.320184Z","end":"2025-06-20T19:53:40.003451Z","steps":["trace[1722259079] 'process raft request' (duration: 668.602828ms)","trace[1722259079] 'compare' (duration: 14.246699ms)"],"step_count":2} Jun 20 19:53:40.006601 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:40.004046Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:39.320152Z","time spent":"683.381847ms","remote":"172.24.4.123:60136","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":4854,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jun 20 19:53:40.006601 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:40.004484Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"671.028017ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/events/kube-system/kube-controller-manager-ci-4344-1-0-0-4524070979.novalocal.184ad84a1f72093f\" limit:1 ","response":"range_response_count:1 size:994"} Jun 20 19:53:40.006601 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:40.004615Z","caller":"traceutil/trace.go:171","msg":"trace[346890997] range","detail":"{range_begin:/registry/events/kube-system/kube-controller-manager-ci-4344-1-0-0-4524070979.novalocal.184ad84a1f72093f; range_end:; response_count:1; response_revision:1586; }","duration":"671.120781ms","start":"2025-06-20T19:53:39.333408Z","end":"2025-06-20T19:53:40.004528Z","steps":["trace[346890997] 'agreement among raft nodes before linearized reading' (duration: 670.935152ms)"],"step_count":1} Jun 20 19:53:40.007109 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:40.004691Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:39.333390Z","time spent":"671.276964ms","remote":"172.24.4.123:60016","response type":"/etcdserverpb.KV/Range","request count":0,"request size":108,"response count":1,"response size":1018,"request content":"key:\"/registry/events/kube-system/kube-controller-manager-ci-4344-1-0-0-4524070979.novalocal.184ad84a1f72093f\" limit:1 "} Jun 20 19:53:40.007109 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:40.004976Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"370.897978ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jun 20 19:53:40.007109 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:40.005035Z","caller":"traceutil/trace.go:171","msg":"trace[545520820] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1586; }","duration":"371.002936ms","start":"2025-06-20T19:53:39.634014Z","end":"2025-06-20T19:53:40.005017Z","steps":["trace[545520820] 'agreement among raft nodes before linearized reading' (duration: 370.908519ms)"],"step_count":1} Jun 20 19:53:40.007109 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:40.005086Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:39.633983Z","time spent":"371.087515ms","remote":"172.24.4.123:59934","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":29,"request content":"key:\"/registry/health\" "} Jun 20 19:53:40.007109 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:40.005301Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"141.061008ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/clusterinformations/default\" limit:1 ","response":"range_response_count:1 size:886"} Jun 20 19:53:40.007494 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:40.005381Z","caller":"traceutil/trace.go:171","msg":"trace[733273386] range","detail":"{range_begin:/registry/crd.projectcalico.org/clusterinformations/default; range_end:; response_count:1; response_revision:1586; }","duration":"141.173529ms","start":"2025-06-20T19:53:39.864166Z","end":"2025-06-20T19:53:40.005340Z","steps":["trace[733273386] 'agreement among raft nodes before linearized reading' (duration: 141.011495ms)"],"step_count":1} Jun 20 19:53:40.260201 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:40.257695Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"148.748355ms","expected-duration":"100ms","prefix":"","request":"header: txn: success:> failure:<>>","response":"size:5"} Jun 20 19:53:40.260201 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:40.257859Z","caller":"traceutil/trace.go:171","msg":"trace[151500970] linearizableReadLoop","detail":"{readStateIndex:1965; appliedIndex:1964; }","duration":"189.760101ms","start":"2025-06-20T19:53:40.068074Z","end":"2025-06-20T19:53:40.257834Z","steps":["trace[151500970] 'read index received' (duration: 40.649636ms)","trace[151500970] 'applied index is now lower than readState.Index' (duration: 149.108812ms)"],"step_count":2} Jun 20 19:53:40.260201 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:40.258023Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"204.87906ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/kube-system/kube-scheduler-ci-4344-1-0-0-4524070979.novalocal\" limit:1 ","response":"range_response_count:1 size:4868"} Jun 20 19:53:40.260201 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:40.258068Z","caller":"traceutil/trace.go:171","msg":"trace[528350594] range","detail":"{range_begin:/registry/pods/kube-system/kube-scheduler-ci-4344-1-0-0-4524070979.novalocal; range_end:; response_count:1; response_revision:1587; }","duration":"204.930216ms","start":"2025-06-20T19:53:40.053120Z","end":"2025-06-20T19:53:40.258050Z","steps":["trace[528350594] 'agreement among raft nodes before linearized reading' (duration: 204.837222ms)"],"step_count":1} Jun 20 19:53:40.261158 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:40.258048Z","caller":"traceutil/trace.go:171","msg":"trace[1530905471] transaction","detail":"{read_only:false; number_of_response:0; response_revision:1587; }","duration":"214.899184ms","start":"2025-06-20T19:53:40.042966Z","end":"2025-06-20T19:53:40.257865Z","steps":["trace[1530905471] 'process raft request' (duration: 65.85829ms)","trace[1530905471] 'compare' (duration: 148.616998ms)"],"step_count":2} Jun 20 19:53:40.261158 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:40.258471Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"185.726872ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/events/kube-system/kube-scheduler-ci-4344-1-0-0-4524070979.novalocal.184ad84a200c3258\" limit:1 ","response":"range_response_count:1 size:958"} Jun 20 19:53:40.261158 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:40.258528Z","caller":"traceutil/trace.go:171","msg":"trace[190808752] range","detail":"{range_begin:/registry/events/kube-system/kube-scheduler-ci-4344-1-0-0-4524070979.novalocal.184ad84a200c3258; range_end:; response_count:1; response_revision:1587; }","duration":"185.81664ms","start":"2025-06-20T19:53:40.072695Z","end":"2025-06-20T19:53:40.258512Z","steps":["trace[190808752] 'agreement among raft nodes before linearized reading' (duration: 185.602196ms)"],"step_count":1} Jun 20 19:53:40.848766 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:40.845949Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078275,"retry-timeout":"500ms"} Jun 20 19:53:41.347984 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:41.347073Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078275,"retry-timeout":"500ms"} Jun 20 19:53:41.646880 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:41.646035Z","caller":"wal/wal.go:805","msg":"slow fdatasync","took":"1.306316566s","expected-duration":"1s"} Jun 20 19:53:43.528640 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:42.638803Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.999780929s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context canceled"} Jun 20 19:53:43.528640 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:42.638929Z","caller":"traceutil/trace.go:171","msg":"trace[2135177401] range","detail":"{range_begin:/registry/health; range_end:; }","duration":"1.999968602s","start":"2025-06-20T19:53:40.638920Z","end":"2025-06-20T19:53:42.638889Z","steps":["trace[2135177401] 'agreement among raft nodes before linearized reading' (duration: 1.999827166s)"],"step_count":1} Jun 20 19:53:43.528640 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:42.639037Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:40.638874Z","time spent":"2.000114025s","remote":"172.24.4.123:59934","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "} Jun 20 19:53:43.565768 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:43.562438Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.915955349s","expected-duration":"100ms","prefix":"","request":"header: txn: success:> failure:<>>","response":"size:5"} Jun 20 19:53:43.565768 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:43.563035Z","caller":"traceutil/trace.go:171","msg":"trace[932506086] transaction","detail":"{read_only:false; number_of_response:0; response_revision:1589; }","duration":"3.259531269s","start":"2025-06-20T19:53:40.303419Z","end":"2025-06-20T19:53:43.562950Z","steps":["trace[932506086] 'process raft request' (duration: 1.342930827s)","trace[932506086] 'compare' (duration: 1.91576921s)"],"step_count":2} Jun 20 19:53:43.565768 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:43.563126Z","caller":"traceutil/trace.go:171","msg":"trace[1214135074] linearizableReadLoop","detail":"{readStateIndex:1969; appliedIndex:1967; }","duration":"3.217139397s","start":"2025-06-20T19:53:40.345824Z","end":"2025-06-20T19:53:43.562963Z","steps":["trace[1214135074] 'read index received' (duration: 1.300410974s)","trace[1214135074] 'applied index is now lower than readState.Index' (duration: 1.916727651s)"],"step_count":2} Jun 20 19:53:43.565768 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:43.563350Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:40.303389Z","time spent":"3.259846972s","remote":"172.24.4.123:39996","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":29,"request content":"compare: success:> failure:<>"} Jun 20 19:53:43.567292 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:43.563650Z","caller":"traceutil/trace.go:171","msg":"trace[828582549] transaction","detail":"{read_only:false; response_revision:1590; number_of_response:1; }","duration":"3.247229406s","start":"2025-06-20T19:53:40.316409Z","end":"2025-06-20T19:53:43.563639Z","steps":["trace[828582549] 'process raft request' (duration: 3.246422199s)"],"step_count":1} Jun 20 19:53:43.567292 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:43.563740Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:40.316374Z","time spent":"3.247305779s","remote":"172.24.4.123:60136","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":4956,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jun 20 19:53:43.567292 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:43.563792Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"3.110087167s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/globalnetworksets/\" range_end:\"/registry/crd.projectcalico.org/globalnetworksets0\" count_only:true ","response":"range_response_count:0 size:5"} Jun 20 19:53:43.567292 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:43.563876Z","caller":"traceutil/trace.go:171","msg":"trace[780126607] range","detail":"{range_begin:/registry/crd.projectcalico.org/globalnetworksets/; range_end:/registry/crd.projectcalico.org/globalnetworksets0; response_count:0; response_revision:1590; }","duration":"3.110187536s","start":"2025-06-20T19:53:40.453671Z","end":"2025-06-20T19:53:43.563859Z","steps":["trace[780126607] 'agreement among raft nodes before linearized reading' (duration: 3.110039197s)"],"step_count":1} Jun 20 19:53:43.567667 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:43.563882Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"924.42531ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jun 20 19:53:43.567667 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:43.563917Z","caller":"traceutil/trace.go:171","msg":"trace[1287780854] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1590; }","duration":"924.533232ms","start":"2025-06-20T19:53:42.639374Z","end":"2025-06-20T19:53:43.563907Z","steps":["trace[1287780854] 'agreement among raft nodes before linearized reading' (duration: 924.485042ms)"],"step_count":1} Jun 20 19:53:43.567667 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:43.563948Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:42.639352Z","time spent":"924.588306ms","remote":"172.24.4.123:59944","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":29,"request content":"key:\"/registry/health\" "} Jun 20 19:53:43.567667 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:43.563954Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:40.453504Z","time spent":"3.110431004s","remote":"172.24.4.123:40066","response type":"/etcdserverpb.KV/Range","request count":0,"request size":106,"response count":0,"response size":29,"request content":"key:\"/registry/crd.projectcalico.org/globalnetworksets/\" range_end:\"/registry/crd.projectcalico.org/globalnetworksets0\" count_only:true "} Jun 20 19:53:43.567667 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:43.564143Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.780927259s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/stagedkubernetesnetworkpolicies/\" range_end:\"/registry/crd.projectcalico.org/stagedkubernetesnetworkpolicies0\" count_only:true ","response":"range_response_count:0 size:5"} Jun 20 19:53:43.567934 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:43.564198Z","caller":"traceutil/trace.go:171","msg":"trace[1901527659] range","detail":"{range_begin:/registry/crd.projectcalico.org/stagedkubernetesnetworkpolicies/; range_end:/registry/crd.projectcalico.org/stagedkubernetesnetworkpolicies0; response_count:0; response_revision:1590; }","duration":"1.781047304s","start":"2025-06-20T19:53:41.783130Z","end":"2025-06-20T19:53:43.564177Z","steps":["trace[1901527659] 'agreement among raft nodes before linearized reading' (duration: 1.780962655s)"],"step_count":1} Jun 20 19:53:43.567934 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:43.564245Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:41.783092Z","time spent":"1.781134659s","remote":"172.24.4.123:40110","response type":"/etcdserverpb.KV/Range","request count":0,"request size":134,"response count":0,"response size":29,"request content":"key:\"/registry/crd.projectcalico.org/stagedkubernetesnetworkpolicies/\" range_end:\"/registry/crd.projectcalico.org/stagedkubernetesnetworkpolicies0\" count_only:true "} Jun 20 19:53:43.567934 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:43.564153Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"3.218324094s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/events/kube-system/kube-apiserver-ci-4344-1-0-0-4524070979.novalocal.184ad84a23b1cec8\" limit:1 ","response":"range_response_count:1 size:904"} Jun 20 19:53:43.567934 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:43.564356Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.359995123s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/servicecidrs/\" range_end:\"/registry/servicecidrs0\" count_only:true ","response":"range_response_count:0 size:7"} Jun 20 19:53:43.568208 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:43.564358Z","caller":"traceutil/trace.go:171","msg":"trace[520833885] range","detail":"{range_begin:/registry/events/kube-system/kube-apiserver-ci-4344-1-0-0-4524070979.novalocal.184ad84a23b1cec8; range_end:; response_count:1; response_revision:1590; }","duration":"3.218566079s","start":"2025-06-20T19:53:40.345779Z","end":"2025-06-20T19:53:43.564345Z","steps":["trace[520833885] 'agreement among raft nodes before linearized reading' (duration: 3.21821563s)"],"step_count":1} Jun 20 19:53:43.568208 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:43.564388Z","caller":"traceutil/trace.go:171","msg":"trace[1731776800] range","detail":"{range_begin:/registry/servicecidrs/; range_end:/registry/servicecidrs0; response_count:0; response_revision:1590; }","duration":"2.360081575s","start":"2025-06-20T19:53:41.204295Z","end":"2025-06-20T19:53:43.564377Z","steps":["trace[1731776800] 'agreement among raft nodes before linearized reading' (duration: 2.360039276s)"],"step_count":1} Jun 20 19:53:43.568208 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:43.564416Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:41.204258Z","time spent":"2.360147679s","remote":"172.24.4.123:60266","response type":"/etcdserverpb.KV/Range","request count":0,"request size":52,"response count":1,"response size":31,"request content":"key:\"/registry/servicecidrs/\" range_end:\"/registry/servicecidrs0\" count_only:true "} Jun 20 19:53:43.568208 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:43.564437Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:40.345758Z","time spent":"3.218656969s","remote":"172.24.4.123:60016","response type":"/etcdserverpb.KV/Range","request count":0,"request size":99,"response count":1,"response size":928,"request content":"key:\"/registry/events/kube-system/kube-apiserver-ci-4344-1-0-0-4524070979.novalocal.184ad84a23b1cec8\" limit:1 "} Jun 20 19:53:43.568555 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:43.564499Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.26154206s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/storageclasses/\" range_end:\"/registry/storageclasses0\" count_only:true ","response":"range_response_count:0 size:7"} Jun 20 19:53:43.568555 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:43.564523Z","caller":"traceutil/trace.go:171","msg":"trace[1087034776] range","detail":"{range_begin:/registry/storageclasses/; range_end:/registry/storageclasses0; response_count:0; response_revision:1590; }","duration":"2.261622282s","start":"2025-06-20T19:53:41.302893Z","end":"2025-06-20T19:53:43.564516Z","steps":["trace[1087034776] 'agreement among raft nodes before linearized reading' (duration: 2.261588718s)"],"step_count":1} Jun 20 19:53:43.568555 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:43.564658Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:41.302858Z","time spent":"2.261682254s","remote":"172.24.4.123:60324","response type":"/etcdserverpb.KV/Range","request count":0,"request size":56,"response count":1,"response size":31,"request content":"key:\"/registry/storageclasses/\" range_end:\"/registry/storageclasses0\" count_only:true "} Jun 20 19:53:44.196421 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:44.195154Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"482.846253ms","expected-duration":"100ms","prefix":"","request":"header: txn: success:> failure:<>>","response":"size:5"} Jun 20 19:53:44.196421 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:44.195349Z","caller":"traceutil/trace.go:171","msg":"trace[403634297] transaction","detail":"{read_only:false; number_of_response:0; response_revision:1591; }","duration":"600.005238ms","start":"2025-06-20T19:53:43.595311Z","end":"2025-06-20T19:53:44.195316Z","steps":["trace[403634297] 'process raft request' (duration: 116.931219ms)","trace[403634297] 'compare' (duration: 482.784135ms)"],"step_count":2} Jun 20 19:53:44.196421 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:44.195472Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:43.595289Z","time spent":"600.130524ms","remote":"172.24.4.123:39996","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":29,"request content":"compare: success:> failure:<>"} Jun 20 19:53:44.196421 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:44.195509Z","caller":"traceutil/trace.go:171","msg":"trace[400533290] transaction","detail":"{read_only:false; response_revision:1593; number_of_response:1; }","duration":"537.766317ms","start":"2025-06-20T19:53:43.657731Z","end":"2025-06-20T19:53:44.195497Z","steps":["trace[400533290] 'process raft request' (duration: 537.671339ms)"],"step_count":1} Jun 20 19:53:44.198739 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:44.195740Z","caller":"traceutil/trace.go:171","msg":"trace[1325403693] transaction","detail":"{read_only:false; response_revision:1592; number_of_response:1; }","duration":"551.729231ms","start":"2025-06-20T19:53:43.643991Z","end":"2025-06-20T19:53:44.195720Z","steps":["trace[1325403693] 'process raft request' (duration: 551.273695ms)"],"step_count":1} Jun 20 19:53:44.198739 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:44.195984Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:43.657695Z","time spent":"537.841439ms","remote":"172.24.4.123:60136","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":6818,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jun 20 19:53:44.198739 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:44.196140Z","caller":"traceutil/trace.go:171","msg":"trace[366641489] linearizableReadLoop","detail":"{readStateIndex:1971; appliedIndex:1970; }","duration":"560.349043ms","start":"2025-06-20T19:53:43.635758Z","end":"2025-06-20T19:53:44.196107Z","steps":["trace[366641489] 'read index received' (duration: 76.500717ms)","trace[366641489] 'applied index is now lower than readState.Index' (duration: 483.84519ms)"],"step_count":2} Jun 20 19:53:44.199119 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:44.196024Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:43.643942Z","time spent":"551.845779ms","remote":"172.24.4.123:60016","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":1155,"response count":0,"response size":40,"request content":"compare: success:> failure:<>"} Jun 20 19:53:44.199119 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:44.196771Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"197.491621ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/clusterrolebindings/\" range_end:\"/registry/clusterrolebindings0\" count_only:true ","response":"range_response_count:0 size:7"} Jun 20 19:53:44.199119 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:44.196807Z","caller":"traceutil/trace.go:171","msg":"trace[411484903] range","detail":"{range_begin:/registry/clusterrolebindings/; range_end:/registry/clusterrolebindings0; response_count:0; response_revision:1593; }","duration":"197.581129ms","start":"2025-06-20T19:53:43.999215Z","end":"2025-06-20T19:53:44.196796Z","steps":["trace[411484903] 'agreement among raft nodes before linearized reading' (duration: 197.483686ms)"],"step_count":1} Jun 20 19:53:44.199119 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:44.197654Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"600.908556ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jun 20 19:53:44.199435 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:44.197769Z","caller":"traceutil/trace.go:171","msg":"trace[2143334353] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1593; }","duration":"601.024013ms","start":"2025-06-20T19:53:43.596721Z","end":"2025-06-20T19:53:44.197745Z","steps":["trace[2143334353] 'agreement among raft nodes before linearized reading' (duration: 599.557707ms)"],"step_count":1} Jun 20 19:53:44.199435 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:44.198074Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:43.596713Z","time spent":"601.233026ms","remote":"172.24.4.123:59934","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":29,"request content":"key:\"/registry/health\" "} Jun 20 19:53:44.423168 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:44.421439Z","caller":"traceutil/trace.go:171","msg":"trace[1180341069] transaction","detail":"{read_only:false; response_revision:1594; number_of_response:1; }","duration":"200.970851ms","start":"2025-06-20T19:53:44.220437Z","end":"2025-06-20T19:53:44.421408Z","steps":["trace[1180341069] 'process raft request' (duration: 113.590037ms)","trace[1180341069] 'compare' (duration: 87.025996ms)"],"step_count":2} Jun 20 19:53:44.423168 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:44.421716Z","caller":"traceutil/trace.go:171","msg":"trace[1339424048] linearizableReadLoop","detail":"{readStateIndex:1974; appliedIndex:1973; }","duration":"200.521494ms","start":"2025-06-20T19:53:44.220824Z","end":"2025-06-20T19:53:44.421346Z","steps":["trace[1339424048] 'read index received' (duration: 113.136483ms)","trace[1339424048] 'applied index is now lower than readState.Index' (duration: 87.383478ms)"],"step_count":2} Jun 20 19:53:44.423168 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:44.422407Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"201.549247ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/tigera-operator/tigera-operator-68f7c7984d-hn5z4\" limit:1 ","response":"range_response_count:1 size:4034"} Jun 20 19:53:44.423168 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:44.422477Z","caller":"traceutil/trace.go:171","msg":"trace[1709820846] range","detail":"{range_begin:/registry/pods/tigera-operator/tigera-operator-68f7c7984d-hn5z4; range_end:; response_count:1; response_revision:1594; }","duration":"201.663061ms","start":"2025-06-20T19:53:44.220797Z","end":"2025-06-20T19:53:44.422460Z","steps":["trace[1709820846] 'agreement among raft nodes before linearized reading' (duration: 201.207174ms)"],"step_count":1} Jun 20 19:53:44.981230 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:44.980325Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078293,"retry-timeout":"500ms"} Jun 20 19:53:46.495883 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:46.492904Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.113925633s","expected-duration":"100ms","prefix":"","request":"header: txn: success:> failure: >>","response":"size:16"} Jun 20 19:53:46.495883 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:46.493129Z","caller":"traceutil/trace.go:171","msg":"trace[853090530] linearizableReadLoop","detail":"{readStateIndex:1976; appliedIndex:1975; }","duration":"2.01283511s","start":"2025-06-20T19:53:44.480256Z","end":"2025-06-20T19:53:46.493092Z","steps":["trace[853090530] 'read index received' (duration: 898.154759ms)","trace[853090530] 'applied index is now lower than readState.Index' (duration: 1.114676644s)"],"step_count":2} Jun 20 19:53:46.495883 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:46.493909Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.858991017s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jun 20 19:53:46.495883 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:46.494025Z","caller":"traceutil/trace.go:171","msg":"trace[170632071] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1596; }","duration":"1.859166285s","start":"2025-06-20T19:53:44.634825Z","end":"2025-06-20T19:53:46.493992Z","steps":["trace[170632071] 'agreement among raft nodes before linearized reading' (duration: 1.858987008s)"],"step_count":1} Jun 20 19:53:46.499324 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:46.494114Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:44.634791Z","time spent":"1.859290898s","remote":"172.24.4.123:59934","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":29,"request content":"key:\"/registry/health\" "} Jun 20 19:53:46.499324 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:46.494401Z","caller":"traceutil/trace.go:171","msg":"trace[244597445] transaction","detail":"{read_only:false; response_revision:1596; number_of_response:1; }","duration":"2.045663s","start":"2025-06-20T19:53:44.447873Z","end":"2025-06-20T19:53:46.493536Z","steps":["trace[244597445] 'process raft request' (duration: 930.650645ms)","trace[244597445] 'compare' (duration: 1.113730496s)"],"step_count":2} Jun 20 19:53:46.499324 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:46.494713Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"587.303415ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiregistration.k8s.io/apiservices/\" range_end:\"/registry/apiregistration.k8s.io/apiservices0\" count_only:true ","response":"range_response_count:0 size:7"} Jun 20 19:53:46.499324 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:46.494803Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:44.447852Z","time spent":"2.04676938s","remote":"172.24.4.123:60136","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":4315,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jun 20 19:53:46.499958 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:46.494941Z","caller":"traceutil/trace.go:171","msg":"trace[1698133596] range","detail":"{range_begin:/registry/apiregistration.k8s.io/apiservices/; range_end:/registry/apiregistration.k8s.io/apiservices0; response_count:0; response_revision:1596; }","duration":"587.4291ms","start":"2025-06-20T19:53:45.907354Z","end":"2025-06-20T19:53:46.494783Z","steps":["trace[1698133596] 'agreement among raft nodes before linearized reading' (duration: 587.204218ms)"],"step_count":1} Jun 20 19:53:46.499958 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:46.495016Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:45.907332Z","time spent":"587.659845ms","remote":"172.24.4.123:60500","response type":"/etcdserverpb.KV/Range","request count":0,"request size":96,"response count":24,"response size":31,"request content":"key:\"/registry/apiregistration.k8s.io/apiservices/\" range_end:\"/registry/apiregistration.k8s.io/apiservices0\" count_only:true "} Jun 20 19:53:46.499958 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:46.495298Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.849066172s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/jobs/\" range_end:\"/registry/jobs0\" count_only:true ","response":"range_response_count:0 size:5"} Jun 20 19:53:46.499958 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:46.495363Z","caller":"traceutil/trace.go:171","msg":"trace[14298401] range","detail":"{range_begin:/registry/jobs/; range_end:/registry/jobs0; response_count:0; response_revision:1596; }","duration":"1.849232102s","start":"2025-06-20T19:53:44.646116Z","end":"2025-06-20T19:53:46.495348Z","steps":["trace[14298401] 'agreement among raft nodes before linearized reading' (duration: 1.849141542s)"],"step_count":1} Jun 20 19:53:46.500375 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:46.495406Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:44.646097Z","time spent":"1.849293589s","remote":"172.24.4.123:60186","response type":"/etcdserverpb.KV/Range","request count":0,"request size":36,"response count":0,"response size":29,"request content":"key:\"/registry/jobs/\" range_end:\"/registry/jobs0\" count_only:true "} Jun 20 19:53:46.500375 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:46.494526Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.014226545s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/events/kube-system/kube-scheduler-ci-4344-1-0-0-4524070979.novalocal.184ad84a200c3258\" limit:1 ","response":"range_response_count:1 size:958"} Jun 20 19:53:46.500375 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:46.496593Z","caller":"traceutil/trace.go:171","msg":"trace[1978842907] range","detail":"{range_begin:/registry/events/kube-system/kube-scheduler-ci-4344-1-0-0-4524070979.novalocal.184ad84a200c3258; range_end:; response_count:1; response_revision:1596; }","duration":"2.016327834s","start":"2025-06-20T19:53:44.480209Z","end":"2025-06-20T19:53:46.496537Z","steps":["trace[1978842907] 'agreement among raft nodes before linearized reading' (duration: 2.014003746s)"],"step_count":1} Jun 20 19:53:46.500375 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:46.496689Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:44.480187Z","time spent":"2.016470011s","remote":"172.24.4.123:60016","response type":"/etcdserverpb.KV/Range","request count":0,"request size":99,"response count":1,"response size":982,"request content":"key:\"/registry/events/kube-system/kube-scheduler-ci-4344-1-0-0-4524070979.novalocal.184ad84a200c3258\" limit:1 "} Jun 20 19:53:46.708427 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:46.707212Z","caller":"traceutil/trace.go:171","msg":"trace[684150924] linearizableReadLoop","detail":"{readStateIndex:1977; appliedIndex:1976; }","duration":"170.305475ms","start":"2025-06-20T19:53:46.536872Z","end":"2025-06-20T19:53:46.707177Z","steps":["trace[684150924] 'read index received' (duration: 73.132722ms)","trace[684150924] 'applied index is now lower than readState.Index' (duration: 97.170979ms)"],"step_count":2} Jun 20 19:53:46.708427 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:46.707271Z","caller":"traceutil/trace.go:171","msg":"trace[1150354710] transaction","detail":"{read_only:false; response_revision:1597; number_of_response:1; }","duration":"207.75589ms","start":"2025-06-20T19:53:46.499464Z","end":"2025-06-20T19:53:46.707220Z","steps":["trace[1150354710] 'process raft request' (duration: 110.652698ms)","trace[1150354710] 'compare' (duration: 96.842632ms)"],"step_count":2} Jun 20 19:53:46.708427 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:46.707811Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"170.910782ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jun 20 19:53:46.709242 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:46.707913Z","caller":"traceutil/trace.go:171","msg":"trace[1981839810] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1597; }","duration":"171.041498ms","start":"2025-06-20T19:53:46.536819Z","end":"2025-06-20T19:53:46.707861Z","steps":["trace[1981839810] 'agreement among raft nodes before linearized reading' (duration: 170.489439ms)"],"step_count":1} Jun 20 19:53:46.947471 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:46.946847Z","caller":"traceutil/trace.go:171","msg":"trace[1517854548] transaction","detail":"{read_only:false; response_revision:1598; number_of_response:1; }","duration":"181.008ms","start":"2025-06-20T19:53:46.765802Z","end":"2025-06-20T19:53:46.946810Z","steps":["trace[1517854548] 'process raft request' (duration: 97.129994ms)","trace[1517854548] 'compare' (duration: 83.701924ms)"],"step_count":2} Jun 20 19:53:47.155741 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:47.154866Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"107.07937ms","expected-duration":"100ms","prefix":"","request":"header: txn: success:> failure:<>>","response":"size:16"} Jun 20 19:53:47.155741 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:47.155024Z","caller":"traceutil/trace.go:171","msg":"trace[977043223] transaction","detail":"{read_only:false; response_revision:1600; number_of_response:1; }","duration":"189.130872ms","start":"2025-06-20T19:53:46.965865Z","end":"2025-06-20T19:53:47.154996Z","steps":["trace[977043223] 'process raft request' (duration: 81.817693ms)","trace[977043223] 'compare' (duration: 106.836754ms)"],"step_count":2} Jun 20 19:53:47.288292 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:53:47.286930Z","caller":"traceutil/trace.go:171","msg":"trace[1489005959] transaction","detail":"{read_only:false; response_revision:1601; number_of_response:1; }","duration":"120.644263ms","start":"2025-06-20T19:53:47.166239Z","end":"2025-06-20T19:53:47.286883Z","steps":["trace[1489005959] 'process raft request' (duration: 97.636942ms)","trace[1489005959] 'compare' (duration: 22.74596ms)"],"step_count":2} Jun 20 19:53:59.069784 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:59.066247Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078463,"retry-timeout":"500ms"} Jun 20 19:53:59.569405 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:53:59.568876Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078463,"retry-timeout":"500ms"} Jun 20 19:54:00.070256 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:00.069330Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078463,"retry-timeout":"500ms"} Jun 20 19:54:00.570620 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:00.569722Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078463,"retry-timeout":"500ms"} Jun 20 19:54:00.644592 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:00.643306Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.0002462s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context canceled"} Jun 20 19:54:00.644976 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:00.643659Z","caller":"traceutil/trace.go:171","msg":"trace[1018839373] range","detail":"{range_begin:/registry/health; range_end:; }","duration":"2.000800443s","start":"2025-06-20T19:53:58.642668Z","end":"2025-06-20T19:54:00.643469Z","steps":["trace[1018839373] 'agreement among raft nodes before linearized reading' (duration: 2.000307987s)"],"step_count":1} Jun 20 19:54:00.644976 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:00.644107Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:58.642643Z","time spent":"2.001421319s","remote":"172.24.4.123:59934","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "} Jun 20 19:54:01.071277 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:01.070745Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078463,"retry-timeout":"500ms"} Jun 20 19:54:02.127689 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:01.571442Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078463,"retry-timeout":"500ms"} Jun 20 19:54:02.127689 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:02.072055Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078463,"retry-timeout":"500ms"} Jun 20 19:54:02.127689 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:02.105447Z","caller":"wal/wal.go:805","msg":"slow fdatasync","took":"3.563284416s","expected-duration":"1s"} Jun 20 19:54:02.127689 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:02.106817Z","caller":"traceutil/trace.go:171","msg":"trace[1878433137] transaction","detail":"{read_only:false; response_revision:1624; number_of_response:1; }","duration":"3.564775477s","start":"2025-06-20T19:53:58.542014Z","end":"2025-06-20T19:54:02.106790Z","steps":["trace[1878433137] 'process raft request' (duration: 3.564449524s)"],"step_count":1} Jun 20 19:54:02.127689 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:02.107313Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:58.541991Z","time spent":"3.56490468s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":625,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jun 20 19:54:02.207058 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:02.206212Z","caller":"traceutil/trace.go:171","msg":"trace[1051459827] transaction","detail":"{read_only:false; response_revision:1625; number_of_response:1; }","duration":"3.66130331s","start":"2025-06-20T19:53:58.544808Z","end":"2025-06-20T19:54:02.206112Z","steps":["trace[1051459827] 'process raft request' (duration: 3.645684101s)","trace[1051459827] 'compare' (duration: 15.173573ms)"],"step_count":2} Jun 20 19:54:02.209522 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:02.207043Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:58.544773Z","time spent":"3.661545896s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":699,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jun 20 19:54:02.209522 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:02.207407Z","caller":"traceutil/trace.go:171","msg":"trace[154420220] linearizableReadLoop","detail":"{readStateIndex:2046; appliedIndex:2042; }","duration":"3.641677099s","start":"2025-06-20T19:53:58.565700Z","end":"2025-06-20T19:54:02.207377Z","steps":["trace[154420220] 'read index received' (duration: 3.540855788s)","trace[154420220] 'applied index is now lower than readState.Index' (duration: 100.820229ms)"],"step_count":2} Jun 20 19:54:02.209522 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:02.207547Z","caller":"traceutil/trace.go:171","msg":"trace[243163269] transaction","detail":"{read_only:false; response_revision:1626; number_of_response:1; }","duration":"3.541848934s","start":"2025-06-20T19:53:58.665684Z","end":"2025-06-20T19:54:02.207533Z","steps":["trace[243163269] 'process raft request' (duration: 3.540302368s)"],"step_count":1} Jun 20 19:54:02.209522 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:02.207892Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"3.642244013s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/masterleases/172.24.4.123\" limit:1 ","response":"range_response_count:1 size:131"} Jun 20 19:54:02.211116 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:02.207996Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:58.665625Z","time spent":"3.54218219s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":537,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jun 20 19:54:02.211116 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:02.208046Z","caller":"traceutil/trace.go:171","msg":"trace[1728435597] range","detail":"{range_begin:/registry/masterleases/172.24.4.123; range_end:; response_count:1; response_revision:1627; }","duration":"3.642485048s","start":"2025-06-20T19:53:58.565536Z","end":"2025-06-20T19:54:02.208021Z","steps":["trace[1728435597] 'agreement among raft nodes before linearized reading' (duration: 3.64200207s)"],"step_count":1} Jun 20 19:54:02.211116 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:02.208138Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:58.565515Z","time spent":"3.642599292s","remote":"172.24.4.123:59956","response type":"/etcdserverpb.KV/Range","request count":0,"request size":39,"response count":1,"response size":155,"request content":"key:\"/registry/masterleases/172.24.4.123\" limit:1 "} Jun 20 19:54:02.211116 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:02.208523Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"3.537377944s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/leases/tigera-operator/operator-lock\" limit:1 ","response":"range_response_count:1 size:505"} Jun 20 19:54:02.211560 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:02.208743Z","caller":"traceutil/trace.go:171","msg":"trace[57626568] range","detail":"{range_begin:/registry/leases/tigera-operator/operator-lock; range_end:; response_count:1; response_revision:1627; }","duration":"3.537542232s","start":"2025-06-20T19:53:58.671096Z","end":"2025-06-20T19:54:02.208639Z","steps":["trace[57626568] 'agreement among raft nodes before linearized reading' (duration: 3.537117284s)"],"step_count":1} Jun 20 19:54:02.211560 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:02.208839Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:58.671088Z","time spent":"3.537726718s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Range","request count":0,"request size":50,"response count":1,"response size":529,"request content":"key:\"/registry/leases/tigera-operator/operator-lock\" limit:1 "} Jun 20 19:54:02.211560 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:02.209054Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"842.98936ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/kube-system/kube-scheduler-ci-4344-1-0-0-4524070979.novalocal\" limit:1 ","response":"range_response_count:1 size:4982"} Jun 20 19:54:02.211560 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:02.210148Z","caller":"traceutil/trace.go:171","msg":"trace[1645683891] range","detail":"{range_begin:/registry/pods/kube-system/kube-scheduler-ci-4344-1-0-0-4524070979.novalocal; range_end:; response_count:1; response_revision:1627; }","duration":"843.790654ms","start":"2025-06-20T19:54:01.365972Z","end":"2025-06-20T19:54:02.209762Z","steps":["trace[1645683891] 'agreement among raft nodes before linearized reading' (duration: 842.948863ms)"],"step_count":1} Jun 20 19:54:02.211970 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:02.209429Z","caller":"traceutil/trace.go:171","msg":"trace[1606103156] transaction","detail":"{read_only:false; response_revision:1627; number_of_response:1; }","duration":"694.77533ms","start":"2025-06-20T19:54:01.514412Z","end":"2025-06-20T19:54:02.209188Z","steps":["trace[1606103156] 'process raft request' (duration: 692.805939ms)"],"step_count":1} Jun 20 19:54:02.213104 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:02.210668Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:01.365943Z","time spent":"844.276768ms","remote":"172.24.4.123:60136","response type":"/etcdserverpb.KV/Range","request count":0,"request size":80,"response count":1,"response size":5006,"request content":"key:\"/registry/pods/kube-system/kube-scheduler-ci-4344-1-0-0-4524070979.novalocal\" limit:1 "} Jun 20 19:54:02.213687 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:02.210954Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.567555461s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jun 20 19:54:02.213687 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:02.212364Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:01.514357Z","time spent":"697.826133ms","remote":"172.24.4.123:60130","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":4592,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jun 20 19:54:02.213687 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:02.212759Z","caller":"traceutil/trace.go:171","msg":"trace[2106661316] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1627; }","duration":"1.569419233s","start":"2025-06-20T19:54:00.643314Z","end":"2025-06-20T19:54:02.212733Z","steps":["trace[2106661316] 'agreement among raft nodes before linearized reading' (duration: 1.567578264s)"],"step_count":1} Jun 20 19:54:02.213687 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:02.212928Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:00.643280Z","time spent":"1.569595225s","remote":"172.24.4.123:59944","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":29,"request content":"key:\"/registry/health\" "} Jun 20 19:54:02.213687 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:02.211042Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.663202486s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/leases/\" range_end:\"/registry/leases0\" count_only:true ","response":"range_response_count:0 size:7"} Jun 20 19:54:02.214746 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:02.213044Z","caller":"traceutil/trace.go:171","msg":"trace[31839927] range","detail":"{range_begin:/registry/leases/; range_end:/registry/leases0; response_count:0; response_revision:1627; }","duration":"1.665286862s","start":"2025-06-20T19:54:00.547735Z","end":"2025-06-20T19:54:02.213022Z","steps":["trace[31839927] 'agreement among raft nodes before linearized reading' (duration: 1.663279611s)"],"step_count":1} Jun 20 19:54:02.214746 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:02.213245Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:00.547706Z","time spent":"1.665455378s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Range","request count":0,"request size":40,"response count":6,"response size":31,"request content":"key:\"/registry/leases/\" range_end:\"/registry/leases0\" count_only:true "} Jun 20 19:54:02.214746 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:02.211201Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.096629226s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/leases/kube-system/kube-controller-manager\" limit:1 ","response":"range_response_count:1 size:532"} Jun 20 19:54:02.214746 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:02.211317Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.558915479s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/leases/kube-system/kube-scheduler\" limit:1 ","response":"range_response_count:1 size:505"} Jun 20 19:54:02.216118 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:02.214466Z","caller":"traceutil/trace.go:171","msg":"trace[1529633150] range","detail":"{range_begin:/registry/leases/kube-system/kube-scheduler; range_end:; response_count:1; response_revision:1627; }","duration":"2.561843009s","start":"2025-06-20T19:53:59.652335Z","end":"2025-06-20T19:54:02.214178Z","steps":["trace[1529633150] 'agreement among raft nodes before linearized reading' (duration: 2.558907975s)"],"step_count":1} Jun 20 19:54:02.216118 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:02.214657Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:59.652312Z","time spent":"2.56231688s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Range","request count":0,"request size":47,"response count":1,"response size":529,"request content":"key:\"/registry/leases/kube-system/kube-scheduler\" limit:1 "} Jun 20 19:54:02.216118 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:02.211425Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.570376865s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/blockaffinities/\" range_end:\"/registry/crd.projectcalico.org/blockaffinities0\" count_only:true ","response":"range_response_count:0 size:7"} Jun 20 19:54:02.216118 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:02.214940Z","caller":"traceutil/trace.go:171","msg":"trace[370817308] range","detail":"{range_begin:/registry/crd.projectcalico.org/blockaffinities/; range_end:/registry/crd.projectcalico.org/blockaffinities0; response_count:0; response_revision:1627; }","duration":"2.573830666s","start":"2025-06-20T19:53:59.641014Z","end":"2025-06-20T19:54:02.214845Z","steps":["trace[370817308] 'agreement among raft nodes before linearized reading' (duration: 2.570333004s)"],"step_count":1} Jun 20 19:54:02.216868 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:02.215052Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:59.640924Z","time spent":"2.574055198s","remote":"172.24.4.123:40134","response type":"/etcdserverpb.KV/Range","request count":0,"request size":102,"response count":2,"response size":31,"request content":"key:\"/registry/crd.projectcalico.org/blockaffinities/\" range_end:\"/registry/crd.projectcalico.org/blockaffinities0\" count_only:true "} Jun 20 19:54:02.216868 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:02.211507Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"3.280017316s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/runtimeclasses/\" range_end:\"/registry/runtimeclasses0\" count_only:true ","response":"range_response_count:0 size:5"} Jun 20 19:54:02.216868 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:02.215241Z","caller":"traceutil/trace.go:171","msg":"trace[1479592166] range","detail":"{range_begin:/registry/leases/kube-system/kube-controller-manager; range_end:; response_count:1; response_revision:1627; }","duration":"2.099072478s","start":"2025-06-20T19:54:00.114464Z","end":"2025-06-20T19:54:02.213537Z","steps":["trace[1479592166] 'agreement among raft nodes before linearized reading' (duration: 2.096626602s)"],"step_count":1} Jun 20 19:54:02.216868 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:02.215273Z","caller":"traceutil/trace.go:171","msg":"trace[619239544] range","detail":"{range_begin:/registry/runtimeclasses/; range_end:/registry/runtimeclasses0; response_count:0; response_revision:1627; }","duration":"3.283876379s","start":"2025-06-20T19:53:58.931381Z","end":"2025-06-20T19:54:02.215258Z","steps":["trace[619239544] 'agreement among raft nodes before linearized reading' (duration: 3.280075316s)"],"step_count":1} Jun 20 19:54:02.217541 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:02.215345Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:00.114429Z","time spent":"2.100885314s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Range","request count":0,"request size":56,"response count":1,"response size":556,"request content":"key:\"/registry/leases/kube-system/kube-controller-manager\" limit:1 "} Jun 20 19:54:02.217541 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:02.215372Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:53:58.931350Z","time spent":"3.284001223s","remote":"172.24.4.123:60274","response type":"/etcdserverpb.KV/Range","request count":0,"request size":56,"response count":0,"response size":29,"request content":"key:\"/registry/runtimeclasses/\" range_end:\"/registry/runtimeclasses0\" count_only:true "} Jun 20 19:54:04.870718 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:04.870191Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078485,"retry-timeout":"500ms"} Jun 20 19:54:05.371786 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:05.370994Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078485,"retry-timeout":"500ms"} Jun 20 19:54:05.463908 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:05.463033Z","caller":"wal/wal.go:805","msg":"slow fdatasync","took":"1.456561436s","expected-duration":"1s"} Jun 20 19:54:05.495061 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:05.492931Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.718419582s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/stagednetworkpolicies/\" range_end:\"/registry/crd.projectcalico.org/stagednetworkpolicies0\" count_only:true ","response":"range_response_count:0 size:5"} Jun 20 19:54:05.495505 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:05.493064Z","caller":"traceutil/trace.go:171","msg":"trace[390308298] range","detail":"{range_begin:/registry/crd.projectcalico.org/stagednetworkpolicies/; range_end:/registry/crd.projectcalico.org/stagednetworkpolicies0; response_count:0; response_revision:1631; }","duration":"2.718605301s","start":"2025-06-20T19:54:02.774418Z","end":"2025-06-20T19:54:05.493024Z","steps":["trace[390308298] 'count revisions from in-memory index tree' (duration: 2.718311298s)"],"step_count":1} Jun 20 19:54:05.495505 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:05.493154Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:02.774393Z","time spent":"2.718738651s","remote":"172.24.4.123:40108","response type":"/etcdserverpb.KV/Range","request count":0,"request size":114,"response count":0,"response size":29,"request content":"key:\"/registry/crd.projectcalico.org/stagednetworkpolicies/\" range_end:\"/registry/crd.projectcalico.org/stagednetworkpolicies0\" count_only:true "} Jun 20 19:54:05.495505 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:05.493884Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.512077885s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/kube-system/kube-controller-manager-ci-4344-1-0-0-4524070979.novalocal\" limit:1 ","response":"range_response_count:1 size:6844"} Jun 20 19:54:05.495505 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:05.493965Z","caller":"traceutil/trace.go:171","msg":"trace[1180120322] range","detail":"{range_begin:/registry/pods/kube-system/kube-controller-manager-ci-4344-1-0-0-4524070979.novalocal; range_end:; response_count:1; response_revision:1631; }","duration":"1.5122301s","start":"2025-06-20T19:54:03.981717Z","end":"2025-06-20T19:54:05.493947Z","steps":["trace[1180120322] 'range keys from in-memory index tree' (duration: 1.511624161s)"],"step_count":1} Jun 20 19:54:05.496921 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:05.494021Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:03.981689Z","time spent":"1.512309199s","remote":"172.24.4.123:60136","response type":"/etcdserverpb.KV/Range","request count":0,"request size":89,"response count":1,"response size":6868,"request content":"key:\"/registry/pods/kube-system/kube-controller-manager-ci-4344-1-0-0-4524070979.novalocal\" limit:1 "} Jun 20 19:54:05.496921 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:05.494287Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.860408077s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jun 20 19:54:05.496921 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:05.494365Z","caller":"traceutil/trace.go:171","msg":"trace[1219965763] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1631; }","duration":"1.860519146s","start":"2025-06-20T19:54:03.633813Z","end":"2025-06-20T19:54:05.494332Z","steps":["trace[1219965763] 'range keys from in-memory index tree' (duration: 1.860263886s)"],"step_count":1} Jun 20 19:54:05.496921 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:05.494409Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:03.633778Z","time spent":"1.860616768s","remote":"172.24.4.123:59934","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":29,"request content":"key:\"/registry/health\" "} Jun 20 19:54:05.496921 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:05.496196Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:04.176295Z","time spent":"1.31986055s","remote":"172.24.4.123:55704","response type":"/etcdserverpb.Maintenance/Status","request count":-1,"request size":-1,"response count":-1,"response size":-1,"request content":""} Jun 20 19:54:05.518824 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:05.517455Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.147719479s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/clusterinformations/default\" limit:1 ","response":"range_response_count:1 size:886"} Jun 20 19:54:05.519091 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:05.517155Z","caller":"traceutil/trace.go:171","msg":"trace[1066062484] linearizableReadLoop","detail":"{readStateIndex:2052; appliedIndex:2051; }","duration":"1.147364473s","start":"2025-06-20T19:54:04.369707Z","end":"2025-06-20T19:54:05.517072Z","steps":["trace[1066062484] 'read index received' (duration: 1.093504248s)","trace[1066062484] 'applied index is now lower than readState.Index' (duration: 53.858772ms)"],"step_count":2} Jun 20 19:54:05.519091 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:05.518217Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.027878615s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/felixconfigurations/\" range_end:\"/registry/crd.projectcalico.org/felixconfigurations0\" count_only:true ","response":"range_response_count:0 size:7"} Jun 20 19:54:05.519091 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:05.518295Z","caller":"traceutil/trace.go:171","msg":"trace[338556069] range","detail":"{range_begin:/registry/crd.projectcalico.org/felixconfigurations/; range_end:/registry/crd.projectcalico.org/felixconfigurations0; response_count:0; response_revision:1631; }","duration":"1.028011082s","start":"2025-06-20T19:54:04.490266Z","end":"2025-06-20T19:54:05.518277Z","steps":["trace[338556069] 'agreement among raft nodes before linearized reading' (duration: 1.027878995s)"],"step_count":1} Jun 20 19:54:05.519091 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:05.518378Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:04.490243Z","time spent":"1.028113475s","remote":"172.24.4.123:46716","response type":"/etcdserverpb.KV/Range","request count":0,"request size":110,"response count":1,"response size":31,"request content":"key:\"/registry/crd.projectcalico.org/felixconfigurations/\" range_end:\"/registry/crd.projectcalico.org/felixconfigurations0\" count_only:true "} Jun 20 19:54:05.520381 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:05.519327Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"595.203834ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jun 20 19:54:05.520713 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:05.517632Z","caller":"traceutil/trace.go:171","msg":"trace[1444230228] range","detail":"{range_begin:/registry/crd.projectcalico.org/clusterinformations/default; range_end:; response_count:1; response_revision:1631; }","duration":"1.147927649s","start":"2025-06-20T19:54:04.369602Z","end":"2025-06-20T19:54:05.517529Z","steps":["trace[1444230228] 'agreement among raft nodes before linearized reading' (duration: 1.147619811s)"],"step_count":1} Jun 20 19:54:05.520713 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:05.519737Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:04.369539Z","time spent":"1.150140668s","remote":"172.24.4.123:46740","response type":"/etcdserverpb.KV/Range","request count":0,"request size":63,"response count":1,"response size":910,"request content":"key:\"/registry/crd.projectcalico.org/clusterinformations/default\" limit:1 "} Jun 20 19:54:05.520713 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:05.519943Z","caller":"traceutil/trace.go:171","msg":"trace[1883185823] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1631; }","duration":"595.427984ms","start":"2025-06-20T19:54:04.923999Z","end":"2025-06-20T19:54:05.519427Z","steps":["trace[1883185823] 'agreement among raft nodes before linearized reading' (duration: 595.244039ms)"],"step_count":1} Jun 20 19:54:05.520713 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:05.520121Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"919.968306ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/leases/kube-system/kube-controller-manager\" limit:1 ","response":"range_response_count:1 size:532"} Jun 20 19:54:05.520713 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:05.520135Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:04.923887Z","time spent":"596.173525ms","remote":"172.24.4.123:59934","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":29,"request content":"key:\"/registry/health\" "} Jun 20 19:54:05.521023 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:05.520169Z","caller":"traceutil/trace.go:171","msg":"trace[422988788] range","detail":"{range_begin:/registry/leases/kube-system/kube-controller-manager; range_end:; response_count:1; response_revision:1631; }","duration":"920.055129ms","start":"2025-06-20T19:54:04.600095Z","end":"2025-06-20T19:54:05.520150Z","steps":["trace[422988788] 'agreement among raft nodes before linearized reading' (duration: 919.871022ms)"],"step_count":1} Jun 20 19:54:05.521023 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:05.520212Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:04.600005Z","time spent":"920.192768ms","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Range","request count":0,"request size":56,"response count":1,"response size":556,"request content":"key:\"/registry/leases/kube-system/kube-controller-manager\" limit:1 "} Jun 20 19:54:05.886069 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:05.885088Z","caller":"traceutil/trace.go:171","msg":"trace[2084464852] transaction","detail":"{read_only:false; response_revision:1632; number_of_response:1; }","duration":"357.696189ms","start":"2025-06-20T19:54:05.527362Z","end":"2025-06-20T19:54:05.885058Z","steps":["trace[2084464852] 'process raft request' (duration: 357.269066ms)"],"step_count":1} Jun 20 19:54:05.886069 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:05.885279Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:05.527327Z","time spent":"357.85682ms","remote":"172.24.4.123:60136","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":6830,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jun 20 19:54:06.159132 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:06.157880Z","caller":"traceutil/trace.go:171","msg":"trace[1838964113] linearizableReadLoop","detail":"{readStateIndex:2054; appliedIndex:2053; }","duration":"264.125493ms","start":"2025-06-20T19:54:05.893724Z","end":"2025-06-20T19:54:06.157850Z","steps":["trace[1838964113] 'read index received' (duration: 236.774142ms)","trace[1838964113] 'applied index is now lower than readState.Index' (duration: 27.328578ms)"],"step_count":2} Jun 20 19:54:06.159132 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:06.157993Z","caller":"traceutil/trace.go:171","msg":"trace[1291139878] transaction","detail":"{read_only:false; number_of_response:0; response_revision:1632; }","duration":"621.107488ms","start":"2025-06-20T19:54:05.536786Z","end":"2025-06-20T19:54:06.157894Z","steps":["trace[1291139878] 'process raft request' (duration: 593.828883ms)","trace[1291139878] 'compare' (duration: 27.167106ms)"],"step_count":2} Jun 20 19:54:06.159132 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:06.158063Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"264.309278ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/kube-system/kube-controller-manager-ci-4344-1-0-0-4524070979.novalocal\" limit:1 ","response":"range_response_count:1 size:6844"} Jun 20 19:54:06.159132 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:06.158115Z","caller":"traceutil/trace.go:171","msg":"trace[184548509] range","detail":"{range_begin:/registry/pods/kube-system/kube-controller-manager-ci-4344-1-0-0-4524070979.novalocal; range_end:; response_count:1; response_revision:1632; }","duration":"264.38499ms","start":"2025-06-20T19:54:05.893714Z","end":"2025-06-20T19:54:06.158099Z","steps":["trace[184548509] 'agreement among raft nodes before linearized reading' (duration: 264.248244ms)"],"step_count":1} Jun 20 19:54:06.159917 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:06.158229Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:05.536758Z","time spent":"621.348572ms","remote":"172.24.4.123:39996","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":29,"request content":"compare: success:> failure:<>"} Jun 20 19:54:11.824786 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:11.823830Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078705,"retry-timeout":"500ms"} Jun 20 19:54:11.973339 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:11.972426Z","caller":"traceutil/trace.go:171","msg":"trace[1941663283] transaction","detail":"{read_only:false; response_revision:1654; number_of_response:1; }","duration":"650.257057ms","start":"2025-06-20T19:54:11.322141Z","end":"2025-06-20T19:54:11.972398Z","steps":["trace[1941663283] 'process raft request' (duration: 650.034259ms)"],"step_count":1} Jun 20 19:54:11.974269 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:11.972679Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:11.322105Z","time spent":"650.408012ms","remote":"172.24.4.123:60016","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":952,"response count":0,"response size":40,"request content":"compare: success:> failure:<>"} Jun 20 19:54:12.009549 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:12.008760Z","caller":"traceutil/trace.go:171","msg":"trace[272412773] linearizableReadLoop","detail":"{readStateIndex:2081; appliedIndex:2080; }","duration":"685.945192ms","start":"2025-06-20T19:54:11.322775Z","end":"2025-06-20T19:54:12.008720Z","steps":["trace[272412773] 'read index received' (duration: 650.488582ms)","trace[272412773] 'applied index is now lower than readState.Index' (duration: 35.455037ms)"],"step_count":2} Jun 20 19:54:12.010977 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:12.009737Z","caller":"traceutil/trace.go:171","msg":"trace[603480266] transaction","detail":"{read_only:false; response_revision:1655; number_of_response:1; }","duration":"369.870019ms","start":"2025-06-20T19:54:11.639833Z","end":"2025-06-20T19:54:12.009703Z","steps":["trace[603480266] 'process raft request' (duration: 368.307073ms)"],"step_count":1} Jun 20 19:54:12.010977 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:12.009914Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:11.639809Z","time spent":"370.01983ms","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":517,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jun 20 19:54:12.010977 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:12.010244Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"687.459157ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/clusterrolebindings/whisker:csr-creator\" limit:1 ","response":"range_response_count:0 size:5"} Jun 20 19:54:12.010977 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:12.010320Z","caller":"traceutil/trace.go:171","msg":"trace[1750511076] range","detail":"{range_begin:/registry/clusterrolebindings/whisker:csr-creator; range_end:; response_count:0; response_revision:1655; }","duration":"687.546651ms","start":"2025-06-20T19:54:11.322733Z","end":"2025-06-20T19:54:12.010280Z","steps":["trace[1750511076] 'agreement among raft nodes before linearized reading' (duration: 687.272987ms)"],"step_count":1} Jun 20 19:54:12.011634 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:12.010365Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:11.322710Z","time spent":"687.639867ms","remote":"172.24.4.123:60306","response type":"/etcdserverpb.KV/Range","request count":0,"request size":53,"response count":0,"response size":29,"request content":"key:\"/registry/clusterrolebindings/whisker:csr-creator\" limit:1 "} Jun 20 19:54:12.511242 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:12.510354Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078709,"retry-timeout":"500ms"} Jun 20 19:54:13.012954 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:13.011780Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078709,"retry-timeout":"500ms"} Jun 20 19:54:13.267105 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:13.265635Z","caller":"wal/wal.go:805","msg":"slow fdatasync","took":"1.257418475s","expected-duration":"1s"} Jun 20 19:54:13.641215 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:13.639657Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.000659599s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context deadline exceeded"} Jun 20 19:54:13.641215 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:13.639912Z","caller":"traceutil/trace.go:171","msg":"trace[316442162] range","detail":"{range_begin:/registry/health; range_end:; }","duration":"2.001050282s","start":"2025-06-20T19:54:11.638778Z","end":"2025-06-20T19:54:13.639828Z","steps":["trace[316442162] 'agreement among raft nodes before linearized reading' (duration: 2.000694895s)"],"step_count":1} Jun 20 19:54:13.641215 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:13.640064Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:11.638752Z","time spent":"2.00125651s","remote":"172.24.4.123:59934","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "} Jun 20 19:54:15.641543 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:15.640395Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.99987962s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context canceled"} Jun 20 19:54:15.641543 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:15.640529Z","caller":"traceutil/trace.go:171","msg":"trace[1534391886] range","detail":"{range_begin:/registry/health; range_end:; }","duration":"2.000102378s","start":"2025-06-20T19:54:13.640396Z","end":"2025-06-20T19:54:15.640498Z","steps":["trace[1534391886] 'agreement among raft nodes before linearized reading' (duration: 1.999935555s)"],"step_count":1} Jun 20 19:54:15.641543 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:15.640700Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:13.640359Z","time spent":"2.000286865s","remote":"172.24.4.123:59944","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "} Jun 20 19:54:23.420977 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:16.926040Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.000267233s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context canceled"} Jun 20 19:54:23.420977 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:16.926328Z","caller":"traceutil/trace.go:171","msg":"trace[1348849121] range","detail":"{range_begin:/registry/health; range_end:; }","duration":"2.000701538s","start":"2025-06-20T19:54:14.925554Z","end":"2025-06-20T19:54:16.926255Z","steps":["trace[1348849121] 'agreement among raft nodes before linearized reading' (duration: 2.000398028s)"],"step_count":1} Jun 20 19:54:23.420977 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:16.926436Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:14.925518Z","time spent":"2.000890433s","remote":"172.24.4.123:59934","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "} Jun 20 19:54:23.420977 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:17.005901Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:12.008053Z","time spent":"4.997827794s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jun 20 19:54:23.420977 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:17.594614Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:12.596824Z","time spent":"4.997734612s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jun 20 19:54:23.420977 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:17.662086Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.000396031s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context deadline exceeded"} Jun 20 19:54:23.423380 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:17.662238Z","caller":"traceutil/trace.go:171","msg":"trace[583545691] range","detail":"{range_begin:/registry/health; range_end:; }","duration":"2.000685333s","start":"2025-06-20T19:54:15.661531Z","end":"2025-06-20T19:54:17.662216Z","steps":["trace[583545691] 'agreement among raft nodes before linearized reading' (duration: 2.000473857s)"],"step_count":1} Jun 20 19:54:23.423380 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:17.663097Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:15.661516Z","time spent":"2.00149249s","remote":"172.24.4.123:59944","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "} Jun 20 19:54:23.423380 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:19.019181Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:14.022800Z","time spent":"4.996372467s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jun 20 19:54:23.423380 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:19.360915Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:12.359723Z","time spent":"7.001184325s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jun 20 19:54:23.423380 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:19.367301Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:12.366669Z","time spent":"7.000621347s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jun 20 19:54:23.423996 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:19.445094Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:12.444017Z","time spent":"7.001020903s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jun 20 19:54:23.423996 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:19.452330Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:12.451271Z","time spent":"7.001048655s","remote":"172.24.4.123:46688","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jun 20 19:54:23.423996 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:19.458611Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:12.458097Z","time spent":"7.000504772s","remote":"172.24.4.123:46688","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jun 20 19:54:23.423996 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:19.682775Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.000321862s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context canceled"} Jun 20 19:54:23.423996 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:19.682838Z","caller":"traceutil/trace.go:171","msg":"trace[1628527392] range","detail":"{range_begin:/registry/health; range_end:; }","duration":"2.00043229s","start":"2025-06-20T19:54:17.682390Z","end":"2025-06-20T19:54:19.682822Z","steps":["trace[1628527392] 'agreement among raft nodes before linearized reading' (duration: 2.000354163s)"],"step_count":1} Jun 20 19:54:23.425121 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:19.682874Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:17.682366Z","time spent":"2.000499235s","remote":"172.24.4.123:59934","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "} Jun 20 19:54:23.425121 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:20.318924Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"3.995679364s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/clusterinformations/default\" limit:1 ","response":"","error":"context canceled"} Jun 20 19:54:23.425121 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:20.318987Z","caller":"traceutil/trace.go:171","msg":"trace[1770128357] range","detail":"{range_begin:/registry/crd.projectcalico.org/clusterinformations/default; range_end:; }","duration":"3.995850685s","start":"2025-06-20T19:54:16.323122Z","end":"2025-06-20T19:54:20.318973Z","steps":["trace[1770128357] 'agreement among raft nodes before linearized reading' (duration: 3.995747091s)"],"step_count":1} Jun 20 19:54:23.425121 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:20.319025Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:16.323037Z","time spent":"3.995976512s","remote":"172.24.4.123:46740","response type":"/etcdserverpb.KV/Range","request count":0,"request size":63,"response count":0,"response size":0,"request content":"key:\"/registry/crd.projectcalico.org/clusterinformations/default\" limit:1 "} Jun 20 19:54:23.425121 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:21.683690Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.000478971s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context deadline exceeded"} Jun 20 19:54:23.425702 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:21.683811Z","caller":"traceutil/trace.go:171","msg":"trace[2136859160] range","detail":"{range_begin:/registry/health; range_end:; }","duration":"2.00072253s","start":"2025-06-20T19:54:19.683062Z","end":"2025-06-20T19:54:21.683784Z","steps":["trace[2136859160] 'agreement among raft nodes before linearized reading' (duration: 2.000573409s)"],"step_count":1} Jun 20 19:54:23.425702 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:21.683908Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:19.683032Z","time spent":"2.000854036s","remote":"172.24.4.123:59944","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "} Jun 20 19:54:23.425702 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:22.010686Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"4.999354454s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/leases/tigera-operator/operator-lock\" limit:1 ","response":"","error":"context deadline exceeded"} Jun 20 19:54:23.425702 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:22.010758Z","caller":"traceutil/trace.go:171","msg":"trace[1420377392] range","detail":"{range_begin:/registry/leases/tigera-operator/operator-lock; range_end:; }","duration":"4.999536678s","start":"2025-06-20T19:54:17.011206Z","end":"2025-06-20T19:54:22.010743Z","steps":["trace[1420377392] 'agreement among raft nodes before linearized reading' (duration: 4.999440707s)"],"step_count":1} Jun 20 19:54:23.425702 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:22.010803Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:17.011182Z","time spent":"4.999608804s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Range","request count":0,"request size":50,"response count":0,"response size":0,"request content":"key:\"/registry/leases/tigera-operator/operator-lock\" limit:1 "} Jun 20 19:54:23.426185 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:22.596681Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"4.999098649s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/leases/kube-system/kube-scheduler\" limit:1 ","response":"","error":"context deadline exceeded"} Jun 20 19:54:23.426185 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:22.596856Z","caller":"traceutil/trace.go:171","msg":"trace[305533252] range","detail":"{range_begin:/registry/leases/kube-system/kube-scheduler; range_end:; }","duration":"4.999266273s","start":"2025-06-20T19:54:17.597500Z","end":"2025-06-20T19:54:22.596766Z","steps":["trace[305533252] 'agreement among raft nodes before linearized reading' (duration: 4.999130909s)"],"step_count":1} Jun 20 19:54:23.426185 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:22.596957Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:17.597479Z","time spent":"4.999454897s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Range","request count":0,"request size":47,"response count":0,"response size":0,"request content":"key:\"/registry/leases/kube-system/kube-scheduler\" limit:1 "} Jun 20 19:54:23.438724 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.438209Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"12.100849712s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/poddisruptionbudgets/calico-apiserver/calico-apiserver\" limit:1 ","response":"","error":"context canceled"} Jun 20 19:54:23.439225 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:23.438815Z","caller":"traceutil/trace.go:171","msg":"trace[717006682] range","detail":"{range_begin:/registry/poddisruptionbudgets/calico-apiserver/calico-apiserver; range_end:; }","duration":"12.101520793s","start":"2025-06-20T19:54:11.337269Z","end":"2025-06-20T19:54:23.438790Z","steps":["trace[717006682] 'agreement among raft nodes before linearized reading' (duration: 12.100905527s)"],"step_count":1} Jun 20 19:54:23.439225 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.438899Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:11.337231Z","time spent":"12.101648953s","remote":"172.24.4.123:60282","response type":"/etcdserverpb.KV/Range","request count":0,"request size":68,"response count":0,"response size":0,"request content":"key:\"/registry/poddisruptionbudgets/calico-apiserver/calico-apiserver\" limit:1 "} Jun 20 19:54:23.439225 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.438597Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:19.467488Z","time spent":"3.971103907s","remote":"172.24.4.123:46688","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jun 20 19:54:23.439225 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.438639Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"12.11397972s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/installations/default\" limit:1 ","response":"","error":"context canceled"} Jun 20 19:54:23.439225 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:23.439101Z","caller":"traceutil/trace.go:171","msg":"trace[1182856053] range","detail":"{range_begin:/registry/operator.tigera.io/installations/default; range_end:; }","duration":"12.11438936s","start":"2025-06-20T19:54:11.324623Z","end":"2025-06-20T19:54:23.439012Z","steps":["trace[1182856053] 'agreement among raft nodes before linearized reading' (duration: 12.114002423s)"],"step_count":1} Jun 20 19:54:23.439937 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.439248Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:11.324527Z","time spent":"12.114707858s","remote":"172.24.4.123:46726","response type":"/etcdserverpb.KV/Range","request count":0,"request size":54,"response count":0,"response size":0,"request content":"key:\"/registry/operator.tigera.io/installations/default\" limit:1 "} Jun 20 19:54:23.439937 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.438665Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"12.110654624s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/ipamconfigs.crd.projectcalico.org\" limit:1 ","response":"","error":"context canceled"} Jun 20 19:54:23.439937 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:23.439683Z","caller":"traceutil/trace.go:171","msg":"trace[750698798] range","detail":"{range_begin:/registry/apiextensions.k8s.io/customresourcedefinitions/ipamconfigs.crd.projectcalico.org; range_end:; }","duration":"12.111737037s","start":"2025-06-20T19:54:11.327935Z","end":"2025-06-20T19:54:23.439672Z","steps":["trace[750698798] 'agreement among raft nodes before linearized reading' (duration: 12.110715889s)"],"step_count":1} Jun 20 19:54:23.440653 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.438679Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"10.985565292s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/tigerastatuses/gatewayapi\" limit:1 ","response":"","error":"context canceled"} Jun 20 19:54:23.440653 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.438694Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"10.988015895s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/tigerastatuses/management-cluster-connection\" limit:1 ","response":"","error":"context canceled"} Jun 20 19:54:23.440653 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.438721Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:19.462314Z","time spent":"3.976390448s","remote":"172.24.4.123:46688","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jun 20 19:54:23.440653 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.438762Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"11.418242681s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/serviceaccounts/calico-system/whisker\" limit:1 ","response":"","error":"context canceled"} Jun 20 19:54:23.440653 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:23.440172Z","caller":"traceutil/trace.go:171","msg":"trace[1693668161] range","detail":"{range_begin:/registry/serviceaccounts/calico-system/whisker; range_end:; }","duration":"11.419633644s","start":"2025-06-20T19:54:12.020476Z","end":"2025-06-20T19:54:23.440110Z","steps":["trace[1693668161] 'agreement among raft nodes before linearized reading' (duration: 11.418278398s)"],"step_count":1} Jun 20 19:54:23.441012 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.440307Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:12.020455Z","time spent":"11.419836715s","remote":"172.24.4.123:60148","response type":"/etcdserverpb.KV/Range","request count":0,"request size":51,"response count":0,"response size":0,"request content":"key:\"/registry/serviceaccounts/calico-system/whisker\" limit:1 "} Jun 20 19:54:23.441012 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:23.440219Z","caller":"traceutil/trace.go:171","msg":"trace[638457755] range","detail":"{range_begin:/registry/operator.tigera.io/tigerastatuses/gatewayapi; range_end:; }","duration":"10.987103982s","start":"2025-06-20T19:54:12.453072Z","end":"2025-06-20T19:54:23.440176Z","steps":["trace[638457755] 'agreement among raft nodes before linearized reading' (duration: 10.98560191s)"],"step_count":1} Jun 20 19:54:23.441012 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.440344Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:11.327917Z","time spent":"12.112381938s","remote":"172.24.4.123:59980","response type":"/etcdserverpb.KV/Range","request count":0,"request size":94,"response count":0,"response size":0,"request content":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/ipamconfigs.crd.projectcalico.org\" limit:1 "} Jun 20 19:54:23.441012 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:23.440416Z","caller":"traceutil/trace.go:171","msg":"trace[26685280] range","detail":"{range_begin:/registry/operator.tigera.io/tigerastatuses/management-cluster-connection; range_end:; }","duration":"10.98987005s","start":"2025-06-20T19:54:12.450538Z","end":"2025-06-20T19:54:23.440408Z","steps":["trace[26685280] 'agreement among raft nodes before linearized reading' (duration: 10.988151511s)"],"step_count":1} Jun 20 19:54:23.441174 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.440442Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:12.450511Z","time spent":"10.989920695s","remote":"172.24.4.123:46688","response type":"/etcdserverpb.KV/Range","request count":0,"request size":77,"response count":0,"response size":0,"request content":"key:\"/registry/operator.tigera.io/tigerastatuses/management-cluster-connection\" limit:1 "} Jun 20 19:54:23.441174 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.440338Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:12.453058Z","time spent":"10.987274421s","remote":"172.24.4.123:46688","response type":"/etcdserverpb.KV/Range","request count":0,"request size":58,"response count":0,"response size":0,"request content":"key:\"/registry/operator.tigera.io/tigerastatuses/gatewayapi\" limit:1 "} Jun 20 19:54:23.476016 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.475400Z","caller":"wal/wal.go:805","msg":"slow fdatasync","took":"10.209359379s","expected-duration":"1s"} Jun 20 19:54:23.477166 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.475942Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"10.209892893s","expected-duration":"100ms","prefix":"","request":"header: txn: success:> failure: >>","response":"size:16"} Jun 20 19:54:23.479615 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:23.476744Z","caller":"traceutil/trace.go:171","msg":"trace[937027855] linearizableReadLoop","detail":"{readStateIndex:2088; appliedIndex:2081; }","duration":"11.467106883s","start":"2025-06-20T19:54:12.009596Z","end":"2025-06-20T19:54:23.476703Z","steps":["trace[937027855] 'read index received' (duration: 1.256383492s)","trace[937027855] 'applied index is now lower than readState.Index' (duration: 10.210722179s)"],"step_count":2} Jun 20 19:54:23.480311 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.478269Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"12.116550893s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/serviceaccounts/kube-system/endpoint-controller\" limit:1 ","response":"range_response_count:1 size:203"} Jun 20 19:54:23.480311 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:23.478904Z","caller":"traceutil/trace.go:171","msg":"trace[108678070] range","detail":"{range_begin:/registry/serviceaccounts/kube-system/endpoint-controller; range_end:; response_count:1; response_revision:1662; }","duration":"12.117192007s","start":"2025-06-20T19:54:11.361689Z","end":"2025-06-20T19:54:23.478881Z","steps":["trace[108678070] 'agreement among raft nodes before linearized reading' (duration: 12.116451116s)"],"step_count":1} Jun 20 19:54:23.480311 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.478974Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:11.361621Z","time spent":"12.117329296s","remote":"172.24.4.123:60148","response type":"/etcdserverpb.KV/Range","request count":0,"request size":61,"response count":1,"response size":227,"request content":"key:\"/registry/serviceaccounts/kube-system/endpoint-controller\" limit:1 "} Jun 20 19:54:23.480311 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.478341Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"12.017850966s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/serviceaccounts/kube-system/service-cidrs-controller\" limit:1 ","response":"range_response_count:1 size:214"} Jun 20 19:54:23.481894 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:23.479103Z","caller":"traceutil/trace.go:171","msg":"trace[1151636676] range","detail":"{range_begin:/registry/serviceaccounts/kube-system/service-cidrs-controller; range_end:; response_count:1; response_revision:1662; }","duration":"12.018634267s","start":"2025-06-20T19:54:11.460452Z","end":"2025-06-20T19:54:23.479087Z","steps":["trace[1151636676] 'agreement among raft nodes before linearized reading' (duration: 12.017855274s)"],"step_count":1} Jun 20 19:54:23.481894 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.479173Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:11.460435Z","time spent":"12.018698519s","remote":"172.24.4.123:60148","response type":"/etcdserverpb.KV/Range","request count":0,"request size":66,"response count":1,"response size":238,"request content":"key:\"/registry/serviceaccounts/kube-system/service-cidrs-controller\" limit:1 "} Jun 20 19:54:23.481894 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.478431Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"12.066720366s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/serviceaccounts/kube-system/statefulset-controller\" limit:1 ","response":"range_response_count:1 size:209"} Jun 20 19:54:23.481894 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:23.479286Z","caller":"traceutil/trace.go:171","msg":"trace[1454662403] range","detail":"{range_begin:/registry/serviceaccounts/kube-system/statefulset-controller; range_end:; response_count:1; response_revision:1662; }","duration":"12.067573509s","start":"2025-06-20T19:54:11.411673Z","end":"2025-06-20T19:54:23.479247Z","steps":["trace[1454662403] 'agreement among raft nodes before linearized reading' (duration: 12.066717791s)"],"step_count":1} Jun 20 19:54:23.482193 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.479344Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:11.411654Z","time spent":"12.067673588s","remote":"172.24.4.123:60148","response type":"/etcdserverpb.KV/Range","request count":0,"request size":64,"response count":1,"response size":233,"request content":"key:\"/registry/serviceaccounts/kube-system/statefulset-controller\" limit:1 "} Jun 20 19:54:23.494978 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.494428Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"11.463229905s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/namespaces/\" range_end:\"/registry/namespaces0\" count_only:true ","response":"range_response_count:0 size:7"} Jun 20 19:54:23.495677 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.495355Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"123.499738ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/whiskers/\" range_end:\"/registry/operator.tigera.io/whiskers0\" count_only:true ","response":"range_response_count:0 size:7"} Jun 20 19:54:23.496053 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:23.495661Z","caller":"traceutil/trace.go:171","msg":"trace[958596722] range","detail":"{range_begin:/registry/operator.tigera.io/whiskers/; range_end:/registry/operator.tigera.io/whiskers0; response_count:0; response_revision:1663; }","duration":"123.832713ms","start":"2025-06-20T19:54:23.371809Z","end":"2025-06-20T19:54:23.495642Z","steps":["trace[958596722] 'agreement among raft nodes before linearized reading' (duration: 123.516499ms)"],"step_count":1} Jun 20 19:54:23.496502 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.496155Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"126.233714ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jun 20 19:54:23.498747 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:23.496382Z","caller":"traceutil/trace.go:171","msg":"trace[159572109] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1663; }","duration":"126.526344ms","start":"2025-06-20T19:54:23.369838Z","end":"2025-06-20T19:54:23.496364Z","steps":["trace[159572109] 'agreement among raft nodes before linearized reading' (duration: 126.246198ms)"],"step_count":1} Jun 20 19:54:23.499423 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:23.495406Z","caller":"traceutil/trace.go:171","msg":"trace[763529615] range","detail":"{range_begin:/registry/namespaces/; range_end:/registry/namespaces0; response_count:0; response_revision:1663; }","duration":"11.464252616s","start":"2025-06-20T19:54:12.031129Z","end":"2025-06-20T19:54:23.495382Z","steps":["trace[763529615] 'agreement among raft nodes before linearized reading' (duration: 11.46313676s)"],"step_count":1} Jun 20 19:54:23.499423 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.496936Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:12.031110Z","time spent":"11.465796125s","remote":"172.24.4.123:60048","response type":"/etcdserverpb.KV/Range","request count":0,"request size":48,"response count":7,"response size":31,"request content":"key:\"/registry/namespaces/\" range_end:\"/registry/namespaces0\" count_only:true "} Jun 20 19:54:23.499423 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.497139Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"3.6330554s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/gatewayapis/\" range_end:\"/registry/operator.tigera.io/gatewayapis0\" count_only:true ","response":"range_response_count:0 size:5"} Jun 20 19:54:23.499423 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:23.497199Z","caller":"traceutil/trace.go:171","msg":"trace[354850741] range","detail":"{range_begin:/registry/operator.tigera.io/gatewayapis/; range_end:/registry/operator.tigera.io/gatewayapis0; response_count:0; response_revision:1663; }","duration":"3.63317295s","start":"2025-06-20T19:54:19.864008Z","end":"2025-06-20T19:54:23.497181Z","steps":["trace[354850741] 'agreement among raft nodes before linearized reading' (duration: 3.633095926s)"],"step_count":1} Jun 20 19:54:23.500317 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.497261Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:19.863992Z","time spent":"3.633236921s","remote":"172.24.4.123:46752","response type":"/etcdserverpb.KV/Range","request count":0,"request size":88,"response count":0,"response size":29,"request content":"key:\"/registry/operator.tigera.io/gatewayapis/\" range_end:\"/registry/operator.tigera.io/gatewayapis0\" count_only:true "} Jun 20 19:54:23.500317 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.497306Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"144.592154ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/policy.networking.k8s.io/baselineadminnetworkpolicies/\" range_end:\"/registry/policy.networking.k8s.io/baselineadminnetworkpolicies0\" count_only:true ","response":"range_response_count:0 size:5"} Jun 20 19:54:23.500317 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.497411Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"4.148369548s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/networkpolicies/\" range_end:\"/registry/crd.projectcalico.org/networkpolicies0\" count_only:true ","response":"range_response_count:0 size:5"} Jun 20 19:54:23.500317 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:23.497481Z","caller":"traceutil/trace.go:171","msg":"trace[1083577480] range","detail":"{range_begin:/registry/crd.projectcalico.org/networkpolicies/; range_end:/registry/crd.projectcalico.org/networkpolicies0; response_count:0; response_revision:1663; }","duration":"4.148515091s","start":"2025-06-20T19:54:19.348945Z","end":"2025-06-20T19:54:23.497460Z","steps":["trace[1083577480] 'agreement among raft nodes before linearized reading' (duration: 4.148412058s)"],"step_count":1} Jun 20 19:54:23.501015 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.497723Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:19.348921Z","time spent":"4.148613276s","remote":"172.24.4.123:40080","response type":"/etcdserverpb.KV/Range","request count":0,"request size":102,"response count":0,"response size":29,"request content":"key:\"/registry/crd.projectcalico.org/networkpolicies/\" range_end:\"/registry/crd.projectcalico.org/networkpolicies0\" count_only:true "} Jun 20 19:54:23.501015 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:23.497362Z","caller":"traceutil/trace.go:171","msg":"trace[1026041209] range","detail":"{range_begin:/registry/policy.networking.k8s.io/baselineadminnetworkpolicies/; range_end:/registry/policy.networking.k8s.io/baselineadminnetworkpolicies0; response_count:0; response_revision:1663; }","duration":"145.091933ms","start":"2025-06-20T19:54:23.352253Z","end":"2025-06-20T19:54:23.497345Z","steps":["trace[1026041209] 'agreement among raft nodes before linearized reading' (duration: 144.574881ms)"],"step_count":1} Jun 20 19:54:23.501015 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.497937Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"4.477110417s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/leases/kube-system/kube-controller-manager\" limit:1 ","response":"range_response_count:1 size:531"} Jun 20 19:54:23.501015 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:23.498016Z","caller":"traceutil/trace.go:171","msg":"trace[1184777981] range","detail":"{range_begin:/registry/leases/kube-system/kube-controller-manager; range_end:; response_count:1; response_revision:1663; }","duration":"4.477254798s","start":"2025-06-20T19:54:19.020742Z","end":"2025-06-20T19:54:23.497997Z","steps":["trace[1184777981] 'agreement among raft nodes before linearized reading' (duration: 4.477141696s)"],"step_count":1} Jun 20 19:54:23.502536 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.498097Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:19.020707Z","time spent":"4.47736273s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Range","request count":0,"request size":56,"response count":1,"response size":555,"request content":"key:\"/registry/leases/kube-system/kube-controller-manager\" limit:1 "} Jun 20 19:54:23.502536 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.498280Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"4.755773956s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/mutatingwebhookconfigurations/\" range_end:\"/registry/mutatingwebhookconfigurations0\" count_only:true ","response":"range_response_count:0 size:5"} Jun 20 19:54:23.502536 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:23.498360Z","caller":"traceutil/trace.go:171","msg":"trace[356690584] range","detail":"{range_begin:/registry/mutatingwebhookconfigurations/; range_end:/registry/mutatingwebhookconfigurations0; response_count:0; response_revision:1663; }","duration":"4.755854759s","start":"2025-06-20T19:54:18.742484Z","end":"2025-06-20T19:54:23.498338Z","steps":["trace[356690584] 'agreement among raft nodes before linearized reading' (duration: 4.755752507s)"],"step_count":1} Jun 20 19:54:23.502536 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.498463Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:18.742402Z","time spent":"4.756013556s","remote":"172.24.4.123:60462","response type":"/etcdserverpb.KV/Range","request count":0,"request size":86,"response count":0,"response size":29,"request content":"key:\"/registry/mutatingwebhookconfigurations/\" range_end:\"/registry/mutatingwebhookconfigurations0\" count_only:true "} Jun 20 19:54:23.502974 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.499417Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.894312668s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/horizontalpodautoscalers/\" range_end:\"/registry/horizontalpodautoscalers0\" count_only:true ","response":"range_response_count:0 size:5"} Jun 20 19:54:23.502974 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:23.499760Z","caller":"traceutil/trace.go:171","msg":"trace[192132391] range","detail":"{range_begin:/registry/horizontalpodautoscalers/; range_end:/registry/horizontalpodautoscalers0; response_count:0; response_revision:1663; }","duration":"2.894740842s","start":"2025-06-20T19:54:20.604993Z","end":"2025-06-20T19:54:23.499734Z","steps":["trace[192132391] 'agreement among raft nodes before linearized reading' (duration: 2.8943137s)"],"step_count":1} Jun 20 19:54:23.502974 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.500089Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:20.604903Z","time spent":"2.895152517s","remote":"172.24.4.123:60184","response type":"/etcdserverpb.KV/Range","request count":0,"request size":76,"response count":0,"response size":29,"request content":"key:\"/registry/horizontalpodautoscalers/\" range_end:\"/registry/horizontalpodautoscalers0\" count_only:true "} Jun 20 19:54:23.502974 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.501116Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"3.195897157s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/horizontalpodautoscalers/\" range_end:\"/registry/horizontalpodautoscalers0\" count_only:true ","response":"range_response_count:0 size:5"} Jun 20 19:54:23.505519 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:23.501284Z","caller":"traceutil/trace.go:171","msg":"trace[84027893] range","detail":"{range_begin:/registry/horizontalpodautoscalers/; range_end:/registry/horizontalpodautoscalers0; response_count:0; response_revision:1663; }","duration":"3.196097644s","start":"2025-06-20T19:54:20.305162Z","end":"2025-06-20T19:54:23.501259Z","steps":["trace[84027893] 'agreement among raft nodes before linearized reading' (duration: 3.195858546s)"],"step_count":1} Jun 20 19:54:23.505519 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.501630Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:20.305145Z","time spent":"3.196400293s","remote":"172.24.4.123:60168","response type":"/etcdserverpb.KV/Range","request count":0,"request size":76,"response count":0,"response size":29,"request content":"key:\"/registry/horizontalpodautoscalers/\" range_end:\"/registry/horizontalpodautoscalers0\" count_only:true "} Jun 20 19:54:23.505519 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.503144Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"9.148364716s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/networkpolicies/\" range_end:\"/registry/networkpolicies0\" count_only:true ","response":"range_response_count:0 size:7"} Jun 20 19:54:23.505519 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:23.503250Z","caller":"traceutil/trace.go:171","msg":"trace[432656130] range","detail":"{range_begin:/registry/networkpolicies/; range_end:/registry/networkpolicies0; response_count:0; response_revision:1663; }","duration":"9.148590101s","start":"2025-06-20T19:54:14.354642Z","end":"2025-06-20T19:54:23.503232Z","steps":["trace[432656130] 'agreement among raft nodes before linearized reading' (duration: 9.148396667s)"],"step_count":1} Jun 20 19:54:23.506288 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.503661Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:14.354613Z","time spent":"9.149018225s","remote":"172.24.4.123:60232","response type":"/etcdserverpb.KV/Range","request count":0,"request size":58,"response count":3,"response size":31,"request content":"key:\"/registry/networkpolicies/\" range_end:\"/registry/networkpolicies0\" count_only:true "} Jun 20 19:54:23.506288 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.504312Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"4.938495095s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/masterleases/172.24.4.123\" limit:1 ","response":"range_response_count:1 size:131"} Jun 20 19:54:23.506288 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:23.504383Z","caller":"traceutil/trace.go:171","msg":"trace[966444141] range","detail":"{range_begin:/registry/masterleases/172.24.4.123; range_end:; response_count:1; response_revision:1663; }","duration":"4.938610443s","start":"2025-06-20T19:54:18.565756Z","end":"2025-06-20T19:54:23.504366Z","steps":["trace[966444141] 'agreement among raft nodes before linearized reading' (duration: 4.938184302s)"],"step_count":1} Jun 20 19:54:23.506288 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.504436Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:18.565732Z","time spent":"4.938686266s","remote":"172.24.4.123:59956","response type":"/etcdserverpb.KV/Range","request count":0,"request size":39,"response count":1,"response size":155,"request content":"key:\"/registry/masterleases/172.24.4.123\" limit:1 "} Jun 20 19:54:23.506288 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.504429Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"10.22591452s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/secrets/\" range_end:\"/registry/secrets0\" count_only:true ","response":"range_response_count:0 size:7"} Jun 20 19:54:23.507037 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:23.504490Z","caller":"traceutil/trace.go:171","msg":"trace[1618344032] range","detail":"{range_begin:/registry/secrets/; range_end:/registry/secrets0; response_count:0; response_revision:1663; }","duration":"10.226030237s","start":"2025-06-20T19:54:13.278443Z","end":"2025-06-20T19:54:23.504473Z","steps":["trace[1618344032] 'agreement among raft nodes before linearized reading' (duration: 10.225926512s)"],"step_count":1} Jun 20 19:54:23.507037 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.504552Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:13.278402Z","time spent":"10.22611757s","remote":"172.24.4.123:60024","response type":"/etcdserverpb.KV/Range","request count":0,"request size":42,"response count":16,"response size":31,"request content":"key:\"/registry/secrets/\" range_end:\"/registry/secrets0\" count_only:true "} Jun 20 19:54:23.508145 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.505700Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"10.84691022s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/persistentvolumes/\" range_end:\"/registry/persistentvolumes0\" count_only:true ","response":"range_response_count:0 size:5"} Jun 20 19:54:23.508145 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:23.505770Z","caller":"traceutil/trace.go:171","msg":"trace[166181807] range","detail":"{range_begin:/registry/persistentvolumes/; range_end:/registry/persistentvolumes0; response_count:0; response_revision:1663; }","duration":"10.847019176s","start":"2025-06-20T19:54:12.658734Z","end":"2025-06-20T19:54:23.505753Z","steps":["trace[166181807] 'agreement among raft nodes before linearized reading' (duration: 10.846886075s)"],"step_count":1} Jun 20 19:54:23.508145 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.505843Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:12.658712Z","time spent":"10.847112801s","remote":"172.24.4.123:60094","response type":"/etcdserverpb.KV/Range","request count":0,"request size":62,"response count":0,"response size":29,"request content":"key:\"/registry/persistentvolumes/\" range_end:\"/registry/persistentvolumes0\" count_only:true "} Jun 20 19:54:23.508145 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.505944Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"11.44879412s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/namespaces\" limit:1 ","response":"range_response_count:0 size:5"} Jun 20 19:54:23.508145 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:23.505983Z","caller":"traceutil/trace.go:171","msg":"trace[1261485633] range","detail":"{range_begin:/registry/namespaces; range_end:; response_count:0; response_revision:1663; }","duration":"11.448869053s","start":"2025-06-20T19:54:12.057099Z","end":"2025-06-20T19:54:23.505968Z","steps":["trace[1261485633] 'agreement among raft nodes before linearized reading' (duration: 11.448811454s)"],"step_count":1} Jun 20 19:54:23.510412 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.506041Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:12.057052Z","time spent":"11.448956356s","remote":"172.24.4.123:60048","response type":"/etcdserverpb.KV/Range","request count":0,"request size":24,"response count":0,"response size":29,"request content":"key:\"/registry/namespaces\" limit:1 "} Jun 20 19:54:23.510412 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.494667Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"3.538469677s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/csistoragecapacities/\" range_end:\"/registry/csistoragecapacities0\" count_only:true ","response":"range_response_count:0 size:5"} Jun 20 19:54:23.510412 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:23.506149Z","caller":"traceutil/trace.go:171","msg":"trace[491002519] range","detail":"{range_begin:/registry/csistoragecapacities/; range_end:/registry/csistoragecapacities0; response_count:0; response_revision:1663; }","duration":"3.549992396s","start":"2025-06-20T19:54:19.956136Z","end":"2025-06-20T19:54:23.506128Z","steps":["trace[491002519] 'agreement among raft nodes before linearized reading' (duration: 3.538478224s)"],"step_count":1} Jun 20 19:54:23.510412 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.506251Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:19.956109Z","time spent":"3.550086983s","remote":"172.24.4.123:60374","response type":"/etcdserverpb.KV/Range","request count":0,"request size":68,"response count":0,"response size":29,"request content":"key:\"/registry/csistoragecapacities/\" range_end:\"/registry/csistoragecapacities0\" count_only:true "} Jun 20 19:54:23.510850 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:23.494837Z","caller":"traceutil/trace.go:171","msg":"trace[1442866082] transaction","detail":"{read_only:false; number_of_response:1; response_revision:1663; }","duration":"4.113678504s","start":"2025-06-20T19:54:19.381136Z","end":"2025-06-20T19:54:23.494814Z","steps":["trace[1442866082] 'process raft request' (duration: 4.112833285s)"],"step_count":1} Jun 20 19:54:23.510850 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.506475Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:19.381077Z","time spent":"4.125318742s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":49,"response count":0,"response size":587,"request content":"compare: success:> failure: >"} Jun 20 19:54:23.510850 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:23.494883Z","caller":"traceutil/trace.go:171","msg":"trace[1154297335] transaction","detail":"{read_only:false; number_of_response:1; response_revision:1663; }","duration":"4.11331507s","start":"2025-06-20T19:54:19.381557Z","end":"2025-06-20T19:54:23.494872Z","steps":["trace[1154297335] 'process raft request' (duration: 4.112492745s)"],"step_count":1} Jun 20 19:54:23.511257 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.506701Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:19.381501Z","time spent":"4.12514136s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":69,"response count":0,"response size":748,"request content":"compare: success:> failure: >"} Jun 20 19:54:23.511257 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:23.494955Z","caller":"traceutil/trace.go:171","msg":"trace[1917827867] transaction","detail":"{read_only:false; number_of_response:1; response_revision:1663; }","duration":"4.04176097s","start":"2025-06-20T19:54:19.453163Z","end":"2025-06-20T19:54:23.494924Z","steps":["trace[1917827867] 'process raft request' (duration: 4.040967559s)"],"step_count":1} Jun 20 19:54:23.511257 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.506883Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:19.453128Z","time spent":"4.053707293s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":71,"response count":0,"response size":674,"request content":"compare: success:> failure: >"} Jun 20 19:54:23.511661 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:23.494987Z","caller":"traceutil/trace.go:171","msg":"trace[429357841] transaction","detail":"{read_only:false; number_of_response:1; response_revision:1663; }","duration":"127.542714ms","start":"2025-06-20T19:54:23.367434Z","end":"2025-06-20T19:54:23.494977Z","steps":["trace[429357841] 'process raft request' (duration: 126.782867ms)"],"step_count":1} Jun 20 19:54:23.511661 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.508122Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"7.848406808s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/events/kube-system/kube-apiserver-ci-4344-1-0-0-4524070979.novalocal.184ad8401ddbdf71\" limit:1 ","response":"range_response_count:1 size:905"} Jun 20 19:54:23.511661 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:23.508196Z","caller":"traceutil/trace.go:171","msg":"trace[1480557918] range","detail":"{range_begin:/registry/events/kube-system/kube-apiserver-ci-4344-1-0-0-4524070979.novalocal.184ad8401ddbdf71; range_end:; response_count:1; response_revision:1663; }","duration":"7.848618546s","start":"2025-06-20T19:54:15.659557Z","end":"2025-06-20T19:54:23.508175Z","steps":["trace[1480557918] 'agreement among raft nodes before linearized reading' (duration: 7.847812571s)"],"step_count":1} Jun 20 19:54:23.511661 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.508692Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:15.659519Z","time spent":"7.849038524s","remote":"172.24.4.123:60016","response type":"/etcdserverpb.KV/Range","request count":0,"request size":99,"response count":1,"response size":929,"request content":"key:\"/registry/events/kube-system/kube-apiserver-ci-4344-1-0-0-4524070979.novalocal.184ad8401ddbdf71\" limit:1 "} Jun 20 19:54:23.512024 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.508978Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"6.936741505s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/controllers/\" range_end:\"/registry/controllers0\" count_only:true ","response":"range_response_count:0 size:5"} Jun 20 19:54:23.512024 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:23.509068Z","caller":"traceutil/trace.go:171","msg":"trace[1154154015] range","detail":"{range_begin:/registry/controllers/; range_end:/registry/controllers0; response_count:0; response_revision:1663; }","duration":"6.936951109s","start":"2025-06-20T19:54:16.572093Z","end":"2025-06-20T19:54:23.509044Z","steps":["trace[1154154015] 'agreement among raft nodes before linearized reading' (duration: 6.93671707s)"],"step_count":1} Jun 20 19:54:23.512024 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:23.509143Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:16.572058Z","time spent":"6.93705755s","remote":"172.24.4.123:60156","response type":"/etcdserverpb.KV/Range","request count":0,"request size":50,"response count":0,"response size":29,"request content":"key:\"/registry/controllers/\" range_end:\"/registry/controllers0\" count_only:true "} Jun 20 19:54:24.019546 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:24.018785Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"466.513016ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/leases/kube-system/kube-controller-manager\" limit:1 ","response":"","error":"context canceled"} Jun 20 19:54:24.019546 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:24.018910Z","caller":"traceutil/trace.go:171","msg":"trace[743157544] range","detail":"{range_begin:/registry/leases/kube-system/kube-controller-manager; range_end:; }","duration":"466.688284ms","start":"2025-06-20T19:54:23.552184Z","end":"2025-06-20T19:54:24.018873Z","steps":["trace[743157544] 'agreement among raft nodes before linearized reading' (duration: 466.54766ms)"],"step_count":1} Jun 20 19:54:24.019546 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:24.019001Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:23.552161Z","time spent":"466.810052ms","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Range","request count":0,"request size":56,"response count":0,"response size":0,"request content":"key:\"/registry/leases/kube-system/kube-controller-manager\" limit:1 "} Jun 20 19:54:24.035256 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:24.034685Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:23.532762Z","time spent":"501.913773ms","remote":"172.24.4.123:60126","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jun 20 19:54:24.040270 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:24.039736Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:23.545733Z","time spent":"493.993853ms","remote":"172.24.4.123:60404","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jun 20 19:54:24.040826 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:24.039860Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:23.511481Z","time spent":"528.374283ms","remote":"172.24.4.123:60266","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jun 20 19:54:24.046138 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:24.045402Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078724,"retry-timeout":"500ms"} Jun 20 19:54:24.547160 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:24.546356Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078724,"retry-timeout":"500ms"} Jun 20 19:54:25.047519 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:25.047101Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078724,"retry-timeout":"500ms"} Jun 20 19:54:25.548749 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:25.548183Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078724,"retry-timeout":"500ms"} Jun 20 19:54:26.049958 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:26.049269Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078724,"retry-timeout":"500ms"} Jun 20 19:54:26.389307 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:26.388779Z","caller":"wal/wal.go:805","msg":"slow fdatasync","took":"2.869511868s","expected-duration":"1s"} Jun 20 19:54:26.547787 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:26.546385Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"3.028272845s","expected-duration":"100ms","prefix":"","request":"header: lease_revoke:","response":"size:29"} Jun 20 19:54:26.548649 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:26.547672Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.000937304s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context deadline exceeded"} Jun 20 19:54:26.548649 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:26.547975Z","caller":"traceutil/trace.go:171","msg":"trace[1778318629] range","detail":"{range_begin:/registry/health; range_end:; }","duration":"2.001415291s","start":"2025-06-20T19:54:24.546520Z","end":"2025-06-20T19:54:26.547935Z","steps":["trace[1778318629] 'agreement among raft nodes before linearized reading' (duration: 2.000971477s)"],"step_count":1} Jun 20 19:54:26.548649 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:26.548201Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:24.546496Z","time spent":"2.001677925s","remote":"172.24.4.123:59934","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "} Jun 20 19:54:26.641296 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:26.639681Z","caller":"traceutil/trace.go:171","msg":"trace[1978432192] transaction","detail":"{read_only:false; response_revision:1665; number_of_response:1; }","duration":"3.107616953s","start":"2025-06-20T19:54:23.531945Z","end":"2025-06-20T19:54:26.639562Z","steps":["trace[1978432192] 'process raft request' (duration: 3.02987397s)","trace[1978432192] 'compare' (duration: 77.343723ms)"],"step_count":2} Jun 20 19:54:26.641296 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:26.640163Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:23.531880Z","time spent":"3.107994251s","remote":"172.24.4.123:60016","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":890,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jun 20 19:54:26.646746 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:26.646171Z","caller":"traceutil/trace.go:171","msg":"trace[863181263] transaction","detail":"{read_only:false; response_revision:1667; number_of_response:1; }","duration":"3.107629387s","start":"2025-06-20T19:54:23.538368Z","end":"2025-06-20T19:54:26.645997Z","steps":["trace[863181263] 'process raft request' (duration: 3.10147216s)"],"step_count":1} Jun 20 19:54:26.649044 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:26.647033Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:23.538345Z","time spent":"3.10856823s","remote":"172.24.4.123:60136","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":6648,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jun 20 19:54:26.650707 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:26.650107Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:23.545271Z","time spent":"3.104825448s","remote":"172.24.4.123:59956","response type":"/etcdserverpb.Lease/LeaseGrant","request count":-1,"request size":-1,"response count":-1,"response size":-1,"request content":""} Jun 20 19:54:26.653119 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:26.652001Z","caller":"traceutil/trace.go:171","msg":"trace[1649990469] linearizableReadLoop","detail":"{readStateIndex:2103; appliedIndex:2095; }","duration":"3.106717874s","start":"2025-06-20T19:54:23.545185Z","end":"2025-06-20T19:54:26.651903Z","steps":["trace[1649990469] 'read index received' (duration: 2.845340577s)","trace[1649990469] 'applied index is now lower than readState.Index' (duration: 260.77251ms)"],"step_count":2} Jun 20 19:54:26.771184 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:26.770326Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"3.225126482s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/leases/kube-node-lease/ci-4344-1-0-0-4524070979.novalocal\" limit:1 ","response":"range_response_count:1 size:639"} Jun 20 19:54:26.771184 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:26.770388Z","caller":"traceutil/trace.go:171","msg":"trace[1893835233] range","detail":"{range_begin:/registry/leases/kube-node-lease/ci-4344-1-0-0-4524070979.novalocal; range_end:; response_count:1; response_revision:1670; }","duration":"3.225228133s","start":"2025-06-20T19:54:23.545143Z","end":"2025-06-20T19:54:26.770372Z","steps":["trace[1893835233] 'agreement among raft nodes before linearized reading' (duration: 3.106851174s)","trace[1893835233] 'range keys from in-memory index tree' (duration: 117.226448ms)"],"step_count":2} Jun 20 19:54:26.771184 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:26.770418Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:23.545126Z","time spent":"3.225282426s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Range","request count":0,"request size":71,"response count":1,"response size":663,"request content":"key:\"/registry/leases/kube-node-lease/ci-4344-1-0-0-4524070979.novalocal\" limit:1 "} Jun 20 19:54:26.775880 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:26.770749Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"125.016061ms","expected-duration":"100ms","prefix":"","request":"header: lease_revoke:","response":"size:29"} Jun 20 19:54:26.775880 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:26.770857Z","caller":"traceutil/trace.go:171","msg":"trace[1487134109] transaction","detail":"{read_only:false; number_of_response:1; response_revision:1670; }","duration":"115.686645ms","start":"2025-06-20T19:54:26.655161Z","end":"2025-06-20T19:54:26.770848Z","steps":["trace[1487134109] 'process raft request' (duration: 115.63063ms)"],"step_count":1} Jun 20 19:54:26.775880 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:26.771083Z","caller":"traceutil/trace.go:171","msg":"trace[544657633] linearizableReadLoop","detail":"{readStateIndex:2104; appliedIndex:2103; }","duration":"118.524396ms","start":"2025-06-20T19:54:26.652549Z","end":"2025-06-20T19:54:26.771074Z","steps":["trace[544657633] 'read index received' (duration: 2.472174ms)","trace[544657633] 'applied index is now lower than readState.Index' (duration: 116.05142ms)"],"step_count":2} Jun 20 19:54:26.775880 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:26.771198Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"121.645079ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/events/kube-system/kube-apiserver-ci-4344-1-0-0-4524070979.novalocal.184ad84a23b1cec8\" limit:1 ","response":"range_response_count:1 size:904"} Jun 20 19:54:26.775880 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:26.771225Z","caller":"traceutil/trace.go:171","msg":"trace[704357076] range","detail":"{range_begin:/registry/events/kube-system/kube-apiserver-ci-4344-1-0-0-4524070979.novalocal.184ad84a23b1cec8; range_end:; response_count:1; response_revision:1670; }","duration":"121.710342ms","start":"2025-06-20T19:54:26.649507Z","end":"2025-06-20T19:54:26.771218Z","steps":["trace[704357076] 'agreement among raft nodes before linearized reading' (duration: 121.631834ms)"],"step_count":1} Jun 20 19:54:26.777178 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:26.771273Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"221.203043ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jun 20 19:54:26.777178 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:26.771288Z","caller":"traceutil/trace.go:171","msg":"trace[938388520] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1670; }","duration":"221.307629ms","start":"2025-06-20T19:54:26.549975Z","end":"2025-06-20T19:54:26.771282Z","steps":["trace[938388520] 'agreement among raft nodes before linearized reading' (duration: 221.28665ms)"],"step_count":1} Jun 20 19:54:26.777178 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:26.771411Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"802.306804ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/ipamblocks/\" range_end:\"/registry/crd.projectcalico.org/ipamblocks0\" count_only:true ","response":"range_response_count:0 size:7"} Jun 20 19:54:26.777178 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:26.771455Z","caller":"traceutil/trace.go:171","msg":"trace[700390470] range","detail":"{range_begin:/registry/crd.projectcalico.org/ipamblocks/; range_end:/registry/crd.projectcalico.org/ipamblocks0; response_count:0; response_revision:1670; }","duration":"802.377096ms","start":"2025-06-20T19:54:25.969063Z","end":"2025-06-20T19:54:26.771440Z","steps":["trace[700390470] 'agreement among raft nodes before linearized reading' (duration: 802.31549ms)"],"step_count":1} Jun 20 19:54:26.778141 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:26.771512Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:25.969047Z","time spent":"802.433862ms","remote":"172.24.4.123:40116","response type":"/etcdserverpb.KV/Range","request count":0,"request size":92,"response count":2,"response size":31,"request content":"key:\"/registry/crd.projectcalico.org/ipamblocks/\" range_end:\"/registry/crd.projectcalico.org/ipamblocks0\" count_only:true "} Jun 20 19:54:26.778141 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:26.771880Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.546272064s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/services/endpoints/calico-system/calico-typha\" limit:1 ","response":"range_response_count:1 size:788"} Jun 20 19:54:26.778141 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:26.771983Z","caller":"traceutil/trace.go:171","msg":"trace[35985739] range","detail":"{range_begin:/registry/services/endpoints/calico-system/calico-typha; range_end:; response_count:1; response_revision:1670; }","duration":"2.546422729s","start":"2025-06-20T19:54:24.225496Z","end":"2025-06-20T19:54:26.771919Z","steps":["trace[35985739] 'agreement among raft nodes before linearized reading' (duration: 2.546167028s)"],"step_count":1} Jun 20 19:54:26.778141 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:26.772090Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:24.225467Z","time spent":"2.546552912s","remote":"172.24.4.123:60126","response type":"/etcdserverpb.KV/Range","request count":0,"request size":59,"response count":1,"response size":812,"request content":"key:\"/registry/services/endpoints/calico-system/calico-typha\" limit:1 "} Jun 20 19:54:26.778755 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:26.772635Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"843.9621ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/goldmanes/\" range_end:\"/registry/operator.tigera.io/goldmanes0\" count_only:true ","response":"range_response_count:0 size:7"} Jun 20 19:54:26.778755 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:26.772875Z","caller":"traceutil/trace.go:171","msg":"trace[1566331440] range","detail":"{range_begin:/registry/operator.tigera.io/goldmanes/; range_end:/registry/operator.tigera.io/goldmanes0; response_count:0; response_revision:1670; }","duration":"844.405595ms","start":"2025-06-20T19:54:25.928448Z","end":"2025-06-20T19:54:26.772853Z","steps":["trace[1566331440] 'agreement among raft nodes before linearized reading' (duration: 843.970066ms)"],"step_count":1} Jun 20 19:54:26.778755 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:26.773332Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:25.928429Z","time spent":"844.608035ms","remote":"172.24.4.123:46732","response type":"/etcdserverpb.KV/Range","request count":0,"request size":84,"response count":1,"response size":31,"request content":"key:\"/registry/operator.tigera.io/goldmanes/\" range_end:\"/registry/operator.tigera.io/goldmanes0\" count_only:true "} Jun 20 19:54:26.778755 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:26.773420Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"3.219303522s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/leases/kube-system/apiserver-lehofg5mhkmdr3ocdysxo4wrly\" limit:1 ","response":"range_response_count:1 size:713"} Jun 20 19:54:26.779061 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:26.773827Z","caller":"traceutil/trace.go:171","msg":"trace[1267827902] range","detail":"{range_begin:/registry/leases/kube-system/apiserver-lehofg5mhkmdr3ocdysxo4wrly; range_end:; response_count:1; response_revision:1670; }","duration":"3.219614587s","start":"2025-06-20T19:54:23.554025Z","end":"2025-06-20T19:54:26.773640Z","steps":["trace[1267827902] 'agreement among raft nodes before linearized reading' (duration: 3.218526223s)"],"step_count":1} Jun 20 19:54:26.779061 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:26.774323Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:23.554010Z","time spent":"3.220138561s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Range","request count":0,"request size":69,"response count":1,"response size":737,"request content":"key:\"/registry/leases/kube-system/apiserver-lehofg5mhkmdr3ocdysxo4wrly\" limit:1 "} Jun 20 19:54:26.779061 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:26.774852Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"3.22263999s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/leases/kube-node-lease/172.24.4.126\" limit:1 ","response":"range_response_count:1 size:552"} Jun 20 19:54:26.779061 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:26.774915Z","caller":"traceutil/trace.go:171","msg":"trace[1060916719] range","detail":"{range_begin:/registry/leases/kube-node-lease/172.24.4.126; range_end:; response_count:1; response_revision:1670; }","duration":"3.222734838s","start":"2025-06-20T19:54:23.552165Z","end":"2025-06-20T19:54:26.774900Z","steps":["trace[1060916719] 'agreement among raft nodes before linearized reading' (duration: 3.222592922s)"],"step_count":1} Jun 20 19:54:26.779391 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:26.774962Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:23.552144Z","time spent":"3.222800722s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Range","request count":0,"request size":49,"response count":1,"response size":576,"request content":"key:\"/registry/leases/kube-node-lease/172.24.4.126\" limit:1 "} Jun 20 19:54:26.779391 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:26.775170Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"119.150893ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/kube-system/kube-apiserver-ci-4344-1-0-0-4524070979.novalocal\" limit:1 ","response":"range_response_count:1 size:6662"} Jun 20 19:54:26.779391 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:26.775224Z","caller":"traceutil/trace.go:171","msg":"trace[1397715014] range","detail":"{range_begin:/registry/pods/kube-system/kube-apiserver-ci-4344-1-0-0-4524070979.novalocal; range_end:; response_count:1; response_revision:1670; }","duration":"119.26125ms","start":"2025-06-20T19:54:26.655950Z","end":"2025-06-20T19:54:26.775211Z","steps":["trace[1397715014] 'agreement among raft nodes before linearized reading' (duration: 119.066153ms)"],"step_count":1} Jun 20 19:54:26.779391 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:26.775866Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.212736926s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/clusterinformations/default\" limit:1 ","response":"range_response_count:1 size:886"} Jun 20 19:54:26.779815 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:26.776060Z","caller":"traceutil/trace.go:171","msg":"trace[1411931690] range","detail":"{range_begin:/registry/crd.projectcalico.org/clusterinformations/default; range_end:; response_count:1; response_revision:1670; }","duration":"1.213070793s","start":"2025-06-20T19:54:25.562963Z","end":"2025-06-20T19:54:26.776034Z","steps":["trace[1411931690] 'agreement among raft nodes before linearized reading' (duration: 1.211250824s)"],"step_count":1} Jun 20 19:54:26.779815 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:26.776295Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:25.562945Z","time spent":"1.213254829s","remote":"172.24.4.123:46740","response type":"/etcdserverpb.KV/Range","request count":0,"request size":63,"response count":1,"response size":910,"request content":"key:\"/registry/crd.projectcalico.org/clusterinformations/default\" limit:1 "} Jun 20 19:54:26.779815 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:26.777034Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.794952505s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/bgppeers/\" range_end:\"/registry/crd.projectcalico.org/bgppeers0\" count_only:true ","response":"range_response_count:0 size:5"} Jun 20 19:54:26.779815 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:26.777107Z","caller":"traceutil/trace.go:171","msg":"trace[1977443323] range","detail":"{range_begin:/registry/crd.projectcalico.org/bgppeers/; range_end:/registry/crd.projectcalico.org/bgppeers0; response_count:0; response_revision:1670; }","duration":"1.795065988s","start":"2025-06-20T19:54:24.982024Z","end":"2025-06-20T19:54:26.777090Z","steps":["trace[1977443323] 'agreement among raft nodes before linearized reading' (duration: 1.794964457s)"],"step_count":1} Jun 20 19:54:26.780175 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:26.777158Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:24.982002Z","time spent":"1.79513699s","remote":"172.24.4.123:40028","response type":"/etcdserverpb.KV/Range","request count":0,"request size":88,"response count":0,"response size":29,"request content":"key:\"/registry/crd.projectcalico.org/bgppeers/\" range_end:\"/registry/crd.projectcalico.org/bgppeers0\" count_only:true "} Jun 20 19:54:27.049336 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:27.048372Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"127.203782ms","expected-duration":"100ms","prefix":"","request":"header: txn: success:> failure: >>","response":"size:16"} Jun 20 19:54:27.051378 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:27.049281Z","caller":"traceutil/trace.go:171","msg":"trace[2084699641] transaction","detail":"{read_only:false; response_revision:1672; number_of_response:1; }","duration":"234.392812ms","start":"2025-06-20T19:54:26.814847Z","end":"2025-06-20T19:54:27.049240Z","steps":["trace[2084699641] 'process raft request' (duration: 106.194232ms)","trace[2084699641] 'compare' (duration: 126.748205ms)"],"step_count":2} Jun 20 19:54:27.053766 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:27.052110Z","caller":"traceutil/trace.go:171","msg":"trace[1599225737] transaction","detail":"{read_only:false; response_revision:1673; number_of_response:1; }","duration":"235.751855ms","start":"2025-06-20T19:54:26.816321Z","end":"2025-06-20T19:54:27.052073Z","steps":["trace[1599225737] 'process raft request' (duration: 232.32648ms)"],"step_count":1} Jun 20 19:54:27.055453 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:27.053450Z","caller":"traceutil/trace.go:171","msg":"trace[639404502] transaction","detail":"{read_only:false; response_revision:1674; number_of_response:1; }","duration":"231.897092ms","start":"2025-06-20T19:54:26.821375Z","end":"2025-06-20T19:54:27.053272Z","steps":["trace[639404502] 'process raft request' (duration: 230.514886ms)"],"step_count":1} Jun 20 19:54:27.057782 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:27.054937Z","caller":"traceutil/trace.go:171","msg":"trace[1485216603] linearizableReadLoop","detail":"{readStateIndex:2111; appliedIndex:2106; }","duration":"218.797564ms","start":"2025-06-20T19:54:26.835632Z","end":"2025-06-20T19:54:27.054430Z","steps":["trace[1485216603] 'read index received' (duration: 14.985563ms)","trace[1485216603] 'applied index is now lower than readState.Index' (duration: 203.809987ms)"],"step_count":2} Jun 20 19:54:27.057782 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:27.055918Z","caller":"traceutil/trace.go:171","msg":"trace[1843971767] transaction","detail":"{read_only:false; response_revision:1675; number_of_response:1; }","duration":"234.363547ms","start":"2025-06-20T19:54:26.821531Z","end":"2025-06-20T19:54:27.055894Z","steps":["trace[1843971767] 'process raft request' (duration: 230.63377ms)"],"step_count":1} Jun 20 19:54:27.057782 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:27.057057Z","caller":"traceutil/trace.go:171","msg":"trace[277688209] transaction","detail":"{read_only:false; response_revision:1676; number_of_response:1; }","duration":"218.347959ms","start":"2025-06-20T19:54:26.838662Z","end":"2025-06-20T19:54:27.057010Z","steps":["trace[277688209] 'process raft request' (duration: 215.4741ms)"],"step_count":1} Jun 20 19:54:27.057782 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:27.057191Z","caller":"traceutil/trace.go:171","msg":"trace[352395406] transaction","detail":"{read_only:false; number_of_response:0; response_revision:1676; }","duration":"207.402746ms","start":"2025-06-20T19:54:26.849775Z","end":"2025-06-20T19:54:27.057177Z","steps":["trace[352395406] 'process raft request' (duration: 204.552181ms)"],"step_count":1} Jun 20 19:54:27.058346 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:27.057362Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"221.705847ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jun 20 19:54:27.058346 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:27.057424Z","caller":"traceutil/trace.go:171","msg":"trace[1927204142] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1676; }","duration":"221.882569ms","start":"2025-06-20T19:54:26.835526Z","end":"2025-06-20T19:54:27.057409Z","steps":["trace[1927204142] 'agreement among raft nodes before linearized reading' (duration: 221.779045ms)"],"step_count":1} Jun 20 19:54:27.058346 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:27.058009Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"202.75249ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/events/kube-system/kube-apiserver-ci-4344-1-0-0-4524070979.novalocal.184ad8401ddbdf71\" limit:1 ","response":"range_response_count:1 size:905"} Jun 20 19:54:27.058931 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:27.058400Z","caller":"traceutil/trace.go:171","msg":"trace[466511770] range","detail":"{range_begin:/registry/events/kube-system/kube-apiserver-ci-4344-1-0-0-4524070979.novalocal.184ad8401ddbdf71; range_end:; response_count:1; response_revision:1676; }","duration":"202.91128ms","start":"2025-06-20T19:54:26.855196Z","end":"2025-06-20T19:54:27.058107Z","steps":["trace[466511770] 'agreement among raft nodes before linearized reading' (duration: 202.329146ms)"],"step_count":1} Jun 20 19:54:27.543285 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:27.542701Z","caller":"traceutil/trace.go:171","msg":"trace[703821167] transaction","detail":"{read_only:false; response_revision:1678; number_of_response:1; }","duration":"432.69107ms","start":"2025-06-20T19:54:27.109990Z","end":"2025-06-20T19:54:27.542681Z","steps":["trace[703821167] 'process raft request' (duration: 411.947642ms)","trace[703821167] 'compare' (duration: 20.558882ms)"],"step_count":2} Jun 20 19:54:27.543285 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:27.542816Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:27.109974Z","time spent":"432.778716ms","remote":"172.24.4.123:60016","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":890,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jun 20 19:54:27.563074 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:27.561867Z","caller":"traceutil/trace.go:171","msg":"trace[1395092971] transaction","detail":"{read_only:false; response_revision:1679; number_of_response:1; }","duration":"450.892925ms","start":"2025-06-20T19:54:27.110960Z","end":"2025-06-20T19:54:27.561853Z","steps":["trace[1395092971] 'process raft request' (duration: 450.802405ms)"],"step_count":1} Jun 20 19:54:27.563074 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:27.561960Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:27.110928Z","time spent":"450.984557ms","remote":"172.24.4.123:60136","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":4968,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jun 20 19:54:27.563074 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:27.562192Z","caller":"traceutil/trace.go:171","msg":"trace[1342502238] transaction","detail":"{read_only:false; number_of_response:0; response_revision:1679; }","duration":"445.551241ms","start":"2025-06-20T19:54:27.116632Z","end":"2025-06-20T19:54:27.562183Z","steps":["trace[1342502238] 'process raft request' (duration: 445.203147ms)"],"step_count":1} Jun 20 19:54:27.563812 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:27.562256Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:27.116607Z","time spent":"445.627143ms","remote":"172.24.4.123:39996","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":29,"request content":"compare: success:> failure:<>"} Jun 20 19:54:27.782642 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:27.781396Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"131.498278ms","expected-duration":"100ms","prefix":"","request":"header: txn: success:> failure: >>","response":"size:16"} Jun 20 19:54:27.782642 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:27.781551Z","caller":"traceutil/trace.go:171","msg":"trace[1038315700] transaction","detail":"{read_only:false; response_revision:1681; number_of_response:1; }","duration":"159.02522ms","start":"2025-06-20T19:54:27.622497Z","end":"2025-06-20T19:54:27.781523Z","steps":["trace[1038315700] 'process raft request' (duration: 27.28625ms)","trace[1038315700] 'compare' (duration: 131.271812ms)"],"step_count":2} Jun 20 19:54:27.796841 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:27.795980Z","caller":"traceutil/trace.go:171","msg":"trace[1694511866] transaction","detail":"{read_only:false; response_revision:1682; number_of_response:1; }","duration":"161.289395ms","start":"2025-06-20T19:54:27.634653Z","end":"2025-06-20T19:54:27.795943Z","steps":["trace[1694511866] 'process raft request' (duration: 160.796538ms)"],"step_count":1} Jun 20 19:54:28.105067 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:28.101865Z","caller":"traceutil/trace.go:171","msg":"trace[100011615] transaction","detail":"{read_only:false; response_revision:1688; number_of_response:1; }","duration":"105.767397ms","start":"2025-06-20T19:54:27.996002Z","end":"2025-06-20T19:54:28.101770Z","steps":["trace[100011615] 'process raft request' (duration: 78.10461ms)","trace[100011615] 'compare' (duration: 26.70062ms)"],"step_count":2} Jun 20 19:54:28.344901 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:28.343019Z","caller":"traceutil/trace.go:171","msg":"trace[2113838317] transaction","detail":"{read_only:false; response_revision:1693; number_of_response:1; }","duration":"142.81051ms","start":"2025-06-20T19:54:28.200065Z","end":"2025-06-20T19:54:28.342875Z","steps":["trace[2113838317] 'process raft request' (duration: 62.855042ms)","trace[2113838317] 'compare' (duration: 79.252686ms)"],"step_count":2} Jun 20 19:54:36.989477 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:36.987895Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078814,"retry-timeout":"500ms"} Jun 20 19:54:37.490626 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:37.489936Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078814,"retry-timeout":"500ms"} Jun 20 19:54:37.991919 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:37.991157Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078814,"retry-timeout":"500ms"} Jun 20 19:54:38.492129 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:38.490434Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.000106184s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context deadline exceeded"} Jun 20 19:54:38.492129 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:38.490946Z","caller":"traceutil/trace.go:171","msg":"trace[288797898] range","detail":"{range_begin:/registry/health; range_end:; }","duration":"2.000909764s","start":"2025-06-20T19:54:36.489903Z","end":"2025-06-20T19:54:38.490813Z","steps":["trace[288797898] 'agreement among raft nodes before linearized reading' (duration: 2.000150166s)"],"step_count":1} Jun 20 19:54:38.492129 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:38.491241Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:36.489886Z","time spent":"2.001304434s","remote":"172.24.4.123:59934","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "} Jun 20 19:54:38.492383 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:38.491720Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078814,"retry-timeout":"500ms"} Jun 20 19:54:38.992654 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:38.992263Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078814,"retry-timeout":"500ms"} Jun 20 19:54:39.494058 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:39.493025Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078814,"retry-timeout":"500ms"} Jun 20 19:54:39.994449 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:39.993786Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078814,"retry-timeout":"500ms"} Jun 20 19:54:40.492902 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:40.491520Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.000517676s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context deadline exceeded"} Jun 20 19:54:40.492902 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:40.491858Z","caller":"traceutil/trace.go:171","msg":"trace[1946656411] range","detail":"{range_begin:/registry/health; range_end:; }","duration":"2.000942082s","start":"2025-06-20T19:54:38.490812Z","end":"2025-06-20T19:54:40.491754Z","steps":["trace[1946656411] 'agreement among raft nodes before linearized reading' (duration: 2.000611571s)"],"step_count":1} Jun 20 19:54:40.492902 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:40.492371Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:38.490796Z","time spent":"2.001508637s","remote":"172.24.4.123:59944","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "} Jun 20 19:54:40.495309 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:40.494808Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078814,"retry-timeout":"500ms"} Jun 20 19:54:40.996476 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:40.995481Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078814,"retry-timeout":"500ms"} Jun 20 19:54:41.497221 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:41.496618Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078814,"retry-timeout":"500ms"} Jun 20 19:54:41.604623 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:41.603922Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"4.000877023s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/clusterinformations/default\" limit:1 ","response":"","error":"context canceled"} Jun 20 19:54:41.604623 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:41.604010Z","caller":"traceutil/trace.go:171","msg":"trace[217509260] range","detail":"{range_begin:/registry/crd.projectcalico.org/clusterinformations/default; range_end:; }","duration":"4.001132451s","start":"2025-06-20T19:54:37.602863Z","end":"2025-06-20T19:54:41.603995Z","steps":["trace[217509260] 'agreement among raft nodes before linearized reading' (duration: 4.000989022s)"],"step_count":1} Jun 20 19:54:41.604623 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:41.604352Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:37.602833Z","time spent":"4.001489051s","remote":"172.24.4.123:46740","response type":"/etcdserverpb.KV/Range","request count":0,"request size":63,"response count":0,"response size":0,"request content":"key:\"/registry/crd.projectcalico.org/clusterinformations/default\" limit:1 "} Jun 20 19:54:41.811686 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:41.810232Z","caller":"wal/wal.go:805","msg":"slow fdatasync","took":"5.327881779s","expected-duration":"1s"} Jun 20 19:54:41.814702 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:41.812979Z","caller":"traceutil/trace.go:171","msg":"trace[1733527848] transaction","detail":"{read_only:false; response_revision:1696; number_of_response:1; }","duration":"5.330878919s","start":"2025-06-20T19:54:36.482018Z","end":"2025-06-20T19:54:41.812897Z","steps":["trace[1733527848] 'process raft request' (duration: 5.32886708s)"],"step_count":1} Jun 20 19:54:41.815857 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:41.814993Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:36.481924Z","time spent":"5.331343451s","remote":"172.24.4.123:60136","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":5136,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jun 20 19:54:41.898547 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:41.896337Z","caller":"traceutil/trace.go:171","msg":"trace[2059830825] transaction","detail":"{read_only:false; response_revision:1697; number_of_response:1; }","duration":"4.720953232s","start":"2025-06-20T19:54:37.175350Z","end":"2025-06-20T19:54:41.896303Z","steps":["trace[2059830825] 'process raft request' (duration: 4.720448775s)"],"step_count":1} Jun 20 19:54:41.898547 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:41.896658Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:37.175261Z","time spent":"4.721214393s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":624,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jun 20 19:54:41.898547 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:41.897134Z","caller":"traceutil/trace.go:171","msg":"trace[704768486] transaction","detail":"{read_only:false; response_revision:1698; number_of_response:1; }","duration":"4.560295125s","start":"2025-06-20T19:54:37.336814Z","end":"2025-06-20T19:54:41.897109Z","steps":["trace[704768486] 'process raft request' (duration: 4.559315195s)"],"step_count":1} Jun 20 19:54:41.899255 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:41.897295Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:37.336791Z","time spent":"4.560420452s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":699,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jun 20 19:54:41.901754 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:41.897500Z","caller":"traceutil/trace.go:171","msg":"trace[1946049822] linearizableReadLoop","detail":"{readStateIndex:2139; appliedIndex:2135; }","duration":"5.409906668s","start":"2025-06-20T19:54:36.487489Z","end":"2025-06-20T19:54:41.897396Z","steps":["trace[1946049822] 'read index received' (duration: 5.323597389s)","trace[1946049822] 'applied index is now lower than readState.Index' (duration: 86.307997ms)"],"step_count":2} Jun 20 19:54:41.901754 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:41.898111Z","caller":"traceutil/trace.go:171","msg":"trace[1390464196] transaction","detail":"{read_only:false; response_revision:1699; number_of_response:1; }","duration":"4.513043352s","start":"2025-06-20T19:54:37.385042Z","end":"2025-06-20T19:54:41.898086Z","steps":["trace[1390464196] 'process raft request' (duration: 4.511925974s)"],"step_count":1} Jun 20 19:54:41.901754 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:41.899136Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:37.385004Z","time spent":"4.513954865s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":537,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jun 20 19:54:41.901754 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:41.899895Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"5.412384152s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/events/kube-system/kube-controller-manager-ci-4344-1-0-0-4524070979.novalocal.184ad84aa2d18a9d\" limit:1 ","response":"range_response_count:1 size:967"} Jun 20 19:54:41.902486 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:41.899999Z","caller":"traceutil/trace.go:171","msg":"trace[1558313423] range","detail":"{range_begin:/registry/events/kube-system/kube-controller-manager-ci-4344-1-0-0-4524070979.novalocal.184ad84aa2d18a9d; range_end:; response_count:1; response_revision:1699; }","duration":"5.412479912s","start":"2025-06-20T19:54:36.487484Z","end":"2025-06-20T19:54:41.899964Z","steps":["trace[1558313423] 'agreement among raft nodes before linearized reading' (duration: 5.410853076s)"],"step_count":1} Jun 20 19:54:41.902486 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:41.900127Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:36.487408Z","time spent":"5.412655462s","remote":"172.24.4.123:60016","response type":"/etcdserverpb.KV/Range","request count":0,"request size":108,"response count":1,"response size":991,"request content":"key:\"/registry/events/kube-system/kube-controller-manager-ci-4344-1-0-0-4524070979.novalocal.184ad84aa2d18a9d\" limit:1 "} Jun 20 19:54:41.902486 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:41.900517Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"332.301863ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/persistentvolumes/pvc-c3c15535-098f-4940-a214-3e6ca1b164de\" limit:1 ","response":"range_response_count:0 size:5"} Jun 20 19:54:41.902486 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:41.900636Z","caller":"traceutil/trace.go:171","msg":"trace[2096237293] range","detail":"{range_begin:/registry/persistentvolumes/pvc-c3c15535-098f-4940-a214-3e6ca1b164de; range_end:; response_count:0; response_revision:1699; }","duration":"332.432939ms","start":"2025-06-20T19:54:41.568128Z","end":"2025-06-20T19:54:41.900560Z","steps":["trace[2096237293] 'agreement among raft nodes before linearized reading' (duration: 332.307183ms)"],"step_count":1} Jun 20 19:54:41.903168 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:41.900724Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:41.568066Z","time spent":"332.629279ms","remote":"172.24.4.123:60094","response type":"/etcdserverpb.KV/Range","request count":0,"request size":72,"response count":0,"response size":29,"request content":"key:\"/registry/persistentvolumes/pvc-c3c15535-098f-4940-a214-3e6ca1b164de\" limit:1 "} Jun 20 19:54:41.904706 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:41.903971Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"159.89239ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jun 20 19:54:41.906436 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:41.905928Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"3.338683732s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/masterleases/172.24.4.123\" limit:1 ","response":"range_response_count:1 size:131"} Jun 20 19:54:41.907487 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:41.906920Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"3.645366241s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/minions/172.24.4.126\" limit:1 ","response":"range_response_count:1 size:4607"} Jun 20 19:54:41.908197 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:41.907662Z","caller":"traceutil/trace.go:171","msg":"trace[1546342879] range","detail":"{range_begin:/registry/minions/172.24.4.126; range_end:; response_count:1; response_revision:1699; }","duration":"3.645972852s","start":"2025-06-20T19:54:38.261434Z","end":"2025-06-20T19:54:41.907407Z","steps":["trace[1546342879] 'agreement among raft nodes before linearized reading' (duration: 3.645222932s)"],"step_count":1} Jun 20 19:54:41.908772 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:41.906042Z","caller":"traceutil/trace.go:171","msg":"trace[1574434233] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1699; }","duration":"161.948834ms","start":"2025-06-20T19:54:41.743959Z","end":"2025-06-20T19:54:41.905908Z","steps":["trace[1574434233] 'agreement among raft nodes before linearized reading' (duration: 159.938798ms)"],"step_count":1} Jun 20 19:54:41.909606 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:41.907075Z","caller":"traceutil/trace.go:171","msg":"trace[1020876223] range","detail":"{range_begin:/registry/masterleases/172.24.4.123; range_end:; response_count:1; response_revision:1699; }","duration":"3.339701794s","start":"2025-06-20T19:54:38.567194Z","end":"2025-06-20T19:54:41.906896Z","steps":["trace[1020876223] 'agreement among raft nodes before linearized reading' (duration: 3.338543118s)"],"step_count":1} Jun 20 19:54:41.910324 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:41.905057Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.398491008s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jun 20 19:54:41.911287 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:41.905223Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.441205634s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/stagedglobalnetworkpolicies/\" range_end:\"/registry/crd.projectcalico.org/stagedglobalnetworkpolicies0\" count_only:true ","response":"range_response_count:0 size:5"} Jun 20 19:54:41.911903 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:41.905670Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"3.266005778s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/minions/ci-4344-1-0-0-4524070979.novalocal\" limit:1 ","response":"range_response_count:1 size:6551"} Jun 20 19:54:41.911903 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:41.904955Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"3.771747157s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/events/\" range_end:\"/registry/events0\" count_only:true ","response":"range_response_count:0 size:8"} Jun 20 19:54:41.911903 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:41.908487Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:38.261406Z","time spent":"3.647043212s","remote":"172.24.4.123:60130","response type":"/etcdserverpb.KV/Range","request count":0,"request size":34,"response count":1,"response size":4631,"request content":"key:\"/registry/minions/172.24.4.126\" limit:1 "} Jun 20 19:54:41.911903 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:41.910631Z","caller":"traceutil/trace.go:171","msg":"trace[1009800567] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1699; }","duration":"1.404161158s","start":"2025-06-20T19:54:40.506393Z","end":"2025-06-20T19:54:41.910555Z","steps":["trace[1009800567] 'agreement among raft nodes before linearized reading' (duration: 1.398605661s)"],"step_count":1} Jun 20 19:54:41.911903 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:41.910737Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:40.506354Z","time spent":"1.404358418s","remote":"172.24.4.123:59934","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":29,"request content":"key:\"/registry/health\" "} Jun 20 19:54:41.913453 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:41.911098Z","caller":"traceutil/trace.go:171","msg":"trace[1309209122] range","detail":"{range_begin:/registry/crd.projectcalico.org/stagedglobalnetworkpolicies/; range_end:/registry/crd.projectcalico.org/stagedglobalnetworkpolicies0; response_count:0; response_revision:1699; }","duration":"2.447073386s","start":"2025-06-20T19:54:39.463915Z","end":"2025-06-20T19:54:41.910989Z","steps":["trace[1309209122] 'agreement among raft nodes before linearized reading' (duration: 2.441212237s)"],"step_count":1} Jun 20 19:54:41.914483 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:41.914134Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:39.463882Z","time spent":"2.450186835s","remote":"172.24.4.123:40092","response type":"/etcdserverpb.KV/Range","request count":0,"request size":126,"response count":0,"response size":29,"request content":"key:\"/registry/crd.projectcalico.org/stagedglobalnetworkpolicies/\" range_end:\"/registry/crd.projectcalico.org/stagedglobalnetworkpolicies0\" count_only:true "} Jun 20 19:54:41.915167 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:41.911163Z","caller":"traceutil/trace.go:171","msg":"trace[598241200] range","detail":"{range_begin:/registry/minions/ci-4344-1-0-0-4524070979.novalocal; range_end:; response_count:1; response_revision:1699; }","duration":"3.271645252s","start":"2025-06-20T19:54:38.639498Z","end":"2025-06-20T19:54:41.911144Z","steps":["trace[598241200] 'agreement among raft nodes before linearized reading' (duration: 3.265793308s)"],"step_count":1} Jun 20 19:54:41.915167 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:41.911205Z","caller":"traceutil/trace.go:171","msg":"trace[934967746] range","detail":"{range_begin:/registry/events/; range_end:/registry/events0; response_count:0; response_revision:1699; }","duration":"3.778090202s","start":"2025-06-20T19:54:38.133100Z","end":"2025-06-20T19:54:41.911191Z","steps":["trace[934967746] 'agreement among raft nodes before linearized reading' (duration: 3.766619155s)"],"step_count":1} Jun 20 19:54:41.915167 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:41.910057Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:38.567179Z","time spent":"3.342752946s","remote":"172.24.4.123:59956","response type":"/etcdserverpb.KV/Range","request count":0,"request size":39,"response count":1,"response size":155,"request content":"key:\"/registry/masterleases/172.24.4.123\" limit:1 "} Jun 20 19:54:41.916051 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:41.915273Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:38.639398Z","time spent":"3.27583927s","remote":"172.24.4.123:60130","response type":"/etcdserverpb.KV/Range","request count":0,"request size":56,"response count":1,"response size":6575,"request content":"key:\"/registry/minions/ci-4344-1-0-0-4524070979.novalocal\" limit:1 "} Jun 20 19:54:41.917875 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:41.916059Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:38.133073Z","time spent":"3.782883276s","remote":"172.24.4.123:60488","response type":"/etcdserverpb.KV/Range","request count":0,"request size":40,"response count":251,"response size":32,"request content":"key:\"/registry/events/\" range_end:\"/registry/events0\" count_only:true "} Jun 20 19:54:42.418285 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:42.417561Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078820,"retry-timeout":"500ms"} Jun 20 19:54:42.918924 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:42.918097Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078820,"retry-timeout":"500ms"} Jun 20 19:54:44.327794 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:43.418979Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078820,"retry-timeout":"500ms"} Jun 20 19:54:44.327794 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:43.659731Z","caller":"wal/wal.go:805","msg":"slow fdatasync","took":"1.756041465s","expected-duration":"1s"} Jun 20 19:54:44.327794 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:43.916368Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.998999244s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context canceled"} Jun 20 19:54:44.327794 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:43.916467Z","caller":"traceutil/trace.go:171","msg":"trace[563794103] range","detail":"{range_begin:/registry/health; range_end:; }","duration":"1.999160347s","start":"2025-06-20T19:54:41.917285Z","end":"2025-06-20T19:54:43.916446Z","steps":["trace[563794103] 'agreement among raft nodes before linearized reading' (duration: 1.999025394s)"],"step_count":1} Jun 20 19:54:44.327794 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:43.916525Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:41.917249Z","time spent":"1.999258621s","remote":"172.24.4.123:59944","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "} Jun 20 19:54:44.636244 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:44.634759Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"974.598929ms","expected-duration":"100ms","prefix":"","request":"header: lease_revoke:","response":"size:29"} Jun 20 19:54:44.637113 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:44.636163Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:41.905326Z","time spent":"2.730649492s","remote":"172.24.4.123:60016","response type":"/etcdserverpb.Lease/LeaseGrant","request count":-1,"request size":-1,"response count":-1,"response size":-1,"request content":""} Jun 20 19:54:44.638719 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:44.637239Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:41.919246Z","time spent":"2.717983489s","remote":"172.24.4.123:59956","response type":"/etcdserverpb.Lease/LeaseGrant","request count":-1,"request size":-1,"response count":-1,"response size":-1,"request content":""} Jun 20 19:54:44.638719 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:44.637517Z","caller":"traceutil/trace.go:171","msg":"trace[497285324] transaction","detail":"{read_only:false; response_revision:1700; number_of_response:1; }","duration":"2.710486046s","start":"2025-06-20T19:54:41.926990Z","end":"2025-06-20T19:54:44.637476Z","steps":["trace[497285324] 'process raft request' (duration: 2.708855854s)"],"step_count":1} Jun 20 19:54:44.638719 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:44.637848Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:41.926967Z","time spent":"2.710672607s","remote":"172.24.4.123:60136","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":4487,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jun 20 19:54:44.638719 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:44.638005Z","caller":"traceutil/trace.go:171","msg":"trace[2022429901] linearizableReadLoop","detail":"{readStateIndex:2143; appliedIndex:2139; }","duration":"2.72088476s","start":"2025-06-20T19:54:41.917100Z","end":"2025-06-20T19:54:44.637985Z","steps":["trace[2022429901] 'read index received' (duration: 1.743034233s)","trace[2022429901] 'applied index is now lower than readState.Index' (duration: 977.847672ms)"],"step_count":2} Jun 20 19:54:44.742350 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:44.737134Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"100.993478ms","expected-duration":"100ms","prefix":"","request":"header: lease_revoke:","response":"size:29"} Jun 20 19:54:44.742350 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:44.738241Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.821112299s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/services/specs/default/nfs-server-provisioner\" limit:1 ","response":"range_response_count:1 size:2748"} Jun 20 19:54:44.742350 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:44.738337Z","caller":"traceutil/trace.go:171","msg":"trace[130234474] range","detail":"{range_begin:/registry/services/specs/default/nfs-server-provisioner; range_end:; response_count:1; response_revision:1701; }","duration":"2.82123483s","start":"2025-06-20T19:54:41.917051Z","end":"2025-06-20T19:54:44.738286Z","steps":["trace[130234474] 'agreement among raft nodes before linearized reading' (duration: 2.721000367s)","trace[130234474] 'range keys from in-memory index tree' (duration: 99.875729ms)"],"step_count":2} Jun 20 19:54:44.742350 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:44.738530Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:41.917027Z","time spent":"2.821449412s","remote":"172.24.4.123:60146","response type":"/etcdserverpb.KV/Range","request count":0,"request size":59,"response count":1,"response size":2772,"request content":"key:\"/registry/services/specs/default/nfs-server-provisioner\" limit:1 "} Jun 20 19:54:44.742350 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:44.739658Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"524.611809ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/default/test-pod-1\" limit:1 ","response":"range_response_count:1 size:2344"} Jun 20 19:54:44.743834 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:44.739727Z","caller":"traceutil/trace.go:171","msg":"trace[931085630] range","detail":"{range_begin:/registry/pods/default/test-pod-1; range_end:; response_count:1; response_revision:1702; }","duration":"524.730673ms","start":"2025-06-20T19:54:44.214981Z","end":"2025-06-20T19:54:44.739711Z","steps":["trace[931085630] 'agreement among raft nodes before linearized reading' (duration: 524.225904ms)"],"step_count":1} Jun 20 19:54:44.743834 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:44.739773Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:44.214938Z","time spent":"524.819259ms","remote":"172.24.4.123:60136","response type":"/etcdserverpb.KV/Range","request count":0,"request size":37,"response count":1,"response size":2368,"request content":"key:\"/registry/pods/default/test-pod-1\" limit:1 "} Jun 20 19:54:46.445905 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:46.445086Z","caller":"wal/wal.go:805","msg":"slow fdatasync","took":"1.659137578s","expected-duration":"1s"} Jun 20 19:54:46.519634 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:46.518146Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"4.59460982s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/minions/172.24.4.126\" limit:1 ","response":"range_response_count:1 size:4607"} Jun 20 19:54:46.519634 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:46.518240Z","caller":"traceutil/trace.go:171","msg":"trace[1376611869] range","detail":"{range_begin:/registry/minions/172.24.4.126; range_end:; response_count:1; response_revision:1702; }","duration":"4.594850231s","start":"2025-06-20T19:54:41.923366Z","end":"2025-06-20T19:54:46.518216Z","steps":["trace[1376611869] 'agreement among raft nodes before linearized reading' (duration: 2.816249955s)","trace[1376611869] 'range keys from in-memory index tree' (duration: 1.778360576s)"],"step_count":2} Jun 20 19:54:46.519634 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:46.518298Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:41.923352Z","time spent":"4.59492972s","remote":"172.24.4.123:60130","response type":"/etcdserverpb.KV/Range","request count":0,"request size":34,"response count":1,"response size":4631,"request content":"key:\"/registry/minions/172.24.4.126\" limit:1 "} Jun 20 19:54:46.519634 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:46.518698Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.585391239s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jun 20 19:54:46.520253 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:46.518791Z","caller":"traceutil/trace.go:171","msg":"trace[1828643777] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1702; }","duration":"2.58565329s","start":"2025-06-20T19:54:43.933101Z","end":"2025-06-20T19:54:46.518754Z","steps":["trace[1828643777] 'agreement among raft nodes before linearized reading' (duration: 806.531574ms)","trace[1828643777] 'range keys from in-memory index tree' (duration: 1.778980681s)"],"step_count":2} Jun 20 19:54:46.520253 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:46.518890Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:43.933010Z","time spent":"2.585858938s","remote":"172.24.4.123:59934","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":29,"request content":"key:\"/registry/health\" "} Jun 20 19:54:46.520253 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:46.519175Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.60347018s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/clusterinformations/default\" limit:1 ","response":"range_response_count:1 size:886"} Jun 20 19:54:46.520253 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:46.519256Z","caller":"traceutil/trace.go:171","msg":"trace[1256190673] range","detail":"{range_begin:/registry/crd.projectcalico.org/clusterinformations/default; range_end:; response_count:1; response_revision:1702; }","duration":"2.603591367s","start":"2025-06-20T19:54:43.915641Z","end":"2025-06-20T19:54:46.519232Z","steps":["trace[1256190673] 'agreement among raft nodes before linearized reading' (duration: 823.996241ms)","trace[1256190673] 'range keys from in-memory index tree' (duration: 1.779344364s)"],"step_count":2} Jun 20 19:54:46.520795 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:46.519324Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:43.915559Z","time spent":"2.60374154s","remote":"172.24.4.123:46740","response type":"/etcdserverpb.KV/Range","request count":0,"request size":63,"response count":1,"response size":910,"request content":"key:\"/registry/crd.projectcalico.org/clusterinformations/default\" limit:1 "} Jun 20 19:54:46.521834 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:46.521394Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.848243295s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/kube-system/kube-controller-manager-ci-4344-1-0-0-4524070979.novalocal\" limit:1 ","response":"range_response_count:1 size:6946"} Jun 20 19:54:46.522406 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:46.521462Z","caller":"traceutil/trace.go:171","msg":"trace[1696978511] range","detail":"{range_begin:/registry/pods/kube-system/kube-controller-manager-ci-4344-1-0-0-4524070979.novalocal; range_end:; response_count:1; response_revision:1702; }","duration":"1.848360915s","start":"2025-06-20T19:54:44.673081Z","end":"2025-06-20T19:54:46.521442Z","steps":["trace[1696978511] 'agreement among raft nodes before linearized reading' (duration: 66.930904ms)","trace[1696978511] 'range keys from in-memory index tree' (duration: 1.781165594s)"],"step_count":2} Jun 20 19:54:46.522406 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:46.521531Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:44.673053Z","time spent":"1.848460262s","remote":"172.24.4.123:60136","response type":"/etcdserverpb.KV/Range","request count":0,"request size":89,"response count":1,"response size":6970,"request content":"key:\"/registry/pods/kube-system/kube-controller-manager-ci-4344-1-0-0-4524070979.novalocal\" limit:1 "} Jun 20 19:54:46.523008 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:46.522179Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"4.590595729s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/minions/ci-4344-1-0-0-4524070979.novalocal\" limit:1 ","response":"range_response_count:1 size:6551"} Jun 20 19:54:46.523008 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:46.522248Z","caller":"traceutil/trace.go:171","msg":"trace[595578345] range","detail":"{range_begin:/registry/minions/ci-4344-1-0-0-4524070979.novalocal; range_end:; response_count:1; response_revision:1702; }","duration":"4.590711707s","start":"2025-06-20T19:54:41.931518Z","end":"2025-06-20T19:54:46.522229Z","steps":["trace[595578345] 'agreement among raft nodes before linearized reading' (duration: 2.809448749s)","trace[595578345] 'range keys from in-memory index tree' (duration: 1.781091055s)"],"step_count":2} Jun 20 19:54:46.523008 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:46.522295Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:41.931494Z","time spent":"4.590785806s","remote":"172.24.4.123:60130","response type":"/etcdserverpb.KV/Range","request count":0,"request size":56,"response count":1,"response size":6575,"request content":"key:\"/registry/minions/ci-4344-1-0-0-4524070979.novalocal\" limit:1 "} Jun 20 19:54:46.524131 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:46.523623Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"4.60387339s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/events/default/test-dynamic-volume-claim.184ad84e421c4859\" limit:1 ","response":"range_response_count:1 size:805"} Jun 20 19:54:46.524131 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:46.523710Z","caller":"traceutil/trace.go:171","msg":"trace[1937922966] range","detail":"{range_begin:/registry/events/default/test-dynamic-volume-claim.184ad84e421c4859; range_end:; response_count:1; response_revision:1702; }","duration":"4.604036557s","start":"2025-06-20T19:54:41.919650Z","end":"2025-06-20T19:54:46.523686Z","steps":["trace[1937922966] 'agreement among raft nodes before linearized reading' (duration: 2.820342303s)","trace[1937922966] 'range keys from in-memory index tree' (duration: 1.779504093s)"],"step_count":2} Jun 20 19:54:46.524664 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:46.523834Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:41.919630Z","time spent":"4.604115996s","remote":"172.24.4.123:60016","response type":"/etcdserverpb.KV/Range","request count":0,"request size":71,"response count":1,"response size":829,"request content":"key:\"/registry/events/default/test-dynamic-volume-claim.184ad84e421c4859\" limit:1 "} Jun 20 19:54:46.600591 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:46.600030Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.843179561s","expected-duration":"100ms","prefix":"","request":"header: lease_revoke:","response":"size:29"} Jun 20 19:54:46.600591 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:46.600262Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:44.762844Z","time spent":"1.83741345s","remote":"172.24.4.123:59956","response type":"/etcdserverpb.Lease/LeaseGrant","request count":-1,"request size":-1,"response count":-1,"response size":-1,"request content":""} Jun 20 19:54:46.601143 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:46.600348Z","caller":"traceutil/trace.go:171","msg":"trace[1317630670] linearizableReadLoop","detail":"{readStateIndex:2147; appliedIndex:2146; }","duration":"1.838621189s","start":"2025-06-20T19:54:44.761715Z","end":"2025-06-20T19:54:46.600336Z","steps":["trace[1317630670] 'read index received' (duration: 43.702µs)","trace[1317630670] 'applied index is now lower than readState.Index' (duration: 1.838576505s)"],"step_count":2} Jun 20 19:54:46.601143 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:46.600512Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.838841653s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/services/endpoints/default/nfs-server-provisioner\" limit:1 ","response":"range_response_count:1 size:1219"} Jun 20 19:54:46.601262 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:46.600556Z","caller":"traceutil/trace.go:171","msg":"trace[29581723] range","detail":"{range_begin:/registry/services/endpoints/default/nfs-server-provisioner; range_end:; response_count:1; response_revision:1702; }","duration":"1.838986986s","start":"2025-06-20T19:54:44.761558Z","end":"2025-06-20T19:54:46.600545Z","steps":["trace[29581723] 'agreement among raft nodes before linearized reading' (duration: 1.838830893s)"],"step_count":1} Jun 20 19:54:46.601262 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:46.600871Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:44.761508Z","time spent":"1.839349768s","remote":"172.24.4.123:60126","response type":"/etcdserverpb.KV/Range","request count":0,"request size":63,"response count":1,"response size":1243,"request content":"key:\"/registry/services/endpoints/default/nfs-server-provisioner\" limit:1 "} Jun 20 19:54:46.728375 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:46.726534Z","caller":"traceutil/trace.go:171","msg":"trace[1733082628] linearizableReadLoop","detail":"{readStateIndex:2151; appliedIndex:2149; }","duration":"126.138398ms","start":"2025-06-20T19:54:46.600371Z","end":"2025-06-20T19:54:46.726510Z","steps":["trace[1733082628] 'read index received' (duration: 124.569772ms)","trace[1733082628] 'applied index is now lower than readState.Index' (duration: 1.567584ms)"],"step_count":2} Jun 20 19:54:46.731006 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:46.726770Z","caller":"traceutil/trace.go:171","msg":"trace[2082840418] transaction","detail":"{read_only:false; response_revision:1704; number_of_response:1; }","duration":"163.781927ms","start":"2025-06-20T19:54:46.562968Z","end":"2025-06-20T19:54:46.726750Z","steps":["trace[2082840418] 'process raft request' (duration: 161.823598ms)"],"step_count":1} Jun 20 19:54:46.731483 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:46.727327Z","caller":"traceutil/trace.go:171","msg":"trace[1498857474] transaction","detail":"{read_only:false; number_of_response:0; response_revision:1704; }","duration":"163.467367ms","start":"2025-06-20T19:54:46.563839Z","end":"2025-06-20T19:54:46.727306Z","steps":["trace[1498857474] 'process raft request' (duration: 162.561976ms)"],"step_count":1} Jun 20 19:54:46.733724 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:46.727441Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"792.976417ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jun 20 19:54:46.733724 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:46.731936Z","caller":"traceutil/trace.go:171","msg":"trace[671193878] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1704; }","duration":"797.523278ms","start":"2025-06-20T19:54:45.934387Z","end":"2025-06-20T19:54:46.731910Z","steps":["trace[671193878] 'agreement among raft nodes before linearized reading' (duration: 793.006143ms)"],"step_count":1} Jun 20 19:54:46.733724 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:46.732015Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:45.934353Z","time spent":"797.633667ms","remote":"172.24.4.123:59944","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":29,"request content":"key:\"/registry/health\" "} Jun 20 19:54:46.734502 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:46.733796Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.962231708s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/events/kube-system/kube-scheduler-ci-4344-1-0-0-4524070979.novalocal.184ad84a9fe57c12\" limit:1 ","response":"range_response_count:1 size:922"} Jun 20 19:54:46.735295 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:46.734536Z","caller":"traceutil/trace.go:171","msg":"trace[486868512] range","detail":"{range_begin:/registry/events/kube-system/kube-scheduler-ci-4344-1-0-0-4524070979.novalocal.184ad84a9fe57c12; range_end:; response_count:1; response_revision:1704; }","duration":"1.963204807s","start":"2025-06-20T19:54:44.771271Z","end":"2025-06-20T19:54:46.734476Z","steps":["trace[486868512] 'agreement among raft nodes before linearized reading' (duration: 1.956209917s)"],"step_count":1} Jun 20 19:54:46.735295 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:46.734661Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:44.771210Z","time spent":"1.963420862s","remote":"172.24.4.123:60016","response type":"/etcdserverpb.KV/Range","request count":0,"request size":99,"response count":1,"response size":946,"request content":"key:\"/registry/events/kube-system/kube-scheduler-ci-4344-1-0-0-4524070979.novalocal.184ad84a9fe57c12\" limit:1 "} Jun 20 19:54:46.752917 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:46.751977Z","caller":"traceutil/trace.go:171","msg":"trace[408772519] transaction","detail":"{read_only:false; response_revision:1705; number_of_response:1; }","duration":"149.997065ms","start":"2025-06-20T19:54:46.601929Z","end":"2025-06-20T19:54:46.751926Z","steps":["trace[408772519] 'process raft request' (duration: 149.763826ms)"],"step_count":1} Jun 20 19:54:47.032870 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:47.031891Z","caller":"traceutil/trace.go:171","msg":"trace[259486404] transaction","detail":"{read_only:false; response_revision:1708; number_of_response:1; }","duration":"222.924541ms","start":"2025-06-20T19:54:46.808940Z","end":"2025-06-20T19:54:47.031864Z","steps":["trace[259486404] 'process raft request' (duration: 157.843613ms)","trace[259486404] 'compare' (duration: 64.66662ms)"],"step_count":2} Jun 20 19:54:47.032870 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:47.032059Z","caller":"traceutil/trace.go:171","msg":"trace[1987584394] linearizableReadLoop","detail":"{readStateIndex:2157; appliedIndex:2155; }","duration":"218.850568ms","start":"2025-06-20T19:54:46.813195Z","end":"2025-06-20T19:54:47.032046Z","steps":["trace[1987584394] 'read index received' (duration: 153.600181ms)","trace[1987584394] 'applied index is now lower than readState.Index' (duration: 65.249605ms)"],"step_count":2} Jun 20 19:54:47.032870 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:47.032149Z","caller":"traceutil/trace.go:171","msg":"trace[1202871039] transaction","detail":"{read_only:false; response_revision:1709; number_of_response:1; }","duration":"220.313445ms","start":"2025-06-20T19:54:46.811820Z","end":"2025-06-20T19:54:47.032133Z","steps":["trace[1202871039] 'process raft request' (duration: 219.976673ms)"],"step_count":1} Jun 20 19:54:47.033269 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:47.032430Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"237.67565ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/masterleases/\" range_end:\"/registry/masterleases0\" ","response":"range_response_count:1 size:131"} Jun 20 19:54:47.033269 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:47.032488Z","caller":"traceutil/trace.go:171","msg":"trace[1154612918] range","detail":"{range_begin:/registry/masterleases/; range_end:/registry/masterleases0; response_count:1; response_revision:1709; }","duration":"237.775567ms","start":"2025-06-20T19:54:46.794685Z","end":"2025-06-20T19:54:47.032461Z","steps":["trace[1154612918] 'agreement among raft nodes before linearized reading' (duration: 237.464503ms)"],"step_count":1} Jun 20 19:54:47.039419 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:47.038480Z","caller":"traceutil/trace.go:171","msg":"trace[346958947] transaction","detail":"{read_only:false; response_revision:1710; number_of_response:1; }","duration":"221.52426ms","start":"2025-06-20T19:54:46.816928Z","end":"2025-06-20T19:54:47.038452Z","steps":["trace[346958947] 'process raft request' (duration: 221.334715ms)"],"step_count":1} Jun 20 19:54:47.040261 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:47.039082Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"225.210334ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/tiers/adminnetworkpolicy\" limit:1 ","response":"range_response_count:1 size:721"} Jun 20 19:54:47.040261 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:47.039655Z","caller":"traceutil/trace.go:171","msg":"trace[1554567730] range","detail":"{range_begin:/registry/crd.projectcalico.org/tiers/adminnetworkpolicy; range_end:; response_count:1; response_revision:1710; }","duration":"225.800995ms","start":"2025-06-20T19:54:46.813829Z","end":"2025-06-20T19:54:47.039630Z","steps":["trace[1554567730] 'agreement among raft nodes before linearized reading' (duration: 224.866038ms)"],"step_count":1} Jun 20 19:54:47.040858 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:47.039181Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"151.426927ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/endpointslices/\" range_end:\"/registry/endpointslices0\" count_only:true ","response":"range_response_count:0 size:7"} Jun 20 19:54:47.040858 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:47.039797Z","caller":"traceutil/trace.go:171","msg":"trace[177891549] range","detail":"{range_begin:/registry/endpointslices/; range_end:/registry/endpointslices0; response_count:0; response_revision:1710; }","duration":"152.08847ms","start":"2025-06-20T19:54:46.887662Z","end":"2025-06-20T19:54:47.039750Z","steps":["trace[177891549] 'agreement among raft nodes before linearized reading' (duration: 151.436646ms)"],"step_count":1} Jun 20 19:54:47.180126 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:47.179379Z","caller":"traceutil/trace.go:171","msg":"trace[1221070068] transaction","detail":"{read_only:false; response_revision:1713; number_of_response:1; }","duration":"102.547044ms","start":"2025-06-20T19:54:47.076810Z","end":"2025-06-20T19:54:47.179357Z","steps":["trace[1221070068] 'process raft request' (duration: 77.915577ms)","trace[1221070068] 'compare' (duration: 24.235704ms)"],"step_count":2} Jun 20 19:54:47.341369 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:47.340826Z","caller":"traceutil/trace.go:171","msg":"trace[1868797766] transaction","detail":"{read_only:false; response_revision:1715; number_of_response:1; }","duration":"135.446021ms","start":"2025-06-20T19:54:47.205352Z","end":"2025-06-20T19:54:47.340798Z","steps":["trace[1868797766] 'process raft request' (duration: 94.365345ms)","trace[1868797766] 'compare' (duration: 40.911247ms)"],"step_count":2} Jun 20 19:54:47.599101 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:47.596904Z","caller":"traceutil/trace.go:171","msg":"trace[1494398932] transaction","detail":"{read_only:false; response_revision:1719; number_of_response:1; }","duration":"158.939118ms","start":"2025-06-20T19:54:47.437814Z","end":"2025-06-20T19:54:47.596754Z","steps":["trace[1494398932] 'process raft request' (duration: 75.186992ms)","trace[1494398932] 'compare' (duration: 83.479325ms)"],"step_count":2} Jun 20 19:54:51.670185 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:51.667505Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:50.458692Z","time spent":"1.208762418s","remote":"172.24.4.123:52294","response type":"/etcdserverpb.Maintenance/Status","request count":-1,"request size":-1,"response count":-1,"response size":-1,"request content":""} Jun 20 19:54:51.670185 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:51.667795Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.707038033s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/leases/kube-system/kube-controller-manager\" limit:1 ","response":"range_response_count:1 size:531"} Jun 20 19:54:51.670185 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:51.667879Z","caller":"traceutil/trace.go:171","msg":"trace[97410089] range","detail":"{range_begin:/registry/leases/kube-system/kube-controller-manager; range_end:; response_count:1; response_revision:1723; }","duration":"2.707327478s","start":"2025-06-20T19:54:48.960527Z","end":"2025-06-20T19:54:51.667854Z","steps":["trace[97410089] 'range keys from in-memory index tree' (duration: 2.706747338s)"],"step_count":1} Jun 20 19:54:51.670185 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:51.667912Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.863518384s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jun 20 19:54:51.670185 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:51.667938Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:48.960497Z","time spent":"2.707421784s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Range","request count":0,"request size":56,"response count":1,"response size":555,"request content":"key:\"/registry/leases/kube-system/kube-controller-manager\" limit:1 "} Jun 20 19:54:51.672227 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:51.667985Z","caller":"traceutil/trace.go:171","msg":"trace[216573675] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1723; }","duration":"1.863615677s","start":"2025-06-20T19:54:49.804344Z","end":"2025-06-20T19:54:51.667960Z","steps":["trace[216573675] 'range keys from in-memory index tree' (duration: 1.863458692s)"],"step_count":1} Jun 20 19:54:51.672227 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:51.668055Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:49.804328Z","time spent":"1.863707529s","remote":"172.24.4.123:59934","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":29,"request content":"key:\"/registry/health\" "} Jun 20 19:54:51.672227 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:51.668106Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"3.362691216s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/configmaps/kube-system/extension-apiserver-authentication\" limit:1 ","response":"range_response_count:1 size:3017"} Jun 20 19:54:51.672227 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:51.668153Z","caller":"traceutil/trace.go:171","msg":"trace[344179562] range","detail":"{range_begin:/registry/configmaps/kube-system/extension-apiserver-authentication; range_end:; response_count:1; response_revision:1723; }","duration":"3.36277849s","start":"2025-06-20T19:54:48.305357Z","end":"2025-06-20T19:54:51.668136Z","steps":["trace[344179562] 'range keys from in-memory index tree' (duration: 3.362567864s)"],"step_count":1} Jun 20 19:54:51.672227 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:51.668196Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:48.305330Z","time spent":"3.362849875s","remote":"172.24.4.123:60040","response type":"/etcdserverpb.KV/Range","request count":0,"request size":71,"response count":1,"response size":3041,"request content":"key:\"/registry/configmaps/kube-system/extension-apiserver-authentication\" limit:1 "} Jun 20 19:54:51.673128 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:51.668308Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.649215113s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/clusterrolebindings/\" range_end:\"/registry/clusterrolebindings0\" count_only:true ","response":"range_response_count:0 size:7"} Jun 20 19:54:51.673128 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:51.668393Z","caller":"traceutil/trace.go:171","msg":"trace[1943731498] range","detail":"{range_begin:/registry/clusterrolebindings/; range_end:/registry/clusterrolebindings0; response_count:0; response_revision:1723; }","duration":"1.649342683s","start":"2025-06-20T19:54:50.019017Z","end":"2025-06-20T19:54:51.668360Z","steps":["trace[1943731498] 'count revisions from in-memory index tree' (duration: 1.649136697s)"],"step_count":1} Jun 20 19:54:51.673128 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:51.668523Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"3.100879005s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/masterleases/172.24.4.123\" limit:1 ","response":"range_response_count:1 size:131"} Jun 20 19:54:51.673128 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:51.668666Z","caller":"traceutil/trace.go:171","msg":"trace[1627741400] range","detail":"{range_begin:/registry/masterleases/172.24.4.123; range_end:; response_count:1; response_revision:1723; }","duration":"3.101100362s","start":"2025-06-20T19:54:48.567547Z","end":"2025-06-20T19:54:51.668647Z","steps":["trace[1627741400] 'range keys from in-memory index tree' (duration: 3.100726969s)"],"step_count":1} Jun 20 19:54:51.673128 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:51.668724Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:48.567523Z","time spent":"3.101180702s","remote":"172.24.4.123:59956","response type":"/etcdserverpb.KV/Range","request count":0,"request size":39,"response count":1,"response size":155,"request content":"key:\"/registry/masterleases/172.24.4.123\" limit:1 "} Jun 20 19:54:51.674177 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:51.668477Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:50.018988Z","time spent":"1.649450848s","remote":"172.24.4.123:60306","response type":"/etcdserverpb.KV/Range","request count":0,"request size":66,"response count":66,"response size":31,"request content":"key:\"/registry/clusterrolebindings/\" range_end:\"/registry/clusterrolebindings0\" count_only:true "} Jun 20 19:54:53.042026 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:53.039823Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078899,"retry-timeout":"500ms"} Jun 20 19:54:53.541537 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:53.540829Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078899,"retry-timeout":"500ms"} Jun 20 19:54:54.042447 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:54.041416Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078899,"retry-timeout":"500ms"} Jun 20 19:54:54.543272 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:54.542632Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078899,"retry-timeout":"500ms"} Jun 20 19:54:54.806630 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:54.805191Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.99925617s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context deadline exceeded"} Jun 20 19:54:54.806630 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:54.805343Z","caller":"traceutil/trace.go:171","msg":"trace[2089278422] range","detail":"{range_begin:/registry/health; range_end:; }","duration":"1.999803238s","start":"2025-06-20T19:54:52.805493Z","end":"2025-06-20T19:54:54.805296Z","steps":["trace[2089278422] 'agreement among raft nodes before linearized reading' (duration: 1.999553038s)"],"step_count":1} Jun 20 19:54:54.806630 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:54.805813Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:52.805393Z","time spent":"2.000386262s","remote":"172.24.4.123:59934","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "} Jun 20 19:54:55.043852 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:55.043200Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078899,"retry-timeout":"500ms"} Jun 20 19:54:55.544953 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:55.544116Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078899,"retry-timeout":"500ms"} Jun 20 19:54:56.045551 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:56.044835Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078899,"retry-timeout":"500ms"} Jun 20 19:54:56.546791 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:56.545911Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078899,"retry-timeout":"500ms"} Jun 20 19:54:56.806396 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:56.805190Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.999888317s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context deadline exceeded"} Jun 20 19:54:56.806396 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:56.805288Z","caller":"traceutil/trace.go:171","msg":"trace[1138470660] range","detail":"{range_begin:/registry/health; range_end:; }","duration":"2.000042618s","start":"2025-06-20T19:54:54.805223Z","end":"2025-06-20T19:54:56.805265Z","steps":["trace[1138470660] 'agreement among raft nodes before linearized reading' (duration: 1.999919898s)"],"step_count":1} Jun 20 19:54:56.807067 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:56.805386Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:54.805199Z","time spent":"2.000133137s","remote":"172.24.4.123:59944","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "} Jun 20 19:54:56.934674 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:56.933762Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.000551452s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context deadline exceeded"} Jun 20 19:54:56.934674 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:56.933941Z","caller":"traceutil/trace.go:171","msg":"trace[400437229] range","detail":"{range_begin:/registry/health; range_end:; }","duration":"2.000793126s","start":"2025-06-20T19:54:54.933116Z","end":"2025-06-20T19:54:56.933909Z","steps":["trace[400437229] 'agreement among raft nodes before linearized reading' (duration: 2.000557534s)"],"step_count":1} Jun 20 19:54:56.934674 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:56.934071Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:54.933093Z","time spent":"2.000916318s","remote":"172.24.4.123:59934","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "} Jun 20 19:55:01.424671 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:57.046961Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078899,"retry-timeout":"500ms"} Jun 20 19:55:01.424671 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:57.548138Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078899,"retry-timeout":"500ms"} Jun 20 19:55:01.424671 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:58.048657Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078899,"retry-timeout":"500ms"} Jun 20 19:55:01.424671 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:58.549750Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078899,"retry-timeout":"500ms"} Jun 20 19:55:01.424671 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:58.831355Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.000570054s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context deadline exceeded"} Jun 20 19:55:01.424671 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:58.831514Z","caller":"traceutil/trace.go:171","msg":"trace[953584049] range","detail":"{range_begin:/registry/health; range_end:; }","duration":"2.000795255s","start":"2025-06-20T19:54:56.830642Z","end":"2025-06-20T19:54:58.831437Z","steps":["trace[953584049] 'agreement among raft nodes before linearized reading' (duration: 2.000657517s)"],"step_count":1} Jun 20 19:55:01.424671 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:58.831644Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:56.830543Z","time spent":"2.001079539s","remote":"172.24.4.123:59934","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "} Jun 20 19:55:01.427537 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:59.050286Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078899,"retry-timeout":"500ms"} Jun 20 19:55:01.427537 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:59.113959Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:52.112842Z","time spent":"7.001101293s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jun 20 19:55:01.427537 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:59.540142Z","caller":"etcdserver/v3_server.go:932","msg":"timed out waiting for read index response (local node might have slow network)","timeout":"7s"} Jun 20 19:55:01.427537 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:59.540488Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"7.001014954s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/caliconodestatuses/\" range_end:\"/registry/crd.projectcalico.org/caliconodestatuses0\" count_only:true ","response":"","error":"etcdserver: request timed out"} Jun 20 19:55:01.427537 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:59.540621Z","caller":"traceutil/trace.go:171","msg":"trace[528240689] range","detail":"{range_begin:/registry/crd.projectcalico.org/caliconodestatuses/; range_end:/registry/crd.projectcalico.org/caliconodestatuses0; }","duration":"7.001287825s","start":"2025-06-20T19:54:52.539254Z","end":"2025-06-20T19:54:59.540542Z","steps":["trace[528240689] 'agreement among raft nodes before linearized reading' (duration: 7.001097047s)"],"step_count":1} Jun 20 19:55:01.428073 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:59.540704Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:52.539188Z","time spent":"7.00148762s","remote":"172.24.4.123:40144","response type":"/etcdserverpb.KV/Range","request count":0,"request size":108,"response count":0,"response size":0,"request content":"key:\"/registry/crd.projectcalico.org/caliconodestatuses/\" range_end:\"/registry/crd.projectcalico.org/caliconodestatuses0\" count_only:true "} Jun 20 19:55:01.428073 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:59.959947Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"5.001637722s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/leases/kube-system/kube-controller-manager\" limit:1 ","response":"","error":"context canceled"} Jun 20 19:55:01.428073 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:54:59.960140Z","caller":"traceutil/trace.go:171","msg":"trace[677932075] range","detail":"{range_begin:/registry/leases/kube-system/kube-controller-manager; range_end:; }","duration":"5.001927987s","start":"2025-06-20T19:54:54.958142Z","end":"2025-06-20T19:54:59.960070Z","steps":["trace[677932075] 'agreement among raft nodes before linearized reading' (duration: 5.001716339s)"],"step_count":1} Jun 20 19:55:01.428073 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:54:59.960290Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:54.958062Z","time spent":"5.002160475s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Range","request count":0,"request size":56,"response count":0,"response size":0,"request content":"key:\"/registry/leases/kube-system/kube-controller-manager\" limit:1 "} Jun 20 19:55:01.428073 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:00.040917Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078905,"retry-timeout":"500ms"} Jun 20 19:55:01.428503 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:00.374149Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"5.000727846s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/leases/kube-system/kube-scheduler\" limit:1 ","response":"","error":"context canceled"} Jun 20 19:55:01.428503 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:55:00.374260Z","caller":"traceutil/trace.go:171","msg":"trace[2144742354] range","detail":"{range_begin:/registry/leases/kube-system/kube-scheduler; range_end:; }","duration":"5.000933451s","start":"2025-06-20T19:54:55.373300Z","end":"2025-06-20T19:55:00.374234Z","steps":["trace[2144742354] 'agreement among raft nodes before linearized reading' (duration: 5.000776176s)"],"step_count":1} Jun 20 19:55:01.428503 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:00.374333Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:55.373265Z","time spent":"5.001048426s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Range","request count":0,"request size":47,"response count":0,"response size":0,"request content":"key:\"/registry/leases/kube-system/kube-scheduler\" limit:1 "} Jun 20 19:55:01.428503 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:00.541063Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078905,"retry-timeout":"500ms"} Jun 20 19:55:01.428503 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:00.831241Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.999241482s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context deadline exceeded"} Jun 20 19:55:01.428503 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:55:00.831462Z","caller":"traceutil/trace.go:171","msg":"trace[2129792537] range","detail":"{range_begin:/registry/health; range_end:; }","duration":"1.999535433s","start":"2025-06-20T19:54:58.831899Z","end":"2025-06-20T19:55:00.831434Z","steps":["trace[2129792537] 'agreement among raft nodes before linearized reading' (duration: 1.999290704s)"],"step_count":1} Jun 20 19:55:01.429157 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:00.831622Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:58.831789Z","time spent":"1.999726603s","remote":"172.24.4.123:59944","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "} Jun 20 19:55:01.429157 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:01.041671Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078905,"retry-timeout":"500ms"} Jun 20 19:55:01.429157 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:01.085655Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"4.001533398s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/clusterinformations/default\" limit:1 ","response":"","error":"context canceled"} Jun 20 19:55:01.429157 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:55:01.085871Z","caller":"traceutil/trace.go:171","msg":"trace[1762716130] range","detail":"{range_begin:/registry/crd.projectcalico.org/clusterinformations/default; range_end:; }","duration":"4.001953037s","start":"2025-06-20T19:54:57.083894Z","end":"2025-06-20T19:55:01.085847Z","steps":["trace[1762716130] 'agreement among raft nodes before linearized reading' (duration: 4.001652141s)"],"step_count":1} Jun 20 19:55:01.429157 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:01.085975Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:57.083863Z","time spent":"4.002089403s","remote":"172.24.4.123:46740","response type":"/etcdserverpb.KV/Range","request count":0,"request size":63,"response count":0,"response size":0,"request content":"key:\"/registry/crd.projectcalico.org/clusterinformations/default\" limit:1 "} Jun 20 19:55:01.429608 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:01.387947Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:53.111709Z","time spent":"8.276224481s","remote":"172.24.4.123:59980","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jun 20 19:55:01.429608 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:01.388290Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:52.054337Z","time spent":"9.333947407s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jun 20 19:55:01.429608 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:01.388507Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:52.188711Z","time spent":"9.199652908s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jun 20 19:55:01.543063 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:01.542283Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587887587127078905,"retry-timeout":"500ms"} Jun 20 19:55:01.778962 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:01.777780Z","caller":"wal/wal.go:805","msg":"slow fdatasync","took":"9.723027169s","expected-duration":"1s"} Jun 20 19:55:02.183022 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:02.182179Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"364.872111ms","expected-duration":"100ms","prefix":"","request":"header: txn: success:> failure:<>>","response":"size:16"} Jun 20 19:55:02.183697 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:55:02.183438Z","caller":"traceutil/trace.go:171","msg":"trace[907794455] transaction","detail":"{read_only:false; number_of_response:1; response_revision:1727; }","duration":"3.060082944s","start":"2025-06-20T19:54:59.123334Z","end":"2025-06-20T19:55:02.183417Z","steps":["trace[907794455] 'process raft request' (duration: 3.059945214s)"],"step_count":1} Jun 20 19:55:02.184651 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:02.183908Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:59.123293Z","time spent":"3.060198982s","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":69,"response count":0,"response size":747,"request content":"compare: success:> failure: >"} Jun 20 19:55:02.184651 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:55:02.184050Z","caller":"traceutil/trace.go:171","msg":"trace[491445510] transaction","detail":"{read_only:false; number_of_response:1; response_revision:1727; }","duration":"771.369176ms","start":"2025-06-20T19:55:01.412671Z","end":"2025-06-20T19:55:02.184040Z","steps":["trace[491445510] 'process raft request' (duration: 770.751647ms)"],"step_count":1} Jun 20 19:55:02.184651 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:02.184103Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:55:01.412648Z","time spent":"771.428797ms","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":71,"response count":0,"response size":673,"request content":"compare: success:> failure: >"} Jun 20 19:55:02.185188 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:55:02.184168Z","caller":"traceutil/trace.go:171","msg":"trace[891706537] transaction","detail":"{read_only:false; number_of_response:1; response_revision:1727; }","duration":"772.365157ms","start":"2025-06-20T19:55:01.411795Z","end":"2025-06-20T19:55:02.184160Z","steps":["trace[891706537] 'process raft request' (duration: 771.586805ms)"],"step_count":1} Jun 20 19:55:02.185188 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:02.184216Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:55:01.411756Z","time spent":"772.435689ms","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":49,"response count":0,"response size":586,"request content":"compare: success:> failure: >"} Jun 20 19:55:02.185188 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:55:02.184319Z","caller":"traceutil/trace.go:171","msg":"trace[1282492548] linearizableReadLoop","detail":"{readStateIndex:2181; appliedIndex:2174; }","duration":"2.643997303s","start":"2025-06-20T19:54:59.540301Z","end":"2025-06-20T19:55:02.184298Z","steps":["trace[1282492548] 'read index received' (duration: 2.238308738s)","trace[1282492548] 'applied index is now lower than readState.Index' (duration: 405.668146ms)"],"step_count":2} Jun 20 19:55:02.265626 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:02.263485Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"3.695203465s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/masterleases/172.24.4.123\" limit:1 ","response":"range_response_count:1 size:131"} Jun 20 19:55:02.265626 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:55:02.263806Z","caller":"traceutil/trace.go:171","msg":"trace[440557720] range","detail":"{range_begin:/registry/masterleases/172.24.4.123; range_end:; response_count:1; response_revision:1727; }","duration":"3.695638001s","start":"2025-06-20T19:54:58.568111Z","end":"2025-06-20T19:55:02.263749Z","steps":["trace[440557720] 'agreement among raft nodes before linearized reading' (duration: 3.616290576s)","trace[440557720] 'range keys from in-memory index tree' (duration: 78.856543ms)"],"step_count":2} Jun 20 19:55:02.265626 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:02.263955Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:58.568078Z","time spent":"3.695808251s","remote":"172.24.4.123:59956","response type":"/etcdserverpb.KV/Range","request count":0,"request size":39,"response count":1,"response size":155,"request content":"key:\"/registry/masterleases/172.24.4.123\" limit:1 "} Jun 20 19:55:02.265626 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:02.264216Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"4.622087716s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/ipamconfigs/\" range_end:\"/registry/crd.projectcalico.org/ipamconfigs0\" count_only:true ","response":"range_response_count:0 size:7"} Jun 20 19:55:02.265626 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:02.264232Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"7.968334s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/services/endpoints/calico-system/calico-typha\" limit:1 ","response":"range_response_count:1 size:788"} Jun 20 19:55:02.266449 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:55:02.264296Z","caller":"traceutil/trace.go:171","msg":"trace[725547597] range","detail":"{range_begin:/registry/crd.projectcalico.org/ipamconfigs/; range_end:/registry/crd.projectcalico.org/ipamconfigs0; response_count:0; response_revision:1727; }","duration":"4.622207793s","start":"2025-06-20T19:54:57.642043Z","end":"2025-06-20T19:55:02.264251Z","steps":["trace[725547597] 'agreement among raft nodes before linearized reading' (duration: 4.542360919s)","trace[725547597] 'count revisions from in-memory index tree' (duration: 79.76577ms)"],"step_count":2} Jun 20 19:55:02.266449 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:02.264348Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:57.642010Z","time spent":"4.622319653s","remote":"172.24.4.123:44292","response type":"/etcdserverpb.KV/Range","request count":0,"request size":94,"response count":1,"response size":31,"request content":"key:\"/registry/crd.projectcalico.org/ipamconfigs/\" range_end:\"/registry/crd.projectcalico.org/ipamconfigs0\" count_only:true "} Jun 20 19:55:02.266449 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:55:02.264351Z","caller":"traceutil/trace.go:171","msg":"trace[282244877] range","detail":"{range_begin:/registry/services/endpoints/calico-system/calico-typha; range_end:; response_count:1; response_revision:1727; }","duration":"7.968521934s","start":"2025-06-20T19:54:54.295800Z","end":"2025-06-20T19:55:02.264322Z","steps":["trace[282244877] 'agreement among raft nodes before linearized reading' (duration: 7.888575905s)","trace[282244877] 'range keys from in-memory index tree' (duration: 79.262315ms)"],"step_count":2} Jun 20 19:55:02.266449 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:02.264499Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"5.58728594s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/podtemplates/\" range_end:\"/registry/podtemplates0\" count_only:true ","response":"range_response_count:0 size:5"} Jun 20 19:55:02.267055 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:02.264558Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"8.624044587s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/validatingadmissionpolicies/\" range_end:\"/registry/validatingadmissionpolicies0\" count_only:true ","response":"range_response_count:0 size:5"} Jun 20 19:55:02.269935 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:55:02.264905Z","caller":"traceutil/trace.go:171","msg":"trace[1803549361] range","detail":"{range_begin:/registry/validatingadmissionpolicies/; range_end:/registry/validatingadmissionpolicies0; response_count:0; response_revision:1727; }","duration":"8.624204838s","start":"2025-06-20T19:54:53.640433Z","end":"2025-06-20T19:55:02.264638Z","steps":["trace[1803549361] 'agreement among raft nodes before linearized reading' (duration: 8.543949247s)","trace[1803549361] 'count revisions from in-memory index tree' (duration: 80.153478ms)"],"step_count":2} Jun 20 19:55:02.269935 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:02.265262Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:53.640397Z","time spent":"8.624836092s","remote":"172.24.4.123:60468","response type":"/etcdserverpb.KV/Range","request count":0,"request size":82,"response count":0,"response size":29,"request content":"key:\"/registry/validatingadmissionpolicies/\" range_end:\"/registry/validatingadmissionpolicies0\" count_only:true "} Jun 20 19:55:02.269935 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:02.266166Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"9.36283211s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/roles/\" range_end:\"/registry/roles0\" count_only:true ","response":"range_response_count:0 size:7"} Jun 20 19:55:02.269935 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:55:02.266276Z","caller":"traceutil/trace.go:171","msg":"trace[476158533] range","detail":"{range_begin:/registry/roles/; range_end:/registry/roles0; response_count:0; response_revision:1727; }","duration":"9.363016456s","start":"2025-06-20T19:54:52.903201Z","end":"2025-06-20T19:55:02.266218Z","steps":["trace[476158533] 'agreement among raft nodes before linearized reading' (duration: 9.281183653s)","trace[476158533] 'count revisions from in-memory index tree' (duration: 81.689113ms)"],"step_count":2} Jun 20 19:55:02.271781 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:02.266378Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:52.903171Z","time spent":"9.363144597s","remote":"172.24.4.123:60286","response type":"/etcdserverpb.KV/Range","request count":0,"request size":38,"response count":12,"response size":31,"request content":"key:\"/registry/roles/\" range_end:\"/registry/roles0\" count_only:true "} Jun 20 19:55:02.271781 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:02.266697Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"9.664239845s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/replicasets/\" range_end:\"/registry/replicasets0\" count_only:true ","response":"range_response_count:0 size:7"} Jun 20 19:55:02.271781 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:55:02.266791Z","caller":"traceutil/trace.go:171","msg":"trace[623309438] range","detail":"{range_begin:/registry/replicasets/; range_end:/registry/replicasets0; response_count:0; response_revision:1727; }","duration":"9.664314835s","start":"2025-06-20T19:54:52.602417Z","end":"2025-06-20T19:55:02.266732Z","steps":["trace[623309438] 'agreement among raft nodes before linearized reading' (duration: 9.581970602s)","trace[623309438] 'count revisions from in-memory index tree' (duration: 82.232694ms)"],"step_count":2} Jun 20 19:55:02.271781 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:02.266884Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:52.602402Z","time spent":"9.664422138s","remote":"172.24.4.123:60434","response type":"/etcdserverpb.KV/Range","request count":0,"request size":50,"response count":11,"response size":31,"request content":"key:\"/registry/replicasets/\" range_end:\"/registry/replicasets0\" count_only:true "} Jun 20 19:55:02.275728 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:55:02.264549Z","caller":"traceutil/trace.go:171","msg":"trace[2055607305] range","detail":"{range_begin:/registry/podtemplates/; range_end:/registry/podtemplates0; response_count:0; response_revision:1727; }","duration":"5.587390646s","start":"2025-06-20T19:54:56.677142Z","end":"2025-06-20T19:55:02.264532Z","steps":["trace[2055607305] 'agreement among raft nodes before linearized reading' (duration: 5.507264819s)","trace[2055607305] 'count revisions from in-memory index tree' (duration: 80.068399ms)"],"step_count":2} Jun 20 19:55:02.275728 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:02.267806Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:56.677089Z","time spent":"5.590664907s","remote":"172.24.4.123:60074","response type":"/etcdserverpb.KV/Range","request count":0,"request size":52,"response count":0,"response size":29,"request content":"key:\"/registry/podtemplates/\" range_end:\"/registry/podtemplates0\" count_only:true "} Jun 20 19:55:02.275728 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:02.268009Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.183929358s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/clusterinformations/\" range_end:\"/registry/crd.projectcalico.org/clusterinformations0\" count_only:true ","response":"range_response_count:0 size:7"} Jun 20 19:55:02.275728 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:55:02.268116Z","caller":"traceutil/trace.go:171","msg":"trace[784837478] range","detail":"{range_begin:/registry/crd.projectcalico.org/clusterinformations/; range_end:/registry/crd.projectcalico.org/clusterinformations0; response_count:0; response_revision:1727; }","duration":"1.18404248s","start":"2025-06-20T19:55:01.084022Z","end":"2025-06-20T19:55:02.268065Z","steps":["trace[784837478] 'agreement among raft nodes before linearized reading' (duration: 1.183941261s)"],"step_count":1} Jun 20 19:55:02.276472 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:02.268169Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:55:01.084007Z","time spent":"1.184142418s","remote":"172.24.4.123:46740","response type":"/etcdserverpb.KV/Range","request count":0,"request size":110,"response count":1,"response size":31,"request content":"key:\"/registry/crd.projectcalico.org/clusterinformations/\" range_end:\"/registry/crd.projectcalico.org/clusterinformations0\" count_only:true "} Jun 20 19:55:02.276472 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:02.268210Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.068158891s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/daemonsets/\" range_end:\"/registry/daemonsets0\" count_only:true ","response":"range_response_count:0 size:7"} Jun 20 19:55:02.276472 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:02.268290Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.41796633s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jun 20 19:55:02.276472 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:55:02.268333Z","caller":"traceutil/trace.go:171","msg":"trace[1746857659] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1727; }","duration":"1.418046331s","start":"2025-06-20T19:55:00.850273Z","end":"2025-06-20T19:55:02.268319Z","steps":["trace[1746857659] 'agreement among raft nodes before linearized reading' (duration: 1.417963354s)"],"step_count":1} Jun 20 19:55:02.276472 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:55:02.268309Z","caller":"traceutil/trace.go:171","msg":"trace[710756043] range","detail":"{range_begin:/registry/daemonsets/; range_end:/registry/daemonsets0; response_count:0; response_revision:1727; }","duration":"1.068392512s","start":"2025-06-20T19:55:01.199900Z","end":"2025-06-20T19:55:02.268292Z","steps":["trace[710756043] 'agreement among raft nodes before linearized reading' (duration: 1.068155346s)"],"step_count":1} Jun 20 19:55:02.277042 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:02.268373Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:55:00.850204Z","time spent":"1.418156478s","remote":"172.24.4.123:59934","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":29,"request content":"key:\"/registry/health\" "} Jun 20 19:55:02.277042 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:02.268407Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:55:01.199873Z","time spent":"1.068512126s","remote":"172.24.4.123:60418","response type":"/etcdserverpb.KV/Range","request count":0,"request size":48,"response count":3,"response size":31,"request content":"key:\"/registry/daemonsets/\" range_end:\"/registry/daemonsets0\" count_only:true "} Jun 20 19:55:02.277042 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:02.268637Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.431892839s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/servicecidrs/\" range_end:\"/registry/servicecidrs0\" count_only:true ","response":"range_response_count:0 size:7"} Jun 20 19:55:02.277042 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:55:02.268690Z","caller":"traceutil/trace.go:171","msg":"trace[1951262508] range","detail":"{range_begin:/registry/servicecidrs/; range_end:/registry/servicecidrs0; response_count:0; response_revision:1727; }","duration":"1.431992185s","start":"2025-06-20T19:55:00.836684Z","end":"2025-06-20T19:55:02.268676Z","steps":["trace[1951262508] 'agreement among raft nodes before linearized reading' (duration: 1.431849657s)"],"step_count":1} Jun 20 19:55:02.277042 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:02.268738Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:55:00.836658Z","time spent":"1.432060743s","remote":"172.24.4.123:60266","response type":"/etcdserverpb.KV/Range","request count":0,"request size":52,"response count":1,"response size":31,"request content":"key:\"/registry/servicecidrs/\" range_end:\"/registry/servicecidrs0\" count_only:true "} Jun 20 19:55:02.278123 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:02.268910Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.445250246s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/certificatesigningrequests/\" range_end:\"/registry/certificatesigningrequests0\" count_only:true ","response":"range_response_count:0 size:7"} Jun 20 19:55:02.278123 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:55:02.269011Z","caller":"traceutil/trace.go:171","msg":"trace[727714776] range","detail":"{range_begin:/registry/certificatesigningrequests/; range_end:/registry/certificatesigningrequests0; response_count:0; response_revision:1727; }","duration":"1.445448409s","start":"2025-06-20T19:55:00.823548Z","end":"2025-06-20T19:55:02.268997Z","steps":["trace[727714776] 'agreement among raft nodes before linearized reading' (duration: 1.445325718s)"],"step_count":1} Jun 20 19:55:02.278123 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:02.269087Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:55:00.823516Z","time spent":"1.445522086s","remote":"172.24.4.123:60202","response type":"/etcdserverpb.KV/Range","request count":0,"request size":80,"response count":2,"response size":31,"request content":"key:\"/registry/certificatesigningrequests/\" range_end:\"/registry/certificatesigningrequests0\" count_only:true "} Jun 20 19:55:02.278123 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:02.268949Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"6.589524034s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/clusterroles/\" range_end:\"/registry/clusterroles0\" count_only:true ","response":"range_response_count:0 size:7"} Jun 20 19:55:02.278427 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:55:02.269151Z","caller":"traceutil/trace.go:171","msg":"trace[2094964755] range","detail":"{range_begin:/registry/clusterroles/; range_end:/registry/clusterroles0; response_count:0; response_revision:1727; }","duration":"6.589788662s","start":"2025-06-20T19:54:55.679338Z","end":"2025-06-20T19:55:02.269127Z","steps":["trace[2094964755] 'agreement among raft nodes before linearized reading' (duration: 6.50507045s)","trace[2094964755] 'count revisions from in-memory index tree' (duration: 84.508558ms)"],"step_count":2} Jun 20 19:55:02.278427 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:02.269308Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.571840932s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/rolebindings/\" range_end:\"/registry/rolebindings0\" count_only:true ","response":"range_response_count:0 size:7"} Jun 20 19:55:02.278427 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:02.269323Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:55.679298Z","time spent":"6.589961876s","remote":"172.24.4.123:60300","response type":"/etcdserverpb.KV/Range","request count":0,"request size":52,"response count":80,"response size":31,"request content":"key:\"/registry/clusterroles/\" range_end:\"/registry/clusterroles0\" count_only:true "} Jun 20 19:55:02.278427 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:55:02.269357Z","caller":"traceutil/trace.go:171","msg":"trace[251173190] range","detail":"{range_begin:/registry/rolebindings/; range_end:/registry/rolebindings0; response_count:0; response_revision:1727; }","duration":"2.571952661s","start":"2025-06-20T19:54:59.697390Z","end":"2025-06-20T19:55:02.269343Z","steps":["trace[251173190] 'agreement among raft nodes before linearized reading' (duration: 2.571849528s)"],"step_count":1} Jun 20 19:55:02.278851 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:02.269404Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:59.697356Z","time spent":"2.5720316s","remote":"172.24.4.123:60292","response type":"/etcdserverpb.KV/Range","request count":0,"request size":52,"response count":16,"response size":31,"request content":"key:\"/registry/rolebindings/\" range_end:\"/registry/rolebindings0\" count_only:true "} Jun 20 19:55:02.278851 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:02.270678Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"7.17060499s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/volumeattachments/\" range_end:\"/registry/volumeattachments0\" count_only:true ","response":"range_response_count:0 size:5"} Jun 20 19:55:02.278851 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:55:02.270854Z","caller":"traceutil/trace.go:171","msg":"trace[1285349002] range","detail":"{range_begin:/registry/volumeattachments/; range_end:/registry/volumeattachments0; response_count:0; response_revision:1727; }","duration":"7.170776813s","start":"2025-06-20T19:54:55.099996Z","end":"2025-06-20T19:55:02.270773Z","steps":["trace[1285349002] 'agreement among raft nodes before linearized reading' (duration: 7.084378505s)","trace[1285349002] 'count revisions from in-memory index tree' (duration: 86.198633ms)"],"step_count":2} Jun 20 19:55:02.278851 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:02.270962Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:55.099961Z","time spent":"7.170980495s","remote":"172.24.4.123:60336","response type":"/etcdserverpb.KV/Range","request count":0,"request size":62,"response count":0,"response size":29,"request content":"key:\"/registry/volumeattachments/\" range_end:\"/registry/volumeattachments0\" count_only:true "} Jun 20 19:55:02.279228 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:02.271319Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"214.937135ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/tigerastatuses/\" range_end:\"/registry/operator.tigera.io/tigerastatuses0\" count_only:true ","response":"range_response_count:0 size:7"} Jun 20 19:55:02.279228 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:55:02.271663Z","caller":"traceutil/trace.go:171","msg":"trace[1113967757] range","detail":"{range_begin:/registry/operator.tigera.io/tigerastatuses/; range_end:/registry/operator.tigera.io/tigerastatuses0; response_count:0; response_revision:1727; }","duration":"215.419952ms","start":"2025-06-20T19:55:02.056224Z","end":"2025-06-20T19:55:02.271644Z","steps":["trace[1113967757] 'agreement among raft nodes before linearized reading' (duration: 214.970718ms)"],"step_count":1} Jun 20 19:55:02.279228 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:02.272861Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"441.705153ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/default/test-pod-1\" limit:1 ","response":"range_response_count:1 size:2344"} Jun 20 19:55:02.279228 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:55:02.273063Z","caller":"traceutil/trace.go:171","msg":"trace[1233236622] range","detail":"{range_begin:/registry/pods/default/test-pod-1; range_end:; response_count:1; response_revision:1727; }","duration":"441.893816ms","start":"2025-06-20T19:55:01.831078Z","end":"2025-06-20T19:55:02.272972Z","steps":["trace[1233236622] 'agreement among raft nodes before linearized reading' (duration: 441.435065ms)"],"step_count":1} Jun 20 19:55:02.279632 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:02.273376Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:55:01.831007Z","time spent":"442.338181ms","remote":"172.24.4.123:60136","response type":"/etcdserverpb.KV/Range","request count":0,"request size":37,"response count":1,"response size":2368,"request content":"key:\"/registry/pods/default/test-pod-1\" limit:1 "} Jun 20 19:55:02.279632 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:02.263511Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"5.445784708s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/events/kube-system/kube-apiserver-ci-4344-1-0-0-4524070979.novalocal.184ad8401ddbdf71\" limit:1 ","response":"range_response_count:1 size:905"} Jun 20 19:55:02.279632 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:55:02.274063Z","caller":"traceutil/trace.go:171","msg":"trace[932327683] range","detail":"{range_begin:/registry/events/kube-system/kube-apiserver-ci-4344-1-0-0-4524070979.novalocal.184ad8401ddbdf71; range_end:; response_count:1; response_revision:1727; }","duration":"5.456422469s","start":"2025-06-20T19:54:56.817607Z","end":"2025-06-20T19:55:02.274029Z","steps":["trace[932327683] 'agreement among raft nodes before linearized reading' (duration: 5.366792351s)","trace[932327683] 'range keys from in-memory index tree' (duration: 78.781803ms)"],"step_count":2} Jun 20 19:55:02.279632 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:02.274186Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:56.817538Z","time spent":"5.456610492s","remote":"172.24.4.123:60016","response type":"/etcdserverpb.KV/Range","request count":0,"request size":99,"response count":1,"response size":929,"request content":"key:\"/registry/events/kube-system/kube-apiserver-ci-4344-1-0-0-4524070979.novalocal.184ad8401ddbdf71\" limit:1 "} Jun 20 19:55:02.280069 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:02.264463Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:54:54.295777Z","time spent":"7.968664211s","remote":"172.24.4.123:60126","response type":"/etcdserverpb.KV/Range","request count":0,"request size":59,"response count":1,"response size":812,"request content":"key:\"/registry/services/endpoints/calico-system/calico-typha\" limit:1 "} Jun 20 19:55:02.280069 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:02.274294Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"774.855472ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/kube-system/kube-scheduler-ci-4344-1-0-0-4524070979.novalocal\" limit:1 ","response":"range_response_count:1 size:4982"} Jun 20 19:55:02.280069 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:55:02.274477Z","caller":"traceutil/trace.go:171","msg":"trace[408136095] range","detail":"{range_begin:/registry/pods/kube-system/kube-scheduler-ci-4344-1-0-0-4524070979.novalocal; range_end:; response_count:1; response_revision:1727; }","duration":"775.087107ms","start":"2025-06-20T19:55:01.499292Z","end":"2025-06-20T19:55:02.274379Z","steps":["trace[408136095] 'agreement among raft nodes before linearized reading' (duration: 774.779429ms)"],"step_count":1} Jun 20 19:55:02.280069 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:02.274674Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:55:01.499256Z","time spent":"775.261344ms","remote":"172.24.4.123:60136","response type":"/etcdserverpb.KV/Range","request count":0,"request size":80,"response count":1,"response size":5006,"request content":"key:\"/registry/pods/kube-system/kube-scheduler-ci-4344-1-0-0-4524070979.novalocal\" limit:1 "} Jun 20 19:55:02.578511 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:02.577345Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:55:02.275261Z","time spent":"302.035436ms","remote":"172.24.4.123:59956","response type":"/etcdserverpb.Lease/LeaseGrant","request count":-1,"request size":-1,"response count":-1,"response size":-1,"request content":""} Jun 20 19:55:02.582183 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:55:02.578355Z","caller":"traceutil/trace.go:171","msg":"trace[1362873197] transaction","detail":"{read_only:false; response_revision:1730; number_of_response:1; }","duration":"285.499298ms","start":"2025-06-20T19:55:02.292818Z","end":"2025-06-20T19:55:02.578318Z","steps":["trace[1362873197] 'process raft request' (duration: 284.998648ms)"],"step_count":1} Jun 20 19:55:02.582183 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:55:02.578757Z","caller":"traceutil/trace.go:171","msg":"trace[559199553] transaction","detail":"{read_only:false; response_revision:1728; number_of_response:1; }","duration":"294.856883ms","start":"2025-06-20T19:55:02.283875Z","end":"2025-06-20T19:55:02.578732Z","steps":["trace[559199553] 'process raft request' (duration: 293.282386ms)"],"step_count":1} Jun 20 19:55:02.582183 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:55:02.578146Z","caller":"traceutil/trace.go:171","msg":"trace[489714661] linearizableReadLoop","detail":"{readStateIndex:2186; appliedIndex:2182; }","duration":"289.927555ms","start":"2025-06-20T19:55:02.288186Z","end":"2025-06-20T19:55:02.578114Z","steps":["trace[489714661] 'read index received' (duration: 258.910117ms)","trace[489714661] 'applied index is now lower than readState.Index' (duration: 31.016397ms)"],"step_count":2} Jun 20 19:55:02.582183 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:02.579399Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"291.180368ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jun 20 19:55:02.582183 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:55:02.579495Z","caller":"traceutil/trace.go:171","msg":"trace[716306741] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1732; }","duration":"291.306825ms","start":"2025-06-20T19:55:02.288138Z","end":"2025-06-20T19:55:02.579445Z","steps":["trace[716306741] 'agreement among raft nodes before linearized reading' (duration: 290.816605ms)"],"step_count":1} Jun 20 19:55:02.585166 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:55:02.581533Z","caller":"traceutil/trace.go:171","msg":"trace[392662144] transaction","detail":"{read_only:false; response_revision:1729; number_of_response:1; }","duration":"293.314808ms","start":"2025-06-20T19:55:02.288142Z","end":"2025-06-20T19:55:02.581457Z","steps":["trace[392662144] 'process raft request' (duration: 289.470366ms)"],"step_count":1} Jun 20 19:55:02.585166 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:55:02.583477Z","caller":"traceutil/trace.go:171","msg":"trace[542966694] transaction","detail":"{read_only:false; response_revision:1731; number_of_response:1; }","duration":"286.601557ms","start":"2025-06-20T19:55:02.296847Z","end":"2025-06-20T19:55:02.583448Z","steps":["trace[542966694] 'process raft request' (duration: 281.079195ms)"],"step_count":1} Jun 20 19:55:02.598619 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:55:02.597510Z","caller":"traceutil/trace.go:171","msg":"trace[634816150] transaction","detail":"{read_only:false; response_revision:1732; number_of_response:1; }","duration":"296.673867ms","start":"2025-06-20T19:55:02.300797Z","end":"2025-06-20T19:55:02.597471Z","steps":["trace[634816150] 'process raft request' (duration: 277.201442ms)"],"step_count":1} Jun 20 19:55:03.765721 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:55:03.764961Z","caller":"traceutil/trace.go:171","msg":"trace[1117223898] transaction","detail":"{read_only:false; response_revision:1737; number_of_response:1; }","duration":"236.06215ms","start":"2025-06-20T19:55:03.528856Z","end":"2025-06-20T19:55:03.764918Z","steps":["trace[1117223898] 'process raft request' (duration: 235.769951ms)"],"step_count":1} Jun 20 19:55:03.889105 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:55:03.887721Z","caller":"traceutil/trace.go:171","msg":"trace[698327472] linearizableReadLoop","detail":"{readStateIndex:2195; appliedIndex:2194; }","duration":"138.063676ms","start":"2025-06-20T19:55:03.749627Z","end":"2025-06-20T19:55:03.887691Z","steps":["trace[698327472] 'read index received' (duration: 17.25543ms)","trace[698327472] 'applied index is now lower than readState.Index' (duration: 120.806854ms)"],"step_count":2} Jun 20 19:55:03.889105 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:55:03.887918Z","caller":"traceutil/trace.go:171","msg":"trace[1048890984] transaction","detail":"{read_only:false; response_revision:1738; number_of_response:1; }","duration":"342.741489ms","start":"2025-06-20T19:55:03.545119Z","end":"2025-06-20T19:55:03.887861Z","steps":["trace[1048890984] 'process raft request' (duration: 279.625331ms)","trace[1048890984] 'compare' (duration: 62.692011ms)"],"step_count":2} Jun 20 19:55:03.889105 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:03.888131Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:55:03.545094Z","time spent":"342.859392ms","remote":"172.24.4.123:60136","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":4429,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jun 20 19:55:03.890344 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:03.888446Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"138.874129ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/clusterinformations/default\" limit:1 ","response":"range_response_count:1 size:886"} Jun 20 19:55:03.890344 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:55:03.888488Z","caller":"traceutil/trace.go:171","msg":"trace[289360484] range","detail":"{range_begin:/registry/crd.projectcalico.org/clusterinformations/default; range_end:; response_count:1; response_revision:1738; }","duration":"138.967854ms","start":"2025-06-20T19:55:03.749509Z","end":"2025-06-20T19:55:03.888476Z","steps":["trace[289360484] 'agreement among raft nodes before linearized reading' (duration: 138.72058ms)"],"step_count":1} Jun 20 19:55:03.890344 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:03.888760Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"129.654361ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/leases/kube-system/kube-controller-manager\" limit:1 ","response":"range_response_count:1 size:531"} Jun 20 19:55:03.890344 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:55:03.888801Z","caller":"traceutil/trace.go:171","msg":"trace[1514508334] range","detail":"{range_begin:/registry/leases/kube-system/kube-controller-manager; range_end:; response_count:1; response_revision:1738; }","duration":"129.864115ms","start":"2025-06-20T19:55:03.758927Z","end":"2025-06-20T19:55:03.888791Z","steps":["trace[1514508334] 'agreement among raft nodes before linearized reading' (duration: 129.624665ms)"],"step_count":1} Jun 20 19:55:04.136422 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:55:04.135657Z","caller":"traceutil/trace.go:171","msg":"trace[1573119141] transaction","detail":"{read_only:false; number_of_response:0; response_revision:1738; }","duration":"143.220569ms","start":"2025-06-20T19:55:03.992304Z","end":"2025-06-20T19:55:04.135525Z","steps":["trace[1573119141] 'process raft request' (duration: 143.044749ms)"],"step_count":1} Jun 20 19:55:04.153065 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:55:04.152119Z","caller":"traceutil/trace.go:171","msg":"trace[761015489] transaction","detail":"{read_only:false; response_revision:1739; number_of_response:1; }","duration":"146.600077ms","start":"2025-06-20T19:55:04.005489Z","end":"2025-06-20T19:55:04.152089Z","steps":["trace[761015489] 'process raft request' (duration: 145.719262ms)"],"step_count":1} Jun 20 19:55:06.543969 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:06.541142Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.616131619s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jun 20 19:55:06.543969 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:55:06.541361Z","caller":"traceutil/trace.go:171","msg":"trace[1061910265] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1740; }","duration":"1.616428876s","start":"2025-06-20T19:55:04.924895Z","end":"2025-06-20T19:55:06.541324Z","steps":["trace[1061910265] 'range keys from in-memory index tree' (duration: 1.61598371s)"],"step_count":1} Jun 20 19:55:06.543969 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:06.541460Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:55:04.924870Z","time spent":"1.616541147s","remote":"172.24.4.123:59934","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":29,"request content":"key:\"/registry/health\" "} Jun 20 19:55:06.543969 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:06.541146Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"726.090655ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jun 20 19:55:06.543969 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:55:06.541561Z","caller":"traceutil/trace.go:171","msg":"trace[17009075] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1740; }","duration":"726.613307ms","start":"2025-06-20T19:55:05.814918Z","end":"2025-06-20T19:55:06.541531Z","steps":["trace[17009075] 'range keys from in-memory index tree' (duration: 725.859681ms)"],"step_count":1} Jun 20 19:55:06.547161 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:06.541683Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:55:05.814887Z","time spent":"726.770632ms","remote":"172.24.4.123:59944","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":29,"request content":"key:\"/registry/health\" "} Jun 20 19:55:06.547161 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:06.541259Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"787.174265ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/persistentvolumeclaims/\" range_end:\"/registry/persistentvolumeclaims0\" count_only:true ","response":"range_response_count:0 size:7"} Jun 20 19:55:06.547161 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:55:06.541853Z","caller":"traceutil/trace.go:171","msg":"trace[321117968] range","detail":"{range_begin:/registry/persistentvolumeclaims/; range_end:/registry/persistentvolumeclaims0; response_count:0; response_revision:1740; }","duration":"787.770284ms","start":"2025-06-20T19:55:05.754062Z","end":"2025-06-20T19:55:06.541832Z","steps":["trace[321117968] 'count revisions from in-memory index tree' (duration: 787.104494ms)"],"step_count":1} Jun 20 19:55:06.547161 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:06.541903Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:55:05.754011Z","time spent":"787.871315ms","remote":"172.24.4.123:60110","response type":"/etcdserverpb.KV/Range","request count":0,"request size":72,"response count":1,"response size":31,"request content":"key:\"/registry/persistentvolumeclaims/\" range_end:\"/registry/persistentvolumeclaims0\" count_only:true "} Jun 20 19:55:06.957114 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:55:06.944006Z","caller":"traceutil/trace.go:171","msg":"trace[1812740298] transaction","detail":"{read_only:false; response_revision:1742; number_of_response:1; }","duration":"100.038895ms","start":"2025-06-20T19:55:06.843851Z","end":"2025-06-20T19:55:06.943890Z","steps":["trace[1812740298] 'process raft request' (duration: 22.177946ms)","trace[1812740298] 'compare' (duration: 77.580803ms)"],"step_count":2} Jun 20 19:55:06.960188 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:55:06.957362Z","caller":"traceutil/trace.go:171","msg":"trace[45797924] transaction","detail":"{read_only:false; response_revision:1743; number_of_response:1; }","duration":"109.440593ms","start":"2025-06-20T19:55:06.847888Z","end":"2025-06-20T19:55:06.957329Z","steps":["trace[45797924] 'process raft request' (duration: 95.945856ms)"],"step_count":1} Jun 20 19:55:07.060940 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:07.060130Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"102.869842ms","expected-duration":"100ms","prefix":"","request":"header: lease_revoke:","response":"size:29"} Jun 20 19:55:07.060940 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:55:07.060370Z","caller":"traceutil/trace.go:171","msg":"trace[478778662] linearizableReadLoop","detail":"{readStateIndex:2204; appliedIndex:2201; }","duration":"141.099906ms","start":"2025-06-20T19:55:06.919249Z","end":"2025-06-20T19:55:07.060349Z","steps":["trace[478778662] 'read index received' (duration: 20.697765ms)","trace[478778662] 'applied index is now lower than readState.Index' (duration: 120.400548ms)"],"step_count":2} Jun 20 19:55:07.060940 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:07.060616Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"141.303649ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/serviceaccounts/kube-system/replication-controller\" limit:1 ","response":"range_response_count:1 size:209"} Jun 20 19:55:07.060940 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:55:07.060679Z","caller":"traceutil/trace.go:171","msg":"trace[1297261747] range","detail":"{range_begin:/registry/serviceaccounts/kube-system/replication-controller; range_end:; response_count:1; response_revision:1743; }","duration":"141.460141ms","start":"2025-06-20T19:55:06.919204Z","end":"2025-06-20T19:55:07.060664Z","steps":["trace[1297261747] 'agreement among raft nodes before linearized reading' (duration: 141.257882ms)"],"step_count":1} Jun 20 19:55:07.877034 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:07.876411Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"305.846722ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/minions\" limit:1 ","response":"range_response_count:0 size:5"} Jun 20 19:55:07.877034 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:55:07.876517Z","caller":"traceutil/trace.go:171","msg":"trace[299056961] range","detail":"{range_begin:/registry/minions; range_end:; response_count:0; response_revision:1744; }","duration":"306.016181ms","start":"2025-06-20T19:55:07.570477Z","end":"2025-06-20T19:55:07.876493Z","steps":["trace[299056961] 'range keys from in-memory index tree' (duration: 305.671814ms)"],"step_count":1} Jun 20 19:55:07.888058 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:07.877362Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:55:07.570450Z","time spent":"306.110308ms","remote":"172.24.4.123:60130","response type":"/etcdserverpb.KV/Range","request count":0,"request size":21,"response count":0,"response size":29,"request content":"key:\"/registry/minions\" limit:1 "} Jun 20 19:55:07.888058 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:55:07.885404Z","caller":"traceutil/trace.go:171","msg":"trace[954734260] transaction","detail":"{read_only:false; response_revision:1745; number_of_response:1; }","duration":"312.572645ms","start":"2025-06-20T19:55:07.572619Z","end":"2025-06-20T19:55:07.885192Z","steps":["trace[954734260] 'process raft request' (duration: 298.714837ms)"],"step_count":1} Jun 20 19:55:07.888825 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:07.888353Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:55:07.572536Z","time spent":"314.292645ms","remote":"172.24.4.123:60016","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":732,"response count":0,"response size":40,"request content":"compare: success:> failure:<>"} Jun 20 19:55:07.889494 etcd-wrapper[1803]: {"level":"info","ts":"2025-06-20T19:55:07.888939Z","caller":"traceutil/trace.go:171","msg":"trace[2113253283] transaction","detail":"{read_only:false; response_revision:1746; number_of_response:1; }","duration":"315.262357ms","start":"2025-06-20T19:55:07.573619Z","end":"2025-06-20T19:55:07.888881Z","steps":["trace[2113253283] 'process raft request' (duration: 303.658973ms)"],"step_count":1} Jun 20 19:55:07.890953 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:07.890481Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:55:07.578150Z","time spent":"312.324328ms","remote":"172.24.4.123:60488","response type":"/etcdserverpb.Lease/LeaseGrant","request count":-1,"request size":-1,"response count":-1,"response size":-1,"request content":""} Jun 20 19:55:07.891654 etcd-wrapper[1803]: {"level":"warn","ts":"2025-06-20T19:55:07.891267Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-06-20T19:55:07.573545Z","time spent":"315.46129ms","remote":"172.24.4.123:60214","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":490,"response count":0,"response size":40,"request content":"compare: success:> failure: >"}