Jul 15 10:53:03.966314 kernel: Linux version 6.6.98-flatcar (build@pony-truck.infra.kinvolk.io) (x86_64-cros-linux-gnu-gcc (Gentoo Hardened 14.2.1_p20241221 p7) 14.2.1 20241221, GNU ld (Gentoo 2.43 p3) 2.43.1) #1 SMP PREEMPT_DYNAMIC Tue Jul 15 09:10:16 -00 2025 Jul 15 10:53:03.966343 kernel: Command line: BOOT_IMAGE=/flatcar/vmlinuz-a mount.usr=/dev/mapper/usr verity.usr=PARTUUID=7130c94a-213a-4e5a-8e26-6cce9662f132 rootflags=rw mount.usrflags=ro consoleblank=0 root=LABEL=ROOT console=ttyS0,115200n8 console=tty0 flatcar.first_boot=detected flatcar.oem.id=openstack flatcar.autologin verity.usrhash=5af33b6d30f308631e4a91e3c355c3478a77b3d8f9ea9ec9a25f78d7867f681f Jul 15 10:53:03.966355 kernel: BIOS-provided physical RAM map: Jul 15 10:53:03.966364 kernel: BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable Jul 15 10:53:03.966372 kernel: BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved Jul 15 10:53:03.966383 kernel: BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved Jul 15 10:53:03.966393 kernel: BIOS-e820: [mem 0x0000000000100000-0x00000000bffdcfff] usable Jul 15 10:53:03.966402 kernel: BIOS-e820: [mem 0x00000000bffdd000-0x00000000bfffffff] reserved Jul 15 10:53:03.966410 kernel: BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved Jul 15 10:53:03.966419 kernel: BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved Jul 15 10:53:03.966427 kernel: BIOS-e820: [mem 0x0000000100000000-0x000000013fffffff] usable Jul 15 10:53:03.966436 kernel: BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved Jul 15 10:53:03.966445 kernel: NX (Execute Disable) protection: active Jul 15 10:53:03.966454 kernel: APIC: Static calls initialized Jul 15 10:53:03.966466 kernel: SMBIOS 3.0.0 present. Jul 15 10:53:03.966475 kernel: DMI: OpenStack Foundation OpenStack Nova, BIOS 1.16.3-debian-1.16.3-2 04/01/2014 Jul 15 10:53:03.966484 kernel: Hypervisor detected: KVM Jul 15 10:53:03.966493 kernel: kvm-clock: Using msrs 4b564d01 and 4b564d00 Jul 15 10:53:03.966502 kernel: kvm-clock: using sched offset of 3661539753 cycles Jul 15 10:53:03.966513 kernel: clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns Jul 15 10:53:03.966523 kernel: tsc: Detected 1996.249 MHz processor Jul 15 10:53:03.966533 kernel: e820: update [mem 0x00000000-0x00000fff] usable ==> reserved Jul 15 10:53:03.966542 kernel: e820: remove [mem 0x000a0000-0x000fffff] usable Jul 15 10:53:03.966552 kernel: last_pfn = 0x140000 max_arch_pfn = 0x400000000 Jul 15 10:53:03.966562 kernel: MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs Jul 15 10:53:03.966571 kernel: x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT Jul 15 10:53:03.966580 kernel: last_pfn = 0xbffdd max_arch_pfn = 0x400000000 Jul 15 10:53:03.966590 kernel: ACPI: Early table checksum verification disabled Jul 15 10:53:03.966601 kernel: ACPI: RSDP 0x00000000000F51E0 000014 (v00 BOCHS ) Jul 15 10:53:03.966611 kernel: ACPI: RSDT 0x00000000BFFE1B65 000030 (v01 BOCHS BXPC 00000001 BXPC 00000001) Jul 15 10:53:03.966620 kernel: ACPI: FACP 0x00000000BFFE1A49 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) Jul 15 10:53:03.966630 kernel: ACPI: DSDT 0x00000000BFFE0040 001A09 (v01 BOCHS BXPC 00000001 BXPC 00000001) Jul 15 10:53:03.966639 kernel: ACPI: FACS 0x00000000BFFE0000 000040 Jul 15 10:53:03.966648 kernel: ACPI: APIC 0x00000000BFFE1ABD 000080 (v03 BOCHS BXPC 00000001 BXPC 00000001) Jul 15 10:53:03.966658 kernel: ACPI: WAET 0x00000000BFFE1B3D 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) Jul 15 10:53:03.966667 kernel: ACPI: Reserving FACP table memory at [mem 0xbffe1a49-0xbffe1abc] Jul 15 10:53:03.966676 kernel: ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe1a48] Jul 15 10:53:03.966687 kernel: ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] Jul 15 10:53:03.966697 kernel: ACPI: Reserving APIC table memory at [mem 0xbffe1abd-0xbffe1b3c] Jul 15 10:53:03.966706 kernel: ACPI: Reserving WAET table memory at [mem 0xbffe1b3d-0xbffe1b64] Jul 15 10:53:03.966719 kernel: No NUMA configuration found Jul 15 10:53:03.966728 kernel: Faking a node at [mem 0x0000000000000000-0x000000013fffffff] Jul 15 10:53:03.966738 kernel: NODE_DATA(0) allocated [mem 0x13fffa000-0x13fffffff] Jul 15 10:53:03.966750 kernel: Zone ranges: Jul 15 10:53:03.966760 kernel: DMA [mem 0x0000000000001000-0x0000000000ffffff] Jul 15 10:53:03.966769 kernel: DMA32 [mem 0x0000000001000000-0x00000000ffffffff] Jul 15 10:53:03.966779 kernel: Normal [mem 0x0000000100000000-0x000000013fffffff] Jul 15 10:53:03.966788 kernel: Movable zone start for each node Jul 15 10:53:03.966798 kernel: Early memory node ranges Jul 15 10:53:03.966807 kernel: node 0: [mem 0x0000000000001000-0x000000000009efff] Jul 15 10:53:03.966817 kernel: node 0: [mem 0x0000000000100000-0x00000000bffdcfff] Jul 15 10:53:03.966829 kernel: node 0: [mem 0x0000000100000000-0x000000013fffffff] Jul 15 10:53:03.966838 kernel: Initmem setup node 0 [mem 0x0000000000001000-0x000000013fffffff] Jul 15 10:53:03.966848 kernel: On node 0, zone DMA: 1 pages in unavailable ranges Jul 15 10:53:03.966857 kernel: On node 0, zone DMA: 97 pages in unavailable ranges Jul 15 10:53:03.966867 kernel: On node 0, zone Normal: 35 pages in unavailable ranges Jul 15 10:53:03.966877 kernel: ACPI: PM-Timer IO Port: 0x608 Jul 15 10:53:03.966887 kernel: ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) Jul 15 10:53:03.966896 kernel: IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 Jul 15 10:53:03.966906 kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) Jul 15 10:53:03.966917 kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) Jul 15 10:53:03.966927 kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) Jul 15 10:53:03.966937 kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) Jul 15 10:53:03.966946 kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) Jul 15 10:53:03.966956 kernel: ACPI: Using ACPI (MADT) for SMP configuration information Jul 15 10:53:03.966966 kernel: smpboot: Allowing 2 CPUs, 0 hotplug CPUs Jul 15 10:53:03.966976 kernel: kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() Jul 15 10:53:03.966985 kernel: [mem 0xc0000000-0xfeffbfff] available for PCI devices Jul 15 10:53:03.966995 kernel: Booting paravirtualized kernel on KVM Jul 15 10:53:03.967006 kernel: clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns Jul 15 10:53:03.967016 kernel: setup_percpu: NR_CPUS:512 nr_cpumask_bits:2 nr_cpu_ids:2 nr_node_ids:1 Jul 15 10:53:03.967026 kernel: percpu: Embedded 58 pages/cpu s197096 r8192 d32280 u1048576 Jul 15 10:53:03.967036 kernel: pcpu-alloc: s197096 r8192 d32280 u1048576 alloc=1*2097152 Jul 15 10:53:03.967045 kernel: pcpu-alloc: [0] 0 1 Jul 15 10:53:03.967054 kernel: kvm-guest: PV spinlocks disabled, no host support Jul 15 10:53:03.967066 kernel: Kernel command line: rootflags=rw mount.usrflags=ro BOOT_IMAGE=/flatcar/vmlinuz-a mount.usr=/dev/mapper/usr verity.usr=PARTUUID=7130c94a-213a-4e5a-8e26-6cce9662f132 rootflags=rw mount.usrflags=ro consoleblank=0 root=LABEL=ROOT console=ttyS0,115200n8 console=tty0 flatcar.first_boot=detected flatcar.oem.id=openstack flatcar.autologin verity.usrhash=5af33b6d30f308631e4a91e3c355c3478a77b3d8f9ea9ec9a25f78d7867f681f Jul 15 10:53:03.967076 kernel: Unknown kernel command line parameters "BOOT_IMAGE=/flatcar/vmlinuz-a", will be passed to user space. Jul 15 10:53:03.967088 kernel: Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) Jul 15 10:53:03.967097 kernel: Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) Jul 15 10:53:03.967135 kernel: Fallback order for Node 0: 0 Jul 15 10:53:03.967145 kernel: Built 1 zonelists, mobility grouping on. Total pages: 1031901 Jul 15 10:53:03.967154 kernel: Policy zone: Normal Jul 15 10:53:03.967180 kernel: mem auto-init: stack:off, heap alloc:off, heap free:off Jul 15 10:53:03.967190 kernel: software IO TLB: area num 2. Jul 15 10:53:03.967200 kernel: Memory: 3964168K/4193772K available (14336K kernel code, 2295K rwdata, 22872K rodata, 43504K init, 1572K bss, 229344K reserved, 0K cma-reserved) Jul 15 10:53:03.967209 kernel: SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=2, Nodes=1 Jul 15 10:53:03.967224 kernel: ftrace: allocating 37944 entries in 149 pages Jul 15 10:53:03.967234 kernel: ftrace: allocated 149 pages with 4 groups Jul 15 10:53:03.967243 kernel: Dynamic Preempt: voluntary Jul 15 10:53:03.967252 kernel: rcu: Preemptible hierarchical RCU implementation. Jul 15 10:53:03.967262 kernel: rcu: RCU event tracing is enabled. Jul 15 10:53:03.967271 kernel: rcu: RCU restricting CPUs from NR_CPUS=512 to nr_cpu_ids=2. Jul 15 10:53:03.967280 kernel: Trampoline variant of Tasks RCU enabled. Jul 15 10:53:03.967290 kernel: Rude variant of Tasks RCU enabled. Jul 15 10:53:03.967299 kernel: Tracing variant of Tasks RCU enabled. Jul 15 10:53:03.967309 kernel: rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. Jul 15 10:53:03.967319 kernel: rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=2 Jul 15 10:53:03.967328 kernel: NR_IRQS: 33024, nr_irqs: 440, preallocated irqs: 16 Jul 15 10:53:03.967337 kernel: rcu: srcu_init: Setting srcu_struct sizes based on contention. Jul 15 10:53:03.967346 kernel: Console: colour VGA+ 80x25 Jul 15 10:53:03.967355 kernel: printk: console [tty0] enabled Jul 15 10:53:03.967364 kernel: printk: console [ttyS0] enabled Jul 15 10:53:03.967373 kernel: ACPI: Core revision 20230628 Jul 15 10:53:03.967382 kernel: APIC: Switch to symmetric I/O mode setup Jul 15 10:53:03.967391 kernel: x2apic enabled Jul 15 10:53:03.967403 kernel: APIC: Switched APIC routing to: physical x2apic Jul 15 10:53:03.967412 kernel: ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 Jul 15 10:53:03.967421 kernel: tsc: Marking TSC unstable due to TSCs unsynchronized Jul 15 10:53:03.967430 kernel: Calibrating delay loop (skipped) preset value.. 3992.49 BogoMIPS (lpj=1996249) Jul 15 10:53:03.967439 kernel: Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 Jul 15 10:53:03.967448 kernel: Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0 Jul 15 10:53:03.967457 kernel: Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization Jul 15 10:53:03.967467 kernel: Spectre V2 : Mitigation: Retpolines Jul 15 10:53:03.967476 kernel: Spectre V2 : Spectre v2 / SpectreRSB: Filling RSB on context switch and VMEXIT Jul 15 10:53:03.967487 kernel: Speculative Store Bypass: Vulnerable Jul 15 10:53:03.967496 kernel: x86/fpu: x87 FPU will use FXSAVE Jul 15 10:53:03.967504 kernel: Freeing SMP alternatives memory: 32K Jul 15 10:53:03.967514 kernel: pid_max: default: 32768 minimum: 301 Jul 15 10:53:03.967530 kernel: LSM: initializing lsm=lockdown,capability,landlock,selinux,integrity Jul 15 10:53:03.967541 kernel: landlock: Up and running. Jul 15 10:53:03.967550 kernel: SELinux: Initializing. Jul 15 10:53:03.967560 kernel: Mount-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) Jul 15 10:53:03.967569 kernel: Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) Jul 15 10:53:03.967579 kernel: smpboot: CPU0: AMD Intel Core i7 9xx (Nehalem Class Core i7) (family: 0x6, model: 0x1a, stepping: 0x3) Jul 15 10:53:03.967588 kernel: RCU Tasks: Setting shift to 1 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=2. Jul 15 10:53:03.967600 kernel: RCU Tasks Rude: Setting shift to 1 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=2. Jul 15 10:53:03.967610 kernel: RCU Tasks Trace: Setting shift to 1 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=2. Jul 15 10:53:03.967619 kernel: Performance Events: AMD PMU driver. Jul 15 10:53:03.967628 kernel: ... version: 0 Jul 15 10:53:03.967638 kernel: ... bit width: 48 Jul 15 10:53:03.967649 kernel: ... generic registers: 4 Jul 15 10:53:03.967658 kernel: ... value mask: 0000ffffffffffff Jul 15 10:53:03.967668 kernel: ... max period: 00007fffffffffff Jul 15 10:53:03.967677 kernel: ... fixed-purpose events: 0 Jul 15 10:53:03.967686 kernel: ... event mask: 000000000000000f Jul 15 10:53:03.967696 kernel: signal: max sigframe size: 1440 Jul 15 10:53:03.967705 kernel: rcu: Hierarchical SRCU implementation. Jul 15 10:53:03.967715 kernel: rcu: Max phase no-delay instances is 400. Jul 15 10:53:03.967724 kernel: smp: Bringing up secondary CPUs ... Jul 15 10:53:03.967736 kernel: smpboot: x86: Booting SMP configuration: Jul 15 10:53:03.967745 kernel: .... node #0, CPUs: #1 Jul 15 10:53:03.967754 kernel: smp: Brought up 1 node, 2 CPUs Jul 15 10:53:03.967764 kernel: smpboot: Max logical packages: 2 Jul 15 10:53:03.967773 kernel: smpboot: Total of 2 processors activated (7984.99 BogoMIPS) Jul 15 10:53:03.967783 kernel: devtmpfs: initialized Jul 15 10:53:03.967792 kernel: x86/mm: Memory block size: 128MB Jul 15 10:53:03.967802 kernel: clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns Jul 15 10:53:03.967811 kernel: futex hash table entries: 512 (order: 3, 32768 bytes, linear) Jul 15 10:53:03.967821 kernel: pinctrl core: initialized pinctrl subsystem Jul 15 10:53:03.967832 kernel: NET: Registered PF_NETLINK/PF_ROUTE protocol family Jul 15 10:53:03.967842 kernel: audit: initializing netlink subsys (disabled) Jul 15 10:53:03.967851 kernel: audit: type=2000 audit(1752576783.374:1): state=initialized audit_enabled=0 res=1 Jul 15 10:53:03.967861 kernel: thermal_sys: Registered thermal governor 'step_wise' Jul 15 10:53:03.967870 kernel: thermal_sys: Registered thermal governor 'user_space' Jul 15 10:53:03.967879 kernel: cpuidle: using governor menu Jul 15 10:53:03.967889 kernel: acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 Jul 15 10:53:03.967899 kernel: dca service started, version 1.12.1 Jul 15 10:53:03.967908 kernel: PCI: Using configuration type 1 for base access Jul 15 10:53:03.967919 kernel: kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. Jul 15 10:53:03.967929 kernel: HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages Jul 15 10:53:03.967939 kernel: HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page Jul 15 10:53:03.967948 kernel: ACPI: Added _OSI(Module Device) Jul 15 10:53:03.967957 kernel: ACPI: Added _OSI(Processor Device) Jul 15 10:53:03.967967 kernel: ACPI: Added _OSI(Processor Aggregator Device) Jul 15 10:53:03.967976 kernel: ACPI: 1 ACPI AML tables successfully acquired and loaded Jul 15 10:53:03.967986 kernel: ACPI: _OSC evaluation for CPUs failed, trying _PDC Jul 15 10:53:03.967995 kernel: ACPI: Interpreter enabled Jul 15 10:53:03.968007 kernel: ACPI: PM: (supports S0 S3 S5) Jul 15 10:53:03.968016 kernel: ACPI: Using IOAPIC for interrupt routing Jul 15 10:53:03.968026 kernel: PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug Jul 15 10:53:03.968035 kernel: PCI: Using E820 reservations for host bridge windows Jul 15 10:53:03.968044 kernel: ACPI: Enabled 2 GPEs in block 00 to 0F Jul 15 10:53:03.968054 kernel: ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) Jul 15 10:53:03.968225 kernel: acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI HPX-Type3] Jul 15 10:53:03.968326 kernel: acpi PNP0A03:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI] Jul 15 10:53:03.968424 kernel: acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended configuration space under this bridge Jul 15 10:53:03.968439 kernel: acpiphp: Slot [3] registered Jul 15 10:53:03.968449 kernel: acpiphp: Slot [4] registered Jul 15 10:53:03.968458 kernel: acpiphp: Slot [5] registered Jul 15 10:53:03.968468 kernel: acpiphp: Slot [6] registered Jul 15 10:53:03.968477 kernel: acpiphp: Slot [7] registered Jul 15 10:53:03.968487 kernel: acpiphp: Slot [8] registered Jul 15 10:53:03.968496 kernel: acpiphp: Slot [9] registered Jul 15 10:53:03.968509 kernel: acpiphp: Slot [10] registered Jul 15 10:53:03.968518 kernel: acpiphp: Slot [11] registered Jul 15 10:53:03.968527 kernel: acpiphp: Slot [12] registered Jul 15 10:53:03.968536 kernel: acpiphp: Slot [13] registered Jul 15 10:53:03.968546 kernel: acpiphp: Slot [14] registered Jul 15 10:53:03.968555 kernel: acpiphp: Slot [15] registered Jul 15 10:53:03.968565 kernel: acpiphp: Slot [16] registered Jul 15 10:53:03.968574 kernel: acpiphp: Slot [17] registered Jul 15 10:53:03.968583 kernel: acpiphp: Slot [18] registered Jul 15 10:53:03.968594 kernel: acpiphp: Slot [19] registered Jul 15 10:53:03.968604 kernel: acpiphp: Slot [20] registered Jul 15 10:53:03.968613 kernel: acpiphp: Slot [21] registered Jul 15 10:53:03.968622 kernel: acpiphp: Slot [22] registered Jul 15 10:53:03.968631 kernel: acpiphp: Slot [23] registered Jul 15 10:53:03.968641 kernel: acpiphp: Slot [24] registered Jul 15 10:53:03.968650 kernel: acpiphp: Slot [25] registered Jul 15 10:53:03.968659 kernel: acpiphp: Slot [26] registered Jul 15 10:53:03.968669 kernel: acpiphp: Slot [27] registered Jul 15 10:53:03.968678 kernel: acpiphp: Slot [28] registered Jul 15 10:53:03.968689 kernel: acpiphp: Slot [29] registered Jul 15 10:53:03.968699 kernel: acpiphp: Slot [30] registered Jul 15 10:53:03.968708 kernel: acpiphp: Slot [31] registered Jul 15 10:53:03.968717 kernel: PCI host bridge to bus 0000:00 Jul 15 10:53:03.968818 kernel: pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] Jul 15 10:53:03.968910 kernel: pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] Jul 15 10:53:03.968995 kernel: pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] Jul 15 10:53:03.969078 kernel: pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] Jul 15 10:53:03.969281 kernel: pci_bus 0000:00: root bus resource [mem 0xc000000000-0xc07fffffff window] Jul 15 10:53:03.969373 kernel: pci_bus 0000:00: root bus resource [bus 00-ff] Jul 15 10:53:03.969493 kernel: pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 Jul 15 10:53:03.969607 kernel: pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 Jul 15 10:53:03.969716 kernel: pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 Jul 15 10:53:03.969813 kernel: pci 0000:00:01.1: reg 0x20: [io 0xc120-0xc12f] Jul 15 10:53:03.969916 kernel: pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] Jul 15 10:53:03.970013 kernel: pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] Jul 15 10:53:03.970131 kernel: pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] Jul 15 10:53:03.970245 kernel: pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] Jul 15 10:53:03.970360 kernel: pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 Jul 15 10:53:03.970462 kernel: pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI Jul 15 10:53:03.970564 kernel: pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB Jul 15 10:53:03.970684 kernel: pci 0000:00:02.0: [1af4:1050] type 00 class 0x030000 Jul 15 10:53:03.970789 kernel: pci 0000:00:02.0: reg 0x10: [mem 0xfe000000-0xfe7fffff pref] Jul 15 10:53:03.970896 kernel: pci 0000:00:02.0: reg 0x18: [mem 0xc000000000-0xc000003fff 64bit pref] Jul 15 10:53:03.971002 kernel: pci 0000:00:02.0: reg 0x20: [mem 0xfeb90000-0xfeb90fff] Jul 15 10:53:03.971122 kernel: pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfeb8ffff pref] Jul 15 10:53:03.971255 kernel: pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] Jul 15 10:53:03.971368 kernel: pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 Jul 15 10:53:03.971465 kernel: pci 0000:00:03.0: reg 0x10: [io 0xc080-0xc0bf] Jul 15 10:53:03.971561 kernel: pci 0000:00:03.0: reg 0x14: [mem 0xfeb91000-0xfeb91fff] Jul 15 10:53:03.971658 kernel: pci 0000:00:03.0: reg 0x20: [mem 0xc000004000-0xc000007fff 64bit pref] Jul 15 10:53:03.971755 kernel: pci 0000:00:03.0: reg 0x30: [mem 0xfeb00000-0xfeb7ffff pref] Jul 15 10:53:03.971859 kernel: pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 Jul 15 10:53:03.971955 kernel: pci 0000:00:04.0: reg 0x10: [io 0xc000-0xc07f] Jul 15 10:53:03.972058 kernel: pci 0000:00:04.0: reg 0x14: [mem 0xfeb92000-0xfeb92fff] Jul 15 10:53:03.972200 kernel: pci 0000:00:04.0: reg 0x20: [mem 0xc000008000-0xc00000bfff 64bit pref] Jul 15 10:53:03.972305 kernel: pci 0000:00:05.0: [1af4:1002] type 00 class 0x00ff00 Jul 15 10:53:03.972399 kernel: pci 0000:00:05.0: reg 0x10: [io 0xc0c0-0xc0ff] Jul 15 10:53:03.972494 kernel: pci 0000:00:05.0: reg 0x20: [mem 0xc00000c000-0xc00000ffff 64bit pref] Jul 15 10:53:03.972604 kernel: pci 0000:00:06.0: [1af4:1005] type 00 class 0x00ff00 Jul 15 10:53:03.972700 kernel: pci 0000:00:06.0: reg 0x10: [io 0xc100-0xc11f] Jul 15 10:53:03.972804 kernel: pci 0000:00:06.0: reg 0x14: [mem 0xfeb93000-0xfeb93fff] Jul 15 10:53:03.972901 kernel: pci 0000:00:06.0: reg 0x20: [mem 0xc000010000-0xc000013fff 64bit pref] Jul 15 10:53:03.972916 kernel: ACPI: PCI: Interrupt link LNKA configured for IRQ 10 Jul 15 10:53:03.972926 kernel: ACPI: PCI: Interrupt link LNKB configured for IRQ 10 Jul 15 10:53:03.972935 kernel: ACPI: PCI: Interrupt link LNKC configured for IRQ 11 Jul 15 10:53:03.972945 kernel: ACPI: PCI: Interrupt link LNKD configured for IRQ 11 Jul 15 10:53:03.972954 kernel: ACPI: PCI: Interrupt link LNKS configured for IRQ 9 Jul 15 10:53:03.972964 kernel: iommu: Default domain type: Translated Jul 15 10:53:03.972974 kernel: iommu: DMA domain TLB invalidation policy: lazy mode Jul 15 10:53:03.972987 kernel: PCI: Using ACPI for IRQ routing Jul 15 10:53:03.972996 kernel: PCI: pci_cache_line_size set to 64 bytes Jul 15 10:53:03.973006 kernel: e820: reserve RAM buffer [mem 0x0009fc00-0x0009ffff] Jul 15 10:53:03.973015 kernel: e820: reserve RAM buffer [mem 0xbffdd000-0xbfffffff] Jul 15 10:53:03.973126 kernel: pci 0000:00:02.0: vgaarb: setting as boot VGA device Jul 15 10:53:03.973245 kernel: pci 0000:00:02.0: vgaarb: bridge control possible Jul 15 10:53:03.973344 kernel: pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none Jul 15 10:53:03.973358 kernel: vgaarb: loaded Jul 15 10:53:03.973372 kernel: clocksource: Switched to clocksource kvm-clock Jul 15 10:53:03.973382 kernel: VFS: Disk quotas dquot_6.6.0 Jul 15 10:53:03.973391 kernel: VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) Jul 15 10:53:03.973401 kernel: pnp: PnP ACPI init Jul 15 10:53:03.973505 kernel: pnp 00:03: [dma 2] Jul 15 10:53:03.973520 kernel: pnp: PnP ACPI: found 5 devices Jul 15 10:53:03.973530 kernel: clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns Jul 15 10:53:03.973540 kernel: NET: Registered PF_INET protocol family Jul 15 10:53:03.973549 kernel: IP idents hash table entries: 65536 (order: 7, 524288 bytes, linear) Jul 15 10:53:03.973562 kernel: tcp_listen_portaddr_hash hash table entries: 2048 (order: 3, 32768 bytes, linear) Jul 15 10:53:03.973572 kernel: Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) Jul 15 10:53:03.973581 kernel: TCP established hash table entries: 32768 (order: 6, 262144 bytes, linear) Jul 15 10:53:03.973591 kernel: TCP bind hash table entries: 32768 (order: 8, 1048576 bytes, linear) Jul 15 10:53:03.973601 kernel: TCP: Hash tables configured (established 32768 bind 32768) Jul 15 10:53:03.973611 kernel: UDP hash table entries: 2048 (order: 4, 65536 bytes, linear) Jul 15 10:53:03.973621 kernel: UDP-Lite hash table entries: 2048 (order: 4, 65536 bytes, linear) Jul 15 10:53:03.973630 kernel: NET: Registered PF_UNIX/PF_LOCAL protocol family Jul 15 10:53:03.973642 kernel: NET: Registered PF_XDP protocol family Jul 15 10:53:03.973728 kernel: pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] Jul 15 10:53:03.973812 kernel: pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] Jul 15 10:53:03.973896 kernel: pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] Jul 15 10:53:03.973980 kernel: pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] Jul 15 10:53:03.974063 kernel: pci_bus 0000:00: resource 8 [mem 0xc000000000-0xc07fffffff window] Jul 15 10:53:03.976211 kernel: pci 0000:00:01.0: PIIX3: Enabling Passive Release Jul 15 10:53:03.976323 kernel: pci 0000:00:00.0: Limiting direct PCI/PCI transfers Jul 15 10:53:03.976344 kernel: PCI: CLS 0 bytes, default 64 Jul 15 10:53:03.976355 kernel: PCI-DMA: Using software bounce buffering for IO (SWIOTLB) Jul 15 10:53:03.976366 kernel: software IO TLB: mapped [mem 0x00000000bbfdd000-0x00000000bffdd000] (64MB) Jul 15 10:53:03.976377 kernel: Initialise system trusted keyrings Jul 15 10:53:03.976387 kernel: workingset: timestamp_bits=39 max_order=20 bucket_order=0 Jul 15 10:53:03.976397 kernel: Key type asymmetric registered Jul 15 10:53:03.976408 kernel: Asymmetric key parser 'x509' registered Jul 15 10:53:03.976418 kernel: Block layer SCSI generic (bsg) driver version 0.4 loaded (major 251) Jul 15 10:53:03.976429 kernel: io scheduler mq-deadline registered Jul 15 10:53:03.976441 kernel: io scheduler kyber registered Jul 15 10:53:03.976451 kernel: io scheduler bfq registered Jul 15 10:53:03.976462 kernel: ioatdma: Intel(R) QuickData Technology Driver 5.00 Jul 15 10:53:03.976473 kernel: ACPI: \_SB_.LNKB: Enabled at IRQ 10 Jul 15 10:53:03.976483 kernel: ACPI: \_SB_.LNKC: Enabled at IRQ 11 Jul 15 10:53:03.976494 kernel: ACPI: \_SB_.LNKD: Enabled at IRQ 11 Jul 15 10:53:03.976504 kernel: ACPI: \_SB_.LNKA: Enabled at IRQ 10 Jul 15 10:53:03.976514 kernel: Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled Jul 15 10:53:03.976525 kernel: 00:00: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A Jul 15 10:53:03.976537 kernel: random: crng init done Jul 15 10:53:03.976547 kernel: i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 Jul 15 10:53:03.976557 kernel: serio: i8042 KBD port at 0x60,0x64 irq 1 Jul 15 10:53:03.976567 kernel: serio: i8042 AUX port at 0x60,0x64 irq 12 Jul 15 10:53:03.976669 kernel: rtc_cmos 00:04: RTC can wake from S4 Jul 15 10:53:03.976685 kernel: input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 Jul 15 10:53:03.976773 kernel: rtc_cmos 00:04: registered as rtc0 Jul 15 10:53:03.976864 kernel: rtc_cmos 00:04: setting system clock to 2025-07-15T10:53:03 UTC (1752576783) Jul 15 10:53:03.976959 kernel: rtc_cmos 00:04: alarms up to one day, y3k, 242 bytes nvram Jul 15 10:53:03.976975 kernel: amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled Jul 15 10:53:03.976986 kernel: NET: Registered PF_INET6 protocol family Jul 15 10:53:03.976996 kernel: Segment Routing with IPv6 Jul 15 10:53:03.977007 kernel: In-situ OAM (IOAM) with IPv6 Jul 15 10:53:03.977017 kernel: NET: Registered PF_PACKET protocol family Jul 15 10:53:03.977027 kernel: Key type dns_resolver registered Jul 15 10:53:03.977037 kernel: IPI shorthand broadcast: enabled Jul 15 10:53:03.977048 kernel: sched_clock: Marking stable (1049008344, 170339004)->(1260798697, -41451349) Jul 15 10:53:03.977062 kernel: registered taskstats version 1 Jul 15 10:53:03.977072 kernel: Loading compiled-in X.509 certificates Jul 15 10:53:03.977083 kernel: Loaded X.509 cert 'Kinvolk GmbH: Module signing key for 6.6.98-flatcar: b24d4d02c910a1872551e9ac8f9af93a6b380d4d' Jul 15 10:53:03.977093 kernel: Key type .fscrypt registered Jul 15 10:53:03.977128 kernel: Key type fscrypt-provisioning registered Jul 15 10:53:03.977140 kernel: ima: No TPM chip found, activating TPM-bypass! Jul 15 10:53:03.977150 kernel: ima: Allocated hash algorithm: sha1 Jul 15 10:53:03.977160 kernel: ima: No architecture policies found Jul 15 10:53:03.977170 kernel: clk: Disabling unused clocks Jul 15 10:53:03.977184 kernel: Freeing unused kernel image (initmem) memory: 43504K Jul 15 10:53:03.977194 kernel: Write protecting the kernel read-only data: 38912k Jul 15 10:53:03.977207 kernel: Freeing unused kernel image (rodata/data gap) memory: 1704K Jul 15 10:53:03.977217 kernel: Run /init as init process Jul 15 10:53:03.977227 kernel: with arguments: Jul 15 10:53:03.977236 kernel: /init Jul 15 10:53:03.977245 kernel: with environment: Jul 15 10:53:03.977255 kernel: HOME=/ Jul 15 10:53:03.977264 kernel: TERM=linux Jul 15 10:53:03.977276 kernel: BOOT_IMAGE=/flatcar/vmlinuz-a Jul 15 10:53:03.977287 systemd[1]: Successfully made /usr/ read-only. Jul 15 10:53:03.977301 systemd[1]: systemd 256.8 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL -ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 -PWQUALITY -P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK -XKBCOMMON +UTMP -SYSVINIT +LIBARCHIVE) Jul 15 10:53:03.977312 systemd[1]: Detected virtualization kvm. Jul 15 10:53:03.977322 systemd[1]: Detected architecture x86-64. Jul 15 10:53:03.977332 systemd[1]: Running in initrd. Jul 15 10:53:03.977342 systemd[1]: No hostname configured, using default hostname. Jul 15 10:53:03.977355 systemd[1]: Hostname set to . Jul 15 10:53:03.977365 systemd[1]: Initializing machine ID from VM UUID. Jul 15 10:53:03.977376 systemd[1]: Queued start job for default target initrd.target. Jul 15 10:53:03.977386 systemd[1]: Started clevis-luks-askpass.path - Forward Password Requests to Clevis Directory Watch. Jul 15 10:53:03.977397 systemd[1]: Started systemd-ask-password-console.path - Dispatch Password Requests to Console Directory Watch. Jul 15 10:53:03.977408 systemd[1]: Expecting device dev-disk-by\x2dlabel-EFI\x2dSYSTEM.device - /dev/disk/by-label/EFI-SYSTEM... Jul 15 10:53:03.977418 systemd[1]: Expecting device dev-disk-by\x2dlabel-OEM.device - /dev/disk/by-label/OEM... Jul 15 10:53:03.977439 systemd[1]: Expecting device dev-disk-by\x2dlabel-ROOT.device - /dev/disk/by-label/ROOT... Jul 15 10:53:03.977453 systemd[1]: Expecting device dev-disk-by\x2dpartlabel-USR\x2dA.device - /dev/disk/by-partlabel/USR-A... Jul 15 10:53:03.977464 systemd[1]: Expecting device dev-disk-by\x2dpartuuid-7130c94a\x2d213a\x2d4e5a\x2d8e26\x2d6cce9662f132.device - /dev/disk/by-partuuid/7130c94a-213a-4e5a-8e26-6cce9662f132... Jul 15 10:53:03.977475 systemd[1]: Expecting device dev-mapper-usr.device - /dev/mapper/usr... Jul 15 10:53:03.977485 systemd[1]: Reached target cryptsetup-pre.target - Local Encrypted Volumes (Pre). Jul 15 10:53:03.977499 systemd[1]: Reached target cryptsetup.target - Local Encrypted Volumes. Jul 15 10:53:03.977509 systemd[1]: Reached target paths.target - Path Units. Jul 15 10:53:03.977520 systemd[1]: Reached target slices.target - Slice Units. Jul 15 10:53:03.977530 systemd[1]: Reached target swap.target - Swaps. Jul 15 10:53:03.977541 systemd[1]: Reached target timers.target - Timer Units. Jul 15 10:53:03.977551 systemd[1]: Listening on iscsid.socket - Open-iSCSI iscsid Socket. Jul 15 10:53:03.977562 systemd[1]: Listening on iscsiuio.socket - Open-iSCSI iscsiuio Socket. Jul 15 10:53:03.977573 systemd[1]: Listening on systemd-journald-dev-log.socket - Journal Socket (/dev/log). Jul 15 10:53:03.977583 systemd[1]: Listening on systemd-journald.socket - Journal Sockets. Jul 15 10:53:03.977596 systemd[1]: Listening on systemd-networkd.socket - Network Service Netlink Socket. Jul 15 10:53:03.977606 systemd[1]: Listening on systemd-udevd-control.socket - udev Control Socket. Jul 15 10:53:03.977617 systemd[1]: Listening on systemd-udevd-kernel.socket - udev Kernel Socket. Jul 15 10:53:03.977628 systemd[1]: Reached target sockets.target - Socket Units. Jul 15 10:53:03.977638 systemd[1]: Starting ignition-setup-pre.service - Ignition env setup... Jul 15 10:53:03.977649 systemd[1]: Starting kmod-static-nodes.service - Create List of Static Device Nodes... Jul 15 10:53:03.977659 systemd[1]: Finished network-cleanup.service - Network Cleanup. Jul 15 10:53:03.977670 systemd[1]: Starting systemd-fsck-usr.service... Jul 15 10:53:03.977680 systemd[1]: Starting systemd-journald.service - Journal Service... Jul 15 10:53:03.977693 systemd[1]: Starting systemd-modules-load.service - Load Kernel Modules... Jul 15 10:53:03.977727 systemd-journald[184]: Collecting audit messages is disabled. Jul 15 10:53:03.977753 systemd[1]: Starting systemd-vconsole-setup.service - Virtual Console Setup... Jul 15 10:53:03.977765 systemd-journald[184]: Journal started Jul 15 10:53:03.977791 systemd-journald[184]: Runtime Journal (/run/log/journal/8656991f64d94efe857774bcacd72dea) is 8M, max 78.3M, 70.3M free. Jul 15 10:53:03.996173 systemd[1]: Started systemd-journald.service - Journal Service. Jul 15 10:53:03.996250 systemd-modules-load[186]: Inserted module 'overlay' Jul 15 10:53:03.998412 systemd[1]: Finished ignition-setup-pre.service - Ignition env setup. Jul 15 10:53:04.001289 systemd[1]: Finished kmod-static-nodes.service - Create List of Static Device Nodes. Jul 15 10:53:04.004338 systemd[1]: Finished systemd-fsck-usr.service. Jul 15 10:53:04.019403 systemd[1]: Starting systemd-tmpfiles-setup-dev-early.service - Create Static Device Nodes in /dev gracefully... Jul 15 10:53:04.065293 kernel: bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this. Jul 15 10:53:04.065323 kernel: Bridge firewalling registered Jul 15 10:53:04.032546 systemd-modules-load[186]: Inserted module 'br_netfilter' Jul 15 10:53:04.075242 systemd[1]: Starting systemd-tmpfiles-setup.service - Create System Files and Directories... Jul 15 10:53:04.076119 systemd[1]: Finished systemd-modules-load.service - Load Kernel Modules. Jul 15 10:53:04.078210 systemd[1]: Finished systemd-vconsole-setup.service - Virtual Console Setup. Jul 15 10:53:04.080596 systemd[1]: Finished systemd-tmpfiles-setup-dev-early.service - Create Static Device Nodes in /dev gracefully. Jul 15 10:53:04.086544 systemd[1]: Starting dracut-cmdline-ask.service - dracut ask for additional cmdline parameters... Jul 15 10:53:04.089896 systemd[1]: Starting systemd-sysctl.service - Apply Kernel Variables... Jul 15 10:53:04.100465 systemd[1]: Starting systemd-tmpfiles-setup-dev.service - Create Static Device Nodes in /dev... Jul 15 10:53:04.102789 systemd[1]: Finished systemd-tmpfiles-setup.service - Create System Files and Directories. Jul 15 10:53:04.108364 systemd[1]: Finished systemd-sysctl.service - Apply Kernel Variables. Jul 15 10:53:04.117262 systemd[1]: Starting systemd-resolved.service - Network Name Resolution... Jul 15 10:53:04.118675 systemd[1]: Finished systemd-tmpfiles-setup-dev.service - Create Static Device Nodes in /dev. Jul 15 10:53:04.123268 systemd[1]: Finished dracut-cmdline-ask.service - dracut ask for additional cmdline parameters. Jul 15 10:53:04.131343 systemd[1]: Starting dracut-cmdline.service - dracut cmdline hook... Jul 15 10:53:04.148877 dracut-cmdline[222]: dracut-dracut-053 Jul 15 10:53:04.153783 dracut-cmdline[222]: Using kernel command line parameters: rd.driver.pre=btrfs rootflags=rw mount.usrflags=ro BOOT_IMAGE=/flatcar/vmlinuz-a mount.usr=/dev/mapper/usr verity.usr=PARTUUID=7130c94a-213a-4e5a-8e26-6cce9662f132 rootflags=rw mount.usrflags=ro consoleblank=0 root=LABEL=ROOT console=ttyS0,115200n8 console=tty0 flatcar.first_boot=detected flatcar.oem.id=openstack flatcar.autologin verity.usrhash=5af33b6d30f308631e4a91e3c355c3478a77b3d8f9ea9ec9a25f78d7867f681f Jul 15 10:53:04.164606 systemd-resolved[214]: Positive Trust Anchors: Jul 15 10:53:04.164629 systemd-resolved[214]: . IN DS 20326 8 2 e06d44b80b8f1d39a95c0b0d7c65d08458e880409bbc683457104237c7f8ec8d Jul 15 10:53:04.164675 systemd-resolved[214]: Negative trust anchors: home.arpa 10.in-addr.arpa 16.172.in-addr.arpa 17.172.in-addr.arpa 18.172.in-addr.arpa 19.172.in-addr.arpa 20.172.in-addr.arpa 21.172.in-addr.arpa 22.172.in-addr.arpa 23.172.in-addr.arpa 24.172.in-addr.arpa 25.172.in-addr.arpa 26.172.in-addr.arpa 27.172.in-addr.arpa 28.172.in-addr.arpa 29.172.in-addr.arpa 30.172.in-addr.arpa 31.172.in-addr.arpa 170.0.0.192.in-addr.arpa 171.0.0.192.in-addr.arpa 168.192.in-addr.arpa d.f.ip6.arpa ipv4only.arpa resolver.arpa corp home internal intranet lan local private test Jul 15 10:53:04.168708 systemd-resolved[214]: Defaulting to hostname 'linux'. Jul 15 10:53:04.169781 systemd[1]: Started systemd-resolved.service - Network Name Resolution. Jul 15 10:53:04.170367 systemd[1]: Reached target nss-lookup.target - Host and Network Name Lookups. Jul 15 10:53:04.233193 kernel: SCSI subsystem initialized Jul 15 10:53:04.244156 kernel: Loading iSCSI transport class v2.0-870. Jul 15 10:53:04.257147 kernel: iscsi: registered transport (tcp) Jul 15 10:53:04.280419 kernel: iscsi: registered transport (qla4xxx) Jul 15 10:53:04.280529 kernel: QLogic iSCSI HBA Driver Jul 15 10:53:04.320971 systemd[1]: Finished dracut-cmdline.service - dracut cmdline hook. Jul 15 10:53:04.331257 systemd[1]: Starting dracut-pre-udev.service - dracut pre-udev hook... Jul 15 10:53:04.378596 kernel: device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. Jul 15 10:53:04.378675 kernel: device-mapper: uevent: version 1.0.3 Jul 15 10:53:04.379547 kernel: device-mapper: ioctl: 4.48.0-ioctl (2023-03-01) initialised: dm-devel@redhat.com Jul 15 10:53:04.435218 kernel: raid6: sse2x4 gen() 5367 MB/s Jul 15 10:53:04.454303 kernel: raid6: sse2x2 gen() 5938 MB/s Jul 15 10:53:04.472530 kernel: raid6: sse2x1 gen() 8405 MB/s Jul 15 10:53:04.472602 kernel: raid6: using algorithm sse2x1 gen() 8405 MB/s Jul 15 10:53:04.491822 kernel: raid6: .... xor() 7286 MB/s, rmw enabled Jul 15 10:53:04.491886 kernel: raid6: using ssse3x2 recovery algorithm Jul 15 10:53:04.514496 kernel: xor: measuring software checksum speed Jul 15 10:53:04.514603 kernel: prefetch64-sse : 17274 MB/sec Jul 15 10:53:04.516540 kernel: generic_sse : 15691 MB/sec Jul 15 10:53:04.516603 kernel: xor: using function: prefetch64-sse (17274 MB/sec) Jul 15 10:53:04.687162 kernel: Btrfs loaded, zoned=no, fsverity=no Jul 15 10:53:04.700188 systemd[1]: Finished dracut-pre-udev.service - dracut pre-udev hook. Jul 15 10:53:04.708268 systemd[1]: Starting systemd-udevd.service - Rule-based Manager for Device Events and Files... Jul 15 10:53:04.752486 systemd-udevd[404]: Using default interface naming scheme 'v255'. Jul 15 10:53:04.764735 systemd[1]: Started systemd-udevd.service - Rule-based Manager for Device Events and Files. Jul 15 10:53:04.776442 systemd[1]: Starting dracut-pre-trigger.service - dracut pre-trigger hook... Jul 15 10:53:04.797386 dracut-pre-trigger[414]: rd.md=0: removing MD RAID activation Jul 15 10:53:04.837788 systemd[1]: Finished dracut-pre-trigger.service - dracut pre-trigger hook. Jul 15 10:53:04.843253 systemd[1]: Starting systemd-udev-trigger.service - Coldplug All udev Devices... Jul 15 10:53:04.892241 systemd[1]: Finished systemd-udev-trigger.service - Coldplug All udev Devices. Jul 15 10:53:04.907221 systemd[1]: Starting dracut-initqueue.service - dracut initqueue hook... Jul 15 10:53:04.961364 systemd[1]: Finished dracut-initqueue.service - dracut initqueue hook. Jul 15 10:53:04.964122 systemd[1]: Reached target remote-fs-pre.target - Preparation for Remote File Systems. Jul 15 10:53:04.971074 kernel: virtio_blk virtio2: 2/0/0 default/read/poll queues Jul 15 10:53:04.971983 kernel: virtio_blk virtio2: [vda] 20971520 512-byte logical blocks (10.7 GB/10.0 GiB) Jul 15 10:53:04.964719 systemd[1]: Reached target remote-cryptsetup.target - Remote Encrypted Volumes. Jul 15 10:53:04.969152 systemd[1]: Reached target remote-fs.target - Remote File Systems. Jul 15 10:53:04.985278 systemd[1]: Starting dracut-pre-mount.service - dracut pre-mount hook... Jul 15 10:53:04.997994 kernel: GPT:Primary header thinks Alt. header is not at the end of the disk. Jul 15 10:53:04.998041 kernel: GPT:17805311 != 20971519 Jul 15 10:53:04.998063 kernel: GPT:Alternate GPT header not at the end of the disk. Jul 15 10:53:04.998078 kernel: GPT:17805311 != 20971519 Jul 15 10:53:04.998091 kernel: GPT: Use GNU Parted to correct GPT errors. Jul 15 10:53:04.998125 kernel: vda: vda1 vda2 vda3 vda4 vda6 vda7 vda9 Jul 15 10:53:05.005375 systemd[1]: Finished dracut-pre-mount.service - dracut pre-mount hook. Jul 15 10:53:05.017191 systemd[1]: dracut-cmdline-ask.service: Deactivated successfully. Jul 15 10:53:05.017333 systemd[1]: Stopped dracut-cmdline-ask.service - dracut ask for additional cmdline parameters. Jul 15 10:53:05.017993 systemd[1]: Stopping dracut-cmdline-ask.service - dracut ask for additional cmdline parameters... Jul 15 10:53:05.020146 systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. Jul 15 10:53:05.020310 systemd[1]: Stopped systemd-vconsole-setup.service - Virtual Console Setup. Jul 15 10:53:05.023851 systemd[1]: Stopping systemd-vconsole-setup.service - Virtual Console Setup... Jul 15 10:53:05.030139 kernel: libata version 3.00 loaded. Jul 15 10:53:05.033153 kernel: ata_piix 0000:00:01.1: version 2.13 Jul 15 10:53:05.033686 systemd[1]: Starting systemd-vconsole-setup.service - Virtual Console Setup... Jul 15 10:53:05.041579 kernel: scsi host0: ata_piix Jul 15 10:53:05.054078 kernel: scsi host1: ata_piix Jul 15 10:53:05.054359 kernel: ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc120 irq 14 Jul 15 10:53:05.054378 kernel: ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc128 irq 15 Jul 15 10:53:05.066142 kernel: BTRFS: device label OEM devid 1 transid 11 /dev/vda6 scanned by (udev-worker) (457) Jul 15 10:53:05.070145 kernel: BTRFS: device fsid 72bb124d-7a3e-423d-a96c-4fa37107854d devid 1 transid 36 /dev/vda3 scanned by (udev-worker) (462) Jul 15 10:53:05.092805 systemd[1]: Found device dev-disk-by\x2dlabel-ROOT.device - /dev/disk/by-label/ROOT. Jul 15 10:53:05.119737 systemd[1]: Finished systemd-vconsole-setup.service - Virtual Console Setup. Jul 15 10:53:05.147815 systemd[1]: Found device dev-disk-by\x2dlabel-EFI\x2dSYSTEM.device - /dev/disk/by-label/EFI-SYSTEM. Jul 15 10:53:05.159310 systemd[1]: Found device dev-disk-by\x2dlabel-OEM.device - /dev/disk/by-label/OEM. Jul 15 10:53:05.168744 systemd[1]: Found device dev-disk-by\x2dpartlabel-USR\x2dA.device - /dev/disk/by-partlabel/USR-A. Jul 15 10:53:05.169339 systemd[1]: Found device dev-disk-by\x2dpartuuid-7130c94a\x2d213a\x2d4e5a\x2d8e26\x2d6cce9662f132.device - /dev/disk/by-partuuid/7130c94a-213a-4e5a-8e26-6cce9662f132. Jul 15 10:53:05.176349 systemd[1]: Starting disk-uuid.service - Generate new UUID for disk GPT if necessary... Jul 15 10:53:05.180298 systemd[1]: Starting dracut-cmdline-ask.service - dracut ask for additional cmdline parameters... Jul 15 10:53:05.190242 disk-uuid[506]: Primary Header is updated. Jul 15 10:53:05.190242 disk-uuid[506]: Secondary Entries is updated. Jul 15 10:53:05.190242 disk-uuid[506]: Secondary Header is updated. Jul 15 10:53:05.204138 kernel: vda: vda1 vda2 vda3 vda4 vda6 vda7 vda9 Jul 15 10:53:05.216920 systemd[1]: Finished dracut-cmdline-ask.service - dracut ask for additional cmdline parameters. Jul 15 10:53:06.224409 kernel: vda: vda1 vda2 vda3 vda4 vda6 vda7 vda9 Jul 15 10:53:06.227025 disk-uuid[507]: The operation has completed successfully. Jul 15 10:53:06.304520 systemd[1]: disk-uuid.service: Deactivated successfully. Jul 15 10:53:06.305493 systemd[1]: Finished disk-uuid.service - Generate new UUID for disk GPT if necessary. Jul 15 10:53:06.379271 systemd[1]: Starting verity-setup.service - Verity Setup for /dev/mapper/usr... Jul 15 10:53:06.383053 sh[526]: Success Jul 15 10:53:06.401190 kernel: device-mapper: verity: sha256 using implementation "sha256-ssse3" Jul 15 10:53:06.466799 systemd[1]: Found device dev-mapper-usr.device - /dev/mapper/usr. Jul 15 10:53:06.468183 systemd[1]: Finished verity-setup.service - Verity Setup for /dev/mapper/usr. Jul 15 10:53:06.470661 systemd[1]: Mounting sysusr-usr.mount - /sysusr/usr... Jul 15 10:53:06.491250 kernel: BTRFS info (device dm-0): first mount of filesystem 72bb124d-7a3e-423d-a96c-4fa37107854d Jul 15 10:53:06.491302 kernel: BTRFS info (device dm-0): using crc32c (crc32c-intel) checksum algorithm Jul 15 10:53:06.491318 kernel: BTRFS warning (device dm-0): 'nologreplay' is deprecated, use 'rescue=nologreplay' instead Jul 15 10:53:06.493375 kernel: BTRFS info (device dm-0): disabling log replay at mount time Jul 15 10:53:06.494980 kernel: BTRFS info (device dm-0): using free space tree Jul 15 10:53:06.514420 systemd[1]: Mounted sysusr-usr.mount - /sysusr/usr. Jul 15 10:53:06.516716 systemd[1]: afterburn-network-kargs.service - Afterburn Initrd Setup Network Kernel Arguments was skipped because no trigger condition checks were met. Jul 15 10:53:06.528479 systemd[1]: Starting ignition-setup.service - Ignition (setup)... Jul 15 10:53:06.534401 systemd[1]: Starting parse-ip-for-networkd.service - Write systemd-networkd units from cmdline... Jul 15 10:53:06.573149 kernel: BTRFS info (device vda6): first mount of filesystem c20e5e0c-dae6-45ce-95fe-16a1362e2f71 Jul 15 10:53:06.573246 kernel: BTRFS info (device vda6): using crc32c (crc32c-intel) checksum algorithm Jul 15 10:53:06.573279 kernel: BTRFS info (device vda6): using free space tree Jul 15 10:53:06.591168 kernel: BTRFS info (device vda6): auto enabling async discard Jul 15 10:53:06.603198 kernel: BTRFS info (device vda6): last unmount of filesystem c20e5e0c-dae6-45ce-95fe-16a1362e2f71 Jul 15 10:53:06.616095 systemd[1]: Finished ignition-setup.service - Ignition (setup). Jul 15 10:53:06.624368 systemd[1]: Starting ignition-fetch-offline.service - Ignition (fetch-offline)... Jul 15 10:53:06.680332 systemd[1]: Finished parse-ip-for-networkd.service - Write systemd-networkd units from cmdline. Jul 15 10:53:06.690792 systemd[1]: Starting systemd-networkd.service - Network Configuration... Jul 15 10:53:06.715556 systemd-networkd[706]: lo: Link UP Jul 15 10:53:06.715566 systemd-networkd[706]: lo: Gained carrier Jul 15 10:53:06.716890 systemd-networkd[706]: Enumeration completed Jul 15 10:53:06.716965 systemd[1]: Started systemd-networkd.service - Network Configuration. Jul 15 10:53:06.717632 systemd[1]: Reached target network.target - Network. Jul 15 10:53:06.718784 systemd-networkd[706]: eth0: found matching network '/usr/lib/systemd/network/zz-default.network', based on potentially unpredictable interface name. Jul 15 10:53:06.718789 systemd-networkd[706]: eth0: Configuring with /usr/lib/systemd/network/zz-default.network. Jul 15 10:53:06.720038 systemd-networkd[706]: eth0: Link UP Jul 15 10:53:06.720042 systemd-networkd[706]: eth0: Gained carrier Jul 15 10:53:06.720050 systemd-networkd[706]: eth0: found matching network '/usr/lib/systemd/network/zz-default.network', based on potentially unpredictable interface name. Jul 15 10:53:06.732156 systemd-networkd[706]: eth0: DHCPv4 address 172.24.4.54/24, gateway 172.24.4.1 acquired from 172.24.4.1 Jul 15 10:53:06.785872 ignition[642]: Ignition 2.20.0 Jul 15 10:53:06.785885 ignition[642]: Stage: fetch-offline Jul 15 10:53:06.785922 ignition[642]: no configs at "/usr/lib/ignition/base.d" Jul 15 10:53:06.785932 ignition[642]: no config dir at "/usr/lib/ignition/base.platform.d/openstack" Jul 15 10:53:06.788070 systemd[1]: Finished ignition-fetch-offline.service - Ignition (fetch-offline). Jul 15 10:53:06.786019 ignition[642]: parsed url from cmdline: "" Jul 15 10:53:06.786023 ignition[642]: no config URL provided Jul 15 10:53:06.786029 ignition[642]: reading system config file "/usr/lib/ignition/user.ign" Jul 15 10:53:06.786038 ignition[642]: no config at "/usr/lib/ignition/user.ign" Jul 15 10:53:06.786043 ignition[642]: failed to fetch config: resource requires networking Jul 15 10:53:06.786322 ignition[642]: Ignition finished successfully Jul 15 10:53:06.795519 systemd[1]: Starting ignition-fetch.service - Ignition (fetch)... Jul 15 10:53:06.807011 ignition[718]: Ignition 2.20.0 Jul 15 10:53:06.807026 ignition[718]: Stage: fetch Jul 15 10:53:06.807222 ignition[718]: no configs at "/usr/lib/ignition/base.d" Jul 15 10:53:06.807235 ignition[718]: no config dir at "/usr/lib/ignition/base.platform.d/openstack" Jul 15 10:53:06.807324 ignition[718]: parsed url from cmdline: "" Jul 15 10:53:06.807328 ignition[718]: no config URL provided Jul 15 10:53:06.807333 ignition[718]: reading system config file "/usr/lib/ignition/user.ign" Jul 15 10:53:06.807342 ignition[718]: no config at "/usr/lib/ignition/user.ign" Jul 15 10:53:06.807420 ignition[718]: GET http://169.254.169.254/openstack/latest/user_data: attempt #1 Jul 15 10:53:06.807493 ignition[718]: config drive ("/dev/disk/by-label/config-2") not found. Waiting... Jul 15 10:53:06.807520 ignition[718]: config drive ("/dev/disk/by-label/CONFIG-2") not found. Waiting... Jul 15 10:53:06.992417 ignition[718]: GET result: OK Jul 15 10:53:06.992506 ignition[718]: parsing config with SHA512: 76b4390d21c1b2ed3d8c7bb0b8cf77e91280fd613adb77958c3f139a6ddcdeeae4b2e4e2673328a902a0f1941c831b9eaa32ee0442973fe3d860fc9651a5bc28 Jul 15 10:53:07.009721 unknown[718]: fetched base config from "system" Jul 15 10:53:07.010298 ignition[718]: fetch: fetch complete Jul 15 10:53:07.009746 unknown[718]: fetched base config from "system" Jul 15 10:53:07.010311 ignition[718]: fetch: fetch passed Jul 15 10:53:07.009761 unknown[718]: fetched user config from "openstack" Jul 15 10:53:07.010399 ignition[718]: Ignition finished successfully Jul 15 10:53:07.013701 systemd[1]: Finished ignition-fetch.service - Ignition (fetch). Jul 15 10:53:07.028933 systemd[1]: Starting ignition-kargs.service - Ignition (kargs)... Jul 15 10:53:07.063535 ignition[724]: Ignition 2.20.0 Jul 15 10:53:07.063562 ignition[724]: Stage: kargs Jul 15 10:53:07.063965 ignition[724]: no configs at "/usr/lib/ignition/base.d" Jul 15 10:53:07.063992 ignition[724]: no config dir at "/usr/lib/ignition/base.platform.d/openstack" Jul 15 10:53:07.065730 ignition[724]: kargs: kargs passed Jul 15 10:53:07.069868 systemd[1]: Finished ignition-kargs.service - Ignition (kargs). Jul 15 10:53:07.065825 ignition[724]: Ignition finished successfully Jul 15 10:53:07.080518 systemd[1]: Starting ignition-disks.service - Ignition (disks)... Jul 15 10:53:07.103389 ignition[730]: Ignition 2.20.0 Jul 15 10:53:07.103413 ignition[730]: Stage: disks Jul 15 10:53:07.103822 ignition[730]: no configs at "/usr/lib/ignition/base.d" Jul 15 10:53:07.103848 ignition[730]: no config dir at "/usr/lib/ignition/base.platform.d/openstack" Jul 15 10:53:07.108229 ignition[730]: disks: disks passed Jul 15 10:53:07.108320 ignition[730]: Ignition finished successfully Jul 15 10:53:07.110284 systemd[1]: Finished ignition-disks.service - Ignition (disks). Jul 15 10:53:07.112724 systemd[1]: Reached target initrd-root-device.target - Initrd Root Device. Jul 15 10:53:07.114242 systemd[1]: Reached target local-fs-pre.target - Preparation for Local File Systems. Jul 15 10:53:07.116224 systemd[1]: Reached target local-fs.target - Local File Systems. Jul 15 10:53:07.118040 systemd[1]: Reached target sysinit.target - System Initialization. Jul 15 10:53:07.119827 systemd[1]: Reached target basic.target - Basic System. Jul 15 10:53:07.128388 systemd[1]: Starting systemd-fsck-root.service - File System Check on /dev/disk/by-label/ROOT... Jul 15 10:53:07.150885 systemd-fsck[738]: ROOT: clean, 14/1628000 files, 120691/1617920 blocks Jul 15 10:53:07.161233 systemd[1]: Finished systemd-fsck-root.service - File System Check on /dev/disk/by-label/ROOT. Jul 15 10:53:07.168322 systemd[1]: Mounting sysroot.mount - /sysroot... Jul 15 10:53:07.318155 kernel: EXT4-fs (vda9): mounted filesystem 94753c30-8339-4199-9a73-c3199acfdab5 r/w with ordered data mode. Quota mode: none. Jul 15 10:53:07.318954 systemd[1]: Mounted sysroot.mount - /sysroot. Jul 15 10:53:07.320547 systemd[1]: Reached target initrd-root-fs.target - Initrd Root File System. Jul 15 10:53:07.332331 systemd[1]: Mounting sysroot-oem.mount - /sysroot/oem... Jul 15 10:53:07.336635 systemd[1]: Mounting sysroot-usr.mount - /sysroot/usr... Jul 15 10:53:07.340138 systemd[1]: flatcar-metadata-hostname.service - Flatcar Metadata Hostname Agent was skipped because no trigger condition checks were met. Jul 15 10:53:07.347627 kernel: BTRFS: device label OEM devid 1 transid 12 /dev/vda6 scanned by mount (746) Jul 15 10:53:07.347680 kernel: BTRFS info (device vda6): first mount of filesystem c20e5e0c-dae6-45ce-95fe-16a1362e2f71 Jul 15 10:53:07.350440 systemd[1]: Starting flatcar-openstack-hostname.service - Flatcar OpenStack Metadata Hostname Agent... Jul 15 10:53:07.360645 kernel: BTRFS info (device vda6): using crc32c (crc32c-intel) checksum algorithm Jul 15 10:53:07.360718 kernel: BTRFS info (device vda6): using free space tree Jul 15 10:53:07.360751 kernel: BTRFS info (device vda6): auto enabling async discard Jul 15 10:53:07.361063 systemd[1]: ignition-remount-sysroot.service - Remount /sysroot read-write for Ignition was skipped because of an unmet condition check (ConditionPathIsReadWrite=!/sysroot). Jul 15 10:53:07.361136 systemd[1]: Reached target ignition-diskful.target - Ignition Boot Disk Setup. Jul 15 10:53:07.367298 systemd[1]: Mounted sysroot-oem.mount - /sysroot/oem. Jul 15 10:53:07.368845 systemd[1]: Mounted sysroot-usr.mount - /sysroot/usr. Jul 15 10:53:07.379271 systemd[1]: Starting initrd-setup-root.service - Root filesystem setup... Jul 15 10:53:07.485490 initrd-setup-root[775]: cut: /sysroot/etc/passwd: No such file or directory Jul 15 10:53:07.492458 initrd-setup-root[782]: cut: /sysroot/etc/group: No such file or directory Jul 15 10:53:07.498724 initrd-setup-root[790]: cut: /sysroot/etc/shadow: No such file or directory Jul 15 10:53:07.506980 initrd-setup-root[797]: cut: /sysroot/etc/gshadow: No such file or directory Jul 15 10:53:07.651513 systemd[1]: Finished initrd-setup-root.service - Root filesystem setup. Jul 15 10:53:07.662323 systemd[1]: Starting ignition-mount.service - Ignition (mount)... Jul 15 10:53:07.666450 systemd[1]: Starting sysroot-boot.service - /sysroot/boot... Jul 15 10:53:07.690412 systemd[1]: sysroot-oem.mount: Deactivated successfully. Jul 15 10:53:07.697082 kernel: BTRFS info (device vda6): last unmount of filesystem c20e5e0c-dae6-45ce-95fe-16a1362e2f71 Jul 15 10:53:07.734820 ignition[864]: INFO : Ignition 2.20.0 Jul 15 10:53:07.734820 ignition[864]: INFO : Stage: mount Jul 15 10:53:07.737473 ignition[864]: INFO : no configs at "/usr/lib/ignition/base.d" Jul 15 10:53:07.737473 ignition[864]: INFO : no config dir at "/usr/lib/ignition/base.platform.d/openstack" Jul 15 10:53:07.737473 ignition[864]: INFO : mount: mount passed Jul 15 10:53:07.737473 ignition[864]: INFO : Ignition finished successfully Jul 15 10:53:07.737755 systemd[1]: Finished sysroot-boot.service - /sysroot/boot. Jul 15 10:53:07.738941 systemd[1]: Finished ignition-mount.service - Ignition (mount). Jul 15 10:53:08.304715 systemd-networkd[706]: eth0: Gained IPv6LL Jul 15 10:53:14.564037 coreos-metadata[748]: Jul 15 10:53:14.563 WARN failed to locate config-drive, using the metadata service API instead Jul 15 10:53:14.618660 coreos-metadata[748]: Jul 15 10:53:14.618 INFO Fetching http://169.254.169.254/latest/meta-data/hostname: Attempt #1 Jul 15 10:53:14.634684 coreos-metadata[748]: Jul 15 10:53:14.634 INFO Fetch successful Jul 15 10:53:14.636967 coreos-metadata[748]: Jul 15 10:53:14.635 INFO wrote hostname ci-4230-2-100-4f60b27630.novalocal to /sysroot/etc/hostname Jul 15 10:53:14.641346 systemd[1]: flatcar-openstack-hostname.service: Deactivated successfully. Jul 15 10:53:14.641586 systemd[1]: Finished flatcar-openstack-hostname.service - Flatcar OpenStack Metadata Hostname Agent. Jul 15 10:53:14.653304 systemd[1]: Starting ignition-files.service - Ignition (files)... Jul 15 10:53:14.685759 systemd[1]: Mounting sysroot-oem.mount - /sysroot/oem... Jul 15 10:53:14.704224 kernel: BTRFS: device label OEM devid 1 transid 13 /dev/vda6 scanned by mount (882) Jul 15 10:53:14.712037 kernel: BTRFS info (device vda6): first mount of filesystem c20e5e0c-dae6-45ce-95fe-16a1362e2f71 Jul 15 10:53:14.712147 kernel: BTRFS info (device vda6): using crc32c (crc32c-intel) checksum algorithm Jul 15 10:53:14.716225 kernel: BTRFS info (device vda6): using free space tree Jul 15 10:53:14.728290 kernel: BTRFS info (device vda6): auto enabling async discard Jul 15 10:53:14.736896 systemd[1]: Mounted sysroot-oem.mount - /sysroot/oem. Jul 15 10:53:14.783086 ignition[900]: INFO : Ignition 2.20.0 Jul 15 10:53:14.784001 ignition[900]: INFO : Stage: files Jul 15 10:53:14.784716 ignition[900]: INFO : no configs at "/usr/lib/ignition/base.d" Jul 15 10:53:14.785446 ignition[900]: INFO : no config dir at "/usr/lib/ignition/base.platform.d/openstack" Jul 15 10:53:14.786972 ignition[900]: DEBUG : files: compiled without relabeling support, skipping Jul 15 10:53:14.788626 ignition[900]: INFO : files: ensureUsers: op(1): [started] creating or modifying user "core" Jul 15 10:53:14.788626 ignition[900]: DEBUG : files: ensureUsers: op(1): executing: "usermod" "--root" "/sysroot" "core" Jul 15 10:53:14.793417 ignition[900]: INFO : files: ensureUsers: op(1): [finished] creating or modifying user "core" Jul 15 10:53:14.794436 ignition[900]: INFO : files: ensureUsers: op(2): [started] adding ssh keys to user "core" Jul 15 10:53:14.795402 ignition[900]: INFO : files: ensureUsers: op(2): [finished] adding ssh keys to user "core" Jul 15 10:53:14.795379 unknown[900]: wrote ssh authorized keys file for user: core Jul 15 10:53:14.802999 ignition[900]: INFO : files: createFilesystemsFiles: createFiles: op(3): [started] writing file "/sysroot/etc/flatcar/update.conf" Jul 15 10:53:14.804154 ignition[900]: INFO : files: createFilesystemsFiles: createFiles: op(3): [finished] writing file "/sysroot/etc/flatcar/update.conf" Jul 15 10:53:14.804154 ignition[900]: INFO : files: op(4): [started] processing unit "coreos-metadata.service" Jul 15 10:53:14.806958 ignition[900]: INFO : files: op(4): op(5): [started] writing systemd drop-in "20-clct-provider-override.conf" at "/sysroot/etc/systemd/system/coreos-metadata.service.d/20-clct-provider-override.conf" Jul 15 10:53:14.808401 ignition[900]: INFO : files: op(4): op(5): [finished] writing systemd drop-in "20-clct-provider-override.conf" at "/sysroot/etc/systemd/system/coreos-metadata.service.d/20-clct-provider-override.conf" Jul 15 10:53:14.808401 ignition[900]: INFO : files: op(4): [finished] processing unit "coreos-metadata.service" Jul 15 10:53:14.808401 ignition[900]: INFO : files: op(6): [started] processing unit "coreos-metadata-sshkeys@.service" Jul 15 10:53:14.808401 ignition[900]: INFO : files: op(6): op(7): [started] writing systemd drop-in "20-clct-provider-override.conf" at "/sysroot/etc/systemd/system/coreos-metadata-sshkeys@.service.d/20-clct-provider-override.conf" Jul 15 10:53:14.812904 ignition[900]: INFO : files: op(6): op(7): [finished] writing systemd drop-in "20-clct-provider-override.conf" at "/sysroot/etc/systemd/system/coreos-metadata-sshkeys@.service.d/20-clct-provider-override.conf" Jul 15 10:53:14.812904 ignition[900]: INFO : files: op(6): [finished] processing unit "coreos-metadata-sshkeys@.service" Jul 15 10:53:14.812904 ignition[900]: INFO : files: op(8): [started] processing unit "etcd-member.service" Jul 15 10:53:14.812904 ignition[900]: INFO : files: op(8): op(9): [started] writing systemd drop-in "20-clct-etcd-member.conf" at "/sysroot/etc/systemd/system/etcd-member.service.d/20-clct-etcd-member.conf" Jul 15 10:53:14.812904 ignition[900]: INFO : files: op(8): op(9): [finished] writing systemd drop-in "20-clct-etcd-member.conf" at "/sysroot/etc/systemd/system/etcd-member.service.d/20-clct-etcd-member.conf" Jul 15 10:53:14.812904 ignition[900]: INFO : files: op(8): [finished] processing unit "etcd-member.service" Jul 15 10:53:14.812904 ignition[900]: INFO : files: op(a): [started] setting preset to enabled for "coreos-metadata-sshkeys@.service " Jul 15 10:53:14.812904 ignition[900]: INFO : files: op(a): [finished] setting preset to enabled for "coreos-metadata-sshkeys@.service " Jul 15 10:53:14.812904 ignition[900]: INFO : files: op(b): [started] setting preset to enabled for "etcd-member.service" Jul 15 10:53:14.812904 ignition[900]: INFO : files: op(b): [finished] setting preset to enabled for "etcd-member.service" Jul 15 10:53:14.828781 ignition[900]: INFO : files: createResultFile: createFiles: op(c): [started] writing file "/sysroot/etc/.ignition-result.json" Jul 15 10:53:14.828781 ignition[900]: INFO : files: createResultFile: createFiles: op(c): [finished] writing file "/sysroot/etc/.ignition-result.json" Jul 15 10:53:14.828781 ignition[900]: INFO : files: files passed Jul 15 10:53:14.828781 ignition[900]: INFO : Ignition finished successfully Jul 15 10:53:14.831655 systemd[1]: Finished ignition-files.service - Ignition (files). Jul 15 10:53:14.850380 systemd[1]: Starting ignition-quench.service - Ignition (record completion)... Jul 15 10:53:14.853832 systemd[1]: Starting initrd-setup-root-after-ignition.service - Root filesystem completion... Jul 15 10:53:14.856856 systemd[1]: ignition-quench.service: Deactivated successfully. Jul 15 10:53:14.856948 systemd[1]: Finished ignition-quench.service - Ignition (record completion). Jul 15 10:53:14.887764 initrd-setup-root-after-ignition[928]: grep: /sysroot/etc/flatcar/enabled-sysext.conf: No such file or directory Jul 15 10:53:14.887764 initrd-setup-root-after-ignition[928]: grep: /sysroot/usr/share/flatcar/enabled-sysext.conf: No such file or directory Jul 15 10:53:14.889619 initrd-setup-root-after-ignition[932]: grep: /sysroot/etc/flatcar/enabled-sysext.conf: No such file or directory Jul 15 10:53:14.893255 systemd[1]: Finished initrd-setup-root-after-ignition.service - Root filesystem completion. Jul 15 10:53:14.897444 systemd[1]: Reached target ignition-complete.target - Ignition Complete. Jul 15 10:53:14.904351 systemd[1]: Starting initrd-parse-etc.service - Mountpoints Configured in the Real Root... Jul 15 10:53:14.943663 systemd[1]: initrd-parse-etc.service: Deactivated successfully. Jul 15 10:53:14.943918 systemd[1]: Finished initrd-parse-etc.service - Mountpoints Configured in the Real Root. Jul 15 10:53:14.947281 systemd[1]: Reached target initrd-fs.target - Initrd File Systems. Jul 15 10:53:14.949639 systemd[1]: Reached target initrd.target - Initrd Default Target. Jul 15 10:53:14.952485 systemd[1]: dracut-mount.service - dracut mount hook was skipped because no trigger condition checks were met. Jul 15 10:53:14.962498 systemd[1]: Starting dracut-pre-pivot.service - dracut pre-pivot and cleanup hook... Jul 15 10:53:14.988789 systemd[1]: Finished dracut-pre-pivot.service - dracut pre-pivot and cleanup hook. Jul 15 10:53:15.002482 systemd[1]: Starting initrd-cleanup.service - Cleaning Up and Shutting Down Daemons... Jul 15 10:53:15.026661 systemd[1]: Stopped target nss-lookup.target - Host and Network Name Lookups. Jul 15 10:53:15.028412 systemd[1]: Stopped target remote-cryptsetup.target - Remote Encrypted Volumes. Jul 15 10:53:15.031461 systemd[1]: Stopped target timers.target - Timer Units. Jul 15 10:53:15.043691 systemd[1]: dracut-pre-pivot.service: Deactivated successfully. Jul 15 10:53:15.043998 systemd[1]: Stopped dracut-pre-pivot.service - dracut pre-pivot and cleanup hook. Jul 15 10:53:15.046855 systemd[1]: Stopped target initrd.target - Initrd Default Target. Jul 15 10:53:15.048645 systemd[1]: Stopped target basic.target - Basic System. Jul 15 10:53:15.051444 systemd[1]: Stopped target ignition-complete.target - Ignition Complete. Jul 15 10:53:15.053915 systemd[1]: Stopped target ignition-diskful.target - Ignition Boot Disk Setup. Jul 15 10:53:15.056443 systemd[1]: Stopped target initrd-root-device.target - Initrd Root Device. Jul 15 10:53:15.059312 systemd[1]: Stopped target remote-fs.target - Remote File Systems. Jul 15 10:53:15.062098 systemd[1]: Stopped target remote-fs-pre.target - Preparation for Remote File Systems. Jul 15 10:53:15.065085 systemd[1]: Stopped target sysinit.target - System Initialization. Jul 15 10:53:15.067867 systemd[1]: Stopped target local-fs.target - Local File Systems. Jul 15 10:53:15.070757 systemd[1]: Stopped target swap.target - Swaps. Jul 15 10:53:15.073358 systemd[1]: dracut-pre-mount.service: Deactivated successfully. Jul 15 10:53:15.073645 systemd[1]: Stopped dracut-pre-mount.service - dracut pre-mount hook. Jul 15 10:53:15.076688 systemd[1]: Stopped target cryptsetup.target - Local Encrypted Volumes. Jul 15 10:53:15.078698 systemd[1]: Stopped target cryptsetup-pre.target - Local Encrypted Volumes (Pre). Jul 15 10:53:15.081041 systemd[1]: clevis-luks-askpass.path: Deactivated successfully. Jul 15 10:53:15.081779 systemd[1]: Stopped clevis-luks-askpass.path - Forward Password Requests to Clevis Directory Watch. Jul 15 10:53:15.084044 systemd[1]: dracut-initqueue.service: Deactivated successfully. Jul 15 10:53:15.084480 systemd[1]: Stopped dracut-initqueue.service - dracut initqueue hook. Jul 15 10:53:15.088095 systemd[1]: initrd-setup-root-after-ignition.service: Deactivated successfully. Jul 15 10:53:15.088453 systemd[1]: Stopped initrd-setup-root-after-ignition.service - Root filesystem completion. Jul 15 10:53:15.091354 systemd[1]: ignition-files.service: Deactivated successfully. Jul 15 10:53:15.091620 systemd[1]: Stopped ignition-files.service - Ignition (files). Jul 15 10:53:15.102629 systemd[1]: Stopping ignition-mount.service - Ignition (mount)... Jul 15 10:53:15.104619 systemd[1]: kmod-static-nodes.service: Deactivated successfully. Jul 15 10:53:15.105700 systemd[1]: Stopped kmod-static-nodes.service - Create List of Static Device Nodes. Jul 15 10:53:15.117355 systemd[1]: Stopping sysroot-boot.service - /sysroot/boot... Jul 15 10:53:15.118961 systemd[1]: systemd-udev-trigger.service: Deactivated successfully. Jul 15 10:53:15.121364 systemd[1]: Stopped systemd-udev-trigger.service - Coldplug All udev Devices. Jul 15 10:53:15.125480 systemd[1]: dracut-pre-trigger.service: Deactivated successfully. Jul 15 10:53:15.125868 systemd[1]: Stopped dracut-pre-trigger.service - dracut pre-trigger hook. Jul 15 10:53:15.133815 systemd[1]: initrd-cleanup.service: Deactivated successfully. Jul 15 10:53:15.135537 systemd[1]: Finished initrd-cleanup.service - Cleaning Up and Shutting Down Daemons. Jul 15 10:53:15.142008 ignition[952]: INFO : Ignition 2.20.0 Jul 15 10:53:15.142008 ignition[952]: INFO : Stage: umount Jul 15 10:53:15.142008 ignition[952]: INFO : no configs at "/usr/lib/ignition/base.d" Jul 15 10:53:15.142008 ignition[952]: INFO : no config dir at "/usr/lib/ignition/base.platform.d/openstack" Jul 15 10:53:15.142008 ignition[952]: INFO : umount: umount passed Jul 15 10:53:15.142008 ignition[952]: INFO : Ignition finished successfully Jul 15 10:53:15.144332 systemd[1]: ignition-mount.service: Deactivated successfully. Jul 15 10:53:15.144452 systemd[1]: Stopped ignition-mount.service - Ignition (mount). Jul 15 10:53:15.145995 systemd[1]: ignition-disks.service: Deactivated successfully. Jul 15 10:53:15.146064 systemd[1]: Stopped ignition-disks.service - Ignition (disks). Jul 15 10:53:15.149129 systemd[1]: ignition-kargs.service: Deactivated successfully. Jul 15 10:53:15.149174 systemd[1]: Stopped ignition-kargs.service - Ignition (kargs). Jul 15 10:53:15.150596 systemd[1]: ignition-fetch.service: Deactivated successfully. Jul 15 10:53:15.150640 systemd[1]: Stopped ignition-fetch.service - Ignition (fetch). Jul 15 10:53:15.151213 systemd[1]: Stopped target network.target - Network. Jul 15 10:53:15.151700 systemd[1]: ignition-fetch-offline.service: Deactivated successfully. Jul 15 10:53:15.151746 systemd[1]: Stopped ignition-fetch-offline.service - Ignition (fetch-offline). Jul 15 10:53:15.153329 systemd[1]: Stopped target paths.target - Path Units. Jul 15 10:53:15.153810 systemd[1]: systemd-ask-password-console.path: Deactivated successfully. Jul 15 10:53:15.158366 systemd[1]: Stopped systemd-ask-password-console.path - Dispatch Password Requests to Console Directory Watch. Jul 15 10:53:15.159199 systemd[1]: Stopped target slices.target - Slice Units. Jul 15 10:53:15.159698 systemd[1]: Stopped target sockets.target - Socket Units. Jul 15 10:53:15.160887 systemd[1]: iscsid.socket: Deactivated successfully. Jul 15 10:53:15.160927 systemd[1]: Closed iscsid.socket - Open-iSCSI iscsid Socket. Jul 15 10:53:15.161977 systemd[1]: iscsiuio.socket: Deactivated successfully. Jul 15 10:53:15.162011 systemd[1]: Closed iscsiuio.socket - Open-iSCSI iscsiuio Socket. Jul 15 10:53:15.163246 systemd[1]: ignition-setup.service: Deactivated successfully. Jul 15 10:53:15.163297 systemd[1]: Stopped ignition-setup.service - Ignition (setup). Jul 15 10:53:15.164524 systemd[1]: ignition-setup-pre.service: Deactivated successfully. Jul 15 10:53:15.164580 systemd[1]: Stopped ignition-setup-pre.service - Ignition env setup. Jul 15 10:53:15.165646 systemd[1]: Stopping systemd-networkd.service - Network Configuration... Jul 15 10:53:15.166673 systemd[1]: Stopping systemd-resolved.service - Network Name Resolution... Jul 15 10:53:15.169576 systemd[1]: sysroot-boot.mount: Deactivated successfully. Jul 15 10:53:15.170264 systemd[1]: systemd-resolved.service: Deactivated successfully. Jul 15 10:53:15.170369 systemd[1]: Stopped systemd-resolved.service - Network Name Resolution. Jul 15 10:53:15.173501 systemd[1]: run-credentials-systemd\x2dresolved.service.mount: Deactivated successfully. Jul 15 10:53:15.173712 systemd[1]: sysroot-boot.service: Deactivated successfully. Jul 15 10:53:15.173809 systemd[1]: Stopped sysroot-boot.service - /sysroot/boot. Jul 15 10:53:15.175718 systemd[1]: systemd-networkd.service: Deactivated successfully. Jul 15 10:53:15.175799 systemd[1]: Stopped systemd-networkd.service - Network Configuration. Jul 15 10:53:15.177871 systemd[1]: run-credentials-systemd\x2dnetworkd.service.mount: Deactivated successfully. Jul 15 10:53:15.179093 systemd[1]: systemd-networkd.socket: Deactivated successfully. Jul 15 10:53:15.179505 systemd[1]: Closed systemd-networkd.socket - Network Service Netlink Socket. Jul 15 10:53:15.180375 systemd[1]: initrd-setup-root.service: Deactivated successfully. Jul 15 10:53:15.180423 systemd[1]: Stopped initrd-setup-root.service - Root filesystem setup. Jul 15 10:53:15.186215 systemd[1]: Stopping network-cleanup.service - Network Cleanup... Jul 15 10:53:15.186706 systemd[1]: parse-ip-for-networkd.service: Deactivated successfully. Jul 15 10:53:15.186764 systemd[1]: Stopped parse-ip-for-networkd.service - Write systemd-networkd units from cmdline. Jul 15 10:53:15.187368 systemd[1]: systemd-sysctl.service: Deactivated successfully. Jul 15 10:53:15.187415 systemd[1]: Stopped systemd-sysctl.service - Apply Kernel Variables. Jul 15 10:53:15.188433 systemd[1]: systemd-modules-load.service: Deactivated successfully. Jul 15 10:53:15.188474 systemd[1]: Stopped systemd-modules-load.service - Load Kernel Modules. Jul 15 10:53:15.189436 systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. Jul 15 10:53:15.189476 systemd[1]: Stopped systemd-tmpfiles-setup.service - Create System Files and Directories. Jul 15 10:53:15.190925 systemd[1]: Stopping systemd-udevd.service - Rule-based Manager for Device Events and Files... Jul 15 10:53:15.193013 systemd[1]: run-credentials-systemd\x2dsysctl.service.mount: Deactivated successfully. Jul 15 10:53:15.193084 systemd[1]: run-credentials-systemd\x2dtmpfiles\x2dsetup.service.mount: Deactivated successfully. Jul 15 10:53:15.207554 systemd[1]: systemd-udevd.service: Deactivated successfully. Jul 15 10:53:15.207695 systemd[1]: Stopped systemd-udevd.service - Rule-based Manager for Device Events and Files. Jul 15 10:53:15.209376 systemd[1]: systemd-udevd-control.socket: Deactivated successfully. Jul 15 10:53:15.209431 systemd[1]: Closed systemd-udevd-control.socket - udev Control Socket. Jul 15 10:53:15.210391 systemd[1]: systemd-udevd-kernel.socket: Deactivated successfully. Jul 15 10:53:15.210427 systemd[1]: Closed systemd-udevd-kernel.socket - udev Kernel Socket. Jul 15 10:53:15.211532 systemd[1]: dracut-pre-udev.service: Deactivated successfully. Jul 15 10:53:15.211580 systemd[1]: Stopped dracut-pre-udev.service - dracut pre-udev hook. Jul 15 10:53:15.213379 systemd[1]: dracut-cmdline.service: Deactivated successfully. Jul 15 10:53:15.213441 systemd[1]: Stopped dracut-cmdline.service - dracut cmdline hook. Jul 15 10:53:15.214588 systemd[1]: dracut-cmdline-ask.service: Deactivated successfully. Jul 15 10:53:15.214635 systemd[1]: Stopped dracut-cmdline-ask.service - dracut ask for additional cmdline parameters. Jul 15 10:53:15.225469 systemd[1]: Starting initrd-udevadm-cleanup-db.service - Cleanup udev Database... Jul 15 10:53:15.226001 systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. Jul 15 10:53:15.226057 systemd[1]: Stopped systemd-tmpfiles-setup-dev.service - Create Static Device Nodes in /dev. Jul 15 10:53:15.226789 systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. Jul 15 10:53:15.226837 systemd[1]: Stopped systemd-vconsole-setup.service - Virtual Console Setup. Jul 15 10:53:15.229758 systemd[1]: network-cleanup.service: Deactivated successfully. Jul 15 10:53:15.229860 systemd[1]: Stopped network-cleanup.service - Network Cleanup. Jul 15 10:53:15.230870 systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. Jul 15 10:53:15.230957 systemd[1]: Finished initrd-udevadm-cleanup-db.service - Cleanup udev Database. Jul 15 10:53:15.232620 systemd[1]: Reached target initrd-switch-root.target - Switch Root. Jul 15 10:53:15.245254 systemd[1]: Starting initrd-switch-root.service - Switch Root... Jul 15 10:53:15.252032 systemd[1]: Switching root. Jul 15 10:53:15.286204 systemd-journald[184]: Journal stopped Jul 15 10:53:16.809238 systemd-journald[184]: Received SIGTERM from PID 1 (systemd). Jul 15 10:53:16.809338 kernel: SELinux: policy capability network_peer_controls=1 Jul 15 10:53:16.809357 kernel: SELinux: policy capability open_perms=1 Jul 15 10:53:16.809370 kernel: SELinux: policy capability extended_socket_class=1 Jul 15 10:53:16.809382 kernel: SELinux: policy capability always_check_network=0 Jul 15 10:53:16.809398 kernel: SELinux: policy capability cgroup_seclabel=1 Jul 15 10:53:16.809411 kernel: SELinux: policy capability nnp_nosuid_transition=1 Jul 15 10:53:16.809423 kernel: SELinux: policy capability genfs_seclabel_symlinks=0 Jul 15 10:53:16.809435 kernel: SELinux: policy capability ioctl_skip_cloexec=0 Jul 15 10:53:16.809450 systemd[1]: Successfully loaded SELinux policy in 69.356ms. Jul 15 10:53:16.809470 kernel: audit: type=1403 audit(1752576795.441:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 Jul 15 10:53:16.809487 systemd[1]: Relabeled /dev/, /dev/shm/, /run/ in 36.428ms. Jul 15 10:53:16.809502 systemd[1]: systemd 256.8 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL -ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 -PWQUALITY -P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK -XKBCOMMON +UTMP -SYSVINIT +LIBARCHIVE) Jul 15 10:53:16.809516 systemd[1]: Detected virtualization kvm. Jul 15 10:53:16.809530 systemd[1]: Detected architecture x86-64. Jul 15 10:53:16.809542 systemd[1]: Detected first boot. Jul 15 10:53:16.809558 systemd[1]: Hostname set to . Jul 15 10:53:16.809572 systemd[1]: Initializing machine ID from VM UUID. Jul 15 10:53:16.809585 zram_generator::config[997]: No configuration found. Jul 15 10:53:16.809599 kernel: Guest personality initialized and is inactive Jul 15 10:53:16.809611 kernel: VMCI host device registered (name=vmci, major=10, minor=125) Jul 15 10:53:16.809624 kernel: Initialized host personality Jul 15 10:53:16.809635 kernel: NET: Registered PF_VSOCK protocol family Jul 15 10:53:16.809648 systemd[1]: Populated /etc with preset unit settings. Jul 15 10:53:16.809666 systemd[1]: run-credentials-systemd\x2djournald.service.mount: Deactivated successfully. Jul 15 10:53:16.809679 systemd[1]: initrd-switch-root.service: Deactivated successfully. Jul 15 10:53:16.809692 systemd[1]: Stopped initrd-switch-root.service - Switch Root. Jul 15 10:53:16.809705 systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. Jul 15 10:53:16.809719 systemd[1]: Created slice system-addon\x2dconfig.slice - Slice /system/addon-config. Jul 15 10:53:16.809736 systemd[1]: Created slice system-addon\x2drun.slice - Slice /system/addon-run. Jul 15 10:53:16.809750 systemd[1]: Created slice system-coreos\x2dmetadata\x2dsshkeys.slice - Slice /system/coreos-metadata-sshkeys. Jul 15 10:53:16.809768 systemd[1]: Created slice system-getty.slice - Slice /system/getty. Jul 15 10:53:16.809781 systemd[1]: Created slice system-modprobe.slice - Slice /system/modprobe. Jul 15 10:53:16.809796 systemd[1]: Created slice system-serial\x2dgetty.slice - Slice /system/serial-getty. Jul 15 10:53:16.809810 systemd[1]: Created slice system-system\x2dcloudinit.slice - Slice /system/system-cloudinit. Jul 15 10:53:16.809823 systemd[1]: Created slice system-systemd\x2dfsck.slice - Slice /system/systemd-fsck. Jul 15 10:53:16.809837 systemd[1]: Created slice user.slice - User and Session Slice. Jul 15 10:53:16.809850 systemd[1]: Started clevis-luks-askpass.path - Forward Password Requests to Clevis Directory Watch. Jul 15 10:53:16.809864 systemd[1]: Started systemd-ask-password-console.path - Dispatch Password Requests to Console Directory Watch. Jul 15 10:53:16.809877 systemd[1]: Started systemd-ask-password-wall.path - Forward Password Requests to Wall Directory Watch. Jul 15 10:53:16.809907 systemd[1]: Set up automount boot.automount - Boot partition Automount Point. Jul 15 10:53:16.809936 systemd[1]: Set up automount proc-sys-fs-binfmt_misc.automount - Arbitrary Executable File Formats File System Automount Point. Jul 15 10:53:16.809951 systemd[1]: Expecting device dev-disk-by\x2dlabel-OEM.device - /dev/disk/by-label/OEM... Jul 15 10:53:16.809965 systemd[1]: Expecting device dev-ttyS0.device - /dev/ttyS0... Jul 15 10:53:16.809978 systemd[1]: Reached target cryptsetup-pre.target - Local Encrypted Volumes (Pre). Jul 15 10:53:16.809991 systemd[1]: Stopped target initrd-switch-root.target - Switch Root. Jul 15 10:53:16.810005 systemd[1]: Stopped target initrd-fs.target - Initrd File Systems. Jul 15 10:53:16.810021 systemd[1]: Stopped target initrd-root-fs.target - Initrd Root File System. Jul 15 10:53:16.810036 systemd[1]: Reached target integritysetup.target - Local Integrity Protected Volumes. Jul 15 10:53:16.810052 systemd[1]: Reached target remote-cryptsetup.target - Remote Encrypted Volumes. Jul 15 10:53:16.810066 systemd[1]: Reached target remote-fs.target - Remote File Systems. Jul 15 10:53:16.810080 systemd[1]: Reached target slices.target - Slice Units. Jul 15 10:53:16.810093 systemd[1]: Reached target swap.target - Swaps. Jul 15 10:53:16.810150 systemd[1]: Reached target veritysetup.target - Local Verity Protected Volumes. Jul 15 10:53:16.810212 systemd[1]: Listening on systemd-coredump.socket - Process Core Dump Socket. Jul 15 10:53:16.810226 systemd[1]: Listening on systemd-creds.socket - Credential Encryption/Decryption. Jul 15 10:53:16.810240 systemd[1]: Listening on systemd-networkd.socket - Network Service Netlink Socket. Jul 15 10:53:16.810258 systemd[1]: Listening on systemd-udevd-control.socket - udev Control Socket. Jul 15 10:53:16.810271 systemd[1]: Listening on systemd-udevd-kernel.socket - udev Kernel Socket. Jul 15 10:53:16.810283 systemd[1]: Listening on systemd-userdbd.socket - User Database Manager Socket. Jul 15 10:53:16.810297 systemd[1]: Mounting dev-hugepages.mount - Huge Pages File System... Jul 15 10:53:16.810310 systemd[1]: Mounting dev-mqueue.mount - POSIX Message Queue File System... Jul 15 10:53:16.810323 systemd[1]: Mounting media.mount - External Media Directory... Jul 15 10:53:16.810337 systemd[1]: proc-xen.mount - /proc/xen was skipped because of an unmet condition check (ConditionVirtualization=xen). Jul 15 10:53:16.810350 systemd[1]: Mounting sys-kernel-debug.mount - Kernel Debug File System... Jul 15 10:53:16.810364 systemd[1]: Mounting sys-kernel-tracing.mount - Kernel Trace File System... Jul 15 10:53:16.810380 systemd[1]: Mounting tmp.mount - Temporary Directory /tmp... Jul 15 10:53:16.810394 systemd[1]: var-lib-machines.mount - Virtual Machine and Container Storage (Compatibility) was skipped because of an unmet condition check (ConditionPathExists=/var/lib/machines.raw). Jul 15 10:53:16.810407 systemd[1]: Reached target machines.target - Containers. Jul 15 10:53:16.810421 systemd[1]: Starting flatcar-tmpfiles.service - Create missing system files... Jul 15 10:53:16.810434 systemd[1]: ignition-delete-config.service - Ignition (delete config) was skipped because no trigger condition checks were met. Jul 15 10:53:16.810448 systemd[1]: Starting kmod-static-nodes.service - Create List of Static Device Nodes... Jul 15 10:53:16.810461 systemd[1]: Starting modprobe@configfs.service - Load Kernel Module configfs... Jul 15 10:53:16.810474 systemd[1]: Starting modprobe@dm_mod.service - Load Kernel Module dm_mod... Jul 15 10:53:16.810490 systemd[1]: Starting modprobe@drm.service - Load Kernel Module drm... Jul 15 10:53:16.810503 systemd[1]: Starting modprobe@efi_pstore.service - Load Kernel Module efi_pstore... Jul 15 10:53:16.810517 systemd[1]: Starting modprobe@fuse.service - Load Kernel Module fuse... Jul 15 10:53:16.810530 systemd[1]: Starting modprobe@loop.service - Load Kernel Module loop... Jul 15 10:53:16.810544 systemd[1]: setup-nsswitch.service - Create /etc/nsswitch.conf was skipped because of an unmet condition check (ConditionPathExists=!/etc/nsswitch.conf). Jul 15 10:53:16.810557 systemd[1]: systemd-fsck-root.service: Deactivated successfully. Jul 15 10:53:16.810570 systemd[1]: Stopped systemd-fsck-root.service - File System Check on Root Device. Jul 15 10:53:16.810583 systemd[1]: systemd-fsck-usr.service: Deactivated successfully. Jul 15 10:53:16.810599 systemd[1]: Stopped systemd-fsck-usr.service. Jul 15 10:53:16.810613 systemd[1]: systemd-hibernate-clear.service - Clear Stale Hibernate Storage Info was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67). Jul 15 10:53:16.810627 systemd[1]: Starting systemd-journald.service - Journal Service... Jul 15 10:53:16.810640 kernel: loop: module loaded Jul 15 10:53:16.810653 systemd[1]: Starting systemd-modules-load.service - Load Kernel Modules... Jul 15 10:53:16.810665 kernel: fuse: init (API version 7.39) Jul 15 10:53:16.810678 systemd[1]: Starting systemd-network-generator.service - Generate network units from Kernel command line... Jul 15 10:53:16.810692 systemd[1]: Starting systemd-remount-fs.service - Remount Root and Kernel File Systems... Jul 15 10:53:16.810706 systemd[1]: Starting systemd-udev-load-credentials.service - Load udev Rules from Credentials... Jul 15 10:53:16.810722 kernel: ACPI: bus type drm_connector registered Jul 15 10:53:16.810735 systemd[1]: Starting systemd-udev-trigger.service - Coldplug All udev Devices... Jul 15 10:53:16.810748 systemd[1]: verity-setup.service: Deactivated successfully. Jul 15 10:53:16.810763 systemd[1]: Stopped verity-setup.service. Jul 15 10:53:16.810776 systemd[1]: xenserver-pv-version.service - Set fake PV driver version for XenServer was skipped because of an unmet condition check (ConditionVirtualization=xen). Jul 15 10:53:16.810789 systemd[1]: Mounted dev-hugepages.mount - Huge Pages File System. Jul 15 10:53:16.810801 systemd[1]: Mounted dev-mqueue.mount - POSIX Message Queue File System. Jul 15 10:53:16.810816 systemd[1]: Mounted media.mount - External Media Directory. Jul 15 10:53:16.810829 systemd[1]: Mounted sys-kernel-debug.mount - Kernel Debug File System. Jul 15 10:53:16.810844 systemd[1]: Mounted sys-kernel-tracing.mount - Kernel Trace File System. Jul 15 10:53:16.810858 systemd[1]: Mounted tmp.mount - Temporary Directory /tmp. Jul 15 10:53:16.810898 systemd-journald[1091]: Collecting audit messages is disabled. Jul 15 10:53:16.810928 systemd[1]: Finished flatcar-tmpfiles.service - Create missing system files. Jul 15 10:53:16.810941 systemd[1]: Finished kmod-static-nodes.service - Create List of Static Device Nodes. Jul 15 10:53:16.810954 systemd[1]: modprobe@configfs.service: Deactivated successfully. Jul 15 10:53:16.810967 systemd[1]: Finished modprobe@configfs.service - Load Kernel Module configfs. Jul 15 10:53:16.810979 systemd[1]: modprobe@dm_mod.service: Deactivated successfully. Jul 15 10:53:16.810993 systemd-journald[1091]: Journal started Jul 15 10:53:16.811020 systemd-journald[1091]: Runtime Journal (/run/log/journal/8656991f64d94efe857774bcacd72dea) is 8M, max 78.3M, 70.3M free. Jul 15 10:53:16.348447 systemd[1]: Queued start job for default target multi-user.target. Jul 15 10:53:16.360461 systemd[1]: Unnecessary job was removed for dev-vda6.device - /dev/vda6. Jul 15 10:53:16.360999 systemd[1]: systemd-journald.service: Deactivated successfully. Jul 15 10:53:16.814042 systemd[1]: Finished modprobe@dm_mod.service - Load Kernel Module dm_mod. Jul 15 10:53:16.816144 systemd[1]: Started systemd-journald.service - Journal Service. Jul 15 10:53:16.817457 systemd[1]: modprobe@drm.service: Deactivated successfully. Jul 15 10:53:16.817632 systemd[1]: Finished modprobe@drm.service - Load Kernel Module drm. Jul 15 10:53:16.818708 systemd[1]: modprobe@efi_pstore.service: Deactivated successfully. Jul 15 10:53:16.818936 systemd[1]: Finished modprobe@efi_pstore.service - Load Kernel Module efi_pstore. Jul 15 10:53:16.820010 systemd[1]: modprobe@fuse.service: Deactivated successfully. Jul 15 10:53:16.820292 systemd[1]: Finished modprobe@fuse.service - Load Kernel Module fuse. Jul 15 10:53:16.821454 systemd[1]: modprobe@loop.service: Deactivated successfully. Jul 15 10:53:16.821729 systemd[1]: Finished modprobe@loop.service - Load Kernel Module loop. Jul 15 10:53:16.822839 systemd[1]: Finished systemd-modules-load.service - Load Kernel Modules. Jul 15 10:53:16.823990 systemd[1]: Finished systemd-network-generator.service - Generate network units from Kernel command line. Jul 15 10:53:16.825089 systemd[1]: Finished systemd-remount-fs.service - Remount Root and Kernel File Systems. Jul 15 10:53:16.826373 systemd[1]: Finished systemd-udev-load-credentials.service - Load udev Rules from Credentials. Jul 15 10:53:16.838991 systemd[1]: Reached target network-pre.target - Preparation for Network. Jul 15 10:53:16.848241 systemd[1]: Mounting sys-fs-fuse-connections.mount - FUSE Control File System... Jul 15 10:53:16.854193 systemd[1]: Mounting sys-kernel-config.mount - Kernel Configuration File System... Jul 15 10:53:16.855216 systemd[1]: remount-root.service - Remount Root File System was skipped because of an unmet condition check (ConditionPathIsReadWrite=!/). Jul 15 10:53:16.855256 systemd[1]: Reached target local-fs.target - Local File Systems. Jul 15 10:53:16.858960 systemd[1]: Listening on systemd-sysext.socket - System Extension Image Management. Jul 15 10:53:16.864995 systemd[1]: Starting dracut-shutdown.service - Restore /run/initramfs on shutdown... Jul 15 10:53:16.872230 systemd[1]: Starting ldconfig.service - Rebuild Dynamic Linker Cache... Jul 15 10:53:16.872892 systemd[1]: systemd-binfmt.service - Set Up Additional Binary Formats was skipped because no trigger condition checks were met. Jul 15 10:53:16.875826 systemd[1]: Starting systemd-hwdb-update.service - Rebuild Hardware Database... Jul 15 10:53:16.878484 systemd[1]: Starting systemd-journal-flush.service - Flush Journal to Persistent Storage... Jul 15 10:53:16.879220 systemd[1]: systemd-pstore.service - Platform Persistent Storage Archival was skipped because of an unmet condition check (ConditionDirectoryNotEmpty=/sys/fs/pstore). Jul 15 10:53:16.882285 systemd[1]: Starting systemd-random-seed.service - Load/Save OS Random Seed... Jul 15 10:53:16.883219 systemd[1]: systemd-repart.service - Repartition Root Disk was skipped because no trigger condition checks were met. Jul 15 10:53:16.887297 systemd[1]: Starting systemd-sysctl.service - Apply Kernel Variables... Jul 15 10:53:16.892810 systemd[1]: Starting systemd-sysext.service - Merge System Extension Images into /usr/ and /opt/... Jul 15 10:53:16.895871 systemd[1]: Starting systemd-sysusers.service - Create System Users... Jul 15 10:53:16.899933 systemd[1]: Mounted sys-fs-fuse-connections.mount - FUSE Control File System. Jul 15 10:53:16.900577 systemd[1]: Mounted sys-kernel-config.mount - Kernel Configuration File System. Jul 15 10:53:16.901415 systemd[1]: Finished dracut-shutdown.service - Restore /run/initramfs on shutdown. Jul 15 10:53:16.920275 systemd-journald[1091]: Time spent on flushing to /var/log/journal/8656991f64d94efe857774bcacd72dea is 86.658ms for 946 entries. Jul 15 10:53:16.920275 systemd-journald[1091]: System Journal (/var/log/journal/8656991f64d94efe857774bcacd72dea) is 8M, max 584.8M, 576.8M free. Jul 15 10:53:17.020596 systemd-journald[1091]: Received client request to flush runtime journal. Jul 15 10:53:17.020833 kernel: loop0: detected capacity change from 0 to 8 Jul 15 10:53:17.020877 kernel: squashfs: version 4.0 (2009/01/31) Phillip Lougher Jul 15 10:53:16.940494 systemd[1]: Finished systemd-random-seed.service - Load/Save OS Random Seed. Jul 15 10:53:16.941886 systemd[1]: Reached target first-boot-complete.target - First Boot Complete. Jul 15 10:53:16.949325 systemd[1]: Starting systemd-machine-id-commit.service - Save Transient machine-id to Disk... Jul 15 10:53:16.983880 systemd[1]: Finished systemd-udev-trigger.service - Coldplug All udev Devices. Jul 15 10:53:16.998334 systemd[1]: Starting systemd-udev-settle.service - Wait for udev To Complete Device Initialization... Jul 15 10:53:17.022438 systemd[1]: Finished systemd-journal-flush.service - Flush Journal to Persistent Storage. Jul 15 10:53:17.027635 systemd[1]: Finished systemd-sysctl.service - Apply Kernel Variables. Jul 15 10:53:17.036159 kernel: loop1: detected capacity change from 0 to 147912 Jul 15 10:53:17.038438 udevadm[1148]: systemd-udev-settle.service is deprecated. Please fix lvm2-activation.service, lvm2-activation-early.service not to pull it in. Jul 15 10:53:17.062398 systemd[1]: Finished systemd-machine-id-commit.service - Save Transient machine-id to Disk. Jul 15 10:53:17.077067 systemd[1]: Finished systemd-sysusers.service - Create System Users. Jul 15 10:53:17.087357 systemd[1]: Starting systemd-tmpfiles-setup-dev.service - Create Static Device Nodes in /dev... Jul 15 10:53:17.120155 kernel: loop2: detected capacity change from 0 to 138176 Jul 15 10:53:17.129916 systemd-tmpfiles[1155]: ACLs are not supported, ignoring. Jul 15 10:53:17.129935 systemd-tmpfiles[1155]: ACLs are not supported, ignoring. Jul 15 10:53:17.140915 systemd[1]: Finished systemd-tmpfiles-setup-dev.service - Create Static Device Nodes in /dev. Jul 15 10:53:17.182164 kernel: loop3: detected capacity change from 0 to 8 Jul 15 10:53:17.193145 kernel: loop4: detected capacity change from 0 to 147912 Jul 15 10:53:17.250666 kernel: loop5: detected capacity change from 0 to 138176 Jul 15 10:53:17.322302 (sd-merge)[1161]: Using extensions 'containerd-flatcar', 'docker-flatcar', 'oem-openstack'. Jul 15 10:53:17.322893 (sd-merge)[1161]: Merged extensions into '/usr'. Jul 15 10:53:17.326535 systemd[1]: Finished systemd-sysext.service - Merge System Extension Images into /usr/ and /opt/. Jul 15 10:53:17.339064 systemd[1]: Starting ensure-sysext.service... Jul 15 10:53:17.352355 systemd[1]: Starting systemd-tmpfiles-setup.service - Create System Files and Directories... Jul 15 10:53:17.368208 systemd[1]: Reload requested from client PID 1163 ('systemctl') (unit ensure-sysext.service)... Jul 15 10:53:17.368256 systemd[1]: Reloading... Jul 15 10:53:17.438913 systemd-tmpfiles[1164]: /usr/lib/tmpfiles.d/provision.conf:20: Duplicate line for path "/root", ignoring. Jul 15 10:53:17.441238 systemd-tmpfiles[1164]: /usr/lib/tmpfiles.d/systemd-flatcar.conf:6: Duplicate line for path "/var/log/journal", ignoring. Jul 15 10:53:17.442946 systemd-tmpfiles[1164]: /usr/lib/tmpfiles.d/systemd.conf:29: Duplicate line for path "/var/lib/systemd", ignoring. Jul 15 10:53:17.443837 systemd-tmpfiles[1164]: ACLs are not supported, ignoring. Jul 15 10:53:17.445086 systemd-tmpfiles[1164]: ACLs are not supported, ignoring. Jul 15 10:53:17.453025 systemd-tmpfiles[1164]: Detected autofs mount point /boot during canonicalization of boot. Jul 15 10:53:17.453397 systemd-tmpfiles[1164]: Skipping /boot Jul 15 10:53:17.490517 systemd-tmpfiles[1164]: Detected autofs mount point /boot during canonicalization of boot. Jul 15 10:53:17.491339 systemd-tmpfiles[1164]: Skipping /boot Jul 15 10:53:17.524136 zram_generator::config[1194]: No configuration found. Jul 15 10:53:17.852594 systemd[1]: /usr/lib/systemd/system/docker.socket:6: ListenStream= references a path below legacy directory /var/run/, updating /var/run/docker.sock → /run/docker.sock; please update the unit file accordingly. Jul 15 10:53:17.976789 systemd[1]: etc-machine\x2did.mount: Deactivated successfully. Jul 15 10:53:17.977081 systemd[1]: Reloading finished in 608 ms. Jul 15 10:53:18.005460 systemd[1]: Finished systemd-tmpfiles-setup.service - Create System Files and Directories. Jul 15 10:53:18.044361 systemd[1]: Starting audit-rules.service - Load Audit Rules... Jul 15 10:53:18.054433 systemd[1]: Starting clean-ca-certificates.service - Clean up broken links in /etc/ssl/certs... Jul 15 10:53:18.067466 ldconfig[1131]: /sbin/ldconfig: /usr/lib/ld.so.conf is not an ELF file - it has the wrong magic bytes at the start. Jul 15 10:53:18.069365 systemd[1]: Starting systemd-journal-catalog-update.service - Rebuild Journal Catalog... Jul 15 10:53:18.083326 systemd[1]: Starting systemd-resolved.service - Network Name Resolution... Jul 15 10:53:18.090313 systemd[1]: Starting systemd-update-utmp.service - Record System Boot/Shutdown in UTMP... Jul 15 10:53:18.092184 systemd[1]: Finished ldconfig.service - Rebuild Dynamic Linker Cache. Jul 15 10:53:18.103610 systemd[1]: proc-xen.mount - /proc/xen was skipped because of an unmet condition check (ConditionVirtualization=xen). Jul 15 10:53:18.103844 systemd[1]: ignition-delete-config.service - Ignition (delete config) was skipped because no trigger condition checks were met. Jul 15 10:53:18.114586 systemd[1]: Starting modprobe@dm_mod.service - Load Kernel Module dm_mod... Jul 15 10:53:18.125997 systemd[1]: Starting modprobe@efi_pstore.service - Load Kernel Module efi_pstore... Jul 15 10:53:18.131201 systemd[1]: Starting modprobe@loop.service - Load Kernel Module loop... Jul 15 10:53:18.132363 systemd[1]: systemd-binfmt.service - Set Up Additional Binary Formats was skipped because no trigger condition checks were met. Jul 15 10:53:18.132951 systemd[1]: systemd-hibernate-clear.service - Clear Stale Hibernate Storage Info was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67). Jul 15 10:53:18.138446 systemd[1]: Starting systemd-userdbd.service - User Database Manager... Jul 15 10:53:18.138990 systemd[1]: xenserver-pv-version.service - Set fake PV driver version for XenServer was skipped because of an unmet condition check (ConditionVirtualization=xen). Jul 15 10:53:18.145413 systemd[1]: proc-xen.mount - /proc/xen was skipped because of an unmet condition check (ConditionVirtualization=xen). Jul 15 10:53:18.146409 systemd[1]: ignition-delete-config.service - Ignition (delete config) was skipped because no trigger condition checks were met. Jul 15 10:53:18.146625 systemd[1]: systemd-binfmt.service - Set Up Additional Binary Formats was skipped because no trigger condition checks were met. Jul 15 10:53:18.146735 systemd[1]: systemd-hibernate-clear.service - Clear Stale Hibernate Storage Info was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67). Jul 15 10:53:18.146862 systemd[1]: xenserver-pv-version.service - Set fake PV driver version for XenServer was skipped because of an unmet condition check (ConditionVirtualization=xen). Jul 15 10:53:18.153200 systemd[1]: modprobe@dm_mod.service: Deactivated successfully. Jul 15 10:53:18.153449 systemd[1]: Finished modprobe@dm_mod.service - Load Kernel Module dm_mod. Jul 15 10:53:18.163136 systemd[1]: modprobe@efi_pstore.service: Deactivated successfully. Jul 15 10:53:18.163364 systemd[1]: Finished modprobe@efi_pstore.service - Load Kernel Module efi_pstore. Jul 15 10:53:18.171445 systemd[1]: proc-xen.mount - /proc/xen was skipped because of an unmet condition check (ConditionVirtualization=xen). Jul 15 10:53:18.171811 systemd[1]: ignition-delete-config.service - Ignition (delete config) was skipped because no trigger condition checks were met. Jul 15 10:53:18.179386 systemd[1]: Starting modprobe@drm.service - Load Kernel Module drm... Jul 15 10:53:18.180175 systemd[1]: systemd-binfmt.service - Set Up Additional Binary Formats was skipped because no trigger condition checks were met. Jul 15 10:53:18.180230 systemd[1]: systemd-hibernate-clear.service - Clear Stale Hibernate Storage Info was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67). Jul 15 10:53:18.180364 systemd[1]: systemd-pstore.service - Platform Persistent Storage Archival was skipped because of an unmet condition check (ConditionDirectoryNotEmpty=/sys/fs/pstore). Jul 15 10:53:18.180451 systemd[1]: xenserver-pv-version.service - Set fake PV driver version for XenServer was skipped because of an unmet condition check (ConditionVirtualization=xen). Jul 15 10:53:18.182379 systemd[1]: Finished ensure-sysext.service. Jul 15 10:53:18.183199 systemd[1]: Finished systemd-update-utmp.service - Record System Boot/Shutdown in UTMP. Jul 15 10:53:18.184422 systemd[1]: modprobe@loop.service: Deactivated successfully. Jul 15 10:53:18.185157 systemd[1]: Finished modprobe@loop.service - Load Kernel Module loop. Jul 15 10:53:18.200384 systemd[1]: systemd-repart.service - Repartition Root Disk was skipped because no trigger condition checks were met. Jul 15 10:53:18.208261 systemd[1]: Starting systemd-timesyncd.service - Network Time Synchronization... Jul 15 10:53:18.209209 systemd[1]: modprobe@drm.service: Deactivated successfully. Jul 15 10:53:18.209443 systemd[1]: Finished modprobe@drm.service - Load Kernel Module drm. Jul 15 10:53:18.238375 systemd[1]: Started systemd-userdbd.service - User Database Manager. Jul 15 10:53:18.251308 systemd[1]: Finished systemd-journal-catalog-update.service - Rebuild Journal Catalog. Jul 15 10:53:18.262070 augenrules[1292]: No rules Jul 15 10:53:18.265012 systemd[1]: audit-rules.service: Deactivated successfully. Jul 15 10:53:18.265342 systemd[1]: Finished audit-rules.service - Load Audit Rules. Jul 15 10:53:18.313739 systemd[1]: Finished systemd-hwdb-update.service - Rebuild Hardware Database. Jul 15 10:53:18.325450 systemd[1]: Starting systemd-udevd.service - Rule-based Manager for Device Events and Files... Jul 15 10:53:18.330322 systemd[1]: Starting systemd-update-done.service - Update is Completed... Jul 15 10:53:18.331321 systemd[1]: Finished clean-ca-certificates.service - Clean up broken links in /etc/ssl/certs. Jul 15 10:53:18.333017 systemd[1]: update-ca-certificates.service - Update CA bundle at /etc/ssl/certs/ca-certificates.crt was skipped because of an unmet condition check (ConditionPathIsSymbolicLink=!/etc/ssl/certs/ca-certificates.crt). Jul 15 10:53:18.360182 systemd[1]: Finished systemd-update-done.service - Update is Completed. Jul 15 10:53:18.371188 systemd-udevd[1301]: Using default interface naming scheme 'v255'. Jul 15 10:53:18.386076 systemd[1]: Started systemd-timesyncd.service - Network Time Synchronization. Jul 15 10:53:18.386826 systemd[1]: Reached target time-set.target - System Time Set. Jul 15 10:53:18.397188 systemd-resolved[1253]: Positive Trust Anchors: Jul 15 10:53:18.397568 systemd-resolved[1253]: . IN DS 20326 8 2 e06d44b80b8f1d39a95c0b0d7c65d08458e880409bbc683457104237c7f8ec8d Jul 15 10:53:18.397672 systemd-resolved[1253]: Negative trust anchors: home.arpa 10.in-addr.arpa 16.172.in-addr.arpa 17.172.in-addr.arpa 18.172.in-addr.arpa 19.172.in-addr.arpa 20.172.in-addr.arpa 21.172.in-addr.arpa 22.172.in-addr.arpa 23.172.in-addr.arpa 24.172.in-addr.arpa 25.172.in-addr.arpa 26.172.in-addr.arpa 27.172.in-addr.arpa 28.172.in-addr.arpa 29.172.in-addr.arpa 30.172.in-addr.arpa 31.172.in-addr.arpa 170.0.0.192.in-addr.arpa 171.0.0.192.in-addr.arpa 168.192.in-addr.arpa d.f.ip6.arpa ipv4only.arpa resolver.arpa corp home internal intranet lan local private test Jul 15 10:53:18.404280 systemd-resolved[1253]: Using system hostname 'ci-4230-2-100-4f60b27630.novalocal'. Jul 15 10:53:18.406514 systemd[1]: Started systemd-resolved.service - Network Name Resolution. Jul 15 10:53:18.407339 systemd[1]: Reached target nss-lookup.target - Host and Network Name Lookups. Jul 15 10:53:18.413504 systemd[1]: Started systemd-udevd.service - Rule-based Manager for Device Events and Files. Jul 15 10:53:18.425166 systemd[1]: Starting systemd-networkd.service - Network Configuration... Jul 15 10:53:18.543518 systemd[1]: Condition check resulted in dev-ttyS0.device - /dev/ttyS0 being skipped. Jul 15 10:53:18.545353 systemd-networkd[1311]: lo: Link UP Jul 15 10:53:18.545364 systemd-networkd[1311]: lo: Gained carrier Jul 15 10:53:18.547686 systemd-networkd[1311]: Enumeration completed Jul 15 10:53:18.547803 systemd[1]: Started systemd-networkd.service - Network Configuration. Jul 15 10:53:18.550069 systemd[1]: Reached target network.target - Network. Jul 15 10:53:18.560351 systemd[1]: Starting systemd-networkd-persistent-storage.service - Enable Persistent Storage in systemd-networkd... Jul 15 10:53:18.562967 systemd[1]: Starting systemd-networkd-wait-online.service - Wait for Network to be Configured... Jul 15 10:53:18.586834 systemd-networkd[1311]: eth0: found matching network '/usr/lib/systemd/network/zz-default.network', based on potentially unpredictable interface name. Jul 15 10:53:18.586853 systemd-networkd[1311]: eth0: Configuring with /usr/lib/systemd/network/zz-default.network. Jul 15 10:53:18.589829 systemd-networkd[1311]: eth0: Link UP Jul 15 10:53:18.589838 systemd-networkd[1311]: eth0: Gained carrier Jul 15 10:53:18.589856 systemd-networkd[1311]: eth0: found matching network '/usr/lib/systemd/network/zz-default.network', based on potentially unpredictable interface name. Jul 15 10:53:18.599237 systemd[1]: Finished systemd-networkd-persistent-storage.service - Enable Persistent Storage in systemd-networkd. Jul 15 10:53:18.602368 systemd-networkd[1311]: eth0: DHCPv4 address 172.24.4.54/24, gateway 172.24.4.1 acquired from 172.24.4.1 Jul 15 10:53:18.603954 systemd-timesyncd[1279]: Network configuration changed, trying to establish connection. Jul 15 10:53:18.621212 kernel: BTRFS warning: duplicate device /dev/vda3 devid 1 generation 36 scanned by (udev-worker) (1308) Jul 15 10:53:18.668164 kernel: input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input2 Jul 15 10:53:18.677145 kernel: ACPI: button: Power Button [PWRF] Jul 15 10:53:18.694130 kernel: input: ImExPS/2 Generic Explorer Mouse as /devices/platform/i8042/serio1/input/input3 Jul 15 10:53:18.737189 kernel: piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 Jul 15 10:53:18.744476 systemd[1]: Starting systemd-vconsole-setup.service - Virtual Console Setup... Jul 15 10:53:18.748174 kernel: mousedev: PS/2 mouse device common for all mice Jul 15 10:53:18.759604 systemd[1]: Found device dev-disk-by\x2dlabel-OEM.device - /dev/disk/by-label/OEM. Jul 15 10:53:18.769217 systemd[1]: Starting systemd-fsck@dev-disk-by\x2dlabel-OEM.service - File System Check on /dev/disk/by-label/OEM... Jul 15 10:53:18.772320 kernel: [drm] pci: virtio-vga detected at 0000:00:02.0 Jul 15 10:53:18.773144 kernel: virtio-pci 0000:00:02.0: vgaarb: deactivate vga console Jul 15 10:53:18.783696 kernel: Console: switching to colour dummy device 80x25 Jul 15 10:53:18.786179 kernel: [drm] features: -virgl +edid -resource_blob -host_visible Jul 15 10:53:18.786224 kernel: [drm] features: -context_init Jul 15 10:53:18.789124 kernel: [drm] number of scanouts: 1 Jul 15 10:53:18.789169 kernel: [drm] number of cap sets: 0 Jul 15 10:53:18.793131 kernel: [drm] Initialized virtio_gpu 0.1.0 0 for 0000:00:02.0 on minor 0 Jul 15 10:53:18.799658 systemd[1]: Finished systemd-fsck@dev-disk-by\x2dlabel-OEM.service - File System Check on /dev/disk/by-label/OEM. Jul 15 10:53:18.800291 systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. Jul 15 10:53:18.800657 systemd[1]: Stopped systemd-vconsole-setup.service - Virtual Console Setup. Jul 15 10:53:18.803227 systemd[1]: run-credentials-systemd\x2dvconsole\x2dsetup.service.mount: Deactivated successfully. Jul 15 10:53:18.822429 systemd[1]: Starting systemd-vconsole-setup.service - Virtual Console Setup... Jul 15 10:53:18.829317 kernel: fbcon: virtio_gpudrmfb (fb0) is primary device Jul 15 10:53:18.829406 kernel: Console: switching to colour frame buffer device 160x50 Jul 15 10:53:18.838181 kernel: virtio-pci 0000:00:02.0: [drm] fb0: virtio_gpudrmfb frame buffer device Jul 15 10:53:18.842659 systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. Jul 15 10:53:18.842934 systemd[1]: Stopped systemd-vconsole-setup.service - Virtual Console Setup. Jul 15 10:53:18.852259 systemd[1]: Starting systemd-vconsole-setup.service - Virtual Console Setup... Jul 15 10:53:18.853186 systemd[1]: Finished systemd-udev-settle.service - Wait for udev To Complete Device Initialization. Jul 15 10:53:18.857510 systemd[1]: Starting lvm2-activation-early.service - Activation of LVM2 logical volumes... Jul 15 10:53:18.882652 lvm[1357]: WARNING: Failed to connect to lvmetad. Falling back to device scanning. Jul 15 10:53:18.920364 systemd[1]: Finished lvm2-activation-early.service - Activation of LVM2 logical volumes. Jul 15 10:53:18.922283 systemd[1]: Reached target cryptsetup.target - Local Encrypted Volumes. Jul 15 10:53:18.928297 systemd[1]: Starting lvm2-activation.service - Activation of LVM2 logical volumes... Jul 15 10:53:18.949882 lvm[1360]: WARNING: Failed to connect to lvmetad. Falling back to device scanning. Jul 15 10:53:18.976298 systemd[1]: Finished systemd-vconsole-setup.service - Virtual Console Setup. Jul 15 10:53:18.978718 systemd[1]: Finished lvm2-activation.service - Activation of LVM2 logical volumes. Jul 15 10:53:18.981016 systemd[1]: Reached target sysinit.target - System Initialization. Jul 15 10:53:18.981806 systemd[1]: Started motdgen.path - Watch for update engine configuration changes. Jul 15 10:53:18.982152 systemd[1]: Started user-cloudinit@var-lib-flatcar\x2dinstall-user_data.path - Watch for a cloud-config at /var/lib/flatcar-install/user_data. Jul 15 10:53:18.982778 systemd[1]: Started logrotate.timer - Daily rotation of log files. Jul 15 10:53:18.984141 systemd[1]: Started mdadm.timer - Weekly check for MD array's redundancy information.. Jul 15 10:53:18.985386 systemd[1]: Started systemd-tmpfiles-clean.timer - Daily Cleanup of Temporary Directories. Jul 15 10:53:18.985586 systemd[1]: update-engine-stub.timer - Update Engine Stub Timer was skipped because of an unmet condition check (ConditionPathExists=/usr/.noupdate). Jul 15 10:53:18.985672 systemd[1]: Reached target paths.target - Path Units. Jul 15 10:53:18.985857 systemd[1]: Reached target timers.target - Timer Units. Jul 15 10:53:18.990399 systemd[1]: Listening on dbus.socket - D-Bus System Message Bus Socket. Jul 15 10:53:18.991994 systemd[1]: Starting docker.socket - Docker Socket for the API... Jul 15 10:53:18.995769 systemd[1]: Listening on sshd-unix-local.socket - OpenSSH Server Socket (systemd-ssh-generator, AF_UNIX Local). Jul 15 10:53:18.998219 systemd[1]: Listening on sshd-vsock.socket - OpenSSH Server Socket (systemd-ssh-generator, AF_VSOCK). Jul 15 10:53:18.998720 systemd[1]: Reached target ssh-access.target - SSH Access Available. Jul 15 10:53:19.011709 systemd[1]: Listening on sshd.socket - OpenSSH Server Socket. Jul 15 10:53:19.016970 systemd[1]: Listening on systemd-hostnamed.socket - Hostname Service Socket. Jul 15 10:53:19.025546 systemd[1]: Listening on docker.socket - Docker Socket for the API. Jul 15 10:53:19.028489 systemd[1]: Reached target sockets.target - Socket Units. Jul 15 10:53:19.031861 systemd[1]: Reached target basic.target - Basic System. Jul 15 10:53:19.035365 systemd[1]: addon-config@oem.service - Configure Addon /oem was skipped because no trigger condition checks were met. Jul 15 10:53:19.035671 systemd[1]: addon-run@oem.service - Run Addon /oem was skipped because no trigger condition checks were met. Jul 15 10:53:19.045343 systemd[1]: Starting containerd.service - containerd container runtime... Jul 15 10:53:19.054682 systemd[1]: Starting coreos-metadata-sshkeys@core.service - Flatcar Metadata Agent (SSH Keys)... Jul 15 10:53:19.084468 systemd[1]: Starting coreos-metadata.service - Flatcar Metadata Agent... Jul 15 10:53:19.103426 systemd[1]: Starting dbus.service - D-Bus System Message Bus... Jul 15 10:53:19.119342 systemd[1]: Starting enable-oem-cloudinit.service - Enable cloudinit... Jul 15 10:53:19.127271 systemd[1]: Starting extend-filesystems.service - Extend Filesystems... Jul 15 10:53:19.127933 systemd[1]: flatcar-setup-environment.service - Modifies /etc/environment for CoreOS was skipped because of an unmet condition check (ConditionPathExists=/oem/bin/flatcar-setup-environment). Jul 15 10:53:19.138218 jq[1373]: false Jul 15 10:53:19.142396 coreos-metadata[1368]: Jul 15 10:53:19.137 INFO Fetching http://169.254.169.254/latest/meta-data/public-keys: Attempt #1 Jul 15 10:53:19.141635 systemd[1]: Starting motdgen.service - Generate /run/flatcar/motd... Jul 15 10:53:19.152421 systemd[1]: Starting ssh-key-proc-cmdline.service - Install an ssh key from /proc/cmdline... Jul 15 10:53:19.155310 coreos-metadata[1368]: Jul 15 10:53:19.155 INFO Fetch successful Jul 15 10:53:19.155437 coreos-metadata[1368]: Jul 15 10:53:19.155 INFO Fetching http://169.254.169.254/latest/meta-data/public-keys/0/openssh-key: Attempt #1 Jul 15 10:53:19.181187 coreos-metadata[1368]: Jul 15 10:53:19.169 INFO Fetch successful Jul 15 10:53:19.169410 systemd[1]: Starting sshd-keygen.service - Generate sshd host keys... Jul 15 10:53:19.179392 systemd[1]: Starting systemd-logind.service - User Login Management... Jul 15 10:53:19.185516 systemd[1]: tcsd.service - TCG Core Services Daemon was skipped because of an unmet condition check (ConditionPathExists=/dev/tpm0). Jul 15 10:53:19.188436 systemd[1]: cgroup compatibility translation between legacy and unified hierarchy settings activated. See cgroup-compat debug messages for details. Jul 15 10:53:19.190251 unknown[1368]: wrote ssh authorized keys file for user: core Jul 15 10:53:19.191391 systemd[1]: Starting update-engine.service - Update Engine... Jul 15 10:53:19.201719 coreos-metadata[1369]: Jul 15 10:53:19.191 INFO Fetching http://169.254.169.254/openstack/2012-08-10/meta_data.json: Attempt #1 Jul 15 10:53:19.194891 systemd[1]: Starting update-ssh-keys-after-ignition.service - Run update-ssh-keys once after Ignition... Jul 15 10:53:19.209853 systemd[1]: enable-oem-cloudinit.service: Skipped due to 'exec-condition'. Jul 15 10:53:19.210099 systemd[1]: Condition check resulted in enable-oem-cloudinit.service - Enable cloudinit being skipped. Jul 15 10:53:19.210479 systemd[1]: ssh-key-proc-cmdline.service: Deactivated successfully. Jul 15 10:53:19.211177 systemd[1]: Finished ssh-key-proc-cmdline.service - Install an ssh key from /proc/cmdline. Jul 15 10:53:19.236136 extend-filesystems[1374]: Found loop3 Jul 15 10:53:19.236136 extend-filesystems[1374]: Found loop4 Jul 15 10:53:19.236136 extend-filesystems[1374]: Found loop5 Jul 15 10:53:19.236136 extend-filesystems[1374]: Found vda Jul 15 10:53:19.236136 extend-filesystems[1374]: Found vda1 Jul 15 10:53:19.236136 extend-filesystems[1374]: Found vda2 Jul 15 10:53:19.236136 extend-filesystems[1374]: Found vda3 Jul 15 10:53:19.236136 extend-filesystems[1374]: Found usr Jul 15 10:53:19.236136 extend-filesystems[1374]: Found vda4 Jul 15 10:53:19.236136 extend-filesystems[1374]: Found vda6 Jul 15 10:53:19.236136 extend-filesystems[1374]: Found vda7 Jul 15 10:53:19.236136 extend-filesystems[1374]: Found vda9 Jul 15 10:53:19.236136 extend-filesystems[1374]: Checking size of /dev/vda9 Jul 15 10:53:19.359529 extend-filesystems[1374]: Resized partition /dev/vda9 Jul 15 10:53:19.360084 jq[1388]: true Jul 15 10:53:19.366319 update_engine[1386]: I20250715 10:53:19.256989 1386 main.cc:92] Flatcar Update Engine starting Jul 15 10:53:19.366319 update_engine[1386]: I20250715 10:53:19.262276 1386 update_check_scheduler.cc:74] Next update check in 6m28s Jul 15 10:53:19.366599 coreos-metadata[1369]: Jul 15 10:53:19.245 INFO Fetch successful Jul 15 10:53:19.366599 coreos-metadata[1369]: Jul 15 10:53:19.245 INFO Fetching http://169.254.169.254/latest/meta-data/hostname: Attempt #1 Jul 15 10:53:19.366599 coreos-metadata[1369]: Jul 15 10:53:19.260 INFO Fetch successful Jul 15 10:53:19.366599 coreos-metadata[1369]: Jul 15 10:53:19.260 INFO Fetching http://169.254.169.254/latest/meta-data/instance-id: Attempt #1 Jul 15 10:53:19.366599 coreos-metadata[1369]: Jul 15 10:53:19.274 INFO Fetch successful Jul 15 10:53:19.366599 coreos-metadata[1369]: Jul 15 10:53:19.274 INFO Fetching http://169.254.169.254/latest/meta-data/instance-type: Attempt #1 Jul 15 10:53:19.366599 coreos-metadata[1369]: Jul 15 10:53:19.291 INFO Fetch successful Jul 15 10:53:19.366599 coreos-metadata[1369]: Jul 15 10:53:19.291 INFO Fetching http://169.254.169.254/latest/meta-data/local-ipv4: Attempt #1 Jul 15 10:53:19.366599 coreos-metadata[1369]: Jul 15 10:53:19.321 INFO Fetch successful Jul 15 10:53:19.366599 coreos-metadata[1369]: Jul 15 10:53:19.321 INFO Fetching http://169.254.169.254/latest/meta-data/public-ipv4: Attempt #1 Jul 15 10:53:19.366599 coreos-metadata[1369]: Jul 15 10:53:19.334 INFO Fetch successful Jul 15 10:53:19.250653 dbus-daemon[1372]: [system] SELinux support is enabled Jul 15 10:53:19.250879 systemd[1]: Started dbus.service - D-Bus System Message Bus. Jul 15 10:53:19.371346 extend-filesystems[1410]: resize2fs 1.47.1 (20-May-2024) Jul 15 10:53:19.489023 kernel: BTRFS warning: duplicate device /dev/vda3 devid 1 generation 36 scanned by (udev-worker) (1312) Jul 15 10:53:19.489074 kernel: EXT4-fs (vda9): resizing filesystem from 1617920 to 2014203 blocks Jul 15 10:53:19.489091 kernel: EXT4-fs (vda9): resized filesystem to 2014203 Jul 15 10:53:19.257818 systemd[1]: system-cloudinit@usr-share-oem-cloud\x2dconfig.yml.service - Load cloud-config from /usr/share/oem/cloud-config.yml was skipped because of an unmet condition check (ConditionFileNotEmpty=/usr/share/oem/cloud-config.yml). Jul 15 10:53:19.257852 systemd[1]: Reached target system-config.target - Load system-provided cloud configs. Jul 15 10:53:19.489497 update-ssh-keys[1391]: Updated "/home/core/.ssh/authorized_keys" Jul 15 10:53:19.262701 systemd[1]: user-cloudinit-proc-cmdline.service - Load cloud-config from url defined in /proc/cmdline was skipped because of an unmet condition check (ConditionKernelCommandLine=cloud-config-url). Jul 15 10:53:19.489736 jq[1405]: true Jul 15 10:53:19.262729 systemd[1]: Reached target user-config.target - Load user-provided cloud configs. Jul 15 10:53:19.265771 systemd[1]: Started update-engine.service - Update Engine. Jul 15 10:53:19.280552 systemd[1]: Started locksmithd.service - Cluster reboot manager. Jul 15 10:53:19.333994 systemd[1]: motdgen.service: Deactivated successfully. Jul 15 10:53:19.334650 systemd[1]: Finished motdgen.service - Generate /run/flatcar/motd. Jul 15 10:53:19.335829 (ntainerd)[1401]: containerd.service: Referenced but unset environment variable evaluates to an empty string: TORCX_IMAGEDIR, TORCX_UNPACKDIR Jul 15 10:53:19.502279 extend-filesystems[1410]: Filesystem at /dev/vda9 is mounted on /; on-line resizing required Jul 15 10:53:19.502279 extend-filesystems[1410]: old_desc_blocks = 1, new_desc_blocks = 1 Jul 15 10:53:19.502279 extend-filesystems[1410]: The filesystem on /dev/vda9 is now 2014203 (4k) blocks long. Jul 15 10:53:19.353202 systemd[1]: Finished coreos-metadata-sshkeys@core.service - Flatcar Metadata Agent (SSH Keys). Jul 15 10:53:19.526836 extend-filesystems[1374]: Resized filesystem in /dev/vda9 Jul 15 10:53:19.418899 systemd[1]: Created slice system-sshd.slice - Slice /system/sshd. Jul 15 10:53:19.430231 systemd[1]: Finished coreos-metadata.service - Flatcar Metadata Agent. Jul 15 10:53:19.430942 systemd[1]: packet-phone-home.service - Report Success to Packet was skipped because no trigger condition checks were met. Jul 15 10:53:19.471238 systemd-logind[1382]: New seat seat0. Jul 15 10:53:19.493091 systemd-logind[1382]: Watching system buttons on /dev/input/event1 (Power Button) Jul 15 10:53:19.493158 systemd-logind[1382]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) Jul 15 10:53:19.493714 systemd[1]: Started systemd-logind.service - User Login Management. Jul 15 10:53:19.502664 systemd[1]: extend-filesystems.service: Deactivated successfully. Jul 15 10:53:19.502971 systemd[1]: Finished extend-filesystems.service - Extend Filesystems. Jul 15 10:53:19.542827 sshd_keygen[1385]: ssh-keygen: generating new host keys: RSA ECDSA ED25519 Jul 15 10:53:19.564215 bash[1430]: Updated "/home/core/.ssh/authorized_keys" Jul 15 10:53:19.566230 systemd[1]: Finished update-ssh-keys-after-ignition.service - Run update-ssh-keys once after Ignition. Jul 15 10:53:19.594591 systemd[1]: Starting sshkeys.service... Jul 15 10:53:19.620827 locksmithd[1403]: locksmithd starting currentOperation="UPDATE_STATUS_IDLE" strategy="reboot" Jul 15 10:53:19.620992 systemd[1]: Finished sshd-keygen.service - Generate sshd host keys. Jul 15 10:53:19.626543 systemd[1]: Finished sshkeys.service. Jul 15 10:53:19.643453 systemd[1]: Starting issuegen.service - Generate /run/issue... Jul 15 10:53:19.657399 systemd[1]: Started sshd@0-172.24.4.54:22-172.24.4.1:54752.service - OpenSSH per-connection server daemon (172.24.4.1:54752). Jul 15 10:53:19.665887 systemd[1]: issuegen.service: Deactivated successfully. Jul 15 10:53:19.666184 systemd[1]: Finished issuegen.service - Generate /run/issue. Jul 15 10:53:19.678464 systemd[1]: Starting systemd-user-sessions.service - Permit User Sessions... Jul 15 10:53:19.720266 systemd[1]: Finished systemd-user-sessions.service - Permit User Sessions. Jul 15 10:53:19.735560 systemd[1]: Started getty@tty1.service - Getty on tty1. Jul 15 10:53:19.750488 systemd[1]: Started serial-getty@ttyS0.service - Serial Getty on ttyS0. Jul 15 10:53:19.751269 systemd[1]: Reached target getty.target - Login Prompts. Jul 15 10:53:19.857274 containerd[1401]: time="2025-07-15T10:53:19.857180598Z" level=info msg="starting containerd" revision=9b2ad7760328148397346d10c7b2004271249db4 version=v1.7.23 Jul 15 10:53:19.885411 containerd[1401]: time="2025-07-15T10:53:19.885356793Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.aufs\"..." type=io.containerd.snapshotter.v1 Jul 15 10:53:19.888781 containerd[1401]: time="2025-07-15T10:53:19.888748504Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.aufs\"..." error="aufs is not supported (modprobe aufs failed: exit status 1 \"modprobe: FATAL: Module aufs not found in directory /lib/modules/6.6.98-flatcar\\n\"): skip plugin" type=io.containerd.snapshotter.v1 Jul 15 10:53:19.888905 containerd[1401]: time="2025-07-15T10:53:19.888886703Z" level=info msg="loading plugin \"io.containerd.event.v1.exchange\"..." type=io.containerd.event.v1 Jul 15 10:53:19.888974 containerd[1401]: time="2025-07-15T10:53:19.888960031Z" level=info msg="loading plugin \"io.containerd.internal.v1.opt\"..." type=io.containerd.internal.v1 Jul 15 10:53:19.889260 containerd[1401]: time="2025-07-15T10:53:19.889237982Z" level=info msg="loading plugin \"io.containerd.warning.v1.deprecations\"..." type=io.containerd.warning.v1 Jul 15 10:53:19.889334 containerd[1401]: time="2025-07-15T10:53:19.889320106Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.blockfile\"..." type=io.containerd.snapshotter.v1 Jul 15 10:53:19.889472 containerd[1401]: time="2025-07-15T10:53:19.889450681Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.blockfile\"..." error="no scratch file generator: skip plugin" type=io.containerd.snapshotter.v1 Jul 15 10:53:19.889547 containerd[1401]: time="2025-07-15T10:53:19.889532154Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.btrfs\"..." type=io.containerd.snapshotter.v1 Jul 15 10:53:19.889821 containerd[1401]: time="2025-07-15T10:53:19.889798092Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.btrfs\"..." error="path /var/lib/containerd/io.containerd.snapshotter.v1.btrfs (ext4) must be a btrfs filesystem to be used with the btrfs snapshotter: skip plugin" type=io.containerd.snapshotter.v1 Jul 15 10:53:19.889888 containerd[1401]: time="2025-07-15T10:53:19.889874205Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.devmapper\"..." type=io.containerd.snapshotter.v1 Jul 15 10:53:19.889952 containerd[1401]: time="2025-07-15T10:53:19.889936742Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.devmapper\"..." error="devmapper not configured: skip plugin" type=io.containerd.snapshotter.v1 Jul 15 10:53:19.890020 containerd[1401]: time="2025-07-15T10:53:19.890005171Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.native\"..." type=io.containerd.snapshotter.v1 Jul 15 10:53:19.890211 containerd[1401]: time="2025-07-15T10:53:19.890187563Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.overlayfs\"..." type=io.containerd.snapshotter.v1 Jul 15 10:53:19.890561 containerd[1401]: time="2025-07-15T10:53:19.890540144Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.zfs\"..." type=io.containerd.snapshotter.v1 Jul 15 10:53:19.890793 containerd[1401]: time="2025-07-15T10:53:19.890771548Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.zfs\"..." error="path /var/lib/containerd/io.containerd.snapshotter.v1.zfs must be a zfs filesystem to be used with the zfs snapshotter: skip plugin" type=io.containerd.snapshotter.v1 Jul 15 10:53:19.890859 containerd[1401]: time="2025-07-15T10:53:19.890843713Z" level=info msg="loading plugin \"io.containerd.content.v1.content\"..." type=io.containerd.content.v1 Jul 15 10:53:19.891262 containerd[1401]: time="2025-07-15T10:53:19.891236761Z" level=info msg="loading plugin \"io.containerd.metadata.v1.bolt\"..." type=io.containerd.metadata.v1 Jul 15 10:53:19.891399 containerd[1401]: time="2025-07-15T10:53:19.891379548Z" level=info msg="metadata content store policy set" policy=shared Jul 15 10:53:19.898966 containerd[1401]: time="2025-07-15T10:53:19.898937824Z" level=info msg="loading plugin \"io.containerd.gc.v1.scheduler\"..." type=io.containerd.gc.v1 Jul 15 10:53:19.899091 containerd[1401]: time="2025-07-15T10:53:19.899074721Z" level=info msg="loading plugin \"io.containerd.differ.v1.walking\"..." type=io.containerd.differ.v1 Jul 15 10:53:19.899232 containerd[1401]: time="2025-07-15T10:53:19.899213992Z" level=info msg="loading plugin \"io.containerd.lease.v1.manager\"..." type=io.containerd.lease.v1 Jul 15 10:53:19.899393 containerd[1401]: time="2025-07-15T10:53:19.899327916Z" level=info msg="loading plugin \"io.containerd.streaming.v1.manager\"..." type=io.containerd.streaming.v1 Jul 15 10:53:19.899393 containerd[1401]: time="2025-07-15T10:53:19.899350288Z" level=info msg="loading plugin \"io.containerd.runtime.v1.linux\"..." type=io.containerd.runtime.v1 Jul 15 10:53:19.900269 containerd[1401]: time="2025-07-15T10:53:19.899588424Z" level=info msg="loading plugin \"io.containerd.monitor.v1.cgroups\"..." type=io.containerd.monitor.v1 Jul 15 10:53:19.900269 containerd[1401]: time="2025-07-15T10:53:19.899864512Z" level=info msg="loading plugin \"io.containerd.runtime.v2.task\"..." type=io.containerd.runtime.v2 Jul 15 10:53:19.900269 containerd[1401]: time="2025-07-15T10:53:19.899969739Z" level=info msg="loading plugin \"io.containerd.runtime.v2.shim\"..." type=io.containerd.runtime.v2 Jul 15 10:53:19.900269 containerd[1401]: time="2025-07-15T10:53:19.899988565Z" level=info msg="loading plugin \"io.containerd.sandbox.store.v1.local\"..." type=io.containerd.sandbox.store.v1 Jul 15 10:53:19.900269 containerd[1401]: time="2025-07-15T10:53:19.900003382Z" level=info msg="loading plugin \"io.containerd.sandbox.controller.v1.local\"..." type=io.containerd.sandbox.controller.v1 Jul 15 10:53:19.900269 containerd[1401]: time="2025-07-15T10:53:19.900018411Z" level=info msg="loading plugin \"io.containerd.service.v1.containers-service\"..." type=io.containerd.service.v1 Jul 15 10:53:19.900269 containerd[1401]: time="2025-07-15T10:53:19.900032337Z" level=info msg="loading plugin \"io.containerd.service.v1.content-service\"..." type=io.containerd.service.v1 Jul 15 10:53:19.900269 containerd[1401]: time="2025-07-15T10:53:19.900053396Z" level=info msg="loading plugin \"io.containerd.service.v1.diff-service\"..." type=io.containerd.service.v1 Jul 15 10:53:19.900269 containerd[1401]: time="2025-07-15T10:53:19.900070388Z" level=info msg="loading plugin \"io.containerd.service.v1.images-service\"..." type=io.containerd.service.v1 Jul 15 10:53:19.900269 containerd[1401]: time="2025-07-15T10:53:19.900084665Z" level=info msg="loading plugin \"io.containerd.service.v1.introspection-service\"..." type=io.containerd.service.v1 Jul 15 10:53:19.900269 containerd[1401]: time="2025-07-15T10:53:19.900129299Z" level=info msg="loading plugin \"io.containerd.service.v1.namespaces-service\"..." type=io.containerd.service.v1 Jul 15 10:53:19.900269 containerd[1401]: time="2025-07-15T10:53:19.900147693Z" level=info msg="loading plugin \"io.containerd.service.v1.snapshots-service\"..." type=io.containerd.service.v1 Jul 15 10:53:19.900269 containerd[1401]: time="2025-07-15T10:53:19.900160537Z" level=info msg="loading plugin \"io.containerd.service.v1.tasks-service\"..." type=io.containerd.service.v1 Jul 15 10:53:19.900269 containerd[1401]: time="2025-07-15T10:53:19.900184823Z" level=info msg="loading plugin \"io.containerd.grpc.v1.containers\"..." type=io.containerd.grpc.v1 Jul 15 10:53:19.901173 containerd[1401]: time="2025-07-15T10:53:19.900205592Z" level=info msg="loading plugin \"io.containerd.grpc.v1.content\"..." type=io.containerd.grpc.v1 Jul 15 10:53:19.901173 containerd[1401]: time="2025-07-15T10:53:19.900220590Z" level=info msg="loading plugin \"io.containerd.grpc.v1.diff\"..." type=io.containerd.grpc.v1 Jul 15 10:53:19.901173 containerd[1401]: time="2025-07-15T10:53:19.900234816Z" level=info msg="loading plugin \"io.containerd.grpc.v1.events\"..." type=io.containerd.grpc.v1 Jul 15 10:53:19.901173 containerd[1401]: time="2025-07-15T10:53:19.900247871Z" level=info msg="loading plugin \"io.containerd.grpc.v1.images\"..." type=io.containerd.grpc.v1 Jul 15 10:53:19.901173 containerd[1401]: time="2025-07-15T10:53:19.900261346Z" level=info msg="loading plugin \"io.containerd.grpc.v1.introspection\"..." type=io.containerd.grpc.v1 Jul 15 10:53:19.901173 containerd[1401]: time="2025-07-15T10:53:19.900274691Z" level=info msg="loading plugin \"io.containerd.grpc.v1.leases\"..." type=io.containerd.grpc.v1 Jul 15 10:53:19.901173 containerd[1401]: time="2025-07-15T10:53:19.900294458Z" level=info msg="loading plugin \"io.containerd.grpc.v1.namespaces\"..." type=io.containerd.grpc.v1 Jul 15 10:53:19.901173 containerd[1401]: time="2025-07-15T10:53:19.900310719Z" level=info msg="loading plugin \"io.containerd.grpc.v1.sandbox-controllers\"..." type=io.containerd.grpc.v1 Jul 15 10:53:19.901173 containerd[1401]: time="2025-07-15T10:53:19.900328081Z" level=info msg="loading plugin \"io.containerd.grpc.v1.sandboxes\"..." type=io.containerd.grpc.v1 Jul 15 10:53:19.901173 containerd[1401]: time="2025-07-15T10:53:19.900351305Z" level=info msg="loading plugin \"io.containerd.grpc.v1.snapshots\"..." type=io.containerd.grpc.v1 Jul 15 10:53:19.901173 containerd[1401]: time="2025-07-15T10:53:19.900366884Z" level=info msg="loading plugin \"io.containerd.grpc.v1.streaming\"..." type=io.containerd.grpc.v1 Jul 15 10:53:19.901173 containerd[1401]: time="2025-07-15T10:53:19.900380189Z" level=info msg="loading plugin \"io.containerd.grpc.v1.tasks\"..." type=io.containerd.grpc.v1 Jul 15 10:53:19.901173 containerd[1401]: time="2025-07-15T10:53:19.900396540Z" level=info msg="loading plugin \"io.containerd.transfer.v1.local\"..." type=io.containerd.transfer.v1 Jul 15 10:53:19.901173 containerd[1401]: time="2025-07-15T10:53:19.900418751Z" level=info msg="loading plugin \"io.containerd.grpc.v1.transfer\"..." type=io.containerd.grpc.v1 Jul 15 10:53:19.901173 containerd[1401]: time="2025-07-15T10:53:19.900434391Z" level=info msg="loading plugin \"io.containerd.grpc.v1.version\"..." type=io.containerd.grpc.v1 Jul 15 10:53:19.902072 containerd[1401]: time="2025-07-15T10:53:19.900447065Z" level=info msg="loading plugin \"io.containerd.internal.v1.restart\"..." type=io.containerd.internal.v1 Jul 15 10:53:19.902072 containerd[1401]: time="2025-07-15T10:53:19.900488452Z" level=info msg="loading plugin \"io.containerd.tracing.processor.v1.otlp\"..." type=io.containerd.tracing.processor.v1 Jul 15 10:53:19.902072 containerd[1401]: time="2025-07-15T10:53:19.900506626Z" level=info msg="skip loading plugin \"io.containerd.tracing.processor.v1.otlp\"..." error="skip plugin: tracing endpoint not configured" type=io.containerd.tracing.processor.v1 Jul 15 10:53:19.902072 containerd[1401]: time="2025-07-15T10:53:19.900518138Z" level=info msg="loading plugin \"io.containerd.internal.v1.tracing\"..." type=io.containerd.internal.v1 Jul 15 10:53:19.902072 containerd[1401]: time="2025-07-15T10:53:19.900534468Z" level=info msg="skip loading plugin \"io.containerd.internal.v1.tracing\"..." error="skip plugin: tracing endpoint not configured" type=io.containerd.internal.v1 Jul 15 10:53:19.902072 containerd[1401]: time="2025-07-15T10:53:19.900546100Z" level=info msg="loading plugin \"io.containerd.grpc.v1.healthcheck\"..." type=io.containerd.grpc.v1 Jul 15 10:53:19.902072 containerd[1401]: time="2025-07-15T10:53:19.900560617Z" level=info msg="loading plugin \"io.containerd.nri.v1.nri\"..." type=io.containerd.nri.v1 Jul 15 10:53:19.902072 containerd[1401]: time="2025-07-15T10:53:19.900572800Z" level=info msg="NRI interface is disabled by configuration." Jul 15 10:53:19.902072 containerd[1401]: time="2025-07-15T10:53:19.900584552Z" level=info msg="loading plugin \"io.containerd.grpc.v1.cri\"..." type=io.containerd.grpc.v1 Jul 15 10:53:19.902903 containerd[1401]: time="2025-07-15T10:53:19.900880227Z" level=info msg="Start cri plugin with config {PluginConfig:{ContainerdConfig:{Snapshotter:overlayfs DefaultRuntimeName:runc DefaultRuntime:{Type: Path: Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:map[] PrivilegedWithoutHostDevices:false PrivilegedWithoutHostDevicesAllDevicesAllowed:false BaseRuntimeSpec: NetworkPluginConfDir: NetworkPluginMaxConfNum:0 Snapshotter: SandboxMode:} UntrustedWorkloadRuntime:{Type: Path: Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:map[] PrivilegedWithoutHostDevices:false PrivilegedWithoutHostDevicesAllDevicesAllowed:false BaseRuntimeSpec: NetworkPluginConfDir: NetworkPluginMaxConfNum:0 Snapshotter: SandboxMode:} Runtimes:map[runc:{Type:io.containerd.runc.v2 Path: Engine: PodAnnotations:[] ContainerAnnotations:[] Root: Options:map[SystemdCgroup:true] PrivilegedWithoutHostDevices:false PrivilegedWithoutHostDevicesAllDevicesAllowed:false BaseRuntimeSpec: NetworkPluginConfDir: NetworkPluginMaxConfNum:0 Snapshotter: SandboxMode:podsandbox}] NoPivot:false DisableSnapshotAnnotations:true DiscardUnpackedLayers:false IgnoreBlockIONotEnabledErrors:false IgnoreRdtNotEnabledErrors:false} CniConfig:{NetworkPluginBinDir:/opt/cni/bin NetworkPluginConfDir:/etc/cni/net.d NetworkPluginMaxConfNum:1 NetworkPluginSetupSerially:false NetworkPluginConfTemplate: IPPreference:} Registry:{ConfigPath: Mirrors:map[] Configs:map[] Auths:map[] Headers:map[]} ImageDecryption:{KeyModel:node} DisableTCPService:true StreamServerAddress:127.0.0.1 StreamServerPort:0 StreamIdleTimeout:4h0m0s EnableSelinux:true SelinuxCategoryRange:1024 SandboxImage:registry.k8s.io/pause:3.8 StatsCollectPeriod:10 SystemdCgroup:false EnableTLSStreaming:false X509KeyPairStreaming:{TLSCertFile: TLSKeyFile:} MaxContainerLogLineSize:16384 DisableCgroup:false DisableApparmor:false RestrictOOMScoreAdj:false MaxConcurrentDownloads:3 DisableProcMount:false UnsetSeccompProfile: TolerateMissingHugetlbController:true DisableHugetlbController:true DeviceOwnershipFromSecurityContext:false IgnoreImageDefinedVolumes:false NetNSMountsUnderStateDir:false EnableUnprivilegedPorts:false EnableUnprivilegedICMP:false EnableCDI:false CDISpecDirs:[/etc/cdi /var/run/cdi] ImagePullProgressTimeout:5m0s DrainExecSyncIOTimeout:0s ImagePullWithSyncFs:false IgnoreDeprecationWarnings:[]} ContainerdRootDir:/var/lib/containerd ContainerdEndpoint:/run/containerd/containerd.sock RootDir:/var/lib/containerd/io.containerd.grpc.v1.cri StateDir:/run/containerd/io.containerd.grpc.v1.cri}" Jul 15 10:53:19.902903 containerd[1401]: time="2025-07-15T10:53:19.900938887Z" level=info msg="Connect containerd service" Jul 15 10:53:19.902903 containerd[1401]: time="2025-07-15T10:53:19.900974073Z" level=info msg="using legacy CRI server" Jul 15 10:53:19.902903 containerd[1401]: time="2025-07-15T10:53:19.900983120Z" level=info msg="using experimental NRI integration - disable nri plugin to prevent this" Jul 15 10:53:19.902903 containerd[1401]: time="2025-07-15T10:53:19.901086053Z" level=info msg="Get image filesystem path \"/var/lib/containerd/io.containerd.snapshotter.v1.overlayfs\"" Jul 15 10:53:19.902903 containerd[1401]: time="2025-07-15T10:53:19.901958209Z" level=error msg="failed to load cni during init, please check CRI plugin status before setting up network for pods" error="cni config load failed: no network config found in /etc/cni/net.d: cni plugin not initialized: failed to load cni config" Jul 15 10:53:19.902903 containerd[1401]: time="2025-07-15T10:53:19.902031817Z" level=info msg="Start subscribing containerd event" Jul 15 10:53:19.902903 containerd[1401]: time="2025-07-15T10:53:19.902070980Z" level=info msg="Start recovering state" Jul 15 10:53:19.902903 containerd[1401]: time="2025-07-15T10:53:19.902147704Z" level=info msg="Start event monitor" Jul 15 10:53:19.902903 containerd[1401]: time="2025-07-15T10:53:19.902175536Z" level=info msg="Start snapshots syncer" Jul 15 10:53:19.902903 containerd[1401]: time="2025-07-15T10:53:19.902184333Z" level=info msg="Start cni network conf syncer for default" Jul 15 10:53:19.902903 containerd[1401]: time="2025-07-15T10:53:19.902194211Z" level=info msg="Start streaming server" Jul 15 10:53:19.904010 containerd[1401]: time="2025-07-15T10:53:19.903141037Z" level=info msg=serving... address=/run/containerd/containerd.sock.ttrpc Jul 15 10:53:19.904010 containerd[1401]: time="2025-07-15T10:53:19.903205678Z" level=info msg=serving... address=/run/containerd/containerd.sock Jul 15 10:53:19.904010 containerd[1401]: time="2025-07-15T10:53:19.903866367Z" level=info msg="containerd successfully booted in 0.048575s" Jul 15 10:53:19.904338 systemd[1]: Started containerd.service - containerd container runtime. Jul 15 10:53:20.464382 systemd-networkd[1311]: eth0: Gained IPv6LL Jul 15 10:53:20.465791 systemd-timesyncd[1279]: Network configuration changed, trying to establish connection. Jul 15 10:53:20.477727 systemd[1]: Finished systemd-networkd-wait-online.service - Wait for Network to be Configured. Jul 15 10:53:20.485591 systemd[1]: Reached target network-online.target - Network is Online. Jul 15 10:53:20.498227 systemd[1]: Starting etcd-member.service - etcd (System Application Container)... Jul 15 10:53:20.514606 (-wrapper)[1472]: etcd-member.service: Referenced but unset environment variable evaluates to an empty string: ETCD_OPTS Jul 15 10:53:20.517743 systemd[1]: Starting nvidia.service - NVIDIA Configure Service... Jul 15 10:53:20.579388 systemd[1]: Finished nvidia.service - NVIDIA Configure Service. Jul 15 10:53:20.741839 sshd[1454]: Accepted publickey for core from 172.24.4.1 port 54752 ssh2: RSA SHA256:yBOpfURoKTwgire6O3HnERbyHyOQL97qx11bEhAl8DU Jul 15 10:53:20.745595 sshd-session[1454]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Jul 15 10:53:20.771166 systemd[1]: Created slice user-500.slice - User Slice of UID 500. Jul 15 10:53:20.786815 systemd[1]: Starting user-runtime-dir@500.service - User Runtime Directory /run/user/500... Jul 15 10:53:20.822378 systemd-logind[1382]: New session 1 of user core. Jul 15 10:53:20.833672 (dockerd)[1491]: docker.service: Referenced but unset environment variable evaluates to an empty string: DOCKER_CGROUPS, DOCKER_OPTS, DOCKER_OPT_BIP, DOCKER_OPT_IPMASQ, DOCKER_OPT_MTU Jul 15 10:53:20.834053 systemd[1]: Starting docker.service - Docker Application Container Engine... Jul 15 10:53:20.847131 systemd[1]: Finished user-runtime-dir@500.service - User Runtime Directory /run/user/500. Jul 15 10:53:20.862714 systemd[1]: Starting user@500.service - User Manager for UID 500... Jul 15 10:53:20.881255 (systemd)[1493]: pam_unix(systemd-user:session): session opened for user core(uid=500) by (uid=0) Jul 15 10:53:20.886640 systemd-logind[1382]: New session c1 of user core. Jul 15 10:53:21.072018 systemd[1493]: Queued start job for default target default.target. Jul 15 10:53:21.079360 systemd[1493]: Created slice app.slice - User Application Slice. Jul 15 10:53:21.079391 systemd[1493]: Reached target paths.target - Paths. Jul 15 10:53:21.079434 systemd[1493]: Reached target timers.target - Timers. Jul 15 10:53:21.082246 systemd[1493]: Starting dbus.socket - D-Bus User Message Bus Socket... Jul 15 10:53:21.092207 systemd[1493]: Listening on dbus.socket - D-Bus User Message Bus Socket. Jul 15 10:53:21.092988 systemd[1493]: Reached target sockets.target - Sockets. Jul 15 10:53:21.093041 systemd[1493]: Reached target basic.target - Basic System. Jul 15 10:53:21.093080 systemd[1493]: Reached target default.target - Main User Target. Jul 15 10:53:21.093602 systemd[1493]: Startup finished in 193ms. Jul 15 10:53:21.094335 systemd[1]: Started user@500.service - User Manager for UID 500. Jul 15 10:53:21.105307 systemd[1]: Started session-1.scope - Session 1 of User core. Jul 15 10:53:21.431596 dockerd[1491]: time="2025-07-15T10:53:21.430980600Z" level=info msg="Starting up" Jul 15 10:53:21.600757 systemd[1]: Started sshd@1-172.24.4.54:22-172.24.4.1:54756.service - OpenSSH per-connection server daemon (172.24.4.1:54756). Jul 15 10:53:21.618039 dockerd[1491]: time="2025-07-15T10:53:21.617833833Z" level=info msg="Loading containers: start." Jul 15 10:53:21.826209 kernel: Initializing XFRM netlink socket Jul 15 10:53:21.863785 systemd-timesyncd[1279]: Network configuration changed, trying to establish connection. Jul 15 10:53:21.879601 systemd-timesyncd[1279]: Network configuration changed, trying to establish connection. Jul 15 10:53:21.939632 systemd-networkd[1311]: docker0: Link UP Jul 15 10:53:21.940267 systemd-timesyncd[1279]: Network configuration changed, trying to establish connection. Jul 15 10:53:21.976329 dockerd[1491]: time="2025-07-15T10:53:21.976151969Z" level=info msg="Loading containers: done." Jul 15 10:53:22.001746 dockerd[1491]: time="2025-07-15T10:53:22.001604775Z" level=warning msg="Not using native diff for overlay2, this may cause degraded performance for building images: kernel has CONFIG_OVERLAY_FS_REDIRECT_DIR enabled" storage-driver=overlay2 Jul 15 10:53:22.001932 dockerd[1491]: time="2025-07-15T10:53:22.001875222Z" level=info msg="Docker daemon" commit=41ca978a0a5400cc24b274137efa9f25517fcc0b containerd-snapshotter=false storage-driver=overlay2 version=27.3.1 Jul 15 10:53:22.002272 dockerd[1491]: time="2025-07-15T10:53:22.002211012Z" level=info msg="Daemon has completed initialization" Jul 15 10:53:22.061470 dockerd[1491]: time="2025-07-15T10:53:22.060222894Z" level=info msg="API listen on /run/docker.sock" Jul 15 10:53:22.061022 systemd[1]: Started docker.service - Docker Application Container Engine. Jul 15 10:53:22.065284 etcd-wrapper[1477]: Error response from daemon: No such container: etcd-member Jul 15 10:53:22.094066 etcd-wrapper[1683]: Error response from daemon: No such container: etcd-member Jul 15 10:53:22.163054 etcd-wrapper[1701]: Unable to find image 'quay.io/coreos/etcd:v3.5.16' locally Jul 15 10:53:23.316809 sshd[1525]: Accepted publickey for core from 172.24.4.1 port 54756 ssh2: RSA SHA256:yBOpfURoKTwgire6O3HnERbyHyOQL97qx11bEhAl8DU Jul 15 10:53:23.323029 sshd-session[1525]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Jul 15 10:53:23.340327 systemd-logind[1382]: New session 2 of user core. Jul 15 10:53:23.350562 systemd[1]: Started session-2.scope - Session 2 of User core. Jul 15 10:53:23.527249 etcd-wrapper[1701]: v3.5.16: Pulling from coreos/etcd Jul 15 10:53:23.838560 etcd-wrapper[1701]: 804c8aba2cc6: Pulling fs layer Jul 15 10:53:23.839155 etcd-wrapper[1701]: 2ae710cd8bfe: Pulling fs layer Jul 15 10:53:23.839824 etcd-wrapper[1701]: d462aa345367: Pulling fs layer Jul 15 10:53:23.839824 etcd-wrapper[1701]: 0f8b424aa0b9: Pulling fs layer Jul 15 10:53:23.839824 etcd-wrapper[1701]: d557676654e5: Pulling fs layer Jul 15 10:53:23.839824 etcd-wrapper[1701]: c8022d07192e: Pulling fs layer Jul 15 10:53:23.839824 etcd-wrapper[1701]: d858cbc252ad: Pulling fs layer Jul 15 10:53:23.839824 etcd-wrapper[1701]: 1069fc2daed1: Pulling fs layer Jul 15 10:53:23.839824 etcd-wrapper[1701]: b40161cd83fc: Pulling fs layer Jul 15 10:53:23.839824 etcd-wrapper[1701]: 5318d93a3a65: Pulling fs layer Jul 15 10:53:23.839824 etcd-wrapper[1701]: 307c1adadb60: Pulling fs layer Jul 15 10:53:23.839824 etcd-wrapper[1701]: fbb01d9e9dc9: Pulling fs layer Jul 15 10:53:23.839824 etcd-wrapper[1701]: fbfea02ac3cf: Pulling fs layer Jul 15 10:53:23.839824 etcd-wrapper[1701]: 8c26e4bf18e2: Pulling fs layer Jul 15 10:53:23.839824 etcd-wrapper[1701]: 1e59a65f8816: Pulling fs layer Jul 15 10:53:23.839824 etcd-wrapper[1701]: ffbd4ca5f0bd: Pulling fs layer Jul 15 10:53:23.839824 etcd-wrapper[1701]: d557676654e5: Waiting Jul 15 10:53:23.839824 etcd-wrapper[1701]: c8022d07192e: Waiting Jul 15 10:53:23.839824 etcd-wrapper[1701]: d858cbc252ad: Waiting Jul 15 10:53:23.839824 etcd-wrapper[1701]: 1069fc2daed1: Waiting Jul 15 10:53:23.839824 etcd-wrapper[1701]: b40161cd83fc: Waiting Jul 15 10:53:23.839824 etcd-wrapper[1701]: 5318d93a3a65: Waiting Jul 15 10:53:23.839824 etcd-wrapper[1701]: 307c1adadb60: Waiting Jul 15 10:53:23.839824 etcd-wrapper[1701]: fbb01d9e9dc9: Waiting Jul 15 10:53:23.839824 etcd-wrapper[1701]: fbfea02ac3cf: Waiting Jul 15 10:53:23.839824 etcd-wrapper[1701]: 8c26e4bf18e2: Waiting Jul 15 10:53:23.839824 etcd-wrapper[1701]: 1e59a65f8816: Waiting Jul 15 10:53:23.839824 etcd-wrapper[1701]: ffbd4ca5f0bd: Waiting Jul 15 10:53:23.839824 etcd-wrapper[1701]: 0f8b424aa0b9: Waiting Jul 15 10:53:23.957810 sshd[1711]: Connection closed by 172.24.4.1 port 54756 Jul 15 10:53:23.958696 sshd-session[1525]: pam_unix(sshd:session): session closed for user core Jul 15 10:53:23.976293 systemd[1]: sshd@1-172.24.4.54:22-172.24.4.1:54756.service: Deactivated successfully. Jul 15 10:53:23.980929 systemd[1]: session-2.scope: Deactivated successfully. Jul 15 10:53:23.985287 systemd-logind[1382]: Session 2 logged out. Waiting for processes to exit. Jul 15 10:53:23.993813 systemd[1]: Started sshd@2-172.24.4.54:22-172.24.4.1:53250.service - OpenSSH per-connection server daemon (172.24.4.1:53250). Jul 15 10:53:24.002461 systemd-logind[1382]: Removed session 2. Jul 15 10:53:24.153611 etcd-wrapper[1701]: 804c8aba2cc6: Verifying Checksum Jul 15 10:53:24.153611 etcd-wrapper[1701]: 804c8aba2cc6: Download complete Jul 15 10:53:24.173644 etcd-wrapper[1701]: 2ae710cd8bfe: Verifying Checksum Jul 15 10:53:24.173644 etcd-wrapper[1701]: 2ae710cd8bfe: Download complete Jul 15 10:53:24.229593 etcd-wrapper[1701]: d462aa345367: Verifying Checksum Jul 15 10:53:24.229593 etcd-wrapper[1701]: d462aa345367: Download complete Jul 15 10:53:24.240380 etcd-wrapper[1701]: 804c8aba2cc6: Pull complete Jul 15 10:53:24.272571 systemd[1]: var-lib-docker-overlay2-22f921410ce072295744147447e50345abda18b3053407d162ef20de2527f92e-merged.mount: Deactivated successfully. Jul 15 10:53:24.309797 etcd-wrapper[1701]: 2ae710cd8bfe: Pull complete Jul 15 10:53:24.465978 etcd-wrapper[1701]: 0f8b424aa0b9: Verifying Checksum Jul 15 10:53:24.465978 etcd-wrapper[1701]: 0f8b424aa0b9: Download complete Jul 15 10:53:24.468438 etcd-wrapper[1701]: d557676654e5: Verifying Checksum Jul 15 10:53:24.468438 etcd-wrapper[1701]: d557676654e5: Download complete Jul 15 10:53:24.685164 etcd-wrapper[1701]: c8022d07192e: Verifying Checksum Jul 15 10:53:24.685702 etcd-wrapper[1701]: c8022d07192e: Download complete Jul 15 10:53:24.730584 etcd-wrapper[1701]: d858cbc252ad: Verifying Checksum Jul 15 10:53:24.730584 etcd-wrapper[1701]: d858cbc252ad: Download complete Jul 15 10:53:24.776721 etcd-wrapper[1701]: 1069fc2daed1: Verifying Checksum Jul 15 10:53:24.776721 etcd-wrapper[1701]: 1069fc2daed1: Download complete Jul 15 10:53:24.795496 login[1466]: pam_unix(login:session): session opened for user core(uid=500) by LOGIN(uid=0) Jul 15 10:53:24.801317 login[1467]: pam_unix(login:session): session opened for user core(uid=500) by LOGIN(uid=0) Jul 15 10:53:24.803291 systemd-logind[1382]: New session 3 of user core. Jul 15 10:53:24.809878 systemd[1]: Started session-3.scope - Session 3 of User core. Jul 15 10:53:24.814659 systemd-logind[1382]: New session 4 of user core. Jul 15 10:53:24.821324 systemd[1]: Started session-4.scope - Session 4 of User core. Jul 15 10:53:24.930577 etcd-wrapper[1701]: d462aa345367: Pull complete Jul 15 10:53:24.969687 etcd-wrapper[1701]: b40161cd83fc: Verifying Checksum Jul 15 10:53:24.969976 etcd-wrapper[1701]: b40161cd83fc: Download complete Jul 15 10:53:25.003575 etcd-wrapper[1701]: 0f8b424aa0b9: Pull complete Jul 15 10:53:25.019177 etcd-wrapper[1701]: 5318d93a3a65: Verifying Checksum Jul 15 10:53:25.019177 etcd-wrapper[1701]: 5318d93a3a65: Download complete Jul 15 10:53:25.049046 etcd-wrapper[1701]: 307c1adadb60: Verifying Checksum Jul 15 10:53:25.050210 etcd-wrapper[1701]: 307c1adadb60: Download complete Jul 15 10:53:25.058798 etcd-wrapper[1701]: d557676654e5: Pull complete Jul 15 10:53:25.111832 etcd-wrapper[1701]: c8022d07192e: Pull complete Jul 15 10:53:25.150248 sshd[1716]: Accepted publickey for core from 172.24.4.1 port 53250 ssh2: RSA SHA256:yBOpfURoKTwgire6O3HnERbyHyOQL97qx11bEhAl8DU Jul 15 10:53:25.153250 sshd-session[1716]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Jul 15 10:53:25.163780 etcd-wrapper[1701]: d858cbc252ad: Pull complete Jul 15 10:53:25.167431 systemd-logind[1382]: New session 5 of user core. Jul 15 10:53:25.175316 systemd[1]: Started session-5.scope - Session 5 of User core. Jul 15 10:53:25.218839 etcd-wrapper[1701]: 1069fc2daed1: Pull complete Jul 15 10:53:25.264181 systemd[1]: var-lib-docker-overlay2-69979131e6607d33233b9a9e7c205704c601348ffec238ec059d735c1467f597-merged.mount: Deactivated successfully. Jul 15 10:53:25.268459 etcd-wrapper[1701]: b40161cd83fc: Pull complete Jul 15 10:53:25.302057 systemd[1]: var-lib-docker-overlay2-8824a07d6a9e55a6741ac06e4962dc2c9fb2f4d246d3890e68fd1f8ce62415d5-merged.mount: Deactivated successfully. Jul 15 10:53:25.320487 etcd-wrapper[1701]: 5318d93a3a65: Pull complete Jul 15 10:53:25.366778 systemd[1]: var-lib-docker-overlay2-74c52dcc5b2b18edca54b94dbcfefde8e5f8c1974a1cb9b1f9872f45b3009ee8-merged.mount: Deactivated successfully. Jul 15 10:53:25.455495 etcd-wrapper[1701]: 307c1adadb60: Pull complete Jul 15 10:53:25.585055 etcd-wrapper[1701]: 8c26e4bf18e2: Verifying Checksum Jul 15 10:53:25.585266 etcd-wrapper[1701]: 8c26e4bf18e2: Download complete Jul 15 10:53:25.586645 etcd-wrapper[1701]: fbfea02ac3cf: Verifying Checksum Jul 15 10:53:25.586777 etcd-wrapper[1701]: fbfea02ac3cf: Download complete Jul 15 10:53:25.703179 etcd-wrapper[1701]: fbb01d9e9dc9: Verifying Checksum Jul 15 10:53:25.703607 etcd-wrapper[1701]: fbb01d9e9dc9: Download complete Jul 15 10:53:25.941681 etcd-wrapper[1701]: 1e59a65f8816: Verifying Checksum Jul 15 10:53:25.941995 etcd-wrapper[1701]: 1e59a65f8816: Download complete Jul 15 10:53:25.953078 etcd-wrapper[1701]: ffbd4ca5f0bd: Verifying Checksum Jul 15 10:53:25.953078 etcd-wrapper[1701]: ffbd4ca5f0bd: Download complete Jul 15 10:53:25.962749 sshd[1784]: Connection closed by 172.24.4.1 port 53250 Jul 15 10:53:25.963459 sshd-session[1716]: pam_unix(sshd:session): session closed for user core Jul 15 10:53:25.968473 systemd[1]: sshd@2-172.24.4.54:22-172.24.4.1:53250.service: Deactivated successfully. Jul 15 10:53:25.971402 systemd[1]: session-5.scope: Deactivated successfully. Jul 15 10:53:25.974481 systemd-logind[1382]: Session 5 logged out. Waiting for processes to exit. Jul 15 10:53:25.975905 systemd-logind[1382]: Removed session 5. Jul 15 10:53:26.185817 etcd-wrapper[1701]: fbb01d9e9dc9: Pull complete Jul 15 10:53:26.419988 systemd[1]: var-lib-docker-overlay2-12215cb6b7f4a5db0fe1d4b2477425ef5e666f708dafbd8d8bfae09a36eb8cbe-merged.mount: Deactivated successfully. Jul 15 10:53:26.525869 etcd-wrapper[1701]: fbfea02ac3cf: Pull complete Jul 15 10:53:26.745213 systemd[1]: var-lib-docker-overlay2-e9c98fed774e2d17dffe584a2edca08cd1cb20a39f62fa2b51f84c4d7636a94c-merged.mount: Deactivated successfully. Jul 15 10:53:26.842795 etcd-wrapper[1701]: 8c26e4bf18e2: Pull complete Jul 15 10:53:26.901235 etcd-wrapper[1701]: 1e59a65f8816: Pull complete Jul 15 10:53:26.951417 etcd-wrapper[1701]: ffbd4ca5f0bd: Pull complete Jul 15 10:53:26.973580 etcd-wrapper[1701]: Digest: sha256:d967d98a12dc220a1a290794711dba7eba04b8ce465e12b02383d1bfbb33e159 Jul 15 10:53:26.983331 etcd-wrapper[1701]: Status: Downloaded newer image for quay.io/coreos/etcd:v3.5.16 Jul 15 10:53:27.277714 systemd[1]: var-lib-docker-overlay2-a0c19d7acde3d1cff1012b5b134b70ba86d7551f080336b70d73e20f8bb87853-merged.mount: Deactivated successfully. Jul 15 10:53:27.387778 containerd[1401]: time="2025-07-15T10:53:27.387220717Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1 Jul 15 10:53:27.387778 containerd[1401]: time="2025-07-15T10:53:27.387283384Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1 Jul 15 10:53:27.387778 containerd[1401]: time="2025-07-15T10:53:27.387301969Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Jul 15 10:53:27.387778 containerd[1401]: time="2025-07-15T10:53:27.387382961Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Jul 15 10:53:27.420286 systemd[1]: Started docker-6a57463cccde52b513206511fceef896c5d6e177f4845d70ca16b364ac8579e2.scope - libcontainer container 6a57463cccde52b513206511fceef896c5d6e177f4845d70ca16b364ac8579e2. Jul 15 10:53:27.499259 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:53:27.498787Z","caller":"flags/flag.go:113","msg":"recognized and used environment variable","variable-name":"ETCD_DATA_DIR","variable-value":"/var/lib/etcd"} Jul 15 10:53:27.499555 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:53:27.499355Z","caller":"flags/flag.go:113","msg":"recognized and used environment variable","variable-name":"ETCD_NAME","variable-value":"8656991f64d94efe857774bcacd72dea"} Jul 15 10:53:27.499827 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:53:27.499634Z","caller":"flags/flag.go:93","msg":"unrecognized environment variable","environment-variable":"ETCD_IMAGE_URL=quay.io/coreos/etcd"} Jul 15 10:53:27.499827 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:53:27.499673Z","caller":"flags/flag.go:93","msg":"unrecognized environment variable","environment-variable":"ETCD_IMAGE_TAG=v3.5.16"} Jul 15 10:53:27.500138 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:53:27.499889Z","caller":"flags/flag.go:93","msg":"unrecognized environment variable","environment-variable":"ETCD_USER=etcd"} Jul 15 10:53:27.500138 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:53:27.499980Z","caller":"flags/flag.go:93","msg":"unrecognized environment variable","environment-variable":"ETCD_SSL_DIR=/etc/ssl/certs"} Jul 15 10:53:27.500540 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:53:27.500353Z","caller":"embed/config.go:689","msg":"Running http and grpc server on single port. This is not recommended for production."} Jul 15 10:53:27.500540 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:53:27.500410Z","caller":"etcdmain/etcd.go:73","msg":"Running: ","args":["/usr/local/bin/etcd","--listen-client-urls=http://0.0.0.0:2379","--advertise-client-urls=http://172.24.4.54:2379"]} Jul 15 10:53:27.500901 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:53:27.500686Z","caller":"embed/config.go:689","msg":"Running http and grpc server on single port. This is not recommended for production."} Jul 15 10:53:27.500901 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:53:27.500730Z","caller":"embed/etcd.go:128","msg":"configuring peer listeners","listen-peer-urls":["http://localhost:2380"]} Jul 15 10:53:27.503029 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:53:27.502841Z","caller":"embed/etcd.go:136","msg":"configuring client listeners","listen-client-urls":["http://0.0.0.0:2379"]} Jul 15 10:53:27.503769 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:53:27.503520Z","caller":"embed/etcd.go:311","msg":"starting an etcd server","etcd-version":"3.5.16","git-sha":"f20bbad","go-version":"go1.22.7","go-os":"linux","go-arch":"amd64","max-cpu-set":2,"max-cpu-available":2,"member-initialized":false,"name":"8656991f64d94efe857774bcacd72dea","data-dir":"/var/lib/etcd","wal-dir":"","wal-dir-dedicated":"","member-dir":"/var/lib/etcd/member","force-new-cluster":false,"heartbeat-interval":"100ms","election-timeout":"1s","initial-election-tick-advance":true,"snapshot-count":100000,"max-wals":5,"max-snapshots":5,"snapshot-catchup-entries":5000,"initial-advertise-peer-urls":["http://localhost:2380"],"listen-peer-urls":["http://localhost:2380"],"advertise-client-urls":["http://172.24.4.54:2379"],"listen-client-urls":["http://0.0.0.0:2379"],"listen-metrics-urls":[],"cors":["*"],"host-whitelist":["*"],"initial-cluster":"8656991f64d94efe857774bcacd72dea=http://localhost:2380","initial-cluster-state":"new","initial-cluster-token":"etcd-cluster","quota-backend-bytes":2147483648,"max-request-bytes":1572864,"max-concurrent-streams":4294967295,"pre-vote":true,"initial-corrupt-check":false,"corrupt-check-time-interval":"0s","compact-check-time-enabled":false,"compact-check-time-interval":"1m0s","auto-compaction-mode":"periodic","auto-compaction-retention":"0s","auto-compaction-interval":"0s","discovery-url":"","discovery-proxy":"","downgrade-check-interval":"5s"} Jul 15 10:53:27.509701 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:53:27.509486Z","caller":"etcdserver/backend.go:81","msg":"opened backend db","path":"/var/lib/etcd/member/snap/db","took":"4.989718ms"} Jul 15 10:53:27.517191 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:53:27.516945Z","caller":"etcdserver/raft.go:505","msg":"starting local member","local-member-id":"8e9e05c52164694d","cluster-id":"cdf818194e3a8c32"} Jul 15 10:53:27.517934 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:53:27.517420Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d switched to configuration voters=()"} Jul 15 10:53:27.517934 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:53:27.517479Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d became follower at term 0"} Jul 15 10:53:27.517934 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:53:27.517492Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"newRaft 8e9e05c52164694d [peers: [], term: 0, commit: 0, applied: 0, lastindex: 0, lastterm: 0]"} Jul 15 10:53:27.517934 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:53:27.517501Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d became follower at term 1"} Jul 15 10:53:27.517934 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:53:27.517537Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d switched to configuration voters=(10276657743932975437)"} Jul 15 10:53:27.529572 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:53:27.529356Z","caller":"auth/store.go:1241","msg":"simple token is not cryptographically signed"} Jul 15 10:53:27.531245 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:53:27.530852Z","caller":"mvcc/kvstore.go:423","msg":"kvstore restored","current-rev":1} Jul 15 10:53:27.534026 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:53:27.533804Z","caller":"etcdserver/quota.go:94","msg":"enabled backend quota with default value","quota-name":"v3-applier","quota-size-bytes":2147483648,"quota-size":"2.1 GB"} Jul 15 10:53:27.535466 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:53:27.535185Z","caller":"etcdserver/server.go:873","msg":"starting etcd server","local-member-id":"8e9e05c52164694d","local-server-version":"3.5.16","cluster-version":"to_be_decided"} Jul 15 10:53:27.537421 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:53:27.536028Z","caller":"etcdserver/server.go:757","msg":"started as single-node; fast-forwarding election ticks","local-member-id":"8e9e05c52164694d","forward-ticks":9,"forward-duration":"900ms","election-ticks":10,"election-timeout":"1s"} Jul 15 10:53:27.537421 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:53:27.536077Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"} Jul 15 10:53:27.537421 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:53:27.536375Z","caller":"fileutil/purge.go:50","msg":"started to purge file","dir":"/var/lib/etcd/member/snap","suffix":"snap.db","max":5,"interval":"30s"} Jul 15 10:53:27.537421 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:53:27.536477Z","caller":"fileutil/purge.go:50","msg":"started to purge file","dir":"/var/lib/etcd/member/snap","suffix":"snap","max":5,"interval":"30s"} Jul 15 10:53:27.537421 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:53:27.536500Z","caller":"fileutil/purge.go:50","msg":"started to purge file","dir":"/var/lib/etcd/member/wal","suffix":"wal","max":5,"interval":"30s"} Jul 15 10:53:27.537421 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:53:27.536968Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d switched to configuration voters=(10276657743932975437)"} Jul 15 10:53:27.537986 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:53:27.537203Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"cdf818194e3a8c32","local-member-id":"8e9e05c52164694d","added-peer-id":"8e9e05c52164694d","added-peer-peer-urls":["http://localhost:2380"]} Jul 15 10:53:27.543694 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:53:27.543412Z","caller":"embed/etcd.go:600","msg":"serving peer traffic","address":"127.0.0.1:2380"} Jul 15 10:53:27.543694 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:53:27.543467Z","caller":"embed/etcd.go:572","msg":"cmux::serve","address":"127.0.0.1:2380"} Jul 15 10:53:27.544719 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:53:27.544333Z","caller":"embed/etcd.go:280","msg":"now serving peer/client/metrics","local-member-id":"8e9e05c52164694d","initial-advertise-peer-urls":["http://localhost:2380"],"listen-peer-urls":["http://localhost:2380"],"advertise-client-urls":["http://172.24.4.54:2379"],"listen-client-urls":["http://0.0.0.0:2379"],"listen-metrics-urls":[]} Jul 15 10:53:28.019005 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:53:28.018343Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d is starting a new election at term 1"} Jul 15 10:53:28.019005 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:53:28.018410Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d became pre-candidate at term 1"} Jul 15 10:53:28.019005 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:53:28.018442Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d received MsgPreVoteResp from 8e9e05c52164694d at term 1"} Jul 15 10:53:28.019005 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:53:28.018467Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d became candidate at term 2"} Jul 15 10:53:28.019005 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:53:28.018486Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d received MsgVoteResp from 8e9e05c52164694d at term 2"} Jul 15 10:53:28.019005 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:53:28.018507Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d became leader at term 2"} Jul 15 10:53:28.019005 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:53:28.018524Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: 8e9e05c52164694d elected leader 8e9e05c52164694d at term 2"} Jul 15 10:53:28.025269 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:53:28.021103Z","caller":"etcdserver/server.go:2140","msg":"published local member to cluster through raft","local-member-id":"8e9e05c52164694d","local-member-attributes":"{Name:8656991f64d94efe857774bcacd72dea ClientURLs:[http://172.24.4.54:2379]}","request-path":"/0/members/8e9e05c52164694d/attributes","cluster-id":"cdf818194e3a8c32","publish-timeout":"7s"} Jul 15 10:53:28.025269 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:53:28.021190Z","caller":"etcdserver/server.go:2651","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"} Jul 15 10:53:28.025269 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:53:28.021440Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"} Jul 15 10:53:28.025269 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:53:28.022086Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"} Jul 15 10:53:28.025269 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:53:28.023008Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"} Jul 15 10:53:28.025269 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:53:28.023511Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"cdf818194e3a8c32","local-member-id":"8e9e05c52164694d","cluster-version":"3.5"} Jul 15 10:53:28.025269 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:53:28.024409Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"} Jul 15 10:53:28.025269 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:53:28.024841Z","caller":"etcdserver/server.go:2675","msg":"cluster version is updated","cluster-version":"3.5"} Jul 15 10:53:28.022973 systemd[1]: Started etcd-member.service - etcd (System Application Container). Jul 15 10:53:28.027080 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:53:28.024098Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"} Jul 15 10:53:28.024969 systemd[1]: Reached target multi-user.target - Multi-User System. Jul 15 10:53:28.028649 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:53:28.027444Z","caller":"embed/serve.go:187","msg":"serving client traffic insecurely; this is strongly discouraged!","traffic":"grpc+http","address":"[::]:2379"} Jul 15 10:53:28.025978 systemd[1]: Startup finished in 1.191s (kernel) + 11.705s (initrd) + 12.653s (userspace) = 25.550s. Jul 15 10:53:36.019542 systemd[1]: Started sshd@3-172.24.4.54:22-172.24.4.1:49696.service - OpenSSH per-connection server daemon (172.24.4.1:49696). Jul 15 10:53:37.537928 sshd[1878]: Accepted publickey for core from 172.24.4.1 port 49696 ssh2: RSA SHA256:yBOpfURoKTwgire6O3HnERbyHyOQL97qx11bEhAl8DU Jul 15 10:53:37.543041 sshd-session[1878]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Jul 15 10:53:37.563737 systemd-logind[1382]: New session 6 of user core. Jul 15 10:53:37.578577 systemd[1]: Started session-6.scope - Session 6 of User core. Jul 15 10:53:38.135190 sshd[1880]: Connection closed by 172.24.4.1 port 49696 Jul 15 10:53:38.135544 sshd-session[1878]: pam_unix(sshd:session): session closed for user core Jul 15 10:53:38.152816 systemd[1]: sshd@3-172.24.4.54:22-172.24.4.1:49696.service: Deactivated successfully. Jul 15 10:53:38.157194 systemd[1]: session-6.scope: Deactivated successfully. Jul 15 10:53:38.161734 systemd-logind[1382]: Session 6 logged out. Waiting for processes to exit. Jul 15 10:53:38.171895 systemd[1]: Started sshd@4-172.24.4.54:22-172.24.4.1:49706.service - OpenSSH per-connection server daemon (172.24.4.1:49706). Jul 15 10:53:38.175394 systemd-logind[1382]: Removed session 6. Jul 15 10:53:39.274909 sshd[1885]: Accepted publickey for core from 172.24.4.1 port 49706 ssh2: RSA SHA256:yBOpfURoKTwgire6O3HnERbyHyOQL97qx11bEhAl8DU Jul 15 10:53:39.278803 sshd-session[1885]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Jul 15 10:53:39.293196 systemd-logind[1382]: New session 7 of user core. Jul 15 10:53:39.303488 systemd[1]: Started session-7.scope - Session 7 of User core. Jul 15 10:53:39.882875 sshd[1888]: Connection closed by 172.24.4.1 port 49706 Jul 15 10:53:39.884351 sshd-session[1885]: pam_unix(sshd:session): session closed for user core Jul 15 10:53:39.902754 systemd[1]: sshd@4-172.24.4.54:22-172.24.4.1:49706.service: Deactivated successfully. Jul 15 10:53:39.907711 systemd[1]: session-7.scope: Deactivated successfully. Jul 15 10:53:39.909634 systemd-logind[1382]: Session 7 logged out. Waiting for processes to exit. Jul 15 10:53:39.916755 systemd[1]: Started sshd@5-172.24.4.54:22-172.24.4.1:49718.service - OpenSSH per-connection server daemon (172.24.4.1:49718). Jul 15 10:53:39.920854 systemd-logind[1382]: Removed session 7. Jul 15 10:53:41.024536 sshd[1893]: Accepted publickey for core from 172.24.4.1 port 49718 ssh2: RSA SHA256:yBOpfURoKTwgire6O3HnERbyHyOQL97qx11bEhAl8DU Jul 15 10:53:41.028555 sshd-session[1893]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Jul 15 10:53:41.041269 systemd-logind[1382]: New session 8 of user core. Jul 15 10:53:41.050459 systemd[1]: Started session-8.scope - Session 8 of User core. Jul 15 10:53:41.756176 sshd[1896]: Connection closed by 172.24.4.1 port 49718 Jul 15 10:53:41.756547 sshd-session[1893]: pam_unix(sshd:session): session closed for user core Jul 15 10:53:41.776877 systemd[1]: sshd@5-172.24.4.54:22-172.24.4.1:49718.service: Deactivated successfully. Jul 15 10:53:41.780955 systemd[1]: session-8.scope: Deactivated successfully. Jul 15 10:53:41.783779 systemd-logind[1382]: Session 8 logged out. Waiting for processes to exit. Jul 15 10:53:41.805336 systemd[1]: Started sshd@6-172.24.4.54:22-172.24.4.1:49722.service - OpenSSH per-connection server daemon (172.24.4.1:49722). Jul 15 10:53:41.808687 systemd-logind[1382]: Removed session 8. Jul 15 10:53:42.922908 sshd[1901]: Accepted publickey for core from 172.24.4.1 port 49722 ssh2: RSA SHA256:yBOpfURoKTwgire6O3HnERbyHyOQL97qx11bEhAl8DU Jul 15 10:53:42.925911 sshd-session[1901]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Jul 15 10:53:42.942310 systemd-logind[1382]: New session 9 of user core. Jul 15 10:53:42.953556 systemd[1]: Started session-9.scope - Session 9 of User core. Jul 15 10:53:43.423846 sudo[1905]: core : PWD=/home/core ; USER=root ; COMMAND=/usr/sbin/setenforce 1 Jul 15 10:53:43.424992 sudo[1905]: pam_unix(sudo:session): session opened for user root(uid=0) by core(uid=500) Jul 15 10:53:43.452356 sudo[1905]: pam_unix(sudo:session): session closed for user root Jul 15 10:53:43.650253 sshd[1904]: Connection closed by 172.24.4.1 port 49722 Jul 15 10:53:43.651595 sshd-session[1901]: pam_unix(sshd:session): session closed for user core Jul 15 10:53:43.665828 systemd[1]: sshd@6-172.24.4.54:22-172.24.4.1:49722.service: Deactivated successfully. Jul 15 10:53:43.669476 systemd[1]: session-9.scope: Deactivated successfully. Jul 15 10:53:43.671806 systemd-logind[1382]: Session 9 logged out. Waiting for processes to exit. Jul 15 10:53:43.680797 systemd[1]: Started sshd@7-172.24.4.54:22-172.24.4.1:45340.service - OpenSSH per-connection server daemon (172.24.4.1:45340). Jul 15 10:53:43.686339 systemd-logind[1382]: Removed session 9. Jul 15 10:53:44.795363 sshd[1910]: Accepted publickey for core from 172.24.4.1 port 45340 ssh2: RSA SHA256:yBOpfURoKTwgire6O3HnERbyHyOQL97qx11bEhAl8DU Jul 15 10:53:44.798482 sshd-session[1910]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Jul 15 10:53:44.813234 systemd-logind[1382]: New session 10 of user core. Jul 15 10:53:44.821506 systemd[1]: Started session-10.scope - Session 10 of User core. Jul 15 10:53:45.266381 sudo[1915]: core : PWD=/home/core ; USER=root ; COMMAND=/usr/sbin/rm -rf /etc/audit/rules.d/80-selinux.rules /etc/audit/rules.d/99-default.rules Jul 15 10:53:45.267080 sudo[1915]: pam_unix(sudo:session): session opened for user root(uid=0) by core(uid=500) Jul 15 10:53:45.280226 sudo[1915]: pam_unix(sudo:session): session closed for user root Jul 15 10:53:45.289412 sudo[1914]: core : PWD=/home/core ; USER=root ; COMMAND=/usr/sbin/systemctl restart audit-rules Jul 15 10:53:45.289728 sudo[1914]: pam_unix(sudo:session): session opened for user root(uid=0) by core(uid=500) Jul 15 10:53:45.320492 systemd[1]: Starting audit-rules.service - Load Audit Rules... Jul 15 10:53:45.371413 augenrules[1937]: No rules Jul 15 10:53:45.372715 systemd[1]: audit-rules.service: Deactivated successfully. Jul 15 10:53:45.373088 systemd[1]: Finished audit-rules.service - Load Audit Rules. Jul 15 10:53:45.374534 sudo[1914]: pam_unix(sudo:session): session closed for user root Jul 15 10:53:45.562366 sshd[1913]: Connection closed by 172.24.4.1 port 45340 Jul 15 10:53:45.565921 sshd-session[1910]: pam_unix(sshd:session): session closed for user core Jul 15 10:53:45.594302 systemd[1]: sshd@7-172.24.4.54:22-172.24.4.1:45340.service: Deactivated successfully. Jul 15 10:53:45.598054 systemd[1]: session-10.scope: Deactivated successfully. Jul 15 10:53:45.600286 systemd-logind[1382]: Session 10 logged out. Waiting for processes to exit. Jul 15 10:53:45.608730 systemd[1]: Started sshd@8-172.24.4.54:22-172.24.4.1:45352.service - OpenSSH per-connection server daemon (172.24.4.1:45352). Jul 15 10:53:45.613154 systemd-logind[1382]: Removed session 10. Jul 15 10:53:46.829299 sshd[1945]: Accepted publickey for core from 172.24.4.1 port 45352 ssh2: RSA SHA256:yBOpfURoKTwgire6O3HnERbyHyOQL97qx11bEhAl8DU Jul 15 10:53:46.833702 sshd-session[1945]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Jul 15 10:53:46.847405 systemd-logind[1382]: New session 11 of user core. Jul 15 10:53:46.859581 systemd[1]: Started session-11.scope - Session 11 of User core. Jul 15 10:53:47.598211 sshd[1948]: Connection closed by 172.24.4.1 port 45352 Jul 15 10:53:47.598559 sshd-session[1945]: pam_unix(sshd:session): session closed for user core Jul 15 10:53:47.614951 systemd[1]: sshd@8-172.24.4.54:22-172.24.4.1:45352.service: Deactivated successfully. Jul 15 10:53:47.618774 systemd[1]: session-11.scope: Deactivated successfully. Jul 15 10:53:47.620816 systemd-logind[1382]: Session 11 logged out. Waiting for processes to exit. Jul 15 10:53:47.629759 systemd[1]: Started sshd@9-172.24.4.54:22-172.24.4.1:45368.service - OpenSSH per-connection server daemon (172.24.4.1:45368). Jul 15 10:53:47.633795 systemd-logind[1382]: Removed session 11. Jul 15 10:53:49.205157 sshd[1955]: Accepted publickey for core from 172.24.4.1 port 45368 ssh2: RSA SHA256:yBOpfURoKTwgire6O3HnERbyHyOQL97qx11bEhAl8DU Jul 15 10:53:49.208749 sshd-session[1955]: pam_unix(sshd:session): session opened for user core(uid=500) by core(uid=0) Jul 15 10:53:49.224381 systemd-logind[1382]: New session 12 of user core. Jul 15 10:53:49.237494 systemd[1]: Started session-12.scope - Session 12 of User core. Jul 15 10:53:50.010174 sshd[1958]: Connection closed by 172.24.4.1 port 45368 Jul 15 10:53:50.011617 sshd-session[1955]: pam_unix(sshd:session): session closed for user core Jul 15 10:53:50.020213 systemd[1]: sshd@9-172.24.4.54:22-172.24.4.1:45368.service: Deactivated successfully. Jul 15 10:53:50.024460 systemd[1]: session-12.scope: Deactivated successfully. Jul 15 10:53:50.026672 systemd-logind[1382]: Session 12 logged out. Waiting for processes to exit. Jul 15 10:53:50.029559 systemd-logind[1382]: Removed session 12. Jul 15 10:53:52.932923 systemd-timesyncd[1279]: Contacted time server 74.208.79.7:123 (2.flatcar.pool.ntp.org). Jul 15 10:53:52.933074 systemd-timesyncd[1279]: Initial clock synchronization to Tue 2025-07-15 10:53:52.932148 UTC. Jul 15 10:53:52.933432 systemd-resolved[1253]: Clock change detected. Flushing caches. Jul 15 10:54:05.300945 update_engine[1386]: I20250715 10:54:05.300202 1386 update_attempter.cc:509] Updating boot flags... Jul 15 10:54:05.403913 kernel: BTRFS warning: duplicate device /dev/vda3 devid 1 generation 36 scanned by (udev-worker) (1976) Jul 15 10:54:05.474639 kernel: BTRFS warning: duplicate device /dev/vda3 devid 1 generation 36 scanned by (udev-worker) (1974) Jul 15 10:55:39.333274 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:55:39.311621Z","caller":"traceutil/trace.go:171","msg":"trace[2022433337] transaction","detail":"{read_only:false; response_revision:190; number_of_response:1; }","duration":"127.116311ms","start":"2025-07-15T10:55:39.184346Z","end":"2025-07-15T10:55:39.311462Z","steps":["trace[2022433337] 'process raft request' (duration: 63.56106ms)","trace[2022433337] 'compare' (duration: 63.124901ms)"],"step_count":2} Jul 15 10:55:41.157356 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:55:41.155271Z","caller":"traceutil/trace.go:171","msg":"trace[262461951] transaction","detail":"{read_only:false; response_revision:244; number_of_response:1; }","duration":"163.327486ms","start":"2025-07-15T10:55:40.991753Z","end":"2025-07-15T10:55:41.155080Z","steps":["trace[262461951] 'process raft request' (duration: 162.92042ms)"],"step_count":1} Jul 15 10:55:42.673205 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:55:42.672050Z","caller":"traceutil/trace.go:171","msg":"trace[880594827] transaction","detail":"{read_only:false; response_revision:281; number_of_response:1; }","duration":"126.048364ms","start":"2025-07-15T10:55:42.545963Z","end":"2025-07-15T10:55:42.672012Z","steps":["trace[880594827] 'process raft request' (duration: 80.090186ms)","trace[880594827] 'compare' (duration: 45.143573ms)"],"step_count":2} Jul 15 10:55:53.631471 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:55:53.625426Z","caller":"traceutil/trace.go:171","msg":"trace[526316386] transaction","detail":"{read_only:false; response_revision:480; number_of_response:1; }","duration":"151.184439ms","start":"2025-07-15T10:55:53.474099Z","end":"2025-07-15T10:55:53.625284Z","steps":["trace[526316386] 'process raft request' (duration: 80.380048ms)","trace[526316386] 'compare' (duration: 70.293134ms)"],"step_count":2} Jul 15 10:55:57.677307 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:55:57.676382Z","caller":"traceutil/trace.go:171","msg":"trace[989386863] transaction","detail":"{read_only:false; response_revision:507; number_of_response:1; }","duration":"164.299831ms","start":"2025-07-15T10:55:57.512051Z","end":"2025-07-15T10:55:57.676351Z","steps":["trace[989386863] 'process raft request' (duration: 164.126037ms)"],"step_count":1} Jul 15 10:55:58.727190 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:55:58.725874Z","caller":"traceutil/trace.go:171","msg":"trace[1251167148] linearizableReadLoop","detail":"{readStateIndex:548; appliedIndex:547; }","duration":"110.07245ms","start":"2025-07-15T10:55:58.615708Z","end":"2025-07-15T10:55:58.725780Z","steps":["trace[1251167148] 'read index received' (duration: 88.652432ms)","trace[1251167148] 'applied index is now lower than readState.Index' (duration: 21.418136ms)"],"step_count":2} Jul 15 10:55:58.727190 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:55:58.726116Z","caller":"traceutil/trace.go:171","msg":"trace[1735817108] transaction","detail":"{read_only:false; response_revision:532; number_of_response:1; }","duration":"113.317344ms","start":"2025-07-15T10:55:58.612763Z","end":"2025-07-15T10:55:58.726081Z","steps":["trace[1735817108] 'process raft request' (duration: 91.673974ms)","trace[1735817108] 'compare' (duration: 21.195196ms)"],"step_count":2} Jul 15 10:55:58.728794 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:55:58.726324Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"110.390046ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/rolebindings/kube-system/calico-apiserver-auth-reader\" limit:1 ","response":"range_response_count:1 size:679"} Jul 15 10:55:58.728794 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:55:58.726608Z","caller":"traceutil/trace.go:171","msg":"trace[47471792] range","detail":"{range_begin:/registry/rolebindings/kube-system/calico-apiserver-auth-reader; range_end:; response_count:1; response_revision:532; }","duration":"110.880967ms","start":"2025-07-15T10:55:58.615651Z","end":"2025-07-15T10:55:58.726532Z","steps":["trace[47471792] 'agreement among raft nodes before linearized reading' (duration: 110.327698ms)"],"step_count":1} Jul 15 10:55:58.732488 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:55:58.732063Z","caller":"traceutil/trace.go:171","msg":"trace[249184858] transaction","detail":"{read_only:false; response_revision:533; number_of_response:1; }","duration":"109.001033ms","start":"2025-07-15T10:55:58.623038Z","end":"2025-07-15T10:55:58.732039Z","steps":["trace[249184858] 'process raft request' (duration: 108.437807ms)"],"step_count":1} Jul 15 10:56:11.507361 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:56:11.496710Z","caller":"traceutil/trace.go:171","msg":"trace[1989383993] transaction","detail":"{read_only:false; response_revision:781; number_of_response:1; }","duration":"141.451442ms","start":"2025-07-15T10:56:11.355169Z","end":"2025-07-15T10:56:11.496621Z","steps":["trace[1989383993] 'process raft request' (duration: 141.03591ms)"],"step_count":1} Jul 15 10:56:11.924304 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:56:11.922259Z","caller":"traceutil/trace.go:171","msg":"trace[1332432078] transaction","detail":"{read_only:false; response_revision:782; number_of_response:1; }","duration":"251.319674ms","start":"2025-07-15T10:56:11.670903Z","end":"2025-07-15T10:56:11.922222Z","steps":["trace[1332432078] 'process raft request' (duration: 251.071391ms)"],"step_count":1} Jul 15 10:56:11.924304 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:56:11.923126Z","caller":"traceutil/trace.go:171","msg":"trace[649867457] linearizableReadLoop","detail":"{readStateIndex:803; appliedIndex:803; }","duration":"220.378803ms","start":"2025-07-15T10:56:11.702633Z","end":"2025-07-15T10:56:11.923011Z","steps":["trace[649867457] 'read index received' (duration: 220.363987ms)","trace[649867457] 'applied index is now lower than readState.Index' (duration: 13.233µs)"],"step_count":2} Jul 15 10:56:11.925441 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:56:11.923733Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"220.838694ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/goldmanes/default\" limit:1 ","response":"range_response_count:1 size:729"} Jul 15 10:56:11.925441 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:56:11.923977Z","caller":"traceutil/trace.go:171","msg":"trace[850835256] range","detail":"{range_begin:/registry/operator.tigera.io/goldmanes/default; range_end:; response_count:1; response_revision:782; }","duration":"221.353782ms","start":"2025-07-15T10:56:11.702584Z","end":"2025-07-15T10:56:11.923938Z","steps":["trace[850835256] 'agreement among raft nodes before linearized reading' (duration: 220.627176ms)"],"step_count":1} Jul 15 10:56:11.928775 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:56:11.928110Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"124.11669ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/configmaps/calico-system/active-operator\" limit:1 ","response":"range_response_count:1 size:518"} Jul 15 10:56:11.928775 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:56:11.928299Z","caller":"traceutil/trace.go:171","msg":"trace[947066846] range","detail":"{range_begin:/registry/configmaps/calico-system/active-operator; range_end:; response_count:1; response_revision:783; }","duration":"124.324602ms","start":"2025-07-15T10:56:11.803934Z","end":"2025-07-15T10:56:11.928258Z","steps":["trace[947066846] 'agreement among raft nodes before linearized reading' (duration: 123.949652ms)"],"step_count":1} Jul 15 10:56:16.332318 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:56:16.326088Z","caller":"traceutil/trace.go:171","msg":"trace[920026395] transaction","detail":"{read_only:false; response_revision:795; number_of_response:1; }","duration":"357.467472ms","start":"2025-07-15T10:56:15.968561Z","end":"2025-07-15T10:56:16.326029Z","steps":["trace[920026395] 'process raft request' (duration: 357.085047ms)"],"step_count":1} Jul 15 10:56:16.332318 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:56:16.330667Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:56:15.968507Z","time spent":"357.799637ms","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":490,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 10:56:16.401542 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:56:16.400059Z","caller":"traceutil/trace.go:171","msg":"trace[648246591] transaction","detail":"{read_only:false; response_revision:796; number_of_response:1; }","duration":"257.937388ms","start":"2025-07-15T10:56:16.142079Z","end":"2025-07-15T10:56:16.400016Z","steps":["trace[648246591] 'process raft request' (duration: 225.330325ms)","trace[648246591] 'compare' (duration: 32.102337ms)"],"step_count":2} Jul 15 10:56:16.401542 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:56:16.400558Z","caller":"traceutil/trace.go:171","msg":"trace[681329158] transaction","detail":"{read_only:false; response_revision:797; number_of_response:1; }","duration":"180.059277ms","start":"2025-07-15T10:56:16.220451Z","end":"2025-07-15T10:56:16.400510Z","steps":["trace[681329158] 'process raft request' (duration: 179.449313ms)"],"step_count":1} Jul 15 10:56:23.420030 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:56:23.416696Z","caller":"traceutil/trace.go:171","msg":"trace[2049484519] transaction","detail":"{read_only:false; response_revision:824; number_of_response:1; }","duration":"134.404769ms","start":"2025-07-15T10:56:23.282125Z","end":"2025-07-15T10:56:23.416529Z","steps":["trace[2049484519] 'process raft request' (duration: 110.892722ms)","trace[2049484519] 'compare' (duration: 23.272344ms)"],"step_count":2} Jul 15 10:56:23.576747 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:56:23.575632Z","caller":"traceutil/trace.go:171","msg":"trace[2081206476] transaction","detail":"{read_only:false; response_revision:825; number_of_response:1; }","duration":"111.250705ms","start":"2025-07-15T10:56:23.464339Z","end":"2025-07-15T10:56:23.575590Z","steps":["trace[2081206476] 'process raft request' (duration: 110.968636ms)"],"step_count":1} Jul 15 10:56:23.752169 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:56:23.751149Z","caller":"traceutil/trace.go:171","msg":"trace[115209352] transaction","detail":"{read_only:false; response_revision:833; number_of_response:1; }","duration":"120.553105ms","start":"2025-07-15T10:56:23.630562Z","end":"2025-07-15T10:56:23.751115Z","steps":["trace[115209352] 'process raft request' (duration: 46.460549ms)","trace[115209352] 'compare' (duration: 73.920216ms)"],"step_count":2} Jul 15 10:56:42.410743 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:56:42.407925Z","caller":"traceutil/trace.go:171","msg":"trace[2023354150] transaction","detail":"{read_only:false; response_revision:1105; number_of_response:1; }","duration":"188.745063ms","start":"2025-07-15T10:56:42.219094Z","end":"2025-07-15T10:56:42.407839Z","steps":["trace[2023354150] 'process raft request' (duration: 167.455088ms)","trace[2023354150] 'compare' (duration: 21.088086ms)"],"step_count":2} Jul 15 10:56:42.746773 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:56:42.744995Z","caller":"traceutil/trace.go:171","msg":"trace[924068216] transaction","detail":"{read_only:false; response_revision:1109; number_of_response:1; }","duration":"102.34145ms","start":"2025-07-15T10:56:42.642622Z","end":"2025-07-15T10:56:42.744963Z","steps":["trace[924068216] 'process raft request' (duration: 101.701853ms)"],"step_count":1} Jul 15 10:56:44.524730 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:56:44.522442Z","caller":"traceutil/trace.go:171","msg":"trace[1692323600] transaction","detail":"{read_only:false; response_revision:1123; number_of_response:1; }","duration":"116.692642ms","start":"2025-07-15T10:56:44.405641Z","end":"2025-07-15T10:56:44.522333Z","steps":["trace[1692323600] 'process raft request' (duration: 84.814128ms)","trace[1692323600] 'compare' (duration: 31.649987ms)"],"step_count":2} Jul 15 10:56:49.913424 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:56:49.909099Z","caller":"traceutil/trace.go:171","msg":"trace[82398388] transaction","detail":"{read_only:false; response_revision:1223; number_of_response:1; }","duration":"155.721606ms","start":"2025-07-15T10:56:49.753282Z","end":"2025-07-15T10:56:49.909004Z","steps":["trace[82398388] 'process raft request' (duration: 123.131128ms)","trace[82398388] 'compare' (duration: 32.289829ms)"],"step_count":2} Jul 15 10:56:49.913424 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:56:49.910397Z","caller":"traceutil/trace.go:171","msg":"trace[1942221957] transaction","detail":"{read_only:false; response_revision:1224; number_of_response:1; }","duration":"153.462286ms","start":"2025-07-15T10:56:49.756909Z","end":"2025-07-15T10:56:49.910372Z","steps":["trace[1942221957] 'process raft request' (duration: 151.99285ms)"],"step_count":1} Jul 15 10:56:50.164419 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:56:50.162751Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"145.006105ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/felixconfigurations/default\" limit:1 ","response":"range_response_count:1 size:1580"} Jul 15 10:56:50.164419 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:56:50.162958Z","caller":"traceutil/trace.go:171","msg":"trace[314951550] range","detail":"{range_begin:/registry/crd.projectcalico.org/felixconfigurations/default; range_end:; response_count:1; response_revision:1225; }","duration":"145.463894ms","start":"2025-07-15T10:56:50.017453Z","end":"2025-07-15T10:56:50.162917Z","steps":["trace[314951550] 'range keys from in-memory index tree' (duration: 144.726384ms)"],"step_count":1} Jul 15 10:56:50.183885 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:56:50.182176Z","caller":"traceutil/trace.go:171","msg":"trace[726934181] linearizableReadLoop","detail":"{readStateIndex:1259; appliedIndex:1258; }","duration":"107.366777ms","start":"2025-07-15T10:56:50.074764Z","end":"2025-07-15T10:56:50.182130Z","steps":["trace[726934181] 'read index received' (duration: 107.025683ms)","trace[726934181] 'applied index is now lower than readState.Index' (duration: 338.148µs)"],"step_count":2} Jul 15 10:56:50.183885 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:56:50.182335Z","caller":"traceutil/trace.go:171","msg":"trace[1839236483] transaction","detail":"{read_only:false; response_revision:1226; number_of_response:1; }","duration":"133.73623ms","start":"2025-07-15T10:56:50.048583Z","end":"2025-07-15T10:56:50.182319Z","steps":["trace[1839236483] 'process raft request' (duration: 133.356346ms)"],"step_count":1} Jul 15 10:56:50.183885 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:56:50.182593Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"107.802344ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/minions/ci-4230-2-100-9439eb8d1a.novalocal\" limit:1 ","response":"range_response_count:1 size:5246"} Jul 15 10:56:50.183885 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:56:50.182743Z","caller":"traceutil/trace.go:171","msg":"trace[2052422875] range","detail":"{range_begin:/registry/minions/ci-4230-2-100-9439eb8d1a.novalocal; range_end:; response_count:1; response_revision:1226; }","duration":"107.920509ms","start":"2025-07-15T10:56:50.074718Z","end":"2025-07-15T10:56:50.182638Z","steps":["trace[2052422875] 'agreement among raft nodes before linearized reading' (duration: 107.715956ms)"],"step_count":1} Jul 15 10:56:50.414129 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:56:50.411727Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"107.404283ms","expected-duration":"100ms","prefix":"","request":"header: txn: success:> failure: >>","response":"size:16"} Jul 15 10:56:50.414129 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:56:50.412034Z","caller":"traceutil/trace.go:171","msg":"trace[1966790348] linearizableReadLoop","detail":"{readStateIndex:1263; appliedIndex:1262; }","duration":"155.093317ms","start":"2025-07-15T10:56:50.256899Z","end":"2025-07-15T10:56:50.411993Z","steps":["trace[1966790348] 'read index received' (duration: 46.24876ms)","trace[1966790348] 'applied index is now lower than readState.Index' (duration: 108.842003ms)"],"step_count":2} Jul 15 10:56:50.414129 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:56:50.412453Z","caller":"traceutil/trace.go:171","msg":"trace[1511282478] transaction","detail":"{read_only:false; response_revision:1230; number_of_response:1; }","duration":"156.921158ms","start":"2025-07-15T10:56:50.255509Z","end":"2025-07-15T10:56:50.412431Z","steps":["trace[1511282478] 'process raft request' (duration: 47.820253ms)","trace[1511282478] 'compare' (duration: 107.160326ms)"],"step_count":2} Jul 15 10:56:50.415489 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:56:50.412983Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"156.053382ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/ipamhandles/wireguard-tunnel-addr-ci-4230-2-100-9439eb8d1a.novalocal\" limit:1 ","response":"range_response_count:0 size:5"} Jul 15 10:56:50.415489 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:56:50.413072Z","caller":"traceutil/trace.go:171","msg":"trace[524975963] range","detail":"{range_begin:/registry/crd.projectcalico.org/ipamhandles/wireguard-tunnel-addr-ci-4230-2-100-9439eb8d1a.novalocal; range_end:; response_count:0; response_revision:1230; }","duration":"156.138057ms","start":"2025-07-15T10:56:50.256892Z","end":"2025-07-15T10:56:50.413030Z","steps":["trace[524975963] 'agreement among raft nodes before linearized reading' (duration: 156.031322ms)"],"step_count":1} Jul 15 10:56:50.415489 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:56:50.413283Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"148.958741ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/services/endpoints/calico-system/calico-typha\" limit:1 ","response":"range_response_count:1 size:789"} Jul 15 10:56:50.416124 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:56:50.413418Z","caller":"traceutil/trace.go:171","msg":"trace[779152419] range","detail":"{range_begin:/registry/services/endpoints/calico-system/calico-typha; range_end:; response_count:1; response_revision:1230; }","duration":"149.266833ms","start":"2025-07-15T10:56:50.264126Z","end":"2025-07-15T10:56:50.413393Z","steps":["trace[779152419] 'agreement among raft nodes before linearized reading' (duration: 148.647381ms)"],"step_count":1} Jul 15 10:57:00.160534 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:00.157730Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"110.077558ms","expected-duration":"100ms","prefix":"","request":"header: txn: success:> failure: >>","response":"size:16"} Jul 15 10:57:00.160534 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:00.157938Z","caller":"traceutil/trace.go:171","msg":"trace[1595562439] linearizableReadLoop","detail":"{readStateIndex:1303; appliedIndex:1302; }","duration":"173.468958ms","start":"2025-07-15T10:56:59.984444Z","end":"2025-07-15T10:57:00.157913Z","steps":["trace[1595562439] 'read index received' (duration: 9.661038ms)","trace[1595562439] 'applied index is now lower than readState.Index' (duration: 163.806287ms)"],"step_count":2} Jul 15 10:57:00.160534 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:00.158109Z","caller":"traceutil/trace.go:171","msg":"trace[1914652905] transaction","detail":"{read_only:false; response_revision:1259; number_of_response:1; }","duration":"174.949191ms","start":"2025-07-15T10:56:59.983123Z","end":"2025-07-15T10:57:00.158072Z","steps":["trace[1914652905] 'process raft request' (duration: 64.413683ms)","trace[1914652905] 'compare' (duration: 109.915051ms)"],"step_count":2} Jul 15 10:57:00.160534 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:00.158356Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"171.342571ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/poddisruptionbudgets/calico-apiserver/calico-apiserver\" limit:1 ","response":"range_response_count:1 size:971"} Jul 15 10:57:00.161965 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:00.158462Z","caller":"traceutil/trace.go:171","msg":"trace[658583933] range","detail":"{range_begin:/registry/poddisruptionbudgets/calico-apiserver/calico-apiserver; range_end:; response_count:1; response_revision:1259; }","duration":"171.49523ms","start":"2025-07-15T10:56:59.986939Z","end":"2025-07-15T10:57:00.158434Z","steps":["trace[658583933] 'agreement among raft nodes before linearized reading' (duration: 171.181615ms)"],"step_count":1} Jul 15 10:57:00.161965 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:00.158587Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"174.124349ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/clusterinformations/default\" limit:1 ","response":"range_response_count:1 size:886"} Jul 15 10:57:00.161965 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:00.158643Z","caller":"traceutil/trace.go:171","msg":"trace[2004143649] range","detail":"{range_begin:/registry/crd.projectcalico.org/clusterinformations/default; range_end:; response_count:1; response_revision:1259; }","duration":"174.227949ms","start":"2025-07-15T10:56:59.984400Z","end":"2025-07-15T10:57:00.158628Z","steps":["trace[2004143649] 'agreement among raft nodes before linearized reading' (duration: 173.904927ms)"],"step_count":1} Jul 15 10:57:00.161965 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:00.158928Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"163.067162ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/bgpconfigurations/\" range_end:\"/registry/crd.projectcalico.org/bgpconfigurations0\" count_only:true ","response":"range_response_count:0 size:5"} Jul 15 10:57:00.162356 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:00.158998Z","caller":"traceutil/trace.go:171","msg":"trace[1568877882] range","detail":"{range_begin:/registry/crd.projectcalico.org/bgpconfigurations/; range_end:/registry/crd.projectcalico.org/bgpconfigurations0; response_count:0; response_revision:1259; }","duration":"163.195738ms","start":"2025-07-15T10:56:59.995780Z","end":"2025-07-15T10:57:00.158976Z","steps":["trace[1568877882] 'agreement among raft nodes before linearized reading' (duration: 163.092889ms)"],"step_count":1} Jul 15 10:57:00.491992 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:00.490902Z","caller":"traceutil/trace.go:171","msg":"trace[2065379558] transaction","detail":"{read_only:false; number_of_response:0; response_revision:1259; }","duration":"101.314183ms","start":"2025-07-15T10:57:00.389554Z","end":"2025-07-15T10:57:00.490868Z","steps":["trace[2065379558] 'process raft request' (duration: 101.156565ms)"],"step_count":1} Jul 15 10:57:07.300721 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:06.744944Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.000691897s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context deadline exceeded"} Jul 15 10:57:07.300721 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:06.745328Z","caller":"traceutil/trace.go:171","msg":"trace[1647525331] range","detail":"{range_begin:/registry/health; range_end:; }","duration":"2.001187818s","start":"2025-07-15T10:57:04.744109Z","end":"2025-07-15T10:57:06.745297Z","steps":["trace[1647525331] 'agreement among raft nodes before linearized reading' (duration: 2.00072625s)"],"step_count":1} Jul 15 10:57:07.300721 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:06.745480Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:57:04.744082Z","time spent":"2.001375261s","remote":"172.24.4.207:54212","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "} Jul 15 10:57:07.442535 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:07.426739Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.764212909s","expected-duration":"100ms","prefix":"","request":"header: lease_revoke:","response":"size:29"} Jul 15 10:57:07.442535 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:07.428448Z","caller":"traceutil/trace.go:171","msg":"trace[873198758] linearizableReadLoop","detail":"{readStateIndex:1369; appliedIndex:1368; }","duration":"2.684120908s","start":"2025-07-15T10:57:04.744191Z","end":"2025-07-15T10:57:07.428312Z","steps":["trace[873198758] 'read index received' (duration: 51.395µs)","trace[873198758] 'applied index is now lower than readState.Index' (duration: 2.684063702s)"],"step_count":2} Jul 15 10:57:07.874116 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:07.872855Z","caller":"traceutil/trace.go:171","msg":"trace[1726831467] transaction","detail":"{read_only:false; response_revision:1268; number_of_response:1; }","duration":"365.704807ms","start":"2025-07-15T10:57:07.507067Z","end":"2025-07-15T10:57:07.872772Z","steps":["trace[1726831467] 'process raft request' (duration: 365.365824ms)"],"step_count":1} Jul 15 10:57:07.874116 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:07.873043Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:57:07.507030Z","time spent":"365.92415ms","remote":"172.24.4.207:47638","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":947,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 10:57:07.874116 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:07.872843Z","caller":"traceutil/trace.go:171","msg":"trace[895759218] linearizableReadLoop","detail":"{readStateIndex:1370; appliedIndex:1370; }","duration":"275.494874ms","start":"2025-07-15T10:57:07.597273Z","end":"2025-07-15T10:57:07.872767Z","steps":["trace[895759218] 'read index received' (duration: 275.483152ms)","trace[895759218] 'applied index is now lower than readState.Index' (duration: 9.197µs)"],"step_count":2} Jul 15 10:57:07.874116 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:07.873098Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"275.793641ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jul 15 10:57:07.875342 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:07.873366Z","caller":"traceutil/trace.go:171","msg":"trace[1439372574] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1268; }","duration":"276.11352ms","start":"2025-07-15T10:57:07.597230Z","end":"2025-07-15T10:57:07.873344Z","steps":["trace[1439372574] 'agreement among raft nodes before linearized reading' (duration: 275.685424ms)"],"step_count":1} Jul 15 10:57:07.879772 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:07.878358Z","caller":"traceutil/trace.go:171","msg":"trace[823883763] transaction","detail":"{read_only:false; response_revision:1269; number_of_response:1; }","duration":"280.855675ms","start":"2025-07-15T10:57:07.597476Z","end":"2025-07-15T10:57:07.878332Z","steps":["trace[823883763] 'process raft request' (duration: 280.665667ms)"],"step_count":1} Jul 15 10:57:07.879772 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:07.878852Z","caller":"traceutil/trace.go:171","msg":"trace[1148951668] transaction","detail":"{read_only:false; response_revision:1270; number_of_response:1; }","duration":"281.235565ms","start":"2025-07-15T10:57:07.597598Z","end":"2025-07-15T10:57:07.878834Z","steps":["trace[1148951668] 'process raft request' (duration: 280.684482ms)"],"step_count":1} Jul 15 10:57:07.879772 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:07.878962Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"281.152992ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/installations/default\" limit:1 ","response":"range_response_count:1 size:3643"} Jul 15 10:57:07.879772 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:07.879016Z","caller":"traceutil/trace.go:171","msg":"trace[2017788161] transaction","detail":"{read_only:false; response_revision:1271; number_of_response:1; }","duration":"281.338402ms","start":"2025-07-15T10:57:07.597662Z","end":"2025-07-15T10:57:07.879000Z","steps":["trace[2017788161] 'process raft request' (duration: 280.918863ms)"],"step_count":1} Jul 15 10:57:07.879772 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:07.879062Z","caller":"traceutil/trace.go:171","msg":"trace[1136441812] range","detail":"{range_begin:/registry/operator.tigera.io/installations/default; range_end:; response_count:1; response_revision:1271; }","duration":"281.28307ms","start":"2025-07-15T10:57:07.597756Z","end":"2025-07-15T10:57:07.879039Z","steps":["trace[1136441812] 'agreement among raft nodes before linearized reading' (duration: 280.95583ms)"],"step_count":1} Jul 15 10:57:09.693416 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:09.692850Z","caller":"traceutil/trace.go:171","msg":"trace[1510037832] transaction","detail":"{read_only:false; response_revision:1274; number_of_response:1; }","duration":"118.812085ms","start":"2025-07-15T10:57:09.573961Z","end":"2025-07-15T10:57:09.692773Z","steps":["trace[1510037832] 'process raft request' (duration: 96.535911ms)","trace[1510037832] 'compare' (duration: 21.385707ms)"],"step_count":2} Jul 15 10:57:09.909267 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:09.908139Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"112.142004ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jul 15 10:57:09.909267 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:09.908261Z","caller":"traceutil/trace.go:171","msg":"trace[683919097] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1274; }","duration":"112.327153ms","start":"2025-07-15T10:57:09.795906Z","end":"2025-07-15T10:57:09.908233Z","steps":["trace[683919097] 'range keys from in-memory index tree' (duration: 111.967733ms)"],"step_count":1} Jul 15 10:57:24.915825 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:24.912137Z","caller":"traceutil/trace.go:171","msg":"trace[1209063562] linearizableReadLoop","detail":"{readStateIndex:1419; appliedIndex:1418; }","duration":"119.535084ms","start":"2025-07-15T10:57:24.792529Z","end":"2025-07-15T10:57:24.912064Z","steps":["trace[1209063562] 'read index received' (duration: 21.176473ms)","trace[1209063562] 'applied index is now lower than readState.Index' (duration: 98.3579ms)"],"step_count":2} Jul 15 10:57:24.915825 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:24.912440Z","caller":"traceutil/trace.go:171","msg":"trace[591563696] transaction","detail":"{read_only:false; response_revision:1317; number_of_response:1; }","duration":"115.217449ms","start":"2025-07-15T10:57:24.797213Z","end":"2025-07-15T10:57:24.912430Z","steps":["trace[591563696] 'process raft request' (duration: 114.53921ms)"],"step_count":1} Jul 15 10:57:24.915825 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:24.912387Z","caller":"traceutil/trace.go:171","msg":"trace[1489400891] transaction","detail":"{read_only:false; response_revision:1315; number_of_response:1; }","duration":"121.341479ms","start":"2025-07-15T10:57:24.790948Z","end":"2025-07-15T10:57:24.912289Z","steps":["trace[1489400891] 'process raft request' (duration: 81.674616ms)","trace[1489400891] 'compare' (duration: 38.390274ms)"],"step_count":2} Jul 15 10:57:24.915825 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:24.912639Z","caller":"traceutil/trace.go:171","msg":"trace[168215488] transaction","detail":"{read_only:false; response_revision:1316; number_of_response:1; }","duration":"119.870793ms","start":"2025-07-15T10:57:24.792751Z","end":"2025-07-15T10:57:24.912621Z","steps":["trace[168215488] 'process raft request' (duration: 118.609601ms)"],"step_count":1} Jul 15 10:57:24.917464 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:24.912739Z","caller":"traceutil/trace.go:171","msg":"trace[1988572878] transaction","detail":"{read_only:false; response_revision:1318; number_of_response:1; }","duration":"115.39262ms","start":"2025-07-15T10:57:24.797336Z","end":"2025-07-15T10:57:24.912729Z","steps":["trace[1988572878] 'process raft request' (duration: 114.518612ms)"],"step_count":1} Jul 15 10:57:24.917464 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:24.912863Z","caller":"traceutil/trace.go:171","msg":"trace[911151051] transaction","detail":"{read_only:false; response_revision:1319; number_of_response:1; }","duration":"113.154351ms","start":"2025-07-15T10:57:24.799699Z","end":"2025-07-15T10:57:24.912854Z","steps":["trace[911151051] 'process raft request' (duration: 112.194364ms)"],"step_count":1} Jul 15 10:57:24.917464 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:24.913310Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"120.480404ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jul 15 10:57:24.917464 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:24.913428Z","caller":"traceutil/trace.go:171","msg":"trace[1123998143] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1320; }","duration":"120.879158ms","start":"2025-07-15T10:57:24.792524Z","end":"2025-07-15T10:57:24.913403Z","steps":["trace[1123998143] 'agreement among raft nodes before linearized reading' (duration: 120.399676ms)"],"step_count":1} Jul 15 10:57:24.917464 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:24.913484Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"119.491203ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/events/\" range_end:\"/registry/events0\" count_only:true ","response":"range_response_count:0 size:8"} Jul 15 10:57:24.917714 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:24.913518Z","caller":"traceutil/trace.go:171","msg":"trace[808037603] range","detail":"{range_begin:/registry/events/; range_end:/registry/events0; response_count:0; response_revision:1320; }","duration":"119.584296ms","start":"2025-07-15T10:57:24.793925Z","end":"2025-07-15T10:57:24.913510Z","steps":["trace[808037603] 'agreement among raft nodes before linearized reading' (duration: 119.017431ms)"],"step_count":1} Jul 15 10:57:24.917714 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:24.913758Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"109.20916ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/daemonsets/calico-system/calico-node\" limit:1 ","response":"range_response_count:1 size:11415"} Jul 15 10:57:24.917714 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:24.913824Z","caller":"traceutil/trace.go:171","msg":"trace[848241330] range","detail":"{range_begin:/registry/daemonsets/calico-system/calico-node; range_end:; response_count:1; response_revision:1320; }","duration":"109.283848ms","start":"2025-07-15T10:57:24.804503Z","end":"2025-07-15T10:57:24.913787Z","steps":["trace[848241330] 'agreement among raft nodes before linearized reading' (duration: 109.139032ms)"],"step_count":1} Jul 15 10:57:24.917714 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:24.913997Z","caller":"traceutil/trace.go:171","msg":"trace[468524271] transaction","detail":"{read_only:false; response_revision:1320; number_of_response:1; }","duration":"103.94349ms","start":"2025-07-15T10:57:24.810045Z","end":"2025-07-15T10:57:24.913989Z","steps":["trace[468524271] 'process raft request' (duration: 101.912702ms)"],"step_count":1} Jul 15 10:57:25.075774 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:25.074448Z","caller":"traceutil/trace.go:171","msg":"trace[1883410674] linearizableReadLoop","detail":"{readStateIndex:1426; appliedIndex:1425; }","duration":"134.918469ms","start":"2025-07-15T10:57:24.939493Z","end":"2025-07-15T10:57:25.074411Z","steps":["trace[1883410674] 'read index received' (duration: 107.907492ms)","trace[1883410674] 'applied index is now lower than readState.Index' (duration: 27.009785ms)"],"step_count":2} Jul 15 10:57:25.075774 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:25.074526Z","caller":"traceutil/trace.go:171","msg":"trace[516396986] transaction","detail":"{read_only:false; response_revision:1321; number_of_response:1; }","duration":"149.107341ms","start":"2025-07-15T10:57:24.925367Z","end":"2025-07-15T10:57:25.074475Z","steps":["trace[516396986] 'process raft request' (duration: 122.017871ms)","trace[516396986] 'compare' (duration: 26.770063ms)"],"step_count":2} Jul 15 10:57:25.075774 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:25.074863Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"135.27793ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/minions/ci-4230-2-100-9439eb8d1a.novalocal\" limit:1 ","response":"range_response_count:1 size:5846"} Jul 15 10:57:25.076460 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:25.074965Z","caller":"traceutil/trace.go:171","msg":"trace[1550058033] range","detail":"{range_begin:/registry/minions/ci-4230-2-100-9439eb8d1a.novalocal; range_end:; response_count:1; response_revision:1321; }","duration":"135.51081ms","start":"2025-07-15T10:57:24.939437Z","end":"2025-07-15T10:57:25.074948Z","steps":["trace[1550058033] 'agreement among raft nodes before linearized reading' (duration: 135.127724ms)"],"step_count":1} Jul 15 10:57:25.432526 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:25.430670Z","caller":"traceutil/trace.go:171","msg":"trace[1760676741] transaction","detail":"{read_only:false; response_revision:1324; number_of_response:1; }","duration":"342.65914ms","start":"2025-07-15T10:57:25.087975Z","end":"2025-07-15T10:57:25.430634Z","steps":["trace[1760676741] 'process raft request' (duration: 342.509966ms)"],"step_count":1} Jul 15 10:57:25.432526 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:25.430914Z","caller":"traceutil/trace.go:171","msg":"trace[512950904] transaction","detail":"{read_only:false; response_revision:1323; number_of_response:1; }","duration":"446.016667ms","start":"2025-07-15T10:57:24.984862Z","end":"2025-07-15T10:57:25.430878Z","steps":["trace[512950904] 'process raft request' (duration: 445.465974ms)"],"step_count":1} Jul 15 10:57:25.432526 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:25.431427Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:57:24.984791Z","time spent":"446.204985ms","remote":"172.24.4.207:54728","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":4949,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 10:57:25.434678 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:25.431398Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:57:25.087935Z","time spent":"342.850173ms","remote":"172.24.4.207:47670","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":1712,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 10:57:25.434678 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:25.431694Z","caller":"traceutil/trace.go:171","msg":"trace[484268581] transaction","detail":"{read_only:false; response_revision:1322; number_of_response:1; }","duration":"491.618443ms","start":"2025-07-15T10:57:24.939981Z","end":"2025-07-15T10:57:25.431600Z","steps":["trace[484268581] 'process raft request' (duration: 403.681917ms)","trace[484268581] 'compare' (duration: 86.386704ms)"],"step_count":2} Jul 15 10:57:25.434678 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:25.431863Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:57:24.939958Z","time spent":"491.78478ms","remote":"172.24.4.207:47648","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":1489,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 10:57:25.435359 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:25.432649Z","caller":"traceutil/trace.go:171","msg":"trace[1489119876] linearizableReadLoop","detail":"{readStateIndex:1428; appliedIndex:1426; }","duration":"355.74145ms","start":"2025-07-15T10:57:25.076881Z","end":"2025-07-15T10:57:25.432623Z","steps":["trace[1489119876] 'read index received' (duration: 266.795505ms)","trace[1489119876] 'applied index is now lower than readState.Index' (duration: 88.94256ms)"],"step_count":2} Jul 15 10:57:25.435359 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:25.433295Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"356.348247ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/services/endpoints/default/kubernetes\" limit:1 ","response":"range_response_count:1 size:420"} Jul 15 10:57:25.435359 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:25.433426Z","caller":"traceutil/trace.go:171","msg":"trace[1818008831] range","detail":"{range_begin:/registry/services/endpoints/default/kubernetes; range_end:; response_count:1; response_revision:1324; }","duration":"356.532927ms","start":"2025-07-15T10:57:25.076873Z","end":"2025-07-15T10:57:25.433406Z","steps":["trace[1818008831] 'agreement among raft nodes before linearized reading' (duration: 355.992171ms)"],"step_count":1} Jul 15 10:57:25.435359 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:25.433547Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:57:25.076777Z","time spent":"356.731492ms","remote":"172.24.4.207:54340","response type":"/etcdserverpb.KV/Range","request count":0,"request size":51,"response count":1,"response size":444,"request content":"key:\"/registry/services/endpoints/default/kubernetes\" limit:1 "} Jul 15 10:57:25.750472 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:25.749691Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"209.044739ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/bgpconfigurations.crd.projectcalico.org\" limit:1 ","response":"range_response_count:1 size:8602"} Jul 15 10:57:25.750472 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:25.750077Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"219.502317ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/clusterroles/calico-crds\" limit:1 ","response":"range_response_count:1 size:1255"} Jul 15 10:57:25.752124 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:25.750863Z","caller":"traceutil/trace.go:171","msg":"trace[1371299375] range","detail":"{range_begin:/registry/clusterroles/calico-crds; range_end:; response_count:1; response_revision:1324; }","duration":"219.617399ms","start":"2025-07-15T10:57:25.530508Z","end":"2025-07-15T10:57:25.750126Z","steps":["trace[1371299375] 'range keys from in-memory index tree' (duration: 219.289485ms)"],"step_count":1} Jul 15 10:57:25.752582 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:25.751049Z","caller":"traceutil/trace.go:171","msg":"trace[249362226] range","detail":"{range_begin:/registry/apiextensions.k8s.io/customresourcedefinitions/bgpconfigurations.crd.projectcalico.org; range_end:; response_count:1; response_revision:1324; }","duration":"209.21409ms","start":"2025-07-15T10:57:25.540577Z","end":"2025-07-15T10:57:25.749791Z","steps":["trace[249362226] 'range keys from in-memory index tree' (duration: 208.831768ms)"],"step_count":1} Jul 15 10:57:25.752582 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:25.751169Z","caller":"traceutil/trace.go:171","msg":"trace[2068562689] transaction","detail":"{read_only:false; response_revision:1325; number_of_response:1; }","duration":"162.37608ms","start":"2025-07-15T10:57:25.588740Z","end":"2025-07-15T10:57:25.751116Z","steps":["trace[2068562689] 'process raft request' (duration: 126.127021ms)","trace[2068562689] 'compare' (duration: 34.551596ms)"],"step_count":2} Jul 15 10:57:27.287204 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:27.286162Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.435351799s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/clusterroles/calico-webhook-reader\" limit:1 ","response":"range_response_count:1 size:602"} Jul 15 10:57:27.287204 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:27.286318Z","caller":"traceutil/trace.go:171","msg":"trace[1771574607] range","detail":"{range_begin:/registry/clusterroles/calico-webhook-reader; range_end:; response_count:1; response_revision:1326; }","duration":"1.435533895s","start":"2025-07-15T10:57:25.850726Z","end":"2025-07-15T10:57:27.286260Z","steps":["trace[1771574607] 'range keys from in-memory index tree' (duration: 1.435076082s)"],"step_count":1} Jul 15 10:57:27.287204 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:27.286388Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:57:25.850706Z","time spent":"1.435658816s","remote":"172.24.4.207:54526","response type":"/etcdserverpb.KV/Range","request count":0,"request size":48,"response count":1,"response size":626,"request content":"key:\"/registry/clusterroles/calico-webhook-reader\" limit:1 "} Jul 15 10:57:27.497540 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:27.495073Z","caller":"traceutil/trace.go:171","msg":"trace[1459720846] transaction","detail":"{read_only:false; response_revision:1328; number_of_response:1; }","duration":"282.842817ms","start":"2025-07-15T10:57:27.212195Z","end":"2025-07-15T10:57:27.495037Z","steps":["trace[1459720846] 'process raft request' (duration: 200.18736ms)","trace[1459720846] 'compare' (duration: 82.262994ms)"],"step_count":2} Jul 15 10:57:27.497540 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:27.495327Z","caller":"traceutil/trace.go:171","msg":"trace[118040121] linearizableReadLoop","detail":"{readStateIndex:1434; appliedIndex:1431; }","duration":"274.736233ms","start":"2025-07-15T10:57:27.220561Z","end":"2025-07-15T10:57:27.495298Z","steps":["trace[118040121] 'read index received' (duration: 46.330072ms)","trace[118040121] 'applied index is now lower than readState.Index' (duration: 228.404899ms)"],"step_count":2} Jul 15 10:57:27.497540 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:27.495494Z","caller":"traceutil/trace.go:171","msg":"trace[1373293147] transaction","detail":"{read_only:false; response_revision:1329; number_of_response:1; }","duration":"276.104302ms","start":"2025-07-15T10:57:27.219375Z","end":"2025-07-15T10:57:27.495479Z","steps":["trace[1373293147] 'process raft request' (duration: 275.556643ms)"],"step_count":1} Jul 15 10:57:27.497540 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:27.495702Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"275.122063ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jul 15 10:57:27.497540 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:27.495847Z","caller":"traceutil/trace.go:171","msg":"trace[1015365602] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1329; }","duration":"275.279272ms","start":"2025-07-15T10:57:27.220515Z","end":"2025-07-15T10:57:27.495794Z","steps":["trace[1015365602] 'agreement among raft nodes before linearized reading' (duration: 275.053175ms)"],"step_count":1} Jul 15 10:57:27.498745 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:27.495894Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"250.379413ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/globalnetworkpolicies.crd.projectcalico.org\" limit:1 ","response":"range_response_count:1 size:35079"} Jul 15 10:57:27.498745 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:27.495985Z","caller":"traceutil/trace.go:171","msg":"trace[1549474181] range","detail":"{range_begin:/registry/apiextensions.k8s.io/customresourcedefinitions/globalnetworkpolicies.crd.projectcalico.org; range_end:; response_count:1; response_revision:1329; }","duration":"250.536162ms","start":"2025-07-15T10:57:27.245425Z","end":"2025-07-15T10:57:27.495961Z","steps":["trace[1549474181] 'agreement among raft nodes before linearized reading' (duration: 250.214169ms)"],"step_count":1} Jul 15 10:57:27.498745 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:27.496371Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"204.947081ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/clusterrolebindings/calico-apiserver-webhook-reader\" limit:1 ","response":"range_response_count:1 size:663"} Jul 15 10:57:27.498745 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:27.496424Z","caller":"traceutil/trace.go:171","msg":"trace[2051389810] range","detail":"{range_begin:/registry/clusterrolebindings/calico-apiserver-webhook-reader; range_end:; response_count:1; response_revision:1329; }","duration":"205.042768ms","start":"2025-07-15T10:57:27.291366Z","end":"2025-07-15T10:57:27.496409Z","steps":["trace[2051389810] 'agreement among raft nodes before linearized reading' (duration: 204.863148ms)"],"step_count":1} Jul 15 10:57:27.791978 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:27.790871Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"150.438394ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/clusterrolebindings/tigera-apiserver-webhook-reader\" limit:1 ","response":"range_response_count:0 size:5"} Jul 15 10:57:27.791978 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:27.790993Z","caller":"traceutil/trace.go:171","msg":"trace[1076428278] range","detail":"{range_begin:/registry/clusterrolebindings/tigera-apiserver-webhook-reader; range_end:; response_count:0; response_revision:1329; }","duration":"150.671963ms","start":"2025-07-15T10:57:27.640293Z","end":"2025-07-15T10:57:27.790965Z","steps":["trace[1076428278] 'range keys from in-memory index tree' (duration: 150.296141ms)"],"step_count":1} Jul 15 10:57:27.791978 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:27.791052Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"103.953515ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/stagedkubernetesnetworkpolicies.crd.projectcalico.org\" limit:1 ","response":"range_response_count:1 size:20393"} Jul 15 10:57:27.791978 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:27.791124Z","caller":"traceutil/trace.go:171","msg":"trace[67158094] range","detail":"{range_begin:/registry/apiextensions.k8s.io/customresourcedefinitions/stagedkubernetesnetworkpolicies.crd.projectcalico.org; range_end:; response_count:1; response_revision:1329; }","duration":"104.079768ms","start":"2025-07-15T10:57:27.687026Z","end":"2025-07-15T10:57:27.791105Z","steps":["trace[67158094] 'range keys from in-memory index tree' (duration: 103.564098ms)"],"step_count":1} Jul 15 10:57:27.792702 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:27.791189Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"150.826288ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/networkpolicies/\" range_end:\"/registry/networkpolicies0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 10:57:27.792702 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:27.791269Z","caller":"traceutil/trace.go:171","msg":"trace[1651412113] range","detail":"{range_begin:/registry/networkpolicies/; range_end:/registry/networkpolicies0; response_count:0; response_revision:1329; }","duration":"150.920762ms","start":"2025-07-15T10:57:27.640322Z","end":"2025-07-15T10:57:27.791243Z","steps":["trace[1651412113] 'count revisions from in-memory index tree' (duration: 150.720042ms)"],"step_count":1} Jul 15 10:57:29.611888 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:29.610407Z","caller":"traceutil/trace.go:171","msg":"trace[37636600] transaction","detail":"{read_only:false; response_revision:1333; number_of_response:1; }","duration":"107.298201ms","start":"2025-07-15T10:57:29.503068Z","end":"2025-07-15T10:57:29.610366Z","steps":["trace[37636600] 'process raft request' (duration: 55.159757ms)","trace[37636600] 'compare' (duration: 51.5171ms)"],"step_count":2} Jul 15 10:57:30.946127 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:30.940359Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"114.201951ms","expected-duration":"100ms","prefix":"","request":"header: txn: success:> failure:<>>","response":"size:5"} Jul 15 10:57:30.946127 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:30.940645Z","caller":"traceutil/trace.go:171","msg":"trace[2014621508] linearizableReadLoop","detail":"{readStateIndex:1443; appliedIndex:1442; }","duration":"132.500277ms","start":"2025-07-15T10:57:30.808101Z","end":"2025-07-15T10:57:30.940601Z","steps":["trace[2014621508] 'read index received' (duration: 17.846264ms)","trace[2014621508] 'applied index is now lower than readState.Index' (duration: 114.65193ms)"],"step_count":2} Jul 15 10:57:30.946127 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:30.940960Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"132.872804ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/clusterrolebindings/calico-tiered-policy-passthrough\" limit:1 ","response":"range_response_count:1 size:680"} Jul 15 10:57:30.946127 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:30.941014Z","caller":"traceutil/trace.go:171","msg":"trace[867377408] range","detail":"{range_begin:/registry/clusterrolebindings/calico-tiered-policy-passthrough; range_end:; response_count:1; response_revision:1337; }","duration":"132.963371ms","start":"2025-07-15T10:57:30.808030Z","end":"2025-07-15T10:57:30.940994Z","steps":["trace[867377408] 'agreement among raft nodes before linearized reading' (duration: 132.678887ms)"],"step_count":1} Jul 15 10:57:30.950337 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:30.941200Z","caller":"traceutil/trace.go:171","msg":"trace[1252246049] transaction","detail":"{read_only:false; number_of_response:0; response_revision:1337; }","duration":"135.926797ms","start":"2025-07-15T10:57:30.805260Z","end":"2025-07-15T10:57:30.941187Z","steps":["trace[1252246049] 'compare' (duration: 114.088353ms)"],"step_count":1} Jul 15 10:57:31.443988 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:31.443146Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"114.088511ms","expected-duration":"100ms","prefix":"","request":"header: txn: success:> failure: >>","response":"size:16"} Jul 15 10:57:31.443988 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:31.443265Z","caller":"traceutil/trace.go:171","msg":"trace[1666925644] transaction","detail":"{read_only:false; response_revision:1341; number_of_response:1; }","duration":"129.665227ms","start":"2025-07-15T10:57:31.313580Z","end":"2025-07-15T10:57:31.443246Z","steps":["trace[1666925644] 'process raft request' (duration: 15.387027ms)","trace[1666925644] 'compare' (duration: 113.78893ms)"],"step_count":2} Jul 15 10:57:31.445308 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:31.444397Z","caller":"traceutil/trace.go:171","msg":"trace[718230772] transaction","detail":"{read_only:false; response_revision:1342; number_of_response:1; }","duration":"121.583804ms","start":"2025-07-15T10:57:31.322752Z","end":"2025-07-15T10:57:31.444335Z","steps":["trace[718230772] 'process raft request' (duration: 121.251563ms)"],"step_count":1} Jul 15 10:57:31.468614 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:31.467879Z","caller":"traceutil/trace.go:171","msg":"trace[386010689] linearizableReadLoop","detail":"{readStateIndex:1452; appliedIndex:1450; }","duration":"115.246875ms","start":"2025-07-15T10:57:31.352543Z","end":"2025-07-15T10:57:31.467790Z","steps":["trace[386010689] 'read index received' (duration: 90.898745ms)","trace[386010689] 'applied index is now lower than readState.Index' (duration: 24.346938ms)"],"step_count":2} Jul 15 10:57:31.469839 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:31.468698Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"116.123027ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/poddisruptionbudgets/calico-apiserver/calico-apiserver\" limit:1 ","response":"range_response_count:1 size:993"} Jul 15 10:57:31.469839 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:31.469074Z","caller":"traceutil/trace.go:171","msg":"trace[1380530900] range","detail":"{range_begin:/registry/poddisruptionbudgets/calico-apiserver/calico-apiserver; range_end:; response_count:1; response_revision:1343; }","duration":"116.561405ms","start":"2025-07-15T10:57:31.352497Z","end":"2025-07-15T10:57:31.469058Z","steps":["trace[1380530900] 'agreement among raft nodes before linearized reading' (duration: 115.696702ms)"],"step_count":1} Jul 15 10:57:31.469839 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:31.468112Z","caller":"traceutil/trace.go:171","msg":"trace[459502196] transaction","detail":"{read_only:false; number_of_response:0; response_revision:1342; }","duration":"135.707335ms","start":"2025-07-15T10:57:31.332327Z","end":"2025-07-15T10:57:31.468035Z","steps":["trace[459502196] 'process raft request' (duration: 135.05271ms)"],"step_count":1} Jul 15 10:57:31.668281 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:31.666427Z","caller":"traceutil/trace.go:171","msg":"trace[1577029779] transaction","detail":"{read_only:false; number_of_response:0; response_revision:1344; }","duration":"186.896888ms","start":"2025-07-15T10:57:31.479498Z","end":"2025-07-15T10:57:31.666395Z","steps":["trace[1577029779] 'process raft request' (duration: 97.690432ms)","trace[1577029779] 'compare' (duration: 89.091204ms)"],"step_count":2} Jul 15 10:57:31.668281 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:31.666634Z","caller":"traceutil/trace.go:171","msg":"trace[434301621] linearizableReadLoop","detail":"{readStateIndex:1455; appliedIndex:1454; }","duration":"180.715394ms","start":"2025-07-15T10:57:31.485907Z","end":"2025-07-15T10:57:31.666623Z","steps":["trace[434301621] 'read index received' (duration: 91.168791ms)","trace[434301621] 'applied index is now lower than readState.Index' (duration: 89.544909ms)"],"step_count":2} Jul 15 10:57:31.668281 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:31.667163Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"182.260599ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/tigerastatuses.operator.tigera.io\" limit:1 ","response":"range_response_count:1 size:5262"} Jul 15 10:57:31.668281 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:31.667207Z","caller":"traceutil/trace.go:171","msg":"trace[1048024400] range","detail":"{range_begin:/registry/apiextensions.k8s.io/customresourcedefinitions/tigerastatuses.operator.tigera.io; range_end:; response_count:1; response_revision:1346; }","duration":"182.407501ms","start":"2025-07-15T10:57:31.484787Z","end":"2025-07-15T10:57:31.667195Z","steps":["trace[1048024400] 'agreement among raft nodes before linearized reading' (duration: 181.906408ms)"],"step_count":1} Jul 15 10:57:31.668693 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:31.667392Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"178.134771ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/clusterrolebindings/tigera-apiserver-delegate-auth\" limit:1 ","response":"range_response_count:0 size:5"} Jul 15 10:57:31.668693 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:31.667350Z","caller":"traceutil/trace.go:171","msg":"trace[1067770319] transaction","detail":"{read_only:false; response_revision:1345; number_of_response:1; }","duration":"145.753426ms","start":"2025-07-15T10:57:31.521533Z","end":"2025-07-15T10:57:31.667286Z","steps":["trace[1067770319] 'process raft request' (duration: 144.86509ms)"],"step_count":1} Jul 15 10:57:31.668693 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:31.667423Z","caller":"traceutil/trace.go:171","msg":"trace[150148311] range","detail":"{range_begin:/registry/clusterrolebindings/tigera-apiserver-delegate-auth; range_end:; response_count:0; response_revision:1346; }","duration":"178.192437ms","start":"2025-07-15T10:57:31.489218Z","end":"2025-07-15T10:57:31.667411Z","steps":["trace[150148311] 'agreement among raft nodes before linearized reading' (duration: 178.150029ms)"],"step_count":1} Jul 15 10:57:34.728337 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:34.724602Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875172722,"retry-timeout":"500ms"} Jul 15 10:57:35.226941 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:35.226078Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875172722,"retry-timeout":"500ms"} Jul 15 10:57:35.727740 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:35.726787Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875172722,"retry-timeout":"500ms"} Jul 15 10:57:36.228361 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:36.227611Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875172722,"retry-timeout":"500ms"} Jul 15 10:57:36.728576 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:36.728066Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875172722,"retry-timeout":"500ms"} Jul 15 10:57:37.229631 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:37.229077Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875172722,"retry-timeout":"500ms"} Jul 15 10:57:37.729977 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:37.729241Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875172722,"retry-timeout":"500ms"} Jul 15 10:57:41.903313 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:38.230195Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875172722,"retry-timeout":"500ms"} Jul 15 10:57:41.903313 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:38.730678Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875172722,"retry-timeout":"500ms"} Jul 15 10:57:41.903313 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:39.231090Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875172722,"retry-timeout":"500ms"} Jul 15 10:57:41.903313 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:39.731540Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875172722,"retry-timeout":"500ms"} Jul 15 10:57:41.903313 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:40.231862Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875172722,"retry-timeout":"500ms"} Jul 15 10:57:41.903313 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:40.569930Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:57:33.569166Z","time spent":"7.000714009s","remote":"172.24.4.207:59328","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jul 15 10:57:41.903313 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:40.732576Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875172722,"retry-timeout":"500ms"} Jul 15 10:57:41.903313 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:41.223962Z","caller":"etcdserver/v3_server.go:932","msg":"timed out waiting for read index response (local node might have slow network)","timeout":"7s"} Jul 15 10:57:41.905679 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:41.224411Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"7.000802142s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/deployments/\" range_end:\"/registry/deployments0\" count_only:true ","response":"","error":"etcdserver: request timed out"} Jul 15 10:57:41.905679 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:41.224609Z","caller":"traceutil/trace.go:171","msg":"trace[453673236] range","detail":"{range_begin:/registry/deployments/; range_end:/registry/deployments0; }","duration":"7.001219972s","start":"2025-07-15T10:57:34.223312Z","end":"2025-07-15T10:57:41.224532Z","steps":["trace[453673236] 'agreement among raft nodes before linearized reading' (duration: 7.000838128s)"],"step_count":1} Jul 15 10:57:41.905679 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:41.224730Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:57:34.223265Z","time spent":"7.001427895s","remote":"172.24.4.207:54636","response type":"/etcdserverpb.KV/Range","request count":0,"request size":50,"response count":0,"response size":0,"request content":"key:\"/registry/deployments/\" range_end:\"/registry/deployments0\" count_only:true "} Jul 15 10:57:41.905679 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:41.724195Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875172725,"retry-timeout":"500ms"} Jul 15 10:57:42.279122 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:42.278290Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:57:35.262669Z","time spent":"7.015591909s","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jul 15 10:57:42.279122 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:42.278405Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875172725,"retry-timeout":"500ms"} Jul 15 10:57:42.478102 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:42.477276Z","caller":"wal/wal.go:805","msg":"slow fdatasync","took":"8.907870518s","expected-duration":"1s"} Jul 15 10:57:44.061352 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:44.060469Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.000764139s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context deadline exceeded"} Jul 15 10:57:44.061352 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:44.060646Z","caller":"traceutil/trace.go:171","msg":"trace[1705119438] range","detail":"{range_begin:/registry/health; range_end:; }","duration":"2.001214881s","start":"2025-07-15T10:57:42.059404Z","end":"2025-07-15T10:57:44.060618Z","steps":["trace[1705119438] 'agreement among raft nodes before linearized reading' (duration: 2.000928432s)"],"step_count":1} Jul 15 10:57:44.061352 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:44.060848Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:57:42.059390Z","time spent":"2.001396766s","remote":"172.24.4.207:54212","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "} Jul 15 10:57:46.947223 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:46.946133Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:57:41.980335Z","time spent":"4.965771225s","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jul 15 10:57:46.949125 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:46.948473Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:57:41.980168Z","time spent":"4.968271975s","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jul 15 10:57:46.975962 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:46.975333Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:57:41.986312Z","time spent":"4.989011912s","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jul 15 10:57:47.008794 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:47.007889Z","caller":"etcdserver/server.go:1237","msg":"Failed to check current member's leadership","error":"context deadline exceeded"} Jul 15 10:57:47.008794 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:47.008239Z","caller":"etcdserver/server.go:1177","msg":"Ignore the lease revoking request because current member isn't a leader","local-member-id":10276657743932975437} Jul 15 10:57:48.957292 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:48.956449Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:57:41.955478Z","time spent":"7.000957044s","remote":"172.24.4.207:47648","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jul 15 10:57:49.932380 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:48.960832Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:57:41.960353Z","time spent":"7.000432071s","remote":"172.24.4.207:47638","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jul 15 10:57:49.932380 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:48.996467Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:57:41.995255Z","time spent":"7.001201786s","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jul 15 10:57:49.932380 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:48.998894Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:57:41.997758Z","time spent":"7.001114146s","remote":"172.24.4.207:54266","response type":"/etcdserverpb.Lease/LeaseGrant","request count":-1,"request size":-1,"response count":-1,"response size":-1,"request content":""} Jul 15 10:57:49.932380 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:49.040160Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:57:42.038855Z","time spent":"7.00129524s","remote":"172.24.4.207:59328","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jul 15 10:57:49.932380 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:49.337509Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:57:42.336504Z","time spent":"7.000992017s","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jul 15 10:57:49.980728 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:49.979200Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"7.999893588s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/clusterinformations/default\" limit:1 ","response":"","error":"context canceled"} Jul 15 10:57:49.980728 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:49.979282Z","caller":"traceutil/trace.go:171","msg":"trace[1604689165] range","detail":"{range_begin:/registry/crd.projectcalico.org/clusterinformations/default; range_end:; }","duration":"8.000037834s","start":"2025-07-15T10:57:41.979230Z","end":"2025-07-15T10:57:49.979267Z","steps":["trace[1604689165] 'agreement among raft nodes before linearized reading' (duration: 7.999937659s)"],"step_count":1} Jul 15 10:57:49.980728 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:49.979337Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:57:41.979214Z","time spent":"8.000110448s","remote":"172.24.4.207:47728","response type":"/etcdserverpb.KV/Range","request count":0,"request size":63,"response count":0,"response size":0,"request content":"key:\"/registry/crd.projectcalico.org/clusterinformations/default\" limit:1 "} Jul 15 10:57:50.116974 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:50.116333Z","caller":"wal/wal.go:805","msg":"slow fdatasync","took":"7.638553285s","expected-duration":"1s"} Jul 15 10:57:50.124927 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:50.121851Z","caller":"traceutil/trace.go:171","msg":"trace[1449394041] linearizableReadLoop","detail":"{readStateIndex:1477; appliedIndex:1468; }","duration":"8.897615953s","start":"2025-07-15T10:57:41.224115Z","end":"2025-07-15T10:57:50.121731Z","steps":["trace[1449394041] 'read index received' (duration: 1.253651721s)","trace[1449394041] 'applied index is now lower than readState.Index' (duration: 7.643962449s)"],"step_count":2} Jul 15 10:57:50.124927 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:50.122151Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"14.735114642s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/ipreservations/\" range_end:\"/registry/crd.projectcalico.org/ipreservations0\" count_only:true ","response":"range_response_count:0 size:5"} Jul 15 10:57:50.124927 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:50.122219Z","caller":"traceutil/trace.go:171","msg":"trace[998034249] range","detail":"{range_begin:/registry/crd.projectcalico.org/ipreservations/; range_end:/registry/crd.projectcalico.org/ipreservations0; response_count:0; response_revision:1363; }","duration":"14.735233619s","start":"2025-07-15T10:57:35.386959Z","end":"2025-07-15T10:57:50.122193Z","steps":["trace[998034249] 'agreement among raft nodes before linearized reading' (duration: 14.734780945s)"],"step_count":1} Jul 15 10:57:50.124927 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:50.122289Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:57:35.386932Z","time spent":"14.735332733s","remote":"172.24.4.207:51860","response type":"/etcdserverpb.KV/Range","request count":0,"request size":100,"response count":0,"response size":29,"request content":"key:\"/registry/crd.projectcalico.org/ipreservations/\" range_end:\"/registry/crd.projectcalico.org/ipreservations0\" count_only:true "} Jul 15 10:57:50.125554 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:50.122408Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"14.151880706s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/replicasets/\" range_end:\"/registry/replicasets0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 10:57:50.125554 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:50.122437Z","caller":"traceutil/trace.go:171","msg":"trace[706347594] range","detail":"{range_begin:/registry/replicasets/; range_end:/registry/replicasets0; response_count:0; response_revision:1363; }","duration":"14.151983516s","start":"2025-07-15T10:57:35.970446Z","end":"2025-07-15T10:57:50.122430Z","steps":["trace[706347594] 'agreement among raft nodes before linearized reading' (duration: 14.15193114s)"],"step_count":1} Jul 15 10:57:50.125554 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:50.122459Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:57:35.970419Z","time spent":"14.152032306s","remote":"172.24.4.207:54658","response type":"/etcdserverpb.KV/Range","request count":0,"request size":50,"response count":8,"response size":31,"request content":"key:\"/registry/replicasets/\" range_end:\"/registry/replicasets0\" count_only:true "} Jul 15 10:57:50.125554 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:50.122524Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"14.226868049s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/tigerastatuses/\" range_end:\"/registry/operator.tigera.io/tigerastatuses0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 10:57:50.125703 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:50.122545Z","caller":"traceutil/trace.go:171","msg":"trace[215774881] range","detail":"{range_begin:/registry/operator.tigera.io/tigerastatuses/; range_end:/registry/operator.tigera.io/tigerastatuses0; response_count:0; response_revision:1363; }","duration":"14.22688974s","start":"2025-07-15T10:57:35.895648Z","end":"2025-07-15T10:57:50.122538Z","steps":["trace[215774881] 'agreement among raft nodes before linearized reading' (duration: 14.226842342s)"],"step_count":1} Jul 15 10:57:50.125703 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:50.122586Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:57:35.895523Z","time spent":"14.227046619s","remote":"172.24.4.207:47638","response type":"/etcdserverpb.KV/Range","request count":0,"request size":94,"response count":5,"response size":31,"request content":"key:\"/registry/operator.tigera.io/tigerastatuses/\" range_end:\"/registry/operator.tigera.io/tigerastatuses0\" count_only:true "} Jul 15 10:57:50.125703 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:50.122756Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"15.368092276s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/masterleases/172.24.4.207\" limit:1 ","response":"range_response_count:1 size:131"} Jul 15 10:57:50.125703 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:50.122815Z","caller":"traceutil/trace.go:171","msg":"trace[1070884723] range","detail":"{range_begin:/registry/masterleases/172.24.4.207; range_end:; response_count:1; response_revision:1363; }","duration":"15.368180067s","start":"2025-07-15T10:57:34.754610Z","end":"2025-07-15T10:57:50.122790Z","steps":["trace[1070884723] 'agreement among raft nodes before linearized reading' (duration: 15.368065836s)"],"step_count":1} Jul 15 10:57:50.125906 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:50.122849Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:57:34.754582Z","time spent":"15.3682578s","remote":"172.24.4.207:54228","response type":"/etcdserverpb.KV/Range","request count":0,"request size":39,"response count":1,"response size":155,"request content":"key:\"/registry/masterleases/172.24.4.207\" limit:1 "} Jul 15 10:57:50.125906 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:50.123071Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"15.357612742s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/tiers/\" range_end:\"/registry/crd.projectcalico.org/tiers0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 10:57:50.125906 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:50.123286Z","caller":"traceutil/trace.go:171","msg":"trace[517303927] range","detail":"{range_begin:/registry/crd.projectcalico.org/tiers/; range_end:/registry/crd.projectcalico.org/tiers0; response_count:0; response_revision:1363; }","duration":"15.358203862s","start":"2025-07-15T10:57:34.764965Z","end":"2025-07-15T10:57:50.123169Z","steps":["trace[517303927] 'agreement among raft nodes before linearized reading' (duration: 15.357511805s)"],"step_count":1} Jul 15 10:57:50.125906 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:50.123633Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"15.630518118s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/events/\" range_end:\"/registry/events0\" count_only:true ","response":"range_response_count:0 size:8"} Jul 15 10:57:50.126075 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:50.123668Z","caller":"traceutil/trace.go:171","msg":"trace[1585198103] range","detail":"{range_begin:/registry/events/; range_end:/registry/events0; response_count:0; response_revision:1363; }","duration":"15.630556729s","start":"2025-07-15T10:57:34.493103Z","end":"2025-07-15T10:57:50.123660Z","steps":["trace[1585198103] 'agreement among raft nodes before linearized reading' (duration: 15.629826323s)"],"step_count":1} Jul 15 10:57:50.126075 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:50.123697Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:57:34.493034Z","time spent":"15.630655702s","remote":"172.24.4.207:54266","response type":"/etcdserverpb.KV/Range","request count":0,"request size":40,"response count":205,"response size":32,"request content":"key:\"/registry/events/\" range_end:\"/registry/events0\" count_only:true "} Jul 15 10:57:50.126075 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:50.123880Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:57:34.764947Z","time spent":"15.358835737s","remote":"172.24.4.207:59328","response type":"/etcdserverpb.KV/Range","request count":0,"request size":82,"response count":3,"response size":31,"request content":"key:\"/registry/crd.projectcalico.org/tiers/\" range_end:\"/registry/crd.projectcalico.org/tiers0\" count_only:true "} Jul 15 10:57:50.136312 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:50.133921Z","caller":"traceutil/trace.go:171","msg":"trace[1716447892] transaction","detail":"{read_only:false; number_of_response:1; response_revision:1363; }","duration":"145.445294ms","start":"2025-07-15T10:57:49.988408Z","end":"2025-07-15T10:57:50.133853Z","steps":["trace[1716447892] 'process raft request' (duration: 145.212565ms)"],"step_count":1} Jul 15 10:57:50.136312 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:50.134446Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"8.199807286s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/installations/\" range_end:\"/registry/operator.tigera.io/installations0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 10:57:50.136312 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:50.134564Z","caller":"traceutil/trace.go:171","msg":"trace[1616484837] range","detail":"{range_begin:/registry/operator.tigera.io/installations/; range_end:/registry/operator.tigera.io/installations0; response_count:0; response_revision:1364; }","duration":"8.199988911s","start":"2025-07-15T10:57:41.934551Z","end":"2025-07-15T10:57:50.134540Z","steps":["trace[1616484837] 'agreement among raft nodes before linearized reading' (duration: 8.199662569s)"],"step_count":1} Jul 15 10:57:50.136312 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:50.134562Z","caller":"traceutil/trace.go:171","msg":"trace[1993090344] transaction","detail":"{read_only:false; number_of_response:0; response_revision:1363; }","duration":"117.536244ms","start":"2025-07-15T10:57:50.017008Z","end":"2025-07-15T10:57:50.134544Z","steps":["trace[1993090344] 'process raft request' (duration: 116.712547ms)"],"step_count":1} Jul 15 10:57:50.138378 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:50.134619Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:57:41.934522Z","time spent":"8.200079046s","remote":"172.24.4.207:47640","response type":"/etcdserverpb.KV/Range","request count":0,"request size":92,"response count":1,"response size":31,"request content":"key:\"/registry/operator.tigera.io/installations/\" range_end:\"/registry/operator.tigera.io/installations0\" count_only:true "} Jul 15 10:57:50.138378 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:50.134854Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"155.623411ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/poddisruptionbudgets/\" range_end:\"/registry/poddisruptionbudgets0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 10:57:50.138378 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:50.134894Z","caller":"traceutil/trace.go:171","msg":"trace[930513898] range","detail":"{range_begin:/registry/poddisruptionbudgets/; range_end:/registry/poddisruptionbudgets0; response_count:0; response_revision:1364; }","duration":"155.751387ms","start":"2025-07-15T10:57:49.979130Z","end":"2025-07-15T10:57:50.134881Z","steps":["trace[930513898] 'agreement among raft nodes before linearized reading' (duration: 155.608232ms)"],"step_count":1} Jul 15 10:57:50.138378 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:50.135021Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"156.835415ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/gatewayapis/\" range_end:\"/registry/operator.tigera.io/gatewayapis0\" count_only:true ","response":"range_response_count:0 size:5"} Jul 15 10:57:50.138954 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:50.135075Z","caller":"traceutil/trace.go:171","msg":"trace[2143347309] range","detail":"{range_begin:/registry/operator.tigera.io/gatewayapis/; range_end:/registry/operator.tigera.io/gatewayapis0; response_count:0; response_revision:1364; }","duration":"156.909201ms","start":"2025-07-15T10:57:49.978132Z","end":"2025-07-15T10:57:50.135041Z","steps":["trace[2143347309] 'agreement among raft nodes before linearized reading' (duration: 156.842378ms)"],"step_count":1} Jul 15 10:57:50.138954 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:50.135236Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"158.922133ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jul 15 10:57:50.138954 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:50.135267Z","caller":"traceutil/trace.go:171","msg":"trace[84808195] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1364; }","duration":"158.986481ms","start":"2025-07-15T10:57:49.976273Z","end":"2025-07-15T10:57:50.135259Z","steps":["trace[84808195] 'agreement among raft nodes before linearized reading' (duration: 158.927994ms)"],"step_count":1} Jul 15 10:57:50.138954 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:50.135369Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"174.640576ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/bgppeers/\" range_end:\"/registry/crd.projectcalico.org/bgppeers0\" count_only:true ","response":"range_response_count:0 size:5"} Jul 15 10:57:50.139985 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:50.135389Z","caller":"traceutil/trace.go:171","msg":"trace[945880116] range","detail":"{range_begin:/registry/crd.projectcalico.org/bgppeers/; range_end:/registry/crd.projectcalico.org/bgppeers0; response_count:0; response_revision:1364; }","duration":"174.721164ms","start":"2025-07-15T10:57:49.960662Z","end":"2025-07-15T10:57:50.135383Z","steps":["trace[945880116] 'agreement among raft nodes before linearized reading' (duration: 174.685719ms)"],"step_count":1} Jul 15 10:57:50.139985 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:50.135435Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"108.173641ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/leases/kube-system/kube-scheduler\" limit:1 ","response":"range_response_count:1 size:505"} Jul 15 10:57:50.139985 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:50.135509Z","caller":"traceutil/trace.go:171","msg":"trace[1762134784] range","detail":"{range_begin:/registry/leases/kube-system/kube-scheduler; range_end:; response_count:1; response_revision:1364; }","duration":"108.295655ms","start":"2025-07-15T10:57:50.027197Z","end":"2025-07-15T10:57:50.135492Z","steps":["trace[1762134784] 'agreement among raft nodes before linearized reading' (duration: 108.192946ms)"],"step_count":1} Jul 15 10:57:50.139985 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:50.135643Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"143.689877ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/bgpfilters/\" range_end:\"/registry/crd.projectcalico.org/bgpfilters0\" count_only:true ","response":"range_response_count:0 size:5"} Jul 15 10:57:50.140457 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:50.135684Z","caller":"traceutil/trace.go:171","msg":"trace[124967972] range","detail":"{range_begin:/registry/crd.projectcalico.org/bgpfilters/; range_end:/registry/crd.projectcalico.org/bgpfilters0; response_count:0; response_revision:1364; }","duration":"143.753175ms","start":"2025-07-15T10:57:49.991918Z","end":"2025-07-15T10:57:50.135671Z","steps":["trace[124967972] 'agreement among raft nodes before linearized reading' (duration: 143.688486ms)"],"step_count":1} Jul 15 10:57:50.140457 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:50.136444Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"7.595630752s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/rolebindings/\" range_end:\"/registry/rolebindings0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 10:57:50.140457 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:50.136294Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"154.154052ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/resourcequotas/\" range_end:\"/registry/resourcequotas0\" count_only:true ","response":"range_response_count:0 size:5"} Jul 15 10:57:50.140457 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:50.136621Z","caller":"traceutil/trace.go:171","msg":"trace[1856280838] range","detail":"{range_begin:/registry/resourcequotas/; range_end:/registry/resourcequotas0; response_count:0; response_revision:1364; }","duration":"154.510659ms","start":"2025-07-15T10:57:49.982095Z","end":"2025-07-15T10:57:50.136606Z","steps":["trace[1856280838] 'agreement among raft nodes before linearized reading' (duration: 153.9635ms)"],"step_count":1} Jul 15 10:57:50.141179 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:50.136855Z","caller":"traceutil/trace.go:171","msg":"trace[1157981813] range","detail":"{range_begin:/registry/rolebindings/; range_end:/registry/rolebindings0; response_count:0; response_revision:1364; }","duration":"7.595842982s","start":"2025-07-15T10:57:42.540664Z","end":"2025-07-15T10:57:50.136507Z","steps":["trace[1157981813] 'agreement among raft nodes before linearized reading' (duration: 7.595685662s)"],"step_count":1} Jul 15 10:57:50.141179 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:50.137204Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"157.274305ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/imagesets/\" range_end:\"/registry/operator.tigera.io/imagesets0\" count_only:true ","response":"range_response_count:0 size:5"} Jul 15 10:57:50.141179 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:50.137348Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:57:42.540641Z","time spent":"7.596680636s","remote":"172.24.4.207:54522","response type":"/etcdserverpb.KV/Range","request count":0,"request size":52,"response count":16,"response size":31,"request content":"key:\"/registry/rolebindings/\" range_end:\"/registry/rolebindings0\" count_only:true "} Jul 15 10:57:50.141179 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:50.137627Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"7.748381569s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/csinodes/\" range_end:\"/registry/csinodes0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 10:57:50.141753 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:50.137741Z","caller":"traceutil/trace.go:171","msg":"trace[1261758236] range","detail":"{range_begin:/registry/operator.tigera.io/imagesets/; range_end:/registry/operator.tigera.io/imagesets0; response_count:0; response_revision:1364; }","duration":"157.360685ms","start":"2025-07-15T10:57:49.979892Z","end":"2025-07-15T10:57:50.137253Z","steps":["trace[1261758236] 'agreement among raft nodes before linearized reading' (duration: 157.268454ms)"],"step_count":1} Jul 15 10:57:50.141753 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:50.137900Z","caller":"traceutil/trace.go:171","msg":"trace[1996846389] range","detail":"{range_begin:/registry/csinodes/; range_end:/registry/csinodes0; response_count:0; response_revision:1364; }","duration":"7.748481173s","start":"2025-07-15T10:57:42.389190Z","end":"2025-07-15T10:57:50.137671Z","steps":["trace[1996846389] 'agreement among raft nodes before linearized reading' (duration: 7.748353187s)"],"step_count":1} Jul 15 10:57:50.141753 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:50.138403Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:57:42.389168Z","time spent":"7.749042568s","remote":"172.24.4.207:54586","response type":"/etcdserverpb.KV/Range","request count":0,"request size":44,"response count":1,"response size":31,"request content":"key:\"/registry/csinodes/\" range_end:\"/registry/csinodes0\" count_only:true "} Jul 15 10:57:50.141753 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:50.139095Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"8.081003497s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/kubecontrollersconfigurations.crd.projectcalico.org\" limit:1 ","response":"range_response_count:1 size:12490"} Jul 15 10:57:50.141977 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:50.138656Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"159.117994ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/endpointslices/\" range_end:\"/registry/endpointslices0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 10:57:50.141977 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:50.139285Z","caller":"traceutil/trace.go:171","msg":"trace[1848919797] range","detail":"{range_begin:/registry/endpointslices/; range_end:/registry/endpointslices0; response_count:0; response_revision:1364; }","duration":"159.768444ms","start":"2025-07-15T10:57:49.979501Z","end":"2025-07-15T10:57:50.139270Z","steps":["trace[1848919797] 'agreement among raft nodes before linearized reading' (duration: 159.048346ms)"],"step_count":1} Jul 15 10:57:50.142493 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:50.139167Z","caller":"traceutil/trace.go:171","msg":"trace[767360038] range","detail":"{range_begin:/registry/apiextensions.k8s.io/customresourcedefinitions/kubecontrollersconfigurations.crd.projectcalico.org; range_end:; response_count:1; response_revision:1364; }","duration":"8.081152152s","start":"2025-07-15T10:57:42.057996Z","end":"2025-07-15T10:57:50.139148Z","steps":["trace[767360038] 'agreement among raft nodes before linearized reading' (duration: 8.080852098s)"],"step_count":1} Jul 15 10:57:50.142493 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:50.140875Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:57:42.057979Z","time spent":"8.08277842s","remote":"172.24.4.207:54256","response type":"/etcdserverpb.KV/Range","request count":0,"request size":112,"response count":1,"response size":12514,"request content":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/kubecontrollersconfigurations.crd.projectcalico.org\" limit:1 "} Jul 15 10:57:50.142493 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:50.141881Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"8.104337157s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/services/endpoints/calico-system/calico-typha\" limit:1 ","response":"range_response_count:1 size:789"} Jul 15 10:57:50.142493 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:50.141946Z","caller":"traceutil/trace.go:171","msg":"trace[1410667398] range","detail":"{range_begin:/registry/services/endpoints/calico-system/calico-typha; range_end:; response_count:1; response_revision:1364; }","duration":"8.104747553s","start":"2025-07-15T10:57:42.037180Z","end":"2025-07-15T10:57:50.141928Z","steps":["trace[1410667398] 'agreement among raft nodes before linearized reading' (duration: 8.104114687s)"],"step_count":1} Jul 15 10:57:50.142835 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:50.142020Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:57:42.037152Z","time spent":"8.104825607s","remote":"172.24.4.207:54340","response type":"/etcdserverpb.KV/Range","request count":0,"request size":59,"response count":1,"response size":813,"request content":"key:\"/registry/services/endpoints/calico-system/calico-typha\" limit:1 "} Jul 15 10:57:50.142835 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:50.142169Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"8.162610879s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/csidrivers/\" range_end:\"/registry/csidrivers0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 10:57:50.143231 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:50.143049Z","caller":"traceutil/trace.go:171","msg":"trace[282706375] range","detail":"{range_begin:/registry/csidrivers/; range_end:/registry/csidrivers0; response_count:0; response_revision:1364; }","duration":"8.163531075s","start":"2025-07-15T10:57:41.979491Z","end":"2025-07-15T10:57:50.143022Z","steps":["trace[282706375] 'agreement among raft nodes before linearized reading' (duration: 8.162627559s)"],"step_count":1} Jul 15 10:57:50.143701 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:50.143529Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:57:41.979476Z","time spent":"8.163881111s","remote":"172.24.4.207:54602","response type":"/etcdserverpb.KV/Range","request count":0,"request size":48,"response count":1,"response size":31,"request content":"key:\"/registry/csidrivers/\" range_end:\"/registry/csidrivers0\" count_only:true "} Jul 15 10:57:50.143973 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:50.142525Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"8.164742668s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/certificatesigningrequests/\" range_end:\"/registry/certificatesigningrequests0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 10:57:50.144308 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:50.142603Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"8.164591179s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/ipamblocks/\" range_end:\"/registry/crd.projectcalico.org/ipamblocks0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 10:57:50.144308 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:50.142664Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"8.164783174s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/persistentvolumeclaims/\" range_end:\"/registry/persistentvolumeclaims0\" count_only:true ","response":"range_response_count:0 size:5"} Jul 15 10:57:50.144308 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:50.134479Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"154.995514ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jul 15 10:57:50.145214 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:50.144234Z","caller":"traceutil/trace.go:171","msg":"trace[466414130] range","detail":"{range_begin:/registry/crd.projectcalico.org/ipamblocks/; range_end:/registry/crd.projectcalico.org/ipamblocks0; response_count:0; response_revision:1364; }","duration":"8.166248054s","start":"2025-07-15T10:57:41.977964Z","end":"2025-07-15T10:57:50.144212Z","steps":["trace[466414130] 'agreement among raft nodes before linearized reading' (duration: 8.164597289s)"],"step_count":1} Jul 15 10:57:50.145214 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:50.144313Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:57:41.977952Z","time spent":"8.166335065s","remote":"172.24.4.207:59350","response type":"/etcdserverpb.KV/Range","request count":0,"request size":92,"response count":1,"response size":31,"request content":"key:\"/registry/crd.projectcalico.org/ipamblocks/\" range_end:\"/registry/crd.projectcalico.org/ipamblocks0\" count_only:true "} Jul 15 10:57:50.145900 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:50.144535Z","caller":"traceutil/trace.go:171","msg":"trace[375524946] range","detail":"{range_begin:/registry/certificatesigningrequests/; range_end:/registry/certificatesigningrequests0; response_count:0; response_revision:1364; }","duration":"8.166797847s","start":"2025-07-15T10:57:41.977722Z","end":"2025-07-15T10:57:50.144519Z","steps":["trace[375524946] 'agreement among raft nodes before linearized reading' (duration: 8.164729905s)"],"step_count":1} Jul 15 10:57:50.145900 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:50.144642Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:57:41.977695Z","time spent":"8.166921897s","remote":"172.24.4.207:54424","response type":"/etcdserverpb.KV/Range","request count":0,"request size":80,"response count":2,"response size":31,"request content":"key:\"/registry/certificatesigningrequests/\" range_end:\"/registry/certificatesigningrequests0\" count_only:true "} Jul 15 10:57:50.145900 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:50.144160Z","caller":"traceutil/trace.go:171","msg":"trace[364548691] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1364; }","duration":"164.74006ms","start":"2025-07-15T10:57:49.979406Z","end":"2025-07-15T10:57:50.144146Z","steps":["trace[364548691] 'agreement among raft nodes before linearized reading' (duration: 154.907431ms)"],"step_count":1} Jul 15 10:57:50.145900 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:50.144940Z","caller":"traceutil/trace.go:171","msg":"trace[1492446098] range","detail":"{range_begin:/registry/persistentvolumeclaims/; range_end:/registry/persistentvolumeclaims0; response_count:0; response_revision:1364; }","duration":"8.167200872s","start":"2025-07-15T10:57:41.977725Z","end":"2025-07-15T10:57:50.144926Z","steps":["trace[1492446098] 'agreement among raft nodes before linearized reading' (duration: 8.164914776s)"],"step_count":1} Jul 15 10:57:50.146298 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:50.145003Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:57:41.977696Z","time spent":"8.167269608s","remote":"172.24.4.207:54328","response type":"/etcdserverpb.KV/Range","request count":0,"request size":72,"response count":0,"response size":29,"request content":"key:\"/registry/persistentvolumeclaims/\" range_end:\"/registry/persistentvolumeclaims0\" count_only:true "} Jul 15 10:57:53.683383 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:53.533277Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875172758,"retry-timeout":"500ms"} Jul 15 10:57:53.683383 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:53.674569Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"3.169587475s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/leases/tigera-operator/operator-lock\" limit:1 ","response":"","error":"context canceled"} Jul 15 10:57:53.683383 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:53.674704Z","caller":"traceutil/trace.go:171","msg":"trace[324712379] range","detail":"{range_begin:/registry/leases/tigera-operator/operator-lock; range_end:; }","duration":"3.169887989s","start":"2025-07-15T10:57:50.504787Z","end":"2025-07-15T10:57:53.674675Z","steps":["trace[324712379] 'agreement among raft nodes before linearized reading' (duration: 3.169655922s)"],"step_count":1} Jul 15 10:57:53.683383 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:53.674788Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:57:50.504770Z","time spent":"3.169994557s","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Range","request count":0,"request size":50,"response count":0,"response size":0,"request content":"key:\"/registry/leases/tigera-operator/operator-lock\" limit:1 "} Jul 15 10:57:53.696692 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:53.695835Z","caller":"wal/wal.go:805","msg":"slow fdatasync","took":"3.296081731s","expected-duration":"1s"} Jul 15 10:57:53.828879 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:53.824981Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"127.866414ms","expected-duration":"100ms","prefix":"","request":"header: txn: success:> failure: >>","response":"size:16"} Jul 15 10:57:53.828879 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:53.825409Z","caller":"traceutil/trace.go:171","msg":"trace[1320793334] transaction","detail":"{read_only:false; response_revision:1373; number_of_response:1; }","duration":"3.439693308s","start":"2025-07-15T10:57:50.385653Z","end":"2025-07-15T10:57:53.825346Z","steps":["trace[1320793334] 'process raft request' (duration: 3.439478933s)"],"step_count":1} Jul 15 10:57:53.828879 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:53.825621Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:57:50.385618Z","time spent":"3.439885673s","remote":"172.24.4.207:54228","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":116,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 10:57:53.828879 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:53.825601Z","caller":"traceutil/trace.go:171","msg":"trace[1198820397] linearizableReadLoop","detail":"{readStateIndex:1495; appliedIndex:1493; }","duration":"3.32624382s","start":"2025-07-15T10:57:50.499331Z","end":"2025-07-15T10:57:53.825574Z","steps":["trace[1198820397] 'read index received' (duration: 3.197493987s)","trace[1198820397] 'applied index is now lower than readState.Index' (duration: 128.74841ms)"],"step_count":2} Jul 15 10:57:53.831498 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:53.825759Z","caller":"traceutil/trace.go:171","msg":"trace[1347267540] transaction","detail":"{read_only:false; response_revision:1372; number_of_response:1; }","duration":"3.440216724s","start":"2025-07-15T10:57:50.385515Z","end":"2025-07-15T10:57:53.825732Z","steps":["trace[1347267540] 'process raft request' (duration: 3.311019065s)","trace[1347267540] 'compare' (duration: 127.58287ms)"],"step_count":2} Jul 15 10:57:53.831498 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:53.825919Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:57:50.385481Z","time spent":"3.440313934s","remote":"172.24.4.207:54424","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":2330,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 10:57:53.831498 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:53.826590Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"3.327222043s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/tigerastatuses/calico\" limit:1 ","response":"range_response_count:1 size:1219"} Jul 15 10:57:53.831498 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:53.826623Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"3.301236397s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/installations/default\" limit:1 ","response":"range_response_count:1 size:4188"} Jul 15 10:57:53.832059 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:53.826655Z","caller":"traceutil/trace.go:171","msg":"trace[344146728] range","detail":"{range_begin:/registry/operator.tigera.io/tigerastatuses/calico; range_end:; response_count:1; response_revision:1375; }","duration":"3.327353906s","start":"2025-07-15T10:57:50.499280Z","end":"2025-07-15T10:57:53.826634Z","steps":["trace[344146728] 'agreement among raft nodes before linearized reading' (duration: 3.326855057s)"],"step_count":1} Jul 15 10:57:53.832059 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:53.826731Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:57:50.499254Z","time spent":"3.32744258s","remote":"172.24.4.207:47638","response type":"/etcdserverpb.KV/Range","request count":0,"request size":54,"response count":1,"response size":1243,"request content":"key:\"/registry/operator.tigera.io/tigerastatuses/calico\" limit:1 "} Jul 15 10:57:53.832059 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:53.826735Z","caller":"traceutil/trace.go:171","msg":"trace[1220197175] range","detail":"{range_begin:/registry/operator.tigera.io/installations/default; range_end:; response_count:1; response_revision:1375; }","duration":"3.301347652s","start":"2025-07-15T10:57:50.525326Z","end":"2025-07-15T10:57:53.826674Z","steps":["trace[1220197175] 'agreement among raft nodes before linearized reading' (duration: 3.301112959s)"],"step_count":1} Jul 15 10:57:53.832059 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:53.826861Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:57:50.525304Z","time spent":"3.301473335s","remote":"172.24.4.207:47640","response type":"/etcdserverpb.KV/Range","request count":0,"request size":54,"response count":1,"response size":4212,"request content":"key:\"/registry/operator.tigera.io/installations/default\" limit:1 "} Jul 15 10:57:53.832360 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:53.827551Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"148.480067ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/clusterinformations/default\" limit:1 ","response":"range_response_count:1 size:886"} Jul 15 10:57:53.832360 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:53.827621Z","caller":"traceutil/trace.go:171","msg":"trace[1451489707] range","detail":"{range_begin:/registry/crd.projectcalico.org/clusterinformations/default; range_end:; response_count:1; response_revision:1375; }","duration":"148.599338ms","start":"2025-07-15T10:57:53.679004Z","end":"2025-07-15T10:57:53.827603Z","steps":["trace[1451489707] 'agreement among raft nodes before linearized reading' (duration: 148.415179ms)"],"step_count":1} Jul 15 10:57:53.832360 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:53.828278Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"294.708524ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/stagedkubernetesnetworkpolicies.crd.projectcalico.org\" limit:1 ","response":"range_response_count:1 size:20393"} Jul 15 10:57:53.832360 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:53.828374Z","caller":"traceutil/trace.go:171","msg":"trace[34891577] range","detail":"{range_begin:/registry/apiextensions.k8s.io/customresourcedefinitions/stagedkubernetesnetworkpolicies.crd.projectcalico.org; range_end:; response_count:1; response_revision:1375; }","duration":"294.820219ms","start":"2025-07-15T10:57:53.533515Z","end":"2025-07-15T10:57:53.828336Z","steps":["trace[34891577] 'agreement among raft nodes before linearized reading' (duration: 294.237805ms)"],"step_count":1} Jul 15 10:57:53.832710 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:53.828933Z","caller":"traceutil/trace.go:171","msg":"trace[1128633040] transaction","detail":"{read_only:false; response_revision:1374; number_of_response:1; }","duration":"210.992039ms","start":"2025-07-15T10:57:53.617909Z","end":"2025-07-15T10:57:53.828901Z","steps":["trace[1128633040] 'process raft request' (duration: 207.35365ms)"],"step_count":1} Jul 15 10:57:53.832710 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:53.829706Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"296.456417ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/minions/ci-4230-2-100-9439eb8d1a.novalocal\" limit:1 ","response":"range_response_count:1 size:5846"} Jul 15 10:57:53.832710 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:53.829776Z","caller":"traceutil/trace.go:171","msg":"trace[1752187099] range","detail":"{range_begin:/registry/minions/ci-4230-2-100-9439eb8d1a.novalocal; range_end:; response_count:1; response_revision:1375; }","duration":"296.562082ms","start":"2025-07-15T10:57:53.533198Z","end":"2025-07-15T10:57:53.829760Z","steps":["trace[1752187099] 'agreement among raft nodes before linearized reading' (duration: 296.332999ms)"],"step_count":1} Jul 15 10:57:53.832710 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:53.830895Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"297.798151ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/installations/default\" limit:1 ","response":"range_response_count:1 size:4188"} Jul 15 10:57:53.832710 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:53.830966Z","caller":"traceutil/trace.go:171","msg":"trace[1949068824] range","detail":"{range_begin:/registry/operator.tigera.io/installations/default; range_end:; response_count:1; response_revision:1375; }","duration":"297.927941ms","start":"2025-07-15T10:57:53.533022Z","end":"2025-07-15T10:57:53.830950Z","steps":["trace[1949068824] 'agreement among raft nodes before linearized reading' (duration: 297.158112ms)"],"step_count":1} Jul 15 10:57:54.115131 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:54.113151Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"133.707503ms","expected-duration":"100ms","prefix":"","request":"header: txn: success:> failure: >>","response":"size:16"} Jul 15 10:57:54.115131 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:54.113373Z","caller":"traceutil/trace.go:171","msg":"trace[1561358782] transaction","detail":"{read_only:false; number_of_response:0; response_revision:1376; }","duration":"228.670078ms","start":"2025-07-15T10:57:53.884682Z","end":"2025-07-15T10:57:54.113352Z","steps":["trace[1561358782] 'process raft request' (duration: 228.599237ms)"],"step_count":1} Jul 15 10:57:54.115131 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:54.113552Z","caller":"traceutil/trace.go:171","msg":"trace[420284066] transaction","detail":"{read_only:false; response_revision:1376; number_of_response:1; }","duration":"260.447551ms","start":"2025-07-15T10:57:53.853057Z","end":"2025-07-15T10:57:54.113505Z","steps":["trace[420284066] 'process raft request' (duration: 126.29694ms)","trace[420284066] 'compare' (duration: 133.514337ms)"],"step_count":2} Jul 15 10:57:54.115131 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:54.113626Z","caller":"traceutil/trace.go:171","msg":"trace[1979495615] linearizableReadLoop","detail":"{readStateIndex:1498; appliedIndex:1497; }","duration":"258.702242ms","start":"2025-07-15T10:57:53.854910Z","end":"2025-07-15T10:57:54.113612Z","steps":["trace[1979495615] 'read index received' (duration: 124.447468ms)","trace[1979495615] 'applied index is now lower than readState.Index' (duration: 134.253702ms)"],"step_count":2} Jul 15 10:57:54.115781 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:54.114000Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"259.065972ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/masterleases/\" range_end:\"/registry/masterleases0\" ","response":"range_response_count:1 size:131"} Jul 15 10:57:54.115781 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:54.114062Z","caller":"traceutil/trace.go:171","msg":"trace[1395220474] range","detail":"{range_begin:/registry/masterleases/; range_end:/registry/masterleases0; response_count:1; response_revision:1376; }","duration":"259.169885ms","start":"2025-07-15T10:57:53.854877Z","end":"2025-07-15T10:57:54.114047Z","steps":["trace[1395220474] 'agreement among raft nodes before linearized reading' (duration: 258.803609ms)"],"step_count":1} Jul 15 10:57:54.125041 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:54.122558Z","caller":"traceutil/trace.go:171","msg":"trace[204288966] transaction","detail":"{read_only:false; response_revision:1377; number_of_response:1; }","duration":"134.254863ms","start":"2025-07-15T10:57:53.988277Z","end":"2025-07-15T10:57:54.122532Z","steps":["trace[204288966] 'process raft request' (duration: 133.802178ms)"],"step_count":1} Jul 15 10:57:54.125041 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:54.123389Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"232.863031ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/minions/ci-4230-2-100-9439eb8d1a.novalocal\" limit:1 ","response":"range_response_count:1 size:6168"} Jul 15 10:57:54.125041 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:54.123545Z","caller":"traceutil/trace.go:171","msg":"trace[947773532] range","detail":"{range_begin:/registry/minions/ci-4230-2-100-9439eb8d1a.novalocal; range_end:; response_count:1; response_revision:1378; }","duration":"233.077927ms","start":"2025-07-15T10:57:53.890447Z","end":"2025-07-15T10:57:54.123525Z","steps":["trace[947773532] 'agreement among raft nodes before linearized reading' (duration: 232.566865ms)"],"step_count":1} Jul 15 10:57:54.125627 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:54.124309Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"208.960662ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/namespaces\" limit:1 ","response":"range_response_count:0 size:5"} Jul 15 10:57:54.125627 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:54.124417Z","caller":"traceutil/trace.go:171","msg":"trace[819841225] range","detail":"{range_begin:/registry/namespaces; range_end:; response_count:0; response_revision:1378; }","duration":"209.285611ms","start":"2025-07-15T10:57:53.915109Z","end":"2025-07-15T10:57:54.124395Z","steps":["trace[819841225] 'agreement among raft nodes before linearized reading' (duration: 208.983333ms)"],"step_count":1} Jul 15 10:57:54.325283 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:54.324503Z","caller":"traceutil/trace.go:171","msg":"trace[1192079411] linearizableReadLoop","detail":"{readStateIndex:1509; appliedIndex:1507; }","duration":"101.830166ms","start":"2025-07-15T10:57:54.222639Z","end":"2025-07-15T10:57:54.324469Z","steps":["trace[1192079411] 'read index received' (duration: 65.785182ms)","trace[1192079411] 'applied index is now lower than readState.Index' (duration: 36.043371ms)"],"step_count":2} Jul 15 10:57:54.325962 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:54.324668Z","caller":"traceutil/trace.go:171","msg":"trace[676544427] transaction","detail":"{read_only:false; response_revision:1383; number_of_response:1; }","duration":"111.453465ms","start":"2025-07-15T10:57:54.213195Z","end":"2025-07-15T10:57:54.324648Z","steps":["trace[676544427] 'process raft request' (duration: 110.347174ms)"],"step_count":1} Jul 15 10:57:54.327407 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:54.326875Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"104.142291ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/events/default/172.24.4.38.1852678f59127a04\" limit:1 ","response":"range_response_count:0 size:5"} Jul 15 10:57:54.328332 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:54.327722Z","caller":"traceutil/trace.go:171","msg":"trace[1750008311] range","detail":"{range_begin:/registry/events/default/172.24.4.38.1852678f59127a04; range_end:; response_count:0; response_revision:1386; }","duration":"105.066275ms","start":"2025-07-15T10:57:54.222577Z","end":"2025-07-15T10:57:54.327643Z","steps":["trace[1750008311] 'agreement among raft nodes before linearized reading' (duration: 104.167628ms)"],"step_count":1} Jul 15 10:57:54.357406 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:54.356593Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"119.248651ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/minions/172.24.4.38\" limit:1 ","response":"range_response_count:1 size:2166"} Jul 15 10:57:54.357406 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:54.356727Z","caller":"traceutil/trace.go:171","msg":"trace[941583158] range","detail":"{range_begin:/registry/minions/172.24.4.38; range_end:; response_count:1; response_revision:1388; }","duration":"119.421128ms","start":"2025-07-15T10:57:54.237273Z","end":"2025-07-15T10:57:54.356694Z","steps":["trace[941583158] 'agreement among raft nodes before linearized reading' (duration: 119.112589ms)"],"step_count":1} Jul 15 10:57:54.491498 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:54.488774Z","caller":"traceutil/trace.go:171","msg":"trace[1797716319] transaction","detail":"{read_only:false; response_revision:1390; number_of_response:1; }","duration":"132.783502ms","start":"2025-07-15T10:57:54.355959Z","end":"2025-07-15T10:57:54.488743Z","steps":["trace[1797716319] 'process raft request' (duration: 88.871689ms)","trace[1797716319] 'compare' (duration: 43.579149ms)"],"step_count":2} Jul 15 10:57:54.491498 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:54.489526Z","caller":"traceutil/trace.go:171","msg":"trace[1144260170] transaction","detail":"{read_only:false; response_revision:1391; number_of_response:1; }","duration":"113.540193ms","start":"2025-07-15T10:57:54.375931Z","end":"2025-07-15T10:57:54.489472Z","steps":["trace[1144260170] 'process raft request' (duration: 112.700014ms)"],"step_count":1} Jul 15 10:57:54.491498 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:54.489777Z","caller":"traceutil/trace.go:171","msg":"trace[209677705] transaction","detail":"{read_only:false; response_revision:1392; number_of_response:1; }","duration":"110.471423ms","start":"2025-07-15T10:57:54.379288Z","end":"2025-07-15T10:57:54.489759Z","steps":["trace[209677705] 'process raft request' (duration: 109.957124ms)"],"step_count":1} Jul 15 10:57:54.491498 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:54.490898Z","caller":"traceutil/trace.go:171","msg":"trace[2060844089] transaction","detail":"{read_only:false; response_revision:1393; number_of_response:1; }","duration":"110.242672ms","start":"2025-07-15T10:57:54.380606Z","end":"2025-07-15T10:57:54.490848Z","steps":["trace[2060844089] 'process raft request' (duration: 109.079457ms)"],"step_count":1} Jul 15 10:57:54.495343 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:54.491553Z","caller":"traceutil/trace.go:171","msg":"trace[1165501317] transaction","detail":"{read_only:false; response_revision:1394; number_of_response:1; }","duration":"109.946014ms","start":"2025-07-15T10:57:54.381587Z","end":"2025-07-15T10:57:54.491533Z","steps":["trace[1165501317] 'process raft request' (duration: 108.899894ms)"],"step_count":1} Jul 15 10:57:54.496005 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:54.493777Z","caller":"traceutil/trace.go:171","msg":"trace[810567229] linearizableReadLoop","detail":"{readStateIndex:1520; appliedIndex:1516; }","duration":"112.4ms","start":"2025-07-15T10:57:54.381291Z","end":"2025-07-15T10:57:54.493691Z","steps":["trace[810567229] 'read index received' (duration: 63.619067ms)","trace[810567229] 'applied index is now lower than readState.Index' (duration: 48.77952ms)"],"step_count":2} Jul 15 10:57:54.496005 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:54.494336Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"113.02877ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/minions/172.24.4.38\" limit:1 ","response":"range_response_count:1 size:2382"} Jul 15 10:57:54.496005 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:54.494409Z","caller":"traceutil/trace.go:171","msg":"trace[1769275582] range","detail":"{range_begin:/registry/minions/172.24.4.38; range_end:; response_count:1; response_revision:1396; }","duration":"113.17523ms","start":"2025-07-15T10:57:54.381215Z","end":"2025-07-15T10:57:54.494391Z","steps":["trace[1769275582] 'agreement among raft nodes before linearized reading' (duration: 113.042756ms)"],"step_count":1} Jul 15 10:57:54.496005 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:54.495254Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"109.449028ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/events/default/172.24.4.38.1852678f59129c25\" limit:1 ","response":"range_response_count:0 size:5"} Jul 15 10:57:54.496005 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:54.495320Z","caller":"traceutil/trace.go:171","msg":"trace[1326967709] range","detail":"{range_begin:/registry/events/default/172.24.4.38.1852678f59129c25; range_end:; response_count:0; response_revision:1396; }","duration":"109.531781ms","start":"2025-07-15T10:57:54.385770Z","end":"2025-07-15T10:57:54.495302Z","steps":["trace[1326967709] 'agreement among raft nodes before linearized reading' (duration: 109.442476ms)"],"step_count":1} Jul 15 10:57:54.496461 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:54.494871Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"110.047772ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/masterleases/\" range_end:\"/registry/masterleases0\" ","response":"range_response_count:1 size:131"} Jul 15 10:57:54.496742 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:54.495877Z","caller":"traceutil/trace.go:171","msg":"trace[1239507044] range","detail":"{range_begin:/registry/masterleases/; range_end:/registry/masterleases0; response_count:1; response_revision:1396; }","duration":"110.955225ms","start":"2025-07-15T10:57:54.384770Z","end":"2025-07-15T10:57:54.495726Z","steps":["trace[1239507044] 'agreement among raft nodes before linearized reading' (duration: 109.534105ms)"],"step_count":1} Jul 15 10:57:54.718383 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:54.716923Z","caller":"traceutil/trace.go:171","msg":"trace[510074155] linearizableReadLoop","detail":"{readStateIndex:1530; appliedIndex:1527; }","duration":"127.694245ms","start":"2025-07-15T10:57:54.589198Z","end":"2025-07-15T10:57:54.716893Z","steps":["trace[510074155] 'read index received' (duration: 85.202922ms)","trace[510074155] 'applied index is now lower than readState.Index' (duration: 42.489982ms)"],"step_count":2} Jul 15 10:57:54.718383 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:54.717350Z","caller":"traceutil/trace.go:171","msg":"trace[2040795099] transaction","detail":"{read_only:false; response_revision:1401; number_of_response:1; }","duration":"132.408139ms","start":"2025-07-15T10:57:54.584911Z","end":"2025-07-15T10:57:54.717319Z","steps":["trace[2040795099] 'process raft request' (duration: 89.362454ms)","trace[2040795099] 'compare' (duration: 42.09377ms)"],"step_count":2} Jul 15 10:57:54.718383 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:54.717386Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"128.149225ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/daemonsets/calico-system/calico-node\" limit:1 ","response":"range_response_count:1 size:11440"} Jul 15 10:57:54.718383 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:54.717481Z","caller":"traceutil/trace.go:171","msg":"trace[1641132759] range","detail":"{range_begin:/registry/daemonsets/calico-system/calico-node; range_end:; response_count:1; response_revision:1403; }","duration":"128.321623ms","start":"2025-07-15T10:57:54.589141Z","end":"2025-07-15T10:57:54.717462Z","steps":["trace[1641132759] 'agreement among raft nodes before linearized reading' (duration: 127.819266ms)"],"step_count":1} Jul 15 10:57:54.720212 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:54.717541Z","caller":"traceutil/trace.go:171","msg":"trace[1441183015] transaction","detail":"{read_only:false; response_revision:1402; number_of_response:1; }","duration":"129.512349ms","start":"2025-07-15T10:57:54.588013Z","end":"2025-07-15T10:57:54.717526Z","steps":["trace[1441183015] 'process raft request' (duration: 128.625723ms)"],"step_count":1} Jul 15 10:57:54.720212 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:54.717683Z","caller":"traceutil/trace.go:171","msg":"trace[143430101] transaction","detail":"{read_only:false; response_revision:1403; number_of_response:1; }","duration":"129.353306ms","start":"2025-07-15T10:57:54.588316Z","end":"2025-07-15T10:57:54.717670Z","steps":["trace[143430101] 'process raft request' (duration: 128.457413ms)"],"step_count":1} Jul 15 10:57:56.080366 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:56.075881Z","caller":"traceutil/trace.go:171","msg":"trace[268081334] linearizableReadLoop","detail":"{readStateIndex:1552; appliedIndex:1551; }","duration":"108.09857ms","start":"2025-07-15T10:57:55.967694Z","end":"2025-07-15T10:57:56.075793Z","steps":["trace[268081334] 'read index received' (duration: 75.457337ms)","trace[268081334] 'applied index is now lower than readState.Index' (duration: 32.63987ms)"],"step_count":2} Jul 15 10:57:56.080366 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:56.076205Z","caller":"traceutil/trace.go:171","msg":"trace[1487452734] transaction","detail":"{read_only:false; response_revision:1425; number_of_response:1; }","duration":"128.167904ms","start":"2025-07-15T10:57:55.948005Z","end":"2025-07-15T10:57:56.076173Z","steps":["trace[1487452734] 'process raft request' (duration: 95.269527ms)","trace[1487452734] 'compare' (duration: 32.300064ms)"],"step_count":2} Jul 15 10:57:56.080366 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:56.076520Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"108.750984ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/serviceaccounts/calico-system/calico-node\" limit:1 ","response":"range_response_count:1 size:525"} Jul 15 10:57:56.080366 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:56.076615Z","caller":"traceutil/trace.go:171","msg":"trace[1098751341] range","detail":"{range_begin:/registry/serviceaccounts/calico-system/calico-node; range_end:; response_count:1; response_revision:1425; }","duration":"108.968074ms","start":"2025-07-15T10:57:55.967632Z","end":"2025-07-15T10:57:56.076600Z","steps":["trace[1098751341] 'agreement among raft nodes before linearized reading' (duration: 108.693677ms)"],"step_count":1} Jul 15 10:57:56.085478 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:57:56.076975Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"108.729434ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/calico-apiserver/calico-apiserver-59bf97d48b-2l487\" limit:1 ","response":"range_response_count:1 size:6357"} Jul 15 10:57:56.085478 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:57:56.077086Z","caller":"traceutil/trace.go:171","msg":"trace[1143559131] range","detail":"{range_begin:/registry/pods/calico-apiserver/calico-apiserver-59bf97d48b-2l487; range_end:; response_count:1; response_revision:1425; }","duration":"108.893367ms","start":"2025-07-15T10:57:55.968151Z","end":"2025-07-15T10:57:56.077045Z","steps":["trace[1143559131] 'agreement among raft nodes before linearized reading' (duration: 108.565853ms)"],"step_count":1} Jul 15 10:58:04.897158 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:04.894330Z","caller":"traceutil/trace.go:171","msg":"trace[498173288] transaction","detail":"{read_only:false; response_revision:1439; number_of_response:1; }","duration":"191.295224ms","start":"2025-07-15T10:58:04.702991Z","end":"2025-07-15T10:58:04.894286Z","steps":["trace[498173288] 'process raft request' (duration: 190.747003ms)"],"step_count":1} Jul 15 10:58:04.906171 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:04.904974Z","caller":"traceutil/trace.go:171","msg":"trace[42516325] transaction","detail":"{read_only:false; response_revision:1440; number_of_response:1; }","duration":"199.174911ms","start":"2025-07-15T10:58:04.705764Z","end":"2025-07-15T10:58:04.904939Z","steps":["trace[42516325] 'process raft request' (duration: 198.873846ms)"],"step_count":1} Jul 15 10:58:04.906171 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:04.905480Z","caller":"traceutil/trace.go:171","msg":"trace[1840851924] transaction","detail":"{read_only:false; response_revision:1442; number_of_response:1; }","duration":"174.704206ms","start":"2025-07-15T10:58:04.730756Z","end":"2025-07-15T10:58:04.905460Z","steps":["trace[1840851924] 'process raft request' (duration: 174.250549ms)"],"step_count":1} Jul 15 10:58:04.908159 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:04.905866Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"191.213865ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jul 15 10:58:04.908159 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:04.906217Z","caller":"traceutil/trace.go:171","msg":"trace[78465748] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1442; }","duration":"191.718696ms","start":"2025-07-15T10:58:04.714476Z","end":"2025-07-15T10:58:04.906195Z","steps":["trace[78465748] 'agreement among raft nodes before linearized reading' (duration: 191.153312ms)"],"step_count":1} Jul 15 10:58:04.908159 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:04.906014Z","caller":"traceutil/trace.go:171","msg":"trace[1287687265] transaction","detail":"{read_only:false; response_revision:1441; number_of_response:1; }","duration":"190.952111ms","start":"2025-07-15T10:58:04.715049Z","end":"2025-07-15T10:58:04.906002Z","steps":["trace[1287687265] 'process raft request' (duration: 189.830872ms)"],"step_count":1} Jul 15 10:58:04.908159 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:04.905426Z","caller":"traceutil/trace.go:171","msg":"trace[1275031752] linearizableReadLoop","detail":"{readStateIndex:1568; appliedIndex:1566; }","duration":"190.865882ms","start":"2025-07-15T10:58:04.714526Z","end":"2025-07-15T10:58:04.905391Z","steps":["trace[1275031752] 'read index received' (duration: 179.671671ms)","trace[1275031752] 'applied index is now lower than readState.Index' (duration: 11.192798ms)"],"step_count":2} Jul 15 10:58:04.908159 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:04.906617Z","caller":"traceutil/trace.go:171","msg":"trace[1332991123] transaction","detail":"{read_only:false; number_of_response:0; response_revision:1442; }","duration":"144.181165ms","start":"2025-07-15T10:58:04.762402Z","end":"2025-07-15T10:58:04.906583Z","steps":["trace[1332991123] 'process raft request' (duration: 142.879634ms)"],"step_count":1} Jul 15 10:58:04.908909 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:04.907072Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"185.234724ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jul 15 10:58:04.908909 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:04.907234Z","caller":"traceutil/trace.go:171","msg":"trace[1742959424] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1442; }","duration":"185.431797ms","start":"2025-07-15T10:58:04.721672Z","end":"2025-07-15T10:58:04.907104Z","steps":["trace[1742959424] 'agreement among raft nodes before linearized reading' (duration: 185.235976ms)"],"step_count":1} Jul 15 10:58:04.908909 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:04.907381Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"155.793098ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/configmaps/kube-system/extension-apiserver-authentication\" limit:1 ","response":"range_response_count:1 size:3017"} Jul 15 10:58:04.908909 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:04.907451Z","caller":"traceutil/trace.go:171","msg":"trace[574352060] range","detail":"{range_begin:/registry/configmaps/kube-system/extension-apiserver-authentication; range_end:; response_count:1; response_revision:1442; }","duration":"155.86497ms","start":"2025-07-15T10:58:04.751575Z","end":"2025-07-15T10:58:04.907440Z","steps":["trace[574352060] 'agreement among raft nodes before linearized reading' (duration: 155.7458ms)"],"step_count":1} Jul 15 10:58:04.908909 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:04.907649Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"176.065697ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/minions\" limit:1 ","response":"range_response_count:0 size:5"} Jul 15 10:58:04.909359 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:04.907694Z","caller":"traceutil/trace.go:171","msg":"trace[969508541] range","detail":"{range_begin:/registry/minions; range_end:; response_count:0; response_revision:1442; }","duration":"176.172655ms","start":"2025-07-15T10:58:04.731515Z","end":"2025-07-15T10:58:04.907687Z","steps":["trace[969508541] 'agreement among raft nodes before linearized reading' (duration: 176.112755ms)"],"step_count":1} Jul 15 10:58:07.267664 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:07.265271Z","caller":"traceutil/trace.go:171","msg":"trace[1170135043] transaction","detail":"{read_only:false; number_of_response:0; response_revision:1452; }","duration":"102.919368ms","start":"2025-07-15T10:58:07.162184Z","end":"2025-07-15T10:58:07.265103Z","steps":["trace[1170135043] 'process raft request' (duration: 102.430255ms)"],"step_count":1} Jul 15 10:58:11.293255 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:11.292081Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"127.662384ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/serviceaccounts/calico-system/whisker\" limit:1 ","response":"range_response_count:1 size:426"} Jul 15 10:58:11.293255 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:11.292208Z","caller":"traceutil/trace.go:171","msg":"trace[1326282793] range","detail":"{range_begin:/registry/serviceaccounts/calico-system/whisker; range_end:; response_count:1; response_revision:1497; }","duration":"127.95755ms","start":"2025-07-15T10:58:11.164231Z","end":"2025-07-15T10:58:11.292188Z","steps":["trace[1326282793] 'range keys from in-memory index tree' (duration: 127.337945ms)"],"step_count":1} Jul 15 10:58:13.023634 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:13.020798Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"150.040103ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/calico-system/whisker-5c6987c79d-hjkf6\" limit:1 ","response":"range_response_count:1 size:6500"} Jul 15 10:58:13.023634 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:13.021299Z","caller":"traceutil/trace.go:171","msg":"trace[42625403] range","detail":"{range_begin:/registry/pods/calico-system/whisker-5c6987c79d-hjkf6; range_end:; response_count:1; response_revision:1512; }","duration":"150.665698ms","start":"2025-07-15T10:58:12.870607Z","end":"2025-07-15T10:58:13.021273Z","steps":["trace[42625403] 'range keys from in-memory index tree' (duration: 149.612615ms)"],"step_count":1} Jul 15 10:58:13.189139 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:13.188115Z","caller":"traceutil/trace.go:171","msg":"trace[2087228157] transaction","detail":"{read_only:false; response_revision:1514; number_of_response:1; }","duration":"149.154885ms","start":"2025-07-15T10:58:13.038921Z","end":"2025-07-15T10:58:13.188076Z","steps":["trace[2087228157] 'process raft request' (duration: 111.358661ms)","trace[2087228157] 'compare' (duration: 37.42489ms)"],"step_count":2} Jul 15 10:58:25.312502 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:25.281863Z","caller":"wal/wal.go:805","msg":"slow fdatasync","took":"5.236720037s","expected-duration":"1s"} Jul 15 10:58:25.434237 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:25.433529Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"131.614564ms","expected-duration":"100ms","prefix":"","request":"header: lease_revoke:","response":"size:29"} Jul 15 10:58:25.435209 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:25.434869Z","caller":"traceutil/trace.go:171","msg":"trace[316291679] linearizableReadLoop","detail":"{readStateIndex:1772; appliedIndex:1771; }","duration":"532.25583ms","start":"2025-07-15T10:58:24.902515Z","end":"2025-07-15T10:58:25.434771Z","steps":["trace[316291679] 'read index received' (duration: 398.948032ms)","trace[316291679] 'applied index is now lower than readState.Index' (duration: 133.299963ms)"],"step_count":2} Jul 15 10:58:25.436302 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:25.435853Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"533.106329ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jul 15 10:58:25.436570 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:25.436195Z","caller":"traceutil/trace.go:171","msg":"trace[1594434237] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1534; }","duration":"533.846244ms","start":"2025-07-15T10:58:24.902267Z","end":"2025-07-15T10:58:25.436113Z","steps":["trace[1594434237] 'agreement among raft nodes before linearized reading' (duration: 532.953356ms)"],"step_count":1} Jul 15 10:58:25.436870 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:25.436381Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:24.902150Z","time spent":"534.164342ms","remote":"172.24.4.207:54214","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":29,"request content":"key:\"/registry/health\" "} Jul 15 10:58:25.439698 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:25.438355Z","caller":"traceutil/trace.go:171","msg":"trace[262848426] transaction","detail":"{read_only:false; response_revision:1535; number_of_response:1; }","duration":"531.911213ms","start":"2025-07-15T10:58:24.906417Z","end":"2025-07-15T10:58:25.438328Z","steps":["trace[262848426] 'process raft request' (duration: 528.35571ms)"],"step_count":1} Jul 15 10:58:25.439698 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:25.438431Z","caller":"traceutil/trace.go:171","msg":"trace[522587716] transaction","detail":"{read_only:false; response_revision:1537; number_of_response:1; }","duration":"236.912903ms","start":"2025-07-15T10:58:25.201471Z","end":"2025-07-15T10:58:25.438384Z","steps":["trace[522587716] 'process raft request' (duration: 236.63428ms)"],"step_count":1} Jul 15 10:58:25.439698 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:25.438669Z","caller":"traceutil/trace.go:171","msg":"trace[654294759] transaction","detail":"{read_only:false; response_revision:1536; number_of_response:1; }","duration":"531.889012ms","start":"2025-07-15T10:58:24.906737Z","end":"2025-07-15T10:58:25.438626Z","steps":["trace[654294759] 'process raft request' (duration: 530.946743ms)"],"step_count":1} Jul 15 10:58:25.439698 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:25.438838Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:24.906347Z","time spent":"532.09352ms","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":517,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 10:58:25.440378 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:25.438918Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:24.906728Z","time spent":"531.999897ms","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":489,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 10:58:25.497970 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:25.497096Z","caller":"traceutil/trace.go:171","msg":"trace[1279233465] transaction","detail":"{read_only:false; response_revision:1538; number_of_response:1; }","duration":"180.706342ms","start":"2025-07-15T10:58:25.316348Z","end":"2025-07-15T10:58:25.497054Z","steps":["trace[1279233465] 'process raft request' (duration: 180.090947ms)"],"step_count":1} Jul 15 10:58:26.516839 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:26.515865Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.611878529s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context canceled"} Jul 15 10:58:26.516839 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:26.516024Z","caller":"traceutil/trace.go:171","msg":"trace[1354807634] range","detail":"{range_begin:/registry/health; range_end:; }","duration":"1.612077546s","start":"2025-07-15T10:58:24.903924Z","end":"2025-07-15T10:58:26.516001Z","steps":["trace[1354807634] 'agreement among raft nodes before linearized reading' (duration: 1.611906029s)"],"step_count":1} Jul 15 10:58:26.516839 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:26.516170Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:24.901597Z","time spent":"1.614537105s","remote":"172.24.4.207:54212","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "} Jul 15 10:58:26.952150 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:26.951545Z","caller":"wal/wal.go:805","msg":"slow fdatasync","took":"1.455211292s","expected-duration":"1s"} Jul 15 10:58:26.977534 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:26.976779Z","caller":"traceutil/trace.go:171","msg":"trace[1962972815] linearizableReadLoop","detail":"{readStateIndex:1777; appliedIndex:1775; }","duration":"1.540674713s","start":"2025-07-15T10:58:25.436032Z","end":"2025-07-15T10:58:26.976706Z","steps":["trace[1962972815] 'read index received' (duration: 60.498664ms)","trace[1962972815] 'applied index is now lower than readState.Index' (duration: 1.480173955s)"],"step_count":2} Jul 15 10:58:26.981552 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:26.978204Z","caller":"traceutil/trace.go:171","msg":"trace[1015602602] transaction","detail":"{read_only:false; response_revision:1539; number_of_response:1; }","duration":"1.596717251s","start":"2025-07-15T10:58:25.380342Z","end":"2025-07-15T10:58:26.977059Z","steps":["trace[1015602602] 'process raft request' (duration: 1.571989259s)","trace[1015602602] 'compare' (duration: 23.36203ms)"],"step_count":2} Jul 15 10:58:26.981552 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:26.978339Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.073040755s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/horizontalpodautoscalers/\" range_end:\"/registry/horizontalpodautoscalers0\" count_only:true ","response":"range_response_count:0 size:5"} Jul 15 10:58:26.981552 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:26.980645Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.075876991s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/servicecidrs/\" range_end:\"/registry/servicecidrs0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 10:58:26.982629 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:26.981411Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.532376616s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jul 15 10:58:26.982629 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:26.980908Z","caller":"traceutil/trace.go:171","msg":"trace[740321773] range","detail":"{range_begin:/registry/servicecidrs/; range_end:/registry/servicecidrs0; response_count:0; response_revision:1540; }","duration":"2.076040622s","start":"2025-07-15T10:58:24.904751Z","end":"2025-07-15T10:58:26.980791Z","steps":["trace[740321773] 'agreement among raft nodes before linearized reading' (duration: 2.075528107s)"],"step_count":1} Jul 15 10:58:26.982629 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:26.981758Z","caller":"traceutil/trace.go:171","msg":"trace[1257029923] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1540; }","duration":"1.532769643s","start":"2025-07-15T10:58:25.448782Z","end":"2025-07-15T10:58:26.981552Z","steps":["trace[1257029923] 'agreement among raft nodes before linearized reading' (duration: 1.532392967s)"],"step_count":1} Jul 15 10:58:26.982629 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:26.981872Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:24.904687Z","time spent":"2.076973985s","remote":"172.24.4.207:54476","response type":"/etcdserverpb.KV/Range","request count":0,"request size":52,"response count":1,"response size":31,"request content":"key:\"/registry/servicecidrs/\" range_end:\"/registry/servicecidrs0\" count_only:true "} Jul 15 10:58:26.984094 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:26.982239Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:25.448747Z","time spent":"1.533257563s","remote":"172.24.4.207:54212","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":29,"request content":"key:\"/registry/health\" "} Jul 15 10:58:26.984094 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:26.983219Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.079574616s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/leases/tigera-operator/operator-lock\" limit:1 ","response":"range_response_count:1 size:505"} Jul 15 10:58:26.984094 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:26.983292Z","caller":"traceutil/trace.go:171","msg":"trace[1794679790] range","detail":"{range_begin:/registry/leases/tigera-operator/operator-lock; range_end:; response_count:1; response_revision:1540; }","duration":"2.079653241s","start":"2025-07-15T10:58:24.903619Z","end":"2025-07-15T10:58:26.983272Z","steps":["trace[1794679790] 'agreement among raft nodes before linearized reading' (duration: 2.079417796s)"],"step_count":1} Jul 15 10:58:26.984094 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:26.983360Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:24.903579Z","time spent":"2.079756571s","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Range","request count":0,"request size":50,"response count":1,"response size":529,"request content":"key:\"/registry/leases/tigera-operator/operator-lock\" limit:1 "} Jul 15 10:58:26.986304 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:26.980740Z","caller":"traceutil/trace.go:171","msg":"trace[2031114316] range","detail":"{range_begin:/registry/horizontalpodautoscalers/; range_end:/registry/horizontalpodautoscalers0; response_count:0; response_revision:1540; }","duration":"2.07568199s","start":"2025-07-15T10:58:24.905003Z","end":"2025-07-15T10:58:26.980685Z","steps":["trace[2031114316] 'agreement among raft nodes before linearized reading' (duration: 2.072914773s)"],"step_count":1} Jul 15 10:58:26.986304 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:26.983839Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:24.904996Z","time spent":"2.078772926s","remote":"172.24.4.207:54388","response type":"/etcdserverpb.KV/Range","request count":0,"request size":76,"response count":0,"response size":29,"request content":"key:\"/registry/horizontalpodautoscalers/\" range_end:\"/registry/horizontalpodautoscalers0\" count_only:true "} Jul 15 10:58:26.986304 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:26.979651Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.749399789s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/clusterinformations/default\" limit:1 ","response":"range_response_count:1 size:886"} Jul 15 10:58:26.986304 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:26.984101Z","caller":"traceutil/trace.go:171","msg":"trace[1291483219] range","detail":"{range_begin:/registry/crd.projectcalico.org/clusterinformations/default; range_end:; response_count:1; response_revision:1540; }","duration":"1.753867165s","start":"2025-07-15T10:58:25.230193Z","end":"2025-07-15T10:58:26.984060Z","steps":["trace[1291483219] 'agreement among raft nodes before linearized reading' (duration: 1.748917829s)"],"step_count":1} Jul 15 10:58:26.987553 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:26.984228Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:25.230175Z","time spent":"1.753995292s","remote":"172.24.4.207:47728","response type":"/etcdserverpb.KV/Range","request count":0,"request size":63,"response count":1,"response size":910,"request content":"key:\"/registry/crd.projectcalico.org/clusterinformations/default\" limit:1 "} Jul 15 10:58:26.987553 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:26.979959Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.778058025s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/masterleases/172.24.4.207\" limit:1 ","response":"range_response_count:1 size:131"} Jul 15 10:58:26.987553 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:26.984481Z","caller":"traceutil/trace.go:171","msg":"trace[250353071] range","detail":"{range_begin:/registry/masterleases/172.24.4.207; range_end:; response_count:1; response_revision:1540; }","duration":"1.782678062s","start":"2025-07-15T10:58:25.201781Z","end":"2025-07-15T10:58:26.984459Z","steps":["trace[250353071] 'agreement among raft nodes before linearized reading' (duration: 1.777951348s)"],"step_count":1} Jul 15 10:58:26.987553 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:26.984555Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:25.201742Z","time spent":"1.782786913s","remote":"172.24.4.207:54228","response type":"/etcdserverpb.KV/Range","request count":0,"request size":39,"response count":1,"response size":155,"request content":"key:\"/registry/masterleases/172.24.4.207\" limit:1 "} Jul 15 10:58:26.987553 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:26.980143Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.779889224s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/leases/\" range_end:\"/registry/leases0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 10:58:26.988482 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:26.984860Z","caller":"traceutil/trace.go:171","msg":"trace[663071575] range","detail":"{range_begin:/registry/leases/; range_end:/registry/leases0; response_count:0; response_revision:1540; }","duration":"1.784575786s","start":"2025-07-15T10:58:25.200219Z","end":"2025-07-15T10:58:26.984794Z","steps":["trace[663071575] 'agreement among raft nodes before linearized reading' (duration: 1.779811382s)"],"step_count":1} Jul 15 10:58:26.988482 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:26.984969Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:25.200198Z","time spent":"1.784740749s","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Range","request count":0,"request size":40,"response count":6,"response size":31,"request content":"key:\"/registry/leases/\" range_end:\"/registry/leases0\" count_only:true "} Jul 15 10:58:26.988482 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:26.979904Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.074867317s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/statefulsets/\" range_end:\"/registry/statefulsets0\" count_only:true ","response":"range_response_count:0 size:5"} Jul 15 10:58:26.988482 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:26.985086Z","caller":"traceutil/trace.go:171","msg":"trace[762665967] range","detail":"{range_begin:/registry/statefulsets/; range_end:/registry/statefulsets0; response_count:0; response_revision:1540; }","duration":"2.081288498s","start":"2025-07-15T10:58:24.903776Z","end":"2025-07-15T10:58:26.985065Z","steps":["trace[762665967] 'agreement among raft nodes before linearized reading' (duration: 2.075709992s)"],"step_count":1} Jul 15 10:58:26.993694 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:26.985161Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:24.903770Z","time spent":"2.081363477s","remote":"172.24.4.207:54646","response type":"/etcdserverpb.KV/Range","request count":0,"request size":52,"response count":0,"response size":29,"request content":"key:\"/registry/statefulsets/\" range_end:\"/registry/statefulsets0\" count_only:true "} Jul 15 10:58:26.993694 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:26.980262Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.780210538s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/validatingadmissionpolicies/\" range_end:\"/registry/validatingadmissionpolicies0\" count_only:true ","response":"range_response_count:0 size:5"} Jul 15 10:58:26.993694 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:26.985347Z","caller":"traceutil/trace.go:171","msg":"trace[2068127663] range","detail":"{range_begin:/registry/validatingadmissionpolicies/; range_end:/registry/validatingadmissionpolicies0; response_count:0; response_revision:1540; }","duration":"1.785318265s","start":"2025-07-15T10:58:25.200008Z","end":"2025-07-15T10:58:26.985326Z","steps":["trace[2068127663] 'agreement among raft nodes before linearized reading' (duration: 1.780199297s)"],"step_count":1} Jul 15 10:58:26.993694 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:26.985439Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:25.200001Z","time spent":"1.785409123s","remote":"172.24.4.207:54704","response type":"/etcdserverpb.KV/Range","request count":0,"request size":82,"response count":0,"response size":29,"request content":"key:\"/registry/validatingadmissionpolicies/\" range_end:\"/registry/validatingadmissionpolicies0\" count_only:true "} Jul 15 10:58:26.994584 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:26.980613Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.780685033s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/events/calico-system/csi-node-driver-cgbrn.18526790a44a210e\" limit:1 ","response":"range_response_count:1 size:873"} Jul 15 10:58:26.994584 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:26.985692Z","caller":"traceutil/trace.go:171","msg":"trace[1960309305] range","detail":"{range_begin:/registry/events/calico-system/csi-node-driver-cgbrn.18526790a44a210e; range_end:; response_count:1; response_revision:1540; }","duration":"1.785751615s","start":"2025-07-15T10:58:25.199876Z","end":"2025-07-15T10:58:26.985627Z","steps":["trace[1960309305] 'agreement among raft nodes before linearized reading' (duration: 1.780436214s)"],"step_count":1} Jul 15 10:58:26.994584 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:26.986696Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"462.924129ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/events/kube-system/kube-apiserver-ci-4230-2-100-9439eb8d1a.novalocal.1852678f480d3898\" limit:1 ","response":"range_response_count:1 size:904"} Jul 15 10:58:26.994584 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:26.987122Z","caller":"traceutil/trace.go:171","msg":"trace[796775708] range","detail":"{range_begin:/registry/events/kube-system/kube-apiserver-ci-4230-2-100-9439eb8d1a.novalocal.1852678f480d3898; range_end:; response_count:1; response_revision:1540; }","duration":"463.055131ms","start":"2025-07-15T10:58:26.523711Z","end":"2025-07-15T10:58:26.986766Z","steps":["trace[796775708] 'agreement among raft nodes before linearized reading' (duration: 462.711897ms)"],"step_count":1} Jul 15 10:58:26.997016 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:26.987471Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:26.523692Z","time spent":"463.665708ms","remote":"172.24.4.207:54266","response type":"/etcdserverpb.KV/Range","request count":0,"request size":99,"response count":1,"response size":928,"request content":"key:\"/registry/events/kube-system/kube-apiserver-ci-4230-2-100-9439eb8d1a.novalocal.1852678f480d3898\" limit:1 "} Jul 15 10:58:26.997016 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:26.985777Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:25.199859Z","time spent":"1.785888288s","remote":"172.24.4.207:54266","response type":"/etcdserverpb.KV/Range","request count":0,"request size":73,"response count":1,"response size":897,"request content":"key:\"/registry/events/calico-system/csi-node-driver-cgbrn.18526790a44a210e\" limit:1 "} Jul 15 10:58:26.997016 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:26.979344Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:25.380323Z","time spent":"1.598361225s","remote":"172.24.4.207:54344","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":3146,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 10:58:26.997016 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:26.988504Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"480.959607ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/priorityclasses/\" range_end:\"/registry/priorityclasses0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 10:58:26.997445 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:26.990539Z","caller":"traceutil/trace.go:171","msg":"trace[1784837573] range","detail":"{range_begin:/registry/priorityclasses/; range_end:/registry/priorityclasses0; response_count:0; response_revision:1540; }","duration":"482.908094ms","start":"2025-07-15T10:58:26.507493Z","end":"2025-07-15T10:58:26.990401Z","steps":["trace[1784837573] 'agreement among raft nodes before linearized reading' (duration: 480.499108ms)"],"step_count":1} Jul 15 10:58:26.997445 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:26.990931Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:26.507478Z","time spent":"483.283487ms","remote":"172.24.4.207:54548","response type":"/etcdserverpb.KV/Range","request count":0,"request size":58,"response count":2,"response size":31,"request content":"key:\"/registry/priorityclasses/\" range_end:\"/registry/priorityclasses0\" count_only:true "} Jul 15 10:58:26.997445 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:26.990027Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"491.740236ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/clusterrolebindings/\" range_end:\"/registry/clusterrolebindings0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 10:58:26.997445 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:26.992008Z","caller":"traceutil/trace.go:171","msg":"trace[1142672388] range","detail":"{range_begin:/registry/clusterrolebindings/; range_end:/registry/clusterrolebindings0; response_count:0; response_revision:1540; }","duration":"493.729868ms","start":"2025-07-15T10:58:26.498173Z","end":"2025-07-15T10:58:26.991903Z","steps":["trace[1142672388] 'agreement among raft nodes before linearized reading' (duration: 491.082902ms)"],"step_count":1} Jul 15 10:58:26.997865 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:26.992405Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:26.498140Z","time spent":"494.016978ms","remote":"172.24.4.207:54536","response type":"/etcdserverpb.KV/Range","request count":0,"request size":66,"response count":65,"response size":31,"request content":"key:\"/registry/clusterrolebindings/\" range_end:\"/registry/clusterrolebindings0\" count_only:true "} Jul 15 10:58:26.997865 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:26.990112Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.403847078s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/minions\" limit:1 ","response":"range_response_count:0 size:5"} Jul 15 10:58:26.997865 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:26.993285Z","caller":"traceutil/trace.go:171","msg":"trace[2126516349] range","detail":"{range_begin:/registry/minions; range_end:; response_count:0; response_revision:1540; }","duration":"1.406960525s","start":"2025-07-15T10:58:25.586206Z","end":"2025-07-15T10:58:26.993166Z","steps":["trace[2126516349] 'agreement among raft nodes before linearized reading' (duration: 1.403864371s)"],"step_count":1} Jul 15 10:58:26.997865 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:26.993536Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:25.586182Z","time spent":"1.407319767s","remote":"172.24.4.207:54344","response type":"/etcdserverpb.KV/Range","request count":0,"request size":21,"response count":0,"response size":29,"request content":"key:\"/registry/minions\" limit:1 "} Jul 15 10:58:27.570949 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:27.570402Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875173346,"retry-timeout":"500ms"} Jul 15 10:58:27.697737 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:27.673550Z","caller":"traceutil/trace.go:171","msg":"trace[1157976776] linearizableReadLoop","detail":"{readStateIndex:1788; appliedIndex:1784; }","duration":"603.773277ms","start":"2025-07-15T10:58:27.069758Z","end":"2025-07-15T10:58:27.673531Z","steps":["trace[1157976776] 'read index received' (duration: 503.287153ms)","trace[1157976776] 'applied index is now lower than readState.Index' (duration: 100.484541ms)"],"step_count":2} Jul 15 10:58:27.697737 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:27.673542Z","caller":"traceutil/trace.go:171","msg":"trace[1703923871] transaction","detail":"{read_only:false; response_revision:1545; number_of_response:1; }","duration":"604.611664ms","start":"2025-07-15T10:58:27.068847Z","end":"2025-07-15T10:58:27.673458Z","steps":["trace[1703923871] 'process raft request' (duration: 504.186042ms)","trace[1703923871] 'compare' (duration: 99.530069ms)"],"step_count":2} Jul 15 10:58:27.697737 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:27.673665Z","caller":"traceutil/trace.go:171","msg":"trace[2060133056] transaction","detail":"{read_only:false; response_revision:1546; number_of_response:1; }","duration":"592.065217ms","start":"2025-07-15T10:58:27.081559Z","end":"2025-07-15T10:58:27.673624Z","steps":["trace[2060133056] 'process raft request' (duration: 591.629583ms)"],"step_count":1} Jul 15 10:58:27.697737 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:27.673777Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:27.081538Z","time spent":"592.169549ms","remote":"172.24.4.207:54266","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":843,"response count":0,"response size":40,"request content":"compare: success:> failure:<>"} Jul 15 10:58:27.704430 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:27.673865Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:27.068779Z","time spent":"604.9076ms","remote":"172.24.4.207:54266","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":858,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 10:58:27.704430 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:27.673995Z","caller":"traceutil/trace.go:171","msg":"trace[732094443] transaction","detail":"{read_only:false; number_of_response:0; response_revision:1545; }","duration":"597.334051ms","start":"2025-07-15T10:58:27.076642Z","end":"2025-07-15T10:58:27.673976Z","steps":["trace[732094443] 'process raft request' (duration: 596.389919ms)"],"step_count":1} Jul 15 10:58:27.704430 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:27.674213Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:27.076619Z","time spent":"597.52331ms","remote":"172.24.4.207:59328","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":29,"request content":"compare: success:> failure:<>"} Jul 15 10:58:27.705221 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:27.674395Z","caller":"traceutil/trace.go:171","msg":"trace[268462647] transaction","detail":"{read_only:false; response_revision:1547; number_of_response:1; }","duration":"581.419907ms","start":"2025-07-15T10:58:27.092953Z","end":"2025-07-15T10:58:27.674373Z","steps":["trace[268462647] 'process raft request' (duration: 580.439628ms)"],"step_count":1} Jul 15 10:58:27.705221 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:27.674621Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:27.092923Z","time spent":"581.527215ms","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":488,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 10:58:27.705221 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:27.674642Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"604.848581ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/masterleases/\" range_end:\"/registry/masterleases0\" ","response":"range_response_count:1 size:131"} Jul 15 10:58:27.705221 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:27.674768Z","caller":"traceutil/trace.go:171","msg":"trace[2084227140] range","detail":"{range_begin:/registry/masterleases/; range_end:/registry/masterleases0; response_count:1; response_revision:1547; }","duration":"605.027621ms","start":"2025-07-15T10:58:27.069719Z","end":"2025-07-15T10:58:27.674746Z","steps":["trace[2084227140] 'agreement among raft nodes before linearized reading' (duration: 604.71798ms)"],"step_count":1} Jul 15 10:58:27.705647 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:27.691768Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:27.069702Z","time spent":"621.899774ms","remote":"172.24.4.207:54228","response type":"/etcdserverpb.KV/Range","request count":0,"request size":50,"response count":1,"response size":155,"request content":"key:\"/registry/masterleases/\" range_end:\"/registry/masterleases0\" "} Jul 15 10:58:27.705647 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:27.699647Z","caller":"traceutil/trace.go:171","msg":"trace[938444270] transaction","detail":"{read_only:false; response_revision:1548; number_of_response:1; }","duration":"114.107485ms","start":"2025-07-15T10:58:27.585462Z","end":"2025-07-15T10:58:27.699570Z","steps":["trace[938444270] 'process raft request' (duration: 112.650156ms)"],"step_count":1} Jul 15 10:58:27.705647 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:27.700713Z","caller":"traceutil/trace.go:171","msg":"trace[204987714] transaction","detail":"{read_only:false; response_revision:1549; number_of_response:1; }","duration":"114.98767ms","start":"2025-07-15T10:58:27.585489Z","end":"2025-07-15T10:58:27.700476Z","steps":["trace[204987714] 'process raft request' (duration: 112.87496ms)"],"step_count":1} Jul 15 10:58:29.124295 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:29.113302Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875173364,"retry-timeout":"500ms"} Jul 15 10:58:29.615280 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:29.614450Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875173364,"retry-timeout":"500ms"} Jul 15 10:58:29.622238 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:29.621309Z","caller":"wal/wal.go:805","msg":"slow fdatasync","took":"1.722505365s","expected-duration":"1s"} Jul 15 10:58:29.625497 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:29.624757Z","caller":"traceutil/trace.go:171","msg":"trace[1356856058] transaction","detail":"{read_only:false; response_revision:1551; number_of_response:1; }","duration":"1.726086306s","start":"2025-07-15T10:58:27.898485Z","end":"2025-07-15T10:58:29.624571Z","steps":["trace[1356856058] 'process raft request' (duration: 1.72405143s)"],"step_count":1} Jul 15 10:58:29.627501 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:29.626569Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:27.898450Z","time spent":"1.72686866s","remote":"172.24.4.207:47648","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":1489,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 10:58:29.665304 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:29.664321Z","caller":"traceutil/trace.go:171","msg":"trace[1379413634] transaction","detail":"{read_only:false; response_revision:1552; number_of_response:1; }","duration":"1.755043336s","start":"2025-07-15T10:58:27.909219Z","end":"2025-07-15T10:58:29.664262Z","steps":["trace[1379413634] 'process raft request' (duration: 1.754355897s)"],"step_count":1} Jul 15 10:58:29.666959 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:29.665065Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:27.909157Z","time spent":"1.755304719s","remote":"172.24.4.207:47640","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":4205,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 10:58:29.667409 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:29.666324Z","caller":"traceutil/trace.go:171","msg":"trace[269808256] transaction","detail":"{read_only:false; response_revision:1553; number_of_response:1; }","duration":"107.334019ms","start":"2025-07-15T10:58:29.558962Z","end":"2025-07-15T10:58:29.666296Z","steps":["trace[269808256] 'process raft request' (duration: 105.035756ms)"],"step_count":1} Jul 15 10:58:29.669152 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:29.668651Z","caller":"traceutil/trace.go:171","msg":"trace[759724074] linearizableReadLoop","detail":"{readStateIndex:1799; appliedIndex:1792; }","duration":"1.759229292s","start":"2025-07-15T10:58:27.909386Z","end":"2025-07-15T10:58:29.668615Z","steps":["trace[759724074] 'read index received' (duration: 1.714335867s)","trace[759724074] 'applied index is now lower than readState.Index' (duration: 44.892033ms)"],"step_count":2} Jul 15 10:58:29.672911 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:29.669503Z","caller":"traceutil/trace.go:171","msg":"trace[1705535978] transaction","detail":"{read_only:false; response_revision:1554; number_of_response:1; }","duration":"103.929575ms","start":"2025-07-15T10:58:29.565552Z","end":"2025-07-15T10:58:29.669481Z","steps":["trace[1705535978] 'process raft request' (duration: 100.323419ms)"],"step_count":1} Jul 15 10:58:29.673397 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:29.669996Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.760412297s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/installations/default\" limit:1 ","response":"range_response_count:1 size:4220"} Jul 15 10:58:29.673397 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:29.671571Z","caller":"traceutil/trace.go:171","msg":"trace[1511563752] range","detail":"{range_begin:/registry/operator.tigera.io/installations/default; range_end:; response_count:1; response_revision:1557; }","duration":"1.762140877s","start":"2025-07-15T10:58:27.909352Z","end":"2025-07-15T10:58:29.671493Z","steps":["trace[1511563752] 'agreement among raft nodes before linearized reading' (duration: 1.759651241s)"],"step_count":1} Jul 15 10:58:29.673845 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:29.671743Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:27.909340Z","time spent":"1.762360874s","remote":"172.24.4.207:47640","response type":"/etcdserverpb.KV/Range","request count":0,"request size":54,"response count":1,"response size":4244,"request content":"key:\"/registry/operator.tigera.io/installations/default\" limit:1 "} Jul 15 10:58:29.673845 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:29.672006Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.759739645s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/installations/default\" limit:1 ","response":"range_response_count:1 size:4220"} Jul 15 10:58:29.673845 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:29.672124Z","caller":"traceutil/trace.go:171","msg":"trace[1496005078] range","detail":"{range_begin:/registry/operator.tigera.io/installations/default; range_end:; response_count:1; response_revision:1557; }","duration":"1.760193141s","start":"2025-07-15T10:58:27.911881Z","end":"2025-07-15T10:58:29.672074Z","steps":["trace[1496005078] 'agreement among raft nodes before linearized reading' (duration: 1.759517044s)"],"step_count":1} Jul 15 10:58:29.673845 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:29.672183Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:27.911865Z","time spent":"1.760296462s","remote":"172.24.4.207:47640","response type":"/etcdserverpb.KV/Range","request count":0,"request size":54,"response count":1,"response size":4244,"request content":"key:\"/registry/operator.tigera.io/installations/default\" limit:1 "} Jul 15 10:58:29.674603 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:29.673377Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"124.980671ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/events/calico-system/csi-node-driver-cgbrn.18526790a44a210e\" limit:1 ","response":"range_response_count:1 size:873"} Jul 15 10:58:29.675163 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:29.674390Z","caller":"traceutil/trace.go:171","msg":"trace[1215364009] range","detail":"{range_begin:/registry/events/calico-system/csi-node-driver-cgbrn.18526790a44a210e; range_end:; response_count:1; response_revision:1557; }","duration":"126.049685ms","start":"2025-07-15T10:58:29.548305Z","end":"2025-07-15T10:58:29.674355Z","steps":["trace[1215364009] 'agreement among raft nodes before linearized reading' (duration: 124.046046ms)"],"step_count":1} Jul 15 10:58:29.676110 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:29.675433Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"461.929879ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/prioritylevelconfigurations/\" range_end:\"/registry/prioritylevelconfigurations0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 10:58:29.676668 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:29.675659Z","caller":"traceutil/trace.go:171","msg":"trace[1972012475] range","detail":"{range_begin:/registry/prioritylevelconfigurations/; range_end:/registry/prioritylevelconfigurations0; response_count:0; response_revision:1557; }","duration":"462.551165ms","start":"2025-07-15T10:58:29.213089Z","end":"2025-07-15T10:58:29.675640Z","steps":["trace[1972012475] 'agreement among raft nodes before linearized reading' (duration: 462.118697ms)"],"step_count":1} Jul 15 10:58:29.676668 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:29.676173Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:29.212749Z","time spent":"463.393961ms","remote":"172.24.4.207:54630","response type":"/etcdserverpb.KV/Range","request count":0,"request size":82,"response count":8,"response size":31,"request content":"key:\"/registry/prioritylevelconfigurations/\" range_end:\"/registry/prioritylevelconfigurations0\" count_only:true "} Jul 15 10:58:29.677276 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:29.672175Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"101.330408ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jul 15 10:58:29.677660 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:29.677110Z","caller":"traceutil/trace.go:171","msg":"trace[1295343721] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1557; }","duration":"106.486245ms","start":"2025-07-15T10:58:29.570604Z","end":"2025-07-15T10:58:29.677091Z","steps":["trace[1295343721] 'agreement among raft nodes before linearized reading' (duration: 101.453906ms)"],"step_count":1} Jul 15 10:58:29.678447 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:29.675582Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.755132171s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/installations/default\" limit:1 ","response":"range_response_count:1 size:4220"} Jul 15 10:58:29.680321 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:29.677950Z","caller":"traceutil/trace.go:171","msg":"trace[1929234196] range","detail":"{range_begin:/registry/operator.tigera.io/installations/default; range_end:; response_count:1; response_revision:1557; }","duration":"1.757546307s","start":"2025-07-15T10:58:27.920379Z","end":"2025-07-15T10:58:29.677925Z","steps":["trace[1929234196] 'agreement among raft nodes before linearized reading' (duration: 1.755051252s)"],"step_count":1} Jul 15 10:58:29.680321 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:29.678678Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.75341993s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/installations/default\" limit:1 ","response":"range_response_count:1 size:4220"} Jul 15 10:58:29.680321 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:29.678948Z","caller":"traceutil/trace.go:171","msg":"trace[1327641445] range","detail":"{range_begin:/registry/operator.tigera.io/installations/default; range_end:; response_count:1; response_revision:1557; }","duration":"1.753720285s","start":"2025-07-15T10:58:27.925209Z","end":"2025-07-15T10:58:29.678930Z","steps":["trace[1327641445] 'agreement among raft nodes before linearized reading' (duration: 1.753241942s)"],"step_count":1} Jul 15 10:58:29.680321 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:29.679290Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:27.920356Z","time spent":"1.757639689s","remote":"172.24.4.207:47640","response type":"/etcdserverpb.KV/Range","request count":0,"request size":54,"response count":1,"response size":4244,"request content":"key:\"/registry/operator.tigera.io/installations/default\" limit:1 "} Jul 15 10:58:29.680699 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:29.679219Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:27.925195Z","time spent":"1.753868489s","remote":"172.24.4.207:47640","response type":"/etcdserverpb.KV/Range","request count":0,"request size":54,"response count":1,"response size":4244,"request content":"key:\"/registry/operator.tigera.io/installations/default\" limit:1 "} Jul 15 10:58:29.930703 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:29.929635Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"172.740658ms","expected-duration":"100ms","prefix":"","request":"header: lease_revoke:","response":"size:29"} Jul 15 10:58:29.931784 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:29.931205Z","caller":"traceutil/trace.go:171","msg":"trace[368978701] transaction","detail":"{read_only:false; response_revision:1558; number_of_response:1; }","duration":"243.981287ms","start":"2025-07-15T10:58:29.687113Z","end":"2025-07-15T10:58:29.931094Z","steps":["trace[368978701] 'process raft request' (duration: 242.939845ms)"],"step_count":1} Jul 15 10:58:29.936743 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:29.933292Z","caller":"traceutil/trace.go:171","msg":"trace[1416050984] transaction","detail":"{read_only:false; response_revision:1559; number_of_response:1; }","duration":"242.562666ms","start":"2025-07-15T10:58:29.690700Z","end":"2025-07-15T10:58:29.933263Z","steps":["trace[1416050984] 'process raft request' (duration: 241.083426ms)"],"step_count":1} Jul 15 10:58:29.936743 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:29.932762Z","caller":"traceutil/trace.go:171","msg":"trace[1952122137] linearizableReadLoop","detail":"{readStateIndex:1801; appliedIndex:1799; }","duration":"245.071609ms","start":"2025-07-15T10:58:29.687642Z","end":"2025-07-15T10:58:29.932714Z","steps":["trace[1952122137] 'read index received' (duration: 69.069972ms)","trace[1952122137] 'applied index is now lower than readState.Index' (duration: 176.000014ms)"],"step_count":2} Jul 15 10:58:29.936743 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:29.933671Z","caller":"traceutil/trace.go:171","msg":"trace[1144228329] transaction","detail":"{read_only:false; response_revision:1560; number_of_response:1; }","duration":"221.357046ms","start":"2025-07-15T10:58:29.712293Z","end":"2025-07-15T10:58:29.933650Z","steps":["trace[1144228329] 'process raft request' (duration: 220.089015ms)"],"step_count":1} Jul 15 10:58:29.936743 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:29.934115Z","caller":"traceutil/trace.go:171","msg":"trace[895391762] transaction","detail":"{read_only:false; response_revision:1561; number_of_response:1; }","duration":"221.572974ms","start":"2025-07-15T10:58:29.712524Z","end":"2025-07-15T10:58:29.934097Z","steps":["trace[895391762] 'process raft request' (duration: 220.024726ms)"],"step_count":1} Jul 15 10:58:29.936743 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:29.934252Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"246.590101ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jul 15 10:58:29.938842 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:29.934300Z","caller":"traceutil/trace.go:171","msg":"trace[598107888] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1561; }","duration":"246.677363ms","start":"2025-07-15T10:58:29.687608Z","end":"2025-07-15T10:58:29.934286Z","steps":["trace[598107888] 'agreement among raft nodes before linearized reading' (duration: 246.575906ms)"],"step_count":1} Jul 15 10:58:29.938842 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:29.934697Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"197.284001ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/clusterroles/tigera-csr-creator\" limit:1 ","response":"range_response_count:0 size:5"} Jul 15 10:58:29.938842 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:29.936121Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"186.330311ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/installations/default\" limit:1 ","response":"range_response_count:1 size:4220"} Jul 15 10:58:29.938842 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:29.937342Z","caller":"traceutil/trace.go:171","msg":"trace[1525334033] range","detail":"{range_begin:/registry/operator.tigera.io/installations/default; range_end:; response_count:1; response_revision:1561; }","duration":"187.66168ms","start":"2025-07-15T10:58:29.749643Z","end":"2025-07-15T10:58:29.937305Z","steps":["trace[1525334033] 'agreement among raft nodes before linearized reading' (duration: 184.949094ms)"],"step_count":1} Jul 15 10:58:29.938842 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:29.937203Z","caller":"traceutil/trace.go:171","msg":"trace[1376789144] range","detail":"{range_begin:/registry/clusterroles/tigera-csr-creator; range_end:; response_count:0; response_revision:1561; }","duration":"197.426343ms","start":"2025-07-15T10:58:29.737350Z","end":"2025-07-15T10:58:29.934776Z","steps":["trace[1376789144] 'agreement among raft nodes before linearized reading' (duration: 197.235822ms)"],"step_count":1} Jul 15 10:58:29.939861 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:29.938840Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"189.67714ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/configmaps/calico-system/goldmane-ca-bundle\" limit:1 ","response":"range_response_count:1 size:1959"} Jul 15 10:58:29.940420 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:29.940066Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"191.705102ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/installations/default\" limit:1 ","response":"range_response_count:1 size:4220"} Jul 15 10:58:29.942235 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:29.940473Z","caller":"traceutil/trace.go:171","msg":"trace[679364102] range","detail":"{range_begin:/registry/operator.tigera.io/installations/default; range_end:; response_count:1; response_revision:1561; }","duration":"192.002803ms","start":"2025-07-15T10:58:29.748342Z","end":"2025-07-15T10:58:29.940345Z","steps":["trace[679364102] 'agreement among raft nodes before linearized reading' (duration: 191.557891ms)"],"step_count":1} Jul 15 10:58:29.942698 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:29.941230Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"202.205064ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/secrets/tigera-operator/tigera-ca-private\" limit:1 ","response":"range_response_count:1 size:3373"} Jul 15 10:58:29.942698 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:29.941335Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"192.761673ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/installations/default\" limit:1 ","response":"range_response_count:1 size:4220"} Jul 15 10:58:29.942698 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:29.941348Z","caller":"traceutil/trace.go:171","msg":"trace[1796838298] range","detail":"{range_begin:/registry/secrets/tigera-operator/tigera-ca-private; range_end:; response_count:1; response_revision:1561; }","duration":"202.364889ms","start":"2025-07-15T10:58:29.738963Z","end":"2025-07-15T10:58:29.941327Z","steps":["trace[1796838298] 'agreement among raft nodes before linearized reading' (duration: 201.961214ms)"],"step_count":1} Jul 15 10:58:29.942698 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:29.941407Z","caller":"traceutil/trace.go:171","msg":"trace[184844388] range","detail":"{range_begin:/registry/operator.tigera.io/installations/default; range_end:; response_count:1; response_revision:1561; }","duration":"192.952326ms","start":"2025-07-15T10:58:29.748434Z","end":"2025-07-15T10:58:29.941387Z","steps":["trace[184844388] 'agreement among raft nodes before linearized reading' (duration: 192.653324ms)"],"step_count":1} Jul 15 10:58:29.943573 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:29.940094Z","caller":"traceutil/trace.go:171","msg":"trace[746574485] range","detail":"{range_begin:/registry/configmaps/calico-system/goldmane-ca-bundle; range_end:; response_count:1; response_revision:1561; }","duration":"190.981067ms","start":"2025-07-15T10:58:29.749086Z","end":"2025-07-15T10:58:29.940067Z","steps":["trace[746574485] 'agreement among raft nodes before linearized reading' (duration: 189.529748ms)"],"step_count":1} Jul 15 10:58:29.943573 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:29.939618Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"185.664322ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/installations/default\" limit:1 ","response":"range_response_count:1 size:4220"} Jul 15 10:58:29.943573 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:29.941847Z","caller":"traceutil/trace.go:171","msg":"trace[801927892] range","detail":"{range_begin:/registry/operator.tigera.io/installations/default; range_end:; response_count:1; response_revision:1561; }","duration":"187.880333ms","start":"2025-07-15T10:58:29.753888Z","end":"2025-07-15T10:58:29.941769Z","steps":["trace[801927892] 'agreement among raft nodes before linearized reading' (duration: 185.56001ms)"],"step_count":1} Jul 15 10:58:29.943573 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:29.939411Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"182.511013ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/configmaps/calico-system/whisker-ca-bundle\" limit:1 ","response":"range_response_count:1 size:1956"} Jul 15 10:58:29.944232 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:29.942045Z","caller":"traceutil/trace.go:171","msg":"trace[706039168] range","detail":"{range_begin:/registry/configmaps/calico-system/whisker-ca-bundle; range_end:; response_count:1; response_revision:1561; }","duration":"185.225654ms","start":"2025-07-15T10:58:29.756793Z","end":"2025-07-15T10:58:29.942018Z","steps":["trace[706039168] 'agreement among raft nodes before linearized reading' (duration: 181.562012ms)"],"step_count":1} Jul 15 10:58:43.286761 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.277102Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"194.683988ms","expected-duration":"100ms","prefix":"","request":"header: lease_revoke:","response":"size:29"} Jul 15 10:58:43.286761 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:43.278853Z","caller":"traceutil/trace.go:171","msg":"trace[1050491306] transaction","detail":"{read_only:false; response_revision:1572; number_of_response:1; }","duration":"568.302623ms","start":"2025-07-15T10:58:42.710381Z","end":"2025-07-15T10:58:43.278684Z","steps":["trace[1050491306] 'process raft request' (duration: 567.641543ms)"],"step_count":1} Jul 15 10:58:43.286761 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:43.279201Z","caller":"traceutil/trace.go:171","msg":"trace[950172093] transaction","detail":"{read_only:false; response_revision:1580; number_of_response:1; }","duration":"425.184542ms","start":"2025-07-15T10:58:42.853992Z","end":"2025-07-15T10:58:43.279176Z","steps":["trace[950172093] 'process raft request' (duration: 425.121424ms)"],"step_count":1} Jul 15 10:58:43.286761 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.279231Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:42.710358Z","time spent":"568.63613ms","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":490,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 10:58:43.296259 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.279368Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:42.853920Z","time spent":"425.343796ms","remote":"172.24.4.207:47638","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":1186,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 10:58:43.296259 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:43.279391Z","caller":"traceutil/trace.go:171","msg":"trace[798981838] linearizableReadLoop","detail":"{readStateIndex:1813; appliedIndex:1812; }","duration":"580.267932ms","start":"2025-07-15T10:58:42.699106Z","end":"2025-07-15T10:58:43.279374Z","steps":["trace[798981838] 'read index received' (duration: 384.01689ms)","trace[798981838] 'applied index is now lower than readState.Index' (duration: 196.249369ms)"],"step_count":2} Jul 15 10:58:43.296259 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:43.279520Z","caller":"traceutil/trace.go:171","msg":"trace[1789440032] transaction","detail":"{read_only:false; response_revision:1573; number_of_response:1; }","duration":"568.97825ms","start":"2025-07-15T10:58:42.710525Z","end":"2025-07-15T10:58:43.279503Z","steps":["trace[1789440032] 'process raft request' (duration: 567.632265ms)"],"step_count":1} Jul 15 10:58:43.296577 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.279631Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:42.710507Z","time spent":"569.04863ms","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":533,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 10:58:43.296577 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:43.279734Z","caller":"traceutil/trace.go:171","msg":"trace[579960936] transaction","detail":"{read_only:false; response_revision:1574; number_of_response:1; }","duration":"562.326331ms","start":"2025-07-15T10:58:42.717380Z","end":"2025-07-15T10:58:43.279720Z","steps":["trace[579960936] 'process raft request' (duration: 560.857619ms)"],"step_count":1} Jul 15 10:58:43.296577 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.279887Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:42.717361Z","time spent":"562.435932ms","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":699,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 10:58:43.297038 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:43.280023Z","caller":"traceutil/trace.go:171","msg":"trace[1714426261] transaction","detail":"{read_only:false; response_revision:1571; number_of_response:1; }","duration":"570.029522ms","start":"2025-07-15T10:58:42.709961Z","end":"2025-07-15T10:58:43.279990Z","steps":["trace[1714426261] 'process raft request' (duration: 567.654547ms)"],"step_count":1} Jul 15 10:58:43.297038 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:43.280045Z","caller":"traceutil/trace.go:171","msg":"trace[1007155080] transaction","detail":"{read_only:false; response_revision:1575; number_of_response:1; }","duration":"535.387388ms","start":"2025-07-15T10:58:42.744643Z","end":"2025-07-15T10:58:43.280030Z","steps":["trace[1007155080] 'process raft request' (duration: 533.80156ms)"],"step_count":1} Jul 15 10:58:43.297038 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.280134Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:42.709940Z","time spent":"570.128504ms","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":517,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 10:58:43.297379 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.280145Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:42.744614Z","time spent":"535.467596ms","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":625,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 10:58:43.297379 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.280283Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"581.147216ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/ranges/servicenodeports\" limit:1 ","response":"range_response_count:1 size:118"} Jul 15 10:58:43.297379 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:43.280339Z","caller":"traceutil/trace.go:171","msg":"trace[998892830] range","detail":"{range_begin:/registry/ranges/servicenodeports; range_end:; response_count:1; response_revision:1580; }","duration":"581.249955ms","start":"2025-07-15T10:58:42.699064Z","end":"2025-07-15T10:58:43.280314Z","steps":["trace[998892830] 'agreement among raft nodes before linearized reading' (duration: 581.124263ms)"],"step_count":1} Jul 15 10:58:43.297379 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:43.280331Z","caller":"traceutil/trace.go:171","msg":"trace[240413809] transaction","detail":"{read_only:false; response_revision:1576; number_of_response:1; }","duration":"438.444911ms","start":"2025-07-15T10:58:42.841824Z","end":"2025-07-15T10:58:43.280269Z","steps":["trace[240413809] 'process raft request' (duration: 436.757957ms)"],"step_count":1} Jul 15 10:58:43.298002 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.280382Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:42.699041Z","time spent":"581.326656ms","remote":"172.24.4.207:54262","response type":"/etcdserverpb.KV/Range","request count":0,"request size":37,"response count":1,"response size":142,"request content":"key:\"/registry/ranges/servicenodeports\" limit:1 "} Jul 15 10:58:43.298002 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.280430Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:42.841697Z","time spent":"438.676098ms","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":489,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 10:58:43.298002 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.280584Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"581.386028ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/mutatingwebhookconfigurations/\" range_end:\"/registry/mutatingwebhookconfigurations0\" count_only:true ","response":"range_response_count:0 size:5"} Jul 15 10:58:43.298002 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:43.280629Z","caller":"traceutil/trace.go:171","msg":"trace[366363344] range","detail":"{range_begin:/registry/mutatingwebhookconfigurations/; range_end:/registry/mutatingwebhookconfigurations0; response_count:0; response_revision:1580; }","duration":"581.460805ms","start":"2025-07-15T10:58:42.699154Z","end":"2025-07-15T10:58:43.280615Z","steps":["trace[366363344] 'agreement among raft nodes before linearized reading' (duration: 581.398871ms)"],"step_count":1} Jul 15 10:58:43.299346 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.280669Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:42.699137Z","time spent":"581.516778ms","remote":"172.24.4.207:54690","response type":"/etcdserverpb.KV/Range","request count":0,"request size":86,"response count":0,"response size":29,"request content":"key:\"/registry/mutatingwebhookconfigurations/\" range_end:\"/registry/mutatingwebhookconfigurations0\" count_only:true "} Jul 15 10:58:43.299346 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:43.280717Z","caller":"traceutil/trace.go:171","msg":"trace[1871346684] transaction","detail":"{read_only:false; response_revision:1577; number_of_response:1; }","duration":"438.915741ms","start":"2025-07-15T10:58:42.841786Z","end":"2025-07-15T10:58:43.280702Z","steps":["trace[1871346684] 'process raft request' (duration: 436.894319ms)"],"step_count":1} Jul 15 10:58:43.299346 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.280796Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:42.841739Z","time spent":"439.013291ms","remote":"172.24.4.207:47638","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":1162,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 10:58:43.299346 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:43.280941Z","caller":"traceutil/trace.go:171","msg":"trace[1317796209] transaction","detail":"{read_only:false; response_revision:1578; number_of_response:1; }","duration":"435.969683ms","start":"2025-07-15T10:58:42.844958Z","end":"2025-07-15T10:58:43.280927Z","steps":["trace[1317796209] 'process raft request' (duration: 433.88281ms)"],"step_count":1} Jul 15 10:58:43.299786 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.281105Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:42.844907Z","time spent":"436.155445ms","remote":"172.24.4.207:47638","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":1183,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 10:58:43.299786 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:43.281211Z","caller":"traceutil/trace.go:171","msg":"trace[1180200541] transaction","detail":"{read_only:false; response_revision:1579; number_of_response:1; }","duration":"430.618774ms","start":"2025-07-15T10:58:42.850550Z","end":"2025-07-15T10:58:43.281169Z","steps":["trace[1180200541] 'process raft request' (duration: 428.398024ms)"],"step_count":1} Jul 15 10:58:43.299786 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.281306Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:42.850529Z","time spent":"430.721934ms","remote":"172.24.4.207:47638","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":1170,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 10:58:43.299786 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.283463Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"573.556924ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/clusterroles/\" range_end:\"/registry/clusterroles0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 10:58:43.300360 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:43.283562Z","caller":"traceutil/trace.go:171","msg":"trace[430789758] range","detail":"{range_begin:/registry/clusterroles/; range_end:/registry/clusterroles0; response_count:0; response_revision:1580; }","duration":"573.739921ms","start":"2025-07-15T10:58:42.709792Z","end":"2025-07-15T10:58:43.283532Z","steps":["trace[430789758] 'agreement among raft nodes before linearized reading' (duration: 573.48976ms)"],"step_count":1} Jul 15 10:58:43.300360 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.283639Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:42.709756Z","time spent":"573.843583ms","remote":"172.24.4.207:54526","response type":"/etcdserverpb.KV/Range","request count":0,"request size":52,"response count":79,"response size":31,"request content":"key:\"/registry/clusterroles/\" range_end:\"/registry/clusterroles0\" count_only:true "} Jul 15 10:58:43.300360 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.283755Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"461.340218ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/clusterrolebindings/calico-typha:csr-creator\" limit:1 ","response":"range_response_count:0 size:5"} Jul 15 10:58:43.300360 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:43.283843Z","caller":"traceutil/trace.go:171","msg":"trace[491188886] range","detail":"{range_begin:/registry/clusterrolebindings/calico-typha:csr-creator; range_end:; response_count:0; response_revision:1580; }","duration":"461.544567ms","start":"2025-07-15T10:58:42.822246Z","end":"2025-07-15T10:58:43.283790Z","steps":["trace[491188886] 'agreement among raft nodes before linearized reading' (duration: 461.479487ms)"],"step_count":1} Jul 15 10:58:43.300718 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.283933Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:42.822219Z","time spent":"461.656222ms","remote":"172.24.4.207:54536","response type":"/etcdserverpb.KV/Range","request count":0,"request size":58,"response count":0,"response size":29,"request content":"key:\"/registry/clusterrolebindings/calico-typha:csr-creator\" limit:1 "} Jul 15 10:58:43.300718 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.284113Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"480.436122ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jul 15 10:58:43.300718 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:43.284163Z","caller":"traceutil/trace.go:171","msg":"trace[1161254458] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1580; }","duration":"480.569409ms","start":"2025-07-15T10:58:42.803581Z","end":"2025-07-15T10:58:43.284150Z","steps":["trace[1161254458] 'agreement among raft nodes before linearized reading' (duration: 480.506563ms)"],"step_count":1} Jul 15 10:58:43.300718 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.284199Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:42.803556Z","time spent":"480.631232ms","remote":"172.24.4.207:54214","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":29,"request content":"key:\"/registry/health\" "} Jul 15 10:58:43.300718 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.284356Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"490.407279ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jul 15 10:58:43.301244 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:43.284440Z","caller":"traceutil/trace.go:171","msg":"trace[944303114] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1580; }","duration":"490.489032ms","start":"2025-07-15T10:58:42.793938Z","end":"2025-07-15T10:58:43.284427Z","steps":["trace[944303114] 'agreement among raft nodes before linearized reading' (duration: 490.394708ms)"],"step_count":1} Jul 15 10:58:43.301244 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.284512Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:42.793779Z","time spent":"490.706762ms","remote":"172.24.4.207:54212","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":29,"request content":"key:\"/registry/health\" "} Jul 15 10:58:43.301244 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.283957Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"452.721136ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/clusterrolebindings/tigera-extension-apiserver-secrets-access\" limit:1 ","response":"range_response_count:0 size:5"} Jul 15 10:58:43.301244 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:43.285748Z","caller":"traceutil/trace.go:171","msg":"trace[603052428] range","detail":"{range_begin:/registry/clusterrolebindings/tigera-extension-apiserver-secrets-access; range_end:; response_count:0; response_revision:1580; }","duration":"457.832203ms","start":"2025-07-15T10:58:42.827890Z","end":"2025-07-15T10:58:43.285722Z","steps":["trace[603052428] 'agreement among raft nodes before linearized reading' (duration: 452.869711ms)"],"step_count":1} Jul 15 10:58:43.301598 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.288396Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:42.827865Z","time spent":"460.459824ms","remote":"172.24.4.207:54536","response type":"/etcdserverpb.KV/Range","request count":0,"request size":75,"response count":0,"response size":29,"request content":"key:\"/registry/clusterrolebindings/tigera-extension-apiserver-secrets-access\" limit:1 "} Jul 15 10:58:43.301598 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.284870Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"512.381566ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/clusterinformations/default\" limit:1 ","response":"range_response_count:1 size:886"} Jul 15 10:58:43.301598 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:43.288548Z","caller":"traceutil/trace.go:171","msg":"trace[1732698806] range","detail":"{range_begin:/registry/crd.projectcalico.org/clusterinformations/default; range_end:; response_count:1; response_revision:1580; }","duration":"516.127552ms","start":"2025-07-15T10:58:42.772394Z","end":"2025-07-15T10:58:43.288522Z","steps":["trace[1732698806] 'agreement among raft nodes before linearized reading' (duration: 512.243832ms)"],"step_count":1} Jul 15 10:58:43.301598 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.288875Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:42.772370Z","time spent":"516.409193ms","remote":"172.24.4.207:47728","response type":"/etcdserverpb.KV/Range","request count":0,"request size":63,"response count":1,"response size":910,"request content":"key:\"/registry/crd.projectcalico.org/clusterinformations/default\" limit:1 "} Jul 15 10:58:43.301598 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.286366Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"580.488661ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/controllerrevisions/\" range_end:\"/registry/controllerrevisions0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 10:58:43.302159 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:43.289061Z","caller":"traceutil/trace.go:171","msg":"trace[1731725115] range","detail":"{range_begin:/registry/controllerrevisions/; range_end:/registry/controllerrevisions0; response_count:0; response_revision:1580; }","duration":"583.250999ms","start":"2025-07-15T10:58:42.705786Z","end":"2025-07-15T10:58:43.289037Z","steps":["trace[1731725115] 'agreement among raft nodes before linearized reading' (duration: 580.440842ms)"],"step_count":1} Jul 15 10:58:43.302159 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.289102Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"588.747376ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/goldmanes/\" range_end:\"/registry/operator.tigera.io/goldmanes0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 10:58:43.302159 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:43.289172Z","caller":"traceutil/trace.go:171","msg":"trace[1361928647] range","detail":"{range_begin:/registry/operator.tigera.io/goldmanes/; range_end:/registry/operator.tigera.io/goldmanes0; response_count:0; response_revision:1580; }","duration":"588.860585ms","start":"2025-07-15T10:58:42.700295Z","end":"2025-07-15T10:58:43.289156Z","steps":["trace[1361928647] 'agreement among raft nodes before linearized reading' (duration: 588.742277ms)"],"step_count":1} Jul 15 10:58:43.302159 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.289217Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:42.700284Z","time spent":"588.916798ms","remote":"172.24.4.207:47714","response type":"/etcdserverpb.KV/Range","request count":0,"request size":84,"response count":1,"response size":31,"request content":"key:\"/registry/operator.tigera.io/goldmanes/\" range_end:\"/registry/operator.tigera.io/goldmanes0\" count_only:true "} Jul 15 10:58:43.302514 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.289385Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"589.934489ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/masterleases/172.24.4.207\" limit:1 ","response":"range_response_count:0 size:5"} Jul 15 10:58:43.302514 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.289336Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"579.872213ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/volumeattachments/\" range_end:\"/registry/volumeattachments0\" count_only:true ","response":"range_response_count:0 size:5"} Jul 15 10:58:43.302514 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:43.289455Z","caller":"traceutil/trace.go:171","msg":"trace[1019775722] range","detail":"{range_begin:/registry/masterleases/172.24.4.207; range_end:; response_count:0; response_revision:1580; }","duration":"590.00599ms","start":"2025-07-15T10:58:42.699405Z","end":"2025-07-15T10:58:43.289411Z","steps":["trace[1019775722] 'agreement among raft nodes before linearized reading' (duration: 589.935981ms)"],"step_count":1} Jul 15 10:58:43.302514 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:43.289477Z","caller":"traceutil/trace.go:171","msg":"trace[821565528] range","detail":"{range_begin:/registry/volumeattachments/; range_end:/registry/volumeattachments0; response_count:0; response_revision:1580; }","duration":"580.074907ms","start":"2025-07-15T10:58:42.709385Z","end":"2025-07-15T10:58:43.289460Z","steps":["trace[821565528] 'agreement among raft nodes before linearized reading' (duration: 579.871992ms)"],"step_count":1} Jul 15 10:58:43.302514 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.289558Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:42.699326Z","time spent":"590.215446ms","remote":"172.24.4.207:54228","response type":"/etcdserverpb.KV/Range","request count":0,"request size":39,"response count":0,"response size":29,"request content":"key:\"/registry/masterleases/172.24.4.207\" limit:1 "} Jul 15 10:58:43.303005 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.285017Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"571.228315ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/events/calico-system/csi-node-driver-cgbrn.18526790a44a210e\" limit:1 ","response":"range_response_count:1 size:873"} Jul 15 10:58:43.303005 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:43.289683Z","caller":"traceutil/trace.go:171","msg":"trace[609502414] range","detail":"{range_begin:/registry/events/calico-system/csi-node-driver-cgbrn.18526790a44a210e; range_end:; response_count:1; response_revision:1580; }","duration":"575.914747ms","start":"2025-07-15T10:58:42.713754Z","end":"2025-07-15T10:58:43.289669Z","steps":["trace[609502414] 'agreement among raft nodes before linearized reading' (duration: 571.151183ms)"],"step_count":1} Jul 15 10:58:43.303005 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.289769Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:42.713741Z","time spent":"575.995134ms","remote":"172.24.4.207:54266","response type":"/etcdserverpb.KV/Range","request count":0,"request size":73,"response count":1,"response size":897,"request content":"key:\"/registry/events/calico-system/csi-node-driver-cgbrn.18526790a44a210e\" limit:1 "} Jul 15 10:58:43.303005 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.289222Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:42.705772Z","time spent":"583.379167ms","remote":"172.24.4.207:54662","response type":"/etcdserverpb.KV/Range","request count":0,"request size":66,"response count":3,"response size":31,"request content":"key:\"/registry/controllerrevisions/\" range_end:\"/registry/controllerrevisions0\" count_only:true "} Jul 15 10:58:43.303457 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.289771Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:42.709371Z","time spent":"580.193416ms","remote":"172.24.4.207:54572","response type":"/etcdserverpb.KV/Range","request count":0,"request size":62,"response count":0,"response size":29,"request content":"key:\"/registry/volumeattachments/\" range_end:\"/registry/volumeattachments0\" count_only:true "} Jul 15 10:58:43.303457 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.290052Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"580.6081ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/blockaffinities/\" range_end:\"/registry/crd.projectcalico.org/blockaffinities0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 10:58:43.303457 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:43.292648Z","caller":"traceutil/trace.go:171","msg":"trace[1633394032] range","detail":"{range_begin:/registry/crd.projectcalico.org/blockaffinities/; range_end:/registry/crd.projectcalico.org/blockaffinities0; response_count:0; response_revision:1580; }","duration":"582.724829ms","start":"2025-07-15T10:58:42.709316Z","end":"2025-07-15T10:58:43.292041Z","steps":["trace[1633394032] 'agreement among raft nodes before linearized reading' (duration: 580.610114ms)"],"step_count":1} Jul 15 10:58:43.303457 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.292776Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:42.709300Z","time spent":"583.41908ms","remote":"172.24.4.207:59360","response type":"/etcdserverpb.KV/Range","request count":0,"request size":102,"response count":1,"response size":31,"request content":"key:\"/registry/crd.projectcalico.org/blockaffinities/\" range_end:\"/registry/crd.projectcalico.org/blockaffinities0\" count_only:true "} Jul 15 10:58:43.618070 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.615472Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"161.956908ms","expected-duration":"100ms","prefix":"","request":"header: lease_grant:","response":"size:41"} Jul 15 10:58:43.619128 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.615980Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:43.313689Z","time spent":"302.223795ms","remote":"172.24.4.207:54228","response type":"/etcdserverpb.Lease/LeaseGrant","request count":-1,"request size":-1,"response count":-1,"response size":-1,"request content":""} Jul 15 10:58:43.619128 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:43.616573Z","caller":"traceutil/trace.go:171","msg":"trace[2127465406] transaction","detail":"{read_only:false; response_revision:1581; number_of_response:1; }","duration":"302.048992ms","start":"2025-07-15T10:58:43.314494Z","end":"2025-07-15T10:58:43.616543Z","steps":["trace[2127465406] 'process raft request' (duration: 301.134995ms)"],"step_count":1} Jul 15 10:58:43.619128 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.616861Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:58:43.314434Z","time spent":"302.190494ms","remote":"172.24.4.207:54266","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":858,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 10:58:43.619128 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:43.616866Z","caller":"traceutil/trace.go:171","msg":"trace[630204703] linearizableReadLoop","detail":"{readStateIndex:1825; appliedIndex:1823; }","duration":"298.598203ms","start":"2025-07-15T10:58:43.318242Z","end":"2025-07-15T10:58:43.616840Z","steps":["trace[630204703] 'read index received' (duration: 135.512171ms)","trace[630204703] 'applied index is now lower than readState.Index' (duration: 163.004901ms)"],"step_count":2} Jul 15 10:58:43.620278 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:43.617030Z","caller":"traceutil/trace.go:171","msg":"trace[1625397775] transaction","detail":"{read_only:false; response_revision:1583; number_of_response:1; }","duration":"255.796265ms","start":"2025-07-15T10:58:43.361216Z","end":"2025-07-15T10:58:43.617012Z","steps":["trace[1625397775] 'process raft request' (duration: 255.481544ms)"],"step_count":1} Jul 15 10:58:43.620278 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:43.617015Z","caller":"traceutil/trace.go:171","msg":"trace[1998803682] transaction","detail":"{read_only:false; number_of_response:0; response_revision:1581; }","duration":"270.20233ms","start":"2025-07-15T10:58:43.346796Z","end":"2025-07-15T10:58:43.616999Z","steps":["trace[1998803682] 'process raft request' (duration: 269.134509ms)"],"step_count":1} Jul 15 10:58:43.620278 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:43.617537Z","caller":"traceutil/trace.go:171","msg":"trace[2093539790] transaction","detail":"{read_only:false; response_revision:1582; number_of_response:1; }","duration":"258.446758ms","start":"2025-07-15T10:58:43.359073Z","end":"2025-07-15T10:58:43.617520Z","steps":["trace[2093539790] 'process raft request' (duration: 257.405335ms)"],"step_count":1} Jul 15 10:58:43.620278 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.617586Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"299.317841ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/services/specs\" limit:1 ","response":"range_response_count:0 size:5"} Jul 15 10:58:43.620278 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:43.617664Z","caller":"traceutil/trace.go:171","msg":"trace[1454481923] range","detail":"{range_begin:/registry/services/specs; range_end:; response_count:0; response_revision:1583; }","duration":"299.456015ms","start":"2025-07-15T10:58:43.318185Z","end":"2025-07-15T10:58:43.617641Z","steps":["trace[1454481923] 'agreement among raft nodes before linearized reading' (duration: 299.05769ms)"],"step_count":1} Jul 15 10:58:43.622869 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.618352Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"261.140601ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/tigerastatuses/goldmane\" limit:1 ","response":"range_response_count:1 size:1185"} Jul 15 10:58:43.622869 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:43.618446Z","caller":"traceutil/trace.go:171","msg":"trace[1722848826] range","detail":"{range_begin:/registry/operator.tigera.io/tigerastatuses/goldmane; range_end:; response_count:1; response_revision:1583; }","duration":"261.298152ms","start":"2025-07-15T10:58:43.357126Z","end":"2025-07-15T10:58:43.618424Z","steps":["trace[1722848826] 'agreement among raft nodes before linearized reading' (duration: 260.955039ms)"],"step_count":1} Jul 15 10:58:43.622869 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.619534Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"253.485129ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/installations/default\" limit:1 ","response":"range_response_count:1 size:4220"} Jul 15 10:58:43.622869 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:43.619613Z","caller":"traceutil/trace.go:171","msg":"trace[1654770550] range","detail":"{range_begin:/registry/operator.tigera.io/installations/default; range_end:; response_count:1; response_revision:1583; }","duration":"253.600492ms","start":"2025-07-15T10:58:43.365996Z","end":"2025-07-15T10:58:43.619596Z","steps":["trace[1654770550] 'agreement among raft nodes before linearized reading' (duration: 253.33414ms)"],"step_count":1} Jul 15 10:58:43.622869 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.620398Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"265.974996ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/clusterrolebindings/calico-kube-controllers:csr-creator\" limit:1 ","response":"range_response_count:0 size:5"} Jul 15 10:58:43.624438 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:43.620529Z","caller":"traceutil/trace.go:171","msg":"trace[895732227] range","detail":"{range_begin:/registry/clusterrolebindings/calico-kube-controllers:csr-creator; range_end:; response_count:0; response_revision:1583; }","duration":"266.089107ms","start":"2025-07-15T10:58:43.354373Z","end":"2025-07-15T10:58:43.620462Z","steps":["trace[895732227] 'agreement among raft nodes before linearized reading' (duration: 265.918201ms)"],"step_count":1} Jul 15 10:58:43.624438 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.620924Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"266.062367ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/roles/calico-apiserver/tigera-extension-apiserver-secrets-access\" limit:1 ","response":"range_response_count:0 size:5"} Jul 15 10:58:43.624438 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:43.622412Z","caller":"traceutil/trace.go:171","msg":"trace[25095278] range","detail":"{range_begin:/registry/roles/calico-apiserver/tigera-extension-apiserver-secrets-access; range_end:; response_count:0; response_revision:1583; }","duration":"270.665116ms","start":"2025-07-15T10:58:43.351685Z","end":"2025-07-15T10:58:43.622350Z","steps":["trace[25095278] 'agreement among raft nodes before linearized reading' (duration: 266.085801ms)"],"step_count":1} Jul 15 10:58:43.893411 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.890000Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"135.728349ms","expected-duration":"100ms","prefix":"","request":"header: txn: success:> failure: >>","response":"size:16"} Jul 15 10:58:43.893411 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:43.890292Z","caller":"traceutil/trace.go:171","msg":"trace[1447320374] transaction","detail":"{read_only:false; response_revision:1584; number_of_response:1; }","duration":"268.622396ms","start":"2025-07-15T10:58:43.621573Z","end":"2025-07-15T10:58:43.890196Z","steps":["trace[1447320374] 'process raft request' (duration: 132.453443ms)","trace[1447320374] 'compare' (duration: 135.462278ms)"],"step_count":2} Jul 15 10:58:43.893411 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:43.890498Z","caller":"traceutil/trace.go:171","msg":"trace[598575059] transaction","detail":"{read_only:false; response_revision:1585; number_of_response:1; }","duration":"239.998123ms","start":"2025-07-15T10:58:43.650453Z","end":"2025-07-15T10:58:43.890452Z","steps":["trace[598575059] 'process raft request' (duration: 239.688201ms)"],"step_count":1} Jul 15 10:58:43.893411 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:43.890634Z","caller":"traceutil/trace.go:171","msg":"trace[1931670585] linearizableReadLoop","detail":"{readStateIndex:1829; appliedIndex:1828; }","duration":"266.653461ms","start":"2025-07-15T10:58:43.623962Z","end":"2025-07-15T10:58:43.890615Z","steps":["trace[1931670585] 'read index received' (duration: 130.092876ms)","trace[1931670585] 'applied index is now lower than readState.Index' (duration: 136.558321ms)"],"step_count":2} Jul 15 10:58:43.894340 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.891225Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"267.240766ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/tiers/default\" limit:1 ","response":"range_response_count:1 size:702"} Jul 15 10:58:43.894340 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:43.891280Z","caller":"traceutil/trace.go:171","msg":"trace[139387149] range","detail":"{range_begin:/registry/crd.projectcalico.org/tiers/default; range_end:; response_count:1; response_revision:1585; }","duration":"267.355437ms","start":"2025-07-15T10:58:43.623911Z","end":"2025-07-15T10:58:43.891266Z","steps":["trace[139387149] 'agreement among raft nodes before linearized reading' (duration: 266.818606ms)"],"step_count":1} Jul 15 10:58:43.894340 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.891410Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"246.808485ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/ranges/servicenodeports\" limit:1 ","response":"range_response_count:1 size:118"} Jul 15 10:58:43.894340 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:43.891446Z","caller":"traceutil/trace.go:171","msg":"trace[1832042629] range","detail":"{range_begin:/registry/ranges/servicenodeports; range_end:; response_count:1; response_revision:1585; }","duration":"246.891579ms","start":"2025-07-15T10:58:43.644543Z","end":"2025-07-15T10:58:43.891435Z","steps":["trace[1832042629] 'agreement among raft nodes before linearized reading' (duration: 246.825627ms)"],"step_count":1} Jul 15 10:58:43.894340 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.891625Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"240.470565ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/tigerastatuses/apiserver\" limit:1 ","response":"range_response_count:1 size:1136"} Jul 15 10:58:43.896977 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:43.891667Z","caller":"traceutil/trace.go:171","msg":"trace[928168137] range","detail":"{range_begin:/registry/operator.tigera.io/tigerastatuses/apiserver; range_end:; response_count:1; response_revision:1585; }","duration":"240.537839ms","start":"2025-07-15T10:58:43.651117Z","end":"2025-07-15T10:58:43.891655Z","steps":["trace[928168137] 'agreement among raft nodes before linearized reading' (duration: 240.387802ms)"],"step_count":1} Jul 15 10:58:43.896977 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.891690Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"239.313729ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/serviceaccounts/calico-system/calico-typha\" limit:1 ","response":"range_response_count:1 size:441"} Jul 15 10:58:43.896977 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:43.891753Z","caller":"traceutil/trace.go:171","msg":"trace[518377458] range","detail":"{range_begin:/registry/serviceaccounts/calico-system/calico-typha; range_end:; response_count:1; response_revision:1585; }","duration":"239.42247ms","start":"2025-07-15T10:58:43.652315Z","end":"2025-07-15T10:58:43.891738Z","steps":["trace[518377458] 'agreement among raft nodes before linearized reading' (duration: 239.195792ms)"],"step_count":1} Jul 15 10:58:43.896977 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.891955Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"237.249859ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/rolebindings/calico-apiserver/tigera-extension-apiserver-secrets-access\" limit:1 ","response":"range_response_count:0 size:5"} Jul 15 10:58:43.897440 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:43.892007Z","caller":"traceutil/trace.go:171","msg":"trace[768099485] range","detail":"{range_begin:/registry/rolebindings/calico-apiserver/tigera-extension-apiserver-secrets-access; range_end:; response_count:0; response_revision:1585; }","duration":"237.362978ms","start":"2025-07-15T10:58:43.654632Z","end":"2025-07-15T10:58:43.891995Z","steps":["trace[768099485] 'agreement among raft nodes before linearized reading' (duration: 237.259427ms)"],"step_count":1} Jul 15 10:58:43.897440 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:43.892346Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"243.791776ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/tigerastatuses/whisker\" limit:1 ","response":"range_response_count:1 size:1132"} Jul 15 10:58:43.897440 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:43.892436Z","caller":"traceutil/trace.go:171","msg":"trace[436703972] range","detail":"{range_begin:/registry/operator.tigera.io/tigerastatuses/whisker; range_end:; response_count:1; response_revision:1585; }","duration":"243.877224ms","start":"2025-07-15T10:58:43.648508Z","end":"2025-07-15T10:58:43.892386Z","steps":["trace[436703972] 'agreement among raft nodes before linearized reading' (duration: 243.622184ms)"],"step_count":1} Jul 15 10:58:44.124857 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:44.122708Z","caller":"traceutil/trace.go:171","msg":"trace[1608254595] linearizableReadLoop","detail":"{readStateIndex:1834; appliedIndex:1831; }","duration":"163.524116ms","start":"2025-07-15T10:58:43.959152Z","end":"2025-07-15T10:58:44.122677Z","steps":["trace[1608254595] 'read index received' (duration: 54.119971ms)","trace[1608254595] 'applied index is now lower than readState.Index' (duration: 109.402832ms)"],"step_count":2} Jul 15 10:58:44.124857 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:44.122946Z","caller":"traceutil/trace.go:171","msg":"trace[1217443786] transaction","detail":"{read_only:false; response_revision:1588; number_of_response:1; }","duration":"165.894821ms","start":"2025-07-15T10:58:43.957032Z","end":"2025-07-15T10:58:44.122926Z","steps":["trace[1217443786] 'process raft request' (duration: 165.473474ms)"],"step_count":1} Jul 15 10:58:44.124857 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:44.123095Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"162.839852ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/mutatingwebhookconfigurations/tigera-sidecar-webhook-configuration\" limit:1 ","response":"range_response_count:0 size:5"} Jul 15 10:58:44.124857 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:44.123178Z","caller":"traceutil/trace.go:171","msg":"trace[851978928] range","detail":"{range_begin:/registry/mutatingwebhookconfigurations/tigera-sidecar-webhook-configuration; range_end:; response_count:0; response_revision:1588; }","duration":"163.04462ms","start":"2025-07-15T10:58:43.960110Z","end":"2025-07-15T10:58:44.123155Z","steps":["trace[851978928] 'agreement among raft nodes before linearized reading' (duration: 162.905684ms)"],"step_count":1} Jul 15 10:58:44.124857 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:44.123537Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"162.87691ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/clusterroles/calico-typha\" limit:1 ","response":"range_response_count:1 size:1668"} Jul 15 10:58:44.126047 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:44.123584Z","caller":"traceutil/trace.go:171","msg":"trace[1505655376] range","detail":"{range_begin:/registry/clusterroles/calico-typha; range_end:; response_count:1; response_revision:1588; }","duration":"162.951828ms","start":"2025-07-15T10:58:43.960618Z","end":"2025-07-15T10:58:44.123570Z","steps":["trace[1505655376] 'agreement among raft nodes before linearized reading' (duration: 162.802302ms)"],"step_count":1} Jul 15 10:58:44.126047 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:44.123646Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"164.482074ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/tiers/adminnetworkpolicy\" limit:1 ","response":"range_response_count:1 size:721"} Jul 15 10:58:44.126047 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:44.123698Z","caller":"traceutil/trace.go:171","msg":"trace[676573071] range","detail":"{range_begin:/registry/crd.projectcalico.org/tiers/adminnetworkpolicy; range_end:; response_count:1; response_revision:1588; }","duration":"164.585815ms","start":"2025-07-15T10:58:43.959098Z","end":"2025-07-15T10:58:44.123684Z","steps":["trace[676573071] 'agreement among raft nodes before linearized reading' (duration: 164.429748ms)"],"step_count":1} Jul 15 10:58:44.246041 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:44.243904Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"102.375307ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/daemonsets/\" range_end:\"/registry/daemonsets0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 10:58:44.246041 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:44.244038Z","caller":"traceutil/trace.go:171","msg":"trace[1925110468] range","detail":"{range_begin:/registry/daemonsets/; range_end:/registry/daemonsets0; response_count:0; response_revision:1588; }","duration":"102.543086ms","start":"2025-07-15T10:58:44.141453Z","end":"2025-07-15T10:58:44.243996Z","steps":["trace[1925110468] 'count revisions from in-memory index tree' (duration: 102.237753ms)"],"step_count":1} Jul 15 10:58:44.246041 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:44.244386Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"102.936823ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/tigerastatuses/whisker\" limit:1 ","response":"range_response_count:1 size:1201"} Jul 15 10:58:44.246041 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:44.244466Z","caller":"traceutil/trace.go:171","msg":"trace[1608379787] range","detail":"{range_begin:/registry/operator.tigera.io/tigerastatuses/whisker; range_end:; response_count:1; response_revision:1588; }","duration":"103.007182ms","start":"2025-07-15T10:58:44.141427Z","end":"2025-07-15T10:58:44.244434Z","steps":["trace[1608379787] 'range keys from in-memory index tree' (duration: 102.743927ms)"],"step_count":1} Jul 15 10:58:44.507084 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:44.505115Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"194.874201ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/configmaps/calico-system/whisker-ca-bundle\" limit:1 ","response":"range_response_count:1 size:1956"} Jul 15 10:58:44.507084 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:44.505126Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"133.149941ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/deployments/calico-system/calico-typha\" limit:1 ","response":"range_response_count:1 size:6708"} Jul 15 10:58:44.507084 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:44.505246Z","caller":"traceutil/trace.go:171","msg":"trace[216724088] range","detail":"{range_begin:/registry/configmaps/calico-system/whisker-ca-bundle; range_end:; response_count:1; response_revision:1589; }","duration":"195.045738ms","start":"2025-07-15T10:58:44.310172Z","end":"2025-07-15T10:58:44.505217Z","steps":["trace[216724088] 'agreement among raft nodes before linearized reading' (duration: 34.017691ms)","trace[216724088] 'range keys from in-memory index tree' (duration: 160.69994ms)"],"step_count":2} Jul 15 10:58:44.507084 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:44.505279Z","caller":"traceutil/trace.go:171","msg":"trace[270064906] range","detail":"{range_begin:/registry/deployments/calico-system/calico-typha; range_end:; response_count:1; response_revision:1589; }","duration":"133.358636ms","start":"2025-07-15T10:58:44.371893Z","end":"2025-07-15T10:58:44.505252Z","steps":["trace[270064906] 'range keys from in-memory index tree' (duration: 132.781981ms)"],"step_count":1} Jul 15 10:58:44.507084 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:44.505623Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"189.964016ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/secrets/calico-system/goldmane-key-pair\" limit:1 ","response":"range_response_count:1 size:4707"} Jul 15 10:58:44.510498 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:44.505721Z","caller":"traceutil/trace.go:171","msg":"trace[1969536604] range","detail":"{range_begin:/registry/secrets/calico-system/goldmane-key-pair; range_end:; response_count:1; response_revision:1589; }","duration":"190.099026ms","start":"2025-07-15T10:58:44.315598Z","end":"2025-07-15T10:58:44.505697Z","steps":["trace[1969536604] 'agreement among raft nodes before linearized reading' (duration: 28.58417ms)","trace[1969536604] 'range keys from in-memory index tree' (duration: 161.297645ms)"],"step_count":2} Jul 15 10:58:44.510498 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:44.505628Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"154.267084ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/clusterroles/tigera-uisettingsgroup-getter\" limit:1 ","response":"range_response_count:0 size:5"} Jul 15 10:58:44.510498 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:44.506602Z","caller":"traceutil/trace.go:171","msg":"trace[196024373] range","detail":"{range_begin:/registry/clusterroles/tigera-uisettingsgroup-getter; range_end:; response_count:0; response_revision:1589; }","duration":"155.265368ms","start":"2025-07-15T10:58:44.351306Z","end":"2025-07-15T10:58:44.506571Z","steps":["trace[196024373] 'range keys from in-memory index tree' (duration: 154.186135ms)"],"step_count":1} Jul 15 10:58:49.897866 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:49.893619Z","caller":"traceutil/trace.go:171","msg":"trace[827371156] linearizableReadLoop","detail":"{readStateIndex:1860; appliedIndex:1859; }","duration":"177.89032ms","start":"2025-07-15T10:58:49.715604Z","end":"2025-07-15T10:58:49.893495Z","steps":["trace[827371156] 'read index received' (duration: 177.650166ms)","trace[827371156] 'applied index is now lower than readState.Index' (duration: 238.691µs)"],"step_count":2} Jul 15 10:58:49.897866 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:49.894003Z","caller":"traceutil/trace.go:171","msg":"trace[1111521618] transaction","detail":"{read_only:false; response_revision:1613; number_of_response:1; }","duration":"184.652504ms","start":"2025-07-15T10:58:49.709296Z","end":"2025-07-15T10:58:49.893948Z","steps":["trace[1111521618] 'process raft request' (duration: 184.034965ms)"],"step_count":1} Jul 15 10:58:49.897866 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:49.894610Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"155.311004ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jul 15 10:58:49.897866 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:49.894843Z","caller":"traceutil/trace.go:171","msg":"trace[1937482110] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1613; }","duration":"155.605738ms","start":"2025-07-15T10:58:49.739076Z","end":"2025-07-15T10:58:49.894682Z","steps":["trace[1937482110] 'agreement among raft nodes before linearized reading' (duration: 155.344416ms)"],"step_count":1} Jul 15 10:58:49.897866 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:58:49.894613Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"178.778278ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/clusterrolebindings/tigera-apiserver-webhook-reader\" limit:1 ","response":"range_response_count:0 size:5"} Jul 15 10:58:49.902655 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:58:49.896848Z","caller":"traceutil/trace.go:171","msg":"trace[2100477902] range","detail":"{range_begin:/registry/clusterrolebindings/tigera-apiserver-webhook-reader; range_end:; response_count:0; response_revision:1613; }","duration":"179.464615ms","start":"2025-07-15T10:58:49.715559Z","end":"2025-07-15T10:58:49.895024Z","steps":["trace[2100477902] 'agreement among raft nodes before linearized reading' (duration: 178.640464ms)"],"step_count":1} Jul 15 10:59:08.310049 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:08.307111Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875174906,"retry-timeout":"500ms"} Jul 15 10:59:08.808621 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:08.808001Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875174906,"retry-timeout":"500ms"} Jul 15 10:59:09.677609 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:09.308991Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875174906,"retry-timeout":"500ms"} Jul 15 10:59:09.689078 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:09.684511Z","caller":"wal/wal.go:805","msg":"slow fdatasync","took":"4.185897714s","expected-duration":"1s"} Jul 15 10:59:09.689078 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:09.685340Z","caller":"traceutil/trace.go:171","msg":"trace[742279937] transaction","detail":"{read_only:false; response_revision:1710; number_of_response:1; }","duration":"4.186846076s","start":"2025-07-15T10:59:05.498455Z","end":"2025-07-15T10:59:09.685301Z","steps":["trace[742279937] 'process raft request' (duration: 4.186577009s)"],"step_count":1} Jul 15 10:59:09.689078 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:09.685948Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:59:05.498401Z","time spent":"4.187100996s","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":517,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 10:59:09.712720 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:09.711189Z","caller":"traceutil/trace.go:171","msg":"trace[1083518323] linearizableReadLoop","detail":"{readStateIndex:1971; appliedIndex:1969; }","duration":"1.905017475s","start":"2025-07-15T10:59:07.806141Z","end":"2025-07-15T10:59:09.711158Z","steps":["trace[1083518323] 'read index received' (duration: 1.878971834s)","trace[1083518323] 'applied index is now lower than readState.Index' (duration: 26.044138ms)"],"step_count":2} Jul 15 10:59:09.713820 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:09.712030Z","caller":"traceutil/trace.go:171","msg":"trace[977791037] transaction","detail":"{read_only:false; response_revision:1711; number_of_response:1; }","duration":"4.203866313s","start":"2025-07-15T10:59:05.508137Z","end":"2025-07-15T10:59:09.712003Z","steps":["trace[977791037] 'process raft request' (duration: 4.202857039s)"],"step_count":1} Jul 15 10:59:09.721784 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:09.712414Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:59:05.508102Z","time spent":"4.204101026s","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":489,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 10:59:09.844862 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:09.843348Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"100.018553ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/events/\" range_end:\"/registry/events0\" count_only:true ","response":"range_response_count:0 size:8"} Jul 15 10:59:09.844862 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:09.843477Z","caller":"traceutil/trace.go:171","msg":"trace[1730256079] range","detail":"{range_begin:/registry/events/; range_end:/registry/events0; response_count:0; response_revision:1712; }","duration":"100.176995ms","start":"2025-07-15T10:59:09.743260Z","end":"2025-07-15T10:59:09.843437Z","steps":["trace[1730256079] 'agreement among raft nodes before linearized reading' (duration: 99.7676ms)"],"step_count":1} Jul 15 10:59:19.928969 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:19.924481Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875174962,"retry-timeout":"500ms"} Jul 15 10:59:20.426778 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:20.425948Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875174962,"retry-timeout":"500ms"} Jul 15 10:59:22.001489 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:21.491406Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.000230009s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context deadline exceeded"} Jul 15 10:59:22.001489 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:21.491576Z","caller":"traceutil/trace.go:171","msg":"trace[1561980917] range","detail":"{range_begin:/registry/health; range_end:; }","duration":"2.000550361s","start":"2025-07-15T10:59:19.490961Z","end":"2025-07-15T10:59:21.491511Z","steps":["trace[1561980917] 'agreement among raft nodes before linearized reading' (duration: 2.00026808s)"],"step_count":1} Jul 15 10:59:22.001489 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:21.491696Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:59:19.490933Z","time spent":"2.000740592s","remote":"172.24.4.207:54212","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "} Jul 15 10:59:22.001489 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:21.993324Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875174962,"retry-timeout":"500ms"} Jul 15 10:59:22.033607 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:21.995198Z","caller":"wal/wal.go:805","msg":"slow fdatasync","took":"4.080241948s","expected-duration":"1s"} Jul 15 10:59:22.103900 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:22.101419Z","caller":"traceutil/trace.go:171","msg":"trace[364135899] transaction","detail":"{read_only:false; response_revision:1730; number_of_response:1; }","duration":"2.640886235s","start":"2025-07-15T10:59:19.460493Z","end":"2025-07-15T10:59:22.101380Z","steps":["trace[364135899] 'process raft request' (duration: 2.639955707s)"],"step_count":1} Jul 15 10:59:22.103900 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:22.101792Z","caller":"traceutil/trace.go:171","msg":"trace[1359305757] transaction","detail":"{read_only:false; response_revision:1731; number_of_response:1; }","duration":"2.57021924s","start":"2025-07-15T10:59:19.531548Z","end":"2025-07-15T10:59:22.101767Z","steps":["trace[1359305757] 'process raft request' (duration: 2.569470278s)"],"step_count":1} Jul 15 10:59:22.103900 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:22.102194Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:59:19.531497Z","time spent":"2.570392841s","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":490,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 10:59:22.103900 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:22.102188Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:59:19.460454Z","time spent":"2.641110629s","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":488,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 10:59:22.106927 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:22.103262Z","caller":"traceutil/trace.go:171","msg":"trace[549850874] transaction","detail":"{read_only:false; response_revision:1732; number_of_response:1; }","duration":"2.571473787s","start":"2025-07-15T10:59:19.531731Z","end":"2025-07-15T10:59:22.103205Z","steps":["trace[549850874] 'process raft request' (duration: 2.569936288s)"],"step_count":1} Jul 15 10:59:22.106927 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:22.103607Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:59:19.531712Z","time spent":"2.571808855s","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":517,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 10:59:22.106927 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:22.103597Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.680091756s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/runtimeclasses/\" range_end:\"/registry/runtimeclasses0\" count_only:true ","response":"range_response_count:0 size:5"} Jul 15 10:59:22.106927 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:22.103845Z","caller":"traceutil/trace.go:171","msg":"trace[885364692] range","detail":"{range_begin:/registry/runtimeclasses/; range_end:/registry/runtimeclasses0; response_count:0; response_revision:1732; }","duration":"2.680358469s","start":"2025-07-15T10:59:19.423472Z","end":"2025-07-15T10:59:22.103830Z","steps":["trace[885364692] 'agreement among raft nodes before linearized reading' (duration: 2.679942831s)"],"step_count":1} Jul 15 10:59:22.107732 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:22.103982Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:59:19.423341Z","time spent":"2.680605064s","remote":"172.24.4.207:54492","response type":"/etcdserverpb.KV/Range","request count":0,"request size":56,"response count":0,"response size":29,"request content":"key:\"/registry/runtimeclasses/\" range_end:\"/registry/runtimeclasses0\" count_only:true "} Jul 15 10:59:22.107732 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:22.103297Z","caller":"traceutil/trace.go:171","msg":"trace[1484116341] linearizableReadLoop","detail":"{readStateIndex:1998; appliedIndex:1994; }","duration":"2.679180303s","start":"2025-07-15T10:59:19.423483Z","end":"2025-07-15T10:59:22.102664Z","steps":["trace[1484116341] 'read index received' (duration: 2.579416062s)","trace[1484116341] 'applied index is now lower than readState.Index' (duration: 99.762137ms)"],"step_count":2} Jul 15 10:59:22.107732 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:22.104558Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.632130878s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/apiservers/\" range_end:\"/registry/operator.tigera.io/apiservers0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 10:59:22.107732 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:22.104669Z","caller":"traceutil/trace.go:171","msg":"trace[749978000] range","detail":"{range_begin:/registry/operator.tigera.io/apiservers/; range_end:/registry/operator.tigera.io/apiservers0; response_count:0; response_revision:1732; }","duration":"2.632314357s","start":"2025-07-15T10:59:19.472329Z","end":"2025-07-15T10:59:22.104643Z","steps":["trace[749978000] 'agreement among raft nodes before linearized reading' (duration: 2.632096205s)"],"step_count":1} Jul 15 10:59:22.108268 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:22.104824Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:59:19.472299Z","time spent":"2.632460858s","remote":"172.24.4.207:47648","response type":"/etcdserverpb.KV/Range","request count":0,"request size":86,"response count":1,"response size":31,"request content":"key:\"/registry/operator.tigera.io/apiservers/\" range_end:\"/registry/operator.tigera.io/apiservers0\" count_only:true "} Jul 15 10:59:22.108268 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:22.106131Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.62585537s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/caliconodestatuses/\" range_end:\"/registry/crd.projectcalico.org/caliconodestatuses0\" count_only:true ","response":"range_response_count:0 size:5"} Jul 15 10:59:22.108268 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:22.106376Z","caller":"traceutil/trace.go:171","msg":"trace[609518369] range","detail":"{range_begin:/registry/crd.projectcalico.org/caliconodestatuses/; range_end:/registry/crd.projectcalico.org/caliconodestatuses0; response_count:0; response_revision:1732; }","duration":"2.626064837s","start":"2025-07-15T10:59:19.480192Z","end":"2025-07-15T10:59:22.106257Z","steps":["trace[609518369] 'agreement among raft nodes before linearized reading' (duration: 2.625896977s)"],"step_count":1} Jul 15 10:59:22.108268 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:22.106675Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:59:19.480164Z","time spent":"2.626435912s","remote":"172.24.4.207:59336","response type":"/etcdserverpb.KV/Range","request count":0,"request size":108,"response count":0,"response size":29,"request content":"key:\"/registry/crd.projectcalico.org/caliconodestatuses/\" range_end:\"/registry/crd.projectcalico.org/caliconodestatuses0\" count_only:true "} Jul 15 10:59:24.586686 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:24.584697Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.192273617s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/ipamconfigs/\" range_end:\"/registry/crd.projectcalico.org/ipamconfigs0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 10:59:24.586686 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:24.584980Z","caller":"traceutil/trace.go:171","msg":"trace[884338702] range","detail":"{range_begin:/registry/crd.projectcalico.org/ipamconfigs/; range_end:/registry/crd.projectcalico.org/ipamconfigs0; response_count:0; response_revision:1735; }","duration":"1.192532644s","start":"2025-07-15T10:59:23.392265Z","end":"2025-07-15T10:59:24.584798Z","steps":["trace[884338702] 'count revisions from in-memory index tree' (duration: 1.192081351s)"],"step_count":1} Jul 15 10:59:24.586686 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:24.585037Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.343923162s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/masterleases/172.24.4.207\" limit:1 ","response":"range_response_count:1 size:131"} Jul 15 10:59:24.586686 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:24.585076Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:59:23.392231Z","time spent":"1.192817531s","remote":"172.24.4.207:51874","response type":"/etcdserverpb.KV/Range","request count":0,"request size":94,"response count":1,"response size":31,"request content":"key:\"/registry/crd.projectcalico.org/ipamconfigs/\" range_end:\"/registry/crd.projectcalico.org/ipamconfigs0\" count_only:true "} Jul 15 10:59:24.588348 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:24.585168Z","caller":"traceutil/trace.go:171","msg":"trace[1903668932] range","detail":"{range_begin:/registry/masterleases/172.24.4.207; range_end:; response_count:1; response_revision:1735; }","duration":"1.34410631s","start":"2025-07-15T10:59:23.241031Z","end":"2025-07-15T10:59:24.585138Z","steps":["trace[1903668932] 'range keys from in-memory index tree' (duration: 1.343470756s)"],"step_count":1} Jul 15 10:59:24.588348 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:24.585301Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:59:23.241019Z","time spent":"1.344252881s","remote":"172.24.4.207:54228","response type":"/etcdserverpb.KV/Range","request count":0,"request size":39,"response count":1,"response size":155,"request content":"key:\"/registry/masterleases/172.24.4.207\" limit:1 "} Jul 15 10:59:24.588348 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:24.585374Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.31445435s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jul 15 10:59:24.588348 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:24.585456Z","caller":"traceutil/trace.go:171","msg":"trace[703998615] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1735; }","duration":"1.314551629s","start":"2025-07-15T10:59:23.270858Z","end":"2025-07-15T10:59:24.585409Z","steps":["trace[703998615] 'range keys from in-memory index tree' (duration: 1.314322536s)"],"step_count":1} Jul 15 10:59:24.588348 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:24.585517Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:59:23.270791Z","time spent":"1.314707496s","remote":"172.24.4.207:54212","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":29,"request content":"key:\"/registry/health\" "} Jul 15 10:59:24.589007 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:24.585653Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.345030497s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/networkpolicies/\" range_end:\"/registry/networkpolicies0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 10:59:24.589007 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:24.585705Z","caller":"traceutil/trace.go:171","msg":"trace[1299839112] range","detail":"{range_begin:/registry/networkpolicies/; range_end:/registry/networkpolicies0; response_count:0; response_revision:1735; }","duration":"1.345138436s","start":"2025-07-15T10:59:23.240549Z","end":"2025-07-15T10:59:24.585688Z","steps":["trace[1299839112] 'count revisions from in-memory index tree' (duration: 1.344845787s)"],"step_count":1} Jul 15 10:59:24.589007 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:24.585763Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:59:23.240517Z","time spent":"1.345229906s","remote":"172.24.4.207:54450","response type":"/etcdserverpb.KV/Range","request count":0,"request size":58,"response count":3,"response size":31,"request content":"key:\"/registry/networkpolicies/\" range_end:\"/registry/networkpolicies0\" count_only:true "} Jul 15 10:59:25.067853 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:25.066681Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"379.701194ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/masterleases/\" range_end:\"/registry/masterleases0\" ","response":"range_response_count:1 size:131"} Jul 15 10:59:25.067853 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:25.066879Z","caller":"traceutil/trace.go:171","msg":"trace[961907526] range","detail":"{range_begin:/registry/masterleases/; range_end:/registry/masterleases0; response_count:1; response_revision:1742; }","duration":"379.965602ms","start":"2025-07-15T10:59:24.686882Z","end":"2025-07-15T10:59:25.066847Z","steps":["trace[961907526] 'range keys from in-memory index tree' (duration: 379.538874ms)"],"step_count":1} Jul 15 10:59:25.067853 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:25.066993Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:59:24.686859Z","time spent":"380.11048ms","remote":"172.24.4.207:54228","response type":"/etcdserverpb.KV/Range","request count":0,"request size":50,"response count":1,"response size":155,"request content":"key:\"/registry/masterleases/\" range_end:\"/registry/masterleases0\" "} Jul 15 10:59:25.069041 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:25.067445Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"377.552086ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/clusterinformations/default\" limit:1 ","response":"range_response_count:1 size:886"} Jul 15 10:59:25.069041 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:25.067549Z","caller":"traceutil/trace.go:171","msg":"trace[835691445] range","detail":"{range_begin:/registry/crd.projectcalico.org/clusterinformations/default; range_end:; response_count:1; response_revision:1742; }","duration":"377.702133ms","start":"2025-07-15T10:59:24.689791Z","end":"2025-07-15T10:59:25.067493Z","steps":["trace[835691445] 'range keys from in-memory index tree' (duration: 377.282808ms)"],"step_count":1} Jul 15 10:59:25.069041 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:25.067617Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:59:24.689752Z","time spent":"377.833044ms","remote":"172.24.4.207:47728","response type":"/etcdserverpb.KV/Range","request count":0,"request size":63,"response count":1,"response size":910,"request content":"key:\"/registry/crd.projectcalico.org/clusterinformations/default\" limit:1 "} Jul 15 10:59:25.069041 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:25.067878Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"174.051037ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/daemonsets/calico-system/calico-node\" limit:1 ","response":"range_response_count:1 size:11440"} Jul 15 10:59:25.069635 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:25.068332Z","caller":"traceutil/trace.go:171","msg":"trace[2136983232] range","detail":"{range_begin:/registry/daemonsets/calico-system/calico-node; range_end:; response_count:1; response_revision:1742; }","duration":"175.525529ms","start":"2025-07-15T10:59:24.892635Z","end":"2025-07-15T10:59:25.068160Z","steps":["trace[2136983232] 'range keys from in-memory index tree' (duration: 173.676837ms)"],"step_count":1} Jul 15 10:59:25.865448 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:25.865001Z","caller":"traceutil/trace.go:171","msg":"trace[1877547571] transaction","detail":"{read_only:false; number_of_response:0; response_revision:1742; }","duration":"773.770801ms","start":"2025-07-15T10:59:25.091212Z","end":"2025-07-15T10:59:25.864983Z","steps":["trace[1877547571] 'process raft request' (duration: 773.417238ms)"],"step_count":1} Jul 15 10:59:25.866899 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:25.865453Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:59:25.091145Z","time spent":"774.128181ms","remote":"172.24.4.207:59328","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":29,"request content":"compare: success:> failure:<>"} Jul 15 10:59:27.054555 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:27.053492Z","caller":"traceutil/trace.go:171","msg":"trace[432773881] transaction","detail":"{read_only:false; response_revision:1743; number_of_response:1; }","duration":"350.061827ms","start":"2025-07-15T10:59:26.703400Z","end":"2025-07-15T10:59:27.053462Z","steps":["trace[432773881] 'process raft request' (duration: 349.71138ms)"],"step_count":1} Jul 15 10:59:27.054555 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:27.053693Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:59:26.703347Z","time spent":"350.25312ms","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":490,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 10:59:27.067885 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:27.066465Z","caller":"traceutil/trace.go:171","msg":"trace[1765935666] transaction","detail":"{read_only:false; response_revision:1744; number_of_response:1; }","duration":"362.101578ms","start":"2025-07-15T10:59:26.704325Z","end":"2025-07-15T10:59:27.066427Z","steps":["trace[1765935666] 'process raft request' (duration: 361.75602ms)"],"step_count":1} Jul 15 10:59:27.069316 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:27.067739Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"294.532204ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/deployments\" limit:1 ","response":"range_response_count:0 size:5"} Jul 15 10:59:27.069316 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:27.068123Z","caller":"traceutil/trace.go:171","msg":"trace[666987800] transaction","detail":"{read_only:false; response_revision:1745; number_of_response:1; }","duration":"362.549586ms","start":"2025-07-15T10:59:26.705536Z","end":"2025-07-15T10:59:27.068085Z","steps":["trace[666987800] 'process raft request' (duration: 360.778917ms)"],"step_count":1} Jul 15 10:59:27.069316 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:27.068194Z","caller":"traceutil/trace.go:171","msg":"trace[742351657] range","detail":"{range_begin:/registry/deployments; range_end:; response_count:0; response_revision:1745; }","duration":"295.063906ms","start":"2025-07-15T10:59:26.773109Z","end":"2025-07-15T10:59:27.068173Z","steps":["trace[742351657] 'agreement among raft nodes before linearized reading' (duration: 293.990403ms)"],"step_count":1} Jul 15 10:59:27.069316 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:27.068259Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:59:26.705483Z","time spent":"362.711525ms","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":489,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 10:59:27.071319 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:27.067782Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:59:26.704290Z","time spent":"363.384317ms","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":517,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 10:59:27.071319 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:27.067045Z","caller":"traceutil/trace.go:171","msg":"trace[280502713] linearizableReadLoop","detail":"{readStateIndex:2015; appliedIndex:2013; }","duration":"293.832402ms","start":"2025-07-15T10:59:26.773184Z","end":"2025-07-15T10:59:27.067016Z","steps":["trace[280502713] 'read index received' (duration: 281.32667ms)","trace[280502713] 'applied index is now lower than readState.Index' (duration: 12.503918ms)"],"step_count":2} Jul 15 10:59:27.071319 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:27.068500Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"220.169555ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/validatingwebhookconfigurations/\" range_end:\"/registry/validatingwebhookconfigurations0\" count_only:true ","response":"range_response_count:0 size:5"} Jul 15 10:59:27.071319 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:27.068542Z","caller":"traceutil/trace.go:171","msg":"trace[457831447] range","detail":"{range_begin:/registry/validatingwebhookconfigurations/; range_end:/registry/validatingwebhookconfigurations0; response_count:0; response_revision:1745; }","duration":"220.217664ms","start":"2025-07-15T10:59:26.848311Z","end":"2025-07-15T10:59:27.068529Z","steps":["trace[457831447] 'agreement among raft nodes before linearized reading' (duration: 220.152494ms)"],"step_count":1} Jul 15 10:59:32.259149 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:32.255945Z","caller":"wal/wal.go:805","msg":"slow fdatasync","took":"4.261507814s","expected-duration":"1s"} Jul 15 10:59:33.989416 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:33.899775Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.000172875s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context deadline exceeded"} Jul 15 10:59:33.989416 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:33.899954Z","caller":"traceutil/trace.go:171","msg":"trace[1798952114] range","detail":"{range_begin:/registry/health; range_end:; }","duration":"2.000434128s","start":"2025-07-15T10:59:31.899496Z","end":"2025-07-15T10:59:33.899930Z","steps":["trace[1798952114] 'agreement among raft nodes before linearized reading' (duration: 2.000196549s)"],"step_count":1} Jul 15 10:59:33.989416 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:33.900052Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:59:31.899479Z","time spent":"2.000539822s","remote":"172.24.4.207:54212","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "} Jul 15 10:59:33.995416 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:33.994653Z","caller":"wal/wal.go:805","msg":"slow fdatasync","took":"1.737749788s","expected-duration":"1s"} Jul 15 10:59:34.039228 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:34.035949Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.778496337s","expected-duration":"100ms","prefix":"","request":"header: lease_revoke:","response":"size:29"} Jul 15 10:59:34.039228 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:34.037233Z","caller":"traceutil/trace.go:171","msg":"trace[1891478983] transaction","detail":"{read_only:false; response_revision:1746; number_of_response:1; }","duration":"4.948947411s","start":"2025-07-15T10:59:29.088234Z","end":"2025-07-15T10:59:34.037181Z","steps":["trace[1891478983] 'process raft request' (duration: 4.947837862s)"],"step_count":1} Jul 15 10:59:34.039228 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:34.037403Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:59:29.088196Z","time spent":"4.94910373s","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":516,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 10:59:34.039228 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:34.037660Z","caller":"traceutil/trace.go:171","msg":"trace[726709447] transaction","detail":"{read_only:false; response_revision:1747; number_of_response:1; }","duration":"2.152143338s","start":"2025-07-15T10:59:31.885496Z","end":"2025-07-15T10:59:34.037640Z","steps":["trace[726709447] 'process raft request' (duration: 2.151357517s)"],"step_count":1} Jul 15 10:59:34.042908 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:34.037773Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:59:31.885471Z","time spent":"2.152229899s","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":490,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 10:59:34.042908 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:34.038410Z","caller":"traceutil/trace.go:171","msg":"trace[1004030285] linearizableReadLoop","detail":"{readStateIndex:2017; appliedIndex:2015; }","duration":"2.179402823s","start":"2025-07-15T10:59:31.858987Z","end":"2025-07-15T10:59:34.038390Z","steps":["trace[1004030285] 'read index received' (duration: 398.512765ms)","trace[1004030285] 'applied index is now lower than readState.Index' (duration: 1.780888385s)"],"step_count":2} Jul 15 10:59:34.042908 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:34.039646Z","caller":"traceutil/trace.go:171","msg":"trace[1043990535] transaction","detail":"{read_only:false; response_revision:1748; number_of_response:1; }","duration":"2.152254455s","start":"2025-07-15T10:59:31.887373Z","end":"2025-07-15T10:59:34.039628Z","steps":["trace[1043990535] 'process raft request' (duration: 2.150154738s)"],"step_count":1} Jul 15 10:59:34.042908 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:34.040244Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.180231413s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/persistentvolumeclaims/\" range_end:\"/registry/persistentvolumeclaims0\" count_only:true ","response":"range_response_count:0 size:5"} Jul 15 10:59:34.045079 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:34.040342Z","caller":"traceutil/trace.go:171","msg":"trace[178023593] range","detail":"{range_begin:/registry/persistentvolumeclaims/; range_end:/registry/persistentvolumeclaims0; response_count:0; response_revision:1748; }","duration":"2.180351936s","start":"2025-07-15T10:59:31.859964Z","end":"2025-07-15T10:59:34.040316Z","steps":["trace[178023593] 'agreement among raft nodes before linearized reading' (duration: 2.180214702s)"],"step_count":1} Jul 15 10:59:34.045079 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:34.040401Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:59:31.859863Z","time spent":"2.180520899s","remote":"172.24.4.207:54328","response type":"/etcdserverpb.KV/Range","request count":0,"request size":72,"response count":0,"response size":29,"request content":"key:\"/registry/persistentvolumeclaims/\" range_end:\"/registry/persistentvolumeclaims0\" count_only:true "} Jul 15 10:59:34.045079 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:34.041156Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.182155476s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/validatingadmissionpolicies/\" range_end:\"/registry/validatingadmissionpolicies0\" count_only:true ","response":"range_response_count:0 size:5"} Jul 15 10:59:34.045079 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:34.041670Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:59:31.887352Z","time spent":"2.152351884s","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":489,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 10:59:34.045506 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:34.041225Z","caller":"traceutil/trace.go:171","msg":"trace[1082628011] range","detail":"{range_begin:/registry/validatingadmissionpolicies/; range_end:/registry/validatingadmissionpolicies0; response_count:0; response_revision:1748; }","duration":"2.182317766s","start":"2025-07-15T10:59:31.858891Z","end":"2025-07-15T10:59:34.041209Z","steps":["trace[1082628011] 'agreement among raft nodes before linearized reading' (duration: 2.182220406s)"],"step_count":1} Jul 15 10:59:34.045506 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:34.041961Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:59:31.858862Z","time spent":"2.18300782s","remote":"172.24.4.207:54704","response type":"/etcdserverpb.KV/Range","request count":0,"request size":82,"response count":0,"response size":29,"request content":"key:\"/registry/validatingadmissionpolicies/\" range_end:\"/registry/validatingadmissionpolicies0\" count_only:true "} Jul 15 10:59:34.045506 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:34.042762Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.161646146s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/daemonsets/calico-system/calico-node\" limit:1 ","response":"range_response_count:1 size:11440"} Jul 15 10:59:34.045506 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:34.043470Z","caller":"traceutil/trace.go:171","msg":"trace[279912157] range","detail":"{range_begin:/registry/daemonsets/calico-system/calico-node; range_end:; response_count:1; response_revision:1748; }","duration":"2.162374971s","start":"2025-07-15T10:59:31.881075Z","end":"2025-07-15T10:59:34.043450Z","steps":["trace[279912157] 'agreement among raft nodes before linearized reading' (duration: 2.161561669s)"],"step_count":1} Jul 15 10:59:34.045936 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:34.043458Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.165113047s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/horizontalpodautoscalers/\" range_end:\"/registry/horizontalpodautoscalers0\" count_only:true ","response":"range_response_count:0 size:5"} Jul 15 10:59:34.045936 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:34.043564Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:59:31.881061Z","time spent":"2.162478984s","remote":"172.24.4.207:54648","response type":"/etcdserverpb.KV/Range","request count":0,"request size":50,"response count":1,"response size":11464,"request content":"key:\"/registry/daemonsets/calico-system/calico-node\" limit:1 "} Jul 15 10:59:34.045936 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:34.043621Z","caller":"traceutil/trace.go:171","msg":"trace[1155740894] range","detail":"{range_begin:/registry/horizontalpodautoscalers/; range_end:/registry/horizontalpodautoscalers0; response_count:0; response_revision:1748; }","duration":"2.165451022s","start":"2025-07-15T10:59:31.878124Z","end":"2025-07-15T10:59:34.043575Z","steps":["trace[1155740894] 'agreement among raft nodes before linearized reading' (duration: 2.16502748s)"],"step_count":1} Jul 15 10:59:34.045936 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:34.043740Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:59:31.878067Z","time spent":"2.165603643s","remote":"172.24.4.207:54400","response type":"/etcdserverpb.KV/Range","request count":0,"request size":76,"response count":0,"response size":29,"request content":"key:\"/registry/horizontalpodautoscalers/\" range_end:\"/registry/horizontalpodautoscalers0\" count_only:true "} Jul 15 10:59:34.227256 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:34.225898Z","caller":"traceutil/trace.go:171","msg":"trace[1466780530] linearizableReadLoop","detail":"{readStateIndex:2021; appliedIndex:2020; }","duration":"125.726715ms","start":"2025-07-15T10:59:34.100139Z","end":"2025-07-15T10:59:34.225866Z","steps":["trace[1466780530] 'read index received' (duration: 66.839369ms)","trace[1466780530] 'applied index is now lower than readState.Index' (duration: 58.884731ms)"],"step_count":2} Jul 15 10:59:34.227256 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:34.225941Z","caller":"traceutil/trace.go:171","msg":"trace[411434971] transaction","detail":"{read_only:false; response_revision:1749; number_of_response:1; }","duration":"129.818131ms","start":"2025-07-15T10:59:34.096070Z","end":"2025-07-15T10:59:34.225888Z","steps":["trace[411434971] 'process raft request' (duration: 70.870703ms)","trace[411434971] 'compare' (duration: 58.337872ms)"],"step_count":2} Jul 15 10:59:34.227256 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:34.226560Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"126.4005ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jul 15 10:59:34.228469 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:34.226983Z","caller":"traceutil/trace.go:171","msg":"trace[1706967251] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1749; }","duration":"126.798213ms","start":"2025-07-15T10:59:34.100100Z","end":"2025-07-15T10:59:34.226898Z","steps":["trace[1706967251] 'agreement among raft nodes before linearized reading' (duration: 125.915103ms)"],"step_count":1} Jul 15 10:59:34.241377 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:34.240078Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"118.724986ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/leases/kube-system/kube-controller-manager\" limit:1 ","response":"range_response_count:1 size:531"} Jul 15 10:59:34.241377 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:34.240175Z","caller":"traceutil/trace.go:171","msg":"trace[810215165] range","detail":"{range_begin:/registry/leases/kube-system/kube-controller-manager; range_end:; response_count:1; response_revision:1750; }","duration":"118.868772ms","start":"2025-07-15T10:59:34.121286Z","end":"2025-07-15T10:59:34.240154Z","steps":["trace[810215165] 'agreement among raft nodes before linearized reading' (duration: 118.296796ms)"],"step_count":1} Jul 15 10:59:34.241377 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:34.240339Z","caller":"traceutil/trace.go:171","msg":"trace[1120712864] transaction","detail":"{read_only:false; response_revision:1750; number_of_response:1; }","duration":"135.073695ms","start":"2025-07-15T10:59:34.105243Z","end":"2025-07-15T10:59:34.240317Z","steps":["trace[1120712864] 'process raft request' (duration: 134.029417ms)"],"step_count":1} Jul 15 10:59:34.241377 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:34.240456Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"118.713646ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/events/kube-system/kube-apiserver-ci-4230-2-100-9439eb8d1a.novalocal.1852678576305dad\" limit:1 ","response":"range_response_count:1 size:905"} Jul 15 10:59:34.242198 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:34.240525Z","caller":"traceutil/trace.go:171","msg":"trace[118607442] range","detail":"{range_begin:/registry/events/kube-system/kube-apiserver-ci-4230-2-100-9439eb8d1a.novalocal.1852678576305dad; range_end:; response_count:1; response_revision:1750; }","duration":"118.788314ms","start":"2025-07-15T10:59:34.121706Z","end":"2025-07-15T10:59:34.240494Z","steps":["trace[118607442] 'agreement among raft nodes before linearized reading' (duration: 118.615234ms)"],"step_count":1} Jul 15 10:59:34.461269 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:34.460349Z","caller":"traceutil/trace.go:171","msg":"trace[2069302703] transaction","detail":"{read_only:false; response_revision:1753; number_of_response:1; }","duration":"115.988234ms","start":"2025-07-15T10:59:34.344328Z","end":"2025-07-15T10:59:34.460316Z","steps":["trace[2069302703] 'process raft request' (duration: 115.465909ms)"],"step_count":1} Jul 15 10:59:34.619706 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:34.618634Z","caller":"traceutil/trace.go:171","msg":"trace[540661355] transaction","detail":"{read_only:false; response_revision:1754; number_of_response:1; }","duration":"109.098834ms","start":"2025-07-15T10:59:34.509498Z","end":"2025-07-15T10:59:34.618597Z","steps":["trace[540661355] 'process raft request' (duration: 37.916354ms)","trace[540661355] 'compare' (duration: 70.357406ms)"],"step_count":2} Jul 15 10:59:38.392328 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:36.667762Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875175068,"retry-timeout":"500ms"} Jul 15 10:59:38.392328 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:37.168523Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875175068,"retry-timeout":"500ms"} Jul 15 10:59:38.392328 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:37.669655Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875175068,"retry-timeout":"500ms"} Jul 15 10:59:38.392328 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:38.170703Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875175068,"retry-timeout":"500ms"} Jul 15 10:59:38.907873 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:38.742271Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875175068,"retry-timeout":"500ms"} Jul 15 10:59:39.148594 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:39.147311Z","caller":"wal/wal.go:805","msg":"slow fdatasync","took":"2.982449624s","expected-duration":"1s"} Jul 15 10:59:39.150019 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:39.148918Z","caller":"traceutil/trace.go:171","msg":"trace[628761024] transaction","detail":"{read_only:false; response_revision:1758; number_of_response:1; }","duration":"2.988738887s","start":"2025-07-15T10:59:36.160142Z","end":"2025-07-15T10:59:39.148881Z","steps":["trace[628761024] 'process raft request' (duration: 2.988048372s)"],"step_count":1} Jul 15 10:59:39.150019 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:39.149119Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:59:36.160131Z","time spent":"2.988869459s","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":489,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 10:59:39.161258 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:39.159250Z","caller":"traceutil/trace.go:171","msg":"trace[279421202] transaction","detail":"{read_only:false; response_revision:1759; number_of_response:1; }","duration":"2.992096288s","start":"2025-07-15T10:59:36.167119Z","end":"2025-07-15T10:59:39.159215Z","steps":["trace[279421202] 'process raft request' (duration: 2.991579213s)"],"step_count":1} Jul 15 10:59:39.161258 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:39.159505Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:59:36.167103Z","time spent":"2.992260089s","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":488,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 10:59:39.161258 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:39.159594Z","caller":"traceutil/trace.go:171","msg":"trace[1500152773] linearizableReadLoop","detail":"{readStateIndex:2033; appliedIndex:2030; }","duration":"2.991997845s","start":"2025-07-15T10:59:36.167506Z","end":"2025-07-15T10:59:39.159504Z","steps":["trace[1500152773] 'read index received' (duration: 2.980607483s)","trace[1500152773] 'applied index is now lower than readState.Index' (duration: 11.388959ms)"],"step_count":2} Jul 15 10:59:39.161258 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:39.159692Z","caller":"traceutil/trace.go:171","msg":"trace[983829067] transaction","detail":"{read_only:false; response_revision:1760; number_of_response:1; }","duration":"2.904617017s","start":"2025-07-15T10:59:36.255045Z","end":"2025-07-15T10:59:39.159662Z","steps":["trace[983829067] 'process raft request' (duration: 2.903900183s)"],"step_count":1} Jul 15 10:59:39.163497 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:39.159856Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:59:36.255009Z","time spent":"2.904722982s","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":517,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 10:59:39.163497 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:39.161189Z","caller":"traceutil/trace.go:171","msg":"trace[1307641421] transaction","detail":"{read_only:false; response_revision:1761; number_of_response:1; }","duration":"197.424209ms","start":"2025-07-15T10:59:38.963742Z","end":"2025-07-15T10:59:39.161166Z","steps":["trace[1307641421] 'process raft request' (duration: 195.302321ms)"],"step_count":1} Jul 15 10:59:39.167730 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:39.161637Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.994098474s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/tiers/default\" limit:1 ","response":"range_response_count:1 size:702"} Jul 15 10:59:39.167730 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:39.164683Z","caller":"traceutil/trace.go:171","msg":"trace[391978616] range","detail":"{range_begin:/registry/crd.projectcalico.org/tiers/default; range_end:; response_count:1; response_revision:1761; }","duration":"2.997167832s","start":"2025-07-15T10:59:36.167479Z","end":"2025-07-15T10:59:39.164647Z","steps":["trace[391978616] 'agreement among raft nodes before linearized reading' (duration: 2.993959267s)"],"step_count":1} Jul 15 10:59:39.167730 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:39.165074Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:59:36.167469Z","time spent":"2.997521875s","remote":"172.24.4.207:59328","response type":"/etcdserverpb.KV/Range","request count":0,"request size":49,"response count":1,"response size":726,"request content":"key:\"/registry/crd.projectcalico.org/tiers/default\" limit:1 "} Jul 15 10:59:39.167730 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:39.161858Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.994156552s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/namespaces/\" range_end:\"/registry/namespaces0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 10:59:39.167730 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:39.165332Z","caller":"traceutil/trace.go:171","msg":"trace[855414299] range","detail":"{range_begin:/registry/namespaces/; range_end:/registry/namespaces0; response_count:0; response_revision:1761; }","duration":"2.997670649s","start":"2025-07-15T10:59:36.167637Z","end":"2025-07-15T10:59:39.165308Z","steps":["trace[855414299] 'agreement among raft nodes before linearized reading' (duration: 2.99406914s)"],"step_count":1} Jul 15 10:59:39.168622 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:39.165404Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:59:36.167615Z","time spent":"2.99776273s","remote":"172.24.4.207:54288","response type":"/etcdserverpb.KV/Range","request count":0,"request size":48,"response count":7,"response size":31,"request content":"key:\"/registry/namespaces/\" range_end:\"/registry/namespaces0\" count_only:true "} Jul 15 10:59:39.168622 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:39.162128Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"161.258428ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jul 15 10:59:39.168622 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:39.165740Z","caller":"traceutil/trace.go:171","msg":"trace[712913640] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1761; }","duration":"164.9751ms","start":"2025-07-15T10:59:39.000747Z","end":"2025-07-15T10:59:39.165722Z","steps":["trace[712913640] 'agreement among raft nodes before linearized reading' (duration: 161.313108ms)"],"step_count":1} Jul 15 10:59:39.168622 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:39.162246Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"336.122898ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/poddisruptionbudgets/\" range_end:\"/registry/poddisruptionbudgets0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 10:59:39.168622 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:39.165905Z","caller":"traceutil/trace.go:171","msg":"trace[165473615] range","detail":"{range_begin:/registry/poddisruptionbudgets/; range_end:/registry/poddisruptionbudgets0; response_count:0; response_revision:1761; }","duration":"339.853297ms","start":"2025-07-15T10:59:38.826028Z","end":"2025-07-15T10:59:39.165881Z","steps":["trace[165473615] 'agreement among raft nodes before linearized reading' (duration: 336.137105ms)"],"step_count":1} Jul 15 10:59:39.169287 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:39.165970Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:59:38.826011Z","time spent":"339.936179ms","remote":"172.24.4.207:54504","response type":"/etcdserverpb.KV/Range","request count":0,"request size":68,"response count":2,"response size":31,"request content":"key:\"/registry/poddisruptionbudgets/\" range_end:\"/registry/poddisruptionbudgets0\" count_only:true "} Jul 15 10:59:39.169287 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:39.166476Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.861326279s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/tiers/\" range_end:\"/registry/crd.projectcalico.org/tiers0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 10:59:39.169287 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:39.166631Z","caller":"traceutil/trace.go:171","msg":"trace[921249460] range","detail":"{range_begin:/registry/crd.projectcalico.org/tiers/; range_end:/registry/crd.projectcalico.org/tiers0; response_count:0; response_revision:1761; }","duration":"2.861550402s","start":"2025-07-15T10:59:36.305030Z","end":"2025-07-15T10:59:39.166580Z","steps":["trace[921249460] 'agreement among raft nodes before linearized reading' (duration: 2.861332951s)"],"step_count":1} Jul 15 10:59:39.169287 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:39.166732Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:59:36.305004Z","time spent":"2.861680112s","remote":"172.24.4.207:59328","response type":"/etcdserverpb.KV/Range","request count":0,"request size":82,"response count":3,"response size":31,"request content":"key:\"/registry/crd.projectcalico.org/tiers/\" range_end:\"/registry/crd.projectcalico.org/tiers0\" count_only:true "} Jul 15 10:59:39.171104 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:39.169940Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"694.89713ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/networkpolicies/\" range_end:\"/registry/crd.projectcalico.org/networkpolicies0\" count_only:true ","response":"range_response_count:0 size:5"} Jul 15 10:59:39.171104 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:39.170618Z","caller":"traceutil/trace.go:171","msg":"trace[1747593863] range","detail":"{range_begin:/registry/crd.projectcalico.org/networkpolicies/; range_end:/registry/crd.projectcalico.org/networkpolicies0; response_count:0; response_revision:1761; }","duration":"695.640544ms","start":"2025-07-15T10:59:38.474945Z","end":"2025-07-15T10:59:39.170585Z","steps":["trace[1747593863] 'agreement among raft nodes before linearized reading' (duration: 694.909233ms)"],"step_count":1} Jul 15 10:59:39.186970 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:39.170794Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"345.808382ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/installations.operator.tigera.io\" limit:1 ","response":"range_response_count:1 size:630504"} Jul 15 10:59:39.186970 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:39.171578Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:59:38.474910Z","time spent":"696.036846ms","remote":"172.24.4.207:59368","response type":"/etcdserverpb.KV/Range","request count":0,"request size":102,"response count":0,"response size":29,"request content":"key:\"/registry/crd.projectcalico.org/networkpolicies/\" range_end:\"/registry/crd.projectcalico.org/networkpolicies0\" count_only:true "} Jul 15 10:59:39.186970 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:39.171475Z","caller":"traceutil/trace.go:171","msg":"trace[1914530019] range","detail":"{range_begin:/registry/apiextensions.k8s.io/customresourcedefinitions/installations.operator.tigera.io; range_end:; response_count:1; response_revision:1761; }","duration":"346.464092ms","start":"2025-07-15T10:59:38.824907Z","end":"2025-07-15T10:59:39.171371Z","steps":["trace[1914530019] 'agreement among raft nodes before linearized reading' (duration: 337.389677ms)"],"step_count":1} Jul 15 10:59:39.186970 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:39.172557Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:59:38.824741Z","time spent":"347.403889ms","remote":"172.24.4.207:54256","response type":"/etcdserverpb.KV/Range","request count":0,"request size":93,"response count":1,"response size":630528,"request content":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/installations.operator.tigera.io\" limit:1 "} Jul 15 10:59:39.188140 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:39.173215Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.997547051s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/deployments\" limit:1 ","response":"range_response_count:0 size:5"} Jul 15 10:59:39.188140 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:39.173342Z","caller":"traceutil/trace.go:171","msg":"trace[508969624] range","detail":"{range_begin:/registry/deployments; range_end:; response_count:0; response_revision:1761; }","duration":"2.997748654s","start":"2025-07-15T10:59:36.175569Z","end":"2025-07-15T10:59:39.173318Z","steps":["trace[508969624] 'agreement among raft nodes before linearized reading' (duration: 2.997532024s)"],"step_count":1} Jul 15 10:59:39.188140 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:39.173673Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:59:36.175559Z","time spent":"2.998086538s","remote":"172.24.4.207:54636","response type":"/etcdserverpb.KV/Range","request count":0,"request size":25,"response count":0,"response size":29,"request content":"key:\"/registry/deployments\" limit:1 "} Jul 15 10:59:39.309068 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:39.307008Z","caller":"traceutil/trace.go:171","msg":"trace[289695868] transaction","detail":"{read_only:false; number_of_response:0; response_revision:1762; }","duration":"120.791765ms","start":"2025-07-15T10:59:39.186189Z","end":"2025-07-15T10:59:39.306981Z","steps":["trace[289695868] 'process raft request' (duration: 120.73534ms)"],"step_count":1} Jul 15 10:59:39.309068 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:39.307134Z","caller":"traceutil/trace.go:171","msg":"trace[1316266787] transaction","detail":"{read_only:false; response_revision:1762; number_of_response:1; }","duration":"145.055308ms","start":"2025-07-15T10:59:39.162007Z","end":"2025-07-15T10:59:39.307062Z","steps":["trace[1316266787] 'process raft request' (duration: 109.383979ms)","trace[1316266787] 'compare' (duration: 35.250392ms)"],"step_count":2} Jul 15 10:59:39.309068 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:39.307235Z","caller":"traceutil/trace.go:171","msg":"trace[2061783007] linearizableReadLoop","detail":"{readStateIndex:2035; appliedIndex:2034; }","duration":"133.964349ms","start":"2025-07-15T10:59:39.173255Z","end":"2025-07-15T10:59:39.307219Z","steps":["trace[2061783007] 'read index received' (duration: 98.154665ms)","trace[2061783007] 'applied index is now lower than readState.Index' (duration: 35.808401ms)"],"step_count":2} Jul 15 10:59:39.309068 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:39.307486Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"134.220262ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jul 15 10:59:39.309068 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:39.307573Z","caller":"traceutil/trace.go:171","msg":"trace[45121858] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1762; }","duration":"134.369406ms","start":"2025-07-15T10:59:39.173190Z","end":"2025-07-15T10:59:39.307560Z","steps":["trace[45121858] 'agreement among raft nodes before linearized reading' (duration: 134.122991ms)"],"step_count":1} Jul 15 10:59:39.310459 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:39.307989Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"121.114631ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/tigerastatuses/calico\" limit:1 ","response":"range_response_count:1 size:1130"} Jul 15 10:59:39.310459 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:39.309374Z","caller":"traceutil/trace.go:171","msg":"trace[453823854] range","detail":"{range_begin:/registry/operator.tigera.io/tigerastatuses/calico; range_end:; response_count:1; response_revision:1762; }","duration":"122.593874ms","start":"2025-07-15T10:59:39.186700Z","end":"2025-07-15T10:59:39.309293Z","steps":["trace[453823854] 'agreement among raft nodes before linearized reading' (duration: 120.764085ms)"],"step_count":1} Jul 15 10:59:48.095505 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:48.092219Z","caller":"traceutil/trace.go:171","msg":"trace[240599252] transaction","detail":"{read_only:false; response_revision:1776; number_of_response:1; }","duration":"429.511381ms","start":"2025-07-15T10:59:47.662537Z","end":"2025-07-15T10:59:48.092048Z","steps":["trace[240599252] 'process raft request' (duration: 428.712897ms)"],"step_count":1} Jul 15 10:59:48.101537 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:48.097291Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:59:47.662481Z","time spent":"433.435257ms","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":490,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 10:59:48.133850 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:48.132912Z","caller":"traceutil/trace.go:171","msg":"trace[1297716393] transaction","detail":"{read_only:false; response_revision:1777; number_of_response:1; }","duration":"469.776343ms","start":"2025-07-15T10:59:47.662959Z","end":"2025-07-15T10:59:48.132735Z","steps":["trace[1297716393] 'process raft request' (duration: 469.384048ms)"],"step_count":1} Jul 15 10:59:48.133850 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:48.133305Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:59:47.662948Z","time spent":"470.193933ms","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":517,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 10:59:48.135307 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:48.133556Z","caller":"traceutil/trace.go:171","msg":"trace[1938838698] transaction","detail":"{read_only:false; response_revision:1778; number_of_response:1; }","duration":"465.655692ms","start":"2025-07-15T10:59:47.667877Z","end":"2025-07-15T10:59:48.133533Z","steps":["trace[1938838698] 'process raft request' (duration: 464.730955ms)"],"step_count":1} Jul 15 10:59:48.135307 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:48.134668Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:59:47.667859Z","time spent":"466.707084ms","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":625,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 10:59:48.138094 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:48.135852Z","caller":"traceutil/trace.go:171","msg":"trace[202649347] linearizableReadLoop","detail":"{readStateIndex:2054; appliedIndex:2052; }","duration":"435.843744ms","start":"2025-07-15T10:59:47.699852Z","end":"2025-07-15T10:59:48.135696Z","steps":["trace[202649347] 'read index received' (duration: 394.013392ms)","trace[202649347] 'applied index is now lower than readState.Index' (duration: 41.829481ms)"],"step_count":2} Jul 15 10:59:48.138884 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:48.136354Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"436.490688ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/masterleases/172.24.4.207\" limit:1 ","response":"range_response_count:1 size:131"} Jul 15 10:59:48.138884 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:48.136358Z","caller":"traceutil/trace.go:171","msg":"trace[1892470308] transaction","detail":"{read_only:false; response_revision:1779; number_of_response:1; }","duration":"433.197297ms","start":"2025-07-15T10:59:47.703108Z","end":"2025-07-15T10:59:48.136305Z","steps":["trace[1892470308] 'process raft request' (duration: 429.957835ms)"],"step_count":1} Jul 15 10:59:48.138884 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:48.136497Z","caller":"traceutil/trace.go:171","msg":"trace[1508830973] range","detail":"{range_begin:/registry/masterleases/172.24.4.207; range_end:; response_count:1; response_revision:1781; }","duration":"436.679007ms","start":"2025-07-15T10:59:47.699789Z","end":"2025-07-15T10:59:48.136468Z","steps":["trace[1508830973] 'agreement among raft nodes before linearized reading' (duration: 436.341964ms)"],"step_count":1} Jul 15 10:59:48.138884 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:48.136594Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:59:47.699774Z","time spent":"436.782468ms","remote":"172.24.4.207:54228","response type":"/etcdserverpb.KV/Range","request count":0,"request size":39,"response count":1,"response size":155,"request content":"key:\"/registry/masterleases/172.24.4.207\" limit:1 "} Jul 15 10:59:48.139444 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:48.136592Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:59:47.703094Z","time spent":"433.397667ms","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":699,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 10:59:48.139444 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:48.136767Z","caller":"traceutil/trace.go:171","msg":"trace[2001139898] transaction","detail":"{read_only:false; response_revision:1780; number_of_response:1; }","duration":"352.368334ms","start":"2025-07-15T10:59:47.784361Z","end":"2025-07-15T10:59:48.136729Z","steps":["trace[2001139898] 'process raft request' (duration: 350.410318ms)"],"step_count":1} Jul 15 10:59:48.139444 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:48.136950Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:59:47.784335Z","time spent":"352.533509ms","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":489,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 10:59:48.139444 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:48.136966Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"436.729579ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/roles/\" range_end:\"/registry/roles0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 10:59:48.140048 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:48.137044Z","caller":"traceutil/trace.go:171","msg":"trace[536855947] range","detail":"{range_begin:/registry/roles/; range_end:/registry/roles0; response_count:0; response_revision:1781; }","duration":"436.839774ms","start":"2025-07-15T10:59:47.700193Z","end":"2025-07-15T10:59:48.137033Z","steps":["trace[536855947] 'agreement among raft nodes before linearized reading' (duration: 436.505215ms)"],"step_count":1} Jul 15 10:59:48.140048 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:48.137143Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:59:47.700186Z","time spent":"436.896628ms","remote":"172.24.4.207:54514","response type":"/etcdserverpb.KV/Range","request count":0,"request size":38,"response count":12,"response size":31,"request content":"key:\"/registry/roles/\" range_end:\"/registry/roles0\" count_only:true "} Jul 15 10:59:48.140048 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:48.137348Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"386.115008ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jul 15 10:59:48.140048 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:48.137424Z","caller":"traceutil/trace.go:171","msg":"trace[721493565] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1781; }","duration":"386.194404ms","start":"2025-07-15T10:59:47.751177Z","end":"2025-07-15T10:59:48.137372Z","steps":["trace[721493565] 'agreement among raft nodes before linearized reading' (duration: 386.145414ms)"],"step_count":1} Jul 15 10:59:48.140048 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:48.137513Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:59:47.751159Z","time spent":"386.300369ms","remote":"172.24.4.207:54212","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":29,"request content":"key:\"/registry/health\" "} Jul 15 10:59:48.140611 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:48.137649Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"436.70768ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/policy.networking.k8s.io/adminnetworkpolicies/\" range_end:\"/registry/policy.networking.k8s.io/adminnetworkpolicies0\" count_only:true ","response":"range_response_count:0 size:5"} Jul 15 10:59:48.140611 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:48.137727Z","caller":"traceutil/trace.go:171","msg":"trace[1535183225] range","detail":"{range_begin:/registry/policy.networking.k8s.io/adminnetworkpolicies/; range_end:/registry/policy.networking.k8s.io/adminnetworkpolicies0; response_count:0; response_revision:1781; }","duration":"436.828673ms","start":"2025-07-15T10:59:47.700879Z","end":"2025-07-15T10:59:48.137708Z","steps":["trace[1535183225] 'agreement among raft nodes before linearized reading' (duration: 436.686601ms)"],"step_count":1} Jul 15 10:59:48.140611 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:48.137835Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:59:47.700872Z","time spent":"436.883764ms","remote":"172.24.4.207:59420","response type":"/etcdserverpb.KV/Range","request count":0,"request size":118,"response count":0,"response size":29,"request content":"key:\"/registry/policy.networking.k8s.io/adminnetworkpolicies/\" range_end:\"/registry/policy.networking.k8s.io/adminnetworkpolicies0\" count_only:true "} Jul 15 10:59:48.326792 update_engine[1386]: I20250715 10:59:48.326000 1386 prefs.cc:52] certificate-report-to-send-update not present in /var/lib/update_engine/prefs Jul 15 10:59:48.326792 update_engine[1386]: I20250715 10:59:48.326507 1386 prefs.cc:52] certificate-report-to-send-download not present in /var/lib/update_engine/prefs Jul 15 10:59:48.330126 update_engine[1386]: I20250715 10:59:48.330047 1386 prefs.cc:52] aleph-version not present in /var/lib/update_engine/prefs Jul 15 10:59:48.334631 update_engine[1386]: I20250715 10:59:48.334340 1386 omaha_request_params.cc:62] Current group set to stable Jul 15 10:59:48.335884 update_engine[1386]: I20250715 10:59:48.335650 1386 update_attempter.cc:499] Already updated boot flags. Skipping. Jul 15 10:59:48.335884 update_engine[1386]: I20250715 10:59:48.335705 1386 update_attempter.cc:643] Scheduling an action processor start. Jul 15 10:59:48.347064 update_engine[1386]: I20250715 10:59:48.335865 1386 action_processor.cc:36] ActionProcessor::StartProcessing: OmahaRequestAction Jul 15 10:59:48.347064 update_engine[1386]: I20250715 10:59:48.336166 1386 prefs.cc:52] previous-version not present in /var/lib/update_engine/prefs Jul 15 10:59:48.347064 update_engine[1386]: I20250715 10:59:48.336428 1386 omaha_request_action.cc:271] Posting an Omaha request to disabled Jul 15 10:59:48.347064 update_engine[1386]: I20250715 10:59:48.336463 1386 omaha_request_action.cc:272] Request: Jul 15 10:59:48.347064 update_engine[1386]: Jul 15 10:59:48.347064 update_engine[1386]: Jul 15 10:59:48.347064 update_engine[1386]: Jul 15 10:59:48.347064 update_engine[1386]: Jul 15 10:59:48.347064 update_engine[1386]: Jul 15 10:59:48.347064 update_engine[1386]: Jul 15 10:59:48.347064 update_engine[1386]: Jul 15 10:59:48.347064 update_engine[1386]: Jul 15 10:59:48.347064 update_engine[1386]: I20250715 10:59:48.336560 1386 libcurl_http_fetcher.cc:47] Starting/Resuming transfer Jul 15 10:59:48.354496 locksmithd[1403]: LastCheckedTime=0 Progress=0 CurrentOperation="UPDATE_STATUS_CHECKING_FOR_UPDATE" NewVersion=0.0.0 NewSize=0 Jul 15 10:59:48.357144 update_engine[1386]: I20250715 10:59:48.357038 1386 libcurl_http_fetcher.cc:151] Setting up curl options for HTTP Jul 15 10:59:48.359754 update_engine[1386]: I20250715 10:59:48.359591 1386 libcurl_http_fetcher.cc:449] Setting up timeout source: 1 seconds. Jul 15 10:59:48.367719 update_engine[1386]: E20250715 10:59:48.367579 1386 libcurl_http_fetcher.cc:266] Unable to get http response code: Could not resolve host: disabled Jul 15 10:59:48.367980 update_engine[1386]: I20250715 10:59:48.367915 1386 libcurl_http_fetcher.cc:283] No HTTP response, retry 1 Jul 15 10:59:51.035934 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:51.034608Z","caller":"wal/wal.go:805","msg":"slow fdatasync","took":"1.769250927s","expected-duration":"1s"} Jul 15 10:59:51.148576 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:51.145660Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"110.119841ms","expected-duration":"100ms","prefix":"","request":"header: lease_revoke:","response":"size:29"} Jul 15 10:59:51.148946 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:51.146052Z","caller":"traceutil/trace.go:171","msg":"trace[1302193370] linearizableReadLoop","detail":"{readStateIndex:2060; appliedIndex:2059; }","duration":"349.471676ms","start":"2025-07-15T10:59:50.796551Z","end":"2025-07-15T10:59:51.146023Z","steps":["trace[1302193370] 'read index received' (duration: 238.923474ms)","trace[1302193370] 'applied index is now lower than readState.Index' (duration: 110.544736ms)"],"step_count":2} Jul 15 10:59:51.148946 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:51.146241Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"349.670863ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/goldmanes/\" range_end:\"/registry/operator.tigera.io/goldmanes0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 10:59:51.148946 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:51.146319Z","caller":"traceutil/trace.go:171","msg":"trace[57746195] range","detail":"{range_begin:/registry/operator.tigera.io/goldmanes/; range_end:/registry/operator.tigera.io/goldmanes0; response_count:0; response_revision:1782; }","duration":"349.792568ms","start":"2025-07-15T10:59:50.796497Z","end":"2025-07-15T10:59:51.146290Z","steps":["trace[57746195] 'agreement among raft nodes before linearized reading' (duration: 349.693345ms)"],"step_count":1} Jul 15 10:59:51.148946 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:51.146395Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:59:50.796469Z","time spent":"349.88627ms","remote":"172.24.4.207:47714","response type":"/etcdserverpb.KV/Range","request count":0,"request size":84,"response count":1,"response size":31,"request content":"key:\"/registry/operator.tigera.io/goldmanes/\" range_end:\"/registry/operator.tigera.io/goldmanes0\" count_only:true "} Jul 15 10:59:51.149759 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:51.146518Z","caller":"traceutil/trace.go:171","msg":"trace[1429098629] transaction","detail":"{read_only:false; response_revision:1785; number_of_response:1; }","duration":"128.399647ms","start":"2025-07-15T10:59:51.018100Z","end":"2025-07-15T10:59:51.146499Z","steps":["trace[1429098629] 'process raft request' (duration: 128.292669ms)"],"step_count":1} Jul 15 10:59:51.149759 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:51.146766Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"342.657434ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/services/specs/\" range_end:\"/registry/services/specs0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 10:59:51.149759 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:51.146865Z","caller":"traceutil/trace.go:171","msg":"trace[104761695] range","detail":"{range_begin:/registry/services/specs/; range_end:/registry/services/specs0; response_count:0; response_revision:1785; }","duration":"342.789788ms","start":"2025-07-15T10:59:50.804059Z","end":"2025-07-15T10:59:51.146849Z","steps":["trace[104761695] 'agreement among raft nodes before linearized reading' (duration: 342.496517ms)"],"step_count":1} Jul 15 10:59:51.149759 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:51.146918Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:59:50.804044Z","time spent":"342.853967ms","remote":"172.24.4.207:54356","response type":"/etcdserverpb.KV/Range","request count":0,"request size":56,"response count":7,"response size":31,"request content":"key:\"/registry/services/specs/\" range_end:\"/registry/services/specs0\" count_only:true "} Jul 15 10:59:51.149759 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:51.147122Z","caller":"traceutil/trace.go:171","msg":"trace[2091474092] transaction","detail":"{read_only:false; response_revision:1783; number_of_response:1; }","duration":"129.271317ms","start":"2025-07-15T10:59:51.017784Z","end":"2025-07-15T10:59:51.147055Z","steps":["trace[2091474092] 'process raft request' (duration: 128.001212ms)"],"step_count":1} Jul 15 10:59:51.150566 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:51.147291Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"179.422834ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/clusterinformations/default\" limit:1 ","response":"range_response_count:1 size:886"} Jul 15 10:59:51.150566 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:51.147347Z","caller":"traceutil/trace.go:171","msg":"trace[1127839156] range","detail":"{range_begin:/registry/crd.projectcalico.org/clusterinformations/default; range_end:; response_count:1; response_revision:1785; }","duration":"179.569052ms","start":"2025-07-15T10:59:50.967763Z","end":"2025-07-15T10:59:51.147332Z","steps":["trace[1127839156] 'agreement among raft nodes before linearized reading' (duration: 179.255533ms)"],"step_count":1} Jul 15 10:59:51.150566 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:51.147335Z","caller":"traceutil/trace.go:171","msg":"trace[1723450765] transaction","detail":"{read_only:false; response_revision:1784; number_of_response:1; }","duration":"129.334513ms","start":"2025-07-15T10:59:51.017982Z","end":"2025-07-15T10:59:51.147317Z","steps":["trace[1723450765] 'process raft request' (duration: 128.250041ms)"],"step_count":1} Jul 15 10:59:51.150566 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:51.147489Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"198.601358ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jul 15 10:59:51.150566 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:51.147525Z","caller":"traceutil/trace.go:171","msg":"trace[1048224893] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1785; }","duration":"198.723023ms","start":"2025-07-15T10:59:50.948790Z","end":"2025-07-15T10:59:51.147513Z","steps":["trace[1048224893] 'agreement among raft nodes before linearized reading' (duration: 198.674734ms)"],"step_count":1} Jul 15 10:59:51.151104 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:51.147611Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"235.127637ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/whiskers/\" range_end:\"/registry/operator.tigera.io/whiskers0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 10:59:51.151104 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:51.147683Z","caller":"traceutil/trace.go:171","msg":"trace[1370813767] range","detail":"{range_begin:/registry/operator.tigera.io/whiskers/; range_end:/registry/operator.tigera.io/whiskers0; response_count:0; response_revision:1785; }","duration":"235.223072ms","start":"2025-07-15T10:59:50.912420Z","end":"2025-07-15T10:59:51.147643Z","steps":["trace[1370813767] 'agreement among raft nodes before linearized reading' (duration: 235.158573ms)"],"step_count":1} Jul 15 10:59:51.151104 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:51.148976Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"314.799873ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/replicasets/\" range_end:\"/registry/replicasets0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 10:59:51.151104 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:51.149333Z","caller":"traceutil/trace.go:171","msg":"trace[2094773591] range","detail":"{range_begin:/registry/replicasets/; range_end:/registry/replicasets0; response_count:0; response_revision:1785; }","duration":"315.250976ms","start":"2025-07-15T10:59:50.834062Z","end":"2025-07-15T10:59:51.149313Z","steps":["trace[2094773591] 'agreement among raft nodes before linearized reading' (duration: 313.803213ms)"],"step_count":1} Jul 15 10:59:51.151471 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:51.149876Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:59:50.834041Z","time spent":"315.74642ms","remote":"172.24.4.207:54658","response type":"/etcdserverpb.KV/Range","request count":0,"request size":50,"response count":10,"response size":31,"request content":"key:\"/registry/replicasets/\" range_end:\"/registry/replicasets0\" count_only:true "} Jul 15 10:59:51.450902 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:51.449484Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"145.160295ms","expected-duration":"100ms","prefix":"","request":"header: txn: success:> failure:<>>","response":"size:5"} Jul 15 10:59:51.450902 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:51.449793Z","caller":"traceutil/trace.go:171","msg":"trace[344987306] transaction","detail":"{read_only:false; number_of_response:0; response_revision:1785; }","duration":"160.411937ms","start":"2025-07-15T10:59:51.289335Z","end":"2025-07-15T10:59:51.449747Z","steps":["trace[344987306] 'compare' (duration: 145.062274ms)"],"step_count":1} Jul 15 10:59:52.725753 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:52.724845Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"105.210737ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/baselineadminnetworkpolicies.policy.networking.k8s.io\" limit:1 ","response":"range_response_count:1 size:33082"} Jul 15 10:59:52.725753 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:52.724956Z","caller":"traceutil/trace.go:171","msg":"trace[48359310] range","detail":"{range_begin:/registry/apiextensions.k8s.io/customresourcedefinitions/baselineadminnetworkpolicies.policy.networking.k8s.io; range_end:; response_count:1; response_revision:1788; }","duration":"105.434911ms","start":"2025-07-15T10:59:52.619503Z","end":"2025-07-15T10:59:52.724938Z","steps":["trace[48359310] 'range keys from in-memory index tree' (duration: 104.869216ms)"],"step_count":1} Jul 15 10:59:53.676414 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:53.674768Z","caller":"traceutil/trace.go:171","msg":"trace[1315694455] transaction","detail":"{read_only:false; response_revision:1794; number_of_response:1; }","duration":"202.803468ms","start":"2025-07-15T10:59:53.471937Z","end":"2025-07-15T10:59:53.674740Z","steps":["trace[1315694455] 'process raft request' (duration: 145.361087ms)","trace[1315694455] 'compare' (duration: 57.034628ms)"],"step_count":2} Jul 15 10:59:53.676414 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:53.675154Z","caller":"traceutil/trace.go:171","msg":"trace[1300699500] transaction","detail":"{read_only:false; response_revision:1795; number_of_response:1; }","duration":"194.265983ms","start":"2025-07-15T10:59:53.480848Z","end":"2025-07-15T10:59:53.675114Z","steps":["trace[1300699500] 'process raft request' (duration: 193.762222ms)"],"step_count":1} Jul 15 10:59:57.912735 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:57.911520Z","caller":"traceutil/trace.go:171","msg":"trace[84718274] linearizableReadLoop","detail":"{readStateIndex:2085; appliedIndex:2084; }","duration":"129.451078ms","start":"2025-07-15T10:59:57.782038Z","end":"2025-07-15T10:59:57.911489Z","steps":["trace[84718274] 'read index received' (duration: 71.63052ms)","trace[84718274] 'applied index is now lower than readState.Index' (duration: 57.819176ms)"],"step_count":2} Jul 15 10:59:57.912735 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:57.911727Z","caller":"traceutil/trace.go:171","msg":"trace[1830698877] transaction","detail":"{read_only:false; response_revision:1802; number_of_response:1; }","duration":"130.711034ms","start":"2025-07-15T10:59:57.780991Z","end":"2025-07-15T10:59:57.911702Z","steps":["trace[1830698877] 'process raft request' (duration: 72.734778ms)","trace[1830698877] 'compare' (duration: 57.545261ms)"],"step_count":2} Jul 15 10:59:57.914670 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:57.913329Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"127.695147ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/services/specs/calico-system/calico-kube-controllers-metrics\" limit:1 ","response":"range_response_count:1 size:1065"} Jul 15 10:59:57.914670 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:57.913440Z","caller":"traceutil/trace.go:171","msg":"trace[1886266885] range","detail":"{range_begin:/registry/services/specs/calico-system/calico-kube-controllers-metrics; range_end:; response_count:1; response_revision:1802; }","duration":"127.850653ms","start":"2025-07-15T10:59:57.785543Z","end":"2025-07-15T10:59:57.913394Z","steps":["trace[1886266885] 'agreement among raft nodes before linearized reading' (duration: 127.32931ms)"],"step_count":1} Jul 15 10:59:57.914670 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:57.912363Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"130.276963ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jul 15 10:59:57.914670 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:57.913953Z","caller":"traceutil/trace.go:171","msg":"trace[1376925408] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1802; }","duration":"131.908988ms","start":"2025-07-15T10:59:57.782021Z","end":"2025-07-15T10:59:57.913930Z","steps":["trace[1376925408] 'agreement among raft nodes before linearized reading' (duration: 129.999812ms)"],"step_count":1} Jul 15 10:59:58.291182 update_engine[1386]: I20250715 10:59:58.290864 1386 libcurl_http_fetcher.cc:47] Starting/Resuming transfer Jul 15 10:59:58.292395 update_engine[1386]: I20250715 10:59:58.291234 1386 libcurl_http_fetcher.cc:151] Setting up curl options for HTTP Jul 15 10:59:58.292395 update_engine[1386]: I20250715 10:59:58.291631 1386 libcurl_http_fetcher.cc:449] Setting up timeout source: 1 seconds. Jul 15 10:59:58.296783 update_engine[1386]: E20250715 10:59:58.296690 1386 libcurl_http_fetcher.cc:266] Unable to get http response code: Could not resolve host: disabled Jul 15 10:59:58.297013 update_engine[1386]: I20250715 10:59:58.296833 1386 libcurl_http_fetcher.cc:283] No HTTP response, retry 2 Jul 15 10:59:58.756388 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:58.755582Z","caller":"traceutil/trace.go:171","msg":"trace[1428708532] transaction","detail":"{read_only:false; response_revision:1803; number_of_response:1; }","duration":"410.804095ms","start":"2025-07-15T10:59:58.344740Z","end":"2025-07-15T10:59:58.755544Z","steps":["trace[1428708532] 'process raft request' (duration: 410.380874ms)"],"step_count":1} Jul 15 10:59:58.757140 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:58.755988Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T10:59:58.344723Z","time spent":"411.035362ms","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":532,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 10:59:58.925191 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:58.923192Z","caller":"traceutil/trace.go:171","msg":"trace[1896834950] linearizableReadLoop","detail":"{readStateIndex:2087; appliedIndex:2086; }","duration":"166.715831ms","start":"2025-07-15T10:59:58.756448Z","end":"2025-07-15T10:59:58.923164Z","steps":["trace[1896834950] 'read index received' (duration: 154.938454ms)","trace[1896834950] 'applied index is now lower than readState.Index' (duration: 11.776004ms)"],"step_count":2} Jul 15 10:59:58.925191 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:58.923771Z","caller":"traceutil/trace.go:171","msg":"trace[1345510566] transaction","detail":"{read_only:false; response_revision:1804; number_of_response:1; }","duration":"221.854869ms","start":"2025-07-15T10:59:58.701894Z","end":"2025-07-15T10:59:58.923749Z","steps":["trace[1345510566] 'process raft request' (duration: 209.479307ms)","trace[1345510566] 'compare' (duration: 11.630146ms)"],"step_count":2} Jul 15 10:59:58.925191 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:58.924052Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"222.405335ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/masterleases/\" range_end:\"/registry/masterleases0\" ","response":"range_response_count:1 size:131"} Jul 15 10:59:58.925191 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:58.924119Z","caller":"traceutil/trace.go:171","msg":"trace[2065649212] range","detail":"{range_begin:/registry/masterleases/; range_end:/registry/masterleases0; response_count:1; response_revision:1804; }","duration":"222.495683ms","start":"2025-07-15T10:59:58.701590Z","end":"2025-07-15T10:59:58.924085Z","steps":["trace[2065649212] 'agreement among raft nodes before linearized reading' (duration: 222.336018ms)"],"step_count":1} Jul 15 10:59:58.938532 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:58.936503Z","caller":"traceutil/trace.go:171","msg":"trace[941286169] transaction","detail":"{read_only:false; response_revision:1805; number_of_response:1; }","duration":"141.217767ms","start":"2025-07-15T10:59:58.795261Z","end":"2025-07-15T10:59:58.936479Z","steps":["trace[941286169] 'process raft request' (duration: 140.971672ms)"],"step_count":1} Jul 15 10:59:58.938532 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:58.937123Z","caller":"traceutil/trace.go:171","msg":"trace[1602510317] transaction","detail":"{read_only:false; response_revision:1806; number_of_response:1; }","duration":"104.96772ms","start":"2025-07-15T10:59:58.832137Z","end":"2025-07-15T10:59:58.937105Z","steps":["trace[1602510317] 'process raft request' (duration: 104.28001ms)"],"step_count":1} Jul 15 10:59:58.938532 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T10:59:58.937879Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"158.396539ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/bgpconfigurations/\" range_end:\"/registry/crd.projectcalico.org/bgpconfigurations0\" count_only:true ","response":"range_response_count:0 size:5"} Jul 15 10:59:58.939183 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T10:59:58.938221Z","caller":"traceutil/trace.go:171","msg":"trace[771523236] range","detail":"{range_begin:/registry/crd.projectcalico.org/bgpconfigurations/; range_end:/registry/crd.projectcalico.org/bgpconfigurations0; response_count:0; response_revision:1806; }","duration":"158.878499ms","start":"2025-07-15T10:59:58.779301Z","end":"2025-07-15T10:59:58.938180Z","steps":["trace[771523236] 'agreement among raft nodes before linearized reading' (duration: 158.328233ms)"],"step_count":1} Jul 15 11:00:07.667946 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:07.652488Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"123.954402ms","expected-duration":"100ms","prefix":"","request":"header: txn: success:> failure: >>","response":"size:16"} Jul 15 11:00:07.667946 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:07.652838Z","caller":"traceutil/trace.go:171","msg":"trace[211382081] linearizableReadLoop","detail":"{readStateIndex:2143; appliedIndex:2142; }","duration":"129.640901ms","start":"2025-07-15T11:00:07.523128Z","end":"2025-07-15T11:00:07.652769Z","steps":["trace[211382081] 'read index received' (duration: 5.110536ms)","trace[211382081] 'applied index is now lower than readState.Index' (duration: 124.528882ms)"],"step_count":2} Jul 15 11:00:07.667946 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:07.652862Z","caller":"traceutil/trace.go:171","msg":"trace[1887621549] transaction","detail":"{read_only:false; response_revision:1856; number_of_response:1; }","duration":"171.97704ms","start":"2025-07-15T11:00:07.480848Z","end":"2025-07-15T11:00:07.652826Z","steps":["trace[1887621549] 'process raft request' (duration: 47.485527ms)","trace[1887621549] 'compare' (duration: 123.810014ms)"],"step_count":2} Jul 15 11:00:07.667946 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:07.664865Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"141.017289ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/installations.operator.tigera.io\" limit:1 ","response":"range_response_count:1 size:630504"} Jul 15 11:00:07.679158 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:07.665976Z","caller":"traceutil/trace.go:171","msg":"trace[716111441] range","detail":"{range_begin:/registry/apiextensions.k8s.io/customresourcedefinitions/installations.operator.tigera.io; range_end:; response_count:1; response_revision:1856; }","duration":"142.565317ms","start":"2025-07-15T11:00:07.523051Z","end":"2025-07-15T11:00:07.665616Z","steps":["trace[716111441] 'agreement among raft nodes before linearized reading' (duration: 129.842914ms)"],"step_count":1} Jul 15 11:00:08.297871 update_engine[1386]: I20250715 11:00:08.295683 1386 libcurl_http_fetcher.cc:47] Starting/Resuming transfer Jul 15 11:00:08.299544 update_engine[1386]: I20250715 11:00:08.299491 1386 libcurl_http_fetcher.cc:151] Setting up curl options for HTTP Jul 15 11:00:08.301986 update_engine[1386]: I20250715 11:00:08.301746 1386 libcurl_http_fetcher.cc:449] Setting up timeout source: 1 seconds. Jul 15 11:00:08.307341 update_engine[1386]: E20250715 11:00:08.307147 1386 libcurl_http_fetcher.cc:266] Unable to get http response code: Could not resolve host: disabled Jul 15 11:00:08.307341 update_engine[1386]: I20250715 11:00:08.307286 1386 libcurl_http_fetcher.cc:283] No HTTP response, retry 3 Jul 15 11:00:09.122750 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:08.243748Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875176011,"retry-timeout":"500ms"} Jul 15 11:00:09.122750 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:08.744791Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875176011,"retry-timeout":"500ms"} Jul 15 11:00:09.246145 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:09.245315Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875176011,"retry-timeout":"500ms"} Jul 15 11:00:11.789969 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:09.742856Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.999776424s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context deadline exceeded"} Jul 15 11:00:11.789969 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:09.743080Z","caller":"traceutil/trace.go:171","msg":"trace[429552324] range","detail":"{range_begin:/registry/health; range_end:; }","duration":"2.000154101s","start":"2025-07-15T11:00:07.742896Z","end":"2025-07-15T11:00:09.743050Z","steps":["trace[429552324] 'agreement among raft nodes before linearized reading' (duration: 1.999820965s)"],"step_count":1} Jul 15 11:00:11.789969 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:09.743455Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:07.742866Z","time spent":"2.000400276s","remote":"172.24.4.207:54212","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "} Jul 15 11:00:11.789969 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:09.745668Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875176011,"retry-timeout":"500ms"} Jul 15 11:00:11.789969 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:10.246550Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875176011,"retry-timeout":"500ms"} Jul 15 11:00:11.789969 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:10.747535Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875176011,"retry-timeout":"500ms"} Jul 15 11:00:11.789969 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:11.248671Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875176011,"retry-timeout":"500ms"} Jul 15 11:00:11.791632 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:11.749437Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875176011,"retry-timeout":"500ms"} Jul 15 11:00:11.899580 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:11.898506Z","caller":"wal/wal.go:805","msg":"slow fdatasync","took":"4.193779529s","expected-duration":"1s"} Jul 15 11:00:11.919039 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:11.917713Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:11.334266Z","time spent":"583.422124ms","remote":"172.24.4.207:39984","response type":"/etcdserverpb.Maintenance/Status","request count":-1,"request size":-1,"response count":-1,"response size":-1,"request content":""} Jul 15 11:00:11.920141 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:11.918796Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:07.703844Z","time spent":"4.214940374s","remote":"172.24.4.207:54228","response type":"/etcdserverpb.Lease/LeaseGrant","request count":-1,"request size":-1,"response count":-1,"response size":-1,"request content":""} Jul 15 11:00:12.070505 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:12.069511Z","caller":"traceutil/trace.go:171","msg":"trace[1165804141] transaction","detail":"{read_only:false; response_revision:1857; number_of_response:1; }","duration":"351.937117ms","start":"2025-07-15T11:00:11.717539Z","end":"2025-07-15T11:00:12.069476Z","steps":["trace[1165804141] 'process raft request' (duration: 302.657097ms)","trace[1165804141] 'compare' (duration: 48.283259ms)"],"step_count":2} Jul 15 11:00:12.076644 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:12.075690Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:11.717461Z","time spent":"352.211764ms","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":699,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 11:00:12.078087 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:12.076702Z","caller":"traceutil/trace.go:171","msg":"trace[1606996035] transaction","detail":"{read_only:false; response_revision:1858; number_of_response:1; }","duration":"352.250947ms","start":"2025-07-15T11:00:11.724409Z","end":"2025-07-15T11:00:12.076660Z","steps":["trace[1606996035] 'process raft request' (duration: 344.753061ms)"],"step_count":1} Jul 15 11:00:12.078087 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:12.077060Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:11.724254Z","time spent":"352.679468ms","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":489,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 11:00:12.080576 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:12.078611Z","caller":"traceutil/trace.go:171","msg":"trace[366919322] transaction","detail":"{read_only:false; response_revision:1859; number_of_response:1; }","duration":"297.8876ms","start":"2025-07-15T11:00:11.780676Z","end":"2025-07-15T11:00:12.078564Z","steps":["trace[366919322] 'process raft request' (duration: 295.858844ms)"],"step_count":1} Jul 15 11:00:12.085291 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:12.084303Z","caller":"traceutil/trace.go:171","msg":"trace[714805016] transaction","detail":"{read_only:false; response_revision:1860; number_of_response:1; }","duration":"301.926178ms","start":"2025-07-15T11:00:11.782339Z","end":"2025-07-15T11:00:12.084265Z","steps":["trace[714805016] 'process raft request' (duration: 296.047914ms)"],"step_count":1} Jul 15 11:00:12.085291 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:12.084767Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:11.782309Z","time spent":"302.178935ms","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":517,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 11:00:12.090857 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:12.088579Z","caller":"traceutil/trace.go:171","msg":"trace[1890255377] transaction","detail":"{read_only:false; response_revision:1861; number_of_response:1; }","duration":"294.181757ms","start":"2025-07-15T11:00:11.794372Z","end":"2025-07-15T11:00:12.088553Z","steps":["trace[1890255377] 'process raft request' (duration: 289.708357ms)"],"step_count":1} Jul 15 11:00:12.091154 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:12.090328Z","caller":"traceutil/trace.go:171","msg":"trace[1324139910] linearizableReadLoop","detail":"{readStateIndex:2146; appliedIndex:2143; }","duration":"4.347312939s","start":"2025-07-15T11:00:07.742976Z","end":"2025-07-15T11:00:12.090289Z","steps":["trace[1324139910] 'read index received' (duration: 4.156530676s)","trace[1324139910] 'applied index is now lower than readState.Index' (duration: 190.463324ms)"],"step_count":2} Jul 15 11:00:12.094996 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:12.094190Z","caller":"traceutil/trace.go:171","msg":"trace[852160180] transaction","detail":"{read_only:false; response_revision:1862; number_of_response:1; }","duration":"270.243965ms","start":"2025-07-15T11:00:11.823895Z","end":"2025-07-15T11:00:12.094139Z","steps":["trace[852160180] 'process raft request' (duration: 262.93586ms)"],"step_count":1} Jul 15 11:00:12.094996 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:12.094494Z","caller":"traceutil/trace.go:171","msg":"trace[221927561] transaction","detail":"{read_only:false; response_revision:1863; number_of_response:1; }","duration":"171.396376ms","start":"2025-07-15T11:00:11.923072Z","end":"2025-07-15T11:00:12.094468Z","steps":["trace[221927561] 'process raft request' (duration: 166.650051ms)"],"step_count":1} Jul 15 11:00:12.098520 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:12.097762Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"4.244737024s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/managementclusterconnections.operator.tigera.io\" limit:1 ","response":"range_response_count:1 size:12873"} Jul 15 11:00:12.098520 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:12.098083Z","caller":"traceutil/trace.go:171","msg":"trace[750928295] range","detail":"{range_begin:/registry/apiextensions.k8s.io/customresourcedefinitions/managementclusterconnections.operator.tigera.io; range_end:; response_count:1; response_revision:1863; }","duration":"4.245071583s","start":"2025-07-15T11:00:07.852896Z","end":"2025-07-15T11:00:12.097967Z","steps":["trace[750928295] 'agreement among raft nodes before linearized reading' (duration: 4.241989642s)"],"step_count":1} Jul 15 11:00:12.099350 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:12.098642Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:07.852839Z","time spent":"4.245418042s","remote":"172.24.4.207:54256","response type":"/etcdserverpb.KV/Range","request count":0,"request size":108,"response count":1,"response size":12897,"request content":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/managementclusterconnections.operator.tigera.io\" limit:1 "} Jul 15 11:00:12.101144 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:12.100642Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"387.624967ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/ingressclasses/\" range_end:\"/registry/ingressclasses0\" count_only:true ","response":"range_response_count:0 size:5"} Jul 15 11:00:12.101669 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:12.100738Z","caller":"traceutil/trace.go:171","msg":"trace[1122678100] range","detail":"{range_begin:/registry/ingressclasses/; range_end:/registry/ingressclasses0; response_count:0; response_revision:1863; }","duration":"387.763494ms","start":"2025-07-15T11:00:11.712942Z","end":"2025-07-15T11:00:12.100706Z","steps":["trace[1122678100] 'agreement among raft nodes before linearized reading' (duration: 383.587162ms)"],"step_count":1} Jul 15 11:00:12.102436 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:12.101953Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:11.712917Z","time spent":"388.50873ms","remote":"172.24.4.207:54460","response type":"/etcdserverpb.KV/Range","request count":0,"request size":56,"response count":0,"response size":29,"request content":"key:\"/registry/ingressclasses/\" range_end:\"/registry/ingressclasses0\" count_only:true "} Jul 15 11:00:12.104312 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:12.102466Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"771.46072ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/clusterroles/\" range_end:\"/registry/clusterroles0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 11:00:12.104668 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:12.102724Z","caller":"traceutil/trace.go:171","msg":"trace[1723489273] range","detail":"{range_begin:/registry/clusterroles/; range_end:/registry/clusterroles0; response_count:0; response_revision:1863; }","duration":"771.684854ms","start":"2025-07-15T11:00:11.330957Z","end":"2025-07-15T11:00:12.102642Z","steps":["trace[1723489273] 'agreement among raft nodes before linearized reading' (duration: 771.004097ms)"],"step_count":1} Jul 15 11:00:12.104668 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:12.102911Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:11.330944Z","time spent":"771.937751ms","remote":"172.24.4.207:54526","response type":"/etcdserverpb.KV/Range","request count":0,"request size":52,"response count":80,"response size":31,"request content":"key:\"/registry/clusterroles/\" range_end:\"/registry/clusterroles0\" count_only:true "} Jul 15 11:00:12.104668 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:12.103357Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"775.735273ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jul 15 11:00:12.104668 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:12.103506Z","caller":"traceutil/trace.go:171","msg":"trace[1597557324] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1863; }","duration":"775.992829ms","start":"2025-07-15T11:00:11.327492Z","end":"2025-07-15T11:00:12.103485Z","steps":["trace[1597557324] 'agreement among raft nodes before linearized reading' (duration: 775.704577ms)"],"step_count":1} Jul 15 11:00:12.104668 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:12.103711Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:11.327470Z","time spent":"776.173803ms","remote":"172.24.4.207:54214","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":29,"request content":"key:\"/registry/health\" "} Jul 15 11:00:12.106059 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:12.105169Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"323.885648ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/clusterinformations/default\" limit:1 ","response":"range_response_count:1 size:886"} Jul 15 11:00:12.106059 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:12.105418Z","caller":"traceutil/trace.go:171","msg":"trace[1223749939] range","detail":"{range_begin:/registry/crd.projectcalico.org/clusterinformations/default; range_end:; response_count:1; response_revision:1863; }","duration":"324.096748ms","start":"2025-07-15T11:00:11.781214Z","end":"2025-07-15T11:00:12.105311Z","steps":["trace[1223749939] 'agreement among raft nodes before linearized reading' (duration: 323.643651ms)"],"step_count":1} Jul 15 11:00:12.106059 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:12.105559Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:11.781186Z","time spent":"324.346298ms","remote":"172.24.4.207:47728","response type":"/etcdserverpb.KV/Range","request count":0,"request size":63,"response count":1,"response size":910,"request content":"key:\"/registry/crd.projectcalico.org/clusterinformations/default\" limit:1 "} Jul 15 11:00:12.106661 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:12.106224Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"392.946745ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/mutatingwebhookconfigurations/\" range_end:\"/registry/mutatingwebhookconfigurations0\" count_only:true ","response":"range_response_count:0 size:5"} Jul 15 11:00:12.107240 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:12.106510Z","caller":"traceutil/trace.go:171","msg":"trace[523788803] range","detail":"{range_begin:/registry/mutatingwebhookconfigurations/; range_end:/registry/mutatingwebhookconfigurations0; response_count:0; response_revision:1863; }","duration":"393.260645ms","start":"2025-07-15T11:00:11.713213Z","end":"2025-07-15T11:00:12.106473Z","steps":["trace[523788803] 'agreement among raft nodes before linearized reading' (duration: 392.78689ms)"],"step_count":1} Jul 15 11:00:12.107240 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:12.106732Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:11.713143Z","time spent":"393.543878ms","remote":"172.24.4.207:54690","response type":"/etcdserverpb.KV/Range","request count":0,"request size":86,"response count":0,"response size":29,"request content":"key:\"/registry/mutatingwebhookconfigurations/\" range_end:\"/registry/mutatingwebhookconfigurations0\" count_only:true "} Jul 15 11:00:13.427460 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:13.426626Z","caller":"traceutil/trace.go:171","msg":"trace[808194069] linearizableReadLoop","detail":"{readStateIndex:2157; appliedIndex:2156; }","duration":"144.260318ms","start":"2025-07-15T11:00:13.282322Z","end":"2025-07-15T11:00:13.426582Z","steps":["trace[808194069] 'read index received' (duration: 52.552632ms)","trace[808194069] 'applied index is now lower than readState.Index' (duration: 91.70478ms)"],"step_count":2} Jul 15 11:00:13.428635 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:13.427053Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"144.679993ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/ipamhandles.crd.projectcalico.org\" limit:1 ","response":"range_response_count:1 size:3184"} Jul 15 11:00:13.428635 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:13.427127Z","caller":"traceutil/trace.go:171","msg":"trace[1443861037] range","detail":"{range_begin:/registry/apiextensions.k8s.io/customresourcedefinitions/ipamhandles.crd.projectcalico.org; range_end:; response_count:1; response_revision:1865; }","duration":"144.8242ms","start":"2025-07-15T11:00:13.282283Z","end":"2025-07-15T11:00:13.427107Z","steps":["trace[1443861037] 'agreement among raft nodes before linearized reading' (duration: 144.458886ms)"],"step_count":1} Jul 15 11:00:17.259915 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:17.258517Z","caller":"traceutil/trace.go:171","msg":"trace[2052094246] transaction","detail":"{read_only:false; response_revision:1866; number_of_response:1; }","duration":"161.251265ms","start":"2025-07-15T11:00:17.097232Z","end":"2025-07-15T11:00:17.258483Z","steps":["trace[2052094246] 'process raft request' (duration: 160.759717ms)"],"step_count":1} Jul 15 11:00:17.267703 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:17.265327Z","caller":"traceutil/trace.go:171","msg":"trace[69917369] transaction","detail":"{read_only:false; response_revision:1867; number_of_response:1; }","duration":"144.151758ms","start":"2025-07-15T11:00:17.121103Z","end":"2025-07-15T11:00:17.265255Z","steps":["trace[69917369] 'process raft request' (duration: 143.58434ms)"],"step_count":1} Jul 15 11:00:17.267703 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:17.265637Z","caller":"traceutil/trace.go:171","msg":"trace[42013438] linearizableReadLoop","detail":"{readStateIndex:2159; appliedIndex:2158; }","duration":"137.647036ms","start":"2025-07-15T11:00:17.127961Z","end":"2025-07-15T11:00:17.265608Z","steps":["trace[42013438] 'read index received' (duration: 131.128379ms)","trace[42013438] 'applied index is now lower than readState.Index' (duration: 6.517104ms)"],"step_count":2} Jul 15 11:00:17.268326 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:17.266474Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"138.503839ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jul 15 11:00:17.268326 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:17.266569Z","caller":"traceutil/trace.go:171","msg":"trace[800143482] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1868; }","duration":"138.646602ms","start":"2025-07-15T11:00:17.127899Z","end":"2025-07-15T11:00:17.266545Z","steps":["trace[800143482] 'agreement among raft nodes before linearized reading' (duration: 138.092138ms)"],"step_count":1} Jul 15 11:00:17.268326 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:17.266961Z","caller":"traceutil/trace.go:171","msg":"trace[1715967972] transaction","detail":"{read_only:false; response_revision:1868; number_of_response:1; }","duration":"130.767644ms","start":"2025-07-15T11:00:17.136107Z","end":"2025-07-15T11:00:17.266875Z","steps":["trace[1715967972] 'process raft request' (duration: 129.027721ms)"],"step_count":1} Jul 15 11:00:17.268326 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:17.266780Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"125.619276ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/felixconfigurations.crd.projectcalico.org\" limit:1 ","response":"range_response_count:1 size:55540"} Jul 15 11:00:17.268326 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:17.267289Z","caller":"traceutil/trace.go:171","msg":"trace[1900894316] range","detail":"{range_begin:/registry/apiextensions.k8s.io/customresourcedefinitions/felixconfigurations.crd.projectcalico.org; range_end:; response_count:1; response_revision:1868; }","duration":"126.114963ms","start":"2025-07-15T11:00:17.141097Z","end":"2025-07-15T11:00:17.267212Z","steps":["trace[1900894316] 'agreement among raft nodes before linearized reading' (duration: 125.165088ms)"],"step_count":1} Jul 15 11:00:18.607973 update_engine[1386]: I20250715 11:00:18.290897 1386 libcurl_http_fetcher.cc:47] Starting/Resuming transfer Jul 15 11:00:18.607973 update_engine[1386]: I20250715 11:00:18.291534 1386 libcurl_http_fetcher.cc:151] Setting up curl options for HTTP Jul 15 11:00:18.607973 update_engine[1386]: I20250715 11:00:18.292197 1386 libcurl_http_fetcher.cc:449] Setting up timeout source: 1 seconds. Jul 15 11:00:18.607973 update_engine[1386]: E20250715 11:00:18.297602 1386 libcurl_http_fetcher.cc:266] Unable to get http response code: Could not resolve host: disabled Jul 15 11:00:18.607973 update_engine[1386]: I20250715 11:00:18.297948 1386 libcurl_http_fetcher.cc:297] Transfer resulted in an error (0), 0 bytes downloaded Jul 15 11:00:18.607973 update_engine[1386]: I20250715 11:00:18.298036 1386 omaha_request_action.cc:617] Omaha request response: Jul 15 11:00:18.607973 update_engine[1386]: E20250715 11:00:18.298681 1386 omaha_request_action.cc:636] Omaha request network transfer failed. Jul 15 11:00:18.607973 update_engine[1386]: I20250715 11:00:18.299382 1386 action_processor.cc:68] ActionProcessor::ActionComplete: OmahaRequestAction action failed. Aborting processing. Jul 15 11:00:18.607973 update_engine[1386]: I20250715 11:00:18.299408 1386 action_processor.cc:73] ActionProcessor::ActionComplete: finished last action of type OmahaRequestAction Jul 15 11:00:18.607973 update_engine[1386]: I20250715 11:00:18.299429 1386 update_attempter.cc:306] Processing Done. Jul 15 11:00:18.607973 update_engine[1386]: E20250715 11:00:18.299618 1386 update_attempter.cc:619] Update failed. Jul 15 11:00:18.607973 update_engine[1386]: I20250715 11:00:18.299652 1386 utils.cc:600] Converting error code 2000 to kActionCodeOmahaErrorInHTTPResponse Jul 15 11:00:18.607973 update_engine[1386]: I20250715 11:00:18.299666 1386 payload_state.cc:97] Updating payload state for error code: 37 (kActionCodeOmahaErrorInHTTPResponse) Jul 15 11:00:18.607973 update_engine[1386]: I20250715 11:00:18.299679 1386 payload_state.cc:103] Ignoring failures until we get a valid Omaha response. Jul 15 11:00:18.607973 update_engine[1386]: I20250715 11:00:18.300402 1386 action_processor.cc:36] ActionProcessor::StartProcessing: OmahaRequestAction Jul 15 11:00:18.607973 update_engine[1386]: I20250715 11:00:18.300606 1386 omaha_request_action.cc:271] Posting an Omaha request to disabled Jul 15 11:00:18.607973 update_engine[1386]: I20250715 11:00:18.300626 1386 omaha_request_action.cc:272] Request: Jul 15 11:00:18.607973 update_engine[1386]: Jul 15 11:00:18.607973 update_engine[1386]: Jul 15 11:00:18.611038 update_engine[1386]: Jul 15 11:00:18.611038 update_engine[1386]: Jul 15 11:00:18.611038 update_engine[1386]: Jul 15 11:00:18.611038 update_engine[1386]: Jul 15 11:00:18.611038 update_engine[1386]: I20250715 11:00:18.300673 1386 libcurl_http_fetcher.cc:47] Starting/Resuming transfer Jul 15 11:00:18.611038 update_engine[1386]: I20250715 11:00:18.301290 1386 libcurl_http_fetcher.cc:151] Setting up curl options for HTTP Jul 15 11:00:18.611038 update_engine[1386]: I20250715 11:00:18.302002 1386 libcurl_http_fetcher.cc:449] Setting up timeout source: 1 seconds. Jul 15 11:00:18.611038 update_engine[1386]: E20250715 11:00:18.307286 1386 libcurl_http_fetcher.cc:266] Unable to get http response code: Could not resolve host: disabled Jul 15 11:00:18.611038 update_engine[1386]: I20250715 11:00:18.307443 1386 libcurl_http_fetcher.cc:297] Transfer resulted in an error (0), 0 bytes downloaded Jul 15 11:00:18.611038 update_engine[1386]: I20250715 11:00:18.307469 1386 omaha_request_action.cc:617] Omaha request response: Jul 15 11:00:18.611038 update_engine[1386]: I20250715 11:00:18.307513 1386 action_processor.cc:65] ActionProcessor::ActionComplete: finished last action of type OmahaRequestAction Jul 15 11:00:18.611038 update_engine[1386]: I20250715 11:00:18.307549 1386 action_processor.cc:73] ActionProcessor::ActionComplete: finished last action of type OmahaRequestAction Jul 15 11:00:18.611038 update_engine[1386]: I20250715 11:00:18.307564 1386 update_attempter.cc:306] Processing Done. Jul 15 11:00:18.611038 update_engine[1386]: I20250715 11:00:18.307576 1386 update_attempter.cc:310] Error event sent. Jul 15 11:00:18.611038 update_engine[1386]: I20250715 11:00:18.307650 1386 update_check_scheduler.cc:74] Next update check in 42m18s Jul 15 11:00:18.616743 locksmithd[1403]: LastCheckedTime=0 Progress=0 CurrentOperation="UPDATE_STATUS_REPORTING_ERROR_EVENT" NewVersion=0.0.0 NewSize=0 Jul 15 11:00:18.616743 locksmithd[1403]: LastCheckedTime=0 Progress=0 CurrentOperation="UPDATE_STATUS_IDLE" NewVersion=0.0.0 NewSize=0 Jul 15 11:00:31.749920 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:31.748054Z","caller":"traceutil/trace.go:171","msg":"trace[368128331] transaction","detail":"{read_only:false; response_revision:1873; number_of_response:1; }","duration":"452.746407ms","start":"2025-07-15T11:00:31.295247Z","end":"2025-07-15T11:00:31.747993Z","steps":["trace[368128331] 'process raft request' (duration: 452.339746ms)"],"step_count":1} Jul 15 11:00:31.749920 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:31.748367Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:31.295237Z","time spent":"452.948861ms","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":490,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 11:00:31.749920 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:31.748527Z","caller":"traceutil/trace.go:171","msg":"trace[906901176] linearizableReadLoop","detail":"{readStateIndex:2166; appliedIndex:2165; }","duration":"496.183197ms","start":"2025-07-15T11:00:31.252326Z","end":"2025-07-15T11:00:31.748509Z","steps":["trace[906901176] 'read index received' (duration: 405.294823ms)","trace[906901176] 'applied index is now lower than readState.Index' (duration: 90.886791ms)"],"step_count":2} Jul 15 11:00:31.749920 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:31.748873Z","caller":"traceutil/trace.go:171","msg":"trace[1598619881] transaction","detail":"{read_only:false; response_revision:1874; number_of_response:1; }","duration":"448.42104ms","start":"2025-07-15T11:00:31.300435Z","end":"2025-07-15T11:00:31.748856Z","steps":["trace[1598619881] 'process raft request' (duration: 447.467799ms)"],"step_count":1} Jul 15 11:00:31.751896 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:31.749017Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:31.300426Z","time spent":"448.490188ms","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":699,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 11:00:31.797587 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:31.795592Z","caller":"traceutil/trace.go:171","msg":"trace[1334733547] transaction","detail":"{read_only:false; response_revision:1875; number_of_response:1; }","duration":"483.968683ms","start":"2025-07-15T11:00:31.311586Z","end":"2025-07-15T11:00:31.795555Z","steps":["trace[1334733547] 'process raft request' (duration: 437.19485ms)","trace[1334733547] 'compare' (duration: 46.353446ms)"],"step_count":2} Jul 15 11:00:31.797587 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:31.795773Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:31.311566Z","time spent":"484.118429ms","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":517,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 11:00:31.801684 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:31.797994Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"545.661585ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/events/\" range_end:\"/registry/events0\" count_only:true ","response":"range_response_count:0 size:8"} Jul 15 11:00:31.801684 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:31.798085Z","caller":"traceutil/trace.go:171","msg":"trace[1844067881] range","detail":"{range_begin:/registry/events/; range_end:/registry/events0; response_count:0; response_revision:1874; }","duration":"545.769604ms","start":"2025-07-15T11:00:31.252281Z","end":"2025-07-15T11:00:31.798050Z","steps":["trace[1844067881] 'agreement among raft nodes before linearized reading' (duration: 496.333065ms)","trace[1844067881] 'count revisions from in-memory index tree' (duration: 49.338058ms)"],"step_count":2} Jul 15 11:00:31.801684 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:31.798168Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:31.252265Z","time spent":"545.868435ms","remote":"172.24.4.207:54724","response type":"/etcdserverpb.KV/Range","request count":0,"request size":40,"response count":300,"response size":32,"request content":"key:\"/registry/events/\" range_end:\"/registry/events0\" count_only:true "} Jul 15 11:00:31.801684 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:31.798649Z","caller":"traceutil/trace.go:171","msg":"trace[217477648] transaction","detail":"{read_only:false; response_revision:1876; number_of_response:1; }","duration":"486.851836ms","start":"2025-07-15T11:00:31.311682Z","end":"2025-07-15T11:00:31.798534Z","steps":["trace[217477648] 'process raft request' (duration: 483.792417ms)"],"step_count":1} Jul 15 11:00:31.802712 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:31.799049Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:31.311674Z","time spent":"487.197766ms","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":532,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 11:00:31.802712 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:31.799420Z","caller":"traceutil/trace.go:171","msg":"trace[1586937663] transaction","detail":"{read_only:false; response_revision:1877; number_of_response:1; }","duration":"469.934779ms","start":"2025-07-15T11:00:31.329455Z","end":"2025-07-15T11:00:31.799390Z","steps":["trace[1586937663] 'process raft request' (duration: 468.900679ms)"],"step_count":1} Jul 15 11:00:31.802712 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:31.799585Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:31.329428Z","time spent":"470.062614ms","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":625,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 11:00:31.808038 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:31.800356Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"510.06407ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/validatingadmissionpolicybindings/\" range_end:\"/registry/validatingadmissionpolicybindings0\" count_only:true ","response":"range_response_count:0 size:5"} Jul 15 11:00:31.808038 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:31.800430Z","caller":"traceutil/trace.go:171","msg":"trace[2071124577] range","detail":"{range_begin:/registry/validatingadmissionpolicybindings/; range_end:/registry/validatingadmissionpolicybindings0; response_count:0; response_revision:1878; }","duration":"510.168212ms","start":"2025-07-15T11:00:31.290242Z","end":"2025-07-15T11:00:31.800410Z","steps":["trace[2071124577] 'agreement among raft nodes before linearized reading' (duration: 509.916417ms)"],"step_count":1} Jul 15 11:00:31.808038 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:31.800501Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:31.290220Z","time spent":"510.260303ms","remote":"172.24.4.207:54710","response type":"/etcdserverpb.KV/Range","request count":0,"request size":94,"response count":0,"response size":29,"request content":"key:\"/registry/validatingadmissionpolicybindings/\" range_end:\"/registry/validatingadmissionpolicybindings0\" count_only:true "} Jul 15 11:00:31.808038 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:31.800871Z","caller":"traceutil/trace.go:171","msg":"trace[1809794077] transaction","detail":"{read_only:false; response_revision:1878; number_of_response:1; }","duration":"456.680411ms","start":"2025-07-15T11:00:31.344109Z","end":"2025-07-15T11:00:31.800790Z","steps":["trace[1809794077] 'process raft request' (duration: 455.155415ms)"],"step_count":1} Jul 15 11:00:31.812453 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:31.801171Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:31.344093Z","time spent":"456.922139ms","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":489,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 11:00:31.812453 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:31.801790Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"354.531485ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jul 15 11:00:31.812453 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:31.801908Z","caller":"traceutil/trace.go:171","msg":"trace[798498373] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1878; }","duration":"354.62124ms","start":"2025-07-15T11:00:31.447241Z","end":"2025-07-15T11:00:31.801862Z","steps":["trace[798498373] 'agreement among raft nodes before linearized reading' (duration: 354.206594ms)"],"step_count":1} Jul 15 11:00:31.812453 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:31.801965Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:31.447192Z","time spent":"354.756861ms","remote":"172.24.4.207:54212","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":29,"request content":"key:\"/registry/health\" "} Jul 15 11:00:31.812453 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:31.802212Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"427.036332ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/clusterinformations/default\" limit:1 ","response":"range_response_count:1 size:886"} Jul 15 11:00:31.814682 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:31.802271Z","caller":"traceutil/trace.go:171","msg":"trace[1894478163] range","detail":"{range_begin:/registry/crd.projectcalico.org/clusterinformations/default; range_end:; response_count:1; response_revision:1878; }","duration":"427.080533ms","start":"2025-07-15T11:00:31.375162Z","end":"2025-07-15T11:00:31.802242Z","steps":["trace[1894478163] 'agreement among raft nodes before linearized reading' (duration: 426.873982ms)"],"step_count":1} Jul 15 11:00:31.814682 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:31.802315Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:31.375052Z","time spent":"427.247191ms","remote":"172.24.4.207:47728","response type":"/etcdserverpb.KV/Range","request count":0,"request size":63,"response count":1,"response size":910,"request content":"key:\"/registry/crd.projectcalico.org/clusterinformations/default\" limit:1 "} Jul 15 11:00:31.814682 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:31.802699Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"437.178079ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/ipreservations.crd.projectcalico.org\" limit:1 ","response":"range_response_count:1 size:3242"} Jul 15 11:00:31.814682 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:31.802774Z","caller":"traceutil/trace.go:171","msg":"trace[806616866] range","detail":"{range_begin:/registry/apiextensions.k8s.io/customresourcedefinitions/ipreservations.crd.projectcalico.org; range_end:; response_count:1; response_revision:1878; }","duration":"437.280187ms","start":"2025-07-15T11:00:31.365473Z","end":"2025-07-15T11:00:31.802753Z","steps":["trace[806616866] 'agreement among raft nodes before linearized reading' (duration: 437.067244ms)"],"step_count":1} Jul 15 11:00:31.817846 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:31.803725Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:31.365413Z","time spent":"438.069015ms","remote":"172.24.4.207:54256","response type":"/etcdserverpb.KV/Range","request count":0,"request size":97,"response count":1,"response size":3266,"request content":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/ipreservations.crd.projectcalico.org\" limit:1 "} Jul 15 11:00:31.817846 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:31.804358Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"454.546191ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/resourcequotas/\" range_end:\"/registry/resourcequotas0\" count_only:true ","response":"range_response_count:0 size:5"} Jul 15 11:00:31.817846 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:31.804520Z","caller":"traceutil/trace.go:171","msg":"trace[1960812082] range","detail":"{range_begin:/registry/resourcequotas/; range_end:/registry/resourcequotas0; response_count:0; response_revision:1878; }","duration":"454.730331ms","start":"2025-07-15T11:00:31.349767Z","end":"2025-07-15T11:00:31.804497Z","steps":["trace[1960812082] 'agreement among raft nodes before linearized reading' (duration: 454.51836ms)"],"step_count":1} Jul 15 11:00:31.817846 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:31.804681Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:31.349758Z","time spent":"454.896268ms","remote":"172.24.4.207:54270","response type":"/etcdserverpb.KV/Range","request count":0,"request size":56,"response count":0,"response size":29,"request content":"key:\"/registry/resourcequotas/\" range_end:\"/registry/resourcequotas0\" count_only:true "} Jul 15 11:00:31.818514 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:31.805158Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"498.565616ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/events/default/test-dynamic-volume-claim.185267aefb01d981\" limit:1 ","response":"range_response_count:1 size:967"} Jul 15 11:00:31.818514 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:31.805279Z","caller":"traceutil/trace.go:171","msg":"trace[1768809847] range","detail":"{range_begin:/registry/events/default/test-dynamic-volume-claim.185267aefb01d981; range_end:; response_count:1; response_revision:1878; }","duration":"498.712287ms","start":"2025-07-15T11:00:31.306549Z","end":"2025-07-15T11:00:31.805261Z","steps":["trace[1768809847] 'agreement among raft nodes before linearized reading' (duration: 498.366469ms)"],"step_count":1} Jul 15 11:00:31.818514 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:31.805428Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:31.306534Z","time spent":"498.868386ms","remote":"172.24.4.207:54266","response type":"/etcdserverpb.KV/Range","request count":0,"request size":71,"response count":1,"response size":991,"request content":"key:\"/registry/events/default/test-dynamic-volume-claim.185267aefb01d981\" limit:1 "} Jul 15 11:00:31.818514 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:31.806084Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"505.564461ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/servicecidrs/\" range_end:\"/registry/servicecidrs0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 11:00:31.819216 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:31.806231Z","caller":"traceutil/trace.go:171","msg":"trace[2024002605] range","detail":"{range_begin:/registry/servicecidrs/; range_end:/registry/servicecidrs0; response_count:0; response_revision:1878; }","duration":"505.71541ms","start":"2025-07-15T11:00:31.300495Z","end":"2025-07-15T11:00:31.806211Z","steps":["trace[2024002605] 'agreement among raft nodes before linearized reading' (duration: 505.535568ms)"],"step_count":1} Jul 15 11:00:31.819216 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:31.806395Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:31.300481Z","time spent":"505.885213ms","remote":"172.24.4.207:54476","response type":"/etcdserverpb.KV/Range","request count":0,"request size":52,"response count":1,"response size":31,"request content":"key:\"/registry/servicecidrs/\" range_end:\"/registry/servicecidrs0\" count_only:true "} Jul 15 11:00:31.819216 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:31.807573Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"512.661917ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/\" range_end:\"/registry/apiextensions.k8s.io/customresourcedefinitions0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 11:00:31.819216 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:31.808106Z","caller":"traceutil/trace.go:171","msg":"trace[1723050174] range","detail":"{range_begin:/registry/apiextensions.k8s.io/customresourcedefinitions/; range_end:/registry/apiextensions.k8s.io/customresourcedefinitions0; response_count:0; response_revision:1878; }","duration":"513.008837ms","start":"2025-07-15T11:00:31.294877Z","end":"2025-07-15T11:00:31.807886Z","steps":["trace[1723050174] 'agreement among raft nodes before linearized reading' (duration: 512.571389ms)"],"step_count":1} Jul 15 11:00:31.820102 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:31.809477Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"514.379158ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/secrets/\" range_end:\"/registry/secrets0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 11:00:31.820102 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:31.809511Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:31.294820Z","time spent":"514.652342ms","remote":"172.24.4.207:54256","response type":"/etcdserverpb.KV/Range","request count":0,"request size":120,"response count":32,"response size":31,"request content":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/\" range_end:\"/registry/apiextensions.k8s.io/customresourcedefinitions0\" count_only:true "} Jul 15 11:00:31.820102 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:31.809592Z","caller":"traceutil/trace.go:171","msg":"trace[494413893] range","detail":"{range_begin:/registry/secrets/; range_end:/registry/secrets0; response_count:0; response_revision:1878; }","duration":"514.519127ms","start":"2025-07-15T11:00:31.295038Z","end":"2025-07-15T11:00:31.809557Z","steps":["trace[494413893] 'agreement among raft nodes before linearized reading' (duration: 514.341879ms)"],"step_count":1} Jul 15 11:00:31.820102 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:31.809708Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:31.295014Z","time spent":"514.66198ms","remote":"172.24.4.207:54276","response type":"/etcdserverpb.KV/Range","request count":0,"request size":42,"response count":16,"response size":31,"request content":"key:\"/registry/secrets/\" range_end:\"/registry/secrets0\" count_only:true "} Jul 15 11:00:31.820102 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:31.808866Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"514.24483ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/daemonsets/\" range_end:\"/registry/daemonsets0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 11:00:31.820894 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:31.809936Z","caller":"traceutil/trace.go:171","msg":"trace[339594733] range","detail":"{range_begin:/registry/daemonsets/; range_end:/registry/daemonsets0; response_count:0; response_revision:1878; }","duration":"515.318282ms","start":"2025-07-15T11:00:31.294589Z","end":"2025-07-15T11:00:31.809908Z","steps":["trace[339594733] 'agreement among raft nodes before linearized reading' (duration: 513.695666ms)"],"step_count":1} Jul 15 11:00:31.820894 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:31.810128Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:31.294572Z","time spent":"515.423255ms","remote":"172.24.4.207:54648","response type":"/etcdserverpb.KV/Range","request count":0,"request size":48,"response count":3,"response size":31,"request content":"key:\"/registry/daemonsets/\" range_end:\"/registry/daemonsets0\" count_only:true "} Jul 15 11:00:31.820894 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:31.808992Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"515.594492ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/storageclasses/\" range_end:\"/registry/storageclasses0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 11:00:31.820894 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:31.810265Z","caller":"traceutil/trace.go:171","msg":"trace[1165414166] range","detail":"{range_begin:/registry/storageclasses/; range_end:/registry/storageclasses0; response_count:0; response_revision:1878; }","duration":"516.870238ms","start":"2025-07-15T11:00:31.293370Z","end":"2025-07-15T11:00:31.810241Z","steps":["trace[1165414166] 'agreement among raft nodes before linearized reading' (duration: 515.572733ms)"],"step_count":1} Jul 15 11:00:31.821694 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:31.810367Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:31.293364Z","time spent":"516.975221ms","remote":"172.24.4.207:54564","response type":"/etcdserverpb.KV/Range","request count":0,"request size":56,"response count":1,"response size":31,"request content":"key:\"/registry/storageclasses/\" range_end:\"/registry/storageclasses0\" count_only:true "} Jul 15 11:00:31.821694 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:31.809114Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"515.778642ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiregistration.k8s.io/apiservices/\" range_end:\"/registry/apiregistration.k8s.io/apiservices0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 11:00:31.821694 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:31.810665Z","caller":"traceutil/trace.go:171","msg":"trace[578391529] range","detail":"{range_begin:/registry/apiregistration.k8s.io/apiservices/; range_end:/registry/apiregistration.k8s.io/apiservices0; response_count:0; response_revision:1878; }","duration":"517.303138ms","start":"2025-07-15T11:00:31.293300Z","end":"2025-07-15T11:00:31.810603Z","steps":["trace[578391529] 'agreement among raft nodes before linearized reading' (duration: 515.754479ms)"],"step_count":1} Jul 15 11:00:31.821694 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:31.810774Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:31.293292Z","time spent":"517.42427ms","remote":"172.24.4.207:54728","response type":"/etcdserverpb.KV/Range","request count":0,"request size":96,"response count":24,"response size":31,"request content":"key:\"/registry/apiregistration.k8s.io/apiservices/\" range_end:\"/registry/apiregistration.k8s.io/apiservices0\" count_only:true "} Jul 15 11:00:31.822480 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:31.809104Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"509.245188ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/masterleases/172.24.4.207\" limit:1 ","response":"range_response_count:1 size:131"} Jul 15 11:00:31.822480 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:31.811940Z","caller":"traceutil/trace.go:171","msg":"trace[1523730039] range","detail":"{range_begin:/registry/masterleases/172.24.4.207; range_end:; response_count:1; response_revision:1878; }","duration":"512.163116ms","start":"2025-07-15T11:00:31.299749Z","end":"2025-07-15T11:00:31.811912Z","steps":["trace[1523730039] 'agreement among raft nodes before linearized reading' (duration: 508.929835ms)"],"step_count":1} Jul 15 11:00:31.822480 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:31.812553Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:31.299742Z","time spent":"512.726296ms","remote":"172.24.4.207:54228","response type":"/etcdserverpb.KV/Range","request count":0,"request size":39,"response count":1,"response size":155,"request content":"key:\"/registry/masterleases/172.24.4.207\" limit:1 "} Jul 15 11:00:31.822480 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:31.809320Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"513.927314ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/serviceaccounts/\" range_end:\"/registry/serviceaccounts0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 11:00:31.822480 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:31.813370Z","caller":"traceutil/trace.go:171","msg":"trace[693653358] range","detail":"{range_begin:/registry/serviceaccounts/; range_end:/registry/serviceaccounts0; response_count:0; response_revision:1878; }","duration":"517.990677ms","start":"2025-07-15T11:00:31.295358Z","end":"2025-07-15T11:00:31.813349Z","steps":["trace[693653358] 'agreement among raft nodes before linearized reading' (duration: 513.833901ms)"],"step_count":1} Jul 15 11:00:31.823354 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:31.814189Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:31.295354Z","time spent":"518.749578ms","remote":"172.24.4.207:54370","response type":"/etcdserverpb.KV/Range","request count":0,"request size":58,"response count":53,"response size":31,"request content":"key:\"/registry/serviceaccounts/\" range_end:\"/registry/serviceaccounts0\" count_only:true "} Jul 15 11:00:32.081439 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:32.080715Z","caller":"traceutil/trace.go:171","msg":"trace[611408556] linearizableReadLoop","detail":"{readStateIndex:2177; appliedIndex:2176; }","duration":"192.31418ms","start":"2025-07-15T11:00:31.888367Z","end":"2025-07-15T11:00:32.080681Z","steps":["trace[611408556] 'read index received' (duration: 144.362914ms)","trace[611408556] 'applied index is now lower than readState.Index' (duration: 47.949913ms)"],"step_count":2} Jul 15 11:00:32.082717 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:32.080957Z","caller":"traceutil/trace.go:171","msg":"trace[1802350875] transaction","detail":"{read_only:false; number_of_response:0; response_revision:1880; }","duration":"193.904786ms","start":"2025-07-15T11:00:31.887034Z","end":"2025-07-15T11:00:32.080939Z","steps":["trace[1802350875] 'process raft request' (duration: 145.813953ms)","trace[1802350875] 'compare' (duration: 47.7693ms)"],"step_count":2} Jul 15 11:00:32.082717 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:32.081837Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"192.781262ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/endpointslices/default/kubernetes\" limit:1 ","response":"range_response_count:1 size:474"} Jul 15 11:00:32.082717 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:32.081938Z","caller":"traceutil/trace.go:171","msg":"trace[127418743] range","detail":"{range_begin:/registry/endpointslices/default/kubernetes; range_end:; response_count:1; response_revision:1880; }","duration":"193.585407ms","start":"2025-07-15T11:00:31.888324Z","end":"2025-07-15T11:00:32.081909Z","steps":["trace[127418743] 'agreement among raft nodes before linearized reading' (duration: 192.780761ms)"],"step_count":1} Jul 15 11:00:32.085648 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:32.082715Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"176.39835ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/stagedkubernetesnetworkpolicies.crd.projectcalico.org\" limit:1 ","response":"range_response_count:1 size:20393"} Jul 15 11:00:32.085648 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:32.083191Z","caller":"traceutil/trace.go:171","msg":"trace[200808553] range","detail":"{range_begin:/registry/apiextensions.k8s.io/customresourcedefinitions/stagedkubernetesnetworkpolicies.crd.projectcalico.org; range_end:; response_count:1; response_revision:1880; }","duration":"176.60996ms","start":"2025-07-15T11:00:31.906289Z","end":"2025-07-15T11:00:32.082899Z","steps":["trace[200808553] 'agreement among raft nodes before linearized reading' (duration: 176.199793ms)"],"step_count":1} Jul 15 11:00:41.741205 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:40.127951Z","caller":"etcdserver/server.go:1198","msg":"failed to revoke lease","lease-id":"694d980db7d27ebb","error":"etcdserver: request timed out"} Jul 15 11:00:41.741205 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:40.636237Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875176215,"retry-timeout":"500ms"} Jul 15 11:00:41.741205 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:41.136982Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875176215,"retry-timeout":"500ms"} Jul 15 11:00:41.741205 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:41.637930Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875176215,"retry-timeout":"500ms"} Jul 15 11:00:41.809492 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:41.808464Z","caller":"wal/wal.go:805","msg":"slow fdatasync","took":"8.681080932s","expected-duration":"1s"} Jul 15 11:00:43.618518 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:43.617780Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:43.059939Z","time spent":"557.82396ms","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jul 15 11:00:47.292434 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:47.136098Z","caller":"etcdserver/server.go:1237","msg":"Failed to check current member's leadership","error":"context deadline exceeded"} Jul 15 11:00:47.292434 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:47.136247Z","caller":"etcdserver/server.go:1177","msg":"Ignore the lease revoking request because current member isn't a leader","local-member-id":10276657743932975437} Jul 15 11:00:47.293596 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:47.291991Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"4.234163728s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context deadline exceeded"} Jul 15 11:00:47.293596 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:47.292303Z","caller":"traceutil/trace.go:171","msg":"trace[1286892215] range","detail":"{range_begin:/registry/health; range_end:; }","duration":"4.234520527s","start":"2025-07-15T11:00:43.057737Z","end":"2025-07-15T11:00:47.292258Z","steps":["trace[1286892215] 'agreement among raft nodes before linearized reading' (duration: 4.234214492s)"],"step_count":1} Jul 15 11:00:47.293596 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:47.292402Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:43.057709Z","time spent":"4.234671917s","remote":"172.24.4.207:54212","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "} Jul 15 11:00:49.978362 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:48.048644Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:43.059886Z","time spent":"4.988747274s","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jul 15 11:00:49.978362 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:48.054199Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:43.059996Z","time spent":"4.994195554s","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jul 15 11:00:49.978362 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:48.617300Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"4.99941088s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/leases/tigera-operator/operator-lock\" limit:1 ","response":"","error":"context deadline exceeded"} Jul 15 11:00:49.978362 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:48.617449Z","caller":"traceutil/trace.go:171","msg":"trace[290510008] range","detail":"{range_begin:/registry/leases/tigera-operator/operator-lock; range_end:; }","duration":"4.99964369s","start":"2025-07-15T11:00:43.617765Z","end":"2025-07-15T11:00:48.617409Z","steps":["trace[290510008] 'agreement among raft nodes before linearized reading' (duration: 4.999432069s)"],"step_count":1} Jul 15 11:00:49.978362 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:48.617589Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:43.617749Z","time spent":"4.999791643s","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Range","request count":0,"request size":50,"response count":0,"response size":0,"request content":"key:\"/registry/leases/tigera-operator/operator-lock\" limit:1 "} Jul 15 11:00:50.060047 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:50.059171Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:43.058201Z","time spent":"7.000907282s","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jul 15 11:00:50.060961 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:50.060079Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:43.059785Z","time spent":"7.000286245s","remote":"172.24.4.207:54220","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jul 15 11:00:50.060961 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:50.060360Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:43.060045Z","time spent":"7.00031007s","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jul 15 11:00:50.941947 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:50.680451Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"7.067559749s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/clusterinformations/default\" limit:1 ","response":"","error":"context canceled"} Jul 15 11:00:50.941947 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:50.680876Z","caller":"traceutil/trace.go:171","msg":"trace[462206329] range","detail":"{range_begin:/registry/crd.projectcalico.org/clusterinformations/default; range_end:; }","duration":"7.067898806s","start":"2025-07-15T11:00:43.612771Z","end":"2025-07-15T11:00:50.680670Z","steps":["trace[462206329] 'agreement among raft nodes before linearized reading' (duration: 7.067647702s)"],"step_count":1} Jul 15 11:00:50.941947 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:50.681116Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:43.612738Z","time spent":"7.068351061s","remote":"172.24.4.207:47728","response type":"/etcdserverpb.KV/Range","request count":0,"request size":63,"response count":0,"response size":0,"request content":"key:\"/registry/crd.projectcalico.org/clusterinformations/default\" limit:1 "} Jul 15 11:00:50.941947 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:50.820539Z","caller":"wal/wal.go:805","msg":"slow fdatasync","took":"7.762141546s","expected-duration":"1s"} Jul 15 11:00:51.310499 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:51.307927Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"9.499208894s","expected-duration":"100ms","prefix":"","request":"header: lease_revoke:","response":"size:29"} Jul 15 11:00:51.310499 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:51.308527Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:50.679868Z","time spent":"628.650744ms","remote":"172.24.4.207:40516","response type":"/etcdserverpb.Maintenance/Status","request count":-1,"request size":-1,"response count":-1,"response size":-1,"request content":""} Jul 15 11:00:51.311429 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:51.310160Z","caller":"traceutil/trace.go:171","msg":"trace[395519636] linearizableReadLoop","detail":"{readStateIndex:2179; appliedIndex:2178; }","duration":"11.174268851s","start":"2025-07-15T11:00:40.135850Z","end":"2025-07-15T11:00:51.310119Z","steps":["trace[395519636] 'read index received' (duration: 1.67277627s)","trace[395519636] 'applied index is now lower than readState.Index' (duration: 9.501485288s)"],"step_count":2} Jul 15 11:00:52.019476 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:51.878960Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875176228,"retry-timeout":"500ms"} Jul 15 11:00:56.453050 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:52.056339Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.376175826s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/leases/kube-system/kube-controller-manager\" limit:1 ","response":"","error":"context canceled"} Jul 15 11:00:56.453050 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:52.056411Z","caller":"traceutil/trace.go:171","msg":"trace[1067649416] range","detail":"{range_begin:/registry/leases/kube-system/kube-controller-manager; range_end:; }","duration":"1.376329879s","start":"2025-07-15T11:00:50.680061Z","end":"2025-07-15T11:00:52.056391Z","steps":["trace[1067649416] 'agreement among raft nodes before linearized reading' (duration: 1.376213565s)"],"step_count":1} Jul 15 11:00:56.453050 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:52.056451Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:50.680049Z","time spent":"1.376390852s","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Range","request count":0,"request size":56,"response count":0,"response size":0,"request content":"key:\"/registry/leases/kube-system/kube-controller-manager\" limit:1 "} Jul 15 11:00:56.453050 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:52.089122Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.712433606s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/events/default/test-dynamic-volume-claim.185267aefb01d981\" limit:1 ","response":"","error":"context canceled"} Jul 15 11:00:56.453050 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:52.089208Z","caller":"traceutil/trace.go:171","msg":"trace[452821490] range","detail":"{range_begin:/registry/events/default/test-dynamic-volume-claim.185267aefb01d981; range_end:; }","duration":"1.71255995s","start":"2025-07-15T11:00:50.376630Z","end":"2025-07-15T11:00:52.089190Z","steps":["trace[452821490] 'agreement among raft nodes before linearized reading' (duration: 1.712452832s)"],"step_count":1} Jul 15 11:00:56.455093 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:52.089266Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:50.376617Z","time spent":"1.712632434s","remote":"172.24.4.207:54266","response type":"/etcdserverpb.KV/Range","request count":0,"request size":71,"response count":0,"response size":0,"request content":"key:\"/registry/events/default/test-dynamic-volume-claim.185267aefb01d981\" limit:1 "} Jul 15 11:00:59.246652 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:52.379531Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875176228,"retry-timeout":"500ms"} Jul 15 11:00:59.246652 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:52.436372Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.000627547s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context deadline exceeded"} Jul 15 11:00:59.246652 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:52.436474Z","caller":"traceutil/trace.go:171","msg":"trace[326158789] range","detail":"{range_begin:/registry/health; range_end:; }","duration":"2.000756225s","start":"2025-07-15T11:00:50.435694Z","end":"2025-07-15T11:00:52.436450Z","steps":["trace[326158789] 'agreement among raft nodes before linearized reading' (duration: 2.000636975s)"],"step_count":1} Jul 15 11:00:59.246652 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:52.436537Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:50.435565Z","time spent":"2.000956524s","remote":"172.24.4.207:54214","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "} Jul 15 11:00:59.246652 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:52.679070Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.998253243s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context deadline exceeded"} Jul 15 11:00:59.246652 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:52.679168Z","caller":"traceutil/trace.go:171","msg":"trace[1214001981] range","detail":"{range_begin:/registry/health; range_end:; }","duration":"1.998597017s","start":"2025-07-15T11:00:50.680550Z","end":"2025-07-15T11:00:52.679147Z","steps":["trace[1214001981] 'agreement among raft nodes before linearized reading' (duration: 1.998457449s)"],"step_count":1} Jul 15 11:00:59.247684 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:52.679280Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:50.680537Z","time spent":"1.998688116s","remote":"172.24.4.207:54212","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "} Jul 15 11:00:59.247684 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:52.880127Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875176228,"retry-timeout":"500ms"} Jul 15 11:00:59.247684 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:53.380852Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875176228,"retry-timeout":"500ms"} Jul 15 11:00:59.247684 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:53.881858Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875176228,"retry-timeout":"500ms"} Jul 15 11:00:59.247684 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:54.382670Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875176228,"retry-timeout":"500ms"} Jul 15 11:00:59.247684 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:54.883539Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875176228,"retry-timeout":"500ms"} Jul 15 11:00:59.247684 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:55.384160Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875176228,"retry-timeout":"500ms"} Jul 15 11:00:59.247684 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:55.884947Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875176228,"retry-timeout":"500ms"} Jul 15 11:00:59.248120 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:55.963621Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:50.974481Z","time spent":"4.989131539s","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jul 15 11:00:59.248120 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:56.385577Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875176228,"retry-timeout":"500ms"} Jul 15 11:00:59.248120 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:56.886421Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875176228,"retry-timeout":"500ms"} Jul 15 11:00:59.248120 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:57.386750Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875176228,"retry-timeout":"500ms"} Jul 15 11:00:59.248120 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:57.400440Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:50.399427Z","time spent":"7.001004s","remote":"172.24.4.207:54728","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jul 15 11:00:59.248120 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:57.430950Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:50.429934Z","time spent":"7.001003359s","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jul 15 11:00:59.248120 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:57.680857Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:50.679669Z","time spent":"7.001174367s","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jul 15 11:00:59.248430 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:57.695474Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:50.694644Z","time spent":"7.000801829s","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jul 15 11:00:59.248430 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:57.886924Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875176228,"retry-timeout":"500ms"} Jul 15 11:00:59.248430 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:58.310412Z","caller":"etcdserver/v3_server.go:932","msg":"timed out waiting for read index response (local node might have slow network)","timeout":"7s"} Jul 15 11:00:59.248430 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:58.310604Z","caller":"etcdserver/server.go:1237","msg":"Failed to check current member's leadership","error":"context deadline exceeded"} Jul 15 11:00:59.248430 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:58.311381Z","caller":"etcdserver/server.go:1177","msg":"Ignore the lease revoking request because current member isn't a leader","local-member-id":10276657743932975437} Jul 15 11:00:59.248430 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:58.310888Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"14.76254674s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/felixconfigurations/\" range_end:\"/registry/crd.projectcalico.org/felixconfigurations0\" count_only:true ","response":"","error":"etcdserver: request timed out"} Jul 15 11:00:59.248430 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:58.311591Z","caller":"traceutil/trace.go:171","msg":"trace[188397231] range","detail":"{range_begin:/registry/crd.projectcalico.org/felixconfigurations/; range_end:/registry/crd.projectcalico.org/felixconfigurations0; }","duration":"14.763308177s","start":"2025-07-15T11:00:43.548265Z","end":"2025-07-15T11:00:58.311573Z","steps":["trace[188397231] 'agreement among raft nodes before linearized reading' (duration: 14.762585112s)"],"step_count":1} Jul 15 11:00:59.248817 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:58.311731Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:43.548235Z","time spent":"14.763479122s","remote":"172.24.4.207:47670","response type":"/etcdserverpb.KV/Range","request count":0,"request size":110,"response count":0,"response size":0,"request content":"key:\"/registry/crd.projectcalico.org/felixconfigurations/\" range_end:\"/registry/crd.projectcalico.org/felixconfigurations0\" count_only:true "} Jul 15 11:00:59.248817 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:58.310915Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"7.615903826s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/networkpolicies/\" range_end:\"/registry/networkpolicies0\" count_only:true ","response":"","error":"etcdserver: request timed out"} Jul 15 11:00:59.248817 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:58.311942Z","caller":"traceutil/trace.go:171","msg":"trace[945624964] range","detail":"{range_begin:/registry/networkpolicies/; range_end:/registry/networkpolicies0; }","duration":"7.616970727s","start":"2025-07-15T11:00:50.694962Z","end":"2025-07-15T11:00:58.311932Z","steps":["trace[945624964] 'agreement among raft nodes before linearized reading' (duration: 7.615947156s)"],"step_count":1} Jul 15 11:00:59.248817 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:58.311973Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:50.694949Z","time spent":"7.617013475s","remote":"172.24.4.207:54450","response type":"/etcdserverpb.KV/Range","request count":0,"request size":58,"response count":0,"response size":0,"request content":"key:\"/registry/networkpolicies/\" range_end:\"/registry/networkpolicies0\" count_only:true "} Jul 15 11:00:59.249094 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:58.310931Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"7.693358725s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/globalnetworksets/\" range_end:\"/registry/crd.projectcalico.org/globalnetworksets0\" count_only:true ","response":"","error":"etcdserver: request timed out"} Jul 15 11:00:59.249094 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:58.312009Z","caller":"traceutil/trace.go:171","msg":"trace[1037996307] range","detail":"{range_begin:/registry/crd.projectcalico.org/globalnetworksets/; range_end:/registry/crd.projectcalico.org/globalnetworksets0; }","duration":"7.694465298s","start":"2025-07-15T11:00:50.617538Z","end":"2025-07-15T11:00:58.312004Z","steps":["trace[1037996307] 'agreement among raft nodes before linearized reading' (duration: 7.693386516s)"],"step_count":1} Jul 15 11:00:59.249094 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:58.312039Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:50.617520Z","time spent":"7.694500483s","remote":"172.24.4.207:59400","response type":"/etcdserverpb.KV/Range","request count":0,"request size":106,"response count":0,"response size":0,"request content":"key:\"/registry/crd.projectcalico.org/globalnetworksets/\" range_end:\"/registry/crd.projectcalico.org/globalnetworksets0\" count_only:true "} Jul 15 11:00:59.249094 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:58.310996Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"7.875505736s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/managementclusterconnections/\" range_end:\"/registry/operator.tigera.io/managementclusterconnections0\" count_only:true ","response":"","error":"etcdserver: request timed out"} Jul 15 11:00:59.249362 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:58.312303Z","caller":"traceutil/trace.go:171","msg":"trace[947126828] range","detail":"{range_begin:/registry/operator.tigera.io/managementclusterconnections/; range_end:/registry/operator.tigera.io/managementclusterconnections0; }","duration":"7.876844689s","start":"2025-07-15T11:00:50.435418Z","end":"2025-07-15T11:00:58.312263Z","steps":["trace[947126828] 'agreement among raft nodes before linearized reading' (duration: 7.875520944s)"],"step_count":1} Jul 15 11:00:59.249362 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:58.312338Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:50.435410Z","time spent":"7.876916099s","remote":"172.24.4.207:47688","response type":"/etcdserverpb.KV/Range","request count":0,"request size":122,"response count":0,"response size":0,"request content":"key:\"/registry/operator.tigera.io/managementclusterconnections/\" range_end:\"/registry/operator.tigera.io/managementclusterconnections0\" count_only:true "} Jul 15 11:00:59.249362 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:58.311025Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"7.87629833s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/validatingadmissionpolicies/\" range_end:\"/registry/validatingadmissionpolicies0\" count_only:true ","response":"","error":"etcdserver: request timed out"} Jul 15 11:00:59.249362 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:58.312535Z","caller":"traceutil/trace.go:171","msg":"trace[674776641] range","detail":"{range_begin:/registry/validatingadmissionpolicies/; range_end:/registry/validatingadmissionpolicies0; }","duration":"7.877813248s","start":"2025-07-15T11:00:50.434699Z","end":"2025-07-15T11:00:58.312513Z","steps":["trace[674776641] 'agreement among raft nodes before linearized reading' (duration: 7.876318808s)"],"step_count":1} Jul 15 11:00:59.249548 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:58.311039Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"7.934339688s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/events/\" range_end:\"/registry/events0\" count_only:true ","response":"","error":"etcdserver: request timed out"} Jul 15 11:00:59.249548 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:58.312946Z","caller":"traceutil/trace.go:171","msg":"trace[970261597] range","detail":"{range_begin:/registry/events/; range_end:/registry/events0; }","duration":"7.936270132s","start":"2025-07-15T11:00:50.376668Z","end":"2025-07-15T11:00:58.312938Z","steps":["trace[970261597] 'agreement among raft nodes before linearized reading' (duration: 7.934365446s)"],"step_count":1} Jul 15 11:00:59.249548 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:58.312970Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:50.376664Z","time spent":"7.936298175s","remote":"172.24.4.207:54266","response type":"/etcdserverpb.KV/Range","request count":0,"request size":40,"response count":0,"response size":0,"request content":"key:\"/registry/events/\" range_end:\"/registry/events0\" count_only:true "} Jul 15 11:00:59.249548 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:58.312897Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:50.434691Z","time spent":"7.878191906s","remote":"172.24.4.207:54704","response type":"/etcdserverpb.KV/Range","request count":0,"request size":82,"response count":0,"response size":0,"request content":"key:\"/registry/validatingadmissionpolicies/\" range_end:\"/registry/validatingadmissionpolicies0\" count_only:true "} Jul 15 11:00:59.249548 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:58.311062Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"7.962077318s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/persistentvolumes/\" range_end:\"/registry/persistentvolumes0\" count_only:true ","response":"","error":"etcdserver: request timed out"} Jul 15 11:00:59.249752 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:58.313324Z","caller":"traceutil/trace.go:171","msg":"trace[278237392] range","detail":"{range_begin:/registry/persistentvolumes/; range_end:/registry/persistentvolumes0; }","duration":"7.964370894s","start":"2025-07-15T11:00:50.348944Z","end":"2025-07-15T11:00:58.313315Z","steps":["trace[278237392] 'agreement among raft nodes before linearized reading' (duration: 7.962113555s)"],"step_count":1} Jul 15 11:00:59.249752 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:58.313603Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:50.348926Z","time spent":"7.964662462s","remote":"172.24.4.207:54326","response type":"/etcdserverpb.KV/Range","request count":0,"request size":62,"response count":0,"response size":0,"request content":"key:\"/registry/persistentvolumes/\" range_end:\"/registry/persistentvolumes0\" count_only:true "} Jul 15 11:00:59.249752 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:58.311084Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"14.695422639s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/cronjobs/\" range_end:\"/registry/cronjobs0\" count_only:true ","response":"","error":"etcdserver: request timed out"} Jul 15 11:00:59.249752 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:58.313790Z","caller":"traceutil/trace.go:171","msg":"trace[735795238] range","detail":"{range_begin:/registry/cronjobs/; range_end:/registry/cronjobs0; }","duration":"14.698166677s","start":"2025-07-15T11:00:43.615615Z","end":"2025-07-15T11:00:58.313781Z","steps":["trace[735795238] 'agreement among raft nodes before linearized reading' (duration: 14.695463836s)"],"step_count":1} Jul 15 11:00:59.249952 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:58.314224Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:43.615594Z","time spent":"14.698473523s","remote":"172.24.4.207:54418","response type":"/etcdserverpb.KV/Range","request count":0,"request size":44,"response count":0,"response size":0,"request content":"key:\"/registry/cronjobs/\" range_end:\"/registry/cronjobs0\" count_only:true "} Jul 15 11:00:59.249952 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:58.311101Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"15.251770434s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/masterleases/172.24.4.207\" limit:1 ","response":"","error":"etcdserver: request timed out"} Jul 15 11:00:59.249952 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:58.311128Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"15.251116276s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/controllerrevisions/\" range_end:\"/registry/controllerrevisions0\" count_only:true ","response":"","error":"etcdserver: request timed out"} Jul 15 11:00:59.249952 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:58.311156Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"15.251531421s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/networksets/\" range_end:\"/registry/crd.projectcalico.org/networksets0\" count_only:true ","response":"","error":"etcdserver: request timed out"} Jul 15 11:00:59.249952 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:58.311173Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"15.251745648s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/flowschemas/\" range_end:\"/registry/flowschemas0\" count_only:true ","response":"","error":"etcdserver: request timed out"} Jul 15 11:00:59.250161 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:58.311201Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"15.252119168s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/blockaffinities/\" range_end:\"/registry/crd.projectcalico.org/blockaffinities0\" count_only:true ","response":"","error":"etcdserver: request timed out"} Jul 15 11:00:59.250161 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:58.311226Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"15.252086598s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/bgppeers/\" range_end:\"/registry/crd.projectcalico.org/bgppeers0\" count_only:true ","response":"","error":"etcdserver: request timed out"} Jul 15 11:00:59.250161 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:58.311271Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"15.252807378s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/validatingwebhookconfigurations/\" range_end:\"/registry/validatingwebhookconfigurations0\" count_only:true ","response":"","error":"etcdserver: request timed out"} Jul 15 11:00:59.250161 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:58.311290Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"15.253300488s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/adminnetworkpolicies.policy.networking.k8s.io\" limit:1 ","response":"","error":"etcdserver: request timed out"} Jul 15 11:00:59.250161 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:58.314490Z","caller":"traceutil/trace.go:171","msg":"trace[2022610594] range","detail":"{range_begin:/registry/crd.projectcalico.org/networksets/; range_end:/registry/crd.projectcalico.org/networksets0; }","duration":"15.254878072s","start":"2025-07-15T11:00:43.059603Z","end":"2025-07-15T11:00:58.314481Z","steps":["trace[2022610594] 'agreement among raft nodes before linearized reading' (duration: 15.25154149s)"],"step_count":1} Jul 15 11:00:59.250342 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:58.314851Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:43.059598Z","time spent":"15.255238256s","remote":"172.24.4.207:59464","response type":"/etcdserverpb.KV/Range","request count":0,"request size":94,"response count":0,"response size":0,"request content":"key:\"/registry/crd.projectcalico.org/networksets/\" range_end:\"/registry/crd.projectcalico.org/networksets0\" count_only:true "} Jul 15 11:00:59.250342 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:58.314327Z","caller":"traceutil/trace.go:171","msg":"trace[1788078597] range","detail":"{range_begin:/registry/apiextensions.k8s.io/customresourcedefinitions/adminnetworkpolicies.policy.networking.k8s.io; range_end:; }","duration":"15.256337809s","start":"2025-07-15T11:00:43.057979Z","end":"2025-07-15T11:00:58.314317Z","steps":["trace[1788078597] 'agreement among raft nodes before linearized reading' (duration: 15.253304777s)"],"step_count":1} Jul 15 11:00:59.250342 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:58.315177Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:43.057928Z","time spent":"15.257224775s","remote":"172.24.4.207:54256","response type":"/etcdserverpb.KV/Range","request count":0,"request size":106,"response count":0,"response size":0,"request content":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/adminnetworkpolicies.policy.networking.k8s.io\" limit:1 "} Jul 15 11:00:59.250342 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:58.314567Z","caller":"traceutil/trace.go:171","msg":"trace[470637125] range","detail":"{range_begin:/registry/flowschemas/; range_end:/registry/flowschemas0; }","duration":"15.25514789s","start":"2025-07-15T11:00:43.059411Z","end":"2025-07-15T11:00:58.314559Z","steps":["trace[470637125] 'agreement among raft nodes before linearized reading' (duration: 15.251755606s)"],"step_count":1} Jul 15 11:00:59.250512 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:58.315234Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:43.059407Z","time spent":"15.255818308s","remote":"172.24.4.207:54620","response type":"/etcdserverpb.KV/Range","request count":0,"request size":50,"response count":0,"response size":0,"request content":"key:\"/registry/flowschemas/\" range_end:\"/registry/flowschemas0\" count_only:true "} Jul 15 11:00:59.250512 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:58.314582Z","caller":"traceutil/trace.go:171","msg":"trace[1614412789] range","detail":"{range_begin:/registry/crd.projectcalico.org/blockaffinities/; range_end:/registry/crd.projectcalico.org/blockaffinities0; }","duration":"15.255502386s","start":"2025-07-15T11:00:43.059076Z","end":"2025-07-15T11:00:58.314578Z","steps":["trace[1614412789] 'agreement among raft nodes before linearized reading' (duration: 15.252119519s)"],"step_count":1} Jul 15 11:00:59.250512 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:58.315275Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:43.059027Z","time spent":"15.256232833s","remote":"172.24.4.207:59360","response type":"/etcdserverpb.KV/Range","request count":0,"request size":102,"response count":0,"response size":0,"request content":"key:\"/registry/crd.projectcalico.org/blockaffinities/\" range_end:\"/registry/crd.projectcalico.org/blockaffinities0\" count_only:true "} Jul 15 11:00:59.250512 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:58.314595Z","caller":"traceutil/trace.go:171","msg":"trace[892951209] range","detail":"{range_begin:/registry/crd.projectcalico.org/bgppeers/; range_end:/registry/crd.projectcalico.org/bgppeers0; }","duration":"15.255484282s","start":"2025-07-15T11:00:43.059107Z","end":"2025-07-15T11:00:58.314591Z","steps":["trace[892951209] 'agreement among raft nodes before linearized reading' (duration: 15.252103319s)"],"step_count":1} Jul 15 11:00:59.250655 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:58.315378Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:43.059085Z","time spent":"15.256267468s","remote":"172.24.4.207:59414","response type":"/etcdserverpb.KV/Range","request count":0,"request size":88,"response count":0,"response size":0,"request content":"key:\"/registry/crd.projectcalico.org/bgppeers/\" range_end:\"/registry/crd.projectcalico.org/bgppeers0\" count_only:true "} Jul 15 11:00:59.250655 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:58.314617Z","caller":"traceutil/trace.go:171","msg":"trace[503444605] range","detail":"{range_begin:/registry/validatingwebhookconfigurations/; range_end:/registry/validatingwebhookconfigurations0; }","duration":"15.256188091s","start":"2025-07-15T11:00:43.058425Z","end":"2025-07-15T11:00:58.314613Z","steps":["trace[503444605] 'agreement among raft nodes before linearized reading' (duration: 15.25282986s)"],"step_count":1} Jul 15 11:00:59.250655 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:58.315443Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:43.058411Z","time spent":"15.257023543s","remote":"172.24.4.207:54676","response type":"/etcdserverpb.KV/Range","request count":0,"request size":90,"response count":0,"response size":0,"request content":"key:\"/registry/validatingwebhookconfigurations/\" range_end:\"/registry/validatingwebhookconfigurations0\" count_only:true "} Jul 15 11:00:59.250655 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:58.314641Z","caller":"traceutil/trace.go:171","msg":"trace[1144976549] range","detail":"{range_begin:/registry/masterleases/172.24.4.207; range_end:; }","duration":"15.255316461s","start":"2025-07-15T11:00:43.059313Z","end":"2025-07-15T11:00:58.314630Z","steps":["trace[1144976549] 'agreement among raft nodes before linearized reading' (duration: 15.251782025s)"],"step_count":1} Jul 15 11:00:59.250843 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:58.315481Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:43.059308Z","time spent":"15.256166771s","remote":"172.24.4.207:54228","response type":"/etcdserverpb.KV/Range","request count":0,"request size":39,"response count":0,"response size":0,"request content":"key:\"/registry/masterleases/172.24.4.207\" limit:1 "} Jul 15 11:00:59.250843 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:00:58.314724Z","caller":"traceutil/trace.go:171","msg":"trace[1232264650] range","detail":"{range_begin:/registry/controllerrevisions/; range_end:/registry/controllerrevisions0; }","duration":"15.254710483s","start":"2025-07-15T11:00:43.060006Z","end":"2025-07-15T11:00:58.314716Z","steps":["trace[1232264650] 'agreement among raft nodes before linearized reading' (duration: 15.251112889s)"],"step_count":1} Jul 15 11:00:59.250843 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:58.315520Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:43.059946Z","time spent":"15.25555913s","remote":"172.24.4.207:54662","response type":"/etcdserverpb.KV/Range","request count":0,"request size":66,"response count":0,"response size":0,"request content":"key:\"/registry/controllerrevisions/\" range_end:\"/registry/controllerrevisions0\" count_only:true "} Jul 15 11:00:59.250843 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:58.811668Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875176231,"retry-timeout":"500ms"} Jul 15 11:00:59.313331 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:59.312600Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875176231,"retry-timeout":"500ms"} Jul 15 11:01:02.757784 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:00:59.813099Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875176231,"retry-timeout":"500ms"} Jul 15 11:01:02.757784 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:00.313900Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875176231,"retry-timeout":"500ms"} Jul 15 11:01:02.757784 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:00.814418Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875176231,"retry-timeout":"500ms"} Jul 15 11:01:02.757784 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:01.315602Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875176231,"retry-timeout":"500ms"} Jul 15 11:01:02.757784 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:01.816348Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875176231,"retry-timeout":"500ms"} Jul 15 11:01:02.757784 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:02.317043Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875176231,"retry-timeout":"500ms"} Jul 15 11:01:02.818130 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:02.817344Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875176231,"retry-timeout":"500ms"} Jul 15 11:01:03.318191 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:03.317498Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875176231,"retry-timeout":"500ms"} Jul 15 11:01:03.819328 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:03.818592Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875176231,"retry-timeout":"500ms"} Jul 15 11:01:04.306762 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:04.305374Z","caller":"wal/wal.go:805","msg":"slow fdatasync","took":"13.484364524s","expected-duration":"1s"} Jul 15 11:01:04.337988 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:04.335404Z","caller":"traceutil/trace.go:171","msg":"trace[1065495875] linearizableReadLoop","detail":"{readStateIndex:2191; appliedIndex:2180; }","duration":"6.024612597s","start":"2025-07-15T11:00:58.310765Z","end":"2025-07-15T11:01:04.335378Z","steps":["trace[1065495875] 'read index received' (duration: 5.995498986s)","trace[1065495875] 'applied index is now lower than readState.Index' (duration: 29.111878ms)"],"step_count":2} Jul 15 11:01:04.337988 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:04.335568Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"12.318923893s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/namespaces/\" range_end:\"/registry/namespaces0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 11:01:04.337988 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:04.335621Z","caller":"traceutil/trace.go:171","msg":"trace[309793278] range","detail":"{range_begin:/registry/namespaces/; range_end:/registry/namespaces0; response_count:0; response_revision:1888; }","duration":"12.319073719s","start":"2025-07-15T11:00:52.016526Z","end":"2025-07-15T11:01:04.335600Z","steps":["trace[309793278] 'agreement among raft nodes before linearized reading' (duration: 12.318988702s)"],"step_count":1} Jul 15 11:01:04.337988 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:04.335672Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:52.016517Z","time spent":"12.319138087s","remote":"172.24.4.207:54288","response type":"/etcdserverpb.KV/Range","request count":0,"request size":48,"response count":7,"response size":31,"request content":"key:\"/registry/namespaces/\" range_end:\"/registry/namespaces0\" count_only:true "} Jul 15 11:01:04.337988 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:04.335758Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"12.279150125s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/services/endpoints/calico-system/calico-typha\" limit:1 ","response":"range_response_count:1 size:789"} Jul 15 11:01:04.338773 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:04.335886Z","caller":"traceutil/trace.go:171","msg":"trace[72838357] range","detail":"{range_begin:/registry/services/endpoints/calico-system/calico-typha; range_end:; response_count:1; response_revision:1888; }","duration":"12.279280807s","start":"2025-07-15T11:00:52.056573Z","end":"2025-07-15T11:01:04.335854Z","steps":["trace[72838357] 'agreement among raft nodes before linearized reading' (duration: 12.278885337s)"],"step_count":1} Jul 15 11:01:04.338773 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:04.335960Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:52.056530Z","time spent":"12.279393766s","remote":"172.24.4.207:54340","response type":"/etcdserverpb.KV/Range","request count":0,"request size":59,"response count":1,"response size":813,"request content":"key:\"/registry/services/endpoints/calico-system/calico-typha\" limit:1 "} Jul 15 11:01:04.338773 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:04.336089Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"12.319579633s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/endpointslices/\" range_end:\"/registry/endpointslices0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 11:01:04.338773 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:04.336149Z","caller":"traceutil/trace.go:171","msg":"trace[1096269363] range","detail":"{range_begin:/registry/endpointslices/; range_end:/registry/endpointslices0; response_count:0; response_revision:1888; }","duration":"12.319742935s","start":"2025-07-15T11:00:52.016391Z","end":"2025-07-15T11:01:04.336134Z","steps":["trace[1096269363] 'agreement among raft nodes before linearized reading' (duration: 12.319520475s)"],"step_count":1} Jul 15 11:01:04.339271 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:04.336196Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:52.016364Z","time spent":"12.319814397s","remote":"172.24.4.207:54438","response type":"/etcdserverpb.KV/Range","request count":0,"request size":56,"response count":8,"response size":31,"request content":"key:\"/registry/endpointslices/\" range_end:\"/registry/endpointslices0\" count_only:true "} Jul 15 11:01:04.339271 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:04.336266Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"12.151660844s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/default/test-pod-1\" limit:1 ","response":"range_response_count:1 size:2344"} Jul 15 11:01:04.339271 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:04.336359Z","caller":"traceutil/trace.go:171","msg":"trace[1707702001] range","detail":"{range_begin:/registry/pods/default/test-pod-1; range_end:; response_count:1; response_revision:1888; }","duration":"12.151755919s","start":"2025-07-15T11:00:52.184551Z","end":"2025-07-15T11:01:04.336306Z","steps":["trace[1707702001] 'agreement among raft nodes before linearized reading' (duration: 12.151584653s)"],"step_count":1} Jul 15 11:01:04.339271 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:04.336442Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:52.184526Z","time spent":"12.151865392s","remote":"172.24.4.207:54350","response type":"/etcdserverpb.KV/Range","request count":0,"request size":37,"response count":1,"response size":2368,"request content":"key:\"/registry/pods/default/test-pod-1\" limit:1 "} Jul 15 11:01:04.339271 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:04.336574Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"12.997124329s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/events/kube-system/kube-apiserver-ci-4230-2-100-9439eb8d1a.novalocal.1852678f480d3898\" limit:1 ","response":"range_response_count:1 size:904"} Jul 15 11:01:04.339778 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:04.336663Z","caller":"traceutil/trace.go:171","msg":"trace[1496329471] range","detail":"{range_begin:/registry/events/kube-system/kube-apiserver-ci-4230-2-100-9439eb8d1a.novalocal.1852678f480d3898; range_end:; response_count:1; response_revision:1888; }","duration":"12.997247928s","start":"2025-07-15T11:00:51.339374Z","end":"2025-07-15T11:01:04.336622Z","steps":["trace[1496329471] 'agreement among raft nodes before linearized reading' (duration: 12.996980104s)"],"step_count":1} Jul 15 11:01:04.339778 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:04.336964Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:00:51.339295Z","time spent":"12.997566686s","remote":"172.24.4.207:54266","response type":"/etcdserverpb.KV/Range","request count":0,"request size":99,"response count":1,"response size":928,"request content":"key:\"/registry/events/kube-system/kube-apiserver-ci-4230-2-100-9439eb8d1a.novalocal.1852678f480d3898\" limit:1 "} Jul 15 11:01:04.518138 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:04.516895Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"118.910891ms","expected-duration":"100ms","prefix":"","request":"header: lease_grant:","response":"size:42"} Jul 15 11:01:04.623527 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:04.621709Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"104.490463ms","expected-duration":"100ms","prefix":"","request":"header: lease_revoke:","response":"size:29"} Jul 15 11:01:04.626862 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:04.623367Z","caller":"traceutil/trace.go:171","msg":"trace[344583219] transaction","detail":"{read_only:false; response_revision:1890; number_of_response:1; }","duration":"103.881247ms","start":"2025-07-15T11:01:04.519461Z","end":"2025-07-15T11:01:04.623342Z","steps":["trace[344583219] 'process raft request' (duration: 103.450922ms)"],"step_count":1} Jul 15 11:01:04.626862 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:04.623884Z","caller":"traceutil/trace.go:171","msg":"trace[1508262405] linearizableReadLoop","detail":"{readStateIndex:2196; appliedIndex:2193; }","duration":"248.64575ms","start":"2025-07-15T11:01:04.375220Z","end":"2025-07-15T11:01:04.623865Z","steps":["trace[1508262405] 'read index received' (duration: 22.687745ms)","trace[1508262405] 'applied index is now lower than readState.Index' (duration: 225.956252ms)"],"step_count":2} Jul 15 11:01:04.626862 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:04.625094Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"249.870352ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/minions/172.24.4.38\" limit:1 ","response":"range_response_count:1 size:4422"} Jul 15 11:01:04.626862 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:04.625379Z","caller":"traceutil/trace.go:171","msg":"trace[1165381001] range","detail":"{range_begin:/registry/minions/172.24.4.38; range_end:; response_count:1; response_revision:1890; }","duration":"250.218444ms","start":"2025-07-15T11:01:04.375141Z","end":"2025-07-15T11:01:04.625359Z","steps":["trace[1165381001] 'agreement among raft nodes before linearized reading' (duration: 249.016684ms)"],"step_count":1} Jul 15 11:01:04.626862 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:04.626363Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"249.440287ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/leases/kube-system/apiserver-fuiduxu7owk6v7uchbxm2eaflq\" limit:1 ","response":"range_response_count:1 size:713"} Jul 15 11:01:04.629751 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:04.627538Z","caller":"traceutil/trace.go:171","msg":"trace[1074462430] range","detail":"{range_begin:/registry/leases/kube-system/apiserver-fuiduxu7owk6v7uchbxm2eaflq; range_end:; response_count:1; response_revision:1890; }","duration":"250.567629ms","start":"2025-07-15T11:01:04.376896Z","end":"2025-07-15T11:01:04.627464Z","steps":["trace[1074462430] 'agreement among raft nodes before linearized reading' (duration: 249.234546ms)"],"step_count":1} Jul 15 11:01:04.630137 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:04.626880Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"174.247716ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/leases/kube-node-lease/ci-4230-2-100-9439eb8d1a.novalocal\" limit:1 ","response":"range_response_count:1 size:639"} Jul 15 11:01:04.630137 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:04.628348Z","caller":"traceutil/trace.go:171","msg":"trace[1308298485] range","detail":"{range_begin:/registry/leases/kube-node-lease/ci-4230-2-100-9439eb8d1a.novalocal; range_end:; response_count:1; response_revision:1890; }","duration":"175.770117ms","start":"2025-07-15T11:01:04.452555Z","end":"2025-07-15T11:01:04.628325Z","steps":["trace[1308298485] 'agreement among raft nodes before linearized reading' (duration: 174.082842ms)"],"step_count":1} Jul 15 11:01:04.630137 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:04.627009Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"248.568286ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/leases/kube-node-lease/172.24.4.38\" limit:1 ","response":"range_response_count:1 size:548"} Jul 15 11:01:04.630137 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:04.628469Z","caller":"traceutil/trace.go:171","msg":"trace[1271805750] range","detail":"{range_begin:/registry/leases/kube-node-lease/172.24.4.38; range_end:; response_count:1; response_revision:1890; }","duration":"250.025768ms","start":"2025-07-15T11:01:04.378408Z","end":"2025-07-15T11:01:04.628433Z","steps":["trace[1271805750] 'agreement among raft nodes before linearized reading' (duration: 248.507314ms)"],"step_count":1} Jul 15 11:01:10.620006 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:10.618298Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"5.85247084s","expected-duration":"100ms","prefix":"","request":"header: txn: success:> failure:<>>","response":"size:16"} Jul 15 11:01:10.621059 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:10.619061Z","caller":"traceutil/trace.go:171","msg":"trace[1010899061] linearizableReadLoop","detail":"{readStateIndex:2205; appliedIndex:2202; }","duration":"5.854666302s","start":"2025-07-15T11:01:04.764382Z","end":"2025-07-15T11:01:10.619048Z","steps":["trace[1010899061] 'read index received' (duration: 1.39742ms)","trace[1010899061] 'applied index is now lower than readState.Index' (duration: 5.853268211s)"],"step_count":2} Jul 15 11:01:10.621059 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:10.619141Z","caller":"traceutil/trace.go:171","msg":"trace[1963193224] transaction","detail":"{read_only:false; response_revision:1894; number_of_response:1; }","duration":"5.933633573s","start":"2025-07-15T11:01:04.685423Z","end":"2025-07-15T11:01:10.619057Z","steps":["trace[1963193224] 'process raft request' (duration: 80.332472ms)","trace[1963193224] 'compare' (duration: 5.852337612s)"],"step_count":2} Jul 15 11:01:10.621059 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:10.619429Z","caller":"traceutil/trace.go:171","msg":"trace[463559264] transaction","detail":"{read_only:false; response_revision:1895; number_of_response:1; }","duration":"5.927449174s","start":"2025-07-15T11:01:04.691969Z","end":"2025-07-15T11:01:10.619419Z","steps":["trace[463559264] 'process raft request' (duration: 5.926939323s)"],"step_count":1} Jul 15 11:01:10.621059 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:10.619421Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:01:04.685379Z","time spent":"5.933894416s","remote":"172.24.4.207:54266","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":943,"response count":0,"response size":40,"request content":"compare: success:> failure:<>"} Jul 15 11:01:10.621245 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:10.619512Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:01:04.691931Z","time spent":"5.927524243s","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":625,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 11:01:10.621245 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:10.619573Z","caller":"traceutil/trace.go:171","msg":"trace[268539962] transaction","detail":"{read_only:false; response_revision:1896; number_of_response:1; }","duration":"5.927086564s","start":"2025-07-15T11:01:04.692480Z","end":"2025-07-15T11:01:10.619566Z","steps":["trace[268539962] 'process raft request' (duration: 5.926495865s)"],"step_count":1} Jul 15 11:01:10.621245 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:10.619610Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:01:04.692446Z","time spent":"5.927141355s","remote":"172.24.4.207:54228","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":116,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 11:01:10.621400 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:10.619660Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"5.855281008s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/caliconodestatuses/\" range_end:\"/registry/crd.projectcalico.org/caliconodestatuses0\" count_only:true ","response":"range_response_count:0 size:5"} Jul 15 11:01:10.621400 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:10.619679Z","caller":"traceutil/trace.go:171","msg":"trace[1567145374] range","detail":"{range_begin:/registry/crd.projectcalico.org/caliconodestatuses/; range_end:/registry/crd.projectcalico.org/caliconodestatuses0; response_count:0; response_revision:1896; }","duration":"5.855348452s","start":"2025-07-15T11:01:04.764324Z","end":"2025-07-15T11:01:10.619673Z","steps":["trace[1567145374] 'agreement among raft nodes before linearized reading' (duration: 5.855316854s)"],"step_count":1} Jul 15 11:01:10.621400 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:10.619718Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:01:04.764289Z","time spent":"5.855420696s","remote":"172.24.4.207:59336","response type":"/etcdserverpb.KV/Range","request count":0,"request size":108,"response count":0,"response size":29,"request content":"key:\"/registry/crd.projectcalico.org/caliconodestatuses/\" range_end:\"/registry/crd.projectcalico.org/caliconodestatuses0\" count_only:true "} Jul 15 11:01:11.488568 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:11.120258Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875176255,"retry-timeout":"500ms"} Jul 15 11:01:11.538945 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:11.536958Z","caller":"wal/wal.go:805","msg":"slow fdatasync","took":"1.151986493s","expected-duration":"1s"} Jul 15 11:01:11.612212 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:11.610507Z","caller":"traceutil/trace.go:171","msg":"trace[1159792928] transaction","detail":"{read_only:false; response_revision:1897; number_of_response:1; }","duration":"6.825813424s","start":"2025-07-15T11:01:04.784573Z","end":"2025-07-15T11:01:11.610387Z","steps":["trace[1159792928] 'process raft request' (duration: 6.753610234s)","trace[1159792928] 'compare' (duration: 71.601568ms)"],"step_count":2} Jul 15 11:01:11.612212 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:11.610986Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:01:04.784546Z","time spent":"6.826096967s","remote":"172.24.4.207:54728","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":4949,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 11:01:11.684044 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:11.683289Z","caller":"traceutil/trace.go:171","msg":"trace[2121738383] linearizableReadLoop","detail":"{readStateIndex:2207; appliedIndex:2205; }","duration":"1.064149263s","start":"2025-07-15T11:01:10.619104Z","end":"2025-07-15T11:01:11.683253Z","steps":["trace[2121738383] 'read index received' (duration: 918.904151ms)","trace[2121738383] 'applied index is now lower than readState.Index' (duration: 145.243198ms)"],"step_count":2} Jul 15 11:01:11.686597 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:11.684587Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"5.177578487s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/clusterinformations/default\" limit:1 ","response":"range_response_count:1 size:886"} Jul 15 11:01:11.686597 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:11.685078Z","caller":"traceutil/trace.go:171","msg":"trace[585505625] range","detail":"{range_begin:/registry/crd.projectcalico.org/clusterinformations/default; range_end:; response_count:1; response_revision:1898; }","duration":"5.178115338s","start":"2025-07-15T11:01:06.506926Z","end":"2025-07-15T11:01:11.685042Z","steps":["trace[585505625] 'agreement among raft nodes before linearized reading' (duration: 5.176818323s)"],"step_count":1} Jul 15 11:01:11.686597 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:11.685141Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:01:06.506903Z","time spent":"5.178217517s","remote":"172.24.4.207:47728","response type":"/etcdserverpb.KV/Range","request count":0,"request size":63,"response count":1,"response size":910,"request content":"key:\"/registry/crd.projectcalico.org/clusterinformations/default\" limit:1 "} Jul 15 11:01:11.686597 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:11.685432Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.058854054s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/services/endpoints/default/kubernetes\" limit:1 ","response":"range_response_count:1 size:420"} Jul 15 11:01:11.686597 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:11.685490Z","caller":"traceutil/trace.go:171","msg":"trace[694251076] range","detail":"{range_begin:/registry/services/endpoints/default/kubernetes; range_end:; response_count:1; response_revision:1898; }","duration":"1.05895959s","start":"2025-07-15T11:01:10.626512Z","end":"2025-07-15T11:01:11.685472Z","steps":["trace[694251076] 'agreement among raft nodes before linearized reading' (duration: 1.058843435s)"],"step_count":1} Jul 15 11:01:11.688170 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:11.685536Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:01:10.626484Z","time spent":"1.059036492s","remote":"172.24.4.207:54340","response type":"/etcdserverpb.KV/Range","request count":0,"request size":51,"response count":1,"response size":444,"request content":"key:\"/registry/services/endpoints/default/kubernetes\" limit:1 "} Jul 15 11:01:11.688170 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:11.684721Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.190469754s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jul 15 11:01:11.688170 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:11.685647Z","caller":"traceutil/trace.go:171","msg":"trace[43975001] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1898; }","duration":"1.191475161s","start":"2025-07-15T11:01:10.494159Z","end":"2025-07-15T11:01:11.685634Z","steps":["trace[43975001] 'agreement among raft nodes before linearized reading' (duration: 1.19049498s)"],"step_count":1} Jul 15 11:01:11.688170 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:11.685686Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:01:10.494125Z","time spent":"1.191547845s","remote":"172.24.4.207:54212","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":29,"request content":"key:\"/registry/health\" "} Jul 15 11:01:11.688170 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:11.684846Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.329016367s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/controllers/\" range_end:\"/registry/controllers0\" count_only:true ","response":"range_response_count:0 size:5"} Jul 15 11:01:11.689017 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:11.686748Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.174880768s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/minions/ci-4230-2-100-9439eb8d1a.novalocal\" limit:1 ","response":"range_response_count:1 size:6679"} Jul 15 11:01:11.689017 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:11.687256Z","caller":"traceutil/trace.go:171","msg":"trace[1590379444] range","detail":"{range_begin:/registry/minions/ci-4230-2-100-9439eb8d1a.novalocal; range_end:; response_count:1; response_revision:1898; }","duration":"1.17510376s","start":"2025-07-15T11:01:10.511729Z","end":"2025-07-15T11:01:11.686833Z","steps":["trace[1590379444] 'agreement among raft nodes before linearized reading' (duration: 1.171574372s)"],"step_count":1} Jul 15 11:01:11.689017 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:11.687619Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:01:10.511713Z","time spent":"1.175599615s","remote":"172.24.4.207:54344","response type":"/etcdserverpb.KV/Range","request count":0,"request size":56,"response count":1,"response size":6703,"request content":"key:\"/registry/minions/ci-4230-2-100-9439eb8d1a.novalocal\" limit:1 "} Jul 15 11:01:11.689017 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:11.688481Z","caller":"traceutil/trace.go:171","msg":"trace[1912063904] transaction","detail":"{read_only:false; response_revision:1898; number_of_response:1; }","duration":"1.052394586s","start":"2025-07-15T11:01:10.635986Z","end":"2025-07-15T11:01:11.688381Z","steps":["trace[1912063904] 'process raft request' (duration: 1.046624691s)"],"step_count":1} Jul 15 11:01:11.689703 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:11.689093Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:01:10.635951Z","time spent":"1.052944742s","remote":"172.24.4.207:54266","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":979,"response count":0,"response size":40,"request content":"compare: success:> failure:<>"} Jul 15 11:01:11.690436 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:11.689963Z","caller":"traceutil/trace.go:171","msg":"trace[1738049465] range","detail":"{range_begin:/registry/controllers/; range_end:/registry/controllers0; response_count:0; response_revision:1898; }","duration":"1.330052882s","start":"2025-07-15T11:01:10.355740Z","end":"2025-07-15T11:01:11.685793Z","steps":["trace[1738049465] 'agreement among raft nodes before linearized reading' (duration: 1.329001901s)"],"step_count":1} Jul 15 11:01:11.691177 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:11.690208Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.159452037s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/kube-system/kube-scheduler-ci-4230-2-100-9439eb8d1a.novalocal\" limit:1 ","response":"range_response_count:1 size:4667"} Jul 15 11:01:11.692667 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:11.690737Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:01:10.355722Z","time spent":"1.334762959s","remote":"172.24.4.207:54372","response type":"/etcdserverpb.KV/Range","request count":0,"request size":50,"response count":0,"response size":29,"request content":"key:\"/registry/controllers/\" range_end:\"/registry/controllers0\" count_only:true "} Jul 15 11:01:11.692667 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:11.691001Z","caller":"traceutil/trace.go:171","msg":"trace[1253535340] range","detail":"{range_begin:/registry/pods/kube-system/kube-scheduler-ci-4230-2-100-9439eb8d1a.novalocal; range_end:; response_count:1; response_revision:1898; }","duration":"1.160003055s","start":"2025-07-15T11:01:10.530635Z","end":"2025-07-15T11:01:11.690638Z","steps":["trace[1253535340] 'agreement among raft nodes before linearized reading' (duration: 1.159064361s)"],"step_count":1} Jul 15 11:01:11.693731 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:11.691547Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:01:10.530617Z","time spent":"1.160706474s","remote":"172.24.4.207:54350","response type":"/etcdserverpb.KV/Range","request count":0,"request size":80,"response count":1,"response size":4691,"request content":"key:\"/registry/pods/kube-system/kube-scheduler-ci-4230-2-100-9439eb8d1a.novalocal\" limit:1 "} Jul 15 11:01:11.694197 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:11.684906Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.33047492s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/stagedglobalnetworkpolicies/\" range_end:\"/registry/crd.projectcalico.org/stagedglobalnetworkpolicies0\" count_only:true ","response":"range_response_count:0 size:5"} Jul 15 11:01:11.694197 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:11.692349Z","caller":"traceutil/trace.go:171","msg":"trace[1918189405] range","detail":"{range_begin:/registry/crd.projectcalico.org/stagedglobalnetworkpolicies/; range_end:/registry/crd.projectcalico.org/stagedglobalnetworkpolicies0; response_count:0; response_revision:1898; }","duration":"1.338074624s","start":"2025-07-15T11:01:10.354252Z","end":"2025-07-15T11:01:11.692327Z","steps":["trace[1918189405] 'agreement among raft nodes before linearized reading' (duration: 1.330628876s)"],"step_count":1} Jul 15 11:01:11.694197 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:11.692677Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:01:10.354213Z","time spent":"1.338239518s","remote":"172.24.4.207:59384","response type":"/etcdserverpb.KV/Range","request count":0,"request size":126,"response count":0,"response size":29,"request content":"key:\"/registry/crd.projectcalico.org/stagedglobalnetworkpolicies/\" range_end:\"/registry/crd.projectcalico.org/stagedglobalnetworkpolicies0\" count_only:true "} Jul 15 11:01:11.978031 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:11.977097Z","caller":"traceutil/trace.go:171","msg":"trace[1063715811] transaction","detail":"{read_only:false; response_revision:1903; number_of_response:1; }","duration":"104.33179ms","start":"2025-07-15T11:01:11.872672Z","end":"2025-07-15T11:01:11.977004Z","steps":["trace[1063715811] 'process raft request' (duration: 87.535694ms)","trace[1063715811] 'compare' (duration: 16.50604ms)"],"step_count":2} Jul 15 11:01:24.540152 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:24.538451Z","caller":"traceutil/trace.go:171","msg":"trace[113006883] transaction","detail":"{read_only:false; response_revision:1937; number_of_response:1; }","duration":"224.497064ms","start":"2025-07-15T11:01:24.313786Z","end":"2025-07-15T11:01:24.538283Z","steps":["trace[113006883] 'process raft request' (duration: 201.301651ms)","trace[113006883] 'compare' (duration: 22.510749ms)"],"step_count":2} Jul 15 11:01:27.557456 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:27.555894Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"411.429398ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/ipamblocks/\" range_end:\"/registry/crd.projectcalico.org/ipamblocks0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 11:01:27.557456 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:27.556017Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"372.668752ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/mutatingwebhookconfigurations/\" range_end:\"/registry/mutatingwebhookconfigurations0\" count_only:true ","response":"range_response_count:0 size:5"} Jul 15 11:01:27.557456 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:27.556105Z","caller":"traceutil/trace.go:171","msg":"trace[160871258] range","detail":"{range_begin:/registry/crd.projectcalico.org/ipamblocks/; range_end:/registry/crd.projectcalico.org/ipamblocks0; response_count:0; response_revision:1937; }","duration":"411.775606ms","start":"2025-07-15T11:01:27.144287Z","end":"2025-07-15T11:01:27.556063Z","steps":["trace[160871258] 'count revisions from in-memory index tree' (duration: 411.338169ms)"],"step_count":1} Jul 15 11:01:27.557456 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:27.556230Z","caller":"traceutil/trace.go:171","msg":"trace[1207020382] range","detail":"{range_begin:/registry/mutatingwebhookconfigurations/; range_end:/registry/mutatingwebhookconfigurations0; response_count:0; response_revision:1937; }","duration":"373.256637ms","start":"2025-07-15T11:01:27.182901Z","end":"2025-07-15T11:01:27.556157Z","steps":["trace[1207020382] 'count revisions from in-memory index tree' (duration: 372.545725ms)"],"step_count":1} Jul 15 11:01:27.558690 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:27.556389Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:01:27.182877Z","time spent":"373.422855ms","remote":"172.24.4.207:54690","response type":"/etcdserverpb.KV/Range","request count":0,"request size":86,"response count":0,"response size":29,"request content":"key:\"/registry/mutatingwebhookconfigurations/\" range_end:\"/registry/mutatingwebhookconfigurations0\" count_only:true "} Jul 15 11:01:27.558690 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:27.556337Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:01:27.144263Z","time spent":"412.008988ms","remote":"172.24.4.207:59350","response type":"/etcdserverpb.KV/Range","request count":0,"request size":92,"response count":2,"response size":31,"request content":"key:\"/registry/crd.projectcalico.org/ipamblocks/\" range_end:\"/registry/crd.projectcalico.org/ipamblocks0\" count_only:true "} Jul 15 11:01:27.699768 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:27.697896Z","caller":"traceutil/trace.go:171","msg":"trace[1406603419] linearizableReadLoop","detail":"{readStateIndex:2257; appliedIndex:2256; }","duration":"123.536353ms","start":"2025-07-15T11:01:27.574212Z","end":"2025-07-15T11:01:27.697749Z","steps":["trace[1406603419] 'read index received' (duration: 123.144921ms)","trace[1406603419] 'applied index is now lower than readState.Index' (duration: 389.99µs)"],"step_count":2} Jul 15 11:01:27.699768 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:27.698170Z","caller":"traceutil/trace.go:171","msg":"trace[1162651875] transaction","detail":"{read_only:false; response_revision:1938; number_of_response:1; }","duration":"124.053268ms","start":"2025-07-15T11:01:27.574085Z","end":"2025-07-15T11:01:27.698138Z","steps":["trace[1162651875] 'process raft request' (duration: 123.089588ms)"],"step_count":1} Jul 15 11:01:27.701563 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:27.699917Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"125.533741ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/ipreservations/\" range_end:\"/registry/crd.projectcalico.org/ipreservations0\" count_only:true ","response":"range_response_count:0 size:5"} Jul 15 11:01:27.701563 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:27.700290Z","caller":"traceutil/trace.go:171","msg":"trace[1108692675] range","detail":"{range_begin:/registry/crd.projectcalico.org/ipreservations/; range_end:/registry/crd.projectcalico.org/ipreservations0; response_count:0; response_revision:1938; }","duration":"125.821944ms","start":"2025-07-15T11:01:27.574162Z","end":"2025-07-15T11:01:27.699984Z","steps":["trace[1108692675] 'agreement among raft nodes before linearized reading' (duration: 124.163932ms)"],"step_count":1} Jul 15 11:01:27.727370 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:27.726131Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"151.429091ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jul 15 11:01:27.727370 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:27.726284Z","caller":"traceutil/trace.go:171","msg":"trace[1636903382] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1939; }","duration":"151.653043ms","start":"2025-07-15T11:01:27.574583Z","end":"2025-07-15T11:01:27.726236Z","steps":["trace[1636903382] 'agreement among raft nodes before linearized reading' (duration: 151.028189ms)"],"step_count":1} Jul 15 11:01:27.727370 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:27.726676Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"109.708539ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/tigera-operator/tigera-operator-747864d56d-tqm9g\" limit:1 ","response":"range_response_count:1 size:4433"} Jul 15 11:01:27.727370 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:27.726723Z","caller":"traceutil/trace.go:171","msg":"trace[1555200446] range","detail":"{range_begin:/registry/pods/tigera-operator/tigera-operator-747864d56d-tqm9g; range_end:; response_count:1; response_revision:1939; }","duration":"109.766567ms","start":"2025-07-15T11:01:27.616942Z","end":"2025-07-15T11:01:27.726709Z","steps":["trace[1555200446] 'agreement among raft nodes before linearized reading' (duration: 109.500315ms)"],"step_count":1} Jul 15 11:01:27.729323 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:27.727385Z","caller":"traceutil/trace.go:171","msg":"trace[1503383451] transaction","detail":"{read_only:false; response_revision:1939; number_of_response:1; }","duration":"121.099955ms","start":"2025-07-15T11:01:27.606234Z","end":"2025-07-15T11:01:27.727334Z","steps":["trace[1503383451] 'process raft request' (duration: 119.227738ms)"],"step_count":1} Jul 15 11:01:27.729323 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:27.727780Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"142.020766ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/leases/kube-system/kube-controller-manager\" limit:1 ","response":"range_response_count:1 size:532"} Jul 15 11:01:27.729323 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:27.728047Z","caller":"traceutil/trace.go:171","msg":"trace[847997982] range","detail":"{range_begin:/registry/leases/kube-system/kube-controller-manager; range_end:; response_count:1; response_revision:1939; }","duration":"142.366094ms","start":"2025-07-15T11:01:27.585666Z","end":"2025-07-15T11:01:27.728032Z","steps":["trace[847997982] 'agreement among raft nodes before linearized reading' (duration: 141.988447ms)"],"step_count":1} Jul 15 11:01:29.163189 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:29.162011Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"645.778357ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/leases/kube-system/kube-scheduler\" limit:1 ","response":"range_response_count:1 size:505"} Jul 15 11:01:29.163189 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:29.162213Z","caller":"traceutil/trace.go:171","msg":"trace[521032291] range","detail":"{range_begin:/registry/leases/kube-system/kube-scheduler; range_end:; response_count:1; response_revision:1941; }","duration":"645.958319ms","start":"2025-07-15T11:01:28.516145Z","end":"2025-07-15T11:01:29.162103Z","steps":["trace[521032291] 'range keys from in-memory index tree' (duration: 645.480057ms)"],"step_count":1} Jul 15 11:01:29.163189 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:29.162301Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:01:28.516111Z","time spent":"646.157177ms","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Range","request count":0,"request size":47,"response count":1,"response size":529,"request content":"key:\"/registry/leases/kube-system/kube-scheduler\" limit:1 "} Jul 15 11:01:35.882446 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:35.879301Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:01:35.502293Z","time spent":"376.995413ms","remote":"172.24.4.207:54228","response type":"/etcdserverpb.Lease/LeaseGrant","request count":-1,"request size":-1,"response count":-1,"response size":-1,"request content":""} Jul 15 11:01:36.117413 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:36.113514Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"112.058757ms","expected-duration":"100ms","prefix":"","request":"header: txn: success:> failure: >>","response":"size:16"} Jul 15 11:01:36.117413 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:36.113840Z","caller":"traceutil/trace.go:171","msg":"trace[1847322809] transaction","detail":"{read_only:false; response_revision:1945; number_of_response:1; }","duration":"598.219424ms","start":"2025-07-15T11:01:35.515536Z","end":"2025-07-15T11:01:36.113756Z","steps":["trace[1847322809] 'process raft request' (duration: 485.341764ms)","trace[1847322809] 'compare' (duration: 111.780805ms)"],"step_count":2} Jul 15 11:01:36.117413 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:36.114050Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:01:35.515516Z","time spent":"598.430455ms","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":625,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 11:01:36.118294 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:36.114415Z","caller":"traceutil/trace.go:171","msg":"trace[1187889377] transaction","detail":"{read_only:false; number_of_response:0; response_revision:1945; }","duration":"550.072268ms","start":"2025-07-15T11:01:35.564324Z","end":"2025-07-15T11:01:36.114396Z","steps":["trace[1187889377] 'process raft request' (duration: 549.313176ms)"],"step_count":1} Jul 15 11:01:36.118294 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:36.114636Z","caller":"traceutil/trace.go:171","msg":"trace[714167160] transaction","detail":"{read_only:false; response_revision:1947; number_of_response:1; }","duration":"231.840158ms","start":"2025-07-15T11:01:35.882704Z","end":"2025-07-15T11:01:36.114545Z","steps":["trace[714167160] 'process raft request' (duration: 231.754028ms)"],"step_count":1} Jul 15 11:01:36.118294 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:36.115008Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:01:35.564301Z","time spent":"550.32834ms","remote":"172.24.4.207:59328","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":29,"request content":"compare: success:> failure:<>"} Jul 15 11:01:36.118294 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:36.115351Z","caller":"traceutil/trace.go:171","msg":"trace[205881460] transaction","detail":"{read_only:false; response_revision:1946; number_of_response:1; }","duration":"281.490993ms","start":"2025-07-15T11:01:35.833841Z","end":"2025-07-15T11:01:36.115332Z","steps":["trace[205881460] 'process raft request' (duration: 280.001382ms)"],"step_count":1} Jul 15 11:01:36.118909 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:36.115495Z","caller":"traceutil/trace.go:171","msg":"trace[1566127174] linearizableReadLoop","detail":"{readStateIndex:2266; appliedIndex:2265; }","duration":"599.726959ms","start":"2025-07-15T11:01:35.515754Z","end":"2025-07-15T11:01:36.115481Z","steps":["trace[1566127174] 'read index received' (duration: 364.207918ms)","trace[1566127174] 'applied index is now lower than readState.Index' (duration: 235.517838ms)"],"step_count":2} Jul 15 11:01:36.118909 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:36.115742Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"599.957805ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/leases/kube-system/kube-controller-manager\" limit:1 ","response":"range_response_count:1 size:532"} Jul 15 11:01:36.118909 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:36.116478Z","caller":"traceutil/trace.go:171","msg":"trace[3787568] range","detail":"{range_begin:/registry/leases/kube-system/kube-controller-manager; range_end:; response_count:1; response_revision:1947; }","duration":"600.04125ms","start":"2025-07-15T11:01:35.515742Z","end":"2025-07-15T11:01:36.115784Z","steps":["trace[3787568] 'agreement among raft nodes before linearized reading' (duration: 599.877787ms)"],"step_count":1} Jul 15 11:01:36.118909 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:36.116403Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"600.59412ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/leases/kube-system/kube-scheduler\" limit:1 ","response":"range_response_count:1 size:505"} Jul 15 11:01:36.119864 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:36.118615Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"235.95754ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/kube-system/kube-scheduler-ci-4230-2-100-9439eb8d1a.novalocal\" limit:1 ","response":"range_response_count:1 size:4973"} Jul 15 11:01:36.119864 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:36.118724Z","caller":"traceutil/trace.go:171","msg":"trace[273343157] range","detail":"{range_begin:/registry/pods/kube-system/kube-scheduler-ci-4230-2-100-9439eb8d1a.novalocal; range_end:; response_count:1; response_revision:1947; }","duration":"236.152791ms","start":"2025-07-15T11:01:35.882553Z","end":"2025-07-15T11:01:36.118705Z","steps":["trace[273343157] 'agreement among raft nodes before linearized reading' (duration: 235.870029ms)"],"step_count":1} Jul 15 11:01:36.119864 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:36.119064Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"117.869257ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/servicecidrs/\" range_end:\"/registry/servicecidrs0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 11:01:36.119864 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:36.119111Z","caller":"traceutil/trace.go:171","msg":"trace[65680681] range","detail":"{range_begin:/registry/servicecidrs/; range_end:/registry/servicecidrs0; response_count:0; response_revision:1947; }","duration":"117.95728ms","start":"2025-07-15T11:01:36.001139Z","end":"2025-07-15T11:01:36.119097Z","steps":["trace[65680681] 'agreement among raft nodes before linearized reading' (duration: 117.886009ms)"],"step_count":1} Jul 15 11:01:36.120459 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:36.117415Z","caller":"traceutil/trace.go:171","msg":"trace[1609227492] range","detail":"{range_begin:/registry/leases/kube-system/kube-scheduler; range_end:; response_count:1; response_revision:1947; }","duration":"601.396172ms","start":"2025-07-15T11:01:35.515769Z","end":"2025-07-15T11:01:36.117165Z","steps":["trace[1609227492] 'agreement among raft nodes before linearized reading' (duration: 600.295911ms)"],"step_count":1} Jul 15 11:01:36.122050 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:36.120663Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:01:35.515766Z","time spent":"603.739559ms","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Range","request count":0,"request size":47,"response count":1,"response size":529,"request content":"key:\"/registry/leases/kube-system/kube-scheduler\" limit:1 "} Jul 15 11:01:36.122050 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:36.120864Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"350.754536ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/persistentvolumes/pvc-b3cac1bf-3bbe-4c21-89b5-3d0f795a1adc\" limit:1 ","response":"range_response_count:0 size:5"} Jul 15 11:01:36.122050 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:36.120926Z","caller":"traceutil/trace.go:171","msg":"trace[680469261] range","detail":"{range_begin:/registry/persistentvolumes/pvc-b3cac1bf-3bbe-4c21-89b5-3d0f795a1adc; range_end:; response_count:0; response_revision:1947; }","duration":"350.870089ms","start":"2025-07-15T11:01:35.770038Z","end":"2025-07-15T11:01:36.120908Z","steps":["trace[680469261] 'agreement among raft nodes before linearized reading' (duration: 350.741782ms)"],"step_count":1} Jul 15 11:01:36.122050 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:36.120994Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:01:35.770010Z","time spent":"350.948243ms","remote":"172.24.4.207:54326","response type":"/etcdserverpb.KV/Range","request count":0,"request size":72,"response count":0,"response size":29,"request content":"key:\"/registry/persistentvolumes/pvc-b3cac1bf-3bbe-4c21-89b5-3d0f795a1adc\" limit:1 "} Jul 15 11:01:36.122050 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:36.121134Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"478.435772ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jul 15 11:01:36.122622 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:36.121185Z","caller":"traceutil/trace.go:171","msg":"trace[1949130713] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1947; }","duration":"478.513676ms","start":"2025-07-15T11:01:35.642658Z","end":"2025-07-15T11:01:36.121171Z","steps":["trace[1949130713] 'agreement among raft nodes before linearized reading' (duration: 478.450348ms)"],"step_count":1} Jul 15 11:01:36.122622 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:36.121221Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:01:35.642639Z","time spent":"478.57044ms","remote":"172.24.4.207:54212","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":29,"request content":"key:\"/registry/health\" "} Jul 15 11:01:36.122622 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:36.116734Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:01:35.515737Z","time spent":"600.84872ms","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Range","request count":0,"request size":56,"response count":1,"response size":556,"request content":"key:\"/registry/leases/kube-system/kube-controller-manager\" limit:1 "} Jul 15 11:01:36.410199 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:36.408430Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"111.338077ms","expected-duration":"100ms","prefix":"","request":"header: txn: success:> failure: >>","response":"size:16"} Jul 15 11:01:36.410199 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:36.408923Z","caller":"traceutil/trace.go:171","msg":"trace[6477699] transaction","detail":"{read_only:false; number_of_response:0; response_revision:1950; }","duration":"225.242795ms","start":"2025-07-15T11:01:36.183636Z","end":"2025-07-15T11:01:36.408879Z","steps":["trace[6477699] 'process raft request' (duration: 225.15294ms)"],"step_count":1} Jul 15 11:01:36.410199 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:36.409076Z","caller":"traceutil/trace.go:171","msg":"trace[235044127] transaction","detail":"{read_only:false; response_revision:1949; number_of_response:1; }","duration":"259.608203ms","start":"2025-07-15T11:01:36.149429Z","end":"2025-07-15T11:01:36.409038Z","steps":["trace[235044127] 'process raft request' (duration: 259.175425ms)"],"step_count":1} Jul 15 11:01:36.410199 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:36.409187Z","caller":"traceutil/trace.go:171","msg":"trace[787815314] transaction","detail":"{read_only:false; response_revision:1950; number_of_response:1; }","duration":"259.596151ms","start":"2025-07-15T11:01:36.149578Z","end":"2025-07-15T11:01:36.409174Z","steps":["trace[787815314] 'process raft request' (duration: 259.105736ms)"],"step_count":1} Jul 15 11:01:36.410972 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:36.409250Z","caller":"traceutil/trace.go:171","msg":"trace[1088222087] transaction","detail":"{read_only:false; response_revision:1948; number_of_response:1; }","duration":"270.226862ms","start":"2025-07-15T11:01:36.139000Z","end":"2025-07-15T11:01:36.409227Z","steps":["trace[1088222087] 'process raft request' (duration: 157.98204ms)","trace[1088222087] 'compare' (duration: 111.14958ms)"],"step_count":2} Jul 15 11:01:36.410972 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:36.409365Z","caller":"traceutil/trace.go:171","msg":"trace[1819993814] linearizableReadLoop","detail":"{readStateIndex:2270; appliedIndex:2269; }","duration":"269.883307ms","start":"2025-07-15T11:01:36.139469Z","end":"2025-07-15T11:01:36.409352Z","steps":["trace[1819993814] 'read index received' (duration: 157.529254ms)","trace[1819993814] 'applied index is now lower than readState.Index' (duration: 112.352841ms)"],"step_count":2} Jul 15 11:01:36.410972 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:36.409527Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"270.050396ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/masterleases/\" range_end:\"/registry/masterleases0\" ","response":"range_response_count:1 size:131"} Jul 15 11:01:36.410972 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:36.409597Z","caller":"traceutil/trace.go:171","msg":"trace[1728389785] range","detail":"{range_begin:/registry/masterleases/; range_end:/registry/masterleases0; response_count:1; response_revision:1950; }","duration":"270.846556ms","start":"2025-07-15T11:01:36.138716Z","end":"2025-07-15T11:01:36.409562Z","steps":["trace[1728389785] 'agreement among raft nodes before linearized reading' (duration: 270.688225ms)"],"step_count":1} Jul 15 11:01:36.415410 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:36.414925Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"196.943307ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/events/default/test-dynamic-volume-claim.185267c04206ed18\" limit:1 ","response":"range_response_count:1 size:805"} Jul 15 11:01:36.415410 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:36.415006Z","caller":"traceutil/trace.go:171","msg":"trace[324060245] range","detail":"{range_begin:/registry/events/default/test-dynamic-volume-claim.185267c04206ed18; range_end:; response_count:1; response_revision:1950; }","duration":"197.081111ms","start":"2025-07-15T11:01:36.217906Z","end":"2025-07-15T11:01:36.414987Z","steps":["trace[324060245] 'agreement among raft nodes before linearized reading' (duration: 196.564647ms)"],"step_count":1} Jul 15 11:01:36.416510 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:36.415247Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"261.674971ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/services/specs/default/nfs-server-provisioner\" limit:1 ","response":"range_response_count:1 size:2752"} Jul 15 11:01:36.416510 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:36.415892Z","caller":"traceutil/trace.go:171","msg":"trace[866268922] range","detail":"{range_begin:/registry/services/specs/default/nfs-server-provisioner; range_end:; response_count:1; response_revision:1950; }","duration":"262.356489ms","start":"2025-07-15T11:01:36.153516Z","end":"2025-07-15T11:01:36.415872Z","steps":["trace[866268922] 'agreement among raft nodes before linearized reading' (duration: 261.610491ms)"],"step_count":1} Jul 15 11:01:36.736096 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:36.734316Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"160.20734ms","expected-duration":"100ms","prefix":"","request":"header: txn: success:> failure:<>>","response":"size:5"} Jul 15 11:01:36.736096 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:36.734519Z","caller":"traceutil/trace.go:171","msg":"trace[249944193] transaction","detail":"{read_only:false; number_of_response:0; response_revision:1956; }","duration":"263.891053ms","start":"2025-07-15T11:01:36.470608Z","end":"2025-07-15T11:01:36.734499Z","steps":["trace[249944193] 'process raft request' (duration: 103.433431ms)","trace[249944193] 'compare' (duration: 160.152629ms)"],"step_count":2} Jul 15 11:01:36.736096 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:36.734739Z","caller":"traceutil/trace.go:171","msg":"trace[1558951241] transaction","detail":"{read_only:false; response_revision:1957; number_of_response:1; }","duration":"234.843624ms","start":"2025-07-15T11:01:36.499877Z","end":"2025-07-15T11:01:36.734721Z","steps":["trace[1558951241] 'process raft request' (duration: 234.604973ms)"],"step_count":1} Jul 15 11:01:36.736096 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:36.734793Z","caller":"traceutil/trace.go:171","msg":"trace[327565148] linearizableReadLoop","detail":"{readStateIndex:2283; appliedIndex:2282; }","duration":"244.041709ms","start":"2025-07-15T11:01:36.490729Z","end":"2025-07-15T11:01:36.734771Z","steps":["trace[327565148] 'read index received' (duration: 83.327623ms)","trace[327565148] 'applied index is now lower than readState.Index' (duration: 160.711622ms)"],"step_count":2} Jul 15 11:01:36.736398 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:36.735153Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"274.904491ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/serviceaccounts/kube-system/token-cleaner\" limit:1 ","response":"range_response_count:1 size:191"} Jul 15 11:01:36.736398 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:36.735176Z","caller":"traceutil/trace.go:171","msg":"trace[235406518] range","detail":"{range_begin:/registry/serviceaccounts/kube-system/token-cleaner; range_end:; response_count:1; response_revision:1957; }","duration":"274.964832ms","start":"2025-07-15T11:01:36.460205Z","end":"2025-07-15T11:01:36.735170Z","steps":["trace[235406518] 'agreement among raft nodes before linearized reading' (duration: 274.647777ms)"],"step_count":1} Jul 15 11:01:36.736398 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:36.735181Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"234.045269ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/tiers/baselineadminnetworkpolicy\" limit:1 ","response":"range_response_count:1 size:741"} Jul 15 11:01:36.736398 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:36.735233Z","caller":"traceutil/trace.go:171","msg":"trace[279600682] range","detail":"{range_begin:/registry/crd.projectcalico.org/tiers/baselineadminnetworkpolicy; range_end:; response_count:1; response_revision:1957; }","duration":"234.137239ms","start":"2025-07-15T11:01:36.501081Z","end":"2025-07-15T11:01:36.735218Z","steps":["trace[279600682] 'agreement among raft nodes before linearized reading' (duration: 233.918524ms)"],"step_count":1} Jul 15 11:01:36.736398 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:36.735327Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"229.028966ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/events/default/test-dynamic-volume-claim.185267c0435134e6\" limit:1 ","response":"range_response_count:1 size:1153"} Jul 15 11:01:36.736624 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:36.735351Z","caller":"traceutil/trace.go:171","msg":"trace[68390940] range","detail":"{range_begin:/registry/events/default/test-dynamic-volume-claim.185267c0435134e6; range_end:; response_count:1; response_revision:1957; }","duration":"229.054073ms","start":"2025-07-15T11:01:36.506289Z","end":"2025-07-15T11:01:36.735343Z","steps":["trace[68390940] 'agreement among raft nodes before linearized reading' (duration: 228.963866ms)"],"step_count":1} Jul 15 11:01:36.736624 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:36.735452Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"232.760848ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/kube-system/kube-scheduler-ci-4230-2-100-9439eb8d1a.novalocal\" limit:1 ","response":"range_response_count:1 size:4973"} Jul 15 11:01:36.736624 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:36.735713Z","caller":"traceutil/trace.go:171","msg":"trace[271757955] range","detail":"{range_begin:/registry/pods/kube-system/kube-scheduler-ci-4230-2-100-9439eb8d1a.novalocal; range_end:; response_count:1; response_revision:1957; }","duration":"232.834844ms","start":"2025-07-15T11:01:36.502651Z","end":"2025-07-15T11:01:36.735486Z","steps":["trace[271757955] 'agreement among raft nodes before linearized reading' (duration: 232.669859ms)"],"step_count":1} Jul 15 11:01:37.136028 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:37.135734Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"258.625129ms","expected-duration":"100ms","prefix":"","request":"header: txn: success:> failure:<>>","response":"size:5"} Jul 15 11:01:37.136933 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:37.136698Z","caller":"traceutil/trace.go:171","msg":"trace[935003924] transaction","detail":"{read_only:false; response_revision:1959; number_of_response:1; }","duration":"342.641014ms","start":"2025-07-15T11:01:36.794028Z","end":"2025-07-15T11:01:37.136669Z","steps":["trace[935003924] 'process raft request' (duration: 342.37324ms)"],"step_count":1} Jul 15 11:01:37.137132 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:37.136966Z","caller":"traceutil/trace.go:171","msg":"trace[57111798] linearizableReadLoop","detail":"{readStateIndex:2286; appliedIndex:2285; }","duration":"348.757539ms","start":"2025-07-15T11:01:36.788187Z","end":"2025-07-15T11:01:37.136945Z","steps":["trace[57111798] 'read index received' (duration: 88.896597ms)","trace[57111798] 'applied index is now lower than readState.Index' (duration: 259.858357ms)"],"step_count":2} Jul 15 11:01:37.137132 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:37.137120Z","caller":"traceutil/trace.go:171","msg":"trace[1751666701] transaction","detail":"{read_only:false; number_of_response:0; response_revision:1958; }","duration":"349.143531ms","start":"2025-07-15T11:01:36.787962Z","end":"2025-07-15T11:01:37.137106Z","steps":["trace[1751666701] 'process raft request' (duration: 89.107896ms)","trace[1751666701] 'compare' (duration: 258.589734ms)"],"step_count":2} Jul 15 11:01:37.137543 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:37.137255Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:01:36.787939Z","time spent":"349.226785ms","remote":"172.24.4.207:54256","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":29,"request content":"compare: success:> failure:<>"} Jul 15 11:01:37.137815 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:37.137680Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:01:36.793999Z","time spent":"342.79024ms","remote":"172.24.4.207:54350","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":4766,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 11:01:37.138363 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:37.137707Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"356.102953ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/serviceaccounts/kube-system/pv-protection-controller\" limit:1 ","response":"range_response_count:1 size:214"} Jul 15 11:01:37.138590 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:37.138167Z","caller":"traceutil/trace.go:171","msg":"trace[2033884919] range","detail":"{range_begin:/registry/serviceaccounts/kube-system/pv-protection-controller; range_end:; response_count:1; response_revision:1959; }","duration":"356.600692ms","start":"2025-07-15T11:01:36.781553Z","end":"2025-07-15T11:01:37.138154Z","steps":["trace[2033884919] 'agreement among raft nodes before linearized reading' (duration: 355.805984ms)"],"step_count":1} Jul 15 11:01:37.138590 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:37.138204Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:01:36.781536Z","time spent":"356.655693ms","remote":"172.24.4.207:54370","response type":"/etcdserverpb.KV/Range","request count":0,"request size":66,"response count":1,"response size":238,"request content":"key:\"/registry/serviceaccounts/kube-system/pv-protection-controller\" limit:1 "} Jul 15 11:01:37.138590 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:37.137853Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"288.533949ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/hostendpoints/\" range_end:\"/registry/crd.projectcalico.org/hostendpoints0\" count_only:true ","response":"range_response_count:0 size:5"} Jul 15 11:01:37.138590 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:37.138254Z","caller":"traceutil/trace.go:171","msg":"trace[1160481046] range","detail":"{range_begin:/registry/crd.projectcalico.org/hostendpoints/; range_end:/registry/crd.projectcalico.org/hostendpoints0; response_count:0; response_revision:1959; }","duration":"288.980864ms","start":"2025-07-15T11:01:36.849266Z","end":"2025-07-15T11:01:37.138246Z","steps":["trace[1160481046] 'agreement among raft nodes before linearized reading' (duration: 288.520034ms)"],"step_count":1} Jul 15 11:01:37.416989 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:37.414776Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"119.513646ms","expected-duration":"100ms","prefix":"","request":"header: txn: success:> failure: >>","response":"size:16"} Jul 15 11:01:37.416989 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:37.415146Z","caller":"traceutil/trace.go:171","msg":"trace[1650761261] linearizableReadLoop","detail":"{readStateIndex:2289; appliedIndex:2288; }","duration":"189.646253ms","start":"2025-07-15T11:01:37.225443Z","end":"2025-07-15T11:01:37.415089Z","steps":["trace[1650761261] 'read index received' (duration: 8.774052ms)","trace[1650761261] 'applied index is now lower than readState.Index' (duration: 180.869926ms)"],"step_count":2} Jul 15 11:01:37.416989 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:37.415380Z","caller":"traceutil/trace.go:171","msg":"trace[2005409827] transaction","detail":"{read_only:false; response_revision:1960; number_of_response:1; }","duration":"202.040409ms","start":"2025-07-15T11:01:37.213299Z","end":"2025-07-15T11:01:37.415339Z","steps":["trace[2005409827] 'process raft request' (duration: 81.852098ms)","trace[2005409827] 'compare' (duration: 119.110581ms)"],"step_count":2} Jul 15 11:01:37.416989 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:37.415451Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"189.995638ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/serviceaccounts/kube-system/daemon-set-controller\" limit:1 ","response":"range_response_count:1 size:207"} Jul 15 11:01:37.417640 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:37.415718Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"180.56851ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/bgppeers.crd.projectcalico.org\" limit:1 ","response":"range_response_count:1 size:8007"} Jul 15 11:01:37.417640 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:37.415744Z","caller":"traceutil/trace.go:171","msg":"trace[761753190] range","detail":"{range_begin:/registry/serviceaccounts/kube-system/daemon-set-controller; range_end:; response_count:1; response_revision:1960; }","duration":"190.3275ms","start":"2025-07-15T11:01:37.225396Z","end":"2025-07-15T11:01:37.415724Z","steps":["trace[761753190] 'agreement among raft nodes before linearized reading' (duration: 189.969579ms)"],"step_count":1} Jul 15 11:01:37.417640 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:37.415773Z","caller":"traceutil/trace.go:171","msg":"trace[730158075] range","detail":"{range_begin:/registry/apiextensions.k8s.io/customresourcedefinitions/bgppeers.crd.projectcalico.org; range_end:; response_count:1; response_revision:1960; }","duration":"180.67153ms","start":"2025-07-15T11:01:37.235085Z","end":"2025-07-15T11:01:37.415757Z","steps":["trace[730158075] 'agreement among raft nodes before linearized reading' (duration: 180.474525ms)"],"step_count":1} Jul 15 11:01:37.969582 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:37.968609Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875176465,"retry-timeout":"500ms"} Jul 15 11:01:38.481431 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:38.478038Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"376.863187ms","expected-duration":"100ms","prefix":"","request":"header: txn: success:> failure:<>>","response":"size:5"} Jul 15 11:01:38.481431 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:38.478419Z","caller":"traceutil/trace.go:171","msg":"trace[1068525184] transaction","detail":"{read_only:false; number_of_response:0; response_revision:1960; }","duration":"1.01510623s","start":"2025-07-15T11:01:37.463274Z","end":"2025-07-15T11:01:38.478380Z","steps":["trace[1068525184] 'process raft request' (duration: 637.787643ms)","trace[1068525184] 'compare' (duration: 376.681601ms)"],"step_count":2} Jul 15 11:01:38.481431 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:38.478614Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:01:37.463243Z","time spent":"1.015287875s","remote":"172.24.4.207:54256","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":29,"request content":"compare: success:> failure:<>"} Jul 15 11:01:38.483294 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:38.478685Z","caller":"traceutil/trace.go:171","msg":"trace[1515794578] linearizableReadLoop","detail":"{readStateIndex:2291; appliedIndex:2289; }","duration":"1.010520152s","start":"2025-07-15T11:01:37.468140Z","end":"2025-07-15T11:01:38.478660Z","steps":["trace[1515794578] 'read index received' (duration: 632.756312ms)","trace[1515794578] 'applied index is now lower than readState.Index' (duration: 377.762358ms)"],"step_count":2} Jul 15 11:01:38.483294 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:38.478943Z","caller":"traceutil/trace.go:171","msg":"trace[227834562] transaction","detail":"{read_only:false; response_revision:1961; number_of_response:1; }","duration":"596.743147ms","start":"2025-07-15T11:01:37.882176Z","end":"2025-07-15T11:01:38.478919Z","steps":["trace[227834562] 'process raft request' (duration: 596.050758ms)"],"step_count":1} Jul 15 11:01:38.483294 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:38.479097Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:01:37.882100Z","time spent":"596.919243ms","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":699,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 11:01:38.483294 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:38.479457Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.011301995s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/serviceaccounts/kube-system/attachdetach-controller\" limit:1 ","response":"range_response_count:1 size:212"} Jul 15 11:01:38.483699 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:38.479532Z","caller":"traceutil/trace.go:171","msg":"trace[432737630] range","detail":"{range_begin:/registry/serviceaccounts/kube-system/attachdetach-controller; range_end:; response_count:1; response_revision:1961; }","duration":"1.011411789s","start":"2025-07-15T11:01:37.468096Z","end":"2025-07-15T11:01:38.479508Z","steps":["trace[432737630] 'agreement among raft nodes before linearized reading' (duration: 1.011289283s)"],"step_count":1} Jul 15 11:01:38.483699 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:38.479590Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:01:37.468049Z","time spent":"1.011519828s","remote":"172.24.4.207:54370","response type":"/etcdserverpb.KV/Range","request count":0,"request size":65,"response count":1,"response size":236,"request content":"key:\"/registry/serviceaccounts/kube-system/attachdetach-controller\" limit:1 "} Jul 15 11:01:38.494467 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:38.493160Z","caller":"traceutil/trace.go:171","msg":"trace[2006173612] transaction","detail":"{read_only:false; response_revision:1962; number_of_response:1; }","duration":"363.514868ms","start":"2025-07-15T11:01:38.129624Z","end":"2025-07-15T11:01:38.493139Z","steps":["trace[2006173612] 'process raft request' (duration: 363.279644ms)"],"step_count":1} Jul 15 11:01:38.494672 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:38.493453Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:01:38.129590Z","time spent":"363.738331ms","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":532,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 11:01:38.494672 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:38.494210Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"771.817511ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jul 15 11:01:38.497227 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:38.495415Z","caller":"traceutil/trace.go:171","msg":"trace[1549987788] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1962; }","duration":"773.01292ms","start":"2025-07-15T11:01:37.722353Z","end":"2025-07-15T11:01:38.495366Z","steps":["trace[1549987788] 'agreement among raft nodes before linearized reading' (duration: 771.508492ms)"],"step_count":1} Jul 15 11:01:38.497227 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:38.495575Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:01:37.722343Z","time spent":"773.187501ms","remote":"172.24.4.207:54214","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":29,"request content":"key:\"/registry/health\" "} Jul 15 11:01:38.497227 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:38.495497Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"773.218909ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/clusterroles/\" range_end:\"/registry/clusterroles0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 11:01:38.497227 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:38.496153Z","caller":"traceutil/trace.go:171","msg":"trace[324536378] range","detail":"{range_begin:/registry/clusterroles/; range_end:/registry/clusterroles0; response_count:0; response_revision:1962; }","duration":"773.839384ms","start":"2025-07-15T11:01:37.722199Z","end":"2025-07-15T11:01:38.496039Z","steps":["trace[324536378] 'agreement among raft nodes before linearized reading' (duration: 772.501865ms)"],"step_count":1} Jul 15 11:01:38.498678 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:38.496922Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"966.380874ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/default/test-pod-1\" limit:1 ","response":"range_response_count:1 size:2344"} Jul 15 11:01:38.498678 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:38.497671Z","caller":"traceutil/trace.go:171","msg":"trace[120496550] range","detail":"{range_begin:/registry/pods/default/test-pod-1; range_end:; response_count:1; response_revision:1962; }","duration":"967.154712ms","start":"2025-07-15T11:01:37.530482Z","end":"2025-07-15T11:01:38.497637Z","steps":["trace[120496550] 'agreement among raft nodes before linearized reading' (duration: 966.215207ms)"],"step_count":1} Jul 15 11:01:38.498678 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:38.497946Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:01:37.530454Z","time spent":"967.305161ms","remote":"172.24.4.207:54350","response type":"/etcdserverpb.KV/Range","request count":0,"request size":37,"response count":1,"response size":2368,"request content":"key:\"/registry/pods/default/test-pod-1\" limit:1 "} Jul 15 11:01:38.500744 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:38.497001Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:01:37.722175Z","time spent":"774.781325ms","remote":"172.24.4.207:54526","response type":"/etcdserverpb.KV/Range","request count":0,"request size":52,"response count":80,"response size":31,"request content":"key:\"/registry/clusterroles/\" range_end:\"/registry/clusterroles0\" count_only:true "} Jul 15 11:01:38.500744 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:38.496661Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"893.004206ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/bgpconfigurations/\" range_end:\"/registry/crd.projectcalico.org/bgpconfigurations0\" count_only:true ","response":"range_response_count:0 size:5"} Jul 15 11:01:38.501659 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:38.499340Z","caller":"traceutil/trace.go:171","msg":"trace[115248559] range","detail":"{range_begin:/registry/crd.projectcalico.org/bgpconfigurations/; range_end:/registry/crd.projectcalico.org/bgpconfigurations0; response_count:0; response_revision:1962; }","duration":"895.766848ms","start":"2025-07-15T11:01:37.603538Z","end":"2025-07-15T11:01:38.499304Z","steps":["trace[115248559] 'agreement among raft nodes before linearized reading' (duration: 893.021588ms)"],"step_count":1} Jul 15 11:01:38.501659 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:38.499907Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:01:37.603506Z","time spent":"896.358832ms","remote":"172.24.4.207:47680","response type":"/etcdserverpb.KV/Range","request count":0,"request size":106,"response count":0,"response size":29,"request content":"key:\"/registry/crd.projectcalico.org/bgpconfigurations/\" range_end:\"/registry/crd.projectcalico.org/bgpconfigurations0\" count_only:true "} Jul 15 11:01:39.284888 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:39.283084Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"686.701166ms","expected-duration":"100ms","prefix":"","request":"header: txn: success:> failure:<>>","response":"size:5"} Jul 15 11:01:39.284888 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:39.283248Z","caller":"traceutil/trace.go:171","msg":"trace[1114078826] linearizableReadLoop","detail":"{readStateIndex:2295; appliedIndex:2294; }","duration":"611.46802ms","start":"2025-07-15T11:01:38.671736Z","end":"2025-07-15T11:01:39.283204Z","steps":["trace[1114078826] 'read index received' (duration: 130.801µs)","trace[1114078826] 'applied index is now lower than readState.Index' (duration: 611.335686ms)"],"step_count":2} Jul 15 11:01:39.284888 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:39.283379Z","caller":"traceutil/trace.go:171","msg":"trace[887929588] transaction","detail":"{read_only:false; number_of_response:0; response_revision:1964; }","duration":"752.43472ms","start":"2025-07-15T11:01:38.530916Z","end":"2025-07-15T11:01:39.283351Z","steps":["trace[887929588] 'process raft request' (duration: 65.396201ms)","trace[887929588] 'compare' (duration: 686.630045ms)"],"step_count":2} Jul 15 11:01:39.284888 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:39.283415Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"611.687957ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/replicasets/\" range_end:\"/registry/replicasets0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 11:01:39.285649 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:39.283461Z","caller":"traceutil/trace.go:171","msg":"trace[53774535] range","detail":"{range_begin:/registry/replicasets/; range_end:/registry/replicasets0; response_count:0; response_revision:1964; }","duration":"611.742438ms","start":"2025-07-15T11:01:38.671705Z","end":"2025-07-15T11:01:39.283447Z","steps":["trace[53774535] 'agreement among raft nodes before linearized reading' (duration: 611.658844ms)"],"step_count":1} Jul 15 11:01:39.285649 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:39.283505Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:01:38.671631Z","time spent":"611.859072ms","remote":"172.24.4.207:54658","response type":"/etcdserverpb.KV/Range","request count":0,"request size":50,"response count":10,"response size":31,"request content":"key:\"/registry/replicasets/\" range_end:\"/registry/replicasets0\" count_only:true "} Jul 15 11:01:39.285649 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:39.283523Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:01:38.530889Z","time spent":"752.556465ms","remote":"172.24.4.207:54256","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":29,"request content":"compare: success:> failure:<>"} Jul 15 11:01:39.285649 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:39.283757Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"556.969623ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jul 15 11:01:39.286118 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:39.283843Z","caller":"traceutil/trace.go:171","msg":"trace[1789417040] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1964; }","duration":"557.072854ms","start":"2025-07-15T11:01:38.726717Z","end":"2025-07-15T11:01:39.283790Z","steps":["trace[1789417040] 'agreement among raft nodes before linearized reading' (duration: 556.997725ms)"],"step_count":1} Jul 15 11:01:39.286118 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:39.283869Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"411.616384ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/deployments/\" range_end:\"/registry/deployments0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 11:01:39.286118 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:39.283906Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:01:38.726688Z","time spent":"557.202203ms","remote":"172.24.4.207:54212","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":29,"request content":"key:\"/registry/health\" "} Jul 15 11:01:39.286118 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:39.283927Z","caller":"traceutil/trace.go:171","msg":"trace[869238049] range","detail":"{range_begin:/registry/deployments/; range_end:/registry/deployments0; response_count:0; response_revision:1964; }","duration":"411.741104ms","start":"2025-07-15T11:01:38.872167Z","end":"2025-07-15T11:01:39.283908Z","steps":["trace[869238049] 'agreement among raft nodes before linearized reading' (duration: 411.569116ms)"],"step_count":1} Jul 15 11:01:39.286118 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:39.283979Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:01:38.872098Z","time spent":"411.86364ms","remote":"172.24.4.207:54636","response type":"/etcdserverpb.KV/Range","request count":0,"request size":50,"response count":8,"response size":31,"request content":"key:\"/registry/deployments/\" range_end:\"/registry/deployments0\" count_only:true "} Jul 15 11:01:39.286628 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:39.283994Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"521.800228ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/whiskers/\" range_end:\"/registry/operator.tigera.io/whiskers0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 11:01:39.286628 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:39.284063Z","caller":"traceutil/trace.go:171","msg":"trace[1640559362] range","detail":"{range_begin:/registry/operator.tigera.io/whiskers/; range_end:/registry/operator.tigera.io/whiskers0; response_count:0; response_revision:1964; }","duration":"521.884665ms","start":"2025-07-15T11:01:38.762133Z","end":"2025-07-15T11:01:39.284018Z","steps":["trace[1640559362] 'agreement among raft nodes before linearized reading' (duration: 521.831637ms)"],"step_count":1} Jul 15 11:01:39.286628 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:39.284118Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:01:38.762106Z","time spent":"521.984068ms","remote":"172.24.4.207:47698","response type":"/etcdserverpb.KV/Range","request count":0,"request size":82,"response count":1,"response size":31,"request content":"key:\"/registry/operator.tigera.io/whiskers/\" range_end:\"/registry/operator.tigera.io/whiskers0\" count_only:true "} Jul 15 11:01:58.057971 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:58.055391Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"227.000569ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context canceled"} Jul 15 11:01:58.060048 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:58.056201Z","caller":"traceutil/trace.go:171","msg":"trace[1359203651] range","detail":"{range_begin:/registry/health; range_end:; }","duration":"228.049923ms","start":"2025-07-15T11:01:57.827970Z","end":"2025-07-15T11:01:58.056019Z","steps":["trace[1359203651] 'agreement among raft nodes before linearized reading' (duration: 227.005062ms)"],"step_count":1} Jul 15 11:01:58.075483 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:58.074706Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"252.035108ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jul 15 11:01:58.076083 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:58.074844Z","caller":"traceutil/trace.go:171","msg":"trace[166361821] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1983; }","duration":"253.068133ms","start":"2025-07-15T11:01:57.821709Z","end":"2025-07-15T11:01:58.074777Z","steps":["trace[166361821] 'range keys from in-memory index tree' (duration: 239.856219ms)"],"step_count":1} Jul 15 11:01:58.102352 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:58.101881Z","caller":"traceutil/trace.go:171","msg":"trace[136142234] linearizableReadLoop","detail":"{readStateIndex:2347; appliedIndex:2345; }","duration":"267.146441ms","start":"2025-07-15T11:01:57.834684Z","end":"2025-07-15T11:01:58.101831Z","steps":["trace[136142234] 'read index received' (duration: 266.093835ms)","trace[136142234] 'applied index is now lower than readState.Index' (duration: 1.051214ms)"],"step_count":2} Jul 15 11:01:58.105012 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:58.102725Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"279.047233ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/ingressclasses/\" range_end:\"/registry/ingressclasses0\" count_only:true ","response":"range_response_count:0 size:5"} Jul 15 11:01:58.105012 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:58.104688Z","caller":"traceutil/trace.go:171","msg":"trace[447831267] range","detail":"{range_begin:/registry/ingressclasses/; range_end:/registry/ingressclasses0; response_count:0; response_revision:1985; }","duration":"281.084973ms","start":"2025-07-15T11:01:57.823586Z","end":"2025-07-15T11:01:58.104671Z","steps":["trace[447831267] 'agreement among raft nodes before linearized reading' (duration: 278.765237ms)"],"step_count":1} Jul 15 11:01:58.107376 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:58.105091Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"280.399128ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/events/default/test-dynamic-volume-claim.185267c4dc89464b\" limit:1 ","response":"range_response_count:1 size:967"} Jul 15 11:01:58.107376 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:58.102982Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"269.877086ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/policy.networking.k8s.io/adminnetworkpolicies/\" range_end:\"/registry/policy.networking.k8s.io/adminnetworkpolicies0\" count_only:true ","response":"range_response_count:0 size:5"} Jul 15 11:01:58.107376 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:58.103532Z","caller":"traceutil/trace.go:171","msg":"trace[309141997] transaction","detail":"{read_only:false; response_revision:1984; number_of_response:1; }","duration":"273.51875ms","start":"2025-07-15T11:01:57.829993Z","end":"2025-07-15T11:01:58.103512Z","steps":["trace[309141997] 'process raft request' (duration: 271.068661ms)"],"step_count":1} Jul 15 11:01:58.107376 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:58.103656Z","caller":"traceutil/trace.go:171","msg":"trace[1301670813] transaction","detail":"{read_only:false; response_revision:1985; number_of_response:1; }","duration":"273.173195ms","start":"2025-07-15T11:01:57.830471Z","end":"2025-07-15T11:01:58.103645Z","steps":["trace[1301670813] 'process raft request' (duration: 271.191662ms)"],"step_count":1} Jul 15 11:01:58.107376 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:58.103932Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"274.949331ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/configmaps/\" range_end:\"/registry/configmaps0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 11:01:58.107936 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:58.104060Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"270.652419ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/services/endpoints/calico-system/calico-typha\" limit:1 ","response":"range_response_count:1 size:789"} Jul 15 11:01:58.107936 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:58.104136Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"270.822035ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/policy.networking.k8s.io/baselineadminnetworkpolicies/\" range_end:\"/registry/policy.networking.k8s.io/baselineadminnetworkpolicies0\" count_only:true ","response":"range_response_count:0 size:5"} Jul 15 11:01:58.107936 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:58.104258Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"279.5107ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/leases/tigera-operator/operator-lock\" limit:1 ","response":"range_response_count:1 size:504"} Jul 15 11:01:58.107936 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:58.105364Z","caller":"traceutil/trace.go:171","msg":"trace[1102448174] range","detail":"{range_begin:/registry/events/default/test-dynamic-volume-claim.185267c4dc89464b; range_end:; response_count:1; response_revision:1985; }","duration":"281.256383ms","start":"2025-07-15T11:01:57.824070Z","end":"2025-07-15T11:01:58.105326Z","steps":["trace[1102448174] 'agreement among raft nodes before linearized reading' (duration: 280.267916ms)"],"step_count":1} Jul 15 11:01:58.108198 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:58.105561Z","caller":"traceutil/trace.go:171","msg":"trace[1622092490] range","detail":"{range_begin:/registry/policy.networking.k8s.io/adminnetworkpolicies/; range_end:/registry/policy.networking.k8s.io/adminnetworkpolicies0; response_count:0; response_revision:1985; }","duration":"272.507682ms","start":"2025-07-15T11:01:57.833019Z","end":"2025-07-15T11:01:58.105527Z","steps":["trace[1622092490] 'agreement among raft nodes before linearized reading' (duration: 269.216414ms)"],"step_count":1} Jul 15 11:01:58.108198 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:58.105772Z","caller":"traceutil/trace.go:171","msg":"trace[1702888731] range","detail":"{range_begin:/registry/services/endpoints/calico-system/calico-typha; range_end:; response_count:1; response_revision:1985; }","duration":"272.382189ms","start":"2025-07-15T11:01:57.833368Z","end":"2025-07-15T11:01:58.105750Z","steps":["trace[1702888731] 'agreement among raft nodes before linearized reading' (duration: 270.341286ms)"],"step_count":1} Jul 15 11:01:58.108198 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:58.105925Z","caller":"traceutil/trace.go:171","msg":"trace[477246683] range","detail":"{range_begin:/registry/configmaps/; range_end:/registry/configmaps0; response_count:0; response_revision:1985; }","duration":"277.004033ms","start":"2025-07-15T11:01:57.828910Z","end":"2025-07-15T11:01:58.105914Z","steps":["trace[477246683] 'agreement among raft nodes before linearized reading' (duration: 274.469122ms)"],"step_count":1} Jul 15 11:01:58.108198 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:58.105558Z","caller":"traceutil/trace.go:171","msg":"trace[2098118706] range","detail":"{range_begin:/registry/leases/tigera-operator/operator-lock; range_end:; response_count:1; response_revision:1985; }","duration":"280.54322ms","start":"2025-07-15T11:01:57.824690Z","end":"2025-07-15T11:01:58.105234Z","steps":["trace[2098118706] 'agreement among raft nodes before linearized reading' (duration: 279.47427ms)"],"step_count":1} Jul 15 11:01:58.108619 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:58.106118Z","caller":"traceutil/trace.go:171","msg":"trace[1784501067] range","detail":"{range_begin:/registry/policy.networking.k8s.io/baselineadminnetworkpolicies/; range_end:/registry/policy.networking.k8s.io/baselineadminnetworkpolicies0; response_count:0; response_revision:1985; }","duration":"272.806523ms","start":"2025-07-15T11:01:57.833289Z","end":"2025-07-15T11:01:58.106095Z","steps":["trace[1784501067] 'agreement among raft nodes before linearized reading' (duration: 270.801052ms)"],"step_count":1} Jul 15 11:01:58.108619 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:58.104282Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"278.546865ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiregistration.k8s.io/apiservices/\" range_end:\"/registry/apiregistration.k8s.io/apiservices0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 11:01:58.108619 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:58.106286Z","caller":"traceutil/trace.go:171","msg":"trace[1614016077] range","detail":"{range_begin:/registry/apiregistration.k8s.io/apiservices/; range_end:/registry/apiregistration.k8s.io/apiservices0; response_count:0; response_revision:1985; }","duration":"280.568315ms","start":"2025-07-15T11:01:57.825697Z","end":"2025-07-15T11:01:58.106265Z","steps":["trace[1614016077] 'agreement among raft nodes before linearized reading' (duration: 278.316527ms)"],"step_count":1} Jul 15 11:01:58.108619 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:58.104394Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"278.90324ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/masterleases/172.24.4.207\" limit:1 ","response":"range_response_count:1 size:131"} Jul 15 11:01:58.109124 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:58.106449Z","caller":"traceutil/trace.go:171","msg":"trace[766105354] range","detail":"{range_begin:/registry/masterleases/172.24.4.207; range_end:; response_count:1; response_revision:1985; }","duration":"281.023716ms","start":"2025-07-15T11:01:57.825412Z","end":"2025-07-15T11:01:58.106436Z","steps":["trace[766105354] 'agreement among raft nodes before linearized reading' (duration: 278.876288ms)"],"step_count":1} Jul 15 11:01:58.606639 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:58.605067Z","caller":"traceutil/trace.go:171","msg":"trace[1845124195] transaction","detail":"{read_only:false; number_of_response:0; response_revision:1991; }","duration":"300.328381ms","start":"2025-07-15T11:01:58.304701Z","end":"2025-07-15T11:01:58.605029Z","steps":["trace[1845124195] 'process raft request' (duration: 238.820806ms)","trace[1845124195] 'compare' (duration: 61.436412ms)"],"step_count":2} Jul 15 11:01:58.606639 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:58.605194Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"303.259591ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/endpointslices/default/kubernetes\" limit:1 ","response":"range_response_count:1 size:474"} Jul 15 11:01:58.606639 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:58.605312Z","caller":"traceutil/trace.go:171","msg":"trace[806352081] range","detail":"{range_begin:/registry/endpointslices/default/kubernetes; range_end:; response_count:1; response_revision:1991; }","duration":"303.354623ms","start":"2025-07-15T11:01:58.301913Z","end":"2025-07-15T11:01:58.605268Z","steps":["trace[806352081] 'range keys from in-memory index tree' (duration: 303.185101ms)"],"step_count":1} Jul 15 11:01:58.606639 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:58.605395Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:01:58.301906Z","time spent":"303.467171ms","remote":"172.24.4.207:54438","response type":"/etcdserverpb.KV/Range","request count":0,"request size":47,"response count":1,"response size":498,"request content":"key:\"/registry/endpointslices/default/kubernetes\" limit:1 "} Jul 15 11:01:58.607374 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:58.605640Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:01:58.304687Z","time spent":"300.49175ms","remote":"172.24.4.207:59328","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":29,"request content":"compare: success:> failure:<>"} Jul 15 11:01:58.607374 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:58.605077Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"303.914305ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/events/kube-system/kube-apiserver-ci-4230-2-100-9439eb8d1a.novalocal.1852678f480d3898\" limit:1 ","response":"range_response_count:1 size:904"} Jul 15 11:01:58.607374 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:01:58.605864Z","caller":"traceutil/trace.go:171","msg":"trace[1165665322] range","detail":"{range_begin:/registry/events/kube-system/kube-apiserver-ci-4230-2-100-9439eb8d1a.novalocal.1852678f480d3898; range_end:; response_count:1; response_revision:1991; }","duration":"304.741084ms","start":"2025-07-15T11:01:58.301103Z","end":"2025-07-15T11:01:58.605844Z","steps":["trace[1165665322] 'range keys from in-memory index tree' (duration: 303.702506ms)"],"step_count":1} Jul 15 11:01:58.608783 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:01:58.607963Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:01:58.301097Z","time spent":"304.846247ms","remote":"172.24.4.207:54266","response type":"/etcdserverpb.KV/Range","request count":0,"request size":99,"response count":1,"response size":928,"request content":"key:\"/registry/events/kube-system/kube-apiserver-ci-4230-2-100-9439eb8d1a.novalocal.1852678f480d3898\" limit:1 "} Jul 15 11:02:02.608733 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:02.596954Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875176776,"retry-timeout":"500ms"} Jul 15 11:02:02.620990 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:02.618763Z","caller":"wal/wal.go:805","msg":"slow fdatasync","took":"1.13688336s","expected-duration":"1s"} Jul 15 11:02:02.620990 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:02.619745Z","caller":"traceutil/trace.go:171","msg":"trace[1759331608] transaction","detail":"{read_only:false; response_revision:1999; number_of_response:1; }","duration":"1.138083869s","start":"2025-07-15T11:02:01.481609Z","end":"2025-07-15T11:02:02.619693Z","steps":["trace[1759331608] 'process raft request' (duration: 1.137573872s)"],"step_count":1} Jul 15 11:02:02.620990 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:02.620070Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:01.481573Z","time spent":"1.138313491s","remote":"172.24.4.207:47648","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":1521,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 11:02:02.660872 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:02.658650Z","caller":"traceutil/trace.go:171","msg":"trace[1234255446] transaction","detail":"{read_only:false; response_revision:2000; number_of_response:1; }","duration":"1.142938011s","start":"2025-07-15T11:02:01.515685Z","end":"2025-07-15T11:02:02.658623Z","steps":["trace[1234255446] 'process raft request' (duration: 1.142442682s)"],"step_count":1} Jul 15 11:02:02.660872 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:02.659014Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:01.515656Z","time spent":"1.1432455s","remote":"172.24.4.207:47640","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":5968,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 11:02:02.661930 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:02.660181Z","caller":"traceutil/trace.go:171","msg":"trace[1746578293] linearizableReadLoop","detail":"{readStateIndex:2368; appliedIndex:2367; }","duration":"1.160862301s","start":"2025-07-15T11:02:01.499276Z","end":"2025-07-15T11:02:02.660138Z","steps":["trace[1746578293] 'read index received' (duration: 1.120668982s)","trace[1746578293] 'applied index is now lower than readState.Index' (duration: 40.191466ms)"],"step_count":2} Jul 15 11:02:02.661930 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:02.660665Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.16137281s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/clusterroles/tigera-csr-creator\" limit:1 ","response":"range_response_count:0 size:5"} Jul 15 11:02:02.662458 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:02.660757Z","caller":"traceutil/trace.go:171","msg":"trace[1430445701] range","detail":"{range_begin:/registry/clusterroles/tigera-csr-creator; range_end:; response_count:0; response_revision:2002; }","duration":"1.161507s","start":"2025-07-15T11:02:01.499233Z","end":"2025-07-15T11:02:02.660740Z","steps":["trace[1430445701] 'agreement among raft nodes before linearized reading' (duration: 1.161344182s)"],"step_count":1} Jul 15 11:02:02.662458 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:02.661295Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:01.499212Z","time spent":"1.161796503s","remote":"172.24.4.207:54526","response type":"/etcdserverpb.KV/Range","request count":0,"request size":45,"response count":0,"response size":29,"request content":"key:\"/registry/clusterroles/tigera-csr-creator\" limit:1 "} Jul 15 11:02:03.161869 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:03.161100Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875176782,"retry-timeout":"500ms"} Jul 15 11:02:03.644717 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:03.642784Z","caller":"traceutil/trace.go:171","msg":"trace[1411681079] transaction","detail":"{read_only:false; response_revision:2003; number_of_response:1; }","duration":"1.009425678s","start":"2025-07-15T11:02:02.633241Z","end":"2025-07-15T11:02:03.642667Z","steps":["trace[1411681079] 'process raft request' (duration: 980.538237ms)","trace[1411681079] 'compare' (duration: 28.572718ms)"],"step_count":2} Jul 15 11:02:03.646217 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:03.643504Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:02.633203Z","time spent":"1.009879253s","remote":"172.24.4.207:47638","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":1117,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 11:02:03.651862 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:03.650133Z","caller":"traceutil/trace.go:171","msg":"trace[1862202578] transaction","detail":"{read_only:false; response_revision:2004; number_of_response:1; }","duration":"983.397978ms","start":"2025-07-15T11:02:02.666709Z","end":"2025-07-15T11:02:03.650107Z","steps":["trace[1862202578] 'process raft request' (duration: 982.988354ms)"],"step_count":1} Jul 15 11:02:03.651862 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:03.650912Z","caller":"traceutil/trace.go:171","msg":"trace[1586333320] transaction","detail":"{read_only:false; response_revision:2005; number_of_response:1; }","duration":"983.665097ms","start":"2025-07-15T11:02:02.667220Z","end":"2025-07-15T11:02:03.650885Z","steps":["trace[1586333320] 'process raft request' (duration: 982.721135ms)"],"step_count":1} Jul 15 11:02:03.652156 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:03.651118Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:02.667207Z","time spent":"983.790117ms","remote":"172.24.4.207:47638","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":1121,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 11:02:03.652156 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:03.651315Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:02.666675Z","time spent":"983.778285ms","remote":"172.24.4.207:47638","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":1117,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 11:02:03.653202 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:03.652638Z","caller":"traceutil/trace.go:171","msg":"trace[407380904] transaction","detail":"{read_only:false; response_revision:2006; number_of_response:1; }","duration":"985.274457ms","start":"2025-07-15T11:02:02.667344Z","end":"2025-07-15T11:02:03.652618Z","steps":["trace[407380904] 'process raft request' (duration: 983.302865ms)"],"step_count":1} Jul 15 11:02:03.654068 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:03.652763Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:02.667332Z","time spent":"985.375911ms","remote":"172.24.4.207:47638","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":1119,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 11:02:03.656931 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:03.654635Z","caller":"traceutil/trace.go:171","msg":"trace[1866938679] transaction","detail":"{read_only:false; response_revision:2007; number_of_response:1; }","duration":"986.163046ms","start":"2025-07-15T11:02:02.668454Z","end":"2025-07-15T11:02:03.654617Z","steps":["trace[1866938679] 'process raft request' (duration: 983.234658ms)"],"step_count":1} Jul 15 11:02:03.657173 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:03.654784Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:02.668399Z","time spent":"986.317126ms","remote":"172.24.4.207:47638","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":1115,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 11:02:03.657173 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:03.655666Z","caller":"traceutil/trace.go:171","msg":"trace[2040415478] linearizableReadLoop","detail":"{readStateIndex:2376; appliedIndex:2370; }","duration":"995.315007ms","start":"2025-07-15T11:02:02.660292Z","end":"2025-07-15T11:02:03.655607Z","steps":["trace[2040415478] 'read index received' (duration: 953.581432ms)","trace[2040415478] 'applied index is now lower than readState.Index' (duration: 41.731832ms)"],"step_count":2} Jul 15 11:02:03.660766 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:03.660134Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"965.009781ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/installations/default\" limit:1 ","response":"range_response_count:1 size:5983"} Jul 15 11:02:03.660766 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:03.660281Z","caller":"traceutil/trace.go:171","msg":"trace[900846064] range","detail":"{range_begin:/registry/operator.tigera.io/installations/default; range_end:; response_count:1; response_revision:2008; }","duration":"965.190394ms","start":"2025-07-15T11:02:02.695048Z","end":"2025-07-15T11:02:03.660238Z","steps":["trace[900846064] 'agreement among raft nodes before linearized reading' (duration: 964.911923ms)"],"step_count":1} Jul 15 11:02:03.663843 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:03.660659Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:02.695027Z","time spent":"965.601062ms","remote":"172.24.4.207:47640","response type":"/etcdserverpb.KV/Range","request count":0,"request size":54,"response count":1,"response size":6007,"request content":"key:\"/registry/operator.tigera.io/installations/default\" limit:1 "} Jul 15 11:02:03.663843 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:03.661208Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.140247996s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/installations/default\" limit:1 ","response":"range_response_count:1 size:5983"} Jul 15 11:02:03.663843 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:03.661519Z","caller":"traceutil/trace.go:171","msg":"trace[1164524680] range","detail":"{range_begin:/registry/operator.tigera.io/installations/default; range_end:; response_count:1; response_revision:2008; }","duration":"2.140520604s","start":"2025-07-15T11:02:01.520874Z","end":"2025-07-15T11:02:03.661395Z","steps":["trace[1164524680] 'agreement among raft nodes before linearized reading' (duration: 2.135150078s)"],"step_count":1} Jul 15 11:02:03.663843 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:03.661752Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:01.520845Z","time spent":"2.14078094s","remote":"172.24.4.207:47640","response type":"/etcdserverpb.KV/Range","request count":0,"request size":54,"response count":1,"response size":6007,"request content":"key:\"/registry/operator.tigera.io/installations/default\" limit:1 "} Jul 15 11:02:03.663843 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:03.661995Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"988.921315ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jul 15 11:02:03.664395 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:03.662094Z","caller":"traceutil/trace.go:171","msg":"trace[428715136] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:2008; }","duration":"989.044484ms","start":"2025-07-15T11:02:02.673018Z","end":"2025-07-15T11:02:03.662063Z","steps":["trace[428715136] 'agreement among raft nodes before linearized reading' (duration: 988.933581ms)"],"step_count":1} Jul 15 11:02:03.664395 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:03.662154Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:02.672999Z","time spent":"989.140516ms","remote":"172.24.4.207:54212","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":29,"request content":"key:\"/registry/health\" "} Jul 15 11:02:03.664395 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:03.662388Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"995.212392ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/tigerastatuses/gatewayapi\" limit:1 ","response":"range_response_count:0 size:5"} Jul 15 11:02:03.664395 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:03.662467Z","caller":"traceutil/trace.go:171","msg":"trace[1599259189] range","detail":"{range_begin:/registry/operator.tigera.io/tigerastatuses/gatewayapi; range_end:; response_count:0; response_revision:2008; }","duration":"995.342105ms","start":"2025-07-15T11:02:02.667091Z","end":"2025-07-15T11:02:03.662433Z","steps":["trace[1599259189] 'agreement among raft nodes before linearized reading' (duration: 995.229107ms)"],"step_count":1} Jul 15 11:02:03.664395 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:03.662518Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:02.667084Z","time spent":"995.418268ms","remote":"172.24.4.207:47638","response type":"/etcdserverpb.KV/Range","request count":0,"request size":58,"response count":0,"response size":29,"request content":"key:\"/registry/operator.tigera.io/tigerastatuses/gatewayapi\" limit:1 "} Jul 15 11:02:03.664922 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:03.662624Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"172.409714ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/tigerastatuses/\" range_end:\"/registry/operator.tigera.io/tigerastatuses0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 11:02:03.664922 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:03.662690Z","caller":"traceutil/trace.go:171","msg":"trace[1888932100] range","detail":"{range_begin:/registry/operator.tigera.io/tigerastatuses/; range_end:/registry/operator.tigera.io/tigerastatuses0; response_count:0; response_revision:2008; }","duration":"172.616281ms","start":"2025-07-15T11:02:03.490044Z","end":"2025-07-15T11:02:03.662661Z","steps":["trace[1888932100] 'agreement among raft nodes before linearized reading' (duration: 166.600084ms)"],"step_count":1} Jul 15 11:02:03.664922 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:03.663399Z","caller":"traceutil/trace.go:171","msg":"trace[591546305] transaction","detail":"{read_only:false; response_revision:2008; number_of_response:1; }","duration":"986.104176ms","start":"2025-07-15T11:02:02.677273Z","end":"2025-07-15T11:02:03.663377Z","steps":["trace[591546305] 'process raft request' (duration: 977.247067ms)"],"step_count":1} Jul 15 11:02:03.664922 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:03.663563Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:02.677246Z","time spent":"986.233006ms","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":490,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 11:02:03.665886 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:03.665520Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.136345888s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/installations/default\" limit:1 ","response":"range_response_count:1 size:5983"} Jul 15 11:02:03.665886 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:03.665597Z","caller":"traceutil/trace.go:171","msg":"trace[1707324025] range","detail":"{range_begin:/registry/operator.tigera.io/installations/default; range_end:; response_count:1; response_revision:2008; }","duration":"2.136483965s","start":"2025-07-15T11:02:01.529093Z","end":"2025-07-15T11:02:03.665577Z","steps":["trace[1707324025] 'agreement among raft nodes before linearized reading' (duration: 2.13455501s)"],"step_count":1} Jul 15 11:02:03.666528 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:03.666208Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:01.529071Z","time spent":"2.137092652s","remote":"172.24.4.207:47640","response type":"/etcdserverpb.KV/Range","request count":0,"request size":54,"response count":1,"response size":6007,"request content":"key:\"/registry/operator.tigera.io/installations/default\" limit:1 "} Jul 15 11:02:03.667587 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:03.667279Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.162146077s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/whiskers/default\" limit:1 ","response":"range_response_count:1 size:948"} Jul 15 11:02:03.668088 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:03.667781Z","caller":"traceutil/trace.go:171","msg":"trace[789332111] range","detail":"{range_begin:/registry/operator.tigera.io/whiskers/default; range_end:; response_count:1; response_revision:2008; }","duration":"2.162314957s","start":"2025-07-15T11:02:01.505085Z","end":"2025-07-15T11:02:03.667400Z","steps":["trace[789332111] 'agreement among raft nodes before linearized reading' (duration: 2.151128697s)"],"step_count":1} Jul 15 11:02:03.668690 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:03.668293Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:01.505070Z","time spent":"2.163174177s","remote":"172.24.4.207:47698","response type":"/etcdserverpb.KV/Range","request count":0,"request size":49,"response count":1,"response size":972,"request content":"key:\"/registry/operator.tigera.io/whiskers/default\" limit:1 "} Jul 15 11:02:03.669647 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:03.661900Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"977.284565ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/clusterroles/tigera-csr-creator\" limit:1 ","response":"range_response_count:0 size:5"} Jul 15 11:02:03.669647 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:03.668971Z","caller":"traceutil/trace.go:171","msg":"trace[1656374663] range","detail":"{range_begin:/registry/clusterroles/tigera-csr-creator; range_end:; response_count:0; response_revision:2008; }","duration":"984.386948ms","start":"2025-07-15T11:02:02.684562Z","end":"2025-07-15T11:02:03.668949Z","steps":["trace[1656374663] 'agreement among raft nodes before linearized reading' (duration: 977.290686ms)"],"step_count":1} Jul 15 11:02:03.670232 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:03.669837Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:02.684543Z","time spent":"984.985254ms","remote":"172.24.4.207:54526","response type":"/etcdserverpb.KV/Range","request count":0,"request size":45,"response count":0,"response size":29,"request content":"key:\"/registry/clusterroles/tigera-csr-creator\" limit:1 "} Jul 15 11:02:03.675174 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:03.671599Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.168058218s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/secrets/tigera-operator/tigera-ca-private\" limit:1 ","response":"range_response_count:1 size:3373"} Jul 15 11:02:03.675174 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:03.671702Z","caller":"traceutil/trace.go:171","msg":"trace[1993518805] range","detail":"{range_begin:/registry/secrets/tigera-operator/tigera-ca-private; range_end:; response_count:1; response_revision:2008; }","duration":"2.168175594s","start":"2025-07-15T11:02:01.503476Z","end":"2025-07-15T11:02:03.671652Z","steps":["trace[1993518805] 'agreement among raft nodes before linearized reading' (duration: 2.152785778s)","trace[1993518805] 'range keys from bolt db' (duration: 15.275936ms)"],"step_count":2} Jul 15 11:02:03.675174 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:03.671756Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:01.503394Z","time spent":"2.168344174s","remote":"172.24.4.207:54276","response type":"/etcdserverpb.KV/Range","request count":0,"request size":55,"response count":1,"response size":3397,"request content":"key:\"/registry/secrets/tigera-operator/tigera-ca-private\" limit:1 "} Jul 15 11:02:03.675174 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:03.668385Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.14566434s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/installations/default\" limit:1 ","response":"range_response_count:1 size:5983"} Jul 15 11:02:03.675699 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:03.672041Z","caller":"traceutil/trace.go:171","msg":"trace[46164907] range","detail":"{range_begin:/registry/operator.tigera.io/installations/default; range_end:; response_count:1; response_revision:2008; }","duration":"2.149305154s","start":"2025-07-15T11:02:01.522693Z","end":"2025-07-15T11:02:03.671998Z","steps":["trace[46164907] 'agreement among raft nodes before linearized reading' (duration: 2.145161458s)"],"step_count":1} Jul 15 11:02:03.675699 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:03.672109Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:01.522635Z","time spent":"2.14945179s","remote":"172.24.4.207:47640","response type":"/etcdserverpb.KV/Range","request count":0,"request size":54,"response count":1,"response size":6007,"request content":"key:\"/registry/operator.tigera.io/installations/default\" limit:1 "} Jul 15 11:02:03.675699 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:03.673230Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"989.53064ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/tigerastatuses/management-cluster-connection\" limit:1 ","response":"range_response_count:0 size:5"} Jul 15 11:02:03.675699 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:03.673447Z","caller":"traceutil/trace.go:171","msg":"trace[1846423906] range","detail":"{range_begin:/registry/operator.tigera.io/tigerastatuses/management-cluster-connection; range_end:; response_count:0; response_revision:2008; }","duration":"1.00630275s","start":"2025-07-15T11:02:02.667044Z","end":"2025-07-15T11:02:03.673347Z","steps":["trace[1846423906] 'agreement among raft nodes before linearized reading' (duration: 989.535148ms)"],"step_count":1} Jul 15 11:02:03.676125 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:03.673604Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:02.667029Z","time spent":"1.006545719s","remote":"172.24.4.207:47638","response type":"/etcdserverpb.KV/Range","request count":0,"request size":77,"response count":0,"response size":29,"request content":"key:\"/registry/operator.tigera.io/tigerastatuses/management-cluster-connection\" limit:1 "} Jul 15 11:02:06.689070 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:06.661109Z","caller":"traceutil/trace.go:171","msg":"trace[2140663842] linearizableReadLoop","detail":"{readStateIndex:2382; appliedIndex:2382; }","duration":"136.153132ms","start":"2025-07-15T11:02:06.524926Z","end":"2025-07-15T11:02:06.661079Z","steps":["trace[2140663842] 'read index received' (duration: 136.146248ms)","trace[2140663842] 'applied index is now lower than readState.Index' (duration: 5.221µs)"],"step_count":2} Jul 15 11:02:06.689070 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:06.661370Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"135.392433ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/clusterroles/calico-tier-getter\" limit:1 ","response":"range_response_count:1 size:515"} Jul 15 11:02:06.689070 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:06.661439Z","caller":"traceutil/trace.go:171","msg":"trace[1354393956] range","detail":"{range_begin:/registry/clusterroles/calico-tier-getter; range_end:; response_count:1; response_revision:2012; }","duration":"135.52523ms","start":"2025-07-15T11:02:06.525899Z","end":"2025-07-15T11:02:06.661424Z","steps":["trace[1354393956] 'agreement among raft nodes before linearized reading' (duration: 135.327061ms)"],"step_count":1} Jul 15 11:02:06.689070 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:06.661626Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"136.691977ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/services/endpoints/default/nfs-server-provisioner\" limit:1 ","response":"range_response_count:1 size:1218"} Jul 15 11:02:06.691110 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:06.661791Z","caller":"traceutil/trace.go:171","msg":"trace[71802102] range","detail":"{range_begin:/registry/services/endpoints/default/nfs-server-provisioner; range_end:; response_count:1; response_revision:2012; }","duration":"136.750854ms","start":"2025-07-15T11:02:06.524906Z","end":"2025-07-15T11:02:06.661656Z","steps":["trace[71802102] 'agreement among raft nodes before linearized reading' (duration: 136.622426ms)"],"step_count":1} Jul 15 11:02:09.438762 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:09.288973Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875177344,"retry-timeout":"500ms"} Jul 15 11:02:14.034781 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:09.789600Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875177344,"retry-timeout":"500ms"} Jul 15 11:02:14.034781 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:10.290264Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875177344,"retry-timeout":"500ms"} Jul 15 11:02:14.034781 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:10.791689Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875177344,"retry-timeout":"500ms"} Jul 15 11:02:14.034781 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:11.292669Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875177344,"retry-timeout":"500ms"} Jul 15 11:02:14.034781 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:11.793675Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875177344,"retry-timeout":"500ms"} Jul 15 11:02:14.034781 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:12.294474Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875177344,"retry-timeout":"500ms"} Jul 15 11:02:14.034781 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:12.795293Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875177344,"retry-timeout":"500ms"} Jul 15 11:02:14.034781 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:12.884320Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:07.887136Z","time spent":"4.997174186s","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jul 15 11:02:14.037212 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:13.295536Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875177344,"retry-timeout":"500ms"} Jul 15 11:02:14.037212 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:13.796271Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875177344,"retry-timeout":"500ms"} Jul 15 11:02:14.037212 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:13.806970Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:08.809059Z","time spent":"4.997843835s","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jul 15 11:02:14.044580 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:14.043910Z","caller":"wal/wal.go:805","msg":"slow fdatasync","took":"6.156652315s","expected-duration":"1s"} Jul 15 11:02:14.118703 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:14.115605Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"6.256953811s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/clusterroles/tigera-network-admin\" limit:1 ","response":"range_response_count:0 size:5"} Jul 15 11:02:14.118703 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:14.115751Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"6.257250646s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/secrets/tigera-operator/goldmane-key-pair\" limit:1 ","response":"range_response_count:1 size:4711"} Jul 15 11:02:14.118703 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:14.115774Z","caller":"traceutil/trace.go:171","msg":"trace[2041879844] range","detail":"{range_begin:/registry/clusterroles/tigera-network-admin; range_end:; response_count:0; response_revision:2029; }","duration":"6.257142869s","start":"2025-07-15T11:02:07.858574Z","end":"2025-07-15T11:02:14.115717Z","steps":["trace[2041879844] 'range keys from in-memory index tree' (duration: 6.256845493s)"],"step_count":1} Jul 15 11:02:14.118703 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:14.115854Z","caller":"traceutil/trace.go:171","msg":"trace[1439652426] range","detail":"{range_begin:/registry/secrets/tigera-operator/goldmane-key-pair; range_end:; response_count:1; response_revision:2029; }","duration":"6.257441277s","start":"2025-07-15T11:02:07.858399Z","end":"2025-07-15T11:02:14.115840Z","steps":["trace[1439652426] 'range keys from in-memory index tree' (duration: 6.256884541s)"],"step_count":1} Jul 15 11:02:14.118703 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:14.115900Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:07.858376Z","time spent":"6.25751257s","remote":"172.24.4.207:54276","response type":"/etcdserverpb.KV/Range","request count":0,"request size":55,"response count":1,"response size":4735,"request content":"key:\"/registry/secrets/tigera-operator/goldmane-key-pair\" limit:1 "} Jul 15 11:02:14.120157 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:14.115902Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:07.858536Z","time spent":"6.257340996s","remote":"172.24.4.207:54526","response type":"/etcdserverpb.KV/Range","request count":0,"request size":47,"response count":0,"response size":29,"request content":"key:\"/registry/clusterroles/tigera-network-admin\" limit:1 "} Jul 15 11:02:14.120157 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:14.116293Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"6.229432461s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/stagedglobalnetworkpolicies.crd.projectcalico.org\" limit:1 ","response":"range_response_count:1 size:35252"} Jul 15 11:02:14.120157 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:14.116337Z","caller":"traceutil/trace.go:171","msg":"trace[1924828635] range","detail":"{range_begin:/registry/apiextensions.k8s.io/customresourcedefinitions/stagedglobalnetworkpolicies.crd.projectcalico.org; range_end:; response_count:1; response_revision:2029; }","duration":"6.229547291s","start":"2025-07-15T11:02:07.886767Z","end":"2025-07-15T11:02:14.116314Z","steps":["trace[1924828635] 'range keys from in-memory index tree' (duration: 6.215797063s)"],"step_count":1} Jul 15 11:02:14.120157 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:14.116367Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:07.886743Z","time spent":"6.229608724s","remote":"172.24.4.207:54256","response type":"/etcdserverpb.KV/Range","request count":0,"request size":110,"response count":1,"response size":35276,"request content":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/stagedglobalnetworkpolicies.crd.projectcalico.org\" limit:1 "} Jul 15 11:02:14.120513 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:14.116233Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"6.413155462s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/installations/default\" limit:1 ","response":"range_response_count:1 size:5983"} Jul 15 11:02:14.120513 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:14.116431Z","caller":"traceutil/trace.go:171","msg":"trace[754945174] range","detail":"{range_begin:/registry/operator.tigera.io/installations/default; range_end:; response_count:1; response_revision:2029; }","duration":"6.413403227s","start":"2025-07-15T11:02:07.703000Z","end":"2025-07-15T11:02:14.116403Z","steps":["trace[754945174] 'range keys from in-memory index tree' (duration: 6.412826683s)"],"step_count":1} Jul 15 11:02:14.120513 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:14.116521Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:07.702965Z","time spent":"6.413526806s","remote":"172.24.4.207:47640","response type":"/etcdserverpb.KV/Range","request count":0,"request size":54,"response count":1,"response size":6007,"request content":"key:\"/registry/operator.tigera.io/installations/default\" limit:1 "} Jul 15 11:02:14.120513 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:14.117104Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"6.288384231s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jul 15 11:02:14.120513 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:14.117175Z","caller":"traceutil/trace.go:171","msg":"trace[1023442972] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:2029; }","duration":"6.288793941s","start":"2025-07-15T11:02:07.828363Z","end":"2025-07-15T11:02:14.117157Z","steps":["trace[1023442972] 'range keys from in-memory index tree' (duration: 6.288316654s)"],"step_count":1} Jul 15 11:02:14.121488 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:14.117238Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:07.828340Z","time spent":"6.288876066s","remote":"172.24.4.207:54212","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":29,"request content":"key:\"/registry/health\" "} Jul 15 11:02:14.121488 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:14.118619Z","caller":"traceutil/trace.go:171","msg":"trace[1359168758] linearizableReadLoop","detail":"{readStateIndex:2402; appliedIndex:2399; }","duration":"5.330279278s","start":"2025-07-15T11:02:08.788320Z","end":"2025-07-15T11:02:14.118599Z","steps":["trace[1359168758] 'read index received' (duration: 5.2561024s)","trace[1359168758] 'applied index is now lower than readState.Index' (duration: 74.176017ms)"],"step_count":2} Jul 15 11:02:14.121488 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:14.119473Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"5.331140353s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/minions/\" range_end:\"/registry/minions0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 11:02:14.121488 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:14.119370Z","caller":"traceutil/trace.go:171","msg":"trace[967541419] transaction","detail":"{read_only:false; response_revision:2032; number_of_response:1; }","duration":"5.310032792s","start":"2025-07-15T11:02:08.809322Z","end":"2025-07-15T11:02:14.119355Z","steps":["trace[967541419] 'process raft request' (duration: 5.308745125s)"],"step_count":1} Jul 15 11:02:14.121705 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:14.120958Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:08.809305Z","time spent":"5.311518627s","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":699,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 11:02:14.122350 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:14.121851Z","caller":"traceutil/trace.go:171","msg":"trace[1488122156] range","detail":"{range_begin:/registry/minions/; range_end:/registry/minions0; response_count:0; response_revision:2032; }","duration":"5.333564276s","start":"2025-07-15T11:02:08.788266Z","end":"2025-07-15T11:02:14.121831Z","steps":["trace[1488122156] 'agreement among raft nodes before linearized reading' (duration: 5.33116832s)"],"step_count":1} Jul 15 11:02:14.122350 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:14.121990Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:08.788239Z","time spent":"5.333711761s","remote":"172.24.4.207:54344","response type":"/etcdserverpb.KV/Range","request count":0,"request size":42,"response count":2,"response size":31,"request content":"key:\"/registry/minions/\" range_end:\"/registry/minions0\" count_only:true "} Jul 15 11:02:14.153269 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:14.152745Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"100.407318ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/ippools/\" range_end:\"/registry/crd.projectcalico.org/ippools0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 11:02:14.154211 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:14.153652Z","caller":"traceutil/trace.go:171","msg":"trace[467176184] range","detail":"{range_begin:/registry/crd.projectcalico.org/ippools/; range_end:/registry/crd.projectcalico.org/ippools0; response_count:0; response_revision:2034; }","duration":"101.311687ms","start":"2025-07-15T11:02:14.052307Z","end":"2025-07-15T11:02:14.153619Z","steps":["trace[467176184] 'agreement among raft nodes before linearized reading' (duration: 100.403128ms)"],"step_count":1} Jul 15 11:02:14.154211 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:14.152907Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"115.222183ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/rolebindings/\" range_end:\"/registry/rolebindings0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 11:02:14.155149 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:14.152970Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"100.81824ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/blockaffinities/\" range_end:\"/registry/crd.projectcalico.org/blockaffinities0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 11:02:14.155149 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:14.154279Z","caller":"traceutil/trace.go:171","msg":"trace[519683835] range","detail":"{range_begin:/registry/crd.projectcalico.org/blockaffinities/; range_end:/registry/crd.projectcalico.org/blockaffinities0; response_count:0; response_revision:2034; }","duration":"102.160828ms","start":"2025-07-15T11:02:14.052105Z","end":"2025-07-15T11:02:14.154266Z","steps":["trace[519683835] 'agreement among raft nodes before linearized reading' (duration: 100.81834ms)"],"step_count":1} Jul 15 11:02:14.155149 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:14.153124Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"100.973059ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/clusterinformations/\" range_end:\"/registry/crd.projectcalico.org/clusterinformations0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 11:02:14.155149 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:14.154368Z","caller":"traceutil/trace.go:171","msg":"trace[1935045772] range","detail":"{range_begin:/registry/crd.projectcalico.org/clusterinformations/; range_end:/registry/crd.projectcalico.org/clusterinformations0; response_count:0; response_revision:2034; }","duration":"102.369264ms","start":"2025-07-15T11:02:14.051990Z","end":"2025-07-15T11:02:14.154360Z","steps":["trace[1935045772] 'agreement among raft nodes before linearized reading' (duration: 100.989883ms)"],"step_count":1} Jul 15 11:02:14.155455 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:14.153213Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"135.946662ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/caliconodestatuses/\" range_end:\"/registry/crd.projectcalico.org/caliconodestatuses0\" count_only:true ","response":"range_response_count:0 size:5"} Jul 15 11:02:14.155455 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:14.154436Z","caller":"traceutil/trace.go:171","msg":"trace[785913791] range","detail":"{range_begin:/registry/crd.projectcalico.org/caliconodestatuses/; range_end:/registry/crd.projectcalico.org/caliconodestatuses0; response_count:0; response_revision:2034; }","duration":"137.20489ms","start":"2025-07-15T11:02:14.017224Z","end":"2025-07-15T11:02:14.154429Z","steps":["trace[785913791] 'agreement among raft nodes before linearized reading' (duration: 135.961561ms)"],"step_count":1} Jul 15 11:02:14.155455 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:14.153356Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"147.187394ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jul 15 11:02:14.155455 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:14.154510Z","caller":"traceutil/trace.go:171","msg":"trace[934708436] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:2034; }","duration":"148.43933ms","start":"2025-07-15T11:02:14.006064Z","end":"2025-07-15T11:02:14.154503Z","steps":["trace[934708436] 'agreement among raft nodes before linearized reading' (duration: 147.177184ms)"],"step_count":1} Jul 15 11:02:14.155455 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:14.153497Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"135.187291ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/leases/kube-system/kube-controller-manager\" limit:1 ","response":"range_response_count:1 size:532"} Jul 15 11:02:14.155745 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:14.154609Z","caller":"traceutil/trace.go:171","msg":"trace[121321548] range","detail":"{range_begin:/registry/leases/kube-system/kube-controller-manager; range_end:; response_count:1; response_revision:2034; }","duration":"136.327604ms","start":"2025-07-15T11:02:14.018275Z","end":"2025-07-15T11:02:14.154603Z","steps":["trace[121321548] 'agreement among raft nodes before linearized reading' (duration: 134.949827ms)"],"step_count":1} Jul 15 11:02:14.155745 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:14.153898Z","caller":"traceutil/trace.go:171","msg":"trace[1721399676] range","detail":"{range_begin:/registry/rolebindings/; range_end:/registry/rolebindings0; response_count:0; response_revision:2034; }","duration":"116.239931ms","start":"2025-07-15T11:02:14.037648Z","end":"2025-07-15T11:02:14.153888Z","steps":["trace[1721399676] 'agreement among raft nodes before linearized reading' (duration: 115.225741ms)"],"step_count":1} Jul 15 11:02:16.192310 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:16.191147Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.000370075s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context deadline exceeded"} Jul 15 11:02:16.192310 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:16.191315Z","caller":"traceutil/trace.go:171","msg":"trace[685101203] range","detail":"{range_begin:/registry/health; range_end:; }","duration":"2.000585144s","start":"2025-07-15T11:02:14.190699Z","end":"2025-07-15T11:02:16.191284Z","steps":["trace[685101203] 'agreement among raft nodes before linearized reading' (duration: 2.0003984s)"],"step_count":1} Jul 15 11:02:16.192310 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:16.191433Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:14.190679Z","time spent":"2.000728622s","remote":"172.24.4.207:54212","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "} Jul 15 11:02:19.182677 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:19.169982Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"4.998779683s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/leases/kube-system/kube-controller-manager\" limit:1 ","response":"","error":"context deadline exceeded"} Jul 15 11:02:19.182677 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:19.170085Z","caller":"traceutil/trace.go:171","msg":"trace[1633696525] range","detail":"{range_begin:/registry/leases/kube-system/kube-controller-manager; range_end:; }","duration":"4.998947536s","start":"2025-07-15T11:02:14.171117Z","end":"2025-07-15T11:02:19.170064Z","steps":["trace[1633696525] 'agreement among raft nodes before linearized reading' (duration: 4.998809421s)"],"step_count":1} Jul 15 11:02:19.182677 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:19.170152Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:14.171098Z","time spent":"4.99903409s","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Range","request count":0,"request size":56,"response count":0,"response size":0,"request content":"key:\"/registry/leases/kube-system/kube-controller-manager\" limit:1 "} Jul 15 11:02:19.267425 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:19.266325Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"4.999943918s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/leases/tigera-operator/operator-lock\" limit:1 ","response":"","error":"context deadline exceeded"} Jul 15 11:02:19.267425 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:19.266437Z","caller":"traceutil/trace.go:171","msg":"trace[10993029] range","detail":"{range_begin:/registry/leases/tigera-operator/operator-lock; range_end:; }","duration":"5.000106082s","start":"2025-07-15T11:02:14.266310Z","end":"2025-07-15T11:02:19.266416Z","steps":["trace[10993029] 'agreement among raft nodes before linearized reading' (duration: 4.999950311s)"],"step_count":1} Jul 15 11:02:19.267425 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:19.266581Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:14.266304Z","time spent":"5.000204138s","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Range","request count":0,"request size":50,"response count":0,"response size":0,"request content":"key:\"/registry/leases/tigera-operator/operator-lock\" limit:1 "} Jul 15 11:02:19.429588 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:19.428460Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"5.243858784s","expected-duration":"100ms","prefix":"","request":"header: lease_revoke:","response":"size:29"} Jul 15 11:02:19.429588 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:19.428966Z","caller":"traceutil/trace.go:171","msg":"trace[1339045463] linearizableReadLoop","detail":"{readStateIndex:2406; appliedIndex:2405; }","duration":"5.257551362s","start":"2025-07-15T11:02:14.171158Z","end":"2025-07-15T11:02:19.428710Z","steps":["trace[1339045463] 'read index received' (duration: 13.330404ms)","trace[1339045463] 'applied index is now lower than readState.Index' (duration: 5.244217712s)"],"step_count":2} Jul 15 11:02:19.449478 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:19.430227Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"5.160705016s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/clusterroles/tigera-crds\" limit:1 ","response":"range_response_count:0 size:5"} Jul 15 11:02:19.449478 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:19.430449Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"5.174631553s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/clusterinformations/default\" limit:1 ","response":"range_response_count:1 size:886"} Jul 15 11:02:19.449478 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:19.430581Z","caller":"traceutil/trace.go:171","msg":"trace[1731772922] range","detail":"{range_begin:/registry/crd.projectcalico.org/clusterinformations/default; range_end:; response_count:1; response_revision:2035; }","duration":"5.174759128s","start":"2025-07-15T11:02:14.255768Z","end":"2025-07-15T11:02:19.430527Z","steps":["trace[1731772922] 'agreement among raft nodes before linearized reading' (duration: 5.174021295s)"],"step_count":1} Jul 15 11:02:19.449478 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:19.430426Z","caller":"traceutil/trace.go:171","msg":"trace[427823633] range","detail":"{range_begin:/registry/clusterroles/tigera-crds; range_end:; response_count:0; response_revision:2035; }","duration":"5.160956329s","start":"2025-07-15T11:02:14.269442Z","end":"2025-07-15T11:02:19.430398Z","steps":["trace[427823633] 'agreement among raft nodes before linearized reading' (duration: 5.160713634s)"],"step_count":1} Jul 15 11:02:19.449478 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:19.430702Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:14.269413Z","time spent":"5.161258962s","remote":"172.24.4.207:54526","response type":"/etcdserverpb.KV/Range","request count":0,"request size":38,"response count":0,"response size":29,"request content":"key:\"/registry/clusterroles/tigera-crds\" limit:1 "} Jul 15 11:02:19.451499 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:19.430979Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"5.162413743s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/configmaps/calico-system/whisker-ca-bundle\" limit:1 ","response":"range_response_count:1 size:1956"} Jul 15 11:02:19.451499 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:19.431049Z","caller":"traceutil/trace.go:171","msg":"trace[238397207] range","detail":"{range_begin:/registry/configmaps/calico-system/whisker-ca-bundle; range_end:; response_count:1; response_revision:2035; }","duration":"5.162500135s","start":"2025-07-15T11:02:14.268529Z","end":"2025-07-15T11:02:19.431030Z","steps":["trace[238397207] 'agreement among raft nodes before linearized reading' (duration: 5.162212461s)"],"step_count":1} Jul 15 11:02:19.451499 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:19.431113Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:14.268525Z","time spent":"5.162564154s","remote":"172.24.4.207:54282","response type":"/etcdserverpb.KV/Range","request count":0,"request size":56,"response count":1,"response size":1980,"request content":"key:\"/registry/configmaps/calico-system/whisker-ca-bundle\" limit:1 "} Jul 15 11:02:19.451499 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:19.431454Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"5.082215047s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/baselineadminnetworkpolicies.policy.networking.k8s.io\" limit:1 ","response":"range_response_count:1 size:33082"} Jul 15 11:02:19.452285 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:19.431530Z","caller":"traceutil/trace.go:171","msg":"trace[1841275855] range","detail":"{range_begin:/registry/apiextensions.k8s.io/customresourcedefinitions/baselineadminnetworkpolicies.policy.networking.k8s.io; range_end:; response_count:1; response_revision:2035; }","duration":"5.082335619s","start":"2025-07-15T11:02:14.349171Z","end":"2025-07-15T11:02:19.431507Z","steps":["trace[1841275855] 'agreement among raft nodes before linearized reading' (duration: 5.081808997s)"],"step_count":1} Jul 15 11:02:19.452285 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:19.431617Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:14.349144Z","time spent":"5.082444737s","remote":"172.24.4.207:54256","response type":"/etcdserverpb.KV/Range","request count":0,"request size":114,"response count":1,"response size":33106,"request content":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/baselineadminnetworkpolicies.policy.networking.k8s.io\" limit:1 "} Jul 15 11:02:19.452285 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:19.431682Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"5.163197949s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/secrets/calico-system/goldmane-key-pair\" limit:1 ","response":"range_response_count:1 size:4707"} Jul 15 11:02:19.452285 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:19.432636Z","caller":"traceutil/trace.go:171","msg":"trace[248356807] range","detail":"{range_begin:/registry/secrets/calico-system/goldmane-key-pair; range_end:; response_count:1; response_revision:2035; }","duration":"5.163325634s","start":"2025-07-15T11:02:14.268456Z","end":"2025-07-15T11:02:19.431777Z","steps":["trace[248356807] 'agreement among raft nodes before linearized reading' (duration: 5.162976677s)"],"step_count":1} Jul 15 11:02:19.453126 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:19.432752Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"5.153312124s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/minions/ci-4230-2-100-9439eb8d1a.novalocal\" limit:1 ","response":"range_response_count:1 size:6679"} Jul 15 11:02:19.453126 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:19.433083Z","caller":"traceutil/trace.go:171","msg":"trace[448375530] range","detail":"{range_begin:/registry/minions/ci-4230-2-100-9439eb8d1a.novalocal; range_end:; response_count:1; response_revision:2035; }","duration":"5.153678255s","start":"2025-07-15T11:02:14.279380Z","end":"2025-07-15T11:02:19.433058Z","steps":["trace[448375530] 'agreement among raft nodes before linearized reading' (duration: 5.153116433s)"],"step_count":1} Jul 15 11:02:19.453126 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:19.433383Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:14.279360Z","time spent":"5.153862994s","remote":"172.24.4.207:54344","response type":"/etcdserverpb.KV/Range","request count":0,"request size":56,"response count":1,"response size":6703,"request content":"key:\"/registry/minions/ci-4230-2-100-9439eb8d1a.novalocal\" limit:1 "} Jul 15 11:02:19.453126 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:19.433473Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:14.268450Z","time spent":"5.164403356s","remote":"172.24.4.207:54276","response type":"/etcdserverpb.KV/Range","request count":0,"request size":53,"response count":1,"response size":4731,"request content":"key:\"/registry/secrets/calico-system/goldmane-key-pair\" limit:1 "} Jul 15 11:02:19.453699 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:19.430702Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:14.255732Z","time spent":"5.174941092s","remote":"172.24.4.207:47728","response type":"/etcdserverpb.KV/Range","request count":0,"request size":63,"response count":1,"response size":910,"request content":"key:\"/registry/crd.projectcalico.org/clusterinformations/default\" limit:1 "} Jul 15 11:02:19.453699 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:19.434632Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"5.168418975s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/events/kube-system/kube-apiserver-ci-4230-2-100-9439eb8d1a.novalocal.1852678576305dad\" limit:1 ","response":"range_response_count:1 size:905"} Jul 15 11:02:19.453699 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:19.434782Z","caller":"traceutil/trace.go:171","msg":"trace[410970496] range","detail":"{range_begin:/registry/events/kube-system/kube-apiserver-ci-4230-2-100-9439eb8d1a.novalocal.1852678576305dad; range_end:; response_count:1; response_revision:2035; }","duration":"5.168587511s","start":"2025-07-15T11:02:14.266171Z","end":"2025-07-15T11:02:19.434758Z","steps":["trace[410970496] 'agreement among raft nodes before linearized reading' (duration: 5.168249957s)"],"step_count":1} Jul 15 11:02:19.453699 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:19.435030Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:14.266162Z","time spent":"5.16883261s","remote":"172.24.4.207:54266","response type":"/etcdserverpb.KV/Range","request count":0,"request size":99,"response count":1,"response size":929,"request content":"key:\"/registry/events/kube-system/kube-apiserver-ci-4230-2-100-9439eb8d1a.novalocal.1852678576305dad\" limit:1 "} Jul 15 11:02:19.950295 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:19.946185Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"164.508975ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/events/calico-system/goldmane-768f4c5c69-4b97g.185267bdfbea0d12\" limit:1 ","response":"range_response_count:1 size:855"} Jul 15 11:02:19.950295 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:19.946881Z","caller":"traceutil/trace.go:171","msg":"trace[223418697] range","detail":"{range_begin:/registry/events/calico-system/goldmane-768f4c5c69-4b97g.185267bdfbea0d12; range_end:; response_count:1; response_revision:2041; }","duration":"165.306939ms","start":"2025-07-15T11:02:19.781522Z","end":"2025-07-15T11:02:19.946829Z","steps":["trace[223418697] 'range keys from in-memory index tree' (duration: 164.10055ms)"],"step_count":1} Jul 15 11:02:20.246064 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:20.244345Z","caller":"traceutil/trace.go:171","msg":"trace[1431476140] transaction","detail":"{read_only:false; response_revision:2042; number_of_response:1; }","duration":"289.860683ms","start":"2025-07-15T11:02:19.954455Z","end":"2025-07-15T11:02:20.244316Z","steps":["trace[1431476140] 'process raft request' (duration: 289.491857ms)"],"step_count":1} Jul 15 11:02:20.882735 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:20.880656Z","caller":"traceutil/trace.go:171","msg":"trace[1937653510] linearizableReadLoop","detail":"{readStateIndex:2416; appliedIndex:2415; }","duration":"106.124148ms","start":"2025-07-15T11:02:20.774459Z","end":"2025-07-15T11:02:20.880583Z","steps":["trace[1937653510] 'read index received' (duration: 66.122623ms)","trace[1937653510] 'applied index is now lower than readState.Index' (duration: 40.000403ms)"],"step_count":2} Jul 15 11:02:20.882735 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:20.880927Z","caller":"traceutil/trace.go:171","msg":"trace[969190075] transaction","detail":"{read_only:false; response_revision:2044; number_of_response:1; }","duration":"222.809853ms","start":"2025-07-15T11:02:20.658098Z","end":"2025-07-15T11:02:20.880908Z","steps":["trace[969190075] 'process raft request' (duration: 182.622277ms)","trace[969190075] 'compare' (duration: 39.614592ms)"],"step_count":2} Jul 15 11:02:20.882735 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:20.881481Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"107.00205ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/persistentvolumes/\" range_end:\"/registry/persistentvolumes0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 11:02:20.882735 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:20.881535Z","caller":"traceutil/trace.go:171","msg":"trace[2146147455] range","detail":"{range_begin:/registry/persistentvolumes/; range_end:/registry/persistentvolumes0; response_count:0; response_revision:2044; }","duration":"107.121639ms","start":"2025-07-15T11:02:20.774400Z","end":"2025-07-15T11:02:20.881522Z","steps":["trace[2146147455] 'agreement among raft nodes before linearized reading' (duration: 106.652423ms)"],"step_count":1} Jul 15 11:02:20.883512 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:20.881888Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"102.134747ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/events/tigera-operator/tigera-operator-747864d56d-tqm9g.185267be6eeca5b3\" limit:1 ","response":"range_response_count:1 size:957"} Jul 15 11:02:20.883512 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:20.881941Z","caller":"traceutil/trace.go:171","msg":"trace[322997641] range","detail":"{range_begin:/registry/events/tigera-operator/tigera-operator-747864d56d-tqm9g.185267be6eeca5b3; range_end:; response_count:1; response_revision:2044; }","duration":"102.226841ms","start":"2025-07-15T11:02:20.779700Z","end":"2025-07-15T11:02:20.881927Z","steps":["trace[322997641] 'agreement among raft nodes before linearized reading' (duration: 101.988605ms)"],"step_count":1} Jul 15 11:02:20.883512 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:20.882011Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"100.244705ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jul 15 11:02:20.884455 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:20.882126Z","caller":"traceutil/trace.go:171","msg":"trace[1092454703] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:2044; }","duration":"100.451798ms","start":"2025-07-15T11:02:20.781644Z","end":"2025-07-15T11:02:20.882096Z","steps":["trace[1092454703] 'agreement among raft nodes before linearized reading' (duration: 100.272621ms)"],"step_count":1} Jul 15 11:02:21.083501 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:21.082273Z","caller":"traceutil/trace.go:171","msg":"trace[106306600] transaction","detail":"{read_only:false; response_revision:2046; number_of_response:1; }","duration":"149.083427ms","start":"2025-07-15T11:02:20.933146Z","end":"2025-07-15T11:02:21.082229Z","steps":["trace[106306600] 'process raft request' (duration: 77.623366ms)","trace[106306600] 'compare' (duration: 71.145303ms)"],"step_count":2} Jul 15 11:02:21.269553 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:21.268418Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"186.22191ms","expected-duration":"100ms","prefix":"","request":"header: lease_revoke:","response":"size:29"} Jul 15 11:02:21.766137 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:21.764178Z","caller":"traceutil/trace.go:171","msg":"trace[929583529] transaction","detail":"{read_only:false; response_revision:2047; number_of_response:1; }","duration":"129.991874ms","start":"2025-07-15T11:02:21.634157Z","end":"2025-07-15T11:02:21.764149Z","steps":["trace[929583529] 'process raft request' (duration: 129.542407ms)"],"step_count":1} Jul 15 11:02:21.766137 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:21.764953Z","caller":"traceutil/trace.go:171","msg":"trace[1584223144] linearizableReadLoop","detail":"{readStateIndex:2420; appliedIndex:2420; }","duration":"126.597024ms","start":"2025-07-15T11:02:21.638334Z","end":"2025-07-15T11:02:21.764931Z","steps":["trace[1584223144] 'read index received' (duration: 126.588066ms)","trace[1584223144] 'applied index is now lower than readState.Index' (duration: 6.804µs)"],"step_count":2} Jul 15 11:02:21.766137 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:21.765254Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"120.351256ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/default/test-pod-1\" limit:1 ","response":"range_response_count:1 size:3359"} Jul 15 11:02:21.766137 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:21.765315Z","caller":"traceutil/trace.go:171","msg":"trace[1413770200] range","detail":"{range_begin:/registry/pods/default/test-pod-1; range_end:; response_count:1; response_revision:2047; }","duration":"120.505182ms","start":"2025-07-15T11:02:21.644795Z","end":"2025-07-15T11:02:21.765300Z","steps":["trace[1413770200] 'agreement among raft nodes before linearized reading' (duration: 120.292619ms)"],"step_count":1} Jul 15 11:02:21.766137 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:21.765643Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"127.285536ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/clusterinformations/default\" limit:1 ","response":"range_response_count:1 size:886"} Jul 15 11:02:21.766934 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:21.765705Z","caller":"traceutil/trace.go:171","msg":"trace[1820446599] range","detail":"{range_begin:/registry/crd.projectcalico.org/clusterinformations/default; range_end:; response_count:1; response_revision:2047; }","duration":"127.405145ms","start":"2025-07-15T11:02:21.638285Z","end":"2025-07-15T11:02:21.765690Z","steps":["trace[1820446599] 'agreement among raft nodes before linearized reading' (duration: 127.212712ms)"],"step_count":1} Jul 15 11:02:24.449169 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:24.448437Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875177419,"retry-timeout":"500ms"} Jul 15 11:02:25.996581 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:25.995247Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.047345119s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context deadline exceeded"} Jul 15 11:02:25.996581 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:25.995462Z","caller":"traceutil/trace.go:171","msg":"trace[2048138425] range","detail":"{range_begin:/registry/health; range_end:; }","duration":"2.047663223s","start":"2025-07-15T11:02:23.947771Z","end":"2025-07-15T11:02:25.995434Z","steps":["trace[2048138425] 'agreement among raft nodes before linearized reading' (duration: 2.047423878s)"],"step_count":1} Jul 15 11:02:25.996581 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:25.995598Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:23.947753Z","time spent":"2.04780264s","remote":"172.24.4.207:54214","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "} Jul 15 11:02:25.996581 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:25.995748Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875177419,"retry-timeout":"500ms"} Jul 15 11:02:28.548751 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:27.455878Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875177419,"retry-timeout":"500ms"} Jul 15 11:02:28.548751 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:27.957174Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875177419,"retry-timeout":"500ms"} Jul 15 11:02:28.637837 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:28.458594Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875177419,"retry-timeout":"500ms"} Jul 15 11:02:28.638119 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:28.636830Z","caller":"wal/wal.go:805","msg":"slow fdatasync","took":"4.690498795s","expected-duration":"1s"} Jul 15 11:02:28.640048 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:28.639550Z","caller":"traceutil/trace.go:171","msg":"trace[1246469529] transaction","detail":"{read_only:false; response_revision:2052; number_of_response:1; }","duration":"4.693209733s","start":"2025-07-15T11:02:23.946180Z","end":"2025-07-15T11:02:28.639389Z","steps":["trace[1246469529] 'process raft request' (duration: 4.691938416s)"],"step_count":1} Jul 15 11:02:28.669081 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:28.641086Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:23.946036Z","time spent":"4.694049254s","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":490,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 11:02:28.669081 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:28.642942Z","caller":"traceutil/trace.go:171","msg":"trace[166851996] linearizableReadLoop","detail":"{readStateIndex:2428; appliedIndex:2428; }","duration":"4.694983292s","start":"2025-07-15T11:02:23.947864Z","end":"2025-07-15T11:02:28.642847Z","steps":["trace[166851996] 'read index received' (duration: 4.694931719s)","trace[166851996] 'applied index is now lower than readState.Index' (duration: 49.829µs)"],"step_count":2} Jul 15 11:02:28.742341 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:28.740584Z","caller":"traceutil/trace.go:171","msg":"trace[750272162] transaction","detail":"{read_only:false; response_revision:2053; number_of_response:1; }","duration":"130.970527ms","start":"2025-07-15T11:02:28.609593Z","end":"2025-07-15T11:02:28.740564Z","steps":["trace[750272162] 'process raft request' (duration: 118.533888ms)","trace[750272162] 'compare' (duration: 11.846336ms)"],"step_count":2} Jul 15 11:02:28.742341 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:28.740683Z","caller":"traceutil/trace.go:171","msg":"trace[1972399100] transaction","detail":"{read_only:false; response_revision:2054; number_of_response:1; }","duration":"130.743196ms","start":"2025-07-15T11:02:28.609933Z","end":"2025-07-15T11:02:28.740677Z","steps":["trace[1972399100] 'process raft request' (duration: 130.131901ms)"],"step_count":1} Jul 15 11:02:28.742341 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:28.740711Z","caller":"traceutil/trace.go:171","msg":"trace[2087682563] transaction","detail":"{read_only:false; response_revision:2055; number_of_response:1; }","duration":"130.694439ms","start":"2025-07-15T11:02:28.610011Z","end":"2025-07-15T11:02:28.740706Z","steps":["trace[2087682563] 'process raft request' (duration: 130.114927ms)"],"step_count":1} Jul 15 11:02:28.742341 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:28.740909Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"131.87713ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/prioritylevelconfigurations/\" range_end:\"/registry/prioritylevelconfigurations0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 11:02:28.742665 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:28.740984Z","caller":"traceutil/trace.go:171","msg":"trace[2108905345] range","detail":"{range_begin:/registry/prioritylevelconfigurations/; range_end:/registry/prioritylevelconfigurations0; response_count:0; response_revision:2055; }","duration":"131.938331ms","start":"2025-07-15T11:02:28.609000Z","end":"2025-07-15T11:02:28.740938Z","steps":["trace[2108905345] 'agreement among raft nodes before linearized reading' (duration: 131.757542ms)"],"step_count":1} Jul 15 11:02:28.742665 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:28.741200Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"133.000402ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/controllerrevisions/\" range_end:\"/registry/controllerrevisions0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 11:02:28.742665 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:28.741230Z","caller":"traceutil/trace.go:171","msg":"trace[1512868327] range","detail":"{range_begin:/registry/controllerrevisions/; range_end:/registry/controllerrevisions0; response_count:0; response_revision:2055; }","duration":"133.163216ms","start":"2025-07-15T11:02:28.608060Z","end":"2025-07-15T11:02:28.741224Z","steps":["trace[1512868327] 'agreement among raft nodes before linearized reading' (duration: 133.051835ms)"],"step_count":1} Jul 15 11:02:29.969537 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:29.968468Z","caller":"wal/wal.go:805","msg":"slow fdatasync","took":"1.195355417s","expected-duration":"1s"} Jul 15 11:02:32.478784 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:31.980455Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.000278586s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context deadline exceeded"} Jul 15 11:02:32.478784 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:31.980611Z","caller":"traceutil/trace.go:171","msg":"trace[1641346675] range","detail":"{range_begin:/registry/health; range_end:; }","duration":"2.000510816s","start":"2025-07-15T11:02:29.980066Z","end":"2025-07-15T11:02:31.980577Z","steps":["trace[1641346675] 'agreement among raft nodes before linearized reading' (duration: 2.000322472s)"],"step_count":1} Jul 15 11:02:32.478784 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:31.980778Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:29.980044Z","time spent":"2.000686295s","remote":"172.24.4.207:54212","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "} Jul 15 11:02:32.543533 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:32.542971Z","caller":"wal/wal.go:805","msg":"slow fdatasync","took":"2.520467659s","expected-duration":"1s"} Jul 15 11:02:32.565562 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:32.562618Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.593485782s","expected-duration":"100ms","prefix":"","request":"header: txn: success:> failure: >>","response":"size:16"} Jul 15 11:02:32.565562 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:32.562992Z","caller":"traceutil/trace.go:171","msg":"trace[627880839] transaction","detail":"{read_only:false; response_revision:2057; number_of_response:1; }","duration":"3.790234226s","start":"2025-07-15T11:02:28.772701Z","end":"2025-07-15T11:02:32.562935Z","steps":["trace[627880839] 'process raft request' (duration: 1.19617667s)","trace[627880839] 'compare' (duration: 2.593130356s)"],"step_count":2} Jul 15 11:02:32.565562 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:32.563206Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:28.772677Z","time spent":"3.790429313s","remote":"172.24.4.207:54266","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":1035,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 11:02:32.566235 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:32.563245Z","caller":"traceutil/trace.go:171","msg":"trace[1921423652] linearizableReadLoop","detail":"{readStateIndex:2434; appliedIndex:2432; }","duration":"2.625510896s","start":"2025-07-15T11:02:29.937713Z","end":"2025-07-15T11:02:32.563224Z","steps":["trace[1921423652] 'read index received' (duration: 31.451496ms)","trace[1921423652] 'applied index is now lower than readState.Index' (duration: 2.594058106s)"],"step_count":2} Jul 15 11:02:32.566235 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:32.563455Z","caller":"traceutil/trace.go:171","msg":"trace[119089337] transaction","detail":"{read_only:false; response_revision:2058; number_of_response:1; }","duration":"3.787252678s","start":"2025-07-15T11:02:28.776178Z","end":"2025-07-15T11:02:32.563431Z","steps":["trace[119089337] 'process raft request' (duration: 3.786720912s)"],"step_count":1} Jul 15 11:02:32.566235 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:32.563645Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:28.776132Z","time spent":"3.787419077s","remote":"172.24.4.207:54350","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":7006,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 11:02:32.566235 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:32.563976Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.626270782s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/stagedglobalnetworkpolicies/\" range_end:\"/registry/crd.projectcalico.org/stagedglobalnetworkpolicies0\" count_only:true ","response":"range_response_count:0 size:5"} Jul 15 11:02:32.567124 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:32.564082Z","caller":"traceutil/trace.go:171","msg":"trace[1674121410] range","detail":"{range_begin:/registry/crd.projectcalico.org/stagedglobalnetworkpolicies/; range_end:/registry/crd.projectcalico.org/stagedglobalnetworkpolicies0; response_count:0; response_revision:2058; }","duration":"2.626457594s","start":"2025-07-15T11:02:29.937607Z","end":"2025-07-15T11:02:32.564064Z","steps":["trace[1674121410] 'agreement among raft nodes before linearized reading' (duration: 2.626185745s)"],"step_count":1} Jul 15 11:02:32.567124 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:32.564183Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:29.937578Z","time spent":"2.626545227s","remote":"172.24.4.207:59384","response type":"/etcdserverpb.KV/Range","request count":0,"request size":126,"response count":0,"response size":29,"request content":"key:\"/registry/crd.projectcalico.org/stagedglobalnetworkpolicies/\" range_end:\"/registry/crd.projectcalico.org/stagedglobalnetworkpolicies0\" count_only:true "} Jul 15 11:02:32.571977 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:32.570669Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.630066927s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/masterleases/172.24.4.207\" limit:1 ","response":"range_response_count:1 size:131"} Jul 15 11:02:32.571977 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:32.571153Z","caller":"traceutil/trace.go:171","msg":"trace[872243073] transaction","detail":"{read_only:false; response_revision:2059; number_of_response:1; }","duration":"136.910758ms","start":"2025-07-15T11:02:32.434218Z","end":"2025-07-15T11:02:32.571128Z","steps":["trace[872243073] 'process raft request' (duration: 135.730968ms)"],"step_count":1} Jul 15 11:02:32.571977 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:32.571160Z","caller":"traceutil/trace.go:171","msg":"trace[1784359881] range","detail":"{range_begin:/registry/masterleases/172.24.4.207; range_end:; response_count:1; response_revision:2059; }","duration":"2.630492049s","start":"2025-07-15T11:02:29.940553Z","end":"2025-07-15T11:02:32.571045Z","steps":["trace[1784359881] 'agreement among raft nodes before linearized reading' (duration: 2.629595772s)"],"step_count":1} Jul 15 11:02:32.573444 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:32.572097Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:29.940539Z","time spent":"2.631203421s","remote":"172.24.4.207:54228","response type":"/etcdserverpb.KV/Range","request count":0,"request size":39,"response count":1,"response size":155,"request content":"key:\"/registry/masterleases/172.24.4.207\" limit:1 "} Jul 15 11:02:32.573444 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:32.572855Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"103.295018ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/operator.tigera.io/managementclusterconnections/\" range_end:\"/registry/operator.tigera.io/managementclusterconnections0\" count_only:true ","response":"range_response_count:0 size:5"} Jul 15 11:02:32.575091 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:32.573669Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"157.987352ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/endpointslices/\" range_end:\"/registry/endpointslices0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 11:02:32.575091 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:32.573734Z","caller":"traceutil/trace.go:171","msg":"trace[1171004013] range","detail":"{range_begin:/registry/endpointslices/; range_end:/registry/endpointslices0; response_count:0; response_revision:2059; }","duration":"158.165625ms","start":"2025-07-15T11:02:32.415553Z","end":"2025-07-15T11:02:32.573719Z","steps":["trace[1171004013] 'agreement among raft nodes before linearized reading' (duration: 157.899667ms)"],"step_count":1} Jul 15 11:02:32.575091 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:32.573243Z","caller":"traceutil/trace.go:171","msg":"trace[317162475] range","detail":"{range_begin:/registry/operator.tigera.io/managementclusterconnections/; range_end:/registry/operator.tigera.io/managementclusterconnections0; response_count:0; response_revision:2059; }","duration":"103.64868ms","start":"2025-07-15T11:02:32.469442Z","end":"2025-07-15T11:02:32.573090Z","steps":["trace[317162475] 'agreement among raft nodes before linearized reading' (duration: 103.282674ms)"],"step_count":1} Jul 15 11:02:32.575091 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:32.573958Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"152.36621ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jul 15 11:02:32.576414 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:32.574004Z","caller":"traceutil/trace.go:171","msg":"trace[1221160086] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:2059; }","duration":"152.411209ms","start":"2025-07-15T11:02:32.421579Z","end":"2025-07-15T11:02:32.573990Z","steps":["trace[1221160086] 'agreement among raft nodes before linearized reading' (duration: 152.332282ms)"],"step_count":1} Jul 15 11:02:32.576414 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:32.574286Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.287355468s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/stagednetworkpolicies/\" range_end:\"/registry/crd.projectcalico.org/stagednetworkpolicies0\" count_only:true ","response":"range_response_count:0 size:5"} Jul 15 11:02:32.576414 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:32.574352Z","caller":"traceutil/trace.go:171","msg":"trace[1193253062] range","detail":"{range_begin:/registry/crd.projectcalico.org/stagednetworkpolicies/; range_end:/registry/crd.projectcalico.org/stagednetworkpolicies0; response_count:0; response_revision:2059; }","duration":"2.287533081s","start":"2025-07-15T11:02:30.286786Z","end":"2025-07-15T11:02:32.574319Z","steps":["trace[1193253062] 'agreement among raft nodes before linearized reading' (duration: 2.287449295s)"],"step_count":1} Jul 15 11:02:32.576414 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:32.574435Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:30.286755Z","time spent":"2.287626187s","remote":"172.24.4.207:59442","response type":"/etcdserverpb.KV/Range","request count":0,"request size":114,"response count":0,"response size":29,"request content":"key:\"/registry/crd.projectcalico.org/stagednetworkpolicies/\" range_end:\"/registry/crd.projectcalico.org/stagednetworkpolicies0\" count_only:true "} Jul 15 11:02:33.172743 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:33.079787Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875177434,"retry-timeout":"500ms"} Jul 15 11:02:33.430909 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:33.429686Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"122.692861ms","expected-duration":"100ms","prefix":"","request":"header: lease_grant:","response":"size:41"} Jul 15 11:02:33.430909 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:33.429898Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:32.576121Z","time spent":"853.767327ms","remote":"172.24.4.207:54228","response type":"/etcdserverpb.Lease/LeaseGrant","request count":-1,"request size":-1,"response count":-1,"response size":-1,"request content":""} Jul 15 11:02:33.433331 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:33.431076Z","caller":"traceutil/trace.go:171","msg":"trace[422702334] linearizableReadLoop","detail":"{readStateIndex:2437; appliedIndex:2435; }","duration":"852.121943ms","start":"2025-07-15T11:02:32.578929Z","end":"2025-07-15T11:02:33.431051Z","steps":["trace[422702334] 'read index received' (duration: 728.100706ms)","trace[422702334] 'applied index is now lower than readState.Index' (duration: 124.020025ms)"],"step_count":2} Jul 15 11:02:33.433331 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:33.431395Z","caller":"traceutil/trace.go:171","msg":"trace[438505322] transaction","detail":"{read_only:false; number_of_response:0; response_revision:2059; }","duration":"828.980331ms","start":"2025-07-15T11:02:32.602369Z","end":"2025-07-15T11:02:33.431350Z","steps":["trace[438505322] 'process raft request' (duration: 828.534847ms)"],"step_count":1} Jul 15 11:02:33.433331 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:33.432717Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:32.602344Z","time spent":"830.279897ms","remote":"172.24.4.207:59328","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":29,"request content":"compare: success:> failure:<>"} Jul 15 11:02:33.434144 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:33.432363Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"853.377251ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/kube-system/kube-controller-manager-ci-4230-2-100-9439eb8d1a.novalocal\" limit:1 ","response":"range_response_count:1 size:7021"} Jul 15 11:02:33.435385 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:33.434349Z","caller":"traceutil/trace.go:171","msg":"trace[770625776] range","detail":"{range_begin:/registry/pods/kube-system/kube-controller-manager-ci-4230-2-100-9439eb8d1a.novalocal; range_end:; response_count:1; response_revision:2059; }","duration":"855.134496ms","start":"2025-07-15T11:02:32.578891Z","end":"2025-07-15T11:02:33.434026Z","steps":["trace[770625776] 'agreement among raft nodes before linearized reading' (duration: 852.692043ms)"],"step_count":1} Jul 15 11:02:33.435956 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:33.434612Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:32.578874Z","time spent":"855.707251ms","remote":"172.24.4.207:54350","response type":"/etcdserverpb.KV/Range","request count":0,"request size":89,"response count":1,"response size":7045,"request content":"key:\"/registry/pods/kube-system/kube-controller-manager-ci-4230-2-100-9439eb8d1a.novalocal\" limit:1 "} Jul 15 11:02:33.448555 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:33.446634Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"843.861831ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/events/kube-system/kube-apiserver-ci-4230-2-100-9439eb8d1a.novalocal.1852678576305dad\" limit:1 ","response":"range_response_count:1 size:905"} Jul 15 11:02:33.448555 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:33.446776Z","caller":"traceutil/trace.go:171","msg":"trace[340914998] range","detail":"{range_begin:/registry/events/kube-system/kube-apiserver-ci-4230-2-100-9439eb8d1a.novalocal.1852678576305dad; range_end:; response_count:1; response_revision:2060; }","duration":"844.071116ms","start":"2025-07-15T11:02:32.602641Z","end":"2025-07-15T11:02:33.446712Z","steps":["trace[340914998] 'agreement among raft nodes before linearized reading' (duration: 843.379674ms)"],"step_count":1} Jul 15 11:02:33.448555 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:33.446905Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:32.602622Z","time spent":"844.242345ms","remote":"172.24.4.207:54266","response type":"/etcdserverpb.KV/Range","request count":0,"request size":99,"response count":1,"response size":929,"request content":"key:\"/registry/events/kube-system/kube-apiserver-ci-4230-2-100-9439eb8d1a.novalocal.1852678576305dad\" limit:1 "} Jul 15 11:02:33.448555 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:33.446634Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"280.697112ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/validatingwebhookconfigurations/\" range_end:\"/registry/validatingwebhookconfigurations0\" count_only:true ","response":"range_response_count:0 size:5"} Jul 15 11:02:33.449754 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:33.447057Z","caller":"traceutil/trace.go:171","msg":"trace[1513726054] range","detail":"{range_begin:/registry/validatingwebhookconfigurations/; range_end:/registry/validatingwebhookconfigurations0; response_count:0; response_revision:2060; }","duration":"281.175291ms","start":"2025-07-15T11:02:33.165846Z","end":"2025-07-15T11:02:33.447014Z","steps":["trace[1513726054] 'agreement among raft nodes before linearized reading' (duration: 280.059218ms)"],"step_count":1} Jul 15 11:02:33.449754 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:33.447113Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"843.397388ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jul 15 11:02:33.449754 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:33.447298Z","caller":"traceutil/trace.go:171","msg":"trace[1906738443] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:2060; }","duration":"843.536885ms","start":"2025-07-15T11:02:32.603672Z","end":"2025-07-15T11:02:33.447209Z","steps":["trace[1906738443] 'agreement among raft nodes before linearized reading' (duration: 843.329203ms)"],"step_count":1} Jul 15 11:02:33.449754 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:33.447367Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:32.603658Z","time spent":"843.689057ms","remote":"172.24.4.207:54212","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":29,"request content":"key:\"/registry/health\" "} Jul 15 11:02:33.449754 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:33.447589Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"590.133733ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/namespaces/\" range_end:\"/registry/namespaces0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 11:02:33.451173 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:33.447646Z","caller":"traceutil/trace.go:171","msg":"trace[1852437220] range","detail":"{range_begin:/registry/namespaces/; range_end:/registry/namespaces0; response_count:0; response_revision:2060; }","duration":"590.22331ms","start":"2025-07-15T11:02:32.857407Z","end":"2025-07-15T11:02:33.447630Z","steps":["trace[1852437220] 'agreement among raft nodes before linearized reading' (duration: 590.023615ms)"],"step_count":1} Jul 15 11:02:33.451173 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:33.447718Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:32.857380Z","time spent":"590.297679ms","remote":"172.24.4.207:54288","response type":"/etcdserverpb.KV/Range","request count":0,"request size":48,"response count":7,"response size":31,"request content":"key:\"/registry/namespaces/\" range_end:\"/registry/namespaces0\" count_only:true "} Jul 15 11:02:33.733883 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:33.732167Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"180.948631ms","expected-duration":"100ms","prefix":"","request":"header: txn: success:> failure:<>>","response":"size:5"} Jul 15 11:02:33.733883 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:33.732442Z","caller":"traceutil/trace.go:171","msg":"trace[579024812] transaction","detail":"{read_only:false; number_of_response:0; response_revision:2062; }","duration":"201.414245ms","start":"2025-07-15T11:02:33.531005Z","end":"2025-07-15T11:02:33.732419Z","steps":["trace[579024812] 'compare' (duration: 180.870345ms)"],"step_count":1} Jul 15 11:02:34.770015 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:34.767738Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"100.663785ms","expected-duration":"100ms","prefix":"","request":"header: txn: success:> failure: >>","response":"size:16"} Jul 15 11:02:34.770015 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:34.768169Z","caller":"traceutil/trace.go:171","msg":"trace[1579560840] transaction","detail":"{read_only:false; response_revision:2064; number_of_response:1; }","duration":"413.44299ms","start":"2025-07-15T11:02:34.354684Z","end":"2025-07-15T11:02:34.768127Z","steps":["trace[1579560840] 'process raft request' (duration: 312.283213ms)","trace[1579560840] 'compare' (duration: 100.291186ms)"],"step_count":2} Jul 15 11:02:34.770015 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:34.768420Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:34.354644Z","time spent":"413.702734ms","remote":"172.24.4.207:54350","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":4476,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 11:02:34.771569 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:34.768615Z","caller":"traceutil/trace.go:171","msg":"trace[1059623412] transaction","detail":"{read_only:false; response_revision:2065; number_of_response:1; }","duration":"103.165092ms","start":"2025-07-15T11:02:34.665417Z","end":"2025-07-15T11:02:34.768582Z","steps":["trace[1059623412] 'process raft request' (duration: 102.560414ms)"],"step_count":1} Jul 15 11:02:34.771569 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:34.768722Z","caller":"traceutil/trace.go:171","msg":"trace[208662172] linearizableReadLoop","detail":"{readStateIndex:2444; appliedIndex:2443; }","duration":"103.561608ms","start":"2025-07-15T11:02:34.665139Z","end":"2025-07-15T11:02:34.768701Z","steps":["trace[208662172] 'read index received' (duration: 1.886489ms)","trace[208662172] 'applied index is now lower than readState.Index' (duration: 101.673266ms)"],"step_count":2} Jul 15 11:02:34.771569 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:34.769272Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"104.120586ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/mutatingwebhookconfigurations/\" range_end:\"/registry/mutatingwebhookconfigurations0\" count_only:true ","response":"range_response_count:0 size:5"} Jul 15 11:02:34.771569 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:34.769325Z","caller":"traceutil/trace.go:171","msg":"trace[452038467] range","detail":"{range_begin:/registry/mutatingwebhookconfigurations/; range_end:/registry/mutatingwebhookconfigurations0; response_count:0; response_revision:2065; }","duration":"104.179031ms","start":"2025-07-15T11:02:34.665131Z","end":"2025-07-15T11:02:34.769310Z","steps":["trace[452038467] 'agreement among raft nodes before linearized reading' (duration: 103.651124ms)"],"step_count":1} Jul 15 11:02:38.181979 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:38.180459Z","caller":"wal/wal.go:805","msg":"slow fdatasync","took":"3.472962671s","expected-duration":"1s"} Jul 15 11:02:38.181979 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:38.181087Z","caller":"traceutil/trace.go:171","msg":"trace[945949310] transaction","detail":"{read_only:false; response_revision:2066; number_of_response:1; }","duration":"3.473898665s","start":"2025-07-15T11:02:34.707156Z","end":"2025-07-15T11:02:38.181055Z","steps":["trace[945949310] 'process raft request' (duration: 3.473565807s)"],"step_count":1} Jul 15 11:02:38.183424 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:38.181408Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:34.707123Z","time spent":"3.474071697s","remote":"172.24.4.207:54266","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":763,"response count":0,"response size":40,"request content":"compare: success:> failure:<>"} Jul 15 11:02:38.355291 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:38.353203Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"157.451377ms","expected-duration":"100ms","prefix":"","request":"header: lease_revoke:","response":"size:29"} Jul 15 11:02:38.355291 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:38.353527Z","caller":"traceutil/trace.go:171","msg":"trace[568378526] linearizableReadLoop","detail":"{readStateIndex:2447; appliedIndex:2446; }","duration":"197.02869ms","start":"2025-07-15T11:02:38.156436Z","end":"2025-07-15T11:02:38.353465Z","steps":["trace[568378526] 'read index received' (duration: 25.033889ms)","trace[568378526] 'applied index is now lower than readState.Index' (duration: 171.991665ms)"],"step_count":2} Jul 15 11:02:38.355291 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:38.353901Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"197.442649ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/cronjobs/\" range_end:\"/registry/cronjobs0\" count_only:true ","response":"range_response_count:0 size:5"} Jul 15 11:02:38.355291 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:38.354010Z","caller":"traceutil/trace.go:171","msg":"trace[1220189129] range","detail":"{range_begin:/registry/cronjobs/; range_end:/registry/cronjobs0; response_count:0; response_revision:2066; }","duration":"197.618838ms","start":"2025-07-15T11:02:38.156370Z","end":"2025-07-15T11:02:38.353989Z","steps":["trace[1220189129] 'agreement among raft nodes before linearized reading' (duration: 197.208867ms)"],"step_count":1} Jul 15 11:02:38.355291 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:38.354031Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"187.371895ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/tiers/\" range_end:\"/registry/crd.projectcalico.org/tiers0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 11:02:38.356046 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:38.354094Z","caller":"traceutil/trace.go:171","msg":"trace[879870226] range","detail":"{range_begin:/registry/crd.projectcalico.org/tiers/; range_end:/registry/crd.projectcalico.org/tiers0; response_count:0; response_revision:2066; }","duration":"187.479217ms","start":"2025-07-15T11:02:38.166595Z","end":"2025-07-15T11:02:38.354074Z","steps":["trace[879870226] 'agreement among raft nodes before linearized reading' (duration: 187.348027ms)"],"step_count":1} Jul 15 11:02:38.356046 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:38.354351Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"183.614079ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"} Jul 15 11:02:38.356046 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:38.354398Z","caller":"traceutil/trace.go:171","msg":"trace[1199073598] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:2066; }","duration":"183.712795ms","start":"2025-07-15T11:02:38.170671Z","end":"2025-07-15T11:02:38.354384Z","steps":["trace[1199073598] 'agreement among raft nodes before linearized reading' (duration: 183.609951ms)"],"step_count":1} Jul 15 11:02:38.356046 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:38.354369Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"181.197247ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/roles/\" range_end:\"/registry/roles0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 11:02:38.356046 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:38.354469Z","caller":"traceutil/trace.go:171","msg":"trace[1231891605] range","detail":"{range_begin:/registry/roles/; range_end:/registry/roles0; response_count:0; response_revision:2066; }","duration":"181.327094ms","start":"2025-07-15T11:02:38.173122Z","end":"2025-07-15T11:02:38.354449Z","steps":["trace[1231891605] 'agreement among raft nodes before linearized reading' (duration: 181.085516ms)"],"step_count":1} Jul 15 11:02:43.663588 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:43.318087Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.291355316s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context deadline exceeded"} Jul 15 11:02:43.663588 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:43.318226Z","caller":"traceutil/trace.go:171","msg":"trace[994665093] range","detail":"{range_begin:/registry/health; range_end:; }","duration":"2.291556954s","start":"2025-07-15T11:02:41.026641Z","end":"2025-07-15T11:02:43.318198Z","steps":["trace[994665093] 'agreement among raft nodes before linearized reading' (duration: 2.29132175s)"],"step_count":1} Jul 15 11:02:43.663588 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:43.318302Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:41.026624Z","time spent":"2.291660058s","remote":"172.24.4.207:54212","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "} Jul 15 11:02:43.765554 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:43.764366Z","caller":"wal/wal.go:805","msg":"slow fdatasync","took":"2.69170818s","expected-duration":"1s"} Jul 15 11:02:43.768710 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:43.767230Z","caller":"traceutil/trace.go:171","msg":"trace[1101522407] transaction","detail":"{read_only:false; response_revision:2067; number_of_response:1; }","duration":"2.786116257s","start":"2025-07-15T11:02:40.981080Z","end":"2025-07-15T11:02:43.767196Z","steps":["trace[1101522407] 'process raft request' (duration: 2.783882878s)"],"step_count":1} Jul 15 11:02:43.768710 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:43.767747Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:40.981056Z","time spent":"2.786293928s","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":490,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 11:02:43.768710 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:43.767260Z","caller":"traceutil/trace.go:171","msg":"trace[1593226937] linearizableReadLoop","detail":"{readStateIndex:2449; appliedIndex:2447; }","duration":"2.785847636s","start":"2025-07-15T11:02:40.981363Z","end":"2025-07-15T11:02:43.767211Z","steps":["trace[1593226937] 'read index received' (duration: 92.66087ms)","trace[1593226937] 'applied index is now lower than readState.Index' (duration: 2.693185383s)"],"step_count":2} Jul 15 11:02:43.771986 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:43.768722Z","caller":"traceutil/trace.go:171","msg":"trace[672007337] transaction","detail":"{read_only:false; response_revision:2068; number_of_response:1; }","duration":"2.783632925s","start":"2025-07-15T11:02:40.985065Z","end":"2025-07-15T11:02:43.768698Z","steps":["trace[672007337] 'process raft request' (duration: 2.780864059s)"],"step_count":1} Jul 15 11:02:43.771986 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:43.768944Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:40.985044Z","time spent":"2.783749055s","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":699,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 11:02:43.771986 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:43.770544Z","caller":"traceutil/trace.go:171","msg":"trace[746769060] transaction","detail":"{read_only:false; response_revision:2069; number_of_response:1; }","duration":"2.752096118s","start":"2025-07-15T11:02:41.018418Z","end":"2025-07-15T11:02:43.770514Z","steps":["trace[746769060] 'process raft request' (duration: 2.748590828s)"],"step_count":1} Jul 15 11:02:43.772404 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:43.771078Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:41.018389Z","time spent":"2.75223881s","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":624,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 11:02:43.776343 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:43.775142Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"2.793739326s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/events/\" range_end:\"/registry/events0\" count_only:true ","response":"range_response_count:0 size:8"} Jul 15 11:02:43.776343 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:43.775292Z","caller":"traceutil/trace.go:171","msg":"trace[1035726472] range","detail":"{range_begin:/registry/events/; range_end:/registry/events0; response_count:0; response_revision:2069; }","duration":"2.793909122s","start":"2025-07-15T11:02:40.981357Z","end":"2025-07-15T11:02:43.775266Z","steps":["trace[1035726472] 'agreement among raft nodes before linearized reading' (duration: 2.785952133s)"],"step_count":1} Jul 15 11:02:43.776343 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:43.775433Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:40.981316Z","time spent":"2.794087503s","remote":"172.24.4.207:54724","response type":"/etcdserverpb.KV/Range","request count":0,"request size":40,"response count":332,"response size":32,"request content":"key:\"/registry/events/\" range_end:\"/registry/events0\" count_only:true "} Jul 15 11:02:43.786998 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:43.786356Z","caller":"traceutil/trace.go:171","msg":"trace[1715597446] transaction","detail":"{read_only:false; response_revision:2070; number_of_response:1; }","duration":"2.710826498s","start":"2025-07-15T11:02:41.075502Z","end":"2025-07-15T11:02:43.786329Z","steps":["trace[1715597446] 'process raft request' (duration: 2.710466217s)"],"step_count":1} Jul 15 11:02:43.788289 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:43.787440Z","caller":"traceutil/trace.go:171","msg":"trace[449559438] transaction","detail":"{read_only:false; response_revision:2071; number_of_response:1; }","duration":"2.700312141s","start":"2025-07-15T11:02:41.087101Z","end":"2025-07-15T11:02:43.787413Z","steps":["trace[449559438] 'process raft request' (duration: 2.699155437s)"],"step_count":1} Jul 15 11:02:43.788289 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:43.787611Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:41.087044Z","time spent":"2.700475583s","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":532,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 11:02:43.788963 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:43.787983Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:41.075469Z","time spent":"2.711928182s","remote":"172.24.4.207:54228","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":116,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 11:02:43.790048 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:43.788160Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"469.237152ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/default/test-pod-1\" limit:1 ","response":"range_response_count:1 size:3765"} Jul 15 11:02:43.790048 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:43.789222Z","caller":"traceutil/trace.go:171","msg":"trace[1539154405] range","detail":"{range_begin:/registry/pods/default/test-pod-1; range_end:; response_count:1; response_revision:2071; }","duration":"470.347815ms","start":"2025-07-15T11:02:43.318848Z","end":"2025-07-15T11:02:43.789196Z","steps":["trace[1539154405] 'agreement among raft nodes before linearized reading' (duration: 468.894426ms)"],"step_count":1} Jul 15 11:02:43.790775 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:43.789313Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:43.318784Z","time spent":"470.498001ms","remote":"172.24.4.207:54350","response type":"/etcdserverpb.KV/Range","request count":0,"request size":37,"response count":1,"response size":3789,"request content":"key:\"/registry/pods/default/test-pod-1\" limit:1 "} Jul 15 11:02:50.244316 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:44.556338Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875177481,"retry-timeout":"500ms"} Jul 15 11:02:50.244316 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:45.056988Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875177481,"retry-timeout":"500ms"} Jul 15 11:02:50.244316 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:45.557863Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875177481,"retry-timeout":"500ms"} Jul 15 11:02:50.244316 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:45.959506Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"1.999931267s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context deadline exceeded"} Jul 15 11:02:50.244316 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:45.959597Z","caller":"traceutil/trace.go:171","msg":"trace[210184602] range","detail":"{range_begin:/registry/health; range_end:; }","duration":"2.00005944s","start":"2025-07-15T11:02:43.959518Z","end":"2025-07-15T11:02:45.959577Z","steps":["trace[210184602] 'agreement among raft nodes before linearized reading' (duration: 1.99994284s)"],"step_count":1} Jul 15 11:02:50.244316 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:45.959784Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:43.959497Z","time spent":"2.00013541s","remote":"172.24.4.207:54212","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "} Jul 15 11:02:50.244316 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:46.058528Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875177481,"retry-timeout":"500ms"} Jul 15 11:02:50.246035 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:46.559266Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875177481,"retry-timeout":"500ms"} Jul 15 11:02:50.246035 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:47.060100Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875177481,"retry-timeout":"500ms"} Jul 15 11:02:50.246035 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:47.561305Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875177481,"retry-timeout":"500ms"} Jul 15 11:02:50.246035 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:48.062044Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875177481,"retry-timeout":"500ms"} Jul 15 11:02:50.246035 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:48.562767Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875177481,"retry-timeout":"500ms"} Jul 15 11:02:50.246035 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:49.063563Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875177481,"retry-timeout":"500ms"} Jul 15 11:02:50.246035 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:49.564027Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875177481,"retry-timeout":"500ms"} Jul 15 11:02:50.246035 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:50.064718Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875177481,"retry-timeout":"500ms"} Jul 15 11:02:50.301893 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:50.300332Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:43.959554Z","time spent":"6.340743366s","remote":"172.24.4.207:59328","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jul 15 11:02:54.830560 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:54.828184Z","caller":"etcdserver/v3_server.go:920","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587888131875177481,"retry-timeout":"500ms"} Jul 15 11:02:54.830560 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:54.828312Z","caller":"etcdserver/v3_server.go:932","msg":"timed out waiting for read index response (local node might have slow network)","timeout":"7s"} Jul 15 11:02:54.830560 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:54.829120Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:43.864556Z","time spent":"10.964545767s","remote":"172.24.4.207:54266","response type":"/etcdserverpb.KV/Txn","request count":0,"request size":0,"response count":0,"response size":0,"request content":""} Jul 15 11:02:54.830560 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:54.829304Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"4.510069781s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context deadline exceeded"} Jul 15 11:02:54.830560 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:54.829440Z","caller":"traceutil/trace.go:171","msg":"trace[1347767199] range","detail":"{range_begin:/registry/health; range_end:; }","duration":"4.510154496s","start":"2025-07-15T11:02:50.319178Z","end":"2025-07-15T11:02:54.829332Z","steps":["trace[1347767199] 'agreement among raft nodes before linearized reading' (duration: 4.51008498s)"],"step_count":1} Jul 15 11:02:54.830560 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:54.829486Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:50.319165Z","time spent":"4.510310212s","remote":"172.24.4.207:54212","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "} Jul 15 11:02:54.832096 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:54.829589Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"4.406148011s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"","error":"context deadline exceeded"} Jul 15 11:02:54.832096 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:54.829619Z","caller":"traceutil/trace.go:171","msg":"trace[981038877] range","detail":"{range_begin:/registry/health; range_end:; }","duration":"4.406264759s","start":"2025-07-15T11:02:50.423346Z","end":"2025-07-15T11:02:54.829610Z","steps":["trace[981038877] 'agreement among raft nodes before linearized reading' (duration: 4.406198509s)"],"step_count":1} Jul 15 11:02:54.832096 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:54.829646Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:50.423311Z","time spent":"4.406327122s","remote":"172.24.4.207:54214","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":0,"request content":"key:\"/registry/health\" "} Jul 15 11:02:54.993137 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:54.992674Z","caller":"wal/wal.go:805","msg":"slow fdatasync","took":"11.127886574s","expected-duration":"1s"} Jul 15 11:02:55.078477 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:55.076749Z","caller":"traceutil/trace.go:171","msg":"trace[137075464] transaction","detail":"{read_only:false; response_revision:2073; number_of_response:1; }","duration":"4.759021579s","start":"2025-07-15T11:02:50.317680Z","end":"2025-07-15T11:02:55.076702Z","steps":["trace[137075464] 'process raft request' (duration: 4.758481919s)"],"step_count":1} Jul 15 11:02:55.078477 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:55.076936Z","caller":"traceutil/trace.go:171","msg":"trace[1693425551] linearizableReadLoop","detail":"{readStateIndex:2457; appliedIndex:2453; }","duration":"248.548342ms","start":"2025-07-15T11:02:54.828368Z","end":"2025-07-15T11:02:55.076916Z","steps":["trace[1693425551] 'read index received' (duration: 165.133773ms)","trace[1693425551] 'applied index is now lower than readState.Index' (duration: 83.413666ms)"],"step_count":2} Jul 15 11:02:55.078477 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:55.077041Z","caller":"traceutil/trace.go:171","msg":"trace[837780083] transaction","detail":"{read_only:false; response_revision:2074; number_of_response:1; }","duration":"4.749670923s","start":"2025-07-15T11:02:50.327362Z","end":"2025-07-15T11:02:55.077033Z","steps":["trace[837780083] 'process raft request' (duration: 4.749034793s)"],"step_count":1} Jul 15 11:02:55.078477 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:55.077034Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:50.317631Z","time spent":"4.759270258s","remote":"172.24.4.207:54436","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":489,"response count":0,"response size":40,"request content":"compare: success:> failure: >"} Jul 15 11:02:55.078919 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:55.077114Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:50.327339Z","time spent":"4.749720831s","remote":"172.24.4.207:54266","response type":"/etcdserverpb.KV/Txn","request count":1,"request size":670,"response count":0,"response size":40,"request content":"compare: success:> failure:<>"} Jul 15 11:02:55.078919 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:55.077457Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"4.757898837s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/crd.projectcalico.org/bgpfilters/\" range_end:\"/registry/crd.projectcalico.org/bgpfilters0\" count_only:true ","response":"range_response_count:0 size:5"} Jul 15 11:02:55.078919 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:55.077490Z","caller":"traceutil/trace.go:171","msg":"trace[1583105832] range","detail":"{range_begin:/registry/crd.projectcalico.org/bgpfilters/; range_end:/registry/crd.projectcalico.org/bgpfilters0; response_count:0; response_revision:2074; }","duration":"4.757958645s","start":"2025-07-15T11:02:50.319522Z","end":"2025-07-15T11:02:55.077481Z","steps":["trace[1583105832] 'agreement among raft nodes before linearized reading' (duration: 4.757647643s)"],"step_count":1} Jul 15 11:02:55.078919 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:55.077540Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:50.319463Z","time spent":"4.758041889s","remote":"172.24.4.207:59470","response type":"/etcdserverpb.KV/Range","request count":0,"request size":92,"response count":0,"response size":29,"request content":"key:\"/registry/crd.projectcalico.org/bgpfilters/\" range_end:\"/registry/crd.projectcalico.org/bgpfilters0\" count_only:true "} Jul 15 11:02:55.079649 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:55.078546Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"4.777646574s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/replicasets/\" range_end:\"/registry/replicasets0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 11:02:55.079649 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:55.078624Z","caller":"traceutil/trace.go:171","msg":"trace[620788077] range","detail":"{range_begin:/registry/replicasets/; range_end:/registry/replicasets0; response_count:0; response_revision:2074; }","duration":"4.777772772s","start":"2025-07-15T11:02:50.300833Z","end":"2025-07-15T11:02:55.078605Z","steps":["trace[620788077] 'agreement among raft nodes before linearized reading' (duration: 4.776486275s)"],"step_count":1} Jul 15 11:02:55.079649 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:55.079332Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:50.300782Z","time spent":"4.777873601s","remote":"172.24.4.207:54658","response type":"/etcdserverpb.KV/Range","request count":0,"request size":50,"response count":10,"response size":31,"request content":"key:\"/registry/replicasets/\" range_end:\"/registry/replicasets0\" count_only:true "} Jul 15 11:02:55.080259 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:55.079794Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"4.76075983s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/certificatesigningrequests/\" range_end:\"/registry/certificatesigningrequests0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 11:02:55.080259 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:55.079895Z","caller":"traceutil/trace.go:171","msg":"trace[1620374381] range","detail":"{range_begin:/registry/certificatesigningrequests/; range_end:/registry/certificatesigningrequests0; response_count:0; response_revision:2074; }","duration":"4.760911397s","start":"2025-07-15T11:02:50.318967Z","end":"2025-07-15T11:02:55.079879Z","steps":["trace[1620374381] 'agreement among raft nodes before linearized reading' (duration: 4.760757785s)"],"step_count":1} Jul 15 11:02:55.080259 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:55.079953Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:50.318942Z","time spent":"4.760991955s","remote":"172.24.4.207:54424","response type":"/etcdserverpb.KV/Range","request count":0,"request size":80,"response count":2,"response size":31,"request content":"key:\"/registry/certificatesigningrequests/\" range_end:\"/registry/certificatesigningrequests0\" count_only:true "} Jul 15 11:02:55.080941 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:55.080269Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"4.777574675s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/flowschemas/\" range_end:\"/registry/flowschemas0\" count_only:true ","response":"range_response_count:0 size:7"} Jul 15 11:02:55.080941 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:55.080325Z","caller":"traceutil/trace.go:171","msg":"trace[426343173] range","detail":"{range_begin:/registry/flowschemas/; range_end:/registry/flowschemas0; response_count:0; response_revision:2074; }","duration":"4.777689972s","start":"2025-07-15T11:02:50.302623Z","end":"2025-07-15T11:02:55.080313Z","steps":["trace[426343173] 'agreement among raft nodes before linearized reading' (duration: 4.777595046s)"],"step_count":1} Jul 15 11:02:55.080941 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:55.080374Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2025-07-15T11:02:50.302608Z","time spent":"4.777751503s","remote":"172.24.4.207:54620","response type":"/etcdserverpb.KV/Range","request count":0,"request size":50,"response count":13,"response size":31,"request content":"key:\"/registry/flowschemas/\" range_end:\"/registry/flowschemas0\" count_only:true "} Jul 15 11:02:55.382445 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:55.381658Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"104.149335ms","expected-duration":"100ms","prefix":"","request":"header: txn: success:> failure:<>>","response":"size:16"} Jul 15 11:02:55.382872 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:55.381926Z","caller":"traceutil/trace.go:171","msg":"trace[169367006] transaction","detail":"{read_only:false; response_revision:2080; number_of_response:1; }","duration":"155.011291ms","start":"2025-07-15T11:02:55.226767Z","end":"2025-07-15T11:02:55.381778Z","steps":["trace[169367006] 'process raft request' (duration: 50.634779ms)","trace[169367006] 'compare' (duration: 103.946626ms)"],"step_count":2} Jul 15 11:02:55.388966 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:55.387505Z","caller":"traceutil/trace.go:171","msg":"trace[1720744236] linearizableReadLoop","detail":"{readStateIndex:2466; appliedIndex:2464; }","duration":"158.312506ms","start":"2025-07-15T11:02:55.229171Z","end":"2025-07-15T11:02:55.387484Z","steps":["trace[1720744236] 'read index received' (duration: 48.241218ms)","trace[1720744236] 'applied index is now lower than readState.Index' (duration: 110.070426ms)"],"step_count":2} Jul 15 11:02:55.388966 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:55.388261Z","caller":"traceutil/trace.go:171","msg":"trace[156086430] transaction","detail":"{read_only:false; response_revision:2081; number_of_response:1; }","duration":"159.989389ms","start":"2025-07-15T11:02:55.228259Z","end":"2025-07-15T11:02:55.388248Z","steps":["trace[156086430] 'process raft request' (duration: 159.028883ms)"],"step_count":1} Jul 15 11:02:55.389626 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:55.388608Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"159.40902ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/events/kube-system/kube-apiserver-ci-4230-2-100-9439eb8d1a.novalocal.1852678576305dad\" limit:1 ","response":"range_response_count:1 size:905"} Jul 15 11:02:55.389626 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:55.388786Z","caller":"traceutil/trace.go:171","msg":"trace[1598008549] range","detail":"{range_begin:/registry/events/kube-system/kube-apiserver-ci-4230-2-100-9439eb8d1a.novalocal.1852678576305dad; range_end:; response_count:1; response_revision:2081; }","duration":"159.625535ms","start":"2025-07-15T11:02:55.229150Z","end":"2025-07-15T11:02:55.388775Z","steps":["trace[1598008549] 'agreement among raft nodes before linearized reading' (duration: 159.256671ms)"],"step_count":1} Jul 15 11:02:55.389626 etcd-wrapper[1701]: {"level":"warn","ts":"2025-07-15T11:02:55.388865Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"159.549635ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/masterleases/\" range_end:\"/registry/masterleases0\" ","response":"range_response_count:1 size:131"} Jul 15 11:02:55.389626 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:55.389066Z","caller":"traceutil/trace.go:171","msg":"trace[1016483794] range","detail":"{range_begin:/registry/masterleases/; range_end:/registry/masterleases0; response_count:1; response_revision:2081; }","duration":"159.641065ms","start":"2025-07-15T11:02:55.229276Z","end":"2025-07-15T11:02:55.388917Z","steps":["trace[1016483794] 'agreement among raft nodes before linearized reading' (duration: 159.380824ms)"],"step_count":1} Jul 15 11:02:55.609451 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:55.607631Z","caller":"traceutil/trace.go:171","msg":"trace[357942550] transaction","detail":"{read_only:false; response_revision:2083; number_of_response:1; }","duration":"165.479895ms","start":"2025-07-15T11:02:55.442102Z","end":"2025-07-15T11:02:55.607582Z","steps":["trace[357942550] 'process raft request' (duration: 117.921901ms)","trace[357942550] 'compare' (duration: 47.004036ms)"],"step_count":2} Jul 15 11:02:55.609451 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:55.607644Z","caller":"traceutil/trace.go:171","msg":"trace[710334830] transaction","detail":"{read_only:false; response_revision:2084; number_of_response:1; }","duration":"153.573676ms","start":"2025-07-15T11:02:55.454040Z","end":"2025-07-15T11:02:55.607614Z","steps":["trace[710334830] 'process raft request' (duration: 153.298045ms)"],"step_count":1} Jul 15 11:02:55.803958 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:55.802652Z","caller":"traceutil/trace.go:171","msg":"trace[1866268692] transaction","detail":"{read_only:false; response_revision:2088; number_of_response:1; }","duration":"104.972011ms","start":"2025-07-15T11:02:55.697629Z","end":"2025-07-15T11:02:55.802601Z","steps":["trace[1866268692] 'process raft request' (duration: 62.763013ms)","trace[1866268692] 'compare' (duration: 41.663156ms)"],"step_count":2} Jul 15 11:02:55.993265 etcd-wrapper[1701]: {"level":"info","ts":"2025-07-15T11:02:55.992742Z","caller":"traceutil/trace.go:171","msg":"trace[2044626475] transaction","detail":"{read_only:false; response_revision:2093; number_of_response:1; }","duration":"119.977228ms","start":"2025-07-15T11:02:55.872734Z","end":"2025-07-15T11:02:55.992711Z","steps":["trace[2044626475] 'process raft request' (duration: 39.289932ms)","trace[2044626475] 'compare' (duration: 79.979896ms)"],"step_count":2}