Page MenuHomeVyOS Platform

vyos-network-event-logger crash prolongs shutdown/reboot times by 90 seconds
Open, NormalPublicBUG

Description

On shutdown/reboot, an uncaught exception in vyos-network-event-logger.service causes the python process to ignore systemd's SIGTERM, which leads to a wait period of 90 seconds before it is forcibly SIGKILLed. This makes reboots take 90 seconds longer than usual.

It seems to be related to PPPoE and/or some kind of systemd unit ordering dependency cycle that would normally ensure the condition(s) leading to the crash can't happen, and systemd itself deciding to shuffle things around leads to an unexpected shutdown order, which in turn confuses the network event logger?

Excerpt from the system logs with what I think are the relevant bits, the full log from the shutdown command to journald exit is attached as a file. Let me know if there's any more info you need.

Aug 19 16:37:24 r0 systemd-logind[904]: The system will reboot now!
Aug 19 16:37:24 r0 systemd-logind[904]: System is rebooting.
Aug 19 16:37:24 r0 systemd[1]: network.target: Found ordering cycle on chrony.service/stop
Aug 19 16:37:24 r0 systemd[1]: network.target: Found dependency on time-sync.target/stop
Aug 19 16:37:24 r0 systemd[1]: network.target: Found dependency on vyos-router.service/stop
Aug 19 16:37:24 r0 systemd[1]: network.target: Found dependency on frr.service/stop
Aug 19 16:37:24 r0 systemd[1]: network.target: Found dependency on network.target/stop
Aug 19 16:37:24 r0 systemd[1]: network.target: Job chrony.service/stop deleted to break ordering cycle starting with network.target/stop
Aug 19 16:37:24 r0 systemd[1]: Stopping Dialing PPP connection pppoe0...
Aug 19 16:37:24 r0 pppd[2880]: Script /etc/ppp/ip-down started (pid 16009)
Aug 19 16:37:24 r0 systemd[1]: Stopping VyOS network-event logger daemon...
Aug 19 16:37:24 r0 pppd[2880]: Script /etc/ppp/ipv6-down started (pid 16011)
Aug 19 16:37:24 r0 pppd[2880]: sent [LCP TermReq id=0x2 "User request"]
Aug 19 16:37:24 r0 vyos-network-event-logger[4469]: Unexpected error: <class 'ConnectionResetError'> [Errno 104] Connection reset by peer [{'family': 2, 'prefixlen': 32, 'flags': 128, 'scope': 0, 'index': 16, 'at
trs': [('IFA_ADDRESS', 'x.x.x.x'), ('IFA_LOCAL', 'x.x.x.x'), ('IFA_LABEL', 'pppoe0'), ('IFA_FLAGS', 128), ('IFA_CACHEINFO', {'ifa_preferred': 4294967295, 'ifa_valid': 4294967295, 'cstamp': 6811, 'tsta
mp': 6811})], 'header': {'length': 80, 'type': 21, 'flags': 0, 'sequence_number': 0, 'pid': 0, 'error': None, 'target': 'localhost', 'stats': Stats(qsize=3, delta=3, delay=0)}, 'event': 'RTM_DELADDR'}]
Aug 19 16:37:24 r0 pppd[2880]: Script /etc/ppp/ipv6-down finished (pid 16011), status = 0x0
Aug 19 16:37:24 r0 pppd[2880]: rcvd [LCP TermAck id=0x2]
Aug 19 16:37:24 r0 pppd[2880]: Connection terminated.
Aug 19 16:37:24 r0 pppd[2880]: Connect time 82.7 minutes.
Aug 19 16:37:24 r0 pppd[2880]: Sent 5351306 bytes, received 10292216 bytes.
Aug 19 16:37:24 r0 pppd[2880]: Waiting for 1 child processes...
Aug 19 16:37:24 r0 pppd[2880]:   script /etc/ppp/ip-down, pid 16009
Aug 19 16:37:24 r0 vyos-network-event-logger[4413]: IPRoute socket closed.
Aug 19 16:37:24 r0 pppd[2880]: Script /etc/ppp/ip-down finished (pid 16009), status = 0x0
Aug 19 16:37:24 r0 pppd[2880]: Exit.
Aug 19 16:37:24 r0 systemd[1]: ppp@pppoe0.service: Main process exited, code=exited, status=5/NOTINSTALLED
Aug 19 16:37:24 r0 systemd[1]: ppp@pppoe0.service: Failed with result 'exit-code'.
Aug 19 16:37:24 r0 systemd[1]: Stopped Dialing PPP connection pppoe0.
Aug 19 16:37:24 r0 systemd[1]: ppp@pppoe0.service: Consumed 4.667s CPU time.
Aug 19 16:37:24 r0 systemd[1]: Removed slice Slice /system/ppp.
Aug 19 16:37:24 r0 systemd[1]: system-ppp.slice: Consumed 4.667s CPU time.

[Elevator music playing]

Aug 19 16:38:54 r0 systemd[1]: vyos-network-event-logger.service: State 'stop-sigterm' timed out. Killing.
Aug 19 16:38:54 r0 systemd[1]: vyos-network-event-logger.service: Killing process 4413 (python3) with signal SIGKILL.
Aug 19 16:38:54 r0 systemd[1]: vyos-network-event-logger.service: Main process exited, code=killed, status=9/KILL
Aug 19 16:38:54 r0 systemd[1]: vyos-network-event-logger.service: Failed with result 'timeout'.
Aug 19 16:38:54 r0 systemd[1]: Stopped VyOS network-event logger daemon.
Aug 19 16:38:54 r0 systemd[1]: vyos-network-event-logger.service: Consumed 35.395s CPU time.
Aug 19 16:38:54 r0 systemd[1]: Stopped target VyOS target.

System information:

pngu@r0:~$ show version
Version:          VyOS 2026.03
Release train:    circinus
Release flavor:   generic

Built by:         autobuild@vyos.net
Built on:         Wed 18 Mar 2026 20:03 UTC
Build UUID:       3969e1c7-a4bb-459a-ac7f-54749c153d21
Build commit ID:  1cac4fd63750b0

Architecture:     x86_64
Boot via:         installed image
System type:      KVM guest

Hardware vendor:  QEMU
Hardware model:   Standard PC (Q35 + ICH9, 2009)
Hardware S/N:
Hardware UUID:    dfb30887-66a7-4291-9929-70d1c4863bcb

Copyright:        VyOS maintainers and contributors

Details

Version
2026.03
Is it a breaking change?
Unspecified (possibly destroys the router)
Issue type
Bug (incorrect behavior)