When update from 1.5-rolling-202312310026 to a newer version, NHRP dont start on reboot
Description
Description
Details
Details
- Difficulty level
- Unknown (require assessment)
- Version
- 1.5-rolling-202401010026 and subsequent versions
- Why the issue appeared?
- Will be filled on close
- Is it a breaking change?
- Behavior change
- Issue type
- Feature/functionality removal
Related Objects
Related Objects
Event Timeline
Comment Actions
I'm seeing this on 1.4 as well, dockerized build 1.4-rolling-202401061915), configured following https://docs.vyos.io/en/sagitta/configuration/vpn/dmvpn.html with no other protocols/services.
$ show configuration commands set interfaces dummy dum0 address '172.20.128.1/32' set interfaces ethernet eth0 address 'removed/23' set interfaces ethernet eth0 address 'removed/64' set interfaces ethernet eth0 ipv6 address autoconf set interfaces loopback lo set interfaces tunnel tun100 address '172.20.8.1/24' set interfaces tunnel tun100 enable-multicast set interfaces tunnel tun100 encapsulation 'gre' set interfaces tunnel tun100 parameters ip key '1' set interfaces tunnel tun100 source-address 'removed' set protocols nhrp tunnel tun100 cisco-authentication 'removed' set protocols nhrp tunnel tun100 holding-time '60' set protocols nhrp tunnel tun100 multicast 'dynamic' set protocols nhrp tunnel tun100 redirect set protocols nhrp tunnel tun100 shortcut set protocols static route 0.0.0.0/0 next-hop removed set service ntp server us.pool.ntp.org set service ssh disable-password-authentication set service ssh listen-address '0.0.0.0' set service ssh listen-address '::' set system config-management commit-revisions '100' set system conntrack modules ftp set system conntrack modules h323 set system conntrack modules nfs set system conntrack modules pptp set system conntrack modules sip set system conntrack modules sqlnet set system conntrack modules tftp set system host-name 'removed' set system login ... set system syslog global facility all level 'info' set system syslog global facility local7 level 'debug' set system time-zone 'America/New_York' set vpn ipsec esp-group ESP-HUB lifetime '1800' set vpn ipsec esp-group ESP-HUB mode 'transport' set vpn ipsec esp-group ESP-HUB pfs 'dh-group2' set vpn ipsec esp-group ESP-HUB proposal 1 encryption 'aes256' set vpn ipsec esp-group ESP-HUB proposal 1 hash 'sha384' set vpn ipsec ike-group IKE-HUB close-action 'hold' set vpn ipsec ike-group IKE-HUB dead-peer-detection action 'restart' set vpn ipsec ike-group IKE-HUB dead-peer-detection interval '3' set vpn ipsec ike-group IKE-HUB dead-peer-detection timeout '30' set vpn ipsec ike-group IKE-HUB key-exchange 'ikev2' set vpn ipsec ike-group IKE-HUB lifetime '3600' set vpn ipsec ike-group IKE-HUB proposal 1 dh-group '2' set vpn ipsec ike-group IKE-HUB proposal 1 encryption 'aes256' set vpn ipsec ike-group IKE-HUB proposal 1 hash 'sha256' set vpn ipsec interface 'eth0' set vpn ipsec profile NHRPVPN authentication mode 'pre-shared-secret' set vpn ipsec profile NHRPVPN authentication pre-shared-secret 'removed' set vpn ipsec profile NHRPVPN bind tunnel 'tun100' set vpn ipsec profile NHRPVPN esp-group 'ESP-HUB' set vpn ipsec profile NHRPVPN ike-group 'IKE-HUB' $ show log nhrp Jan 14 21:35:47 systemd[1]: Starting opennhrp.service - OpenNHRP... Jan 14 21:35:47 opennhrp[1841]: opennhrp[1841]: OpenNHRP 0.14-20-g613277f starting Jan 14 21:35:47 opennhrp[1841]: OpenNHRP 0.14-20-g613277f starting Jan 14 21:35:47 opennhrp[1841]: opennhrp[1841]: Interface lo: configured UP, mtu=0 Jan 14 21:35:47 opennhrp[1841]: Interface lo: configured UP, mtu=0 Jan 14 21:35:47 opennhrp[1841]: opennhrp[1841]: Interface eth0: configured UP, mtu=1500 Jan 14 21:35:47 opennhrp[1841]: opennhrp[1841]: Interface pim6reg: configured UP, mtu=1452 Jan 14 21:35:47 opennhrp[1841]: opennhrp[1841]: Interface dum0: configured UP, mtu=1500 Jan 14 21:35:47 opennhrp[1841]: Interface eth0: configured UP, mtu=1500 Jan 14 21:35:47 opennhrp[1841]: Interface pim6reg: configured UP, mtu=1452 Jan 14 21:35:47 opennhrp[1841]: Interface dum0: configured UP, mtu=1500 Jan 14 21:35:47 opennhrp[1841]: opennhrp[1841]: Interface gre0: config change, mtu=1476 Jan 14 21:35:47 opennhrp[1841]: opennhrp[1841]: Interface gretap0: config change, mtu=1462 Jan 14 21:35:47 opennhrp[1841]: opennhrp[1841]: Interface erspan0: config change, mtu=1450 Jan 14 21:35:47 opennhrp[1841]: opennhrp[1841]: Interface tun100: configured UP, mtu=1476 Jan 14 21:35:47 opennhrp[1841]: opennhrp[1841]: Interface tun100: GRE configuration changed. Purged 0 peers. Jan 14 21:35:47 opennhrp[1841]: opennhrp[1841]: Adding local 172.20.8.1/32 dev tun100 Jan 14 21:35:47 opennhrp[1841]: opennhrp[1841]: Adding local 172.20.8.255/32 alias 172.20.8.1 dev tun100 Jan 14 21:35:47 opennhrp[1841]: Interface gre0: config change, mtu=1476 Jan 14 21:35:47 opennhrp[1841]: Interface gretap0: config change, mtu=1462 Jan 14 21:35:47 opennhrp[1841]: Interface erspan0: config change, mtu=1450 Jan 14 21:35:47 opennhrp[1841]: Interface tun100: configured UP, mtu=1476 Jan 14 21:35:47 opennhrp[1841]: Interface tun100: GRE configuration changed. Purged 0 peers. Jan 14 21:35:47 opennhrp[1841]: Adding local 172.20.8.1/32 dev tun100 Jan 14 21:35:47 opennhrp[1841]: Adding local 172.20.8.255/32 alias 172.20.8.1 dev tun100 Jan 14 21:35:47 opennhrp[1841]: opennhrp[1841]: Filter code installed (21 opcodes) Jan 14 21:35:47 systemd[1]: opennhrp.service: Failed to parse PID from file /run/opennhrp/opennhrp.pid: Invalid argument Jan 14 21:35:47 opennhrp[1841]: Filter code installed (21 opcodes) Jan 14 21:35:47 opennhrp[1848]: Interface tun100: config change, mtu=1476 Jan 14 21:35:47 systemd[1]: Started opennhrp.service - OpenNHRP. Jan 14 21:35:48 opennhrp-script.py[1845]: Running script with arguments: ['/etc/opennhrp/opennhrp-script.py', 'interface-up'], environment: environ({'NHRP_TYPE': 'INTERFACE', 'NHRP_INTERFACE': 'dum0', 'NHRP_GRE_KEY': '0', 'LC_CTYPE': 'C.UTF-8'}) Jan 14 21:35:48 opennhrp-script.py[1843]: Running script with arguments: ['/etc/opennhrp/opennhrp-script.py', 'interface-up'], environment: environ({'NHRP_TYPE': 'INTERFACE', 'NHRP_INTERFACE': 'eth0', 'NHRP_GRE_KEY': '0', 'LC_CTYPE': 'C.UTF-8'}) Jan 14 21:35:48 opennhrp-script.py[1842]: Running script with arguments: ['/etc/opennhrp/opennhrp-script.py', 'interface-up'], environment: environ({'NHRP_TYPE': 'INTERFACE', 'NHRP_INTERFACE': 'lo', 'NHRP_GRE_KEY': '0', 'LC_CTYPE': 'C.UTF-8'}) Jan 14 21:35:48 opennhrp-script.py[1842]: Interface lo is not NHRP tunnel Jan 14 21:35:48 opennhrp-script.py[1846]: Running script with arguments: ['/etc/opennhrp/opennhrp-script.py', 'interface-up'], environment: environ({'NHRP_TYPE': 'INTERFACE', 'NHRP_INTERFACE': 'tun100', 'NHRP_GRE_KEY': '0', 'LC_CTYPE': 'C.UTF-8'}) Jan 14 21:35:48 opennhrp-script.py[1846]: Turning up interface tun100 Jan 14 21:35:48 opennhrp-script.py[1845]: Interface dum0 is not NHRP tunnel Jan 14 21:35:48 opennhrp-script.py[1843]: Interface eth0 is not NHRP tunnel Jan 14 21:35:48 opennhrp-script.py[1844]: Running script with arguments: ['/etc/opennhrp/opennhrp-script.py', 'interface-up'], environment: environ({'NHRP_TYPE': 'INTERFACE', 'NHRP_INTERFACE': 'pim6reg', 'NHRP_GRE_KEY': '0', 'LC_CTYPE': 'C.UTF-8'}) Jan 14 21:35:48 opennhrp-script.py[1844]: Interface pim6reg is not NHRP tunnel Jan 14 21:35:48 sudo[1859]: root : PWD=/ ; USER=root ; COMMAND=/usr/sbin/ip route flush proto 42 dev tun100 Jan 14 21:35:48 sudo[1859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=0) Jan 14 21:35:48 sudo[1859]: pam_unix(sudo:session): session closed for user root Jan 14 21:35:48 sudo[1861]: root : PWD=/ ; USER=root ; COMMAND=/usr/sbin/ip neigh flush dev tun100 Jan 14 21:35:48 sudo[1861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=0) Jan 14 21:35:48 sudo[1861]: pam_unix(sudo:session): session closed for user root Jan 14 21:35:50 opennhrp[1848]: Interface xfrmi-test-3090: config change, mtu=1500 Jan 14 21:35:50 opennhrp[1848]: Interface xfrmi-test-3090: configured UP, mtu=1500 Jan 14 21:35:50 opennhrp[1848]: Interface xfrmi-test-3090: config change, mtu=1500 Jan 14 21:35:50 opennhrp[1848]: Interface 'xfrmi-test-3090' deleted Jan 14 21:35:50 opennhrp-script.py[2029]: Running script with arguments: ['/etc/opennhrp/opennhrp-script.py', 'interface-up'], environment: environ({'NHRP_TYPE': 'INTERFACE', 'NHRP_INTERFACE': 'xfrmi-test-3090', 'NHRP_GRE_KEY': '0', 'LC_CTYPE': 'C.UTF-8'}) Jan 14 21:35:50 opennhrp-script.py[2029]: Interface xfrmi-test-3090 is not NHRP tunnel Jan 14 21:35:50 systemd[1]: Stopping opennhrp.service - OpenNHRP... Jan 14 21:35:50 opennhrp[1848]: Removing local 172.20.8.255/32 alias 172.20.8.1 dev tun100 up Jan 14 21:35:50 opennhrp[1848]: Removing local 172.20.8.1/32 dev tun100 up Jan 14 21:35:50 systemd[1]: opennhrp.service: Deactivated successfully. Jan 14 21:35:50 systemd[1]: Stopped opennhrp.service - OpenNHRP.
Comment Actions
With the same config:
IMAGE: 1.5-rolling-202312310026 (starts OK)
$ sh log nhrp Jan 15 08:25:48 systemd[1]: Starting opennhrp.service - OpenNHRP... Jan 15 08:25:48 opennhrp[2688]: opennhrp[2688]: OpenNHRP 0.14-20-g613277f starting Jan 15 08:25:48 opennhrp[2688]: opennhrp[2688]: Adding static ******* nbma ******* dev tun100 Jan 15 08:25:48 opennhrp[2688]: opennhrp[2688]: Adding static ****** nbma ******* dev tun100 Jan 15 08:25:48 opennhrp[2688]: opennhrp[2688]: Interface lo: configured UP, mtu=0 Jan 15 08:25:48 opennhrp[2688]: opennhrp[2688]: Interface eth0: configured UP, mtu=1500 Jan 15 08:25:48 opennhrp[2688]: opennhrp[2688]: Interface eth1: configured UP, mtu=1500 Jan 15 08:25:48 opennhrp[2688]: opennhrp[2688]: Interface eth2: configured UP, mtu=1500 Jan 15 08:25:48 opennhrp[2688]: opennhrp[2688]: Interface pim6reg: configured UP, mtu=1452 Jan 15 08:25:48 opennhrp[2688]: opennhrp[2688]: Interface gre0: config change, mtu=1476 Jan 15 08:25:48 opennhrp[2688]: opennhrp[2688]: Interface gretap0: config change, mtu=1462 Jan 15 08:25:48 opennhrp[2688]: opennhrp[2688]: Interface erspan0: config change, mtu=1450 Jan 15 08:25:48 opennhrp[2688]: opennhrp[2688]: Interface tun100: configured UP, mtu=1476 Jan 15 08:25:48 opennhrp[2688]: opennhrp[2688]: Interface tun100: GRE configuration changed. Purged 2 peers. Jan 15 08:25:48 opennhrp[2688]: opennhrp[2688]: Adding local ******* dev tun100 Jan 15 08:25:48 opennhrp[2688]: opennhrp[2688]: Adding local ******* alias ******* dev tun100 Jan 15 08:25:48 opennhrp[2688]: opennhrp[2688]: Adding local-route ****** nexthop ****** dev tun100 Jan 15 08:25:48 opennhrp[2688]: opennhrp[2688]: Filter code installed (21 opcodes) Jan 15 08:25:48 systemd[1]: opennhrp.service: Failed to parse PID from file /run/opennhrp/opennhrp.pid: Invalid argument Jan 15 08:25:48 opennhrp[2688]: OpenNHRP 0.14-20-g613277f starting Jan 15 08:25:48 systemd[1]: Started opennhrp.service - OpenNHRP. Jan 15 08:25:48 opennhrp[2688]: Adding static ******* nbma ******* dev tun100 Jan 15 08:25:48 opennhrp[2688]: Adding static ****** nbma ******* dev tun100 Jan 15 08:25:48 opennhrp[2688]: Interface lo: configured UP, mtu=0 Jan 15 08:25:48 opennhrp[2688]: Interface eth0: configured UP, mtu=1500 Jan 15 08:25:48 opennhrp[2688]: Interface eth1: configured UP, mtu=1500 Jan 15 08:25:48 opennhrp[2688]: Interface eth2: configured UP, mtu=1500 Jan 15 08:25:48 opennhrp[2688]: Interface pim6reg: configured UP, mtu=1452 Jan 15 08:25:48 opennhrp[2688]: Interface gre0: config change, mtu=1476 Jan 15 08:25:48 opennhrp[2688]: Interface gretap0: config change, mtu=1462 Jan 15 08:25:48 opennhrp[2688]: Interface erspan0: config change, mtu=1450 Jan 15 08:25:48 opennhrp[2688]: Interface tun100: configured UP, mtu=1476 Jan 15 08:25:48 opennhrp[2688]: Interface tun100: GRE configuration changed. Purged 2 peers. Jan 15 08:25:48 opennhrp[2688]: Adding local ******* dev tun100 Jan 15 08:25:48 opennhrp[2688]: Adding local ******* alias ******* dev tun100 Jan 15 08:25:48 opennhrp[2688]: Adding local-route ****** nexthop ****** dev tun100 Jan 15 08:25:48 opennhrp[2688]: Filter code installed (21 opcodes) Jan 15 08:25:48 opennhrp[2697]: Interface tun100: config change, mtu=1476 Jan 15 08:25:48 opennhrp-script.py[2694]: Running script with arguments: ['/etc/opennhrp/opennhrp-script.py', 'interface-up'], environment: environ({'NHRP_TYPE': 'INTERFACE', 'NHRP_INTERFACE': 'pim6reg', 'NHRP_GRE_KEY': '0', 'LC_CTYPE': 'C.UTF-8'}) Jan 15 08:25:48 opennhrp-script.py[2694]: Interface pim6reg is not NHRP tunnel Jan 15 08:25:48 opennhrp-script.py[2693]: Running script with arguments: ['/etc/opennhrp/opennhrp-script.py', 'interface-up'], environment: environ({'NHRP_TYPE': 'INTERFACE', 'NHRP_INTERFACE': 'eth2', 'NHRP_GRE_KEY': '0', 'LC_CTYPE': 'C.UTF-8'}) Jan 15 08:25:48 opennhrp-script.py[2693]: Interface eth2 is not NHRP tunnel Jan 15 08:25:48 opennhrp-script.py[2690]: Running script with arguments: ['/etc/opennhrp/opennhrp-script.py', 'interface-up'], environment: environ({'NHRP_TYPE': 'INTERFACE', 'NHRP_INTERFACE': 'lo', 'NHRP_GRE_KEY': '0', 'LC_CTYPE': 'C.UTF-8'}) Jan 15 08:25:48 opennhrp-script.py[2690]: Interface lo is not NHRP tunnel Jan 15 08:25:48 opennhrp-script.py[2692]: Running script with arguments: ['/etc/opennhrp/opennhrp-script.py', 'interface-up'], environment: environ({'NHRP_TYPE': 'INTERFACE', 'NHRP_INTERFACE': 'eth1', 'NHRP_GRE_KEY': '0', 'LC_CTYPE': 'C.UTF-8'}) Jan 15 08:25:48 opennhrp-script.py[2692]: Interface eth1 is not NHRP tunnel Jan 15 08:25:48 opennhrp-script.py[2691]: Running script with arguments: ['/etc/opennhrp/opennhrp-script.py', 'interface-up'], environment: environ({'NHRP_TYPE': 'INTERFACE', 'NHRP_INTERFACE': 'eth0', 'NHRP_GRE_KEY': '0', 'LC_CTYPE': 'C.UTF-8'}) Jan 15 08:25:48 opennhrp-script.py[2691]: Interface eth0 is not NHRP tunnel Jan 15 08:25:48 opennhrp-script.py[2695]: Running script with arguments: ['/etc/opennhrp/opennhrp-script.py', 'interface-up'], environment: environ({'NHRP_TYPE': 'INTERFACE', 'NHRP_INTERFACE': 'tun100', 'NHRP_GRE_KEY': '0', 'LC_CTYPE': 'C.UTF-8'}) Jan 15 08:25:48 opennhrp-script.py[2695]: Turning up interface tun100 Jan 15 08:25:48 sudo[2723]: root : PWD=/ ; USER=root ; COMMAND=/usr/sbin/ip route flush proto 42 dev tun100 Jan 15 08:25:48 sudo[2723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=0) Jan 15 08:25:48 sudo[2723]: pam_unix(sudo:session): session closed for user root Jan 15 08:25:48 sudo[2726]: root : PWD=/ ; USER=root ; COMMAND=/usr/sbin/ip neigh flush dev tun100 Jan 15 08:25:48 sudo[2726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=0) Jan 15 08:25:48 sudo[2726]: pam_unix(sudo:session): session closed for user root Jan 15 08:25:48 systemd[1]: Starting opennhrp.service - OpenNHRP... Jan 15 08:25:48 opennhrp[2688]: opennhrp[2688]: OpenNHRP 0.14-20-g613277f starting Jan 15 08:25:48 opennhrp[2688]: opennhrp[2688]: Adding static ******* nbma ******* dev tun100 Jan 15 08:25:48 opennhrp[2688]: opennhrp[2688]: Adding static ****** nbma ******* dev tun100 Jan 15 08:25:48 opennhrp[2688]: opennhrp[2688]: Interface lo: configured UP, mtu=0 Jan 15 08:25:48 opennhrp[2688]: opennhrp[2688]: Interface eth0: configured UP, mtu=1500 Jan 15 08:25:48 opennhrp[2688]: opennhrp[2688]: Interface eth1: configured UP, mtu=1500 Jan 15 08:25:48 opennhrp[2688]: opennhrp[2688]: Interface eth2: configured UP, mtu=1500 Jan 15 08:25:48 opennhrp[2688]: opennhrp[2688]: Interface pim6reg: configured UP, mtu=1452 Jan 15 08:25:48 opennhrp[2688]: opennhrp[2688]: Interface gre0: config change, mtu=1476 Jan 15 08:25:48 opennhrp[2688]: opennhrp[2688]: Interface gretap0: config change, mtu=1462 Jan 15 08:25:48 opennhrp[2688]: opennhrp[2688]: Interface erspan0: config change, mtu=1450 Jan 15 08:25:48 opennhrp[2688]: opennhrp[2688]: Interface tun100: configured UP, mtu=1476 Jan 15 08:25:48 opennhrp[2688]: opennhrp[2688]: Interface tun100: GRE configuration changed. Purged 2 peers. Jan 15 08:25:48 opennhrp[2688]: opennhrp[2688]: Adding local ******* dev tun100 Jan 15 08:25:48 opennhrp[2688]: opennhrp[2688]: Adding local ******* alias ******* dev tun100 Jan 15 08:25:48 opennhrp[2688]: opennhrp[2688]: Adding local-route ****** nexthop ****** dev tun100 Jan 15 08:25:48 opennhrp[2688]: opennhrp[2688]: Filter code installed (21 opcodes) Jan 15 08:25:48 systemd[1]: opennhrp.service: Failed to parse PID from file /run/opennhrp/opennhrp.pid: Invalid argument Jan 15 08:25:48 opennhrp[2688]: OpenNHRP 0.14-20-g613277f starting Jan 15 08:25:48 systemd[1]: Started opennhrp.service - OpenNHRP. Jan 15 08:25:48 opennhrp[2688]: Adding static ******* nbma ******* dev tun100 Jan 15 08:25:48 opennhrp[2688]: Adding static ****** nbma ******* dev tun100 Jan 15 08:25:48 opennhrp[2688]: Interface lo: configured UP, mtu=0 Jan 15 08:25:48 opennhrp[2688]: Interface eth0: configured UP, mtu=1500 Jan 15 08:25:48 opennhrp[2688]: Interface eth1: configured UP, mtu=1500 Jan 15 08:25:48 opennhrp[2688]: Interface eth2: configured UP, mtu=1500 Jan 15 08:25:48 opennhrp[2688]: Interface pim6reg: configured UP, mtu=1452 Jan 15 08:25:48 opennhrp[2688]: Interface gre0: config change, mtu=1476 Jan 15 08:25:48 opennhrp[2688]: Interface gretap0: config change, mtu=1462 Jan 15 08:25:48 opennhrp[2688]: Interface erspan0: config change, mtu=1450 Jan 15 08:25:48 opennhrp[2688]: Interface tun100: configured UP, mtu=1476 Jan 15 08:25:48 opennhrp[2688]: Interface tun100: GRE configuration changed. Purged 2 peers. Jan 15 08:25:48 opennhrp[2688]: Adding local ******* dev tun100 Jan 15 08:25:48 opennhrp[2688]: Adding local ******* alias ******* dev tun100 Jan 15 08:25:48 opennhrp[2688]: Adding local-route ****** nexthop ****** dev tun100 Jan 15 08:25:48 opennhrp[2688]: Filter code installed (21 opcodes) Jan 15 08:25:48 opennhrp[2697]: Interface tun100: config change, mtu=1476 Jan 15 08:25:48 opennhrp-script.py[2694]: Running script with arguments: ['/etc/opennhrp/opennhrp-script.py', 'interface-up'], environment: environ({'NHRP_TYPE': 'INTERFACE', 'NHRP_INTERFACE': 'pim6reg', 'NHRP_GRE_KEY': '0', 'LC_CTYPE': 'C.UTF-8'}) Jan 15 08:25:48 opennhrp-script.py[2694]: Interface pim6reg is not NHRP tunnel Jan 15 08:25:48 opennhrp-script.py[2693]: Running script with arguments: ['/etc/opennhrp/opennhrp-script.py', 'interface-up'], environment: environ({'NHRP_TYPE': 'INTERFACE', 'NHRP_INTERFACE': 'eth2', 'NHRP_GRE_KEY': '0', 'LC_CTYPE': 'C.UTF-8'}) Jan 15 08:25:48 opennhrp-script.py[2693]: Interface eth2 is not NHRP tunnel Jan 15 08:25:48 opennhrp-script.py[2690]: Running script with arguments: ['/etc/opennhrp/opennhrp-script.py', 'interface-up'], environment: environ({'NHRP_TYPE': 'INTERFACE', 'NHRP_INTERFACE': 'lo', 'NHRP_GRE_KEY': '0', 'LC_CTYPE': 'C.UTF-8'}) Jan 15 08:25:48 opennhrp-script.py[2690]: Interface lo is not NHRP tunnel Jan 15 08:25:48 opennhrp-script.py[2692]: Running script with arguments: ['/etc/opennhrp/opennhrp-script.py', 'interface-up'], environment: environ({'NHRP_TYPE': 'INTERFACE', 'NHRP_INTERFACE': 'eth1', 'NHRP_GRE_KEY': '0', 'LC_CTYPE': 'C.UTF-8'}) Jan 15 08:25:48 opennhrp-script.py[2692]: Interface eth1 is not NHRP tunnel Jan 15 08:25:48 opennhrp-script.py[2691]: Running script with arguments: ['/etc/opennhrp/opennhrp-script.py', 'interface-up'], environment: environ({'NHRP_TYPE': 'INTERFACE', 'NHRP_INTERFACE': 'eth0', 'NHRP_GRE_KEY': '0', 'LC_CTYPE': 'C.UTF-8'}) Jan 15 08:25:48 opennhrp-script.py[2691]: Interface eth0 is not NHRP tunnel Jan 15 08:25:48 opennhrp-script.py[2695]: Running script with arguments: ['/etc/opennhrp/opennhrp-script.py', 'interface-up'], environment: environ({'NHRP_TYPE': 'INTERFACE', 'NHRP_INTERFACE': 'tun100', 'NHRP_GRE_KEY': '0', 'LC_CTYPE': 'C.UTF-8'}) Jan 15 08:25:48 opennhrp-script.py[2695]: Turning up interface tun100 Jan 15 08:25:48 sudo[2723]: root : PWD=/ ; USER=root ; COMMAND=/usr/sbin/ip route flush proto 42 dev tun100 Jan 15 08:25:48 sudo[2723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=0) Jan 15 08:25:48 sudo[2723]: pam_unix(sudo:session): session closed for user root Jan 15 08:25:48 sudo[2726]: root : PWD=/ ; USER=root ; COMMAND=/usr/sbin/ip neigh flush dev tun100 Jan 15 08:25:48 sudo[2726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=0) Jan 15 08:25:48 sudo[2726]: pam_unix(sudo:session): session closed for user root
IMAGE: 1.5-rolling-202401150027 (dont start on reboot)
$ sh log nhrp Jan 15 08:36:21 systemd[1]: Starting opennhrp.service - OpenNHRP... Jan 15 08:36:21 opennhrp[2948]: opennhrp[2948]: OpenNHRP 0.14-20-g613277f starting Jan 15 08:36:21 opennhrp[2948]: opennhrp[2948]: Adding static ******** nbma ******** dev tun100 Jan 15 08:36:21 opennhrp[2948]: opennhrp[2948]: Adding static ******** nbma ******** dev tun100 Jan 15 08:36:21 opennhrp[2948]: OpenNHRP 0.14-20-g613277f starting Jan 15 08:36:21 opennhrp[2948]: Adding static ******** nbma ******** dev tun100 Jan 15 08:36:21 opennhrp[2948]: Adding static ******** nbma ******** dev tun100 Jan 15 08:36:21 opennhrp[2948]: opennhrp[2948]: Interface lo: configured UP, mtu=0 Jan 15 08:36:21 opennhrp[2948]: Interface lo: configured UP, mtu=0 Jan 15 08:36:21 opennhrp[2948]: opennhrp[2948]: Interface eth0: configured UP, mtu=1500 Jan 15 08:36:21 opennhrp[2948]: Interface eth0: configured UP, mtu=1500 Jan 15 08:36:21 opennhrp[2948]: opennhrp[2948]: Interface eth1: configured UP, mtu=1500 Jan 15 08:36:21 opennhrp[2948]: opennhrp[2948]: Interface eth2: configured UP, mtu=1500 Jan 15 08:36:21 opennhrp[2948]: opennhrp[2948]: Interface pim6reg: configured UP, mtu=1452 Jan 15 08:36:21 opennhrp[2948]: opennhrp[2948]: Interface gre0: config change, mtu=1476 Jan 15 08:36:21 opennhrp[2948]: opennhrp[2948]: Interface gretap0: config change, mtu=1462 Jan 15 08:36:21 opennhrp[2948]: opennhrp[2948]: Interface erspan0: config change, mtu=1450 Jan 15 08:36:21 opennhrp[2948]: opennhrp[2948]: Interface tun100: configured UP, mtu=1476 Jan 15 08:36:21 opennhrp[2948]: opennhrp[2948]: Interface tun100: GRE configuration changed. Purged 2 peers. Jan 15 08:36:21 opennhrp[2948]: opennhrp[2948]: Adding local ******** dev tun100 Jan 15 08:36:21 opennhrp[2948]: opennhrp[2948]: Adding local ******** alias ******** dev tun100 Jan 15 08:36:21 opennhrp[2948]: opennhrp[2948]: Adding local-route ******** nexthop ******** dev tun100 Jan 15 08:36:21 opennhrp[2948]: opennhrp[2948]: Filter code installed (21 opcodes) Jan 15 08:36:21 opennhrp[2948]: Interface eth1: configured UP, mtu=1500 Jan 15 08:36:21 opennhrp[2948]: Interface eth2: configured UP, mtu=1500 Jan 15 08:36:21 opennhrp[2948]: Interface pim6reg: configured UP, mtu=1452 Jan 15 08:36:21 opennhrp[2948]: Interface gre0: config change, mtu=1476 Jan 15 08:36:21 opennhrp[2948]: Interface gretap0: config change, mtu=1462 Jan 15 08:36:21 opennhrp[2948]: Interface erspan0: config change, mtu=1450 Jan 15 08:36:21 opennhrp[2948]: Interface tun100: configured UP, mtu=1476 Jan 15 08:36:21 opennhrp[2948]: Interface tun100: GRE configuration changed. Purged 2 peers. Jan 15 08:36:21 opennhrp[2948]: Adding local ******** dev tun100 Jan 15 08:36:21 opennhrp[2948]: Adding local ******** alias ******** dev tun100 Jan 15 08:36:21 opennhrp[2948]: Adding local-route ******** nexthop ******** dev tun100 Jan 15 08:36:21 opennhrp[2948]: Filter code installed (21 opcodes) Jan 15 08:36:21 systemd[1]: opennhrp.service: Failed to parse PID from file /run/opennhrp/opennhrp.pid: Invalid argument Jan 15 08:36:21 opennhrp[2956]: Interface tun100: config change, mtu=1476 Jan 15 08:36:21 systemd[1]: Started opennhrp.service - OpenNHRP. Jan 15 08:36:21 opennhrp-script.py[2954]: Running script with arguments: ['/etc/opennhrp/opennhrp-script.py', 'interface-up'], environment: environ({'NHRP_TYPE': 'INTERFACE', 'NHRP_INTERFACE': 'tun100', 'NHRP_GRE_KEY': '0', 'LC_CTYPE': 'C.UTF-8'}) Jan 15 08:36:21 opennhrp-script.py[2954]: Turning up interface tun100 Jan 15 08:36:21 opennhrp-script.py[2950]: Running script with arguments: ['/etc/opennhrp/opennhrp-script.py', 'interface-up'], environment: environ({'NHRP_TYPE': 'INTERFACE', 'NHRP_INTERFACE': 'eth0', 'NHRP_GRE_KEY': '0', 'LC_CTYPE': 'C.UTF-8'}) Jan 15 08:36:21 opennhrp-script.py[2952]: Running script with arguments: ['/etc/opennhrp/opennhrp-script.py', 'interface-up'], environment: environ({'NHRP_TYPE': 'INTERFACE', 'NHRP_INTERFACE': 'eth2', 'NHRP_GRE_KEY': '0', 'LC_CTYPE': 'C.UTF-8'}) Jan 15 08:36:21 opennhrp-script.py[2952]: Interface eth2 is not NHRP tunnel Jan 15 08:36:21 opennhrp-script.py[2953]: Running script with arguments: ['/etc/opennhrp/opennhrp-script.py', 'interface-up'], environment: environ({'NHRP_TYPE': 'INTERFACE', 'NHRP_INTERFACE': 'pim6reg', 'NHRP_GRE_KEY': '0', 'LC_CTYPE': 'C.UTF-8'}) Jan 15 08:36:21 opennhrp-script.py[2953]: Interface pim6reg is not NHRP tunnel Jan 15 08:36:21 opennhrp-script.py[2951]: Running script with arguments: ['/etc/opennhrp/opennhrp-script.py', 'interface-up'], environment: environ({'NHRP_TYPE': 'INTERFACE', 'NHRP_INTERFACE': 'eth1', 'NHRP_GRE_KEY': '0', 'LC_CTYPE': 'C.UTF-8'}) Jan 15 08:36:21 opennhrp-script.py[2951]: Interface eth1 is not NHRP tunnel Jan 15 08:36:21 opennhrp-script.py[2950]: Interface eth0 is not NHRP tunnel Jan 15 08:36:21 opennhrp-script.py[2949]: Running script with arguments: ['/etc/opennhrp/opennhrp-script.py', 'interface-up'], environment: environ({'NHRP_TYPE': 'INTERFACE', 'NHRP_INTERFACE': 'lo', 'NHRP_GRE_KEY': '0', 'LC_CTYPE': 'C.UTF-8'}) Jan 15 08:36:21 opennhrp-script.py[2949]: Interface lo is not NHRP tunnel Jan 15 08:36:21 sudo[2983]: root : PWD=/ ; USER=root ; COMMAND=/usr/sbin/ip route flush proto 42 dev tun100 Jan 15 08:36:21 sudo[2983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=0) Jan 15 08:36:21 sudo[2983]: pam_unix(sudo:session): session closed for user root Jan 15 08:36:21 sudo[2985]: root : PWD=/ ; USER=root ; COMMAND=/usr/sbin/ip neigh flush dev tun100 Jan 15 08:36:21 sudo[2985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=0) Jan 15 08:36:21 sudo[2985]: pam_unix(sudo:session): session closed for user root Jan 15 08:36:22 opennhrp[2956]: Multicast from ******** to 224.0.0.9 Jan 15 08:36:22 opennhrp[2956]: Multicast from ******** to 224.0.0.22 Jan 15 08:36:22 opennhrp[2956]: Multicast from ******** to 224.0.0.22 Jan 15 08:36:23 opennhrp[2956]: NL-ARP(tun100) who-has ******** Jan 15 08:36:23 opennhrp[2956]: Adding incomplete ********/32 dev tun100 Jan 15 08:36:23 opennhrp[2956]: Sending Resolution Request to ******** Jan 15 08:36:23 opennhrp[2956]: NL-ARP(tun100) who-has ******** Jan 15 08:36:23 opennhrp[2956]: Adding incomplete ********/32 dev tun100 Jan 15 08:36:23 opennhrp[2956]: Sending Resolution Request to ******** Jan 15 08:36:23 opennhrp[2956]: NL-ARP(tun100) who-has ******** Jan 15 08:36:23 opennhrp[2956]: Adding incomplete ********/32 dev tun100 Jan 15 08:36:23 opennhrp[2956]: Sending Resolution Request to ******** Jan 15 08:36:23 opennhrp[2956]: NL-ARP(tun100) who-has ******** Jan 15 08:36:23 opennhrp[2956]: Adding incomplete ********/32 dev tun100 Jan 15 08:36:23 opennhrp[2956]: Sending Resolution Request to ******** Jan 15 08:36:23 opennhrp[2956]: NL-ARP(tun100) who-has ******** Jan 15 08:36:23 opennhrp[2956]: Adding incomplete ********/32 dev tun100 Jan 15 08:36:23 opennhrp[2956]: Sending Resolution Request to ******** Jan 15 08:36:23 opennhrp[2956]: NL-ARP(tun100) who-has ******** Jan 15 08:36:23 opennhrp[2956]: NL-ARP(tun100) who-has ******** Jan 15 08:36:23 opennhrp[2956]: Multicast from ******** to 224.0.0.9 Jan 15 08:36:23 opennhrp[2956]: Interface xfrmi-test-6366: config change, mtu=1500 Jan 15 08:36:23 opennhrp[2956]: Interface xfrmi-test-6366: configured UP, mtu=1500 Jan 15 08:36:23 opennhrp[2956]: Interface xfrmi-test-6366: config change, mtu=1500 Jan 15 08:36:23 opennhrp[2956]: Interface 'xfrmi-test-6366' deleted Jan 15 08:36:23 opennhrp-script.py[3149]: Running script with arguments: ['/etc/opennhrp/opennhrp-script.py', 'interface-up'], environment: environ({'NHRP_TYPE': 'INTERFACE', 'NHRP_INTERFACE': 'xfrmi-test-6366', 'NHRP_GRE_KEY': '0', 'LC_CTYPE': 'C.UTF-8'}) Jan 15 08:36:23 opennhrp-script.py[3149]: Interface xfrmi-test-6366 is not NHRP tunnel Jan 15 08:36:23 systemd[1]: Stopping opennhrp.service - OpenNHRP... Jan 15 08:36:23 opennhrp[2956]: Removing local ******** alias ******** dev tun100 up Jan 15 08:36:23 opennhrp[2956]: Removing local ********/32 dev tun100 up Jan 15 08:36:23 opennhrp[2956]: Removing incomplete ********/32 dev tun100 Jan 15 08:36:23 opennhrp[2956]: Removing incomplete ********/32 dev tun100 Jan 15 08:36:23 opennhrp[2956]: Removing incomplete ********/32 dev tun100 Jan 15 08:36:23 opennhrp[2956]: Removing incomplete ********/32 dev tun100 Jan 15 08:36:23 opennhrp[2956]: Removing incomplete ********/32 dev tun100 Jan 15 08:36:23 opennhrp[2956]: Removing local-route ******** nexthop ******** dev tun100 up Jan 15 08:36:23 opennhrp[2956]: Removing static ******** nbma ******** dev tun100 Jan 15 08:36:23 opennhrp[2956]: Removing static ******** nbma ******** dev tun100 Jan 15 08:36:23 opennhrp[2956]: Failed to install filter code: Bad file descriptor Jan 15 08:36:28 opennhrp[2956]: Sending packet 1, from: ******** (nbma (unspecified)), to: ******** (nbma ********) Jan 15 08:36:28 opennhrp[2956]: Sending packet 1, from: ******** (nbma (unspecified)), to: ******** (nbma ********) Jan 15 08:36:28 opennhrp[2956]: Sending packet 1, from: ******** (nbma (unspecified)), to: ******** (nbma ********) Jan 15 08:36:28 opennhrp[2956]: Sending packet 1, from: ******** (nbma (unspecified)), to: ******** (nbma ********) Jan 15 08:36:28 opennhrp[2956]: Sending packet 1, from: ******** (nbma (unspecified)), to: ******** (nbma ********) Jan 15 08:36:29 opennhrp[2956]: Waiting for peers to die, 7 left Jan 15 08:36:33 opennhrp[2956]: Sending packet 1, from: ******** (nbma (unspecified)), to: ******** (nbma ********) Jan 15 08:36:33 opennhrp[2956]: Sending packet 1, from: ******** (nbma (unspecified)), to: ******** (nbma ********) Jan 15 08:36:33 opennhrp[2956]: Sending packet 1, from: ******** (nbma (unspecified)), to: ******** (nbma ********) Jan 15 08:36:33 opennhrp[2956]: Sending packet 1, from: ******** (nbma (unspecified)), to: ******** (nbma ********) Jan 15 08:36:33 opennhrp[2956]: Sending packet 1, from: ******** (nbma (unspecified)), to: ******** (nbma ********) Jan 15 08:36:38 opennhrp[2956]: Sending packet 1, from: ******** (nbma (unspecified)), to: ******** (nbma ********) Jan 15 08:36:38 opennhrp[2956]: Sending packet 1, from: ******** (nbma (unspecified)), to: ******** (nbma ********) Jan 15 08:36:38 opennhrp[2956]: Sending packet 1, from: ******** (nbma (unspecified)), to: ******** (nbma ********) Jan 15 08:36:38 opennhrp[2956]: Sending packet 1, from: ******** (nbma (unspecified)), to: ******** (nbma ********) Jan 15 08:36:38 opennhrp[2956]: Sending packet 1, from: ******** (nbma (unspecified)), to: ******** (nbma ********) Jan 15 08:36:38 opennhrp[2956]: Waiting for peers to die, 7 left Jan 15 08:36:43 opennhrp[2956]: Sending packet 1, from: ******** (nbma (unspecified)), to: ******** (nbma ********) Jan 15 08:36:43 opennhrp[2956]: Sending packet 1, from: ******** (nbma (unspecified)), to: ******** (nbma ********) Jan 15 08:36:43 opennhrp[2956]: Sending packet 1, from: ******** (nbma (unspecified)), to: ******** (nbma ********) Jan 15 08:36:43 opennhrp[2956]: Sending packet 1, from: ******** (nbma (unspecified)), to: ******** (nbma ********) Jan 15 08:36:43 opennhrp[2956]: Sending packet 1, from: ******** (nbma (unspecified)), to: ******** (nbma ********) Jan 15 08:36:46 opennhrp[2956]: Waiting for peers to die, 7 left Jan 15 08:36:48 opennhrp[2956]: Sending packet 1, from: ******** (nbma (unspecified)), to: ******** (nbma ********) Jan 15 08:36:48 opennhrp[2956]: Sending packet 1, from: ******** (nbma (unspecified)), to: ******** (nbma ********) Jan 15 08:36:48 opennhrp[2956]: Sending packet 1, from: ******** (nbma (unspecified)), to: ******** (nbma ********) Jan 15 08:36:48 opennhrp[2956]: Sending packet 1, from: ******** (nbma (unspecified)), to: ******** (nbma ********) Jan 15 08:36:48 opennhrp[2956]: Sending packet 1, from: ******** (nbma (unspecified)), to: ******** (nbma ********) Jan 15 08:36:53 opennhrp[2956]: NL-ARP(tun100) ******** not-reachable Jan 15 08:36:53 opennhrp[2956]: NL-ARP(tun100) ******** not-reachable Jan 15 08:36:53 systemd[1]: opennhrp.service: Deactivated successfully. Jan 15 08:36:53 systemd[1]: Stopped opennhrp.service - OpenNHRP. $ sh nhrp tunnel OpenNHRP is not running.
Comment Actions
I was unable to duplicate the behavior with 1.4.0-rc1. Performed add system image https://cdn.vyos.io/1.4.0-rc1/vyos-1.4.0-rc1-amd64.iso) with above configuration, and nhrp came up on reboot. So it's common to 1.4 and 1.5, but only since sometime in December (post rc1)?
Comment Actions
With 1.4.0-rc1 All OK, came up on reboot:
$ sh ver Version: VyOS 1.4.0-rc1 ......... ......... $ sh nhrp tunnel Status: ok
Comment Actions
1.4.0-rc2 also has opennhrp service stop after vyos startup. Can you please add a 1.4 tag to this issue?
Comment Actions
Using the same router/config I noted previously, I see an "empty" config per T6084.
admin@removed# cat /run/opennhrp/opennhrp.conf # Created by VyOS - manual changes will be overwritten
I then modified the nhrp vyos config and saved, and the opennhrp.conf was re-populated. Upon reboot, the file reverted to "empty".
Comment Actions
works with version 1.5-rolling-202403050022
But:
when interfaces came up opennhrp starts:
...
Mar 05 08:43:45 systemd[1]: Started opennhrp.service - OpenNHRP.
...
Mar 05 08:43:45 opennhrp-script.py[2689]: Running script with arguments: ['/etc/opennhrp/opennhrp-script.py', 'interface-up'], environment: environ({'NHRP_TYPE': 'INTERFACE', 'NHRP_INTERFACE': 'tun100', 'NHRP_GRE_KEY': '0', 'LC_CTYPE': 'C.UTF-8'})
Mar 05 08:43:45 opennhrp-script.py[2689]: Turning up interface tun100
...Then xfrmi-test appears, and opennhrp stops
...
Mar 05 08:43:48 opennhrp[2691]: Interface xfrmi-test-1246: config change, mtu=1500
Mar 05 08:43:48 opennhrp[2691]: Interface xfrmi-test-1246: configured UP, mtu=1500
Mar 05 08:43:48 opennhrp[2691]: Interface xfrmi-test-1246: config change, mtu=1500
Mar 05 08:43:48 opennhrp[2691]: Interface 'xfrmi-test-1246' deleted
Mar 05 08:43:48 opennhrp-script.py[2886]: Running script with arguments: ['/etc/opennhrp/opennhrp-script.py', 'interface-up'], environment: environ({'NHRP_TYPE': 'INTERFACE', 'NHRP_INTERFACE': 'xfrmi-test-1246', 'NHRP_GRE_KEY': '0', 'LC_CTYPE': 'C.UTF-8'})
Mar 05 08:43:48 opennhrp-script.py[2886]: Interface xfrmi-test-1246 is not NHRP tunnel
Mar 05 08:43:48 systemd[1]: Stopping opennhrp.service - OpenNHRP...
Mar 05 08:43:48 opennhrp[2691]: Removing local *********** alias *********** dev tun100 up
Mar 05 08:43:48 opennhrp[2691]: Removing local *********** dev tun100 up
Mar 05 08:43:48 opennhrp[2691]: Removing ***********
Mar 05 08:43:48 opennhrp[2691]: Removing ***********
Mar 05 08:43:48 opennhrp[2691]: Removing ***********
Mar 05 08:43:48 opennhrp[2691]: Removing ***********
Mar 05 08:43:48 opennhrp[2691]: Removing ***********
Mar 05 08:43:48 opennhrp[2691]: Removing static ***********
Mar 05 08:43:48 opennhrp[2691]: Removing static ***********
Mar 05 08:44:17 systemd[1]: opennhrp.service: Deactivated successfully.
Mar 05 08:44:17 systemd[1]: Stopped opennhrp.service - OpenNHRP.And then opennhrp re-starts
Mar 05 08:44:17 opennhrp[3051]: opennhrp[3051]: OpenNHRP 0.14-20-g613277f starting ... ... ...
And then everything is correct
$ sh nhrp tunnel Status: ok
Thank you
Comment Actions
Working on 1.4-rolling. Thanks for the awesome work.
admin@removed:~$ show system image Name Default boot Running ------------------------ -------------- --------- 1.4-rolling-202403092332 Yes Yes admin@removed:~$ show nhrp tunnel Status: ok