Page MenuHomeVyOS Platform
Create Task
Maniphest T7244

VPP crashes if using VPP/non-VPP interfaces for OSPF MPLS
Closed, ResolvedPublicBUG
Actions

Description

VPP crashes if using VPP/non-VPP interfaces for OSPF MPLS
Topology

mpls-ospf.png (704×627 px, 53 KB)

The wan-vpp configuration:

set interfaces ethernet eth0 address '10.0.0.254/24'
set interfaces ethernet eth0 description 'Switch1'
set interfaces ethernet eth1 address '10.0.1.1/30'
set interfaces ethernet eth1 description 'Link-to-wan-right'
set interfaces ethernet eth2 address '10.0.4.1/30'
set interfaces ethernet eth2 description 'r4'
set interfaces loopback lo
set protocols mpls interface 'eth0'
set protocols mpls interface 'eth1'
set protocols mpls interface 'eth2'
set protocols mpls ldp discovery transport-ipv4-address '100.64.0.254'
set protocols mpls ldp interface 'eth0'
set protocols mpls ldp interface 'lo'
set protocols mpls ldp interface 'eth1'
set protocols mpls ldp interface 'eth2'
set protocols mpls ldp router-id '100.64.0.254'
set protocols ospf interface eth0 area '0'
set protocols ospf interface eth1 area '0'
set protocols ospf interface eth2 area '0'
set protocols ospf interface vpptun0 area '0'
set system host-name 'wan-vpp'
set system login user vyos authentication plaintext-password ''
set vpp interfaces loopback lo0 kernel-interface 'vpptun0'
set vpp kernel-interfaces vpptun0 address '100.64.0.254/32'
set vpp settings interface eth0 driver 'dpdk'
set vpp settings interface eth1 driver 'dpdk'
set vpp settings unix poll-sleep-usec '120'

wan-right config:

set interfaces ethernet eth0 address '10.0.4.6/30'
set interfaces ethernet eth0 description 'Link-to-r4'
set interfaces ethernet eth1 address '10.0.1.2/30'
set interfaces ethernet eth1 description 'Link-to-wan-vpp'
set interfaces ethernet eth2 address '10.0.3.1/30'
set interfaces ethernet eth2 description 'Link-to-r3'
set interfaces loopback lo address '100.64.0.253/32'
set protocols mpls interface 'eth0'
set protocols mpls interface 'eth2'
set protocols mpls interface 'eth1'
set protocols mpls ldp discovery transport-ipv4-address '100.64.0.253'
set protocols mpls ldp interface 'eth0'
set protocols mpls ldp interface 'lo'
set protocols mpls ldp interface 'eth1'
set protocols mpls ldp interface 'eth2'
set protocols mpls ldp router-id '100.64.0.253'
set protocols ospf interface eth0 area '0'
set protocols ospf interface eth1 area '0'
set protocols ospf interface eth2 area '0'
set protocols ospf interface lo area '0'
set protocols ospf parameters router-id '100.64.0.253'
set system host-name 'wan-right'

r1 config:

set interfaces ethernet eth0 address '10.0.0.1/24'
set interfaces loopback lo address '100.64.0.1/32'
set protocols mpls interface 'eth0'
set protocols mpls ldp discovery transport-ipv4-address '100.64.0.1'
set protocols mpls ldp interface 'eth0'
set protocols mpls ldp interface 'lo'
set protocols mpls ldp router-id '100.64.0.1'
set protocols ospf interface eth0 area '0'
set protocols ospf interface lo area '0'
set protocols ospf parameters router-id '100.64.0.1'
set system host-name 'r1'

r2 config:

set interfaces ethernet eth0 address '10.0.0.2/24'
set interfaces loopback lo address '100.64.0.2/32'
set protocols mpls interface 'eth0'
set protocols mpls ldp discovery transport-ipv4-address '100.64.0.2'
set protocols mpls ldp interface 'eth0'
set protocols mpls ldp interface 'lo'
set protocols mpls ldp router-id '100.64.0.2'
set protocols ospf interface eth0 area '0'
set protocols ospf interface lo area '0'
set protocols ospf parameters router-id '100.64.0.2'
set system host-name 'r2'

r3 config:

set interfaces ethernet eth0 address '10.0.0.3/24'
set interfaces ethernet eth0 description 'Switch1'
set interfaces ethernet eth1 address '10.0.3.2/30'
set interfaces ethernet eth1 description 'wan-right'
set interfaces loopback lo address '100.64.0.3/32'
set protocols mpls interface 'eth0'
set protocols mpls interface 'eth1'
set protocols mpls ldp discovery transport-ipv4-address '100.64.0.3'
set protocols mpls ldp interface 'eth0'
set protocols mpls ldp interface 'lo'
set protocols mpls ldp interface 'eth1'
set protocols mpls ldp router-id '100.64.0.3'
set protocols ospf interface eth0 area '0'
set protocols ospf interface eth1 area '0'
set protocols ospf interface lo area '0'
set protocols ospf parameters router-id '100.64.0.3'
set system host-name 'r3'

r4 config:

set interfaces ethernet eth0 address '10.0.4.5/30'
set interfaces ethernet eth0 description 'wan-right'
set interfaces ethernet eth1 address '10.0.4.2/30'
set interfaces ethernet eth1 description 'wan-vpp'
set interfaces loopback lo address '100.64.0.4/32'
set protocols mpls interface 'eth0'
set protocols mpls interface 'eth1'
set protocols mpls ldp discovery transport-ipv4-address '100.64.0.4'
set protocols mpls ldp interface 'eth0'
set protocols mpls ldp interface 'lo'
set protocols mpls ldp interface 'eth1'
set protocols mpls ldp router-id '100.64.0.4'
set protocols ospf interface eth0 area '0'
set protocols ospf interface eth1 area '0'
set protocols ospf interface lo area '0'
set protocols ospf parameters router-id '100.64.0.4'
set system host-name 'r4'

The interface eth2 on the wan-vpp node is a regular Interface (without VPP)
After loading OSPF and state full, we have VPP crash (interfaces eth0/eth1) disappears from the system

vyos@wan-vpp:~$ show int
Codes: S - State, L - Link, u - Up, D - Down, A - Admin Down
Interface    IP Address     MAC                VRF        MTU  S/L    Description
-----------  -------------  -----------------  -------  -----  -----  -----------------
eth0         10.0.0.254/24  0c:65:9d:44:00:00  default   1500  u/D    Switch1
eth1         10.0.1.1/30    0c:65:9d:44:00:01  default   1500  u/D    Link-to-wan-right
eth2         10.0.4.1/30    0c:65:9d:44:00:02  default   1500  u/u    r4
eth3         -              0c:65:9d:44:00:03  default   1500  u/D
eth4         -              0c:65:9d:44:00:04  default   1500  u/D
lo           127.0.0.1/8    00:00:00:00:00:00  default  65536  u/u
             ::1/128
vyos@wan-vpp:~$ 
vyos@wan-vpp:~$ show ip ospf neighbor 

Neighbor ID     Pri State           Up Time         Dead Time Address         Interface                        RXmtL RqstL DBsmL
100.64.0.4        1 Loading/DR      2.745s            30.902s 10.0.4.2        eth2:10.0.4.1                        0     1     0

vyos@wan-vpp:~$ 
vyos@wan-vpp:~$ 
vyos@wan-vpp:~$ show ip ospf neighbor 

Neighbor ID     Pri State           Up Time         Dead Time Address         Interface                        RXmtL RqstL DBsmL
100.64.0.4        1 Full/DR         3.831s            34.816s 10.0.4.2        eth2:10.0.4.1                        1     0     0

vyos@wan-vpp:~$ 
vyos@wan-vpp:~$ 
vyos@wan-vpp:~$ show ip ospf neighbor 

Neighbor ID     Pri State           Up Time         Dead Time Address         Interface                        RXmtL RqstL DBsmL
100.64.0.4        1 Full/DR         7.489s            31.158s 10.0.4.2        eth2:10.0.4.1                        0     0     0

vyos@wan-vpp:~$ 
vyos@wan-vpp:~$ show int
Codes: S - State, L - Link, u - Up, D - Down, A - Admin Down
Interface    IP Address    MAC                VRF        MTU  S/L    Description
-----------  ------------  -----------------  -------  -----  -----  -------------
eth2         10.0.4.1/30   0c:65:9d:44:00:02  default   1500  u/u    r4
eth3         -             0c:65:9d:44:00:03  default   1500  u/D
eth4         -             0c:65:9d:44:00:04  default   1500  u/D
lo           127.0.0.1/8   00:00:00:00:00:00  default  65536  u/u
             ::1/128
vyos@wan-vpp:~$

Details

Version
VyOS 2025.03.12-1116-rolling
Is it a breaking change?
Unspecified (possibly destroys the router)
Issue type
Bug (incorrect behavior)
Story points
5

Related Objects
Search...

Event Timeline

Viacheslav created this task.Fri, Mar 14, 11:55 AM
Viacheslav triaged this task as High priority.
Viacheslav updated the task description. (Show Details)Fri, Mar 14, 11:58 AM
Viacheslav added a comment.EditedFri, Mar 14, 12:37 PM

Log

vyos@wan-vpp:~$ sudo journalctl -f
Mar 14 12:32:18 wan-vpp systemd[1]: Starting user@1002.service - User Manager for UID 1002...
Mar 14 12:32:18 wan-vpp systemd[2629]: Queued start job for default target default.target.
Mar 14 12:32:18 wan-vpp systemd[2629]: Reached target paths.target - Paths.
Mar 14 12:32:18 wan-vpp systemd[2629]: Reached target sockets.target - Sockets.
Mar 14 12:32:18 wan-vpp systemd[2629]: Reached target timers.target - Timers.
Mar 14 12:32:18 wan-vpp systemd[2629]: Reached target basic.target - Basic System.
Mar 14 12:32:18 wan-vpp systemd[1]: Started user@1002.service - User Manager for UID 1002.
Mar 14 12:32:18 wan-vpp systemd[1]: Started session-1.scope - Session 1 of User vyos.
Mar 14 12:32:18 wan-vpp systemd[2629]: Reached target default.target - Main User Target.
Mar 14 12:32:18 wan-vpp systemd[2629]: Startup finished in 115ms.




Mar 14 12:32:31 wan-vpp systemd[1]: systemd-localed.service: Deactivated successfully.
Mar 14 12:32:35 wan-vpp systemd[1]: systemd-hostnamed.service: Deactivated successfully.


Mar 14 12:32:59 wan-vpp vpp[1700]: received signal SIGSEGV, PC 0x7fbe36bd1d24, faulting address 0x0
Mar 14 12:32:59 wan-vpp vpp[1700]: Code:  4c 8b 30 4d 85 f6 0f 84 00 01 00 00 4c 8b 2d a9 e6 a9 00 49
Mar 14 12:32:59 wan-vpp vpp[1700]: #0  0x00007fbe36bd1d24 adj_delegate_register_new_type + 0x164
Mar 14 12:32:59 wan-vpp vpp[1700]:      from /lib/x86_64-linux-gnu/libvnet.so.24.10.0
Mar 14 12:32:59 wan-vpp vpp[1700]: #1  0x00007fbe36bd2a41 dpo_stack + 0x421
Mar 14 12:32:59 wan-vpp vpp[1700]:      from /lib/x86_64-linux-gnu/libvnet.so.24.10.0
Mar 14 12:32:59 wan-vpp vpp[1700]: #2  0x00007fbe36bd7a42 load_balance_multipath_update + 0x432
Mar 14 12:32:59 wan-vpp vpp[1700]:      from /lib/x86_64-linux-gnu/libvnet.so.24.10.0
Mar 14 12:32:59 wan-vpp vpp[1700]: #3  0x00007fbe36bb3865 fib_entry_src_mk_lb + 0x1e5
Mar 14 12:32:59 wan-vpp vpp[1700]:      from /lib/x86_64-linux-gnu/libvnet.so.24.10.0
Mar 14 12:32:59 wan-vpp vpp[1700]: #4  0x00007fbe36bb3ade fib_entry_src_action_install + 0x3e
Mar 14 12:32:59 wan-vpp vpp[1700]:      from /lib/x86_64-linux-gnu/libvnet.so.24.10.0
Mar 14 12:32:59 wan-vpp vpp[1700]: #5  0x00007fbe36bb0e24 fib_entry_create + 0x74
Mar 14 12:32:59 wan-vpp vpp[1700]:      from /lib/x86_64-linux-gnu/libvnet.so.24.10.0
Mar 14 12:32:59 wan-vpp vpp[1700]: #6  0x00007fbe36ba64de fib_table_entry_path_add2 + 0x2de
Mar 14 12:32:59 wan-vpp vpp[1700]:      from /lib/x86_64-linux-gnu/libvnet.so.24.10.0
Mar 14 12:32:59 wan-vpp vpp[1700]: #7  0x00007fbdeee3094a
Mar 14 12:32:59 wan-vpp vpp[1700]:      from /usr/lib/x86_64-linux-gnu/vpp_plugins//linux_nl_plugin.so
Mar 14 12:32:59 wan-vpp vpp[1700]: #8  0x00007fbdeee33907
Mar 14 12:32:59 wan-vpp vpp[1700]:      from /usr/lib/x86_64-linux-gnu/vpp_plugins//linux_nl_plugin.so
Mar 14 12:32:59 wan-vpp vpp[1700]: #9  0x00007fbdeeeefc3e mpls_pton + 0xee
Mar 14 12:32:59 wan-vpp vpp[1700]:      from /lib/x86_64-linux-gnu/libnl-3.so.200
Mar 14 12:32:59 wan-vpp vpp[1700]: #10 0x00007fbdeeea5bf4 rtnl_qdisc_tbf_get_peakrate_cell + 0xb4
Mar 14 12:32:59 wan-vpp vpp[1700]:      from /lib/x86_64-linux-gnu/libnl-route-3.so.200
Mar 14 12:32:59 wan-vpp vpp[1700]: #11 0x00007fbdeeeebf82 nl_cache_parse + 0x62
Mar 14 12:32:59 wan-vpp vpp[1700]:      from /lib/x86_64-linux-gnu/libnl-3.so.200
Mar 14 12:32:59 wan-vpp vpp[1700]: #12 0x00007fbdeeef138b nl_msg_parse + 0x7b
Mar 14 12:32:59 wan-vpp vpp[1700]:      from /lib/x86_64-linux-gnu/libnl-3.so.200
Mar 14 12:32:59 wan-vpp vpp[1700]: #13 0x00007fbdeee34582
Mar 14 12:32:59 wan-vpp vpp[1700]:      from /usr/lib/x86_64-linux-gnu/vpp_plugins//linux_nl_plugin.so
Mar 14 12:32:59 wan-vpp vpp[1700]: #14 0x00007fbe36370526 vlib_log_init + 0x886
Mar 14 12:32:59 wan-vpp vpp[1700]:      from /lib/x86_64-linux-gnu/libvlib.so.24.10.0
Mar 14 12:32:59 wan-vpp vpp[1700]: #15 0x00007fbe3632a2bc clib_calljmp + 0x18
Mar 14 12:32:59 wan-vpp vpp[1700]:      from /lib/x86_64-linux-gnu/libvppinfra.so.24.10.0
Mar 14 12:32:59 wan-vpp netplugd[946]: eth0: state INNING flags 0x00011043 UP,BROADCAST,RUNNING,MULTICAST,10000 -> 0x00001002 BROADCAST,MULTICAST
Mar 14 12:32:59 wan-vpp systemd[1]: vpp.service: Main process exited, code=killed, status=6/ABRT
Mar 14 12:32:59 wan-vpp systemd[1]: vpp.service: Failed with result 'signal'.
Mar 14 12:32:59 wan-vpp systemd[1]: vpp.service: Consumed 4.159s CPU time.
Mar 14 12:33:00 wan-vpp netplugd[946]: eth1: state INSANE flags 0x00011043 UP,BROADCAST,RUNNING,MULTICAST,10000 -> 0x00001002 BROADCAST,MULTICAST
Mar 14 12:33:00 wan-vpp netplugd[2752]: /etc/netplug/netplug eth0 probe -> pid 2752
Mar 14 12:33:00 wan-vpp netplugd[2753]: /etc/netplug/netplug eth1 probe -> pid 2753
Mar 14 12:33:00 wan-vpp netplugd[946]: eth0: can't get flags: No such device
Mar 14 12:33:00 wan-vpp netplugd[946]: eth1: can't get flags: No such device
Mar 14 12:33:00 wan-vpp netplugd[946]: eth0: can't get flags: No such device
Mar 14 12:33:00 wan-vpp netplugd[946]: eth1: can't get flags: No such device
Mar 14 12:33:00 wan-vpp netplugd[946]: eth0: state PROBING pid 2752 exited status 256
Mar 14 12:33:00 wan-vpp netplugd[946]: Could not bring eth0 back up
Mar 14 12:33:00 wan-vpp netplugd[946]: eth0: can't get flags: No such device
Mar 14 12:33:00 wan-vpp netplugd[946]: eth1: can't get flags: No such device
Mar 14 12:33:00 wan-vpp netplugd[946]: eth0: can't get flags: No such device
Mar 14 12:33:00 wan-vpp netplugd[946]: eth1: can't get flags: No such device
Mar 14 12:33:09 wan-vpp systemd[1]: vpp.service: Scheduled restart job, restart counter is at 1.
Mar 14 12:33:09 wan-vpp systemd[1]: Stopped vpp.service - vector packet processing engine.
Mar 14 12:33:09 wan-vpp systemd[1]: vpp.service: Consumed 4.159s CPU time.
Mar 14 12:33:09 wan-vpp systemd[1]: Starting vpp.service - vector packet processing engine...
Mar 14 12:33:09 wan-vpp systemd[1]: Started vpp.service - vector packet processing engine.

^C
vyos@wan-vpp:~$

gdb backtrace:

(gdb) c
Continuing.

Thread 1 "vpp_main" received signal SIGSEGV, Segmentation fault.
0x00007f44e0f1ad24 in dpo_default_get_next_node (dpo=0x7f44a3dda198)
    at /__w/vyos-reusable-workflows/vyos-reusable-workflows/vyos-build/scripts/package-build/vpp/vpp/src/vnet/dpo/dpo.c:300
300     /__w/vyos-reusable-workflows/vyos-reusable-workflows/vyos-build/scripts/package-build/vpp/vpp/src/vnet/dpo/dpo.c: No such file or directory.
(gdb) 
Continuing.

Thread 1 "vpp_main" received signal SIGABRT, Aborted.
0x00007f44e0483ebc in ?? () from /lib/x86_64-linux-gnu/libc.so.6
(gdb) bt
#0  0x00007f44e0483ebc in ?? () from /lib/x86_64-linux-gnu/libc.so.6
#1  0x00007f44e0434fb2 in raise () from /lib/x86_64-linux-gnu/libc.so.6
#2  0x00007f44e041f472 in abort () from /lib/x86_64-linux-gnu/libc.so.6
#3  0x000055b9a0d84e8a in os_exit (code=<optimized out>)
    at /__w/vyos-reusable-workflows/vyos-reusable-workflows/vyos-build/scripts/package-build/vpp/vpp/src/vpp/vnet/main.c:464
#4  <signal handler called>
#5  0x00007f44e0f1ad24 in dpo_default_get_next_node (dpo=0x7f44a3dda198)
    at /__w/vyos-reusable-workflows/vyos-reusable-workflows/vyos-build/scripts/package-build/vpp/vpp/src/vnet/dpo/dpo.c:300
#6  0x00007f44e0f1ba41 in dpo_get_next_node (parent_dpo=0x20, 
    child_proto=DPO_PROTO_MPLS, child_type=DPO_LOAD_BALANCE)
    at /__w/vyos-reusable-workflows/vyos-reusable-workflows/vyos-build/scripts/package-build/vpp/vpp/src/vnet/dpo/dpo.c:447
#7  dpo_stack (child_type=child_type@entry=DPO_LOAD_BALANCE, 
    child_proto=<optimized out>, dpo=<optimized out>, 
    parent=parent@entry=0x7f44a3dda198)
    at /__w/vyos-reusable-workflows/vyos-reusable-workflows/vyos-build/scripts/package-build/vpp/vpp/src/vnet/dpo/dpo.c:540
#8  0x00007f44e0f20a42 in load_balance_set_bucket_i (next=0x7f44a3dda198, 
    buckets=0x7f44a3ddabe0, bucket=<optimized out>, lb=0x7f44a3ddabc0)
    at /__w/vyos-reusable-workflows/vyos-reusable-workflows/vyos-build/scripts/package-build/vpp/vpp/src/vnet/dpo/load_balance.c:287
--Type <RET> for more, q to quit, c to continue without paging--
#9  load_balance_fill_buckets_norm (n_buckets=<optimized out>, 
    buckets=<optimized out>, nhs=<optimized out>, lb=<optimized out>)
    at /__w/vyos-reusable-workflows/vyos-reusable-workflows/vyos-build/scripts/package-build/vpp/vpp/src/vnet/dpo/load_balance.c:571
#10 load_balance_fill_buckets (n_buckets=<optimized out>, 
    flags=<optimized out>, buckets=0x7f44a3ddabe0, nhs=0x7f44a3dda198, 
    lb=0x7f44a3ddabc0)
    at /__w/vyos-reusable-workflows/vyos-reusable-workflows/vyos-build/scripts/package-build/vpp/vpp/src/vnet/dpo/load_balance.c:636
#11 load_balance_multipath_update (dpo=dpo@entry=0x7f44a359efd0, 
    raw_nhs=<optimized out>, flags=<optimized out>)
    at /__w/vyos-reusable-workflows/vyos-reusable-workflows/vyos-build/scripts/package-build/vpp/vpp/src/vnet/dpo/load_balance.c:700
#12 0x00007f44e0efc865 in fib_entry_src_mk_lb (
    fib_entry=fib_entry@entry=0x7f44a359efa8, source=source@entry=24, 
    fct=<optimized out>, dpo_lb=dpo_lb@entry=0x7f44a359efd0)
    at /__w/vyos-reusable-workflows/vyos-reusable-workflows/vyos-build/scripts/package-build/vpp/vpp/src/vnet/fib/fib_entry_src.c:657
#13 0x00007f44e0efcade in fib_entry_src_action_install (
    fib_entry=fib_entry@entry=0x7f44a359efa8, source=source@entry=24)
    at /__w/vyos-reusable-workflows/vyos-reusable-workflows/vyos-build/scripts/package-build/vpp/vpp/src/vnet/fib/fib_entry_src.c:715
#14 0x00007f44e0efce2e in fib_entry_src_action_activate (
--Type <RET> for more, q to quit, c to continue without paging--
    fib_entry=fib_entry@entry=0x7f44a359efa8, source=source@entry=24)
    at /__w/vyos-reusable-workflows/vyos-reusable-workflows/vyos-build/scripts/package-build/vpp/vpp/src/vnet/fib/fib_entry_src.c:1093
#15 0x00007f44e0ef9e24 in fib_entry_create (fib_index=fib_index@entry=0, 
    prefix=prefix@entry=0x7f4496e4bd60, source=source@entry=24, 
    flags=flags@entry=FIB_ENTRY_FLAG_LOCAL, paths=paths@entry=0x7f44a359f188)
    at /__w/vyos-reusable-workflows/vyos-reusable-workflows/vyos-build/scripts/package-build/vpp/vpp/src/vnet/fib/fib_entry.c:704
#16 0x00007f44e0eef4de in fib_table_entry_path_add2 (fib_index=0, 
    prefix=prefix@entry=0x7f4496e4bd60, source=source@entry=24, 
    flags=<optimized out>, flags@entry=FIB_ENTRY_FLAG_NONE, 
    rpaths=0x7f44a359f188)
    at /__w/vyos-reusable-workflows/vyos-reusable-workflows/vyos-build/scripts/package-build/vpp/vpp/src/vnet/fib/fib_table.c:641
#17 0x00007f449917994a in lcp_router_route_add (rr=<optimized out>, 
    is_replace=<optimized out>)
    at /__w/vyos-reusable-workflows/vyos-reusable-workflows/vyos-build/scripts/package-build/vpp/vpp/src/plugins/linux-cp/lcp_router.c:1431
#18 0x00007f449917c907 in nl_route_add (arg=<optimized out>, rr=0x55b9c8425b50)
    at /__w/vyos-reusable-workflows/vyos-reusable-workflows/vyos-build/scripts/package-build/vpp/vpp/src/plugins/linux-cp/lcp_nl.c:222
#19 nl_route_dispatch (arg=<optimized out>, obj=0x55b9c8425b50)
    at /__w/vyos-reusable-workflows/vyos-reusable-workflows/vyos-build/scripts/p--Type <RET> for more, q to quit, c to continue without paging--
ackage-build/vpp/vpp/src/plugins/linux-cp/lcp_nl.c:319
#20 nl_route_dispatch (obj=0x55b9c8425b50, arg=<optimized out>)
    at /__w/vyos-reusable-workflows/vyos-reusable-workflows/vyos-build/scripts/package-build/vpp/vpp/src/plugins/linux-cp/lcp_nl.c:310
#21 0x00007f4499238c3e in ?? () from /lib/x86_64-linux-gnu/libnl-3.so.200
#22 0x00007f44991eebf4 in ?? () from /lib/x86_64-linux-gnu/libnl-route-3.so.200
#23 0x00007f4499234f82 in nl_cache_parse ()
   from /lib/x86_64-linux-gnu/libnl-3.so.200
#24 0x00007f449923a38b in nl_msg_parse ()
   from /lib/x86_64-linux-gnu/libnl-3.so.200
#25 0x00007f449917d582 in nl_route_process_msgs ()
    at /__w/vyos-reusable-workflows/vyos-reusable-workflows/vyos-build/scripts/package-build/vpp/vpp/src/plugins/linux-cp/lcp_nl.c:360
#26 nl_route_process (vm=0x7f44a02a8700, node=<optimized out>, 
    frame=<optimized out>)
    at /__w/vyos-reusable-workflows/vyos-reusable-workflows/vyos-build/scripts/package-build/vpp/vpp/src/plugins/linux-cp/lcp_nl.c:582
#27 0x00007f44e06b9526 in vlib_process_bootstrap (_a=<optimized out>)
    at /__w/vyos-reusable-workflows/vyos-reusable-workflows/vyos-build/scripts/package-build/vpp/vpp/src/vlib/main.c:1208
#28 0x00007f44e06732bc in clib_calljmp ()
    at /__w/vyos-reusable-workflows/vyos-reusable-workflows/vyos-build/scripts/package-build/vpp/vpp/src/vppinfra/longjmp.S:123
--Type <RET> for more, q to quit, c to continue without paging--
#29 0x00007f449908fdb0 in ?? ()
#30 0x00007f44e06bb0a4 in vlib_process_startup (f=0x0, p=0x7f44a0866fc0, 
    vm=0x7f44a02a8700)
    at /__w/vyos-reusable-workflows/vyos-reusable-workflows/vyos-build/scripts/package-build/vpp/vpp/src/vlib/main.c:1233
#31 dispatch_process (vm=0x7f44a02a8700, p=<optimized out>, 
    last_time_stamp=<optimized out>, f=0x0)
    at /__w/vyos-reusable-workflows/vyos-reusable-workflows/vyos-build/scripts/package-build/vpp/vpp/src/vlib/main.c:1289
#32 0x0000000000000000 in ?? ()
(gdb)
Viacheslav updated the task description. (Show Details)Fri, Mar 14, 3:35 PM
Viacheslav added a comment.Fri, Mar 14, 4:44 PM

BT full

(gdb) c
Continuing.

Thread 1 "vpp_main" received signal SIGSEGV, Segmentation fault.
0x00007f4d766a6d24 in dpo_default_get_next_node (dpo=0x7f4d38d1d0d8)
    at /__w/vyos-reusable-workflows/vyos-reusable-workflows/vyos-build/scripts/package-build/vpp/vpp/src/vnet/dpo/dpo.c:300
300     /__w/vyos-reusable-workflows/vyos-reusable-workflows/vyos-build/scripts/package-build/vpp/vpp/src/vnet/dpo/dpo.c: No such file or directory.
(gdb) bt full
#0  0x00007f4d766a6d24 in dpo_default_get_next_node (dpo=0x7f4d38d1d0d8)
    at /__w/vyos-reusable-workflows/vyos-reusable-workflows/vyos-build/scripts/package-build/vpp/vpp/src/vnet/dpo/dpo.c:300
        node_indices = 0x0
        node_name = <optimized out>
        ii = 0
        __FUNCTION__ = <optimized out>
#1  0x00007f4d766a7a41 in dpo_get_next_node (parent_dpo=0x20, 
    child_proto=DPO_PROTO_MPLS, child_type=DPO_LOAD_BALANCE)
    at /__w/vyos-reusable-workflows/vyos-reusable-workflows/vyos-build/scripts/package-build/vpp/vpp/src/vnet/dpo/dpo.c:447
        parent_indices = <optimized out>
        cc = 0
        child_node = <optimized out>
        vm = 0x7f4d35a34700
        edge = <optimized out>
        pi = <optimized out>
        parent_proto = <optimized out>
        parent_type = <optimized out>
        parent_proto = <optimized out>
        parent_type = <optimized out>
        __FUNCTION__ = "dpo_get_next_node"
        _vec_i = <optimized out>
--Type <RET> for more, q to quit, c to continue without paging--c
        _vec_l = <optimized out>
        child_node = <optimized out>
        parent_indices = <optimized out>
        vm = <optimized out>
        edge = <optimized out>
        pi = <optimized out>
        cc = <optimized out>
#2  dpo_stack (child_type=child_type@entry=DPO_LOAD_BALANCE, 
    child_proto=<optimized out>, dpo=<optimized out>, 
    parent=parent@entry=0x7f4d38d1d0d8)
    at /__w/vyos-reusable-workflows/vyos-reusable-workflows/vyos-build/scripts/package-build/vpp/vpp/src/vnet/dpo/dpo.c:540
No locals.
#3  0x00007f4d766aca42 in load_balance_set_bucket_i (next=0x7f4d38d1d0d8, 
    buckets=0x7f4d3958c920, bucket=<optimized out>, lb=0x7f4d3958c900)
    at /__w/vyos-reusable-workflows/vyos-reusable-workflows/vyos-build/scripts/package-build/vpp/vpp/src/vnet/dpo/load_balance.c:287
No locals.
#4  load_balance_fill_buckets_norm (n_buckets=<optimized out>, 
    buckets=<optimized out>, nhs=<optimized out>, lb=<optimized out>)
    at /__w/vyos-reusable-workflows/vyos-reusable-workflows/vyos-build/scripts/package-build/vpp/vpp/src/vnet/dpo/load_balance.c:571
        nh = 0x7f4d38d1d0d8
        ii = <optimized out>
        bucket = 1
        nh = <optimized out>
        ii = <optimized out>
        bucket = <optimized out>
        __FUNCTION__ = <optimized out>
#5  load_balance_fill_buckets (n_buckets=<optimized out>, 
    flags=<optimized out>, buckets=0x7f4d3958c920, nhs=0x7f4d38d1d0d8, 
    lb=0x7f4d3958c900)
    at /__w/vyos-reusable-workflows/vyos-reusable-workflows/vyos-build/scripts/package-build/vpp/vpp/src/vnet/dpo/load_balance.c:636
No locals.
#6  load_balance_multipath_update (dpo=dpo@entry=0x7f4d3958d920, 
    raw_nhs=<optimized out>, flags=<optimized out>)
    at /__w/vyos-reusable-workflows/vyos-reusable-workflows/vyos-build/scripts/package-build/vpp/vpp/src/vnet/dpo/load_balance.c:700
        nh = <optimized out>
        nhs = 0x7f4d38d1d0d8
        fixed_nhs = <optimized out>
        sum_of_weights = 1
        n_buckets = <optimized out>
        ii = <optimized out>
        lbmi = <optimized out>
        old_lbmi = <optimized out>
        lb = 0x7f4d3958c900
        tmp_dpo = <optimized out>
        __FUNCTION__ = <optimized out>
#7  0x00007f4d76688865 in fib_entry_src_mk_lb (
    fib_entry=fib_entry@entry=0x7f4d3958d8f8, source=source@entry=24, 
    fct=<optimized out>, dpo_lb=dpo_lb@entry=0x7f4d3958d920)
    at /__w/vyos-reusable-workflows/vyos-reusable-workflows/vyos-build/scripts/package-build/vpp/vpp/src/vnet/fib/fib_entry_src.c:657
        ui = <optimized out>
        esrc = 0x7f4d365cca98
        lb_proto = DPO_PROTO_MPLS
        start = <optimized out>
        end = <optimized out>
        ctx = {next_hops = 0x7f4d38d1d198, fib_entry = 0x7f4d3958d8f8, 
          start_source_index = 0, end_source_index = 0, 
          fct = FIB_FORW_CHAIN_TYPE_MPLS_EOS, n_recursive_constrained = 0, 
          preference = 0, payload_proto = DPO_PROTO_MPLS}
#8  0x00007f4d76688ade in fib_entry_src_action_install (
    fib_entry=fib_entry@entry=0x7f4d3958d8f8, source=source@entry=24)
    at /__w/vyos-reusable-workflows/vyos-reusable-workflows/vyos-build/scripts/package-build/vpp/vpp/src/vnet/fib/fib_entry_src.c:715
        fct = <optimized out>
        insert = 1
        __FUNCTION__ = <optimized out>
        fdt = <optimized out>
        fed = <optimized out>
#9  0x00007f4d76688e2e in fib_entry_src_action_activate (
    fib_entry=fib_entry@entry=0x7f4d3958d8f8, source=source@entry=24)
    at /__w/vyos-reusable-workflows/vyos-reusable-workflows/vyos-build/scripts/package-build/vpp/vpp/src/vnet/fib/fib_entry_src.c:1093
        houston_we_are_go_for_install = <optimized out>
        vft = <optimized out>
        esrc = <optimized out>
        __FUNCTION__ = <optimized out>
#10 0x00007f4d76685e24 in fib_entry_create (fib_index=fib_index@entry=0, 
    prefix=prefix@entry=0x7f4d2c5d7d60, source=source@entry=24, 
    flags=flags@entry=FIB_ENTRY_FLAG_LOCAL, paths=paths@entry=0x7f4d38d21458)
    at /__w/vyos-reusable-workflows/vyos-reusable-workflows/vyos-build/scripts/package-build/vpp/vpp/src/vnet/fib/fib_entry.c:704
        fib_entry_index = 41
        fib_entry = 0x7f4d3958d8f8
        __FUNCTION__ = <optimized out>
#11 0x00007f4d7667b4de in fib_table_entry_path_add2 (fib_index=0, 
    prefix=prefix@entry=0x7f4d2c5d7d60, source=source@entry=24, 
    flags=<optimized out>, flags@entry=FIB_ENTRY_FLAG_NONE, 
    rpaths=0x7f4d38d21458)
    at /__w/vyos-reusable-workflows/vyos-reusable-workflows/vyos-build/scripts/package-build/vpp/vpp/src/vnet/fib/fib_table.c:641
        fib_entry_index = <optimized out>
        fib_table = 0x7f4d38d2df10
        ii = <optimized out>
#12 0x00007f4d2e90594a in lcp_router_route_add (rr=<optimized out>, 
    is_replace=<optimized out>)
    at /__w/vyos-reusable-workflows/vyos-reusable-workflows/vyos-build/scripts/package-build/vpp/vpp/src/plugins/linux-cp/lcp_router.c:1431
        fib_src = <optimized out>
        rpath = <optimized out>
        entry_flags = <optimized out>
        table_id = <optimized out>
        pfx = {fp_len = 21, fp_proto = FIB_PROTOCOL_MPLS, 
          ___fp___pad = 0 '\000', {fp_addr = {{pad = {16, 1, 2}, ip4 = {
                  data = "\000\000\000", data_u32 = 0, as_u8 = "\000\000\000", 
                  as_u16 = {0, 0}, as_u32 = 0}}, ip6 = {
                as_u8 = "\020\000\000\000\001\000\000\000\002\000\000\000\000\000\000", as_u16 = {16, 0, 1, 0, 2, 0, 0, 0}, as_u32 = {16, 1, 2, 0}, as_u64 = {
                  4294967312, 2}, as_u128 = {4294967312, 2}, as_uword = {
                  4294967312, 2}}, 
              as_u8 = "\020\000\000\000\001\000\000\000\002\000\000\000\000\000\000", as_u64 = {4294967312, 2}}, {fp_label = 16, fp_eos = MPLS_EOS, 
              fp_payload_proto = DPO_PROTO_MPLS}}}
        nlt = 0x7f4d365f34c8
        rtype = <optimized out>
        rproto = <optimized out>
        np = {paths = 0x7f4d38d21458, route_proto = FIB_PROTOCOL_MPLS, 
          is_mcast = false, type_flags = FIB_ROUTE_PATH_FLAG_NONE, 
          preference = 0 '\000'}
#13 0x00007f4d2e908907 in nl_route_add (arg=<optimized out>, rr=0x556f1fd7eac0)
    at /__w/vyos-reusable-workflows/vyos-reusable-workflows/vyos-build/scripts/package-build/vpp/vpp/src/plugins/linux-cp/lcp_nl.c:222
        nm = 0x7f4d2e9239a0 <nl_main>
        __nv = 0x7f4d366c2f18
        is_replace = 0
        is_replace = <optimized out>
        __FUNCTION__ = "nl_route_add"
        msg_info = <optimized out>
        nlh = <optimized out>
        nm = <optimized out>
        __nv = <optimized out>
#14 nl_route_dispatch (arg=<optimized out>, obj=0x556f1fd7eac0)
    at /__w/vyos-reusable-workflows/vyos-reusable-workflows/vyos-build/scripts/package-build/vpp/vpp/src/plugins/linux-cp/lcp_nl.c:319
No locals.
#15 nl_route_dispatch (obj=0x556f1fd7eac0, arg=<optimized out>)
    at /__w/vyos-reusable-workflows/vyos-reusable-workflows/vyos-build/scripts/package-build/vpp/vpp/src/plugins/linux-cp/lcp_nl.c:310
No locals.
#16 0x00007f4d2e9c4c3e in ?? () from /lib/x86_64-linux-gnu/libnl-3.so.200
No symbol table info available.
#17 0x00007f4d2e97abf4 in ?? () from /lib/x86_64-linux-gnu/libnl-route-3.so.200
No symbol table info available.
#18 0x00007f4d2e9c0f82 in nl_cache_parse ()
   from /lib/x86_64-linux-gnu/libnl-3.so.200
No symbol table info available.
#19 0x00007f4d2e9c638b in nl_msg_parse ()
   from /lib/x86_64-linux-gnu/libnl-3.so.200
No symbol table info available.
#20 0x00007f4d2e909582 in nl_route_process_msgs ()
    at /__w/vyos-reusable-workflows/vyos-reusable-workflows/vyos-build/scripts/package-build/vpp/vpp/src/plugins/linux-cp/lcp_nl.c:360
        nm = 0x7f4d2e9239a0 <nl_main>
        msg_info = 0x7f4d38d1e1a8
        err = <optimized out>
        n_msgs = 18
        nm = <optimized out>
        msg_info = <optimized out>
        err = <optimized out>
        n_msgs = <optimized out>
#21 nl_route_process (vm=0x7f4d35a34700, node=<optimized out>, 
    frame=<optimized out>)
    at /__w/vyos-reusable-workflows/vyos-reusable-workflows/vyos-build/scripts/package-build/vpp/vpp/src/plugins/linux-cp/lcp_nl.c:582
        nm = 0x7f4d2e9239a0 <nl_main>
        event_type = <optimized out>
        event_data = 0x7f4d38ce59f8
        wait_time = <optimized out>
        n_msgs = <optimized out>
        is_done = 1
#22 0x00007f4d75e45526 in vlib_process_bootstrap (_a=<optimized out>)
    at /__w/vyos-reusable-workflows/vyos-reusable-workflows/vyos-build/scripts/package-build/vpp/vpp/src/vlib/main.c:1208
        a = <optimized out>
        vm = <optimized out>
        node = 0x7f4d37130180
        f = <optimized out>
        p = 0x7f4d37130180
        n = <optimized out>
        __FUNCTION__ = <optimized out>
#23 0x00007f4d75dff2bc in clib_calljmp ()
    at /__w/vyos-reusable-workflows/vyos-reusable-workflows/vyos-build/scripts/package-build/vpp/vpp/src/vppinfra/longjmp.S:123
No locals.
#24 0x00007f4d2e81bdb0 in ?? ()
No symbol table info available.
#25 0x00007f4d75e470a4 in vlib_process_startup (f=0x0, p=0x7f4d37130180, 
    vm=0x7f4d35a34700)
    at /__w/vyos-reusable-workflows/vyos-reusable-workflows/vyos-build/scripts/package-build/vpp/vpp/src/vlib/main.c:1233
        a = {vm = 0x7f4d2c5b7000, process = 0x0, frame = 0x0}
        r = 18446744073709551615
        a = <optimized out>
        r = <optimized out>
#26 dispatch_process (vm=0x7f4d35a34700, p=<optimized out>, 
    last_time_stamp=<optimized out>, f=0x0)
    at /__w/vyos-reusable-workflows/vyos-reusable-workflows/vyos-build/scripts/package-build/vpp/vpp/src/vlib/main.c:1289
        nm = 0x7f4d35a34858
        node_runtime = <optimized out>
        node = 0x7f4d37128550
        old_process_index = <optimized out>
        t = <optimized out>
        n_vectors = <optimized out>
        is_suspend = <optimized out>
        __FUNCTION__ = <optimized out>
#27 0x0000000000000000 in ?? ()
No symbol table info available.
(gdb) 
(gdb) 
(gdb) 
(gdb) c
Continuing.

Thread 1 "vpp_main" received signal SIGABRT, Aborted.
0x00007f4d75c0febc in ?? () from /lib/x86_64-linux-gnu/libc.so.6
(gdb) 
Continuing.
Couldn't get registers: No such process.
(gdb) [Thread 0x7f4d75a34f40 (LWP 1700) exited]
[Thread 0x7f4d75a34f40 (LWP 1808) exited]
[Thread 0x7f4d75a34f40 (LWP 1731) exited]
[Thread 0x7f4d75a34f40 (LWP 1726) exited]
[Thread 0x7f4d2c4356c0 (LWP 1713) exited]
[New process 1700]

Program terminated with signal SIGABRT, Aborted.
The program no longer exists.

The program is not being run.
(gdb) 
The program is not being run.
(gdb) q
Viacheslav added a comment.Thu, Mar 20, 11:08 AM

PR https://github.com/vyos/vyos-vpp-patches/pull/4

Viacheslav closed this task as Resolved.Mon, Mar 24, 11:38 AM
Viacheslav claimed this task.
Viacheslav moved this task from Need Triage to Completed on the VyOS Rolling board.