ENA interface (in AWS) cannot be initialized by VPP in ARM64 instances
Open, NormalPublicBUG
Actions

Assigned To

None

Authored By

	zsdc
	Wed, Jan 7, 7:20 PM

Description

When VPP tries to initialize an ENA interface, it fails with error -22. This can be reproduced only on ARM64 instances.

Example configuration that triggers the issue is:

set interfaces ethernet eth0 address 'dhcp'
set system option kernel cpu disable-nmi-watchdog
set system option kernel cpu isolate-cpus '2-3'
set system option kernel cpu nohz-full '2-3'
set system option kernel cpu rcu-no-cbs '2-3'
set system option kernel disable-hpet
set system option kernel disable-mce
set system option kernel disable-mitigations
set system option kernel disable-softlockup
set system option kernel memory hugepage-size 2M hugepage-count '1536'
set system option reboot-on-upgrade-failure '5'
set vpp settings cpu corelist-workers '3'
set vpp settings cpu main-core '2'
set vpp settings interface eth0 driver 'dpdk'
set vpp settings logging default-log-level 'debug'
set vpp settings memory main-heap-size '1G'
set vpp settings unix poll-sleep-usec '1000'

When the interface cannot be initialized, it is displayed in vppctl like this:

vpp# show hardware-interfaces 
              Name                Idx   Link  Hardware
eth0                               1     up   eth0
  Link speed: unknown
  RX Queues:
    queue thread         mode      
    0     vpp_wk_0 (1)   polling   
  TX Queues:
    TX Hash: [name: hash-eth-l34 priority: 50 description: Hash ethernet L34 headers]
    queue shared thread(s)      
    0     yes    0-1
  Ethernet address 16:ff:fa:4b:98:77
  AWS ENA VF
    carrier up full duplex max-frame-size 1522 
    flags: maybe-multiseg tx-offload rx-ip4-cksum tx-prepare
    Devargs: 
    rx: queues 1 (max 4), desc 256 (min 128 max 8192 align 1)
    tx: queues 1 (max 4), desc 256 (min 128 max 1024 align 1)
    pci: device 1d0f:ec20 subsystem 1d0f:ec20 address 0000:27:00.00 numa 0
    max rx packet len: 9234
    promiscuous: unicast off all-multicast off
    vlan offload: strip off filter off qinq off
    rx offload avail:  ipv4-cksum udp-cksum tcp-cksum scatter 
    rx offload active: ipv4-cksum scatter 
    tx offload avail:  ipv4-cksum udp-cksum tcp-cksum multi-segs mbuf-fast-free                                                                                          
    tx offload active: ipv4-cksum udp-cksum tcp-cksum multi-segs 
    rss avail:         ipv4-tcp ipv4-udp ipv6-tcp ipv6-udp 
    rss active:        none
    tx burst function: (not available)
    rx burst function: (not available)
  Errors:
    rte_eth_dev_start[port:0, errno:-22]: Unknown error -22
  rte_eth_dev_start[port:0, errno:-22]: Unknown error -22
  rte_eth_dev_start[port:0, errno:-22]: Unknown error -22
  rte_eth_dev_start[port:0, errno:-22]: Unknown error -22
  rte_eth_dev_start[port:0, errno:-22]: Unknown error -22
  rte_eth_dev_start[port:0, errno:-22]: Unknown error -22

Note: I think the issue is only triggered by an attempt to actually bring up an interface, but may not be triggered by a simple VPP start with an interface attached - that's why if you restart the VPP service, everything will look fine, but only till the moment when such an interface is actually tried to be used.

More detailed debug log of such VPP start is here:

Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: avf/stats: initialized
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: avf: initialized
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: session/sdl: initialized
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: session/api: initialized
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: session/rt: initialized
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: dev/platform: initialized
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: crypto/main: initialized
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: ip6/neighbor: initialized
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: ip4/neighbor: initialized
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: interface/runtime: initialized
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: interface/tx-queue: initialized
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: interface/rx-queue: initialized
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: interface/caps: initialized
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: interface: initialized
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: dev/runtime: initialized
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: dev/error: initialized
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: dev/process: initialized
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: dev/port: initialized
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: dev/handler: initialized
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: dev: initialized
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: dev/counters: initialized
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: dev/config: initialized
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: dev/pci: initialized
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: dev/args: initialized
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: dev/api: initialized
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: pci/linux: initialized
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: dma: initialized
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: pci: initialized
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: vlib/file: initialized
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: log: initialized
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: dev: main_init: bus 'platform' registered
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: dev: main_init: bus 'pci' registered
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: vnet_feature_arc_init:272: feature node 'ip4-dhcp-client-detect' not found (before 'det44-out2in', arc 'ip4-unicast')
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: vnet_feature_arc_init:272: feature node 'ip4-dhcp-client-detect' not found (before 'nat44-ei-out2in', arc 'ip4-unicast')
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: vnet_feature_arc_init:272: feature node 'ip4-dhcp-client-detect' not found (before 'nat44-ei-out2in-worker-handoff', arc 'ip4-unicast')
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: vnet_feature_arc_init:272: feature node 'ip4-dhcp-client-detect' not found (before 'nat-pre-out2in', arc 'ip4-unicast')
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: vnet_feature_arc_init:272: feature node 'ip4-dhcp-client-detect' not found (before 'nat44-out2in-worker-handoff', arc 'ip4-unicast')
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: vnet_feature_arc_init:272: feature node 'ip4-dhcp-client-detect' not found (before 'nat44-ed-out2in', arc 'ip4-unicast')
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[0] locks:0 uRPF-list: None
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[0] locks:0 flags:drop, uRPF-list: None
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[0] locks:2 flags:drop, uPRF-list:0 len:0 itfs:[]
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/entry: [@0:[0.0.0.0/0]:drop,:default-route]: activate: 0
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: dpo/load-balance: lb:[dpo-load-balance: [proto:ip4 index:1 buckets:0 uRPF:-1 to:[0:0]]]:create
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/entry: [@0:[0.0.0.0/0]:drop,:default-route]: install: 4
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/entry: [@0:[0.0.0.0/0]:drop,:default-route]: create-special
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[1] locks:0 uRPF-list: None
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[1] locks:0 flags:drop, uRPF-list: None
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[1] locks:2 flags:drop, uPRF-list:1 len:0 itfs:[]
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/entry: [@1:[0.0.0.0/32]:drop,:default-route]: activate: 1
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: dpo/load-balance: lb:[dpo-load-balance: [proto:ip4 index:2 buckets:0 uRPF:-1 to:[0:0]]]:create
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/entry: [@1:[0.0.0.0/32]:drop,:default-route]: install: 4
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/entry: [@1:[0.0.0.0/32]:drop,:default-route]: create-special
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[2] locks:0 uRPF-list: None
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[2] locks:0 flags:drop, uRPF-list: None
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[2] locks:2 flags:drop, uPRF-list:2 len:0 itfs:[]
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/entry: [@2:[240.0.0.0/4]:drop,:special]: activate: 2
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: dpo/load-balance: lb:[dpo-load-balance: [proto:ip4 index:3 buckets:0 uRPF:-1 to:[0:0]]]:create
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/entry: [@2:[240.0.0.0/4]:drop,:special]: install: 4
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/entry: [@2:[240.0.0.0/4]:drop,:special]: create-special
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[3] locks:0 uRPF-list: None
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[3] locks:0 flags:drop, uRPF-list: None
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[3] locks:2 flags:drop, uPRF-list:3 len:0 itfs:[]
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/entry: [@3:[224.0.0.0/4]:drop,:special]: activate: 3
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: dpo/load-balance: lb:[dpo-load-balance: [proto:ip4 index:4 buckets:0 uRPF:-1 to:[0:0]]]:create
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/entry: [@3:[224.0.0.0/4]:drop,:special]: install: 4
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/entry: [@3:[224.0.0.0/4]:drop,:special]: create-special
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[4] locks:0 uRPF-list: None
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[4] locks:0 flags:drop, uRPF-list: None
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[4] locks:2 flags:drop, uPRF-list:4 len:0 itfs:[]
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/entry: [@4:[255.255.255.255/32]:drop,:default-route]: activate: 4
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: dpo/load-balance: lb:[dpo-load-balance: [proto:ip4 index:5 buckets:0 uRPF:-1 to:[0:0]]]:create
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/entry: [@4:[255.255.255.255/32]:drop,:default-route]: install: 4
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/entry: [@4:[255.255.255.255/32]:drop,:default-route]: create-special
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: mfib/entry: e:[0:(*, 0.0.0.0/0)]: alloc
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: mfib/entry: e:[1:(*, 224.0.0.1/32)]: alloc
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[5] locks:0 uRPF-list: None
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[5] locks:0 flags:no-uRPF, uRPF-list: None
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[5] locks:1 flags:no-uRPF, uRPF-list: None
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/path: [path:[5] pl-index:5 ip4 weight=1 pref=0 receive:  cfg-flags:local,]: create
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[5] locks:1 flags:no-uRPF, uRPF-list: None
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: dpo/replicate: rep:[dpo-replicate: [index:0 buckets:0 flags:[none] to:[0:0]]]:create
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: mfib/entry: e:[2:(*, 224.0.0.2/32)]: alloc
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[6] locks:0 uRPF-list: None
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[6] locks:0 flags:no-uRPF, uRPF-list: None
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[6] locks:1 flags:no-uRPF, uRPF-list: None
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/path: [path:[6] pl-index:6 ip4 weight=1 pref=0 receive:  cfg-flags:local,]: create
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[6] locks:1 flags:no-uRPF, uRPF-list: None
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: dpo/replicate: rep:[dpo-replicate: [index:1 buckets:0 flags:[none] to:[0:0]]]:create
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[7] locks:0 uRPF-list: None
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[7] locks:0 flags:drop, uRPF-list: None
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[7] locks:2 flags:drop, uPRF-list:5 len:0 itfs:[]
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/entry: [@5:[::/0]:drop,:default-route]: activate: 7
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: dpo/load-balance: lb:[dpo-load-balance: [proto:ip6 index:6 buckets:0 uRPF:-1 to:[0:0]]]:create
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/entry: [@5:[::/0]:drop,:default-route]: install: 260
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/entry: [@5:[::/0]:drop,:default-route]: create-special
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[8] locks:0 uRPF-list: None
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[8] locks:0 uRPF-list: None
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[8] locks:2 uPRF-list:6 len:0 itfs:[]
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/entry: [@6:[fe80::/10]::special]: activate: 8
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: dpo/load-balance: lb:[dpo-load-balance: [proto:ip6 index:7 buckets:0 uRPF:-1 to:[0:0]]]:create
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/entry: [@6:[fe80::/10]::special]: install: 260
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/entry: [@6:[fe80::/10]::special]: create-special
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: mfib/entry: e:[3:(*, ::/0)]: alloc
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: mfib/entry: e:[4:(*, ff02::1:ff00:0/104)]: alloc
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[9] locks:0 uRPF-list: None
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[9] locks:0 flags:no-uRPF, uRPF-list: None
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[9] locks:1 flags:no-uRPF, uRPF-list: None
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/path: [path:[9] pl-index:9 ip6 weight=1 pref=0 receive:  cfg-flags:local,]: create
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[9] locks:1 flags:no-uRPF, uRPF-list: None
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: dpo/replicate: rep:[dpo-replicate: [index:2 buckets:0 flags:[none] to:[0:0]]]:create
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: mfib/entry: e:[5:(*, ff02::2/128)]: alloc
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[10] locks:0 uRPF-list: None
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[10] locks:0 flags:no-uRPF, uRPF-list: None
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[10] locks:1 flags:no-uRPF, uRPF-list: None
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/path: [path:[10] pl-index:10 ip6 weight=1 pref=0 receive:  cfg-flags:local,]: create
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[10] locks:1 flags:no-uRPF, uRPF-list: None
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: dpo/replicate: rep:[dpo-replicate: [index:3 buckets:0 flags:[none] to:[0:0]]]:create
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: mfib/entry: e:[6:(*, ff02::1/128)]: alloc
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[11] locks:0 uRPF-list: None
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[11] locks:0 flags:no-uRPF, uRPF-list: None
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[11] locks:1 flags:no-uRPF, uRPF-list: None
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/path: [path:[11] pl-index:11 ip6 weight=1 pref=0 receive:  cfg-flags:local,]: create
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[11] locks:1 flags:no-uRPF, uRPF-list: None
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: dpo/replicate: rep:[dpo-replicate: [index:4 buckets:0 flags:[none] to:[0:0]]]:create
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: mfib/entry: e:[7:(*, ff02::16/128)]: alloc
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[12] locks:0 uRPF-list: None
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[12] locks:0 flags:no-uRPF, uRPF-list: None
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[12] locks:1 flags:no-uRPF, uRPF-list: None
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/path: [path:[12] pl-index:12 ip6 weight=1 pref=0 receive:  cfg-flags:local,]: create
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[12] locks:1 flags:no-uRPF, uRPF-list: None
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: dpo/replicate: rep:[dpo-replicate: [index:5 buckets:0 flags:[none] to:[0:0]]]:create
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: bfd/udp: initialized
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: bfd: initialized
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: crypto/main: exec path is /usr/bin/vpp
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: crypto/main: libpath is /usr/lib/aarch64-linux-gnu/vpp_crypto_engines
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: crypto/main: crypto disabled (default): native
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: crypto/main: crypto disabled (default): openssl
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: virtio: initialized
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: tap: initialized
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: nl/nl: Added file 2
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: nl/nl: Opened netlink socket 10
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: sflow/all: linux-cp found - using LIP vif_index, where available
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: nl/xfrm: Added file 3
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: nl/xfrm: Opened netlink socket 11
Jun 26 15:21:36 ip-172-31-72-221 vpp[3972]: dpdk: EAL init args: --in-memory --no-telemetry --file-prefix vpp -a 0000:00:00.0 -a 0000:27:00.0
Jun 26 15:21:36 ip-172-31-72-221 kernel: vfio-pci 0000:27:00.0: vfio-noiommu device opened by user (vpp:3972)
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: dpdk: [0] min_mtu: 128, max_mtu: 9216, min_rx_bufsize: 64, max_rx_pktlen: 9234, max_lro_pkt_size: 0
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: dpdk: [0] driver frame overhead is 18
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: dpdk: [0] n_rx_queues: 1 n_tx_queues: 2 n_rx_desc: 1024 n_tx_desc: 1024
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: ip/neighbor: interface-change: eth0  add
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: interface: set_mtu: interface eth0, new mtu 9000
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: linux-cp/itf: mtu_change: sw eth0 0
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: linux-cp/itf: mtu_change: si eth0 hi eth0, syncing children
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: linux-cp/itf: sync_state_hw: hi eth0
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: dpdk: [0] interface eth0 created
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: interface/rx-queue: set_input_node: node dpdk-input for interface eth0
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: interface/rx-queue: register: interface eth0 queue-id 0 thread 1
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: interface/tx-queue: register: interface eth0 queue-id 0
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: interface/tx-queue: register: interface eth0 queue-id 1
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: interface/tx-queue: assign_thread: interface eth0 queue-id 0 thread 0 queue-shared no
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: interface/tx-queue: assign_thread: interface eth0 queue-id 1 thread 1 queue-shared no
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: dpdk: [0] configuring device name: 0000:27:00.0, numa: 0, driver: net_ena, bus: pci
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: dpdk: [0] Supported RX offloads: ipv4-cksum udp-cksum tcp-cksum scatter
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: dpdk: [0] Configured RX offloads: ipv4-cksum scatter
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: dpdk: [0] Supported TX offloads: ipv4-cksum udp-cksum tcp-cksum multi-segs mbuf-fast-free
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: dpdk: [0] Configured TX offloads: ipv4-cksum udp-cksum tcp-cksum multi-segs
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: interface: set_max_frame_size: interface eth0, max_frame_size 0 -> 9022
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: dpdk: [0] max_frame_size set to 9022 by setting MTU to 9004
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: dpdk: [0] max_frame_size 9022 max max_frame_size 9234 driver_frame_overhead 18
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: interface/caps: change: interface eth0, set: ip4-csum-tx tcp-csum-tx udp-csum-tx mac-filter, cleared: none
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: interface/runtime: update node 'dpdk-input' triggered by interface eth0
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: interface/runtime: state changed for node dpdk-input on thread 1 from disabled to polling
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: interface/runtime: tx queue data changed for interface eth0, thread 0 (queue_id 0)
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: interface/runtime: tx queue lookup table changed for interface eth0, (lookup table [0]=0)
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: interface/runtime: tx queue data changed for interface eth0, thread 1 (queue_id 1)
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: interface/runtime: tx queue lookup table changed for interface eth0, (lookup table [0]=1)
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: interface/runtime: already running under the barrier
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: interface: hw_set_flags: hw_if_index 1 flags 0x5
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: vat-plug/load: Loaded plugin: acl_test_plugin.so
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: vat-plug/load: vat_plugin_register: adl plugin not loaded...
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: vat-plug/load: Loaded plugin: af_xdp_test_plugin.so
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: vat-plug/load: vat_plugin_register: arping plugin not loaded...
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: vat-plug/load: Loaded plugin: avf_test_plugin.so
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: vat-plug/load: vat_plugin_register: cdp plugin not loaded...
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: vat-plug/load: vat_plugin_register: ct6 plugin not loaded...
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: vat-plug/load: vat_plugin_register: dhcp plugin not loaded...
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: vat-plug/load: vat_plugin_register: dns plugin not loaded...
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: vat-plug/load: Loaded plugin: flowprobe_test_plugin.so
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: vat-plug/load: Loaded plugin: geneve_test_plugin.so
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: vat-plug/load: vat_plugin_register: gtpu plugin not loaded...
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: vat-plug/load: vat_plugin_register: http_static plugin not loaded...
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: vat-plug/load: vat_plugin_register: idpf plugin not loaded...
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: vat-plug/load: vat_plugin_register: ikev2 plugin not loaded...
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: vat-plug/load: pot_vat_plugin_register: pot plugin not loaded...
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: vat-plug/load: vat_plugin_register: ip_session_redirect plugin not loaded...
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: vat-plug/load: vat_plugin_register: l2tp plugin not loaded...
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: vat-plug/load: Loaded plugin: lacp_test_plugin.so
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: vat-plug/load: vat_plugin_register: lb plugin not loaded...
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: vat-plug/load: vat_plugin_register_gpe: lisp_gpe plugin not loaded...
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: vat-plug/load: vat_plugin_register: lldp plugin not loaded...
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: vat-plug/load: vat_plugin_register: mactime plugin not loaded...
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: vat-plug/load: vat_plugin_register: mdata plugin not loaded...
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: vat-plug/load: vat_plugin_register: memif plugin not loaded...
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: vat-plug/load: vat_plugin_register: nsh plugin not loaded...
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: vat-plug/load: vat_plugin_register: nsim plugin not loaded...
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: vat-plug/load: Loaded plugin: pppoe_test_plugin.so
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: vat-plug/load: vat_plugin_register: rdma plugin not loaded...
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: vat-plug/load: Loaded plugin: sflow_test_plugin.so
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: vat-plug/load: vat_plugin_register: sr_mpls plugin not loaded...
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: vat-plug/load: vat_plugin_register: stn plugin not loaded...
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: vat-plug/load: vat_plugin_register: tls_openssl plugin not loaded...
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: vat-plug/load: Loaded plugin: vlib_vlibapi_test_plugin.so
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: vat-plug/load: Loaded plugin: vmxnet3_test_plugin.so
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: vat-plug/load: Loaded plugin: vnet_arp_test_plugin.so
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: vat-plug/load: Loaded plugin: vnet_interface_test_plugin.so
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: vat-plug/load: Loaded plugin: vnet_ip6_nd_test_plugin.so
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: vat-plug/load: Loaded plugin: vnet_ip_test_plugin.so
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: vat-plug/load: Loaded plugin: vnet_ipsec_test_plugin.so
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: vat-plug/load: Loaded plugin: vnet_l2_test_plugin.so
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: vat-plug/load: Loaded plugin: vnet_session_test_plugin.so
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: vat-plug/load: Loaded plugin: vpp_api_test_plugin.so
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: vat-plug/load: vat_plugin_register: vrrp plugin not loaded...
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: dpdk: EAL: Detected CPU lcores: 4
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: dpdk: EAL: Detected NUMA nodes: 1
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: dpdk: EAL: Detected static linkage of DPDK
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: dpdk: EAL: Selected IOVA mode 'PA'
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: dpdk: EAL: No free 32768 kB hugepages reported on node 0
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: dpdk: EAL: No free 64 kB hugepages reported on node 0
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: dpdk: EAL: No free 1048576 kB hugepages reported on node 0
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: dpdk: EAL: VFIO support initialized
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: dpdk: EAL: Using IOMMU type 8 (No-IOMMU)
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: dpdk: ENA_DRIVER: ena_get_metrics_entries(): 0x6 customer metrics are supported
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: dpdk: ENA_DRIVER: ena_set_queues_placement_policy(): NOTE: LLQ has been disabled as per user's request. This may lead to a huge performance degradation!
Jun 26 15:21:37 ip-172-31-72-221 vpp[3972]: dpdk: ENA_DRIVER: ena_mtu_set(): MTU set to: 9004
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: tap: tap0: open tap fd 34
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: tap: tap0: TUNGETFEATURES: features 0x7173
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: tap: tap0: TUNSETIFF fd 34 name eth0 flags 0x5102
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: tap: tap0: ifindex 6
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: tap: tap0: TUNSETVNETHDRSZ: fd 34 vnet_hdr_sz 12
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: tap: tap0: TUNSETSNDBUF: fd 34 sndbuf 2147483647
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: tap: tap0: TUNSETOFFLOAD: fd 34 offload 0x0
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: virtio: tap4096: open vhost-net fd 35 qpair 0
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: virtio: tap4096: VHOST_SET_OWNER: fd 35
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: virtio: tap4096: open vhost-net fd 36 qpair 1
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: virtio: tap4096: VHOST_SET_OWNER: fd 36
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: virtio: tap4096: VHOST_GET_FEATURES: features 0x1033d008000
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: virtio: tap4096: vring 0 size 256 call_fd 37 kick_fd 38
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: virtio: tap4096: vring 1 size 256 call_fd -1 kick_fd 39
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: virtio: tap4096: vring 3 size 256 call_fd -1 kick_fd 40
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: virtio: tap4096: memtable region 0 memory_size 0x400000000 guest_phys_addr 0xfffb40a00000 userspace_addr 0xfffb40a00000
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: virtio: tap4096: VHOST_SET_FEATURES: fd 35 features 0x110008000
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: virtio: tap4096: VHOST_SET_MEM_TABLE: fd 35
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: virtio: tap4096: VHOST_SET_FEATURES: fd 36 features 0x110008000
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: virtio: tap4096: VHOST_SET_MEM_TABLE: fd 36
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: virtio: tap4096: VHOST_SET_VRING_NUM fd 35 index 0 num 256
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: virtio: tap4096: VHOST_SET_VRING_ADDR fd 35 index 0 flags 0x0 desc_user_addr 0xffff48b4bf80 avail_user_addr 0xffff48b49880 used_user_addr 0xffff47be0300
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: virtio: tap4096: VHOST_SET_VRING_CALL fd 35 index 0 call_fd 37
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: virtio: tap4096: VHOST_SET_VRING_KICK fd 35 index 0 kick_fd 38
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: virtio: tap4096: VHOST_NET_SET_BACKEND fd 35 index 0 tap_fd 34
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: virtio: tap4096: VHOST_SET_VRING_NUM fd 35 index 1 num 256
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: virtio: tap4096: VHOST_SET_VRING_ADDR fd 35 index 1 flags 0x0 desc_user_addr 0xffff48b4f300 avail_user_addr 0xffff48b4d000 used_user_addr 0xffff48b50380
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: virtio: tap4096: VHOST_SET_VRING_CALL fd 35 index 1 call_fd -1
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: virtio: tap4096: VHOST_SET_VRING_KICK fd 35 index 1 kick_fd 39
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: virtio: tap4096: VHOST_NET_SET_BACKEND fd 35 index 1 tap_fd 34
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: virtio: tap4096: VHOST_SET_VRING_NUM fd 36 index 1 num 256
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: virtio: tap4096: VHOST_SET_VRING_ADDR fd 36 index 1 flags 0x0 desc_user_addr 0xffff48b51180 avail_user_addr 0xffff48b4d300 used_user_addr 0xffff48b52200
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: virtio: tap4096: VHOST_SET_VRING_CALL fd 36 index 1 call_fd -1
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: virtio: tap4096: VHOST_SET_VRING_KICK fd 36 index 1 kick_fd 40
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: virtio: tap4096: VHOST_NET_SET_BACKEND fd 36 index 1 tap_fd 34
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: ip/neighbor: interface-change: tap4096  add
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: interface: set_mtu: interface tap4096, new mtu 9000
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: linux-cp/itf: mtu_change: sw tap4096 0
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: linux-cp/itf: mtu_change: si tap4096 hi tap4096, syncing children
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: linux-cp/itf: sync_state_hw: hi tap4096
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: interface/caps: change: interface tap4096, set: int-mode, cleared: none
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: interface/rx-queue: set_input_node: node virtio-input for interface tap4096
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: interface/rx-queue: register: interface tap4096 queue-id 0 thread 1
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: interface/rx-queue: set_file_index: interface tap4096 queue-id 0 file-index 9
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: interface/rx-queue: set_rx_queue_mode: interface tap4096 queue-id 0 mode unchanged (polling)
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: interface/runtime: update node 'virtio-input' triggered by interface tap4096
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: interface/runtime: state changed for node virtio-input on thread 0 from interrupt to disabled
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: interface/runtime: state changed for node virtio-input on thread 1 from interrupt to polling
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: interface/runtime: already running under the barrier
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: interface/tx-queue: register: interface tap4096 queue-id 0
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: interface/tx-queue: register: interface tap4096 queue-id 1
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: interface/tx-queue: assign_thread: interface tap4096 queue-id 0 thread 0 queue-shared no
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: interface/tx-queue: assign_thread: interface tap4096 queue-id 1 thread 1 queue-shared no
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: interface/runtime: update node 'virtio-input' triggered by interface tap4096
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: interface/runtime: tx queue data changed for interface tap4096, thread 0 (queue_id 0)
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: interface/runtime: tx queue lookup table changed for interface tap4096, (lookup table [0]=0)
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: interface/runtime: tx queue data changed for interface tap4096, thread 1 (queue_id 1)
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: interface/runtime: tx queue lookup table changed for interface tap4096, (lookup table [0]=1)
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: interface/runtime: already running under the barrier
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: interface: hw_set_flags: hw_if_index 2 flags 0x1
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: linux-cp/itf: pair create: {eth0, tap4096, eth0}
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: linux-cp/itf: add: host:tap4096 phy:eth0, host_if:eth0
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: clib_c11_violation: s1 NULL
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: clib_c11_violation: s2 NULL
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[13] locks:0 uRPF-list: None
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: fib/path: [path:[13] pl-index:13 ip4 weight=1 pref=0 dvr:  tap4096]: create
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[13] locks:0 flags:no-uRPF, uRPF-list: None
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: dpo/load-balance: lb:[dpo-load-balance: [proto:ip4 index:8 buckets:1 uRPF:-1 to:[0:0]]
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[13] locks:1 flags:no-uRPF, uRPF-list: None
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: dpo/load-balance: lb:[dpo-load-balance: [proto:ip4 index:8 buckets:1 uRPF:-1 to:[0:0]]
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[14] locks:0 uRPF-list: None
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: fib/path: [path:[14] pl-index:14 ip6 weight=1 pref=0 dvr:  tap4096]: create
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[14] locks:0 flags:no-uRPF, uRPF-list: None
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: dpo/load-balance: lb:[dpo-load-balance: [proto:ip6 index:8 buckets:1 uRPF:-1 to:[0:0]]
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[14] locks:1 flags:no-uRPF, uRPF-list: None
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: dpo/load-balance: lb:[dpo-load-balance: [proto:ip6 index:8 buckets:1 uRPF:-1 to:[0:0]]
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: linux-cp/mpls-sync: pair_add_cb: mpls enabled 0, parent itf-pair: [0] eth0 tap4096 eth0
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: linux-cp/itf: pair create: itf-pair: [0] eth0 tap4096 eth0
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: interface: sw_admin_up: sw_if_index 2
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: interface: sw_set_flags: sw_if_index 2 flags 0x1
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: linux-cp/itf: admin_state_change: sw tap4096 1
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: ip/neighbor: interface-admin: tap4096  up
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: ip/neighbor: populate: tap4096 ip4
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: ip/neighbor: populate: tap4096 ip6
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: interface: hw_set_flags: hw_if_index 2 flags 0x1
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: interface/runtime: update node 'virtio-input' triggered by interface tap4096
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: interface/runtime: tx queue data changed for interface tap4096, thread 0 (queue_id 0)
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: interface/runtime: tx queue lookup table changed for interface tap4096, (lookup table [0]=0)
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: interface/runtime: tx queue data changed for interface tap4096, thread 1 (queue_id 1)
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: interface/runtime: tx queue lookup table changed for interface tap4096, (lookup table [0]=1)
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: interface/runtime: already running under the barrier
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: linux-cp/router: Early message received for eth0
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: linux-cp/router: Early message received for eth0
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: linux-cp/router: Early message received for eth0
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: linux-cp/router: Early message received for eth0
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: nl/nl: Processed 5 messages
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: linux-cp/router: link: eth0 (6) -> eth0/tap4096 down
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: interface: set_max_frame_size: interface eth0, max_frame_size 9022 -> 9022
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: nl/nl: Processed 1 messages
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: interface: sw_admin_up: sw_if_index 1
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: interface: sw_set_flags: sw_if_index 1 flags 0x1
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: ip/neighbor: interface-admin: eth0  up
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: ip/neighbor: populate: eth0 ip4
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: ip/neighbor: populate: eth0 ip6
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: dpdk: Interface eth0 error -22: Unknown error -22
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: interface: sw_set_flags_helper: dpdk_interface_admin_up_down: Interface start failed
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: linux-cp/router: link: eth0 (6) -> eth0/tap4096 up
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: interface: set_max_frame_size: interface eth0, max_frame_size 9022 -> 9022
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: nl/nl: Processed 2 messages
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: nl/nl: Stopping poll of fd 10
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: nl/nl: Closing netlink socket 10
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: nl/nl: Wait before next synchronization attempt for 2000ms
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: dpdk: [ENA_COM: ena_com_comp_status_to_errno]Admin command failed[6]
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: dpdk: [ENA_COM: ena_com_execute_admin_command]Failed to process command [-22]
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: dpdk: [ENA_COM: ena_com_create_io_sq]Failed to create IO SQ. error: -22
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: dpdk: ENA_DRIVER: ena_create_io_queue(): Failed to create IO queue[0] (qid:0), rc: -22
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: dpdk: ENA_INIT: ena_queue_start(): Failed to create IO queue
Jun 26 15:21:39 ip-172-31-72-221 vpp[3972]: dpdk: ENA_INIT: ena_queue_start_all(): Failed to start queue[0] of type(2)
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: nl/nl: Opened netlink synchronization socket 10 of type 0
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: nl/nl: Opened netlink synchronization socket 42 of type 1
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: nl/nl: Opened netlink synchronization socket 43 of type 2
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: nl/nl: Opened netlink synchronization socket 44 of type 3
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: nl/nl: Starting poll of 45
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: nl/nl: Opened netlink socket 45
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: nl/nl: Dump request sent via socket 10 of type 0
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: nl/nl: Dump request sent via socket 42 of type 1
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: nl/nl: Dump request sent via socket 43 of type 2
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: nl/nl: Dump request sent via socket 44 of type 3
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: linux-cp/router: Begin synchronization of interface configurations
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: linux-cp/router: ignore link add: (nil) - lo
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: linux-cp/router: ignore link add: (nil) - pim6reg
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: interface: sw_admin_up: sw_if_index 1
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: interface: sw_set_flags: sw_if_index 1 flags 0x1
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: ip/neighbor: interface-admin: eth0  up
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: ip/neighbor: populate: eth0 ip4
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: ip/neighbor: populate: eth0 ip6
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: dpdk: Interface eth0 error -22: Unknown error -22
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: interface: sw_set_flags_helper: dpdk_interface_admin_up_down: Interface start failed
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: linux-cp/router: link: eth0 (6) -> eth0/tap4096 up
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: interface: set_max_frame_size: interface eth0, max_frame_size 9022 -> 9022
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: nl/nl: Processed 4 dump replies of type link
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: dpdk: [ENA_COM: ena_com_comp_status_to_errno]Admin command failed[6]
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: dpdk: [ENA_COM: ena_com_execute_admin_command]Failed to process command [-22]
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: dpdk: [ENA_COM: ena_com_create_io_sq]Failed to create IO SQ. error: -22
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: dpdk: ENA_DRIVER: ena_create_io_queue(): Failed to create IO queue[0] (qid:0), rc: -22
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: dpdk: ENA_INIT: ena_queue_start(): Failed to create IO queue
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: dpdk: ENA_INIT: ena_queue_start_all(): Failed to start queue[0] of type(2)
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: linux-cp/router: End synchronization of interface configurations
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: linux-cp/router: Begin synchronization of interface addresses
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: nl/nl: Processed 4 dump replies of type address
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: linux-cp/router: End synchronization of interface addresses
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: linux-cp/router: Begin synchronization of neighbors
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: linux-cp/router: ignore neighbour add on: 1
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: linux-cp/router: ignore neighbor add: ff02::16 eth0
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: nl/nl: Processed 3 dump replies of type neighbor
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: linux-cp/router: End synchronization of neighbors
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: mfib/entry: e:[8:(*, ff00::/8)]: alloc
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[15] locks:0 uRPF-list: None
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[15] locks:0 flags:no-uRPF, uRPF-list: None
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[15] locks:1 flags:no-uRPF, uRPF-list: None
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: fib/path: [path:[15] pl-index:15 ip6 weight=1 pref=0 receive:  cfg-flags:local,]: create
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[15] locks:1 flags:no-uRPF, uRPF-list: None
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: dpo/replicate: rep:[dpo-replicate: [index:6 buckets:0 flags:[none] to:[0:0]]]:create
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: linux-cp/router: route add: 254:fe80::/64 connected,attached,
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: linux-cp/router: route skip: 254:fe80::/64 connected,attached,
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: nl/nl: Processed 9 dump replies of type route
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: linux-cp/router: End synchronization of ipv6 routes in table 0
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: nl/nl: Closing netlink synchronization socket 10 of type 0
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: nl/nl: Closing netlink synchronization socket 42 of type 1
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: nl/nl: Closing netlink synchronization socket 43 of type 2
Jun 26 15:21:41 ip-172-31-72-221 vpp[3972]: nl/nl: Closing netlink synchronization socket 44 of type 3
Jun 26 15:21:42 ip-172-31-72-221 vpp[3972]: interface: sw_admin_up: sw_if_index 1
Jun 26 15:21:42 ip-172-31-72-221 vpp[3972]: interface: sw_set_flags: sw_if_index 1 flags 0x1
Jun 26 15:21:42 ip-172-31-72-221 vpp[3972]: ip/neighbor: interface-admin: eth0  up
Jun 26 15:21:42 ip-172-31-72-221 vpp[3972]: ip/neighbor: populate: eth0 ip4
Jun 26 15:21:42 ip-172-31-72-221 vpp[3972]: ip/neighbor: populate: eth0 ip6
Jun 26 15:21:42 ip-172-31-72-221 vpp[3972]: dpdk: Interface eth0 error -22: Unknown error -22
Jun 26 15:21:42 ip-172-31-72-221 vpp[3972]: interface: sw_set_flags_helper: dpdk_interface_admin_up_down: Interface start failed
Jun 26 15:21:42 ip-172-31-72-221 vpp[3972]: linux-cp/router: link: eth0 (6) -> eth0/tap4096 up
Jun 26 15:21:42 ip-172-31-72-221 vpp[3972]: interface: set_max_frame_size: interface eth0, max_frame_size 9022 -> 9022
Jun 26 15:21:42 ip-172-31-72-221 vpp[3972]: nl/nl: Processed 1 messages
Jun 26 15:21:42 ip-172-31-72-221 vpp[3972]: dpdk: [ENA_COM: ena_com_comp_status_to_errno]Admin command failed[6]
Jun 26 15:21:42 ip-172-31-72-221 vpp[3972]: dpdk: [ENA_COM: ena_com_execute_admin_command]Failed to process command [-22]
Jun 26 15:21:42 ip-172-31-72-221 vpp[3972]: dpdk: [ENA_COM: ena_com_create_io_sq]Failed to create IO SQ. error: -22
Jun 26 15:21:42 ip-172-31-72-221 vpp[3972]: dpdk: ENA_DRIVER: ena_create_io_queue(): Failed to create IO queue[0] (qid:0), rc: -22
Jun 26 15:21:42 ip-172-31-72-221 vpp[3972]: dpdk: ENA_INIT: ena_queue_start(): Failed to create IO queue
Jun 26 15:21:42 ip-172-31-72-221 vpp[3972]: dpdk: ENA_INIT: ena_queue_start_all(): Failed to start queue[0] of type(2)
Jun 26 15:21:42 ip-172-31-72-221 vpp[3972]: interface: sw_admin_up: sw_if_index 1
Jun 26 15:21:42 ip-172-31-72-221 vpp[3972]: interface: sw_set_flags: sw_if_index 1 flags 0x1
Jun 26 15:21:42 ip-172-31-72-221 vpp[3972]: ip/neighbor: interface-admin: eth0  up
Jun 26 15:21:42 ip-172-31-72-221 vpp[3972]: ip/neighbor: populate: eth0 ip4
Jun 26 15:21:42 ip-172-31-72-221 vpp[3972]: ip/neighbor: populate: eth0 ip6
Jun 26 15:21:42 ip-172-31-72-221 vpp[3972]: dpdk: Interface eth0 error -22: Unknown error -22
Jun 26 15:21:42 ip-172-31-72-221 vpp[3972]: interface: sw_set_flags_helper: dpdk_interface_admin_up_down: Interface start failed
Jun 26 15:21:42 ip-172-31-72-221 vpp[3972]: linux-cp/router: link: eth0 (6) -> eth0/tap4096 up
Jun 26 15:21:42 ip-172-31-72-221 vpp[3972]: interface: set_max_frame_size: interface eth0, max_frame_size 9022 -> 9022
Jun 26 15:21:42 ip-172-31-72-221 vpp[3972]: nl/nl: Processed 1 messages
Jun 26 15:21:42 ip-172-31-72-221 vpp[3972]: dpdk: [ENA_COM: ena_com_comp_status_to_errno]Admin command failed[6]
Jun 26 15:21:42 ip-172-31-72-221 vpp[3972]: dpdk: [ENA_COM: ena_com_execute_admin_command]Failed to process command [-22]
Jun 26 15:21:42 ip-172-31-72-221 vpp[3972]: dpdk: [ENA_COM: ena_com_create_io_sq]Failed to create IO SQ. error: -22
Jun 26 15:21:42 ip-172-31-72-221 vpp[3972]: dpdk: ENA_DRIVER: ena_create_io_queue(): Failed to create IO queue[0] (qid:0), rc: -22
Jun 26 15:21:42 ip-172-31-72-221 vpp[3972]: dpdk: ENA_INIT: ena_queue_start(): Failed to create IO queue
Jun 26 15:21:42 ip-172-31-72-221 vpp[3972]: dpdk: ENA_INIT: ena_queue_start_all(): Failed to start queue[0] of type(2)
Jun 26 15:21:42 ip-172-31-72-221 vpp[3972]: interface: sw_admin_up: sw_if_index 1
Jun 26 15:21:42 ip-172-31-72-221 vpp[3972]: interface: sw_set_flags: sw_if_index 1 flags 0x1
Jun 26 15:21:42 ip-172-31-72-221 vpp[3972]: ip/neighbor: interface-admin: eth0  up
Jun 26 15:21:42 ip-172-31-72-221 vpp[3972]: ip/neighbor: populate: eth0 ip4
Jun 26 15:21:42 ip-172-31-72-221 vpp[3972]: ip/neighbor: populate: eth0 ip6
Jun 26 15:21:42 ip-172-31-72-221 vpp[3972]: dpdk: Interface eth0 error -22: Unknown error -22
Jun 26 15:21:42 ip-172-31-72-221 vpp[3972]: interface: sw_set_flags_helper: dpdk_interface_admin_up_down: Interface start failed
Jun 26 15:21:42 ip-172-31-72-221 vpp[3972]: linux-cp/router: link: eth0 (6) -> eth0/tap4096 up
Jun 26 15:21:42 ip-172-31-72-221 vpp[3972]: interface: set_max_frame_size: interface eth0, max_frame_size 9022 -> 9022
Jun 26 15:21:42 ip-172-31-72-221 vpp[3972]: nl/nl: Processed 1 messages
Jun 26 15:21:42 ip-172-31-72-221 vpp[3972]: dpdk: [ENA_COM: ena_com_comp_status_to_errno]Admin command failed[6]
Jun 26 15:21:42 ip-172-31-72-221 vpp[3972]: dpdk: [ENA_COM: ena_com_execute_admin_command]Failed to process command [-22]
Jun 26 15:21:42 ip-172-31-72-221 vpp[3972]: dpdk: [ENA_COM: ena_com_create_io_sq]Failed to create IO SQ. error: -22
Jun 26 15:21:42 ip-172-31-72-221 vpp[3972]: dpdk: ENA_DRIVER: ena_create_io_queue(): Failed to create IO queue[0] (qid:0), rc: -22
Jun 26 15:21:42 ip-172-31-72-221 vpp[3972]: dpdk: ENA_INIT: ena_queue_start(): Failed to create IO queue
Jun 26 15:21:42 ip-172-31-72-221 vpp[3972]: dpdk: ENA_INIT: ena_queue_start_all(): Failed to start queue[0] of type(2)
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[5] locks:2 flags:no-uRPF, uRPF-list: None
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path: [path:[16] pl-index:5 ip4 weight=1 pref=0 attached:  eth0]: create
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[5] locks:2 flags:no-uRPF, uRPF-list: None
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: interface: hw_add_del_mac_address: dpdk_add_del_mac_address: mac address add/del failed: -95
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[6] locks:2 flags:no-uRPF, uRPF-list: None
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path: [path:[17] pl-index:6 ip4 weight=1 pref=0 attached:  eth0]: create
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[6] locks:2 flags:no-uRPF, uRPF-list: None
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: interface: hw_add_del_mac_address: dpdk_add_del_mac_address: mac address add/del failed: -95
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: ip/neighbor: addr-add: eth0, 172.31.72.221/20
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: mfib/entry: e:[9:(*, 224.0.0.0/24)]: alloc
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[16] locks:0 uRPF-list: None
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[16] locks:0 flags:no-uRPF, uRPF-list: None
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[16] locks:1 flags:no-uRPF, uRPF-list: None
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path: [path:[18] pl-index:16 ip4 weight=1 pref=0 attached:  eth0]: create
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[16] locks:1 flags:no-uRPF, uRPF-list: None
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: interface: hw_add_del_mac_address: dpdk_add_del_mac_address: mac address add/del failed: -95
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: linux-cp/router: link-addr: eth0 172.31.72.221/20
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[17] locks:0 uRPF-list: None
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[17] locks:0 flags:local, uRPF-list: None
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/entry: [@4:[255.255.255.255/32]:local,:lcp-rt]: deactivate: 4
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[4] locks:2 flags:drop, uPRF-list:4 len:0 itfs:[]
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[17] locks:2 flags:local, uPRF-list:7 len:0 itfs:[]
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/entry: [@4:[255.255.255.255/32]:local,:lcp-rt]: activate: 17
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/entry: [@4:[255.255.255.255/32]:local,:lcp-rt]: install: 4
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/entry: [@4:[255.255.255.255/32]:local,:lcp-rt]: special-add:lcp-rt
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[16] locks:2 flags:no-uRPF, uRPF-list: None
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path: [path:[20] pl-index:16 ip4 weight=1 pref=0 receive:  cfg-flags:local,]: create
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[16] locks:2 flags:no-uRPF, uRPF-list: None
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: dpo/replicate: rep:[dpo-replicate: [index:7 buckets:0 flags:[none] to:[0:0]]]:create
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: linux-cp/router: route add: 254:172.31.64.0/20 connected,attached,
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: linux-cp/router:  path:[ip4 0.0.0.0, eth0, []]
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: linux-cp/router: route skip: 254:172.31.64.0/20 connected,attached,
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: nl/nl: Processed 4 messages
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: interface: sw_admin_up: sw_if_index 1
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: interface: sw_set_flags: sw_if_index 1 flags 0x1
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/walk: [[@0] parent:{adj:2} visits:0 flags:1]:sync-start: if-up
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path: [path:[18] pl-index:16 ip4 weight=1 pref=0 attached:  eth0]: bw:if-up
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[16] locks:2 flags:no-uRPF, uPRF-list:8 len:1 itfs:[1, ]
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/walk: [[@1] parent:{path-list:16} visits:0 flags:1]:sync-start: if-up
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/walk: [[@1] parent:{path-list:16} visits:1 flags:5]:sync-stop: if-up
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path: [path:[17] pl-index:6 ip4 weight=1 pref=0 attached:  eth0]: bw:if-up
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[6] locks:2 flags:no-uRPF, uPRF-list:9 len:1 itfs:[1, ]
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/walk: [[@1] parent:{path-list:6} visits:0 flags:1]:sync-start: if-up
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/walk: [[@1] parent:{path-list:6} visits:1 flags:5]:sync-stop: if-up
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path: [path:[16] pl-index:5 ip4 weight=1 pref=0 attached:  eth0]: bw:if-up
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[5] locks:2 flags:no-uRPF, uPRF-list:10 len:1 itfs:[1, ]
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/walk: [[@1] parent:{path-list:5} visits:0 flags:1]:sync-start: if-up
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/walk: [[@1] parent:{path-list:5} visits:1 flags:5]:sync-stop: if-up
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/walk: [[@0] parent:{adj:2} visits:3 flags:5]:sync-stop: if-up
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: ip/neighbor: interface-admin: eth0  up
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: ip/neighbor: populate: eth0 ip4
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: ip/neighbor: populate: eth0 ip6
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[18] locks:0 uRPF-list: None
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[18] locks:0 uRPF-list: None
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[19] locks:0 uRPF-list: None
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path: [path:[22] pl-index:19 ip4 weight=1 pref=0 attached:  cfg-flags:glean, eth0]: create
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[19] locks:0 uRPF-list: None
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[18] locks:0 uPRF-list:11 len:0 itfs:[]
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[18] locks:0 uPRF-list:11 len:0 itfs:[]
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path: [path:[21] pl-index:18 ip4 weight=1 pref=0 exclusive:  oper-flags:resolved,[@0]: dpo-drop ip4]: destroy
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path: [path:[22] pl-index:19 ip4 weight=1 pref=0 attached:  oper-flags:resolved, cfg-flags:glean, eth0]: recursive loop cleared
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[19] locks:2 uPRF-list:12 len:1 itfs:[1, ]
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/entry: [@7:[172.31.64.0/20]:connected,attached,:interface]: activate: 19
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: dpo/load-balance: lb:[dpo-load-balance: [proto:ip4 index:8 buckets:0 uRPF:-1 to:[0:0]]]:create
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/entry: [@7:[172.31.64.0/20]:connected,attached,:interface]: install: 4
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/entry: [@7:[172.31.64.0/20]:connected,attached,:interface]: create
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[18] locks:0 uRPF-list: None
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[18] locks:0 flags:drop, uRPF-list: None
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[18] locks:2 flags:drop, uPRF-list:11 len:0 itfs:[]
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/entry: [@8:[172.31.64.0/32]:drop,uRPF-exempt,:interface]: activate: 18
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: dpo/load-balance: lb:[dpo-load-balance: [proto:ip4 index:9 buckets:0 uRPF:-1 to:[0:0]]]:create
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/entry: [@8:[172.31.64.0/32]:drop,uRPF-exempt,:interface]: install: 4
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/entry: [@8:[172.31.64.0/32]:drop,uRPF-exempt,:interface]: create-special
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[20] locks:0 uRPF-list: None
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[20] locks:0 flags:drop, uRPF-list: None
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[20] locks:2 flags:drop, uPRF-list:14 len:0 itfs:[]
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/entry: [@9:[172.31.79.255/32]:drop,uRPF-exempt,:interface]: activate: 20
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: dpo/load-balance: lb:[dpo-load-balance: [proto:ip4 index:10 buckets:0 uRPF:-1 to:[0:0]]]:create
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/entry: [@9:[172.31.79.255/32]:drop,uRPF-exempt,:interface]: install: 4
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/entry: [@9:[172.31.79.255/32]:drop,uRPF-exempt,:interface]: create-special
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[21] locks:0 uRPF-list: None
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[21] locks:0 flags:local, uRPF-list: None
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[22] locks:0 uRPF-list: None
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path: [path:[25] pl-index:22 ip4 weight=1 pref=0 receive:  cfg-flags:local,]: create
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[22] locks:0 flags:local, uRPF-list: None
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[21] locks:0 flags:local, uPRF-list:16 len:0 itfs:[]
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[21] locks:0 flags:local, uPRF-list:16 len:0 itfs:[]
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path: [path:[24] pl-index:21 ip4 weight=1 pref=0 receive:  oper-flags:resolved, cfg-flags:local,[@0]: dpo-receive: 0.0.0.0 on local0]: destroy
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/entry: [@7:[172.31.64.0/20]:connected,attached,:interface]: cover-track 10
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[22] locks:2 flags:local, uPRF-list:17 len:0 itfs:[]
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/entry: [@10:[172.31.72.221/32]:connected,local,:interface]: activate: 22
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: dpo/load-balance: lb:[dpo-load-balance: [proto:ip4 index:11 buckets:0 uRPF:-1 to:[0:0]]]:create
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/entry: [@10:[172.31.72.221/32]:connected,local,:interface]: install: 4
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/entry: [@10:[172.31.72.221/32]:connected,local,:interface]: create
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: dpdk: Interface eth0 error -22: Unknown error -22
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: interface: sw_set_flags_helper: dpdk_interface_admin_up_down: Interface start failed
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: linux-cp/router: link: eth0 (6) -> eth0/tap4096 up
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: interface: set_max_frame_size: interface eth0, max_frame_size 9022 -> 1522
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: dpdk: [0] max_frame_size set to 1522 by setting MTU to 1504
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: interface: set_mtu: interface eth0, new mtu 1500
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: nl/nl: Processed 1 messages
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: dpdk: [ENA_COM: ena_com_comp_status_to_errno]Admin command failed[6]
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: dpdk: [ENA_COM: ena_com_execute_admin_command]Failed to process command [-22]
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: dpdk: [ENA_COM: ena_com_create_io_sq]Failed to create IO SQ. error: -22
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: dpdk: ENA_DRIVER: ena_create_io_queue(): Failed to create IO queue[0] (qid:0), rc: -22
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: dpdk: ENA_INIT: ena_queue_start(): Failed to create IO queue
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: dpdk: ENA_INIT: ena_queue_start_all(): Failed to start queue[0] of type(2)
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: dpdk: ENA_DRIVER: ena_mtu_set(): MTU set to: 1504
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: linux-cp/router: route add: 254:0.0.0.0/0
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: linux-cp/router:  path:[ip4 172.31.64.1, eth0, []]
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[21] locks:0 uRPF-list: None
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path: [path:[24] pl-index:21 ip4 weight=1 pref=20 attached-nexthop: 172.31.64.1 eth0  unresolved]: create
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[21] locks:0 flags:shared, uRPF-list: None
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[21] locks:0 flags:shared, uRPF-list: None
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/entry: [@0:[0.0.0.0/0]::lcp-rt-dynamic]: deactivate: 0
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[0] locks:2 flags:drop, uPRF-list:0 len:0 itfs:[]
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path: [path:[24] pl-index:21 ip4 weight=1 pref=20 attached-nexthop: 172.31.64.1 eth0[@0]: arp-ipv4: via 172.31.64.1 eth0]: recursive loop cleared
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[21] locks:2 flags:shared, uPRF-list:16 len:1 itfs:[1, ]
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/entry: [@0:[0.0.0.0/0]::lcp-rt-dynamic]: activate: 21
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/entry: [@0:[0.0.0.0/0]::lcp-rt-dynamic]: install: 4
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/entry: [@0:[0.0.0.0/0]::lcp-rt-dynamic]: path add:lcp-rt-dynamic
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: nl/nl: Processed 1 messages
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: linux-cp/router: route add: 254:fe80::/64 connected,attached,
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: linux-cp/router:  path:[ip6 0.0.0.0, eth0, []]
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: linux-cp/router: route skip: 254:fe80::/64 connected,attached,
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: ip6/link: enable: eth0
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[23] locks:0 uRPF-list: None
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[23] locks:0 flags:drop, uRPF-list: None
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[23] locks:2 flags:drop, uPRF-list:18 len:0 itfs:[]
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/entry: [@11:[::/0]:drop,:default-route]: activate: 23
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: dpo/load-balance: lb:[dpo-load-balance: [proto:ip6 index:12 buckets:0 uRPF:-1 to:[0:0]]]:create
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/entry: [@11:[::/0]:drop,:default-route]: install: 260
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/entry: [@11:[::/0]:drop,:default-route]: create-special
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[24] locks:0 uRPF-list: None
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[24] locks:0 uRPF-list: None
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[24] locks:2 uPRF-list:19 len:0 itfs:[]
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/entry: [@12:[fe80::/10]::special]: activate: 24
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: dpo/load-balance: lb:[dpo-load-balance: [proto:ip6 index:13 buckets:0 uRPF:-1 to:[0:0]]]:create
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/entry: [@12:[fe80::/10]::special]: install: 260
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/entry: [@12:[fe80::/10]::special]: create-special
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[25] locks:0 uRPF-list: None
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path: [path:[28] pl-index:25 ip6 weight=1 pref=0 attached:  cfg-flags:glean, eth0]: create
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path-list: [path-list:[25] locks:0 flags:shared, uRPF-list: None
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path-list: --- message(s) throttled ---
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/entry: [@12:[fe80::/10]:attached,no-attached-export,:special]: reactivate: 24 to 25
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path: [path:[28] pl-index:25 ip6 weight=1 pref=0 attached:  cfg-flags:glean, eth0]: recursive loop cleared
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path: [path:[27] pl-index:24 ip6 weight=1 pref=0 exclusive:  oper-flags:resolved,[@0]: ip6-link-local]: destroy
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/entry: [@12:[fe80::/10]:attached,no-attached-export,:special]: install: 260
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/entry: [@12:[fe80::/10]:attached,no-attached-export,:special]: update
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path: [path:[29] pl-index:26 ip6 weight=1 pref=0 receive:  cfg-flags:local,]: create
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path: [path:[27] pl-index:24 ip6 weight=1 pref=0 receive:  oper-flags:resolved, cfg-flags:local,[@0]: dpo-receive: 0.0.0.0 on local0]: destroy
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/entry: [@13:[fe80::14ff:faff:fe4b:9877/128]:connected,local,:IPv6-nd]: activate: 26
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: dpo/load-balance: lb:[dpo-load-balance: [proto:ip6 index:14 buckets:0 uRPF:-1 to:[0:0]]]:create
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/entry: [@13:[fe80::14ff:faff:fe4b:9877/128]:connected,local,:IPv6-nd]: install: 260
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/entry: [@13:[fe80::14ff:faff:fe4b:9877/128]:connected,local,:IPv6-nd]: create
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path: [path:[27] pl-index:9 ip6 weight=1 pref=0 attached:  eth0]: create
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: interface: hw_add_del_mac_address: dpdk_add_del_mac_address: mac address add/del failed: -95
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path: [path:[30] pl-index:10 ip6 weight=1 pref=0 attached:  eth0]: create
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: interface: hw_add_del_mac_address: dpdk_add_del_mac_address: mac address add/del failed: -95
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path: [path:[31] pl-index:11 ip6 weight=1 pref=0 attached:  eth0]: create
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: interface: hw_add_del_mac_address: dpdk_add_del_mac_address: mac address add/del failed: -95
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path: [path:[32] pl-index:12 ip6 weight=1 pref=0 attached:  eth0]: create
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: interface: hw_add_del_mac_address: dpdk_add_del_mac_address: mac address add/del failed: -95
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: ip6/link: set-ll: eth0 -> fe80::14ff:faff:fe4b:9877
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/entry: [@13:[fe80::14ff:faff:fe4b:9877/128]:connected,local,:IPv6-nd]: special remove:IPv6-nd
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/entry: [@13:[fe80::14ff:faff:fe4b:9877/128]:connected,local,:IPv6-nd]: deactivate: 26
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path: [path:[29] pl-index:26 ip6 weight=1 pref=0 receive:  oper-flags:resolved, cfg-flags:local,[@0]: dpo-receive: fe80::14ff:faff:fe4b:9877 on eth0]: destroy
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/entry: [@13:[fe80::14ff:faff:fe4b:9877/128]::invalid]: uninstall
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: dpo/load-balance: lb:[dpo-load-balance: [proto:ip6 index:14 buckets:1 uRPF:21 to:[0:0]]
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/entry: [@13:[fe80::14ff:faff:fe4b:9877/128]::invalid]: last-lock
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/entry: [@12:[fe80::/10]:attached,no-attached-export,:special]: special remove:special
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/entry: [@12:[fe80::/10]:attached,no-attached-export,:special]: deactivate: 25
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path: [path:[28] pl-index:25 ip6 weight=1 pref=0 attached:  cfg-flags:glean, eth0]: recursive loop cleared
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path: [path:[28] pl-index:25 ip6 weight=1 pref=0 attached:  cfg-flags:glean, eth0]: destroy
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/entry: [@12:[fe80::/10]::invalid]: uninstall
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: dpo/load-balance: lb:[dpo-load-balance: [proto:ip6 index:13 buckets:1 uRPF:20 to:[0:0]]
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/entry: [@12:[fe80::/10]::invalid]: last-lock
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/entry: [@11:[::/0]:drop,:default-route]: special remove:default-route
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/entry: [@11:[::/0]:drop,:default-route]: deactivate: 23
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path: [path:[26] pl-index:23 ip6 weight=1 pref=0 special:  cfg-flags:drop,[@0]: dpo-drop ip6]: destroy
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/entry: [@11:[::/0]::invalid]: uninstall
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: dpo/load-balance: lb:[dpo-load-balance: [proto:ip6 index:12 buckets:1 uRPF:18 to:[0:0]]
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/entry: [@11:[::/0]::invalid]: last-lock
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/entry: [@11:[::/0]:drop,:default-route]: activate: 23
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: dpo/load-balance: lb:[dpo-load-balance: [proto:ip6 index:12 buckets:0 uRPF:-1 to:[0:0]]]:create
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/entry: [@11:[::/0]:drop,:default-route]: install: 260
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/entry: [@11:[::/0]:drop,:default-route]: create-special
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/entry: [@12:[fe80::/10]::special]: activate: 25
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: dpo/load-balance: lb:[dpo-load-balance: [proto:ip6 index:13 buckets:0 uRPF:-1 to:[0:0]]]:create
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/entry: [@12:[fe80::/10]::special]: install: 260
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/entry: --- message(s) throttled ---
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path: [path:[29] pl-index:26 ip6 weight=1 pref=0 attached:  cfg-flags:glean, eth0]: create
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path: [path:[29] pl-index:26 ip6 weight=1 pref=0 attached:  cfg-flags:glean, eth0]: recursive loop cleared
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path: [path:[28] pl-index:25 ip6 weight=1 pref=0 exclusive:  oper-flags:resolved,[@0]: ip6-link-local]: destroy
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path: [path:[33] pl-index:24 ip6 weight=1 pref=0 receive:  cfg-flags:local,]: create
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: fib/path: [path:[28] pl-index:25 ip6 weight=1 pref=0 receive:  oper-flags:resolved, cfg-flags:local,[@0]: dpo-receive: 0.0.0.0 on local0]: destroy
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: dpo/load-balance: lb:[dpo-load-balance: [proto:ip6 index:14 buckets:0 uRPF:-1 to:[0:0]]]:create
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: linux-cp/router: link-addr: eth0 fe80::14ff:faff:fe4b:9877/64
Jun 26 15:21:43 ip-172-31-72-221 vpp[3972]: nl/nl: Processed 2 messages
Jun 26 15:21:43 ip-172-31-72-221 vyos-configd[779]: [vpp]
Jun 26 15:21:43 ip-172-31-72-221 vyos-configd[779]: scripts_called: ['vpp']
Jun 26 15:21:44 ip-172-31-72-221 vpp[3972]: ip6/link: set-ll: eth0 -> fe80::14ff:faff:fe4b:9877
Jun 26 15:21:44 ip-172-31-72-221 vpp[3972]: fib/path: [path:[33] pl-index:24 ip6 weight=1 pref=0 receive:  oper-flags:resolved, cfg-flags:local,[@0]: dpo-receive: fe80::14ff:faff:fe4b:9877 on eth0]: destroy
Jun 26 15:21:44 ip-172-31-72-221 vpp[3972]: dpo/load-balance: lb:[dpo-load-balance: [proto:ip6 index:14 buckets:1 uRPF:19 to:[0:0]]
Jun 26 15:21:44 ip-172-31-72-221 vpp[3972]: fib/path: [path:[29] pl-index:26 ip6 weight=1 pref=0 attached:  cfg-flags:glean, eth0]: recursive loop cleared
Jun 26 15:21:44 ip-172-31-72-221 vpp[3972]: fib/path: [path:[29] pl-index:26 ip6 weight=1 pref=0 attached:  cfg-flags:glean, eth0]: destroy
Jun 26 15:21:44 ip-172-31-72-221 vpp[3972]: dpo/load-balance: lb:[dpo-load-balance: [proto:ip6 index:13 buckets:1 uRPF:21 to:[0:0]]
Jun 26 15:21:44 ip-172-31-72-221 vpp[3972]: fib/path: [path:[26] pl-index:23 ip6 weight=1 pref=0 special:  cfg-flags:drop,[@0]: dpo-drop ip6]: destroy
Jun 26 15:21:44 ip-172-31-72-221 vpp[3972]: dpo/load-balance: lb:[dpo-load-balance: [proto:ip6 index:12 buckets:1 uRPF:18 to:[0:0]]
Jun 26 15:21:44 ip-172-31-72-221 vpp[3972]: dpo/load-balance: lb:[dpo-load-balance: [proto:ip6 index:12 buckets:0 uRPF:-1 to:[0:0]]]:create
Jun 26 15:21:44 ip-172-31-72-221 vpp[3972]: dpo/load-balance: lb:[dpo-load-balance: [proto:ip6 index:13 buckets:0 uRPF:-1 to:[0:0]]]:create
Jun 26 15:21:44 ip-172-31-72-221 vpp[3972]: fib/path: [path:[33] pl-index:24 ip6 weight=1 pref=0 attached:  cfg-flags:glean, eth0]: create
Jun 26 15:21:44 ip-172-31-72-221 vpp[3972]: fib/path: [path:[33] pl-index:24 ip6 weight=1 pref=0 attached:  cfg-flags:glean, eth0]: recursive loop cleared
Jun 26 15:21:44 ip-172-31-72-221 vpp[3972]: fib/path: [path:[29] pl-index:26 ip6 weight=1 pref=0 exclusive:  oper-flags:resolved,[@0]: ip6-link-local]: destroy
Jun 26 15:21:44 ip-172-31-72-221 vpp[3972]: fib/path: [path:[28] pl-index:25 ip6 weight=1 pref=0 receive:  cfg-flags:local,]: create
Jun 26 15:21:44 ip-172-31-72-221 vpp[3972]: fib/path: [path:[29] pl-index:26 ip6 weight=1 pref=0 receive:  oper-flags:resolved, cfg-flags:local,[@0]: dpo-receive: 0.0.0.0 on local0]: destroy
Jun 26 15:21:44 ip-172-31-72-221 vpp[3972]: dpo/load-balance: lb:[dpo-load-balance: [proto:ip6 index:14 buckets:0 uRPF:-1 to:[0:0]]]:create
Jun 26 15:21:44 ip-172-31-72-221 vpp[3972]: linux-cp/router: link-addr: eth0 fe80::14ff:faff:fe4b:9877/64
Jun 26 15:21:44 ip-172-31-72-221 vpp[3972]: nl/nl: Processed 3 messages

It seems that the problem is in ENA DPDK driver - it fails to initialize an admin queue. But I'm not sure why. The issue can be traced to:

And likely then to:

But then, I am lost - the error is originated by either the firmware or something that is out of my field of view.

I may assume that firmware does not like something in the parameters passed to a VF during initialization, but I do not see what exactly. Probably, this needs to be traced.

Details

Version: 2026.01.07-0020-rolling
Is it a breaking change?: Unspecified (possibly destroys the router)
Issue type: Bug (incorrect behavior)

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Open	BUG	None	T7070 VPP related bugs the root task
		Open	BUG	None	T8163 ENA interface (in AWS) cannot be initialized by VPP in ARM64 instances

Event Timeline

zsdc created this task.Wed, Jan 7, 7:20 PM

pasik subscribed.Thu, Jan 8, 7:23 AM

Viacheslav triaged this task as Normal priority.Thu, Jan 8, 10:59 AM

Viacheslav added a parent task: T7070: VPP related bugs the root task.

ENA interface (in AWS) cannot be initialized by VPP in ARM64 instancesOpen, NormalPublicBUGActions

Description

Details

Related ObjectsSearch...

Event Timeline

ENA interface (in AWS) cannot be initialized by VPP in ARM64 instances
Open, NormalPublicBUG
Actions

Related Objects
Search...