After upgrading one of our routers to VyOS 1.3-rolling-202010110146, we are investigating issues with VxLAN with the same configuration before upgrading the router.
The destination gets ARP packets from the source side (the upgraded VyOS router), but if the destination replies to these ARP packets, the source does not them.
Rolling back to the May build solves the issue. A fresh installation with a new configuration does not help.
We are using the following October build:
Version: VyOS 1.3-rolling-202010110146 Release Train: equuleus Built by: [email protected] Built on: Sun 11 Oct 2020 01:46 UTC Build UUID: 94bc3836-a078-407e-8b66-7b4760a64233 Build Commit ID:
and the following May build (before upgrading):
Version: VyOS 1.3-rolling-202005260117 Release Train: equuleus Built by: [email protected] Built on: Tue 26 May 2020 01:17 UTC Build UUID: c9832ae0-9cab-4287-bb2d-5d9bdfa02312 Build Commit ID: a29347ca9dd260
This is the one of our VxLAN configurations on the upgraded router:
set interfaces vxlan vxlan122 address '10.0.122.1/30` set interfaces vxlan vxlan122 address 'fd01:122::1/127' set interfaces vxlan vxlan122 description 'VNI 122' set interfaces vxlan vxlan122 port '4789' set interfaces vxlan vxlan122 remote '116.202.x.xxx' set interfaces vxlan vxlan122 source-address '45.xx.xx.x' set interfaces vxlan vxlan122 vni '122'
A bit of investigation showed me that the local parameter is missing on the interface config in May build:
## ip -d l sh output on the source side # May ip -d l sh vxlan122 6: vxlan122: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1450 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000 link/ether 86:a1:c1:5f:ba:2a brd ff:ff:ff:ff:ff:ff promiscuity 0 minmtu 68 maxmtu 65535 vxlan id 122 remote 116.202.x.xxx srcport 0 0 dstport 4789 ttl auto ageing 300 udpcsum noudp6zerocsumtx noudp6zerocsumrx addrgenmode none numtxqueues 1 numrxqueues 1 gso_max_size 65536 gso_max_segs 65535 alias VNI 122 # October 12: vxlan122: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1450 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000 link/ether 1e:0f:e8:39:16:29 brd ff:ff:ff:ff:ff:ff promiscuity 0 minmtu 68 maxmtu 65535 vxlan id 122 remote 116.202.x.xxx local 45.xx.xx.x srcport 0 0 dstport 4789 ttl auto ageing 300 udpcsum noudp6zerocsumtx noudp6zerocsumrx addrgenmode none numtxqueues 1 numrxqueues 1 gso_max_size 65536 gso_max_segs 65535 alias VNI 122
October build tcpdumps:
tcpdump on source side:
tcpdump: listening on vxlan122, link-type EN10MB (Ethernet), capture size 262144 bytes 15:11:30.346066 ARP, Ethernet (len 6), IPv4 (len 4), Request who-has 10.0.122.2 tell 10.0.122.1, length 28 15:11:31.356431 ARP, Ethernet (len 6), IPv4 (len 4), Request who-has 10.0.122.2 tell 10.0.122.1, length 28
tcpdump on destination side:
tcpdump: listening on vxlan122, link-type EN10MB (Ethernet), capture size 262144 bytes 17:10:30.135055 ARP, Ethernet (len 6), IPv4 (len 4), Request who-has 10.0.122.2 tell 10.0.122.1, length 28 17:10:30.135131 ARP, Ethernet (len 6), IPv4 (len 4), Reply 10.0.122.2 is-at 42:b5:43:36:a8:4d (oui Unknown), length 28 17:10:31.158696 ARP, Ethernet (len 6), IPv4 (len 4), Request who-has 10.0.122.2 tell 10.0.122.1, length 28 17:10:31.158752 ARP, Ethernet (len 6), IPv4 (len 4), Reply 10.0.122.2 is-at 42:b5:43:36:a8:4d (oui Unknown), length 28