I'm having lots of issues with EVPN-VXLAN L3VPN, now at the point where I can't apply config at runtime and have to reboot, or on this node can't apply the config at all.
Note that this bug seems to be a config validation error, see below why.
I have other configs (I will create separate issues) that work when applied on boot, but can't be adjusted at runtime!
The issue seems to be the advertise-all-vni in the vrf! Once advertise-all-vni in the vrf is removed, the config works. This makes sense, this is clearly an invalid config, however this MUST be caught by the validation and not cause weird errors.
vrf {
name vrf_Elim01 {
protocols {
bgp {
address-family {
l2vpn-evpn {
advertise-all-vni
}Some example error output below:
vyos@pve-sdn-test-vyos-01:~$ cat /tmp/boot-config-trace
Traceback (most recent call last):
File "/usr/libexec/vyos/vyos-boot-config-loader.py", line 145, in <module>
commit_out = session.commit()
^^^^^^^^^^^^^^^^
File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 325, in commit
out = self.__run_command([COMMIT])
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 252, in __run_command
raise ConfigSessionError(output)
vyos.configsession.ConfigSessionError: Processing the Priority Queue
Entering the _commit_check_cfg_node
Elapsed 0.000 sec: _commit_check_cfg_node
Entering the _commit_exec_cfg_node
Elapsed 0.000 sec: _commit_exec_cfg_node
Entering the _commit_check_cfg_node
Executing the "system host-name pve-sdn-test-vyos-01" ...
Elapsed 0.001 sec:
Elapsed 0.001 sec: _commit_check_cfg_node
Entering the _commit_exec_cfg_node
Executing the "system host-name pve-sdn-test-vyos-01" ...
Elapsed 0.125 sec:
Elapsed 0.125 sec: _commit_exec_cfg_node
Entering the _commit_check_cfg_node
Executing the "vrf name vrf_Elim01" ...
Elapsed 0.014 sec:
Executing the "vrf name vrf_Elim01 table 10001" ...
Elapsed 0.015 sec:
Executing the "vrf name vrf_Elim01 vni 10001" ...
Elapsed 0.002 sec:
Elapsed 0.031 sec: _commit_check_cfg_node
Entering the _commit_exec_cfg_node
Executing the "vrf" ...
Elapsed 0.068 sec:
Elapsed 0.068 sec: _commit_exec_cfg_node
Entering the _commit_check_cfg_node
Executing the "system console device ttyS0" ...
Elapsed 0.001 sec:
Executing the "system console device ttyS0 speed 115200" ...
Elapsed 0.001 sec:
Elapsed 0.002 sec: _commit_check_cfg_node
Entering the _commit_exec_cfg_node
Executing the "system console" ...
Elapsed 0.086 sec:
Elapsed 0.086 sec: _commit_exec_cfg_node
Entering the _commit_check_cfg_node
Elapsed 0.000 sec: _commit_check_cfg_node
Entering the _commit_exec_cfg_node
Executing the "system conntrack" ...
Elapsed 0.111 sec:
Elapsed 0.111 sec: _commit_exec_cfg_node
Entering the _commit_check_cfg_node
Executing the "interfaces loopback lo" ...
Elapsed 0.001 sec:
Elapsed 0.001 sec: _commit_check_cfg_node
Entering the _commit_exec_cfg_node
Executing the "interfaces loopback lo" ...
Elapsed 0.056 sec:
Elapsed 0.056 sec: _commit_exec_cfg_node
Entering the _commit_check_cfg_node
Executing the "interfaces ethernet eth0" ...
Elapsed 0.001 sec:
Executing the "interfaces ethernet eth0 address 10.4.3.120/16" ...
Elapsed 0.004 sec:
Executing the "interfaces ethernet eth0 description UPLINK" ...
Elapsed 0.000 sec:
Executing the "interfaces ethernet eth0 hw-id ..." ...
Elapsed 0.002 sec:
Elapsed 0.009 sec: _commit_check_cfg_node
Entering the _commit_exec_cfg_node
Executing the "interfaces ethernet eth0" ...
Elapsed 0.079 sec:
Elapsed 0.079 sec: _commit_exec_cfg_node
Entering the _commit_check_cfg_node
Executing the "interfaces ethernet eth1" ...
Elapsed 0.001 sec:
Executing the "interfaces ethernet eth1 address 10.255.2.120/24" ...
Elapsed 0.002 sec:
Executing the "interfaces ethernet eth1 description SDN" ...
Elapsed 0.001 sec:
Executing the "interfaces ethernet eth1 hw-id ..." ...
Elapsed 0.002 sec:
Executing the "interfaces ethernet eth1 mtu 9100" ...
Elapsed 0.001 sec:
Elapsed 0.009 sec: _commit_check_cfg_node
Entering the _commit_exec_cfg_node
Executing the "interfaces ethernet eth1" ...
Elapsed 0.064 sec:
Elapsed 0.064 sec: _commit_exec_cfg_node
Entering the _commit_check_cfg_node
Executing the "interfaces bridge br999" ...
Elapsed 0.001 sec:
Executing the "interfaces bridge br999 description br_l3vni" ...
Elapsed 0.001 sec:
Executing the "interfaces bridge br999 member interface vxlan99" ...
Elapsed 0.002 sec:
Executing the "interfaces bridge br999 vif 4000" ...
Elapsed 0.001 sec:
Executing the "interfaces bridge br999 vif 4000 vrf vrf_Elim01" ...
Elapsed 0.011 sec:
Elapsed 0.018 sec: _commit_check_cfg_node
Entering the _commit_exec_cfg_node
Executing the "interfaces bridge br999" ...
Elapsed 0.120 sec:
Elapsed 0.120 sec: _commit_exec_cfg_node
Entering the _commit_check_cfg_node
Executing the "interfaces bridge br1" ...
Elapsed 0.001 sec:
Executing the "interfaces bridge br1 description VRF vrf_Elim01" ...
Elapsed 0.001 sec:
Executing the "interfaces bridge br1 member interface vxlan1" ...
Elapsed 0.002 sec:
Executing the "interfaces bridge br1 vif 1001" ...
Elapsed 0.001 sec:
Executing the "interfaces bridge br1 vif 1001 vrf vrf_Elim01" ...
Elapsed 0.011 sec:
Executing the "interfaces bridge br1 vif 1002" ...
Elapsed 0.002 sec:
Executing the "interfaces bridge br1 vif 1002 vrf vrf_Elim01" ...
Elapsed 0.011 sec:
Executing the "interfaces bridge br1 vif 1003" ...
Elapsed 0.002 sec:
Executing the "interfaces bridge br1 vif 1003 vrf vrf_Elim01" ...
Elapsed 0.010 sec:
Elapsed 0.043 sec: _commit_check_cfg_node
Entering the _commit_exec_cfg_node
Executing the "interfaces bridge br1" ...
Elapsed 0.244 sec:
Elapsed 0.244 sec: _commit_exec_cfg_node
Entering the _commit_check_cfg_node
Executing the "system login operator-group default" ...
Elapsed 0.001 sec:
Executing the "system login user vyos" ...
Elapsed 0.001 sec:
Executing the "system login user vyos authentication encrypted-password $6$rounds=656000$...
Elapsed 0.000 sec:
Elapsed 0.003 sec: _commit_check_cfg_node
Entering the _commit_exec_cfg_node
Executing the "system login" ...
Elapsed 0.209 sec:
Elapsed 0.209 sec: _commit_exec_cfg_node
Entering the _commit_check_cfg_node
Executing the "system syslog local facility all" ...
Elapsed 0.001 sec:
Executing the "system syslog local facility all level info" ...
Elapsed 0.001 sec:
Executing the "system syslog local facility local7" ...
Elapsed 0.001 sec:
Executing the "system syslog local facility local7 level debug" ...
Elapsed 0.001 sec:
Elapsed 0.004 sec: _commit_check_cfg_node
Entering the _commit_exec_cfg_node
Executing the "system syslog" ...
Elapsed 0.056 sec:
Elapsed 0.056 sec: _commit_exec_cfg_node
Entering the _commit_check_cfg_node
Executing the "system domain-search ..." ...
Elapsed 0.005 sec:
Elapsed 0.005 sec: _commit_check_cfg_node
Entering the _commit_exec_cfg_node
Executing the "system domain-search ..." ...
Elapsed 0.024 sec:
Executing the "system domain-search ..." ...
Elapsed 0.022 sec:
Elapsed 0.046 sec: _commit_exec_cfg_node
Entering the _commit_check_cfg_node
Executing the "system config-management commit-revisions 100" ...
Elapsed 0.002 sec:
Elapsed 0.002 sec: _commit_check_cfg_node
Entering the _commit_exec_cfg_node
Executing the "system config-management" ...
Elapsed 0.004 sec:
Elapsed 0.004 sec: _commit_exec_cfg_node
Entering the _commit_check_cfg_node
Executing the "system name-server 10.4.0.1" ...
Elapsed 0.003 sec:
Executing the "system name-server 1.1.1.1" ...
Elapsed 0.003 sec:
Executing the "system name-server 8.8.8.8" ...
Elapsed 0.003 sec:
Elapsed 0.010 sec: _commit_check_cfg_node
Entering the _commit_exec_cfg_node
Executing the "system name-server 10.4.0.1" ...
Elapsed 0.022 sec:
Executing the "system name-server 1.1.1.1" ...
Elapsed 0.021 sec:
Executing the "system name-server 8.8.8.8" ...
Elapsed 0.021 sec:
Executing the "system name-server 10.4.0.1" ...
Elapsed 0.021 sec:
Executing the "system name-server 1.1.1.1" ...
Elapsed 0.021 sec:
Executing the "system name-server 8.8.8.8" ...
Elapsed 0.022 sec:
Elapsed 0.129 sec: _commit_exec_cfg_node
Entering the _commit_check_cfg_node
Executing the "interfaces vxlan vxlan99" ...
Elapsed 0.001 sec:
Executing the "interfaces vxlan vxlan99 source-interface eth1" ...
Elapsed 0.002 sec:
Executing the "interfaces vxlan vxlan99 vlan-to-vni 4000" ...
Elapsed 0.002 sec:
Executing the "interfaces vxlan vxlan99 vlan-to-vni 4000 vni 10001" ...
Elapsed 0.001 sec:
Elapsed 0.007 sec: _commit_check_cfg_node
Entering the _commit_exec_cfg_node
Executing the "interfaces vxlan vxlan99" ...
Elapsed 0.070 sec:
Elapsed 0.070 sec: _commit_exec_cfg_node
Entering the _commit_check_cfg_node
Executing the "interfaces vxlan vxlan1" ...
Elapsed 0.001 sec:
Executing the "interfaces vxlan vxlan1 description VRF vrf_Elim01" ...
Elapsed 0.001 sec:
Executing the "interfaces vxlan vxlan1 source-interface eth1" ...
Elapsed 0.002 sec:
Executing the "interfaces vxlan vxlan1 vlan-to-vni 1001" ...
Elapsed 0.002 sec:
Executing the "interfaces vxlan vxlan1 vlan-to-vni 1001 vni 1001" ...
Elapsed 0.002 sec:
Executing the "interfaces vxlan vxlan1 vlan-to-vni 1002" ...
Elapsed 0.002 sec:
Executing the "interfaces vxlan vxlan1 vlan-to-vni 1002 vni 1002" ...
Elapsed 0.002 sec:
Executing the "interfaces vxlan vxlan1 vlan-to-vni 1003" ...
Elapsed 0.001 sec:
Executing the "interfaces vxlan vxlan1 vlan-to-vni 1003 vni 1003" ...
Elapsed 0.001 sec:
Elapsed 0.017 sec: _commit_check_cfg_node
Entering the _commit_exec_cfg_node
Executing the "interfaces vxlan vxlan1" ...
Elapsed 0.064 sec:
Elapsed 0.064 sec: _commit_exec_cfg_node
Entering the _commit_check_cfg_node
Executing the "protocols bgp neighbor 10.255.2.121" ...
Elapsed 0.003 sec:
Executing the "protocols bgp neighbor 10.255.2.121 description pve-sdn-test-01" ...
Elapsed 0.001 sec:
Executing the "protocols bgp neighbor 10.255.2.122" ...
Elapsed 0.003 sec:
Executing the "protocols bgp neighbor 10.255.2.122 description pve-sdn-test-02" ...
Elapsed 0.000 sec:
Executing the "protocols bgp neighbor 10.255.2.123" ...
Elapsed 0.003 sec:
Executing the "protocols bgp neighbor 10.255.2.123 description pve-sdn-test-03" ...
Elapsed 0.000 sec:
Executing the "protocols bgp parameters router-id 10.255.2.120" ...
Elapsed 0.004 sec:
Executing the "protocols bgp peer-group PVE-NODES" ...
Elapsed 0.000 sec:
Executing the "protocols bgp peer-group PVE-NODES remote-as 65000" ...
Elapsed 0.002 sec:
Executing the "protocols bgp system-as 65000" ...
Elapsed 0.001 sec:
Elapsed 0.022 sec: _commit_check_cfg_node
Entering the _commit_exec_cfg_node
Executing the "protocols bgp" ...
Elapsed 0.078 sec:
Elapsed 0.078 sec: _commit_exec_cfg_node
Entering the _commit_check_cfg_node
Executing the "vrf name vrf_Elim01 protocols bgp parameters router-id 10.255.2.120" ...
Elapsed 0.002 sec:
Executing the "vrf name vrf_Elim01 protocols bgp system-as 65000" ...
Elapsed 0.002 sec:
Elapsed 0.004 sec: _commit_check_cfg_node
Entering the _commit_exec_cfg_node
Executing the "vrf name vrf_Elim01 protocols bgp" ...
[ vrf name vrf_Elim01 protocols bgp ]
[2779|mgmtd] sending configuration [2780|zebra] sending configuration
[2781|ripd] sending configuration [2782|ripngd] sending configuration
[2783|ospfd] sending configuration [2784|ospf6d] sending configuration
[2780|zebra] done [2787|isisd] sending configuration [2791|babeld]
sending configuration [2786|bgpd] sending configuration [2789|nhrpd]
sending configuration [2785|ldpd] sending configuration [2794|watchfrr]
sending configuration [2782|ripngd] done [2779|mgmtd] done [2784|ospf6d]
done [2781|ripd] done [2791|babeld] done [2793|fabricd] sending
configuration [2787|isisd] done [2783|ospfd] done [2794|watchfrr] done
[2789|nhrpd] done [2785|ldpd] done [2793|fabricd] done [2796|staticd]
sending configuration % Please unconfigure EVPN in VRF default line 22:
Failure to communicate[13] to bgpd, line: advertise-all-vni Waiting
for children to finish applying config... [2797|bfdd] sending
configuration [2800|pim6d] sending configuration [2796|staticd] done
[2786|bgpd] Configuration file[/etc/frr/frr.conf] processing failure: 13
[2797|bfdd] done [2800|pim6d] done [2804|mgmtd] sending configuration
[2805|zebra] sending configuration [2806|ripd] sending configuration
[2807|ripngd] sending configuration [2810|ldpd] sending configuration
[2811|bgpd] sending configuration [2812|isisd] sending configuration
[2814|nhrpd] sending configuration [2816|babeld] sending configuration
[2805|zebra] done Waiting for children to finish applying config...
[2808|ospfd] sending configuration [2806|ripd] done [2809|ospf6d]
sending configuration [2821|staticd] sending configuration [2822|bfdd]
sending configuration [2810|ldpd] done [2804|mgmtd] done [2818|fabricd]
sending configuration [2807|ripngd] done [2814|nhrpd] done
[2819|watchfrr] sending configuration [2825|pim6d] sending configuration
% Please unconfigure EVPN in VRF default line 22: Failure to
communicate[13] to bgpd, line: advertise-all-vni [2812|isisd] done
[2825|pim6d] done [2816|babeld] done % Please unconfigure EVPN in VRF
default line 47: Failure to communicate[13] to bgpd, line: advertise-
all-vni [2811|bgpd] Configuration file[/etc/frr/frr.conf] processing
failure: 13 [2808|ospfd] done [2822|bfdd] done [2809|ospf6d] done
[2821|staticd] done [2819|watchfrr] done [2818|fabricd] done
Elapsed 10.606 sec:
Elapsed 10.606 sec: _commit_exec_cfg_node
[[vrf name vrf_Elim01 protocols bgp]] failed
Elapsed 12.419 sec: Commit execute priority tree
Commit failedConfig:
vyos@pve-sdn-test-vyos-01# load
Load complete. Use 'commit' to make changes effective.
[edit]
vyos@pve-sdn-test-vyos-01# show
interfaces {
bridge br1 {
description "VRF vrf_Elim01"
enable-vlan
member {
interface vxlan1 {
}
}
vif 1001 {
vrf vrf_Elim01
}
vif 1002 {
vrf vrf_Elim01
}
vif 1003 {
vrf vrf_Elim01
}
}
bridge br999 {
description br_l3vni
enable-vlan
member {
interface vxlan99 {
}
}
vif 4000 {
vrf vrf_Elim01
}
}
ethernet eth0 {
address 10.4.3.120/16
description UPLINK
hw-id ...
offload {
gro
gso
sg
tso
}
}
ethernet eth1 {
address 10.255.2.120/24
description SDN
hw-id ...
mtu 9100
offload {
gro
gso
sg
tso
}
}
loopback lo {
}
vxlan vxlan1 {
description "VRF vrf_Elim01"
parameters {
external
vni-filter
}
source-interface eth1
vlan-to-vni 1001 {
vni 1001
}
vlan-to-vni 1002 {
vni 1002
}
vlan-to-vni 1003 {
vni 1003
}
}
vxlan vxlan99 {
parameters {
external
vni-filter
}
source-interface eth1
vlan-to-vni 4000 {
vni 10001
}
}
}
protocols {
bgp {
address-family {
l2vpn-evpn {
advertise-all-vni
}
}
neighbor 10.255.2.121 {
description pve-sdn-test-01
peer-group PVE-NODES
}
neighbor 10.255.2.122 {
description pve-sdn-test-02
peer-group PVE-NODES
}
neighbor 10.255.2.123 {
description pve-sdn-test-03
peer-group PVE-NODES
}
parameters {
router-id 10.255.2.120
}
peer-group PVE-NODES {
address-family {
l2vpn-evpn {
soft-reconfiguration {
inbound
}
}
}
remote-as 65000
}
system-as 65000
}
}
vrf {
name vrf_Elim01 {
protocols {
+ bgp {
+ address-family {
+ l2vpn-evpn {
+ advertise-all-vni
+ }
+ }
+ parameters {
+ router-id 10.255.2.120
+ }
+ system-as 65000
+ }
}
table 10001
vni 10001
}
}