I'm having lots of issues with EVPN-VXLAN L3VPN, now at the point where I can't apply config at runtime and have to reboot, or on this node can't apply the config at all.
Note that this seems to be a **validation error**, or **config error, but the validation does not catch it**, so the config can't even be applied on boot.
I have other configs (I will create separate issues) that work when applied on boot, but can't be adjusted at runtime!
The issue seems to be the `advertise-all-vni` in the vrf!
```
vrf {
name vrf_Elim01 {
protocols {
bgp {
address-family {
l2vpn-evpn {
advertise-all-vni
}
```
Some example error output below:
```
vyos@pve-sdn-test-vyos-01:~$ cat /tmp/boot-config-trace
Traceback (most recent call last):
File "/usr/libexec/vyos/vyos-boot-config-loader.py", line 145, in <module>
commit_out = session.commit()
^^^^^^^^^^^^^^^^
File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 325, in commit
out = self.__run_command([COMMIT])
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 252, in __run_command
raise ConfigSessionError(output)
vyos.configsession.ConfigSessionError: Processing the Priority Queue
Entering the _commit_check_cfg_node
Elapsed 0.000 sec: _commit_check_cfg_node
Entering the _commit_exec_cfg_node
Elapsed 0.000 sec: _commit_exec_cfg_node
Entering the _commit_check_cfg_node
Executing the "system host-name pve-sdn-test-vyos-01" ...
Elapsed 0.001 sec:
Elapsed 0.001 sec: _commit_check_cfg_node
Entering the _commit_exec_cfg_node
Executing the "system host-name pve-sdn-test-vyos-01" ...
Elapsed 0.125 sec:
Elapsed 0.125 sec: _commit_exec_cfg_node
Entering the _commit_check_cfg_node
Executing the "vrf name vrf_Elim01" ...
Elapsed 0.014 sec:
Executing the "vrf name vrf_Elim01 table 10001" ...
Elapsed 0.015 sec:
Executing the "vrf name vrf_Elim01 vni 10001" ...
Elapsed 0.002 sec:
Elapsed 0.031 sec: _commit_check_cfg_node
Entering the _commit_exec_cfg_node
Executing the "vrf" ...
Elapsed 0.068 sec:
Elapsed 0.068 sec: _commit_exec_cfg_node
Entering the _commit_check_cfg_node
Executing the "system console device ttyS0" ...
Elapsed 0.001 sec:
Executing the "system console device ttyS0 speed 115200" ...
Elapsed 0.001 sec:
Elapsed 0.002 sec: _commit_check_cfg_node
Entering the _commit_exec_cfg_node
Executing the "system console" ...
Elapsed 0.086 sec:
Elapsed 0.086 sec: _commit_exec_cfg_node
Entering the _commit_check_cfg_node
Elapsed 0.000 sec: _commit_check_cfg_node
Entering the _commit_exec_cfg_node
Executing the "system conntrack" ...
Elapsed 0.111 sec:
Elapsed 0.111 sec: _commit_exec_cfg_node
Entering the _commit_check_cfg_node
Executing the "interfaces loopback lo" ...
Elapsed 0.001 sec:
Elapsed 0.001 sec: _commit_check_cfg_node
Entering the _commit_exec_cfg_node
Executing the "interfaces loopback lo" ...
Elapsed 0.056 sec:
Elapsed 0.056 sec: _commit_exec_cfg_node
Entering the _commit_check_cfg_node
Executing the "interfaces ethernet eth0" ...
Elapsed 0.001 sec:
Executing the "interfaces ethernet eth0 address 10.4.3.120/16" ...
Elapsed 0.004 sec:
Executing the "interfaces ethernet eth0 description UPLINK" ...
Elapsed 0.000 sec:
Executing the "interfaces ethernet eth0 hw-id ..." ...
Elapsed 0.002 sec:
Elapsed 0.009 sec: _commit_check_cfg_node
Entering the _commit_exec_cfg_node
Executing the "interfaces ethernet eth0" ...
Elapsed 0.079 sec:
Elapsed 0.079 sec: _commit_exec_cfg_node
Entering the _commit_check_cfg_node
Executing the "interfaces ethernet eth1" ...
Elapsed 0.001 sec:
Executing the "interfaces ethernet eth1 address 10.255.2.120/24" ...
Elapsed 0.002 sec:
Executing the "interfaces ethernet eth1 description SDN" ...
Elapsed 0.001 sec:
Executing the "interfaces ethernet eth1 hw-id ..." ...
Elapsed 0.002 sec:
Executing the "interfaces ethernet eth1 mtu 9100" ...
Elapsed 0.001 sec:
Elapsed 0.009 sec: _commit_check_cfg_node
Entering the _commit_exec_cfg_node
Executing the "interfaces ethernet eth1" ...
Elapsed 0.064 sec:
Elapsed 0.064 sec: _commit_exec_cfg_node
Entering the _commit_check_cfg_node
Executing the "interfaces bridge br999" ...
Elapsed 0.001 sec:
Executing the "interfaces bridge br999 description br_l3vni" ...
Elapsed 0.001 sec:
Executing the "interfaces bridge br999 member interface vxlan99" ...
Elapsed 0.002 sec:
Executing the "interfaces bridge br999 vif 4000" ...
Elapsed 0.001 sec:
Executing the "interfaces bridge br999 vif 4000 vrf vrf_Elim01" ...
Elapsed 0.011 sec:
Elapsed 0.018 sec: _commit_check_cfg_node
Entering the _commit_exec_cfg_node
Executing the "interfaces bridge br999" ...
Elapsed 0.120 sec:
Elapsed 0.120 sec: _commit_exec_cfg_node
Entering the _commit_check_cfg_node
Executing the "interfaces bridge br1" ...
Elapsed 0.001 sec:
Executing the "interfaces bridge br1 description VRF vrf_Elim01" ...
Elapsed 0.001 sec:
Executing the "interfaces bridge br1 member interface vxlan1" ...
Elapsed 0.002 sec:
Executing the "interfaces bridge br1 vif 1001" ...
Elapsed 0.001 sec:
Executing the "interfaces bridge br1 vif 1001 vrf vrf_Elim01" ...
Elapsed 0.011 sec:
Executing the "interfaces bridge br1 vif 1002" ...
Elapsed 0.002 sec:
Executing the "interfaces bridge br1 vif 1002 vrf vrf_Elim01" ...
Elapsed 0.011 sec:
Executing the "interfaces bridge br1 vif 1003" ...
Elapsed 0.002 sec:
Executing the "interfaces bridge br1 vif 1003 vrf vrf_Elim01" ...
Elapsed 0.010 sec:
Elapsed 0.043 sec: _commit_check_cfg_node
Entering the _commit_exec_cfg_node
Executing the "interfaces bridge br1" ...
Elapsed 0.244 sec:
Elapsed 0.244 sec: _commit_exec_cfg_node
Entering the _commit_check_cfg_node
Executing the "system login operator-group default" ...
Elapsed 0.001 sec:
Executing the "system login user vyos" ...
Elapsed 0.001 sec:
Executing the "system login user vyos authentication encrypted-password $6$rounds=656000$...
Elapsed 0.000 sec:
Elapsed 0.003 sec: _commit_check_cfg_node
Entering the _commit_exec_cfg_node
Executing the "system login" ...
Elapsed 0.209 sec:
Elapsed 0.209 sec: _commit_exec_cfg_node
Entering the _commit_check_cfg_node
Executing the "system syslog local facility all" ...
Elapsed 0.001 sec:
Executing the "system syslog local facility all level info" ...
Elapsed 0.001 sec:
Executing the "system syslog local facility local7" ...
Elapsed 0.001 sec:
Executing the "system syslog local facility local7 level debug" ...
Elapsed 0.001 sec:
Elapsed 0.004 sec: _commit_check_cfg_node
Entering the _commit_exec_cfg_node
Executing the "system syslog" ...
Elapsed 0.056 sec:
Elapsed 0.056 sec: _commit_exec_cfg_node
Entering the _commit_check_cfg_node
Executing the "system domain-search ..." ...
Elapsed 0.005 sec:
Elapsed 0.005 sec: _commit_check_cfg_node
Entering the _commit_exec_cfg_node
Executing the "system domain-search ..." ...
Elapsed 0.024 sec:
Executing the "system domain-search ..." ...
Elapsed 0.022 sec:
Elapsed 0.046 sec: _commit_exec_cfg_node
Entering the _commit_check_cfg_node
Executing the "system config-management commit-revisions 100" ...
Elapsed 0.002 sec:
Elapsed 0.002 sec: _commit_check_cfg_node
Entering the _commit_exec_cfg_node
Executing the "system config-management" ...
Elapsed 0.004 sec:
Elapsed 0.004 sec: _commit_exec_cfg_node
Entering the _commit_check_cfg_node
Executing the "system name-server 10.4.0.1" ...
Elapsed 0.003 sec:
Executing the "system name-server 1.1.1.1" ...
Elapsed 0.003 sec:
Executing the "system name-server 8.8.8.8" ...
Elapsed 0.003 sec:
Elapsed 0.010 sec: _commit_check_cfg_node
Entering the _commit_exec_cfg_node
Executing the "system name-server 10.4.0.1" ...
Elapsed 0.022 sec:
Executing the "system name-server 1.1.1.1" ...
Elapsed 0.021 sec:
Executing the "system name-server 8.8.8.8" ...
Elapsed 0.021 sec:
Executing the "system name-server 10.4.0.1" ...
Elapsed 0.021 sec:
Executing the "system name-server 1.1.1.1" ...
Elapsed 0.021 sec:
Executing the "system name-server 8.8.8.8" ...
Elapsed 0.022 sec:
Elapsed 0.129 sec: _commit_exec_cfg_node
Entering the _commit_check_cfg_node
Executing the "interfaces vxlan vxlan99" ...
Elapsed 0.001 sec:
Executing the "interfaces vxlan vxlan99 source-interface eth1" ...
Elapsed 0.002 sec:
Executing the "interfaces vxlan vxlan99 vlan-to-vni 4000" ...
Elapsed 0.002 sec:
Executing the "interfaces vxlan vxlan99 vlan-to-vni 4000 vni 10001" ...
Elapsed 0.001 sec:
Elapsed 0.007 sec: _commit_check_cfg_node
Entering the _commit_exec_cfg_node
Executing the "interfaces vxlan vxlan99" ...
Elapsed 0.070 sec:
Elapsed 0.070 sec: _commit_exec_cfg_node
Entering the _commit_check_cfg_node
Executing the "interfaces vxlan vxlan1" ...
Elapsed 0.001 sec:
Executing the "interfaces vxlan vxlan1 description VRF vrf_Elim01" ...
Elapsed 0.001 sec:
Executing the "interfaces vxlan vxlan1 source-interface eth1" ...
Elapsed 0.002 sec:
Executing the "interfaces vxlan vxlan1 vlan-to-vni 1001" ...
Elapsed 0.002 sec:
Executing the "interfaces vxlan vxlan1 vlan-to-vni 1001 vni 1001" ...
Elapsed 0.002 sec:
Executing the "interfaces vxlan vxlan1 vlan-to-vni 1002" ...
Elapsed 0.002 sec:
Executing the "interfaces vxlan vxlan1 vlan-to-vni 1002 vni 1002" ...
Elapsed 0.002 sec:
Executing the "interfaces vxlan vxlan1 vlan-to-vni 1003" ...
Elapsed 0.001 sec:
Executing the "interfaces vxlan vxlan1 vlan-to-vni 1003 vni 1003" ...
Elapsed 0.001 sec:
Elapsed 0.017 sec: _commit_check_cfg_node
Entering the _commit_exec_cfg_node
Executing the "interfaces vxlan vxlan1" ...
Elapsed 0.064 sec:
Elapsed 0.064 sec: _commit_exec_cfg_node
Entering the _commit_check_cfg_node
Executing the "protocols bgp neighbor 10.255.2.121" ...
Elapsed 0.003 sec:
Executing the "protocols bgp neighbor 10.255.2.121 description pve-sdn-test-01" ...
Elapsed 0.001 sec:
Executing the "protocols bgp neighbor 10.255.2.122" ...
Elapsed 0.003 sec:
Executing the "protocols bgp neighbor 10.255.2.122 description pve-sdn-test-02" ...
Elapsed 0.000 sec:
Executing the "protocols bgp neighbor 10.255.2.123" ...
Elapsed 0.003 sec:
Executing the "protocols bgp neighbor 10.255.2.123 description pve-sdn-test-03" ...
Elapsed 0.000 sec:
Executing the "protocols bgp parameters router-id 10.255.2.120" ...
Elapsed 0.004 sec:
Executing the "protocols bgp peer-group PVE-NODES" ...
Elapsed 0.000 sec:
Executing the "protocols bgp peer-group PVE-NODES remote-as 65000" ...
Elapsed 0.002 sec:
Executing the "protocols bgp system-as 65000" ...
Elapsed 0.001 sec:
Elapsed 0.022 sec: _commit_check_cfg_node
Entering the _commit_exec_cfg_node
Executing the "protocols bgp" ...
Elapsed 0.078 sec:
Elapsed 0.078 sec: _commit_exec_cfg_node
Entering the _commit_check_cfg_node
Executing the "vrf name vrf_Elim01 protocols bgp parameters router-id 10.255.2.120" ...
Elapsed 0.002 sec:
Executing the "vrf name vrf_Elim01 protocols bgp system-as 65000" ...
Elapsed 0.002 sec:
Elapsed 0.004 sec: _commit_check_cfg_node
Entering the _commit_exec_cfg_node
Executing the "vrf name vrf_Elim01 protocols bgp" ...
[ vrf name vrf_Elim01 protocols bgp ]
[2779|mgmtd] sending configuration [2780|zebra] sending configuration
[2781|ripd] sending configuration [2782|ripngd] sending configuration
[2783|ospfd] sending configuration [2784|ospf6d] sending configuration
[2780|zebra] done [2787|isisd] sending configuration [2791|babeld]
sending configuration [2786|bgpd] sending configuration [2789|nhrpd]
sending configuration [2785|ldpd] sending configuration [2794|watchfrr]
sending configuration [2782|ripngd] done [2779|mgmtd] done [2784|ospf6d]
done [2781|ripd] done [2791|babeld] done [2793|fabricd] sending
configuration [2787|isisd] done [2783|ospfd] done [2794|watchfrr] done
[2789|nhrpd] done [2785|ldpd] done [2793|fabricd] done [2796|staticd]
sending configuration % Please unconfigure EVPN in VRF default line 22:
Failure to communicate[13] to bgpd, line: advertise-all-vni Waiting
for children to finish applying config... [2797|bfdd] sending
configuration [2800|pim6d] sending configuration [2796|staticd] done
[2786|bgpd] Configuration file[/etc/frr/frr.conf] processing failure: 13
[2797|bfdd] done [2800|pim6d] done [2804|mgmtd] sending configuration
[2805|zebra] sending configuration [2806|ripd] sending configuration
[2807|ripngd] sending configuration [2810|ldpd] sending configuration
[2811|bgpd] sending configuration [2812|isisd] sending configuration
[2814|nhrpd] sending configuration [2816|babeld] sending configuration
[2805|zebra] done Waiting for children to finish applying config...
[2808|ospfd] sending configuration [2806|ripd] done [2809|ospf6d]
sending configuration [2821|staticd] sending configuration [2822|bfdd]
sending configuration [2810|ldpd] done [2804|mgmtd] done [2818|fabricd]
sending configuration [2807|ripngd] done [2814|nhrpd] done
[2819|watchfrr] sending configuration [2825|pim6d] sending configuration
% Please unconfigure EVPN in VRF default line 22: Failure to
communicate[13] to bgpd, line: advertise-all-vni [2812|isisd] done
[2825|pim6d] done [2816|babeld] done % Please unconfigure EVPN in VRF
default line 47: Failure to communicate[13] to bgpd, line: advertise-
all-vni [2811|bgpd] Configuration file[/etc/frr/frr.conf] processing
failure: 13 [2808|ospfd] done [2822|bfdd] done [2809|ospf6d] done
[2821|staticd] done [2819|watchfrr] done [2818|fabricd] done
Elapsed 10.606 sec:
Elapsed 10.606 sec: _commit_exec_cfg_node
[[vrf name vrf_Elim01 protocols bgp]] failed
Elapsed 12.419 sec: Commit execute priority tree
Commit failed
```
Config:
```
vyos@pve-sdn-test-vyos-01# load
Load complete. Use 'commit' to make changes effective.
[edit]
vyos@pve-sdn-test-vyos-01# show
interfaces {
bridge br1 {
description "VRF vrf_Elim01"
enable-vlan
member {
interface vxlan1 {
}
}
vif 1001 {
vrf vrf_Elim01
}
vif 1002 {
vrf vrf_Elim01
}
vif 1003 {
vrf vrf_Elim01
}
}
bridge br999 {
description br_l3vni
enable-vlan
member {
interface vxlan99 {
}
}
vif 4000 {
vrf vrf_Elim01
}
}
ethernet eth0 {
address 10.4.3.120/16
description UPLINK
hw-id ...
offload {
gro
gso
sg
tso
}
}
ethernet eth1 {
address 10.255.2.120/24
description SDN
hw-id ...
mtu 9100
offload {
gro
gso
sg
tso
}
}
loopback lo {
}
vxlan vxlan1 {
description "VRF vrf_Elim01"
parameters {
external
vni-filter
}
source-interface eth1
vlan-to-vni 1001 {
vni 1001
}
vlan-to-vni 1002 {
vni 1002
}
vlan-to-vni 1003 {
vni 1003
}
}
vxlan vxlan99 {
parameters {
external
vni-filter
}
source-interface eth1
vlan-to-vni 4000 {
vni 10001
}
}
}
protocols {
bgp {
address-family {
l2vpn-evpn {
advertise-all-vni
}
}
neighbor 10.255.2.121 {
description pve-sdn-test-01
peer-group PVE-NODES
}
neighbor 10.255.2.122 {
description pve-sdn-test-02
peer-group PVE-NODES
}
neighbor 10.255.2.123 {
description pve-sdn-test-03
peer-group PVE-NODES
}
parameters {
router-id 10.255.2.120
}
peer-group PVE-NODES {
address-family {
l2vpn-evpn {
soft-reconfiguration {
inbound
}
}
}
remote-as 65000
}
system-as 65000
}
}
vrf {
name vrf_Elim01 {
protocols {
+ bgp {
+ address-family {
+ l2vpn-evpn {
+ advertise-all-vni
+ }
+ }
+ parameters {
+ router-id 10.255.2.120
+ }
+ system-as 65000
+ }
}
table 10001
vni 10001
}
}
```