Page MenuHomeVyOS Platform
Create Task
Maniphest T7996

smoketest: sporadic errors during VRF smoketests
Closed, ResolvedPublicBUG
Actions

Description

After merge of https://github.com/vyos/vyos-1x/pull/4797 we have seen sporadic smoketest issues in the VRF code.

This is caused by commit 186900f7165b2 ("smoketest: T7927: test DHCP route preservation") which defines a VRF named red15 for the tests, but when reading in the FRR configuration we have a hardcoded search for VRF red https://github.com/vyos/vyos-1x/pull/4797/commits/186900f7165b298ed4b24d0c6b795e50a01ebbdb#diff-6481fbb55705992048c6c91ca18ca347e7f17811d36305a73b95e6185cc07421R817

DEBUG - test_vrf_ip_ipv6_protocol_non_existing_route_map (__main__.VRFTest.test_vrf_ip_ipv6_protocol_non_existing_route_map) ... ok
DEBUG - test_vrf_ip_protocol_route_map (__main__.VRFTest.test_vrf_ip_protocol_route_map) ... FAIL
DEBUG - test_vrf_ipv6_protocol_route_map (__main__.VRFTest.test_vrf_ipv6_protocol_route_map) ... FAIL
DEBUG - test_vrf_link_local_ip_addresses (__main__.VRFTest.test_vrf_link_local_ip_addresses) ... ok
DEBUG - test_vrf_loopbacks_ips (__main__.VRFTest.test_vrf_loopbacks_ips) ... ok
DEBUG - test_vrf_static_route (__main__.VRFTest.test_vrf_static_route) ... /usr/libexec/vyos/tests/smoke/cli/base_vyostest_shim.py:153: ResourceWarning: unclosed file <_io.BufferedReader name=5>
DEBUG -   frr_config = self._vtysh.mark_show_run()
DEBUG - ResourceWarning: Enable tracemalloc to get the object allocation traceback
DEBUG - ok
DEBUG - test_vrf_table_id_is_unalterable (__main__.VRFTest.test_vrf_table_id_is_unalterable) ... ok
DEBUG - test_vrf_vni_add_change_remove (__main__.VRFTest.test_vrf_vni_add_change_remove) ... FAIL
DEBUG - test_vrf_vni_and_table_id (__main__.VRFTest.test_vrf_vni_and_table_id) ... FAIL
DEBUG - test_vrf_vni_duplicates (__main__.VRFTest.test_vrf_vni_duplicates) ... FAIL
DEBUG - DEBUG - test_vrf_ip_ipv6_protocol_non_existing_route_map (__main__.VRFTest.test_vrf_ip_ipv6_protocol_non_existing_route_map) ... ok
DEBUG - test_vrf_ip_protocol_route_map (__main__.VRFTest.test_vrf_ip_protocol_route_map) ... FAIL
DEBUG - test_vrf_ipv6_protocol_route_map (__main__.VRFTest.test_vrf_ipv6_protocol_route_map) ... FAIL
DEBUG - test_vrf_link_local_ip_addresses (__main__.VRFTest.test_vrf_link_local_ip_addresses) ... ok
DEBUG - test_vrf_loopbacks_ips (__main__.VRFTest.test_vrf_loopbacks_ips) ... ok
DEBUG - test_vrf_static_route (__main__.VRFTest.test_vrf_static_route) ... /usr/libexec/vyos/tests/smoke/cli/base_vyostest_shim.py:153: ResourceWarning: unclosed file <_io.BufferedReader name=5>
DEBUG -   frr_config = self._vtysh.mark_show_run()
DEBUG - ResourceWarning: Enable tracemalloc to get the object allocation traceback
DEBUG - ok
DEBUG - test_vrf_table_id_is_unalterable (__main__.VRFTest.test_vrf_table_id_is_unalterable) ... ok
DEBUG - test_vrf_vni_add_change_remove (__main__.VRFTest.test_vrf_vni_add_change_remove) ... FAIL
DEBUG - test_vrf_vni_and_table_id (__main__.VRFTest.test_vrf_vni_and_table_id) ... FAIL
DEBUG - test_vrf_vni_duplicates (__main__.VRFTest.test_vrf_vni_duplicates) ... FAIL

Details

Version
2025.11.04-0019-rolling
Is it a breaking change?
Perfectly compatible
Issue type
Internal change (not visible to end users)

Related Objects
Search...

Event Timeline

c-po created this task.Thu, Nov 6, 8:26 PM
c-po changed the task status from Open to In progress.
c-po claimed this task.
c-po triaged this task as Normal priority.
c-po added a comment.Thu, Nov 6, 8:46 PM

https://github.com/vyos/vyos-1x/pull/4836

c-po moved this task from Need Triage to Completed on the VyOS Rolling board.Fri, Nov 7, 4:43 PM
c-po mentioned this in rVYOSONEX874eabd1bcaa: smoketest: T7996: fix hardcoded "vrf red" search path in FRR config.Fri, Nov 7, 4:43 PM
c-po mentioned this in rVYOSONEXda679f0cf8fe: smoketest: T7996: replace hardcoded sleep(8) in VRF test with wait_for().
c-po mentioned this in rVYOSONEXc0deb11a5c0e: smoketest: T7996: vrf CLI path is always deleted in tearDown().
c-po mentioned this in rVYOSONEXb50808ac8245: smoketest: T7996: drop frr-reload.py implementation when reading running config.
Restricted Repository Identity mentioned this in rVYOSONEX25224cff3452: Merge pull request #4836 from c-po/fix-vrf-smoketest.Fri, Nov 7, 4:43 PM
c-po closed this task as Resolved.Fri, Nov 7, 7:54 PM
c-po moved this task from Open to Finished on the VyOS 1.5 Circinus (1.5-stream-2025-Q3) board.
dmbaturin edited projects, added VyOS 1.5 Circinus (2025.11); removed VyOS 1.5 Circinus (1.5-stream-2025-Q3), VyOS Rolling.Wed, Nov 12, 5:09 PM
dmbaturin changed Is it a breaking change? from Unspecified (possibly destroys the router) to Perfectly compatible.
dmbaturin changed Issue type from Bug (incorrect behavior) to Internal change (not visible to end users).