Page MenuHomeVyOS Platform
Create Task
Maniphest T7215

VRF smoke tests failing
Not ApplicablePublicBUG
Actions

Description

Hey, just reporting another smoke test failure. This time *all* VRF tests are failing when running via vyos_build docker using make test target :/ Output see below.

DEBUG - OK (skipped=2)
DEBUG - Running Testcase: /usr/libexec/vyos/tests/smoke/cli/test_vrf.py
DEBUG - test_vrf_assign_interface (__main__.VRFTest.test_vrf_assign_interface) ... ERROR
DEBUG - test_vrf_assign_interface (__main__.VRFTest.test_vrf_assign_interface) ... ERROR
DEBUG - test_vrf_bind_all (__main__.VRFTest.test_vrf_bind_all) ... ERROR
DEBUG - test_vrf_bind_all (__main__.VRFTest.test_vrf_bind_all) ... ERROR
DEBUG - test_vrf_conntrack (__main__.VRFTest.test_vrf_conntrack) ... ERROR
DEBUG - test_vrf_conntrack (__main__.VRFTest.test_vrf_conntrack) ... ERROR
DEBUG - test_vrf_disable_forwarding (__main__.VRFTest.test_vrf_disable_forwarding) ... ERROR
DEBUG - test_vrf_disable_forwarding (__main__.VRFTest.test_vrf_disable_forwarding) ... ERROR
DEBUG - test_vrf_ip_ipv6_nht (__main__.VRFTest.test_vrf_ip_ipv6_nht) ... ERROR
DEBUG - test_vrf_ip_ipv6_nht (__main__.VRFTest.test_vrf_ip_ipv6_nht) ... ERROR
DEBUG - test_vrf_ip_ipv6_protocol_non_existing_route_map (__main__.VRFTest.test_vrf_ip_ipv6_protocol_non_existing_route_map) ... ERROR
DEBUG - test_vrf_ip_ipv6_protocol_non_existing_route_map (__main__.VRFTest.test_vrf_ip_ipv6_protocol_non_existing_route_map) ... ERROR
DEBUG - test_vrf_ip_protocol_route_map (__main__.VRFTest.test_vrf_ip_protocol_route_map) ... ERROR
DEBUG - test_vrf_ip_protocol_route_map (__main__.VRFTest.test_vrf_ip_protocol_route_map) ... ERROR
DEBUG - test_vrf_ipv6_protocol_route_map (__main__.VRFTest.test_vrf_ipv6_protocol_route_map) ... ERROR
DEBUG - test_vrf_ipv6_protocol_route_map (__main__.VRFTest.test_vrf_ipv6_protocol_route_map) ... ERROR
DEBUG - test_vrf_link_local_ip_addresses (__main__.VRFTest.test_vrf_link_local_ip_addresses) ... ERROR
DEBUG - test_vrf_link_local_ip_addresses (__main__.VRFTest.test_vrf_link_local_ip_addresses) ... ERROR
DEBUG - test_vrf_loopbacks_ips (__main__.VRFTest.test_vrf_loopbacks_ips) ... ERROR
DEBUG - test_vrf_loopbacks_ips (__main__.VRFTest.test_vrf_loopbacks_ips) ... ERROR
DEBUG - test_vrf_static_route (__main__.VRFTest.test_vrf_static_route) ... ERROR
DEBUG - test_vrf_static_route (__main__.VRFTest.test_vrf_static_route) ... ERROR
DEBUG - test_vrf_table_id_is_unalterable (__main__.VRFTest.test_vrf_table_id_is_unalterable) ... ERROR
DEBUG - test_vrf_vni_add_change_remove (__main__.VRFTest.test_vrf_vni_add_change_remove) ... ERROR
DEBUG - test_vrf_vni_add_change_remove (__main__.VRFTest.test_vrf_vni_add_change_remove) ... ERROR
DEBUG - test_vrf_vni_and_table_id (__main__.VRFTest.test_vrf_vni_and_table_id) ... ERROR
DEBUG - test_vrf_vni_duplicates (__main__.VRFTest.test_vrf_vni_duplicates) ... ERROR
DEBUG - test_vrf_vni_duplicates (__main__.VRFTest.test_vrf_vni_duplicates) ... ERROR
DEBUG - 
DEBUG - ======================================================================
DEBUG - ERROR: test_vrf_assign_interface (__main__.VRFTest.test_vrf_assign_interface)
DEBUG - ----------------------------------------------------------------------
DEBUG - Traceback (most recent call last):
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/test_vrf.py", line 201, in test_vrf_assign_interface
DEBUG -     self.cli_commit()
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/base_vyostest_shim.py", line 97, in cli_commit
DEBUG -     self._session.commit()
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 264, in commit
DEBUG -     out = self.__run_command([COMMIT])
DEBUG -           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 201, in __run_command
DEBUG -     raise ConfigSessionError(output)
DEBUG - vyos.configsession.ConfigSessionError: [ vrf ]
DEBUG - VRF "red" table id modification not possible!
DEBUG - [[vrf]] failed
DEBUG - Commit failed
DEBUG - 
DEBUG - 
DEBUG - ======================================================================
DEBUG - ERROR: test_vrf_assign_interface (__main__.VRFTest.test_vrf_assign_interface)
DEBUG - ----------------------------------------------------------------------
DEBUG - Traceback (most recent call last):
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/test_vrf.py", line 71, in tearDown
DEBUG -     self.cli_commit()
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/base_vyostest_shim.py", line 97, in cli_commit
DEBUG -     self._session.commit()
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 264, in commit
DEBUG -     out = self.__run_command([COMMIT])
DEBUG -           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 201, in __run_command
DEBUG -     raise ConfigSessionError(output)
DEBUG - vyos.configsession.ConfigSessionError: [ vrf ]
DEBUG - Can not remove VRF "red", it still has member interfaces!
DEBUG - delete [ vrf ] failed
DEBUG - Commit failed
DEBUG - 
DEBUG - 
DEBUG - ======================================================================
DEBUG - ERROR: test_vrf_bind_all (__main__.VRFTest.test_vrf_bind_all)
DEBUG - ----------------------------------------------------------------------
DEBUG - Traceback (most recent call last):
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/test_vrf.py", line 162, in test_vrf_bind_all
DEBUG -     self.cli_commit()
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/base_vyostest_shim.py", line 97, in cli_commit
DEBUG -     self._session.commit()
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 264, in commit
DEBUG -     out = self.__run_command([COMMIT])
DEBUG -           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 201, in __run_command
DEBUG -     raise ConfigSessionError(output)
DEBUG - vyos.configsession.ConfigSessionError: [ vrf ]
DEBUG - VRF "red" table id modification not possible!
DEBUG - [[vrf]] failed
DEBUG - Commit failed
DEBUG - 
DEBUG - 
DEBUG - ======================================================================
DEBUG - ERROR: test_vrf_bind_all (__main__.VRFTest.test_vrf_bind_all)
DEBUG - ----------------------------------------------------------------------
DEBUG - Traceback (most recent call last):
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/test_vrf.py", line 71, in tearDown
DEBUG -     self.cli_commit()
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/base_vyostest_shim.py", line 97, in cli_commit
DEBUG -     self._session.commit()
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 264, in commit
DEBUG -     out = self.__run_command([COMMIT])
DEBUG -           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 201, in __run_command
DEBUG -     raise ConfigSessionError(output)
DEBUG - vyos.configsession.ConfigSessionError: [ vrf ]
DEBUG - Can not remove VRF "red", it still has member interfaces!
DEBUG - delete [ vrf ] failed
DEBUG - Commit failed
DEBUG - 
DEBUG - 
DEBUG - ======================================================================
DEBUG - ERROR: test_vrf_conntrack (__main__.VRFTest.test_vrf_conntrack)
DEBUG - ----------------------------------------------------------------------
DEBUG - Traceback (most recent call last):
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/test_vrf.py", line 576, in test_vrf_conntrack
DEBUG -     self.cli_commit()
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/base_vyostest_shim.py", line 97, in cli_commit
DEBUG -     self._session.commit()
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 264, in commit
DEBUG -     out = self.__run_command([COMMIT])
DEBUG -           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 201, in __run_command
DEBUG -     raise ConfigSessionError(output)
DEBUG - vyos.configsession.ConfigSessionError: [ vrf ]
DEBUG - Can not remove VRF "red", it still has member interfaces!
DEBUG - [[vrf]] failed
DEBUG - Commit failed
DEBUG - 
DEBUG - 
DEBUG - ======================================================================
DEBUG - ERROR: test_vrf_conntrack (__main__.VRFTest.test_vrf_conntrack)
DEBUG - ----------------------------------------------------------------------
DEBUG - Traceback (most recent call last):
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/test_vrf.py", line 71, in tearDown
DEBUG -     self.cli_commit()
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/base_vyostest_shim.py", line 97, in cli_commit
DEBUG -     self._session.commit()
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 264, in commit
DEBUG -     out = self.__run_command([COMMIT])
DEBUG -           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 201, in __run_command
DEBUG -     raise ConfigSessionError(output)
DEBUG - vyos.configsession.ConfigSessionError: [ vrf ]
DEBUG - Can not remove VRF "red", it still has member interfaces!
DEBUG - delete [ vrf ] failed
DEBUG - Commit failed
DEBUG - 
DEBUG - 
DEBUG - ======================================================================
DEBUG - ERROR: test_vrf_disable_forwarding (__main__.VRFTest.test_vrf_disable_forwarding)
DEBUG - ----------------------------------------------------------------------
DEBUG - Traceback (most recent call last):
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/test_vrf.py", line 298, in test_vrf_disable_forwarding
DEBUG -     self.cli_commit()
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/base_vyostest_shim.py", line 97, in cli_commit
DEBUG -     self._session.commit()
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 264, in commit
DEBUG -     out = self.__run_command([COMMIT])
DEBUG -           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 201, in __run_command
DEBUG -     raise ConfigSessionError(output)
DEBUG - vyos.configsession.ConfigSessionError: [ vrf ]
DEBUG - VRF "red" table id modification not possible!
DEBUG - [[vrf]] failed
DEBUG - Commit failed
DEBUG - 
DEBUG - 
DEBUG - ======================================================================
DEBUG - ERROR: test_vrf_disable_forwarding (__main__.VRFTest.test_vrf_disable_forwarding)
DEBUG - ----------------------------------------------------------------------
DEBUG - Traceback (most recent call last):
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/test_vrf.py", line 71, in tearDown
DEBUG -     self.cli_commit()
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/base_vyostest_shim.py", line 97, in cli_commit
DEBUG -     self._session.commit()
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 264, in commit
DEBUG -     out = self.__run_command([COMMIT])
DEBUG -           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 201, in __run_command
DEBUG -     raise ConfigSessionError(output)
DEBUG - vyos.configsession.ConfigSessionError: [ vrf ]
DEBUG - Can not remove VRF "red", it still has member interfaces!
DEBUG - delete [ vrf ] failed
DEBUG - Commit failed
DEBUG - 
DEBUG - 
DEBUG - ======================================================================
DEBUG - ERROR: test_vrf_ip_ipv6_nht (__main__.VRFTest.test_vrf_ip_ipv6_nht)
DEBUG - ----------------------------------------------------------------------
DEBUG - Traceback (most recent call last):
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/test_vrf.py", line 545, in test_vrf_ip_ipv6_nht
DEBUG -     self.cli_commit()
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/base_vyostest_shim.py", line 97, in cli_commit
DEBUG -     self._session.commit()
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 264, in commit
DEBUG -     out = self.__run_command([COMMIT])
DEBUG -           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 201, in __run_command
DEBUG -     raise ConfigSessionError(output)
DEBUG - vyos.configsession.ConfigSessionError: [ vrf ]
DEBUG - VRF "red" table id modification not possible!
DEBUG - [[vrf]] failed
DEBUG - Commit failed
DEBUG - 
DEBUG - 
DEBUG - ======================================================================
DEBUG - ERROR: test_vrf_ip_ipv6_nht (__main__.VRFTest.test_vrf_ip_ipv6_nht)
DEBUG - ----------------------------------------------------------------------
DEBUG - Traceback (most recent call last):
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/test_vrf.py", line 71, in tearDown
DEBUG -     self.cli_commit()
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/base_vyostest_shim.py", line 97, in cli_commit
DEBUG -     self._session.commit()
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 264, in commit
DEBUG -     out = self.__run_command([COMMIT])
DEBUG -           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 201, in __run_command
DEBUG -     raise ConfigSessionError(output)
DEBUG - vyos.configsession.ConfigSessionError: [ vrf ]
DEBUG - Can not remove VRF "red", it still has member interfaces!
DEBUG - delete [ vrf ] failed
DEBUG - Commit failed
DEBUG - 
DEBUG - 
DEBUG - ======================================================================
DEBUG - ERROR: test_vrf_ip_ipv6_protocol_non_existing_route_map (__main__.VRFTest.test_vrf_ip_ipv6_protocol_non_existing_route_map)
DEBUG - ----------------------------------------------------------------------
DEBUG - Traceback (most recent call last):
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/test_vrf.py", line 369, in test_vrf_ip_ipv6_protocol_non_existing_route_map
DEBUG -     self.cli_commit()
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/base_vyostest_shim.py", line 97, in cli_commit
DEBUG -     self._session.commit()
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 264, in commit
DEBUG -     out = self.__run_command([COMMIT])
DEBUG -           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 201, in __run_command
DEBUG -     raise ConfigSessionError(output)
DEBUG - vyos.configsession.ConfigSessionError: [ vrf ]
DEBUG - VRF "red" table id modification not possible!
DEBUG - [[vrf]] failed
DEBUG - Commit failed
DEBUG - 
DEBUG - 
DEBUG - ======================================================================
DEBUG - ERROR: test_vrf_ip_ipv6_protocol_non_existing_route_map (__main__.VRFTest.test_vrf_ip_ipv6_protocol_non_existing_route_map)
DEBUG - ----------------------------------------------------------------------
DEBUG - Traceback (most recent call last):
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/test_vrf.py", line 71, in tearDown
DEBUG -     self.cli_commit()
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/base_vyostest_shim.py", line 97, in cli_commit
DEBUG -     self._session.commit()
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 264, in commit
DEBUG -     out = self.__run_command([COMMIT])
DEBUG -           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 201, in __run_command
DEBUG -     raise ConfigSessionError(output)
DEBUG - vyos.configsession.ConfigSessionError: [ vrf ]
DEBUG - Can not remove VRF "red", it still has member interfaces!
DEBUG - delete [ vrf ] failed
DEBUG - Commit failed
DEBUG - 
DEBUG - 
DEBUG - ======================================================================
DEBUG - ERROR: test_vrf_ip_protocol_route_map (__main__.VRFTest.test_vrf_ip_protocol_route_map)
DEBUG - ----------------------------------------------------------------------
DEBUG - Traceback (most recent call last):
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/test_vrf.py", line 322, in test_vrf_ip_protocol_route_map
DEBUG -     self.cli_commit()
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/base_vyostest_shim.py", line 97, in cli_commit
DEBUG -     self._session.commit()
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 264, in commit
DEBUG -     out = self.__run_command([COMMIT])
DEBUG -           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 201, in __run_command
DEBUG -     raise ConfigSessionError(output)
DEBUG - vyos.configsession.ConfigSessionError: [ vrf ]
DEBUG - VRF "red" table id modification not possible!
DEBUG - [[vrf]] failed
DEBUG - Commit failed
DEBUG - 
DEBUG - 
DEBUG - ======================================================================
DEBUG - ERROR: test_vrf_ip_protocol_route_map (__main__.VRFTest.test_vrf_ip_protocol_route_map)
DEBUG - ----------------------------------------------------------------------
DEBUG - Traceback (most recent call last):
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/test_vrf.py", line 71, in tearDown
DEBUG -     self.cli_commit()
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/base_vyostest_shim.py", line 97, in cli_commit
DEBUG -     self._session.commit()
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 264, in commit
DEBUG -     out = self.__run_command([COMMIT])
DEBUG -           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 201, in __run_command
DEBUG -     raise ConfigSessionError(output)
DEBUG - vyos.configsession.ConfigSessionError: [ vrf ]
DEBUG - Can not remove VRF "red", it still has member interfaces!
DEBUG - 
DEBUG - delete [ vrf ] failed
DEBUG - Commit failed
DEBUG - 
DEBUG - 
DEBUG - ======================================================================
DEBUG - ERROR: test_vrf_ipv6_protocol_route_map (__main__.VRFTest.test_vrf_ipv6_protocol_route_map)
DEBUG - ----------------------------------------------------------------------
DEBUG - Traceback (most recent call last):
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/test_vrf.py", line 385, in test_vrf_ipv6_protocol_route_map
DEBUG -     self.cli_commit()
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/base_vyostest_shim.py", line 97, in cli_commit
DEBUG -     self._session.commit()
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 264, in commit
DEBUG -     out = self.__run_command([COMMIT])
DEBUG -           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 201, in __run_command
DEBUG -     raise ConfigSessionError(output)
DEBUG - vyos.configsession.ConfigSessionError: [ vrf ]
DEBUG - VRF "red" table id modification not possible!
DEBUG - [[vrf]] failed
DEBUG - Commit failed
DEBUG - 
DEBUG - 
DEBUG - ======================================================================
DEBUG - ERROR: test_vrf_ipv6_protocol_route_map (__main__.VRFTest.test_vrf_ipv6_protocol_route_map)
DEBUG - ----------------------------------------------------------------------
DEBUG - Traceback (most recent call last):
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/test_vrf.py", line 71, in tearDown
DEBUG -     self.cli_commit()
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/base_vyostest_shim.py", line 97, in cli_commit
DEBUG -     self._session.commit()
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 264, in commit
DEBUG -     out = self.__run_command([COMMIT])
DEBUG -           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 201, in __run_command
DEBUG -     raise ConfigSessionError(output)
DEBUG - vyos.configsession.ConfigSessionError: [ vrf ]
DEBUG - Can not remove VRF "red", it still has member interfaces!
DEBUG - delete [ vrf ] failed
DEBUG - Commit failed
DEBUG - 
DEBUG - 
DEBUG - ======================================================================
DEBUG - ERROR: test_vrf_link_local_ip_addresses (__main__.VRFTest.test_vrf_link_local_ip_addresses)
DEBUG - ----------------------------------------------------------------------
DEBUG - Traceback (most recent call last):
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/test_vrf.py", line 260, in test_vrf_link_local_ip_addresses
DEBUG -     self.cli_commit()
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/base_vyostest_shim.py", line 97, in cli_commit
DEBUG -     self._session.commit()
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 264, in commit
DEBUG -     out = self.__run_command([COMMIT])
DEBUG -           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 201, in __run_command
DEBUG -     raise ConfigSessionError(output)
DEBUG - vyos.configsession.ConfigSessionError: [ vrf ]
DEBUG - Can not remove VRF "red", it still has member interfaces!
DEBUG - delete [ vrf ] failed
DEBUG - Commit failed
DEBUG - 
DEBUG - 
DEBUG - ======================================================================
DEBUG - ERROR: test_vrf_link_local_ip_addresses (__main__.VRFTest.test_vrf_link_local_ip_addresses)
DEBUG - ----------------------------------------------------------------------
DEBUG - Traceback (most recent call last):
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/test_vrf.py", line 71, in tearDown
DEBUG -     self.cli_commit()
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/base_vyostest_shim.py", line 97, in cli_commit
DEBUG -     self._session.commit()
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 264, in commit
DEBUG -     out = self.__run_command([COMMIT])
DEBUG -           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 201, in __run_command
DEBUG -     raise ConfigSessionError(output)
DEBUG - vyos.configsession.ConfigSessionError: [ vrf ]
DEBUG - Can not remove VRF "red", it still has member interfaces!
DEBUG - delete [ vrf ] failed
DEBUG - Commit failed
DEBUG - 
DEBUG - 
DEBUG - ======================================================================
DEBUG - ERROR: test_vrf_loopbacks_ips (__main__.VRFTest.test_vrf_loopbacks_ips)
DEBUG - ----------------------------------------------------------------------
DEBUG - Traceback (most recent call last):
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/test_vrf.py", line 137, in test_vrf_loopbacks_ips
DEBUG -     self.cli_commit()
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/base_vyostest_shim.py", line 97, in cli_commit
DEBUG -     self._session.commit()
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 264, in commit
DEBUG -     out = self.__run_command([COMMIT])
DEBUG -           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 201, in __run_command
DEBUG -     raise ConfigSessionError(output)
DEBUG - vyos.configsession.ConfigSessionError: [ vrf ]
DEBUG - VRF "red" table id modification not possible!
DEBUG - [[vrf]] failed
DEBUG - Commit failed
DEBUG - 
DEBUG - 
DEBUG - ======================================================================
DEBUG - ERROR: test_vrf_loopbacks_ips (__main__.VRFTest.test_vrf_loopbacks_ips)
DEBUG - ----------------------------------------------------------------------
DEBUG - Traceback (most recent call last):
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/test_vrf.py", line 71, in tearDown
DEBUG -     self.cli_commit()
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/base_vyostest_shim.py", line 97, in cli_commit
DEBUG -     self._session.commit()
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 264, in commit
DEBUG -     out = self.__run_command([COMMIT])
DEBUG -           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 201, in __run_command
DEBUG -     raise ConfigSessionError(output)
DEBUG - vyos.configsession.ConfigSessionError: [ vrf ]
DEBUG - Can not remove VRF "red", it still has member interfaces!
DEBUG - delete [ vrf ] failed
DEBUG - Commit failed
DEBUG - 
DEBUG - 
DEBUG - ======================================================================
DEBUG - ERROR: test_vrf_static_route (__main__.VRFTest.test_vrf_static_route)
DEBUG - ----------------------------------------------------------------------
DEBUG - Traceback (most recent call last):
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/test_vrf.py", line 232, in test_vrf_static_route
DEBUG -     self.cli_commit()
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/base_vyostest_shim.py", line 97, in cli_commit
DEBUG -     self._session.commit()
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 264, in commit
DEBUG -     out = self.__run_command([COMMIT])
DEBUG -           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 201, in __run_command
DEBUG -     raise ConfigSessionError(output)
DEBUG - vyos.configsession.ConfigSessionError: [ vrf ]
DEBUG - VRF "red" table id modification not possible!
DEBUG - [[vrf]] failed
DEBUG - [[vrf name baz_foo protocols static]] failed
DEBUG - [[vrf name green protocols static]] failed
DEBUG - [[vrf name foo-bar protocols static]] failed
DEBUG - [[vrf name blue protocols static]] failed
DEBUG - Commit failed
DEBUG - 
DEBUG - 
DEBUG - ======================================================================
DEBUG - ERROR: test_vrf_static_route (__main__.VRFTest.test_vrf_static_route)
DEBUG - ----------------------------------------------------------------------
DEBUG - Traceback (most recent call last):
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/test_vrf.py", line 71, in tearDown
DEBUG -     self.cli_commit()
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/base_vyostest_shim.py", line 97, in cli_commit
DEBUG -     self._session.commit()
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 264, in commit
DEBUG -     out = self.__run_command([COMMIT])
DEBUG -           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 201, in __run_command
DEBUG -     raise ConfigSessionError(output)
DEBUG - vyos.configsession.ConfigSessionError: [ vrf ]
DEBUG - Can not remove VRF "red", it still has member interfaces!
DEBUG - delete [ vrf ] failed
DEBUG - Commit failed
DEBUG - 
DEBUG - 
DEBUG - ======================================================================
DEBUG - ERROR: test_vrf_table_id_is_unalterable (__main__.VRFTest.test_vrf_table_id_is_unalterable)
DEBUG - ----------------------------------------------------------------------
DEBUG - Traceback (most recent call last):
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/test_vrf.py", line 71, in tearDown
DEBUG -     self.cli_commit()
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/base_vyostest_shim.py", line 97, in cli_commit
DEBUG -     self._session.commit()
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 264, in commit
DEBUG -     out = self.__run_command([COMMIT])
DEBUG -           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 201, in __run_command
DEBUG -     raise ConfigSessionError(output)
DEBUG - vyos.configsession.ConfigSessionError: [ vrf ]
DEBUG - Can not remove VRF "red", it still has member interfaces!
DEBUG - delete [ vrf ] failed
DEBUG - Commit failed
DEBUG - 
DEBUG - 
DEBUG - ======================================================================
DEBUG - ERROR: test_vrf_vni_add_change_remove (__main__.VRFTest.test_vrf_vni_add_change_remove)
DEBUG - ----------------------------------------------------------------------
DEBUG - Traceback (most recent call last):
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/test_vrf.py", line 453, in test_vrf_vni_add_change_remove
DEBUG -     self.cli_commit()
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/base_vyostest_shim.py", line 97, in cli_commit
DEBUG -     self._session.commit()
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 264, in commit
DEBUG -     out = self.__run_command([COMMIT])
DEBUG -           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 201, in __run_command
DEBUG -     raise ConfigSessionError(output)
DEBUG - vyos.configsession.ConfigSessionError: [ vrf ]
DEBUG - VRF "red" table id modification not possible!
DEBUG - [[vrf]] failed
DEBUG - Commit failed
DEBUG - 
DEBUG - 
DEBUG - ======================================================================
DEBUG - ERROR: test_vrf_vni_add_change_remove (__main__.VRFTest.test_vrf_vni_add_change_remove)
DEBUG - ----------------------------------------------------------------------
DEBUG - Traceback (most recent call last):
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/test_vrf.py", line 71, in tearDown
DEBUG -     self.cli_commit()
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/base_vyostest_shim.py", line 97, in cli_commit
DEBUG -     self._session.commit()
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 264, in commit
DEBUG -     out = self.__run_command([COMMIT])
DEBUG -           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 201, in __run_command
DEBUG -     raise ConfigSessionError(output)
DEBUG - vyos.configsession.ConfigSessionError: [ vrf ]
DEBUG - Can not remove VRF "red", it still has member interfaces!
DEBUG - delete [ vrf ] failed
DEBUG - Commit failed
DEBUG - 
DEBUG - 
DEBUG - ======================================================================
DEBUG - ERROR: test_vrf_vni_and_table_id (__main__.VRFTest.test_vrf_vni_and_table_id)
DEBUG - ----------------------------------------------------------------------
DEBUG - Traceback (most recent call last):
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/test_vrf.py", line 71, in tearDown
DEBUG -     self.cli_commit()
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/base_vyostest_shim.py", line 97, in cli_commit
DEBUG -     self._session.commit()
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 264, in commit
DEBUG -     out = self.__run_command([COMMIT])
DEBUG -           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 201, in __run_command
DEBUG -     raise ConfigSessionError(output)
DEBUG - vyos.configsession.ConfigSessionError: [ vrf ]
DEBUG - Can not remove VRF "red", it still has member interfaces!
DEBUG - delete [ vrf ] failed
DEBUG - Commit failed
DEBUG - 
DEBUG - 
DEBUG - ======================================================================
DEBUG - ERROR: test_vrf_vni_duplicates (__main__.VRFTest.test_vrf_vni_duplicates)
DEBUG - ----------------------------------------------------------------------
DEBUG - Traceback (most recent call last):
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/test_vrf.py", line 431, in test_vrf_vni_duplicates
DEBUG -     self.cli_commit()
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/base_vyostest_shim.py", line 97, in cli_commit
DEBUG -     self._session.commit()
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 264, in commit
DEBUG -     out = self.__run_command([COMMIT])
DEBUG -           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 201, in __run_command
DEBUG -     raise ConfigSessionError(output)
DEBUG - vyos.configsession.ConfigSessionError: [ vrf ]
DEBUG - VRF "baz_foo" table id modification not possible!
DEBUG - [[vrf]] failed
DEBUG - Commit failed
DEBUG - 
DEBUG - 
DEBUG - ======================================================================
DEBUG - ERROR: test_vrf_vni_duplicates (__main__.VRFTest.test_vrf_vni_duplicates)
DEBUG - ----------------------------------------------------------------------
DEBUG - Traceback (most recent call last):
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/test_vrf.py", line 71, in tearDown
DEBUG -     self.cli_commit()
DEBUG -   File "/usr/libexec/vyos/tests/smoke/cli/base_vyostest_shim.py", line 97, in cli_commit
DEBUG -     self._session.commit()
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 264, in commit
DEBUG -     out = self.__run_command([COMMIT])
DEBUG -           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
DEBUG -   File "/usr/lib/python3/dist-packages/vyos/configsession.py", line 201, in __run_command
DEBUG -     raise ConfigSessionError(output)
DEBUG - vyos.configsession.ConfigSessionError: [ vrf ]
DEBUG - Can not remove VRF "red", it still has member interfaces!
DEBUG - delete [ vrf ] failed
DEBUG - Commit failed
DEBUG - 
DEBUG - 
DEBUG - ----------------------------------------------------------------------
DEBUG - Ran 15 tests in 130.471s
DEBUG - 
DEBUG - FAILED (errors=28)

Details

Version
current
Is it a breaking change?
Unspecified (possibly destroys the router)
Issue type
Bug (incorrect behavior)
Forum thread
https://forum.vyos.io/t/smoke-tests-failing-again/16200

Event Timeline

MPStudyly created this task.Mar 4 2025, 9:41 AM
MPStudyly updated the task description. (Show Details)Mar 4 2025, 10:19 AM
Viacheslav triaged this task as Normal priority.Mar 4 2025, 10:24 AM
MPStudyly set Forum thread to https://forum.vyos.io/t/smoke-tests-failing-again/16200.Mar 4 2025, 10:26 AM
pasik subscribed.Mar 4 2025, 1:23 PM
c-po subscribed.Mar 4 2025, 1:28 PM

Hi @MPStudyly,

can it be the case that your system you're running the test son already has a VRF named red?

MPStudyly added a comment.Mar 4 2025, 9:16 PM
In T7215#217255, @c-po wrote:

Hi @MPStudyly,

can it be the case that your system you're running the test son already has a VRF named red?

I'm not sure, I simply run it from the vyos_build docker container, which spawns it's own VM. I never touch that VM by hand, just let it do it's thing. It could be though some previous tests create such VRF and never clean it up.

MPStudyly added a comment.Mar 11 2025, 6:41 PM

Is there anything else I can provide you with @c-po?

c-po added a comment.Apr 7 2025, 3:44 PM

It could be though some previous tests create such VRF and never clean it up.

Yes - check for previous errors

MPStudyly added a comment.Apr 15 2025, 3:19 PM

I finally got to run it again. There were indeed quite a few errors before the VRF tests. Though I'm not sure which one could actually be the curlprit. I attached the full output of the smoketest run. Hope this actually helps in sorting the issues :)

smoketests_output_failure.txt309 KBDownload

Viacheslav subscribed.Apr 15 2025, 4:22 PM

Try the same but with make test-no-interfaces

MPStudyly added a comment.Apr 15 2025, 5:30 PM

Will do on Thursday, the whole procedure takes ~6h on my machine and tomorrow I'm out of town 😅

MPStudyly added a comment.Apr 17 2025, 4:08 PM

Here you go :)

smoketests_output_test_no_interfaces.txt76 KBDownload

MPStudyly added a comment.EditedJul 11 2025, 12:57 PM

Any updates on this? Just re-ran the tests to discover there are quite a lot of other/new failures. I also noticed the nightly builds workflow to be disabled since 4 months. Still there are recent nightly releases available in that repository. Did you internally switch to some other workflow that's not public (yet)? Otherwise I'd not assume you've quit running the tests yourself.

Viacheslav closed this task as Not Applicable.Jul 11 2025, 1:24 PM

In our environment, all tests passed as during build, as installed on the test VM

 DEBUG - Running Testcase: /usr/libexec/vyos/tests/smoke/cli/test_vrf.py
DEBUG - test_vrf_assign_interface (__main__.VRFTest.test_vrf_assign_interface) ... ok
DEBUG - test_vrf_bind_all (__main__.VRFTest.test_vrf_bind_all) ... ok
DEBUG - test_vrf_conntrack (__main__.VRFTest.test_vrf_conntrack) ... ok
DEBUG - test_vrf_disable_forwarding (__main__.VRFTest.test_vrf_disable_forwarding) ... ok
DEBUG - test_vrf_ip_ipv6_nht (__main__.VRFTest.test_vrf_ip_ipv6_nht) ... ok
DEBUG - test_vrf_ip_ipv6_protocol_non_existing_route_map (__main__.VRFTest.test_vrf_ip_ipv6_protocol_non_existing_route_map) ... ok
DEBUG - test_vrf_ip_protocol_route_map (__main__.VRFTest.test_vrf_ip_protocol_route_map) ... ok
DEBUG - test_vrf_ipv6_protocol_route_map (__main__.VRFTest.test_vrf_ipv6_protocol_route_map) ... ok
DEBUG - test_vrf_link_local_ip_addresses (__main__.VRFTest.test_vrf_link_local_ip_addresses) ... ok
DEBUG - test_vrf_loopbacks_ips (__main__.VRFTest.test_vrf_loopbacks_ips) ... ok
DEBUG - test_vrf_static_route (__main__.VRFTest.test_vrf_static_route) ... ok
DEBUG - test_vrf_table_id_is_unalterable (__main__.VRFTest.test_vrf_table_id_is_unalterable) ... ok
DEBUG - test_vrf_vni_add_change_remove (__main__.VRFTest.test_vrf_vni_add_change_remove) ... ok
DEBUG - test_vrf_vni_and_table_id (__main__.VRFTest.test_vrf_vni_and_table_id) ... ok
DEBUG - test_vrf_vni_duplicates (__main__.VRFTest.test_vrf_vni_duplicates) ... ok
DEBUG - 
DEBUG - ----------------------------------------------------------------------
DEBUG - Ran 15 tests in 308.260s
DEBUG -

For example, the latest rolling:

vyos@r14:~$ /usr/libexec/vyos/tests/smoke/cli/test_vrf.py
test_vrf_assign_interface (__main__.VRFTest.test_vrf_assign_interface) ... ok
test_vrf_bind_all (__main__.VRFTest.test_vrf_bind_all) ... ok
test_vrf_conntrack (__main__.VRFTest.test_vrf_conntrack) ... ok
test_vrf_disable_forwarding (__main__.VRFTest.test_vrf_disable_forwarding) ... ok
test_vrf_ip_ipv6_nht (__main__.VRFTest.test_vrf_ip_ipv6_nht) ... ok
test_vrf_ip_ipv6_protocol_non_existing_route_map (__main__.VRFTest.test_vrf_ip_ipv6_protocol_non_existing_route_map) ... ok
test_vrf_ip_protocol_route_map (__main__.VRFTest.test_vrf_ip_protocol_route_map) ... ok
test_vrf_ipv6_protocol_route_map (__main__.VRFTest.test_vrf_ipv6_protocol_route_map) ... ok
test_vrf_link_local_ip_addresses (__main__.VRFTest.test_vrf_link_local_ip_addresses) ... ok
test_vrf_loopbacks_ips (__main__.VRFTest.test_vrf_loopbacks_ips) ... ok
test_vrf_static_route (__main__.VRFTest.test_vrf_static_route) ... ok
test_vrf_table_id_is_unalterable (__main__.VRFTest.test_vrf_table_id_is_unalterable) ... ok
test_vrf_vni_add_change_remove (__main__.VRFTest.test_vrf_vni_add_change_remove) ... ok
test_vrf_vni_and_table_id (__main__.VRFTest.test_vrf_vni_and_table_id) ... ok
test_vrf_vni_duplicates (__main__.VRFTest.test_vrf_vni_duplicates) ... ok

----------------------------------------------------------------------
Ran 15 tests in 296.552s

OK
vyos@r14:~$ 
vyos@r14:~$ show ver
Version:          VyOS 2025.07.11-0020-rolling
Release train:    current
Release flavor:   generic

Built by:         autobuild@vyos.net
Built on:         Fri 11 Jul 2025 00:20 UTC
Build UUID:       0f11a506-f241-46a1-86cf-fb6008264d0f
Build commit ID:  c9b8053f272986

Architecture:     x86_64
Boot via:         installed image
System type:      KVM guest
Secure Boot:      n/a (BIOS)

Hardware vendor:  QEMU
Hardware model:   Standard PC (Q35 + ICH9, 2009)
Hardware S/N:     
Hardware UUID:    99538d03-5068-45e7-a5ef-847967ffc5c7

Copyright:        VyOS maintainers and contributors
vyos@r14:~$

I'll mark as not applicable

MPStudyly added a comment.EditedJul 11 2025, 4:34 PM

That's odd, I really wonder what the difference between our environments is. I'm running all tests inside the build container directly calling "sudo make <target>" one after another for the targets:

  • test-no-interfaces
  • test-interfaces
  • testc
  • testraid
  • testtpm

Which should be 1:1 what your workflow is doing. I'll provide an other output text, when I can rerun the tests. Even if this looks like an issue on my side, I'd love to find the culprit, hopefully being able to help setting up some docs about running the tests.

jestabro subscribed.Jul 14 2025, 12:27 PM

@MPStudyly note that tests are not run with sudo

MPStudyly added a comment.EditedJul 15 2025, 1:51 PM
In T7215#229394, @jestabro wrote:

@MPStudyly note that tests are not run with sudo

That is an interesting point I probably overlooked. I assumed these targets to require sudo as well, as ./build-vyos-image does require it, at least following the existing docs. I'll do a rerun of the tests now and post my findings. Fingers crossed all issues go away with the removal of sudo.

EDIT: The tests fail due to permission errors when omitting sudo:

Run target 'test-no-interfaces' ...

if [ ! -f build/live-image-amd64.hybrid.iso ]; then
echo "Could not find build/live-image-amd64.hybrid.iso"
exit 1
fi
scripts/check-qemu-install --debug --configd --smoketest --uefi --no-interfaces --cpu 4 --memory 8 build/live-image-amd64.hybrid.iso
 INFO - Creating Disk image testinstall-20250715-141319-9813.img
DEBUG - Formatting 'testinstall-20250715-141319-9813.img', fmt=raw size=2147483648

 INFO - Installing system
DEBUG - Executing command: qemu-system-x86_64         -name "VyOS-QEMU-UEFI"         -smp 4,sockets=1,cores=4,threads=1         -cpu host         -machine pc,accel=kvm         -bios /usr/share/OVMF/OVMF_CODE.fd         -m 8G         -vga none         -nographic         -vga none         -uuid f48b60b2-e6ad-49ef-9d09-4245d0585e52         -cpu host          -drive file=build/live-image-amd64.hybrid.iso,format=raw,if=none,media=cdrom,id=drive-cd1,readonly=on -device ahci,id=achi0 -device ide-cd,bus=achi0.0,drive=drive-cd1,id=cd1,bootindex=10         -enable-kvm         -monitor unix:/tmp/qemu-monitor-socket-testinstall-20250715-141319-9813.img,server,nowait         -netdev user,id=n0,net=192.0.2.0/24,dhcpstart=192.0.2.101,dns=192.0.2.10 -device virtio-net-pci,netdev=n0,mac=00:00:5E:00:53:00,romfile=""         -netdev user,id=n1 -device virtio-net-pci,netdev=n1,mac=00:00:5E:00:53:01,romfile=""         -netdev user,id=n2 -device virtio-net-pci,netdev=n2,mac=00:00:5E:00:53:02,romfile=""         -netdev user,id=n3 -device virtio-net-pci,netdev=n3,mac=00:00:5E:00:53:03,romfile=""         -netdev user,id=n4 -device virtio-net-pci,netdev=n4,mac=00:00:5E:00:53:04,romfile=""         -netdev user,id=n5 -device virtio-net-pci,netdev=n5,mac=00:00:5E:00:53:05,romfile=""         -netdev user,id=n6 -device virtio-net-pci,netdev=n6,mac=00:00:5E:00:53:06,romfile=""         -netdev user,id=n7 -device virtio-net-pci,netdev=n7,mac=00:00:5E:00:53:07,romfile=""         -device virtio-scsi-pci,id=scsi0         -drive format=raw,file=testinstall-20250715-141319-9813.img,if=none,media=disk,id=drive-hd1,readonly=off         -device scsi-hd,bus=scsi0.0,drive=drive-hd1,id=hd1,bootindex=1
DEBUG - Could not access KVM kernel module: Permission denied
DEBUG - qemu-system-x86_64: failed to initialize kvm: Permission denied
ERROR - Exeption while executing QEMU
ERROR - Is qemu working on this system?
ERROR - Traceback (most recent call last):
  File "/vyos/scripts/check-qemu-install", line 398, in <module>
    c.expect('Welcome to GRUB', timeout=10)
  File "/usr/lib/python3/dist-packages/pexpect/spawnbase.py", line 343, in expect
    return self.expect_list(compiled_pattern_list,
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/pexpect/spawnbase.py", line 372, in expect_list
    return exp.expect_loop(timeout)
           ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/pexpect/expect.py", line 179, in expect_loop
    return self.eof(e)
           ^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/pexpect/expect.py", line 122, in eof
    raise exc
pexpect.exceptions.EOF: End Of File (EOF). Exception style platform.
<pexpect.pty_spawn.spawn object at 0x7f09a8128590>
command: /usr/bin/qemu-system-x86_64
args: ['/usr/bin/qemu-system-x86_64', '-name', 'VyOS-QEMU-UEFI', '-smp', '4,sockets=1,cores=4,threads=1', '-cpu', 'host', '-machine', 'pc,accel=kvm', '-bios', '/usr/share/OVMF/OVMF_CODE.fd', '-m', '8G', '-vga', 'none', '-nographic', '-vga', 'none', '-uuid', 'f48b60b2-e6ad-49ef-9d09-4245d0585e52', '-cpu', 'host', '-drive', 'file=build/live-image-amd64.hybrid.iso,format=raw,if=none,media=cdrom,id=drive-cd1,readonly=on', '-device', 'ahci,id=achi0', '-device', 'ide-cd,bus=achi0.0,drive=drive-cd1,id=cd1,bootindex=10', '-enable-kvm', '-monitor', 'unix:/tmp/qemu-monitor-socket-testinstall-20250715-141319-9813.img,server,nowait', '-netdev', 'user,id=n0,net=192.0.2.0/24,dhcpstart=192.0.2.101,dns=192.0.2.10', '-device', 'virtio-net-pci,netdev=n0,mac=00:00:5E:00:53:00,romfile=', '-netdev', 'user,id=n1', '-device', 'virtio-net-pci,netdev=n1,mac=00:00:5E:00:53:01,romfile=', '-netdev', 'user,id=n2', '-device', 'virtio-net-pci,netdev=n2,mac=00:00:5E:00:53:02,romfile=', '-netdev', 'user,id=n3', '-device', 'virtio-net-pci,netdev=n3,mac=00:00:5E:00:53:03,romfile=', '-netdev', 'user,id=n4', '-device', 'virtio-net-pci,netdev=n4,mac=00:00:5E:00:53:04,romfile=', '-netdev', 'user,id=n5', '-device', 'virtio-net-pci,netdev=n5,mac=00:00:5E:00:53:05,romfile=', '-netdev', 'user,id=n6', '-device', 'virtio-net-pci,netdev=n6,mac=00:00:5E:00:53:06,romfile=', '-netdev', 'user,id=n7', '-device', 'virtio-net-pci,netdev=n7,mac=00:00:5E:00:53:07,romfile=', '-device', 'virtio-scsi-pci,id=scsi0', '-drive', 'format=raw,file=testinstall-20250715-141319-9813.img,if=none,media=disk,id=drive-hd1,readonly=off', '-device', 'scsi-hd,bus=scsi0.0,drive=drive-hd1,id=hd1,bootindex=1']
buffer (last 100 chars): b''
before (last 100 chars): b' kernel module: Permission denied\r\nqemu-system-x86_64: failed to initialize kvm: Permission denied\r\n'
after: <class 'pexpect.exceptions.EOF'>
match: None
match_index: None
exitstatus: None
flag_eof: True
pid: 131460
child_fd: 5
closed: False
timeout: 60
delimiter: <class 'pexpect.exceptions.EOF'>
logfile: <__main__.StreamToLogger object at 0x7f09a7e69490>
logfile_read: None
logfile_send: None
maxread: 2000
ignorecase: False
searchwindowsize: None
delaybeforesend: 0.05
delayafterclose: 0.1
delayafterterminate: 0.1
searcher: searcher_re:
    0: re.compile(b'Welcome to GRUB')

 INFO - Cleaning up
 INFO - Removing disk file: testinstall-20250715-141319-9813.img
ERROR - Hmm... system got an exception while processing.
ERROR - The ISO image is not considered usable!
make: *** [Makefile:29: test-no-interfaces] Error 1
Error occurred in tests for target 'test-no-interfaces', aborting!

EDIT2: @jestabro it seems you also run the tests with sudo, at least the nightly build workflow is configured to do so. So I assume calling them with sudo is the right way to do it.

MPStudyly added a comment.EditedJul 16 2025, 9:18 AM

Unfortunately I don't get the tests to run through. I rechecked the docs, noticed I was missing the sysctl to enable (?) local ipv6, added that and re-ran the tests, just to have some less fail, but still. What also confuses me are the VPP tests. Weren't those supposed to be hidden behind a separate target, as that whole feature is still under development? Regardless, there are still other errors occurring on some login related stuff, but that could indeed be caused by something broken.

test-no-interfaces.txt244 KBDownload

EDIT: I just found out, the VPP tests were indeed split off the default tests, but instead of adding a target including those, a new target without VPP tests was created. Going to do a run with 'test-no-interfaces-no-vpp' for now. Regardless, I'd like to know how to get VPP tests going, as it seems the issue on my side is probably just missing huge page support.

Viacheslav added a comment.Jul 16 2025, 10:20 AM

You can open a topic on the forum

MPStudyly added a comment.EditedJul 17 2025, 10:05 AM

I found one actually relevant/related issue, opened a task and an according PR. With that done, I'm able to get through the tests in general. They still fail for me due to those login related issues, which is probably something actually broken on upstream, but can be discussed at the forum indeed.

MPStudyly added a comment.Tue, Nov 11, 2:14 PM

As posted in https://forum.vyos.io/t/vyos-build-failing-smoketests/16811/13 I can close this bug report as user error 😅