Currently smoketest/bin/vyos-smoketest in vyos-1x runs all tests without any indication of progress + when tests are finished just outputs SUCCESS or FAILURE without any indication which tests failed. Moreover if one test hangs, whole script hangs.
I suggest:
- Before each test start output progress like "Running Testcase (50/114): /usr/libexec/vyos/tests/smoke/cli/test_protocols_rip.py"
- On run finish, output list of failed tests if there were any.
- Otuput "TIMEOUT" as result of test if it hanged (20 minutes limit should be fine?..)