podman/tests
Ed Santiago c10ab01751 Sigh. Disable reboot. Disable cgroups v1 test.
There's a nasty bug in the CI infrastructure: reboots
hang forever[1]. Sometimes they work, but only 25% of
the time -- the rest of the time, gating tests fail.

 [1] https://redhat.service-now.com/surl.do?n=PNT0808530

So, let's just disable the reboot and all cgroups v1 tests.
For now, I've disabled with a quick edit that should allow
us to reenable if/when the reboot bug is fixed.

TODO: reevaluate in three months (2020-08). If the reboot
bug is not fixed by then, just scrap the entire cgroups
refactoring and go back to plain standard-test-basic.

Signed-off-by: Ed Santiago <santiago@redhat.com>
2020-05-21 17:37:36 +00:00
..
roles Yet more ansible muckery, to get test results 2020-05-14 07:14:13 -06:00
check_results.yml Yet more ansible muckery, to get test results 2020-05-14 07:14:13 -06:00
README Complete rewrite of gating tests 2020-04-28 12:30:29 -06:00
test_podman_cgroups_vn.yml Complete rewrite of gating tests 2020-04-28 12:30:29 -06:00
test_podman.yml Sigh. Disable reboot. Disable cgroups v1 test. 2020-05-21 17:37:36 +00:00
tests.yml Quick simple tests for podman 2018-11-13 09:50:53 -07:00

I'm sorry. The playbooks here are a much-too-complicated way of saying:

   - test podman (root and rootless) under cgroups v2
   - reboot into cgroups v1
   - repeat the same podman tests

We can't use standard-test-basic any more because, tl;dr, that has to
be the last stanza in the playbook and it doesn't offer any mechanism
for running a reboot in the middle of tests. (I actually found a way
but it was even uglier than this approach).

The starting point is tests.yml . From there:

    tests.yml
      \- test_podman.yml
           |- roles/rootless_user_ready/
           \- test_podman_cgroups_vn.yml    (runs twice: cgroups v2, v1)
                |- roles/set_cgroups/
                \- roles/run_bats_tests/    (runs tests: root, rootless)

Principal result is the file 'artifacts/test.log'. It will contain
one line for each test run, format will be '(PASS|FAIL|ERROR) <test name>'

For each completed test there will also be a 'test.<name>.bats.log'
containing some setup blurbs (RPMs, environment) and the full BATS log.