Upstream now includes FMF metadata and the setup/run scripts to run the
nondestructive verify tests in a provided testbed. These are now
constantly being verified through packit.
Drop the code duplication and just add some minimal FMF metadata to
discover the tests.
This currently has to hardcode the version number. This eventually must
become more flexible in FMF (https://github.com/psss/tmt/issues/585),
but until then we can update this in the cockpituous release scripts.
Revert the downgrade from commit 168e0397aa and install the full
chromium package instead. This has a lot more dependencies, but is not
affected by the Ctrl+A keyDown crash.
Commit e17149cb did not work as intended -- the RHEL gating machines
also don't have /dev/kvm, but are still powerful enough to run all
Machines tests. So consult /etc/os-release instead of /dev/kvm.
Each Machines test takes about 4 minutes with QEMU emulation, and they
are very prone to failing. Due to the automatic retry, the Machines
tests currently take about 6 hours on Fedora gating infrastructure, and
are just about impossible to get succeeding.
Only set `$SOURCE` to ./source/ if that actually exists, which is when
it is being called through Standard Test Interface.
Provide fallbacks for using FMF or when calling the script manually.
In the presence of a package-lock.json, `npm install` apparently
downloads all packages even when giving explicit ones on the CLI. Avoid
that by removing package-lock.json before.
These seem work fine now, especially with run-tests flake retrying.
testCreatePXE() and some others will be fixed in the next upstream
release.
testCreate() still seems to give trouble, though.
RHEL 8's PAM has some weird bug where it rejects the *current* password
when changing an expired one. This isn't trivial to reproduce on the CLI
and thus has no bugzilla yet.
Cockpit 221 fixed storage test classes to all have different names, so
the "TestStorage" pattern now catches them all.
Also move the `image-download cirros` to simplify conditional blocks.
This provides retries on flakes, integrates tests-policy for known
issues, and outputs proper TAP format.
Once we work out the remaining kinks (unstable tests and proper test
class names), it will also be much shorter.
We currently have 3 versions of this script (one in fedora, one in rhel
cockpit and one in rhel cockpit-appstream).
With this patch we can keep this same file in all 3.
Also backporting hack in verify.sh.
Dynamically set $TEST_OS from /etc/os-release, and install chromium
directly on Fedora and from EPEL on RHEL. With these we can keep the
test in sync between RHEL and Fedora.
Also drop the obsolete resetting of system changes, that was fixed in
cockpit's tests.
