Commit Graph

394 Commits

Author SHA1 Message Date
Martin Pitt
bc3c660e8b tests: Drop run-tests download hack
Cockpit 221.1 includes what the test needs.
2020-06-15 22:02:18 +02:00
Cockpit Project
aa6fc6afa4 Update to 221.1-1
- Put back missing base1/patternfly.css
- Services: Don't offer 'Start Service' in Limited Access mode
2020-06-15 17:41:34 +00:00
Martin Pitt
db96fd730f test: Skip some new Machines tests
They didn't run before, and still need some adjustment for the gating
environment.
2020-06-15 15:06:29 +02:00
Martin Pitt
c7c30d7162 tests: Skip TestAccounts.testBasic
The "Terminate session" button does not work in CI, this needs to be
investigated. Skip that test for now.
2020-06-15 14:45:52 +02:00
Martin Pitt
12407e7f2f tests: Skip TestLogin.testTally
This doesn't work on our CI environment, still needs debugging. It
didn't run before.
2020-06-15 13:48:52 +02:00
Martin Pitt
5f7e778846 tests: Adjust unexpected message pattern
This also hits for a related message about COPR.
2020-06-15 13:46:27 +02:00
Martin Pitt
1c54526baf tests: Use run-tests --exclude option
This is simpler, more robust, and fixes the silently skipped tests as
the `{}` did not get expanded by the shell any more.
2020-06-15 13:46:27 +02:00
Martin Pitt
029dfa3410 tests: Exclude TestLogin.testExpired on RHEL
RHEL 8's PAM has some weird bug where it rejects the *current* password
when changing an expired one. This isn't trivial to reproduce on the CLI
and thus has no bugzilla yet.
2020-06-15 09:35:27 +02:00
Martin Pitt
8cdec9d69e tests: Grab latest upstream run-tests to fix BlockingIOError crash
This can be reverted once version 222 gets packaged, which includes the
fix.
2020-06-15 07:48:30 +02:00
Martin Pitt
2734e8d5fe tests: Fix cockpit-appstream detection
cwd in run-tests.sh is just the test user's home directory. Look into
the original test unpack directory for the cockpit-appstream spec file.
2020-06-15 07:43:19 +02:00
Martin Pitt
bbd0810e02 tests: Make libpwquality less aggressive
So that our standard "foobar" password works.
2020-06-15 07:12:44 +02:00
Martin Pitt
ebd03582ec tests: Properly set up ssh access
Allow the unprivileged `runtest` account to ssh to localhost as root.
2020-06-15 07:06:33 +02:00
Martin Pitt
a6f0e0a3b0 tests: Ignore message about wrong beakerlib app-info permissions
This is unrelated to the test, and really uninteresting.
2020-06-15 07:06:30 +02:00
Martin Pitt
a043a83424 tests: Use run-tests for everything
Cockpit 221 fixed storage test classes to all have different names, so
the "TestStorage" pattern now catches them all.

Also move the `image-download cirros` to simplify conditional blocks.
2020-06-14 16:13:00 +02:00
Cockpit Project
3756a63a8f Update to 221-1
- Support for Cross-Origin-Resource-Policy
- Accounts: Some buttons are hidden when access is limited
- Developers: Importing "base1/patternfly.css" is deprecated
2020-06-10 11:53:28 +00:00
Martin Pitt
6c679bed82 tests: Fix nonexisting variable access in run-test.sh 2020-05-30 12:41:30 +02:00
Martin Pitt
ecd7b62189 tests: Use run-tests
This provides retries on flakes, integrates tests-policy for known
issues, and outputs proper TAP format.

Once we work out the remaining kinks (unstable tests and proper test
class names), it will also be much shorter.
2020-05-28 18:57:06 +02:00
Matej Marusak
b6bc45dfef test: 'run-test.sh' can decide which tests to run
We currently have 3 versions of this script (one in fedora, one in rhel
cockpit and one in rhel cockpit-appstream).
With this patch we can keep this same file in all 3.

Also backporting hack in verify.sh.
2020-05-28 15:43:32 +00:00
Cockpit Project
8f952d3560 Update to 220-1
- New navigation with integrated switching of hosts
- Logs: Inline help for filtering
- Storage: Improve side panel on details page
2020-05-28 04:56:09 +00:00
Martin Pitt
e929045b34 tests: Adjust to version 219
- check-machines-dbus got renamed to check-machines
 - More Machines tests should be stable now
2020-05-14 14:00:31 +02:00
Cockpit Project
c3e7814df3 Update to 219-1
- Logs: Improved filtering
- Gain or drop administrative access in a running Cockpit session
2020-05-13 16:25:22 +00:00
Martin Pitt
c91e8793d5 gating.yaml: Drop Taskotron tests
They are no more :-(
https://kparal.wordpress.com/2020/04/30/taskotron-is-eol-end-of-life-today/
2020-05-07 17:35:04 +02:00
Cockpit Project
19a3c8e3ca Update to 218-1
- Services: Improved accessibility and mobile support
- Overview: Add uptime information
- Disable idle timeout by default
- Support building without polkit
2020-04-29 16:33:15 +00:00
Martin Pitt
4f6978c45e gating.yml: Generalize product_versions
See https://docs.fedoraproject.org/en-US/ci/gating/
2020-04-29 12:39:28 +02:00
Martin Pitt
63f5fd2065 test: Re-disable TestFirewall.testNetworkingPage
Still too unstable.
2020-04-28 16:29:07 +02:00
Martin Pitt
5c652c5d08 test: Re-disable TestMachinesDBus.test{Libvirt,NetworkSettings}
They are still too unstable.
2020-04-28 13:59:04 +02:00
Martin Pitt
6d1be3eb74 test: Run browser and tests directly on the host
Dynamically set $TEST_OS from /etc/os-release, and install chromium
directly on Fedora and from EPEL on RHEL. With these we can keep the
test in sync between RHEL and Fedora.

Also drop the obsolete resetting of system changes, that was fixed in
cockpit's tests.
2020-04-28 13:59:04 +02:00
Cockpit Project
a8fc94b097 Update to 217-1
- verview: more Insights details
- ialogs: new button order
- achines: sendings keys to VM consoles
2020-04-15 14:19:58 +00:00
Martin Pitt
a791ac3ba7 tests: Re-drop testNICAdd
It's too unstable: https://github.com/cockpit-project/cockpit/issues/13861
2020-04-07 20:13:35 +02:00
Martin Pitt
365ca755d7 tests: Fix syntax error 2020-04-07 13:43:40 +02:00
Martin Pitt
cc5550a75f test: Enable first libvirt tests
Enable the ones corresponding to the selenium tests [1], except for
some which are still too unstable.

[1] https://github.com/cockpit-project/cockpit/issues/13481
2020-04-07 07:21:17 +02:00
Martin Pitt
15c2932687 tests: Split host and container run scripts
This fixes trap handling and also is easier to write and debug.
2020-04-06 20:44:29 +02:00
Martin Pitt
46f292cc92 tests: Robustify exit code handling from podman
Apparently when encountering some cleanup errors (at least when podman
fails to remove its temporary network), podman exits with 0 instead of
with the exit code of the container workload. This hides failing tests.

Pass the test exit code to the host via the logs directory instead.
2020-04-06 20:26:11 +02:00
Martin Pitt
259131798c tests: Fix PackageKit tests 2020-04-06 20:25:45 +02:00
Martin Pitt
21edca3e02 tests: Disable core dumps
They don't get copied out of the VM anyway, and we rather investigate
them upstream where test VMs are accessible.
2020-04-06 18:43:01 +02:00
Martin Pitt
9d79a2b83b tests: Enable basic networking tests 2020-04-02 13:20:39 +02:00
Martin Pitt
75d054e32f tests: Enable some PackageKit tests 2020-04-02 13:20:22 +02:00
Martin Pitt
146d1315a0 tests: Fix and enable testSessionRecordingShell 2020-04-02 09:07:46 +02:00
Martin Pitt
9d218c301f tests: Always run all tests
That makes it easier to see which ones fail.
2020-04-02 09:06:29 +02:00
Martin Pitt
af9b0e0290 tests: Enable more tests
Version 216 fixed some tests to now work correctly in the Fedora gating
environment.
2020-04-01 19:40:49 +02:00
Cockpit Project
ee8a894e6f Update to 216-1
- SELinux: Automatic application of solutions that set booleans
- Machines: Drop virsh backend support
- Overview: New “last login” banner
2020-04-01 11:51:54 +00:00
Martin Pitt
b5759713f1 tests: Run firewall tests
As the firewalld tests expect the libvirt "default" network, add
cockpit-machines test dependency, which pulls in the libvirt stack. We
will soon test the Machines page anyway.
2020-03-24 14:41:09 +01:00
Martin Pitt
b210155ba1 tests: Run storage tests 2020-03-23 22:43:32 +01:00
Martin Pitt
12cf08914b tests: Run more browser tests
Upstream now grows more and more @nondestructive test, which we can run
in our single test VM, so add the first batch.

This uncovers some issues in the tests that assume that there is no root
login in the VM, skip them. They are being fixed in
https://github.com/cockpit-project/cockpit/pull/13773
2020-03-23 16:38:58 +01:00
Martin Pitt
ffbd0b8503 Enable gating tests
Add a gating.yaml to make sure that newer Cockpit versions don't enter
stable when they cause regressions in various static RPM checks or our
CI tests.

See https://docs.pagure.org/greenwave/policies.html
2020-03-23 10:14:23 +01:00
Martin Pitt
5706aaec3b tests: Sync with downstream RHEL 2020-03-23 09:57:56 +01:00
Cockpit Project
e4b8e77fe7 Update to 215-1
- Networking: Show additional ports for each firewall zone
2020-03-18 16:08:47 +00:00
Cockpit Project
037e78010d Update to 214.1-1
- Updates: Fix unstyled button regression
- Machines: Fix slow requests when enabling polkit access driver
- Deprecate cockpit-docker for Fedora, Debian, and Ubuntu development series
2020-03-12 14:23:56 +00:00
Martin Pitt
fad5102765 Revert "Backport PR #13657 to fix Software Updates pane button theming"
This doesn't work, the change needs to be fed through webpack. This
rather needs a new upstream release.

This reverts commit acef37288e.
2020-03-12 09:34:30 +01:00
Adam Williamson
acef37288e Backport PR #13657 to fix Software Updates pane button theming 2020-03-11 16:47:24 -07:00