1
0
mirror of https://pagure.io/fedora-qa/os-autoinst-distri-fedora.git synced 2024-12-11 13:53:08 +00:00
Commit Graph

178 Commits

Author SHA1 Message Date
Lukáš Růžička
861a4a3053 Fix parallelism 2024-11-12 10:56:22 -08:00
Lukáš Růžička
6142895580 Add tests to templates. 2024-11-12 10:56:22 -08:00
Adam Williamson
7f75a35bfd Remove VNC install tests
VNC is gone in current Rawhide. As F41 is released now, we won't
hit these tests any more anywhere where they might work (we don't
get a Server DVD image for respins), so let's just drop the tests.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-11-08 08:29:04 -08:00
Adam Williamson
9ec6d3bf23 Drop four retries on encrypted upgrade tests
We added this to try and mitigate #2274770 but that is now fixed
so it's no longer needed.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-10-22 11:58:57 -07:00
Adam Williamson
d88c8e4335 Add several more tests to the desktop update test set
There's no obvious reason we're not also running these tests on
updates, so let's do it. We have to skip the advisory and UEFI
post checks for desktop_login as the last step of that test is
shutting down the system.

We leave out desktop_login for now because of
https://gitlab.gnome.org/GNOME/gjs/-/issues/647

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-10-08 08:51:35 -07:00
Adam Williamson
d109fbdb43 Rename i3_tilling to i3_tiling
This is the correct name.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-09-26 16:56:55 -07:00
Lukas Ruzicka
c392480f92 Rebase the PR to fit within the current status quo. 2024-09-26 16:04:59 -07:00
Dan Čermák
4315e5ff6f Add openQA tests for i3 2024-09-26 16:04:59 -07:00
Adam Williamson
19b8f8d172 Revert "Run ELN tests on BIOS"
This reverts commit af7705f47b (and
the follow-up). ELN is now supposed to be fixed on SB, per
https://github.com/fedora-eln/eln/issues/183 , so let's try it
again.
2024-08-14 18:08:31 -04:00
Adam Williamson
d515ad1195 Revert "desktop_update_graphical: try to workaround GGO #2442"
This reverts commit b3e5dd41cb.
Some testing on lab seems to indicate it's not needed any more,
at least several runs with the workarounds reverted have passed.
Will put them back if we hit failures.
2024-08-02 16:07:05 -07:00
Adam Williamson
8ccad8844a Bump server disk version to 5
We made it bigger.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-07-30 14:28:50 -07:00
Lukáš Růžička
6a4ed83384 Enable start/stop tests on Silverblue. 2024-06-19 23:42:42 -07:00
Lukas Ruzicka
992e51f5c5 Create test suite for Desktop Keyring
This adds both the Gnome and the KDE tests to test the
Desktop Keyring. After a discussion with the Brno team,
how this could be tested without the need to rely on
external servers to log into, we set up a local FTP server,
we will log into it and remember the credentials and verify
that the credentials will be stored in the keyring correctly.
2024-06-11 16:04:44 -07:00
Adam Williamson
3db37dcf01 Flip encrypted install tests back to UEFI
https://bugzilla.redhat.com/show_bug.cgi?id=2274770 seems to be
fixed, so these can go back to UEFI.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-06-10 15:51:07 -07:00
Adam Williamson
4e102743b7 Put all upgrade encrypted tests back on UEFI
They use base disk images, and it's too fiddly to try and
arrange for the one the update test uses to be UEFI but the
other to be BIOS...let's just keep these on UEFI but kick up the
retry count :/

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-27 08:48:38 -07:00
Adam Williamson
82b23f9738 Revert "D'oh, move the most important encryption test to BIOS"
This reverts commit 508635ed1c and
the fix-up follow-up, because this causes the test to have a
different scenario which screws up gating. Argh. I guess we're
stuck restarting it forever. Let's bump the retry number even
higher instead.
2024-05-24 11:40:03 -07:00
Adam Williamson
d16d954012 Switch graphical encrypted tests to BIOS (#2274770)
There is a weird and annoying kernel bug ATM which makes entering
encryption passphrases into plymouth's graphical interface often
fail on UEFI VMs. Using a BIOS VM seems to avoid this, and the
bug is not getting fixed, so let's switch all these tests to
BIOS to avoid this annoying bug causing failures all the time,
especially for update tests.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-24 08:45:10 -07:00
Adam Williamson
a353caeb90 Enable testing of COPRs, fix some issues, enable package checks
This works more or less like testing side tags. We also fix up
some flow problems with this path (that also affect the side tag
case), and enable the package checks on this path - it's not too
hard really, we just need to write the updatepkgs file when we
set up the repo, which we can do with dnf repoquery.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-03 14:40:34 -07:00
Adam Williamson
5cd9c83e73 Ensure repos are set up for cockpit tests
When running these tests on updates we inherit the main disk
image from server_cockpit_default, which has the repo config,
but the actual repo data is on HDD_3 which is not inherited.
We need to re-download the updates here to ensure they're
available to the tests (the automatic update test installs the
dnf-automatic package, so it should pull it from the update repo
if it is part of the update being tested).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-25 16:52:09 -07:00
Lukas Ruzicka
d3a6beda3d Add the graphical upgrade tests.
This PR builds on some elements of the current upgrade process,
such as upgrade_boot, upgrade_preinstall, upgrade_postinstall, but
replaces the upgrade_run with graphical_upgrade_run to use graphical
methods to upgrade the system.
This would not be possible without necessary settings, that are
performed by graphical_upgrade_prerequisites.
Works for both Gnome and KDE.
2024-04-15 23:08:58 -07:00
Lukas Ruzicka
b0bc18b187 Add a 'navigation' test for GNOME.
This PR partly solves the issue #301 when it adds the navigation
testing for Gnome. It uses the keyboard combinations to cycle through
running applications and checks that applications could be switched
accordingly. It also tests that you can switch between workspaces
and that you can move an applications to another workspace.
2024-04-10 21:46:43 +00:00
Adam Williamson
d0912fd217 Fix blivet preserve_home test templates for UEFI switchover
Somehow these two got completely scrambled, testing the wrong
things on the wrong images. Fix them to match the non-blivet
counterparts, which are correct.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-08 12:19:51 -07:00
Adam Williamson
c3baa66465 Bump retry count on some flaky tests
The silverblue tests are flaky because of
https://github.com/fedora-silverblue/issue-tracker/issues/548 .
The desktop_upgrade_encrypted test is flaky on Rawhide (so, when
booting from F40 initially) since we switched to UEFI, not sure
if it's because of UEFI somehow or just a timing coincidence.
Am going to look into it, but for now this should save lots of
manual restarting.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-05 08:01:16 -07:00
Adam Williamson
64f06b6415 Don't run secure_boot_fallback on ELN for now
As we're not running on UEFI, it of course fails.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-02 21:16:39 -07:00
Adam Williamson
af7705f47b Run ELN tests on BIOS
ELN can't boot with Secure Boot enabled currently:
https://github.com/fedora-eln/eln/issues/183

Until that's resolved, let's go back to testing on BIOS (this is
easier than testing on non-SB UEFI for...reasons).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-02 15:39:42 -07:00
Adam Williamson
7e0cd0898e Make UEFI testing the default, add Secure Boot testing
This essentially inverts the x86_64 machines so that '64bit' is
UEFI and instead of a variant 'uefi' machine we have a variant
'bios' machine that is BIOS. The point is to make UEFI testing
the default. We also enable Secure Boot in the UEFI testing,
and add a test of UEFI fallback booting on various products.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-02 09:24:52 -07:00
Adam Williamson
aeac70814b Drop the addrepo_metalink_graphical test
Anaconda has dropped the ability to interactively configure
additional repositories, so this test cannot work any more.
It's now possible only with inst.addrepo or a kickstart.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-03-01 16:55:59 -08:00
Adam Williamson
21887eae3d Add tests for the Workstation live osbuild image
We should test this image to make sure it works as well as the
official image.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-02-20 16:50:28 -08:00
Adam Williamson
b3e5dd41cb desktop_update_graphical: try to workaround GGO #2442
In current F40 and Rawhide, this test is frequently failing
because gnome-software is behaving weirdly at startup - the
third-party software dialog moves around even more than before,
the app seems to get stuck in the "not responding" state
briefly sometimes, and there's a very weird state it gets into
sometimes where the window is shorter than usual and clicks
don't seem to register in the right place. While I'm trying to
bisect these bugs, these magic voodoo incantations (tested on
the staging instance) seem to mostly work around the weird
behaviour, and setting RETRY=2 should backstop it a bit further.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-02-16 12:50:05 -08:00
Adam Williamson
32a7798037 Make Silverblue install target disk bigger
It's defaulting to 10Gi, which definitely has caused *some*
issues (the flatpak test fails because there isn't enough disk
space). I'm hoping this will turn out to explain why SB tests
have been generally so unreliable lately.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-03 15:03:24 -08:00
Adam Williamson
4e62eb8ec5 Remove the anaconda_help test
Help support has been removed from anaconda:
https://github.com/rhinstaller/anaconda/pull/5335
so we no longer ought to test it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-11-29 12:11:00 -08:00
Adam Williamson
461e211618 Drop use of PXEBOOT, rely on default boot order
Per https://progress.opensuse.org/issues/151258 , PXEBOOT=once
doesn't work right in current os-autoinst. Now I look at it,
PXEBOOT is just pretty ropey in general; on UEFI and aarch64 it
doesn't actually do anything at all, we're actually just relying
on the default boot order there.

Since it doesn't seem like there's a practical way to make
PXEBOOT=once work as intended on all platforms, let's just drop
use of it and make it clear that we rely on the default boot
order: we hope that on first boot we'll get a PXE boot since no
local media are bootable, then on second boot we'll get a local
disk boot.

We set up a new IS_PXE variable to cue the couple of places where
the test logic needs to be different.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-11-21 16:23:25 -08:00
Adam Williamson
1343e1e7c0 Revert "Set a high RETRY value for desktop_printing"
This reverts commit 73f860ecb9. The
mesa issue has been resolved, so we can drop this now.
2023-11-20 23:03:38 -08:00
Lukas Ruzicka
d50885e584 Create a test for basic Flatpak operations.
This PR tries to respond to issue #294.
On Silverblue, this will try:

* flatpak install
* flatpak remote-add
* flatpak list
* flatpak remotes
* flatpak remove
* flatpak update

and also it tests that a flatpak can be built.
2023-11-13 10:37:52 -08:00
Adam Williamson
73f860ecb9 Set a high RETRY value for desktop_printing
It's super flaky ATM due to some GNOME/mesa bug(?) This will make
life easier till I have time to actually debug the issue.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-11-13 10:37:03 -08:00
Adam Williamson
db7d47d0dd Don't run loupe test on Silverblue yet
Silverblue still has eog. It seems a bit excessive to bring back
the eog test just for Silverblue, so let's just disable loupe
until Silverblue has it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-09-22 13:44:22 -07:00
Lukáš Růžička
9e0d74453c Create a test suite for Loupe (Image Viewer)
This PR adds a test for a new Image Viewer called Loupe.
It is based on the old Image Viewer test, newly reneedled
with some of the tests shortened, deleted or edited
as the new Image Viewer has a little bit less functions
compared to the previous one.

Add needles.
2023-09-20 10:29:39 +02:00
Adam Williamson
d05a215ad5 Run toolbox test on KDE as well
There's no obvious reason it'd ever give a different result on
KDE vs. Workstation, but since we added a matrix box for it on
both, we'd better run it on both.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-29 15:08:09 -07:00
sumantrom
b9afdc8ae7 add toolbox test case with basic func to create, list, start and stop 2023-08-29 07:59:24 +05:30
Adam Williamson
35ae0b358f Also drop the eog test from templates
Whoops!

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-23 09:13:28 -07:00
Adam Williamson
4cf48547bf Apply LVM resize disk change to correct test
The affected tests start after install_lvm_ext4, so we need to
bump HDDSIZEGB there, not in the downstream tests.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-03 09:08:29 +01:00
Adam Williamson
b7be0bd064 Bump HDD size for LVM resize tests
With the 2G ESP change, we need bigger disks for these tests to
work correctly. On BIOS the test still just about works because
anaconda rounds the remaining space after BIOS boot partition
and /boot to 14G, but it seems fragile to rely on this. On UEFI
(aarch64), anaconda sees a max of 12G remaining after 2G ESP
and 1G /boot, so the test fails because we cannot size to 13G.
Give the test an extra 2G, this should be sufficient to make
sure it's valid on all platforms.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-03 09:01:44 +01:00
Adam Williamson
74b468b949 Add Samba AD tests
This adds a Samba AD server test, and client enrolment tests via
sssd, Cockpit and kickstart. Requires the matching createhdds
commit to add the kickstart to the disk_ks image.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-07-27 16:14:30 -07:00
Lukáš Růžička
f528904344 Add the Turkish installation test.
Add turkish console to console_loadkeys_us
2023-07-27 21:18:15 +00:00
Lukas Ruzicka
0a10727a7a Remove modularity tests.
Modularity will be retired in Fedora 39 and the modular repository
removed. Also, the upcoming version of DNF that is default in
Rawhide, does not support modularity, so the tests are currently
failing anyway.
2023-07-20 10:23:44 +02:00
Adam Williamson
0a87a76ff9 Run base tests on ELN
This requires a change in the package we use for base_update_cli
because pandoc-common is not in ELN.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-06-23 11:53:11 +02:00
Lukas Ruzicka
bc8601a1d4 Create test for the Tour application. 2023-06-23 10:53:58 +02:00
Adam Williamson
7adb698b21 Set TEST_TARGET to COMPOSE for upgrade flavors
The ISO or HDD image won't be attached to the post-upgrade
tests, and these are not tests of the image anyway, they're
tests of the compose.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-06-19 20:18:44 +02:00
Adam Williamson
b0fb6911f3 Add initial template stuff and test tweaks for ELN testing
Just a couple of flavors and tests for now.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-06-19 17:28:42 +02:00
Adam Williamson
426747c368 Adjust modularity_tests to enable the modular repos at the start
As of yesterday's Rawhide, the modular repos are not installed by
default, so of course all the modular tests fail. So, install
the repos before running the tests.

This isn't conditionalized on release version as I don't think
we ever run this test on anything other than Rawhide and
Branched.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-06-18 11:15:56 +02:00