Commit Graph

3167 Commits

Author SHA1 Message Date
Lukas Ruzicka b0bc18b187 Add a 'navigation' test for GNOME.
This PR partly solves the issue #301 when it adds the navigation
testing for Gnome. It uses the keyboard combinations to cycle through
running applications and checks that applications could be switched
accordingly. It also tests that you can switch between workspaces
and that you can move an applications to another workspace.
2024-04-10 21:46:43 +00:00
Adam Williamson 5bd224687f Bump base version in ostree-parse-pungi.py
The flatpaks have been updated to the F40 runtime, so we need to
keep pace here.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-09 20:28:13 -07:00
Adam Williamson d74fd9e6b4 Update some GNOME needles too
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-08 13:21:08 -07:00
Adam Williamson 3ca5816696 Update some more needles for KDE
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-08 13:18:03 -07:00
Adam Williamson d0912fd217 Fix blivet preserve_home test templates for UEFI switchover
Somehow these two got completely scrambled, testing the wrong
things on the wrong images. Fix them to match the non-blivet
counterparts, which are correct.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-08 12:19:51 -07:00
Deborah Brouwer 4eec75bec3 Get dns server address if host isn’t using systemd-resolved
The worker containers aren’t using systemd-resolved so
get_host_dns() can’t find the dns server causing tests that need
it to fail. Add an alternative place to look for the dns server address
that doesn’t rely on systemd-resolved.

Signed-off-by: Deborah Brouwer <deborah.brouwer@collabora.com>
2024-04-05 21:10:11 +00:00
Adam Williamson c3baa66465 Bump retry count on some flaky tests
The silverblue tests are flaky because of
https://github.com/fedora-silverblue/issue-tracker/issues/548 .
The desktop_upgrade_encrypted test is flaky on Rawhide (so, when
booting from F40 initially) since we switched to UEFI, not sure
if it's because of UEFI somehow or just a timing coincidence.
Am going to look into it, but for now this should save lots of
manual restarting.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-05 08:01:16 -07:00
Lukáš Růžička f48dc5a0d5 Add wait_still_screen to menu_launch_type.
This is actually a very useful to wait a little bit before
we try to operate with the started application, especially
if we want to send keys.

Having this wait time here can save us doing this every time,
we start an application.
2024-04-05 14:09:28 +02:00
Lukáš Růžička d2238360b8 Revert "Add needles"
This reverts commit bde855b343.
2024-04-05 10:04:17 +02:00
Adam Williamson 5701d1a5a5 Try and robustify menu_launch_type a bit
The mistypes on KDE are bugging me. Let's see if this - mainly
the wait_screen_change, the other just seems like a logical
tweak - helps at all.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-04 11:19:16 -07:00
Lukáš Růžička bde855b343 Add needles 2024-04-03 09:19:30 +02:00
Adam Williamson 64f06b6415 Don't run secure_boot_fallback on ELN for now
As we're not running on UEFI, it of course fails.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-02 21:16:39 -07:00
Adam Williamson af7705f47b Run ELN tests on BIOS
ELN can't boot with Secure Boot enabled currently:
https://github.com/fedora-eln/eln/issues/183

Until that's resolved, let's go back to testing on BIOS (this is
easier than testing on non-SB UEFI for...reasons).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-02 15:39:42 -07:00
Adam Williamson 7e0cd0898e Make UEFI testing the default, add Secure Boot testing
This essentially inverts the x86_64 machines so that '64bit' is
UEFI and instead of a variant 'uefi' machine we have a variant
'bios' machine that is BIOS. The point is to make UEFI testing
the default. We also enable Secure Boot in the UEFI testing,
and add a test of UEFI fallback booting on various products.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-02 09:24:52 -07:00
Adam Williamson 85943b9aeb Update a GNOME needle for a slightly changed icon
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-02 09:20:07 -07:00
Adam Williamson 615be43cd5 Drop match level on KDE menu button needles
For some reason we keep getting not-quite matches on this, even
though we added two new needles. Let's drop the match level on
all existing needles as a coping mechanism.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-02 09:15:25 -07:00
Adam Williamson cf51484b2e Update several KDE needles for Plasma 6 changes
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-02 09:13:54 -07:00
Adam Williamson eaf7c48e0b Update several Arabic needles to translated versions
Someone's knocking out the Arabic translation, yay.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-02 09:12:38 -07:00
Adam Williamson f1c23be409 Fix #2268505 workaround - move the actions push earlier
Oops, all other actions pushes need to happen *before* the reboot
action push, or the logic breaks.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-03-26 08:29:25 -07:00
Adam Williamson 1739f38061 Add a workaround for RHBZ #2268505
My anaconda patch for ensuring we get an EFI boot manager entry
on installs using bootupd (currently only 'canned', i.e. Atomic,
installs - IoT and Atomic Desktops - are affected) was rejected
and dropped in the latest Rawhide build. It'll probably also be
lost in the next F40 build. So install tests of affected images
have started failing. This is a kinda awkward workaround: on
UEFI canned installs, we check whether it looks like there is no
"Fedora" efibootmgr entry, and if so, we delete the entry for the
optical drive, so hopefully we'll boot via fallback path from
the hard disk on reboot.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-03-25 17:25:10 -07:00
Adam Williamson 66aa587755 Updated/variant Firefox main screen needle
Old one was a 96% match. Not really sure what changed.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-03-25 08:56:43 -07:00
Adam Williamson cc832a4ad8 Fix new logic in Clocks test
Whoops, we can't just use a straight match_has_tag there as we
did another assert in the middle...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-03-25 08:22:53 -07:00
Adam Williamson 5332b99076 Update a bunch of GNOME needles for 46.0 changes
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-03-24 18:12:25 -07:00
Adam Williamson 8ebf3bdddb Tweak Clocks alarm test for change in upstream code
Upstream now sets an alarm with no explicit recurrence inactive
after it is stopped (previously it assumed recurrence every day).
We need the test to handle both behaviours for a while (until
we are no longer testing < 46.0 anywhere).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-03-24 09:47:21 -07:00
Adam Williamson 37150e430f Add yet another variant 'updates available' needle
GNOME seems to be growing a bunch of different variants of this
alert. Annoying.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-03-24 09:23:38 -07:00
Adam Williamson f6273425ee Add FEDORA-2024-01fd5aa621 to workarounds
gvfs from the GNOME 46 megaupdate needs it. It's been pushed
stable but not included in a compose, yet.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-03-23 17:12:40 -07:00
Adam Williamson 92c822a719 Clear no-longer-needed update from workarounds
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-03-23 17:12:11 -07:00
Adam Williamson 222223309e Update another GNOME needle for 46
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-03-21 12:15:12 -07:00
Adam Williamson c097516599 Update several GNOME needles for 46 RC/Final
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-03-20 20:44:58 -07:00
Adam Williamson 83d26b6945 Add variant update notification needle for GNOME
We see this when there's a *critical* update pending.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-03-20 20:38:30 -07:00
Adam Williamson a0eb2827b8 aarch64 kernel arg fixup: fix for bootupd
We now have some images using bootupd, at least Fedora IoT images
from F40 onwards do. These don't have a /etc/default/grub and
don't really intend you to run grub2-mkconfig. As advised at
https://github.com/ostreedev/ostree/pull/3150#issuecomment-1998768240
let's just add our required arguments directly in the BLS snippet
files.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-03-15 09:30:52 -07:00
Adam Williamson b20aac5373 Add FEDORA-2024-b8e524ffdd as F40 workaround
It's queued for stable but blocked by the freeze, and
FEDORA-2024-9c9174f3dd requires it. Let's just make it a
workaround to clear the other update's tests.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-03-15 09:22:56 -07:00
Adam Williamson 30a71127c0 Clear F40 workarounds list
All updates are now stable.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-03-15 09:21:55 -07:00
Adam Williamson dc7ff01f27 toolbox: handle OCI images (as produced by Kiwi)
We changed to building toolbox container images with Kiwi. These
are OCI archives, not docker archives. So we need to call skopeo
appropriately.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-03-14 14:34:38 -07:00
Adam Williamson 4ee74a0bca iot_zezere_remote: add a safety wait after adding ssh key
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-03-14 08:32:25 -07:00
Adam Williamson 41f2adaf46 os_release: update for osbuild change to ISO names
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-03-14 08:25:26 -07:00
Adam Williamson b8fddfa265 Fix the logic for skipping _repo_setup_updates
Just checking for the package update list is wrong in a couple of
ways:

1. It goes wrong for child tests that inherit the main disk from
the parent test, but not the second disk where the actual update
repo lives. They'll have the package list, but not the repo. So
we should test for both the package list and the repo dir.

2. It goes wrong for side tag tests, because we don't write a
package list (or create an update repo) on that path. So on that
path let's check whether we already created the repo definition
we use on that path.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-03-13 10:49:05 -07:00
Adam Williamson 28b2d02b5f Update prerelease note needle for F40
The existing needle matches on bits of the keyboard layout
selector under the note and the Help button next to it, for some
reason (I don't recall why). The Help button is gone because we
killed installer help, and the keyboard layout indicator is not
always shown any more, there's no reason to match on it here
that I can recall.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-03-13 08:40:38 -07:00
Adam Williamson 128b5ff4fa Update console_initial_setup_done needle for a font change
We got a different console font affecting this needle recently.
It *may* be due to building the ARM minimal disk image (which I
think is the only image whose tests hit this needle) with osbuild,
but anyway, it's not a bug, so we should just accept it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-03-13 08:39:18 -07:00
Adam Williamson 722da7da06 Update all KDE notification needles for F40 backgrounds
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-03-13 08:37:59 -07:00
Adam Williamson 28697a27cd Add F40 Beta night background needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-03-08 11:13:10 -08:00
Adam Williamson 2b51d930b9 Tweak the IoT incomplete hub workaround a bit
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-03-08 08:49:52 -08:00
Adam Williamson 460eee87bc updates: test Silverblue install on UEFI as well as BIOS
https://bugzilla.redhat.com/show_bug.cgi?id=2268505 made it
clear that this is a bit of a hole. We don't test installing the
Silverblue image we build on UEFI, only on BIOS. Add this as a
separate test so we don't uselessly upload a disk image we won't
use for any follow-on tests.

This also adds an anaconda build that fixes a bug in this path
as a workaround for F40, so the test won't fail on all F40
updates.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-03-07 16:13:02 -08:00
Adam Williamson 89686bceba desktop_background: drop F40 exemption
Now we have F40 backgrounds, we can drop this exemption and have
the test always fail on non-Rawhide again.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-03-07 16:05:51 -08:00
Adam Williamson 938dc5958b Add F40 background needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-03-07 16:05:51 -08:00
Adam Williamson 9d1ae2aaf7 Add kde-settings update as a workaround too
This should mean all F40 update tests get the new background,
and we can once again make that test fail if it doesn't see it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-03-07 16:03:18 -08:00
Adam Williamson 02015ed5a0 Add F40 backgrounds update as workaround
So the kde-settings update can pass tests.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-03-07 15:54:51 -08:00
Adam Williamson cca9f90c8a Drop workarounds that have gone stable
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-03-07 15:52:54 -08:00
Adam Williamson 8da5b7c010 Work around IoT incomplete hub issue
This is a workaround for
https://github.com/osbuild/images/issues/309 , the IoT installer
showing incomplete spokes in the main hub. We work around it by
visiting them all.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-03-06 17:52:04 -08:00
Adam Williamson a5f9c88584 Tidy a couple of things that got missed in earlier commits
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-03-05 14:27:10 -08:00