Commit Graph

3232 Commits

Author SHA1 Message Date
Adam Williamson f14200e50d Update cockpit autoupdate test for new dnf5 service
The service cockpit enables is different when it detects dnf5,
since cockpit 317. Let's just make this an F40/F41 boundary
thing, and add the cockpit 317 update as a workaround for F41
until it goes stable.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-29 17:43:12 -07:00
Adam Williamson af06ac0809 Add a workaround for alt-d-s not working right after login
This broke the KDE app start/stop test. We need to click on the
desktop before alt-d-s will work, for some reason.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-28 16:02:06 -07:00
Adam Williamson 3146570101 Update more needles for KDE 6.0.90
These are from the compose tests, last batch was from the update
tests.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-28 15:53:34 -07:00
Adam Williamson d3833d376c check-needles: tweak the handling of send_key_until_needlematch
The previous way of doing this isn't really safe. It assumes we
will find at least one string literal on any line containing
send_key_until_needlematch, and strips the last one, on the basis
it must be the key to press. But if the key to press is an
unquoted variable, this will strip the tag instead. And if both
the key to press and the tag are unquoted variables, this will
strip the most recent string literal we put into the global list
from some *other* line!

So instead let's try to be a bit smarter about how we parse
send_key_until_needlematch lines - just stripping out everything
after the first comma after "send_key_until_needlematch" - and
drop the dangerous "pop the last item from the list" logic. This
way we should always only find the needle to match, if it's a
string literal, as for other directives. We should never reach
the key to press so we don't need to worry about taking it out.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-28 09:26:15 -07:00
Adam Williamson 833204e060 Re-enable FAS homepage check in desktop_browser
Let's hope it's more reliable now.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-28 09:14:53 -07:00
Adam Williamson 990f81b229 check-needles: ignore commented lines
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-28 09:13:30 -07:00
Adam Williamson cb4654e2a2 Update a couple of needles for KDE 6.0.90 changes
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-27 13:56:52 -07:00
Adam Williamson 3a4b874b38 Add ARM variants of a couple of Nautilus needles
These look different on ARM for some reason. No idea why.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-27 13:44:41 -07:00
Adam Williamson 576938af72 Update a few GNOME needles for minor Rawhide changes
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-27 13:43:54 -07:00
Adam Williamson 4ccdaf0236 Add some wait_still_screens to GNOME Software ignore handling
I think the lack here is sometimes causing us to click more
times than we should. Let's do this to try and make sure we
don't click once it worked.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-27 12:17:40 -07:00
Adam Williamson 4e102743b7 Put all upgrade encrypted tests back on UEFI
They use base disk images, and it's too fiddly to try and
arrange for the one the update test uses to be UEFI but the
other to be BIOS...let's just keep these on UEFI but kick up the
retry count :/

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-27 08:48:38 -07:00
Adam Williamson 82b23f9738 Revert "D'oh, move the most important encryption test to BIOS"
This reverts commit 508635ed1c and
the fix-up follow-up, because this causes the test to have a
different scenario which screws up gating. Argh. I guess we're
stuck restarting it forever. Let's bump the retry number even
higher instead.
2024-05-24 11:40:03 -07:00
Adam Williamson 787304be16 ...aaand now do that properly
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-24 11:34:51 -07:00
Adam Williamson 508635ed1c D'oh, move the most important encryption test to BIOS
This is the one that's most significant (as updates are gated if
it fails), forgot it. Sigh.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-24 11:33:28 -07:00
Adam Williamson d16d954012 Switch graphical encrypted tests to BIOS (#2274770)
There is a weird and annoying kernel bug ATM which makes entering
encryption passphrases into plymouth's graphical interface often
fail on UEFI VMs. Using a BIOS VM seems to avoid this, and the
bug is not getting fixed, so let's switch all these tests to
BIOS to avoid this annoying bug causing failures all the time,
especially for update tests.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-24 08:45:10 -07:00
Adam Williamson aa6a907857 Update all ELN needles for font change
ELN changed to some new font, which means it now needs all its
own needles for any installer screen that matches on text :(
Here they are.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-22 09:39:10 -07:00
Adam Williamson 0f40d518a9 Update a bunch of needles for changed font rendering in Yelp
Yelp changed something that makes it render fonts differently,
so we get to update every needle that matches text in Yelp.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-22 09:03:09 -07:00
Adam Williamson 109cb84fa1 Add another weather report variant needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-22 08:49:27 -07:00
Adam Williamson 92da1925d6 Update a Maps needle for upstream data changes
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-13 10:38:04 -07:00
Adam Williamson 810b1a3166 Drop match level on another KDE panel needle to 90
This needle is affected by the blurry panel bug -
https://bugs.kde.org/show_bug.cgi?id=484888 .

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-13 10:20:33 -07:00
Adam Williamson 5ace81910b Update a Cockpit auto-update needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-13 10:09:44 -07:00
Adam Williamson 976b37f976 Use workarounds and Rawhide tag repo for update net installs
We're getting failures in the update network install tests today
which seem to be because we're using an image built with systemd
256 to install systemd 255. This is because systemd 256 has been
tagged but isn't in a compose yet, and we use the Rawhide tag
repo when building the installer image but we don't add it as an
additional repo for the install itself.

This is obviously a hole in the process, we should use the extra
repos, where appropriate, all the way through. So this makes us
use both the Rawhide tag repo (when doing a Rawhide install test)
and the workarounds repo (when there are workarounds) for network
install tests.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-13 09:38:00 -07:00
Adam Williamson 3b3e00f123 flatpak: proxy the connection to flathub
This is intended to reduce the amount of traffic we generate to
flathub, particularly so we can run this test on updates as well
as composes. We have to set a proxy and trust an SSL cert.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-06 15:12:15 -07:00
Adam Williamson 3a6e65914a Update kparted runs needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-06 15:11:50 -07:00
Adam Williamson b782c44ee9 Update a couple of straggler needles for GTK 4.15
The Japanese one was hidden by the UEFI encryption passphrase
entry bug, and the weather one we only hit when the test runs
at an unusual time.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-06 15:10:53 -07:00
Adam Williamson 637a411fd6 Add yet another KDE menu button needle variant
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-06 15:09:49 -07:00
Adam Williamson 57329a69fc Update some Maps needles for upstream metadata changes
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-06 15:09:11 -07:00
Adam Williamson 3da32a643f Update some loupe needles for GTK 4.15
These are screens that weren't previously reached due to a bug
that was recently fixed.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-06 15:08:13 -07:00
Adam Williamson a353caeb90 Enable testing of COPRs, fix some issues, enable package checks
This works more or less like testing side tags. We also fix up
some flow problems with this path (that also affect the side tag
case), and enable the package checks on this path - it's not too
hard really, we just need to write the updatepkgs file when we
set up the repo, which we can do with dnf repoquery.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-03 14:40:34 -07:00
Adam Williamson 1edde53988 Try and avoid launcher typing issues in more KDE tests
This is the same thing we do for the app_startstop tests in
aaa_setup, applied to a couple of other places we use
menu_launch_type in KDE and it's having trouble.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-03 14:22:59 -07:00
Adam Williamson d142d2f4a1 zezere: update for new default ssh key algorithm
ssh-keygen now defaults to ed25519, so this test needs updating.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-29 10:32:14 -07:00
Adam Williamson 5cd9c83e73 Ensure repos are set up for cockpit tests
When running these tests on updates we inherit the main disk
image from server_cockpit_default, which has the repo config,
but the actual repo data is on HDD_3 which is not inherited.
We need to re-download the updates here to ensure they're
available to the tests (the automatic update test installs the
dnf-automatic package, so it should pull it from the update repo
if it is part of the update being tested).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-25 16:52:09 -07:00
Adam Williamson a7ec8ada2b container build test: configure for dnf5
When testing the update that implements the dnf5 switchover, we
need to patch the kiwi config on the fly for dnf5.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-25 15:29:15 -07:00
Adam Williamson 4c53e53e87 Big needle update for GTK 4.15.0
Here's all the needles that *weren't* hit in the updates tests.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-25 12:48:16 -07:00
Adam Williamson 46c0719e66 Let installedupdatepkgs generation take longer in a container
From https://openqa.fedoraproject.org/tests/2594954 it looks
like this takes more than three minutes for updates with hundreds
of packages when running in a container (in the container build/
validate test). So, let's give it more time in that case.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-25 10:51:51 -07:00
Adam Williamson 09f1317691 Update various needles for GTK 4.15.0
These are only the ones from update tests, there will be more in
the Rawhide compose tomorrow.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-23 17:19:01 -07:00
Adam Williamson 18edc46417 Add variant KDE color select needle for F39 respin
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-23 17:17:00 -07:00
Adam Williamson 56281a41bd Update a FIXME notice
The bug number is wrong and I can't find the right one, d'oh.
We could *probably* safely remove this right now but I'm not
100% sure, I think it should be fine when F38 is EOL.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-22 17:56:44 -07:00
Adam Williamson c6d808ed23 Revert "Give `systemctl stop ipa.service` longer due to RHBZ #2100282"
This reverts commit b203f41f55.
The bug has been worked around for some time with a downstream
patch. Dropping the extended timeout means we'll notice if the
workaround is dropped prematurely or stops working.
2024-04-22 17:29:44 -07:00
Adam Williamson 691e82b1f9 Drop workaround for RHBZ #1943943
This whole complicated loop looks like it's no longer needed for
current KDE. It seems like we always refresh, then we hit
"Update All", and from there we go straight to "Restart Now".
Clicking the button always seems to work, we never seem to need
to click "Refresh" again. So, let's drop it and simply expect to
see and click Restart Now.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-22 17:04:52 -07:00
Adam Williamson bdae22d7de Drop another config-manager fixme
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-22 16:52:54 -07:00
Adam Williamson b614a38d6c Revert "Make evince test handle #2183356 (wrong save target on flatpak)"
This reverts commit 278b1e32b0.
The bug it worked around seems to have been fixed.
2024-04-22 16:52:05 -07:00
Adam Williamson ce2c511588 Revert "live_build: hack anaconda-webui out of kickstart on g-i-s update"
This reverts commit 0425be0d8e. We
only needed it for that one update and it went stable ages ago.
2024-04-22 16:33:47 -07:00
Adam Williamson 9f2d44a181 drop a FIXME on enabling/disabling repos with sed
dnf5 config-manager can now do this, but the syntax is different
to dnf4, and honestly, it seems easier to just stick with this
going forward than make it conditional on dnf version until
dnf4 goes away. So let's stop marking this as a FIXME.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-22 16:14:29 -07:00
Adam Williamson f4bd3c6f58 Add a container build test
This test, much like _live_build or _installer_build, builds a
container image in a way intended to be as similar as possible
to how official compose images are built. The purpose of the test
is to make sure updates do not break official container image
builds.

At the end of the test, we also check that the built container
is functional (at least, that we can run a 'hello world' command
in it). This can't really be rolled into podman.pm because that
test is more about testing podman itself, and it's just a one-
liner here anyway. We also run the 'if any packages from the
update are installed, are they the versions from the update?'
check inside the container, which required giving that check the
ability to 'wrap' the rpm commands to run inside a container.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-22 16:01:41 -07:00
Adam Williamson d65aac4c83 Drop a no-longer-needed workaround
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-19 16:30:52 -07:00
Adam Williamson f9cda76860 Revert "Install composefs with podman/toolbox to workaround #2275820"
This reverts commit 7b29a8f1b2.
It should no longer be needed now containers-common added a
dependency.
2024-04-19 16:29:58 -07:00
Adam Williamson 5a548fd3c7 Update GNOME lock screen needle
Seems they changed it from the user's initials to a generic icon.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-19 16:18:34 -07:00
Adam Williamson b976fb2d58 Yet another KDE system tray expander needle
Don't know why we need so many of these. There's something odd
about the panel in Plasma 6, I think.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-19 16:17:57 -07:00
Adam Williamson 4b3ee64ee8 Update gnome_reboot_confirm needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-18 12:59:41 -07:00