Commit Graph

3251 Commits

Author SHA1 Message Date
Adam Williamson 356ee975c0 d'oh, only do doublek workaround on KDE (desktop_terminal)
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-06-18 00:43:57 -07:00
Deborah Brouwer 3afc8fbed7 Add new variant boot_enter_passphrase graphical needle
The graphics on the boot_enter_passphrase screen can be a bit narrower
than currently expected. Add a new needle to account for this.

Signed-off-by: Deborah Brouwer <deborah.brouwer@collabora.com>
2024-06-18 07:27:06 +00:00
Adam Williamson b9125b9702 Use doublek workaround on desktop_terminal too
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-06-17 09:01:44 -07:00
Adam Williamson 943c4193d3 Factor out the KDE launcher double-typing workaround, use it more
There's a couple of places where we do menu_launch_type in KDE
without doing this workaround first, and they do run into the
bug sometimes. Let's factor it out from the few places it's
already repeated, and add it to the places it is missing.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-06-11 16:21:00 -07:00
Lukas Ruzicka 992e51f5c5 Create test suite for Desktop Keyring
This adds both the Gnome and the KDE tests to test the
Desktop Keyring. After a discussion with the Brno team,
how this could be tested without the need to rely on
external servers to log into, we set up a local FTP server,
we will log into it and remember the credentials and verify
that the credentials will be stored in the keyring correctly.
2024-06-11 16:04:44 -07:00
Adam Williamson 206ffc2a7e COPR / tag tests: handle GNOME "download unsigned" prompt
When using a side repo for testing a COPR or a side tag, there
may be unsigned packages. We set gpgcheck=0 to make dnf okay
with this, but gnome-software still shows a warning. Let's
click through it so the test can complete.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-06-11 14:38:18 -07:00
Adam Williamson 304699bc6f Defend even harder against progress spew in updatepkgs.txt
Seems current dnf5 has a bug which causes repository refresh
progress to be sent to stdout even with -q.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-06-11 09:13:01 -07:00
Adam Williamson 670d1072de Yet more timeout
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-06-11 08:17:22 -07:00
Adam Williamson e2fde7809c Bump advisory_check timeout even more for really huge "updates"
...well, in this case, the Python side tag, because side tags
that inherit have just *all* the packages in them.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-06-11 00:56:29 -07:00
Adam Williamson 5aaf78bf26 Adjust COPR / tag package info generation for dnf5 properties
dnf5 behaves differently from dnf < 5 in a couple of ways: like
rpm it does not always add a newline to the query format, and it
sends its status messages to stdout, not stderr. These commands
account for this and produce identical output with dnf < 5 and
dnf 5.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-06-11 00:33:36 -07:00
Adam Williamson a36e86fcf8 setup_repos: don't die on tag/COPR if there are workarounds
whoops, this bailout is too hard. we get here on tag/COPR path
if there are workarounds, that is fine.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-06-10 23:47:30 -07:00
Adam Williamson 9cf8e1b296 Update anaconda blivet RAID level select needle
The dropdown got a bit wider in latest blivet-gui.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-06-10 15:54:09 -07:00
Adam Williamson 9da1b5aa4b Update a GNOME Maps needle for an upstream map data change
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-06-10 15:53:43 -07:00
Adam Williamson d39b004c11 Update a Vinagre needle for an icon change
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-06-10 15:53:25 -07:00
Adam Williamson 3db37dcf01 Flip encrypted install tests back to UEFI
https://bugzilla.redhat.com/show_bug.cgi?id=2274770 seems to be
fixed, so these can go back to UEFI.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-06-10 15:51:07 -07:00
Adam Williamson e32ba706b3 Update another KDE needle
This was making the kfirewall test fail.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-06-04 15:49:37 -07:00
Adam Williamson 247c1853b4 Fix logic in live install retry loop
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-06-03 22:55:28 -07:00
Adam Williamson e353649ed8 Try launching live installer up to 5 times (#2280840)
We already try twice, but that seems to be not enough for the
annoying #2280840, we're often seeing failures.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-06-03 17:22:39 -07:00
Adam Williamson d8ddcc2791 Update anaconda launcher icon needle for KDE
Seems it's displaying the icon a bit bigger now.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-06-02 16:28:01 -07:00
Adam Williamson f14200e50d Update cockpit autoupdate test for new dnf5 service
The service cockpit enables is different when it detects dnf5,
since cockpit 317. Let's just make this an F40/F41 boundary
thing, and add the cockpit 317 update as a workaround for F41
until it goes stable.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-29 17:43:12 -07:00
Adam Williamson af06ac0809 Add a workaround for alt-d-s not working right after login
This broke the KDE app start/stop test. We need to click on the
desktop before alt-d-s will work, for some reason.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-28 16:02:06 -07:00
Adam Williamson 3146570101 Update more needles for KDE 6.0.90
These are from the compose tests, last batch was from the update
tests.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-28 15:53:34 -07:00
Adam Williamson d3833d376c check-needles: tweak the handling of send_key_until_needlematch
The previous way of doing this isn't really safe. It assumes we
will find at least one string literal on any line containing
send_key_until_needlematch, and strips the last one, on the basis
it must be the key to press. But if the key to press is an
unquoted variable, this will strip the tag instead. And if both
the key to press and the tag are unquoted variables, this will
strip the most recent string literal we put into the global list
from some *other* line!

So instead let's try to be a bit smarter about how we parse
send_key_until_needlematch lines - just stripping out everything
after the first comma after "send_key_until_needlematch" - and
drop the dangerous "pop the last item from the list" logic. This
way we should always only find the needle to match, if it's a
string literal, as for other directives. We should never reach
the key to press so we don't need to worry about taking it out.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-28 09:26:15 -07:00
Adam Williamson 833204e060 Re-enable FAS homepage check in desktop_browser
Let's hope it's more reliable now.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-28 09:14:53 -07:00
Adam Williamson 990f81b229 check-needles: ignore commented lines
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-28 09:13:30 -07:00
Adam Williamson cb4654e2a2 Update a couple of needles for KDE 6.0.90 changes
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-27 13:56:52 -07:00
Adam Williamson 3a4b874b38 Add ARM variants of a couple of Nautilus needles
These look different on ARM for some reason. No idea why.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-27 13:44:41 -07:00
Adam Williamson 576938af72 Update a few GNOME needles for minor Rawhide changes
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-27 13:43:54 -07:00
Adam Williamson 4ccdaf0236 Add some wait_still_screens to GNOME Software ignore handling
I think the lack here is sometimes causing us to click more
times than we should. Let's do this to try and make sure we
don't click once it worked.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-27 12:17:40 -07:00
Adam Williamson 4e102743b7 Put all upgrade encrypted tests back on UEFI
They use base disk images, and it's too fiddly to try and
arrange for the one the update test uses to be UEFI but the
other to be BIOS...let's just keep these on UEFI but kick up the
retry count :/

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-27 08:48:38 -07:00
Adam Williamson 82b23f9738 Revert "D'oh, move the most important encryption test to BIOS"
This reverts commit 508635ed1c and
the fix-up follow-up, because this causes the test to have a
different scenario which screws up gating. Argh. I guess we're
stuck restarting it forever. Let's bump the retry number even
higher instead.
2024-05-24 11:40:03 -07:00
Adam Williamson 787304be16 ...aaand now do that properly
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-24 11:34:51 -07:00
Adam Williamson 508635ed1c D'oh, move the most important encryption test to BIOS
This is the one that's most significant (as updates are gated if
it fails), forgot it. Sigh.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-24 11:33:28 -07:00
Adam Williamson d16d954012 Switch graphical encrypted tests to BIOS (#2274770)
There is a weird and annoying kernel bug ATM which makes entering
encryption passphrases into plymouth's graphical interface often
fail on UEFI VMs. Using a BIOS VM seems to avoid this, and the
bug is not getting fixed, so let's switch all these tests to
BIOS to avoid this annoying bug causing failures all the time,
especially for update tests.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-24 08:45:10 -07:00
Adam Williamson aa6a907857 Update all ELN needles for font change
ELN changed to some new font, which means it now needs all its
own needles for any installer screen that matches on text :(
Here they are.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-22 09:39:10 -07:00
Adam Williamson 0f40d518a9 Update a bunch of needles for changed font rendering in Yelp
Yelp changed something that makes it render fonts differently,
so we get to update every needle that matches text in Yelp.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-22 09:03:09 -07:00
Adam Williamson 109cb84fa1 Add another weather report variant needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-22 08:49:27 -07:00
Adam Williamson 92da1925d6 Update a Maps needle for upstream data changes
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-13 10:38:04 -07:00
Adam Williamson 810b1a3166 Drop match level on another KDE panel needle to 90
This needle is affected by the blurry panel bug -
https://bugs.kde.org/show_bug.cgi?id=484888 .

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-13 10:20:33 -07:00
Adam Williamson 5ace81910b Update a Cockpit auto-update needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-13 10:09:44 -07:00
Adam Williamson 976b37f976 Use workarounds and Rawhide tag repo for update net installs
We're getting failures in the update network install tests today
which seem to be because we're using an image built with systemd
256 to install systemd 255. This is because systemd 256 has been
tagged but isn't in a compose yet, and we use the Rawhide tag
repo when building the installer image but we don't add it as an
additional repo for the install itself.

This is obviously a hole in the process, we should use the extra
repos, where appropriate, all the way through. So this makes us
use both the Rawhide tag repo (when doing a Rawhide install test)
and the workarounds repo (when there are workarounds) for network
install tests.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-13 09:38:00 -07:00
Adam Williamson 3b3e00f123 flatpak: proxy the connection to flathub
This is intended to reduce the amount of traffic we generate to
flathub, particularly so we can run this test on updates as well
as composes. We have to set a proxy and trust an SSL cert.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-06 15:12:15 -07:00
Adam Williamson 3a6e65914a Update kparted runs needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-06 15:11:50 -07:00
Adam Williamson b782c44ee9 Update a couple of straggler needles for GTK 4.15
The Japanese one was hidden by the UEFI encryption passphrase
entry bug, and the weather one we only hit when the test runs
at an unusual time.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-06 15:10:53 -07:00
Adam Williamson 637a411fd6 Add yet another KDE menu button needle variant
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-06 15:09:49 -07:00
Adam Williamson 57329a69fc Update some Maps needles for upstream metadata changes
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-06 15:09:11 -07:00
Adam Williamson 3da32a643f Update some loupe needles for GTK 4.15
These are screens that weren't previously reached due to a bug
that was recently fixed.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-06 15:08:13 -07:00
Adam Williamson a353caeb90 Enable testing of COPRs, fix some issues, enable package checks
This works more or less like testing side tags. We also fix up
some flow problems with this path (that also affect the side tag
case), and enable the package checks on this path - it's not too
hard really, we just need to write the updatepkgs file when we
set up the repo, which we can do with dnf repoquery.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-03 14:40:34 -07:00
Adam Williamson 1edde53988 Try and avoid launcher typing issues in more KDE tests
This is the same thing we do for the app_startstop tests in
aaa_setup, applied to a couple of other places we use
menu_launch_type in KDE and it's having trouble.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-03 14:22:59 -07:00
Adam Williamson d142d2f4a1 zezere: update for new default ssh key algorithm
ssh-keygen now defaults to ed25519, so this test needs updating.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-29 10:32:14 -07:00