Commit Graph

2768 Commits

Author SHA1 Message Date
Adam Williamson ca6ca2e490 Handle a persistent overlay warning on live boot (#2170544)
In today's F38 and Rawhide, changes to the persistent overlay
stuff result in a boot warning you have to spam through. Let's
handle this as a soft fail so we don't have floods of failed
tests till it's fixed.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-16 09:12:36 -08:00
Lukas Ruzicka 94f92c8ae7 Add failed needles for Maps. 2023-02-15 18:35:14 +01:00
Lukas Ruzicka ecf02bb48b Add failed needles for Gnome Text Editor. 2023-02-15 16:07:13 +01:00
Adam Williamson 7156881b64 workarounds: add kde-settings for F38 too
This gets us the F38 background in KDE.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-14 11:27:18 -08:00
Adam Williamson 42316bdfb1 workarounds: add desktop-backgrounds too for F38
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-14 09:58:49 -08:00
Adam Williamson 8ce8f2aba4 f38 workarounds: drop updates now stable, add f38-backgrounds
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-14 09:17:49 -08:00
Adam Williamson 6baf67aefd Work around the f39 toolbox container not existing
On Rawhide, just use an f38 toolbox container for now.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-13 19:16:09 -08:00
Adam Williamson 619f5a70fe Add glib2 2.75.3 to f38 workarounds (FEDORA-2023-965f517da3)
GNOME blows up without it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-13 15:09:14 -08:00
Adam Williamson 860c8e0a09 Add bug F38 GNOME update to workarounds
As we're not getting composes ATM this isn't being pulled into
tests of subsequent updates, but we need it to be or else there
are issues.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-13 12:23:08 -08:00
Adam Williamson 016c78d80b Add FEDORA-2023-ad52b2e4b9 as a workaround for F38
tracker-miners had a bad dep which broke live image builds.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-10 00:05:40 -08:00
Adam Williamson 4db301bba6 Use systemctl start not systemctl isolate in notifications test
Per https://github.com/systemd/systemd/issues/26364#issuecomment-1424900066
this resolves the problem with systemctl isolate not working on
current Rawhide.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-09 14:56:33 -08:00
Adam Williamson 56999e1330 Update more anaconda network needles for font kerning changes
Looks like what happened here is font kerning changed (got
better) in the nm-connection-editor spawned from anaconda.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-08 15:21:24 -08:00
Adam Williamson e75c3ffcb5 Update a couple of Cockpit needles for new release
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-08 15:20:22 -08:00
Adam Williamson 796e50f4fb Update various needles for KDE appearance changes
A lot of these are because anaconda is more KDE-themed on the
KDE live ISO now. The rest are just miscellaneous appearance
changes to KDE apps in recent Rawhide.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-07 16:57:27 -08:00
Adam Williamson 8a960da62b Update installer IPv4 network tab needle
Font changed a bit, for some reason.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-07 16:56:16 -08:00
Adam Williamson f4b154253c desktop_login: don't hit esc on lock screen
Tested that this is not necessary on KDE or GNOME, and on current
KDE it actually seems to break stuff. It's better to just start
typing the password.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-07 11:43:16 -08:00
Adam Williamson 95de85b33a Adjust a wait_still_screen not to time out on a flashing cursor
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-07 10:02:38 -08:00
Adam Williamson 95b89ca832 Update anaconda needles for KDE live appearance change (#2167534)
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-06 17:25:11 -08:00
Adam Williamson 7475176c00 Update maps needles
Bike route changed again. For the website opened needle, the
URL bar text seems to keep changing slightly, so instead let's
try matching on the big app logo...hopefully that won't change
as much.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-03 16:33:21 -08:00
Adam Williamson b2abe0e6a6 Update evince annotation added needle for some small change
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-03 16:32:43 -08:00
Adam Williamson 8bcabe25a8 Give some long-running package install operations a bit longer
These have timed out quite often recently.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-03 09:04:48 -08:00
Adam Williamson 245903dd0c Reduce a match area on firefox addon_success needle
Now we sometimes have to scroll the page down to add the addon,
the Remove button isn't always fully visible behind the popup.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-03 09:01:43 -08:00
Adam Williamson 6a7c11466c Get updvercheck.py from main now it's merged
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-03 08:58:38 -08:00
Lukas Ruzicka 8ba56693ed Add snowflake needle for Gnome Weather 2023-02-03 13:45:09 +01:00
Adam Williamson 06bfd2d2ae Make the update non-matching package check smarter
With Rawhide updates, we quite often run into a situation where
a test runs after a *later* version of the package has already
gone stable. This even happens for stable releases too, though
less often. The current shell-based check just always fails on
this case, but it's usually OK, and manually marking every case
like this with an "it's OK!" comment gets tiring. Instead, let's
use a smarter Python script to do the check. We compare the EVR
of all installed update packages with the EVR of the package
from the update. If it's the same, fine. If the installed package
is lower-versioned, that's always an error, and we fail. If the
installed package is higher-versioned, we check whether the
update already went stable. If it did, then we soft fail, because
probably nothing can go wrong at this point (this is the usual
Rawhide case). If the update did not yet go stable, we still
hard fail, because something can go wrong in this case: if the
update *now* goes stable, the older version from the update may
be tagged over the newer version the test got (presumably from
current stable).

If anything goes wrong with the Bodhi check, or the test is
running on a task not an advisory, we treat both cases as fatal.

The script also gives easier-to-understand output than the old
approach, which should be a bonus.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-31 10:14:45 -08:00
Adam Williamson a881d227fb apps_startstop: tweak print theme editor launch to avoid #2165657
Typing a partial binary name no longer seems to work. Typing the
full binary name works, but differently from before; seems best
to do a partial entry name search so we launch the actual entry,
not the executable directly.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-30 09:31:28 -08:00
Adam Williamson a4362346d4 Update various KDE needles for recent Rawhide changes
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-27 14:00:20 -08:00
Adam Williamson f2e87cd128 desktop_browser: handle addon add button not always being visible
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-26 22:58:14 -08:00
Adam Williamson 0bda4ad073 rpmostree_overlay: try to cancel running operations
I've seen a few cases of this test failing because there was
some running operation when it tries to do `rpm-ostree install`.
I think this is GNOME Software checking for updates or something,
I've seen it on my own Silverblue install too. Let's just throw
some `rpm-ostree cancel`s at it and hope that helps.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-26 17:02:49 -08:00
Adam Williamson e22f0c66e4 Update Maps needles for Rawhide
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-23 16:33:42 -08:00
Adam Williamson ebf259680b Update LibreOffice launcher needles
Looks like the icons got redesigned.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-23 16:33:02 -08:00
Adam Williamson f3c8b570d1 More fixes to anaconda additional repository flow
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-23 15:32:07 -08:00
Adam Williamson f03743a01d Update anaconda additional repository flow
"Additional repositories" is now hidden behind a dropdown we
have to open first. This will make the test fail on anything
older than Fedora-Rawhide-20230121.n.0, but I don't think we
run this test anywhere that would be a problem.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-23 14:38:12 -08:00
Lukas Ruzicka 7ad809339f Add new test for Characters.
This PR adds a small test suite to test the Characters applications.
It displays several different groups of characters and then tries
to copy one of the characters and place it into a text editor.
2023-01-19 17:53:03 -08:00
Adam Williamson 1d46c5aa85 Update maps 'website opened' needle
Looks like some font rendering change in the browser URL bar.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-18 10:00:54 -08:00
Adam Williamson 296d2c0a20 Update Firefox addon success needle
Seems like some tiny graphical change in the icon of the addon
we use for testing.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-18 09:58:01 -08:00
Adam Williamson 6a36fe28d1 Handle a false failure when testing koji updates
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-14 02:57:38 -08:00
Adam Williamson da18856ed3 Update cockpit needle for font change in 283
zero characters lost the line through the middle...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-12 22:56:49 -08:00
Adam Williamson a64cadb8fe Make the Software welcome->ignore change in apps_startstop too
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-11 09:16:31 -08:00
Adam Williamson 279ae24fc1 Add a couple more UEFI console passphrase needles
This seems like a tricky match.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-09 11:51:27 -08:00
Adam Williamson 2a157bbd4e Fix up the Ignore button clicking
The dialog moves a bit.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-09 11:45:03 -08:00
Adam Williamson 2db1e57674 Check for 3rd-party popup instead of 'welcome' screen
GNOME Software no longer has a welcome screen in any current
Fedora (it was dropped between 35 and 36), but in Rawhide it now
has a popup that prompts you to enable third-party repos which
we need to get rid of, so just convert the welcome screen check
to handle that, and drop all the welcome screen needles.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-09 10:34:27 -08:00
Lukas Ruzicka d4cb357db7 Add needle for Akonadi notification to make KDE notification test pass. 2023-01-03 09:56:24 +01:00
Adam Williamson 8a36423314 remote_logging_server: sleep at the end
It seems ending the test right after we create the mutex can
cause the client not to catch it, sometimes. So let's sleep for
a few seconds after creating it to make sure it does.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-24 14:30:03 -08:00
Adam Williamson 1dfae9b44e ...and in the other file too.
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-24 13:42:16 -08:00
Adam Williamson f32ee1040a maps: update bike route needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-24 13:33:07 -08:00
Adam Williamson 21d14ac93d remote_logging: ugh, need to include utils too
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-24 13:31:58 -08:00
Adam Williamson 0a4d86e7bf remote_logging tests: do repo_setup
These tests weren't doing it, I guess it's just an oversight;
this is probably why they often fail on slow repos.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-24 09:57:22 -08:00
Adam Williamson fa3881e80e Revert "Use older grub for _support_server tftp to fix PXE (#2152763)"
This reverts commit 61d77ee108.
The bug looks to be fixed now, and the fix hit stable for F37,
so this should no longer be necessary.
2022-12-23 11:17:00 -08:00
Adam Williamson 434b492eae Reduce match level for a KDE no notifications needle
Got a 92% match at
https://openqa.fedoraproject.org/tests/1661285#step/desktop_notifications/21

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-23 11:11:35 -08:00