Commit Graph

2756 Commits

Author SHA1 Message Date
Adam Williamson e75c3ffcb5 Update a couple of Cockpit needles for new release
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-08 15:20:22 -08:00
Adam Williamson 796e50f4fb Update various needles for KDE appearance changes
A lot of these are because anaconda is more KDE-themed on the
KDE live ISO now. The rest are just miscellaneous appearance
changes to KDE apps in recent Rawhide.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-07 16:57:27 -08:00
Adam Williamson 8a960da62b Update installer IPv4 network tab needle
Font changed a bit, for some reason.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-07 16:56:16 -08:00
Adam Williamson f4b154253c desktop_login: don't hit esc on lock screen
Tested that this is not necessary on KDE or GNOME, and on current
KDE it actually seems to break stuff. It's better to just start
typing the password.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-07 11:43:16 -08:00
Adam Williamson 95de85b33a Adjust a wait_still_screen not to time out on a flashing cursor
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-07 10:02:38 -08:00
Adam Williamson 95b89ca832 Update anaconda needles for KDE live appearance change (#2167534)
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-06 17:25:11 -08:00
Adam Williamson 7475176c00 Update maps needles
Bike route changed again. For the website opened needle, the
URL bar text seems to keep changing slightly, so instead let's
try matching on the big app logo...hopefully that won't change
as much.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-03 16:33:21 -08:00
Adam Williamson b2abe0e6a6 Update evince annotation added needle for some small change
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-03 16:32:43 -08:00
Adam Williamson 8bcabe25a8 Give some long-running package install operations a bit longer
These have timed out quite often recently.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-03 09:04:48 -08:00
Adam Williamson 245903dd0c Reduce a match area on firefox addon_success needle
Now we sometimes have to scroll the page down to add the addon,
the Remove button isn't always fully visible behind the popup.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-03 09:01:43 -08:00
Adam Williamson 6a7c11466c Get updvercheck.py from main now it's merged
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-03 08:58:38 -08:00
Lukas Ruzicka 8ba56693ed Add snowflake needle for Gnome Weather 2023-02-03 13:45:09 +01:00
Adam Williamson 06bfd2d2ae Make the update non-matching package check smarter
With Rawhide updates, we quite often run into a situation where
a test runs after a *later* version of the package has already
gone stable. This even happens for stable releases too, though
less often. The current shell-based check just always fails on
this case, but it's usually OK, and manually marking every case
like this with an "it's OK!" comment gets tiring. Instead, let's
use a smarter Python script to do the check. We compare the EVR
of all installed update packages with the EVR of the package
from the update. If it's the same, fine. If the installed package
is lower-versioned, that's always an error, and we fail. If the
installed package is higher-versioned, we check whether the
update already went stable. If it did, then we soft fail, because
probably nothing can go wrong at this point (this is the usual
Rawhide case). If the update did not yet go stable, we still
hard fail, because something can go wrong in this case: if the
update *now* goes stable, the older version from the update may
be tagged over the newer version the test got (presumably from
current stable).

If anything goes wrong with the Bodhi check, or the test is
running on a task not an advisory, we treat both cases as fatal.

The script also gives easier-to-understand output than the old
approach, which should be a bonus.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-31 10:14:45 -08:00
Adam Williamson a881d227fb apps_startstop: tweak print theme editor launch to avoid #2165657
Typing a partial binary name no longer seems to work. Typing the
full binary name works, but differently from before; seems best
to do a partial entry name search so we launch the actual entry,
not the executable directly.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-30 09:31:28 -08:00
Adam Williamson a4362346d4 Update various KDE needles for recent Rawhide changes
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-27 14:00:20 -08:00
Adam Williamson f2e87cd128 desktop_browser: handle addon add button not always being visible
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-26 22:58:14 -08:00
Adam Williamson 0bda4ad073 rpmostree_overlay: try to cancel running operations
I've seen a few cases of this test failing because there was
some running operation when it tries to do `rpm-ostree install`.
I think this is GNOME Software checking for updates or something,
I've seen it on my own Silverblue install too. Let's just throw
some `rpm-ostree cancel`s at it and hope that helps.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-26 17:02:49 -08:00
Adam Williamson e22f0c66e4 Update Maps needles for Rawhide
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-23 16:33:42 -08:00
Adam Williamson ebf259680b Update LibreOffice launcher needles
Looks like the icons got redesigned.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-23 16:33:02 -08:00
Adam Williamson f3c8b570d1 More fixes to anaconda additional repository flow
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-23 15:32:07 -08:00
Adam Williamson f03743a01d Update anaconda additional repository flow
"Additional repositories" is now hidden behind a dropdown we
have to open first. This will make the test fail on anything
older than Fedora-Rawhide-20230121.n.0, but I don't think we
run this test anywhere that would be a problem.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-23 14:38:12 -08:00
Lukas Ruzicka 7ad809339f Add new test for Characters.
This PR adds a small test suite to test the Characters applications.
It displays several different groups of characters and then tries
to copy one of the characters and place it into a text editor.
2023-01-19 17:53:03 -08:00
Adam Williamson 1d46c5aa85 Update maps 'website opened' needle
Looks like some font rendering change in the browser URL bar.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-18 10:00:54 -08:00
Adam Williamson 296d2c0a20 Update Firefox addon success needle
Seems like some tiny graphical change in the icon of the addon
we use for testing.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-18 09:58:01 -08:00
Adam Williamson 6a36fe28d1 Handle a false failure when testing koji updates
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-14 02:57:38 -08:00
Adam Williamson da18856ed3 Update cockpit needle for font change in 283
zero characters lost the line through the middle...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-12 22:56:49 -08:00
Adam Williamson a64cadb8fe Make the Software welcome->ignore change in apps_startstop too
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-11 09:16:31 -08:00
Adam Williamson 279ae24fc1 Add a couple more UEFI console passphrase needles
This seems like a tricky match.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-09 11:51:27 -08:00
Adam Williamson 2a157bbd4e Fix up the Ignore button clicking
The dialog moves a bit.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-09 11:45:03 -08:00
Adam Williamson 2db1e57674 Check for 3rd-party popup instead of 'welcome' screen
GNOME Software no longer has a welcome screen in any current
Fedora (it was dropped between 35 and 36), but in Rawhide it now
has a popup that prompts you to enable third-party repos which
we need to get rid of, so just convert the welcome screen check
to handle that, and drop all the welcome screen needles.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-09 10:34:27 -08:00
Lukas Ruzicka d4cb357db7 Add needle for Akonadi notification to make KDE notification test pass. 2023-01-03 09:56:24 +01:00
Adam Williamson 8a36423314 remote_logging_server: sleep at the end
It seems ending the test right after we create the mutex can
cause the client not to catch it, sometimes. So let's sleep for
a few seconds after creating it to make sure it does.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-24 14:30:03 -08:00
Adam Williamson 1dfae9b44e ...and in the other file too.
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-24 13:42:16 -08:00
Adam Williamson f32ee1040a maps: update bike route needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-24 13:33:07 -08:00
Adam Williamson 21d14ac93d remote_logging: ugh, need to include utils too
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-24 13:31:58 -08:00
Adam Williamson 0a4d86e7bf remote_logging tests: do repo_setup
These tests weren't doing it, I guess it's just an oversight;
this is probably why they often fail on slow repos.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-24 09:57:22 -08:00
Adam Williamson fa3881e80e Revert "Use older grub for _support_server tftp to fix PXE (#2152763)"
This reverts commit 61d77ee108.
The bug looks to be fixed now, and the fix hit stable for F37,
so this should no longer be necessary.
2022-12-23 11:17:00 -08:00
Adam Williamson 434b492eae Reduce match level for a KDE no notifications needle
Got a 92% match at
https://openqa.fedoraproject.org/tests/1661285#step/desktop_notifications/21

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-23 11:11:35 -08:00
Adam Williamson bfe0558575 Update kwrite_runs needle for some Rawhide change
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-23 11:11:11 -08:00
Adam Williamson 2c1a0e8128 desktop_update_graphical: disable koji-rawhide on update tests
...or else we get stuff like
https://openqa.fedoraproject.org/tests/1649309#step/desktop_update_graphical/40

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-16 23:23:26 -08:00
Adam Williamson 6daf9c36a0 Make rpm-ostree tests generic, run on Silverblue and CoreOS
This makes the two rpm-ostree tests written for IoT - overlaying
and rebasing - work across all rpm-ostree-based flavors we
currently test (IoT, CoreOS and Silverblue) and runs them on
all those flavors.

This requires some other changes. For the Workstation ostree
installer update tests, we have install_default_update_ostree
upload a disk image and run these tests on that image. That means
install_default_update_ostree cannot use a scratch disk (as if
we boot it with two disks but only upload one, the subsequent
tests fail to boot, looking for the missing second disk), but its
specified disk size should be large enough for all updates.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-16 08:44:43 -08:00
Adam Williamson 89faf008dd Drop match level on another KDE needle
Got a 94% match on this one.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-15 14:47:22 -08:00
Adam Williamson 31ea2f1d2e Update a KDE update notification needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-15 14:45:27 -08:00
Adam Williamson f4cf54486b Update some KDE login test needles
This test fails on Rawhide (because sddm-on-wayland) but we just
got an F37 respin, where it passes but needs some needle updates.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-15 14:41:53 -08:00
Adam Williamson bf1a19c07f Clean up KDE expand_systray needles, drop match level on remaining
All the deleted ones haven't been matched for five months. Drop
match level to 90 on the remaining ones, we got a 96 match for
one of them in today's respin test.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-15 14:27:49 -08:00
Adam Williamson aec26e8b2c Yet more needles for the cockpit update
I don't know why we wind up with so many slightly different
matches on the login screen. It's weird.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-15 11:17:49 -08:00
Adam Williamson 3754ab3d8a Drop all handling of MODULAR
This was from years ago when we briefly did "modular composes".
That died and ain't coming back.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-15 11:10:40 -08:00
Adam Williamson 51d79a5435 Update a bunch of needles for Cockpit 282
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-14 17:35:24 -08:00
Adam Williamson a566f01a79 _boot_to_anaconda: extend the sleep before bootloader re-check
What's supposed to happen here is the `do_bootloader` invocation
a few lines back boots to the installer, then here, we wait for
the install to complete and the system to reboot, and match the
bootloader again. However, on PXE installs, the bootloader screen
can hang around for quite a long time here, and if it does, we
can match it again before the installer starts up, and move on
too early. Hence the sleep.

It seems on current Rawhide 20 seconds isn't long enough - we're
still matching the installer bootloader after the sleep, see
e.g. https://openqa.stg.fedoraproject.org/tests/2431660#step/_boot_to_anaconda/3
This is causing the test to almost always fail (it'll only pass
if the install+reboot takes less than five minutes). Let's bump
it to 60 seconds and hope that's long enough.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-14 12:29:00 -08:00
Adam Williamson 6b6caaf3a8 Update KDE menu button needle for an F36 update
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-14 09:02:20 -08:00