1
0
mirror of https://pagure.io/fedora-qa/os-autoinst-distri-fedora.git synced 2024-11-30 01:23:08 +00:00
Commit Graph

2554 Commits

Author SHA1 Message Date
Adam Williamson
8a960da62b Update installer IPv4 network tab needle
Font changed a bit, for some reason.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-07 16:56:16 -08:00
Adam Williamson
f4b154253c desktop_login: don't hit esc on lock screen
Tested that this is not necessary on KDE or GNOME, and on current
KDE it actually seems to break stuff. It's better to just start
typing the password.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-07 11:43:16 -08:00
Adam Williamson
95de85b33a Adjust a wait_still_screen not to time out on a flashing cursor
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-07 10:02:38 -08:00
Adam Williamson
95b89ca832 Update anaconda needles for KDE live appearance change (#2167534)
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-06 17:25:11 -08:00
Adam Williamson
7475176c00 Update maps needles
Bike route changed again. For the website opened needle, the
URL bar text seems to keep changing slightly, so instead let's
try matching on the big app logo...hopefully that won't change
as much.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-03 16:33:21 -08:00
Adam Williamson
b2abe0e6a6 Update evince annotation added needle for some small change
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-03 16:32:43 -08:00
Adam Williamson
8bcabe25a8 Give some long-running package install operations a bit longer
These have timed out quite often recently.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-03 09:04:48 -08:00
Adam Williamson
245903dd0c Reduce a match area on firefox addon_success needle
Now we sometimes have to scroll the page down to add the addon,
the Remove button isn't always fully visible behind the popup.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-03 09:01:43 -08:00
Adam Williamson
6a7c11466c Get updvercheck.py from main now it's merged
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-03 08:58:38 -08:00
Lukas Ruzicka
8ba56693ed Add snowflake needle for Gnome Weather 2023-02-03 13:45:09 +01:00
Adam Williamson
06bfd2d2ae Make the update non-matching package check smarter
With Rawhide updates, we quite often run into a situation where
a test runs after a *later* version of the package has already
gone stable. This even happens for stable releases too, though
less often. The current shell-based check just always fails on
this case, but it's usually OK, and manually marking every case
like this with an "it's OK!" comment gets tiring. Instead, let's
use a smarter Python script to do the check. We compare the EVR
of all installed update packages with the EVR of the package
from the update. If it's the same, fine. If the installed package
is lower-versioned, that's always an error, and we fail. If the
installed package is higher-versioned, we check whether the
update already went stable. If it did, then we soft fail, because
probably nothing can go wrong at this point (this is the usual
Rawhide case). If the update did not yet go stable, we still
hard fail, because something can go wrong in this case: if the
update *now* goes stable, the older version from the update may
be tagged over the newer version the test got (presumably from
current stable).

If anything goes wrong with the Bodhi check, or the test is
running on a task not an advisory, we treat both cases as fatal.

The script also gives easier-to-understand output than the old
approach, which should be a bonus.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-31 10:14:45 -08:00
Adam Williamson
a881d227fb apps_startstop: tweak print theme editor launch to avoid #2165657
Typing a partial binary name no longer seems to work. Typing the
full binary name works, but differently from before; seems best
to do a partial entry name search so we launch the actual entry,
not the executable directly.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-30 09:31:28 -08:00
Adam Williamson
a4362346d4 Update various KDE needles for recent Rawhide changes
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-27 14:00:20 -08:00
Adam Williamson
f2e87cd128 desktop_browser: handle addon add button not always being visible
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-26 22:58:14 -08:00
Adam Williamson
0bda4ad073 rpmostree_overlay: try to cancel running operations
I've seen a few cases of this test failing because there was
some running operation when it tries to do `rpm-ostree install`.
I think this is GNOME Software checking for updates or something,
I've seen it on my own Silverblue install too. Let's just throw
some `rpm-ostree cancel`s at it and hope that helps.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-26 17:02:49 -08:00
Adam Williamson
e22f0c66e4 Update Maps needles for Rawhide
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-23 16:33:42 -08:00
Adam Williamson
ebf259680b Update LibreOffice launcher needles
Looks like the icons got redesigned.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-23 16:33:02 -08:00
Adam Williamson
f3c8b570d1 More fixes to anaconda additional repository flow
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-23 15:32:07 -08:00
Adam Williamson
f03743a01d Update anaconda additional repository flow
"Additional repositories" is now hidden behind a dropdown we
have to open first. This will make the test fail on anything
older than Fedora-Rawhide-20230121.n.0, but I don't think we
run this test anywhere that would be a problem.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-23 14:38:12 -08:00
Lukas Ruzicka
7ad809339f Add new test for Characters.
This PR adds a small test suite to test the Characters applications.
It displays several different groups of characters and then tries
to copy one of the characters and place it into a text editor.
2023-01-19 17:53:03 -08:00
Adam Williamson
1d46c5aa85 Update maps 'website opened' needle
Looks like some font rendering change in the browser URL bar.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-18 10:00:54 -08:00
Adam Williamson
296d2c0a20 Update Firefox addon success needle
Seems like some tiny graphical change in the icon of the addon
we use for testing.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-18 09:58:01 -08:00
Adam Williamson
6a36fe28d1 Handle a false failure when testing koji updates
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-14 02:57:38 -08:00
Adam Williamson
da18856ed3 Update cockpit needle for font change in 283
zero characters lost the line through the middle...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-12 22:56:49 -08:00
Adam Williamson
a64cadb8fe Make the Software welcome->ignore change in apps_startstop too
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-11 09:16:31 -08:00
Adam Williamson
279ae24fc1 Add a couple more UEFI console passphrase needles
This seems like a tricky match.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-09 11:51:27 -08:00
Adam Williamson
2a157bbd4e Fix up the Ignore button clicking
The dialog moves a bit.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-09 11:45:03 -08:00
Adam Williamson
2db1e57674 Check for 3rd-party popup instead of 'welcome' screen
GNOME Software no longer has a welcome screen in any current
Fedora (it was dropped between 35 and 36), but in Rawhide it now
has a popup that prompts you to enable third-party repos which
we need to get rid of, so just convert the welcome screen check
to handle that, and drop all the welcome screen needles.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-09 10:34:27 -08:00
Lukas Ruzicka
d4cb357db7 Add needle for Akonadi notification to make KDE notification test pass. 2023-01-03 09:56:24 +01:00
Adam Williamson
8a36423314 remote_logging_server: sleep at the end
It seems ending the test right after we create the mutex can
cause the client not to catch it, sometimes. So let's sleep for
a few seconds after creating it to make sure it does.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-24 14:30:03 -08:00
Adam Williamson
1dfae9b44e ...and in the other file too.
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-24 13:42:16 -08:00
Adam Williamson
f32ee1040a maps: update bike route needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-24 13:33:07 -08:00
Adam Williamson
21d14ac93d remote_logging: ugh, need to include utils too
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-24 13:31:58 -08:00
Adam Williamson
0a4d86e7bf remote_logging tests: do repo_setup
These tests weren't doing it, I guess it's just an oversight;
this is probably why they often fail on slow repos.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-24 09:57:22 -08:00
Adam Williamson
fa3881e80e Revert "Use older grub for _support_server tftp to fix PXE (#2152763)"
This reverts commit 61d77ee108.
The bug looks to be fixed now, and the fix hit stable for F37,
so this should no longer be necessary.
2022-12-23 11:17:00 -08:00
Adam Williamson
434b492eae Reduce match level for a KDE no notifications needle
Got a 92% match at
https://openqa.fedoraproject.org/tests/1661285#step/desktop_notifications/21

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-23 11:11:35 -08:00
Adam Williamson
bfe0558575 Update kwrite_runs needle for some Rawhide change
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-23 11:11:11 -08:00
Adam Williamson
2c1a0e8128 desktop_update_graphical: disable koji-rawhide on update tests
...or else we get stuff like
https://openqa.fedoraproject.org/tests/1649309#step/desktop_update_graphical/40

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-16 23:23:26 -08:00
Adam Williamson
6daf9c36a0 Make rpm-ostree tests generic, run on Silverblue and CoreOS
This makes the two rpm-ostree tests written for IoT - overlaying
and rebasing - work across all rpm-ostree-based flavors we
currently test (IoT, CoreOS and Silverblue) and runs them on
all those flavors.

This requires some other changes. For the Workstation ostree
installer update tests, we have install_default_update_ostree
upload a disk image and run these tests on that image. That means
install_default_update_ostree cannot use a scratch disk (as if
we boot it with two disks but only upload one, the subsequent
tests fail to boot, looking for the missing second disk), but its
specified disk size should be large enough for all updates.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-16 08:44:43 -08:00
Adam Williamson
89faf008dd Drop match level on another KDE needle
Got a 94% match on this one.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-15 14:47:22 -08:00
Adam Williamson
31ea2f1d2e Update a KDE update notification needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-15 14:45:27 -08:00
Adam Williamson
f4cf54486b Update some KDE login test needles
This test fails on Rawhide (because sddm-on-wayland) but we just
got an F37 respin, where it passes but needs some needle updates.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-15 14:41:53 -08:00
Adam Williamson
bf1a19c07f Clean up KDE expand_systray needles, drop match level on remaining
All the deleted ones haven't been matched for five months. Drop
match level to 90 on the remaining ones, we got a 96 match for
one of them in today's respin test.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-15 14:27:49 -08:00
Adam Williamson
aec26e8b2c Yet more needles for the cockpit update
I don't know why we wind up with so many slightly different
matches on the login screen. It's weird.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-15 11:17:49 -08:00
Adam Williamson
3754ab3d8a Drop all handling of MODULAR
This was from years ago when we briefly did "modular composes".
That died and ain't coming back.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-15 11:10:40 -08:00
Adam Williamson
51d79a5435 Update a bunch of needles for Cockpit 282
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-14 17:35:24 -08:00
Adam Williamson
a566f01a79 _boot_to_anaconda: extend the sleep before bootloader re-check
What's supposed to happen here is the `do_bootloader` invocation
a few lines back boots to the installer, then here, we wait for
the install to complete and the system to reboot, and match the
bootloader again. However, on PXE installs, the bootloader screen
can hang around for quite a long time here, and if it does, we
can match it again before the installer starts up, and move on
too early. Hence the sleep.

It seems on current Rawhide 20 seconds isn't long enough - we're
still matching the installer bootloader after the sleep, see
e.g. https://openqa.stg.fedoraproject.org/tests/2431660#step/_boot_to_anaconda/3
This is causing the test to almost always fail (it'll only pass
if the install+reboot takes less than five minutes). Let's bump
it to 60 seconds and hope that's long enough.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-14 12:29:00 -08:00
Adam Williamson
6b6caaf3a8 Update KDE menu button needle for an F36 update
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-14 09:02:20 -08:00
Adam Williamson
d012d31270 _post_fail_hook: only do advisory package checks when appropriate
Same conditions as used in main.pm to load the tests in the
normal flow. It makes no sense to do this on non-update tests,
or on the non-matching support server case.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-14 08:47:46 -08:00
Adam Williamson
2023172c24 Revert "Try and workaround IoT rebase problems with F37 read-only change"
This reverts commit 093da03139.
As the comment says, this should be safe now F37 is stable.
2022-12-13 14:34:34 -08:00