1
0
mirror of https://pagure.io/fedora-qa/os-autoinst-distri-fedora.git synced 2024-11-09 09:04:20 +00:00
Commit Graph

1983 Commits

Author SHA1 Message Date
Adam Williamson
492fcf62e4 Great Needle Cleanup 2021
Remove a whole chunk of needles that haven't matched for more
than 3 months. Also move a few needles to appropriate locations,
simplify some code chunks that relied on removed needles (if
we're not matching the needles, we don't need those chunks any
more), and drop some other no-longer-needed conditionals for
older releases.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-10 11:57:48 -07:00
Adam Williamson
ba5a338e13 More tweaking the damn 'begin installation' bit
`click_lastmatch` wasn't safe there, if we caught the middlle of
the scroll animation. We have to assert again after waiting.
Also do the same in `_do_install_and_reboot` as the same can
happen.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-10 11:56:56 -07:00
Adam Williamson
07aa8cfb32 More tweaking of anaconda_help annoying part
Grr, with the screen changes and the animations...waiting for
screen to change when clicking a button doesn't work very well
as the button animation often counts as a 'screen change', so
we're still having issues with the stupid animation transition.
Let's see if this helps.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-10 09:00:41 -07:00
Adam Williamson
02b32196d0 Wait longer for begin_installation in anaconda_help
The root password spoke takes a long time to exit lately, it
seems.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-10 08:41:14 -07:00
Adam Williamson
a9f54e9a50 Try to avoid a race in GNOME check_desktop
We can match on apps_menu_button_active before the overview has
totally loaded in, and it seems the alt-f1 press can be dropped
in that case. Add a wait_still_screen to try and avoid that.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-05 11:22:25 -07:00
Adam Williamson
c13b19591c Update several anaconda needles for KDE using different icons
As of today's Rawhide, KDE seems to be using a different icon
theme for anaconda. Not sure if this is intentional or not, but
we need to cope with it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-05 11:17:11 -07:00
Adam Williamson
05c793179a Add a fingerprint login test (GNOME only) (#223)
This adds a test for fingerprint-based login, as requested by
@benzea in #223. We use the fprintd dummy device to let us
simulate scanning a fingerprint, and check various scenarios
recommended by @benzea.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-03 15:21:33 -07:00
Adam Williamson
2980f2f0ae Update kontact_provide_data needle
Color changed a bit.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-03 14:47:16 -07:00
Adam Williamson
eab06ad96f Specify click_point for Japanese needle from last commit
Now we have two areas, openQA wants to click in the wrong one.
Let's tell it which one to click in.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-03 14:36:59 -07:00
Adam Williamson
7eb4e29f73 Tweak Japanese input source needle to avoid false match
The main screen now also has identical "Japanese" (that's what it
says) text. To avoid false matching before the picker opens, add
another match area.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-03 10:46:37 -07:00
Adam Williamson
7d14da3746 Bring back the older Evince 'rotate' needle
Current Silverblue still has it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-29 12:10:31 -07:00
Adam Williamson
5b1d3517fe Open Documents folder on Silverblue
The open dialog on Silverblue (which is apparently not at all
the same thing as the open dialog on Workstation, though they
look the same) does not default to the Documents folder, so we
have to open it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-29 12:09:34 -07:00
Adam Williamson
5905546f6e Update Evince needles
These all failed to match first time the test was run in
production. I guess Lukas was working from an older release.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-29 11:46:32 -07:00
Adam Williamson
b8c58428b0 Don't check for git on CANNED
`rpm` doesn't work. I dunno off-hand how you'd install git on
ostree if it wasn't there, so let's just assume it will be.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-29 11:19:09 -07:00
Lukáš Růžička
6da1dbcdb9 Small fixes. 2021-07-28 09:15:44 +02:00
Lukáš Růžička
e0d9409c74 Create a test suite for Evince.
This PR fixes issue #188. It adds a test suite to test basic
functionality of Evince and brings the following features:

* test scripts for various Evince functions.
* needles to support the Evince test scripts
* new template variables `TESTPATH` and `POSTINSTALL_LOAD_ALL` (see
  below)
* new logic in `main.py` (see below)

The new variables and the new logic make it easier to create test
suites for post-installation tests. If TESTPATH is used, OpenQA
will take all tests mentioned in POSTINSTALL from that specified
TESTPATH. If both TESTPATH and POSTINSTALL_LOAD_ALL are used, then
OpenQA will run all tests it can find at the TESTPATH location.
If POSTINSTALL and POSTINSTALL_LOAD_ALL are set simultaneously,
then only POSTINSTALL will be taken into account and OpenQA will
only load tests mentioned there.
2021-07-28 08:58:23 +02:00
Adam Williamson
420205bd5e Update a desktop update test needle
Dunno if this is os-autoinst or what.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-23 15:36:18 -07:00
Adam Williamson
a75e040062 Update a few more needles for os-autoinst
Also move all kde_next needles to the same dir.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-22 13:15:17 -07:00
Adam Williamson
910fbf2c2f Also run Cloud tests on x86_64 UEFI, on Rawhide only
Cloud images are now BIOS/UEFI hybrid in Rawhide (but not F33
or F34), so we want to run the Cloud tests on UEFI as well, but
only on Rawhide.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-22 09:58:23 -07:00
Dan Čermák
4811ad3fae Replace check_shutdown with assert_shutdown
The power_off function in desktop_login was not really asserting/checking
whether the VM got turned off. However, os-autoinst supports checking whether
the VM is turned off via assert_shutdown. This is additionally much more useful
than using check_shutdown, which does nothing if the VM is still running.
2021-07-21 22:41:08 +00:00
Dan Čermák
5ed8e33b75
Specify branch to compare for diff-cover
diff-cover now compares by default against origin/main, but the main branch is
origin/master which makes the Zuul pipeline fail.
2021-07-21 11:02:03 +02:00
Adam Williamson
fa94d92433 OK, fine, we need one more kernel.org patch needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-20 16:53:06 -07:00
Paul Whalen
146071ca3c Add a timeout to rpm-ostree package removal.
Signed-off-by: Paul Whalen <pwhalen@fedoraproject.org>
2021-07-20 22:42:33 +00:00
Adam Williamson
04654f0d09 Add a few more updated needles missed in recent commit
Missed a few needles from the recent big commit of updates for
new os-autoinst behaviour.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-20 10:47:22 -07:00
Adam Williamson
df8d08db6f Update zezere needles for upstream/os-autoinst changes
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-19 15:59:07 -07:00
Adam Williamson
db19350db2 Update akonadi migration needle for newer KDE/os-autoinst
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-19 15:58:47 -07:00
Adam Williamson
2a7787c1da Update lots of needles for os-autoinst behaviour change
Recent git os-autoinst no longer downsamples screenshots as far
as it did before comparison. This makes a lot of needles where
colors have changed slightly no longer match, so they all needed
updating.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-19 13:03:11 -07:00
Adam Williamson
bc738149ec Try to robustify anaconda_help transition a bit
Wait for a change when clicking the done button in root password
screen (anaconda can pause for a long time there).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-19 12:22:04 -07:00
Adam Williamson
86c34ca063 Drop match level for kernel.org "patch" needles to 92
Again, to combat os-autoinst's new behaviour without adding yet
more needles. We're getting 96% match on stg.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-19 11:13:14 -07:00
Adam Williamson
d5ebaaa756 Drop match level to 90 for all background needles
Also delete ones for F32 and earlier. This should hopefully help
us not need to have too many needles for the newer stricter
matching.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-17 12:46:07 -07:00
Adam Williamson
2f4ef74def Avoid a needle duplication in KDE vault test
"show_hidden_icons" is the same thing as "desktop_expand_systray".

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-17 12:40:15 -07:00
Adam Williamson
0668357dd7 Fix os_release checks for name change to "Fedora Linux"
A couple of the checks here need updating now we're calling it
"Fedora Linux" not just "Fedora".

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-14 14:42:15 -07:00
Adam Williamson
1cf779fa20 Update Cockpit login needle for "Fedora Linux" change
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-14 14:11:52 -07:00
Adam Williamson
46c04c6a03 Update printing_check_sentence needle for a Pango change
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-14 14:11:35 -07:00
Paul Whalen
49987a5e41 Extend timeout for podman container test.
Signed-off-by: Paul Whalen <pwhalen@fedoraproject.org>
2021-07-13 17:44:34 +00:00
Adam Williamson
a7504441de Tighten match area to fix matching against trivial change
Latest Firefox has moved the underline down slightly for some
dumb reason. This tweaks the match area to only the text, so it
matches wherever the underline is.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-12 16:16:45 -07:00
Adam Williamson
088dc9d5ff Correct postinstall test name for install_blivet_resize_lvm
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-06 10:56:16 -07:00
Lukáš Růžička
6d1d549941 Introduce a resize check and a postinstall test for custom and blivet
tests.

This PR fixes #228.
2021-06-30 11:01:50 +02:00
Adam Williamson
bc611d6975 Tweak the desktop update loop again to try and be more robust
I've seen some failures caused by a sort of race where both
'apply' and 'refresh' needles match at the first assertion, but
openQA "prefers" the 'refresh' match. So we click the 'refresh'
button and *immediately* check_screen for apply, which is still
visible...but by the time we go to click it, it's gone because
the refresh found something new and now it's showing "Download".
This tweak should help, because if we can 'see' both refresh and
apply at the start, we'll just go ahead and click apply, we
won't refresh. The logic becomes a little more obscure, but I'm
not sure I see a fix for that. At least until KDE's tool finally
settles down for two releases in a row and we might be able to
simplify this whole thing.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-29 10:53:37 -07:00
Adam Williamson
4553a9e43b desktop_login: bit more generous timeout for check_desktop
It can take some time for first login of a user (especially in
KDE). Test has been failing lately on Rawhide because of this.
It seems until recently we never got a still screen when trying
to log in as Jim - so the effective wait for login to complete
was 60 seconds, 30 seconds for wait_still_screen to time out
then 30 seconds for the actual login needle assertion - but now
we are getting a blank screen for 5 seconds which satisfies
wait_still_screen almost immediately, so effective timeout for
the login process is only 35 seconds, which isn't long enough.
So let's bump the check_desktop timeout to 60 seconds.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-28 16:54:13 -07:00
Adam Williamson
e5229fd969 Run desktop upgrade tests on aarch64 (#220)
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-25 10:27:38 -07:00
Adam Williamson
a24da1ef63 Update Firefox addon_install needle for new release
Existing needle matched 95% on F33 and F34 tests of a new version.
Not suer what changed.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-25 10:26:29 -07:00
Adam Williamson
87454c5c98 Simplify KDE anaconda launch double click conditional
The kde-settings update went stable now, so we can just do 'if
KDE and relnum > 33'.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-23 10:50:56 -07:00
Adam Williamson
6807b54a64 Need to double click anaconda launcher with kde-settings 34.6
KDE has made it so you need to double-click icons on the desktop
now. Unfortunately this means a clunky conditional at least until
the update goes stable. When F33 is EOL we can reduce it to
just "if kde".

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-21 17:10:35 -07:00
Adam Williamson
6a79565afa Fix up KDE 'plasma-disks' test stuff
In #235 we accidentally included an entire disks.pm test that
wasn't meant to be there - the infocenter module test is the
right thing to exercise plasma-disks, there is no standalone
app, running 'disks' just gets you the KDE Partition Manager,
which we already test. So this removes that test and renames a
needle that looks like it's for that test but is actually for
the kinfocenter module, to make this clearer.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-21 15:16:40 -07:00
Adam Williamson
9174472637 Run podman tests on updates
It has been noted that updates have broken podman in the past and
this is a major issue for some users. Let's create a new update
flavor and run the test in it. We'll use the server image as a
base, but it's not really a server test, so I'm giving it its own
flavor so it's not run on updates that we only want to run server
tests on, and we can schedule just this test to run on container-y
updates.

As part of this, we need to install podman before running the
test; for flavors we currently run it on we expect podman to be
preinstalled, but that's not true for the server base image.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-21 12:20:09 -07:00
Adam Williamson
bdb107b472 Add check_help_on_pane back to anaconda.pm exports
It was inadvertently when rebasing a recent PR.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-21 12:18:31 -07:00
Lukáš Růžička
9f0103a95f Enhance the Infocenter test to test the presence of Disks module. 2021-06-18 11:39:28 -07:00
Lukáš Růžička
2c366cc7a4 Add startstop test for Plasma Vault. 2021-06-18 11:39:24 -07:00
Adam Williamson
cb3aa17b1a Note new test perl library requirements in README
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-18 09:48:24 -07:00