1
0
mirror of https://pagure.io/fedora-qa/os-autoinst-distri-fedora.git synced 2024-12-22 18:33:07 +00:00
Commit Graph

854 Commits

Author SHA1 Message Date
Adam Williamson
f86cbd93fb desktop_printing: be a bit more defensive when launching editor
Seeing a failure quite often lately where when we try and hit
ctrl-p to print, we just type a p. There's no wait between
maximizing and trying to print, and only a short wait on
launch, so let's try being a bit more defensive there.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-04-21 08:18:56 -07:00
Adam Williamson
45a1a3a36b Wait *longer* to reach hub after setting root password
This can actually take a bit of time, it seems, especially with
debug kernels. Let's give it a minute.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-24 09:01:22 -07:00
Adam Williamson
e9261b8f29 Wait till we reach hub after setting root password
Lately anaconda can take up to 10 seconds to exit the root pw
spoke, which can defeat the subsequent `wait_still_screen` that's
meant to wait out the 'slide-in-from-the-top' animation of the
hub. So let's assert the hub after we click Done, then the still
screen wait will only happen *once the hub is visible* and should
really do its job.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-22 08:27:56 -07:00
Adam Williamson
06c66dcd30 desktop_update_graphical: explicitly check refresh on GNOME
OK, this is annoying. GNOME Software intentionally does *not*
clear the 'download' or 'reboot and update' button when you hit
the refresh button, it just leaves them sitting there while the
refresh happens. So let's specifically require the 'refreshing'
text to appear and go away before we try and click on download
or apply.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-18 13:51:33 -07:00
Adam Williamson
4dab8520b0 Bump the wait after hitting the Refresh button
Agh, GNOME's UI is *not* helpful here at all. The Apply button
remains visible for a long time after you hit Refresh.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-18 11:24:07 -07:00
Adam Williamson
b17fd9c3fe desktop_update_graphical: always refresh
This is yet another twiddle to that same damn bit where we try
to apply updates. This more or less reverts the last tweak to
it, where we skipped hitting 'refresh' if 'download' or 'apply'
are already visible. The trouble with that is that the app may
have already found and prepared updates before we got our
"prepared" python3-kickstart update in place - so the update
operation might work perfectly, but not update the package we
expect it to update, and the test may fail.

This time, let's try *always* refreshing, then wait a bit after
hitting the refresh button before we start looking for apply
or download to try and avoid the 'race' we were trying to solve
with the last tweak (where we hit refresh then immediately try
to hit a download or apply button which vanishes before we can
hit it). I think this should be safe as both KDE and GNOME
should always show a refresh button now (this wasn't the case
before, I think, F34).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-18 11:15:10 -07:00
Adam Williamson
7d62f3b48e evince: handle wrong filename in save_as as soft failure
There's a bug in the Save As... dialog on the flatpak version
of evince currently where the existing filename is not pre-
selected, so when the test types 'alternative', it gets
prepended to the existing filename instead of overwriting it,
and we wind up with alternativeevince.pdf, not alternative.pdf.
Let's treat this as a soft failure rather than a hard failure.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-18 10:58:36 -07:00
Adam Williamson
ced946dba9 gnome-text-editor: uninstall gedit on upgrade tests
On upgraded systems, gedit might still be present; remove it so
we don't launch it by accident and try to test it instead.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-16 12:31:08 -07:00
Adam Williamson
e05a7629a3 Handle Firefox 97+ not prompting what to do about downloads
Firefox 97+ don't ask you what to do with downloads any more,
they just...download them. For now we'll handle both workflows,
once 97+ is stable everywhere we can drop handling the old one.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-10 16:29:31 -08:00
Adam Williamson
bace4170f4 Wait longer before exiting _podman_client
At the end of _podman_client we create a mutex that we want the
server to pick up. If we exit too soon, the mutex goes away and
the server test fails. 5 seconds turns out to be not enough of a
wait because, although the server retries the lock call every
5 seconds, it can hit `api_call_2 failed` and wait 10 seconds
before retrying. Let's wait 30 seconds just to be safe.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-08 14:25:40 -08:00
Adam Williamson
9be26becc5 desktop_login: disable automatic updating
Otherwise, if there's an update to fXX-backgrounds pending, we'll
get it on reboot in the middle of the test, and the real
backgrounds will comes back and replace our black fake ones and
break the test.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-07 16:38:30 -08:00
Adam Williamson
5065202fcc gnome-text-editor: add old skins logic for Silverblue
Silverblue still has an old version of g-t-e where this theming
stuff worked differently, so put that stuff back for Silverblue
but keep the new stuff for RPMs.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-07 14:24:31 -08:00
Adam Williamson
45514ae985 Don't look for System tab on gnome-text-editor on Silverblue
Silverblue has an older version of g-t-e which does not have this
tab.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-07 13:40:30 -08:00
Adam Williamson
f4fbbe65e3 Typing 'gnome-text-editor' on Silverblue doesn't find the app
So just type 'text-editor'. If you have both gedit and gte
installed this will find both, but that should never be the case
so it should be OK.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-04 18:39:08 -08:00
Adam Williamson
6544850829 Update a needle and fix launching keyboard settings on Japanese
To get to the keyboard/input method settings and add an input
method when doing a Japanese install test, we type 'keyboard',
but in current GNOME 42.beta that doesn't find the right pane.
Typing 'input' does work, though, so let's use that instead.
Also the GDM login needle needed updating.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-04 17:20:18 -08:00
Lukáš Růžička
a67398acf5 Change module version as the old one does not exist any more. 2022-03-04 12:48:52 +01:00
Adam Williamson
1084aa0828 Update KDE vault needles and test
The backend is now cryfs in F36/Rawhide. I don't think we need
to be policing which backend Vault decides to use, so let's just
accept either.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-03 08:42:45 -08:00
Adam Williamson
7ecba92fb5 Drop similarity_level on some desktop_login wait_still_screens
Again, there's a blinking cursor in play here. 47 is too high.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-01 20:23:53 -08:00
Adam Williamson
1aee5d1ec0 Avoid duplication between desktop_update and 'software' app test
The 'software' test module in GNOME apps_startstop does a subset
of what the desktop_update_graphical test does already, but
using its own needles. Let's just have it use the same needles.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-01 15:58:45 -08:00
Adam Williamson
8fab101745 Use lower similarity_level for some terminal wait_still_screens
We can't use the default similarity_level for wait_still_screen
when there's a flashing cursor - flashing cursor will always
cause the similarity level to be too low and the wait will just
time out at 30 seconds. Cut it to 42.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-01 10:31:06 -08:00
Adam Williamson
752a9476be Drop KDE app 'netcon' test
This was originally a test of nm-connection-editor. However,
at some point that app stopped shipping a .desktop file by
default (it's in a subpackage that is not included in a default
KDE install) and the needle got updated to match on what the
same string now launched, which is a random part of the KDE
system settings. But there's no real sense in this - we don't
test launching every other pane of the system settings app from
the launcher, so it doesn't make sense to just test one random
one like this. Let's just throw the test out.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-25 12:37:53 -08:00
Adam Williamson
fcac2af4f8 Update and rationalize KDE app "cancel" needles
We have three different needles which all match on a stock KDE
"cancel" button. Let's just have one. Also, update it for latest
Rawhide/F36 KDE.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-25 12:22:47 -08:00
Adam Williamson
2d67e0b140 desktop_printing: do the file find from a VT
script_output has no arg to make it type slowly, and I'm seeing
that the test often fails trying to do full-speed script_output
at a desktop terminal. Let's do this part from a VT.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-24 08:24:36 -08:00
Adam Williamson
9243fa88fc Avoid duplication of "user creation" needle
The help test had its own needle for the user creation link,
but we already have an existing one. We should probably re-
arrange all the needles that are in 'install_process' now the
root and user creation spokes are moved to the main hub, but
that's a big change so I'll do it separately. This just removes
the duplicate needle and tweaks some match names.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-18 14:59:17 -08:00
Adam Williamson
5c011ab567 printing: always use ls to find PDF, update needles
When the printing_builtin test ran on an F35 respin compose it
failed; it turns out the target filename was different for the
built-in print-to-PDF on GNOME on F35. So let's just always
use the 'ls' output to find the file, but pick the directory
to check based on whether we're using cups or not.

Also rename the needles to have unique names, and add one for
F35 GNOME.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-16 17:21:36 -08:00
Lukáš Růžička
9a56adcfd0 Modify Desktop Printing test to use two different methods.
The PR introduces an improved logic to the desktop_printing.pm
that allows to use the USE_CUPS variable in templates to trigger
the installation of cups-pdf prior to the actual test.
The cups-pdf is then used as an alternative PDF printer
instead the built-in Save As PDF method.
2022-02-10 09:35:22 +01:00
Adam Williamson
4282048819 Drop screenshot app from GNOME app start/stop tests
It was removed from the default install:
https://pagure.io/fedora-comps/c/5371509
in favor of a new screenshot mechanism that's built in to GNOME
Shell.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-09 10:23:38 -08:00
Adam Williamson
29c5c01431 Revert "Fix the os_release.pm and fedora_release.pm."
This reverts commit 182bfdaa55. The
problem was not in the test code here, it's just that the tests
were run with RAWREL set to 36 when it should be 37; this is
because fedfind's data source hadn't been updated for 36 branch
when the tests ran. It's tricky to time this exactly right -
ideally we'd probably update fedfind's data source one second
before the first Branched compose completes, but of course that's
difficult in practice.
2022-02-09 09:59:45 -08:00
Lukáš Růžička
182bfdaa55 Fix the os_release.pm and fedora_release.pm.
It seems that the IoT fix was not limited to the IoT
subvariant only, which caused wierd behaviour when
the version was set to Rawhide when it should not be.
This fixes it.
2022-02-09 18:49:22 +01:00
Lukáš Růžička
185e2d51bb Prolong installation time to let tests finish gracefully. 2022-02-09 16:44:46 +01:00
Lukáš Růžička
7945a08271 Change the module profile to common. 2022-02-07 13:27:59 +01:00
Lukáš Růžička
42e9f713b2 Change test suite to fit with the latest known version.
The latest version of Gnome-Text-Editor bring a little
bit different UI and some new or modified features.
This commit fixes the suite to run on newest version.
2022-02-07 10:50:10 +01:00
Lukáš Růžička
ceaf711f76 Create a test suite for Gnome Text Editor 2022-01-29 00:49:10 +00:00
Lukáš Růžička
c4b3fe401e Replace serial device with a variable. 2022-01-28 20:57:36 +00:00
Lukáš Růžička
980ba5f411 Make changes to the Desktop Printing test. 2022-01-28 20:57:36 +00:00
Lukáš Růžička
83356ceec6 Use waiting commands to make the tests more defensive. 2022-01-25 13:36:57 +01:00
Lukáš Růžička
8a60991d0a Correct the command. 2022-01-25 10:55:08 +01:00
Lukáš Růžička
0ddf3e784c Add waiting and use icon to enter the menu for certain parts. 2022-01-25 10:35:23 +01:00
Lukáš Růžička
a720fd2c75 Change the way to enter the menu to make tests pass more easily. 2022-01-24 14:09:25 +01:00
Lukáš Růžička
d061a5683e Add still screen waiting to make it more reliable. 2022-01-24 12:22:41 +01:00
Adam Williamson
24e3ecb89f Drop gedit application tests
Workstation has replaced gedit with gnome-text-editor in Rawhide,
so this is no longer useful. We will replace it with a test suite
for gnome-text-editor.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-18 15:52:40 -08:00
Adam Williamson
3ae23f66a9 Update GNOME apps test for gedit->gnome-text-editor switch
Workstation replaced gedit with gnome-text-editor. This updates
the needles and also changes the name used for 'tagging' the
application for the core_applications test.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-18 15:11:50 -08:00
Adam Williamson
d5ca75cb04 Also remove system-config-language test from KDE app test
This was also dropped:
https://pagure.io/fedora-kickstarts/c/5b5fba2

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-12 17:26:37 -08:00
Adam Williamson
4e15e16824 Drop kcolorchooser and kruler from KDE apps test
Both were dropped from the default KDE install set:
https://pagure.io/fedora-comps/c/edd0d74
so we need to drop them here too.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-12 16:59:13 -08:00
Adam Williamson
b17b112800 _check_install_source: adapt to anaconda changing logs, again
anaconda changed the repository add code (again) and so the log
messages changed (again). We're now tracking three variations
from <F35, F35, and F36. Sigh.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-12 14:28:32 -08:00
Adam Williamson
74927d154a KDE apps: make firefox test handle no 'close tabs' case
Lately Firefox sometimes just closes immediately, it doesn't
show the 'close tabs' dialog. So let's make that optional, but
check we quit properly.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-24 10:24:54 -08:00
Lukáš Růžička
cda0d0b0d1 Create a test suite for EoG (Image Viewer) 2021-11-18 13:13:59 -08:00
Adam Williamson
2f0e75ed26 freeipa_webui: handle scrolling for add_user button
In https://openqa.fedoraproject.org/tests/1051360 Firefox showed
an "Open previous tabs?" bar which put this button just off the
bottom of the screen, so we need to scroll to it if that happens.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-04 10:49:17 -07:00
Adam Williamson
ab58692879 Remove Plymouth from Server install_default_upload (#1933378)
This is a workaround for
https://bugzilla.redhat.com/show_bug.cgi?id=1933378 . Sometimes
when booting Server on a tap test without a working network
config (no DHCP server, static network not yet configured) we
hit a bug where the splash screen does not clear completely, and
this causes all the console needle matches to fail. To work
around this, we remove plymouth from the installed system after
running the install_default_upload test on Server; all affected
tests use the image uploaded by that test. We exclude aarch64
because there's a known problem with removing plymouth on that
arch (#1940163), plus the bug doesn't actually seem to happen on
aarch64 for some reason.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-10-27 11:29:00 -07:00
Adam Williamson
c424d63ea8 _graphical_input: retry launch of keyboard if it fails
First attempt at this often fails for some reason - while we're
typing 'keyboard' the results come up as normal, but before we
hit enter, they all disappear and are replaced with "no results
found" (in Japanese). Dunno why. This will hopefully work around
that, if it works reliably on the second try.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-10-20 14:07:15 -07:00
Lukáš Růžička
c4da4e234d Add waiting to let the test settle a bit before checking the install progress. 2021-10-15 13:37:40 +02:00
Lukáš Růžička
e519786e91 Fix the rotation test by using a keyboard shortcut. 2021-10-15 12:01:46 +02:00
Adam Williamson
ec2a962163 Handle change to tabs required in Cockpit 255 "Join a domain"
In Cockpit 255 we need fewer tabs to navigate this screen. Handle
both cases.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-10-13 14:41:45 -07:00
Adam Williamson
de939c17df Update and rationalize KDE "next" needles
kgpg had its own, which doesn't make any sense. There are grey
and blue background variants that weren't consistently named.
This should rationalize things sensibly, and adds a new needle
for the new Plasma in Rawhide, with a lighter blue background.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-29 11:05:40 -07:00
Adam Williamson
27fe0710ec _graphical_input: add a wait at the start
We sometimes type 'keyboard' at the overview and get no results.
This might help something finish caching or whatever, let's see.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-28 13:02:14 -07:00
Adam Williamson
6b140fd4ad Allow twice as long for cockpit log refresh
After we change the log level in Cockpit, on aarch64, it seems
to take quite a long time to reload the messages. This allows
twice as long, with a soft failure if we get into the back half.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-23 08:59:00 -07:00
Adam Williamson
28d2242bb3 Revert "Add workaround for log filtering issue in cockpit 251"
This reverts commit 8992d37ce6.
The workaround is no longer needed as cockpit 252, which fixes
the bug, is stable for all current releases.
2021-09-23 08:59:00 -07:00
Adam Williamson
2ec41b1f43 Disable dnssec on FreeIPA server for upgrades (#1999321)
To work around #1999321, we'll disable dnssec validation on the
FreeIPA server when doing an upgrade to Fedora 35 or later.
This sucks but I can't find a better option.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-22 14:41:57 -07:00
Adam Williamson
53b2afb217 Drop memtest test for now
We dropped memtest from the images. We may replace it with
something better at some point, but until that day, let's drop
this test so it's not uselessly failing all the time.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-17 14:42:02 -07:00
Adam Williamson
05a43bdb3c Boxes: workaround #2005458 by hitting esc twice (with softfail)
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-17 14:33:09 -07:00
Adam Williamson
65cdc9609c De-dupe anaconda root password spoke needle
The anaconda help test had its own version, it doesn't need it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-15 16:26:05 -07:00
Adam Williamson
9882ddcaa5 Robustify and tweak switch out of overview on GNOME boot
This fails sometimes just because we're too early, or something.
Also with GNOME Shell 41rc, alt-f1 no longer works to open and
close the overview. super *does* seem to work in KDE these days,
so let's switch from alt-f1 to super everywhere.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-07 11:05:55 -07:00
Adam Williamson
5d0309b147 desktop_notifications: give login screen a bit longer to appear
Seen a few failures where it takes just longer than 30 seconds
for GDM to show up here, e.g.
https://openqa.fedoraproject.org/tests/968142

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-03 16:56:17 -07:00
Adam Williamson
5d6feb9808 Tweak Cockpit 'Join Domain...' click
Always do the page-down thing, having it conditional just makes
things more complicated unnecessarily. Try up to 5 times to
click the link, because Cockpit sometimes redraws itself before
us identifying it and clicking on it, e.g.:
https://openqa.fedoraproject.org/tests/968422

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-03 10:16:45 -07:00
Adam Williamson
a35befab8c Workaround a notification test issue on F35 KDE
Closing the last notification in the tray closes the entire tray
now, which seems odd. Cope with that by re-opening it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-02 11:10:16 -07:00
Adam Williamson
86a7f849e7 Fix root password screen handling in anaconda_help test
Code isn't shared with _do_install_and_reboot, maybe we should
fix that.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-02 11:04:17 -07:00
Adam Williamson
34a60ce789 Use stream 12 for postgres, not 13
Rawhide doesn't have a 13 stream, only a 12. F35 has both, so 12
should be safe.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-27 11:37:57 -07:00
Adam Williamson
dc82c90abd Handle redesigned root password screen in new anaconda
Really this just boils down to needing an extra click. We can
even just do the click in the old UI as well, it's not needed
but won't hurt anything and keeps the code simple.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-24 13:12:18 -07:00
Adam Williamson
e95515a740 Drop two now-unneeded workarounds in _set_root_password
The 'root spoke takes forever to load if debug enabled' bug was
fixed a while back, and we now always set root password before
the install process starts, so the race problem we had when
doing it at the same time as install was happening is no longer
an issue.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-24 13:00:23 -07:00
Adam Williamson
c9356ee196 Update _check_install_source for NFS addrepo on F35
We need the same alternate check method logic for NFS addrepo on
F35 now we're testing F35 updates. This is all getting a bit
messy and could maybe stand a refactor at some point...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-20 15:17:39 -07:00
Adam Williamson
8992d37ce6 Add workaround for log filtering issue in cockpit 251
See https://github.com/cockpit-project/cockpit/issues/16243 .
This is a fairly minor issue upstream knows about but will not
be fixed immediately, so we'll add a workaround for it for now.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-19 15:46:45 -07:00
Adam Williamson
803ae7ca57 Add a test of an additional repository using a metalink (#198)
As suggested by @kparal, this adds a test that specifies an
additional repository using a metalink. The repository contains
a single package, 'testpackage', that supplements glibc (so it
should always get installed). The test runs an install then
checks that testpackage got installed.

We also deduplicate a pair of needles which were matching on the
same anaconda UI feature (an "add" button) and use that same
needle in this test.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-18 14:03:27 -07:00
Dan Čermák
6cb0634edc
fix desktop_browser: FAS is deprecated, use accounts.fedoraproject.org
This also requires a new needle for accounts.fedoraproject.org, as the webpage
is completely different now. The old needle for browser_fas_home is obsolete via
this change and can be removed
2021-08-13 22:53:05 +02:00
Lukáš Růžička
b65f470eee Create basic functions tests for Gedit. 2021-08-12 15:37:37 +02:00
Adam Williamson
492fcf62e4 Great Needle Cleanup 2021
Remove a whole chunk of needles that haven't matched for more
than 3 months. Also move a few needles to appropriate locations,
simplify some code chunks that relied on removed needles (if
we're not matching the needles, we don't need those chunks any
more), and drop some other no-longer-needed conditionals for
older releases.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-10 11:57:48 -07:00
Adam Williamson
ba5a338e13 More tweaking the damn 'begin installation' bit
`click_lastmatch` wasn't safe there, if we caught the middlle of
the scroll animation. We have to assert again after waiting.
Also do the same in `_do_install_and_reboot` as the same can
happen.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-10 11:56:56 -07:00
Adam Williamson
07aa8cfb32 More tweaking of anaconda_help annoying part
Grr, with the screen changes and the animations...waiting for
screen to change when clicking a button doesn't work very well
as the button animation often counts as a 'screen change', so
we're still having issues with the stupid animation transition.
Let's see if this helps.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-10 09:00:41 -07:00
Adam Williamson
02b32196d0 Wait longer for begin_installation in anaconda_help
The root password spoke takes a long time to exit lately, it
seems.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-10 08:41:14 -07:00
Adam Williamson
05c793179a Add a fingerprint login test (GNOME only) (#223)
This adds a test for fingerprint-based login, as requested by
@benzea in #223. We use the fprintd dummy device to let us
simulate scanning a fingerprint, and check various scenarios
recommended by @benzea.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-03 15:21:33 -07:00
Adam Williamson
5b1d3517fe Open Documents folder on Silverblue
The open dialog on Silverblue (which is apparently not at all
the same thing as the open dialog on Workstation, though they
look the same) does not default to the Documents folder, so we
have to open it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-29 12:09:34 -07:00
Adam Williamson
b8c58428b0 Don't check for git on CANNED
`rpm` doesn't work. I dunno off-hand how you'd install git on
ostree if it wasn't there, so let's just assume it will be.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-29 11:19:09 -07:00
Lukáš Růžička
e0d9409c74 Create a test suite for Evince.
This PR fixes issue #188. It adds a test suite to test basic
functionality of Evince and brings the following features:

* test scripts for various Evince functions.
* needles to support the Evince test scripts
* new template variables `TESTPATH` and `POSTINSTALL_LOAD_ALL` (see
  below)
* new logic in `main.py` (see below)

The new variables and the new logic make it easier to create test
suites for post-installation tests. If TESTPATH is used, OpenQA
will take all tests mentioned in POSTINSTALL from that specified
TESTPATH. If both TESTPATH and POSTINSTALL_LOAD_ALL are used, then
OpenQA will run all tests it can find at the TESTPATH location.
If POSTINSTALL and POSTINSTALL_LOAD_ALL are set simultaneously,
then only POSTINSTALL will be taken into account and OpenQA will
only load tests mentioned there.
2021-07-28 08:58:23 +02:00
Dan Čermák
4811ad3fae Replace check_shutdown with assert_shutdown
The power_off function in desktop_login was not really asserting/checking
whether the VM got turned off. However, os-autoinst supports checking whether
the VM is turned off via assert_shutdown. This is additionally much more useful
than using check_shutdown, which does nothing if the VM is still running.
2021-07-21 22:41:08 +00:00
Paul Whalen
146071ca3c Add a timeout to rpm-ostree package removal.
Signed-off-by: Paul Whalen <pwhalen@fedoraproject.org>
2021-07-20 22:42:33 +00:00
Adam Williamson
bc738149ec Try to robustify anaconda_help transition a bit
Wait for a change when clicking the done button in root password
screen (anaconda can pause for a long time there).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-19 12:22:04 -07:00
Adam Williamson
2f4ef74def Avoid a needle duplication in KDE vault test
"show_hidden_icons" is the same thing as "desktop_expand_systray".

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-17 12:40:15 -07:00
Adam Williamson
0668357dd7 Fix os_release checks for name change to "Fedora Linux"
A couple of the checks here need updating now we're calling it
"Fedora Linux" not just "Fedora".

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-14 14:42:15 -07:00
Paul Whalen
49987a5e41 Extend timeout for podman container test.
Signed-off-by: Paul Whalen <pwhalen@fedoraproject.org>
2021-07-13 17:44:34 +00:00
Lukáš Růžička
6d1d549941 Introduce a resize check and a postinstall test for custom and blivet
tests.

This PR fixes #228.
2021-06-30 11:01:50 +02:00
Adam Williamson
bc611d6975 Tweak the desktop update loop again to try and be more robust
I've seen some failures caused by a sort of race where both
'apply' and 'refresh' needles match at the first assertion, but
openQA "prefers" the 'refresh' match. So we click the 'refresh'
button and *immediately* check_screen for apply, which is still
visible...but by the time we go to click it, it's gone because
the refresh found something new and now it's showing "Download".
This tweak should help, because if we can 'see' both refresh and
apply at the start, we'll just go ahead and click apply, we
won't refresh. The logic becomes a little more obscure, but I'm
not sure I see a fix for that. At least until KDE's tool finally
settles down for two releases in a row and we might be able to
simplify this whole thing.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-29 10:53:37 -07:00
Adam Williamson
4553a9e43b desktop_login: bit more generous timeout for check_desktop
It can take some time for first login of a user (especially in
KDE). Test has been failing lately on Rawhide because of this.
It seems until recently we never got a still screen when trying
to log in as Jim - so the effective wait for login to complete
was 60 seconds, 30 seconds for wait_still_screen to time out
then 30 seconds for the actual login needle assertion - but now
we are getting a blank screen for 5 seconds which satisfies
wait_still_screen almost immediately, so effective timeout for
the login process is only 35 seconds, which isn't long enough.
So let's bump the check_desktop timeout to 60 seconds.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-28 16:54:13 -07:00
Adam Williamson
87454c5c98 Simplify KDE anaconda launch double click conditional
The kde-settings update went stable now, so we can just do 'if
KDE and relnum > 33'.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-23 10:50:56 -07:00
Adam Williamson
6807b54a64 Need to double click anaconda launcher with kde-settings 34.6
KDE has made it so you need to double-click icons on the desktop
now. Unfortunately this means a clunky conditional at least until
the update goes stable. When F33 is EOL we can reduce it to
just "if kde".

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-21 17:10:35 -07:00
Adam Williamson
6a79565afa Fix up KDE 'plasma-disks' test stuff
In #235 we accidentally included an entire disks.pm test that
wasn't meant to be there - the infocenter module test is the
right thing to exercise plasma-disks, there is no standalone
app, running 'disks' just gets you the KDE Partition Manager,
which we already test. So this removes that test and renames a
needle that looks like it's for that test but is actually for
the kinfocenter module, to make this clearer.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-21 15:16:40 -07:00
Adam Williamson
9174472637 Run podman tests on updates
It has been noted that updates have broken podman in the past and
this is a major issue for some users. Let's create a new update
flavor and run the test in it. We'll use the server image as a
base, but it's not really a server test, so I'm giving it its own
flavor so it's not run on updates that we only want to run server
tests on, and we can schedule just this test to run on container-y
updates.

As part of this, we need to install podman before running the
test; for flavors we currently run it on we expect podman to be
preinstalled, but that's not true for the server base image.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-21 12:20:09 -07:00
Lukáš Růžička
9f0103a95f Enhance the Infocenter test to test the presence of Disks module. 2021-06-18 11:39:28 -07:00
Lukáš Růžička
2c366cc7a4 Add startstop test for Plasma Vault. 2021-06-18 11:39:24 -07:00
Lukáš Růžička
395ed61a1a Automate the Anaconda_Save_Traceback_to_Bugzilla_Text test case.
This PR adds a new test that automates the above mentioned test case.
It starts the installation in text mode using the `install_text` test
case, which it interrupts using the Anaconda crash trigger.
When the crash happens, it goes through the process of reporting
the bug to Bugzilla, checks that Bugzilla sends a positive
confirmation of the action, but also performs some REST API
calls to do a proper check and then it closes the bug to clean up.
2021-06-17 16:28:29 -07:00
Lukáš Růžička
b87049217c Add testcase for Memtest. 2021-06-16 18:11:01 +00:00
Adam Williamson
526042b0a5 Manually add Japanese input source for install_asian_language
GNOME dropped the g-i-s new user mode in F34, so on a Japanese
install with user created in the installer, you don't get an
input source configured out of the box or on first boot. So
we'll just have to do it manually after booting, before we test
if it works.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-15 16:19:31 -07:00