1
0
mirror of https://pagure.io/fedora-qa/os-autoinst-distri-fedora.git synced 2024-12-21 01:43:09 +00:00
Commit Graph

1327 Commits

Author SHA1 Message Date
Adam Williamson
119229cce7 Add a needle cleanup script, enhance the needle check script
This adds a new script - cleanup-needles.py - to use for cleaning
up old needles. It has to be used in conjunction with a database
query; the comment at the top explains how to do that query and
export the needed information. It produces a git commit with
needles that haven't matched since a certain date (specified in
the sql query) removed, subject to a 'keeplist' of needles we
keep even if they seem to be old.

I also enhanced check-needles.py to check for cases where tests
seem to be trying to match a tag we have no needles for. This
was necessary to find cases where the cleanup script was too
aggressive (i.e. the things that wound up in the 'keeplist'),
but it also turned out to find quite a lot of cases where the
code really *was* looking for a needle that had gone in a
previous cleanup or that never existed; the commits before this
one clean up a lot of those cases.

The code to decide which string literals are needle tags is
pretty dumb and hacky and needs some manual cueing sometimes -
that's what the `# testtag` changes in this commit are for.
Making it smarter would probably require this script to get a
lot more complicated and either incorporate or become a
tokenizer, which I don't really want to do.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-04 09:57:15 -07:00
Adam Williamson
1effed1069 Drop unused branch and needle in desktop_login
We never hit this path without a system menu button any more,
due to changes in KDE over time. It hasn't been hit for two years.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-04 09:57:15 -07:00
Adam Williamson
3e6e80ca87 Drop a no-longer-reached branch and associated needle
Now both GNOME and KDE do offline updates on all supported
releases, we never see an 'update done' screen any more. This
branch is left over from when the KDE offline update branch was
still conditional on release number.

If we ever implement this test on a desktop that doesn't do
offline updates, we can put this back easily enough.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-04 09:57:15 -07:00
Adam Williamson
c7e0af6e8c Simplify blivet_btrfs_preserve_home, drop unneeded needles
There's no need to do all this 'check whether it's selected and
click it if not' stuff (for three different mount points). Just
always click it. If it's already selected, clicking it again
doesn't hurt (one of these stanzas even clicks it *even if it's
selected*!)

If we need to cover both cases, we just need two needles with
the same tag, we don't need separate code paths. In each case,
though, we actually haven't matched one of the needles for ages
(the most recent was part_boot_selected, but now we're using
GPT by default, we won't hit that any more as it'll be the BIOS
boot partition that's selected by default), so delete the needles
we aren't matching any more. If we *do* hit any case where we
need to handle the 'other' state, we can just add the alternative
needle with the same tag.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-04 09:57:15 -07:00
Adam Williamson
73e9c5c27e Drop a check for ext4 filesystem already selected
This has not been hit for a year (on stg; three years on prod).
I *think* it would only be hit if we ran the test on an Everything
image, but as the test is now specifically associated with the
Server install DVD, that doesn't seem likely to happen.

If we somehow *do* hit ext4 pre-selected again, this can still
be handled simply by adding an alternate
anaconda_blivet_part_fs_ext4 needle which matches on ext4 already
being selected; that avoids the need to keep an alternate code
path around.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-04 09:57:15 -07:00
Adam Williamson
b62d832c3a cockpit updates: drop the security branch, update 'ignore' needle
This branch is very fragile, because the test won't fail if we
miss the match on the security needle. So in practice, we are
never going to notice when the needle goes stale, and we'll just
wind up never triggering this branch and always going down the
other path. That's the current situation: the security_install
needle last matched more than a year ago at least. Let's just
admit the truth here and drop the branch entirely.

Also update the cockpit_updates_restart_ignore needle. This is
in a similar case - we don't really notice when it goes stale,
as the test completes, it just takes a bit longer - but since
this one is quite easy to find, let's just update it instead of
dropping it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-04 09:57:15 -07:00
Adam Williamson
9199f8a0f0 Drop gnome-contacts softfail for "Unnamed Person" problem
This was resolved upstream and we're no longer hitting this bug
in tests on F38, Rawhide or even F37 respins, so we should no
longer need this workaround.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-04 09:57:15 -07:00
Adam Williamson
7dece68ae6 Drop old branch of gnome-text-editor 'skins' test
This is never hit any more, everywhere we run this test is on
the newer code now.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-04 09:57:15 -07:00
Adam Williamson
1de9d7fa34 Drop click_unwanted_notifications (and associated needle)
It looks like neither of these has been a problem for some time.
The notification needle has not matched for a year. The akonadi
needle doesn't exist any more - it was cleaned up in the 2021
needle cleanup, meaning it hadn't matched for weeks in 2021. I
checked the last several months of KDE app start/stop tests and
don't see any case where there was a stray notification that we
missed. So I think we can just ditch this whole mechanism for
now; if we have problems with these notifications again in future
we can put it back.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-04 09:57:15 -07:00
Adam Williamson
51e7b28978 Correct 'grant_access' needle name in several tests
Several tests still had the old 'apps_run_access' name which we
changed some time ago, so these safety checks weren't working.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-04 09:57:15 -07:00
Adam Williamson
039f3c265e Drop a useless check_screen (needle missing)
This check_screen always fails, because the needle doesn't exist
and never has - the commit that added the check_screen didn't
add a matching needle. In every run of the test I've checked from
the last two months, the initially-selected filesystem is always
xfs anyway. Let's just drop the check_screen conditional and
always expect we have to set the correct filesystem.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-04 09:57:15 -07:00
Adam Williamson
5cab5ec565 Move most 'universal' tests to Server-dvd-iso
The 'universal' flavor has been kinda pointless for some time
now. It dates back to the earliest days of openQA, before Pungi
4 was a thing, when composes were very different; we only built
a boot.iso and some live images nightly for Rawhide, these
weren't even formally grouped as a 'compose' at all (fedfind had
to invent the concept). The TCs/RCs had DVD installer images
(not *Server* DVD, at the time, just a universal DVD installer).
We wanted to run some tests on the DVD image if it was available,
but we still wanted to run them for the nightlies, so we invented
a whole mechanism for that - this 'universal' flavor, with some
complicated logic in fedora_openqa which schedules universal on
the 'best available' image it can find in the compose.

All this is functionally obsolete now. All composes we test are
now run through Pungi (except the live respins, but they aren't
relevant here). In current config, the Server DVD is non-failable
on x86_64 and aarch64, which means it will *always be there* -
if it fails to build, the compose itself fails, so we won't test
it. It's failable for ppc64le, but we don't care that much about
ppc64le; I'm fine with these tests just not running if the Server
DVD happens to fail in a ppc64le compose.

As a cherry on top, some of the 'universal' tests aren't really
universal anyway, they fail if you run them on a netinst (off
the top of my head, all the NFS install tests are like this, as
we use the ISO to populate the NFS share on the server end).

So let's just move all the tests that actually need an installer
image to the Server-dvd-iso flavor. Left over in the 'universal'
flavor are upgrade tests, which don't need an ISO at all - they
boot from hard disk images and run an upgrade using repos. We
can change the scheduler logic to be more simple for these, and
just always schedule them, with no ISO attached. We could even
rename this flavor 'upgrade', but it might not be worth it.

One slight complication is that the split happened to be helping
us avoid too many tests in a single support_server cluster; we
have a cluster of five support_server tests on Server-dvd-iso
and five support_server tests on universal. I try to avoid the
clusters getting too big as you need as many worker instances on
at least one worker host as your largest cluster; if you don't
have that many, the cluster's tests simply never get scheduled.
Requiring folks to have at least ten worker instances on one
host to run these tests is a bit of a big ask. So, to handle
that, we create a support_server_2 and have the former universal
tests use that one instead, so we'll have two separate clusters
on Server-dvd-iso now.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-03 16:29:38 -07:00
Adam Williamson
e89ec3017a Update serial console handling for upstream changes
Upstream https://github.com/os-autoinst/openQA/pull/4973 requires
us to poke things here a bit. This only works with the newer
os-autoinst and openQA (there may be a way to conditionalize it
to work with both, but I can't be bothered figuring it out, let's
just update).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-02 12:24:26 -07:00
Adam Williamson
0f781bdaf2 Robustify the scrolling in the Help app test
This keeps failing on the accessibility section, and looking at
the screenshots I realized why. When you press 'down', GNOME
doesn't just 'snap' to the new view, it does a smooth downward
scroll. We're often matching *while it's scrolling*, so the
needle match is right at the bottom of the screen. But then the
animation continues, so when we get to the click action (even
though we use click_lastmatch it's not *instant* in openQA),
the thing we're trying to click (the "Accessibility" section
title) is a bit further up the screen, and the click 'misses'.

So, we need to wait out the scroll then re-assert and click.
This unfortunately will make the test take about 30 seconds
longer, but I don't see another way to do it. We could maybe
shave the wait_still_screen to one second...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-02 09:37:02 -07:00
Adam Williamson
7860f32b96 Give podman a bit longer to install
It's taking quite a while in Rawhide ATM, seemingly due to a
scriptlet in a dependency.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-04-22 16:35:22 -07:00
Adam Williamson
853ed17664 Handle app appearing before access request in gnome-panel test
Similar to the dedicated tests for these apps, the app can appear
for a split second before the access request, so we match on the
app and don't realize we need to click through the access
request. Handle this the same way we do in the dedicated tests.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-04-22 11:03:00 -07:00
Adam Williamson
da3f9df5b7 _check_install_source: more fixes for upstream changes
anaconda is really kicking log messages around lately.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-04-14 14:04:51 -07:00
Adam Williamson
8bc74fd5dc panel: also handle permission request for Clocks
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-04-14 13:54:37 -07:00
Adam Williamson
a678f783cb nautilus delete_file: correct name of second file
The second file that we delete and don't restore is called
evince.pdf these days.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-04-11 11:15:05 -07:00
Adam Williamson
0271642f61 Adjust _check_install_source for more changes in anaconda
Another message changed format a bit, and all the messages are
now showing up in syslog instead of packaging.log, so handle
all possibilities here. I had to split the first check into two
commands because I can't seem to make it work if I try and do it
all in one command with bracket groups :/

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-04-11 10:58:09 -07:00
Lukas Ruzicka
7291e3526e Create a test for Gnome Panel. 2023-04-06 15:50:43 -07:00
Adam Williamson
abf80ad384 tidy a recent change to characters test
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-04-06 12:58:48 -07:00
Adam Williamson
4fb87a077e Fix KDE media writer launch test
Typing 'mediawriter' doesn't work on Rawhide any more. 'media
writer' (with a space) works OK.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-04-06 11:23:57 -07:00
Adam Williamson
cb2f9ecee9 KDE doesn't show welcome tour on live any more, drop handling
We actually get a softfail because we're expecting it; now it's
been fixed not to show up, drop the code that expects it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-04-06 10:31:17 -07:00
Adam Williamson
85d28ce4ab characters: workaround text editor starting behind characters
We're constantly seeing this test fail on an odd problem where
text editor starts *behind* characters. To handle this, check
if we see text editor and if not, hit alt-tab.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-04-06 09:24:29 -07:00
Adam Williamson
d41ec1eb8a Calculator: drop the switch to basic mode
It always launches in basic mode anyway, and sometimes this key
press doesn't work right and leaves a stray 'b' in the entry
field, which messes things up when we get to the calculation
tests.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-04-04 09:14:14 -07:00
Adam Williamson
278b1e32b0 Make evince test handle (wrong save target on flatpak)
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-03-30 16:25:08 -07:00
Adam Williamson
7b2c9d3e45 live_build: temporarily drop a newly-added group in KDE kickstart
This group was only added to comps today, so it's not in the
comps in the rawhide repo yet (will be after next compose). The
Koji repo doesn't have normal comps so it's not there either.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-03-30 11:20:51 -07:00
Adam Williamson
594457dff0 Contacts test: wait before maximizing
Try and make sure maximize actually works - wait for still screen
after hitting Done and before trying to maximize.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-03-30 09:28:40 -07:00
Adam Williamson
637e9e4cfe Characters app copy/paste test: be more defensive
There's a failure mode we hit quite often where, when we run
the text editor after copying the character, it pops up *behind*
the character page. So let's close the page first. When we click
the 'Copy Character' button a notification that the character was
copied is briefly displayed and if we hit esc while it's visible
we dismiss *that* not the character page, so hit esc twice to be
safe. If we miss dismissing the notification, the 'extra' press
is safe, it doesn't quit the app.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-03-30 09:25:47 -07:00
Adam Williamson
6ae2e05484 Be a bit more defensive when setting admin pw in zezere server
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-03-29 15:45:17 -07:00
Adam Williamson
9251ac21fa Disable audit messages on ostree rebase tests on aarch64
Otherwise they tend to get into the output of the status command
and mess up the test.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-03-29 14:29:52 -07:00
Lukáš Růžička
0075780ac5 Create test suite for Fonts. 2023-03-28 15:58:16 -07:00
Adam Williamson
7603b38dec Update _check_install_source for a change to NFS handling
A change to how anaconda handles NFS repos changed the log
messages we get when we use one. We may need further changes for
using NFS as a base repo when this change hits Rawhide nightly.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-03-28 10:26:34 -07:00
Adam Williamson
a6e5700854 Unset 'last time notification shown' setting for KDE ()
It looks like the desktop_notifications postinstall test on KDE
on F38 is failing currently because the notification is being
shown during the install_default_upload test that precedes it,
so KDE decides not to show it again yet. So, unset the setting
that stores the timestamp of the last time the notification was
shown. This is similar to a thing we already do for GNOME above.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-03-27 17:35:22 -07:00
Adam Williamson
5c62a909c8 Weather: handle app UI showing briefly before the access prompt
Exactly the same as the change for Maps from a few days back,
for the same reason.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-03-24 11:42:19 -07:00
Adam Williamson
8b19c9b3df rpmostree_rebase: use --bypass-driver
This is needed to force the rebase on current CoreOS (because it
has zincati registered by default). It should be harmless in all
other cases.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-03-22 22:59:21 -07:00
Adam Williamson
5572a73f61 Use pandoc-common instead of python3-kickstart for package tests
Reasoning:

1. pandoc is not in critpath so will not itself be tested
2. pandoc is widely used and actively maintained
3. package is noarch
4. package has minimal deps

Hopefully this will work for everything. For some reason, the
"use python3-blivet for pykickstart tests" fails mysteriously
sometimes, see e.g.
https://openqa.stg.fedoraproject.org/tests/2672282

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-03-18 09:44:02 -07:00
Adam Williamson
38c3693684 Revert "Fix desktop_update_graphical tests for pykickstart updates"
This reverts commit 2e5fa93415.
Let's try using one non-critpath package for all these tests
instead.
2023-03-18 09:39:19 -07:00
Adam Williamson
bac28124a0 _ostree_build: use koji-rawhide.repo in lorax command
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-03-18 08:37:01 -07:00
Adam Williamson
96118b4b60 Maps: handle app UI showing briefly before the access prompt
See e.g. https://openqa.fedoraproject.org/tests/1829593
sometimes we see the app UI briefly before the access prompt
appears. Handle that case by waiting a few seconds and doing
the match again.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-03-17 09:19:35 -07:00
Adam Williamson
2e5fa93415 Fix desktop_update_graphical tests for pykickstart updates
Somehow, the dummy package being python3-kickstart causes the
graphical update tests (only) to fail for pykickstart updates
(that's the source package of python3-kickstart). The CLI and
Cockpit update tests are fine with this and pass.

To workaround this, use python3-blivet as the dummy package for
the graphical update tests when testing an update that contains
python3-kickstart. I've updated the test repo to contain both
dummy packages.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-03-14 14:14:25 -07:00
Lukas Ruzicka
0d4f3f4542 Fix a failing needle for Maps. 2023-03-13 13:39:22 +01:00
Adam Williamson
989bfd22db zezere: change secure cookie setting to 'no'
We don't use https in this test (no valid cert), so this has to
be 'no'.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-03-03 19:05:26 -08:00
Adam Williamson
750f26b43b graphical_input: also type hotkey on the *second* attempt
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-03-03 10:28:43 -08:00
Adam Williamson
282ecb6c32 Revert "zezere: tweak for web UI change"
This reverts commit 2fecb70468.
Sadly, clicking on the right menu entry...doesn't work. Let's
try going back to the old way, but add an 'enter' press once
the entry we want is selected.
2023-03-02 15:02:14 -08:00
Adam Williamson
2fecb70468 zezere: tweak for web UI change
The runrequest list is just a normal dropdown menu now, so we
can just click the thing we want.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-03-02 14:39:00 -08:00
Adam Williamson
20620236b3 Clean up minimal browser environment setup
Move the xauth disablement and the disabling of studies into
_setup_browser, instead of repeating it in a couple of other
places (but *not* doing it in the zezere test, where we should
be doing it). Drop some explicit package installs that should
no longer be needed as Firefox and/or X.org now depend on those
things. Install the current default fonts (Noto), not the old
ones (DejaVu).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-03-02 13:51:08 -08:00
Adam Williamson
0b2053b842 zezere: add expected 'secure_cookie' value to config file
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-03-02 12:53:33 -08:00
Adam Williamson
eadf23a516 Add an ugly workaround for FEDORA-2023-f6afa6f9e5 rebase issue
There's a weird issue with the rpmostree_rebase test for this
update:
https://bodhi.fedoraproject.org/updates/FEDORA-2023-f6afa6f9e5#comment-2919613
it doesn't reproduce locally (I can type fine after doing the
same things the test does up to the rollback) and I can't think
of any possible cause, and I don't want to hold the update up.
So we're just gonna work around it and hope this doesn't start
happening to all F38 update tests after this goes stable. If it
does, we'll have to do the workaround for all of them.

The workaround is just to rollback and reboot 'blindly', instead
of checking the rollback command works. The drawback is that if
the rollback command fails we'll wait 7.5 minutes before giving
up on it, and it'll be a bit less clear exactly what happened.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-03-02 10:16:52 -08:00
Adam Williamson
a984674e9b add an 'esc' to krfb startstop test to deal with a dialog
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-03-01 14:10:00 -08:00
Adam Williamson
6aa52fc3cb Drop similarity level on a wait_still_screen with a cursor
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-23 15:06:07 -08:00
Adam Williamson
8e68c385d3 Just *always* expect a welcome tour now
Plasma 5.27.1 is going all the way back to F36 (in
FEDORA-2023-d7dcc38129), so we'll have a welcome tour on both
desktops we actually test on, on all supported releases. So we
can just drop the desktop conditional entirely here now.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-23 09:41:46 -08:00
Adam Williamson
9a0ef37a25 Revert "Update live install tests: handle awkward install ordering"
This reverts commit 56936df7a5. It
was a lovely idea, but forgot that the 'matching update version'
check doesn't actually use the allpkgs.txt list...
2023-02-22 15:55:24 -08:00
Adam Williamson
56936df7a5 Update live install tests: handle awkward install ordering
There's this awkward path for the live image install tests on
updates. We run the 'are the correct versions of all the packages
installed' check on these tests to ensure the right versions
actually made it onto the live image. So we don't run
`dnf -y update` at the end of repo_setup_updates on that path,
because if we did that, even if the packages on the live image
were old, we'd update them there and hide the problem.

However, this causes a bit of an ordering issue, because in
order to set up the advisory repo, we need to install a few
packages. What if the update under test includes one of those
packages, or a dependency that wasn't already installed? In
that case, we wind up with the older stable version of the
package (because obviously we can't install the newer version
from the advisory repo *before we've set up the advisory repo*),
don't update it later, and so the 'correct version' check at
the end of the test fails. See:
https://openqa.fedoraproject.org/tests/1778707 for a case of
this happening with a python-cryptography update.

Up till now I was trying to handle this by just updating the
specific packages we install, but that doesn't account for
*dependencies* of them. I looked down the path of trying to
generate a list of all those dependencies and update all of
them but it looks a bit mad. So instead let's try this. On that
specific path, we'll generate the "all installed packages" list
*before* we run repo_setup, so it just doesn't include anything
that gets installed during repo_setup. The implementation is a
bit icky but not too horrible.

We *could* just *always* generate the all installed packages
list earlier, but then that would mean we *wouldn't* catch dep
issues in this kind of package on the other test paths, whereas
currently we do. I don't want to lose that.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-22 14:54:18 -08:00
Adam Williamson
66a899d797 Expect KDE welcome screen on F37 too
5.27.1 is going to F37, and adds it. In the short term this
will waste a minute and a half and cause soft fails on all other
F37 updates until the update that adds this goes stable, but
I don't really feel like working around this, let's just live
with it till the update goes stable.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-22 14:11:07 -08:00
Adam Williamson
822af3d025 graphical_input: try typing 'hotkey'
OK, neither 'input' nor 'keyboard' actually gives us the Keyboard
pane, they both give results for uninstalled apps from Software
:(. 'hotkey' (which is one of the keywords in the .desktop file)
does seem to work, for now at least, let's try that.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-22 13:57:33 -08:00
Adam Williamson
b1dfcfdd3d Contacts: handle menu changes in 44
Contacts now has two burger menus, which is awkward. We need
specific needles to identify each, we can't rely on the generic
needle any more as it won't always open the right menu. We also
need to still work with the old UI for the flatpak.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-22 12:38:02 -08:00
Adam Williamson
a99178732a desktop_notifications: handle KDE welcome screen on lives
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-21 18:28:28 -08:00
Adam Williamson
b9500536cc Make the changed handle_welcome_screen conditional clearer
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-21 18:22:59 -08:00
Adam Williamson
ddb3f44c57 Extend handle_welcome_screen to cover new KDE welcome tour
KDE has a welcome tour now, on F38 and Rawhide at least. Let's
"handle" it with extreme prejudice...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-21 18:16:13 -08:00
Adam Williamson
13d935eb85 graphical_input: go back to typing 'keyboard'
On GNOME 44, typing 'input' is now giving us the Software page
for PulseAudio Volume Control, for some reason. Let's try typing
'keyboard' again and hope that works again now...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-18 14:30:41 -08:00
Adam Williamson
5e2a91192f desktop_login: also give assert_shutdown longer
Can't really work a soft fail into this one.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-18 12:27:52 -08:00
Adam Williamson
3213bb9043 desktop_login: give logout longer, but soft fail
Logout seems to be taking a long time in Rawhide currently. Give
it longer to run, but soft fail. I'll add a bug link once I've
investigated and filed one.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-18 11:47:07 -08:00
Adam Williamson
5f8876691f Give _ostree_build lorax command a bit longer
It seems to be timing out a lot.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-16 20:36:14 -08:00
Adam Williamson
05f13a002d Revert "rpmostree_rebase: avoid rebasing Silverblue to 38 for now"
This reverts commit d0d37e6aca.
Turns out rebase still fails even with 37 as the target.
2023-02-16 20:36:03 -08:00
Adam Williamson
d0d37e6aca rpmostree_rebase: avoid rebasing Silverblue to 38 for now
It seems to be busted:
https://github.com/fedora-silverblue/issue-tracker/issues/420
so let's just have anything that would rebase to SB 38 rebase to
SB 37 instead for now.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-16 12:04:37 -08:00
Adam Williamson
0a9abca4a6 _ostree_build: drop a stray comment
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-16 11:52:32 -08:00
Adam Williamson
ca6ca2e490 Handle a persistent overlay warning on live boot ()
In today's F38 and Rawhide, changes to the persistent overlay
stuff result in a boot warning you have to spam through. Let's
handle this as a soft fail so we don't have floods of failed
tests till it's fixed.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-16 09:12:36 -08:00
Adam Williamson
4db301bba6 Use systemctl start not systemctl isolate in notifications test
Per https://github.com/systemd/systemd/issues/26364#issuecomment-1424900066
this resolves the problem with systemctl isolate not working on
current Rawhide.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-09 14:56:33 -08:00
Adam Williamson
f4b154253c desktop_login: don't hit esc on lock screen
Tested that this is not necessary on KDE or GNOME, and on current
KDE it actually seems to break stuff. It's better to just start
typing the password.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-07 11:43:16 -08:00
Adam Williamson
8bcabe25a8 Give some long-running package install operations a bit longer
These have timed out quite often recently.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-03 09:04:48 -08:00
Adam Williamson
a881d227fb apps_startstop: tweak print theme editor launch to avoid
Typing a partial binary name no longer seems to work. Typing the
full binary name works, but differently from before; seems best
to do a partial entry name search so we launch the actual entry,
not the executable directly.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-30 09:31:28 -08:00
Adam Williamson
f2e87cd128 desktop_browser: handle addon add button not always being visible
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-26 22:58:14 -08:00
Adam Williamson
0bda4ad073 rpmostree_overlay: try to cancel running operations
I've seen a few cases of this test failing because there was
some running operation when it tries to do `rpm-ostree install`.
I think this is GNOME Software checking for updates or something,
I've seen it on my own Silverblue install too. Let's just throw
some `rpm-ostree cancel`s at it and hope that helps.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-26 17:02:49 -08:00
Adam Williamson
f3c8b570d1 More fixes to anaconda additional repository flow
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-23 15:32:07 -08:00
Adam Williamson
f03743a01d Update anaconda additional repository flow
"Additional repositories" is now hidden behind a dropdown we
have to open first. This will make the test fail on anything
older than Fedora-Rawhide-20230121.n.0, but I don't think we
run this test anywhere that would be a problem.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-23 14:38:12 -08:00
Lukas Ruzicka
7ad809339f Add new test for Characters.
This PR adds a small test suite to test the Characters applications.
It displays several different groups of characters and then tries
to copy one of the characters and place it into a text editor.
2023-01-19 17:53:03 -08:00
Adam Williamson
a64cadb8fe Make the Software welcome->ignore change in apps_startstop too
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-11 09:16:31 -08:00
Adam Williamson
2a157bbd4e Fix up the Ignore button clicking
The dialog moves a bit.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-09 11:45:03 -08:00
Adam Williamson
2db1e57674 Check for 3rd-party popup instead of 'welcome' screen
GNOME Software no longer has a welcome screen in any current
Fedora (it was dropped between 35 and 36), but in Rawhide it now
has a popup that prompts you to enable third-party repos which
we need to get rid of, so just convert the welcome screen check
to handle that, and drop all the welcome screen needles.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-09 10:34:27 -08:00
Adam Williamson
8a36423314 remote_logging_server: sleep at the end
It seems ending the test right after we create the mutex can
cause the client not to catch it, sometimes. So let's sleep for
a few seconds after creating it to make sure it does.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-24 14:30:03 -08:00
Adam Williamson
1dfae9b44e ...and in the other file too.
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-24 13:42:16 -08:00
Adam Williamson
21d14ac93d remote_logging: ugh, need to include utils too
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-24 13:31:58 -08:00
Adam Williamson
0a4d86e7bf remote_logging tests: do repo_setup
These tests weren't doing it, I guess it's just an oversight;
this is probably why they often fail on slow repos.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-24 09:57:22 -08:00
Adam Williamson
fa3881e80e Revert "Use older grub for _support_server tftp to fix PXE ()"
This reverts commit 61d77ee108.
The bug looks to be fixed now, and the fix hit stable for F37,
so this should no longer be necessary.
2022-12-23 11:17:00 -08:00
Adam Williamson
2c1a0e8128 desktop_update_graphical: disable koji-rawhide on update tests
...or else we get stuff like
https://openqa.fedoraproject.org/tests/1649309#step/desktop_update_graphical/40

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-16 23:23:26 -08:00
Adam Williamson
6daf9c36a0 Make rpm-ostree tests generic, run on Silverblue and CoreOS
This makes the two rpm-ostree tests written for IoT - overlaying
and rebasing - work across all rpm-ostree-based flavors we
currently test (IoT, CoreOS and Silverblue) and runs them on
all those flavors.

This requires some other changes. For the Workstation ostree
installer update tests, we have install_default_update_ostree
upload a disk image and run these tests on that image. That means
install_default_update_ostree cannot use a scratch disk (as if
we boot it with two disks but only upload one, the subsequent
tests fail to boot, looking for the missing second disk), but its
specified disk size should be large enough for all updates.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-16 08:44:43 -08:00
Adam Williamson
3754ab3d8a Drop all handling of MODULAR
This was from years ago when we briefly did "modular composes".
That died and ain't coming back.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-15 11:10:40 -08:00
Adam Williamson
a566f01a79 _boot_to_anaconda: extend the sleep before bootloader re-check
What's supposed to happen here is the `do_bootloader` invocation
a few lines back boots to the installer, then here, we wait for
the install to complete and the system to reboot, and match the
bootloader again. However, on PXE installs, the bootloader screen
can hang around for quite a long time here, and if it does, we
can match it again before the installer starts up, and move on
too early. Hence the sleep.

It seems on current Rawhide 20 seconds isn't long enough - we're
still matching the installer bootloader after the sleep, see
e.g. https://openqa.stg.fedoraproject.org/tests/2431660#step/_boot_to_anaconda/3
This is causing the test to almost always fail (it'll only pass
if the install+reboot takes less than five minutes). Let's bump
it to 60 seconds and hope that's long enough.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-14 12:29:00 -08:00
Adam Williamson
2023172c24 Revert "Try and workaround IoT rebase problems with F37 read-only change"
This reverts commit 093da03139.
As the comment says, this should be safe now F37 is stable.
2022-12-13 14:34:34 -08:00
Adam Williamson
5b3e90e032 _software_selection: simplify a grep (F35 is EOL)
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-13 14:34:34 -08:00
Adam Williamson
0b8d1a58e0 desktop_printing: drop gedit, F35 is EOL
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-13 14:34:34 -08:00
Adam Williamson
5acd4ea80b Update notes about clicking root password screen in anaconda
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-13 14:34:34 -08:00
Adam Williamson
c6fe9743bd cockpit_autoupdate: update note on the 30s sleep workaround
Sadly, dropping this sleep caused the test to start failing
again at least on F36, so we still need it - update the note.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-13 14:34:05 -08:00
Adam Williamson
d28f520dbf os_release: drop a now-unneeded > 34 conditional
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-13 12:45:20 -08:00
Adam Williamson
079eecf23c Update notes about power menus in desktop_login
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-13 12:45:20 -08:00
Adam Williamson
a664c10817 _check_install_source: drop branches for EOL releases
Thankfully this all calmed down a bit so we can simplify it a
lot. Clean things up a bit at the same time; escaping nested
single quotes is a lot clearer than concatening blocks with
different quote marks.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-13 12:45:20 -08:00
Adam Williamson
ea8e1f950d Drop workaround
The bug seems to have gone away, at least I don't see that this
soft failure has been hit much for the last two months.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-13 12:45:20 -08:00
Adam Williamson
2226cea183 Update note as to why we use tty1 in desktop_notifications
It's been on 1 so long now I kinda don't want to change it to 3
or 4 or anything. That might break something. As long as it's not
causing any trouble let's just leave it on 1.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-13 12:45:20 -08:00
Adam Williamson
fecf4ea595 Simplify condition for disabling dnssec on FreeIPA upgrade test
We don't need the release number part any more, it's always
more than 34.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-13 12:45:20 -08:00
Adam Williamson
61d77ee108 Use older grub for _support_server tftp to fix PXE ()
PXE install on UEFI (incl. aarch64) is failing at present, this
seems to be due to a grub bug:
https://bugzilla.redhat.com/show_bug.cgi?id=2152763
we're really intending to test the client side here, not the
server end, so let's work around this problem on the server end
by installing a grub2 scratch build that's the package from just
before the bad change, but with the release and epoch bumped,
from a side repo.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-12 17:51:52 -08:00
Adam Williamson
ffbb618d03 Simplify _graphical_wait_login welcome screen logic
This turns out to be overcomplicated. We don't need the special
handling for updates any more, because a few months after we
implemented it, we had to make sure the affected update tests had
an empty START_AFTER_TEST anyway, or else openQA would refuse to
schedule them. So we can just rely on the START_AFTER_TEST
condition for those now. We also don't need the additional
INSTALL_NO_USER condition; the only case where it's actually used
is for install_arm_image_deployment_upload on Workstation, and
that test does not have START_AFTER_TEST set, so the other
condition catches it for welcome screen handling purposes. There
is no need to nest the IMAGE_DEPLOY conditional inside a check
for the desktop and the INSTALL_NO_USER var either; we don't
test any other desktop on ARM, and the IMAGE_DEPLOY var is only
set for that one install_arm_image_deployment_upload test.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-12 08:48:53 -08:00
Adam Williamson
f915297475 Use buildroot repo for Rawhide image builds also
We recently started using the buildroot repo for Rawhide update
tests, but weren't including it in the image build tests. This
should include it in all the image build tests.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-12 08:42:18 -08:00
Adam Williamson
f752b4c00a Don't snapshot after wait_login tests (usually)
We currently snapshot after every run of _console_wait_login or
_graphical_wait_login, which means we snapshot *twice* on most
update tests as those modules get run twice. However, we almost
never use those snapshots. Snapshotting takes quite some time,
and hits the disk pretty hard, so we should avoid it unless it
is really needed.

We only have a few modules that are not fatal (and so might use
the snapshots), and most of those don't run after one of these
tests, or run after a later module that's also a milestone. Best
I can tell, only two test suites really need to use a snapshot
from a login test: server_cockpit_updates and modularity_tests.
To handle these and potential future cases, we'll add a new
module that does nothing, but is marked 'milestone', so it will
take a snapshot, and load that test after the login test if the
var LOGIN_SNAPSHOT is set, and set that var for those two suites.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-08 09:59:23 -08:00
Adam Williamson
a13cd7a08a Add --squashfs-only to lorax args
We started using this in real composes a year or two back, so
openQA should do the same. It drops the nesting of an ext4 fs
image inside a squashfs image, just using a single squashfs
image instead. This results in smaller images - missing this
is why the images built by openQA were coming out larger than
the real ones.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-07 14:03:19 -08:00
Adam Williamson
4d3673f811 Simply abrt KDE stuff even more
...wait, this is what 'workaround' needles are for.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-07 11:30:08 -08:00
Adam Williamson
9c6d5459e6 Simplify the KDE abrt logic
This does the same, just cleaner.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-07 11:26:27 -08:00
Lukáš Růžička
179764d49c Fix tests for Maps.
* Scarborough provided quite a messy map that resulted
in frequent needle failure. Changing the location
for something better to make it more reliable.
* The zoom test could have failed with a low resolution
image. Adding some timeout to the needle give more
time to load the proper image.
2022-12-07 11:52:11 +01:00
Lukáš Růžička
0cb57e7511 Add timeout 30 secs to make less fragile.
The check_screen function checks for the existing tag
but it only waits 1 second by default. In this time,
Abrt will not even start so we need to prolong
the check_screen timeout to make sure the application
has started (or at least give it enough time to try).
2022-12-07 10:00:33 +01:00
Adam Williamson
98653847d3 Add missing single quotes
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-06 14:01:51 -08:00
Adam Williamson
7536b6ce10 ostree_build: tee and timestamp the rpm-ostree output
Instead of just redirecting it to a log file, let's tee it, so
simple errors can be read off a screenshot without bothering to
download the file. Also, let's timestamp it (via `ts` from
moreutils) so we can see which bits of it take a long time...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-06 13:38:57 -08:00
Lukas Ruzicka
1605706fb3 Set timeout to 60 on startstop needles. 2022-12-05 15:16:16 +01:00
Lukas Ruzicka
f29572ba76 Abrt should not fail on found issues but softfail on startup tests. 2022-12-05 14:30:03 +01:00
Lukas Ruzicka
7daa4b3dd0 Give more time to the needle to avoid failing on delayed start. 2022-12-05 14:03:48 +01:00
Adam Williamson
1ae7065961 ostree: use scratch disk as target for rpm-ostree compose
Seems like we might be running out of space on this step on F35.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-03 16:16:39 -08:00
Adam Williamson
c2fb8fa83b Use 'main' branch for ostree-parse-pungi.py checkout
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-03 12:29:23 -08:00
Adam Williamson
37412b95a8 ostree_build: bump timeout on ISO build
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-03 11:10:37 -08:00
Adam Williamson
03b6663339 Add tests to build a Silverblue installer image and install it
This is like the existing tests that build network install and
live images then install them, only for Silverblue. First we
build an ostree, using the standard configuration for the release
and subvariant but with the 'advisory' and 'workarounds' repos
included, so it will contain current stable packages plus the
packages from the update and any workarounds. Then we build an
ostree installer image with the ostree embedded, again including
advisory and workarounds repos in the installer build config so
packages from them will be included in the installer environment.
The image is uploaded, which completes the _ostree_build test.
Then an install_default_update_ostree test runs, which does a
standard install and boot from the installer image.

We do make a change that affects other tests, too. We now run
_advisory_post on live image install tests, as well as this new
ostree install image install test. It was skipped before because
of an exception that's really only needed for the netinst image
install test. In that test, packages from the update won't be
included in the installed system, so we can't run _advisory_post
on it. But for ostree and live image build/install tests, the
installed system *should* include packages from the update, so
we should check and make sure that it does.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-11-30 13:17:28 -08:00
Adam Williamson
137f2a2176 nautilus: check app started *before* trying to fullscreen it
Seems to make a lot more sense this way around.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-11-29 09:41:47 -08:00
Adam Williamson
9d8a35ed39 cockpit: don't try and get admin privs when re-logging in
There's one point in the tests where we may log into cockpit for
the second time in one run (it depends how a package update
process goes). When this happens, we don't get prompted again
for admin access, so we need to *not* expect that.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-11-25 11:24:52 -08:00
Lukas Ruzicka
d4717ff090 Create test suite for Maps. 2022-11-21 18:17:11 +00:00
Adam Williamson
3c13f02679 Revert "_advisory_update: stop the graphical desktop at the start"
This reverts commit 3208d15725 and
the two follow-ups. I'm hoping
https://bugzilla.redhat.com/show_bug.cgi?id=2133829 is now
resolved; this was intended to help with that (though I'm not
sure it ever really did), and so we can hopefully ditch it, which
simplifies this code.
2022-11-18 12:23:33 -08:00
Adam Williamson
82588f4a52 Revert GTK focus bug workarounds
This reverts the last few commits which worked around a focus bug
in GTK. This bug is now (I hope) fixed, so I'm dropping the
workarounds so the tests will confirm whether it's fixed.
2022-11-02 11:03:02 -07:00
Lukas Ruzicka
3e096234d9 Move cursor out of the way in the text field. 2022-11-02 08:42:14 +01:00
Lukas Ruzicka
8dfcbfee48 In Gnome-Text-Editor perform an extra click to move the focus inside the text area. 2022-11-01 18:03:29 +01:00
Lukas Ruzicka
c394603058 Make an extra click into the the list view to force correct focus. 2022-11-01 17:35:23 +01:00
Lukas Ruzicka
aa98b12c5c Make install times longer to prevent failures on slow VMs 2022-10-31 15:56:04 +01:00
Lukas Ruzicka
ef5969b600 Wait until screen to make sure the exit shortcut is not pressed when not ready. 2022-10-31 15:56:04 +01:00
Adam Williamson
69dc252da9 tidy lukas' change to the arabic fonts test
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-10-24 14:56:30 -07:00
Lukas Ruzicka
3105e88626 Softfail the check_default_fonts to prevent breaking the Install Arabic test. 2022-10-24 12:56:15 +02:00
Adam Williamson
734c75fb23 _advisory_update: add a wait_still_screen too...
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-10-21 09:04:32 -07:00
Adam Williamson
9c8fb47484 _advisory_update: ensure we're back on tty3
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-10-21 08:55:27 -07:00
Adam Williamson
3208d15725 _advisory_update: stop the graphical desktop at the start
We have a big problem with Rawhide KDE update tests getting OOM
killed during this phase. Stopping the desktop before we install
updates should save some RAM and help avoid this.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-10-20 18:10:23 -07:00
Lukáš Růžička
5ea921b17b Create tests for Gnome Contacts. 2022-10-18 14:22:52 -07:00
Adam Williamson
dd6b502b04 server_cockpit_basic: more defensive waiting
Boy this seems slow in Rawhide currently. This has the effect
of being more defensive around the services page load.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-10-14 10:20:15 +02:00
Adam Williamson
25ed1e236d weather: settle before snapshotting in aaa_setup
We've seen some failures of the weather test at the start of
weather_report, where the test expects to be at the hourly view,
and instead it seems to be at a sort of broken state:
https://openqa.fedoraproject.org/tests/1505080#step/weather_report/3
I'm guessing this may be because currently aaa_setup clicks the
city name then is immediately complete, so it will immediately
snapshot. I guess this can result in things being stuck in a kind
of intermediate state on snapshot restore. So, to try and avoid
this, let's assert that we reach the hourly view after clicking
the city name, then wait_still_screen for a few seconds to make
sure things are settled down, before we complete and snapshot.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-10-13 10:35:38 +02:00
Adam Williamson
20ef09d4f4 Protect against long load times in Cockpit
We seem to be hitting very long loads on the Services and Logs
pages of Cockpit in recent Rawhide testing especially. As I don't
have time to deeply debug this at the moment, let's just give it
longer (but make it a soft failure when it takes longer than
expected).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-10-12 10:21:34 +02:00
Lukas Ruzicka
5d3fc244eb Create the test for system monitor. 2022-10-10 15:14:21 +02:00
Adam Williamson
baedbd22aa Run tidy to fix some syntax errors that creeped in recently
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-10-10 15:04:06 +02:00
Lukas Ruzicka
5038dcaab0 Fix the logic in Kmail startstop test
Sometimes the windows are displayed in the reversed order, which
prevents the checks to find the needles and the test fail
even if it should pass. This change should address this case.
2022-10-06 09:51:16 +02:00
Adam Williamson
3a96ef8501 kmouth: also give the first run wizard longer to appear
It seems to consistently take a bit more than 30 seconds.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-09-29 13:17:29 -07:00
Adam Williamson
5592e2ac93 desktop_login: handle backgrounds in WebP format
...which we just started doing.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-09-28 08:41:45 -07:00
Adam Williamson
7675e99fcc Make internal state marker variables upper-case
We use variables to track test state across modules, sometimes.
As this is all internal to the test logic I didn't bother always
making these variables upper-case, but os-autoinst now treats
lower-case variables as a fatal error, so we have to change.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-09-27 23:18:42 -07:00
Lukas Ruzicka
ba0062e5be Create a test case for Archiver. 2022-09-22 08:59:07 +02:00
Adam Williamson
093da03139 Try and workaround IoT rebase problems with F37 read-only change
The change to read-only sysroot for IoT in F37 causes problems
with this rebase test. It's not supported to rebase from an RO
release (37 or 38) to a non-RO release (36). So we need to make
sure we don't try and do that. This uses some quick hack logic,
but it should be OK and sufficiently specific not to break
anything even if we forget to remove it in future.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-09-20 15:48:22 -07:00
Adam Williamson
2be9d203f3 Disable dnssec again for FreeIPA upgrade tests
It seems we still have trouble with this turned on :( About 60%
of tests fail with the client unable to resolve names.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-09-20 13:58:48 -07:00
Lukas Ruzicka
4c03c0d814 Fix the Silverblue failure on new_file test. 2022-09-20 17:25:54 +02:00
Adam Williamson
49dac8d872 Re-enable dnssec for all FreeIPA tests
The cluster of bugs for F37/Rawhide should all be resolved now,
and I'm hoping the old upgrade bug is no longer relevant.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-09-19 12:28:17 -07:00
Adam Williamson
2b79d59379 Disable updates-testing during upgrade_preinstall
This issue appeared when we started testing Rawhide updates, but
I only noticed it today. When testing Rawhide updates after
Branch point, the upgrade tests upgrade from Branched to Rawhide.
On Branched, updates-testing is enabled by default. We only
disable it when we reach `upgrade_run`, but by that point we've
already done a `dnf -y update` in `upgrade_preinstall` and
potentially installed other packages in steps between
`upgrade_preinstall` and `upgrade_run`. That can cause problems,
like today all FreeIPA upgrade tests on Rawhide are failing
because there's a newer freeipa in updates-testing for F37 than
is in the current Rawhide compose.

Solve this by disabling updates-testing before we do the update
in `upgrade_preinstall`. To avoid excessive code duplication,
factor out the repo disabling code.

We'll do this twice on upgrade tests now, but it shouldn't be a
problem.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-09-15 10:18:26 -07:00
Adam Williamson
9fd78aa99b g-t-e: only use the 'old' path for Silverblue < 37 now
Because Silverblue 37 has a newer g-t-e.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-09-08 15:07:49 -07:00
Adam Williamson
1d395ad262 Update some nautilus needles and a test for 43-rc changes
We need to do Restore from the context menu now, because the
special button bar thing went away:
https://gitlab.gnome.org/GNOME/nautilus/-/merge_requests/943

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-09-08 15:05:04 -07:00
Adam Williamson
5f6232a5a5 Workaround RHBZ#2120433 - try login again if it fails
Also stop re-doing get_var("DESKTOP") because that's dumb. This
should only, at worst, make things slower if unexpected things
happen - it shouldn't cause failures that wouldn't happen anyway.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-08-22 17:24:39 -07:00
Adam Williamson
ba6a2c508a Use type_very_safely through gnome-text-editor tests
This will make them slower, but lately type_safely is just not
reliable, particularly in the new_file test, it's constantly
typoing.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-08-22 14:27:50 -07:00
Adam Williamson
ed91ef94ff Drop systemd-oomd-defaults from Rawhide Workstation live ()
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-08-20 00:08:12 -04:00
Adam Williamson
aadcc428d6 Give live image build even longer and bump max job time
Rawhide live image builds are still taking an awful long time
and often failing. I will look more into why later, but for now,
let's bump the timeouts even more just to try and get through
the job backlog.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-08-19 15:35:24 -04:00
Adam Williamson
1971164c7e Bump some more timeouts in _live_build
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-08-19 15:23:36 -04:00
Adam Williamson
d4cd737c9f Disable dnssec validation for FreeIPA replica server too
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-08-19 00:18:00 -04:00
Adam Williamson
6717cf7a4a Give live image build a bit longer to run
It's timing out a lot on Rawhide.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-08-18 17:19:42 -04:00
Adam Williamson
dc318983f1 Disable dnssec on FreeIPA on Rawhide to avoid
I'd prefer not to have to do this, but having the tests fail on
every compose and Rawhide update test is just too distracting
to live with.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-08-18 14:29:44 -04:00
Adam Williamson
72c37efe46 Check correct destinations in nautilus/move_file_into
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-08-18 01:34:56 -04:00
Lukas Ruzicka
378d50eabd Fix the modularity tests by selecting existing modules. 2022-08-17 14:18:39 +02:00
Adam Williamson
f7a8550258 Create biosboot partitions in blivet tests
From anaconda-37.12.1, anaconda defaults to GPT for all BIOS
installs. So we need to create a BIOS boot partition when doing
a BIOS install. I think all other potential configs (x86_64
UEFI, aarch64 (UEFI), ppc64le (OFW)) are covered under the other
two paths, so just making this `else` should be OK.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-08-16 15:39:38 -04:00
Adam Williamson
58fbcf31f2 Tweak Clocks world clock test removal loop to be more robust
We need to move the mouse out of the way so we don't need two
needles for "X not highlighted" and "X highlighted", and give
the check_screen a few seconds to update for the cursor move.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-08-16 10:05:26 -04:00
Adam Williamson
8479cb979f Remove nautilus side panel test and associated needles
The show/hide side panel functionality was intentionally removed
in version 43-beta:

https://gitlab.gnome.org/GNOME/nautilus/-/issues/2427

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-08-16 08:53:42 -04:00
Lukas Ruzicka
e69ba53f51 Fix the Clocks test to work on Fedora 37. 2022-08-15 16:47:46 +02:00
Adam Williamson
228fdcf42b Update nautilus needles and star_file test for 43-beta
"Star" was removed from the file context menu, so we have to
star the file from the main view now.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-08-11 09:40:15 -07:00
Adam Williamson
e2e8fcadd4 Rationalize GNOME credit button handling
We had a ton of needles all covering something very similar
(press a "Credits" button in a GNOME app). There are about four
real variations: old-style regular face white-on-black (eog),
old-style regular face (nautilus and evince before recent
libadwaita ports), old-style bold face (GTE and Clocks before
new libadwaita), and new-style (everything that's been ported
to use libadwaita for its About page). Let's just rationalize
it down to those, using the same needle tag for all of them.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-08-08 18:24:57 -07:00
Lukáš Růžička
9e0ec721a6 Create a new test for Gnome Weather 2022-08-08 18:24:51 -07:00
Lukáš Růžička
c40a35ea62 Add a new test for Calculator. 2022-08-05 11:34:22 -07:00
Adam Williamson
fcbcaaf59a anaconda_help: don't include 'root' in the root password
anaconda now warns about this and it breaks things.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-08-05 11:28:24 -07:00
Adam Williamson
1a65993d36 Add a perltidy check and apply it to the entire codebase
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-07-28 14:38:38 -07:00
Adam Williamson
8ce8a7fe65 clocks/world: search for "Reykjav" not "Reykjavik"
The city is called Reykjavík (note the í). Previously our search
worked because the search function also looked in the name of the
timezone, and the *timezone* name is "Atlantic/Reykjavik" - i.e.
it's really Latin-ized in the name of the timezone. However,
upstream intentionally stopped including the timezone name in
search matches:
https://gitlab.gnome.org/GNOME/gnome-clocks/-/merge_requests/199
so that doesn't work any more. Just searching for "Reykjav"
should solve the problem.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-07-25 16:50:17 -07:00
Adam Williamson
b7dea9f80c gnome-text-editor: don't check 'System' tab in About
In 43-alpha it's gone, the replacement is Troubleshooting ->
Debugging Information. But it would be a pain to write two
forks in the code for handling both cases, and there's a ton
more stuff in the new-style About dialog that we're not
checking either. I don't think we really need to click on all
of it, and this bit of it isn't super important. So on the
whole I'd rather just keep things simple and drop this check.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-07-25 16:41:46 -07:00
Adam Williamson
9495cfb1ff Update nautilus tests and needles for 43~alpha
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-07-22 17:24:43 -07:00
Adam Williamson
84c6e18f14 Reduce duplication of nautilus Documents directory needles
We had three. We only need one, matching on the sidebar entry,
which should be always visible.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-07-22 17:17:59 -07:00
Adam Williamson
dcda535db0 gnome-text-editor: make sure to overwrite prefilled filename
the new_file test failed today because it seems g-t-e now pre-
fills a suggested filename, with extension, and pre-selects the
name part but not the extension part. So when we type 'list.md'
we wound up saving the file as 'list.md.md'. I think hitting
ctrl-a should fix this, and not break when run on older versions
of g-t-e if we ever do that.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-07-22 12:24:09 -07:00
Lukáš Růžička
621f6c13b5 Add wait time to let the application start properly. 2022-07-19 14:49:26 +02:00
Adam Williamson
2ee0377ece nautilus/move_file_into: fix whitespace errors
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-07-15 11:28:58 -07:00
Adam Williamson
f84792f819 nautilus/move_file_into: be more defensive
This is to try and fix some issues on aarch64.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-07-15 11:28:15 -07:00
Adam Williamson
ef76c76024 help.pm: wait longer for main screen to appear
Looks like it can take longer than 45s on aarch64.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-07-15 11:20:36 -07:00
Adam Williamson
f407ceaf0e help.pm: fix whitespace errors
Lots of use of tabs instead of spaces, spaces at ends of lines,
spaces on blank lines...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-07-15 11:20:09 -07:00
Adam Williamson
f67bcef9f7 g-t-e: extend sleep in one test, add in another
aarch64 looks like it often needs more time to settle after
restoring from snapshot before trying a key combo.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-07-15 11:15:52 -07:00
Lukáš Růžička
48ec73e814 Create a test suite for Nautilus. 2022-07-12 16:01:36 -07:00
Adam Williamson
14942f86e7 Some safety around Discover maximize in desktop_update_graphical
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-07-08 15:58:11 -07:00
Adam Williamson
788b7167b1 clocks: add missing needle, improve tag name
That last commit to 'fix' the Clocks tests when Silverblue needs
location access to be granted wasn't complete, I left the needle
out. D'oh. Take the chance to give it a better name too.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-07-07 14:28:59 -07:00
Adam Williamson
cf969061ce Wait for Discover to run before maximizing it
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-07-04 10:07:13 -07:00
Adam Williamson
be39c0e3a1 desktop_update_graphical: maximize Discover on launch
If there are too many categories, we don't see the Updates entry
on the left, and this has been breaking Rawhide and F36 tests.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-07-04 09:47:56 -07:00
Lukáš Růžička
1f8b56e068 Change the way to download test data.
This PR changes the way to download the test data into the VM.
Although it does not use a disk image as suggested in one
of the review, it does not clone the entire repository, but
a simple tar.gz file that holds the data which will be
distributed into the directory structure.

This way, the amount of data needed to be downloaded dropped
from approximately 50MB to below 2MB.

Also, the existing test suites were adapted to this situation.
2022-07-04 09:34:04 +02:00
Adam Williamson
f81dab6739 Clocks: handle auth, check we actually launched the app
Clocks' aaa_setup did not ever actually check the app launched
properly. It also doesn't handle granting permissions if
necessary, which the apps_startstop test for Clocks does do.

This makes the permission check in the apps_startstop test more
efficient, and adds it to the Clocks app aaa_setup test too.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-06-30 13:56:29 -07:00
Lukáš Růžička
7c1e686d14 Create tests for Help. 2022-06-29 23:06:37 +00:00
Adam Williamson
d5757b054c Fix assert_and_click call in realmd_join_cockpit
This was just doing something silly before, but with recent
os-autoinst having function signatures, it actually causes the
test to fail because '5' isn't a sane value for the argument
this was setting before. Fix it to set the timeout, as it was
trying to do all along.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-06-27 09:21:48 -07:00
Lukáš Růžička
6f00e3fe8a Create tests for Clocks. 2022-06-23 21:41:56 +00:00
Adam Williamson
b203f41f55 Give systemctl stop ipa.service longer due to RHBZ
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-06-22 17:51:04 -07:00
Lukáš Růžička
d09d9d8fe6 Fix the Rhythmbox crash when launched for the first time. 2022-06-15 15:53:20 +02:00
Adam Williamson
4971de39e9 Tweak quit_firefox to handle hang on exit on ppc64le ()
It seems when we quit Firefox back to a VT on ppc64le, the system
hangs. Not sure why, but we can deal with it by rebooting the
system and logging back in as root if it happens. Also take the
opportunity to clean up the flow of quit_firefox so we always
check that we get back to a console then wait 5 seconds for the
console to settle, so all the tests that call it can stop doing
that.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-06-06 18:35:52 -07:00
Adam Williamson
e1ed9960f3 Let _console_avc_crash wait a bit longer for console login
On Rawhide update tests we often don't seem to get to the login
prompt in 10 seconds, so tweak the code a bit to let us specify
a timeout in root_console, and use 30 seconds here.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-06-06 18:34:44 -07:00
Adam Williamson
e047a88ffc check_default_fonts: move reference files, use diff -u
Let's not have the reference files in one person's fedorapeople
space, in case that person leaves. Let's upload the text.txt
for checking (it's easier to be able to just read what's in it
than try and figure it out from the diff output), and let's use
diff -u because non-unified diff output is awful.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-06-02 14:36:33 -07:00
Adam Williamson
aa5a248237 Bump timeouts in _setup_browser a bit more
Slow on Rawhide updates.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-06-01 09:00:39 -07:00
Adam Williamson
e9a7e0eb6c Give dracut -f longer to run in _advisory_update
It seems slow on Rawhide updates ATM.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-06-01 08:56:27 -07:00
Adam Williamson
815c6b28e5 check_default_fonts: wait_still_screen after launching terminal
As we do in desktop_terminal. It's not always ready for input
when the window is visible.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-27 11:01:27 -07:00
Lukáš Růžička
1acef21fa5 Automate the i18n_default_fonts testcase for Japanese.
This is the automation of the optional testcase https://fedoraproject.org/wiki/QA:Testcase_i18n_default_fonts.
The test implementation runs the same commands as the mentioned test
case and checks the expected output. It is designed to run in the scope
of postinstall tests when the language is set to "japanese".
2022-05-26 09:54:38 +02:00
Adam Williamson
66bc59de1d Have desktop_browser run disable_firefox_studies
I'd prefer not to do this, but I don't see a better way to deal
with the stupid 'welcome' screens. I'm not maintaining needles
to click them away forever.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-24 23:51:59 -07:00
Adam Williamson
bd9e17dc85 Update FIXME note on workaround
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-17 16:04:28 -07:00
Adam Williamson
b24802d4e0 Update a FIXME note in VNC client test
Connections is now default, we just have to update the test to
use it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-16 16:33:40 -07:00
Adam Williamson
4d049f8f7d browser: drop download save screen handling
Firefox 97 is now stable on all releases, so we can forget about
handling browser_download_save and just assume download will
happen automatically.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-16 16:27:35 -07:00
Adam Williamson
428b022255 Drop new user g-i-s handling in _graphical_wait_login
New user g-i-s is gone since F34, and F33 is dead.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-16 16:15:52 -07:00
Adam Williamson
5beb87cc16 Drop another unnecessary release number condition
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-16 16:14:02 -07:00
Adam Williamson
a2df6d976b desktop_login: drop obsolete check for 'login failed' message
Up to F33 we could check that an error message was shown when we
tried to log in with the wrong password on GNOME, but since F34
it's transient and disappears too quick to reliably catch, so
we don't check it any more. Now F33 is EOL, drop the conditional.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-16 16:11:52 -07:00
Adam Williamson
77cadae5d4 Drop g-i-s disablement in desktop_login
The g-i-s new user mode was removed in F34, so we don't need to
do this any more (as the now-removed comment said).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-16 16:09:28 -07:00
Adam Williamson
375c7409af Drop another unnecessary release number condition
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-16 16:07:59 -07:00
Adam Williamson
381e3e3561 Drop a now-unnecessary release number conditional in a check
We're never testing a release lower than 34 again.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-16 16:05:15 -07:00
Adam Williamson
a22d3b28b6 Drop a pre-F34 path for launching update tool on KDE
Before F34 we had to launch the update tool from the systray.
This isn't the case any more, so we can throw all this code and
these needles away.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-16 16:04:33 -07:00
Adam Williamson
8c298851a4 Drop handling of 'transient' update notification in KDE
We seem to be solidly back to always getting a permanent update
notification in current F36/Rawhide, so we don't need this more
complex path any more. We also don't need these needles any more,
they haven't matched for months.
2022-05-16 15:53:22 -07:00
Adam Williamson
a57a3ec403 _check_install_source: handle change to addrepo logging in F37
Logging of additional repo setup changed recently in F37, we
need to handle the new message format here.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-09 16:34:44 -07:00
Adam Williamson
8ff6e3b78a desktop_printing: wait longer for terminal
2 seconds isn't enough to be sure it opened, which is causing
some weird failures in KDE Rawhide update tests.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-09 16:33:35 -07:00
Adam Williamson
bb3221a46c btrfs_preserve_home: a bit more time for partition delete confirm
aarch64 tests are failing here because anaconda's still thinking
about the delete confirmation, it seems.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-06 14:19:31 -07:00
Adam Williamson
a441a9d7a6 _live_build: give mock tool installation longer to run
It timed out in a Rawhide update test.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-06 14:08:04 -07:00
Adam Williamson
0ca13cc949 _installer_build: give lorax a bit longer to run
It timed out on some Rawhide update tests.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-06 14:05:41 -07:00
Adam Williamson
3df5d1fac8 Give _live_build a little longer to run
Seems it can take a bit longer on Rawhide sometimes.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-02 10:37:00 -07:00
Adam Williamson
12f423f5a8 Skip desktop background check for Rawhide update tests
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-04-26 16:12:55 -07:00
Adam Williamson
c41c55cefe Handle Rawhide updates in upgrade postinstall version check
When testing Rawhide updates we set VERSION to the Rawhide
release number, not "Rawhide". This post-upgrade version check
needs adjusting to handle that.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-04-26 16:08:57 -07:00
Adam Williamson
0ed87c1b66 Adjust live and installer build for Rawhide support
We need to tweak various things when building live and installer
images for Rawhide.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-04-26 16:08:42 -07:00
Adam Williamson
f86cbd93fb desktop_printing: be a bit more defensive when launching editor
Seeing a failure quite often lately where when we try and hit
ctrl-p to print, we just type a p. There's no wait between
maximizing and trying to print, and only a short wait on
launch, so let's try being a bit more defensive there.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-04-21 08:18:56 -07:00
Adam Williamson
45a1a3a36b Wait *longer* to reach hub after setting root password
This can actually take a bit of time, it seems, especially with
debug kernels. Let's give it a minute.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-24 09:01:22 -07:00
Adam Williamson
e9261b8f29 Wait till we reach hub after setting root password
Lately anaconda can take up to 10 seconds to exit the root pw
spoke, which can defeat the subsequent `wait_still_screen` that's
meant to wait out the 'slide-in-from-the-top' animation of the
hub. So let's assert the hub after we click Done, then the still
screen wait will only happen *once the hub is visible* and should
really do its job.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-22 08:27:56 -07:00
Adam Williamson
06c66dcd30 desktop_update_graphical: explicitly check refresh on GNOME
OK, this is annoying. GNOME Software intentionally does *not*
clear the 'download' or 'reboot and update' button when you hit
the refresh button, it just leaves them sitting there while the
refresh happens. So let's specifically require the 'refreshing'
text to appear and go away before we try and click on download
or apply.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-18 13:51:33 -07:00
Adam Williamson
4dab8520b0 Bump the wait after hitting the Refresh button
Agh, GNOME's UI is *not* helpful here at all. The Apply button
remains visible for a long time after you hit Refresh.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-18 11:24:07 -07:00
Adam Williamson
b17fd9c3fe desktop_update_graphical: always refresh
This is yet another twiddle to that same damn bit where we try
to apply updates. This more or less reverts the last tweak to
it, where we skipped hitting 'refresh' if 'download' or 'apply'
are already visible. The trouble with that is that the app may
have already found and prepared updates before we got our
"prepared" python3-kickstart update in place - so the update
operation might work perfectly, but not update the package we
expect it to update, and the test may fail.

This time, let's try *always* refreshing, then wait a bit after
hitting the refresh button before we start looking for apply
or download to try and avoid the 'race' we were trying to solve
with the last tweak (where we hit refresh then immediately try
to hit a download or apply button which vanishes before we can
hit it). I think this should be safe as both KDE and GNOME
should always show a refresh button now (this wasn't the case
before, I think, F34).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-18 11:15:10 -07:00
Adam Williamson
7d62f3b48e evince: handle wrong filename in save_as as soft failure
There's a bug in the Save As... dialog on the flatpak version
of evince currently where the existing filename is not pre-
selected, so when the test types 'alternative', it gets
prepended to the existing filename instead of overwriting it,
and we wind up with alternativeevince.pdf, not alternative.pdf.
Let's treat this as a soft failure rather than a hard failure.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-18 10:58:36 -07:00
Adam Williamson
ced946dba9 gnome-text-editor: uninstall gedit on upgrade tests
On upgraded systems, gedit might still be present; remove it so
we don't launch it by accident and try to test it instead.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-16 12:31:08 -07:00
Adam Williamson
e05a7629a3 Handle Firefox 97+ not prompting what to do about downloads
Firefox 97+ don't ask you what to do with downloads any more,
they just...download them. For now we'll handle both workflows,
once 97+ is stable everywhere we can drop handling the old one.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-10 16:29:31 -08:00
Adam Williamson
bace4170f4 Wait longer before exiting _podman_client
At the end of _podman_client we create a mutex that we want the
server to pick up. If we exit too soon, the mutex goes away and
the server test fails. 5 seconds turns out to be not enough of a
wait because, although the server retries the lock call every
5 seconds, it can hit `api_call_2 failed` and wait 10 seconds
before retrying. Let's wait 30 seconds just to be safe.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-08 14:25:40 -08:00
Adam Williamson
9be26becc5 desktop_login: disable automatic updating
Otherwise, if there's an update to fXX-backgrounds pending, we'll
get it on reboot in the middle of the test, and the real
backgrounds will comes back and replace our black fake ones and
break the test.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-07 16:38:30 -08:00
Adam Williamson
5065202fcc gnome-text-editor: add old skins logic for Silverblue
Silverblue still has an old version of g-t-e where this theming
stuff worked differently, so put that stuff back for Silverblue
but keep the new stuff for RPMs.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-07 14:24:31 -08:00
Adam Williamson
45514ae985 Don't look for System tab on gnome-text-editor on Silverblue
Silverblue has an older version of g-t-e which does not have this
tab.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-07 13:40:30 -08:00
Adam Williamson
f4fbbe65e3 Typing 'gnome-text-editor' on Silverblue doesn't find the app
So just type 'text-editor'. If you have both gedit and gte
installed this will find both, but that should never be the case
so it should be OK.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-04 18:39:08 -08:00
Adam Williamson
6544850829 Update a needle and fix launching keyboard settings on Japanese
To get to the keyboard/input method settings and add an input
method when doing a Japanese install test, we type 'keyboard',
but in current GNOME 42.beta that doesn't find the right pane.
Typing 'input' does work, though, so let's use that instead.
Also the GDM login needle needed updating.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-04 17:20:18 -08:00
Lukáš Růžička
a67398acf5 Change module version as the old one does not exist any more. 2022-03-04 12:48:52 +01:00
Adam Williamson
1084aa0828 Update KDE vault needles and test
The backend is now cryfs in F36/Rawhide. I don't think we need
to be policing which backend Vault decides to use, so let's just
accept either.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-03 08:42:45 -08:00
Adam Williamson
7ecba92fb5 Drop similarity_level on some desktop_login wait_still_screens
Again, there's a blinking cursor in play here. 47 is too high.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-01 20:23:53 -08:00
Adam Williamson
1aee5d1ec0 Avoid duplication between desktop_update and 'software' app test
The 'software' test module in GNOME apps_startstop does a subset
of what the desktop_update_graphical test does already, but
using its own needles. Let's just have it use the same needles.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-01 15:58:45 -08:00
Adam Williamson
8fab101745 Use lower similarity_level for some terminal wait_still_screens
We can't use the default similarity_level for wait_still_screen
when there's a flashing cursor - flashing cursor will always
cause the similarity level to be too low and the wait will just
time out at 30 seconds. Cut it to 42.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-01 10:31:06 -08:00
Adam Williamson
752a9476be Drop KDE app 'netcon' test
This was originally a test of nm-connection-editor. However,
at some point that app stopped shipping a .desktop file by
default (it's in a subpackage that is not included in a default
KDE install) and the needle got updated to match on what the
same string now launched, which is a random part of the KDE
system settings. But there's no real sense in this - we don't
test launching every other pane of the system settings app from
the launcher, so it doesn't make sense to just test one random
one like this. Let's just throw the test out.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-25 12:37:53 -08:00
Adam Williamson
fcac2af4f8 Update and rationalize KDE app "cancel" needles
We have three different needles which all match on a stock KDE
"cancel" button. Let's just have one. Also, update it for latest
Rawhide/F36 KDE.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-25 12:22:47 -08:00
Adam Williamson
2d67e0b140 desktop_printing: do the file find from a VT
script_output has no arg to make it type slowly, and I'm seeing
that the test often fails trying to do full-speed script_output
at a desktop terminal. Let's do this part from a VT.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-24 08:24:36 -08:00
Adam Williamson
9243fa88fc Avoid duplication of "user creation" needle
The help test had its own needle for the user creation link,
but we already have an existing one. We should probably re-
arrange all the needles that are in 'install_process' now the
root and user creation spokes are moved to the main hub, but
that's a big change so I'll do it separately. This just removes
the duplicate needle and tweaks some match names.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-18 14:59:17 -08:00
Adam Williamson
5c011ab567 printing: always use ls to find PDF, update needles
When the printing_builtin test ran on an F35 respin compose it
failed; it turns out the target filename was different for the
built-in print-to-PDF on GNOME on F35. So let's just always
use the 'ls' output to find the file, but pick the directory
to check based on whether we're using cups or not.

Also rename the needles to have unique names, and add one for
F35 GNOME.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-16 17:21:36 -08:00
Lukáš Růžička
9a56adcfd0 Modify Desktop Printing test to use two different methods.
The PR introduces an improved logic to the desktop_printing.pm
that allows to use the USE_CUPS variable in templates to trigger
the installation of cups-pdf prior to the actual test.
The cups-pdf is then used as an alternative PDF printer
instead the built-in Save As PDF method.
2022-02-10 09:35:22 +01:00
Adam Williamson
4282048819 Drop screenshot app from GNOME app start/stop tests
It was removed from the default install:
https://pagure.io/fedora-comps/c/5371509
in favor of a new screenshot mechanism that's built in to GNOME
Shell.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-09 10:23:38 -08:00
Adam Williamson
29c5c01431 Revert "Fix the os_release.pm and fedora_release.pm."
This reverts commit 182bfdaa55. The
problem was not in the test code here, it's just that the tests
were run with RAWREL set to 36 when it should be 37; this is
because fedfind's data source hadn't been updated for 36 branch
when the tests ran. It's tricky to time this exactly right -
ideally we'd probably update fedfind's data source one second
before the first Branched compose completes, but of course that's
difficult in practice.
2022-02-09 09:59:45 -08:00
Lukáš Růžička
182bfdaa55 Fix the os_release.pm and fedora_release.pm.
It seems that the IoT fix was not limited to the IoT
subvariant only, which caused wierd behaviour when
the version was set to Rawhide when it should not be.
This fixes it.
2022-02-09 18:49:22 +01:00
Lukáš Růžička
185e2d51bb Prolong installation time to let tests finish gracefully. 2022-02-09 16:44:46 +01:00
Lukáš Růžička
7945a08271 Change the module profile to common. 2022-02-07 13:27:59 +01:00
Lukáš Růžička
42e9f713b2 Change test suite to fit with the latest known version.
The latest version of Gnome-Text-Editor bring a little
bit different UI and some new or modified features.
This commit fixes the suite to run on newest version.
2022-02-07 10:50:10 +01:00
Lukáš Růžička
ceaf711f76 Create a test suite for Gnome Text Editor 2022-01-29 00:49:10 +00:00
Lukáš Růžička
c4b3fe401e Replace serial device with a variable. 2022-01-28 20:57:36 +00:00
Lukáš Růžička
980ba5f411 Make changes to the Desktop Printing test. 2022-01-28 20:57:36 +00:00
Lukáš Růžička
83356ceec6 Use waiting commands to make the tests more defensive. 2022-01-25 13:36:57 +01:00
Lukáš Růžička
8a60991d0a Correct the command. 2022-01-25 10:55:08 +01:00
Lukáš Růžička
0ddf3e784c Add waiting and use icon to enter the menu for certain parts. 2022-01-25 10:35:23 +01:00
Lukáš Růžička
a720fd2c75 Change the way to enter the menu to make tests pass more easily. 2022-01-24 14:09:25 +01:00
Lukáš Růžička
d061a5683e Add still screen waiting to make it more reliable. 2022-01-24 12:22:41 +01:00
Adam Williamson
24e3ecb89f Drop gedit application tests
Workstation has replaced gedit with gnome-text-editor in Rawhide,
so this is no longer useful. We will replace it with a test suite
for gnome-text-editor.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-18 15:52:40 -08:00
Adam Williamson
3ae23f66a9 Update GNOME apps test for gedit->gnome-text-editor switch
Workstation replaced gedit with gnome-text-editor. This updates
the needles and also changes the name used for 'tagging' the
application for the core_applications test.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-18 15:11:50 -08:00
Adam Williamson
d5ca75cb04 Also remove system-config-language test from KDE app test
This was also dropped:
https://pagure.io/fedora-kickstarts/c/5b5fba2

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-12 17:26:37 -08:00
Adam Williamson
4e15e16824 Drop kcolorchooser and kruler from KDE apps test
Both were dropped from the default KDE install set:
https://pagure.io/fedora-comps/c/edd0d74
so we need to drop them here too.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-12 16:59:13 -08:00
Adam Williamson
b17b112800 _check_install_source: adapt to anaconda changing logs, again
anaconda changed the repository add code (again) and so the log
messages changed (again). We're now tracking three variations
from <F35, F35, and F36. Sigh.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-12 14:28:32 -08:00
Adam Williamson
74927d154a KDE apps: make firefox test handle no 'close tabs' case
Lately Firefox sometimes just closes immediately, it doesn't
show the 'close tabs' dialog. So let's make that optional, but
check we quit properly.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-24 10:24:54 -08:00
Lukáš Růžička
cda0d0b0d1 Create a test suite for EoG (Image Viewer) 2021-11-18 13:13:59 -08:00
Adam Williamson
2f0e75ed26 freeipa_webui: handle scrolling for add_user button
In https://openqa.fedoraproject.org/tests/1051360 Firefox showed
an "Open previous tabs?" bar which put this button just off the
bottom of the screen, so we need to scroll to it if that happens.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-04 10:49:17 -07:00
Adam Williamson
ab58692879 Remove Plymouth from Server install_default_upload ()
This is a workaround for
https://bugzilla.redhat.com/show_bug.cgi?id=1933378 . Sometimes
when booting Server on a tap test without a working network
config (no DHCP server, static network not yet configured) we
hit a bug where the splash screen does not clear completely, and
this causes all the console needle matches to fail. To work
around this, we remove plymouth from the installed system after
running the install_default_upload test on Server; all affected
tests use the image uploaded by that test. We exclude aarch64
because there's a known problem with removing plymouth on that
arch (), plus the bug doesn't actually seem to happen on
aarch64 for some reason.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-10-27 11:29:00 -07:00
Adam Williamson
c424d63ea8 _graphical_input: retry launch of keyboard if it fails
First attempt at this often fails for some reason - while we're
typing 'keyboard' the results come up as normal, but before we
hit enter, they all disappear and are replaced with "no results
found" (in Japanese). Dunno why. This will hopefully work around
that, if it works reliably on the second try.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-10-20 14:07:15 -07:00
Lukáš Růžička
c4da4e234d Add waiting to let the test settle a bit before checking the install progress. 2021-10-15 13:37:40 +02:00
Lukáš Růžička
e519786e91 Fix the rotation test by using a keyboard shortcut. 2021-10-15 12:01:46 +02:00
Adam Williamson
ec2a962163 Handle change to tabs required in Cockpit 255 "Join a domain"
In Cockpit 255 we need fewer tabs to navigate this screen. Handle
both cases.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-10-13 14:41:45 -07:00
Adam Williamson
de939c17df Update and rationalize KDE "next" needles
kgpg had its own, which doesn't make any sense. There are grey
and blue background variants that weren't consistently named.
This should rationalize things sensibly, and adds a new needle
for the new Plasma in Rawhide, with a lighter blue background.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-29 11:05:40 -07:00
Adam Williamson
27fe0710ec _graphical_input: add a wait at the start
We sometimes type 'keyboard' at the overview and get no results.
This might help something finish caching or whatever, let's see.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-28 13:02:14 -07:00
Adam Williamson
6b140fd4ad Allow twice as long for cockpit log refresh
After we change the log level in Cockpit, on aarch64, it seems
to take quite a long time to reload the messages. This allows
twice as long, with a soft failure if we get into the back half.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-23 08:59:00 -07:00
Adam Williamson
28d2242bb3 Revert "Add workaround for log filtering issue in cockpit 251"
This reverts commit 8992d37ce6.
The workaround is no longer needed as cockpit 252, which fixes
the bug, is stable for all current releases.
2021-09-23 08:59:00 -07:00
Adam Williamson
2ec41b1f43 Disable dnssec on FreeIPA server for upgrades ()
To work around , we'll disable dnssec validation on the
FreeIPA server when doing an upgrade to Fedora 35 or later.
This sucks but I can't find a better option.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-22 14:41:57 -07:00
Adam Williamson
53b2afb217 Drop memtest test for now
We dropped memtest from the images. We may replace it with
something better at some point, but until that day, let's drop
this test so it's not uselessly failing all the time.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-17 14:42:02 -07:00
Adam Williamson
05a43bdb3c Boxes: workaround by hitting esc twice (with softfail)
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-17 14:33:09 -07:00
Adam Williamson
65cdc9609c De-dupe anaconda root password spoke needle
The anaconda help test had its own version, it doesn't need it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-15 16:26:05 -07:00
Adam Williamson
9882ddcaa5 Robustify and tweak switch out of overview on GNOME boot
This fails sometimes just because we're too early, or something.
Also with GNOME Shell 41rc, alt-f1 no longer works to open and
close the overview. super *does* seem to work in KDE these days,
so let's switch from alt-f1 to super everywhere.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-07 11:05:55 -07:00
Adam Williamson
5d0309b147 desktop_notifications: give login screen a bit longer to appear
Seen a few failures where it takes just longer than 30 seconds
for GDM to show up here, e.g.
https://openqa.fedoraproject.org/tests/968142

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-03 16:56:17 -07:00
Adam Williamson
5d6feb9808 Tweak Cockpit 'Join Domain...' click
Always do the page-down thing, having it conditional just makes
things more complicated unnecessarily. Try up to 5 times to
click the link, because Cockpit sometimes redraws itself before
us identifying it and clicking on it, e.g.:
https://openqa.fedoraproject.org/tests/968422

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-03 10:16:45 -07:00
Adam Williamson
a35befab8c Workaround a notification test issue on F35 KDE
Closing the last notification in the tray closes the entire tray
now, which seems odd. Cope with that by re-opening it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-02 11:10:16 -07:00
Adam Williamson
86a7f849e7 Fix root password screen handling in anaconda_help test
Code isn't shared with _do_install_and_reboot, maybe we should
fix that.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-02 11:04:17 -07:00
Adam Williamson
34a60ce789 Use stream 12 for postgres, not 13
Rawhide doesn't have a 13 stream, only a 12. F35 has both, so 12
should be safe.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-27 11:37:57 -07:00
Adam Williamson
dc82c90abd Handle redesigned root password screen in new anaconda
Really this just boils down to needing an extra click. We can
even just do the click in the old UI as well, it's not needed
but won't hurt anything and keeps the code simple.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-24 13:12:18 -07:00
Adam Williamson
e95515a740 Drop two now-unneeded workarounds in _set_root_password
The 'root spoke takes forever to load if debug enabled' bug was
fixed a while back, and we now always set root password before
the install process starts, so the race problem we had when
doing it at the same time as install was happening is no longer
an issue.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-24 13:00:23 -07:00
Adam Williamson
c9356ee196 Update _check_install_source for NFS addrepo on F35
We need the same alternate check method logic for NFS addrepo on
F35 now we're testing F35 updates. This is all getting a bit
messy and could maybe stand a refactor at some point...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-20 15:17:39 -07:00
Adam Williamson
8992d37ce6 Add workaround for log filtering issue in cockpit 251
See https://github.com/cockpit-project/cockpit/issues/16243 .
This is a fairly minor issue upstream knows about but will not
be fixed immediately, so we'll add a workaround for it for now.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-19 15:46:45 -07:00
Adam Williamson
803ae7ca57 Add a test of an additional repository using a metalink ()
As suggested by @kparal, this adds a test that specifies an
additional repository using a metalink. The repository contains
a single package, 'testpackage', that supplements glibc (so it
should always get installed). The test runs an install then
checks that testpackage got installed.

We also deduplicate a pair of needles which were matching on the
same anaconda UI feature (an "add" button) and use that same
needle in this test.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-18 14:03:27 -07:00
Dan Čermák
6cb0634edc
fix desktop_browser: FAS is deprecated, use accounts.fedoraproject.org
This also requires a new needle for accounts.fedoraproject.org, as the webpage
is completely different now. The old needle for browser_fas_home is obsolete via
this change and can be removed
2021-08-13 22:53:05 +02:00
Lukáš Růžička
b65f470eee Create basic functions tests for Gedit. 2021-08-12 15:37:37 +02:00
Adam Williamson
492fcf62e4 Great Needle Cleanup 2021
Remove a whole chunk of needles that haven't matched for more
than 3 months. Also move a few needles to appropriate locations,
simplify some code chunks that relied on removed needles (if
we're not matching the needles, we don't need those chunks any
more), and drop some other no-longer-needed conditionals for
older releases.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-10 11:57:48 -07:00
Adam Williamson
ba5a338e13 More tweaking the damn 'begin installation' bit
`click_lastmatch` wasn't safe there, if we caught the middlle of
the scroll animation. We have to assert again after waiting.
Also do the same in `_do_install_and_reboot` as the same can
happen.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-10 11:56:56 -07:00
Adam Williamson
07aa8cfb32 More tweaking of anaconda_help annoying part
Grr, with the screen changes and the animations...waiting for
screen to change when clicking a button doesn't work very well
as the button animation often counts as a 'screen change', so
we're still having issues with the stupid animation transition.
Let's see if this helps.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-10 09:00:41 -07:00
Adam Williamson
02b32196d0 Wait longer for begin_installation in anaconda_help
The root password spoke takes a long time to exit lately, it
seems.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-10 08:41:14 -07:00
Adam Williamson
05c793179a Add a fingerprint login test (GNOME only) ()
This adds a test for fingerprint-based login, as requested by
@benzea in . We use the fprintd dummy device to let us
simulate scanning a fingerprint, and check various scenarios
recommended by @benzea.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-03 15:21:33 -07:00
Adam Williamson
5b1d3517fe Open Documents folder on Silverblue
The open dialog on Silverblue (which is apparently not at all
the same thing as the open dialog on Workstation, though they
look the same) does not default to the Documents folder, so we
have to open it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-29 12:09:34 -07:00
Adam Williamson
b8c58428b0 Don't check for git on CANNED
`rpm` doesn't work. I dunno off-hand how you'd install git on
ostree if it wasn't there, so let's just assume it will be.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-29 11:19:09 -07:00
Lukáš Růžička
e0d9409c74 Create a test suite for Evince.
This PR fixes issue . It adds a test suite to test basic
functionality of Evince and brings the following features:

* test scripts for various Evince functions.
* needles to support the Evince test scripts
* new template variables `TESTPATH` and `POSTINSTALL_LOAD_ALL` (see
  below)
* new logic in `main.py` (see below)

The new variables and the new logic make it easier to create test
suites for post-installation tests. If TESTPATH is used, OpenQA
will take all tests mentioned in POSTINSTALL from that specified
TESTPATH. If both TESTPATH and POSTINSTALL_LOAD_ALL are used, then
OpenQA will run all tests it can find at the TESTPATH location.
If POSTINSTALL and POSTINSTALL_LOAD_ALL are set simultaneously,
then only POSTINSTALL will be taken into account and OpenQA will
only load tests mentioned there.
2021-07-28 08:58:23 +02:00
Dan Čermák
4811ad3fae Replace check_shutdown with assert_shutdown
The power_off function in desktop_login was not really asserting/checking
whether the VM got turned off. However, os-autoinst supports checking whether
the VM is turned off via assert_shutdown. This is additionally much more useful
than using check_shutdown, which does nothing if the VM is still running.
2021-07-21 22:41:08 +00:00
Paul Whalen
146071ca3c Add a timeout to rpm-ostree package removal.
Signed-off-by: Paul Whalen <pwhalen@fedoraproject.org>
2021-07-20 22:42:33 +00:00
Adam Williamson
bc738149ec Try to robustify anaconda_help transition a bit
Wait for a change when clicking the done button in root password
screen (anaconda can pause for a long time there).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-19 12:22:04 -07:00
Adam Williamson
2f4ef74def Avoid a needle duplication in KDE vault test
"show_hidden_icons" is the same thing as "desktop_expand_systray".

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-17 12:40:15 -07:00
Adam Williamson
0668357dd7 Fix os_release checks for name change to "Fedora Linux"
A couple of the checks here need updating now we're calling it
"Fedora Linux" not just "Fedora".

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-14 14:42:15 -07:00
Paul Whalen
49987a5e41 Extend timeout for podman container test.
Signed-off-by: Paul Whalen <pwhalen@fedoraproject.org>
2021-07-13 17:44:34 +00:00
Lukáš Růžička
6d1d549941 Introduce a resize check and a postinstall test for custom and blivet
tests.

This PR fixes .
2021-06-30 11:01:50 +02:00
Adam Williamson
bc611d6975 Tweak the desktop update loop again to try and be more robust
I've seen some failures caused by a sort of race where both
'apply' and 'refresh' needles match at the first assertion, but
openQA "prefers" the 'refresh' match. So we click the 'refresh'
button and *immediately* check_screen for apply, which is still
visible...but by the time we go to click it, it's gone because
the refresh found something new and now it's showing "Download".
This tweak should help, because if we can 'see' both refresh and
apply at the start, we'll just go ahead and click apply, we
won't refresh. The logic becomes a little more obscure, but I'm
not sure I see a fix for that. At least until KDE's tool finally
settles down for two releases in a row and we might be able to
simplify this whole thing.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-29 10:53:37 -07:00
Adam Williamson
4553a9e43b desktop_login: bit more generous timeout for check_desktop
It can take some time for first login of a user (especially in
KDE). Test has been failing lately on Rawhide because of this.
It seems until recently we never got a still screen when trying
to log in as Jim - so the effective wait for login to complete
was 60 seconds, 30 seconds for wait_still_screen to time out
then 30 seconds for the actual login needle assertion - but now
we are getting a blank screen for 5 seconds which satisfies
wait_still_screen almost immediately, so effective timeout for
the login process is only 35 seconds, which isn't long enough.
So let's bump the check_desktop timeout to 60 seconds.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-28 16:54:13 -07:00
Adam Williamson
87454c5c98 Simplify KDE anaconda launch double click conditional
The kde-settings update went stable now, so we can just do 'if
KDE and relnum > 33'.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-23 10:50:56 -07:00
Adam Williamson
6807b54a64 Need to double click anaconda launcher with kde-settings 34.6
KDE has made it so you need to double-click icons on the desktop
now. Unfortunately this means a clunky conditional at least until
the update goes stable. When F33 is EOL we can reduce it to
just "if kde".

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-21 17:10:35 -07:00
Adam Williamson
6a79565afa Fix up KDE 'plasma-disks' test stuff
In  we accidentally included an entire disks.pm test that
wasn't meant to be there - the infocenter module test is the
right thing to exercise plasma-disks, there is no standalone
app, running 'disks' just gets you the KDE Partition Manager,
which we already test. So this removes that test and renames a
needle that looks like it's for that test but is actually for
the kinfocenter module, to make this clearer.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-21 15:16:40 -07:00
Adam Williamson
9174472637 Run podman tests on updates
It has been noted that updates have broken podman in the past and
this is a major issue for some users. Let's create a new update
flavor and run the test in it. We'll use the server image as a
base, but it's not really a server test, so I'm giving it its own
flavor so it's not run on updates that we only want to run server
tests on, and we can schedule just this test to run on container-y
updates.

As part of this, we need to install podman before running the
test; for flavors we currently run it on we expect podman to be
preinstalled, but that's not true for the server base image.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-21 12:20:09 -07:00
Lukáš Růžička
9f0103a95f Enhance the Infocenter test to test the presence of Disks module. 2021-06-18 11:39:28 -07:00
Lukáš Růžička
2c366cc7a4 Add startstop test for Plasma Vault. 2021-06-18 11:39:24 -07:00
Lukáš Růžička
395ed61a1a Automate the Anaconda_Save_Traceback_to_Bugzilla_Text test case.
This PR adds a new test that automates the above mentioned test case.
It starts the installation in text mode using the `install_text` test
case, which it interrupts using the Anaconda crash trigger.
When the crash happens, it goes through the process of reporting
the bug to Bugzilla, checks that Bugzilla sends a positive
confirmation of the action, but also performs some REST API
calls to do a proper check and then it closes the bug to clean up.
2021-06-17 16:28:29 -07:00
Lukáš Růžička
b87049217c Add testcase for Memtest. 2021-06-16 18:11:01 +00:00
Adam Williamson
526042b0a5 Manually add Japanese input source for install_asian_language
GNOME dropped the g-i-s new user mode in F34, so on a Japanese
install with user created in the installer, you don't get an
input source configured out of the box or on first boot. So
we'll just have to do it manually after booting, before we test
if it works.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-15 16:19:31 -07:00
Adam Williamson
9d499eb5e1 Handle KDE having a permanent update notification again
Looks like the latest Rawhide got a permanent update notification
for KDE again. F34 is still around, though, so we can't just
revert to the old code, I don't think.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-15 13:56:00 -07:00
Adam Williamson
0b45cd4adc Try and clean up desktop update needles a bit
The 'desktop_pacakge_tool_update-kde-detected' needles and
'desktop_update_notification_systray-kde' needles are actually
matching on exactly the same thing, so drop the redundancy. We
need to have the desktop_package_tool_update tag on the older
(F33) version of this needle because on F33 we click on it to
launch the update tool in the desktop_update_graphical test; from
F34 onwards this is *not* what we want to do so the needle should
not have that tag to avoid throwing the test off. When F33 goes
EOL we can drop that tag from the needle and simplify the
destop_update_graphical test. Also add a needle for the Discover
app's 'update' icon when no updates are found.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-14 12:32:27 -07:00
Adam Williamson
5a9a65bb5b Remove juk and kget from KDE app tests
They were removed from comps in c4d9287.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-08 15:18:02 -07:00
Adam Williamson
3b4d0aa00b Revert "Prevent the Konqueror test from running on F32 and later."
This reverts commit 603ee871c1. We
are well past F32 at this point so it's not longer needed. Just
wipe the test entirely instead.
2021-06-08 15:17:25 -07:00
Adam Williamson
fcf96f73b7 Tweak Blivet LVM device type needles
There's some cheating/sloppiness going on here, with the same tag
and sometimes same needle being used to match "LVM2 Volume Group"
and "LVM2 Logical Volume". Today this caused us to pick the thin
pool entry instead in a test, so let's just clean this up and do
it right, with separate needles for matching each thing.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-07 18:16:46 -07:00
Adam Williamson
b231f87417 desktop_printing: adjust for cups-pdf output filename change
A recent cups-pdf build changed the default filename for files
output by cups-pdf. We need to have the test look for the
correct filename based on the cups-pdf version.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-04 13:51:24 -07:00
Adam Williamson
6c52a1c1dd Update Konsole runs needle, maximize Konsole in desktop_terminal
The needle match seems to have changed when bug  showed
up, but it's actually just a text rendering change in the window
title, it's not exactly caused by the tiny window. So not marking
as a workaround needle.

Maximizing the window makes the test work faster when we hit that
bug, as type_safely needs to be able to see the results of its
typing.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-02 11:07:49 -07:00
Adam Williamson
45381f33ff anaconda_help: change the check for root password creation
Seems silly to wait 120 seconds when we know what the criteria
are. GNOME installs, can't do this; others, we have to.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-05-31 16:17:09 -07:00
Adam Williamson
3364732110 anaconda_help: tweak nonlive needle handling, add waits, tabs
Some fixups for anaconda_help. Two runs of it failed today around
handoff from the root password screen to the install progress
screen; add a couple of wait_still_screens there to make it
safer. Drop the added nonlive needles, because they're too
permissive, causing problems for other tests (they're matching
before they should); instead we solve the problem of spokes being
highlighted by just pressing shift-tab a few times. And fix some
tabs to be spaces.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-05-31 16:17:06 -07:00
Adam Williamson
5d4cf014a2 Add a wait_still_screen to desktop_update_graphical for safety
Had some repeated failures where there's kind of a race between
Software doing some kind of auto-refresh and the test clicking
on stuff. This seems to help.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-05-28 15:04:37 -07:00
Lukáš Růžička
c6d443a20f Automate the QA:Testcase_Anaconda_help.
This PR automates the mentioned testcase to test that Help can be
displayed in Anaconda during the installation. It navigates through
the available Help screens and if it can see it, it finishes.

This test runs after `install_default_upload` to override the
installation defaults defined for all primary tests.

Delete a duplicated needle.

Reformat list extensions to make it nicer.

Get rid of wrong export and an empty line.

Delete empty line.

Use _boot_to_anaconda for booting and move subroutine accordingly.

Add variable to templates.fif.json

Delete trailing whitespace.

Fix calling the pretest.

Move help checking to another place.
2021-05-27 21:39:26 +00:00
Adam Williamson
f475156eff Fix cockpit version check
There's a 244.1. D'oh.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-05-27 08:56:58 -07:00
Adam Williamson
f38dc4cfe1 realmd_join_cockpit: only hit tab twice for Cockpit 245+
Since 232, there's been a bug where we need to hit tab three
times to get into the first field in the "Join domain" dialog.
In 245, it's down to two times, for some reason. So, handle
that.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-05-26 17:46:04 -07:00
Adam Williamson
c8004201ae Update check_install_source checks for anaconda changes
Since f33b50e, anaconda doesn't log "enabled repo:" any more. To
ensure the repo actually is enabled we need to check some other
lines. Good news is, we don't need the 'anaconda'|'' dodge any
more, so we can drop that.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-05-25 18:04:06 -07:00
Adam Williamson
4a11af9958 Revert "Wait a bit longer from software selection back to main hub"
This reverts commit 90cc65b2fa.
There does not seem to be such a long delay any more, so let's
drop the time.
2021-05-25 15:10:06 -07:00
Adam Williamson
f5377ad1d2 Tweak _vnc_client_connect to click things better
vinagre likes to make things move around and pop up in awkward
ways...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-05-07 09:47:35 -07:00
Adam Williamson
35660bb4ed Use Vinagre instead of Boxes as VNC client, prepare Connections
Boxes dropped VNC functionality. It's supposed to be replaced by
Connections, but we can't use that until it has fullscreen:
https://gitlab.gnome.org/GNOME/connections/-/issues/5
so use Vinagre for now. We do also prepare some needles for
Connections in anticipation of being able to use it later (since
I already did the work and don't want to waste it...)

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-05-06 16:28:49 -07:00
Adam Williamson
a4867ebe76 desktop_login: use esc not alt-f4 to dismiss menu on KDE
alt-f4 makes sense for an app (Terminal on GNOME) but not really
for closing the system menu (KDE). It seems like it worked till
a day or two back then broke, but I think just using Esc instead
rather than filing a bug is the best plan, I'm not sure I'd
*expect* alt-f4 to work for this.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-05-06 09:52:13 -07:00
Adam Williamson
c9609cf26d Drop bypass_1691487 function and usage (bug seems fixed)
Per https://bugzilla.redhat.com/show_bug.cgi?id=1691487#c14 it
seems like the bug here got fixed along the way and we probably
don't need this any more.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-05-06 09:02:52 -07:00
Adam Williamson
4691928c2f Enhance _software_selection environment check for anaconda change
anaconda changed how this log line looks (again); update the
check to handle old and new styles for now.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-05-06 09:00:28 -07:00
Tomas Popela
055662fe36 Mark qt as unwanted package 2021-05-04 15:34:14 +00:00
Adam Williamson
93628ed230 Tweak desktop_login test for GNOME after wrong password entry
It doesn't seem to return to the top level automatically any more,
though the message goes away after a short time, still.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-05-03 15:54:41 -07:00
Adam Williamson
2b02253ecb Fix modularity test to use Rawhide repo on Rawhide
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-05-03 13:55:43 -07:00
Lukáš Růžička
114610bf90 Rewrite Modularity tests to use Perl only.
The Modularity tests rely on an external script to test the modular
behaviour of DNF. There is a potentional risk that the connection
is be down and the script cannot be downloaded.

This enhancement uses a regular OpenQA perl test case script to only
invoke DNF commands and parse their output to test the same behaviour
that we have been testing already.

This enhancement picks a random module for each of the operations,
and thus tries to mimick reality a little bit more.
2021-05-03 19:13:09 +00:00
Adam Williamson
6c5507b174 Add an 'unwanted packages' test, run on Workstation for now ()
This adds a test that just fails if any one of a given list of
unwanted packages is installed. This was a request for the
Workstation edition from @catanzaro so I've just implemented it
for Workstation so far, but it's designed to be easily extended
to cover other subvariants too if we want.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-05-03 08:59:46 -07:00
Lukáš Růžička
477d918b64 Add testcase to test the Package_install_remove testcase. 2021-05-01 00:11:43 +02:00
Adam Williamson
b4f3e6ea5a Move install_blivet_resize_lvm, fix install_resize_lvm ()
This is the same thing we did for install_resize_lvm, to address
issue . We just didn't get around to doing it for the blivet
test yet. We also change the HDDSIZEGB for the parent test to
15GB so the resizing stuff actually works in both resize tests;
ever since we changed this the install_resize_lvm test has not
been working properly, it hasn't actually been doing any resize.
Also drop the swap partition stuff from that test as it's for
sure no longer needed.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-04-30 11:10:21 -07:00