1
0
mirror of https://pagure.io/fedora-qa/os-autoinst-distri-fedora.git synced 2024-09-21 14:37:23 +00:00
Commit Graph

1274 Commits

Author SHA1 Message Date
Lukáš Růžička
d656bc45a6 Wait until the dialogue settles 2024-02-20 15:01:14 +01:00
Adam Williamson
47e9f576c0 CoreOS: tweak rpmostree_rebase test to work from OCI remote
The rpmostree_rebase test has been failing on CoreOS 40+ for a
while. Per
https://github.com/coreos/fedora-coreos-tracker/issues/1672
it turns out this is because FCOS actually deploys OCI remotes
by default now. Rebasing from an OCI remote to an ostree
remote (as we are trying to do here) requires specifying the
registry, so let's do that.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-02-19 15:00:34 -08:00
Lukáš Růžička
e2e22341d3 Fix nautilus issues. 2024-02-19 14:19:52 +01:00
Lukáš Růžička
99b4d6ec17 Run scripts with assertions.
Creating the .invisible.txt file was done using non-assertion commands.
The tests have been failing for some and it seems like the commands
did not run correctly. Running them with assertions will make sure
that they will run (or fail correctly).
2024-02-19 11:26:39 +01:00
Adam Williamson
98513a0185 archive: be safer about the 'archive' dialog appearing
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-02-16 17:53:42 -08:00
Adam Williamson
caa4353fe0 maps: add some sleeps to the zoom test
These loops make us click extremely fast. This may cause
unreliable results, I think. At least, the test is failing a
lot lately, with results that look like it's not always getting
the expected four levels of zoom. Let's try a short sleep
between clicks.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-02-16 17:52:19 -08:00
Adam Williamson
106a63f101 Maps: try and be a bit safer with the export screen
It seems like the export screen takes a while to appear on 40 and
Rawhide ATM, and we might start typing before it's there. Let's
assert it's actually there before we start doing stuff.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-02-16 17:22:22 -08:00
Adam Williamson
b3e5dd41cb desktop_update_graphical: try to workaround GGO #2442
In current F40 and Rawhide, this test is frequently failing
because gnome-software is behaving weirdly at startup - the
third-party software dialog moves around even more than before,
the app seems to get stuck in the "not responding" state
briefly sometimes, and there's a very weird state it gets into
sometimes where the window is shorter than usual and clicks
don't seem to register in the right place. While I'm trying to
bisect these bugs, these magic voodoo incantations (tested on
the staging instance) seem to mostly work around the weird
behaviour, and setting RETRY=2 should backstop it a bit further.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-02-16 12:50:05 -08:00
Lukáš Růžička
58544fcbce Wait until Loupe responds correctly. 2024-02-16 17:22:52 +01:00
Adam Williamson
b371331436 _ostree_build: handle change to repos in workstation-ostree-config
The place where repos are defined changed on the F40+ branches
of workstation-ostree-config, this handles both possibilities.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-02-14 12:29:51 -08:00
Adam Williamson
de4735f6f1 Soft fail on missing background for F40
...we know there isn't one yet.
https://bugzilla.redhat.com/show_bug.cgi?id=2230720

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-02-14 00:43:46 -08:00
Adam Williamson
375250000f Add a wait_still_screen to update_graphical for an animation
GNOME Software seems to be doing some kind of animation between
the third party dialog and the main UI, and we're clicking on
a banner instead of the update button. Try a wait_still_screen
to deal with this.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-02-12 09:55:31 -08:00
Adam Williamson
965dc99ef5 Give ostree_build another half hour again
Another bunch of these timed out. Not sure why. Maybe it's when
I run a lot of them at the same time? Let's try this, again.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-02-06 23:07:25 -08:00
Adam Williamson
61910e7610 Make tidy happy with how we disabled accounts.fp.o check
Sigh, this is less obvious but we need the tests to pass.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-02-03 09:25:44 -08:00
Adam Williamson
f8de09df24 desktop_browser: temporarily disable FAS homepage check again
accounts.fp.o seems to be unreliable again today, let's drop this
again so tests don't fail on it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-31 13:28:53 -08:00
Adam Williamson
09e4f526a8 Revert "Give ostree_build another half hour"
This reverts commit 56c9e80f60.
Things seem to have settled down with the mass rebuild and this
test seems to be back to consistently taking about 90 minutes.
2024-01-30 09:47:44 -08:00
Adam Williamson
56c9e80f60 Give ostree_build another half hour
It seems to be timing out a lot on Rawhide lately. Not sure if
it's just mass rebuild stuff, but anyhow...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-29 17:03:30 -08:00
Adam Williamson
ce6beac5a6 Revert "base_services_start: temporarily allow colord to fail (#2260663)"
This reverts commit ab5b1a4367. A
new colord build has been pushed which should resolve the issue,
so I'm disabling the workaround to ensure that's the case.
2024-01-29 08:30:08 -08:00
Adam Williamson
ab5b1a4367 base_services_start: temporarily allow colord to fail (#2260663)
Somehow, colord is sometimes failing to start in stable Rawhide
ATM - I don't know how this problem got through testing. It's
now blocking other updates.

Doing this only on x86_64 is lazy and wrong, but the logic gets
way more complicated if we need to allow potentially *two* things
to fail on aarch64 and ppc64le, and it's the weekend and we
don't gate updates on those arches so I'm not doing it. Hopefully
this will be resolved quite quickly.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-27 13:50:58 -08:00
Adam Williamson
b40ab389b7 Revert "desktop_browser: temporarily disable FAS homepage check"
This reverts commit a9c6111499. The
system is more or less working again, so it should be safe now.
2024-01-24 08:45:23 -08:00
Adam Williamson
a9c6111499 desktop_browser: temporarily disable FAS homepage check
FAS is down right now, so let's skip testing accounts.fp.o as it
will fail.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-22 09:16:20 -08:00
Adam Williamson
d23e5d7dd7 Bump the default bootloader timeout a bit
We're taking a long time to reach it on aarch64 on prod recently
for some reason. It's probably some weirdness with qemu/edk2. So
let's just bump the timeout as I don't have an easy fix on hand
and this won't hurt anything.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-19 15:24:19 -08:00
Adam Williamson
9cf3105168 Try a longer timeout for the rpm-ostree cancels in overlay
We seem to be getting quite a lot of failures in update tests
where this times out. Let's try a longer timeout.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-17 11:48:01 -08:00
Adam Williamson
5f702b0be8 Run update repo setup steps from a serial console
This is a surprisingly large change as we want to go back to
the console we were previously on after doing it. To do that we
need to know what console we were on, and to know *that*, we need
to port everything that currently uses (ctrl-)alt-fX to switch
consoles to use select_console instead.

This is primarily intended to make running setup_repos.py faster
when it has to download a lot of packages (as typing in hundreds
of package names is quite slow). But it actually makes the whole
thing faster, even when only downloading one or two packages.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-11 12:09:59 -08:00
Adam Williamson
d445a80016 update testing: use a concurrent script to download packages
This uses a Python script which implements concurrent downloads
(via asyncio) to download workaround and update packages and
configure the repos. This should speed up the process for large
multi-package updates.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-11 11:31:40 -08:00
Adam Williamson
8251756331 Revert to having tests, not the scheduler, download packages (#108)
This effectively reverts 97618193 - but had to be done manually
and adjusted to maintain support for testing side tags and for
testing multiple tasks, since those features were added since
the update ISO change.

The 'scheduler injects ISOs of packages into the tests' approach
was intended to speed things up, especially for large updates,
and it did, but it had a few drawbacks. It means restarting
older tests from the web UI doesn't work as the ISOs get garbage
collected (you have to re-schedule in this case). And it has the
rather large problem that you can now only schedule tests from
the openQA server (or at least a machine with the openQA asset
share mounted), because the package download and ISO creation
just happen wherever the scheduler is running and assume that
the openQA asset share that will be used by the tests is at
/var/lib/openqa/share in that filesystem.

That's too big of a drawback to continue with this approach, IMO,
so this reverts back to the old way of doing things, with a bit
of refactoring to clean up the flow a little, and with support
for testing side tags and multiple tasks maintained.

As a follow-up I'm going to see if I can replace
_download_packages with a much more efficient downloader script
to mitigate the time this process takes on each test, especially
for large updates.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-11 11:31:40 -08:00
Adam Williamson
6654e522ac app start/stop tests: use normal flags for GNOME Terminal test
This test had special flags because it used to be run first and
did the prep steps for the other tests. Now the aaa_setup test
does that job, so there's no reason for this test to have these
flags any more, and somehow they seem to be breaking the test on
Rawhide. Let's give it the same flag as all the other normal
tests.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-10 12:43:45 -08:00
Adam Williamson
abc5e7c679 Plasma notifications: drop the Akonadi migration note check
Per the needle cleanup, we do not seem to have seen it for some
time.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-09 17:52:15 -08:00
Adam Williamson
6f5b10dbe6 Drop workaround for RHBZ #2170544
The change was reverted, and per the needle cleanup, we have not
seen this path for some time.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-09 17:50:24 -08:00
Adam Williamson
99b3ef8f03 kontakt: drop the check for 'enable_unified_mailboxes'
Per the needle cleanup, it hasn't been seen for some time. The
test is failing ATM but even the last time it passed -
https://openqa.fedoraproject.org/tests/2311371#step/kontakt/3 -
we did not see this.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-09 17:44:47 -08:00
Adam Williamson
247e8dd822 gnome-text-editor: drop setting of English language
The bug this was meant to fix hasn't happened for months. Back
in Fedora-Rawhide-20230629.n.0 we were seeing every line in the
poem marked as a spelling error until we did this, but that's
not happening any more, we don't need this.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-09 17:41:27 -08:00
Adam Williamson
5e3f39209d Workaround KDE kickstart referencing new comps group
This breaks things until a compose has happened and comps data
with the new group in it is actually out there in the repos. So
we need to hack it back out again till a compose goes through.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-04 15:01:15 -08:00
Adam Williamson
f2dcfed498 Also settle during the setup stage for Maps
This has similarly been failing quite a lot lately, let's see if
a sleep helps here.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-03 15:31:56 -08:00
Adam Williamson
6e95581865 Calculator: delay before snapshotting
In some tests on staging this seems to help with the 'clicks
don't work in later test steps' problem we're seeing a lot.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-03 15:12:44 -08:00
Adam Williamson
7b453a493c autocloud: blocking off more atomic tests on non-atomic images
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-02 14:06:35 -08:00
Adam Williamson
32621bd042 Drop KDE live build workaround we no longer need
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-12-23 12:10:41 -08:00
Adam Williamson
88b3213af4 autocloud: only run atomic test on canned (==atomic) installs
It seems Python 3.12.1 changed unittests' behaviour so that all
tests being skipped is now a fail not a pass. That breaks this
test because TestAtomic01Status only does anything if this is
an atomic system. So, let's just skip that test entirely if we
aren't one. As things stand this means the test will never run,
because we only test on Cloud_Base which is not atomic.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-12-23 12:04:50 -08:00
Adam Williamson
893052197d Workaround needed comps change for KF6 rebuild
https://pagure.io/fedora-comps/pull-request/920 is a required
comps change now
https://bodhi.fedoraproject.org/updates/FEDORA-2023-ad16578136
landed in stable, but it won't be in the public comps data till
after the next compose. This reproduces the same effect on the
fly in the KDE kickstart when doing the KDE live image build
test, so it will pass.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-12-15 13:20:34 -08:00
Adam Williamson
c05dfdd120 Fix KDE background solidification for change to sddm-breeze
There used to be a theme.conf.user file, there isn't any more.
I think this should work both before and after.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-12-05 17:17:42 -08:00
Adam Williamson
fc7affc473 limpress: use esc not alt-f4 to close template chooser
See https://bugzilla.redhat.com/show_bug.cgi?id=2252806 for why,
we're working around that.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-12-04 11:18:12 -08:00
Adam Williamson
171230ab1a Try hiding cursor in middle right of screen on desktops
os-autoinst is set so that if you once manually set the cursor
somewhere, all subsequent calls to `assert_and_click` will return
the cursor to the last manually-set position (if you never set
the cursor anywhere manually, it uses the `mouse_hide` location).
The mouse_hide location is no good for modern desktops as they
use hot corners in various ways, so for the desktop tests, early
in login, we set the mouse to 300/800, which we hope is a kind
of neutral location that doesn't interfere with matches of the
desktop_background needles (which I usually put towards the
right of the screen).

Unfortunately, KDE can show fairly big previews of active windows
down there, and hovering over one causes that window to be
displayed and all others to be hidden. Which rather breaks the
desktop browser test, when we have the Welcome Center popping up
on boot.

We already moved the mouse set point from 300/200 a few years
back because of a *different* awkward interaction with the browser
test, so we can't go back there. Let's try 1023/384 instead -
that's all the way on the right hand side of the screen, but half
way down, not in either corner. I really hope this doesn't cause
problems for any tests cos I don't know where else to stick the
damn thing if this doesn't work.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-12-04 09:15:17 -08:00
Adam Williamson
b2928ff399 KDE app start/stop test updates for Plasma 6
Several needle updates and a tweak to the text we type to launch
kinfocenter (just "info" now launches something else).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-11-30 18:05:37 -08:00
Adam Williamson
af73a24f50 Drop dbusviewer from KDE apps start/stop test
khotkeys was removed from Plasma 6, and qdbusviewer was only on
the live image because khotkeys recommended it, so now it's gone.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-11-30 12:12:09 -08:00
Adam Williamson
683234d7a5 Simplify package set selection in anaconda
tab will both reach the environment selection list and then go
through it, so we don't need to start out with tab and then
switch to down. And since all we need to do is hit one key until
a needle matches, let's use the handy function os-autoinst
provides for doing this...

This should fix it on current Rawhide (where it only takes one
tab, or zero tabs - not sure which - to reach the list).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-11-29 16:20:13 -08:00
Adam Williamson
4e62eb8ec5 Remove the anaconda_help test
Help support has been removed from anaconda:
https://github.com/rhinstaller/anaconda/pull/5335
so we no longer ought to test it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-11-29 12:11:00 -08:00
Adam Williamson
13404c6aaf loupe: don't pass args to download_testdata
You can see what these args are trying to do, but the function
does not currently work that way. I think running it without
args should get what the test wants. If Lukas wants to refine
download_testdata so you can specify the payload and where to
extract it, he can do that, then put this back...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-11-27 10:53:31 -08:00
Adam Williamson
1ecbd28f82 desktop_login: get rid of KDE welcome tour
The KDE welcome tour is getting in the way of the desktop login
test. Try getting rid of it after logging in.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-11-27 09:55:34 -08:00
Adam Williamson
461e211618 Drop use of PXEBOOT, rely on default boot order
Per https://progress.opensuse.org/issues/151258 , PXEBOOT=once
doesn't work right in current os-autoinst. Now I look at it,
PXEBOOT is just pretty ropey in general; on UEFI and aarch64 it
doesn't actually do anything at all, we're actually just relying
on the default boot order there.

Since it doesn't seem like there's a practical way to make
PXEBOOT=once work as intended on all platforms, let's just drop
use of it and make it clear that we rely on the default boot
order: we hope that on first boot we'll get a PXE boot since no
local media are bootable, then on second boot we'll get a local
disk boot.

We set up a new IS_PXE variable to cue the couple of places where
the test logic needs to be different.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-11-21 16:23:25 -08:00
Lukas Ruzicka
d50885e584 Create a test for basic Flatpak operations.
This PR tries to respond to issue #294.
On Silverblue, this will try:

* flatpak install
* flatpak remote-add
* flatpak list
* flatpak remotes
* flatpak remove
* flatpak update

and also it tests that a flatpak can be built.
2023-11-13 10:37:52 -08:00
Adam Williamson
849753a047 Fix an error in desktop_printing soft fail path (oops)
thanks, tidy

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-11-13 08:39:43 -08:00
Adam Williamson
dd946b0960 desktop_printing: adjust to g-t-e dying after print
It seems like in current Rawhide (since about Saturday - possibly
due to new mesa?), g-t-e quite often dies after we print. This
messes up the test because we wind up quitting the terminal
instead of g-t-e. Let's handle it as a soft failure instead,
until we can figure out why g-t-e is dying.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-11-06 20:36:18 -10:00
Adam Williamson
e60a390db2 some waiting and screenshots to debug desktop_printing fails
desktop_printing is failing a lot in recent Rawhide (and so are
some other tests, but this one is nice and easy to target). Add
some wait_still_screens and save_screenshots to try and see
exactly what's going on when we exit gnome-text-editor before
switching to a VT.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-11-06 09:51:10 -08:00
Adam Williamson
4e3a284220 krfb: handle two cancel buttons
In today's Rawhide, two dialogs have to be cancelled on krfb
launch before we see the UI: a remote control permission screen
and a kwallet creation flow.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-10-24 08:21:51 -07:00
Adam Williamson
475ee6b89c loupe: add a wait at start of browse test
We often get a failure where it's stuck at a spinner here, let's
see if waiting to settle the snapshot resume helps.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-10-17 15:33:53 -07:00
Adam Williamson
69dad7a975 sysmon: click, don't use shortcuts, to switch views
It looks like
https://gitlab.gnome.org/GNOME/gnome-system-monitor/-/issues/262
won't be fixed for a while - the fixes are tied up with the GTK
4 port - so let's just work around it for now by clicking instead
of using keyboard shortcuts.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-10-17 15:30:31 -07:00
Adam Williamson
f36d04e650 KDE start/stop krfb: dismiss Wallet window if it shows up
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-10-17 09:15:21 -07:00
Adam Williamson
c697ca171d Adjust to replacement of cheese with snapshot (Camera)
A new app called snapshot (Camera, on the menus) has replaced
cheese in F40 (but not F39). Adjust to that. We can simplify
this when F39 is out.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-10-15 10:21:17 -07:00
Adam Williamson
1db0e7465a Drop kmag test on F40+
kmag was removed in
https://pagure.io/fedora-comps/c/bb332b310b22a1103347afece6f845087694d85e?branch=main
we can't drop the test entirely yet as it's still in F39. Will
drop this after F39 is released.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-10-15 09:10:51 -07:00
Adam Williamson
22e174069e gnome-panel: set update notification timestamp early
If we do it after forcing the clock to 18:30, doing it takes so
long we wind up at 18:32, and that kinda sets the rest of the
test out of whack (we have several needles that assume we start
at 18:30 or 18:31 after the snapshot). So let's set the update
timestamp *before* we force the clock. This will mean it's waay
in the future after we force the clock, but that should still
do the job of avoiding notifications showing up, I hope.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-10-14 10:34:01 -07:00
Adam Williamson
b043e99430 Drop EOG alternate path in Maps export image test
Silverblue now has Loupe, like Workstation, so the paths are the
same.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-10-14 10:24:24 -07:00
Lukas Ruzicka
b1799eb084 Use the new subroutine on desktop tests. 2023-10-10 17:43:21 -07:00
Adam Williamson
eb6a47f462 Adjust konversation test to run neochat on Rawhide
KDE replaced Konversation (IRC client) with Neochat (Matrix
client) in Rawhide. As the replacement isn't done in F39 we can't
just switch the test out, we have to handle both, so for now,
let's have the "konversation" test run neochat on Rawhide.

We can't really proceed through neochat's first run wizard as
it needs a Matrix account name and password and we don't want
the hassle of handling a secret just for this, so we'll just
quit out once we see it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-09-26 15:53:54 -07:00
Lukáš Růžička
9e0d74453c Create a test suite for Loupe (Image Viewer)
This PR adds a test for a new Image Viewer called Loupe.
It is based on the old Image Viewer test, newly reneedled
with some of the tests shortened, deleted or edited
as the new Image Viewer has a little bit less functions
compared to the previous one.

Add needles.
2023-09-20 10:29:39 +02:00
Adam Williamson
413dba4c95 Give live image tool install longer to run
It's timing out on stg quite a lot.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-09-19 12:47:35 -07:00
Adam Williamson
836f8e2da6 Revert "apps_startstop: new GNOME image viewer is not in Utilities"
This reverts commit 0d8df76b1b.
Loupe now seems to have been moved down into Utilities like eog
was, so revert this.
2023-09-18 08:48:38 -07:00
Adam Williamson
ea8500cf07 Various changes for webUI deferral to F40
webUI has been deferred to F40, so we need to expect the old UI
flow on F39 now. This should cover everything, I hope.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-09-12 16:13:49 -07:00
Adam Williamson
2458ff7580 Adjust tests to handle webUI reversion
We're reverting webUI for Fedora 39.
https://bodhi.fedoraproject.org/updates/FEDORA-2023-73c4f1a802
is the update that implements this; adapt the tests to handle it
(by expecting the old flow when testing that update, and editing
the kickstart to drop anaconda-webui when building the live
image).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-09-12 11:09:52 -07:00
Adam Williamson
ccfef0d168 Retry setting root password on live
This seems to have started failing periodically at the start of
this month, I've no idea why. For now, let's retry it a few
times and see if that helps.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-09-07 08:34:16 -07:00
Adam Williamson
d8efb7df1d installer_build: fix image upload on non-x86_64
Let's not hardcode the arch in the upload_asset call!

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-09-06 17:24:35 -07:00
Adam Williamson
deb25acdf9 installer_build: install hfsplus-tools on ppc64le
We need this on ppc64le. Never tried running this test on it
before.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-09-06 16:43:36 -07:00
Adam Williamson
bca01de5e7 Give toolbox install a bit longer to run
It seems psst-selinux scripts can take a *long* time and this
test is sometimes timing out here.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-09-06 12:33:01 -07:00
sumantrom
b9afdc8ae7 add toolbox test case with basic func to create, list, start and stop 2023-08-29 07:59:24 +05:30
Adam Williamson
8f888317b5 anaconda_help: create test plans before the first assert_screen
So we can bail early enough on webUI.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-25 14:55:20 -07:00
Adam Williamson
d9ebb56ebf Sigh, it's record_soft_failure, not register_soft_failure
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-25 14:51:35 -07:00
Adam Williamson
539f8a54fc Effectively skip anaconda_help on F39+ Workstation live for now
There isn't any Help in the webUI installer, really. In future
it's meant to have more 'contextual' help - little question
mark icons next to elements of the UI that explain them when
clicked on - which we could implement tests for, but this isn't
done yet.

Let's not skip scheduling the test entirely, because we can
still run it on F38 respins, and we may be able to implement
testing of the contextual help in future. So let's just soft
fail and return immediately. If we get to F39 stable without
the contextual help being implemented (or it turns out not to
be testable within the confines of this design), we can skip
scheduling the test on webUI images entirely.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-25 14:48:42 -07:00
Adam Williamson
f22af41f0f ostree: avoid rebasing from F39+ to <F39
Now F39 has branched from Rawhide, we can tweak the rebase logic
to never rebase from F39+ to <F39, and avoid
https://github.com/fedora-silverblue/issue-tracker/issues/470 .

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-23 16:12:57 -07:00
Adam Williamson
f1a6c91784 Drop a couple of webUI conditionals to 39, not 40
We just landed the webUI stuff for F39, so now we need these
conditionals to kick in for F39+, not F40+.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-23 15:48:53 -07:00
Adam Williamson
efe4a3da2e Maps: sigh, okay, need another test logic change for Loupe
Loupe's Open dialog defaults to Recent, not Pictures, so when
we're using Loupe we need to click into Pictures to find the
exported image.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-23 11:17:06 -07:00
Adam Williamson
af8a6635a6 Maps: go back to always typing 'image viewer'
Loupe has replaced EOG on F39 and Rawhide, and it can be found
with "image viewer", so let's just go with that. The rest of the
logic should be OK but we will likely need some new needles,
will do that next.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-23 11:03:36 -07:00
Adam Williamson
0d8df76b1b apps_startstop: new GNOME image viewer is not in Utilities
It's on the top level.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-23 10:34:03 -07:00
Adam Williamson
d0ac2a5ba8 notifications: also handle the welcome tour on live flow
Seems with the g-i-s / anaconda webUI changes we also get the
welcome tour here now.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-23 10:19:56 -07:00
Adam Williamson
9528d37582 launch desktop, not installer, at end of g-i-s on notifications
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-23 10:15:07 -07:00
Adam Williamson
a8d17e057f Whoops, get the release number correctly
Wow, I am not awake yet.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-23 09:47:03 -07:00
Adam Williamson
602636ef24 Handle new live g-i-s flow in desktop_notifications
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-23 09:42:54 -07:00
Adam Williamson
026f70e063 webui: only select disk if we have more than 1
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-23 09:12:30 -07:00
Adam Williamson
d000a96fc6 Remove the EOG app test
EOG has been replaced by Loupe in F39+. We will need to add a
test for Loupe, but first let's remove the EOG test so it does
not fail on every compose.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-23 09:07:06 -07:00
Adam Williamson
ec5bab0176 Initial anaconda webUI support
This is tailored to the initial deployment of webUI in
Workstation live images only; we may need to tweak flows and
approaches as webUI goes further.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-22 18:05:51 -07:00
Adam Williamson
14bd0b177e FreeIPA replica test: decommission the replica
A new FreeIPA update adds a check which causes a failure when
we try to decommission the original server with the replica
still alive. Let's see if decommissioning the replica helps.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-22 01:18:08 -07:00
Adam Williamson
329d878343 Revert "workaround odd dnf issues with samba-4.19.0-0.3.rc2 updates"
This reverts commit 511b5382ec.
The updates have gone stable and we don't need the workaround.
2023-08-22 01:18:08 -07:00
Adam Williamson
2e330f78ab podman: also run the upstream integration test suite
Per https://github.com/containers/podman/pull/19302 and
https://github.com/containers/podman/issues/19299 , upstream
have kindly set things up so we can easily run relevant parts of
the upstream test suite as an integration test in openQA. This
should help us catch if changes in other components break key
features of podman.

This only runs any tests with podman 4.6.1 or higher, but with
earlier versions it just does nothing and exits 0, so that's
fine. 4.6.1 is in F39 and Rawhide already, will land for F37
and F38 shortly.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-16 22:56:20 -07:00
Adam Williamson
511b5382ec workaround odd dnf issues with samba-4.19.0-0.3.rc2 updates
dnf seems to have some odd trouble with these updates. It
 really wants to use the older 2.rc2 builds, even though there
doesn't seem to be any actual *problem* with the 3.rc2 builds.

For the samba server test, passing `--best` to dnf seems to be
enough to make it use the .3.rc2 builds. For the FreeIPA tests,
we have to do a second pass with `--best` after the initial
install.

It's weird that we have to do this, but to get these updates
through - because there doesn't really seem to be a problem
here - let's do it. They will replace the 2.rc2 builds in the
main F39 and Rawhide trees once they land in 'stable' so the
problem shouldn't persist.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-16 12:18:42 -07:00
Adam Williamson
91bf4e423f Disable forced use of HTTP 1.1 for curl and git
To see if the bug has gone away now -
https://pagure.io/fedora-infrastructure/issue/11426#comment-867456

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-10 15:13:04 -07:00
Adam Williamson
94a743b37e Drop _live_build mock config corrections for F39 and F40
These should no longer be needed with the new mock-core-configs
and mock. Tested on stg.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-10 12:54:36 -07:00
Adam Williamson
ccda54d0f7 Fix launching eog on Silverblue
We still have to type "image viewer" there, for now.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-09 18:04:05 -07:00
Adam Williamson
8483e7bd82 Workaround mock-core-configs not being updated for F39 branch
mock still thinks the releasever for Rawhide is 39, which causes
it to use the wrong GPG keys and not be able to install packages.
This overrides that setting in our mock config file, until
mock-core-configs is updated in the distro.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-09 15:21:35 -07:00
Adam Williamson
b228af2f76 Sigh, declare $mockver
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-09 14:27:38 -07:00
Adam Williamson
98bb256950 live_build: tweak mock config used for Rawhide
The numbered config file won't always exist right after branch
(there is no fedora-40-x86_64 now, for e.g.) But the named one
always does. This additional variable is a small price to pay for
making the test more robust.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-09 14:26:02 -07:00
Adam Williamson
53bd47d909 Disable modular repos for upgrades to F39 as well (#2230720)
We know this is broken and we don't want it to fail on every
update, so we need to work around the problem for now.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-09 14:25:24 -07:00
Lukas Ruzicka
8ac3885897 Make various fixes in Workstation product to make tests pass. 2023-08-08 14:50:03 +02:00
Adam Williamson
ae7d5011df Fixes for Active Directory client tests
abbra told me where I was going wrong with the 'expected' target
of the getent command ("AD/" is not a magic string, it's just
"(netbiosname)/", and our netbios name is "SAMDOM"...) so this
fixes that too, trying to avoid hard-coding stuff.

For the kickstart test, it seems like it's a timing issue. We
added this 'install sssd-tools and enable debugging' step to try
and debug it, and instead it fixed it. So...let's just stick
with this, for now, because it's useful to have this debugging
anyway. If the problem starts happening again, we can fiddle
about with it more.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-05 11:22:37 +01:00
Adam Williamson
601d0c4f96 Disable modular repos for Rawhide upgrades to avoid #2228827
As 'real' upgrades (using releases/development/rawhide on the
mirrors) do not hit this bug because it has a stale Modular
tree, it makes sense to work around the bug in testing so we can
see if upgrades are broken in any *other* way.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-05 09:44:13 +01:00
Adam Williamson
92dbd802e8 koji-rawhide: set skip_if_unavailable=1 for now due to 404 issues
We're seeing a lot of tests fail on 404s when trying to access
the koji-rawhide repo (the repo for the Rawhide build tag, which
we use to get packages tagged since the last compose. nirik is
trying to figure this out from the server end, but for now at
least, let's mark the repo as skip_if_unavailable. This should
mean that if we hit a 404, the test will continue, it just won't
have access to the packages from that repo. Occasionally this
will cause a problem - a false failure or false pass - but this
still seems better than every test that hits it failing. The
false pass case is the most concerning, but I would hope in that
case some other tests from the same update would fail, making it
not an issue.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-02 09:10:55 +01:00
Adam Williamson
6f0480727f Make sure live image volume ID isn't longer than 32 chars
This can happen now we allow working on multiple Koji tasks.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-07-28 15:10:37 -07:00
Adam Williamson
2e572d72b6 Add --http1.1 to one curl command that didn't have it
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-07-28 10:50:15 -07:00
Adam Williamson
0e01e4e659 Use fXX-build in the koji-rawhide repo definition, not rawhide
Per nirik, 'repos/rawhide' is just a symlink to 'repos/fXX-build'
and this could possibly be part of our 404 problem. So let's
try using fXX-build directly instead of the symlink.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-07-28 10:31:32 -07:00
Adam Williamson
74b468b949 Add Samba AD tests
This adds a Samba AD server test, and client enrolment tests via
sssd, Cockpit and kickstart. Requires the matching createhdds
commit to add the kickstart to the disk_ks image.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-07-27 16:14:30 -07:00
Adam Williamson
ba1d492416 ostree: only use --unified-core on F39+
I think it's breaking F37 and F38 tests, not surprisingly as we
didn't do all the fixes there.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-07-27 12:26:23 -07:00
Adam Williamson
bf4a8ec454 Enable unified core for ostree composes
It got enabled in production, so we should do the same here.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-07-25 18:35:58 -07:00
Adam Williamson
2d6180b25e Try forcing HTTP/1.1 for pagure.io git clones
The change to the curl commands to force HTTP/1.1 seems to have
stopped them failing, so let's try doing it for the git clones
too and see if that avoids the problem till we can work out
what is causing it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-07-24 11:56:28 -07:00
Lukas Ruzicka
0a10727a7a Remove modularity tests.
Modularity will be retired in Fedora 39 and the modular repository
removed. Also, the upcoming version of DNF that is default in
Rawhide, does not support modularity, so the tests are currently
failing anyway.
2023-07-20 10:23:44 +02:00
Adam Williamson
d5a9e4777e Retry all pagure.io downloads
This tweaks all pagure.io downloads to be retried a few times,
since we seem to be getting failures quite often. We use curl
for this as it has nice options for it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-07-19 13:37:29 -07:00
Lukas Ruzicka
3e7936fd01 Replace the dropped pactl with amixer to manipulate audio levels. 2023-07-17 14:30:05 +02:00
Adam Williamson
f49c8bc66b gnome-text-editor: only handle spellcheck language if needed
The Flatpak build doesn't have the spellcheck issue at the
moment, and it may be fixed soon in the RPM build. Trying to
'fix' the issue on the flatpak build actually makes the test
fail. So, let's only do the fix if we actually have a misspelled
word.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-07-05 12:19:41 -07:00
Adam Williamson
ba9a36d10e g-t-e: mark 'new_file' test as fatal
The tests after it assume new_file ran - they rely on the file
it creates - so it should be considered fatal.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-07-05 11:39:18 -07:00
Adam Williamson
1f24f84bb1 Support testing a side tag instead of an update or task
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-07-04 19:10:03 -07:00
Adam Williamson
d8c374044a Add more safety to the fullscreen for Archiver
We can't really just hit super-up and then immediately go on our
merry way clicking on stuff...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-07-04 17:25:52 -07:00
Adam Williamson
20a2d161ca Add some safety to g-t-e language setup
Seems in Rawhide the menu is loading without dividers briefly,
we match there, then the dividers load in and make the menu
longer, so when we click, we hit a different entry in the menu.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-07-03 11:31:48 -07:00
Lukas Ruzicka
d749317f29 Update the Gnome-Text-Editot test.
The editor started to show spell-checking that would require a lot
of new needles to be created. Theredore, we set the language to
English to stop showing the spelling mistakes in aaa_setup.pm

Also, the application started to have problems with getting correct
focus, so we want to click into the text before the status gets
recorded.
2023-06-30 14:26:00 +02:00
Adam Williamson
fbb9bd7386 Revert "_live_build: workaround util-linux-user problem for KDE live"
This reverts commit efc2f8ae36.
As the comment said, it's no longer needed.
2023-06-28 16:52:48 +02:00
Adam Williamson
5c6ae24e99 _live_build: FIXME for using three disks
Change the comment on why we put /var/lib/mock on the third hard
disk: we probably can cut it down to two, now, but I don't want
to do it right now.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-06-28 16:48:55 +02:00
Lukas Ruzicka
4c426051ce Remove the Photos start-stop test.
Based on the information that the application has been removed
from the standard Workstation installation, see
https://pagure.io/fedora-comps/c/462b65876fb4258fdb2ce19f4193900ef2bdc2d9?branch=main,
we remove that application from this suite.
2023-06-28 13:44:31 +02:00
Adam Williamson
500fea03ad Fix workaround repo in live images
D'oh. This is the first time we actually tried to use the new
workarounds ISO thing for real, I forgot to update some paths.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-06-26 01:50:49 +02:00
Adam Williamson
0a87a76ff9 Run base tests on ELN
This requires a change in the package we use for base_update_cli
because pandoc-common is not in ELN.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-06-23 11:53:11 +02:00
Lukas Ruzicka
bc8601a1d4 Create test for the Tour application. 2023-06-23 10:53:58 +02:00
Adam Williamson
3bce9f1007 Type more safely in the gnome-panel volume bar test
The shifted characters here frequently get mistyped. Let's use
type_safely. If this isn't enough we can try very_safely.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-06-23 10:52:33 +02:00
Adam Williamson
6fefd092e9 Try and fix Cockpit tests breaking with update ISO change
We drop the line for the update ISO from /etc/fstab before
uploading the image after the cockpit_default test, but we don't
make sure it's set up again before Cockpit tries to use it, in
the subsequent Cockpit tests. I don't know why this didn't fail
on stg before, but it sure as hell is failing in prod...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-06-20 15:18:01 +02:00
Adam Williamson
74730f904a Workaround config-manager plugin missing from dnf5 using sed
This is ugly, but ought to work, I hope.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-06-20 12:42:34 +02:00
Adam Williamson
7be16956d7 Use "dnf group install" not "dnf groupinstall" (dnf5 support)
dnf4 and dnf5 both support the former, dnf5 does not support the
latter.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-06-20 12:27:30 +02:00
Adam Williamson
97618193c6 Adjust tests for update and workaround repos provided as ISO
I'm attempting a new approach to the update and workaround repos.
Instead of having each update test recreate them for itself -
which is slow and wastes bandwidth - the dispatcher will create
an ISO at test schedule time and pass it as ISO_2. Then the test
just mounts the ISO. This makes the necessary adjustments on the
test side.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-06-19 20:21:07 +02:00
Adam Williamson
b0fb6911f3 Add initial template stuff and test tweaks for ELN testing
Just a couple of flavors and tests for now.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-06-19 17:28:42 +02:00
Adam Williamson
326ea5c913 Brown paper bag fix for modularity_setup
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-06-19 17:08:05 +02:00
Adam Williamson
8b997279a4 vnc: give a dnf install command a bit longer to run
These can take a while if repos haven't been refreshed lately.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-06-19 12:42:03 +02:00
Adam Williamson
317deff82c disk_custom_with_swap: drop root part size to 6G
With the new 2G max EFI system partition size, we were trying to
stuff 12G of Fedora into a 10G disk. That wasn't going to work.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-06-19 12:30:52 +02:00
Adam Williamson
2427d8c0dc ostree: get ostree-parse-pungi.py from main again
whoops, forgot to reset this on merging the change.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-06-19 11:21:29 +02:00
Adam Williamson
30563c6aed Simplify the blivet resize LVM testcase
I don't think we need an alternative needle for ppc - the
current 'boot_inactive' needle should work fine on ppc. Let's
just always use that.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-06-18 13:00:07 +02:00
Adam Williamson
426747c368 Adjust modularity_tests to enable the modular repos at the start
As of yesterday's Rawhide, the modular repos are not installed by
default, so of course all the modular tests fail. So, install
the repos before running the tests.

This isn't conditionalized on release version as I don't think
we ever run this test on anything other than Rawhide and
Branched.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-06-18 11:15:56 +02:00
Adam Williamson
d964129736 ostree rebase: drop an old unneeded workaround
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-06-12 08:56:26 -07:00
Adam Williamson
e8df07813b ostree rebase: for update tests, check we deployed custom ref
This checks we actually deployed the 'fedora-openqa' ref as we
intended to (if not, the rebase test probably won't work
properly or won't test what we want it to).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-06-12 08:55:32 -07:00
Adam Williamson
d07b5a4178 Tweak ostree build and rebase for update tests to be more robust
We have had several problems where rebasing from one release to
another just doesn't work, and we have to work around it somehow.
Sometimes it's difficult or impossible to do. All we want to do
here is check the rebase mechanism itself; we don't actually want
to assert that you can rebase to any specific other release.

For update tests, we should be able to use a non-standard ref
name for the ostree we build, embed into the installer image,
and install. That should mean we can then rebase to the standard
ref name for the same release, which should be much safer than
trying to rebase to a different release. We can't do this for
the compose tests, but at least for update tests I'm hoping this
makes things more robust.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-06-11 21:06:57 -07:00
Adam Williamson
abc60d23c8 Drop dnfdragora from KDE app start/stop tests
It's not in the images any more. As aleasto pointed out, we're
actually being sent to Discover to install it, and matching on
*that* screen, which isn't what we intend.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-30 14:05:42 -07:00
Adam Williamson
2dade9e1d9 Revert "Workaround a notification test issue on F35 KDE"
This reverts commit a35befab8c. Per
https://openqa.fedoraproject.org/tests/1867885#step/desktop_notifications/30
and https://openqa.fedoraproject.org/tests/1932066#step/desktop_notifications/30
, in both F37 and Rawhide, clicking away an akonadi notification
no longer closes the panel, so it looks like we don't need this
any more.
2023-05-24 14:51:19 -07:00
Adam Williamson
db89554357 _support_server: only create temp dir when needed
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-24 11:17:47 -07:00
Adam Williamson
efc2f8ae36 _live_build: workaround util-linux-user problem for KDE live
util-linux-user subpackage was removed but comps wasn't updated.
I've fixed comps now, but that won't "kick in" until after the
next Rawhide compose; we need to workaround the issue until then.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-18 09:26:58 -07:00
Adam Williamson
3462050cf7 _live_build: drop some workarounds we shouldn't need any more
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-18 09:24:55 -07:00
Adam Williamson
37bd56033d nautilus: adjust keyboard shortcut page navigation
As recommended by @mclasen in
https://gitlab.gnome.org/GNOME/gtk/-/issues/5831#note_1743386 .

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-16 16:09:04 -07:00
Adam Williamson
b1e975a21f anaconda: end install immediately if we see the error screen
If install errors out, currently we still wait like an hour for
an "install_done" screen that will never come, before we give
up. Since we have a needle for the "unknown error has occurred"
screen, we may as well use it here - if we see that screen, we
can just die immediately. This may go stale if we forget to
update the needle, but it's only one line, so meh.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-16 15:40:02 -07:00
Lukas Ruzicka
e211a87fc7 Create a test suite for Disks. 2023-05-12 17:05:44 -07:00
Adam Williamson
119229cce7 Add a needle cleanup script, enhance the needle check script
This adds a new script - cleanup-needles.py - to use for cleaning
up old needles. It has to be used in conjunction with a database
query; the comment at the top explains how to do that query and
export the needed information. It produces a git commit with
needles that haven't matched since a certain date (specified in
the sql query) removed, subject to a 'keeplist' of needles we
keep even if they seem to be old.

I also enhanced check-needles.py to check for cases where tests
seem to be trying to match a tag we have no needles for. This
was necessary to find cases where the cleanup script was too
aggressive (i.e. the things that wound up in the 'keeplist'),
but it also turned out to find quite a lot of cases where the
code really *was* looking for a needle that had gone in a
previous cleanup or that never existed; the commits before this
one clean up a lot of those cases.

The code to decide which string literals are needle tags is
pretty dumb and hacky and needs some manual cueing sometimes -
that's what the `# testtag` changes in this commit are for.
Making it smarter would probably require this script to get a
lot more complicated and either incorporate or become a
tokenizer, which I don't really want to do.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-04 09:57:15 -07:00
Adam Williamson
1effed1069 Drop unused branch and needle in desktop_login
We never hit this path without a system menu button any more,
due to changes in KDE over time. It hasn't been hit for two years.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-04 09:57:15 -07:00
Adam Williamson
3e6e80ca87 Drop a no-longer-reached branch and associated needle
Now both GNOME and KDE do offline updates on all supported
releases, we never see an 'update done' screen any more. This
branch is left over from when the KDE offline update branch was
still conditional on release number.

If we ever implement this test on a desktop that doesn't do
offline updates, we can put this back easily enough.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-04 09:57:15 -07:00