1
0
mirror of https://pagure.io/fedora-qa/os-autoinst-distri-fedora.git synced 2024-12-28 13:13:09 +00:00
Commit Graph

1160 Commits

Author SHA1 Message Date
Adam Williamson
f8de09df24 desktop_browser: temporarily disable FAS homepage check again
accounts.fp.o seems to be unreliable again today, let's drop this
again so tests don't fail on it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-31 13:28:53 -08:00
Adam Williamson
09e4f526a8 Revert "Give ostree_build another half hour"
This reverts commit 56c9e80f60.
Things seem to have settled down with the mass rebuild and this
test seems to be back to consistently taking about 90 minutes.
2024-01-30 09:47:44 -08:00
Adam Williamson
56c9e80f60 Give ostree_build another half hour
It seems to be timing out a lot on Rawhide lately. Not sure if
it's just mass rebuild stuff, but anyhow...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-29 17:03:30 -08:00
Adam Williamson
ce6beac5a6 Revert "base_services_start: temporarily allow colord to fail (#2260663)"
This reverts commit ab5b1a4367. A
new colord build has been pushed which should resolve the issue,
so I'm disabling the workaround to ensure that's the case.
2024-01-29 08:30:08 -08:00
Adam Williamson
ab5b1a4367 base_services_start: temporarily allow colord to fail (#2260663)
Somehow, colord is sometimes failing to start in stable Rawhide
ATM - I don't know how this problem got through testing. It's
now blocking other updates.

Doing this only on x86_64 is lazy and wrong, but the logic gets
way more complicated if we need to allow potentially *two* things
to fail on aarch64 and ppc64le, and it's the weekend and we
don't gate updates on those arches so I'm not doing it. Hopefully
this will be resolved quite quickly.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-27 13:50:58 -08:00
Adam Williamson
b40ab389b7 Revert "desktop_browser: temporarily disable FAS homepage check"
This reverts commit a9c6111499. The
system is more or less working again, so it should be safe now.
2024-01-24 08:45:23 -08:00
Adam Williamson
a9c6111499 desktop_browser: temporarily disable FAS homepage check
FAS is down right now, so let's skip testing accounts.fp.o as it
will fail.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-22 09:16:20 -08:00
Adam Williamson
d23e5d7dd7 Bump the default bootloader timeout a bit
We're taking a long time to reach it on aarch64 on prod recently
for some reason. It's probably some weirdness with qemu/edk2. So
let's just bump the timeout as I don't have an easy fix on hand
and this won't hurt anything.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-19 15:24:19 -08:00
Adam Williamson
9cf3105168 Try a longer timeout for the rpm-ostree cancels in overlay
We seem to be getting quite a lot of failures in update tests
where this times out. Let's try a longer timeout.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-17 11:48:01 -08:00
Adam Williamson
5f702b0be8 Run update repo setup steps from a serial console
This is a surprisingly large change as we want to go back to
the console we were previously on after doing it. To do that we
need to know what console we were on, and to know *that*, we need
to port everything that currently uses (ctrl-)alt-fX to switch
consoles to use select_console instead.

This is primarily intended to make running setup_repos.py faster
when it has to download a lot of packages (as typing in hundreds
of package names is quite slow). But it actually makes the whole
thing faster, even when only downloading one or two packages.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-11 12:09:59 -08:00
Adam Williamson
d445a80016 update testing: use a concurrent script to download packages
This uses a Python script which implements concurrent downloads
(via asyncio) to download workaround and update packages and
configure the repos. This should speed up the process for large
multi-package updates.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-11 11:31:40 -08:00
Adam Williamson
8251756331 Revert to having tests, not the scheduler, download packages (#108)
This effectively reverts 97618193 - but had to be done manually
and adjusted to maintain support for testing side tags and for
testing multiple tasks, since those features were added since
the update ISO change.

The 'scheduler injects ISOs of packages into the tests' approach
was intended to speed things up, especially for large updates,
and it did, but it had a few drawbacks. It means restarting
older tests from the web UI doesn't work as the ISOs get garbage
collected (you have to re-schedule in this case). And it has the
rather large problem that you can now only schedule tests from
the openQA server (or at least a machine with the openQA asset
share mounted), because the package download and ISO creation
just happen wherever the scheduler is running and assume that
the openQA asset share that will be used by the tests is at
/var/lib/openqa/share in that filesystem.

That's too big of a drawback to continue with this approach, IMO,
so this reverts back to the old way of doing things, with a bit
of refactoring to clean up the flow a little, and with support
for testing side tags and multiple tasks maintained.

As a follow-up I'm going to see if I can replace
_download_packages with a much more efficient downloader script
to mitigate the time this process takes on each test, especially
for large updates.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-11 11:31:40 -08:00
Adam Williamson
6654e522ac app start/stop tests: use normal flags for GNOME Terminal test
This test had special flags because it used to be run first and
did the prep steps for the other tests. Now the aaa_setup test
does that job, so there's no reason for this test to have these
flags any more, and somehow they seem to be breaking the test on
Rawhide. Let's give it the same flag as all the other normal
tests.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-10 12:43:45 -08:00
Adam Williamson
abc5e7c679 Plasma notifications: drop the Akonadi migration note check
Per the needle cleanup, we do not seem to have seen it for some
time.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-09 17:52:15 -08:00
Adam Williamson
6f5b10dbe6 Drop workaround for RHBZ #2170544
The change was reverted, and per the needle cleanup, we have not
seen this path for some time.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-09 17:50:24 -08:00
Adam Williamson
99b3ef8f03 kontakt: drop the check for 'enable_unified_mailboxes'
Per the needle cleanup, it hasn't been seen for some time. The
test is failing ATM but even the last time it passed -
https://openqa.fedoraproject.org/tests/2311371#step/kontakt/3 -
we did not see this.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-09 17:44:47 -08:00
Adam Williamson
247e8dd822 gnome-text-editor: drop setting of English language
The bug this was meant to fix hasn't happened for months. Back
in Fedora-Rawhide-20230629.n.0 we were seeing every line in the
poem marked as a spelling error until we did this, but that's
not happening any more, we don't need this.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-09 17:41:27 -08:00
Adam Williamson
5e3f39209d Workaround KDE kickstart referencing new comps group
This breaks things until a compose has happened and comps data
with the new group in it is actually out there in the repos. So
we need to hack it back out again till a compose goes through.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-04 15:01:15 -08:00
Adam Williamson
f2dcfed498 Also settle during the setup stage for Maps
This has similarly been failing quite a lot lately, let's see if
a sleep helps here.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-03 15:31:56 -08:00
Adam Williamson
6e95581865 Calculator: delay before snapshotting
In some tests on staging this seems to help with the 'clicks
don't work in later test steps' problem we're seeing a lot.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-03 15:12:44 -08:00
Adam Williamson
7b453a493c autocloud: blocking off more atomic tests on non-atomic images
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-02 14:06:35 -08:00
Adam Williamson
32621bd042 Drop KDE live build workaround we no longer need
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-12-23 12:10:41 -08:00
Adam Williamson
88b3213af4 autocloud: only run atomic test on canned (==atomic) installs
It seems Python 3.12.1 changed unittests' behaviour so that all
tests being skipped is now a fail not a pass. That breaks this
test because TestAtomic01Status only does anything if this is
an atomic system. So, let's just skip that test entirely if we
aren't one. As things stand this means the test will never run,
because we only test on Cloud_Base which is not atomic.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-12-23 12:04:50 -08:00
Adam Williamson
893052197d Workaround needed comps change for KF6 rebuild
https://pagure.io/fedora-comps/pull-request/920 is a required
comps change now
https://bodhi.fedoraproject.org/updates/FEDORA-2023-ad16578136
landed in stable, but it won't be in the public comps data till
after the next compose. This reproduces the same effect on the
fly in the KDE kickstart when doing the KDE live image build
test, so it will pass.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-12-15 13:20:34 -08:00
Adam Williamson
c05dfdd120 Fix KDE background solidification for change to sddm-breeze
There used to be a theme.conf.user file, there isn't any more.
I think this should work both before and after.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-12-05 17:17:42 -08:00
Adam Williamson
fc7affc473 limpress: use esc not alt-f4 to close template chooser
See https://bugzilla.redhat.com/show_bug.cgi?id=2252806 for why,
we're working around that.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-12-04 11:18:12 -08:00
Adam Williamson
171230ab1a Try hiding cursor in middle right of screen on desktops
os-autoinst is set so that if you once manually set the cursor
somewhere, all subsequent calls to `assert_and_click` will return
the cursor to the last manually-set position (if you never set
the cursor anywhere manually, it uses the `mouse_hide` location).
The mouse_hide location is no good for modern desktops as they
use hot corners in various ways, so for the desktop tests, early
in login, we set the mouse to 300/800, which we hope is a kind
of neutral location that doesn't interfere with matches of the
desktop_background needles (which I usually put towards the
right of the screen).

Unfortunately, KDE can show fairly big previews of active windows
down there, and hovering over one causes that window to be
displayed and all others to be hidden. Which rather breaks the
desktop browser test, when we have the Welcome Center popping up
on boot.

We already moved the mouse set point from 300/200 a few years
back because of a *different* awkward interaction with the browser
test, so we can't go back there. Let's try 1023/384 instead -
that's all the way on the right hand side of the screen, but half
way down, not in either corner. I really hope this doesn't cause
problems for any tests cos I don't know where else to stick the
damn thing if this doesn't work.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-12-04 09:15:17 -08:00
Adam Williamson
b2928ff399 KDE app start/stop test updates for Plasma 6
Several needle updates and a tweak to the text we type to launch
kinfocenter (just "info" now launches something else).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-11-30 18:05:37 -08:00
Adam Williamson
af73a24f50 Drop dbusviewer from KDE apps start/stop test
khotkeys was removed from Plasma 6, and qdbusviewer was only on
the live image because khotkeys recommended it, so now it's gone.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-11-30 12:12:09 -08:00
Adam Williamson
683234d7a5 Simplify package set selection in anaconda
tab will both reach the environment selection list and then go
through it, so we don't need to start out with tab and then
switch to down. And since all we need to do is hit one key until
a needle matches, let's use the handy function os-autoinst
provides for doing this...

This should fix it on current Rawhide (where it only takes one
tab, or zero tabs - not sure which - to reach the list).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-11-29 16:20:13 -08:00
Adam Williamson
4e62eb8ec5 Remove the anaconda_help test
Help support has been removed from anaconda:
https://github.com/rhinstaller/anaconda/pull/5335
so we no longer ought to test it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-11-29 12:11:00 -08:00
Adam Williamson
13404c6aaf loupe: don't pass args to download_testdata
You can see what these args are trying to do, but the function
does not currently work that way. I think running it without
args should get what the test wants. If Lukas wants to refine
download_testdata so you can specify the payload and where to
extract it, he can do that, then put this back...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-11-27 10:53:31 -08:00
Adam Williamson
1ecbd28f82 desktop_login: get rid of KDE welcome tour
The KDE welcome tour is getting in the way of the desktop login
test. Try getting rid of it after logging in.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-11-27 09:55:34 -08:00
Adam Williamson
461e211618 Drop use of PXEBOOT, rely on default boot order
Per https://progress.opensuse.org/issues/151258 , PXEBOOT=once
doesn't work right in current os-autoinst. Now I look at it,
PXEBOOT is just pretty ropey in general; on UEFI and aarch64 it
doesn't actually do anything at all, we're actually just relying
on the default boot order there.

Since it doesn't seem like there's a practical way to make
PXEBOOT=once work as intended on all platforms, let's just drop
use of it and make it clear that we rely on the default boot
order: we hope that on first boot we'll get a PXE boot since no
local media are bootable, then on second boot we'll get a local
disk boot.

We set up a new IS_PXE variable to cue the couple of places where
the test logic needs to be different.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-11-21 16:23:25 -08:00
Lukas Ruzicka
d50885e584 Create a test for basic Flatpak operations.
This PR tries to respond to issue #294.
On Silverblue, this will try:

* flatpak install
* flatpak remote-add
* flatpak list
* flatpak remotes
* flatpak remove
* flatpak update

and also it tests that a flatpak can be built.
2023-11-13 10:37:52 -08:00
Adam Williamson
849753a047 Fix an error in desktop_printing soft fail path (oops)
thanks, tidy

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-11-13 08:39:43 -08:00
Adam Williamson
dd946b0960 desktop_printing: adjust to g-t-e dying after print
It seems like in current Rawhide (since about Saturday - possibly
due to new mesa?), g-t-e quite often dies after we print. This
messes up the test because we wind up quitting the terminal
instead of g-t-e. Let's handle it as a soft failure instead,
until we can figure out why g-t-e is dying.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-11-06 20:36:18 -10:00
Adam Williamson
e60a390db2 some waiting and screenshots to debug desktop_printing fails
desktop_printing is failing a lot in recent Rawhide (and so are
some other tests, but this one is nice and easy to target). Add
some wait_still_screens and save_screenshots to try and see
exactly what's going on when we exit gnome-text-editor before
switching to a VT.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-11-06 09:51:10 -08:00
Adam Williamson
4e3a284220 krfb: handle two cancel buttons
In today's Rawhide, two dialogs have to be cancelled on krfb
launch before we see the UI: a remote control permission screen
and a kwallet creation flow.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-10-24 08:21:51 -07:00
Adam Williamson
475ee6b89c loupe: add a wait at start of browse test
We often get a failure where it's stuck at a spinner here, let's
see if waiting to settle the snapshot resume helps.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-10-17 15:33:53 -07:00
Adam Williamson
69dad7a975 sysmon: click, don't use shortcuts, to switch views
It looks like
https://gitlab.gnome.org/GNOME/gnome-system-monitor/-/issues/262
won't be fixed for a while - the fixes are tied up with the GTK
4 port - so let's just work around it for now by clicking instead
of using keyboard shortcuts.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-10-17 15:30:31 -07:00
Adam Williamson
f36d04e650 KDE start/stop krfb: dismiss Wallet window if it shows up
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-10-17 09:15:21 -07:00
Adam Williamson
c697ca171d Adjust to replacement of cheese with snapshot (Camera)
A new app called snapshot (Camera, on the menus) has replaced
cheese in F40 (but not F39). Adjust to that. We can simplify
this when F39 is out.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-10-15 10:21:17 -07:00
Adam Williamson
1db0e7465a Drop kmag test on F40+
kmag was removed in
https://pagure.io/fedora-comps/c/bb332b310b22a1103347afece6f845087694d85e?branch=main
we can't drop the test entirely yet as it's still in F39. Will
drop this after F39 is released.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-10-15 09:10:51 -07:00
Adam Williamson
22e174069e gnome-panel: set update notification timestamp early
If we do it after forcing the clock to 18:30, doing it takes so
long we wind up at 18:32, and that kinda sets the rest of the
test out of whack (we have several needles that assume we start
at 18:30 or 18:31 after the snapshot). So let's set the update
timestamp *before* we force the clock. This will mean it's waay
in the future after we force the clock, but that should still
do the job of avoiding notifications showing up, I hope.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-10-14 10:34:01 -07:00
Adam Williamson
b043e99430 Drop EOG alternate path in Maps export image test
Silverblue now has Loupe, like Workstation, so the paths are the
same.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-10-14 10:24:24 -07:00
Lukas Ruzicka
b1799eb084 Use the new subroutine on desktop tests. 2023-10-10 17:43:21 -07:00
Adam Williamson
eb6a47f462 Adjust konversation test to run neochat on Rawhide
KDE replaced Konversation (IRC client) with Neochat (Matrix
client) in Rawhide. As the replacement isn't done in F39 we can't
just switch the test out, we have to handle both, so for now,
let's have the "konversation" test run neochat on Rawhide.

We can't really proceed through neochat's first run wizard as
it needs a Matrix account name and password and we don't want
the hassle of handling a secret just for this, so we'll just
quit out once we see it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-09-26 15:53:54 -07:00
Lukáš Růžička
9e0d74453c Create a test suite for Loupe (Image Viewer)
This PR adds a test for a new Image Viewer called Loupe.
It is based on the old Image Viewer test, newly reneedled
with some of the tests shortened, deleted or edited
as the new Image Viewer has a little bit less functions
compared to the previous one.

Add needles.
2023-09-20 10:29:39 +02:00
Adam Williamson
413dba4c95 Give live image tool install longer to run
It's timing out on stg quite a lot.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-09-19 12:47:35 -07:00