Commit Graph

3202 Commits

Author SHA1 Message Date
Adam Williamson edcbf6a524 Wipe the openh264 repo a bit harder
We should wipe it both before and after running repo_setup to
really get rid of it. Ideally we should stop doing this at all,
but for right now the repo isn't there for Rawhide post-F40
branching yet, so let's keep this until that's done.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-02-14 14:22:44 -08:00
Adam Williamson d998a56383 Add 41 to the workarounds table
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-02-14 13:35:32 -08:00
Adam Williamson 541d637726 Revert local testing change to setup_repos.py
Er, whoops, that was *not* meant to get rolled into an unrelated
commit and break every test on the public instance. Sorry.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-02-14 12:48:36 -08:00
Adam Williamson b371331436 _ostree_build: handle change to repos in workstation-ostree-config
The place where repos are defined changed on the F40+ branches
of workstation-ostree-config, this handles both possibilities.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-02-14 12:29:51 -08:00
Adam Williamson f8f1d0d433 Add mock and mock-core-configs to F40 workarounds
I'm hoping this will fix live image builds.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-02-14 11:58:43 -08:00
Adam Williamson 6d4a8a9fb7 setup_repos: fix a logic bug
we might be on a non-update waonly path here, we can't bail in
that case.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-02-14 11:45:37 -08:00
Adam Williamson de4735f6f1 Soft fail on missing background for F40
...we know there isn't one yet.
https://bugzilla.redhat.com/show_bug.cgi?id=2230720

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-02-14 00:43:46 -08:00
Adam Williamson e6dabfa0df f40 workarounds: drop old anaconda build, add new lorax
We don't need this anaconda scratch build any more (the official
build has the fix now), but we *do* need the new lorax update I
just built to fix installer image builds with branched F40. See
https://github.com/weldr/lorax/pull/1379

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-02-14 00:15:09 -08:00
Adam Williamson 375250000f Add a wait_still_screen to update_graphical for an animation
GNOME Software seems to be doing some kind of animation between
the third party dialog and the main UI, and we're clicking on
a banner instead of the update button. Try a wait_still_screen
to deal with this.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-02-12 09:55:31 -08:00
Adam Williamson 2148674ed4 Update a couple more KDE needles for Plasma 6
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-02-10 00:07:56 -08:00
Adam Williamson 7e33a327f1 Update gnome-software refresh needle for 46~beta
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-02-10 00:07:04 -08:00
Adam Williamson b1cb7a04ad Drop match level on gnome-software refreshing needle
Updating this needle is a pain, and we have a 0.95 match. This
is easier!

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-02-09 23:47:11 -08:00
Adam Williamson 6e719d0f93 Fine, just drop the match level on the Updates needle then
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-02-09 17:28:23 -08:00
Adam Williamson fb5e5a22a7 Tweak GNOME Software Updates needle match area slightly
It kinda looks like the text has been moved closer to the icon
in the latest gnome-software, such that the little '1' bubble
is now in the needle match area if it's present. Obviously that
may vary, so let's tweak the needle match area a bit to the
right so it's hopefully consistent and still matches on older
versions.
2024-02-09 15:41:40 -08:00
Adam Williamson 965dc99ef5 Give ostree_build another half hour again
Another bunch of these timed out. Not sure why. Maybe it's when
I run a lot of them at the same time? Let's try this, again.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-02-06 23:07:25 -08:00
Adam Williamson fa5cedc63a Add anaconda workaround build for #2262892
This adds a scratch build with my proposed patch:
https://github.com/rhinstaller/anaconda/pull/5460
to get the tests to start passing again, so we don't have the
flood of red which makes it hard to spot other problems.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-02-06 16:51:55 -08:00
Adam Williamson 811ff708d2 Update a KDE notification needle
Different shade of grey again or something.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-02-03 09:26:59 -08:00
Adam Williamson 61910e7610 Make tidy happy with how we disabled accounts.fp.o check
Sigh, this is less obvious but we need the tests to pass.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-02-03 09:25:44 -08:00
Adam Williamson e805837597 Update a system monitoring needle for Silverblue
This got missed in the big GNOME 46 needle update because
Silverblue wasn't composing.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-02-03 09:08:23 -08:00
Adam Williamson 2238723977 Add yet another bike route variant for Maps
Seriously, Google, figure out where people in the UK should ride
their bikes already.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-02-03 09:06:39 -08:00
Adam Williamson 73c6e7fc8a Update several Arabic needles
The font has changed a bit, I think, and the Done button is now
translated.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-02-03 09:05:01 -08:00
Adam Williamson f8de09df24 desktop_browser: temporarily disable FAS homepage check again
accounts.fp.o seems to be unreliable again today, let's drop this
again so tests don't fail on it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-31 13:28:53 -08:00
Adam Williamson 09e4f526a8 Revert "Give ostree_build another half hour"
This reverts commit 56c9e80f60.
Things seem to have settled down with the mass rebuild and this
test seems to be back to consistently taking about 90 minutes.
2024-01-30 09:47:44 -08:00
Adam Williamson 56c9e80f60 Give ostree_build another half hour
It seems to be timing out a lot on Rawhide lately. Not sure if
it's just mass rebuild stuff, but anyhow...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-29 17:03:30 -08:00
Adam Williamson ce6beac5a6 Revert "base_services_start: temporarily allow colord to fail (#2260663)"
This reverts commit ab5b1a4367. A
new colord build has been pushed which should resolve the issue,
so I'm disabling the workaround to ensure that's the case.
2024-01-29 08:30:08 -08:00
Adam Williamson fdb008ad65 Update a bunch of GNOME app needles for GNOME 46
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-27 13:58:24 -08:00
Adam Williamson 96256be7a3 Add a workaround needle for Japanese input source selection
There's an untranslated string here, so this has to be a
workaround needle. I didn't get to reporting the missing
translation yet.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-27 13:55:13 -08:00
Adam Williamson 6e872d4126 Update the Turkish 'accept your fate' anaconda needle
Translation changed.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-27 13:54:40 -08:00
Adam Williamson ab5b1a4367 base_services_start: temporarily allow colord to fail (#2260663)
Somehow, colord is sometimes failing to start in stable Rawhide
ATM - I don't know how this problem got through testing. It's
now blocking other updates.

Doing this only on x86_64 is lazy and wrong, but the logic gets
way more complicated if we need to allow potentially *two* things
to fail on aarch64 and ppc64le, and it's the weekend and we
don't gate updates on those arches so I'm not doing it. Hopefully
this will be resolved quite quickly.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-27 13:50:58 -08:00
Adam Williamson 1fbe886229 Add one more color logged_in needle variant
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-25 23:10:48 -08:00
Adam Williamson f799a2c5af Add another addon_install needle for Firefox
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-25 16:30:58 -08:00
Adam Williamson c9a5f67d21 Update logged_in needles for color shell prompt
The color shell prompt feature just got applied to VTs in Rawhide.
That broke...everything. Here, new needles!

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-25 16:15:51 -08:00
Adam Williamson afaa8284d9 Update a Maps route needle for a route change
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-24 13:46:22 -08:00
Adam Williamson 3889a6f009 Update Firefox needles for 122.0
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-24 13:45:47 -08:00
Adam Williamson 4ad5834023 Various Plasma 6 needle updates that were lying around prod
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-24 13:45:22 -08:00
Adam Williamson 5379850780 setup_repos: fix setup_repos.py call for KOJITASK case
I forgot to actually set the string in this case. Whoops.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-24 11:16:07 -08:00
Adam Williamson b40ab389b7 Revert "desktop_browser: temporarily disable FAS homepage check"
This reverts commit a9c6111499. The
system is more or less working again, so it should be safe now.
2024-01-24 08:45:23 -08:00
Adam Williamson a9c6111499 desktop_browser: temporarily disable FAS homepage check
FAS is down right now, so let's skip testing accounts.fp.o as it
will fail.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-22 09:16:20 -08:00
Adam Williamson d23e5d7dd7 Bump the default bootloader timeout a bit
We're taking a long time to reach it on aarch64 on prod recently
for some reason. It's probably some weirdness with qemu/edk2. So
let's just bump the timeout as I don't have an easy fix on hand
and this won't hurt anything.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-19 15:24:19 -08:00
Adam Williamson e0ac7b3ca5 Add some missing test coverage for fifloader
Mainly covering the retry stuff, but also another thing that's
been missing for a while but which we totally can cover.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-18 11:41:01 -08:00
Adam Williamson 9cf3105168 Try a longer timeout for the rpm-ostree cancels in overlay
We seem to be getting quite a lot of failures in update tests
where this times out. Let's try a longer timeout.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-17 11:48:01 -08:00
Adam Williamson 4dd94df3bc get setup_repos.py from main branch not concdl now it's merged
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-11 15:38:10 -08:00
Adam Williamson 5f702b0be8 Run update repo setup steps from a serial console
This is a surprisingly large change as we want to go back to
the console we were previously on after doing it. To do that we
need to know what console we were on, and to know *that*, we need
to port everything that currently uses (ctrl-)alt-fX to switch
consoles to use select_console instead.

This is primarily intended to make running setup_repos.py faster
when it has to download a lot of packages (as typing in hundreds
of package names is quite slow). But it actually makes the whole
thing faster, even when only downloading one or two packages.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-11 12:09:59 -08:00
Adam Williamson d445a80016 update testing: use a concurrent script to download packages
This uses a Python script which implements concurrent downloads
(via asyncio) to download workaround and update packages and
configure the repos. This should speed up the process for large
multi-package updates.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-11 11:31:40 -08:00
Adam Williamson 8251756331 Revert to having tests, not the scheduler, download packages (#108)
This effectively reverts 97618193 - but had to be done manually
and adjusted to maintain support for testing side tags and for
testing multiple tasks, since those features were added since
the update ISO change.

The 'scheduler injects ISOs of packages into the tests' approach
was intended to speed things up, especially for large updates,
and it did, but it had a few drawbacks. It means restarting
older tests from the web UI doesn't work as the ISOs get garbage
collected (you have to re-schedule in this case). And it has the
rather large problem that you can now only schedule tests from
the openQA server (or at least a machine with the openQA asset
share mounted), because the package download and ISO creation
just happen wherever the scheduler is running and assume that
the openQA asset share that will be used by the tests is at
/var/lib/openqa/share in that filesystem.

That's too big of a drawback to continue with this approach, IMO,
so this reverts back to the old way of doing things, with a bit
of refactoring to clean up the flow a little, and with support
for testing side tags and multiple tasks maintained.

As a follow-up I'm going to see if I can replace
_download_packages with a much more efficient downloader script
to mitigate the time this process takes on each test, especially
for large updates.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-11 11:31:40 -08:00
Adam Williamson 6654e522ac app start/stop tests: use normal flags for GNOME Terminal test
This test had special flags because it used to be run first and
did the prep steps for the other tests. Now the aaa_setup test
does that job, so there's no reason for this test to have these
flags any more, and somehow they seem to be breaking the test on
Rawhide. Let's give it the same flag as all the other normal
tests.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-10 12:43:45 -08:00
Adam Williamson 33b9df20d3 Update several needles for GNOME 46
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-10 09:30:06 -08:00
Adam Williamson 89382a3b71 Drop a stray dbusviewer needle
We removed the test a while back, as the app is not in a default
KDE install any more.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-09 17:53:12 -08:00
Adam Williamson abc5e7c679 Plasma notifications: drop the Akonadi migration note check
Per the needle cleanup, we do not seem to have seen it for some
time.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-09 17:52:15 -08:00
Adam Williamson 6f5b10dbe6 Drop workaround for RHBZ #2170544
The change was reverted, and per the needle cleanup, we have not
seen this path for some time.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-09 17:50:24 -08:00