Commit Graph

3028 Commits

Author SHA1 Message Date
Adam Williamson ce6beac5a6 Revert "base_services_start: temporarily allow colord to fail (#2260663)"
This reverts commit ab5b1a4367. A
new colord build has been pushed which should resolve the issue,
so I'm disabling the workaround to ensure that's the case.
2024-01-29 08:30:08 -08:00
Adam Williamson fdb008ad65 Update a bunch of GNOME app needles for GNOME 46
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-27 13:58:24 -08:00
Adam Williamson 96256be7a3 Add a workaround needle for Japanese input source selection
There's an untranslated string here, so this has to be a
workaround needle. I didn't get to reporting the missing
translation yet.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-27 13:55:13 -08:00
Adam Williamson 6e872d4126 Update the Turkish 'accept your fate' anaconda needle
Translation changed.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-27 13:54:40 -08:00
Adam Williamson ab5b1a4367 base_services_start: temporarily allow colord to fail (#2260663)
Somehow, colord is sometimes failing to start in stable Rawhide
ATM - I don't know how this problem got through testing. It's
now blocking other updates.

Doing this only on x86_64 is lazy and wrong, but the logic gets
way more complicated if we need to allow potentially *two* things
to fail on aarch64 and ppc64le, and it's the weekend and we
don't gate updates on those arches so I'm not doing it. Hopefully
this will be resolved quite quickly.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-27 13:50:58 -08:00
Adam Williamson 1fbe886229 Add one more color logged_in needle variant
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-25 23:10:48 -08:00
Adam Williamson f799a2c5af Add another addon_install needle for Firefox
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-25 16:30:58 -08:00
Adam Williamson c9a5f67d21 Update logged_in needles for color shell prompt
The color shell prompt feature just got applied to VTs in Rawhide.
That broke...everything. Here, new needles!

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-25 16:15:51 -08:00
Adam Williamson afaa8284d9 Update a Maps route needle for a route change
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-24 13:46:22 -08:00
Adam Williamson 3889a6f009 Update Firefox needles for 122.0
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-24 13:45:47 -08:00
Adam Williamson 4ad5834023 Various Plasma 6 needle updates that were lying around prod
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-24 13:45:22 -08:00
Adam Williamson 5379850780 setup_repos: fix setup_repos.py call for KOJITASK case
I forgot to actually set the string in this case. Whoops.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-24 11:16:07 -08:00
Adam Williamson b40ab389b7 Revert "desktop_browser: temporarily disable FAS homepage check"
This reverts commit a9c6111499. The
system is more or less working again, so it should be safe now.
2024-01-24 08:45:23 -08:00
Adam Williamson a9c6111499 desktop_browser: temporarily disable FAS homepage check
FAS is down right now, so let's skip testing accounts.fp.o as it
will fail.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-22 09:16:20 -08:00
Adam Williamson d23e5d7dd7 Bump the default bootloader timeout a bit
We're taking a long time to reach it on aarch64 on prod recently
for some reason. It's probably some weirdness with qemu/edk2. So
let's just bump the timeout as I don't have an easy fix on hand
and this won't hurt anything.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-19 15:24:19 -08:00
Adam Williamson e0ac7b3ca5 Add some missing test coverage for fifloader
Mainly covering the retry stuff, but also another thing that's
been missing for a while but which we totally can cover.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-18 11:41:01 -08:00
Adam Williamson 9cf3105168 Try a longer timeout for the rpm-ostree cancels in overlay
We seem to be getting quite a lot of failures in update tests
where this times out. Let's try a longer timeout.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-17 11:48:01 -08:00
Adam Williamson 4dd94df3bc get setup_repos.py from main branch not concdl now it's merged
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-11 15:38:10 -08:00
Adam Williamson 5f702b0be8 Run update repo setup steps from a serial console
This is a surprisingly large change as we want to go back to
the console we were previously on after doing it. To do that we
need to know what console we were on, and to know *that*, we need
to port everything that currently uses (ctrl-)alt-fX to switch
consoles to use select_console instead.

This is primarily intended to make running setup_repos.py faster
when it has to download a lot of packages (as typing in hundreds
of package names is quite slow). But it actually makes the whole
thing faster, even when only downloading one or two packages.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-11 12:09:59 -08:00
Adam Williamson d445a80016 update testing: use a concurrent script to download packages
This uses a Python script which implements concurrent downloads
(via asyncio) to download workaround and update packages and
configure the repos. This should speed up the process for large
multi-package updates.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-11 11:31:40 -08:00
Adam Williamson 8251756331 Revert to having tests, not the scheduler, download packages (#108)
This effectively reverts 97618193 - but had to be done manually
and adjusted to maintain support for testing side tags and for
testing multiple tasks, since those features were added since
the update ISO change.

The 'scheduler injects ISOs of packages into the tests' approach
was intended to speed things up, especially for large updates,
and it did, but it had a few drawbacks. It means restarting
older tests from the web UI doesn't work as the ISOs get garbage
collected (you have to re-schedule in this case). And it has the
rather large problem that you can now only schedule tests from
the openQA server (or at least a machine with the openQA asset
share mounted), because the package download and ISO creation
just happen wherever the scheduler is running and assume that
the openQA asset share that will be used by the tests is at
/var/lib/openqa/share in that filesystem.

That's too big of a drawback to continue with this approach, IMO,
so this reverts back to the old way of doing things, with a bit
of refactoring to clean up the flow a little, and with support
for testing side tags and multiple tasks maintained.

As a follow-up I'm going to see if I can replace
_download_packages with a much more efficient downloader script
to mitigate the time this process takes on each test, especially
for large updates.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-11 11:31:40 -08:00
Adam Williamson 6654e522ac app start/stop tests: use normal flags for GNOME Terminal test
This test had special flags because it used to be run first and
did the prep steps for the other tests. Now the aaa_setup test
does that job, so there's no reason for this test to have these
flags any more, and somehow they seem to be breaking the test on
Rawhide. Let's give it the same flag as all the other normal
tests.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-10 12:43:45 -08:00
Adam Williamson 33b9df20d3 Update several needles for GNOME 46
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-10 09:30:06 -08:00
Adam Williamson 89382a3b71 Drop a stray dbusviewer needle
We removed the test a while back, as the app is not in a default
KDE install any more.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-09 17:53:12 -08:00
Adam Williamson abc5e7c679 Plasma notifications: drop the Akonadi migration note check
Per the needle cleanup, we do not seem to have seen it for some
time.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-09 17:52:15 -08:00
Adam Williamson 6f5b10dbe6 Drop workaround for RHBZ #2170544
The change was reverted, and per the needle cleanup, we have not
seen this path for some time.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-09 17:50:24 -08:00
Adam Williamson 45c7e7a63a disks: drop a workaround we did not hit for a long time
The issue is not marked as fixed, but per the needle cleanup we
have not hit this workaround condition for a long time. I checked
past failures and it doesn't look like we're still hitting the
problem but the needle stopped matching, or anything.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-09 17:48:28 -08:00
Adam Williamson 99b3ef8f03 kontakt: drop the check for 'enable_unified_mailboxes'
Per the needle cleanup, it hasn't been seen for some time. The
test is failing ATM but even the last time it passed -
https://openqa.fedoraproject.org/tests/2311371#step/kontakt/3 -
we did not see this.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-09 17:44:47 -08:00
Adam Williamson 247e8dd822 gnome-text-editor: drop setting of English language
The bug this was meant to fix hasn't happened for months. Back
in Fedora-Rawhide-20230629.n.0 we were seeing every line in the
poem marked as a spelling error until we did this, but that's
not happening any more, we don't need this.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-09 17:41:27 -08:00
Adam Williamson 5e3f39209d Workaround KDE kickstart referencing new comps group
This breaks things until a compose has happened and comps data
with the new group in it is actually out there in the repos. So
we need to hack it back out again till a compose goes through.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-04 15:01:15 -08:00
Adam Williamson 50b4e70a1f Old needle cleanup 2024-01-02
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-03 17:48:30 -08:00
Adam Williamson f7a337db9e Fix the retry logic in fifloader.py
subprocess.run raises an exception by default if the command
fails, you don't have to look for the return code.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-03 17:47:48 -08:00
Adam Williamson 04e9f84338 decrypt: instead of waiting, let's try slow typing
Seems the bug might just be that plymouth got more sensitive to
fast typing, so instead of waiting, let's try slow typing.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-03 17:40:31 -08:00
Adam Williamson f2dcfed498 Also settle during the setup stage for Maps
This has similarly been failing quite a lot lately, let's see if
a sleep helps here.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-03 15:31:56 -08:00
Adam Williamson 6e95581865 Calculator: delay before snapshotting
In some tests on staging this seems to help with the 'clicks
don't work in later test steps' problem we're seeing a lot.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-03 15:12:44 -08:00
Adam Williamson 32a7798037 Make Silverblue install target disk bigger
It's defaulting to 10Gi, which definitely has caused *some*
issues (the flatpak test fails because there isn't enough disk
space). I'm hoping this will turn out to explain why SB tests
have been generally so unreliable lately.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-03 15:03:24 -08:00
Adam Williamson ce0a04b40a Wait and re-assert before entering decryption passphrase (#2256682)
New Plymouth seems to have a bug where it shows the decryption
prompt briefly then shows a spinner and refreshes it, throwing
away any already-typed input. This is breaking our tests quite
often (any time os-autoinst is "lucky" enough to spot the first
brief appearance of the prompt and start typing). To work around
it, after we first see the prompt, wait for the screen to settle
and re-assert the needle before typing. This should reliably
wait out the refresh cycle.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-03 14:13:30 -08:00
Adam Williamson 7b453a493c autocloud: blocking off more atomic tests on non-atomic images
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-02 14:06:35 -08:00
Adam Williamson a4e63df10f New weather icon: snow!
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-02 12:04:47 -08:00
Adam Williamson ec87c19d65 Add a couple more KDE printing check sentence variants
Why this rendering changes so much I do not know.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-02 12:04:04 -08:00
Adam Williamson 32621bd042 Drop KDE live build workaround we no longer need
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-12-23 12:10:41 -08:00
Adam Williamson 88b3213af4 autocloud: only run atomic test on canned (==atomic) installs
It seems Python 3.12.1 changed unittests' behaviour so that all
tests being skipped is now a fail not a pass. That breaks this
test because TestAtomic01Status only does anything if this is
an atomic system. So, let's just skip that test entirely if we
aren't one. As things stand this means the test will never run,
because we only test on Cloud_Base which is not atomic.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-12-23 12:04:50 -08:00
Adam Williamson 893052197d Workaround needed comps change for KF6 rebuild
https://pagure.io/fedora-comps/pull-request/920 is a required
comps change now
https://bodhi.fedoraproject.org/updates/FEDORA-2023-ad16578136
landed in stable, but it won't be in the public comps data till
after the next compose. This reproduces the same effect on the
fly in the KDE kickstart when doing the KDE live image build
test, so it will pass.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-12-15 13:20:34 -08:00
Adam Williamson 107715a3de Update KDE printing needles for Plasma 6 changes (I guess)
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-12-06 11:41:34 -08:00
Adam Williamson 3e8178fa51 Add a variant '7' button calculator needle
I *think* it gets shaded slightly when we have to click it twice
in a row, or something.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-12-06 11:40:45 -08:00
Adam Williamson ee661e1812 Update KDE user confirm needles for latest Plasma
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-12-05 17:59:52 -08:00
Adam Williamson 3f27e90117 Update KDE no notifications needle again
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-12-05 17:23:10 -08:00
Adam Williamson c05dfdd120 Fix KDE background solidification for change to sddm-breeze
There used to be a theme.conf.user file, there isn't any more.
I think this should work both before and after.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-12-05 17:17:42 -08:00
Adam Williamson fc7affc473 limpress: use esc not alt-f4 to close template chooser
See https://bugzilla.redhat.com/show_bug.cgi?id=2252806 for why,
we're working around that.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-12-04 11:18:12 -08:00
Adam Williamson 2c476fded6 Add a retry loop to fifloader
load_templates often fails for no good reason - see
https://progress.opensuse.org/issues/121378 . This makes
fifloader retry 20 times on failure to mitigate the issue.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-12-04 10:18:47 -08:00