1
0
mirror of https://pagure.io/fedora-qa/os-autoinst-distri-fedora.git synced 2024-11-11 01:24:20 +00:00
Commit Graph

663 Commits

Author SHA1 Message Date
Adam Williamson
fd3a6d1941 Drop a no-longer-needed workaround
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-08-13 15:27:26 -04:00
Adam Williamson
5132786456 Add 42 to workarounds hash
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-08-13 15:10:15 -04:00
Adam Williamson
4be9ce3e88 Use 'terminal' instead of 'gnome-terminal' for ptyxis switch
In several places we run 'gnome-terminal' explicitly, but as of
today's compose, the default terminal app on GNOME in Rawhide is
ptyxis, not gnome-terminal.

Running 'terminal' should launch whichever is correct, so let's
consistently do that.

Also, add an apps_run_terminal needle and navigation navbar
needle for ptyxis.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-08-13 10:39:20 -04:00
Adam Williamson
3f951b47d8 Run update package version check on installer environments
As discussed in https://pagure.io/releng/failed-composes/issue/6538
we noticed a gap in openQA coverage here. We don't check the
versions of packages lorax installs to the installer environment,
and those packages do not make it to the installed system, so if
there's a dep issue that prevents a package in the update from
being included in the installer environment, but the same dep
issue isn't caught on any other path, we miss the problem. This
wires the updvercheck.py script into the _installer_build and
_ostree_build tests to catch this kind of problem, and makes it
capable of parsing pylorax.log files into its preferred format
to enable that.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-08-02 15:10:53 -07:00
Adam Williamson
107d7ce03d Add FEDORA-2024-f86a143437 to workarounds (pd-mapper for F40)
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-07-20 09:24:17 -07:00
Adam Williamson
7945c797fa Remove FEDORA-2024-442827752b and 120746008 from workarounds
Both are stable now.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-07-20 09:23:52 -07:00
Adam Williamson
92ea362578 Add pd-mapper scratch build as workaround
To fix base_services_start always failing on aarch64, while I
wait for review of the upstream and downstream PRs.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-07-19 12:23:47 -07:00
Adam Williamson
187e3486be podman bats: tee the output to a log file and upload it
...this makes it much easier to see what's failing if it fails.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-07-17 18:22:53 -07:00
Adam Williamson
0bde610430 Add updated plymouth as workaround for F39
To deal with the UEFI passphrase entry issue, now F39 has kernel
6.9.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-07-10 16:00:58 -07:00
Adam Williamson
51f1654224 Drop 38 from workarounds matrix
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-07-10 16:00:48 -07:00
Adam Williamson
8cbf280e93 Tweak the select_disks special case for another anaconda change
anaconda now no longer protects the entire disk which contains
stage 2 or is being used as an install source, it protects only
the relevant partition:
https://github.com/rhinstaller/anaconda/pull/5687
so we want to go down the regular path again with F41+. We can
drop the "before F39" bound now, as F38 is EOL.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-07-05 09:50:26 -07:00
Adam Williamson
5fda734892 tag/copr updatepkgs.txt generation: filter arches
If the repo has source packages in it, we get a badly-formed
updatepkgs.txt that breaks updvercheck. So let's filter to only
packages of the target arch and noarch.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-06-26 15:16:22 -07:00
Adam Williamson
146e41cca5 Install python3-dnf before running updvercheck.py
...when we're not in an atomic (canned) env, anyway. If we are,
we'll rely on it already being there (as previously ensured by
an earlier commit).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-06-26 10:56:23 -07:00
Adam Williamson
c8de083f1c Revert "disable_firefox_studies: use SUSE style and add SUSE values"
This reverts commit a3f4a6f2e6. It
seemed to cause *more* annoying bars in Firefox than before, for
some reason, I don't know why. Reverting till I can do more
testing on lab.
2024-06-21 12:46:50 -07:00
Adam Williamson
a3f4a6f2e6 disable_firefox_studies: use SUSE style and add SUSE values
SUSE has a much nicer style for handling all the nested quoting
and stuff in creating the autoconfig files, so switch to that,
and also merge in all the SUSE autoconfig values...the more the
merrier, for making Firefox be less annoying. I'm hoping this
might suppress the "Add a splash of color" modal that's breaking
tests ATM.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-06-21 10:26:57 -07:00
Adam Williamson
e30060218b Drop a workaround that went stable weeks ago
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-06-19 12:53:10 -07:00
Adam Williamson
943c4193d3 Factor out the KDE launcher double-typing workaround, use it more
There's a couple of places where we do menu_launch_type in KDE
without doing this workaround first, and they do run into the
bug sometimes. Let's factor it out from the few places it's
already repeated, and add it to the places it is missing.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-06-11 16:21:00 -07:00
Adam Williamson
304699bc6f Defend even harder against progress spew in updatepkgs.txt
Seems current dnf5 has a bug which causes repository refresh
progress to be sent to stdout even with -q.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-06-11 09:13:01 -07:00
Adam Williamson
670d1072de Yet more timeout
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-06-11 08:17:22 -07:00
Adam Williamson
e2fde7809c Bump advisory_check timeout even more for really huge "updates"
...well, in this case, the Python side tag, because side tags
that inherit have just *all* the packages in them.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-06-11 00:56:29 -07:00
Adam Williamson
5aaf78bf26 Adjust COPR / tag package info generation for dnf5 properties
dnf5 behaves differently from dnf < 5 in a couple of ways: like
rpm it does not always add a newline to the query format, and it
sends its status messages to stdout, not stderr. These commands
account for this and produce identical output with dnf < 5 and
dnf 5.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-06-11 00:33:36 -07:00
Adam Williamson
a36e86fcf8 setup_repos: don't die on tag/COPR if there are workarounds
whoops, this bailout is too hard. we get here on tag/COPR path
if there are workarounds, that is fine.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-06-10 23:47:30 -07:00
Adam Williamson
f14200e50d Update cockpit autoupdate test for new dnf5 service
The service cockpit enables is different when it detects dnf5,
since cockpit 317. Let's just make this an F40/F41 boundary
thing, and add the cockpit 317 update as a workaround for F41
until it goes stable.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-29 17:43:12 -07:00
Adam Williamson
af06ac0809 Add a workaround for alt-d-s not working right after login
This broke the KDE app start/stop test. We need to click on the
desktop before alt-d-s will work, for some reason.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-28 16:02:06 -07:00
Adam Williamson
a353caeb90 Enable testing of COPRs, fix some issues, enable package checks
This works more or less like testing side tags. We also fix up
some flow problems with this path (that also affect the side tag
case), and enable the package checks on this path - it's not too
hard really, we just need to write the updatepkgs file when we
set up the repo, which we can do with dnf repoquery.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-03 14:40:34 -07:00
Adam Williamson
46c0719e66 Let installedupdatepkgs generation take longer in a container
From https://openqa.fedoraproject.org/tests/2594954 it looks
like this takes more than three minutes for updates with hundreds
of packages when running in a container (in the container build/
validate test). So, let's give it more time in that case.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-25 10:51:51 -07:00
Adam Williamson
9f2d44a181 drop a FIXME on enabling/disabling repos with sed
dnf5 config-manager can now do this, but the syntax is different
to dnf4, and honestly, it seems easier to just stick with this
going forward than make it conditional on dnf version until
dnf4 goes away. So let's stop marking this as a FIXME.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-22 16:14:29 -07:00
Adam Williamson
f4bd3c6f58 Add a container build test
This test, much like _live_build or _installer_build, builds a
container image in a way intended to be as similar as possible
to how official compose images are built. The purpose of the test
is to make sure updates do not break official container image
builds.

At the end of the test, we also check that the built container
is functional (at least, that we can run a 'hello world' command
in it). This can't really be rolled into podman.pm because that
test is more about testing podman itself, and it's just a one-
liner here anyway. We also run the 'if any packages from the
update are installed, are they the versions from the update?'
check inside the container, which required giving that check the
ability to 'wrap' the rpm commands to run inside a container.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-22 16:01:41 -07:00
Adam Williamson
d65aac4c83 Drop a no-longer-needed workaround
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-19 16:30:52 -07:00
Adam Williamson
a8f547f5ef Fix check_prerelease when we don't care
I inadvertently broke this in the logic change in the previous
commit to this.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-14 08:36:50 -07:00
Adam Williamson
a07ad20240 Add FEDORA-2024-b156c57ef1 as F40 workaround to fix upgrades
See https://bugzilla.redhat.com/show_bug.cgi?id=2274833. Upgrades
from F39 to F40 fail without this.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-12 18:59:41 -07:00
Adam Williamson
fcbb00d0ac Drop workaround which went stable weeks ago
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-12 18:59:24 -07:00
Adam Williamson
4938c0e5ae Make pre-release check a soft failure on osbuild images
osbuild is struggling with the pre-release warnings ATM:

https://pagure.io/fedora-iot/issue/57
https://github.com/osbuild/images/issues/515

Until that mess is cleaned up we can't really make sensible
assertions for osbuild images, so let's make the check a soft
failure for now (now we know about the bugs, we want to let
the rest of the tests run and not block them on this).

Note for IoT the behaviour has never really been correct (IoT
images never get pre-release warnings), but the logic in this
check matches the wrong behaviour (IoT composes always have
RC- labels even when they're clearly not RCs), so the test
didn't fail. While fixing this in osbuild we might try to get
'correct' behaviour for IoT, and then we'd need to tweak the
logic here.

While we're at it, tweak the implementation a bit; without this
tweak, implementing this 'soft fail if osbuild' behaviour is more
awkward and ugly.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-12 09:00:25 -07:00
Lukas Ruzicka
b0bc18b187 Add a 'navigation' test for GNOME.
This PR partly solves the issue #301 when it adds the navigation
testing for Gnome. It uses the keyboard combinations to cycle through
running applications and checks that applications could be switched
accordingly. It also tests that you can switch between workspaces
and that you can move an applications to another workspace.
2024-04-10 21:46:43 +00:00
Deborah Brouwer
4eec75bec3 Get dns server address if host isn’t using systemd-resolved
The worker containers aren’t using systemd-resolved so
get_host_dns() can’t find the dns server causing tests that need
it to fail. Add an alternative place to look for the dns server address
that doesn’t rely on systemd-resolved.

Signed-off-by: Deborah Brouwer <deborah.brouwer@collabora.com>
2024-04-05 21:10:11 +00:00
Lukáš Růžička
f48dc5a0d5 Add wait_still_screen to menu_launch_type.
This is actually a very useful to wait a little bit before
we try to operate with the started application, especially
if we want to send keys.

Having this wait time here can save us doing this every time,
we start an application.
2024-04-05 14:09:28 +02:00
Adam Williamson
5701d1a5a5 Try and robustify menu_launch_type a bit
The mistypes on KDE are bugging me. Let's see if this - mainly
the wait_screen_change, the other just seems like a logical
tweak - helps at all.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-04 11:19:16 -07:00
Adam Williamson
f6273425ee Add FEDORA-2024-01fd5aa621 to workarounds
gvfs from the GNOME 46 megaupdate needs it. It's been pushed
stable but not included in a compose, yet.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-03-23 17:12:40 -07:00
Adam Williamson
92c822a719 Clear no-longer-needed update from workarounds
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-03-23 17:12:11 -07:00
Adam Williamson
b20aac5373 Add FEDORA-2024-b8e524ffdd as F40 workaround
It's queued for stable but blocked by the freeze, and
FEDORA-2024-9c9174f3dd requires it. Let's just make it a
workaround to clear the other update's tests.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-03-15 09:22:56 -07:00
Adam Williamson
30a71127c0 Clear F40 workarounds list
All updates are now stable.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-03-15 09:21:55 -07:00
Adam Williamson
b8fddfa265 Fix the logic for skipping _repo_setup_updates
Just checking for the package update list is wrong in a couple of
ways:

1. It goes wrong for child tests that inherit the main disk from
the parent test, but not the second disk where the actual update
repo lives. They'll have the package list, but not the repo. So
we should test for both the package list and the repo dir.

2. It goes wrong for side tag tests, because we don't write a
package list (or create an update repo) on that path. So on that
path let's check whether we already created the repo definition
we use on that path.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-03-13 10:49:05 -07:00
Adam Williamson
460eee87bc updates: test Silverblue install on UEFI as well as BIOS
https://bugzilla.redhat.com/show_bug.cgi?id=2268505 made it
clear that this is a bit of a hole. We don't test installing the
Silverblue image we build on UEFI, only on BIOS. Add this as a
separate test so we don't uselessly upload a disk image we won't
use for any follow-on tests.

This also adds an anaconda build that fixes a bug in this path
as a workaround for F40, so the test won't fail on all F40
updates.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-03-07 16:13:02 -08:00
Adam Williamson
9d1ae2aaf7 Add kde-settings update as a workaround too
This should mean all F40 update tests get the new background,
and we can once again make that test fail if it doesn't see it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-03-07 16:03:18 -08:00
Adam Williamson
02015ed5a0 Add F40 backgrounds update as workaround
So the kde-settings update can pass tests.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-03-07 15:54:51 -08:00
Adam Williamson
cca9f90c8a Drop workarounds that have gone stable
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-03-07 15:52:54 -08:00
Adam Williamson
d42ada609b f41 workarounds: add realmd update needed to fix FreeIPA tests
a realmd update a few hours ago broke FreeIPA enrolment. This is
the fix.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-03-01 10:23:54 -08:00
Adam Williamson
b348f47108 workarounds: drop dogtag-pki update that went stable
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-03-01 10:23:34 -08:00
Adam Williamson
43be62ac01 Add FEDORA-2024-ff7b17cdea as workaround for FreeIPA Java issue
The Java 21 update broke FreeIPA and was waived stable. This
update rebuilds dogtag-pki and should fix it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-02-29 17:43:02 -08:00
Adam Williamson
8dbcca38b0 clean up workarounds
Drop two that went stable, replace a scratch build with the
official update.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-02-29 17:42:27 -08:00