1
0
mirror of https://pagure.io/fedora-qa/os-autoinst-distri-fedora.git synced 2024-11-25 07:13:09 +00:00
Commit Graph

675 Commits

Author SHA1 Message Date
Adam Williamson
e49b5f9645 Initial ELN update test support (installer build)
This should make the installer image build test work for ELN,
so we can try doing some update tests on ELN.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-09-05 14:57:59 -07:00
Adam Williamson
9a95ece8d3 Clear a now-stable workaround
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-08-22 11:50:29 -07:00
Adam Williamson
cbb9bb59d4 g-i-s: go back to relnum conditional, update comments
Changing to a conditional based on whether we saw webui broke the
ostree installer install tests, because they of course use the
same g-i-s even though they don't use webui. So, we have to go
back to the relnum-based conditional :/

Yes, this means we have redundant screens in g-i-s for install
paths that use gtkui to deploy GNOME, e.g. SB installer images,
but I can't see a good way to fix that. We need to show those
screens for the live install, which is the 'most important'
one, and we don't have an obvious way to show them for installs
that used webui but hide them for installs that used gtkui.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-08-20 23:12:29 -07:00
Adam Williamson
76711fd039 Tweak _boot_to_anaconda and g-i-s flow for new Rawhide g-i-s
We're dropping the live user mode patch from g-i-s downstream
because it's just too hard to maintain, apparently. So on Rawhide
the live image will boot to the welcome screen as normal, but
running the installer will give you newui rather than webui. If
you need a language other than English you have to sort it out
at the desktop before running the installer.

On first boot, g-i-s will show *all* screens, not skipping
language, keyboard layout or timezone, because we did not see
those in the installer.

This adapts the tests to handle the new flow, and should still
work with the other flows.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-08-20 16:15:55 -07:00
Adam Williamson
7379f7636d More updates for webUI deferral to F42
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-08-18 16:23:13 -07:00
Adam Williamson
3da4f4e8bb Update f41 g-i-s workaround to latest build
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-08-18 14:13:42 -07:00
Adam Williamson
bd317e001f Add gnome-initial-setup vendor.conf revert update as F41 workaround
This is part of reverting webui for F41. The kickstarts change
is merged, so we need this also.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-08-18 09:18:48 -07:00
Adam Williamson
175b056ce7 Clear out F41 workarounds list
They're all in stable now.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-08-18 09:18:16 -07:00
Adam Williamson
89551b72ee Add kde-settings update to workarounds to get f41 bg on KDE
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-08-16 01:01:10 -04:00
Adam Williamson
d3150edae3 Add tuned to f41 workarounds
To fix base_services_start failures till next compose is done.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-08-15 22:51:32 -04:00
Adam Williamson
e8ed3a2a96 Add mock-core-configs branched update to F41 workarounds
Looks like it didn't make the compose, or something, we need
this for tests to work.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-08-15 17:32:12 -04:00
Adam Williamson
6a9ab101bf Remove last vestiges of modularity stuff
This comes with a subtle behavioural change that we no longer
pass --nogpgcheck for upgrade tests, but we didn't really *mean*
to do that for anything but Rawhide, and it *shouldn't* be
necessary for Rawhide now, so let's see if everything is fine
without it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-08-14 07:55:24 -04:00
Adam Williamson
fd3a6d1941 Drop a no-longer-needed workaround
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-08-13 15:27:26 -04:00
Adam Williamson
5132786456 Add 42 to workarounds hash
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-08-13 15:10:15 -04:00
Adam Williamson
4be9ce3e88 Use 'terminal' instead of 'gnome-terminal' for ptyxis switch
In several places we run 'gnome-terminal' explicitly, but as of
today's compose, the default terminal app on GNOME in Rawhide is
ptyxis, not gnome-terminal.

Running 'terminal' should launch whichever is correct, so let's
consistently do that.

Also, add an apps_run_terminal needle and navigation navbar
needle for ptyxis.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-08-13 10:39:20 -04:00
Adam Williamson
3f951b47d8 Run update package version check on installer environments
As discussed in https://pagure.io/releng/failed-composes/issue/6538
we noticed a gap in openQA coverage here. We don't check the
versions of packages lorax installs to the installer environment,
and those packages do not make it to the installed system, so if
there's a dep issue that prevents a package in the update from
being included in the installer environment, but the same dep
issue isn't caught on any other path, we miss the problem. This
wires the updvercheck.py script into the _installer_build and
_ostree_build tests to catch this kind of problem, and makes it
capable of parsing pylorax.log files into its preferred format
to enable that.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-08-02 15:10:53 -07:00
Adam Williamson
107d7ce03d Add FEDORA-2024-f86a143437 to workarounds (pd-mapper for F40)
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-07-20 09:24:17 -07:00
Adam Williamson
7945c797fa Remove FEDORA-2024-442827752b and 120746008 from workarounds
Both are stable now.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-07-20 09:23:52 -07:00
Adam Williamson
92ea362578 Add pd-mapper scratch build as workaround
To fix base_services_start always failing on aarch64, while I
wait for review of the upstream and downstream PRs.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-07-19 12:23:47 -07:00
Adam Williamson
187e3486be podman bats: tee the output to a log file and upload it
...this makes it much easier to see what's failing if it fails.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-07-17 18:22:53 -07:00
Adam Williamson
0bde610430 Add updated plymouth as workaround for F39
To deal with the UEFI passphrase entry issue, now F39 has kernel
6.9.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-07-10 16:00:58 -07:00
Adam Williamson
51f1654224 Drop 38 from workarounds matrix
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-07-10 16:00:48 -07:00
Adam Williamson
8cbf280e93 Tweak the select_disks special case for another anaconda change
anaconda now no longer protects the entire disk which contains
stage 2 or is being used as an install source, it protects only
the relevant partition:
https://github.com/rhinstaller/anaconda/pull/5687
so we want to go down the regular path again with F41+. We can
drop the "before F39" bound now, as F38 is EOL.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-07-05 09:50:26 -07:00
Adam Williamson
5fda734892 tag/copr updatepkgs.txt generation: filter arches
If the repo has source packages in it, we get a badly-formed
updatepkgs.txt that breaks updvercheck. So let's filter to only
packages of the target arch and noarch.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-06-26 15:16:22 -07:00
Adam Williamson
146e41cca5 Install python3-dnf before running updvercheck.py
...when we're not in an atomic (canned) env, anyway. If we are,
we'll rely on it already being there (as previously ensured by
an earlier commit).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-06-26 10:56:23 -07:00
Adam Williamson
c8de083f1c Revert "disable_firefox_studies: use SUSE style and add SUSE values"
This reverts commit a3f4a6f2e6. It
seemed to cause *more* annoying bars in Firefox than before, for
some reason, I don't know why. Reverting till I can do more
testing on lab.
2024-06-21 12:46:50 -07:00
Adam Williamson
a3f4a6f2e6 disable_firefox_studies: use SUSE style and add SUSE values
SUSE has a much nicer style for handling all the nested quoting
and stuff in creating the autoconfig files, so switch to that,
and also merge in all the SUSE autoconfig values...the more the
merrier, for making Firefox be less annoying. I'm hoping this
might suppress the "Add a splash of color" modal that's breaking
tests ATM.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-06-21 10:26:57 -07:00
Adam Williamson
e30060218b Drop a workaround that went stable weeks ago
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-06-19 12:53:10 -07:00
Adam Williamson
943c4193d3 Factor out the KDE launcher double-typing workaround, use it more
There's a couple of places where we do menu_launch_type in KDE
without doing this workaround first, and they do run into the
bug sometimes. Let's factor it out from the few places it's
already repeated, and add it to the places it is missing.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-06-11 16:21:00 -07:00
Adam Williamson
304699bc6f Defend even harder against progress spew in updatepkgs.txt
Seems current dnf5 has a bug which causes repository refresh
progress to be sent to stdout even with -q.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-06-11 09:13:01 -07:00
Adam Williamson
670d1072de Yet more timeout
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-06-11 08:17:22 -07:00
Adam Williamson
e2fde7809c Bump advisory_check timeout even more for really huge "updates"
...well, in this case, the Python side tag, because side tags
that inherit have just *all* the packages in them.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-06-11 00:56:29 -07:00
Adam Williamson
5aaf78bf26 Adjust COPR / tag package info generation for dnf5 properties
dnf5 behaves differently from dnf < 5 in a couple of ways: like
rpm it does not always add a newline to the query format, and it
sends its status messages to stdout, not stderr. These commands
account for this and produce identical output with dnf < 5 and
dnf 5.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-06-11 00:33:36 -07:00
Adam Williamson
a36e86fcf8 setup_repos: don't die on tag/COPR if there are workarounds
whoops, this bailout is too hard. we get here on tag/COPR path
if there are workarounds, that is fine.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-06-10 23:47:30 -07:00
Adam Williamson
f14200e50d Update cockpit autoupdate test for new dnf5 service
The service cockpit enables is different when it detects dnf5,
since cockpit 317. Let's just make this an F40/F41 boundary
thing, and add the cockpit 317 update as a workaround for F41
until it goes stable.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-29 17:43:12 -07:00
Adam Williamson
af06ac0809 Add a workaround for alt-d-s not working right after login
This broke the KDE app start/stop test. We need to click on the
desktop before alt-d-s will work, for some reason.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-28 16:02:06 -07:00
Adam Williamson
a353caeb90 Enable testing of COPRs, fix some issues, enable package checks
This works more or less like testing side tags. We also fix up
some flow problems with this path (that also affect the side tag
case), and enable the package checks on this path - it's not too
hard really, we just need to write the updatepkgs file when we
set up the repo, which we can do with dnf repoquery.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-05-03 14:40:34 -07:00
Adam Williamson
46c0719e66 Let installedupdatepkgs generation take longer in a container
From https://openqa.fedoraproject.org/tests/2594954 it looks
like this takes more than three minutes for updates with hundreds
of packages when running in a container (in the container build/
validate test). So, let's give it more time in that case.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-25 10:51:51 -07:00
Adam Williamson
9f2d44a181 drop a FIXME on enabling/disabling repos with sed
dnf5 config-manager can now do this, but the syntax is different
to dnf4, and honestly, it seems easier to just stick with this
going forward than make it conditional on dnf version until
dnf4 goes away. So let's stop marking this as a FIXME.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-22 16:14:29 -07:00
Adam Williamson
f4bd3c6f58 Add a container build test
This test, much like _live_build or _installer_build, builds a
container image in a way intended to be as similar as possible
to how official compose images are built. The purpose of the test
is to make sure updates do not break official container image
builds.

At the end of the test, we also check that the built container
is functional (at least, that we can run a 'hello world' command
in it). This can't really be rolled into podman.pm because that
test is more about testing podman itself, and it's just a one-
liner here anyway. We also run the 'if any packages from the
update are installed, are they the versions from the update?'
check inside the container, which required giving that check the
ability to 'wrap' the rpm commands to run inside a container.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-22 16:01:41 -07:00
Adam Williamson
d65aac4c83 Drop a no-longer-needed workaround
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-19 16:30:52 -07:00
Adam Williamson
a8f547f5ef Fix check_prerelease when we don't care
I inadvertently broke this in the logic change in the previous
commit to this.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-14 08:36:50 -07:00
Adam Williamson
a07ad20240 Add FEDORA-2024-b156c57ef1 as F40 workaround to fix upgrades
See https://bugzilla.redhat.com/show_bug.cgi?id=2274833. Upgrades
from F39 to F40 fail without this.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-12 18:59:41 -07:00
Adam Williamson
fcbb00d0ac Drop workaround which went stable weeks ago
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-12 18:59:24 -07:00
Adam Williamson
4938c0e5ae Make pre-release check a soft failure on osbuild images
osbuild is struggling with the pre-release warnings ATM:

https://pagure.io/fedora-iot/issue/57
https://github.com/osbuild/images/issues/515

Until that mess is cleaned up we can't really make sensible
assertions for osbuild images, so let's make the check a soft
failure for now (now we know about the bugs, we want to let
the rest of the tests run and not block them on this).

Note for IoT the behaviour has never really been correct (IoT
images never get pre-release warnings), but the logic in this
check matches the wrong behaviour (IoT composes always have
RC- labels even when they're clearly not RCs), so the test
didn't fail. While fixing this in osbuild we might try to get
'correct' behaviour for IoT, and then we'd need to tweak the
logic here.

While we're at it, tweak the implementation a bit; without this
tweak, implementing this 'soft fail if osbuild' behaviour is more
awkward and ugly.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-12 09:00:25 -07:00
Lukas Ruzicka
b0bc18b187 Add a 'navigation' test for GNOME.
This PR partly solves the issue #301 when it adds the navigation
testing for Gnome. It uses the keyboard combinations to cycle through
running applications and checks that applications could be switched
accordingly. It also tests that you can switch between workspaces
and that you can move an applications to another workspace.
2024-04-10 21:46:43 +00:00
Deborah Brouwer
4eec75bec3 Get dns server address if host isn’t using systemd-resolved
The worker containers aren’t using systemd-resolved so
get_host_dns() can’t find the dns server causing tests that need
it to fail. Add an alternative place to look for the dns server address
that doesn’t rely on systemd-resolved.

Signed-off-by: Deborah Brouwer <deborah.brouwer@collabora.com>
2024-04-05 21:10:11 +00:00
Lukáš Růžička
f48dc5a0d5 Add wait_still_screen to menu_launch_type.
This is actually a very useful to wait a little bit before
we try to operate with the started application, especially
if we want to send keys.

Having this wait time here can save us doing this every time,
we start an application.
2024-04-05 14:09:28 +02:00
Adam Williamson
5701d1a5a5 Try and robustify menu_launch_type a bit
The mistypes on KDE are bugging me. Let's see if this - mainly
the wait_screen_change, the other just seems like a logical
tweak - helps at all.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-04 11:19:16 -07:00
Adam Williamson
f6273425ee Add FEDORA-2024-01fd5aa621 to workarounds
gvfs from the GNOME 46 megaupdate needs it. It's been pushed
stable but not included in a compose, yet.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-03-23 17:12:40 -07:00