1
0
mirror of https://pagure.io/fedora-qa/os-autoinst-distri-fedora.git synced 2025-07-15 18:01:42 +00:00
Commit Graph

737 Commits

Author SHA1 Message Date
Adam Williamson
ad3796c9db side tag package lists: get binary not source package names
Whoops, this works much better.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2025-06-11 08:56:23 +02:00
Adam Williamson
3fd367938b Make updatepkgs and updatepkgnames more precise for side tags
The way side tags work, every package in the distro is in the side
tag repo, so updatepkgs and updatepkgnames end up huge. To fix
this, we'll use a koji query for all packages that are actually in
the side tag to generate updatepkgnames.txt, and then use that to
filter the dnf command to generate updatepkgs.txt.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2025-06-10 15:57:11 +02:00
Adam Williamson
62dabf3894 Fix the package count in advisory_check_nonmatching_packages
This doesn't work because the output has the filename in it. We
need just the line count. catting the file to wc achieves that
as now it doesn't know the file name.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2025-06-07 08:15:35 -07:00
Adam Williamson
e65c23b6f2 Update shortcut to launch desktop settings in KDE 6.3.90
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2025-05-26 10:16:22 -07:00
Adam Williamson
a6a033b2e6 Update webUI storage needles/tests for new webui/cockpit
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2025-05-15 14:00:37 -07:00
Adam Williamson
613324a755 Add libvirt with zfs obsoletion fix as F43 workaround 2025-05-09 00:19:20 -07:00
Adam Williamson
0887eece36 Drop already-stable workarounds
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2025-05-09 00:19:01 -07:00
Lukáš Růžička
0190f38677 Use the new features of menu_launch_type in code.
We have enhanced the menu_launch_type to allow for
start checking and maximizing applications.
This PR uses the new functions wherever it seems
logical.
If special logic was used for certain cases,
we have not touched these to preserve the
exact behaviour.

The crash workaround for the Fonts flatpak is dropped because it
no longer seems to be needed with the latest version of the
flatpak, and dropping it simplifies this migration.

Fixes: https://pagure.io/fedora-qa/os-autoinst-distri-fedora/issue/358
2025-04-25 14:40:54 -07:00
Adam Williamson
4a7e0721d4 Add FEDORA-2025-c25f31b10b as a workaround for F43
alsa-utils that requires this alsa-lib is already stable, so we
need this or all tests fail.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2025-04-15 07:50:01 -07:00
Adam Williamson
394249079f Stop wiping the openh264 repo
This caused problems (particularly with the more obscure package
install paths like cockpit and realmd) before, but I don't really
like removing it, as it differs from real-world usage. Tests are
currently failing because of a bug in this repo wiping - in
upgrade_preinstall, we should wipe the file again after the
dnf -y update --refresh call, in case that reinstalls it - but
instead of fixing that, let's try just leaving the file alone.

The risk here is that we run into problems when the repo doesn't
exist, again. In theory we should not because it has
skip_if_unavailable=True , and everything *should* respect that.
But if it does turn out to still be a problem we'll have to
revert this and fix upgrade_preinstall.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2025-04-03 12:52:30 -07:00
Adam Williamson
c08f08cc99 update tests: do main update with --best and fail if it fails
We currently use script_run (not assert_script_run) for the
catch-all update we run at the start of the test, and don't use
--best. This means that if a dependency issue happens at this
point, we don't catch it yet, we only catch it in _advisory_post.

By using assert_script_run and --best, we can fail on dep issues
at this point. We have to keep the _advisory_post check to catch
dep issues that crop up *later* in the test, including when
things like Cockpit or GNOME Software install updates and we
can't force them to use --best logic. But we can at least catch
*most* of them earlier this way.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2025-04-02 17:13:19 -07:00
Adam Williamson
3a7ef807de custom_blivet_format_partition: protect against missed click
I think since the wayland port, sometimes clicks on
anaconda_blivet_part_drop_select are missed and don't open the
menu. So, if that happens, click it again.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2025-04-02 15:40:51 -07:00
Adam Williamson
eda3f9b4b6 Move testdata tarball into this repo
Again to reduce direct usage of pagure.io, move the testdata
tarball (used by download_testdata) directly into this repo. For
now it includes repository.tar.gz, which is silly, but I'll send
a follow-up PR to openqa_testdata to drop that file if this works
out. This includes a script to produce the tarball from the base
repository, and adjusts download_testdata to get the tarball from
autoinst_url and update its unpacking logic (as this version of
the tarball has a top-level directory).

Note the tarball in this commit is actually from the branch that
backs https://pagure.io/fedora-qa/openqa_testdata/pull-request/1
to reduce size.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2025-03-17 17:17:57 -07:00
Adam Williamson
93ea483979 Reduce pagure.io usage (WIP)
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2025-03-17 10:39:33 -07:00
Lukáš Růžička
7e352e429c Use special start checking on Software.
The enhanced method of menu_launch_type does not cover for
special corner cases, where the application starts in a
specific mode (settings dialogues etc.)

This handles exceptions for Software.
2025-03-05 19:59:40 +00:00
Lukáš Růžička
653fb2938f Enhance the menu_launch_type subroutine.
The previous version of menu_launch_type took the name of the
application as an argument and it started the application.
To maximize the application or to check that it has started indeed
we had to do it manually.

Now, the application also takes "maximize => 1" or "checkstart => 1"
to maximize the application or check that it has started as optional
arguments to avoid doing it manually, while it still accepts just
the name of the application and behaves like it did before.

Note that if you decide to use the checkstart argument, you
also need to update the check-needles.py script to whitelist
the application needle tag, see the example test scripts
attached to this PR.

Fixes: https://pagure.io/fedora-qa/os-autoinst-distri-fedora/issue/329
2025-03-05 19:59:40 +00:00
Adam Williamson
d63c327b16 Unify buildroot repo handling and base it on a variable
This is intended to address the problem that we don't use the
buildroot repo for Branched between branching and u-t activation,
which often causes problems when newly-created updates depend on
builds that recently went stable. So instead of having logic in
the tests that sets up the buildroot repo only if the release is
Rawhide (or ELN), we'll do the decision about whether to set it
up in the scheduler (which decides based on info from Bodhi), and
just have the 'set up the repo' steps in the tests. Let's also
use the same code and repo name for ELN and non-ELN so we don't
have pointless divergence there.

Depends on the matching fedora_openqa change, of course - without
that, no test will use the buildroot repo.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2025-02-11 09:47:55 -08:00
Adam Williamson
52c9060bce Add 43 to the workarounds matrix
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2025-02-04 17:12:18 -08:00
Lukas Ruzicka
0c8af34e2e Tidy lib/utils.pm. 2025-02-04 14:25:59 +01:00
Adam Williamson
83e48505c9 Switch keyboard layouts with click, not key combo, in anaconda
With anaconda on Wayland (in F42+), switching layout by key combo
does not work and it seems like it won't be fixed any time soon,
so let's do it by clicking instead.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2025-02-03 13:41:34 -08:00
Adam Williamson
dfd26e0505 Add initial webUI custom install tests (xfs, ext4)
This adds two initial custom layout install tests for webUI, and
wires up some library functions for other tests to use. They may
need refining over time but this should be good enough for a
start.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2025-01-30 15:45:20 -08:00
Adam Williamson
c461a11451 setup_repos: fix for case where we test 3+ tasks
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2025-01-27 14:24:18 -08:00
Adam Williamson
c9408e2335 select_cockpit_update: be more defensive against scrolls
This new way is working better, but a few times I've seen it fail,
I think because it's matching the 'updates' link while it's still
scrolling so when it clicks, the link has moved and the click
fails. Let's wait a bit after we see it, then match *again* and
click, instead of relying on the last match area.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2025-01-25 10:30:24 -08:00
Adam Williamson
45728be935 Add some ELN workarounds to try and fix ELN tests
These should make ELN image build work again. They can go again
after the next ELN compose.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2025-01-17 15:10:43 -08:00
Adam Williamson
5ecc674b6d Drop workarounds that are stable now
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2025-01-17 10:55:29 -08:00
Adam Williamson
5aad236882 Add user/group ownership fix builds as workarounds for FreeIPA
A FreeIPA update failed tests because dogtag-pki and bind don't
provide the now-necessary virtual provides for users and groups
they create. These builds fix that, adding them as workarounds
before they go stable will let me rerun the FreeIPA tests and
let that update through.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2025-01-16 17:09:28 -08:00
Adam Williamson
40e5e23985 Drop rpm-ostree workaround (it went stable)
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2025-01-16 17:08:23 -08:00
Adam Williamson
077d3182d6 cockpit: use down instead of up to find the Updates page
Seems like this might work better? Up is still failing a lot.
Tested on lab and it looked good.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2025-01-16 12:57:24 -08:00
Adam Williamson
f8e72763da Add scratch build with rpm-ostree fix for sbin merge as workaround
This will fix the ostree build tests on Rawhide and get rid of
all those failures. See:

https://gitlab.com/fedora/bootc/tracker/-/issues/29
https://bugzilla.redhat.com/show_bug.cgi?id=2337460
https://github.com/coreos/rpm-ostree/pull/5224

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2025-01-14 17:22:10 -08:00
Adam Williamson
722b8c1cf1 Drop a workaround that's been stable for a month
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2025-01-14 17:21:35 -08:00
Adam Williamson
e440059247 cockpit: work around issue with selecting Update view
In recent Firefox, just pressing 'up' once doesn't seem to work
100% to scroll to the bottom of the list so we can see the Update
link. So, let's do it up to 3 times!

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2025-01-07 17:26:00 -08:00
Adam Williamson
601555d79b Add FEDORA-2024-07a6f9366e as F40 workaround
...so we can get tests of FEDORA-2024-4d154cc829 to pass.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-12-05 13:29:33 -08:00
Adam Williamson
341c792b31 Clear out already-stable workarounds
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-12-05 13:29:11 -08:00
Lukáš Růžička
dab034c39e Extend the Navigation test for QA:Testcase_window_manager. 2024-12-04 18:27:59 -08:00
Adam Williamson
2d4ae597f0 Move KDE live build test to Kiwi, refactor mock bits
KDE live images for Rawhide are now built with Kiwi, so let's do
it that way in openQA too (including for stable releases because
it's awkward to do it any other way). Kiwi build steps are almost
the same whatever you're building, so convert the container build
test into a generic Kiwi build test and use it for both. mock
setup is shared between Kiwi and LMC, so let's factor it out.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-11-29 11:38:06 -08:00
Adam Williamson
06349fb449 F39 EOL cleanup: drop 39 from the workarounds hash
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-11-28 13:54:21 -08:00
Adam Williamson
971a8de7b9 F39 EOL cleanup: remove handling of g-i-s GOA screen
As the comment says, this was removed, so we don't need this
block any more.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-11-28 13:53:37 -08:00
Adam Williamson
6c861c033e Add anaconda with rsync check rollback as F42 workaround
Without this, KDE live installs always fail.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-11-28 13:13:05 -08:00
Adam Williamson
c6aeba1e99 Add NetworkManager ppp rebuild update to Rawhide workarounds
This is needed as ppp 2.5.1 accidentally went stable, don't want
to wait for the tests on this update to fully complete.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-11-28 00:18:14 -08:00
Adam Williamson
fff511c144 Clear a long-stable workaround
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-11-28 00:11:13 -08:00
Adam Williamson
77d6f3128c Use 'fXX-build' tag repo for Rawhide, not 'rawhide'
The 'rawhide' tag repo used to be just a symlink to the 'fXX-build'
one, but With the on-demand repo changes, that's no longer the
case. It looks like the 'fXX-build' repo gets regenerated more
often than 'rawhide' (which seems to regen every two hours), so
let's use 'fXX-build' instead.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-11-07 15:19:40 -08:00
Adam Williamson
ce00bc94f1 blivet: more workarounds for issues with anaconda wayland port
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-11-06 11:42:12 -08:00
Adam Williamson
b3b39a79d9 Add FEDORA-2024-b3e53a2b43 as workaround for Rawhide
This fixes the systemd-homed service start failure due to SELinux
denial.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-10-22 08:42:44 -07:00
Adam Williamson
905376e320 Drop workarounds which have gone stable
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-10-22 08:42:25 -07:00
Adam Williamson
5f1a8eb355 select_disks: workaround failed first Destination click
In tests of the Rawhide anaconda update that ports to Wayland,
we often hit failures because the first attempt to click on
Installation Destination doesn't work. This only happened on prod
(not staging), it didn't happen every time (but quite often), and
we can't reproduce it manually, so it seems like a weird glitch
that we should just work around. Simply waiting a second and
clicking again seems to do the job, and should be safe even if
the first click works (the second click will just be on an empty
area of the Installation Destination screen, unless we have like
eight disks attached).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-10-16 12:49:57 -07:00
Adam Williamson
d761df56b2 Add gjs user switch crash fix update as workaround for F41
This should allow us to turn the desktop_login test back on for
updates.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-10-16 11:01:32 -07:00
Adam Williamson
b4910cee94 Add F40 and F41 kwin sluggishness fix updates as workarounds
All the KDE flakiness lately is likely caused by the recurrence
of https://bugzilla.redhat.com/show_bug.cgi?id=2312900 , which
came back because the patch to fix it was inadvertently dropped.
This adds the F40 and F41 updates that re-introduce the patch as
workarounds to address the sluggishness.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-10-16 10:57:59 -07:00
Adam Williamson
d194b9d2af Drop a workaround that's already stable
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-10-16 10:57:26 -07:00
Adam Williamson
e9e967c4bf Consistently use desktop_launch_terminal
Also be a bit more consistent about asserting we saw a terminal
and waiting a bit before typing stuff. We can drop the doublek
workarounds from the keyring tests as we no longer use the
kicker to launch the terminal on KDE (we use ctrl-alt-t shortcut).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-10-09 17:19:00 -07:00
Adam Williamson
1f4324b270 abstract desktop terminal launch, refactor user switch, enable for KDE
This started out as just factoring out the repeated pattern for
launching a terminal on the desktop that came in with the i3
tests. But as I worked on desktop_login, which is a major user
of it, I noticed some potential cleanups and improvements in the
user switching stuff, and also realized we can turn that test
back on for KDE now - user switching was re-enabled in KDE a year
ago and is advertised to be reliable.

I don't think the "switch user from a lock screen" test fully
worked before, as we did not verify that we'd really switched
back to an existing session rather than starting a new one. Now
we do. Using the terminal to verify the logged-in user on all
desktops just keeps things simpler than using the kicker menu
on KDE (though if typing proves unreliable on KDE I may switch
this back).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-10-09 17:16:13 -07:00