1
0
mirror of https://pagure.io/fedora-qa/os-autoinst-distri-fedora.git synced 2025-05-21 15:31:33 +00:00
Commit Graph

533 Commits

Author SHA1 Message Date
Adam Williamson
eda3f9b4b6 Move testdata tarball into this repo
Again to reduce direct usage of pagure.io, move the testdata
tarball (used by download_testdata) directly into this repo. For
now it includes repository.tar.gz, which is silly, but I'll send
a follow-up PR to openqa_testdata to drop that file if this works
out. This includes a script to produce the tarball from the base
repository, and adjusts download_testdata to get the tarball from
autoinst_url and update its unpacking logic (as this version of
the tarball has a top-level directory).

Note the tarball in this commit is actually from the branch that
backs https://pagure.io/fedora-qa/openqa_testdata/pull-request/1
to reduce size.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2025-03-17 17:17:57 -07:00
Adam Williamson
93ea483979 Reduce pagure.io usage (WIP)
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2025-03-17 10:39:33 -07:00
Lukáš Růžička
7e352e429c Use special start checking on Software.
The enhanced method of menu_launch_type does not cover for
special corner cases, where the application starts in a
specific mode (settings dialogues etc.)

This handles exceptions for Software.
2025-03-05 19:59:40 +00:00
Lukáš Růžička
653fb2938f Enhance the menu_launch_type subroutine.
The previous version of menu_launch_type took the name of the
application as an argument and it started the application.
To maximize the application or to check that it has started indeed
we had to do it manually.

Now, the application also takes "maximize => 1" or "checkstart => 1"
to maximize the application or check that it has started as optional
arguments to avoid doing it manually, while it still accepts just
the name of the application and behaves like it did before.

Note that if you decide to use the checkstart argument, you
also need to update the check-needles.py script to whitelist
the application needle tag, see the example test scripts
attached to this PR.

Fixes: https://pagure.io/fedora-qa/os-autoinst-distri-fedora/issue/329
2025-03-05 19:59:40 +00:00
Adam Williamson
d63c327b16 Unify buildroot repo handling and base it on a variable
This is intended to address the problem that we don't use the
buildroot repo for Branched between branching and u-t activation,
which often causes problems when newly-created updates depend on
builds that recently went stable. So instead of having logic in
the tests that sets up the buildroot repo only if the release is
Rawhide (or ELN), we'll do the decision about whether to set it
up in the scheduler (which decides based on info from Bodhi), and
just have the 'set up the repo' steps in the tests. Let's also
use the same code and repo name for ELN and non-ELN so we don't
have pointless divergence there.

Depends on the matching fedora_openqa change, of course - without
that, no test will use the buildroot repo.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2025-02-11 09:47:55 -08:00
Adam Williamson
52c9060bce Add 43 to the workarounds matrix
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2025-02-04 17:12:18 -08:00
Lukas Ruzicka
0c8af34e2e Tidy lib/utils.pm. 2025-02-04 14:25:59 +01:00
Adam Williamson
83e48505c9 Switch keyboard layouts with click, not key combo, in anaconda
With anaconda on Wayland (in F42+), switching layout by key combo
does not work and it seems like it won't be fixed any time soon,
so let's do it by clicking instead.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2025-02-03 13:41:34 -08:00
Adam Williamson
c461a11451 setup_repos: fix for case where we test 3+ tasks
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2025-01-27 14:24:18 -08:00
Adam Williamson
45728be935 Add some ELN workarounds to try and fix ELN tests
These should make ELN image build work again. They can go again
after the next ELN compose.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2025-01-17 15:10:43 -08:00
Adam Williamson
5ecc674b6d Drop workarounds that are stable now
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2025-01-17 10:55:29 -08:00
Adam Williamson
5aad236882 Add user/group ownership fix builds as workarounds for FreeIPA
A FreeIPA update failed tests because dogtag-pki and bind don't
provide the now-necessary virtual provides for users and groups
they create. These builds fix that, adding them as workarounds
before they go stable will let me rerun the FreeIPA tests and
let that update through.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2025-01-16 17:09:28 -08:00
Adam Williamson
40e5e23985 Drop rpm-ostree workaround (it went stable)
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2025-01-16 17:08:23 -08:00
Adam Williamson
f8e72763da Add scratch build with rpm-ostree fix for sbin merge as workaround
This will fix the ostree build tests on Rawhide and get rid of
all those failures. See:

https://gitlab.com/fedora/bootc/tracker/-/issues/29
https://bugzilla.redhat.com/show_bug.cgi?id=2337460
https://github.com/coreos/rpm-ostree/pull/5224

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2025-01-14 17:22:10 -08:00
Adam Williamson
722b8c1cf1 Drop a workaround that's been stable for a month
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2025-01-14 17:21:35 -08:00
Adam Williamson
601555d79b Add FEDORA-2024-07a6f9366e as F40 workaround
...so we can get tests of FEDORA-2024-4d154cc829 to pass.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-12-05 13:29:33 -08:00
Adam Williamson
341c792b31 Clear out already-stable workarounds
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-12-05 13:29:11 -08:00
Lukáš Růžička
dab034c39e Extend the Navigation test for QA:Testcase_window_manager. 2024-12-04 18:27:59 -08:00
Adam Williamson
06349fb449 F39 EOL cleanup: drop 39 from the workarounds hash
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-11-28 13:54:21 -08:00
Adam Williamson
971a8de7b9 F39 EOL cleanup: remove handling of g-i-s GOA screen
As the comment says, this was removed, so we don't need this
block any more.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-11-28 13:53:37 -08:00
Adam Williamson
6c861c033e Add anaconda with rsync check rollback as F42 workaround
Without this, KDE live installs always fail.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-11-28 13:13:05 -08:00
Adam Williamson
c6aeba1e99 Add NetworkManager ppp rebuild update to Rawhide workarounds
This is needed as ppp 2.5.1 accidentally went stable, don't want
to wait for the tests on this update to fully complete.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-11-28 00:18:14 -08:00
Adam Williamson
fff511c144 Clear a long-stable workaround
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-11-28 00:11:13 -08:00
Adam Williamson
77d6f3128c Use 'fXX-build' tag repo for Rawhide, not 'rawhide'
The 'rawhide' tag repo used to be just a symlink to the 'fXX-build'
one, but With the on-demand repo changes, that's no longer the
case. It looks like the 'fXX-build' repo gets regenerated more
often than 'rawhide' (which seems to regen every two hours), so
let's use 'fXX-build' instead.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-11-07 15:19:40 -08:00
Adam Williamson
b3b39a79d9 Add FEDORA-2024-b3e53a2b43 as workaround for Rawhide
This fixes the systemd-homed service start failure due to SELinux
denial.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-10-22 08:42:44 -07:00
Adam Williamson
905376e320 Drop workarounds which have gone stable
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-10-22 08:42:25 -07:00
Adam Williamson
d761df56b2 Add gjs user switch crash fix update as workaround for F41
This should allow us to turn the desktop_login test back on for
updates.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-10-16 11:01:32 -07:00
Adam Williamson
b4910cee94 Add F40 and F41 kwin sluggishness fix updates as workarounds
All the KDE flakiness lately is likely caused by the recurrence
of https://bugzilla.redhat.com/show_bug.cgi?id=2312900 , which
came back because the patch to fix it was inadvertently dropped.
This adds the F40 and F41 updates that re-introduce the patch as
workarounds to address the sluggishness.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-10-16 10:57:59 -07:00
Adam Williamson
d194b9d2af Drop a workaround that's already stable
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-10-16 10:57:26 -07:00
Adam Williamson
e9e967c4bf Consistently use desktop_launch_terminal
Also be a bit more consistent about asserting we saw a terminal
and waiting a bit before typing stuff. We can drop the doublek
workarounds from the keyring tests as we no longer use the
kicker to launch the terminal on KDE (we use ctrl-alt-t shortcut).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-10-09 17:19:00 -07:00
Adam Williamson
1f4324b270 abstract desktop terminal launch, refactor user switch, enable for KDE
This started out as just factoring out the repeated pattern for
launching a terminal on the desktop that came in with the i3
tests. But as I worked on desktop_login, which is a major user
of it, I noticed some potential cleanups and improvements in the
user switching stuff, and also realized we can turn that test
back on for KDE now - user switching was re-enabled in KDE a year
ago and is advertised to be reliable.

I don't think the "switch user from a lock screen" test fully
worked before, as we did not verify that we'd really switched
back to an existing session rather than starting a new one. Now
we do. Using the terminal to verify the logged-in user on all
desktops just keeps things simpler than using the kicker menu
on KDE (though if typing proves unreliable on KDE I may switch
this back).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-10-09 17:16:13 -07:00
Adam Williamson
b7487e97e9 Fix menu_launch_type for i3
Without this, all we did on i3 was hit alt-d and...do nothing,
we didn't type the app name.

I was confused at how we didn't notice this before, but it looks
like at present menu_launch_type isn't actually used in any
test we run on i3 (a lot of tests that use it to run a terminal
got a branch for i3 which uses alt-enter instead). This is an
obvious landmine, though, and it caused things to look weird
when rebasing #323 (which is how I noticed the bug).

This also refactors the sub to use the same logic for all
desktops, just with a different key for i3, since they really
all work the same. i3 doesn't need as much waiting as the other
desktops, probably, but it doesn't really hurt and keeps the code
simple.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-10-09 11:40:31 -07:00
Adam Williamson
c65071f879 Add ffmpeg 7.0 update as a workaround for F41
It's stable now, and
https://bodhi.fedoraproject.org/updates/FEDORA-2024-8b18ef8dfb
needs it, let's add it as a workaround so we don't have to wait
for a compose.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-10-05 15:44:52 -07:00
Adam Williamson
52f3897eec Clear existing workarounds, they are all stable now
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-10-05 15:44:28 -07:00
Adam Williamson
91f4a24b20 Also add FEDORA-2024-cb1e9f47a3 as F41 workaround
The new NetworkManager update needs it. Lack of composes is
starting to bite us more, need to get one through.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-10-03 12:18:30 -07:00
Adam Williamson
31691a317b Add a higher-NVR build of FreeIPA as a workaround for F42
The freeipa package in F41 got bumped to a higher NVR than the
one in F42, which causes FreeIPA upgrades to fail.

See: https://src.fedoraproject.org/rpms/freeipa/pull-request/22

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-10-03 10:12:01 -07:00
Adam Williamson
0b5aabcc57 Add FEDORA-2024-e331cd53ac as a workaround for F41
Another update depends on it. It's gone stable already, but we
are having issues with composes ATM so it hasn't made a compose.
It's safe to do this as we can be sure the depended-on update
will be in the next stable compose whenever it completes, so we
can't wind up in an inconsistent state.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-10-02 16:26:17 -07:00
Lukas Ruzicka
092cc5dd05 Move the content from i3 library to the files.
Over the time, we have changed the test scripts so that the code
in the i3.pm library was no more needed. The only leftover was the
user config subroutine that could be moved to the only file that was
using it and we could get rid of the library file.
2024-09-26 16:06:43 -07:00
Lukas Ruzicka
c392480f92 Rebase the PR to fit within the current status quo. 2024-09-26 16:04:59 -07:00
Dan Čermák
4315e5ff6f Add openQA tests for i3 2024-09-26 16:04:59 -07:00
Adam Williamson
82abc61432 Factor DM login process out of _graphical_wait_login
There are several other tests doing the same thing (but not as
safely, in some cases). To improve reliability and reduce
duplication, let's factor this out into utils.pm and reuse it
where appropriate.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-09-26 22:20:34 +00:00
Alessandro Astone
39e26ed029 kde_doublek_workaround: Allow some time for the menu to close 2024-09-15 21:19:18 +02:00
Adam Williamson
358695e417 doublek_workaround: tweak to work for other letters too
In a couple of cases we type something that *doesn't* start with
a 'k', so we should use that other letter for the workaround.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-09-15 11:54:35 -07:00
Adam Williamson
e49b5f9645 Initial ELN update test support (installer build)
This should make the installer image build test work for ELN,
so we can try doing some update tests on ELN.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-09-05 14:57:59 -07:00
Adam Williamson
9a95ece8d3 Clear a now-stable workaround
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-08-22 11:50:29 -07:00
Adam Williamson
cbb9bb59d4 g-i-s: go back to relnum conditional, update comments
Changing to a conditional based on whether we saw webui broke the
ostree installer install tests, because they of course use the
same g-i-s even though they don't use webui. So, we have to go
back to the relnum-based conditional :/

Yes, this means we have redundant screens in g-i-s for install
paths that use gtkui to deploy GNOME, e.g. SB installer images,
but I can't see a good way to fix that. We need to show those
screens for the live install, which is the 'most important'
one, and we don't have an obvious way to show them for installs
that used webui but hide them for installs that used gtkui.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-08-20 23:12:29 -07:00
Adam Williamson
76711fd039 Tweak _boot_to_anaconda and g-i-s flow for new Rawhide g-i-s
We're dropping the live user mode patch from g-i-s downstream
because it's just too hard to maintain, apparently. So on Rawhide
the live image will boot to the welcome screen as normal, but
running the installer will give you newui rather than webui. If
you need a language other than English you have to sort it out
at the desktop before running the installer.

On first boot, g-i-s will show *all* screens, not skipping
language, keyboard layout or timezone, because we did not see
those in the installer.

This adapts the tests to handle the new flow, and should still
work with the other flows.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-08-20 16:15:55 -07:00
Adam Williamson
7379f7636d More updates for webUI deferral to F42
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-08-18 16:23:13 -07:00
Adam Williamson
3da4f4e8bb Update f41 g-i-s workaround to latest build
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-08-18 14:13:42 -07:00
Adam Williamson
bd317e001f Add gnome-initial-setup vendor.conf revert update as F41 workaround
This is part of reverting webui for F41. The kickstarts change
is merged, so we need this also.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-08-18 09:18:48 -07:00