Commit Graph

1069 Commits

Author SHA1 Message Date
Adam Williamson 74b468b949 Add Samba AD tests
This adds a Samba AD server test, and client enrolment tests via
sssd, Cockpit and kickstart. Requires the matching createhdds
commit to add the kickstart to the disk_ks image.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-07-27 16:14:30 -07:00
Adam Williamson ba1d492416 ostree: only use --unified-core on F39+
I think it's breaking F37 and F38 tests, not surprisingly as we
didn't do all the fixes there.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-07-27 12:26:23 -07:00
Adam Williamson bf4a8ec454 Enable unified core for ostree composes
It got enabled in production, so we should do the same here.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-07-25 18:35:58 -07:00
Adam Williamson 2d6180b25e Try forcing HTTP/1.1 for pagure.io git clones
The change to the curl commands to force HTTP/1.1 seems to have
stopped them failing, so let's try doing it for the git clones
too and see if that avoids the problem till we can work out
what is causing it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-07-24 11:56:28 -07:00
Lukas Ruzicka 0a10727a7a Remove modularity tests.
Modularity will be retired in Fedora 39 and the modular repository
removed. Also, the upcoming version of DNF that is default in
Rawhide, does not support modularity, so the tests are currently
failing anyway.
2023-07-20 10:23:44 +02:00
Adam Williamson d5a9e4777e Retry all pagure.io downloads
This tweaks all pagure.io downloads to be retried a few times,
since we seem to be getting failures quite often. We use curl
for this as it has nice options for it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-07-19 13:37:29 -07:00
Lukas Ruzicka 3e7936fd01 Replace the dropped pactl with amixer to manipulate audio levels. 2023-07-17 14:30:05 +02:00
Adam Williamson f49c8bc66b gnome-text-editor: only handle spellcheck language if needed
The Flatpak build doesn't have the spellcheck issue at the
moment, and it may be fixed soon in the RPM build. Trying to
'fix' the issue on the flatpak build actually makes the test
fail. So, let's only do the fix if we actually have a misspelled
word.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-07-05 12:19:41 -07:00
Adam Williamson ba9a36d10e g-t-e: mark 'new_file' test as fatal
The tests after it assume new_file ran - they rely on the file
it creates - so it should be considered fatal.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-07-05 11:39:18 -07:00
Adam Williamson 1f24f84bb1 Support testing a side tag instead of an update or task
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-07-04 19:10:03 -07:00
Adam Williamson d8c374044a Add more safety to the fullscreen for Archiver
We can't really just hit super-up and then immediately go on our
merry way clicking on stuff...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-07-04 17:25:52 -07:00
Adam Williamson 20a2d161ca Add some safety to g-t-e language setup
Seems in Rawhide the menu is loading without dividers briefly,
we match there, then the dividers load in and make the menu
longer, so when we click, we hit a different entry in the menu.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-07-03 11:31:48 -07:00
Lukas Ruzicka d749317f29 Update the Gnome-Text-Editot test.
The editor started to show spell-checking that would require a lot
of new needles to be created. Theredore, we set the language to
English to stop showing the spelling mistakes in aaa_setup.pm

Also, the application started to have problems with getting correct
focus, so we want to click into the text before the status gets
recorded.
2023-06-30 14:26:00 +02:00
Adam Williamson fbb9bd7386 Revert "_live_build: workaround util-linux-user problem for KDE live"
This reverts commit efc2f8ae36.
As the comment said, it's no longer needed.
2023-06-28 16:52:48 +02:00
Adam Williamson 5c6ae24e99 _live_build: FIXME for using three disks
Change the comment on why we put /var/lib/mock on the third hard
disk: we probably can cut it down to two, now, but I don't want
to do it right now.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-06-28 16:48:55 +02:00
Lukas Ruzicka 4c426051ce Remove the Photos start-stop test.
Based on the information that the application has been removed
from the standard Workstation installation, see
https://pagure.io/fedora-comps/c/462b65876fb4258fdb2ce19f4193900ef2bdc2d9?branch=main,
we remove that application from this suite.
2023-06-28 13:44:31 +02:00
Adam Williamson 500fea03ad Fix workaround repo in live images
D'oh. This is the first time we actually tried to use the new
workarounds ISO thing for real, I forgot to update some paths.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-06-26 01:50:49 +02:00
Adam Williamson 0a87a76ff9 Run base tests on ELN
This requires a change in the package we use for base_update_cli
because pandoc-common is not in ELN.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-06-23 11:53:11 +02:00
Lukas Ruzicka bc8601a1d4 Create test for the Tour application. 2023-06-23 10:53:58 +02:00
Adam Williamson 3bce9f1007 Type more safely in the gnome-panel volume bar test
The shifted characters here frequently get mistyped. Let's use
type_safely. If this isn't enough we can try very_safely.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-06-23 10:52:33 +02:00
Adam Williamson 6fefd092e9 Try and fix Cockpit tests breaking with update ISO change
We drop the line for the update ISO from /etc/fstab before
uploading the image after the cockpit_default test, but we don't
make sure it's set up again before Cockpit tries to use it, in
the subsequent Cockpit tests. I don't know why this didn't fail
on stg before, but it sure as hell is failing in prod...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-06-20 15:18:01 +02:00
Adam Williamson 74730f904a Workaround config-manager plugin missing from dnf5 using sed
This is ugly, but ought to work, I hope.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-06-20 12:42:34 +02:00
Adam Williamson 7be16956d7 Use "dnf group install" not "dnf groupinstall" (dnf5 support)
dnf4 and dnf5 both support the former, dnf5 does not support the
latter.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-06-20 12:27:30 +02:00
Adam Williamson 97618193c6 Adjust tests for update and workaround repos provided as ISO
I'm attempting a new approach to the update and workaround repos.
Instead of having each update test recreate them for itself -
which is slow and wastes bandwidth - the dispatcher will create
an ISO at test schedule time and pass it as ISO_2. Then the test
just mounts the ISO. This makes the necessary adjustments on the
test side.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-06-19 20:21:07 +02:00
Adam Williamson b0fb6911f3 Add initial template stuff and test tweaks for ELN testing
Just a couple of flavors and tests for now.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-06-19 17:28:42 +02:00
Adam Williamson 326ea5c913 Brown paper bag fix for modularity_setup
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-06-19 17:08:05 +02:00
Adam Williamson 8b997279a4 vnc: give a dnf install command a bit longer to run
These can take a while if repos haven't been refreshed lately.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-06-19 12:42:03 +02:00
Adam Williamson 317deff82c disk_custom_with_swap: drop root part size to 6G
With the new 2G max EFI system partition size, we were trying to
stuff 12G of Fedora into a 10G disk. That wasn't going to work.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-06-19 12:30:52 +02:00
Adam Williamson 2427d8c0dc ostree: get ostree-parse-pungi.py from main again
whoops, forgot to reset this on merging the change.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-06-19 11:21:29 +02:00
Adam Williamson 30563c6aed Simplify the blivet resize LVM testcase
I don't think we need an alternative needle for ppc - the
current 'boot_inactive' needle should work fine on ppc. Let's
just always use that.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-06-18 13:00:07 +02:00
Adam Williamson 426747c368 Adjust modularity_tests to enable the modular repos at the start
As of yesterday's Rawhide, the modular repos are not installed by
default, so of course all the modular tests fail. So, install
the repos before running the tests.

This isn't conditionalized on release version as I don't think
we ever run this test on anything other than Rawhide and
Branched.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-06-18 11:15:56 +02:00
Adam Williamson d964129736 ostree rebase: drop an old unneeded workaround
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-06-12 08:56:26 -07:00
Adam Williamson e8df07813b ostree rebase: for update tests, check we deployed custom ref
This checks we actually deployed the 'fedora-openqa' ref as we
intended to (if not, the rebase test probably won't work
properly or won't test what we want it to).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-06-12 08:55:32 -07:00
Adam Williamson d07b5a4178 Tweak ostree build and rebase for update tests to be more robust
We have had several problems where rebasing from one release to
another just doesn't work, and we have to work around it somehow.
Sometimes it's difficult or impossible to do. All we want to do
here is check the rebase mechanism itself; we don't actually want
to assert that you can rebase to any specific other release.

For update tests, we should be able to use a non-standard ref
name for the ostree we build, embed into the installer image,
and install. That should mean we can then rebase to the standard
ref name for the same release, which should be much safer than
trying to rebase to a different release. We can't do this for
the compose tests, but at least for update tests I'm hoping this
makes things more robust.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-06-11 21:06:57 -07:00
Adam Williamson abc60d23c8 Drop dnfdragora from KDE app start/stop tests
It's not in the images any more. As aleasto pointed out, we're
actually being sent to Discover to install it, and matching on
*that* screen, which isn't what we intend.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-30 14:05:42 -07:00
Adam Williamson 2dade9e1d9 Revert "Workaround a notification test issue on F35 KDE"
This reverts commit a35befab8c. Per
https://openqa.fedoraproject.org/tests/1867885#step/desktop_notifications/30
and https://openqa.fedoraproject.org/tests/1932066#step/desktop_notifications/30
, in both F37 and Rawhide, clicking away an akonadi notification
no longer closes the panel, so it looks like we don't need this
any more.
2023-05-24 14:51:19 -07:00
Adam Williamson db89554357 _support_server: only create temp dir when needed
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-24 11:17:47 -07:00
Adam Williamson efc2f8ae36 _live_build: workaround util-linux-user problem for KDE live
util-linux-user subpackage was removed but comps wasn't updated.
I've fixed comps now, but that won't "kick in" until after the
next Rawhide compose; we need to workaround the issue until then.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-18 09:26:58 -07:00
Adam Williamson 3462050cf7 _live_build: drop some workarounds we shouldn't need any more
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-18 09:24:55 -07:00
Adam Williamson 37bd56033d nautilus: adjust keyboard shortcut page navigation
As recommended by @mclasen in
https://gitlab.gnome.org/GNOME/gtk/-/issues/5831#note_1743386 .

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-16 16:09:04 -07:00
Adam Williamson b1e975a21f anaconda: end install immediately if we see the error screen
If install errors out, currently we still wait like an hour for
an "install_done" screen that will never come, before we give
up. Since we have a needle for the "unknown error has occurred"
screen, we may as well use it here - if we see that screen, we
can just die immediately. This may go stale if we forget to
update the needle, but it's only one line, so meh.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-16 15:40:02 -07:00
Lukas Ruzicka e211a87fc7 Create a test suite for Disks. 2023-05-12 17:05:44 -07:00
Adam Williamson 119229cce7 Add a needle cleanup script, enhance the needle check script
This adds a new script - cleanup-needles.py - to use for cleaning
up old needles. It has to be used in conjunction with a database
query; the comment at the top explains how to do that query and
export the needed information. It produces a git commit with
needles that haven't matched since a certain date (specified in
the sql query) removed, subject to a 'keeplist' of needles we
keep even if they seem to be old.

I also enhanced check-needles.py to check for cases where tests
seem to be trying to match a tag we have no needles for. This
was necessary to find cases where the cleanup script was too
aggressive (i.e. the things that wound up in the 'keeplist'),
but it also turned out to find quite a lot of cases where the
code really *was* looking for a needle that had gone in a
previous cleanup or that never existed; the commits before this
one clean up a lot of those cases.

The code to decide which string literals are needle tags is
pretty dumb and hacky and needs some manual cueing sometimes -
that's what the `# testtag` changes in this commit are for.
Making it smarter would probably require this script to get a
lot more complicated and either incorporate or become a
tokenizer, which I don't really want to do.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-04 09:57:15 -07:00
Adam Williamson 1effed1069 Drop unused branch and needle in desktop_login
We never hit this path without a system menu button any more,
due to changes in KDE over time. It hasn't been hit for two years.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-04 09:57:15 -07:00
Adam Williamson 3e6e80ca87 Drop a no-longer-reached branch and associated needle
Now both GNOME and KDE do offline updates on all supported
releases, we never see an 'update done' screen any more. This
branch is left over from when the KDE offline update branch was
still conditional on release number.

If we ever implement this test on a desktop that doesn't do
offline updates, we can put this back easily enough.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-04 09:57:15 -07:00
Adam Williamson c7e0af6e8c Simplify blivet_btrfs_preserve_home, drop unneeded needles
There's no need to do all this 'check whether it's selected and
click it if not' stuff (for three different mount points). Just
always click it. If it's already selected, clicking it again
doesn't hurt (one of these stanzas even clicks it *even if it's
selected*!)

If we need to cover both cases, we just need two needles with
the same tag, we don't need separate code paths. In each case,
though, we actually haven't matched one of the needles for ages
(the most recent was part_boot_selected, but now we're using
GPT by default, we won't hit that any more as it'll be the BIOS
boot partition that's selected by default), so delete the needles
we aren't matching any more. If we *do* hit any case where we
need to handle the 'other' state, we can just add the alternative
needle with the same tag.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-04 09:57:15 -07:00
Adam Williamson 73e9c5c27e Drop a check for ext4 filesystem already selected
This has not been hit for a year (on stg; three years on prod).
I *think* it would only be hit if we ran the test on an Everything
image, but as the test is now specifically associated with the
Server install DVD, that doesn't seem likely to happen.

If we somehow *do* hit ext4 pre-selected again, this can still
be handled simply by adding an alternate
anaconda_blivet_part_fs_ext4 needle which matches on ext4 already
being selected; that avoids the need to keep an alternate code
path around.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-04 09:57:15 -07:00
Adam Williamson b62d832c3a cockpit updates: drop the security branch, update 'ignore' needle
This branch is very fragile, because the test won't fail if we
miss the match on the security needle. So in practice, we are
never going to notice when the needle goes stale, and we'll just
wind up never triggering this branch and always going down the
other path. That's the current situation: the security_install
needle last matched more than a year ago at least. Let's just
admit the truth here and drop the branch entirely.

Also update the cockpit_updates_restart_ignore needle. This is
in a similar case - we don't really notice when it goes stale,
as the test completes, it just takes a bit longer - but since
this one is quite easy to find, let's just update it instead of
dropping it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-04 09:57:15 -07:00
Adam Williamson 9199f8a0f0 Drop gnome-contacts softfail for "Unnamed Person" problem
This was resolved upstream and we're no longer hitting this bug
in tests on F38, Rawhide or even F37 respins, so we should no
longer need this workaround.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-04 09:57:15 -07:00
Adam Williamson 7dece68ae6 Drop old branch of gnome-text-editor 'skins' test
This is never hit any more, everywhere we run this test is on
the newer code now.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-04 09:57:15 -07:00