Commit Graph

1102 Commits

Author SHA1 Message Date
Adam Williamson 8f888317b5 anaconda_help: create test plans before the first assert_screen
So we can bail early enough on webUI.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-25 14:55:20 -07:00
Adam Williamson d9ebb56ebf Sigh, it's record_soft_failure, not register_soft_failure
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-25 14:51:35 -07:00
Adam Williamson 539f8a54fc Effectively skip anaconda_help on F39+ Workstation live for now
There isn't any Help in the webUI installer, really. In future
it's meant to have more 'contextual' help - little question
mark icons next to elements of the UI that explain them when
clicked on - which we could implement tests for, but this isn't
done yet.

Let's not skip scheduling the test entirely, because we can
still run it on F38 respins, and we may be able to implement
testing of the contextual help in future. So let's just soft
fail and return immediately. If we get to F39 stable without
the contextual help being implemented (or it turns out not to
be testable within the confines of this design), we can skip
scheduling the test on webUI images entirely.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-25 14:48:42 -07:00
Adam Williamson f22af41f0f ostree: avoid rebasing from F39+ to <F39
Now F39 has branched from Rawhide, we can tweak the rebase logic
to never rebase from F39+ to <F39, and avoid
https://github.com/fedora-silverblue/issue-tracker/issues/470 .

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-23 16:12:57 -07:00
Adam Williamson f1a6c91784 Drop a couple of webUI conditionals to 39, not 40
We just landed the webUI stuff for F39, so now we need these
conditionals to kick in for F39+, not F40+.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-23 15:48:53 -07:00
Adam Williamson efe4a3da2e Maps: sigh, okay, need another test logic change for Loupe
Loupe's Open dialog defaults to Recent, not Pictures, so when
we're using Loupe we need to click into Pictures to find the
exported image.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-23 11:17:06 -07:00
Adam Williamson af8a6635a6 Maps: go back to always typing 'image viewer'
Loupe has replaced EOG on F39 and Rawhide, and it can be found
with "image viewer", so let's just go with that. The rest of the
logic should be OK but we will likely need some new needles,
will do that next.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-23 11:03:36 -07:00
Adam Williamson 0d8df76b1b apps_startstop: new GNOME image viewer is not in Utilities
It's on the top level.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-23 10:34:03 -07:00
Adam Williamson d0ac2a5ba8 notifications: also handle the welcome tour on live flow
Seems with the g-i-s / anaconda webUI changes we also get the
welcome tour here now.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-23 10:19:56 -07:00
Adam Williamson 9528d37582 launch desktop, not installer, at end of g-i-s on notifications
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-23 10:15:07 -07:00
Adam Williamson a8d17e057f Whoops, get the release number correctly
Wow, I am not awake yet.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-23 09:47:03 -07:00
Adam Williamson 602636ef24 Handle new live g-i-s flow in desktop_notifications
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-23 09:42:54 -07:00
Adam Williamson 026f70e063 webui: only select disk if we have more than 1
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-23 09:12:30 -07:00
Adam Williamson d000a96fc6 Remove the EOG app test
EOG has been replaced by Loupe in F39+. We will need to add a
test for Loupe, but first let's remove the EOG test so it does
not fail on every compose.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-23 09:07:06 -07:00
Adam Williamson ec5bab0176 Initial anaconda webUI support
This is tailored to the initial deployment of webUI in
Workstation live images only; we may need to tweak flows and
approaches as webUI goes further.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-22 18:05:51 -07:00
Adam Williamson 14bd0b177e FreeIPA replica test: decommission the replica
A new FreeIPA update adds a check which causes a failure when
we try to decommission the original server with the replica
still alive. Let's see if decommissioning the replica helps.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-22 01:18:08 -07:00
Adam Williamson 329d878343 Revert "workaround odd dnf issues with samba-4.19.0-0.3.rc2 updates"
This reverts commit 511b5382ec.
The updates have gone stable and we don't need the workaround.
2023-08-22 01:18:08 -07:00
Adam Williamson 2e330f78ab podman: also run the upstream integration test suite
Per https://github.com/containers/podman/pull/19302 and
https://github.com/containers/podman/issues/19299 , upstream
have kindly set things up so we can easily run relevant parts of
the upstream test suite as an integration test in openQA. This
should help us catch if changes in other components break key
features of podman.

This only runs any tests with podman 4.6.1 or higher, but with
earlier versions it just does nothing and exits 0, so that's
fine. 4.6.1 is in F39 and Rawhide already, will land for F37
and F38 shortly.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-16 22:56:20 -07:00
Adam Williamson 511b5382ec workaround odd dnf issues with samba-4.19.0-0.3.rc2 updates
dnf seems to have some odd trouble with these updates. It
 really wants to use the older 2.rc2 builds, even though there
doesn't seem to be any actual *problem* with the 3.rc2 builds.

For the samba server test, passing `--best` to dnf seems to be
enough to make it use the .3.rc2 builds. For the FreeIPA tests,
we have to do a second pass with `--best` after the initial
install.

It's weird that we have to do this, but to get these updates
through - because there doesn't really seem to be a problem
here - let's do it. They will replace the 2.rc2 builds in the
main F39 and Rawhide trees once they land in 'stable' so the
problem shouldn't persist.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-16 12:18:42 -07:00
Adam Williamson 91bf4e423f Disable forced use of HTTP 1.1 for curl and git
To see if the bug has gone away now -
https://pagure.io/fedora-infrastructure/issue/11426#comment-867456

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-10 15:13:04 -07:00
Adam Williamson 94a743b37e Drop _live_build mock config corrections for F39 and F40
These should no longer be needed with the new mock-core-configs
and mock. Tested on stg.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-10 12:54:36 -07:00
Adam Williamson ccda54d0f7 Fix launching eog on Silverblue
We still have to type "image viewer" there, for now.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-09 18:04:05 -07:00
Adam Williamson 8483e7bd82 Workaround mock-core-configs not being updated for F39 branch
mock still thinks the releasever for Rawhide is 39, which causes
it to use the wrong GPG keys and not be able to install packages.
This overrides that setting in our mock config file, until
mock-core-configs is updated in the distro.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-09 15:21:35 -07:00
Adam Williamson b228af2f76 Sigh, declare $mockver
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-09 14:27:38 -07:00
Adam Williamson 98bb256950 live_build: tweak mock config used for Rawhide
The numbered config file won't always exist right after branch
(there is no fedora-40-x86_64 now, for e.g.) But the named one
always does. This additional variable is a small price to pay for
making the test more robust.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-09 14:26:02 -07:00
Adam Williamson 53bd47d909 Disable modular repos for upgrades to F39 as well (#2230720)
We know this is broken and we don't want it to fail on every
update, so we need to work around the problem for now.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-09 14:25:24 -07:00
Lukas Ruzicka 8ac3885897 Make various fixes in Workstation product to make tests pass. 2023-08-08 14:50:03 +02:00
Adam Williamson ae7d5011df Fixes for Active Directory client tests
abbra told me where I was going wrong with the 'expected' target
of the getent command ("AD/" is not a magic string, it's just
"(netbiosname)/", and our netbios name is "SAMDOM"...) so this
fixes that too, trying to avoid hard-coding stuff.

For the kickstart test, it seems like it's a timing issue. We
added this 'install sssd-tools and enable debugging' step to try
and debug it, and instead it fixed it. So...let's just stick
with this, for now, because it's useful to have this debugging
anyway. If the problem starts happening again, we can fiddle
about with it more.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-05 11:22:37 +01:00
Adam Williamson 601d0c4f96 Disable modular repos for Rawhide upgrades to avoid #2228827
As 'real' upgrades (using releases/development/rawhide on the
mirrors) do not hit this bug because it has a stale Modular
tree, it makes sense to work around the bug in testing so we can
see if upgrades are broken in any *other* way.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-05 09:44:13 +01:00
Adam Williamson 92dbd802e8 koji-rawhide: set skip_if_unavailable=1 for now due to 404 issues
We're seeing a lot of tests fail on 404s when trying to access
the koji-rawhide repo (the repo for the Rawhide build tag, which
we use to get packages tagged since the last compose. nirik is
trying to figure this out from the server end, but for now at
least, let's mark the repo as skip_if_unavailable. This should
mean that if we hit a 404, the test will continue, it just won't
have access to the packages from that repo. Occasionally this
will cause a problem - a false failure or false pass - but this
still seems better than every test that hits it failing. The
false pass case is the most concerning, but I would hope in that
case some other tests from the same update would fail, making it
not an issue.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-02 09:10:55 +01:00
Adam Williamson 6f0480727f Make sure live image volume ID isn't longer than 32 chars
This can happen now we allow working on multiple Koji tasks.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-07-28 15:10:37 -07:00
Adam Williamson 2e572d72b6 Add --http1.1 to one curl command that didn't have it
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-07-28 10:50:15 -07:00
Adam Williamson 0e01e4e659 Use fXX-build in the koji-rawhide repo definition, not rawhide
Per nirik, 'repos/rawhide' is just a symlink to 'repos/fXX-build'
and this could possibly be part of our 404 problem. So let's
try using fXX-build directly instead of the symlink.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-07-28 10:31:32 -07:00
Adam Williamson 74b468b949 Add Samba AD tests
This adds a Samba AD server test, and client enrolment tests via
sssd, Cockpit and kickstart. Requires the matching createhdds
commit to add the kickstart to the disk_ks image.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-07-27 16:14:30 -07:00
Adam Williamson ba1d492416 ostree: only use --unified-core on F39+
I think it's breaking F37 and F38 tests, not surprisingly as we
didn't do all the fixes there.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-07-27 12:26:23 -07:00
Adam Williamson bf4a8ec454 Enable unified core for ostree composes
It got enabled in production, so we should do the same here.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-07-25 18:35:58 -07:00
Adam Williamson 2d6180b25e Try forcing HTTP/1.1 for pagure.io git clones
The change to the curl commands to force HTTP/1.1 seems to have
stopped them failing, so let's try doing it for the git clones
too and see if that avoids the problem till we can work out
what is causing it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-07-24 11:56:28 -07:00
Lukas Ruzicka 0a10727a7a Remove modularity tests.
Modularity will be retired in Fedora 39 and the modular repository
removed. Also, the upcoming version of DNF that is default in
Rawhide, does not support modularity, so the tests are currently
failing anyway.
2023-07-20 10:23:44 +02:00
Adam Williamson d5a9e4777e Retry all pagure.io downloads
This tweaks all pagure.io downloads to be retried a few times,
since we seem to be getting failures quite often. We use curl
for this as it has nice options for it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-07-19 13:37:29 -07:00
Lukas Ruzicka 3e7936fd01 Replace the dropped pactl with amixer to manipulate audio levels. 2023-07-17 14:30:05 +02:00
Adam Williamson f49c8bc66b gnome-text-editor: only handle spellcheck language if needed
The Flatpak build doesn't have the spellcheck issue at the
moment, and it may be fixed soon in the RPM build. Trying to
'fix' the issue on the flatpak build actually makes the test
fail. So, let's only do the fix if we actually have a misspelled
word.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-07-05 12:19:41 -07:00
Adam Williamson ba9a36d10e g-t-e: mark 'new_file' test as fatal
The tests after it assume new_file ran - they rely on the file
it creates - so it should be considered fatal.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-07-05 11:39:18 -07:00
Adam Williamson 1f24f84bb1 Support testing a side tag instead of an update or task
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-07-04 19:10:03 -07:00
Adam Williamson d8c374044a Add more safety to the fullscreen for Archiver
We can't really just hit super-up and then immediately go on our
merry way clicking on stuff...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-07-04 17:25:52 -07:00
Adam Williamson 20a2d161ca Add some safety to g-t-e language setup
Seems in Rawhide the menu is loading without dividers briefly,
we match there, then the dividers load in and make the menu
longer, so when we click, we hit a different entry in the menu.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-07-03 11:31:48 -07:00
Lukas Ruzicka d749317f29 Update the Gnome-Text-Editot test.
The editor started to show spell-checking that would require a lot
of new needles to be created. Theredore, we set the language to
English to stop showing the spelling mistakes in aaa_setup.pm

Also, the application started to have problems with getting correct
focus, so we want to click into the text before the status gets
recorded.
2023-06-30 14:26:00 +02:00
Adam Williamson fbb9bd7386 Revert "_live_build: workaround util-linux-user problem for KDE live"
This reverts commit efc2f8ae36.
As the comment said, it's no longer needed.
2023-06-28 16:52:48 +02:00
Adam Williamson 5c6ae24e99 _live_build: FIXME for using three disks
Change the comment on why we put /var/lib/mock on the third hard
disk: we probably can cut it down to two, now, but I don't want
to do it right now.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-06-28 16:48:55 +02:00
Lukas Ruzicka 4c426051ce Remove the Photos start-stop test.
Based on the information that the application has been removed
from the standard Workstation installation, see
https://pagure.io/fedora-comps/c/462b65876fb4258fdb2ce19f4193900ef2bdc2d9?branch=main,
we remove that application from this suite.
2023-06-28 13:44:31 +02:00
Adam Williamson 500fea03ad Fix workaround repo in live images
D'oh. This is the first time we actually tried to use the new
workarounds ISO thing for real, I forgot to update some paths.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-06-26 01:50:49 +02:00