1
0
mirror of https://pagure.io/fedora-qa/os-autoinst-distri-fedora.git synced 2024-11-25 07:13:09 +00:00
Commit Graph

2479 Commits

Author SHA1 Message Date
Lukas Ruzicka
bc0f512ba7 Add needles that have failed. 2022-12-06 14:02:00 -08:00
Lukas Ruzicka
ef4f819703 Lower the needle level. 2022-12-06 14:02:00 -08:00
Lukas Ruzicka
5f44ba0c55 Delete old needles. 2022-12-06 14:02:00 -08:00
Lukas Ruzicka
1d6458ae5a Delete potentionally useless needles. 2022-12-06 14:02:00 -08:00
Lukas Ruzicka
6c5882e079 Set the level low for all menu needles. 2022-12-06 14:02:00 -08:00
Lukas Ruzicka
48a601ddc4 Review the needles and try to get rid of duplicates. 2022-12-06 14:02:00 -08:00
Adam Williamson
98653847d3 Add missing single quotes
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-06 14:01:51 -08:00
Adam Williamson
7536b6ce10 ostree_build: tee and timestamp the rpm-ostree output
Instead of just redirecting it to a log file, let's tee it, so
simple errors can be read off a screenshot without bothering to
download the file. Also, let's timestamp it (via `ts` from
moreutils) so we can see which bits of it take a long time...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-06 13:38:57 -08:00
Lukas Ruzicka
bf2f8d7305 Add two more needles for Maps. 2022-12-06 10:45:19 +01:00
Adam Williamson
894cc5072e Update some more maps needles
I think these needles are pretty fragile to changes in the
underlying OSM dataset, not just in Maps itself...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-05 17:54:56 -08:00
Adam Williamson
6e0192fed4 Update anaconda warning bar needle
It seems to have become more orange.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-05 10:09:32 -08:00
Adam Williamson
1fecb3f9c4 Add an 'already selected' needle for root password screen
In case it's already selected/highlighted on the hub.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-05 10:08:49 -08:00
Adam Williamson
9b97028a25 Update the Maps 'found Scarborough' needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-05 10:07:50 -08:00
Lukas Ruzicka
1605706fb3 Set timeout to 60 on startstop needles. 2022-12-05 15:16:16 +01:00
Lukas Ruzicka
f29572ba76 Abrt should not fail on found issues but softfail on startup tests. 2022-12-05 14:30:03 +01:00
Lukas Ruzicka
7daa4b3dd0 Give more time to the needle to avoid failing on delayed start. 2022-12-05 14:03:48 +01:00
Adam Williamson
1ae7065961 ostree: use scratch disk as target for rpm-ostree compose
Seems like we might be running out of space on this step on F35.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-03 16:16:39 -08:00
Adam Williamson
c2fb8fa83b Use 'main' branch for ostree-parse-pungi.py checkout
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-03 12:29:23 -08:00
Adam Williamson
e45473103f Upload appropriate logs on ostree_build failure
Also use get_var("TEST") for installer_build - no point trying
to upload these logs for the other tests in the same flavor,
they won't be there.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-03 11:17:17 -08:00
Adam Williamson
37412b95a8 ostree_build: bump timeout on ISO build
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-03 11:10:37 -08:00
Adam Williamson
9d050b8501 Add missing console_in_toolbox needle for ostree tests
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-02 23:09:17 -08:00
Adam Williamson
55721ae690 Drop match levels on the akonadi migration needle
To catch minor variations.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-02 15:53:10 -08:00
Adam Williamson
ba88dac325 Handle chunked ADVISORY_NVRS_N settings
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-01 15:52:20 -08:00
Adam Williamson
3c957de6d8 Update needles for Cockpit 281 (workaround)
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-01 15:49:56 -08:00
Adam Williamson
03b6663339 Add tests to build a Silverblue installer image and install it
This is like the existing tests that build network install and
live images then install them, only for Silverblue. First we
build an ostree, using the standard configuration for the release
and subvariant but with the 'advisory' and 'workarounds' repos
included, so it will contain current stable packages plus the
packages from the update and any workarounds. Then we build an
ostree installer image with the ostree embedded, again including
advisory and workarounds repos in the installer build config so
packages from them will be included in the installer environment.
The image is uploaded, which completes the _ostree_build test.
Then an install_default_update_ostree test runs, which does a
standard install and boot from the installer image.

We do make a change that affects other tests, too. We now run
_advisory_post on live image install tests, as well as this new
ostree install image install test. It was skipped before because
of an exception that's really only needed for the netinst image
install test. In that test, packages from the update won't be
included in the installed system, so we can't run _advisory_post
on it. But for ostree and live image build/install tests, the
installed system *should* include packages from the update, so
we should check and make sure that it does.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-11-30 13:17:28 -08:00
Adam Williamson
4f3a5acea7 Update an anaconda help needle for some change in Rawhide KDE
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-11-29 09:49:34 -08:00
Adam Williamson
7a25ad7023 Add a variant nautilus app needle for F36 (respin tests)
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-11-29 09:48:35 -08:00
Adam Williamson
137f2a2176 nautilus: check app started *before* trying to fullscreen it
Seems to make a lot more sense this way around.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-11-29 09:41:47 -08:00
Adam Williamson
1429e5b1c8 Give all update tests the same priority, ahead of compose tests
It doesn't make sense for update tests to have different
priorities. We gate on all update tests, so they are all equally
important. With varying priorities we get a problem: if 10
updates are created quite close together, first we do all the
prio 30 and prio 40 tests for all of them, and only after all of
those are done do we get to the prio 41 and 42 tests for the
earliest of the updates, which means they can be waiting longer
than they should to have all the tests done. If all the tests
have the same priority, openQA should always use creation time
to order them, so it should prioritize finishing tests for
earlier updates, which is what we want.

Update tests are also more time-critical than compose tests,
because we gate on update tests. So we should prioritize update
tests over compose tests in all cases.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-11-28 08:43:30 -08:00
Adam Williamson
c1f0c65a3e Move some tap job groups to new 'tap2' worker class
This is intended to allow us to split the workload across
multiple tap workers, as right now, sometimes we wind up in a
situation where all non-tap jobs are done and the non-tap
workers are sitting idle, but the poor tap worker has a backlog.
This way the tap jobs for updates can be split across two
worker hosts, which should help out.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-11-25 17:33:31 -08:00
Adam Williamson
8ce76de09f Revert "Retry tests affected by #2119970 three times"
This reverts commit 41d8d5923a. The
bug seems to have magically disappeared, so hopefully we should
not need this any more.
2022-11-25 12:21:41 -08:00
Adam Williamson
173bdef5cb Revert "Try and get more detailed Firefox logs from startx"
This reverts commit f424e5bac5. It
never actually worked, and the Firefox-dying bug seems to have
magically gone away recently.
2022-11-25 12:13:08 -08:00
Adam Williamson
c9191b0d4a disable_firefox_studies: don't run twice, skip uploads
There's no need to run this twice (which can happen on some
paths), so if the first file already exists, just bail. Also,
don't bother uploading the config files any more - that was just
for debug while I was making this stuff work, now it works, and
this saves some time.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-11-25 11:39:39 -08:00
Adam Williamson
9d8a35ed39 cockpit: don't try and get admin privs when re-logging in
There's one point in the tests where we may log into cockpit for
the second time in one run (it depends how a package update
process goes). When this happens, we don't get prompted again
for admin access, so we need to *not* expect that.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-11-25 11:24:52 -08:00
Adam Williamson
2c6e1ec76b post_fail_hook: give dnf -y install tar a bit longer
It seems to time out a lot on lab but not on prod, for some
reason. Let's just give it a little longer.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-11-25 11:12:46 -08:00
Lukas Ruzicka
d4717ff090 Create test suite for Maps. 2022-11-21 18:17:11 +00:00
Adam Williamson
b388c6fc94 cockpit: enable admin mode after logging in as test
Sigh, this is a pain and adds more fragile needles.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-11-18 17:24:15 -08:00
Adam Williamson
0646dc64ad cockpit: log in as user 'test', not root
From 280, the cockpit package disabled logging in as root by
default. We could wipe that config file, but it seems better to
respect the default config and log in as the admin user 'test'
instead of as root.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-11-18 16:34:55 -08:00
Adam Williamson
c9924ecdeb Drop workaround which went stable two weeks ago
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-11-18 13:19:48 -08:00
Adam Williamson
3c13f02679 Revert "_advisory_update: stop the graphical desktop at the start"
This reverts commit 3208d15725 and
the two follow-ups. I'm hoping
https://bugzilla.redhat.com/show_bug.cgi?id=2133829 is now
resolved; this was intended to help with that (though I'm not
sure it ever really did), and so we can hopefully ditch it, which
simplifies this code.
2022-11-18 12:23:33 -08:00
Adam Williamson
604da9142e Reduce QEMURAM back to 3G for most cases
Hopefully https://bugzilla.redhat.com/show_bug.cgi?id=2133829
is fully resolved/worked around by now, and we shouldn't need
these any more. We could drop back to 2G but let's just do
3G for now.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-11-18 11:57:38 -08:00
Adam Williamson
bc20fc9147 Misc needle updates for Rawhide
The Rawhide 'accept fate' text seems to have lost its Japanese
translation for some reason (I think the string might have had
a terminating period removed). And in one test, the "Extract"
menu item in Archiver was pre-highlighted so the needle didn't
match. Not sure why, but this doesn't seem like a problem, so
let's just handle it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-11-17 10:32:39 -08:00
Adam Williamson
ecb039cdb1 Update a KDE needle for change in recent Rawhide
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-11-09 08:46:58 -08:00
Adam Williamson
32da572cfb Update Cockpit needles for new release 279
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-11-09 08:45:49 -08:00
Adam Williamson
90f7d513a3 Remove an unneeded needle caused by merge order
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-11-04 11:03:35 -07:00
Adam Williamson
a92095e288 Add missing profile from previous commit
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-11-03 10:04:11 -07:00
Adam Williamson
84adf7262a templates: Drop special-casing of Cloud_Base on Rawhide
This was from F35 era when Cloud_Base worked on UEFI on Rawhide
but not F33 or F34. Now F34 is EOL, we can just follow the same
policy for every release (run two tests on both BIOS and UEFI,
the rest only on UEFI).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-11-03 09:18:28 -07:00
Adam Williamson
4c49a94a66 Update zezere provision schedule needle
Some tiny font/rendering difference.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-11-02 11:09:18 -07:00
Adam Williamson
5686285b9b Update gnome-text-editor side panel needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-11-02 11:08:55 -07:00
Adam Williamson
55b40a5e7b Update KDE no notifications needle for latest KDE bits
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-11-02 11:08:34 -07:00