1
0
mirror of https://pagure.io/fedora-qa/os-autoinst-distri-fedora.git synced 2024-11-16 19:53:09 +00:00
Commit Graph

118 Commits

Author SHA1 Message Date
Adam Williamson
6daf9c36a0 Make rpm-ostree tests generic, run on Silverblue and CoreOS
This makes the two rpm-ostree tests written for IoT - overlaying
and rebasing - work across all rpm-ostree-based flavors we
currently test (IoT, CoreOS and Silverblue) and runs them on
all those flavors.

This requires some other changes. For the Workstation ostree
installer update tests, we have install_default_update_ostree
upload a disk image and run these tests on that image. That means
install_default_update_ostree cannot use a scratch disk (as if
we boot it with two disks but only upload one, the subsequent
tests fail to boot, looking for the missing second disk), but its
specified disk size should be large enough for all updates.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-16 08:44:43 -08:00
Adam Williamson
fdf4e4e757 Put INSTALL variable back for LVM resize tests
These actually *do* need it because they have START_AFTER_TEST
set, but they're still install tests.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-13 12:25:38 -08:00
Adam Williamson
7429b438fd Don't update system in repo_setup on update install tests
When I enabled _advisory_post for live and ostree install tests,
the point was to check that updated packages were included in
the install media and used during installation. We shouldn't run
a system update in _repo_setup_updates on this path because it
will hide the problem if the updated packages weren't included.
The INSTALL variable is for this purpose - it was previously
used to skip _advisory_post on the same path. At the same time
let's remove some stray settings of this var on non-update tests
as it serves no purpose there.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-09 13:07:15 -08:00
Adam Williamson
f752b4c00a Don't snapshot after wait_login tests (usually)
We currently snapshot after every run of _console_wait_login or
_graphical_wait_login, which means we snapshot *twice* on most
update tests as those modules get run twice. However, we almost
never use those snapshots. Snapshotting takes quite some time,
and hits the disk pretty hard, so we should avoid it unless it
is really needed.

We only have a few modules that are not fatal (and so might use
the snapshots), and most of those don't run after one of these
tests, or run after a later module that's also a milestone. Best
I can tell, only two test suites really need to use a snapshot
from a login test: server_cockpit_updates and modularity_tests.
To handle these and potential future cases, we'll add a new
module that does nothing, but is marked 'milestone', so it will
take a snapshot, and load that test after the login test if the
var LOGIN_SNAPSHOT is set, and set that var for those two suites.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-08 09:59:23 -08:00
Adam Williamson
c1f0c65a3e Move some tap job groups to new 'tap2' worker class
This is intended to allow us to split the workload across
multiple tap workers, as right now, sometimes we wind up in a
situation where all non-tap jobs are done and the non-tap
workers are sitting idle, but the poor tap worker has a backlog.
This way the tap jobs for updates can be split across two
worker hosts, which should help out.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-11-25 17:33:31 -08:00
Adam Williamson
8ce76de09f Revert "Retry tests affected by #2119970 three times"
This reverts commit 41d8d5923a. The
bug seems to have magically disappeared, so hopefully we should
not need this any more.
2022-11-25 12:21:41 -08:00
Lukas Ruzicka
d4717ff090 Create test suite for Maps. 2022-11-21 18:17:11 +00:00
Adam Williamson
604da9142e Reduce QEMURAM back to 3G for most cases
Hopefully https://bugzilla.redhat.com/show_bug.cgi?id=2133829
is fully resolved/worked around by now, and we shouldn't need
these any more. We could drop back to 2G but let's just do
3G for now.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-11-18 11:57:38 -08:00
Adam Williamson
a92095e288 Add missing profile from previous commit
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-11-03 10:04:11 -07:00
Adam Williamson
84adf7262a templates: Drop special-casing of Cloud_Base on Rawhide
This was from F35 era when Cloud_Base worked on UEFI on Rawhide
but not F33 or F34. Now F34 is EOL, we can just follow the same
policy for every release (run two tests on both BIOS and UEFI,
the rest only on UEFI).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-11-03 09:18:28 -07:00
Adam Williamson
f61a01548e Bump QEMURAM to 4G for kde-live-iso flavor
This is getting messy, but even the install_default_upload test
is failing out with 3G now. Let's try putting 4G here so it
reaches that test and see how that goes.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-10-31 10:56:34 -07:00
Adam Williamson
d94ffaa72e Give FreeIPA upgrade tests 3 hours to run
These can take a while.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-10-24 12:53:22 -07:00
Adam Williamson
41d8d5923a Retry tests affected by #2119970 three times
We keep running into 2119970 and it's really a pain restarting
tests manually all the time. So let's just retry the affected
tests three times. Big hammer time!

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-10-20 18:11:41 -07:00
Lukáš Růžička
5ea921b17b Create tests for Gnome Contacts. 2022-10-18 14:22:52 -07:00
Adam Williamson
05c38f3023 Give more desktop update tests 4G of RAM
Looking through more openQA failures I saw other desktop update
tests which were clearly caused by OOM kills, so let's give all
the desktop tests we run on updates 4G for now.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-10-13 10:12:53 +02:00
Adam Williamson
fe383fcec5 Give desktop_browser 4G of RAM
We're seeing a lot of failures recently in desktop_browser caused
by the browser or desktop getting OOM killed. I've filed a bug
on this: https://bugzilla.redhat.com/show_bug.cgi?id=2133829
but we need to try and work around it, having the test failing
constantly is no good. Let's see if 4G of RAM is enough.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-10-13 09:50:22 +02:00
Adam Williamson
baf9c10424 Increase QEMU_MAX_MIGRATION_TIME to avoid incomplete tests
We see tests periodically come up incomplete with this:
"Migrate to file failed, it has been running for more than 240 seconds"
Turns out there's a setting for this, so...let's set it. I don't
think there's really a bug here, just when our workers are busy,
these migrations can take longer than expected.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-10-12 10:35:02 +02:00
Lukas Ruzicka
5d3fc244eb Create the test for system monitor. 2022-10-10 15:14:21 +02:00
Lukas Ruzicka
ba0062e5be Create a test case for Archiver. 2022-09-22 08:59:07 +02:00
Adam Williamson
5b897801bf Bump RAM on x86_64 machines to 3G
Workstation tests on Rawhide are getting OOM killed. Let's see
if this helps. All the other arches have this much already, and
the worker hosts can handle it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-08-18 13:41:13 -04:00
Lukáš Růžička
9e0ec721a6 Create a new test for Gnome Weather 2022-08-08 18:24:51 -07:00
Lukáš Růžička
c40a35ea62 Add a new test for Calculator. 2022-08-05 11:34:22 -07:00
Lukáš Růžička
48ec73e814 Create a test suite for Nautilus. 2022-07-12 16:01:36 -07:00
Lukáš Růžička
7c1e686d14 Create tests for Help. 2022-06-29 23:06:37 +00:00
Lukáš Růžička
6f00e3fe8a Create tests for Clocks. 2022-06-23 21:41:56 +00:00
Adam Williamson
25f59d86da Bump HDDSIZEGB for more GNOME and KDE products
We have it at 20G for Workstation live, but not for KDE live or
for the update Workstation or KDE products. We just hit an issue
today where anaconda thinks 10G isn't enough space for a KDE
live install after a grub2 update (which I think only bumped
the required space veeery slightly, but enough to throw anaconda
over the limit). Let's just go up to 15G for all GNOME and KDE
cases where we're not at 20G.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-06-08 16:53:47 -07:00
Adam Williamson
c41bcd56de Use std video on ppc64le as virtio is broken (#2070333)
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-30 12:51:52 -07:00
Adam Williamson
810ab3777d Try running iot_zezere_server on minimal UEFI image instead
OK, so we can't have parallel tests on different machines, so
we can't have iot_zezere_server on 64bit and iot_zezere_ignition
on uefi. We need both to be on uefi. So, let's try using the
minimal-uefi image that we build for upgrade tests instead. It's
built for -1 (which is the same as CURRREL) on x86_64 and aarch64
so it should be there when we need it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-17 11:12:20 -07:00
Adam Williamson
fd08abf954 Add back the 64bit IoT profile needed for previous commit
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-17 10:40:53 -07:00
Adam Williamson
03e87ba8d0 Switch iot_zezere_server back to 64bit not uefi
It boots the 'support' disk image, not the image created by
install_default_upload, and that disk image is only set up for
BIOS boot.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-17 10:26:29 -07:00
Adam Williamson
a60f19b5e7 Switch IoT tests to all run on UEFI
It doesn't support BIOS any more...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-01 16:02:21 -08:00
Adam Williamson
4251b7b73a Rename desktop_printing_cups back to desktop_printing
It's best to keep the test name consistent unless we *really*
have to change it; that way the "past runs" history in openQA
still works and the name doesn't change in resultsdb and CI
messages.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-10 09:35:50 -08:00
Adam Williamson
ad52e3a94d Add a space to USE_CUPS in templates to match style
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-10 09:33:15 -08:00
Lukáš Růžička
9a56adcfd0 Modify Desktop Printing test to use two different methods.
The PR introduces an improved logic to the desktop_printing.pm
that allows to use the USE_CUPS variable in templates to trigger
the installation of cups-pdf prior to the actual test.
The cups-pdf is then used as an alternative PDF printer
instead the built-in Save As PDF method.
2022-02-10 09:35:22 +01:00
Lukáš Růžička
ceaf711f76 Create a test suite for Gnome Text Editor 2022-01-29 00:49:10 +00:00
Adam Williamson
24e3ecb89f Drop gedit application tests
Workstation has replaced gedit with gnome-text-editor in Rawhide,
so this is no longer useful. We will replace it with a test suite
for gnome-text-editor.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-18 15:52:40 -08:00
Lukáš Růžička
3a5c499e52 Remove desktop_notifications_live from upgrade test. 2021-12-10 13:01:38 +01:00
Lukáš Růžička
f8e9e10e8a Rename tests and flavours as per review. 2021-12-08 13:38:57 -08:00
Lukáš Růžička
eb99e809f9 Switch on upgrades even for aarch64. 2021-12-08 13:38:57 -08:00
Lukáš Růžička
33b52caded Switch on in all workstation tests. 2021-12-08 13:38:57 -08:00
Lukáš Růžička
e85f09f071 Add a new flavour to test upgrade postinstall tests. 2021-12-08 13:38:57 -08:00
Lukáš Růžička
cda0d0b0d1 Create a test suite for EoG (Image Viewer) 2021-11-18 13:13:59 -08:00
Adam Williamson
4860ad1398 Revert "Stop using virtio video temporarily (#2020438)"
This reverts commit 9dbd614fe4
(and a follow-up commit). The bug has been fixed in the latest
Rawhide kernel, so we can go back to virtio.
2021-11-09 15:52:32 -08:00
Adam Williamson
0519c8ec2c Use virtio graphics for server_cockpit_updates test
With qxl it hits a weird bug where running startx a second time
after snapshot restore tends to crash. This is affecting updates
so let's force it to virtio. Hopefully the kernel build with
virtio fix will succeed so I can just revert all this messing
around soon.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-09 08:44:45 -08:00
Adam Williamson
498915d864 Use 'ide-hd' instead of deprecated 'ide-drive' in SATA test
This was deprecated in qemu 4.2, but only actually taken out in
6.1.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-08 14:40:47 -08:00
Adam Williamson
9dbd614fe4 Stop using virtio video temporarily (#2020438)
It's totally broken in Rawhide, so let's use qxl or another
fallback temporarily. Hopefully not too many other bugs show up
with this.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-08 08:37:20 -08:00
Adam Williamson
53b2afb217 Drop memtest test for now
We dropped memtest from the images. We may replace it with
something better at some point, but until that day, let's drop
this test so it's not uselessly failing all the time.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-17 14:42:02 -07:00
Adam Williamson
23c9adac93 Update names of qcow2 base disk images
We're changing these to be named `foo.qcow2` not `foo.img` due
to a change in qemu and os-autoinst to do with backing file
format detection.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-10 10:58:08 -07:00
Adam Williamson
803ae7ca57 Add a test of an additional repository using a metalink (#198)
As suggested by @kparal, this adds a test that specifies an
additional repository using a metalink. The repository contains
a single package, 'testpackage', that supplements glibc (so it
should always get installed). The test runs an install then
checks that testpackage got installed.

We also deduplicate a pair of needles which were matching on the
same anaconda UI feature (an "add" button) and use that same
needle in this test.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-18 14:03:27 -07:00
Lukáš Růžička
b65f470eee Create basic functions tests for Gedit. 2021-08-12 15:37:37 +02:00