Commit Graph

104 Commits

Author SHA1 Message Date
Adam Williamson 05c38f3023 Give more desktop update tests 4G of RAM
Looking through more openQA failures I saw other desktop update
tests which were clearly caused by OOM kills, so let's give all
the desktop tests we run on updates 4G for now.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-10-13 10:12:53 +02:00
Adam Williamson fe383fcec5 Give desktop_browser 4G of RAM
We're seeing a lot of failures recently in desktop_browser caused
by the browser or desktop getting OOM killed. I've filed a bug
on this: https://bugzilla.redhat.com/show_bug.cgi?id=2133829
but we need to try and work around it, having the test failing
constantly is no good. Let's see if 4G of RAM is enough.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-10-13 09:50:22 +02:00
Adam Williamson baf9c10424 Increase QEMU_MAX_MIGRATION_TIME to avoid incomplete tests
We see tests periodically come up incomplete with this:
"Migrate to file failed, it has been running for more than 240 seconds"
Turns out there's a setting for this, so...let's set it. I don't
think there's really a bug here, just when our workers are busy,
these migrations can take longer than expected.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-10-12 10:35:02 +02:00
Lukas Ruzicka 5d3fc244eb Create the test for system monitor. 2022-10-10 15:14:21 +02:00
Lukas Ruzicka ba0062e5be Create a test case for Archiver. 2022-09-22 08:59:07 +02:00
Adam Williamson 5b897801bf Bump RAM on x86_64 machines to 3G
Workstation tests on Rawhide are getting OOM killed. Let's see
if this helps. All the other arches have this much already, and
the worker hosts can handle it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-08-18 13:41:13 -04:00
Lukáš Růžička 9e0ec721a6 Create a new test for Gnome Weather 2022-08-08 18:24:51 -07:00
Lukáš Růžička c40a35ea62 Add a new test for Calculator. 2022-08-05 11:34:22 -07:00
Lukáš Růžička 48ec73e814 Create a test suite for Nautilus. 2022-07-12 16:01:36 -07:00
Lukáš Růžička 7c1e686d14 Create tests for Help. 2022-06-29 23:06:37 +00:00
Lukáš Růžička 6f00e3fe8a Create tests for Clocks. 2022-06-23 21:41:56 +00:00
Adam Williamson 25f59d86da Bump HDDSIZEGB for more GNOME and KDE products
We have it at 20G for Workstation live, but not for KDE live or
for the update Workstation or KDE products. We just hit an issue
today where anaconda thinks 10G isn't enough space for a KDE
live install after a grub2 update (which I think only bumped
the required space veeery slightly, but enough to throw anaconda
over the limit). Let's just go up to 15G for all GNOME and KDE
cases where we're not at 20G.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-06-08 16:53:47 -07:00
Adam Williamson c41bcd56de Use std video on ppc64le as virtio is broken (#2070333)
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-30 12:51:52 -07:00
Adam Williamson 810ab3777d Try running iot_zezere_server on minimal UEFI image instead
OK, so we can't have parallel tests on different machines, so
we can't have iot_zezere_server on 64bit and iot_zezere_ignition
on uefi. We need both to be on uefi. So, let's try using the
minimal-uefi image that we build for upgrade tests instead. It's
built for -1 (which is the same as CURRREL) on x86_64 and aarch64
so it should be there when we need it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-17 11:12:20 -07:00
Adam Williamson fd08abf954 Add back the 64bit IoT profile needed for previous commit
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-17 10:40:53 -07:00
Adam Williamson 03e87ba8d0 Switch iot_zezere_server back to 64bit not uefi
It boots the 'support' disk image, not the image created by
install_default_upload, and that disk image is only set up for
BIOS boot.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-17 10:26:29 -07:00
Adam Williamson a60f19b5e7 Switch IoT tests to all run on UEFI
It doesn't support BIOS any more...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-01 16:02:21 -08:00
Adam Williamson 4251b7b73a Rename desktop_printing_cups back to desktop_printing
It's best to keep the test name consistent unless we *really*
have to change it; that way the "past runs" history in openQA
still works and the name doesn't change in resultsdb and CI
messages.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-10 09:35:50 -08:00
Adam Williamson ad52e3a94d Add a space to USE_CUPS in templates to match style
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-10 09:33:15 -08:00
Lukáš Růžička 9a56adcfd0 Modify Desktop Printing test to use two different methods.
The PR introduces an improved logic to the desktop_printing.pm
that allows to use the USE_CUPS variable in templates to trigger
the installation of cups-pdf prior to the actual test.
The cups-pdf is then used as an alternative PDF printer
instead the built-in Save As PDF method.
2022-02-10 09:35:22 +01:00
Lukáš Růžička ceaf711f76 Create a test suite for Gnome Text Editor 2022-01-29 00:49:10 +00:00
Adam Williamson 24e3ecb89f Drop gedit application tests
Workstation has replaced gedit with gnome-text-editor in Rawhide,
so this is no longer useful. We will replace it with a test suite
for gnome-text-editor.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-18 15:52:40 -08:00
Lukáš Růžička 3a5c499e52 Remove desktop_notifications_live from upgrade test. 2021-12-10 13:01:38 +01:00
Lukáš Růžička f8e9e10e8a Rename tests and flavours as per review. 2021-12-08 13:38:57 -08:00
Lukáš Růžička eb99e809f9 Switch on upgrades even for aarch64. 2021-12-08 13:38:57 -08:00
Lukáš Růžička 33b52caded Switch on in all workstation tests. 2021-12-08 13:38:57 -08:00
Lukáš Růžička e85f09f071 Add a new flavour to test upgrade postinstall tests. 2021-12-08 13:38:57 -08:00
Lukáš Růžička cda0d0b0d1 Create a test suite for EoG (Image Viewer) 2021-11-18 13:13:59 -08:00
Adam Williamson 4860ad1398 Revert "Stop using virtio video temporarily (#2020438)"
This reverts commit 9dbd614fe4
(and a follow-up commit). The bug has been fixed in the latest
Rawhide kernel, so we can go back to virtio.
2021-11-09 15:52:32 -08:00
Adam Williamson 0519c8ec2c Use virtio graphics for server_cockpit_updates test
With qxl it hits a weird bug where running startx a second time
after snapshot restore tends to crash. This is affecting updates
so let's force it to virtio. Hopefully the kernel build with
virtio fix will succeed so I can just revert all this messing
around soon.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-09 08:44:45 -08:00
Adam Williamson 498915d864 Use 'ide-hd' instead of deprecated 'ide-drive' in SATA test
This was deprecated in qemu 4.2, but only actually taken out in
6.1.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-08 14:40:47 -08:00
Adam Williamson 9dbd614fe4 Stop using virtio video temporarily (#2020438)
It's totally broken in Rawhide, so let's use qxl or another
fallback temporarily. Hopefully not too many other bugs show up
with this.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-08 08:37:20 -08:00
Adam Williamson 53b2afb217 Drop memtest test for now
We dropped memtest from the images. We may replace it with
something better at some point, but until that day, let's drop
this test so it's not uselessly failing all the time.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-17 14:42:02 -07:00
Adam Williamson 23c9adac93 Update names of qcow2 base disk images
We're changing these to be named `foo.qcow2` not `foo.img` due
to a change in qemu and os-autoinst to do with backing file
format detection.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-10 10:58:08 -07:00
Adam Williamson 803ae7ca57 Add a test of an additional repository using a metalink (#198)
As suggested by @kparal, this adds a test that specifies an
additional repository using a metalink. The repository contains
a single package, 'testpackage', that supplements glibc (so it
should always get installed). The test runs an install then
checks that testpackage got installed.

We also deduplicate a pair of needles which were matching on the
same anaconda UI feature (an "add" button) and use that same
needle in this test.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-18 14:03:27 -07:00
Lukáš Růžička b65f470eee Create basic functions tests for Gedit. 2021-08-12 15:37:37 +02:00
Adam Williamson 05c793179a Add a fingerprint login test (GNOME only) (#223)
This adds a test for fingerprint-based login, as requested by
@benzea in #223. We use the fprintd dummy device to let us
simulate scanning a fingerprint, and check various scenarios
recommended by @benzea.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-03 15:21:33 -07:00
Lukáš Růžička e0d9409c74 Create a test suite for Evince.
This PR fixes issue #188. It adds a test suite to test basic
functionality of Evince and brings the following features:

* test scripts for various Evince functions.
* needles to support the Evince test scripts
* new template variables `TESTPATH` and `POSTINSTALL_LOAD_ALL` (see
  below)
* new logic in `main.py` (see below)

The new variables and the new logic make it easier to create test
suites for post-installation tests. If TESTPATH is used, OpenQA
will take all tests mentioned in POSTINSTALL from that specified
TESTPATH. If both TESTPATH and POSTINSTALL_LOAD_ALL are used, then
OpenQA will run all tests it can find at the TESTPATH location.
If POSTINSTALL and POSTINSTALL_LOAD_ALL are set simultaneously,
then only POSTINSTALL will be taken into account and OpenQA will
only load tests mentioned there.
2021-07-28 08:58:23 +02:00
Adam Williamson 910fbf2c2f Also run Cloud tests on x86_64 UEFI, on Rawhide only
Cloud images are now BIOS/UEFI hybrid in Rawhide (but not F33
or F34), so we want to run the Cloud tests on UEFI as well, but
only on Rawhide.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-22 09:58:23 -07:00
Adam Williamson 088dc9d5ff Correct postinstall test name for install_blivet_resize_lvm
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-06 10:56:16 -07:00
Lukáš Růžička 6d1d549941 Introduce a resize check and a postinstall test for custom and blivet
tests.

This PR fixes #228.
2021-06-30 11:01:50 +02:00
Adam Williamson e5229fd969 Run desktop upgrade tests on aarch64 (#220)
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-25 10:27:38 -07:00
Lukáš Růžička 395ed61a1a Automate the Anaconda_Save_Traceback_to_Bugzilla_Text test case.
This PR adds a new test that automates the above mentioned test case.
It starts the installation in text mode using the `install_text` test
case, which it interrupts using the Anaconda crash trigger.
When the crash happens, it goes through the process of reporting
the bug to Bugzilla, checks that Bugzilla sends a positive
confirmation of the action, but also performs some REST API
calls to do a proper check and then it closes the bug to clean up.
2021-06-17 16:28:29 -07:00
Lukáš Růžička b87049217c Add testcase for Memtest. 2021-06-16 18:11:01 +00:00
Lukáš Růžička c6d443a20f Automate the QA:Testcase_Anaconda_help.
This PR automates the mentioned testcase to test that Help can be
displayed in Anaconda during the installation. It navigates through
the available Help screens and if it can see it, it finishes.

This test runs after `install_default_upload` to override the
installation defaults defined for all primary tests.

Delete a duplicated needle.

Reformat list extensions to make it nicer.

Get rid of wrong export and an empty line.

Delete empty line.

Use _boot_to_anaconda for booting and move subroutine accordingly.

Add variable to templates.fif.json

Delete trailing whitespace.

Fix calling the pretest.

Move help checking to another place.
2021-05-27 21:39:26 +00:00
Adam Williamson 592f50d3c2 Fix Cloud tests to run on correct image
For Cloud, we want to run these tests directly on the disk image
from the compose. But for other flavors, they are run on a disk
image produced by install_default_upload, so the test suites
specify HDD_1. This causes a problem as the value from the test
suite is used as the filename when downloading the image, but
that file name does not change between composes, so instead of
downloading the image to be tested for each compose, we just
wound up downloading it one time and then re-using that same
file every day.

Solving this is a bit tricky for reasons explained in the
fedora_openqa commit, but this is the best option I could think
of. The scheduler has been changed to schedule the downloaded
image as HDD_2_URL, not HDD_1_URL; so now in the templates we just
override the HDD_1 value for the Cloud flavors to "%HDD_2%",
meaning to take the value of HDD_2 (which will be parsed from
HDD_2_URL). We do not actually attach HDD_2 at all, it's only
used to be copied to HDD_1.

We also explicitly set DEPLOY_UPLOAD_TEST to "" for all flavors
(it was only set for one before), just for clarity.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-05-20 13:15:34 -07:00
Adam Williamson 6c5507b174 Add an 'unwanted packages' test, run on Workstation for now (#218)
This adds a test that just fails if any one of a given list of
unwanted packages is installed. This was a request for the
Workstation edition from @catanzaro so I've just implemented it
for Workstation so far, but it's designed to be easily extended
to cover other subvariants too if we want.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-05-03 08:59:46 -07:00
Lukáš Růžička 477d918b64 Add testcase to test the Package_install_remove testcase. 2021-05-01 00:11:43 +02:00
Adam Williamson b4f3e6ea5a Move install_blivet_resize_lvm, fix install_resize_lvm (#201)
This is the same thing we did for install_resize_lvm, to address
issue #201. We just didn't get around to doing it for the blivet
test yet. We also change the HDDSIZEGB for the parent test to
15GB so the resizing stuff actually works in both resize tests;
ever since we changed this the install_resize_lvm test has not
been working properly, it hasn't actually been doing any resize.
Also drop the swap partition stuff from that test as it's for
sure no longer needed.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-04-30 11:10:21 -07:00
Lukáš Růžička d82eae850d Add UEFI versions of cust_btrfs_pres_home and custom_std_part. 2021-03-25 11:28:36 +01:00