1
0
mirror of https://pagure.io/fedora-qa/os-autoinst-distri-fedora.git synced 2024-12-29 13:43:08 +00:00
Commit Graph

199 Commits

Author SHA1 Message Date
Adam Williamson
469a1395d0 Revise desktop background checks
Split this out of install_default, because it really is not a
part of that test and we do not want that test to fail because
the desktop background is wrong. Make it its own test module
and test suite instead. Don't do it on Rawhide, because we
really can't assert anything worthwhile about Rawhide at the
moment at least (this means the test runs but is a no-op and
will always pass on Rawhide, unfortunately). Move the needles
to a more appropriate location (this has nothing to do with
anaconda) and use 'background' not 'wallpaper' naming (that's
the name we use elsewhere in the project, e.g. package names).
Also, run the test on updates, and add an F29 needle for this
purpose.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-08-14 14:30:25 -07:00
Lukas Ruzicka
d06b30e8dc Add new testcases and methods for release identification. 2019-07-30 15:45:02 -07:00
Adam Williamson
1165fdc969 Switch graphics to virtio to work around #1732113
This probably means we'll run into #1403365 again, but that's
better than the alternative.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-07-22 12:38:03 -07:00
Lukas Ruzicka
1475813b75 Update the modularity tests.
* Add test to check module defaults.
* Add whitelist download.
* Fix install test to include selected profile to be on the safe side.
* Add test into templates.
2019-07-15 13:19:06 +02:00
Michel Normand
d8e327ab1e Add Silverblue tests for ppc64le
Note that before Silverblue
there was no "AtomicWorkstation-dvd_ostree-iso" for ppc64le

Signed-off-by: Michel Normand <normand@linux.vnet.ibm.com>
2019-07-12 15:44:43 +02:00
Adam Williamson
277e0d7493 Drop all use of the old 'ppc64' (BE) arch/products/machine
Fedora stopped supporting big-endian ppc64 and producing images
for it after F28, which is now EOL. So we can drop all these
bits for it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-07-10 12:58:49 -07:00
Adam Williamson
1e729f1281 Revert "Set version for AtomicHost tests to 29"
This reverts commit 5bc343fd7e.
Turns out this created a new job group, which I wasn't really
meaning to do. I'll tweak checkwiki to not choke on this.
2019-07-08 10:26:13 -07:00
Adam Williamson
5bc343fd7e Set version for AtomicHost tests to 29
We stopped building Atomic Host images from F30 onwards, so we
shouldn't expect to run tests for any version other than 29 any
more (28 is EOL).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-07-04 17:26:06 -07:00
Adam Williamson
0a4043aad7 Drop "Atomic" subvariant references from templates
It hasn't existed since early 2018.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-07-04 17:23:33 -07:00
Adam Williamson
78dd42b876 Automate two 'mediakit' tests (repoclosure and file conflicts)
We can run these tests much like support_server - have a test
which boots from the support_server disk image but with the ISO
to be tested attached, then mounts it and runs the scripts.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-07-04 13:44:20 -07:00
Adam Williamson
3a8a5f4de0 install_no_user for Silverblue is now pointless...
...install_default_upload is now the same thing, since you
cannot create a user during install any more.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-28 14:09:55 -07:00
Adam Williamson
650c4bb11d Bump a couple of disk sizes (KDE package set, Workstation boot)
Some tests on Rawhide started failing back in April due to
insufficient space. I dug into it for an hour or two but can't
find any big smoking guns where unnecessary packages got added
to groups or some package suddenly got bigger or anything, so I
can't find any real bugs to report here; we're just gonna have
to bump the sizes.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-05-01 12:37:21 -07:00
Adam Williamson
abeeb650b2 Fix a stray ; in REPOSITORY_VARIATION for hd_variation test
This, for some reason, made the test fail on x86_64 but not on
ppc64le. I do not understand computers.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-04-12 15:55:02 -07:00
Guy Menanteau
33fd05f3d0 New install_repository_nfsiso_variation
This is covering the  NFSISO_variation test as per:
https://fedoraproject.org/wiki/QA:Testcase_install_repository_NFSISO_variation

Change support_server to use support_5 disk image in templates
supposed to be previously created by updated createhdds tool
required for new test.

Signed-off-by: Guy Menanteau <menantea@linux.vnet.ibm.com>
2019-04-12 15:49:54 -07:00
Guy Menanteau
29070a54f1 New install_repository_hd_variation
use a new PREINSTALL to execute a rescue script before install.

This is covering the  Hard_drive_variation test as per:
https://fedoraproject.org/wiki/QA:Testcase_install_repository_Hard_drive_variation

Signed-off-by: Guy Menanteau <menantea@linux.vnet.ibm.com>
2019-04-12 15:49:54 -07:00
Michel Normand
09e81d6510 Add tests for QA:Testcase Remote Logging also ppc64le
Signed-off-by: Michel Normand <normand@linux.vnet.ibm.com>
2019-04-01 11:24:50 +02:00
Adam Williamson
b1a0fd7dc3 Add tests for QA:Testcase Remote Logging test case
This commit adds server and client tests to cover the remote
logging Server test case.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-03-28 12:52:54 -07:00
Adam Williamson
94818cd1aa Remove DESKTOP key from apps_startstop test suite
This should not be set here; it is set in the 'product' (i.e.
the flavor), so it's set to 'gnome' for Workstation live flavor,
'kde' for KDE live flavor. Setting here overrides that and makes
it always 'gnome', we don't want that.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-03-19 12:15:03 -07:00
Adam Williamson
f77d240407 Add KDE startstop test to templates
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-03-19 12:15:03 -07:00
Adam Williamson
126109f8ac D'oh, missed a quote mark
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-03-13 11:25:58 -07:00
Adam Williamson
4c281e3d23 Set new PARALLEL_CANCEL_WHOLE_CLUSTER for all parallel parents
This is the magic variable to disable openQA's "cancel whole
cluster on child failure" behaviour that I'm adding in
https://github.com/os-autoinst/openQA/pull/2017 . We want it
set for all parallel parent suites in Fedora.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-03-13 11:20:15 -07:00
Michel Normand
1b546261c5 Add PowerPC support for tests upgrade of FreeIPA
This is using the two tests previously added by
"Test upgrade of FreeIPA server and client deployment"

Signed-off-by: Michel Normand <normand@linux.vnet.ibm.com>
2019-03-12 19:41:20 +00:00
Adam Williamson
8a68b04a3b Run the install_default_update test on UEFI as well
Obviously an installer image may work fine for a BIOS install
but fail for a UEFI install, so we should test it both ways.
This requires the invention of a new (terribly named, but I
couldn't think of anything better...) variable to allow us to
use the 'run test on machine A after test run on machine B'
mechanism without just hardcoding '64bit' as the machine name
in the START_AFTER setting (which would break if we ever wanted
to run update tests on any *other* arch).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-01-29 15:49:59 +01:00
Adam Williamson
12affb145f Add update tests to build and test a netinst image
This adds a test which builds a netinst image potentially with
the package(s) from the update, and uploads that image. It also
adds a test which runs a default install using that image. This
is intended to check whether the update breaks the creation or
use of install images; particularly this will let us test
anaconda etc. updates. We also update the minimal disk image
name, as we have to make it bigger to accommodate this test,
and making it bigger changes its name - the actual change to
the disk image itself is in createhdds. We also have to redo a
bunch of installer needles for F28 fonts, after I removed them
a month or so back...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-01-18 08:24:44 -08:00
Adam Williamson
510662c1ec Drop all RHBZ #1663040 workarounds, should be fixed now
In Fedora-Rawhide-20190117.n.0 #1663040 should be fixed, so drop
all workarounds for it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-01-17 08:35:30 -08:00
Adam Williamson
e718f76c19 Boot workstation live with enforcing=0 (RHBZ #1663040)
Today's Workstation live doesn't boot at all without enforcing=0.
We *still* want to see how subsequent tests run, so let's work
around this for now.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-01-14 18:19:43 -08:00
Lukas Ruzicka
39d3427471 Create a test suite for application start stop testing.
Merges #86
Fixes #85
2019-01-04 15:23:03 -08:00
Adam Williamson
2d63bd9702 Bump HDDSIZEGB to 13GiB for language tests
12GiB seems not to be enough for aarch64.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-12-18 11:05:10 -08:00
Adam Williamson
59ec361700 Temporarily disable modularity_update_norepo subtest
This is known to not work at present as it's not implemented in
DNF yet; failing on it every day isn't proving much. Once it's
implemented (expected by end Jan) we can turn it back on again.
See https://bugzilla.redhat.com/show_bug.cgi?id=1616167

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-12-12 22:13:20 -08:00
Adam Williamson
2f2f0973ec Update shrink disk image names in templates
We weren't using the gpt-labelled one, so I took it out of
createhdds; that makes the name of the mbr-labelled one lose
its label tag, so we need to update that name here.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-12-01 09:05:48 -08:00
Adam Williamson
77afbad45e Fix up aarch64 UEFI vars to something that works
fd files don't work on aarch64, it seems. Drop BIOS even though
it's probably not breaking anything as I don't intend to move
aarch64 to prod until prod is up to new openQA, so no need to
stay compatible.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-11-20 22:40:22 -08:00
Adam Williamson
b802ea9401 Update how we specify SCSI device variables
In recent os-autoinst the old 'stuff it all in HDDMODEL' doesn't
work and tells you to do it like this. This way does work in the
older os-autoinst currently on prod too, so this should be fine.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-11-20 22:26:50 -08:00
Adam Williamson
e870e43a08 Add new-style UEFI firmware vars to machine templates
We're about to deploy recent os-autoinst to staging. The UEFI
stuff got rewritten since the version we currently have, and
this is now the recommended way to handle UEFI firmware. The
new vars shouldn't confuse the old code still deployed on prod,
it should just ignore these vars and keep working off the old
'UEFI=1' (which causes it to autodetect the file locations).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-11-19 12:41:08 -08:00
Adam Williamson
11e34f57c1 Bump version of support server disk image
We made it bigger.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-11-09 17:16:36 -08:00
Adam Williamson
d4c87a4f36 Handle rename of AtomicWorkstation to Silverblue
We updated the dispatcher code, but not the templates...so we
didn't have any actual tests to run on Silverblue images. Let's
fix that. Note this means we won't test F28 and earlier images
that still have 'AtomicWorkstation' as their subvariant any
more, unless I set up some sorta workaround in the dispatcher.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-10-27 12:51:20 +09:00
Adam Williamson
abecb62785 Switch to std graphics to avoid vt/splash issues
Time for the great video driver merry-go-round again...lately
we're having some issues with vt corruption and rendering over
the boot splash, let's try using 'std' driver to see if it
helps a bit. stg has been set up this way for a couple of days
and it's not blowing up at least.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-10-13 17:03:44 -07:00
Adam Williamson
071e54fc44 Move modularity tests to Server-dvd-iso
They can't be in universal as there's no install_default_upload
for them to run after. Let's just run on the Server DVD install
like we do many other post-install tests.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-09-28 17:51:43 -07:00
Lukas Ruzicka
24e68aa8a2 Create openqa tests to test modularity. 2018-09-26 23:09:36 -07:00
Adam Williamson
9df64398ee Add a FreeIPA replication job set
This adds a set of jobs to test FreeIPA replication. We deploy
a server, deploy a replica of that server, then enrol a client
against the replica and run the client tests.

At first I was planning to add the replica testing into the
main set of FreeIPA tests, but the test ordering/blocking (via
mutexes and barriers and what-have-you) just turns into a big
nightmare that way. This way seems rather simpler to deal with.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-08-02 09:59:40 -07:00
Adam Williamson
7ba5dfcc94 Set QEMUVGA back to qxl for x86_64, unset it for aarch64
qemu 2.11.2 fixes #1403343, so we can go back to using qxl for
x86_64 VMs. Also, setting QEMUVGA doesn't actually do anything
on aarch64 (os-autoinst ignores it and sets up virtio graphics
instead), so let's not set it to avoid confusion.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-07-12 14:49:42 -07:00
Lukas Ruzicka
8897fe45a6 Add test for Arabic installation (revisited). 2018-06-13 11:56:26 +02:00
Adam Williamson
ce0efcd8df Bump HDDSIZEGB for Workstation-boot-iso i386
Did this for x86_64 last year, but forgot about i386.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-06-04 16:17:23 -07:00
Adam Williamson
7de1c4837a Go back to 'std' video driver for UEFI tests
This should be safe now we finally figured out #1518464.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-06-04 11:08:07 -07:00
Adam Williamson
34dbe78406 Use virtio-rng for all tests
...to try and avoid running into RHBZ#1572916, which is killing
Rawhide tests it seems. Let's hope this doesn't result in host
entropy starvation. If it does I might try patching os-autoinst
to seed virtio-rng from /dev/urandom, not /dev/random...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-05-03 13:12:34 -07:00
Adam Williamson
e931cfa0a5 Test FreeIPA upgrade on updates
This adds the FreeIPA server and client upgrade tests to a new
updates-server-upgrade flavor which fedora_openqa will schedule
for updates. This way, we can test whether updates break
FreeIPA upgrades, which is a request the FreeIPA team made to
me. This has been deployed on staging for the last week or so
and appears to work fine.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-04-26 11:35:18 -07:00
Adam Williamson
07527a8afa Set aarch64 timeout scale to 1.5x, not 5x
This is what I meant...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-04-03 18:04:45 -07:00
Adam Williamson
df9db4fb2f Bump disk size for KDE package set install to 11GiB (#1541433)
KDE package set install constantly runs into #1541433. While
that's not being fixed, let's bump the disk size so we can see
if the install actually works.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-03-27 13:02:49 -07:00
Adam Williamson
7ca549f4e1 Try 3GiB RAM per aarch64 worker
The hosts only have 16GiB, so 4GiB per worker is pretty high.
3 really should be enough.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-03-23 16:05:03 -07:00
Adam Williamson
c0eee06e9a aarch64: two CPUs per VM, 1.5x timeout
Tweaking aarch64 settings a bit to try and improve reliability.
I'm going to cut down to 3 workers per box along with this.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-03-23 15:54:21 -07:00
Adam Williamson
4d997d7323 Move install of Firefox into its own milestone module
This reduces duplication, but it also means that if the FreeIPA
web UI module fails, the password change module will pick up
from a point where Firefox is set up and won't fail in a bogus
way because it isn't.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-03-23 09:10:51 -07:00