1
0
mirror of https://pagure.io/fedora-qa/os-autoinst-distri-fedora.git synced 2024-11-22 22:13:08 +00:00
Commit Graph

175 Commits

Author SHA1 Message Date
Adam Williamson
510662c1ec Drop all RHBZ #1663040 workarounds, should be fixed now
In Fedora-Rawhide-20190117.n.0 #1663040 should be fixed, so drop
all workarounds for it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-01-17 08:35:30 -08:00
Adam Williamson
e718f76c19 Boot workstation live with enforcing=0 (RHBZ #1663040)
Today's Workstation live doesn't boot at all without enforcing=0.
We *still* want to see how subsequent tests run, so let's work
around this for now.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-01-14 18:19:43 -08:00
Lukas Ruzicka
39d3427471 Create a test suite for application start stop testing.
Merges #86
Fixes #85
2019-01-04 15:23:03 -08:00
Adam Williamson
2d63bd9702 Bump HDDSIZEGB to 13GiB for language tests
12GiB seems not to be enough for aarch64.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-12-18 11:05:10 -08:00
Adam Williamson
59ec361700 Temporarily disable modularity_update_norepo subtest
This is known to not work at present as it's not implemented in
DNF yet; failing on it every day isn't proving much. Once it's
implemented (expected by end Jan) we can turn it back on again.
See https://bugzilla.redhat.com/show_bug.cgi?id=1616167

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-12-12 22:13:20 -08:00
Adam Williamson
2f2f0973ec Update shrink disk image names in templates
We weren't using the gpt-labelled one, so I took it out of
createhdds; that makes the name of the mbr-labelled one lose
its label tag, so we need to update that name here.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-12-01 09:05:48 -08:00
Adam Williamson
77afbad45e Fix up aarch64 UEFI vars to something that works
fd files don't work on aarch64, it seems. Drop BIOS even though
it's probably not breaking anything as I don't intend to move
aarch64 to prod until prod is up to new openQA, so no need to
stay compatible.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-11-20 22:40:22 -08:00
Adam Williamson
b802ea9401 Update how we specify SCSI device variables
In recent os-autoinst the old 'stuff it all in HDDMODEL' doesn't
work and tells you to do it like this. This way does work in the
older os-autoinst currently on prod too, so this should be fine.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-11-20 22:26:50 -08:00
Adam Williamson
e870e43a08 Add new-style UEFI firmware vars to machine templates
We're about to deploy recent os-autoinst to staging. The UEFI
stuff got rewritten since the version we currently have, and
this is now the recommended way to handle UEFI firmware. The
new vars shouldn't confuse the old code still deployed on prod,
it should just ignore these vars and keep working off the old
'UEFI=1' (which causes it to autodetect the file locations).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-11-19 12:41:08 -08:00
Adam Williamson
11e34f57c1 Bump version of support server disk image
We made it bigger.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-11-09 17:16:36 -08:00
Adam Williamson
d4c87a4f36 Handle rename of AtomicWorkstation to Silverblue
We updated the dispatcher code, but not the templates...so we
didn't have any actual tests to run on Silverblue images. Let's
fix that. Note this means we won't test F28 and earlier images
that still have 'AtomicWorkstation' as their subvariant any
more, unless I set up some sorta workaround in the dispatcher.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-10-27 12:51:20 +09:00
Adam Williamson
abecb62785 Switch to std graphics to avoid vt/splash issues
Time for the great video driver merry-go-round again...lately
we're having some issues with vt corruption and rendering over
the boot splash, let's try using 'std' driver to see if it
helps a bit. stg has been set up this way for a couple of days
and it's not blowing up at least.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-10-13 17:03:44 -07:00
Adam Williamson
071e54fc44 Move modularity tests to Server-dvd-iso
They can't be in universal as there's no install_default_upload
for them to run after. Let's just run on the Server DVD install
like we do many other post-install tests.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-09-28 17:51:43 -07:00
Lukas Ruzicka
24e68aa8a2 Create openqa tests to test modularity. 2018-09-26 23:09:36 -07:00
Adam Williamson
9df64398ee Add a FreeIPA replication job set
This adds a set of jobs to test FreeIPA replication. We deploy
a server, deploy a replica of that server, then enrol a client
against the replica and run the client tests.

At first I was planning to add the replica testing into the
main set of FreeIPA tests, but the test ordering/blocking (via
mutexes and barriers and what-have-you) just turns into a big
nightmare that way. This way seems rather simpler to deal with.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-08-02 09:59:40 -07:00
Adam Williamson
7ba5dfcc94 Set QEMUVGA back to qxl for x86_64, unset it for aarch64
qemu 2.11.2 fixes #1403343, so we can go back to using qxl for
x86_64 VMs. Also, setting QEMUVGA doesn't actually do anything
on aarch64 (os-autoinst ignores it and sets up virtio graphics
instead), so let's not set it to avoid confusion.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-07-12 14:49:42 -07:00
Lukas Ruzicka
8897fe45a6 Add test for Arabic installation (revisited). 2018-06-13 11:56:26 +02:00
Adam Williamson
ce0efcd8df Bump HDDSIZEGB for Workstation-boot-iso i386
Did this for x86_64 last year, but forgot about i386.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-06-04 16:17:23 -07:00
Adam Williamson
7de1c4837a Go back to 'std' video driver for UEFI tests
This should be safe now we finally figured out #1518464.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-06-04 11:08:07 -07:00
Adam Williamson
34dbe78406 Use virtio-rng for all tests
...to try and avoid running into RHBZ#1572916, which is killing
Rawhide tests it seems. Let's hope this doesn't result in host
entropy starvation. If it does I might try patching os-autoinst
to seed virtio-rng from /dev/urandom, not /dev/random...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-05-03 13:12:34 -07:00
Adam Williamson
e931cfa0a5 Test FreeIPA upgrade on updates
This adds the FreeIPA server and client upgrade tests to a new
updates-server-upgrade flavor which fedora_openqa will schedule
for updates. This way, we can test whether updates break
FreeIPA upgrades, which is a request the FreeIPA team made to
me. This has been deployed on staging for the last week or so
and appears to work fine.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-04-26 11:35:18 -07:00
Adam Williamson
07527a8afa Set aarch64 timeout scale to 1.5x, not 5x
This is what I meant...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-04-03 18:04:45 -07:00
Adam Williamson
df9db4fb2f Bump disk size for KDE package set install to 11GiB (#1541433)
KDE package set install constantly runs into #1541433. While
that's not being fixed, let's bump the disk size so we can see
if the install actually works.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-03-27 13:02:49 -07:00
Adam Williamson
7ca549f4e1 Try 3GiB RAM per aarch64 worker
The hosts only have 16GiB, so 4GiB per worker is pretty high.
3 really should be enough.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-03-23 16:05:03 -07:00
Adam Williamson
c0eee06e9a aarch64: two CPUs per VM, 1.5x timeout
Tweaking aarch64 settings a bit to try and improve reliability.
I'm going to cut down to 3 workers per box along with this.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-03-23 15:54:21 -07:00
Adam Williamson
4d997d7323 Move install of Firefox into its own milestone module
This reduces duplication, but it also means that if the FreeIPA
web UI module fails, the password change module will pick up
from a point where Firefox is set up and won't fail in a bogus
way because it isn't.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-03-23 09:10:51 -07:00
Adam Williamson
cc1067a95a Set PART_TABLE_TYPE for aarch64 machine
This is needed to fix the install_simple_free_space test.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-03-20 14:08:39 -07:00
Adam Williamson
f830cf3ddc Set qemu machine for aarch64 (this is required)
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-03-15 12:24:05 -07:00
Adam Williamson
836d1d2f89 Remove install-no-user for F27 live till I can make it work
This doesn't really work, it needs a product with that explicit
version to make it work, apparently. I think I'd better just
take this out and read up again on how the wildcards work rather
than just messing around with it. I'll put it back if I can be
reasonably sure of making it work.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-03-10 08:31:43 -08:00
Adam Williamson
7ab3debd77 Try a different way of disabling root/user on Workstation live
Sigh, 'overloaded' product templates like that don't quite work.
So, let's try doing it a different way, in main.pm.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-03-08 18:42:09 -08:00
Adam Williamson
7c28cfc909 Adapt for no user/root panes on Workstation live install
Workstation live installs for F28+ drop the user creation and
root password panes from anaconda, so we need to not try and
use them any more. But we still want the old behaviour for F27.
I'm hoping this approach will work, if not, we'll find out soon
enough. This removes the install_no_user test for F28+ as it
will no longer differ from the install_default test.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-03-08 18:32:16 -08:00
Paul Whalen
b1bac1bf99 Add aarch64 to Products 2018-03-07 09:53:19 -05:00
Paul Whalen
03d0845f04 Add aarch64 to Machines 2018-03-07 09:53:19 -05:00
Paul Whalen
9ce8e94e35 Add aarch64 to JobTemplates 2018-03-07 09:53:19 -05:00
Adam Williamson
08b4c6984c Update templates for Atomic (sub)variant renames
Atomic was renamed AtomicHost, and Workstation Ostree was renamed
AtomicWorkstation, for F28+. As we still have F26 and F27 images
which will have the Atomic name, we duplicate those templates,
but there should be no more 'Workstation Ostree' images, so we
just rename those templates to the new name.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-03-06 16:03:28 -08:00
Adam Williamson
ffa7ca2447 Add a check that correct filesystem was used on Server installs
This is currently broken, but openQA doesn't notice; we really
should. We could also check the default in other cases, but I
think that's less clear-cut, as it's kind of an anaconda design
choice, it's not mandated in Fedora requirements anywhere.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2018-01-05 15:18:05 -08:00
Adam Williamson
e358bf405f Use qxl for x86_64 UEFI, virtio for ppc64(le)
virtio graphics still seem to suffer from RHBZ#1403365, and also
os-autoinst believes they don't support snapshotting. So let's
try qxl for x86_64 UEFI. *That* may still suffer from #1403343,
but oh well, seems like we have no good choices here.

It looks like ppc64 also suffers from the Plymouth bug that's
affecting x86_64 UEFI + 'std' graphics, so let's use virtio
there - qxl apparently isn't available on ppc64 VMs, at least it
doesn't work in our deployment.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2017-12-22 15:19:25 -08:00
Adam Williamson
16943ad7ef Use virtio not std graphics for UEFI
While Rawhide suffers from #1518464 , virtio is a better choice
for UEFI tests, even if we get the problem with consoles using
the wrong color scheme again...
2017-12-13 16:02:09 -08:00
Guy Menanteau
f169675699 Add Atomic tests for PowerPC
two same tests as for x86_64.
2017-11-29 10:56:41 -08:00
Adam Williamson
cedef3878a Enable virtio RNG device for base_services_start tests
This should prevent rngd.service from failing, because it will
now see a 'hardware' RNG device.
2017-11-08 15:06:50 -08:00
Adam Williamson
80234f9576 Update desktop image file name for version bump 2017-10-20 17:45:13 -07:00
Adam Williamson
63725c5d3e Change Workstation OStree flavor name to match new variant name
I don't even know if a flavor name with a space in it is going to
work, but let's find out!
2017-10-13 16:53:38 -07:00
Guy Menanteau
9fe10f6715 Add PowerPC support in templates
* use only a subset of tests for ppc64 and ppc64le
  with a new "Fedora PowerPC group"
  and only three flavors
  "Server-boot-iso", "Server-dvd-iso", "universal",

* TEST_TARGET for all PowerPC Products set as ISO

* increase disk size for asian cyrillic and european tests
  add HDDSIZEGB = 12  for related tests
  install_asian_language install_cyrillic_language
  install_european_language
  This is required to avoid anaconda failure like:
  (my own translation)
  "... Fedora requests 10.03GB of free space,
  with 5.95GB for software and 4.08GB for swap.
  Your selected disks have the following free space:
  10GB free space for use..."

* Remove hardcoded arch in some HDD_1 key replaced by ARCH variable
  That concerns the images generated by createhdds tool
  (only for supported PowerPC tests not all of them)
  eg change from:
  "disk_f%CURRREL%_support_3_x86_64.img"
  to:
  "disk_f%CURRREL%_support_3_%ARCH%.img"
  Warning: use ARCH and not MACHINE variable

* Try to keep same order for PowerPC as for x86_64 tests
  and same priorities as documented in
  cid a5861ebc5d:
    0-20: critical smoke tests (higher than Alpha priority)
    20-29: Alpha priority
    30-39: Beta priority
    40-49: Final priority
    50+: Optional priority

* force nfsvers=4 as bypass bugs:
  https://bugzilla.redhat.com/show_bug.cgi?id=1386059
  https://bugzilla.redhat.com/show_bug.cgi?id=1368932

* role_deploy_domain_controller failed for ppc64 (BE)
  https://bugzilla.redhat.com/show_bug.cgi?id=1437793

* Warning: tests failure for PowerPC, not added:
  install_delete_pata
  install_sata
  install_package_set_kde
  install_updates_img_local
* tests not tried:
  upgrade_server_domain_controller
  upgrade_realmd_client
  upgrade_desktop_encrypted_64bit

* Note: TIMEOUT_SCALE initially set for PowerPC machines
  has been removed from this commit as seems not required
  anymore after upstream merge.
  Will need to track if two following timer values
  may create problem on remote openQA instances:
  tests/install_source_graphical.pm (300 to 600)
  tests/_boot_to_anaconda.pm (300 to 1200)

Signed-off-by: Guy Menanteau <menantea@linux.vnet.ibm.com>
Signed-off-by: Michel Normand <normand@linux.vnet.ibm.com>
2017-09-06 08:43:04 +02:00
Adam Williamson
e2a818f8af Increase hard disk size for Workstation-boot-iso
Recent runs with this image seem to failing due to lack of disk
space (e.g. https://openqa.fedoraproject.org/tests/127103 )
2017-08-11 11:45:18 -07:00
Adam Williamson
258412ec4b Use + for START_AFTER_TEST as well as HDD_1 when appropriate
As with HDD_1, we want to override the scheduler-provided value
for update test runs, for these two tests.
2017-07-27 15:14:09 -07:00
Adam Williamson
c11e08df20 Specify WORKER_CLASS in our machines
This seems to be needed to prevent openQA trying to run x86_64
jobs on ppc64 workers (which, uh, doesn't go very well). openQA
is kinda supposed to not do this, but it seems like that got
broken somewhere along the line:
https://progress.opensuse.org/issues/20812
2017-07-26 16:12:49 -07:00
Adam Williamson
09c264fe16 Add Workstation dvd-ostree flavor and tests
Summary:
As we're getting the Workstation dvd-ostree (OStree installer
image) built for Rawhide now, let's try testing it.

Test Plan:
Run the tests on a Rawhide compose that works and
has the image (e.g. 20170615.n.0). Check that new tests work
as expected and old tests are not adversely affected. A
corresponding diff for fedora_openqa will be coming to take
care of scheduling. Note that the tests will often soft fail
for now; this is intentional due to RHBZ#1193590, the bash
prompt for root is incorrect on ostree installs, so I have
added a needle that matches the incorrect prompt but which is
flagged as a workaround needle (so causing the test result to
be a soft fail).

Reviewers: jsedlak, jskladan

Reviewed By: jsedlak

Subscribers: tflink

Differential Revision: https://phab.qa.fedoraproject.org/D1211
2017-06-26 18:48:27 -07:00
Adam Williamson
ab085f4724 Correct name of realmd upgrade client test in job templates
Whoops.
2017-06-21 16:18:37 -07:00
Adam Williamson
a29875a2ff Upgrade tests: Run FreeIPA webUI and password change modules
Summary:
This just adds the FreeIPA web UI and password change
test modules to the FreeIPA upgrade test (client end). It's
useful to check out these features too. We don't need to
separate these into separate jobs, as we're not trying to
fill out different matrix checkboxes here, we just want to
know whether everything works.

Test Plan:
Run the test, see that the modules work properly.
I was actually expecting this to fail given the issues with
the upgrade on the server end, but it seems to pass.

Reviewers: jsedlak, jskladan

Reviewed By: jsedlak

Subscribers: tflink

Differential Revision: https://phab.qa.fedoraproject.org/D1207
2017-06-13 10:06:15 -07:00
Adam Williamson
df2c3cd906 Test upgrade of FreeIPA server and client deployment
Summary:
This adds an upgrade variant of the FreeIPA tests, with only
the simplest client enrolment (sssd) for now. The server test
starts from the N-1 release and deploys the domain controller
role. The client test similarly starts from the N-1 release
and, when the server is deployed, enrols as a domain client.
Then the server upgrades itself, while the client waits (as the
server is its name server). Then the client upgrades itself,
while the server does some self-checks. The server then waits
for the client to do its checks before decommissioning itself,
as usual. So, summary: *deployment* of both server and client
occurs on N-1, then both are upgraded, then the actual *checks*
occur on N.

In my testing, this all more or less works, except the role
decommission step fails. This failure seems to be a genuine one
so far as I can tell; I intend to file a bug for it soon.

Test Plan:
Run the new tests, check they work. Run the existing
FreeIPA tests (both the compose and the update variants), check
they both behave the same.

Reviewers: jsedlak, jskladan

Reviewed By: jsedlak

Subscribers: tflink

Differential Revision: https://phab.qa.fedoraproject.org/D1204
2017-06-02 12:17:07 -07:00