1
0
mirror of https://pagure.io/fedora-qa/os-autoinst-distri-fedora.git synced 2024-11-28 16:43:09 +00:00
Commit Graph

2227 Commits

Author SHA1 Message Date
Adam Williamson
343ef8226b Use new RETRY variable handling to restart update tests on fail
Upstream recently implemented support for using the variable
RETRY to specify how many times a test should be restarted on
failure. This is something we currently handle with a downstream
openQA plugin; if we switch to using this upstream feature
instead, we can drop the plugin.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-07-06 10:28:57 -07:00
Adam Williamson
cf969061ce Wait for Discover to run before maximizing it
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-07-04 10:07:13 -07:00
Adam Williamson
0d71fd8554 Remove incorrect desktop_update_graphical needle for KDE
The previous commit is the correct fix for the problem here.
Adding a needle that matches on the tray icon was not correct,
we need to be sure that we can access the Updates view from
within Discover itself.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-07-04 09:56:25 -07:00
Adam Williamson
be39c0e3a1 desktop_update_graphical: maximize Discover on launch
If there are too many categories, we don't see the Updates entry
on the left, and this has been breaking Rawhide and F36 tests.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-07-04 09:47:56 -07:00
Lukáš Růžička
1f8b56e068 Change the way to download test data.
This PR changes the way to download the test data into the VM.
Although it does not use a disk image as suggested in one
of the review, it does not clone the entire repository, but
a simple tar.gz file that holds the data which will be
distributed into the directory structure.

This way, the amount of data needed to be downloaded dropped
from approximately 50MB to below 2MB.

Also, the existing test suites were adapted to this situation.
2022-07-04 09:34:04 +02:00
Adam Williamson
f81dab6739 Clocks: handle auth, check we actually launched the app
Clocks' aaa_setup did not ever actually check the app launched
properly. It also doesn't handle granting permissions if
necessary, which the apps_startstop test for Clocks does do.

This makes the permission check in the apps_startstop test more
efficient, and adds it to the Clocks app aaa_setup test too.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-06-30 13:56:29 -07:00
Adam Williamson
e13c716ab9 Update a couple of KDE needles for recent Rawhide
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-06-29 16:48:11 -07:00
Lukáš Růžička
7c1e686d14 Create tests for Help. 2022-06-29 23:06:37 +00:00
Adam Williamson
79d92fc8cb Update a couple of GNOME needles for recent Rawhide
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-06-28 15:05:53 -07:00
Adam Williamson
1c0ebc4f3f Update KDE vault needle for Rawhide
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-06-28 15:04:44 -07:00
Adam Williamson
d5757b054c Fix assert_and_click call in realmd_join_cockpit
This was just doing something silly before, but with recent
os-autoinst having function signatures, it actually causes the
test to fail because '5' isn't a sane value for the argument
this was setting before. Fix it to set the timeout, as it was
trying to do all along.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-06-27 09:21:48 -07:00
Adam Williamson
97b7e7a0f0 Add another UEFI passphrase prompt needle variant
This one is for current F36 IoT images.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-06-23 16:44:28 -07:00
Adam Williamson
b9d0401d8f Update KDE grey-on-black desktop_expand_systray needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-06-23 16:36:14 -07:00
Adam Williamson
5ed1d88f61 Add several new Cockpit login needles for Cockpit 272
The wider one seems to happen when text at the bottom of the
login box prevents the "Fedora Linux..." text from wrapping
across two lines. I have no idea why we see two different
cases of the "Fedora Linux text wrapped" variant with very
slightly different amounts of whitespace, but we do, it seems
we need both of these.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-06-23 16:30:18 -07:00
Lukáš Růžička
6f00e3fe8a Create tests for Clocks. 2022-06-23 21:41:56 +00:00
Adam Williamson
b203f41f55 Give systemctl stop ipa.service longer due to RHBZ #2100282
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-06-22 17:51:04 -07:00
Adam Williamson
a6eb9024cf do_bootloader: bootloader is always grub on F37+
Now we've ditched syslinux in Rawhide, we should just always
expect to see grub if release number is > 36.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-06-17 16:58:34 -07:00
Adam Williamson
fe6314c8de Add yet another bootloader_uefi needle variant
No idea why the UEFI grub appearance keeps changing, but we need
to keep up with it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-06-15 10:22:26 -07:00
Lukáš Růžička
d09d9d8fe6 Fix the Rhythmbox crash when launched for the first time. 2022-06-15 15:53:20 +02:00
Lukáš Růžička
7637238951 Add some extra steps for KDE to overcome BZ2097208. 2022-06-15 10:35:57 +02:00
Lukáš Růžička
b702f8ebcd Add needle to make desktop_upgrade_kde pass. 2022-06-15 09:24:56 +02:00
Lukáš Růžička
e29e8f2f38 Add updated needles to make desktop_notifications pass. 2022-06-14 14:12:56 +02:00
Adam Williamson
25f59d86da Bump HDDSIZEGB for more GNOME and KDE products
We have it at 20G for Workstation live, but not for KDE live or
for the update Workstation or KDE products. We just hit an issue
today where anaconda thinks 10G isn't enough space for a KDE
live install after a grub2 update (which I think only bumped
the required space veeery slightly, but enough to throw anaconda
over the limit). Let's just go up to 15G for all GNOME and KDE
cases where we're not at 20G.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-06-08 16:53:47 -07:00
Adam Williamson
4971de39e9 Tweak quit_firefox to handle hang on exit on ppc64le (#2094137)
It seems when we quit Firefox back to a VT on ppc64le, the system
hangs. Not sure why, but we can deal with it by rebooting the
system and logging back in as root if it happens. Also take the
opportunity to clean up the flow of quit_firefox so we always
check that we get back to a console then wait 5 seconds for the
console to settle, so all the tests that call it can stop doing
that.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-06-06 18:35:52 -07:00
Adam Williamson
e1ed9960f3 Let _console_avc_crash wait a bit longer for console login
On Rawhide update tests we often don't seem to get to the login
prompt in 10 seconds, so tweak the code a bit to let us specify
a timeout in root_console, and use 30 seconds here.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-06-06 18:34:44 -07:00
Adam Williamson
e047a88ffc check_default_fonts: move reference files, use diff -u
Let's not have the reference files in one person's fedorapeople
space, in case that person leaves. Let's upload the text.txt
for checking (it's easier to be able to just read what's in it
than try and figure it out from the diff output), and let's use
diff -u because non-unified diff output is awful.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-06-02 14:36:33 -07:00
Adam Williamson
4ee583ad43 Bump a console login timeout a little
After typing the username, on some Rawhide tests, it's taking
over 30 seconds for the password prompt to appear. This isn't
ideal but we don't want the test to fail on this. Give it up
to 45 seconds.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-06-01 09:04:34 -07:00
Adam Williamson
aa5a248237 Bump timeouts in _setup_browser a bit more
Slow on Rawhide updates.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-06-01 09:00:39 -07:00
Adam Williamson
e9a7e0eb6c Give dracut -f longer to run in _advisory_update
It seems slow on Rawhide updates ATM.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-06-01 08:56:27 -07:00
Adam Williamson
ac24eeefb4 Update UEFI bootloader needle for resolution change(?)
Not sure what's going on here, but it seems like the resolution
of the UEFI bootloader screen in some tests changed. Not sure
if this is a qemu or edk2 change or what.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-27 11:59:33 -07:00
Adam Williamson
1d76c12584 Add Arabic gnome-terminal needle
For the i18n fonts test, this was missing from the PR.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-27 11:58:43 -07:00
Adam Williamson
815c6b28e5 check_default_fonts: wait_still_screen after launching terminal
As we do in desktop_terminal. It's not always ready for input
when the window is visible.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-27 11:01:27 -07:00
Adam Williamson
e9de5f28a3 Avoid uninitialized value warnings in main.pm
If LANGUAGE isn't specified we wind up using undefined in string
eq, which perl warns about. So let's avoid that by falling back
to "".

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-26 14:51:20 -07:00
Adam Williamson
56b443176a tapnet: don't double-declare @forwards
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-26 14:49:57 -07:00
Adam Williamson
e30fa5a0a1 Update vinagre fullscreen icon needle again
Looks like it got fixed but it now looks slightly different from
before.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-26 10:45:47 -07:00
Adam Williamson
21e4ded350 Fix disable_firefox_studies for ostree installs
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-26 09:25:07 -07:00
Adam Williamson
2d4d6ae8f2 Rename needles from i18n fonts test
Just giving them names that kinda explains why they exist.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-26 08:41:01 -07:00
Lukáš Růžička
1acef21fa5 Automate the i18n_default_fonts testcase for Japanese.
This is the automation of the optional testcase https://fedoraproject.org/wiki/QA:Testcase_i18n_default_fonts.
The test implementation runs the same commands as the mentioned test
case and checks the expected output. It is designed to run in the scope
of postinstall tests when the language is set to "japanese".
2022-05-26 09:54:38 +02:00
Adam Williamson
66bc59de1d Have desktop_browser run disable_firefox_studies
I'd prefer not to do this, but I don't see a better way to deal
with the stupid 'welcome' screens. I'm not maintaining needles
to click them away forever.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-24 23:51:59 -07:00
Adam Williamson
919ade3152 Tweak the Firefox config override stuff again based on research
Wow, so the real way to do config overrides is, uh...obscure.
One file pointing to another file, both with mandatory comment
lines and one with a weird required value. Wat. Anyway, this
works in a VM. I still don't know why the policy for the first
run page isn't working as advertised.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-24 23:49:31 -07:00
Adam Williamson
d236ea2cfb Fiddle with firefox welcome screen disabling again
The new way isn't working, so put the old way back but change it
to use user_pref instead of pref to see if that helps, and upload
the files for checking.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-24 23:20:23 -07:00
Adam Williamson
3f74203003 Fix missing quote in Firefox policy JSON
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-24 16:54:00 -07:00
Adam Williamson
1f7ac82ca1 Set script_run_die_on_timeout distri-wide
This is required for script_run invocations in current
os-autoinst to tell it what to do if script_run times out, rather
than failing or succeeding (this behaviour was always undefined).
Right now you just get a deprecation warning but at some point
not setting it will be fatal. This tells it to die if script_run
times out; 0 would mean "just keep going, even though the
terminal is probably still blocked waiting for the command to
return".

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-24 16:52:13 -07:00
Adam Williamson
a9413c417a Make firefox nobookmarks needle not workaround any more
We've been told the bookmark toolbar no longer being shown on app
start is by design, so we can't call this a workaround needle
any more really. There's a preference we could use to turn it
back on so we can wait for the bookmark toolbar to show up to
be sure firefox is fully started, but in fact tests seem to be
passing OK with just this needle these days, so we may not need
to.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-24 14:05:13 -07:00
Adam Williamson
1e8a82f0e1 Try different way to disable Firefox 'welcome pages' (mkaply)
Thanks to Mike Kaply in
https://bugzilla.mozilla.org/show_bug.cgi?id=1703903#c18 , this
should avoid Quick Suggest onboarding, "Total Cookie Protection"
onboarding, and future annoying things using the same mechanisms
without using the prefs mechanism or going after each one case
by case.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-24 08:28:31 -07:00
Adam Williamson
f3e4750f6e Fix line wrapping in firefox config override
Missed a line break...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-20 23:41:26 -07:00
Adam Williamson
7ee3a91ffc Try and disable yet another Firefox popup that breaks tests
See https://bugzilla.mozilla.org/show_bug.cgi?id=1703903#c9 and
comment #13 for this one.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-19 14:54:54 -07:00
Lukáš Růžička
18f6b0863e Delete unused needles. 2022-05-19 11:13:30 +02:00
Adam Williamson
a5433c823d Quick fix for get_host_dns when resolv.conf points to resolved
The Fedora infra workers got changed so their resolv.conf doesn't
have the correct DNS server addresses in it any more, it just
has 127.0.0.53 (the systemd-resolved resolver address). We need
to query resolved to get the correct addresses.

This is quick and hacky; it doesn't accommodate anyone running
a worker host that *isn't* using resolved, and it doesn't handle
IPv6 server addresses correctly if any are present (in infra we
currently don't use any on the worker hosts). I'll try and find
time to refine it but need to deploy this for now to make the
tests pass again.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-18 18:05:26 -07:00
Adam Williamson
dac2a82fea Update KDE help_runs needle
Not sure what changed here, something subtle. Background color?

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-18 13:52:03 -07:00