Commit Graph

2123 Commits

Author SHA1 Message Date
Adam Williamson 904fd7e406 Drop match level on user_created_qwerty needle
It's coming up a 96% match, I dunno why.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-18 16:45:47 -07:00
Adam Williamson f24c09fad2 Update the topbar_generic needle
We very rarely see this needle - only when we run the 'generic'
tests on an Everything image instead of a Server one, which
will usually only happen if we trigger it manually. I did this
recently to test an anaconda update, and found it needs an
update.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-18 13:55:49 -07:00
Adam Williamson 3d6b74a63f Add yet another F36 background needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-18 13:54:52 -07:00
Adam Williamson 06c66dcd30 desktop_update_graphical: explicitly check refresh on GNOME
OK, this is annoying. GNOME Software intentionally does *not*
clear the 'download' or 'reboot and update' button when you hit
the refresh button, it just leaves them sitting there while the
refresh happens. So let's specifically require the 'refreshing'
text to appear and go away before we try and click on download
or apply.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-18 13:51:33 -07:00
Adam Williamson 4dab8520b0 Bump the wait after hitting the Refresh button
Agh, GNOME's UI is *not* helpful here at all. The Apply button
remains visible for a long time after you hit Refresh.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-18 11:24:07 -07:00
Adam Williamson b17fd9c3fe desktop_update_graphical: always refresh
This is yet another twiddle to that same damn bit where we try
to apply updates. This more or less reverts the last tweak to
it, where we skipped hitting 'refresh' if 'download' or 'apply'
are already visible. The trouble with that is that the app may
have already found and prepared updates before we got our
"prepared" python3-kickstart update in place - so the update
operation might work perfectly, but not update the package we
expect it to update, and the test may fail.

This time, let's try *always* refreshing, then wait a bit after
hitting the refresh button before we start looking for apply
or download to try and avoid the 'race' we were trying to solve
with the last tweak (where we hit refresh then immediately try
to hit a download or apply button which vanishes before we can
hit it). I think this should be safe as both KDE and GNOME
should always show a refresh button now (this wasn't the case
before, I think, F34).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-18 11:15:10 -07:00
Adam Williamson 7d62f3b48e evince: handle wrong filename in save_as as soft failure
There's a bug in the Save As... dialog on the flatpak version
of evince currently where the existing filename is not pre-
selected, so when the test types 'alternative', it gets
prepended to the existing filename instead of overwriting it,
and we wind up with alternativeevince.pdf, not alternative.pdf.
Let's treat this as a soft failure rather than a hard failure.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-18 10:58:36 -07:00
Adam Williamson 90d0a04d14 Add another printing_check_sentence needle
Yet again this is looking different for no obvious reason.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-17 15:05:14 -07:00
Adam Williamson 541a9ae619 Update SDDM login input needle
Looks like the text got slightly smaller.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-17 13:48:21 -07:00
Adam Williamson 278f997b5c Update GNOME reboot_confirm needle for bold button label
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-17 13:46:42 -07:00
Adam Williamson 8bb5aef223 Update an eog needle for flatpak dialog change
Again, a dialog changed a bit in the flatpak version of the app.
For this needle, the shade of grey is slightly different. Change
happened between Fedora-36-20220314.n.0 and 20220315.n.0.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-17 13:42:11 -07:00
Adam Williamson 47e90c9010 Add variant needles for current Flatpak open/save dialogs
The open/save dialogs for Flatpak apps in current F36 (and
probably Rawhide, but can't tell due to another bug) look a bit
odd: https://github.com/fedora-silverblue/issue-tracker/issues/245
This adds variant needles to handle various differences there.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-17 13:23:35 -07:00
Adam Williamson 19b3bb865f Update some KDE needles for F35 respin tests
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-17 12:39:53 -07:00
Adam Williamson 66b111cecc Update gnome-text-editor needles for F36 upgrade test
For some reason various bits of gte started looking slightly
different on the F36 upgrade test. I don't really know why and
don't care enough to look it up. I'm just hoping all these
variations between gte running in slightly different contexts
calm down soon...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-17 12:37:34 -07:00
Adam Williamson 810ab3777d Try running iot_zezere_server on minimal UEFI image instead
OK, so we can't have parallel tests on different machines, so
we can't have iot_zezere_server on 64bit and iot_zezere_ignition
on uefi. We need both to be on uefi. So, let's try using the
minimal-uefi image that we build for upgrade tests instead. It's
built for -1 (which is the same as CURRREL) on x86_64 and aarch64
so it should be there when we need it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-17 11:12:20 -07:00
Adam Williamson fd08abf954 Add back the 64bit IoT profile needed for previous commit
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-17 10:40:53 -07:00
Adam Williamson 03e87ba8d0 Switch iot_zezere_server back to 64bit not uefi
It boots the 'support' disk image, not the image created by
install_default_upload, and that disk image is only set up for
BIOS boot.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-17 10:26:29 -07:00
Adam Williamson ced946dba9 gnome-text-editor: uninstall gedit on upgrade tests
On upgraded systems, gedit might still be present; remove it so
we don't launch it by accident and try to test it instead.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-16 12:31:08 -07:00
Adam Williamson 94520bb7a8 Drop similarity_level on type_safely
I meant to include this in the earlier commit that does the same
for type_very_safely, but forgot.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-16 11:14:50 -07:00
Adam Williamson 1b7c89b016 Update desktop_login needles for KDE and GNOME in Rawhide
Both KDE and GNOME saw some changes to desktop_login needles in
recent Rawhide, this updates them.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-14 20:19:16 -07:00
Adam Williamson b491d283b1 Update login_gdm_input French and Russian needles for 42~rc
These went to 96% match, not sure why.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-14 20:18:02 -07:00
Adam Williamson 5e15d8a273 Update GNOME overview needle for 42~rc
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-14 20:16:43 -07:00
Adam Williamson 9ff7f60fd8 Update krfb_runs needle for recent KDE
krfb finally started for a change, so we can update the needle.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-14 20:15:58 -07:00
Adam Williamson bbfe7416df Add a couple more printing_check_sentence needles
Why rendering of this text is always changing I just don't know.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-14 20:15:05 -07:00
Adam Williamson 239640200a Update dnfdragora_runs for over-large window on KDE
The dnfdragora window is too big on current KDE so we can't see
the top of it (where we used to match). It's kinda better to
match on some active element of the app than just the window
title anyway (so we don't 'pass' if the window loads but is
empty, or something like that).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-14 20:13:16 -07:00
Adam Williamson 7bf3bd8689 Drop similarity levels on type(_very)_safely, solidify_wallpaper
I noticed today that we're timing out all the time on these
wait_still_screens in gnome-terminal, because it uses a big
flashing cursor and the similarity between "cursor there" and
"cursor not there" is less than 45 or 42 (it seems to be 38.x).
So let's drop these levels to 38, hopefully that's not too low.
There are probably more places where this is an issue, I'll
change them as I notice them.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-14 16:32:29 -07:00
Adam Williamson 522e004914 Add a workaround Firefox needle for missing bookmarks toolbar
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-10 17:07:26 -08:00
Adam Williamson f1c44aa1e7 Update GTE preferences_off needle for Rawhide/F36
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-10 17:06:26 -08:00
Adam Williamson e05a7629a3 Handle Firefox 97+ not prompting what to do about downloads
Firefox 97+ don't ask you what to do with downloads any more,
they just...download them. For now we'll handle both workflows,
once 97+ is stable everywhere we can drop handling the old one.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-10 16:29:31 -08:00
Adam Williamson f873eb671e Update login_gdm_input for some tiny change in 42~rc
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-10 08:46:32 -08:00
Adam Williamson bace4170f4 Wait longer before exiting _podman_client
At the end of _podman_client we create a mutex that we want the
server to pick up. If we exit too soon, the mutex goes away and
the server test fails. 5 seconds turns out to be not enough of a
wait because, although the server retries the lock call every
5 seconds, it can hit `api_call_2 failed` and wait 10 seconds
before retrying. Let's wait 30 seconds just to be safe.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-08 14:25:40 -08:00
Adam Williamson 9be26becc5 desktop_login: disable automatic updating
Otherwise, if there's an update to fXX-backgrounds pending, we'll
get it on reboot in the middle of the test, and the real
backgrounds will comes back and replace our black fake ones and
break the test.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-07 16:38:30 -08:00
Adam Williamson 50db12402c Add needles for old flatpak gnome-text-editor
Silverblue has an older version of gnome-text-editor, using a
Flatpak base environment built off an older GNOME. Because of
this most of the needles for the current RPM-packaged version
don't match. For some reason the old needles we delete don't
match either - some difference in font rendering configuration
or something. So I had to create a bunch of new needles.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-07 16:00:45 -08:00
Adam Williamson 4e09c5696b Add yet another help_quit_kde needle
I do not know what's going on with this quit button and why it
seems to keep showing up looking different. Today it looks
different in the same image (KDE live) from the same compose
(today's Rawhide) on prod and stg openQA. I've no idea how that
is possible, but oh well, let's keep adding needles till the
pain stops.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-07 15:55:35 -08:00
Adam Williamson f4bc90e681 Tweak the gte_preferences_off needle click point
I did this by hand and I think 20 pixels is a bit too much.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-07 15:03:05 -08:00
Adam Williamson 0a80004f3e Make gte_preferences_off needle more specific
It matches on the "close the app" button on older Flatpak GTE.
So widen the needle to include the "Preferences" text, and add
a click point.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-07 14:47:22 -08:00
Adam Williamson 5065202fcc gnome-text-editor: add old skins logic for Silverblue
Silverblue still has an old version of g-t-e where this theming
stuff worked differently, so put that stuff back for Silverblue
but keep the new stuff for RPMs.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-07 14:24:31 -08:00
Adam Williamson 45514ae985 Don't look for System tab on gnome-text-editor on Silverblue
Silverblue has an older version of g-t-e which does not have this
tab.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-07 13:40:30 -08:00
Adam Williamson af69bf1990 Update a few more miscellaneous needles for GNOME 42
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-05 08:48:46 -08:00
Adam Williamson d57cef71de Update Japanese needles for latest GNOME
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-05 08:47:44 -08:00
Adam Williamson 88f4c55647 Update GNOME menu button needles for French
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-05 08:46:43 -08:00
Adam Williamson d28a507078 Reduce match area of gte_credits_shown needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-04 19:29:40 -08:00
Adam Williamson f4fbbe65e3 Typing 'gnome-text-editor' on Silverblue doesn't find the app
So just type 'text-editor'. If you have both gedit and gte
installed this will find both, but that should never be the case
so it should be OK.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-04 18:39:08 -08:00
Adam Williamson 6544850829 Update a needle and fix launching keyboard settings on Japanese
To get to the keyboard/input method settings and add an input
method when doing a Japanese install test, we type 'keyboard',
but in current GNOME 42.beta that doesn't find the right pane.
Typing 'input' does work, though, so let's use that instead.
Also the GDM login needle needed updating.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-04 17:20:18 -08:00
Adam Williamson 2da5b6abf4 Complete gnome-text-editor needle update
Just needed a few more.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-04 15:12:02 -08:00
Adam Williamson b81bdceba5 Update UEFI console passphrase needle for IoT 37
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-04 14:59:03 -08:00
Adam Williamson ca60a51896 Update several needles for F36/Rawhide KDE changes
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-04 14:55:24 -08:00
Lukáš Růžička bd1e7b0295 Big needle recreation for Gnome-Text-Editor 2022-03-04 15:12:57 +01:00
Lukáš Růžička f1af1bca6e Add newer needle for gnome-text-editor test. 2022-03-04 13:00:34 +01:00
Lukáš Růžička a67398acf5 Change module version as the old one does not exist any more. 2022-03-04 12:48:52 +01:00