Commit Graph

2446 Commits

Author SHA1 Message Date
Adam Williamson 05af76265f Handle Firefox 100 disappearing scrollbars in Cockpit update test
The Cockpit update test relies on scrolling the Cockpit left bar
to find the Software Updates page, but in Firefox 100, the scroll
bars disappear shortly after the last time you moved the mouse.
To deal with this, instead of looking for a scroll bar to scroll,
we'll click the search box in the left bar and hit 'up' to scroll
it to the bottom.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-03 13:15:02 -07:00
Adam Williamson 241ab275a6 Update several needles for Firefox 100
Not sure what changed in the addon needles. For the webui needle
I think it's affected by the new scrollbar behaviour.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-03 13:14:00 -07:00
Adam Williamson c0255c5682 Revert a change accidentally included in previous commit
So it can be re-applied separately with correct message.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-03 13:14:00 -07:00
Adam Williamson 954b6f90bc Update variant anaconda layout needles for F36 RCs
We get these variant needles with the keyboard icon and layout
name at slightly different relative vertical positions every
time we do a Final RC. I think the layout is affected by the
pre-release warning text no longer being present. Usually each
cycle something changes with the icon or with font rendering,
so the needles have to be updated, as in this case.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-03 13:10:09 -07:00
Adam Williamson 3df5d1fac8 Give _live_build a little longer to run
Seems it can take a bit longer on Rawhide sometimes.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-02 10:37:00 -07:00
Adam Williamson 12f423f5a8 Skip desktop background check for Rawhide update tests
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-04-26 16:12:55 -07:00
Adam Williamson c41c55cefe Handle Rawhide updates in upgrade postinstall version check
When testing Rawhide updates we set VERSION to the Rawhide
release number, not "Rawhide". This post-upgrade version check
needs adjusting to handle that.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-04-26 16:08:57 -07:00
Adam Williamson 0ed87c1b66 Adjust live and installer build for Rawhide support
We need to tweak various things when building live and installer
images for Rawhide.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-04-26 16:08:42 -07:00
Lukáš Růžička aa448d48bc Reupload the needle again, as I sent an incorrect file before. 2022-04-25 14:10:08 +02:00
Lukáš Růžička bcf46f0cd0 Fix failing Gnome Text Editor needle. 2022-04-25 13:07:49 +02:00
Adam Williamson 6ec9d9a3f1 Update Japanese needles for latest Rawhide
"Make user admin" is translated now, and Japanese text rendering
seems to have changed a bit.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-04-21 08:27:40 -07:00
Adam Williamson 6f90551eea Update KDE expand_systray needle for latest Rawhide
The caret got thinner.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-04-21 08:26:32 -07:00
Adam Williamson cb3de66b8d Update gnome-text-editor needles for latest Rawhide
Seems like text rendering changed slightly.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-04-21 08:25:10 -07:00
Adam Williamson f86cbd93fb desktop_printing: be a bit more defensive when launching editor
Seeing a failure quite often lately where when we try and hit
ctrl-p to print, we just type a p. There's no wait between
maximizing and trying to print, and only a short wait on
launch, so let's try being a bit more defensive there.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-04-21 08:18:56 -07:00
Adam Williamson 42db9be5fb Add yet another printing_check_sentence needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-04-01 15:12:24 -07:00
Adam Williamson c41bcd56de Use std video on ppc64le as virtio is broken (#2070333)
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-30 12:51:52 -07:00
Adam Williamson a034ba4c2b Add needle for final F36 background ("day" version)
This is from KDE so it's the static "day" image.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-28 14:18:24 -07:00
Adam Williamson 909469bd47 Update Arabic needles for translated layout indicators etc.
So it turns out the translated layout indicators in Arabic are
intentional:
https://gitlab.gnome.org/GNOME/gnome-shell/-/issues/5257
so we can just add needles for them and we're good. Also update
a couple of other needles which need updates since we last
reached this far in the tests.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-25 14:47:33 -07:00
Adam Williamson 3b0de96922 Update KDE needles for new version of F36 backgrounds
The new version of the F36 backgrounds means all these needles
that hit translucent panel elements need updating.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-24 14:43:00 -07:00
Adam Williamson c8377e2329 Add yet another F36 background needle
I hate animated backgrounds.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-24 14:41:34 -07:00
Adam Williamson 4a6404a4be Update KDE login needles for recent F36 change
SDDM looks slightly different on F36 since 20220319.n.0. The
Sleep / Restart / Shut Down / Other... buttons are visible, and
the keyboard layout indicator isn't. Previously on F36, and still
on Rawhide, those buttons aren't shown but the layout indicator
is. I'm not sure why this is, but it means the size of the name
labels is slightly different, and we need new needles.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-24 14:37:57 -07:00
Adam Williamson 45a1a3a36b Wait *longer* to reach hub after setting root password
This can actually take a bit of time, it seems, especially with
debug kernels. Let's give it a minute.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-24 09:01:22 -07:00
Adam Williamson e9261b8f29 Wait till we reach hub after setting root password
Lately anaconda can take up to 10 seconds to exit the root pw
spoke, which can defeat the subsequent `wait_still_screen` that's
meant to wait out the 'slide-in-from-the-top' animation of the
hub. So let's assert the hub after we click Done, then the still
screen wait will only happen *once the hub is visible* and should
really do its job.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-22 08:27:56 -07:00
Adam Williamson 904fd7e406 Drop match level on user_created_qwerty needle
It's coming up a 96% match, I dunno why.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-18 16:45:47 -07:00
Adam Williamson f24c09fad2 Update the topbar_generic needle
We very rarely see this needle - only when we run the 'generic'
tests on an Everything image instead of a Server one, which
will usually only happen if we trigger it manually. I did this
recently to test an anaconda update, and found it needs an
update.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-18 13:55:49 -07:00
Adam Williamson 3d6b74a63f Add yet another F36 background needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-18 13:54:52 -07:00
Adam Williamson 06c66dcd30 desktop_update_graphical: explicitly check refresh on GNOME
OK, this is annoying. GNOME Software intentionally does *not*
clear the 'download' or 'reboot and update' button when you hit
the refresh button, it just leaves them sitting there while the
refresh happens. So let's specifically require the 'refreshing'
text to appear and go away before we try and click on download
or apply.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-18 13:51:33 -07:00
Adam Williamson 4dab8520b0 Bump the wait after hitting the Refresh button
Agh, GNOME's UI is *not* helpful here at all. The Apply button
remains visible for a long time after you hit Refresh.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-18 11:24:07 -07:00
Adam Williamson b17fd9c3fe desktop_update_graphical: always refresh
This is yet another twiddle to that same damn bit where we try
to apply updates. This more or less reverts the last tweak to
it, where we skipped hitting 'refresh' if 'download' or 'apply'
are already visible. The trouble with that is that the app may
have already found and prepared updates before we got our
"prepared" python3-kickstart update in place - so the update
operation might work perfectly, but not update the package we
expect it to update, and the test may fail.

This time, let's try *always* refreshing, then wait a bit after
hitting the refresh button before we start looking for apply
or download to try and avoid the 'race' we were trying to solve
with the last tweak (where we hit refresh then immediately try
to hit a download or apply button which vanishes before we can
hit it). I think this should be safe as both KDE and GNOME
should always show a refresh button now (this wasn't the case
before, I think, F34).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-18 11:15:10 -07:00
Adam Williamson 7d62f3b48e evince: handle wrong filename in save_as as soft failure
There's a bug in the Save As... dialog on the flatpak version
of evince currently where the existing filename is not pre-
selected, so when the test types 'alternative', it gets
prepended to the existing filename instead of overwriting it,
and we wind up with alternativeevince.pdf, not alternative.pdf.
Let's treat this as a soft failure rather than a hard failure.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-18 10:58:36 -07:00
Adam Williamson 90d0a04d14 Add another printing_check_sentence needle
Yet again this is looking different for no obvious reason.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-17 15:05:14 -07:00
Adam Williamson 541a9ae619 Update SDDM login input needle
Looks like the text got slightly smaller.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-17 13:48:21 -07:00
Adam Williamson 278f997b5c Update GNOME reboot_confirm needle for bold button label
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-17 13:46:42 -07:00
Adam Williamson 8bb5aef223 Update an eog needle for flatpak dialog change
Again, a dialog changed a bit in the flatpak version of the app.
For this needle, the shade of grey is slightly different. Change
happened between Fedora-36-20220314.n.0 and 20220315.n.0.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-17 13:42:11 -07:00
Adam Williamson 47e90c9010 Add variant needles for current Flatpak open/save dialogs
The open/save dialogs for Flatpak apps in current F36 (and
probably Rawhide, but can't tell due to another bug) look a bit
odd: https://github.com/fedora-silverblue/issue-tracker/issues/245
This adds variant needles to handle various differences there.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-17 13:23:35 -07:00
Adam Williamson 19b3bb865f Update some KDE needles for F35 respin tests
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-17 12:39:53 -07:00
Adam Williamson 66b111cecc Update gnome-text-editor needles for F36 upgrade test
For some reason various bits of gte started looking slightly
different on the F36 upgrade test. I don't really know why and
don't care enough to look it up. I'm just hoping all these
variations between gte running in slightly different contexts
calm down soon...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-17 12:37:34 -07:00
Adam Williamson 810ab3777d Try running iot_zezere_server on minimal UEFI image instead
OK, so we can't have parallel tests on different machines, so
we can't have iot_zezere_server on 64bit and iot_zezere_ignition
on uefi. We need both to be on uefi. So, let's try using the
minimal-uefi image that we build for upgrade tests instead. It's
built for -1 (which is the same as CURRREL) on x86_64 and aarch64
so it should be there when we need it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-17 11:12:20 -07:00
Adam Williamson fd08abf954 Add back the 64bit IoT profile needed for previous commit
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-17 10:40:53 -07:00
Adam Williamson 03e87ba8d0 Switch iot_zezere_server back to 64bit not uefi
It boots the 'support' disk image, not the image created by
install_default_upload, and that disk image is only set up for
BIOS boot.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-17 10:26:29 -07:00
Adam Williamson ced946dba9 gnome-text-editor: uninstall gedit on upgrade tests
On upgraded systems, gedit might still be present; remove it so
we don't launch it by accident and try to test it instead.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-16 12:31:08 -07:00
Adam Williamson 94520bb7a8 Drop similarity_level on type_safely
I meant to include this in the earlier commit that does the same
for type_very_safely, but forgot.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-16 11:14:50 -07:00
Adam Williamson 1b7c89b016 Update desktop_login needles for KDE and GNOME in Rawhide
Both KDE and GNOME saw some changes to desktop_login needles in
recent Rawhide, this updates them.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-14 20:19:16 -07:00
Adam Williamson b491d283b1 Update login_gdm_input French and Russian needles for 42~rc
These went to 96% match, not sure why.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-14 20:18:02 -07:00
Adam Williamson 5e15d8a273 Update GNOME overview needle for 42~rc
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-14 20:16:43 -07:00
Adam Williamson 9ff7f60fd8 Update krfb_runs needle for recent KDE
krfb finally started for a change, so we can update the needle.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-14 20:15:58 -07:00
Adam Williamson bbfe7416df Add a couple more printing_check_sentence needles
Why rendering of this text is always changing I just don't know.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-14 20:15:05 -07:00
Adam Williamson 239640200a Update dnfdragora_runs for over-large window on KDE
The dnfdragora window is too big on current KDE so we can't see
the top of it (where we used to match). It's kinda better to
match on some active element of the app than just the window
title anyway (so we don't 'pass' if the window loads but is
empty, or something like that).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-14 20:13:16 -07:00
Adam Williamson 7bf3bd8689 Drop similarity levels on type(_very)_safely, solidify_wallpaper
I noticed today that we're timing out all the time on these
wait_still_screens in gnome-terminal, because it uses a big
flashing cursor and the similarity between "cursor there" and
"cursor not there" is less than 45 or 42 (it seems to be 38.x).
So let's drop these levels to 38, hopefully that's not too low.
There are probably more places where this is an issue, I'll
change them as I notice them.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-14 16:32:29 -07:00
Adam Williamson 522e004914 Add a workaround Firefox needle for missing bookmarks toolbar
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-10 17:07:26 -08:00