Commit Graph

1082 Commits

Author SHA1 Message Date
Lukáš Růžička 1f8b56e068 Change the way to download test data.
This PR changes the way to download the test data into the VM.
Although it does not use a disk image as suggested in one
of the review, it does not clone the entire repository, but
a simple tar.gz file that holds the data which will be
distributed into the directory structure.

This way, the amount of data needed to be downloaded dropped
from approximately 50MB to below 2MB.

Also, the existing test suites were adapted to this situation.
2022-07-04 09:34:04 +02:00
Adam Williamson e13c716ab9 Update a couple of KDE needles for recent Rawhide
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-06-29 16:48:11 -07:00
Lukáš Růžička 7c1e686d14 Create tests for Help. 2022-06-29 23:06:37 +00:00
Adam Williamson 79d92fc8cb Update a couple of GNOME needles for recent Rawhide
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-06-28 15:05:53 -07:00
Adam Williamson 1c0ebc4f3f Update KDE vault needle for Rawhide
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-06-28 15:04:44 -07:00
Adam Williamson 97b7e7a0f0 Add another UEFI passphrase prompt needle variant
This one is for current F36 IoT images.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-06-23 16:44:28 -07:00
Adam Williamson b9d0401d8f Update KDE grey-on-black desktop_expand_systray needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-06-23 16:36:14 -07:00
Adam Williamson 5ed1d88f61 Add several new Cockpit login needles for Cockpit 272
The wider one seems to happen when text at the bottom of the
login box prevents the "Fedora Linux..." text from wrapping
across two lines. I have no idea why we see two different
cases of the "Fedora Linux text wrapped" variant with very
slightly different amounts of whitespace, but we do, it seems
we need both of these.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-06-23 16:30:18 -07:00
Lukáš Růžička 6f00e3fe8a Create tests for Clocks. 2022-06-23 21:41:56 +00:00
Adam Williamson fe6314c8de Add yet another bootloader_uefi needle variant
No idea why the UEFI grub appearance keeps changing, but we need
to keep up with it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-06-15 10:22:26 -07:00
Lukáš Růžička b702f8ebcd Add needle to make desktop_upgrade_kde pass. 2022-06-15 09:24:56 +02:00
Lukáš Růžička e29e8f2f38 Add updated needles to make desktop_notifications pass. 2022-06-14 14:12:56 +02:00
Adam Williamson ac24eeefb4 Update UEFI bootloader needle for resolution change(?)
Not sure what's going on here, but it seems like the resolution
of the UEFI bootloader screen in some tests changed. Not sure
if this is a qemu or edk2 change or what.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-27 11:59:33 -07:00
Adam Williamson 1d76c12584 Add Arabic gnome-terminal needle
For the i18n fonts test, this was missing from the PR.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-27 11:58:43 -07:00
Adam Williamson e30fa5a0a1 Update vinagre fullscreen icon needle again
Looks like it got fixed but it now looks slightly different from
before.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-26 10:45:47 -07:00
Adam Williamson 2d4d6ae8f2 Rename needles from i18n fonts test
Just giving them names that kinda explains why they exist.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-26 08:41:01 -07:00
Lukáš Růžička 1acef21fa5 Automate the i18n_default_fonts testcase for Japanese.
This is the automation of the optional testcase https://fedoraproject.org/wiki/QA:Testcase_i18n_default_fonts.
The test implementation runs the same commands as the mentioned test
case and checks the expected output. It is designed to run in the scope
of postinstall tests when the language is set to "japanese".
2022-05-26 09:54:38 +02:00
Adam Williamson a9413c417a Make firefox nobookmarks needle not workaround any more
We've been told the bookmark toolbar no longer being shown on app
start is by design, so we can't call this a workaround needle
any more really. There's a preference we could use to turn it
back on so we can wait for the bookmark toolbar to show up to
be sure firefox is fully started, but in fact tests seem to be
passing OK with just this needle these days, so we may not need
to.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-24 14:05:13 -07:00
Lukáš Růžička 18f6b0863e Delete unused needles. 2022-05-19 11:13:30 +02:00
Adam Williamson dac2a82fea Update KDE help_runs needle
Not sure what changed here, something subtle. Background color?

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-18 13:52:03 -07:00
Adam Williamson 960f2055c2 Update KDE 'no notifications' needle
I think the text went bold.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-18 13:51:32 -07:00
Adam Williamson 3a27510656 Update boxes/vinagre "allow inhibit" needle
The font went bolder.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-17 16:24:17 -07:00
Adam Williamson da0d1969f6 Add a workaround needle for broken vinagre fullscreen icon
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-17 16:22:37 -07:00
Adam Williamson f6f9ae58e6 Update gnome-text-editor dark style needle for current highlight
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-17 16:21:57 -07:00
Adam Williamson 4d049f8f7d browser: drop download save screen handling
Firefox 97 is now stable on all releases, so we can forget about
handling browser_download_save and just assume download will
happen automatically.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-16 16:27:35 -07:00
Adam Williamson a22d3b28b6 Drop a pre-F34 path for launching update tool on KDE
Before F34 we had to launch the update tool from the systray.
This isn't the case any more, so we can throw all this code and
these needles away.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-16 16:04:33 -07:00
Adam Williamson 8c298851a4 Drop handling of 'transient' update notification in KDE
We seem to be solidly back to always getting a permanent update
notification in current F36/Rawhide, so we don't need this more
complex path any more. We also don't need these needles any more,
they haven't matched for months.
2022-05-16 15:53:22 -07:00
Lukáš Růžička 29d69d1de1 Delete unusued needles that prevent branches from passing tests. 2022-05-12 09:09:42 +02:00
Adam Williamson f7d1fe8ccd Update gte_text_replaced needle for different underlining
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-11 16:25:19 -07:00
Adam Williamson ea880659fc Update root password screen needles for other languages
Same difference as for English - 4 pixels of padding was added.
Also move a stray Russian needle to the right directory.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-11 16:21:14 -07:00
Adam Williamson 763ef5d48f Update leftbar_server for current Rawhide
The "FEDORA" part of the logo has changed a bit for some reason
(smaller, no TM).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-09 16:46:15 -07:00
Adam Williamson 4d2c997d47 Update root password screen needle for anaconda 37.7
A margin got bumped by four pixels.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-09 16:44:53 -07:00
Adam Williamson 8468bd2e0b Shrink cockpit updates link needle a bit
We can wind up with this a bit hidden by the bottom-left URL
location indicator, so shrink it a bit to hopefully match even
in that case.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-06 14:10:15 -07:00
Adam Williamson 618944b0a9 Update French admin selected needle now it's translated
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-04 17:05:03 -07:00
Adam Williamson c784011fc2 Add 'version 37' needles needed for Rawhide update tests
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-04 17:04:15 -07:00
Adam Williamson 05af76265f Handle Firefox 100 disappearing scrollbars in Cockpit update test
The Cockpit update test relies on scrolling the Cockpit left bar
to find the Software Updates page, but in Firefox 100, the scroll
bars disappear shortly after the last time you moved the mouse.
To deal with this, instead of looking for a scroll bar to scroll,
we'll click the search box in the left bar and hit 'up' to scroll
it to the bottom.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-03 13:15:02 -07:00
Adam Williamson 241ab275a6 Update several needles for Firefox 100
Not sure what changed in the addon needles. For the webui needle
I think it's affected by the new scrollbar behaviour.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-03 13:14:00 -07:00
Adam Williamson 954b6f90bc Update variant anaconda layout needles for F36 RCs
We get these variant needles with the keyboard icon and layout
name at slightly different relative vertical positions every
time we do a Final RC. I think the layout is affected by the
pre-release warning text no longer being present. Usually each
cycle something changes with the icon or with font rendering,
so the needles have to be updated, as in this case.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-03 13:10:09 -07:00
Lukáš Růžička aa448d48bc Reupload the needle again, as I sent an incorrect file before. 2022-04-25 14:10:08 +02:00
Lukáš Růžička bcf46f0cd0 Fix failing Gnome Text Editor needle. 2022-04-25 13:07:49 +02:00
Adam Williamson 6ec9d9a3f1 Update Japanese needles for latest Rawhide
"Make user admin" is translated now, and Japanese text rendering
seems to have changed a bit.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-04-21 08:27:40 -07:00
Adam Williamson 6f90551eea Update KDE expand_systray needle for latest Rawhide
The caret got thinner.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-04-21 08:26:32 -07:00
Adam Williamson cb3de66b8d Update gnome-text-editor needles for latest Rawhide
Seems like text rendering changed slightly.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-04-21 08:25:10 -07:00
Adam Williamson 42db9be5fb Add yet another printing_check_sentence needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-04-01 15:12:24 -07:00
Adam Williamson a034ba4c2b Add needle for final F36 background ("day" version)
This is from KDE so it's the static "day" image.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-28 14:18:24 -07:00
Adam Williamson 909469bd47 Update Arabic needles for translated layout indicators etc.
So it turns out the translated layout indicators in Arabic are
intentional:
https://gitlab.gnome.org/GNOME/gnome-shell/-/issues/5257
so we can just add needles for them and we're good. Also update
a couple of other needles which need updates since we last
reached this far in the tests.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-25 14:47:33 -07:00
Adam Williamson 3b0de96922 Update KDE needles for new version of F36 backgrounds
The new version of the F36 backgrounds means all these needles
that hit translucent panel elements need updating.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-24 14:43:00 -07:00
Adam Williamson c8377e2329 Add yet another F36 background needle
I hate animated backgrounds.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-24 14:41:34 -07:00
Adam Williamson 4a6404a4be Update KDE login needles for recent F36 change
SDDM looks slightly different on F36 since 20220319.n.0. The
Sleep / Restart / Shut Down / Other... buttons are visible, and
the keyboard layout indicator isn't. Previously on F36, and still
on Rawhide, those buttons aren't shown but the layout indicator
is. I'm not sure why this is, but it means the size of the name
labels is slightly different, and we need new needles.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-24 14:37:57 -07:00
Adam Williamson 904fd7e406 Drop match level on user_created_qwerty needle
It's coming up a 96% match, I dunno why.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-18 16:45:47 -07:00