Commit Graph

1063 Commits

Author SHA1 Message Date
Adam Williamson 50db12402c Add needles for old flatpak gnome-text-editor
Silverblue has an older version of gnome-text-editor, using a
Flatpak base environment built off an older GNOME. Because of
this most of the needles for the current RPM-packaged version
don't match. For some reason the old needles we delete don't
match either - some difference in font rendering configuration
or something. So I had to create a bunch of new needles.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-07 16:00:45 -08:00
Adam Williamson 4e09c5696b Add yet another help_quit_kde needle
I do not know what's going on with this quit button and why it
seems to keep showing up looking different. Today it looks
different in the same image (KDE live) from the same compose
(today's Rawhide) on prod and stg openQA. I've no idea how that
is possible, but oh well, let's keep adding needles till the
pain stops.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-07 15:55:35 -08:00
Adam Williamson f4bc90e681 Tweak the gte_preferences_off needle click point
I did this by hand and I think 20 pixels is a bit too much.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-07 15:03:05 -08:00
Adam Williamson 0a80004f3e Make gte_preferences_off needle more specific
It matches on the "close the app" button on older Flatpak GTE.
So widen the needle to include the "Preferences" text, and add
a click point.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-07 14:47:22 -08:00
Adam Williamson af69bf1990 Update a few more miscellaneous needles for GNOME 42
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-05 08:48:46 -08:00
Adam Williamson d57cef71de Update Japanese needles for latest GNOME
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-05 08:47:44 -08:00
Adam Williamson 88f4c55647 Update GNOME menu button needles for French
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-05 08:46:43 -08:00
Adam Williamson d28a507078 Reduce match area of gte_credits_shown needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-04 19:29:40 -08:00
Adam Williamson 6544850829 Update a needle and fix launching keyboard settings on Japanese
To get to the keyboard/input method settings and add an input
method when doing a Japanese install test, we type 'keyboard',
but in current GNOME 42.beta that doesn't find the right pane.
Typing 'input' does work, though, so let's use that instead.
Also the GDM login needle needed updating.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-04 17:20:18 -08:00
Adam Williamson 2da5b6abf4 Complete gnome-text-editor needle update
Just needed a few more.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-04 15:12:02 -08:00
Adam Williamson b81bdceba5 Update UEFI console passphrase needle for IoT 37
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-04 14:59:03 -08:00
Adam Williamson ca60a51896 Update several needles for F36/Rawhide KDE changes
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-04 14:55:24 -08:00
Lukáš Růžička bd1e7b0295 Big needle recreation for Gnome-Text-Editor 2022-03-04 15:12:57 +01:00
Lukáš Růžička f1af1bca6e Add newer needle for gnome-text-editor test. 2022-03-04 13:00:34 +01:00
Adam Williamson 44914d13ab Drop match level on older KDE no notifications needle
Now KDE is back to being black, this needle almost matches. Let's
just drop the level instead of making a new one.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-03 10:06:09 -08:00
Adam Williamson c6ffea301c Add some more F36 background needles
Sigh, this one sure likes to animate.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-03 08:46:02 -08:00
Adam Williamson 1084aa0828 Update KDE vault needles and test
The backend is now cryfs in F36/Rawhide. I don't think we need
to be policing which backend Vault decides to use, so let's just
accept either.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-03 08:42:45 -08:00
Adam Williamson 482712f953 Update more KDE login needles for Rawhide/F36 changes
Now we have an SDDM that actually works, we can update these.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-01 20:27:41 -08:00
Adam Williamson 28a2d16417 Add missing tags to new KDE logout confirm needle and rename it
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-01 20:03:50 -08:00
Adam Williamson e794c24de7 Update Arabic needles for GNOME and keyboard icon changes
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-01 16:37:05 -08:00
Adam Williamson 61c988f401 Update some KDE needles for changes in Rawhide
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-01 16:05:04 -08:00
Adam Williamson 1493cb9aa9 Update app start/stop needles for GNOME 42.beta
These are taken with the latest gnome-shell build, with CSS
fixes for the overview applied. They don't work for current
F36/Rawhide but will work once that gnome-shell build lands.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-01 15:59:57 -08:00
Adam Williamson c0e83e3e3d Update KDE menu button needle for Rawhide
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-01 14:03:18 -08:00
Adam Williamson f75cd0e732 Add another F36 background needle (at 17:25)
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-27 23:06:38 -08:00
Adam Williamson 416de35376 More needle updates for GNOME 42 / icon theme changes
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-26 16:38:25 -08:00
Adam Williamson fb214eef03 Update Arabic pre-release needle for font change
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-25 14:47:34 -08:00
Adam Williamson 8a7d5dd1ff Update various KDE/Plasma needles for Rawhide/F36 changes
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-25 14:47:04 -08:00
Adam Williamson 752a9476be Drop KDE app 'netcon' test
This was originally a test of nm-connection-editor. However,
at some point that app stopped shipping a .desktop file by
default (it's in a subpackage that is not included in a default
KDE install) and the needle got updated to match on what the
same string now launched, which is a random part of the KDE
system settings. But there's no real sense in this - we don't
test launching every other pane of the system settings app from
the launcher, so it doesn't make sense to just test one random
one like this. Let's just throw the test out.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-25 12:37:53 -08:00
Adam Williamson fcac2af4f8 Update and rationalize KDE app "cancel" needles
We have three different needles which all match on a stock KDE
"cancel" button. Let's just have one. Also, update it for latest
Rawhide/F36 KDE.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-25 12:22:47 -08:00
Adam Williamson e305202c84 Make an anaconda help needle smaller to match on KDE
The last line of text is slightly cut off on KDE lives, so shrink
this needle area so it still matches.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-25 09:16:23 -08:00
Adam Williamson 0281cfd7f1 Add another anaconda main hub needle for KDE
One of the icons showed up bigger in a UEFI test. I dunno why.
Just keep adding needles till the pain stops.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-24 08:31:00 -08:00
Adam Williamson 172e5a3fdc Add another 36 background needle (05:34)
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-24 08:27:47 -08:00
Adam Williamson dd6ebb2171 Add a second F36 background needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-23 16:11:53 -08:00
Adam Williamson 671a19cda8 Update a KDE needle for F36
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-23 16:08:54 -08:00
Adam Williamson eefe75aa7f Update KDE menu button needle
Dunno what changed here, but it dropped to 93% match when I
rebuilt the F36 KDE base disk image.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-23 10:11:09 -08:00
Adam Williamson 97a109eb3c Add an initial F36 background needle (daytime, 10:47)
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-23 09:46:10 -08:00
Adam Williamson 50afc237e6 Add version 37 identification needle for IoT
IoT started doing 37 composes, so we need this.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-23 09:00:56 -08:00
Adam Williamson 3a9b21969d Add one more needle update for GNOME 42
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-23 08:52:52 -08:00
Adam Williamson 67b599d16f Add variant KDE cups-pdf needle for F36 update tests
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-23 08:50:47 -08:00
Adam Williamson 10df5a57bf Update a bunch of needles for GNOME and adwaita-icon-theme 42
GNOME 42 and adwaita-icon-theme 42 changed a lot of things in
GNOME and anaconda, we need to update all these needles.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-20 15:52:42 -08:00
Adam Williamson 9bc039b26d Correct JSON error in user_creation-20200219.json
Please endorse my RFE at
https://www.happyassassin.net/posts/2017/09/07/a-modest-proposal/

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-20 15:34:51 -08:00
Adam Williamson 9243fa88fc Avoid duplication of "user creation" needle
The help test had its own needle for the user creation link,
but we already have an existing one. We should probably re-
arrange all the needles that are in 'install_process' now the
root and user creation spokes are moved to the main hub, but
that's a big change so I'll do it separately. This just removes
the duplicate needle and tweaks some match names.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-18 14:59:17 -08:00
Adam Williamson 28600540c0 Update user_creation_screen Arabic needle for a font change
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-17 14:05:16 -08:00
Adam Williamson 08a4e955df Update install_lang_input needle for new icon theme
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-17 14:03:02 -08:00
Adam Williamson 5c011ab567 printing: always use ls to find PDF, update needles
When the printing_builtin test ran on an F35 respin compose it
failed; it turns out the target filename was different for the
built-in print-to-PDF on GNOME on F35. So let's just always
use the 'ls' output to find the file, but pick the directory
to check based on whether we're using cups or not.

Also rename the needles to have unique names, and add one for
F35 GNOME.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-16 17:21:36 -08:00
Adam Williamson b26fa834ef Update Akonadi migration notification needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-14 18:18:35 -08:00
Adam Williamson 4fe497c6df Update KDE login needle for font kerning change
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-14 18:16:51 -08:00
Adam Williamson 9e570a06a1 Add variant printing needles for F34 KDE
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-12 10:51:26 -08:00
Adam Williamson cd139e5f65 Add use_cups_printer needle for F35, rearrange needles a bit
We should not use the same name for two different needles even
in two different directories as it can be confusing in some parts
of the UI which don't account for the directory name. Let's use
names differentiated by desktop. Also add a needle for F35 as
the one from the PR doesn't match (different relative placement
of icon and text).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-11 08:59:48 -08:00
Lukáš Růžička 9a56adcfd0 Modify Desktop Printing test to use two different methods.
The PR introduces an improved logic to the desktop_printing.pm
that allows to use the USE_CUPS variable in templates to trigger
the installation of cups-pdf prior to the actual test.
The cups-pdf is then used as an alternative PDF printer
instead the built-in Save As PDF method.
2022-02-10 09:35:22 +01:00
Adam Williamson 4282048819 Drop screenshot app from GNOME app start/stop tests
It was removed from the default install:
https://pagure.io/fedora-comps/c/5371509
in favor of a new screenshot mechanism that's built in to GNOME
Shell.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-09 10:23:38 -08:00
Adam Williamson d112944526 Shrink Arabic prerelease note match area a bit
We don't need to capture the greyspace.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-09 09:24:40 -08:00
Adam Williamson 2d87ac8ff5 Make the F36 version id needle narrower, drop language variants
It does not need to include any of the language specific text,
I guess Lukas included it in the English needle because it was
based on the IoT needle which is wider. So just shrink it to
not include any language specific text and drop the variants.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-09 09:22:42 -08:00
Adam Williamson 57a35562ad Shrink match area on install_lang needle a bit for IoT
IoT says "FEDORA-IOT" here, not just "FEDORA", and the greyspace
at the right-hand side was making the match fail. Not sure why
this only just started being a problem, but oh well, let's
make it a bit smaller.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-09 09:20:05 -08:00
Lukáš Růžička d27f195de3 Add version needles for language mutations. 2022-02-09 16:37:56 +01:00
Lukáš Růžička 1975ef2f2b Add Silverblue left bar needle. 2022-02-09 13:31:45 +01:00
Lukáš Růžička 9e1632e364 Add needle to identify the 36 version 2022-02-09 12:37:21 +01:00
Adam Williamson 698348a478 Update anaconda network needles for some font change
The kerning got a lot worse. Not sure why.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-07 18:26:07 -08:00
Adam Williamson a6ac35c91b Update firefox_close_tabs needle again
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-07 18:20:16 -08:00
Adam Williamson 294c29ed07 Update Arabic needles for a font change
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-07 18:18:21 -08:00
Lukáš Růžička 42e9f713b2 Change test suite to fit with the latest known version.
The latest version of Gnome-Text-Editor bring a little
bit different UI and some new or modified features.
This commit fixes the suite to run on newest version.
2022-02-07 10:50:10 +01:00
Adam Williamson d313e4d9b3 Update KDE notification needles for current Rawhide
Looks like KDE changed some background greys again.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-04 15:53:02 -08:00
Adam Williamson 52f661b986 Update anaconda help test needles for current Rawhide
Font sizes changed a bit, it looks like.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-04 15:49:33 -08:00
Adam Williamson c95bb4306d Remove duplicate needle in anaconda_help test
We check the same screen twice with two different needles.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-04 15:47:21 -08:00
Lukáš Růžička 4d16dd085a Add needle to check a printed sentence. 2022-02-02 13:13:07 +01:00
Lukáš Růžička 222270c3dd Add failing needle for eog. 2022-02-02 12:50:20 +01:00
Adam Williamson 0af5692ebf Add another GNOME printing needle
Not sure if we lost one with the recent adjustment to the tests
or F35 actually changed somehow, but hey, we need this.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-31 16:44:54 -08:00
Lukáš Růžička ceaf711f76 Create a test suite for Gnome Text Editor 2022-01-29 00:49:10 +00:00
Lukáš Růžička 980ba5f411 Make changes to the Desktop Printing test. 2022-01-28 20:57:36 +00:00
Lukáš Růžička fe8306d2cd Implement distribution methods to replace the testapi defaults.
This PR adds implementations of distribution methods to make them
usable on Fedora. It adds the following methods

* ensure_installed (to install packages)
* become_root (to switch to root account)
* script_sudo (run script with sudo)
* assert_script_sudo (run and assert a sudo script)

It also adds a helper script to the utils.pm

* make_serial_writable

that makes the serial console writable for normal users
and so enables to run commands that check their progress
by sending messages to the serial console. Normally, they
fail, because the messages will not be written their, so
the checking mechanism will never see them.
2022-01-27 21:44:35 +00:00
Lukáš Růžička 83356ceec6 Use waiting commands to make the tests more defensive. 2022-01-25 13:36:57 +01:00
Lukáš Růžička 1052712410 Add needles to make them not failing. 2022-01-24 14:49:32 +01:00
Lukáš Růžička d9ba0883e7 Delete unused needles
These needles have been probably forgotten and left over from one
of the previous commits. The tox tests are failing on other
pull requests and this PR fixes it.
2022-01-21 18:09:07 +01:00
Adam Williamson c80f20f947 Update KDE menu button needle for new KDE in Rawhide
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-20 14:52:09 -08:00
Adam Williamson 8894e022b2 Update a couple of Japanese needles for GNOME changes
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-18 17:40:23 -08:00
Adam Williamson f4bdedc57e Update user_creation_screen French needle
The text line we matched on before changed and is currently
untranslated, let's match on a different line.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-18 15:58:08 -08:00
Adam Williamson 4363918b5d Update GNOME "no notifications" needle for GNOME 42
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-18 15:57:26 -08:00
Adam Williamson 24e3ecb89f Drop gedit application tests
Workstation has replaced gedit with gnome-text-editor in Rawhide,
so this is no longer useful. We will replace it with a test suite
for gnome-text-editor.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-18 15:52:40 -08:00
Adam Williamson 3ae23f66a9 Update GNOME apps test for gedit->gnome-text-editor switch
Workstation replaced gedit with gnome-text-editor. This updates
the needles and also changes the name used for 'tagging' the
application for the core_applications test.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-18 15:11:50 -08:00
Adam Williamson c7f5ec6689 Update several GNOME needles for GNOME 42 in Rawhide
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-18 14:13:42 -08:00
Adam Williamson 574498eb66 Correct language tags on needles from last commit
I forgot to update the language tags in the 'untranslated'
needles when copying them from the English one.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-18 11:39:42 -08:00
Adam Williamson 8e414cc469 Handle anaconda giving users admin by default in Rawhide
As of today's Rawhide compose, user accounts added in Rawhide
have admin privs by default. For now we need to handle both
possibilities here (click the box if it's not clicked already);
after F35 EOL we can just drop all handling of that box.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-18 11:36:06 -08:00
Adam Williamson d5ca75cb04 Also remove system-config-language test from KDE app test
This was also dropped:
https://pagure.io/fedora-kickstarts/c/5b5fba2

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-12 17:26:37 -08:00
Adam Williamson 4e15e16824 Drop kcolorchooser and kruler from KDE apps test
Both were dropped from the default KDE install set:
https://pagure.io/fedora-comps/c/edd0d74
so we need to drop them here too.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-12 16:59:13 -08:00
Adam Williamson b94daf25d0 Update GNOME software needles a bit more
Add the download and apply needles (whoops), and tighten the
match area on the update needle a bit so it matches even when
there's a little blue balloon to the left of the text.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-12 16:05:34 -08:00
Adam Williamson d19b7f6890 Update some GNOME app needles
Calculator's equals button changed a bit somehow, EOG changed a
button and the kerning on Activities button changed.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-12 15:20:56 -08:00
Adam Williamson 2a14756a3d Update some GNOME Software needles for a UI change
Looks like text got bolded a bit.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-12 15:20:29 -08:00
Adam Williamson 2ecd05ddb3 Update KDE needles for slightly greyer grey
KDE team inform me they fixed a bug in Rawhide which made grey
not quite grey enough. Now it's greyer. So, more needles. So
many needles.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-12 15:11:43 -08:00
Adam Williamson b60b0f85b4 Update several needles for KDE Frameworks 5.90.0
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-06 14:16:00 -08:00
Adam Williamson 5d10fae391 Update a couple of EOG needles with minor changes
Slight spacing changes is all.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-12-14 09:58:49 -08:00
Adam Williamson fb909555e6 Update Cockpit 'join domain' screen needle for Cockpit 259
They probably moved it to a different JS lib or something.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-12-08 13:34:18 -08:00
Adam Williamson 740fef2da6 Update a KDE vault app needle for some change in F35 updates
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-12-08 13:32:40 -08:00
Adam Williamson dbd7883200 Drop match levels on some KDE update notification needles
These incorporate bits of the background so are subject to
non-100% matching, got a 97% match in current Rawhide, let's
see if dropping the match level is enough.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-30 14:41:53 -08:00
Adam Williamson 15cdd4f398 Update the Cockpit 'reconnect' needle
Font's changed since the last time we actually matched this (it
only happens occasionally if specific packages are in the update).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-30 14:06:35 -08:00
Adam Williamson af31d4e8ae Update a Cockpit needle for Cockpit 258
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-24 09:45:31 -08:00
Adam Williamson 1d2255b041 Update PPC bootloader needles
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-24 09:45:21 -08:00
Adam Williamson be235cd7ea Drop match level on a KDE notification needle
Got a 95% match on this in a 35 respin test.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-18 15:57:21 -08:00
Lukáš Růžička cda0d0b0d1 Create a test suite for EoG (Image Viewer) 2021-11-18 13:13:59 -08:00
Adam Williamson 6aa41f038c Update a bunch of needles for font rendering changes
Seems like the new Pango changed font rendering in quite a lot
of places.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-12 15:48:05 -08:00
Adam Williamson 07ff387293 Drop match level on an Evince needle a bit
96% match with today's Rawhide, don't feel like a new needle.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-12 13:20:11 -08:00