Commit Graph

293 Commits

Author SHA1 Message Date
Lukas Ruzicka aa0d077630 Add new set of results needles for Calculator 2023-08-21 15:09:44 +02:00
Adam Williamson b4b98235ac Update Contacts needles for some recent change in Rawhide
Not sure what changed, some minor chrome thing.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-14 17:16:20 -07:00
Adam Williamson b287a4a9d5 Remove two recently-added, unused needles
Lukas added these in a recent big commit that fixed problems with
GNOME 45, I think these two were probably needles from some
in-development tests that are not actually needed in prod yet.
They make the tests fail, so we need to get rid of them.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-11 14:38:58 -07:00
Lukas Ruzicka babc8ef87a Add fixes to make some tests pass on F39 2023-08-09 13:20:05 +02:00
Adam Williamson 14205c3acd Update several needles for GNOME 45
The 'global' app menu is no longer shown, which affects the
apps_run_terminal needle (it will affect many others for the
compose tests, but this is just for updates tests). It seems we
sometimes have the cursor over the Activities button and it
looks slightly different in that case, so add a variant needle
for that. Finally, the password input box in GDM is no longer
highlighted in blue as it probably should be to indicate that
it's active, so add a workaround needle to handle that.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-08 11:11:37 -07:00
Lukas Ruzicka 8ac3885897 Make various fixes in Workstation product to make tests pass. 2023-08-08 14:50:03 +02:00
Adam Williamson 9f49acdd61 Update Maps walking route needle for a route change
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-07-25 18:12:39 -07:00
Adam Williamson 38a2d39aba Update GNOME Characters needle for some change in Rawhide
Background color changed a bit, not sure what did it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-07-25 18:05:27 -07:00
Adam Williamson daf092398a Update several needles for an icon theme change in Rawhide
Looks like the GNOME icon theme changed a bit in Rawhide, here
are several required needle updates.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-07-19 11:59:54 -07:00
Adam Williamson b9e3b859f6 Update apps_run_files needle for some change from two weeks ago
Somehow I had this needle lying around prod but hadn't committed
it, oops.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-07-19 11:58:54 -07:00
Lukas Ruzicka c322924826 Add stormy needle for the Weather test. 2023-07-17 13:57:53 +02:00
Lukas Ruzicka e807286805 Add a new walking route needle to make Maps pass. 2023-07-17 13:22:59 +02:00
Lukas Ruzicka 04c4417a13 Add the needle to cover for zoom-in button in Maps
The zoom-in button were not correctly recognized. This adds a needle
to recognize it again.
2023-07-07 14:06:37 +02:00
Adam Williamson 8039934123 Update several gnome-text-editor needles for 45 alpha
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-07-05 12:21:44 -07:00
Adam Williamson f49c8bc66b gnome-text-editor: only handle spellcheck language if needed
The Flatpak build doesn't have the spellcheck issue at the
moment, and it may be fixed soon in the RPM build. Trying to
'fix' the issue on the flatpak build actually makes the test
fail. So, let's only do the fix if we actually have a misspelled
word.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-07-05 12:19:41 -07:00
Adam Williamson 7dc1299d9f Update a bunch of needles for GNOME 45 Alpha builds
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-07-05 10:57:52 -07:00
Adam Williamson 2f709ed28e Update a lot more needles for new libadwaita
Aside from g-t-e which requires some more logic change I'll do
in the morning, this should be everything.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-07-03 23:10:20 -07:00
Adam Williamson f31e3d192f Add F38 variant of the new gnome-text-editor needle
This is needed for the respin tests to pass.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-06-30 16:50:38 -07:00
Adam Williamson bb7c7d42d0 Drop now-unused needles for Photos
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-06-30 10:13:48 -07:00
Lukas Ruzicka d749317f29 Update the Gnome-Text-Editot test.
The editor started to show spell-checking that would require a lot
of new needles to be created. Theredore, we set the language to
English to stop showing the spelling mistakes in aaa_setup.pm

Also, the application started to have problems with getting correct
focus, so we want to click into the text before the status gets
recorded.
2023-06-30 14:26:00 +02:00
Adam Williamson a01c5bc45d Update Maps needles for some recent changes
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-06-29 10:00:32 +02:00
Adam Williamson 91e77c1eec Update Calculator needles for Rawhide
Seems the font used in Calculator changed.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-06-29 09:58:18 +02:00
Lukas Ruzicka bc8601a1d4 Create test for the Tour application. 2023-06-23 10:53:58 +02:00
Adam Williamson d1228e5813 Add another variant for maps_found_brno
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-06-18 14:33:22 +02:00
Adam Williamson eda7964c0f Update some Maps needles
Seems like it's not showing as much stuff on the address
selection box as before...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-06-12 10:23:21 -07:00
Adam Williamson d8bad7a292 Update GNOME maps walking route needle
It's more zoomed out now, possibly because the route changed.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-30 15:26:06 -07:00
Adam Williamson ed5e1e28dc Add yet another Weather icon variant
Rain. How did we not have rain yet?

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-18 16:43:02 -07:00
Adam Williamson 89fa04661f Disks: workaround partitions sometimes being mounted after format
https://github.com/storaged-project/udisks/issues/1102 - udisks2
seems to have a bug where it leaves filesystems mounted at a
"temporary" mount point after creating them. We need to work
around this when it happens or else we'll frequently get test
failures.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-18 15:15:02 -07:00
Adam Williamson 280139db2b Add some more variant 'website opened' needles
These hit low-90% matches when run on the F38 respins for some
reason, just add another variant...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-16 15:45:10 -07:00
Adam Williamson e297cf89d8 Add another Maps needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-12 17:22:29 -07:00
Lukas Ruzicka e211a87fc7 Create a test suite for Disks. 2023-05-12 17:05:44 -07:00
Adam Williamson 3781b2796d Update several needles for changes in GTK 4.11.2
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-11 16:56:19 -07:00
Adam Williamson 12fa854527 Add a variant archiver file needle
I don't know exactly why this sometimes shows up highlighted and
sometimes unhighlighted, but hey, it's not wrong either way, so
we just handle it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-11 16:54:41 -07:00
Adam Williamson 108e234d66 Add a variant nautilus needle that showed up in respin testing
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-11 16:52:50 -07:00
Adam Williamson d4136392d4 Old needle cleanup 2023-04-28
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-04 09:57:15 -07:00
Adam Williamson 9199f8a0f0 Drop gnome-contacts softfail for "Unnamed Person" problem
This was resolved upstream and we're no longer hitting this bug
in tests on F38, Rawhide or even F37 respins, so we should no
longer need this workaround.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-04 09:57:15 -07:00
Adam Williamson 7dece68ae6 Drop old branch of gnome-text-editor 'skins' test
This is never hit any more, everywhere we run this test is on
the newer code now.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-04 09:57:15 -07:00
Adam Williamson e3b0211689 Update multiple needles for GNOME 44.1 changes
That grey background that's used in a lot of places changed
shade slightly.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-04-26 17:46:56 -07:00
Adam Williamson 8744042e32 Update Nautilus needles for changes in GNOME/GTK file selection
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-04-25 11:30:26 -07:00
Adam Williamson de7f018632 Update Archiver needles for changes in GNOME/GTK file selection
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-04-25 11:29:36 -07:00
Adam Williamson a2a3ba8790 Add another variant Evince file select needle for Flatpak
For some reason the file can be highlighted/selected in blue as
well as grey. Well, whatever.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-04-25 10:26:31 -07:00
Adam Williamson 5ab7fc505c Update several Maps needles for OSM changes
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-04-25 10:20:56 -07:00
Adam Williamson 1264ce4aca Add variant 'another file' needle for nautilus test
In today's Rawhide, for some reason, after we delete the first
file, the second file we want to delete is highlighted.
Previously the other file in the directory was highlighted. No
biggie, just handle both cases.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-04-11 11:16:59 -07:00
Adam Williamson 44147a67da Add some variant Fonts needles for Silverblue
There's a difference in the Info page and we get every font
twice on Silverblue because they're present in two locations.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-04-11 11:16:12 -07:00
Adam Williamson a07cc52a6e Add variant gnome-panel lockscreen needle for F37
For when this test runs on respins.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-04-07 09:45:11 -07:00
Lukas Ruzicka 7291e3526e Create a test for Gnome Panel. 2023-04-06 15:50:43 -07:00
Adam Williamson d3e3dc1a31 Update a Maps bike route needle, again
Man, this app loves changing its mind about how to ride a bike
across the UK...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-04-06 12:38:56 -07:00
Adam Williamson 7aa21b308f Update some Maps needles for OSM data changes
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-04-04 18:24:13 -07:00
Adam Williamson 1ce16da1c2 Add another weather icon variant needle
Half sun half cloud?

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-04-01 15:17:25 -07:00
Adam Williamson b2d039d1d8 Add a variant needle for nautilus "new window" menu entry
This is when it's highlighted in grey, for some reason.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-04-01 15:00:23 -07:00
Adam Williamson 2c8067698f Update a bunch of Japanese needles for a CJK font change
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-03-29 12:33:13 -07:00
Lukas Ruzicka 4f8c4411a4 Update Map needles. 2023-03-29 09:50:46 +02:00
Lukáš Růžička 0075780ac5 Create test suite for Fonts. 2023-03-28 15:58:16 -07:00
Adam Williamson a9fcc1071e Drop match level on a Maps 'issue opened' needle
The font rendering on this URL bar seems to be slightly unstable
for some reason. We got a 95% match on this needle in
https://openqa.fedoraproject.org/tests/1846906#step/about/10
so let's just bump the level down a bit.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-03-24 11:40:08 -07:00
Adam Williamson 47f239e03d Update a Maps needle
Just looks like the content on OSM changed a little.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-03-23 15:14:00 -07:00
Adam Williamson 16ba2a3cb9 Update GNOME Contacts "right menu" needle
They made it a kebab menu instead of a second burger menu, which
makes things easier.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-03-23 15:12:56 -07:00
Adam Williamson c9a0cab6ec Update a GNOME Clocks needle
The button label changed slightly.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-03-16 13:41:47 -07:00
Adam Williamson 301daa6c9e Update a GNOME system monitor needle for ARM
This is a 44 change that I didn't catch for a while as I forgot
to check the ARM tests.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-03-16 13:35:44 -07:00
Lukas Ruzicka 0d4f3f4542 Fix a failing needle for Maps. 2023-03-13 13:39:22 +01:00
Adam Williamson 1133d7fbdc Update several GNOME Contacts needles
They tweaked how the contact name field is named/placed, so these
all need updating.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-03-07 12:23:24 -08:00
Adam Williamson bda24173b1 Delete one match from a GNOME Help needle
They've dropped the IRC section from this page. We don't really
need three match areas, just the two is sufficient to identify
it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-03-07 11:45:30 -08:00
Adam Williamson 9c736f9ffc Update a bunch more Japanese needles for GNOME 44
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-24 14:54:08 -08:00
Adam Williamson 7abd61077e Update various anaconda and GNOME needles for icon theme changes
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-23 13:11:50 -08:00
Adam Williamson b1dfcfdd3d Contacts: handle menu changes in 44
Contacts now has two burger menus, which is awkward. We need
specific needles to identify each, we can't rely on the generic
needle any more as it won't always open the right menu. We also
need to still work with the old UI for the flatpak.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-22 12:38:02 -08:00
Adam Williamson d9c27577c3 Update a bunch of GNOME needles for changes in GNOME 44
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-18 14:54:43 -08:00
Lukas Ruzicka 94f92c8ae7 Add failed needles for Maps. 2023-02-15 18:35:14 +01:00
Lukas Ruzicka ecf02bb48b Add failed needles for Gnome Text Editor. 2023-02-15 16:07:13 +01:00
Adam Williamson 7475176c00 Update maps needles
Bike route changed again. For the website opened needle, the
URL bar text seems to keep changing slightly, so instead let's
try matching on the big app logo...hopefully that won't change
as much.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-03 16:33:21 -08:00
Adam Williamson b2abe0e6a6 Update evince annotation added needle for some small change
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-02-03 16:32:43 -08:00
Lukas Ruzicka 8ba56693ed Add snowflake needle for Gnome Weather 2023-02-03 13:45:09 +01:00
Adam Williamson e22f0c66e4 Update Maps needles for Rawhide
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-23 16:33:42 -08:00
Adam Williamson ebf259680b Update LibreOffice launcher needles
Looks like the icons got redesigned.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-23 16:33:02 -08:00
Lukas Ruzicka 7ad809339f Add new test for Characters.
This PR adds a small test suite to test the Characters applications.
It displays several different groups of characters and then tries
to copy one of the characters and place it into a text editor.
2023-01-19 17:53:03 -08:00
Adam Williamson 1d46c5aa85 Update maps 'website opened' needle
Looks like some font rendering change in the browser URL bar.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-01-18 10:00:54 -08:00
Adam Williamson f32ee1040a maps: update bike route needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-24 13:33:07 -08:00
Lukáš Růžička 5af70b9dda Reneedle Maps needles to support newer version. 2022-12-08 11:42:18 +01:00
Lukáš Růžička 179764d49c Fix tests for Maps.
* Scarborough provided quite a messy map that resulted
in frequent needle failure. Changing the location
for something better to make it more reliable.
* The zoom test could have failed with a low resolution
image. Adding some timeout to the needle give more
time to load the proper image.
2022-12-07 11:52:11 +01:00
Lukas Ruzicka bf2f8d7305 Add two more needles for Maps. 2022-12-06 10:45:19 +01:00
Adam Williamson 894cc5072e Update some more maps needles
I think these needles are pretty fragile to changes in the
underlying OSM dataset, not just in Maps itself...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-05 17:54:56 -08:00
Adam Williamson 9b97028a25 Update the Maps 'found Scarborough' needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-05 10:07:50 -08:00
Adam Williamson 7a25ad7023 Add a variant nautilus app needle for F36 (respin tests)
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-11-29 09:48:35 -08:00
Lukas Ruzicka d4717ff090 Create test suite for Maps. 2022-11-21 18:17:11 +00:00
Adam Williamson bc20fc9147 Misc needle updates for Rawhide
The Rawhide 'accept fate' text seems to have lost its Japanese
translation for some reason (I think the string might have had
a terminating period removed). And in one test, the "Extract"
menu item in Archiver was pre-highlighted so the needle didn't
match. Not sure why, but this doesn't seem like a problem, so
let's just handle it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-11-17 10:32:39 -08:00
Adam Williamson 90f7d513a3 Remove an unneeded needle caused by merge order
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-11-04 11:03:35 -07:00
Adam Williamson 5686285b9b Update gnome-text-editor side panel needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-11-02 11:08:55 -07:00
Adam Williamson c5ef5f93db Add F36 versions of several GNOME app needles
This is for F36 live respin testing. Several tests still need
more.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-11-02 11:07:34 -07:00
Adam Williamson 82588f4a52 Revert GTK focus bug workarounds
This reverts the last few commits which worked around a focus bug
in GTK. This bug is now (I hope) fixed, so I'm dropping the
workarounds so the tests will confirm whether it's fixed.
2022-11-02 11:03:02 -07:00
Lukas Ruzicka c394603058 Make an extra click into the the list view to force correct focus. 2022-11-01 17:35:23 +01:00
Lukas Ruzicka 7fb70a9926 Add new needles to cope with new weather conditions on weather tests. 2022-10-24 12:25:36 +02:00
Adam Williamson ebe42ef1e3 Add a system monitor variant needle for ARM
Different filesystems on ARM as it's a UEFI install.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-10-21 09:08:08 -07:00
Lukáš Růžička 5ea921b17b Create tests for Gnome Contacts. 2022-10-18 14:22:52 -07:00
Lukas Ruzicka 5d3fc244eb Create the test for system monitor. 2022-10-10 15:14:21 +02:00
Adam Williamson 79d14edfe9 Add another weather variant needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-10-05 18:15:43 +02:00
Lukáš Růžička c4443b0298 Add a needle to cope with a changed design. 2022-09-27 10:47:08 +02:00
Lukas Ruzicka ba0062e5be Create a test case for Archiver. 2022-09-22 08:59:07 +02:00
Adam Williamson 3c209fe1e8 Update some GNOME needles for minor changes in 43.0
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-09-20 16:22:36 -07:00
Adam Williamson 7c205c11db Update Weather app needles some more
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-09-20 16:20:18 -07:00
Lukas Ruzicka 4c03c0d814 Fix the Silverblue failure on new_file test. 2022-09-20 17:25:54 +02:00
Lukas Ruzicka 12c00f96d7 Delete needles that confused the test by providing an alternative match. 2022-09-12 12:54:09 +02:00
Adam Williamson 72f9e0e448 Add another variant needle for Weather
Caught another time of day where none of the existing 'hourly'
needles matches.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-09-08 15:05:49 -07:00