1
0
mirror of https://pagure.io/fedora-qa/os-autoinst-distri-fedora.git synced 2024-12-27 04:33:09 +00:00
Commit Graph

365 Commits

Author SHA1 Message Date
Adam Williamson
894cc5072e Update some more maps needles
I think these needles are pretty fragile to changes in the
underlying OSM dataset, not just in Maps itself...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-05 17:54:56 -08:00
Adam Williamson
9b97028a25 Update the Maps 'found Scarborough' needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-12-05 10:07:50 -08:00
Adam Williamson
7a25ad7023 Add a variant nautilus app needle for F36 (respin tests)
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-11-29 09:48:35 -08:00
Lukas Ruzicka
d4717ff090 Create test suite for Maps. 2022-11-21 18:17:11 +00:00
Adam Williamson
bc20fc9147 Misc needle updates for Rawhide
The Rawhide 'accept fate' text seems to have lost its Japanese
translation for some reason (I think the string might have had
a terminating period removed). And in one test, the "Extract"
menu item in Archiver was pre-highlighted so the needle didn't
match. Not sure why, but this doesn't seem like a problem, so
let's just handle it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-11-17 10:32:39 -08:00
Adam Williamson
90f7d513a3 Remove an unneeded needle caused by merge order
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-11-04 11:03:35 -07:00
Adam Williamson
5686285b9b Update gnome-text-editor side panel needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-11-02 11:08:55 -07:00
Adam Williamson
c5ef5f93db Add F36 versions of several GNOME app needles
This is for F36 live respin testing. Several tests still need
more.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-11-02 11:07:34 -07:00
Adam Williamson
82588f4a52 Revert GTK focus bug workarounds
This reverts the last few commits which worked around a focus bug
in GTK. This bug is now (I hope) fixed, so I'm dropping the
workarounds so the tests will confirm whether it's fixed.
2022-11-02 11:03:02 -07:00
Lukas Ruzicka
c394603058 Make an extra click into the the list view to force correct focus. 2022-11-01 17:35:23 +01:00
Lukas Ruzicka
7fb70a9926 Add new needles to cope with new weather conditions on weather tests. 2022-10-24 12:25:36 +02:00
Adam Williamson
ebe42ef1e3 Add a system monitor variant needle for ARM
Different filesystems on ARM as it's a UEFI install.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-10-21 09:08:08 -07:00
Lukáš Růžička
5ea921b17b Create tests for Gnome Contacts. 2022-10-18 14:22:52 -07:00
Lukas Ruzicka
5d3fc244eb Create the test for system monitor. 2022-10-10 15:14:21 +02:00
Adam Williamson
79d14edfe9 Add another weather variant needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-10-05 18:15:43 +02:00
Lukáš Růžička
c4443b0298 Add a needle to cope with a changed design. 2022-09-27 10:47:08 +02:00
Lukas Ruzicka
ba0062e5be Create a test case for Archiver. 2022-09-22 08:59:07 +02:00
Adam Williamson
3c209fe1e8 Update some GNOME needles for minor changes in 43.0
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-09-20 16:22:36 -07:00
Adam Williamson
7c205c11db Update Weather app needles some more
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-09-20 16:20:18 -07:00
Lukas Ruzicka
4c03c0d814 Fix the Silverblue failure on new_file test. 2022-09-20 17:25:54 +02:00
Lukas Ruzicka
12c00f96d7 Delete needles that confused the test by providing an alternative match. 2022-09-12 12:54:09 +02:00
Adam Williamson
72f9e0e448 Add another variant needle for Weather
Caught another time of day where none of the existing 'hourly'
needles matches.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-09-08 15:05:49 -07:00
Adam Williamson
1d395ad262 Update some nautilus needles and a test for 43-rc changes
We need to do Restore from the context menu now, because the
special button bar thing went away:
https://gitlab.gnome.org/GNOME/nautilus/-/merge_requests/943

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-09-08 15:05:04 -07:00
Adam Williamson
a58f98cc14 Update some Calculator needles for 43-rc changes
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-09-08 15:00:07 -07:00
Adam Williamson
cc7387fbe1 Update apps_run_maps needle
Just a slight change here.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-09-04 08:40:44 -07:00
Adam Williamson
b71046eac0 Update the weather hourly 'later' needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-08-21 00:00:55 -04:00
Adam Williamson
8f75386838 More GTK4 needle updates
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-08-18 10:09:49 -04:00
Adam Williamson
79cad84bc3 Update needles for GTK4 changes (mainly hinting enabled)
GTK4 enabled font hinting recently, and that breaks this huge pile
of needles.

There are probably a few more that need doing, but it's 2am and
I've had enough.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-08-18 02:09:44 -04:00
Adam Williamson
6486a33006 Revert "Add missing needles to support Clocks test."
This reverts commit 31987c7688. I
already pushed an equivalent commit earlier.
2022-08-16 15:39:15 -04:00
Lukas Ruzicka
31987c7688 Add missing needles to support Clocks test. 2022-08-16 16:27:32 +02:00
Adam Williamson
2bfe0f53cd Add another weather icon (large sun and cloud)
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-08-16 10:10:06 -04:00
Adam Williamson
8b8108f051 Update more Clocks needles
Lukas left these lying around stg, they are needed.
clocks_alarm_cross_remove is a dupe of gnome_button_cross_remove
with a bad name, so removed it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-08-16 09:31:35 -04:00
Adam Williamson
581180c19c Remove nautilus context menu star needles
We already changed how we do this since the context menu entry
was removed, just cleaning up the now-unneeded needles.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-08-16 08:56:38 -04:00
Adam Williamson
d2afd6f627 Correct tag on recently-added apps_run_logs needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-08-16 08:56:13 -04:00
Adam Williamson
8479cb979f Remove nautilus side panel test and associated needles
The show/hide side panel functionality was intentionally removed
in version 43-beta:

https://gitlab.gnome.org/GNOME/nautilus/-/issues/2427

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-08-16 08:53:42 -04:00
Lukas Ruzicka
c8816f6435 Add new needles to cover the Menu changes. 2022-08-15 22:26:32 -04:00
Adam Williamson
5e1b918775 Add another weather icon - sun and cloud (small)
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-08-15 22:22:57 -04:00
Adam Williamson
321e09a396 Add variant nautilus star selected file needle
The star looks a little different. Not sure if this is just a
new look or what.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-08-15 22:20:16 -04:00
Lukas Ruzicka
e69ba53f51 Fix the Clocks test to work on Fedora 37. 2022-08-15 16:47:46 +02:00
Lukas Ruzicka
decbe662c5 Add needle to cover for Logs test. 2022-08-11 13:58:25 -07:00
Adam Williamson
0c3b8c1ff3 Update nautilus needles
This was meant to be in the previous commit, but I forgot.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-08-11 09:41:13 -07:00
Adam Williamson
1d1ffa0203 Update Calculator credits shown needle for 43
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-08-11 08:58:59 -07:00
Adam Williamson
e2e8fcadd4 Rationalize GNOME credit button handling
We had a ton of needles all covering something very similar
(press a "Credits" button in a GNOME app). There are about four
real variations: old-style regular face white-on-black (eog),
old-style regular face (nautilus and evince before recent
libadwaita ports), old-style bold face (GTE and Clocks before
new libadwaita), and new-style (everything that's been ported
to use libadwaita for its About page). Let's just rationalize
it down to those, using the same needle tag for all of them.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-08-08 18:24:57 -07:00
Lukáš Růžička
9e0ec721a6 Create a new test for Gnome Weather 2022-08-08 18:24:51 -07:00
Adam Williamson
3cb6b5899a Remove a script file I used for the calculator needle thing
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-08-08 17:43:39 -07:00
Adam Williamson
87ad2fb63e Add (back) old calculator button needles for Silverblue/flatpak
Silverblue has Calculator as an older-versioned flatpak, so it
still looks like it did in GNOME 42 (blue equals button, lighter
colored number buttons).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-08-08 17:34:32 -07:00
Adam Williamson
1154a2b739 Update a bunch of GNOME needles for libadwaita font color change
Text on some dialogs is now dark grey instead of black.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-08-08 11:07:42 -07:00
Lukáš Růžička
c40a35ea62 Add a new test for Calculator. 2022-08-05 11:34:22 -07:00
Adam Williamson
6f6ca81e95 Update a bunch of GNOME needles for GNOME 43 alpha
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-07-28 16:33:34 -07:00
Adam Williamson
406b99eaed Add some variant needles for F36 respin testing
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-07-28 16:29:58 -07:00
Adam Williamson
8bec03edd7 Drop needles for check removed in previous commit
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-07-25 16:45:17 -07:00
Adam Williamson
9495cfb1ff Update nautilus tests and needles for 43~alpha
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-07-22 17:24:43 -07:00
Adam Williamson
84c6e18f14 Reduce duplication of nautilus Documents directory needles
We had three. We only need one, matching on the sidebar entry,
which should be always visible.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-07-22 17:17:59 -07:00
Adam Williamson
3274d29137 Update gnome-text-editor new document needle
Not sure exactly what changed, some kinda UI label tweak.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-07-20 09:34:55 -07:00
Adam Williamson
66f4ad296a Lower match level on clocks_timer_finished needle
We got a 95% match in the F36 respin test.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-07-15 11:07:46 -07:00
Lukáš Růžička
48ec73e814 Create a test suite for Nautilus. 2022-07-12 16:01:36 -07:00
Lukáš Růžička
1f8b56e068 Change the way to download test data.
This PR changes the way to download the test data into the VM.
Although it does not use a disk image as suggested in one
of the review, it does not clone the entire repository, but
a simple tar.gz file that holds the data which will be
distributed into the directory structure.

This way, the amount of data needed to be downloaded dropped
from approximately 50MB to below 2MB.

Also, the existing test suites were adapted to this situation.
2022-07-04 09:34:04 +02:00
Lukáš Růžička
7c1e686d14 Create tests for Help. 2022-06-29 23:06:37 +00:00
Lukáš Růžička
6f00e3fe8a Create tests for Clocks. 2022-06-23 21:41:56 +00:00
Adam Williamson
1d76c12584 Add Arabic gnome-terminal needle
For the i18n fonts test, this was missing from the PR.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-27 11:58:43 -07:00
Adam Williamson
2d4d6ae8f2 Rename needles from i18n fonts test
Just giving them names that kinda explains why they exist.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-26 08:41:01 -07:00
Lukáš Růžička
1acef21fa5 Automate the i18n_default_fonts testcase for Japanese.
This is the automation of the optional testcase https://fedoraproject.org/wiki/QA:Testcase_i18n_default_fonts.
The test implementation runs the same commands as the mentioned test
case and checks the expected output. It is designed to run in the scope
of postinstall tests when the language is set to "japanese".
2022-05-26 09:54:38 +02:00
Adam Williamson
f6f9ae58e6 Update gnome-text-editor dark style needle for current highlight
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-17 16:21:57 -07:00
Lukáš Růžička
29d69d1de1 Delete unusued needles that prevent branches from passing tests. 2022-05-12 09:09:42 +02:00
Adam Williamson
f7d1fe8ccd Update gte_text_replaced needle for different underlining
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-11 16:25:19 -07:00
Lukáš Růžička
aa448d48bc Reupload the needle again, as I sent an incorrect file before. 2022-04-25 14:10:08 +02:00
Lukáš Růžička
bcf46f0cd0 Fix failing Gnome Text Editor needle. 2022-04-25 13:07:49 +02:00
Adam Williamson
cb3de66b8d Update gnome-text-editor needles for latest Rawhide
Seems like text rendering changed slightly.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-04-21 08:25:10 -07:00
Adam Williamson
8bb5aef223 Update an eog needle for flatpak dialog change
Again, a dialog changed a bit in the flatpak version of the app.
For this needle, the shade of grey is slightly different. Change
happened between Fedora-36-20220314.n.0 and 20220315.n.0.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-17 13:42:11 -07:00
Adam Williamson
47e90c9010 Add variant needles for current Flatpak open/save dialogs
The open/save dialogs for Flatpak apps in current F36 (and
probably Rawhide, but can't tell due to another bug) look a bit
odd: https://github.com/fedora-silverblue/issue-tracker/issues/245
This adds variant needles to handle various differences there.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-17 13:23:35 -07:00
Adam Williamson
66b111cecc Update gnome-text-editor needles for F36 upgrade test
For some reason various bits of gte started looking slightly
different on the F36 upgrade test. I don't really know why and
don't care enough to look it up. I'm just hoping all these
variations between gte running in slightly different contexts
calm down soon...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-17 12:37:34 -07:00
Adam Williamson
f1c44aa1e7 Update GTE preferences_off needle for Rawhide/F36
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-10 17:06:26 -08:00
Adam Williamson
50db12402c Add needles for old flatpak gnome-text-editor
Silverblue has an older version of gnome-text-editor, using a
Flatpak base environment built off an older GNOME. Because of
this most of the needles for the current RPM-packaged version
don't match. For some reason the old needles we delete don't
match either - some difference in font rendering configuration
or something. So I had to create a bunch of new needles.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-07 16:00:45 -08:00
Adam Williamson
f4bc90e681 Tweak the gte_preferences_off needle click point
I did this by hand and I think 20 pixels is a bit too much.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-07 15:03:05 -08:00
Adam Williamson
0a80004f3e Make gte_preferences_off needle more specific
It matches on the "close the app" button on older Flatpak GTE.
So widen the needle to include the "Preferences" text, and add
a click point.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-07 14:47:22 -08:00
Adam Williamson
af69bf1990 Update a few more miscellaneous needles for GNOME 42
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-05 08:48:46 -08:00
Adam Williamson
d28a507078 Reduce match area of gte_credits_shown needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-04 19:29:40 -08:00
Adam Williamson
2da5b6abf4 Complete gnome-text-editor needle update
Just needed a few more.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-04 15:12:02 -08:00
Lukáš Růžička
bd1e7b0295 Big needle recreation for Gnome-Text-Editor 2022-03-04 15:12:57 +01:00
Lukáš Růžička
f1af1bca6e Add newer needle for gnome-text-editor test. 2022-03-04 13:00:34 +01:00
Adam Williamson
1493cb9aa9 Update app start/stop needles for GNOME 42.beta
These are taken with the latest gnome-shell build, with CSS
fixes for the overview applied. They don't work for current
F36/Rawhide but will work once that gnome-shell build lands.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-01 15:59:57 -08:00
Adam Williamson
10df5a57bf Update a bunch of needles for GNOME and adwaita-icon-theme 42
GNOME 42 and adwaita-icon-theme 42 changed a lot of things in
GNOME and anaconda, we need to update all these needles.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-20 15:52:42 -08:00
Adam Williamson
4282048819 Drop screenshot app from GNOME app start/stop tests
It was removed from the default install:
https://pagure.io/fedora-comps/c/5371509
in favor of a new screenshot mechanism that's built in to GNOME
Shell.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-09 10:23:38 -08:00
Lukáš Růžička
42e9f713b2 Change test suite to fit with the latest known version.
The latest version of Gnome-Text-Editor bring a little
bit different UI and some new or modified features.
This commit fixes the suite to run on newest version.
2022-02-07 10:50:10 +01:00
Lukáš Růžička
222270c3dd Add failing needle for eog. 2022-02-02 12:50:20 +01:00
Lukáš Růžička
ceaf711f76 Create a test suite for Gnome Text Editor 2022-01-29 00:49:10 +00:00
Lukáš Růžička
83356ceec6 Use waiting commands to make the tests more defensive. 2022-01-25 13:36:57 +01:00
Adam Williamson
24e3ecb89f Drop gedit application tests
Workstation has replaced gedit with gnome-text-editor in Rawhide,
so this is no longer useful. We will replace it with a test suite
for gnome-text-editor.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-18 15:52:40 -08:00
Adam Williamson
3ae23f66a9 Update GNOME apps test for gedit->gnome-text-editor switch
Workstation replaced gedit with gnome-text-editor. This updates
the needles and also changes the name used for 'tagging' the
application for the core_applications test.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-18 15:11:50 -08:00
Adam Williamson
c7f5ec6689 Update several GNOME needles for GNOME 42 in Rawhide
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-18 14:13:42 -08:00
Adam Williamson
d19b7f6890 Update some GNOME app needles
Calculator's equals button changed a bit somehow, EOG changed a
button and the kerning on Activities button changed.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-12 15:20:56 -08:00
Adam Williamson
5d10fae391 Update a couple of EOG needles with minor changes
Slight spacing changes is all.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-12-14 09:58:49 -08:00
Lukáš Růžička
cda0d0b0d1 Create a test suite for EoG (Image Viewer) 2021-11-18 13:13:59 -08:00
Adam Williamson
6aa41f038c Update a bunch of needles for font rendering changes
Seems like the new Pango changed font rendering in quite a lot
of places.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-12 15:48:05 -08:00
Adam Williamson
07ff387293 Drop match level on an Evince needle a bit
96% match with today's Rawhide, don't feel like a new needle.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-12 13:20:11 -08:00
Adam Williamson
323c6a0a45 Drop match level on a gedit needle a bit
We get a 96% match on this because the "A" in "Activities" moved
a bit. Instead of a new needle let's just be OK with the lower
match.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-12 12:07:58 -08:00
Adam Williamson
a5bf0a6aae Tighten match area on evince_file_select_pdf
So it doesn't fail if there's a dotted line around the entry
(indicating keyboard active, I think).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-12 11:55:40 -08:00
Adam Williamson
7a6f15fa6c Update several gedit app needles for today's Rawhide
Not sure what caused it, but line spacing seems to have changed
slightly in today's Rawhide.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-09 15:56:24 -08:00
Lukáš Růžička
cda2e902fa Fix the typo in the name. 2021-10-15 12:38:20 +02:00
Lukáš Růžička
243c1916d2 Add new weather needle to reflect when location is already set. 2021-10-15 12:36:13 +02:00
Lukáš Růžička
e519786e91 Fix the rotation test by using a keyboard shortcut. 2021-10-15 12:01:46 +02:00
Adam Williamson
e1e9f64036 Update various needles for icon theme changes
Some changes were made in the icon theme used by the installer
and GNOME, update various needles for this.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-16 14:05:09 -07:00
Adam Williamson
f012df5e86 Adjust match area on Evince 'run' needle
Similar to the 'open' needle, adjust match area to work even
when there's a notification obscuring the top bar.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-03 16:53:43 -07:00
Adam Williamson
02c47efab4 Reduce match area on Evince open needle
This will make it match even when partially obscured by a
notification, as in https://openqa.fedoraproject.org/tests/967109

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-02 15:28:52 -07:00
Adam Williamson
67d587cb51 Update GNOME libreoffice impress start needle for new LO
We do this slightly differently on KDE and GNOME for whatever
reason, so this needle needs updating too.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-27 17:20:48 -07:00
Adam Williamson
a5ea81103e Update a few needles for changes in today's Rawhide/F35
LibreOffice adjusted layout a bit and dropped a template, one
icon changed in the utilities menu compilation.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-25 16:00:00 -07:00
Adam Williamson
d47dfe7f7a Update Utilities app menu needle for some change in F35
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-19 13:59:51 -07:00
Adam Williamson
2ed23740d4 A few misc needle updates
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-18 14:02:27 -07:00
Lukáš Růžička
b65f470eee Create basic functions tests for Gedit. 2021-08-12 15:37:37 +02:00
Adam Williamson
492fcf62e4 Great Needle Cleanup 2021
Remove a whole chunk of needles that haven't matched for more
than 3 months. Also move a few needles to appropriate locations,
simplify some code chunks that relied on removed needles (if
we're not matching the needles, we don't need those chunks any
more), and drop some other no-longer-needed conditionals for
older releases.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-10 11:57:48 -07:00
Adam Williamson
7d14da3746 Bring back the older Evince 'rotate' needle
Current Silverblue still has it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-29 12:10:31 -07:00
Adam Williamson
5b1d3517fe Open Documents folder on Silverblue
The open dialog on Silverblue (which is apparently not at all
the same thing as the open dialog on Workstation, though they
look the same) does not default to the Documents folder, so we
have to open it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-29 12:09:34 -07:00
Adam Williamson
5905546f6e Update Evince needles
These all failed to match first time the test was run in
production. I guess Lukas was working from an older release.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-29 11:46:32 -07:00
Lukáš Růžička
e0d9409c74 Create a test suite for Evince.
This PR fixes issue . It adds a test suite to test basic
functionality of Evince and brings the following features:

* test scripts for various Evince functions.
* needles to support the Evince test scripts
* new template variables `TESTPATH` and `POSTINSTALL_LOAD_ALL` (see
  below)
* new logic in `main.py` (see below)

The new variables and the new logic make it easier to create test
suites for post-installation tests. If TESTPATH is used, OpenQA
will take all tests mentioned in POSTINSTALL from that specified
TESTPATH. If both TESTPATH and POSTINSTALL_LOAD_ALL are used, then
OpenQA will run all tests it can find at the TESTPATH location.
If POSTINSTALL and POSTINSTALL_LOAD_ALL are set simultaneously,
then only POSTINSTALL will be taken into account and OpenQA will
only load tests mentioned there.
2021-07-28 08:58:23 +02:00
Adam Williamson
2a7787c1da Update lots of needles for os-autoinst behaviour change
Recent git os-autoinst no longer downsamples screenshots as far
as it did before comparison. This makes a lot of needles where
colors have changed slightly no longer match, so they all needed
updating.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-19 13:03:11 -07:00
Adam Williamson
1b28976f49 Update several GNOME app test needles
Not sure why these changed, but oh well. Utilities menu was
highlighted in a test run for some reason, so let's just handle
that. Other needles changed very slightly.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-05-14 14:26:10 -07:00
Adam Williamson
de87c3f28e Update gedit needle for recent change
It now calls new files "Untitled File", not "Untitled Document".

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-04-01 15:46:34 -07:00
Adam Williamson
29f75788e9 Update a bunch of GNOME app needles for GNOME 40 final
Some apps moved around, others the needles stopped matching for
some reason, some kind of slight scale change or something.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-24 18:36:38 -07:00
Adam Williamson
ac9edb4cfb GNOME apps: drop Archiver test
The app was dropped from Workstation's default package set a few
days ago. See:
https://pagure.io/fedora-workstation/issue/167

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-05 18:25:29 -08:00
Adam Williamson
51341dc2ff Update several GNOME app needles for overview change
The icons in the dash got a bit smaller again, so all these
needles need updating.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-03 18:59:16 -08:00
Adam Williamson
6658740b2a Update the GNOME app run test needles for GNOME 40
Overview changed a lot, so all these needles need updating.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-22 17:04:22 -08:00
Adam Williamson
aebabc706e Update some GNOME-related needles for changes in GNOME 40
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-04 14:06:11 -08:00
Adam Williamson
179ab45bca Update various needles for GNOME down caret changing a bit
This affected apps_run_terminal and a ton of layout needles.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-01-25 16:27:39 -08:00
Adam Williamson
d065974cc6 apps_run_terminal: match window area too
Just matching the Overview entry isn't really enough, the app
hasn't really run yet. This makes the test more robust and also
helps out on aarch64 desktop tests where the app window takes a
long time to appear.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-12-04 11:55:36 -08:00
Adam Williamson
fde492aa5d Update a few desktop needles
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-11-10 13:00:46 -08:00
Adam Williamson
fba3a3a290 Update Cheese and Videos app needles, icons changed
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-09-18 13:40:23 -07:00
Adam Williamson
b117d16133 Update GNOME Calculator app needle
Icon no longer has labels on the calculator buttons.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-08-18 17:04:20 -07:00
Adam Williamson
160602d8af Update a bunch of GNOME app test needles for latest Shell
Latest Shell changes how the icons look a bit, again.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-07-09 16:24:29 -07:00
Adam Williamson
0cea4b1cd5 Update Screenshot app needle
Button turned blue!

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-06-17 17:34:43 -07:00
Adam Williamson
87af7d4ecd Update GNOME app needles for GNOME 3.37.2
Not sure if the needles changed or just the way they're rendered
in the overview, but either way, we need to update a bunch.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-06-05 16:07:25 -07:00
Adam Williamson
2e21161785 Update various needles for a GNOME symbol change
The little triangle that's used on drop-down menus and stuff got
bigger. That breaks all these needles.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-06-05 14:27:34 -07:00
Adam Williamson
417b876ead Add F31 variant Terminal app run needle
Needed for F31 respin tests.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-04-14 12:12:57 -07:00
Adam Williamson
21eea18562 Add a needle check script, remove some unused needles
I call this...The @lruzicka Catcher!

It's a script that checks for needles that aren't actually used
anywhere. It also checks for cases where we have a needle JSON
file but no image, or an image file but no JSON file (and wipes
one case of the latter). It also adds a run of the script to tox
so we get it in CI.

You could make this script a lot more elaborate if you like, by
being fancier about parsing the test code and templates, but I
don't think it's really warranted, I think it just needs to be
'good enough'. It's not the end of the world if it misses the
odd thing or the whitelisting goes stale.

Quite a lot of the removed needles are remnants of different
approaches to app start/stop testing which weren't caught in the
initial PR review. The short-name partitioning ones are odd; they
were introduced in the commit that moved needles into subdirs,
but at least some of them don't actually appear to be moves. They
may have been non-tracked files Josef had lying around that got
into the commit by mistake, or they may just be old needles we
really used at some point but aren't using any more.
reclaim_space_second_partition was introduced as part of the
shrink test (along with reclaim_space_first_partition) but was
never actually used by that test - I guess, again, the test got
re-written during review but we forgot to remove the needle. We
rejigged user creation to use tab presses not a needle match a
while back, which made user_creation_password_input unnecessary.
The various cockpit_updates_* needles are I think remnants of
rewrites of the cockpit update tests that again were missed in
PR review, the tests as merged never used them.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-04-08 16:55:46 -07:00
Adam Williamson
8b5be61971 Update a few GNOME app needles that seem to have changed
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-04-02 20:27:01 -07:00
Adam Williamson
dc7b7a7241 Great Needle Cleanup 2020
Remove a bunch of needles that have not been used for some time,
plus a few workarounds that are similarly stale.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-03-20 14:02:10 -07:00
Lukáš Růžička
d19cf9553e Reneedle the Gnome Application StartStop tests. 2020-03-18 18:06:34 +01:00
Adam Williamson
28642f4002 Move a stray app needle to the right place
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-01-17 15:19:17 +00:00
Adam Williamson
8612858b1f Second batch of Cantarell needles: GNOME apps tests
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-01-17 15:18:50 +00:00
Adam Williamson
e3430e82ef Update Rhythmbox app needle
The icon changed, so the needle needs changing.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-01-06 12:32:44 -08:00
Adam Williamson
5c03c435ca Stop having two 'firefox close tabs' needle tags, drop old ones
We still have a 'apps_run_firefox_stop' needle tag which is for
the same thing as 'firefox_close_tabs'. That's dumb. Get rid of
it and only have the firefox_close_tabs tag and needles. Also
clean up some old firefox_close_tabs needles that haven't matched
for months and all the 'apps_run_firefox_stop' needles.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-11-29 12:10:35 -08:00
Adam Williamson
4bb89046d3 Add one more updated GNOME app test needle
'Simple Scan' renamed itself.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-08-26 17:51:20 -07:00
Adam Williamson
28443abf04 Add new variants for GNOME app start/stop tests
Several apps changed icon.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-08-26 16:29:37 -07:00
Adam Williamson
be12f07900 GNOME apps: dismiss new LibreOffice 'tip of the day' if it shows
Also add a new needle for Impress startup.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-07-23 20:15:24 -07:00
Adam Williamson
bc2add845e Add the settings needle that provides the 'workspace' tag back
Removing this broke the GNOME apps test entirely because there
was no GNOME 'workspace' needle any more.

I don't like this needle much, we should probably use
check_desktop_clean or something instead. But for now let's just
put it back.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-25 14:16:11 -07:00
Adam Williamson
6656f1659d apps_activities is a dupe with overview_app_grid, kill it
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-25 14:01:39 -07:00
Lukas Ruzicka
9e3b16bfcf Change Settings test due to change functionality. 2019-06-21 14:54:18 +02:00
Lukas Ruzicka
868fca87b3 Add new needle for Simple Scan Menu item. 2019-06-21 11:33:12 +02:00
Adam Williamson
bad3263160 Update ABRT app launcher needle
Icon was changed.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-05-27 17:51:27 -07:00
Adam Williamson
d30714dbca Add a variant apps_stop needle for Firefox 66 without header
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-04-17 12:30:11 -07:00
Adam Williamson
e744cea358 Update GNOME apps needles for cheese and scan
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-04-16 18:46:31 -07:00
Lukas Ruzicka
9a2d9ea190 Create needles needed for firefox test to really work. 2019-03-28 14:18:51 +01:00
Adam Williamson
5a1a71c67f Use the existing 'oh hai this is firefox' needle for app tests
The KDE and GNOME 'apps' tests for Firefox both invented their
own 'oh look Firefox is running' needle, even though we already
had one. The GNOME one was broken by the removal of the app
title bar in Firefox 66.

Instead of having three needles for the same thing, let's just
throw the 'apps' ones out and use the pre-existing one from
needles/firefox for all cases.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-03-26 12:23:45 -07:00
Adam Williamson
26cdcb8d3c Add several new needles for changed GNOME app icons
Utilities came up different *again* in a Rawhide test today, so
this adds a needle which matches on the text. Usually we prefer
image matches to text, but this image seems to keep changing...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-03-20 12:21:55 -07:00
Adam Williamson
0365e2f18d Add another utilities needle variant
Dunno why we need yet *another*, but even the new one didn't
match on the most recent Branched compose. For now just add
another, we can look in a few weeks which can be thrown away.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-03-19 10:13:44 -07:00
Adam Williamson
1ed87382a9 abrt back under utilities, drop sundry
As of Fedora-30-20190316.n.1, gnome-abrt is back under the
Utilities menu and the 'Sundry' menu seems to have disappeared.
Change the test back to using utilities and drop the sundry
needle.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-03-19 10:11:32 -07:00
Lukas Ruzicka
bbb2ac06b8 Add new needle to cover changed utilities. 2019-03-18 15:27:44 +01:00
Adam Williamson
072333a0f7 Update needle for apps 'System Monitor'
Icon changed.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-02-25 11:30:19 -08:00
Lukas Ruzicka
690788f107 Reneedle the test suite
This is another take of needles to make the suite work again.
2019-02-21 12:29:36 +01:00
Lukas Ruzicka
1e8834825d Add new set of needles (first run)
These needles fix the test suite after the looks has been changed.
2019-02-20 15:52:38 +01:00
Lukas Ruzicka
be3aadc249 Change the target of the needle for Clocks in StartStop test
The needle could sometimes fail because the item it was looking
for only appeared in a limited set of situations. The new
location should be safer to check and the test should not
fail as a result.
2019-01-29 10:48:28 +01:00
Lukas Ruzicka
83ff7a0679 Delete Evolution needles.
Evolution has been removed from the default installation of Workstation
so the test is no more needed.
2019-01-28 14:54:58 +01:00
Lukas Ruzicka
4288041889 Use the current date instead f30 as a filename for new needles. 2019-01-28 14:53:59 +01:00
Lukas Ruzicka
e72a800fd1 Add new needles.
This commit adds new needles to reflect the changes which
have been made to the Desktop. It also now FIXES .
2019-01-28 11:11:36 +01:00
Lukas Ruzicka
c97c23d485 Recreate needles to make them check different area.
This commit adjusts the area that needles look for to avoid checking
based on a menu item that has disappeared from the system.
2019-01-28 11:11:36 +01:00
Lukas Ruzicka
39d3427471 Create a test suite for application start stop testing.
Merges 
Fixes 
2019-01-04 15:23:03 -08:00