1
0
mirror of https://pagure.io/fedora-qa/os-autoinst-distri-fedora.git synced 2024-11-04 23:24:21 +00:00
Commit Graph

233 Commits

Author SHA1 Message Date
Adam Williamson
4282048819 Drop screenshot app from GNOME app start/stop tests
It was removed from the default install:
https://pagure.io/fedora-comps/c/5371509
in favor of a new screenshot mechanism that's built in to GNOME
Shell.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-09 10:23:38 -08:00
Lukáš Růžička
42e9f713b2 Change test suite to fit with the latest known version.
The latest version of Gnome-Text-Editor bring a little
bit different UI and some new or modified features.
This commit fixes the suite to run on newest version.
2022-02-07 10:50:10 +01:00
Lukáš Růžička
222270c3dd Add failing needle for eog. 2022-02-02 12:50:20 +01:00
Lukáš Růžička
ceaf711f76 Create a test suite for Gnome Text Editor 2022-01-29 00:49:10 +00:00
Lukáš Růžička
83356ceec6 Use waiting commands to make the tests more defensive. 2022-01-25 13:36:57 +01:00
Adam Williamson
24e3ecb89f Drop gedit application tests
Workstation has replaced gedit with gnome-text-editor in Rawhide,
so this is no longer useful. We will replace it with a test suite
for gnome-text-editor.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-18 15:52:40 -08:00
Adam Williamson
3ae23f66a9 Update GNOME apps test for gedit->gnome-text-editor switch
Workstation replaced gedit with gnome-text-editor. This updates
the needles and also changes the name used for 'tagging' the
application for the core_applications test.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-18 15:11:50 -08:00
Adam Williamson
c7f5ec6689 Update several GNOME needles for GNOME 42 in Rawhide
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-18 14:13:42 -08:00
Adam Williamson
d19b7f6890 Update some GNOME app needles
Calculator's equals button changed a bit somehow, EOG changed a
button and the kerning on Activities button changed.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-12 15:20:56 -08:00
Adam Williamson
5d10fae391 Update a couple of EOG needles with minor changes
Slight spacing changes is all.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-12-14 09:58:49 -08:00
Lukáš Růžička
cda0d0b0d1 Create a test suite for EoG (Image Viewer) 2021-11-18 13:13:59 -08:00
Adam Williamson
6aa41f038c Update a bunch of needles for font rendering changes
Seems like the new Pango changed font rendering in quite a lot
of places.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-12 15:48:05 -08:00
Adam Williamson
07ff387293 Drop match level on an Evince needle a bit
96% match with today's Rawhide, don't feel like a new needle.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-12 13:20:11 -08:00
Adam Williamson
323c6a0a45 Drop match level on a gedit needle a bit
We get a 96% match on this because the "A" in "Activities" moved
a bit. Instead of a new needle let's just be OK with the lower
match.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-12 12:07:58 -08:00
Adam Williamson
a5bf0a6aae Tighten match area on evince_file_select_pdf
So it doesn't fail if there's a dotted line around the entry
(indicating keyboard active, I think).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-12 11:55:40 -08:00
Adam Williamson
7a6f15fa6c Update several gedit app needles for today's Rawhide
Not sure what caused it, but line spacing seems to have changed
slightly in today's Rawhide.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-09 15:56:24 -08:00
Lukáš Růžička
cda2e902fa Fix the typo in the name. 2021-10-15 12:38:20 +02:00
Lukáš Růžička
243c1916d2 Add new weather needle to reflect when location is already set. 2021-10-15 12:36:13 +02:00
Lukáš Růžička
e519786e91 Fix the rotation test by using a keyboard shortcut. 2021-10-15 12:01:46 +02:00
Adam Williamson
e1e9f64036 Update various needles for icon theme changes
Some changes were made in the icon theme used by the installer
and GNOME, update various needles for this.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-16 14:05:09 -07:00
Adam Williamson
f012df5e86 Adjust match area on Evince 'run' needle
Similar to the 'open' needle, adjust match area to work even
when there's a notification obscuring the top bar.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-03 16:53:43 -07:00
Adam Williamson
02c47efab4 Reduce match area on Evince open needle
This will make it match even when partially obscured by a
notification, as in https://openqa.fedoraproject.org/tests/967109

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-02 15:28:52 -07:00
Adam Williamson
67d587cb51 Update GNOME libreoffice impress start needle for new LO
We do this slightly differently on KDE and GNOME for whatever
reason, so this needle needs updating too.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-27 17:20:48 -07:00
Adam Williamson
a5ea81103e Update a few needles for changes in today's Rawhide/F35
LibreOffice adjusted layout a bit and dropped a template, one
icon changed in the utilities menu compilation.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-25 16:00:00 -07:00
Adam Williamson
d47dfe7f7a Update Utilities app menu needle for some change in F35
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-19 13:59:51 -07:00
Adam Williamson
2ed23740d4 A few misc needle updates
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-18 14:02:27 -07:00
Lukáš Růžička
b65f470eee Create basic functions tests for Gedit. 2021-08-12 15:37:37 +02:00
Adam Williamson
492fcf62e4 Great Needle Cleanup 2021
Remove a whole chunk of needles that haven't matched for more
than 3 months. Also move a few needles to appropriate locations,
simplify some code chunks that relied on removed needles (if
we're not matching the needles, we don't need those chunks any
more), and drop some other no-longer-needed conditionals for
older releases.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-10 11:57:48 -07:00
Adam Williamson
7d14da3746 Bring back the older Evince 'rotate' needle
Current Silverblue still has it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-29 12:10:31 -07:00
Adam Williamson
5b1d3517fe Open Documents folder on Silverblue
The open dialog on Silverblue (which is apparently not at all
the same thing as the open dialog on Workstation, though they
look the same) does not default to the Documents folder, so we
have to open it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-29 12:09:34 -07:00
Adam Williamson
5905546f6e Update Evince needles
These all failed to match first time the test was run in
production. I guess Lukas was working from an older release.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-29 11:46:32 -07:00
Lukáš Růžička
e0d9409c74 Create a test suite for Evince.
This PR fixes issue #188. It adds a test suite to test basic
functionality of Evince and brings the following features:

* test scripts for various Evince functions.
* needles to support the Evince test scripts
* new template variables `TESTPATH` and `POSTINSTALL_LOAD_ALL` (see
  below)
* new logic in `main.py` (see below)

The new variables and the new logic make it easier to create test
suites for post-installation tests. If TESTPATH is used, OpenQA
will take all tests mentioned in POSTINSTALL from that specified
TESTPATH. If both TESTPATH and POSTINSTALL_LOAD_ALL are used, then
OpenQA will run all tests it can find at the TESTPATH location.
If POSTINSTALL and POSTINSTALL_LOAD_ALL are set simultaneously,
then only POSTINSTALL will be taken into account and OpenQA will
only load tests mentioned there.
2021-07-28 08:58:23 +02:00
Adam Williamson
2a7787c1da Update lots of needles for os-autoinst behaviour change
Recent git os-autoinst no longer downsamples screenshots as far
as it did before comparison. This makes a lot of needles where
colors have changed slightly no longer match, so they all needed
updating.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-19 13:03:11 -07:00
Adam Williamson
1b28976f49 Update several GNOME app test needles
Not sure why these changed, but oh well. Utilities menu was
highlighted in a test run for some reason, so let's just handle
that. Other needles changed very slightly.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-05-14 14:26:10 -07:00
Adam Williamson
de87c3f28e Update gedit needle for recent change
It now calls new files "Untitled File", not "Untitled Document".

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-04-01 15:46:34 -07:00
Adam Williamson
29f75788e9 Update a bunch of GNOME app needles for GNOME 40 final
Some apps moved around, others the needles stopped matching for
some reason, some kind of slight scale change or something.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-24 18:36:38 -07:00
Adam Williamson
ac9edb4cfb GNOME apps: drop Archiver test
The app was dropped from Workstation's default package set a few
days ago. See:
https://pagure.io/fedora-workstation/issue/167

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-05 18:25:29 -08:00
Adam Williamson
51341dc2ff Update several GNOME app needles for overview change
The icons in the dash got a bit smaller again, so all these
needles need updating.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-03 18:59:16 -08:00
Adam Williamson
6658740b2a Update the GNOME app run test needles for GNOME 40
Overview changed a lot, so all these needles need updating.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-22 17:04:22 -08:00
Adam Williamson
aebabc706e Update some GNOME-related needles for changes in GNOME 40
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-04 14:06:11 -08:00
Adam Williamson
179ab45bca Update various needles for GNOME down caret changing a bit
This affected apps_run_terminal and a ton of layout needles.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-01-25 16:27:39 -08:00
Adam Williamson
d065974cc6 apps_run_terminal: match window area too
Just matching the Overview entry isn't really enough, the app
hasn't really run yet. This makes the test more robust and also
helps out on aarch64 desktop tests where the app window takes a
long time to appear.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-12-04 11:55:36 -08:00
Adam Williamson
fde492aa5d Update a few desktop needles
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-11-10 13:00:46 -08:00
Adam Williamson
fba3a3a290 Update Cheese and Videos app needles, icons changed
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-09-18 13:40:23 -07:00
Adam Williamson
b117d16133 Update GNOME Calculator app needle
Icon no longer has labels on the calculator buttons.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-08-18 17:04:20 -07:00
Adam Williamson
160602d8af Update a bunch of GNOME app test needles for latest Shell
Latest Shell changes how the icons look a bit, again.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-07-09 16:24:29 -07:00
Adam Williamson
0cea4b1cd5 Update Screenshot app needle
Button turned blue!

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-06-17 17:34:43 -07:00
Adam Williamson
87af7d4ecd Update GNOME app needles for GNOME 3.37.2
Not sure if the needles changed or just the way they're rendered
in the overview, but either way, we need to update a bunch.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-06-05 16:07:25 -07:00
Adam Williamson
2e21161785 Update various needles for a GNOME symbol change
The little triangle that's used on drop-down menus and stuff got
bigger. That breaks all these needles.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-06-05 14:27:34 -07:00
Adam Williamson
417b876ead Add F31 variant Terminal app run needle
Needed for F31 respin tests.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-04-14 12:12:57 -07:00
Adam Williamson
21eea18562 Add a needle check script, remove some unused needles
I call this...The @lruzicka Catcher!

It's a script that checks for needles that aren't actually used
anywhere. It also checks for cases where we have a needle JSON
file but no image, or an image file but no JSON file (and wipes
one case of the latter). It also adds a run of the script to tox
so we get it in CI.

You could make this script a lot more elaborate if you like, by
being fancier about parsing the test code and templates, but I
don't think it's really warranted, I think it just needs to be
'good enough'. It's not the end of the world if it misses the
odd thing or the whitelisting goes stale.

Quite a lot of the removed needles are remnants of different
approaches to app start/stop testing which weren't caught in the
initial PR review. The short-name partitioning ones are odd; they
were introduced in the commit that moved needles into subdirs,
but at least some of them don't actually appear to be moves. They
may have been non-tracked files Josef had lying around that got
into the commit by mistake, or they may just be old needles we
really used at some point but aren't using any more.
reclaim_space_second_partition was introduced as part of the
shrink test (along with reclaim_space_first_partition) but was
never actually used by that test - I guess, again, the test got
re-written during review but we forgot to remove the needle. We
rejigged user creation to use tab presses not a needle match a
while back, which made user_creation_password_input unnecessary.
The various cockpit_updates_* needles are I think remnants of
rewrites of the cockpit update tests that again were missed in
PR review, the tests as merged never used them.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-04-08 16:55:46 -07:00
Adam Williamson
8b5be61971 Update a few GNOME app needles that seem to have changed
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-04-02 20:27:01 -07:00
Adam Williamson
dc7b7a7241 Great Needle Cleanup 2020
Remove a bunch of needles that have not been used for some time,
plus a few workarounds that are similarly stale.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-03-20 14:02:10 -07:00
Lukáš Růžička
d19cf9553e Reneedle the Gnome Application StartStop tests. 2020-03-18 18:06:34 +01:00
Adam Williamson
28642f4002 Move a stray app needle to the right place
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-01-17 15:19:17 +00:00
Adam Williamson
8612858b1f Second batch of Cantarell needles: GNOME apps tests
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-01-17 15:18:50 +00:00
Adam Williamson
e3430e82ef Update Rhythmbox app needle
The icon changed, so the needle needs changing.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-01-06 12:32:44 -08:00
Adam Williamson
5c03c435ca Stop having two 'firefox close tabs' needle tags, drop old ones
We still have a 'apps_run_firefox_stop' needle tag which is for
the same thing as 'firefox_close_tabs'. That's dumb. Get rid of
it and only have the firefox_close_tabs tag and needles. Also
clean up some old firefox_close_tabs needles that haven't matched
for months and all the 'apps_run_firefox_stop' needles.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-11-29 12:10:35 -08:00
Adam Williamson
4bb89046d3 Add one more updated GNOME app test needle
'Simple Scan' renamed itself.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-08-26 17:51:20 -07:00
Adam Williamson
28443abf04 Add new variants for GNOME app start/stop tests
Several apps changed icon.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-08-26 16:29:37 -07:00
Adam Williamson
be12f07900 GNOME apps: dismiss new LibreOffice 'tip of the day' if it shows
Also add a new needle for Impress startup.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-07-23 20:15:24 -07:00
Adam Williamson
bc2add845e Add the settings needle that provides the 'workspace' tag back
Removing this broke the GNOME apps test entirely because there
was no GNOME 'workspace' needle any more.

I don't like this needle much, we should probably use
check_desktop_clean or something instead. But for now let's just
put it back.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-25 14:16:11 -07:00
Adam Williamson
6656f1659d apps_activities is a dupe with overview_app_grid, kill it
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-06-25 14:01:39 -07:00
Lukas Ruzicka
9e3b16bfcf Change Settings test due to change functionality. 2019-06-21 14:54:18 +02:00
Lukas Ruzicka
868fca87b3 Add new needle for Simple Scan Menu item. 2019-06-21 11:33:12 +02:00
Adam Williamson
bad3263160 Update ABRT app launcher needle
Icon was changed.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-05-27 17:51:27 -07:00
Adam Williamson
d30714dbca Add a variant apps_stop needle for Firefox 66 without header
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-04-17 12:30:11 -07:00
Adam Williamson
e744cea358 Update GNOME apps needles for cheese and scan
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-04-16 18:46:31 -07:00
Lukas Ruzicka
9a2d9ea190 Create needles needed for firefox test to really work. 2019-03-28 14:18:51 +01:00
Adam Williamson
5a1a71c67f Use the existing 'oh hai this is firefox' needle for app tests
The KDE and GNOME 'apps' tests for Firefox both invented their
own 'oh look Firefox is running' needle, even though we already
had one. The GNOME one was broken by the removal of the app
title bar in Firefox 66.

Instead of having three needles for the same thing, let's just
throw the 'apps' ones out and use the pre-existing one from
needles/firefox for all cases.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-03-26 12:23:45 -07:00
Adam Williamson
26cdcb8d3c Add several new needles for changed GNOME app icons
Utilities came up different *again* in a Rawhide test today, so
this adds a needle which matches on the text. Usually we prefer
image matches to text, but this image seems to keep changing...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-03-20 12:21:55 -07:00
Adam Williamson
0365e2f18d Add another utilities needle variant
Dunno why we need yet *another*, but even the new one didn't
match on the most recent Branched compose. For now just add
another, we can look in a few weeks which can be thrown away.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-03-19 10:13:44 -07:00
Adam Williamson
1ed87382a9 abrt back under utilities, drop sundry
As of Fedora-30-20190316.n.1, gnome-abrt is back under the
Utilities menu and the 'Sundry' menu seems to have disappeared.
Change the test back to using utilities and drop the sundry
needle.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-03-19 10:11:32 -07:00
Lukas Ruzicka
bbb2ac06b8 Add new needle to cover changed utilities. 2019-03-18 15:27:44 +01:00
Adam Williamson
072333a0f7 Update needle for apps 'System Monitor'
Icon changed.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-02-25 11:30:19 -08:00
Lukas Ruzicka
690788f107 Reneedle the test suite
This is another take of needles to make the suite work again.
2019-02-21 12:29:36 +01:00
Lukas Ruzicka
1e8834825d Add new set of needles (first run)
These needles fix the test suite after the looks has been changed.
2019-02-20 15:52:38 +01:00
Lukas Ruzicka
be3aadc249 Change the target of the needle for Clocks in StartStop test
The needle could sometimes fail because the item it was looking
for only appeared in a limited set of situations. The new
location should be safer to check and the test should not
fail as a result.
2019-01-29 10:48:28 +01:00
Lukas Ruzicka
83ff7a0679 Delete Evolution needles.
Evolution has been removed from the default installation of Workstation
so the test is no more needed.
2019-01-28 14:54:58 +01:00
Lukas Ruzicka
4288041889 Use the current date instead f30 as a filename for new needles. 2019-01-28 14:53:59 +01:00
Lukas Ruzicka
e72a800fd1 Add new needles.
This commit adds new needles to reflect the changes which
have been made to the Desktop. It also now FIXES #87.
2019-01-28 11:11:36 +01:00
Lukas Ruzicka
c97c23d485 Recreate needles to make them check different area.
This commit adjusts the area that needles look for to avoid checking
based on a menu item that has disappeared from the system.
2019-01-28 11:11:36 +01:00
Lukas Ruzicka
39d3427471 Create a test suite for application start stop testing.
Merges #86
Fixes #85
2019-01-04 15:23:03 -08:00