1
0
mirror of https://pagure.io/fedora-qa/os-autoinst-distri-fedora.git synced 2024-12-05 03:23:09 +00:00
Commit Graph

191 Commits

Author SHA1 Message Date
Adam Williamson
cc7387fbe1 Update apps_run_maps needle
Just a slight change here.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-09-04 08:40:44 -07:00
Adam Williamson
b71046eac0 Update the weather hourly 'later' needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-08-21 00:00:55 -04:00
Adam Williamson
8f75386838 More GTK4 needle updates
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-08-18 10:09:49 -04:00
Adam Williamson
79cad84bc3 Update needles for GTK4 changes (mainly hinting enabled)
GTK4 enabled font hinting recently, and that breaks this huge pile
of needles.

There are probably a few more that need doing, but it's 2am and
I've had enough.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-08-18 02:09:44 -04:00
Adam Williamson
6486a33006 Revert "Add missing needles to support Clocks test."
This reverts commit 31987c7688. I
already pushed an equivalent commit earlier.
2022-08-16 15:39:15 -04:00
Lukas Ruzicka
31987c7688 Add missing needles to support Clocks test. 2022-08-16 16:27:32 +02:00
Adam Williamson
2bfe0f53cd Add another weather icon (large sun and cloud)
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-08-16 10:10:06 -04:00
Adam Williamson
8b8108f051 Update more Clocks needles
Lukas left these lying around stg, they are needed.
clocks_alarm_cross_remove is a dupe of gnome_button_cross_remove
with a bad name, so removed it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-08-16 09:31:35 -04:00
Adam Williamson
581180c19c Remove nautilus context menu star needles
We already changed how we do this since the context menu entry
was removed, just cleaning up the now-unneeded needles.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-08-16 08:56:38 -04:00
Adam Williamson
d2afd6f627 Correct tag on recently-added apps_run_logs needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-08-16 08:56:13 -04:00
Adam Williamson
8479cb979f Remove nautilus side panel test and associated needles
The show/hide side panel functionality was intentionally removed
in version 43-beta:

https://gitlab.gnome.org/GNOME/nautilus/-/issues/2427

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-08-16 08:53:42 -04:00
Lukas Ruzicka
c8816f6435 Add new needles to cover the Menu changes. 2022-08-15 22:26:32 -04:00
Adam Williamson
5e1b918775 Add another weather icon - sun and cloud (small)
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-08-15 22:22:57 -04:00
Adam Williamson
321e09a396 Add variant nautilus star selected file needle
The star looks a little different. Not sure if this is just a
new look or what.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-08-15 22:20:16 -04:00
Lukas Ruzicka
e69ba53f51 Fix the Clocks test to work on Fedora 37. 2022-08-15 16:47:46 +02:00
Lukas Ruzicka
decbe662c5 Add needle to cover for Logs test. 2022-08-11 13:58:25 -07:00
Adam Williamson
0c3b8c1ff3 Update nautilus needles
This was meant to be in the previous commit, but I forgot.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-08-11 09:41:13 -07:00
Adam Williamson
1d1ffa0203 Update Calculator credits shown needle for 43
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-08-11 08:58:59 -07:00
Adam Williamson
e2e8fcadd4 Rationalize GNOME credit button handling
We had a ton of needles all covering something very similar
(press a "Credits" button in a GNOME app). There are about four
real variations: old-style regular face white-on-black (eog),
old-style regular face (nautilus and evince before recent
libadwaita ports), old-style bold face (GTE and Clocks before
new libadwaita), and new-style (everything that's been ported
to use libadwaita for its About page). Let's just rationalize
it down to those, using the same needle tag for all of them.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-08-08 18:24:57 -07:00
Lukáš Růžička
9e0ec721a6 Create a new test for Gnome Weather 2022-08-08 18:24:51 -07:00
Adam Williamson
3cb6b5899a Remove a script file I used for the calculator needle thing
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-08-08 17:43:39 -07:00
Adam Williamson
87ad2fb63e Add (back) old calculator button needles for Silverblue/flatpak
Silverblue has Calculator as an older-versioned flatpak, so it
still looks like it did in GNOME 42 (blue equals button, lighter
colored number buttons).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-08-08 17:34:32 -07:00
Adam Williamson
1154a2b739 Update a bunch of GNOME needles for libadwaita font color change
Text on some dialogs is now dark grey instead of black.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-08-08 11:07:42 -07:00
Lukáš Růžička
c40a35ea62 Add a new test for Calculator. 2022-08-05 11:34:22 -07:00
Adam Williamson
6f6ca81e95 Update a bunch of GNOME needles for GNOME 43 alpha
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-07-28 16:33:34 -07:00
Adam Williamson
406b99eaed Add some variant needles for F36 respin testing
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-07-28 16:29:58 -07:00
Adam Williamson
8bec03edd7 Drop needles for check removed in previous commit
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-07-25 16:45:17 -07:00
Adam Williamson
9495cfb1ff Update nautilus tests and needles for 43~alpha
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-07-22 17:24:43 -07:00
Adam Williamson
84c6e18f14 Reduce duplication of nautilus Documents directory needles
We had three. We only need one, matching on the sidebar entry,
which should be always visible.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-07-22 17:17:59 -07:00
Adam Williamson
3274d29137 Update gnome-text-editor new document needle
Not sure exactly what changed, some kinda UI label tweak.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-07-20 09:34:55 -07:00
Adam Williamson
66f4ad296a Lower match level on clocks_timer_finished needle
We got a 95% match in the F36 respin test.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-07-15 11:07:46 -07:00
Lukáš Růžička
48ec73e814 Create a test suite for Nautilus. 2022-07-12 16:01:36 -07:00
Lukáš Růžička
1f8b56e068 Change the way to download test data.
This PR changes the way to download the test data into the VM.
Although it does not use a disk image as suggested in one
of the review, it does not clone the entire repository, but
a simple tar.gz file that holds the data which will be
distributed into the directory structure.

This way, the amount of data needed to be downloaded dropped
from approximately 50MB to below 2MB.

Also, the existing test suites were adapted to this situation.
2022-07-04 09:34:04 +02:00
Lukáš Růžička
7c1e686d14 Create tests for Help. 2022-06-29 23:06:37 +00:00
Lukáš Růžička
6f00e3fe8a Create tests for Clocks. 2022-06-23 21:41:56 +00:00
Adam Williamson
1d76c12584 Add Arabic gnome-terminal needle
For the i18n fonts test, this was missing from the PR.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-27 11:58:43 -07:00
Adam Williamson
2d4d6ae8f2 Rename needles from i18n fonts test
Just giving them names that kinda explains why they exist.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-26 08:41:01 -07:00
Lukáš Růžička
1acef21fa5 Automate the i18n_default_fonts testcase for Japanese.
This is the automation of the optional testcase https://fedoraproject.org/wiki/QA:Testcase_i18n_default_fonts.
The test implementation runs the same commands as the mentioned test
case and checks the expected output. It is designed to run in the scope
of postinstall tests when the language is set to "japanese".
2022-05-26 09:54:38 +02:00
Adam Williamson
f6f9ae58e6 Update gnome-text-editor dark style needle for current highlight
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-17 16:21:57 -07:00
Lukáš Růžička
29d69d1de1 Delete unusued needles that prevent branches from passing tests. 2022-05-12 09:09:42 +02:00
Adam Williamson
f7d1fe8ccd Update gte_text_replaced needle for different underlining
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-05-11 16:25:19 -07:00
Lukáš Růžička
aa448d48bc Reupload the needle again, as I sent an incorrect file before. 2022-04-25 14:10:08 +02:00
Lukáš Růžička
bcf46f0cd0 Fix failing Gnome Text Editor needle. 2022-04-25 13:07:49 +02:00
Adam Williamson
cb3de66b8d Update gnome-text-editor needles for latest Rawhide
Seems like text rendering changed slightly.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-04-21 08:25:10 -07:00
Adam Williamson
8bb5aef223 Update an eog needle for flatpak dialog change
Again, a dialog changed a bit in the flatpak version of the app.
For this needle, the shade of grey is slightly different. Change
happened between Fedora-36-20220314.n.0 and 20220315.n.0.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-17 13:42:11 -07:00
Adam Williamson
47e90c9010 Add variant needles for current Flatpak open/save dialogs
The open/save dialogs for Flatpak apps in current F36 (and
probably Rawhide, but can't tell due to another bug) look a bit
odd: https://github.com/fedora-silverblue/issue-tracker/issues/245
This adds variant needles to handle various differences there.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-17 13:23:35 -07:00
Adam Williamson
66b111cecc Update gnome-text-editor needles for F36 upgrade test
For some reason various bits of gte started looking slightly
different on the F36 upgrade test. I don't really know why and
don't care enough to look it up. I'm just hoping all these
variations between gte running in slightly different contexts
calm down soon...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-17 12:37:34 -07:00
Adam Williamson
f1c44aa1e7 Update GTE preferences_off needle for Rawhide/F36
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-10 17:06:26 -08:00
Adam Williamson
50db12402c Add needles for old flatpak gnome-text-editor
Silverblue has an older version of gnome-text-editor, using a
Flatpak base environment built off an older GNOME. Because of
this most of the needles for the current RPM-packaged version
don't match. For some reason the old needles we delete don't
match either - some difference in font rendering configuration
or something. So I had to create a bunch of new needles.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-07 16:00:45 -08:00
Adam Williamson
f4bc90e681 Tweak the gte_preferences_off needle click point
I did this by hand and I think 20 pixels is a bit too much.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-07 15:03:05 -08:00
Adam Williamson
0a80004f3e Make gte_preferences_off needle more specific
It matches on the "close the app" button on older Flatpak GTE.
So widen the needle to include the "Preferences" text, and add
a click point.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-07 14:47:22 -08:00
Adam Williamson
af69bf1990 Update a few more miscellaneous needles for GNOME 42
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-05 08:48:46 -08:00
Adam Williamson
d28a507078 Reduce match area of gte_credits_shown needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-04 19:29:40 -08:00
Adam Williamson
2da5b6abf4 Complete gnome-text-editor needle update
Just needed a few more.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-04 15:12:02 -08:00
Lukáš Růžička
bd1e7b0295 Big needle recreation for Gnome-Text-Editor 2022-03-04 15:12:57 +01:00
Lukáš Růžička
f1af1bca6e Add newer needle for gnome-text-editor test. 2022-03-04 13:00:34 +01:00
Adam Williamson
1493cb9aa9 Update app start/stop needles for GNOME 42.beta
These are taken with the latest gnome-shell build, with CSS
fixes for the overview applied. They don't work for current
F36/Rawhide but will work once that gnome-shell build lands.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-03-01 15:59:57 -08:00
Adam Williamson
10df5a57bf Update a bunch of needles for GNOME and adwaita-icon-theme 42
GNOME 42 and adwaita-icon-theme 42 changed a lot of things in
GNOME and anaconda, we need to update all these needles.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-20 15:52:42 -08:00
Adam Williamson
4282048819 Drop screenshot app from GNOME app start/stop tests
It was removed from the default install:
https://pagure.io/fedora-comps/c/5371509
in favor of a new screenshot mechanism that's built in to GNOME
Shell.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-02-09 10:23:38 -08:00
Lukáš Růžička
42e9f713b2 Change test suite to fit with the latest known version.
The latest version of Gnome-Text-Editor bring a little
bit different UI and some new or modified features.
This commit fixes the suite to run on newest version.
2022-02-07 10:50:10 +01:00
Lukáš Růžička
222270c3dd Add failing needle for eog. 2022-02-02 12:50:20 +01:00
Lukáš Růžička
ceaf711f76 Create a test suite for Gnome Text Editor 2022-01-29 00:49:10 +00:00
Lukáš Růžička
83356ceec6 Use waiting commands to make the tests more defensive. 2022-01-25 13:36:57 +01:00
Adam Williamson
24e3ecb89f Drop gedit application tests
Workstation has replaced gedit with gnome-text-editor in Rawhide,
so this is no longer useful. We will replace it with a test suite
for gnome-text-editor.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-18 15:52:40 -08:00
Adam Williamson
3ae23f66a9 Update GNOME apps test for gedit->gnome-text-editor switch
Workstation replaced gedit with gnome-text-editor. This updates
the needles and also changes the name used for 'tagging' the
application for the core_applications test.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-18 15:11:50 -08:00
Adam Williamson
c7f5ec6689 Update several GNOME needles for GNOME 42 in Rawhide
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-18 14:13:42 -08:00
Adam Williamson
d19b7f6890 Update some GNOME app needles
Calculator's equals button changed a bit somehow, EOG changed a
button and the kerning on Activities button changed.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-12 15:20:56 -08:00
Adam Williamson
5d10fae391 Update a couple of EOG needles with minor changes
Slight spacing changes is all.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-12-14 09:58:49 -08:00
Lukáš Růžička
cda0d0b0d1 Create a test suite for EoG (Image Viewer) 2021-11-18 13:13:59 -08:00
Adam Williamson
6aa41f038c Update a bunch of needles for font rendering changes
Seems like the new Pango changed font rendering in quite a lot
of places.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-12 15:48:05 -08:00
Adam Williamson
07ff387293 Drop match level on an Evince needle a bit
96% match with today's Rawhide, don't feel like a new needle.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-12 13:20:11 -08:00
Adam Williamson
323c6a0a45 Drop match level on a gedit needle a bit
We get a 96% match on this because the "A" in "Activities" moved
a bit. Instead of a new needle let's just be OK with the lower
match.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-12 12:07:58 -08:00
Adam Williamson
a5bf0a6aae Tighten match area on evince_file_select_pdf
So it doesn't fail if there's a dotted line around the entry
(indicating keyboard active, I think).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-12 11:55:40 -08:00
Adam Williamson
7a6f15fa6c Update several gedit app needles for today's Rawhide
Not sure what caused it, but line spacing seems to have changed
slightly in today's Rawhide.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-09 15:56:24 -08:00
Lukáš Růžička
cda2e902fa Fix the typo in the name. 2021-10-15 12:38:20 +02:00
Lukáš Růžička
243c1916d2 Add new weather needle to reflect when location is already set. 2021-10-15 12:36:13 +02:00
Lukáš Růžička
e519786e91 Fix the rotation test by using a keyboard shortcut. 2021-10-15 12:01:46 +02:00
Adam Williamson
e1e9f64036 Update various needles for icon theme changes
Some changes were made in the icon theme used by the installer
and GNOME, update various needles for this.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-16 14:05:09 -07:00
Adam Williamson
f012df5e86 Adjust match area on Evince 'run' needle
Similar to the 'open' needle, adjust match area to work even
when there's a notification obscuring the top bar.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-03 16:53:43 -07:00
Adam Williamson
02c47efab4 Reduce match area on Evince open needle
This will make it match even when partially obscured by a
notification, as in https://openqa.fedoraproject.org/tests/967109

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-02 15:28:52 -07:00
Adam Williamson
67d587cb51 Update GNOME libreoffice impress start needle for new LO
We do this slightly differently on KDE and GNOME for whatever
reason, so this needle needs updating too.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-27 17:20:48 -07:00
Adam Williamson
a5ea81103e Update a few needles for changes in today's Rawhide/F35
LibreOffice adjusted layout a bit and dropped a template, one
icon changed in the utilities menu compilation.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-25 16:00:00 -07:00
Adam Williamson
d47dfe7f7a Update Utilities app menu needle for some change in F35
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-19 13:59:51 -07:00
Adam Williamson
2ed23740d4 A few misc needle updates
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-18 14:02:27 -07:00
Lukáš Růžička
b65f470eee Create basic functions tests for Gedit. 2021-08-12 15:37:37 +02:00
Adam Williamson
492fcf62e4 Great Needle Cleanup 2021
Remove a whole chunk of needles that haven't matched for more
than 3 months. Also move a few needles to appropriate locations,
simplify some code chunks that relied on removed needles (if
we're not matching the needles, we don't need those chunks any
more), and drop some other no-longer-needed conditionals for
older releases.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-10 11:57:48 -07:00
Adam Williamson
7d14da3746 Bring back the older Evince 'rotate' needle
Current Silverblue still has it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-29 12:10:31 -07:00
Adam Williamson
5b1d3517fe Open Documents folder on Silverblue
The open dialog on Silverblue (which is apparently not at all
the same thing as the open dialog on Workstation, though they
look the same) does not default to the Documents folder, so we
have to open it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-29 12:09:34 -07:00
Adam Williamson
5905546f6e Update Evince needles
These all failed to match first time the test was run in
production. I guess Lukas was working from an older release.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-29 11:46:32 -07:00
Lukáš Růžička
e0d9409c74 Create a test suite for Evince.
This PR fixes issue #188. It adds a test suite to test basic
functionality of Evince and brings the following features:

* test scripts for various Evince functions.
* needles to support the Evince test scripts
* new template variables `TESTPATH` and `POSTINSTALL_LOAD_ALL` (see
  below)
* new logic in `main.py` (see below)

The new variables and the new logic make it easier to create test
suites for post-installation tests. If TESTPATH is used, OpenQA
will take all tests mentioned in POSTINSTALL from that specified
TESTPATH. If both TESTPATH and POSTINSTALL_LOAD_ALL are used, then
OpenQA will run all tests it can find at the TESTPATH location.
If POSTINSTALL and POSTINSTALL_LOAD_ALL are set simultaneously,
then only POSTINSTALL will be taken into account and OpenQA will
only load tests mentioned there.
2021-07-28 08:58:23 +02:00
Adam Williamson
2a7787c1da Update lots of needles for os-autoinst behaviour change
Recent git os-autoinst no longer downsamples screenshots as far
as it did before comparison. This makes a lot of needles where
colors have changed slightly no longer match, so they all needed
updating.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-19 13:03:11 -07:00
Adam Williamson
1b28976f49 Update several GNOME app test needles
Not sure why these changed, but oh well. Utilities menu was
highlighted in a test run for some reason, so let's just handle
that. Other needles changed very slightly.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-05-14 14:26:10 -07:00
Adam Williamson
de87c3f28e Update gedit needle for recent change
It now calls new files "Untitled File", not "Untitled Document".

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-04-01 15:46:34 -07:00
Adam Williamson
29f75788e9 Update a bunch of GNOME app needles for GNOME 40 final
Some apps moved around, others the needles stopped matching for
some reason, some kind of slight scale change or something.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-24 18:36:38 -07:00
Adam Williamson
ac9edb4cfb GNOME apps: drop Archiver test
The app was dropped from Workstation's default package set a few
days ago. See:
https://pagure.io/fedora-workstation/issue/167

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-05 18:25:29 -08:00
Adam Williamson
51341dc2ff Update several GNOME app needles for overview change
The icons in the dash got a bit smaller again, so all these
needles need updating.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-03-03 18:59:16 -08:00
Adam Williamson
6658740b2a Update the GNOME app run test needles for GNOME 40
Overview changed a lot, so all these needles need updating.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-22 17:04:22 -08:00
Adam Williamson
aebabc706e Update some GNOME-related needles for changes in GNOME 40
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-02-04 14:06:11 -08:00
Adam Williamson
179ab45bca Update various needles for GNOME down caret changing a bit
This affected apps_run_terminal and a ton of layout needles.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-01-25 16:27:39 -08:00
Adam Williamson
d065974cc6 apps_run_terminal: match window area too
Just matching the Overview entry isn't really enough, the app
hasn't really run yet. This makes the test more robust and also
helps out on aarch64 desktop tests where the app window takes a
long time to appear.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-12-04 11:55:36 -08:00