1
0
mirror of https://pagure.io/fedora-qa/os-autoinst-distri-fedora.git synced 2024-12-01 17:53:08 +00:00
Commit Graph

998 Commits

Author SHA1 Message Date
Lukáš Růžička
222270c3dd Add failing needle for eog. 2022-02-02 12:50:20 +01:00
Adam Williamson
0af5692ebf Add another GNOME printing needle
Not sure if we lost one with the recent adjustment to the tests
or F35 actually changed somehow, but hey, we need this.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-31 16:44:54 -08:00
Lukáš Růžička
ceaf711f76 Create a test suite for Gnome Text Editor 2022-01-29 00:49:10 +00:00
Lukáš Růžička
980ba5f411 Make changes to the Desktop Printing test. 2022-01-28 20:57:36 +00:00
Lukáš Růžička
fe8306d2cd Implement distribution methods to replace the testapi defaults.
This PR adds implementations of distribution methods to make them
usable on Fedora. It adds the following methods

* ensure_installed (to install packages)
* become_root (to switch to root account)
* script_sudo (run script with sudo)
* assert_script_sudo (run and assert a sudo script)

It also adds a helper script to the utils.pm

* make_serial_writable

that makes the serial console writable for normal users
and so enables to run commands that check their progress
by sending messages to the serial console. Normally, they
fail, because the messages will not be written their, so
the checking mechanism will never see them.
2022-01-27 21:44:35 +00:00
Lukáš Růžička
83356ceec6 Use waiting commands to make the tests more defensive. 2022-01-25 13:36:57 +01:00
Lukáš Růžička
1052712410 Add needles to make them not failing. 2022-01-24 14:49:32 +01:00
Lukáš Růžička
d9ba0883e7 Delete unused needles
These needles have been probably forgotten and left over from one
of the previous commits. The tox tests are failing on other
pull requests and this PR fixes it.
2022-01-21 18:09:07 +01:00
Adam Williamson
c80f20f947 Update KDE menu button needle for new KDE in Rawhide
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-20 14:52:09 -08:00
Adam Williamson
8894e022b2 Update a couple of Japanese needles for GNOME changes
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-18 17:40:23 -08:00
Adam Williamson
f4bdedc57e Update user_creation_screen French needle
The text line we matched on before changed and is currently
untranslated, let's match on a different line.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-18 15:58:08 -08:00
Adam Williamson
4363918b5d Update GNOME "no notifications" needle for GNOME 42
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-18 15:57:26 -08:00
Adam Williamson
24e3ecb89f Drop gedit application tests
Workstation has replaced gedit with gnome-text-editor in Rawhide,
so this is no longer useful. We will replace it with a test suite
for gnome-text-editor.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-18 15:52:40 -08:00
Adam Williamson
3ae23f66a9 Update GNOME apps test for gedit->gnome-text-editor switch
Workstation replaced gedit with gnome-text-editor. This updates
the needles and also changes the name used for 'tagging' the
application for the core_applications test.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-18 15:11:50 -08:00
Adam Williamson
c7f5ec6689 Update several GNOME needles for GNOME 42 in Rawhide
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-18 14:13:42 -08:00
Adam Williamson
574498eb66 Correct language tags on needles from last commit
I forgot to update the language tags in the 'untranslated'
needles when copying them from the English one.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-18 11:39:42 -08:00
Adam Williamson
8e414cc469 Handle anaconda giving users admin by default in Rawhide
As of today's Rawhide compose, user accounts added in Rawhide
have admin privs by default. For now we need to handle both
possibilities here (click the box if it's not clicked already);
after F35 EOL we can just drop all handling of that box.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-18 11:36:06 -08:00
Adam Williamson
d5ca75cb04 Also remove system-config-language test from KDE app test
This was also dropped:
https://pagure.io/fedora-kickstarts/c/5b5fba2

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-12 17:26:37 -08:00
Adam Williamson
4e15e16824 Drop kcolorchooser and kruler from KDE apps test
Both were dropped from the default KDE install set:
https://pagure.io/fedora-comps/c/edd0d74
so we need to drop them here too.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-12 16:59:13 -08:00
Adam Williamson
b94daf25d0 Update GNOME software needles a bit more
Add the download and apply needles (whoops), and tighten the
match area on the update needle a bit so it matches even when
there's a little blue balloon to the left of the text.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-12 16:05:34 -08:00
Adam Williamson
d19b7f6890 Update some GNOME app needles
Calculator's equals button changed a bit somehow, EOG changed a
button and the kerning on Activities button changed.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-12 15:20:56 -08:00
Adam Williamson
2a14756a3d Update some GNOME Software needles for a UI change
Looks like text got bolded a bit.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-12 15:20:29 -08:00
Adam Williamson
2ecd05ddb3 Update KDE needles for slightly greyer grey
KDE team inform me they fixed a bug in Rawhide which made grey
not quite grey enough. Now it's greyer. So, more needles. So
many needles.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-12 15:11:43 -08:00
Adam Williamson
b60b0f85b4 Update several needles for KDE Frameworks 5.90.0
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2022-01-06 14:16:00 -08:00
Adam Williamson
5d10fae391 Update a couple of EOG needles with minor changes
Slight spacing changes is all.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-12-14 09:58:49 -08:00
Adam Williamson
fb909555e6 Update Cockpit 'join domain' screen needle for Cockpit 259
They probably moved it to a different JS lib or something.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-12-08 13:34:18 -08:00
Adam Williamson
740fef2da6 Update a KDE vault app needle for some change in F35 updates
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-12-08 13:32:40 -08:00
Adam Williamson
dbd7883200 Drop match levels on some KDE update notification needles
These incorporate bits of the background so are subject to
non-100% matching, got a 97% match in current Rawhide, let's
see if dropping the match level is enough.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-30 14:41:53 -08:00
Adam Williamson
15cdd4f398 Update the Cockpit 'reconnect' needle
Font's changed since the last time we actually matched this (it
only happens occasionally if specific packages are in the update).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-30 14:06:35 -08:00
Adam Williamson
af31d4e8ae Update a Cockpit needle for Cockpit 258
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-24 09:45:31 -08:00
Adam Williamson
1d2255b041 Update PPC bootloader needles
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-24 09:45:21 -08:00
Adam Williamson
be235cd7ea Drop match level on a KDE notification needle
Got a 95% match on this in a 35 respin test.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-18 15:57:21 -08:00
Lukáš Růžička
cda0d0b0d1 Create a test suite for EoG (Image Viewer) 2021-11-18 13:13:59 -08:00
Adam Williamson
6aa41f038c Update a bunch of needles for font rendering changes
Seems like the new Pango changed font rendering in quite a lot
of places.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-12 15:48:05 -08:00
Adam Williamson
07ff387293 Drop match level on an Evince needle a bit
96% match with today's Rawhide, don't feel like a new needle.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-12 13:20:11 -08:00
Adam Williamson
323c6a0a45 Drop match level on a gedit needle a bit
We get a 96% match on this because the "A" in "Activities" moved
a bit. Instead of a new needle let's just be OK with the lower
match.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-12 12:07:58 -08:00
Adam Williamson
a5bf0a6aae Tighten match area on evince_file_select_pdf
So it doesn't fail if there's a dotted line around the entry
(indicating keyboard active, I think).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-12 11:55:40 -08:00
Adam Williamson
c16c7a1536 Update a few needles for Cockpit 257
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-10 23:16:43 -08:00
Adam Williamson
1670f3c170 Update several KDE needles for buttons turning blue
Some buttons that were grey are blue now. OK then!

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-09 15:57:46 -08:00
Adam Williamson
7a6f15fa6c Update several gedit app needles for today's Rawhide
Not sure what caused it, but line spacing seems to have changed
slightly in today's Rawhide.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-09 15:56:24 -08:00
Adam Williamson
7048363e5b Update apps_menu_button needles for Pango changes
New Pango version seems to change rendering of "Activities" text.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-09 15:55:30 -08:00
Adam Williamson
1aefd5f883 Update some bootloader needles for grub 2.06
Looks like someone decided to make it prettier.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-08 16:07:53 -08:00
Adam Williamson
a4737f13ad Update some needles for Firefox 94.0
Some minor text rendering changes.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-02 14:31:57 -07:00
Adam Williamson
d4a15962cb Update some Cockpit needles for Cockpit 256
Slight text rendering change for some reason.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-10-27 16:16:42 -07:00
Adam Williamson
d0bd3e05db Add a variant KDE printing check sentence needle
Dunno why the rendering changed slightly, oh well.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-10-27 16:16:05 -07:00
Adam Williamson
b9e7b11b5b Add variant anaconda layout indicator needles for F35 stable
This seems to happen every cycle: when we get to testing an
RC, the layout indicators in anaconda move a bit (the text
moves relative to the little keyboard icon). I think the fact
that the prerelease text is no longer present is what causes
this. Anyway, we need to handle it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-10-27 16:14:05 -07:00
Adam Williamson
c8efe87a1e Drop old F35 background needles, loosen match on current ones
The dropped needles are all of the Beta art, before it was
fuzzed out a bit for Final. We drop the match area on the
Final needles to catch more transitions (saw a 94% today).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-10-26 14:07:38 -07:00
Lukáš Růžička
9ec295fef2 Add needle to support the change of an icon in smart_status 2021-10-15 13:26:13 +02:00
Lukáš Růžička
cda2e902fa Fix the typo in the name. 2021-10-15 12:38:20 +02:00
Lukáš Růžička
243c1916d2 Add new weather needle to reflect when location is already set. 2021-10-15 12:36:13 +02:00
Lukáš Růžička
e519786e91 Fix the rotation test by using a keyboard shortcut. 2021-10-15 12:01:46 +02:00
Lukáš Růžička
95fefe87e6 Add a needle to match the bigger font in KDE login screen. 2021-10-15 11:36:42 +02:00
Lukáš Růžička
59026f18a6 Delete unused memtest needles to make check_needles script pass. 2021-10-15 11:36:02 +02:00
Adam Williamson
ea86795225 Update Cockpit "Join a Domain" needle for cockpit 255 change
We got a capital letter.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-10-14 14:28:01 -07:00
Adam Williamson
4e705d514e Add several new background transition needles
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-10-12 14:43:30 -07:00
Adam Williamson
0998bc7c76 Drop match level on a couple of Zezere needles
These things are always trouble...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-10-12 14:40:58 -07:00
Adam Williamson
1beb59d2ca Add a KDE light blue 'Finish' button needle
More new light blue backgrounded buttons.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-10-06 16:42:31 -07:00
Adam Williamson
62fe3df215 Add some more background needles
...this reminds me I was naming them by time of day for F33,
which was a good idea. Should've remembered to keep doing that.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-10-06 16:41:17 -07:00
Adam Williamson
c4b4028b49 Update F35 background day needle for final artwork
We'll need a whole farm of variants for this revised artwork.
Joy. Once it goes stable we can ditch the older versions.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-30 14:36:23 -07:00
Adam Williamson
bdf0a8f0ec Update various needles for Plasma 5.23 Beta
Plasma changed a few things, notably some button backgrounds.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-29 17:00:10 -07:00
Adam Williamson
8a051084d3 Update a couple of translated needles for Rawhide
The Japanese "accept your fate" button changed slightly, and
the new root password screen got a French translation.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-29 16:58:34 -07:00
Adam Williamson
0f7739a8b5 Add an alternate light blue KDE next needle
Somehow this button looks slightly different depending on where
the arrow is or something, even if you don't match on the arrow.
Sigh. So we need two.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-29 16:56:51 -07:00
Adam Williamson
ef028e89b9 Narrow the light blue Next button match
Don't match on the arrow, another app has it on the other side.
The color and text should be enough to avoid false matches.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-29 12:03:00 -07:00
Adam Williamson
de939c17df Update and rationalize KDE "next" needles
kgpg had its own, which doesn't make any sense. There are grey
and blue background variants that weren't consistently named.
This should rationalize things sensibly, and adds a new needle
for the new Plasma in Rawhide, with a lighter blue background.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-29 11:05:40 -07:00
Adam Williamson
c2a6ca8594 Update "add input source" needle
The cross got bigger. This needle might be a dupe with something
but I couldn't be bothered finding it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-28 15:49:02 -07:00
Adam Williamson
4c8a58be22 Add yet another variant of an IoT zezere needle
There's some issue with font kerning or something on this page
which means we constantly get slightly different rendering of
this text. Rather annoying.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-28 15:48:41 -07:00
Adam Williamson
28d2242bb3 Revert "Add workaround for log filtering issue in cockpit 251"
This reverts commit 8992d37ce6.
The workaround is no longer needed as cockpit 252, which fixes
the bug, is stable for all current releases.
2021-09-23 08:59:00 -07:00
Adam Williamson
e076630d8c Drop match level on all f35 background needles to 92
This should give us better transition matches without needing to
make even more needles.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-23 08:45:17 -07:00
Adam Williamson
60bfdd53b9 Update prelease note needle
Likely for font rendering changes since last time we matched on
it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-22 08:34:22 -07:00
Adam Williamson
ba0e976d8d More KDE update notification needle updates
For background translucency (sigh) and also a color difference
that I guess indicates a critical update or something.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-22 08:33:08 -07:00
Adam Williamson
673d3dd8a5 Update GNOME Japanese input source needle
I think Japanese font rendering changed a bit.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-22 08:32:29 -07:00
Adam Williamson
f4f1d48459 Yet another F35 background transition needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-16 14:14:35 -07:00
Adam Williamson
fcc494ce9a More new versions of KDE needles for stupid translucency
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-16 14:12:02 -07:00
Adam Williamson
e1e9f64036 Update various needles for icon theme changes
Some changes were made in the icon theme used by the installer
and GNOME, update various needles for this.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-16 14:05:09 -07:00
Adam Williamson
dafa528d89 Update root password needle for new icon and add other tag
The other tag the Help test uses is created by a concatenation
that isn't easy to change, so just add the tag to the other needle.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-15 16:57:59 -07:00
Adam Williamson
65cdc9609c De-dupe anaconda root password spoke needle
The anaconda help test had its own version, it doesn't need it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-15 16:26:05 -07:00
Adam Williamson
aa136bb807 ...and yet another F35 background transition needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-15 15:39:25 -07:00
Adam Williamson
eb98053bb8 Add yet another F35 background transition needle
Can I kill animated backgrounds yet

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-15 15:37:40 -07:00
Adam Williamson
c1d22142bb Update a Cockpit needle for Cockpit 253
Very slight text rendering change, not sure what.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-15 15:37:10 -07:00
Adam Williamson
a298f935f1 Add new variants on a couple of KDE needles for F35 backgrounds
I hate translucency with animated backgrounds. We may need more
of these.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-15 15:36:05 -07:00
Adam Williamson
8b13ece29e Update root password screen needles for Japanese and Russian
The new screen got translated for these languages now.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-15 15:32:56 -07:00
Adam Williamson
d172c49c62 Drop match level for KDE systray needle even lower
Got an 85% in https://openqa.fedoraproject.org/tests/975580 . Stupid
freaking transparency.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-10 16:53:58 -07:00
Adam Williamson
1ed4fc9ca1 And update one more needle I forgot in previous commit
Darn F33 KDE having a different font.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-09 14:09:21 -07:00
Adam Williamson
7a1b2e5ddf Update Firefox addon install needles for Firefox 92.0
They changed how this button looks yet again.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-09 14:05:37 -07:00
Adam Williamson
61ba4b4c98 Drop match level on KDE 'no notifications' needle
Got a 94% match at https://openqa.fedoraproject.org/tests/972329#step/desktop_notifications/36

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-08 13:57:47 -07:00
Adam Williamson
d26ebafa20 Add several more F35 background needle variations
Night, plus a couple of transitions.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-08 12:07:24 -07:00
Adam Williamson
d2a431a3fa Update KDE systray expand needle for new F35 background
Use a 90 match level because it seems it can vary a bit, saw a
94 in https://openqa.fedoraproject.org/tests/971978#step/desktop_notifications/33

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-08 12:06:23 -07:00
Adam Williamson
f012df5e86 Adjust match area on Evince 'run' needle
Similar to the 'open' needle, adjust match area to work even
when there's a notification obscuring the top bar.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-03 16:53:43 -07:00
Adam Williamson
02c47efab4 Reduce match area on Evince open needle
This will make it match even when partially obscured by a
notification, as in https://openqa.fedoraproject.org/tests/967109

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-02 15:28:52 -07:00
Adam Williamson
cb8ea979a3 Update Cockpit log entry needle
Somehow this dropped to a 94% match on some tests, not sure how.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-02 13:00:39 -07:00
Adam Williamson
369513ef7a Add a new F34 background transition needle
We somehow hit a transition point that didn't match any existing
needle. Oh background transitions, how I love you.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-02 13:00:01 -07:00
Adam Williamson
0891384805 Update Japanese 'install done' needle for font change
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-27 17:21:35 -07:00
Adam Williamson
67d587cb51 Update GNOME libreoffice impress start needle for new LO
We do this slightly differently on KDE and GNOME for whatever
reason, so this needle needs updating too.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-27 17:20:48 -07:00
Adam Williamson
dbb4d96403 Add F35 'day' background needle
There's also a 'night' and two transitions, so we'll have to
catch those as they show up.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-27 17:19:52 -07:00
Adam Williamson
a5ea81103e Update a few needles for changes in today's Rawhide/F35
LibreOffice adjusted layout a bit and dropped a template, one
icon changed in the utilities menu compilation.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-25 16:00:00 -07:00
Adam Williamson
375231fdf4 Add untranslated Arabic root password screen needle
Arabic doesn't match the English needle even though it's not
translated, because it's RTL, so the radio button is on the
other side of the text.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-25 15:13:06 -07:00
Adam Williamson
9b77392c0a Make the new root password screen needle all languages for now
The screen is not translated in any language yet, so let's just
make the needle language-independent at least for now. We could
change this after translations show up.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-25 15:11:27 -07:00
Adam Williamson
6f221809b1 Drop the match level on zezere claim button needle
This often seems to get a 90-95% match for some reason. Let's
just drop the threshold. I think it may be a kerning difference
based on the width of the MAC address?

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-24 16:08:56 -07:00
Adam Williamson
9231df62ac Add IoT 36 version needle now we have '36' builds
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-24 13:47:22 -07:00
Adam Williamson
dc82c90abd Handle redesigned root password screen in new anaconda
Really this just boils down to needing an extra click. We can
even just do the click in the old UI as well, it's not needed
but won't hurt anything and keeps the code simple.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-24 13:12:18 -07:00