1
0
mirror of https://pagure.io/fedora-qa/os-autoinst-distri-fedora.git synced 2024-11-29 17:13:09 +00:00
Commit Graph

1022 Commits

Author SHA1 Message Date
Adam Williamson
740fef2da6 Update a KDE vault app needle for some change in F35 updates
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-12-08 13:32:40 -08:00
Adam Williamson
dbd7883200 Drop match levels on some KDE update notification needles
These incorporate bits of the background so are subject to
non-100% matching, got a 97% match in current Rawhide, let's
see if dropping the match level is enough.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-30 14:41:53 -08:00
Adam Williamson
15cdd4f398 Update the Cockpit 'reconnect' needle
Font's changed since the last time we actually matched this (it
only happens occasionally if specific packages are in the update).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-30 14:06:35 -08:00
Adam Williamson
af31d4e8ae Update a Cockpit needle for Cockpit 258
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-24 09:45:31 -08:00
Adam Williamson
1d2255b041 Update PPC bootloader needles
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-24 09:45:21 -08:00
Adam Williamson
be235cd7ea Drop match level on a KDE notification needle
Got a 95% match on this in a 35 respin test.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-18 15:57:21 -08:00
Lukáš Růžička
cda0d0b0d1 Create a test suite for EoG (Image Viewer) 2021-11-18 13:13:59 -08:00
Adam Williamson
6aa41f038c Update a bunch of needles for font rendering changes
Seems like the new Pango changed font rendering in quite a lot
of places.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-12 15:48:05 -08:00
Adam Williamson
07ff387293 Drop match level on an Evince needle a bit
96% match with today's Rawhide, don't feel like a new needle.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-12 13:20:11 -08:00
Adam Williamson
323c6a0a45 Drop match level on a gedit needle a bit
We get a 96% match on this because the "A" in "Activities" moved
a bit. Instead of a new needle let's just be OK with the lower
match.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-12 12:07:58 -08:00
Adam Williamson
a5bf0a6aae Tighten match area on evince_file_select_pdf
So it doesn't fail if there's a dotted line around the entry
(indicating keyboard active, I think).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-12 11:55:40 -08:00
Adam Williamson
c16c7a1536 Update a few needles for Cockpit 257
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-10 23:16:43 -08:00
Adam Williamson
1670f3c170 Update several KDE needles for buttons turning blue
Some buttons that were grey are blue now. OK then!

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-09 15:57:46 -08:00
Adam Williamson
7a6f15fa6c Update several gedit app needles for today's Rawhide
Not sure what caused it, but line spacing seems to have changed
slightly in today's Rawhide.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-09 15:56:24 -08:00
Adam Williamson
7048363e5b Update apps_menu_button needles for Pango changes
New Pango version seems to change rendering of "Activities" text.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-09 15:55:30 -08:00
Adam Williamson
1aefd5f883 Update some bootloader needles for grub 2.06
Looks like someone decided to make it prettier.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-08 16:07:53 -08:00
Adam Williamson
a4737f13ad Update some needles for Firefox 94.0
Some minor text rendering changes.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-11-02 14:31:57 -07:00
Adam Williamson
d4a15962cb Update some Cockpit needles for Cockpit 256
Slight text rendering change for some reason.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-10-27 16:16:42 -07:00
Adam Williamson
d0bd3e05db Add a variant KDE printing check sentence needle
Dunno why the rendering changed slightly, oh well.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-10-27 16:16:05 -07:00
Adam Williamson
b9e7b11b5b Add variant anaconda layout indicator needles for F35 stable
This seems to happen every cycle: when we get to testing an
RC, the layout indicators in anaconda move a bit (the text
moves relative to the little keyboard icon). I think the fact
that the prerelease text is no longer present is what causes
this. Anyway, we need to handle it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-10-27 16:14:05 -07:00
Adam Williamson
c8efe87a1e Drop old F35 background needles, loosen match on current ones
The dropped needles are all of the Beta art, before it was
fuzzed out a bit for Final. We drop the match area on the
Final needles to catch more transitions (saw a 94% today).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-10-26 14:07:38 -07:00
Lukáš Růžička
9ec295fef2 Add needle to support the change of an icon in smart_status 2021-10-15 13:26:13 +02:00
Lukáš Růžička
cda2e902fa Fix the typo in the name. 2021-10-15 12:38:20 +02:00
Lukáš Růžička
243c1916d2 Add new weather needle to reflect when location is already set. 2021-10-15 12:36:13 +02:00
Lukáš Růžička
e519786e91 Fix the rotation test by using a keyboard shortcut. 2021-10-15 12:01:46 +02:00
Lukáš Růžička
95fefe87e6 Add a needle to match the bigger font in KDE login screen. 2021-10-15 11:36:42 +02:00
Lukáš Růžička
59026f18a6 Delete unused memtest needles to make check_needles script pass. 2021-10-15 11:36:02 +02:00
Adam Williamson
ea86795225 Update Cockpit "Join a Domain" needle for cockpit 255 change
We got a capital letter.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-10-14 14:28:01 -07:00
Adam Williamson
4e705d514e Add several new background transition needles
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-10-12 14:43:30 -07:00
Adam Williamson
0998bc7c76 Drop match level on a couple of Zezere needles
These things are always trouble...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-10-12 14:40:58 -07:00
Adam Williamson
1beb59d2ca Add a KDE light blue 'Finish' button needle
More new light blue backgrounded buttons.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-10-06 16:42:31 -07:00
Adam Williamson
62fe3df215 Add some more background needles
...this reminds me I was naming them by time of day for F33,
which was a good idea. Should've remembered to keep doing that.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-10-06 16:41:17 -07:00
Adam Williamson
c4b4028b49 Update F35 background day needle for final artwork
We'll need a whole farm of variants for this revised artwork.
Joy. Once it goes stable we can ditch the older versions.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-30 14:36:23 -07:00
Adam Williamson
bdf0a8f0ec Update various needles for Plasma 5.23 Beta
Plasma changed a few things, notably some button backgrounds.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-29 17:00:10 -07:00
Adam Williamson
8a051084d3 Update a couple of translated needles for Rawhide
The Japanese "accept your fate" button changed slightly, and
the new root password screen got a French translation.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-29 16:58:34 -07:00
Adam Williamson
0f7739a8b5 Add an alternate light blue KDE next needle
Somehow this button looks slightly different depending on where
the arrow is or something, even if you don't match on the arrow.
Sigh. So we need two.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-29 16:56:51 -07:00
Adam Williamson
ef028e89b9 Narrow the light blue Next button match
Don't match on the arrow, another app has it on the other side.
The color and text should be enough to avoid false matches.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-29 12:03:00 -07:00
Adam Williamson
de939c17df Update and rationalize KDE "next" needles
kgpg had its own, which doesn't make any sense. There are grey
and blue background variants that weren't consistently named.
This should rationalize things sensibly, and adds a new needle
for the new Plasma in Rawhide, with a lighter blue background.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-29 11:05:40 -07:00
Adam Williamson
c2a6ca8594 Update "add input source" needle
The cross got bigger. This needle might be a dupe with something
but I couldn't be bothered finding it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-28 15:49:02 -07:00
Adam Williamson
4c8a58be22 Add yet another variant of an IoT zezere needle
There's some issue with font kerning or something on this page
which means we constantly get slightly different rendering of
this text. Rather annoying.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-28 15:48:41 -07:00
Adam Williamson
28d2242bb3 Revert "Add workaround for log filtering issue in cockpit 251"
This reverts commit 8992d37ce6.
The workaround is no longer needed as cockpit 252, which fixes
the bug, is stable for all current releases.
2021-09-23 08:59:00 -07:00
Adam Williamson
e076630d8c Drop match level on all f35 background needles to 92
This should give us better transition matches without needing to
make even more needles.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-23 08:45:17 -07:00
Adam Williamson
60bfdd53b9 Update prelease note needle
Likely for font rendering changes since last time we matched on
it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-22 08:34:22 -07:00
Adam Williamson
ba0e976d8d More KDE update notification needle updates
For background translucency (sigh) and also a color difference
that I guess indicates a critical update or something.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-22 08:33:08 -07:00
Adam Williamson
673d3dd8a5 Update GNOME Japanese input source needle
I think Japanese font rendering changed a bit.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-22 08:32:29 -07:00
Adam Williamson
f4f1d48459 Yet another F35 background transition needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-16 14:14:35 -07:00
Adam Williamson
fcc494ce9a More new versions of KDE needles for stupid translucency
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-16 14:12:02 -07:00
Adam Williamson
e1e9f64036 Update various needles for icon theme changes
Some changes were made in the icon theme used by the installer
and GNOME, update various needles for this.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-16 14:05:09 -07:00
Adam Williamson
dafa528d89 Update root password needle for new icon and add other tag
The other tag the Help test uses is created by a concatenation
that isn't easy to change, so just add the tag to the other needle.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-15 16:57:59 -07:00
Adam Williamson
65cdc9609c De-dupe anaconda root password spoke needle
The anaconda help test had its own version, it doesn't need it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-15 16:26:05 -07:00
Adam Williamson
aa136bb807 ...and yet another F35 background transition needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-15 15:39:25 -07:00
Adam Williamson
eb98053bb8 Add yet another F35 background transition needle
Can I kill animated backgrounds yet

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-15 15:37:40 -07:00
Adam Williamson
c1d22142bb Update a Cockpit needle for Cockpit 253
Very slight text rendering change, not sure what.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-15 15:37:10 -07:00
Adam Williamson
a298f935f1 Add new variants on a couple of KDE needles for F35 backgrounds
I hate translucency with animated backgrounds. We may need more
of these.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-15 15:36:05 -07:00
Adam Williamson
8b13ece29e Update root password screen needles for Japanese and Russian
The new screen got translated for these languages now.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-15 15:32:56 -07:00
Adam Williamson
d172c49c62 Drop match level for KDE systray needle even lower
Got an 85% in https://openqa.fedoraproject.org/tests/975580 . Stupid
freaking transparency.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-10 16:53:58 -07:00
Adam Williamson
1ed4fc9ca1 And update one more needle I forgot in previous commit
Darn F33 KDE having a different font.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-09 14:09:21 -07:00
Adam Williamson
7a1b2e5ddf Update Firefox addon install needles for Firefox 92.0
They changed how this button looks yet again.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-09 14:05:37 -07:00
Adam Williamson
61ba4b4c98 Drop match level on KDE 'no notifications' needle
Got a 94% match at https://openqa.fedoraproject.org/tests/972329#step/desktop_notifications/36

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-08 13:57:47 -07:00
Adam Williamson
d26ebafa20 Add several more F35 background needle variations
Night, plus a couple of transitions.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-08 12:07:24 -07:00
Adam Williamson
d2a431a3fa Update KDE systray expand needle for new F35 background
Use a 90 match level because it seems it can vary a bit, saw a
94 in https://openqa.fedoraproject.org/tests/971978#step/desktop_notifications/33

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-08 12:06:23 -07:00
Adam Williamson
f012df5e86 Adjust match area on Evince 'run' needle
Similar to the 'open' needle, adjust match area to work even
when there's a notification obscuring the top bar.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-03 16:53:43 -07:00
Adam Williamson
02c47efab4 Reduce match area on Evince open needle
This will make it match even when partially obscured by a
notification, as in https://openqa.fedoraproject.org/tests/967109

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-02 15:28:52 -07:00
Adam Williamson
cb8ea979a3 Update Cockpit log entry needle
Somehow this dropped to a 94% match on some tests, not sure how.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-02 13:00:39 -07:00
Adam Williamson
369513ef7a Add a new F34 background transition needle
We somehow hit a transition point that didn't match any existing
needle. Oh background transitions, how I love you.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-09-02 13:00:01 -07:00
Adam Williamson
0891384805 Update Japanese 'install done' needle for font change
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-27 17:21:35 -07:00
Adam Williamson
67d587cb51 Update GNOME libreoffice impress start needle for new LO
We do this slightly differently on KDE and GNOME for whatever
reason, so this needle needs updating too.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-27 17:20:48 -07:00
Adam Williamson
dbb4d96403 Add F35 'day' background needle
There's also a 'night' and two transitions, so we'll have to
catch those as they show up.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-27 17:19:52 -07:00
Adam Williamson
a5ea81103e Update a few needles for changes in today's Rawhide/F35
LibreOffice adjusted layout a bit and dropped a template, one
icon changed in the utilities menu compilation.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-25 16:00:00 -07:00
Adam Williamson
375231fdf4 Add untranslated Arabic root password screen needle
Arabic doesn't match the English needle even though it's not
translated, because it's RTL, so the radio button is on the
other side of the text.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-25 15:13:06 -07:00
Adam Williamson
9b77392c0a Make the new root password screen needle all languages for now
The screen is not translated in any language yet, so let's just
make the needle language-independent at least for now. We could
change this after translations show up.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-25 15:11:27 -07:00
Adam Williamson
6f221809b1 Drop the match level on zezere claim button needle
This often seems to get a 90-95% match for some reason. Let's
just drop the threshold. I think it may be a kerning difference
based on the width of the MAC address?

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-24 16:08:56 -07:00
Adam Williamson
9231df62ac Add IoT 36 version needle now we have '36' builds
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-24 13:47:22 -07:00
Adam Williamson
dc82c90abd Handle redesigned root password screen in new anaconda
Really this just boils down to needing an extra click. We can
even just do the click in the old UI as well, it's not needed
but won't hurt anything and keeps the code simple.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-24 13:12:18 -07:00
Adam Williamson
0ab4c40f9a Update FreeIPA WebUI password reset link needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-20 16:10:12 -07:00
Adam Williamson
8992d37ce6 Add workaround for log filtering issue in cockpit 251
See https://github.com/cockpit-project/cockpit/issues/16243 .
This is a fairly minor issue upstream knows about but will not
be fixed immediately, so we'll add a workaround for it for now.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-19 15:46:45 -07:00
Adam Williamson
d47dfe7f7a Update Utilities app menu needle for some change in F35
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-19 13:59:51 -07:00
Adam Williamson
49c42e1806 Update GDM login needles for some GTK/GNOME change
The box changed style a bit.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-19 13:08:18 -07:00
Adam Williamson
803ae7ca57 Add a test of an additional repository using a metalink (#198)
As suggested by @kparal, this adds a test that specifies an
additional repository using a metalink. The repository contains
a single package, 'testpackage', that supplements glibc (so it
should always get installed). The test runs an install then
checks that testpackage got installed.

We also deduplicate a pair of needles which were matching on the
same anaconda UI feature (an "add" button) and use that same
needle in this test.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-18 14:03:27 -07:00
Adam Williamson
2ed23740d4 A few misc needle updates
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-18 14:02:27 -07:00
Adam Williamson
0cd4b7bafb Update Cockpit login needle for slight spacing change in Firefox
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-16 11:28:48 -07:00
Dan Čermák
6cb0634edc
fix desktop_browser: FAS is deprecated, use accounts.fedoraproject.org
This also requires a new needle for accounts.fedoraproject.org, as the webpage
is completely different now. The old needle for browser_fas_home is obsolete via
this change and can be removed
2021-08-13 22:53:05 +02:00
Adam Williamson
06d89172b0 Update a couple of Arabic needles for some font change
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-13 10:35:27 -07:00
Lukáš Růžička
b65f470eee Create basic functions tests for Gedit. 2021-08-12 15:37:37 +02:00
Lukáš Růžička
70959aae18 Delete a leftover unused needle reported by check_needles.py 2021-08-12 09:52:25 +02:00
Adam Williamson
3afd2c27e3 Update leftbar_workstation for F35
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-11 21:18:38 -07:00
Adam Williamson
82a0e06303 Update topbar_generic needle for electric blue
I feel like I might've wiped a needle for this yesterday. Oh,
well.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-11 21:16:58 -07:00
Adam Williamson
0851e641d3 Add version 35 needle (now 35 is Branched)
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-11 21:09:51 -07:00
Adam Williamson
492fcf62e4 Great Needle Cleanup 2021
Remove a whole chunk of needles that haven't matched for more
than 3 months. Also move a few needles to appropriate locations,
simplify some code chunks that relied on removed needles (if
we're not matching the needles, we don't need those chunks any
more), and drop some other no-longer-needed conditionals for
older releases.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-10 11:57:48 -07:00
Adam Williamson
c13b19591c Update several anaconda needles for KDE using different icons
As of today's Rawhide, KDE seems to be using a different icon
theme for anaconda. Not sure if this is intentional or not, but
we need to cope with it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-05 11:17:11 -07:00
Adam Williamson
05c793179a Add a fingerprint login test (GNOME only) (#223)
This adds a test for fingerprint-based login, as requested by
@benzea in #223. We use the fprintd dummy device to let us
simulate scanning a fingerprint, and check various scenarios
recommended by @benzea.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-03 15:21:33 -07:00
Adam Williamson
2980f2f0ae Update kontact_provide_data needle
Color changed a bit.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-03 14:47:16 -07:00
Adam Williamson
eab06ad96f Specify click_point for Japanese needle from last commit
Now we have two areas, openQA wants to click in the wrong one.
Let's tell it which one to click in.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-03 14:36:59 -07:00
Adam Williamson
7eb4e29f73 Tweak Japanese input source needle to avoid false match
The main screen now also has identical "Japanese" (that's what it
says) text. To avoid false matching before the picker opens, add
another match area.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-03 10:46:37 -07:00
Adam Williamson
7d14da3746 Bring back the older Evince 'rotate' needle
Current Silverblue still has it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-29 12:10:31 -07:00
Adam Williamson
5b1d3517fe Open Documents folder on Silverblue
The open dialog on Silverblue (which is apparently not at all
the same thing as the open dialog on Workstation, though they
look the same) does not default to the Documents folder, so we
have to open it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-29 12:09:34 -07:00
Adam Williamson
5905546f6e Update Evince needles
These all failed to match first time the test was run in
production. I guess Lukas was working from an older release.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-29 11:46:32 -07:00
Lukáš Růžička
e0d9409c74 Create a test suite for Evince.
This PR fixes issue #188. It adds a test suite to test basic
functionality of Evince and brings the following features:

* test scripts for various Evince functions.
* needles to support the Evince test scripts
* new template variables `TESTPATH` and `POSTINSTALL_LOAD_ALL` (see
  below)
* new logic in `main.py` (see below)

The new variables and the new logic make it easier to create test
suites for post-installation tests. If TESTPATH is used, OpenQA
will take all tests mentioned in POSTINSTALL from that specified
TESTPATH. If both TESTPATH and POSTINSTALL_LOAD_ALL are used, then
OpenQA will run all tests it can find at the TESTPATH location.
If POSTINSTALL and POSTINSTALL_LOAD_ALL are set simultaneously,
then only POSTINSTALL will be taken into account and OpenQA will
only load tests mentioned there.
2021-07-28 08:58:23 +02:00
Adam Williamson
420205bd5e Update a desktop update test needle
Dunno if this is os-autoinst or what.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-23 15:36:18 -07:00
Adam Williamson
a75e040062 Update a few more needles for os-autoinst
Also move all kde_next needles to the same dir.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-22 13:15:17 -07:00
Adam Williamson
fa94d92433 OK, fine, we need one more kernel.org patch needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-20 16:53:06 -07:00
Adam Williamson
04654f0d09 Add a few more updated needles missed in recent commit
Missed a few needles from the recent big commit of updates for
new os-autoinst behaviour.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-20 10:47:22 -07:00
Adam Williamson
df8d08db6f Update zezere needles for upstream/os-autoinst changes
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-19 15:59:07 -07:00
Adam Williamson
db19350db2 Update akonadi migration needle for newer KDE/os-autoinst
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-19 15:58:47 -07:00
Adam Williamson
2a7787c1da Update lots of needles for os-autoinst behaviour change
Recent git os-autoinst no longer downsamples screenshots as far
as it did before comparison. This makes a lot of needles where
colors have changed slightly no longer match, so they all needed
updating.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-19 13:03:11 -07:00
Adam Williamson
86c34ca063 Drop match level for kernel.org "patch" needles to 92
Again, to combat os-autoinst's new behaviour without adding yet
more needles. We're getting 96% match on stg.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-19 11:13:14 -07:00
Adam Williamson
d5ebaaa756 Drop match level to 90 for all background needles
Also delete ones for F32 and earlier. This should hopefully help
us not need to have too many needles for the newer stricter
matching.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-17 12:46:07 -07:00
Adam Williamson
2f4ef74def Avoid a needle duplication in KDE vault test
"show_hidden_icons" is the same thing as "desktop_expand_systray".

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-17 12:40:15 -07:00
Adam Williamson
1cf779fa20 Update Cockpit login needle for "Fedora Linux" change
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-14 14:11:52 -07:00
Adam Williamson
46c04c6a03 Update printing_check_sentence needle for a Pango change
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-14 14:11:35 -07:00
Adam Williamson
a7504441de Tighten match area to fix matching against trivial change
Latest Firefox has moved the underline down slightly for some
dumb reason. This tweaks the match area to only the text, so it
matches wherever the underline is.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-12 16:16:45 -07:00
Lukáš Růžička
6d1d549941 Introduce a resize check and a postinstall test for custom and blivet
tests.

This PR fixes #228.
2021-06-30 11:01:50 +02:00
Adam Williamson
a24da1ef63 Update Firefox addon_install needle for new release
Existing needle matched 95% on F33 and F34 tests of a new version.
Not suer what changed.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-25 10:26:29 -07:00
Adam Williamson
6a79565afa Fix up KDE 'plasma-disks' test stuff
In #235 we accidentally included an entire disks.pm test that
wasn't meant to be there - the infocenter module test is the
right thing to exercise plasma-disks, there is no standalone
app, running 'disks' just gets you the KDE Partition Manager,
which we already test. So this removes that test and renames a
needle that looks like it's for that test but is actually for
the kinfocenter module, to make this clearer.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-21 15:16:40 -07:00
Lukáš Růžička
9f0103a95f Enhance the Infocenter test to test the presence of Disks module. 2021-06-18 11:39:28 -07:00
Lukáš Růžička
2c366cc7a4 Add startstop test for Plasma Vault. 2021-06-18 11:39:24 -07:00
Lukáš Růžička
395ed61a1a Automate the Anaconda_Save_Traceback_to_Bugzilla_Text test case.
This PR adds a new test that automates the above mentioned test case.
It starts the installation in text mode using the `install_text` test
case, which it interrupts using the Anaconda crash trigger.
When the crash happens, it goes through the process of reporting
the bug to Bugzilla, checks that Bugzilla sends a positive
confirmation of the action, but also performs some REST API
calls to do a proper check and then it closes the bug to clean up.
2021-06-17 16:28:29 -07:00
Lukáš Růžička
b87049217c Add testcase for Memtest. 2021-06-16 18:11:01 +00:00
Adam Williamson
526042b0a5 Manually add Japanese input source for install_asian_language
GNOME dropped the g-i-s new user mode in F34, so on a Japanese
install with user created in the installer, you don't get an
input source configured out of the box or on first boot. So
we'll just have to do it manually after booting, before we test
if it works.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-15 16:19:31 -07:00
Adam Williamson
9d499eb5e1 Handle KDE having a permanent update notification again
Looks like the latest Rawhide got a permanent update notification
for KDE again. F34 is still around, though, so we can't just
revert to the old code, I don't think.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-15 13:56:00 -07:00
Adam Williamson
50947f8ba5 Update KDE desktop_icon_notifications needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-14 13:05:50 -07:00
Adam Williamson
0b45cd4adc Try and clean up desktop update needles a bit
The 'desktop_pacakge_tool_update-kde-detected' needles and
'desktop_update_notification_systray-kde' needles are actually
matching on exactly the same thing, so drop the redundancy. We
need to have the desktop_package_tool_update tag on the older
(F33) version of this needle because on F33 we click on it to
launch the update tool in the desktop_update_graphical test; from
F34 onwards this is *not* what we want to do so the needle should
not have that tag to avoid throwing the test off. When F33 goes
EOL we can drop that tag from the needle and simplify the
destop_update_graphical test. Also add a needle for the Discover
app's 'update' icon when no updates are found.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-14 12:32:27 -07:00
Adam Williamson
c28785afec Add F33 KDE variant Firefox 89 needles
KDE on F33 uses a different font, so needs its own needles...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-10 14:13:32 -07:00
Lukáš Růžička
9fdc63d4e2 Delete needles reported as unused by the check_needles script. 2021-06-10 12:13:41 +02:00
Adam Williamson
2f73b7302b Add another Firefox 'close tabs' needle
Not sure why. Some font difference in different tests.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-08 16:36:52 -07:00
Adam Williamson
2961a06dbd Update cockpit auto-updates needle
Radio button style change.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-08 16:36:20 -07:00
Adam Williamson
4fd395ff74 Update KDE Spectacle app runs needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-08 15:40:53 -07:00
Adam Williamson
bb9eb7d60e Update Firefox close tabs needle for GNOME
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-08 15:40:14 -07:00
Adam Williamson
59fbfcaa91 Update Firefox needles for new version
They did a UI refresh, it seems.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-08 11:36:49 -07:00
Adam Williamson
fcf96f73b7 Tweak Blivet LVM device type needles
There's some cheating/sloppiness going on here, with the same tag
and sometimes same needle being used to match "LVM2 Volume Group"
and "LVM2 Logical Volume". Today this caused us to pick the thin
pool entry instead in a test, so let's just clean this up and do
it right, with separate needles for matching each thing.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-07 18:16:46 -07:00
Adam Williamson
6c52a1c1dd Update Konsole runs needle, maximize Konsole in desktop_terminal
The needle match seems to have changed when bug #1957858 showed
up, but it's actually just a text rendering change in the window
title, it's not exactly caused by the tiny window. So not marking
as a workaround needle.

Maximizing the window makes the test work faster when we hit that
bug, as type_safely needs to be able to see the results of its
typing.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-02 11:07:49 -07:00
Adam Williamson
3364732110 anaconda_help: tweak nonlive needle handling, add waits, tabs
Some fixups for anaconda_help. Two runs of it failed today around
handoff from the root password screen to the install progress
screen; add a couple of wait_still_screens there to make it
safer. Drop the added nonlive needles, because they're too
permissive, causing problems for other tests (they're matching
before they should); instead we solve the problem of spokes being
highlighted by just pressing shift-tab a few times. And fix some
tabs to be spaces.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-05-31 16:17:06 -07:00
Lukáš Růžička
c6d443a20f Automate the QA:Testcase_Anaconda_help.
This PR automates the mentioned testcase to test that Help can be
displayed in Anaconda during the installation. It navigates through
the available Help screens and if it can see it, it finishes.

This test runs after `install_default_upload` to override the
installation defaults defined for all primary tests.

Delete a duplicated needle.

Reformat list extensions to make it nicer.

Get rid of wrong export and an empty line.

Delete empty line.

Use _boot_to_anaconda for booting and move subroutine accordingly.

Add variable to templates.fif.json

Delete trailing whitespace.

Fix calling the pretest.

Move help checking to another place.
2021-05-27 21:39:26 +00:00
Adam Williamson
5b15979f54 Update KDE system-settings runs needle (some font change)
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-05-19 12:09:09 -07:00
Adam Williamson
1b28976f49 Update several GNOME app test needles
Not sure why these changed, but oh well. Utilities menu was
highlighted in a test run for some reason, so let's just handle
that. Other needles changed very slightly.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-05-14 14:26:10 -07:00
Adam Williamson
875a817977 Drop Boxes/Connections needles for now
We're not using them, so they fail the unused needles check. We
can just revert this commit when we want them back.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-05-14 12:53:49 -07:00
Adam Williamson
65eef45cda Update Firefox addon_add needle, icon on button disappeared
I think this is in upstream page source, not on our end.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-05-13 18:08:59 -07:00
Adam Williamson
143f553ec4 Update kparted-runs needle
Font rendering changed slightly, dunno why.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-05-10 15:52:56 -07:00
Adam Williamson
8dc1bc7a8a Update leftbar generic needle, add rhbz#1959160 workaround
The background color of the generic left bar needle has changed
to match the new logo base color. The top bar's background color
has similarly changed, but this also caused us to notice a bug
in fedora-logos - that topbar image file seems to be basically
empty (just a transparent rectangle) so we see no 'image' in the
top bar, just solid electric blue. This needle matches that.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-05-10 13:57:38 -07:00
Adam Williamson
35660bb4ed Use Vinagre instead of Boxes as VNC client, prepare Connections
Boxes dropped VNC functionality. It's supposed to be replaced by
Connections, but we can't use that until it has fullscreen:
https://gitlab.gnome.org/GNOME/connections/-/issues/5
so use Vinagre for now. We do also prepare some needles for
Connections in anticipation of being able to use it later (since
I already did the work and don't want to waste it...)

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-05-06 16:28:49 -07:00
Adam Williamson
b1e28d4e77 Update Cockpit log entry detail needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-05-03 15:04:02 -07:00
Adam Williamson
28b1126c95 Update Japanese install_done-reboot needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-05-03 15:03:12 -07:00
Adam Williamson
f73ff0968c Update KDE addon install Firefox needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-05-03 15:02:05 -07:00
Adam Williamson
1a613fc8c2 Restore the cockput updated "Reboot" needle
OK, so sometimes we have a Reboot button, sometimes a Restart
button, sometimes both, but never *always* one or the other. So
we need both needles. Sigh.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-04-30 14:37:35 -07:00
Adam Williamson
92d17499c0 Update Firefox close tabs needles for font changes
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-04-30 11:34:19 -07:00
Adam Williamson
87a2477c31 Update KDE live installer needle for new logo
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-04-29 15:34:06 -07:00
Adam Williamson
efe793a465 Update some Cockpit needles for cockpit 243
There's a spurious warning on the Updates page, but we don't
want to fail tests for non-related updates on that, and I've
already reported it so it should get fixed.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-04-29 15:32:37 -07:00
Adam Williamson
571d7c2efe Update KDE app needles once again for Noto with grey background
...sigh.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-04-22 17:00:21 -07:00
Adam Williamson
6f6e84f65e Update a couple of Firefox needles for changes in 88
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-04-22 15:01:14 -07:00
Adam Williamson
533264900f Replace cockput updated 'reboot' needle with 'restart' needle
The 'reboot' button isn't always there in this case, it seems,
but the 'restart services' one is more likely to be. So let's
switch.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-04-22 14:52:52 -07:00