Commit Graph

840 Commits

Author SHA1 Message Date
Adam Williamson 06d89172b0 Update a couple of Arabic needles for some font change
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-13 10:35:27 -07:00
Lukáš Růžička b65f470eee Create basic functions tests for Gedit. 2021-08-12 15:37:37 +02:00
Lukáš Růžička 70959aae18 Delete a leftover unused needle reported by check_needles.py 2021-08-12 09:52:25 +02:00
Adam Williamson 3afd2c27e3 Update leftbar_workstation for F35
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-11 21:18:38 -07:00
Adam Williamson 82a0e06303 Update topbar_generic needle for electric blue
I feel like I might've wiped a needle for this yesterday. Oh,
well.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-11 21:16:58 -07:00
Adam Williamson 0851e641d3 Add version 35 needle (now 35 is Branched)
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-11 21:09:51 -07:00
Adam Williamson 492fcf62e4 Great Needle Cleanup 2021
Remove a whole chunk of needles that haven't matched for more
than 3 months. Also move a few needles to appropriate locations,
simplify some code chunks that relied on removed needles (if
we're not matching the needles, we don't need those chunks any
more), and drop some other no-longer-needed conditionals for
older releases.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-10 11:57:48 -07:00
Adam Williamson c13b19591c Update several anaconda needles for KDE using different icons
As of today's Rawhide, KDE seems to be using a different icon
theme for anaconda. Not sure if this is intentional or not, but
we need to cope with it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-05 11:17:11 -07:00
Adam Williamson 05c793179a Add a fingerprint login test (GNOME only) (#223)
This adds a test for fingerprint-based login, as requested by
@benzea in #223. We use the fprintd dummy device to let us
simulate scanning a fingerprint, and check various scenarios
recommended by @benzea.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-03 15:21:33 -07:00
Adam Williamson 2980f2f0ae Update kontact_provide_data needle
Color changed a bit.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-03 14:47:16 -07:00
Adam Williamson eab06ad96f Specify click_point for Japanese needle from last commit
Now we have two areas, openQA wants to click in the wrong one.
Let's tell it which one to click in.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-03 14:36:59 -07:00
Adam Williamson 7eb4e29f73 Tweak Japanese input source needle to avoid false match
The main screen now also has identical "Japanese" (that's what it
says) text. To avoid false matching before the picker opens, add
another match area.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-08-03 10:46:37 -07:00
Adam Williamson 7d14da3746 Bring back the older Evince 'rotate' needle
Current Silverblue still has it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-29 12:10:31 -07:00
Adam Williamson 5b1d3517fe Open Documents folder on Silverblue
The open dialog on Silverblue (which is apparently not at all
the same thing as the open dialog on Workstation, though they
look the same) does not default to the Documents folder, so we
have to open it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-29 12:09:34 -07:00
Adam Williamson 5905546f6e Update Evince needles
These all failed to match first time the test was run in
production. I guess Lukas was working from an older release.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-29 11:46:32 -07:00
Lukáš Růžička e0d9409c74 Create a test suite for Evince.
This PR fixes issue #188. It adds a test suite to test basic
functionality of Evince and brings the following features:

* test scripts for various Evince functions.
* needles to support the Evince test scripts
* new template variables `TESTPATH` and `POSTINSTALL_LOAD_ALL` (see
  below)
* new logic in `main.py` (see below)

The new variables and the new logic make it easier to create test
suites for post-installation tests. If TESTPATH is used, OpenQA
will take all tests mentioned in POSTINSTALL from that specified
TESTPATH. If both TESTPATH and POSTINSTALL_LOAD_ALL are used, then
OpenQA will run all tests it can find at the TESTPATH location.
If POSTINSTALL and POSTINSTALL_LOAD_ALL are set simultaneously,
then only POSTINSTALL will be taken into account and OpenQA will
only load tests mentioned there.
2021-07-28 08:58:23 +02:00
Adam Williamson 420205bd5e Update a desktop update test needle
Dunno if this is os-autoinst or what.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-23 15:36:18 -07:00
Adam Williamson a75e040062 Update a few more needles for os-autoinst
Also move all kde_next needles to the same dir.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-22 13:15:17 -07:00
Adam Williamson fa94d92433 OK, fine, we need one more kernel.org patch needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-20 16:53:06 -07:00
Adam Williamson 04654f0d09 Add a few more updated needles missed in recent commit
Missed a few needles from the recent big commit of updates for
new os-autoinst behaviour.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-20 10:47:22 -07:00
Adam Williamson df8d08db6f Update zezere needles for upstream/os-autoinst changes
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-19 15:59:07 -07:00
Adam Williamson db19350db2 Update akonadi migration needle for newer KDE/os-autoinst
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-19 15:58:47 -07:00
Adam Williamson 2a7787c1da Update lots of needles for os-autoinst behaviour change
Recent git os-autoinst no longer downsamples screenshots as far
as it did before comparison. This makes a lot of needles where
colors have changed slightly no longer match, so they all needed
updating.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-19 13:03:11 -07:00
Adam Williamson 86c34ca063 Drop match level for kernel.org "patch" needles to 92
Again, to combat os-autoinst's new behaviour without adding yet
more needles. We're getting 96% match on stg.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-19 11:13:14 -07:00
Adam Williamson d5ebaaa756 Drop match level to 90 for all background needles
Also delete ones for F32 and earlier. This should hopefully help
us not need to have too many needles for the newer stricter
matching.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-17 12:46:07 -07:00
Adam Williamson 2f4ef74def Avoid a needle duplication in KDE vault test
"show_hidden_icons" is the same thing as "desktop_expand_systray".

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-17 12:40:15 -07:00
Adam Williamson 1cf779fa20 Update Cockpit login needle for "Fedora Linux" change
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-14 14:11:52 -07:00
Adam Williamson 46c04c6a03 Update printing_check_sentence needle for a Pango change
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-14 14:11:35 -07:00
Adam Williamson a7504441de Tighten match area to fix matching against trivial change
Latest Firefox has moved the underline down slightly for some
dumb reason. This tweaks the match area to only the text, so it
matches wherever the underline is.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-07-12 16:16:45 -07:00
Lukáš Růžička 6d1d549941 Introduce a resize check and a postinstall test for custom and blivet
tests.

This PR fixes #228.
2021-06-30 11:01:50 +02:00
Adam Williamson a24da1ef63 Update Firefox addon_install needle for new release
Existing needle matched 95% on F33 and F34 tests of a new version.
Not suer what changed.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-25 10:26:29 -07:00
Adam Williamson 6a79565afa Fix up KDE 'plasma-disks' test stuff
In #235 we accidentally included an entire disks.pm test that
wasn't meant to be there - the infocenter module test is the
right thing to exercise plasma-disks, there is no standalone
app, running 'disks' just gets you the KDE Partition Manager,
which we already test. So this removes that test and renames a
needle that looks like it's for that test but is actually for
the kinfocenter module, to make this clearer.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-21 15:16:40 -07:00
Lukáš Růžička 9f0103a95f Enhance the Infocenter test to test the presence of Disks module. 2021-06-18 11:39:28 -07:00
Lukáš Růžička 2c366cc7a4 Add startstop test for Plasma Vault. 2021-06-18 11:39:24 -07:00
Lukáš Růžička 395ed61a1a Automate the Anaconda_Save_Traceback_to_Bugzilla_Text test case.
This PR adds a new test that automates the above mentioned test case.
It starts the installation in text mode using the `install_text` test
case, which it interrupts using the Anaconda crash trigger.
When the crash happens, it goes through the process of reporting
the bug to Bugzilla, checks that Bugzilla sends a positive
confirmation of the action, but also performs some REST API
calls to do a proper check and then it closes the bug to clean up.
2021-06-17 16:28:29 -07:00
Lukáš Růžička b87049217c Add testcase for Memtest. 2021-06-16 18:11:01 +00:00
Adam Williamson 526042b0a5 Manually add Japanese input source for install_asian_language
GNOME dropped the g-i-s new user mode in F34, so on a Japanese
install with user created in the installer, you don't get an
input source configured out of the box or on first boot. So
we'll just have to do it manually after booting, before we test
if it works.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-15 16:19:31 -07:00
Adam Williamson 9d499eb5e1 Handle KDE having a permanent update notification again
Looks like the latest Rawhide got a permanent update notification
for KDE again. F34 is still around, though, so we can't just
revert to the old code, I don't think.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-15 13:56:00 -07:00
Adam Williamson 50947f8ba5 Update KDE desktop_icon_notifications needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-14 13:05:50 -07:00
Adam Williamson 0b45cd4adc Try and clean up desktop update needles a bit
The 'desktop_pacakge_tool_update-kde-detected' needles and
'desktop_update_notification_systray-kde' needles are actually
matching on exactly the same thing, so drop the redundancy. We
need to have the desktop_package_tool_update tag on the older
(F33) version of this needle because on F33 we click on it to
launch the update tool in the desktop_update_graphical test; from
F34 onwards this is *not* what we want to do so the needle should
not have that tag to avoid throwing the test off. When F33 goes
EOL we can drop that tag from the needle and simplify the
destop_update_graphical test. Also add a needle for the Discover
app's 'update' icon when no updates are found.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-14 12:32:27 -07:00
Adam Williamson c28785afec Add F33 KDE variant Firefox 89 needles
KDE on F33 uses a different font, so needs its own needles...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-10 14:13:32 -07:00
Lukáš Růžička 9fdc63d4e2 Delete needles reported as unused by the check_needles script. 2021-06-10 12:13:41 +02:00
Adam Williamson 2f73b7302b Add another Firefox 'close tabs' needle
Not sure why. Some font difference in different tests.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-08 16:36:52 -07:00
Adam Williamson 2961a06dbd Update cockpit auto-updates needle
Radio button style change.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-08 16:36:20 -07:00
Adam Williamson 4fd395ff74 Update KDE Spectacle app runs needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-08 15:40:53 -07:00
Adam Williamson bb9eb7d60e Update Firefox close tabs needle for GNOME
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-08 15:40:14 -07:00
Adam Williamson 59fbfcaa91 Update Firefox needles for new version
They did a UI refresh, it seems.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-08 11:36:49 -07:00
Adam Williamson fcf96f73b7 Tweak Blivet LVM device type needles
There's some cheating/sloppiness going on here, with the same tag
and sometimes same needle being used to match "LVM2 Volume Group"
and "LVM2 Logical Volume". Today this caused us to pick the thin
pool entry instead in a test, so let's just clean this up and do
it right, with separate needles for matching each thing.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-07 18:16:46 -07:00
Adam Williamson 6c52a1c1dd Update Konsole runs needle, maximize Konsole in desktop_terminal
The needle match seems to have changed when bug #1957858 showed
up, but it's actually just a text rendering change in the window
title, it's not exactly caused by the tiny window. So not marking
as a workaround needle.

Maximizing the window makes the test work faster when we hit that
bug, as type_safely needs to be able to see the results of its
typing.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-06-02 11:07:49 -07:00
Adam Williamson 3364732110 anaconda_help: tweak nonlive needle handling, add waits, tabs
Some fixups for anaconda_help. Two runs of it failed today around
handoff from the root password screen to the install progress
screen; add a couple of wait_still_screens there to make it
safer. Drop the added nonlive needles, because they're too
permissive, causing problems for other tests (they're matching
before they should); instead we solve the problem of spokes being
highlighted by just pressing shift-tab a few times. And fix some
tabs to be spaces.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2021-05-31 16:17:06 -07:00