Commit Graph

122 Commits

Author SHA1 Message Date
Adam Williamson b614a38d6c Revert "Make evince test handle #2183356 (wrong save target on flatpak)"
This reverts commit 278b1e32b0.
The bug it worked around seems to have been fixed.
2024-04-22 16:52:05 -07:00
Adam Williamson 96c75c5e28 Update tour needles for upstream changes
Various changes to the Tour text needed needle updates. The
final screen doesn't say "Have a nice day!" any more, so let's
rename that needle.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-12 12:04:25 -07:00
Adam Williamson 6b6cd20956 clocks/timer: don't always expect 'start' button
Since 46, the 1 minute button is a quickstart, it doesn't just
set the timer but starts it. So we can't always expect to have
to click the start button. Let's keep it working both ways for
now for respin testing, we can drop it once we're sure we're not
doing any testing on F39 any more.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-04-12 11:11:58 -07:00
Lukas Ruzicka b0bc18b187 Add a 'navigation' test for GNOME.
This PR partly solves the issue #301 when it adds the navigation
testing for Gnome. It uses the keyboard combinations to cycle through
running applications and checks that applications could be switched
accordingly. It also tests that you can switch between workspaces
and that you can move an applications to another workspace.
2024-04-10 21:46:43 +00:00
Adam Williamson cc832a4ad8 Fix new logic in Clocks test
Whoops, we can't just use a straight match_has_tag there as we
did another assert in the middle...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-03-25 08:22:53 -07:00
Adam Williamson 8ebf3bdddb Tweak Clocks alarm test for change in upstream code
Upstream now sets an alarm with no explicit recurrence inactive
after it is stopped (previously it assumed recurrence every day).
We need the test to handle both behaviours for a while (until
we are no longer testing < 46.0 anywhere).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-03-24 09:47:21 -07:00
Lukas Ruzicka e069a25396 Create a workaround for Flatpak Fonts start up.
On Silverblue, Fonts cannot be started using the menu_launch_type
for the first time, or it starts and crashes immediately.
However, if Fonts are started with flatpak run org.gnome.font-viewer,
it seems that the application starts and holds.
Let's start it using this workaround and when it still crashes, let's restart.
2024-02-23 12:38:42 +01:00
Lukas Ruzicka 1cd5455eae Revert "Restart Fonts on Silverblue (bug)"
This reverts commit 5ae9926225.
Unfortunately, the fix did not work on Staging, and some
other precaution will have to be made.
2024-02-22 17:01:51 +01:00
Lukas Ruzicka 5ae9926225 Restart Fonts on Silverblue (bug) 2024-02-22 15:31:14 +01:00
Adam Williamson 8e929f079f Try and make the archiver test more robust
These are some changes @lruzicka left lying around uncommitted
on openqa01.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-02-20 17:40:55 -08:00
Lukáš Růžička 3b4c94bb55 Add some more fixes for Nautilus. 2024-02-20 15:58:25 +01:00
Lukáš Růžička d656bc45a6 Wait until the dialogue settles 2024-02-20 15:01:14 +01:00
Lukáš Růžička e2e22341d3 Fix nautilus issues. 2024-02-19 14:19:52 +01:00
Lukáš Růžička 99b4d6ec17 Run scripts with assertions.
Creating the .invisible.txt file was done using non-assertion commands.
The tests have been failing for some and it seems like the commands
did not run correctly. Running them with assertions will make sure
that they will run (or fail correctly).
2024-02-19 11:26:39 +01:00
Adam Williamson 98513a0185 archive: be safer about the 'archive' dialog appearing
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-02-16 17:53:42 -08:00
Adam Williamson caa4353fe0 maps: add some sleeps to the zoom test
These loops make us click extremely fast. This may cause
unreliable results, I think. At least, the test is failing a
lot lately, with results that look like it's not always getting
the expected four levels of zoom. Let's try a short sleep
between clicks.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-02-16 17:52:19 -08:00
Adam Williamson 106a63f101 Maps: try and be a bit safer with the export screen
It seems like the export screen takes a while to appear on 40 and
Rawhide ATM, and we might start typing before it's there. Let's
assert it's actually there before we start doing stuff.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-02-16 17:22:22 -08:00
Lukáš Růžička 58544fcbce Wait until Loupe responds correctly. 2024-02-16 17:22:52 +01:00
Adam Williamson 5f702b0be8 Run update repo setup steps from a serial console
This is a surprisingly large change as we want to go back to
the console we were previously on after doing it. To do that we
need to know what console we were on, and to know *that*, we need
to port everything that currently uses (ctrl-)alt-fX to switch
consoles to use select_console instead.

This is primarily intended to make running setup_repos.py faster
when it has to download a lot of packages (as typing in hundreds
of package names is quite slow). But it actually makes the whole
thing faster, even when only downloading one or two packages.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-11 12:09:59 -08:00
Adam Williamson 247e8dd822 gnome-text-editor: drop setting of English language
The bug this was meant to fix hasn't happened for months. Back
in Fedora-Rawhide-20230629.n.0 we were seeing every line in the
poem marked as a spelling error until we did this, but that's
not happening any more, we don't need this.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-09 17:41:27 -08:00
Adam Williamson f2dcfed498 Also settle during the setup stage for Maps
This has similarly been failing quite a lot lately, let's see if
a sleep helps here.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-03 15:31:56 -08:00
Adam Williamson 6e95581865 Calculator: delay before snapshotting
In some tests on staging this seems to help with the 'clicks
don't work in later test steps' problem we're seeing a lot.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2024-01-03 15:12:44 -08:00
Adam Williamson 13404c6aaf loupe: don't pass args to download_testdata
You can see what these args are trying to do, but the function
does not currently work that way. I think running it without
args should get what the test wants. If Lukas wants to refine
download_testdata so you can specify the payload and where to
extract it, he can do that, then put this back...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-11-27 10:53:31 -08:00
Adam Williamson 475ee6b89c loupe: add a wait at start of browse test
We often get a failure where it's stuck at a spinner here, let's
see if waiting to settle the snapshot resume helps.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-10-17 15:33:53 -07:00
Adam Williamson 69dad7a975 sysmon: click, don't use shortcuts, to switch views
It looks like
https://gitlab.gnome.org/GNOME/gnome-system-monitor/-/issues/262
won't be fixed for a while - the fixes are tied up with the GTK
4 port - so let's just work around it for now by clicking instead
of using keyboard shortcuts.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-10-17 15:30:31 -07:00
Adam Williamson 22e174069e gnome-panel: set update notification timestamp early
If we do it after forcing the clock to 18:30, doing it takes so
long we wind up at 18:32, and that kinda sets the rest of the
test out of whack (we have several needles that assume we start
at 18:30 or 18:31 after the snapshot). So let's set the update
timestamp *before* we force the clock. This will mean it's waay
in the future after we force the clock, but that should still
do the job of avoiding notifications showing up, I hope.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-10-14 10:34:01 -07:00
Adam Williamson b043e99430 Drop EOG alternate path in Maps export image test
Silverblue now has Loupe, like Workstation, so the paths are the
same.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-10-14 10:24:24 -07:00
Lukas Ruzicka b1799eb084 Use the new subroutine on desktop tests. 2023-10-10 17:43:21 -07:00
Lukáš Růžička 9e0d74453c Create a test suite for Loupe (Image Viewer)
This PR adds a test for a new Image Viewer called Loupe.
It is based on the old Image Viewer test, newly reneedled
with some of the tests shortened, deleted or edited
as the new Image Viewer has a little bit less functions
compared to the previous one.

Add needles.
2023-09-20 10:29:39 +02:00
Adam Williamson efe4a3da2e Maps: sigh, okay, need another test logic change for Loupe
Loupe's Open dialog defaults to Recent, not Pictures, so when
we're using Loupe we need to click into Pictures to find the
exported image.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-23 11:17:06 -07:00
Adam Williamson af8a6635a6 Maps: go back to always typing 'image viewer'
Loupe has replaced EOG on F39 and Rawhide, and it can be found
with "image viewer", so let's just go with that. The rest of the
logic should be OK but we will likely need some new needles,
will do that next.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-23 11:03:36 -07:00
Adam Williamson d000a96fc6 Remove the EOG app test
EOG has been replaced by Loupe in F39+. We will need to add a
test for Loupe, but first let's remove the EOG test so it does
not fail on every compose.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-23 09:07:06 -07:00
Adam Williamson ccda54d0f7 Fix launching eog on Silverblue
We still have to type "image viewer" there, for now.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-09 18:04:05 -07:00
Lukas Ruzicka 8ac3885897 Make various fixes in Workstation product to make tests pass. 2023-08-08 14:50:03 +02:00
Lukas Ruzicka 3e7936fd01 Replace the dropped pactl with amixer to manipulate audio levels. 2023-07-17 14:30:05 +02:00
Adam Williamson f49c8bc66b gnome-text-editor: only handle spellcheck language if needed
The Flatpak build doesn't have the spellcheck issue at the
moment, and it may be fixed soon in the RPM build. Trying to
'fix' the issue on the flatpak build actually makes the test
fail. So, let's only do the fix if we actually have a misspelled
word.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-07-05 12:19:41 -07:00
Adam Williamson ba9a36d10e g-t-e: mark 'new_file' test as fatal
The tests after it assume new_file ran - they rely on the file
it creates - so it should be considered fatal.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-07-05 11:39:18 -07:00
Adam Williamson d8c374044a Add more safety to the fullscreen for Archiver
We can't really just hit super-up and then immediately go on our
merry way clicking on stuff...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-07-04 17:25:52 -07:00
Adam Williamson 20a2d161ca Add some safety to g-t-e language setup
Seems in Rawhide the menu is loading without dividers briefly,
we match there, then the dividers load in and make the menu
longer, so when we click, we hit a different entry in the menu.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-07-03 11:31:48 -07:00
Lukas Ruzicka d749317f29 Update the Gnome-Text-Editot test.
The editor started to show spell-checking that would require a lot
of new needles to be created. Theredore, we set the language to
English to stop showing the spelling mistakes in aaa_setup.pm

Also, the application started to have problems with getting correct
focus, so we want to click into the text before the status gets
recorded.
2023-06-30 14:26:00 +02:00
Lukas Ruzicka bc8601a1d4 Create test for the Tour application. 2023-06-23 10:53:58 +02:00
Adam Williamson 3bce9f1007 Type more safely in the gnome-panel volume bar test
The shifted characters here frequently get mistyped. Let's use
type_safely. If this isn't enough we can try very_safely.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-06-23 10:52:33 +02:00
Adam Williamson 37bd56033d nautilus: adjust keyboard shortcut page navigation
As recommended by @mclasen in
https://gitlab.gnome.org/GNOME/gtk/-/issues/5831#note_1743386 .

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-16 16:09:04 -07:00
Lukas Ruzicka e211a87fc7 Create a test suite for Disks. 2023-05-12 17:05:44 -07:00
Adam Williamson 9199f8a0f0 Drop gnome-contacts softfail for "Unnamed Person" problem
This was resolved upstream and we're no longer hitting this bug
in tests on F38, Rawhide or even F37 respins, so we should no
longer need this workaround.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-04 09:57:15 -07:00
Adam Williamson 7dece68ae6 Drop old branch of gnome-text-editor 'skins' test
This is never hit any more, everywhere we run this test is on
the newer code now.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-04 09:57:15 -07:00
Adam Williamson 0f781bdaf2 Robustify the scrolling in the Help app test
This keeps failing on the accessibility section, and looking at
the screenshots I realized why. When you press 'down', GNOME
doesn't just 'snap' to the new view, it does a smooth downward
scroll. We're often matching *while it's scrolling*, so the
needle match is right at the bottom of the screen. But then the
animation continues, so when we get to the click action (even
though we use click_lastmatch it's not *instant* in openQA),
the thing we're trying to click (the "Accessibility" section
title) is a bit further up the screen, and the click 'misses'.

So, we need to wait out the scroll then re-assert and click.
This unfortunately will make the test take about 30 seconds
longer, but I don't see another way to do it. We could maybe
shave the wait_still_screen to one second...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-02 09:37:02 -07:00
Adam Williamson 853ed17664 Handle app appearing before access request in gnome-panel test
Similar to the dedicated tests for these apps, the app can appear
for a split second before the access request, so we match on the
app and don't realize we need to click through the access
request. Handle this the same way we do in the dedicated tests.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-04-22 11:03:00 -07:00
Adam Williamson 8bc74fd5dc panel: also handle permission request for Clocks
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-04-14 13:54:37 -07:00
Adam Williamson a678f783cb nautilus delete_file: correct name of second file
The second file that we delete and don't restore is called
evince.pdf these days.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-04-11 11:15:05 -07:00