Commit Graph

2934 Commits

Author SHA1 Message Date
Adam Williamson 93a58c5496 tox: set ignore_errors
This doesn't actually *ignore* errors, it just means we continue
running commands after one errors out instead of immediately
bailing. This avoids problems like "the tests don't run if
check-needles fails, so then the coverage reports fail because
there's no coverage.xml".

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-09-26 16:16:56 -07:00
Adam Williamson 8cb8836d3f Update check-needles for changes to konversation test
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-09-26 16:14:03 -07:00
Adam Williamson eb6a47f462 Adjust konversation test to run neochat on Rawhide
KDE replaced Konversation (IRC client) with Neochat (Matrix
client) in Rawhide. As the replacement isn't done in F39 we can't
just switch the test out, we have to handle both, so for now,
let's have the "konversation" test run neochat on Rawhide.

We can't really proceed through neochat's first run wizard as
it needs a Matrix account name and password and we don't want
the hassle of handling a secret just for this, so we'll just
quit out once we see it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-09-26 15:53:54 -07:00
Lukas Ruzicka 296b43381a Allow language selection on WebUI installations.
Currently, the installation via WebUI is mostly pushing the Next button
which seems to be ok for the production which is based in the US.

This PR makes openQA to select languages when the  G-I-S runs
before Anaconda. The particular language is selected based on
the LANGUAGE variable.
2023-09-26 00:16:22 +00:00
Lukas Ruzicka d45f2add79 Add a Vilnius needle to support Maps test. 2023-09-25 17:24:12 +02:00
Adam Williamson 8be45cd89e Update Loupe needles
One is for the change from Activities to a UFO in GNOME 45, the
others are recreations of ones we dropped from the PR, because
it really seems like Loupe is a bit unreliable about the zoom
level when rotating the image. Maybe we should file a bug on
that.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-09-22 17:39:33 -07:00
Adam Williamson c267d5f857 Update Maps zoomed out needle
Just a slight change in upstream OSM, I think.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-09-22 17:38:44 -07:00
Adam Williamson 6c5f86cbf8 Update a gnome-text-editor needle for an icon change
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-09-22 17:38:00 -07:00
Adam Williamson 63aae8f162 Update a Help viewer needle
The icon for this section changed a bit.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-09-22 17:37:26 -07:00
Adam Williamson 8f0b5c77e6 Update root_logged_in-noprofile-sh52 needle
I think this actually just reduces the match area slightly
because the existing needle doesn't match if there's a green
bar directly below the prompt. But I didn't make it a change to
the existing needle cos I'm lazy.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-09-22 17:36:12 -07:00
Adam Williamson eef7f5b00f Update krdc_runs needle
The title bar text changed slightly, but let's make the needle
match on some active part of the app instead; this is a better
check, as it's possible for an app to hang with its title bar
showing but not really working.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-09-22 17:35:08 -07:00
Adam Williamson ea7112814f Update Clocks needles for some change in Rawhide
Don't know what changed, some minor styling thing.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-09-22 17:34:34 -07:00
Adam Williamson db7d47d0dd Don't run loupe test on Silverblue yet
Silverblue still has eog. It seems a bit excessive to bring back
the eog test just for Silverblue, so let's just disable loupe
until Silverblue has it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-09-22 13:44:22 -07:00
Adam Williamson e92ddbbece Use shift-tab, not tab, to get to Try button in g-i-s live flow
The latest version of g-i-s grew a "Previous" button on the
final page, and hitting tab once now activates that, not the
Try button. shift-tab *should* get us to Try on both old and
new versions.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-09-21 17:59:34 -07:00
Lukas Ruzicka 863ee33073 Only choose one rotated_left needle. 2023-09-21 13:56:30 +02:00
Lukas Ruzicka 6c3f2c6a3e Replace an incorrect needle with a correct one. 2023-09-21 12:38:37 +02:00
Lukáš Růžička 9e0d74453c Create a test suite for Loupe (Image Viewer)
This PR adds a test for a new Image Viewer called Loupe.
It is based on the old Image Viewer test, newly reneedled
with some of the tests shortened, deleted or edited
as the new Image Viewer has a little bit less functions
compared to the previous one.

Add needles.
2023-09-20 10:29:39 +02:00
Adam Williamson 413dba4c95 Give live image tool install longer to run
It's timing out on stg quite a lot.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-09-19 12:47:35 -07:00
Adam Williamson bc20de5f14 Update imageviewer needle for Loupe in utilities menu
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-09-18 12:29:05 -07:00
Adam Williamson e37322d631 Update Maps website opened needle
Same URL change we saw in another app, I think.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-09-18 12:28:16 -07:00
Adam Williamson 27604ea521 Update a KDE notifications needle
I think this is still for the new backgrounds.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-09-18 12:27:16 -07:00
Adam Williamson 16a35b5b6c Update GNOME panel needles
For some change from last week. I forget what it was.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-09-18 12:26:28 -07:00
Adam Williamson 836f8e2da6 Revert "apps_startstop: new GNOME image viewer is not in Utilities"
This reverts commit 0d8df76b1b.
Loupe now seems to have been moved down into Utilities like eog
was, so revert this.
2023-09-18 08:48:38 -07:00
Lukas Ruzicka 380a8d5dd6 Revert "Add print."
This reverts commit e977a70cb0.

By mistake, I pushed into the main branch.
2023-09-14 12:56:26 +02:00
Lukas Ruzicka e977a70cb0 Add print. 2023-09-14 12:45:24 +02:00
Adam Williamson ea8500cf07 Various changes for webUI deferral to F40
webUI has been deferred to F40, so we need to expect the old UI
flow on F39 now. This should cover everything, I hope.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-09-12 16:13:49 -07:00
Adam Williamson 2458ff7580 Adjust tests to handle webUI reversion
We're reverting webUI for Fedora 39.
https://bodhi.fedoraproject.org/updates/FEDORA-2023-73c4f1a802
is the update that implements this; adapt the tests to handle it
(by expecting the old flow when testing that update, and editing
the kickstart to drop anaconda-webui when building the live
image).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-09-12 11:09:52 -07:00
Adam Williamson 20a3deb11c Drop English tag on new apps_menu_button needles
They're not English-specific any more, since they're not text.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-09-08 23:59:55 -07:00
Adam Williamson 82ae0a3b81 gnome-initial-setup: handle keyboard being skipped
We now have a fix for the bug on the new webUI flow where the
language and keyboard screens weren't skipped on the first boot
after install, as intended. language is never *really* skipped -
it just turns into welcome - but keyboard is now being skipped,
which messes up the logic here.

For a short time we need to handle both paths, to get the new
anaconda builds through and new composes built. In a couple of
days we can simplify this to just always assume keyboard will
be skipped on the first boot on Workstation live installs on
F39+.

Also drop handling of auth_required in g-i-s - I'm pretty sure
that bug got fixed years ago - and wait_still_screen for three
seconds on each page, to let animated transitions settle.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-09-07 13:11:45 -07:00
Adam Williamson ccfef0d168 Retry setting root password on live
This seems to have started failing periodically at the start of
this month, I've no idea why. For now, let's retry it a few
times and see if that helps.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-09-07 08:34:16 -07:00
Adam Williamson d8efb7df1d installer_build: fix image upload on non-x86_64
Let's not hardcode the arch in the upload_asset call!

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-09-06 17:24:35 -07:00
Adam Williamson deb25acdf9 installer_build: install hfsplus-tools on ppc64le
We need this on ppc64le. Never tried running this test on it
before.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-09-06 16:43:36 -07:00
Adam Williamson 45c1dd465f Add a variant console_in_toolbox needle
Seems like sometimes the purple blob looks a bit different,
somehow? Dunno why.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-09-06 14:53:35 -07:00
Adam Williamson fc130c5202 Update Characters 'website opened' needle
Seems the displayed URL changed a bit.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-09-06 14:52:45 -07:00
Adam Williamson 7362323cef Update GNOME overview button needles for 45-rc
The button to open the overview no longer says Activities.
Instead it's a...flat...oval...thingy. Okay! New needles.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-09-06 14:51:20 -07:00
Adam Williamson 636d16e122 More needle updates for F39 backgrounds
Add the dark background variant, and update KDE systray needles
(thanks, translucency!)

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-09-06 14:50:32 -07:00
Adam Williamson bca01de5e7 Give toolbox install a bit longer to run
It seems psst-selinux scripts can take a *long* time and this
test is sometimes timing out here.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-09-06 12:33:01 -07:00
Adam Williamson e283bf6718 Add F39 Beta day background needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-09-01 23:23:36 -07:00
Adam Williamson 4976c83f5e Update a couple of GNOME needles for appearance changes today
I guess this is related to the cluster of GNOME bits that was
updated recently. Just a slightly different background color for
the control-center sidebar, and slightly different rendering of
the misspelling red dot underline in gte.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-31 18:35:59 -07:00
Adam Williamson d05a215ad5 Run toolbox test on KDE as well
There's no obvious reason it'd ever give a different result on
KDE vs. Workstation, but since we added a matrix box for it on
both, we'd better run it on both.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-29 15:08:09 -07:00
sumantrom b9afdc8ae7 add toolbox test case with basic func to create, list, start and stop 2023-08-29 07:59:24 +05:30
Adam Williamson c28ef7a3af Revert "Update apps_run_terminal needle"
This reverts commit a2c6f88fab.
Turns out this change was a bug in adobe-source-code-pro-fonts -
if we see this again, it's bad news and we shouldn't accept it.
2023-08-28 17:09:25 -07:00
Adam Williamson a2c6f88fab Update apps_run_terminal needle
I think this is either a font change or an update to the color
prompt Change, not sure which.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-28 16:02:03 -07:00
Adam Williamson 8f888317b5 anaconda_help: create test plans before the first assert_screen
So we can bail early enough on webUI.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-25 14:55:20 -07:00
Adam Williamson d9ebb56ebf Sigh, it's record_soft_failure, not register_soft_failure
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-25 14:51:35 -07:00
Adam Williamson 539f8a54fc Effectively skip anaconda_help on F39+ Workstation live for now
There isn't any Help in the webUI installer, really. In future
it's meant to have more 'contextual' help - little question
mark icons next to elements of the UI that explain them when
clicked on - which we could implement tests for, but this isn't
done yet.

Let's not skip scheduling the test entirely, because we can
still run it on F38 respins, and we may be able to implement
testing of the contextual help in future. So let's just soft
fail and return immediately. If we get to F39 stable without
the contextual help being implemented (or it turns out not to
be testable within the confines of this design), we can skip
scheduling the test on webUI images entirely.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-25 14:48:42 -07:00
Adam Williamson df1c9037d6 Add a missing ; in utils.pm
I've no idea how this isn't making things crash?

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-25 14:38:40 -07:00
Adam Williamson e854035816 Update several Maps needles for routing
Seems the button color changed a bit.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-08-24 23:51:54 -07:00
Adam Williamson 5eeeacc77e Revert "Add new ImageViewer needle."
This reverts commit de83ea13ba. I
already added a needle for this yesterday, this seems to be a
dupe.
2023-08-24 23:50:19 -07:00
Lukas Ruzicka de83ea13ba Add new ImageViewer needle. 2023-08-24 14:07:24 +02:00