Commit Graph

174 Commits

Author SHA1 Message Date
Adam Williamson a2bbd5ecfb Add some needles for universal tests with btrfs default
The 'universal' tests have quite a few failures if you run them
on an image where btrfs is the default (currently they usually
run on the Server DVD, where xfs-on-LVM is still the default).
This fixes some of them, the others would need code fixes.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-09-11 16:20:12 -07:00
Adam Williamson 86c881db80 Add IoT version "34" needles
IoT is still versioning its 'rawhide' composes, so here.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-08-24 12:49:56 -07:00
Adam Williamson 837f8e88cf Add 33 version ident needle (non-IoT)
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-08-17 17:37:26 -07:00
Adam Williamson 0f072d973a Update anaconda network spoke IPv4 needle for GTK+ change
See https://gitlab.gnome.org/GNOME/gtk/-/issues/2652 . I thought
this was a bug at first but apparently not...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-07-22 12:45:08 -07:00
Dan Čermák 9768ac5178
Fix the install_lang_english_filtered needle for non en_US lang 2020-06-25 23:45:02 +02:00
Adam Williamson 2e21161785 Update various needles for a GNOME symbol change
The little triangle that's used on drop-down menus and stuff got
bigger. That breaks all these needles.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-06-05 14:27:34 -07:00
Lukáš Růžička b5169e602b Use existing needles for fs selection. 2020-05-27 15:54:10 -07:00
Lukáš Růžička d8171958ed Rename needle to correct typo. 2020-05-27 15:54:10 -07:00
Lukáš Růžička c9bc7f0570 Rename needles to match the tag. 2020-05-27 15:54:10 -07:00
Lukáš Růžička 2a3e67991b Whitelist not recognized needles in check-needles.py 2020-05-27 15:54:09 -07:00
Lukáš Růžička 5f1db40ebe Add to templates. 2020-05-27 15:54:09 -07:00
Lukáš Růžička c42f62da14 Create a test for resizing using custom partitioning 2020-05-27 15:54:09 -07:00
Lukáš Růžička 9efb0e10e6 Create a test to resize LVM partitions using Blivet. 2020-05-27 15:54:09 -07:00
Adam Williamson ac602d43b7 Update Japanese 'install done' needle
The button is translated now.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-05-09 10:33:00 -07:00
Adam Williamson 0594fc8d57 Update French user creation screen needle for translation change
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-05-01 16:48:21 -07:00
Adam Williamson 9bad775aae Update a blivet needle for a change to check mark design
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-04-29 12:19:39 -07:00
Adam Williamson 83a394bba2 Update a Boxes needle for a font rendering change
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-04-27 15:06:14 -07:00
Adam Williamson 19677de20a Add variant anaconda keyboard layout needles
There's this weird thing where the vertical alignment of the
language name in the keyboard layout indicator is sometimes
different. I never can figure out why. It may be to do with
presence or absence of the pre-release indicator.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-04-14 12:07:06 -07:00
Adam Williamson 21eea18562 Add a needle check script, remove some unused needles
I call this...The @lruzicka Catcher!

It's a script that checks for needles that aren't actually used
anywhere. It also checks for cases where we have a needle JSON
file but no image, or an image file but no JSON file (and wipes
one case of the latter). It also adds a run of the script to tox
so we get it in CI.

You could make this script a lot more elaborate if you like, by
being fancier about parsing the test code and templates, but I
don't think it's really warranted, I think it just needs to be
'good enough'. It's not the end of the world if it misses the
odd thing or the whitelisting goes stale.

Quite a lot of the removed needles are remnants of different
approaches to app start/stop testing which weren't caught in the
initial PR review. The short-name partitioning ones are odd; they
were introduced in the commit that moved needles into subdirs,
but at least some of them don't actually appear to be moves. They
may have been non-tracked files Josef had lying around that got
into the commit by mistake, or they may just be old needles we
really used at some point but aren't using any more.
reclaim_space_second_partition was introduced as part of the
shrink test (along with reclaim_space_first_partition) but was
never actually used by that test - I guess, again, the test got
re-written during review but we forgot to remove the needle. We
rejigged user creation to use tab presses not a needle match a
while back, which made user_creation_password_input unnecessary.
The various cockpit_updates_* needles are I think remnants of
rewrites of the cockpit update tests that again were missed in
PR review, the tests as merged never used them.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-04-08 16:55:46 -07:00
Adam Williamson ea397783d5 Update French 'accept fate' needle
Verb changed.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-04-02 20:17:42 -07:00
Adam Williamson 6b5e933ff4 Update error_report needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-04-02 20:16:02 -07:00
Adam Williamson dc7b7a7241 Great Needle Cleanup 2020
Remove a bunch of needles that have not been used for some time,
plus a few workarounds that are similarly stale.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-03-20 14:02:10 -07:00
Adam Williamson 608209499d Add Fedora 33 IoT ident needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-03-16 14:17:31 -07:00
Adam Williamson ff1d75050e Update French pre-release note needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-03-12 09:19:04 -07:00
Adam Williamson 948e5f23ae Add missing tags to Russian prerelease note needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-03-12 08:50:05 -07:00
Lukáš Růžička 0557af9a2d Add needle to cover a changed prerelease note for Russian. 2020-03-12 16:17:28 +01:00
Adam Williamson 00f1241318 Update French 'install done' needle
Translation was updated.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-03-10 16:04:45 -07:00
Adam Williamson e5feab11f7 Update iSCSI-related needles for font changes
This test has been failing forever, now the bug is fixed, we need
to update the needles for font changes...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-03-04 09:15:00 -08:00
Adam Williamson 884f71bb81 Revert "Workaround #1805553 (single disk not selected as install target)"
This reverts commit adf3f91818.
The bug has been fixed in anaconda, so we can drop this, which
is good as it has timing issues producing false positives on
Rawhide...
2020-02-26 14:30:08 -08:00
Adam Williamson 95e6ddc896 Update blivet vdb selected needle yet again
I do not know why this needle seems so troublesome...

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-02-25 23:02:29 -08:00
Adam Williamson da28938572 Update prerelease note needle for font rendering change
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-02-25 22:59:14 -08:00
Adam Williamson adf3f91818 Workaround #1805553 (single disk not selected as install target)
Rawhide seems to have developed a bug where a single disk is no
longer automatically selected as the install target when you
enter the INSTALLATION DESTINATION spoke. We need to work around
this (but register it as a soft failure).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-02-20 17:41:34 -08:00
Adam Williamson 54afe23572 Update an iSCSI needle for font changes
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-02-20 12:14:35 -08:00
Adam Williamson deab03a80d Update another partitioning needle for GTK+ widget changes
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-02-20 08:12:16 -08:00
Adam Williamson 2c33325595 Add IoT 32 identification needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-02-20 08:11:52 -08:00
Adam Williamson 8d14addd18 Update two more anaconda needles for smaller radio buttons
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-02-19 10:36:59 -08:00
Adam Williamson 2fda57482b Update anaconda needles for icon/widget changes
Seems some changes to symbolic icons and widgets have happened
in GTK+ or something, this updates anaconda needles for them.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-02-19 09:46:35 -08:00
Adam Williamson 0f8f6082eb Enable IoT testing with install and base tests
IoT is becoming a release-blocking edition for F32, so we should
be testing it for sure. We may add specific tests, but for now
let's run the install and base tests on it.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-02-17 08:36:55 -08:00
Adam Williamson b09936ba0a Update 'select_disk_1' needle
Some kinda font rendering change or something.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-02-17 08:33:57 -08:00
Adam Williamson e5728beada Add version 32 identification needle
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-02-14 16:53:31 -08:00
Adam Williamson 12b0fb04dc Update a ppc64le-only blivet needle for Cantarell 0.201
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-01-24 15:20:54 +01:00
Adam Williamson f8292bfeeb More Cantarell: Russian and French
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-01-18 23:56:11 +00:00
Adam Williamson a653ded877 Next batch of Cantarell needles: Arabic install
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-01-17 15:32:30 +00:00
Adam Williamson 21febe3592 First batch of updates for new version of cantarell
Still need to do the non-English languages. I'll do those
tomorrow.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-01-17 01:18:52 +00:00
Adam Williamson acf27fcd4a Update the blivet 'bluebox-alt' needle used on alt arches
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2020-01-06 10:56:44 -08:00
Adam Williamson 7fbaa426e8 Update a bunch of needles for font rendering change in Rawhide
Not sure what changed; it seems like mostly browser needles got
broken, but there's a few installer needles too.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-11-29 13:00:54 -08:00
Adam Williamson 4f72d4ebd3 Add one missing needle for VNC test
Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-11-05 14:48:25 -08:00
Adam Williamson b82a1dec6f Add test for QA:Testcase_Anaconda_User_Interface_VNC
This adds a test for QA:Testcase_Anaconda_User_Interface_VNC -
the VNC install test case. It's implemented as a server/client
pair, with the server booting from the Server DVD image with
`inst.vnc` and the client booting from the desktop base disk
image, setting up networking, then running Boxes to connect to
the server and run the install.

There are various little tweaks to test loading and logic to
handle this, mostly pretty clear. We also move the workaround
for 'spurious auth prompt appears on desktop after you switch
away to a VT and back' out of the desktop update test and into
the `desktop_vt` helper function, since now this test can hit
it as well. We enhance _graphical_wait_login to handle the boot
loader if needed (it has never needed to until now).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-11-05 14:46:10 -08:00
Adam Williamson 5f38971a78 Add some new variant layout indicator needles
Once again, the text is at a slightly different height to the
needles we already have. I do not know why this sometimes
happens. It's a mystery.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-10-16 16:34:55 -07:00
Adam Williamson b55782358d Don't check version or pre-release note on banners
This reduces the coverage of the identification test a bit but
also *substantially* simplifies it. We run into a ton of problems
when we try to check the version and prerelease text on screens
where it appears on banners:

* The banners differ between variants
* The pre-release text is translated
* The banners have gradients so for RTL languages, even if some
  text is untranslated (e.g. 'Fedora 31') it appears on a
  different background color than on LTR languages
* The prerelease text is dark red; if it appears on a dark blue
  area of the banner this can trigger an os-autoinst needle
  comparison bug: https://progress.opensuse.org/issues/56822

All of this together means we wind up continually fighting these
checks and we have a whole forest of needles just for them, and
it doesn't seem worthwhile. So let's drop all the places where
we were checking version and prerelease on banners, and only
check them in two places where they appear on a grey background,
which avoids most of the problems (we just need one version
needle per release, and one prerelease needle per language).

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2019-10-16 11:08:24 -07:00