os-autoinst-distri-fedora/tests
Adam Williamson 5cab5ec565 Move most 'universal' tests to Server-dvd-iso
The 'universal' flavor has been kinda pointless for some time
now. It dates back to the earliest days of openQA, before Pungi
4 was a thing, when composes were very different; we only built
a boot.iso and some live images nightly for Rawhide, these
weren't even formally grouped as a 'compose' at all (fedfind had
to invent the concept). The TCs/RCs had DVD installer images
(not *Server* DVD, at the time, just a universal DVD installer).
We wanted to run some tests on the DVD image if it was available,
but we still wanted to run them for the nightlies, so we invented
a whole mechanism for that - this 'universal' flavor, with some
complicated logic in fedora_openqa which schedules universal on
the 'best available' image it can find in the compose.

All this is functionally obsolete now. All composes we test are
now run through Pungi (except the live respins, but they aren't
relevant here). In current config, the Server DVD is non-failable
on x86_64 and aarch64, which means it will *always be there* -
if it fails to build, the compose itself fails, so we won't test
it. It's failable for ppc64le, but we don't care that much about
ppc64le; I'm fine with these tests just not running if the Server
DVD happens to fail in a ppc64le compose.

As a cherry on top, some of the 'universal' tests aren't really
universal anyway, they fail if you run them on a netinst (off
the top of my head, all the NFS install tests are like this, as
we use the ISO to populate the NFS share on the server end).

So let's just move all the tests that actually need an installer
image to the Server-dvd-iso flavor. Left over in the 'universal'
flavor are upgrade tests, which don't need an ISO at all - they
boot from hard disk images and run an upgrade using repos. We
can change the scheduler logic to be more simple for these, and
just always schedule them, with no ISO attached. We could even
rename this flavor 'upgrade', but it might not be worth it.

One slight complication is that the split happened to be helping
us avoid too many tests in a single support_server cluster; we
have a cluster of five support_server tests on Server-dvd-iso
and five support_server tests on universal. I try to avoid the
clusters getting too big as you need as many worker instances on
at least one worker host as your largest cluster; if you don't
have that many, the cluster's tests simply never get scheduled.
Requiring folks to have at least ten worker instances on one
host to run these tests is a bit of a big ask. So, to handle
that, we create a support_server_2 and have the former universal
tests use that one instead, so we'll have two separate clusters
on Server-dvd-iso now.

Signed-off-by: Adam Williamson <awilliam@redhat.com>
2023-05-03 16:29:38 -07:00
..
applications Robustify the scrolling in the Help app test 2023-05-02 09:37:02 -07:00
apps_startstop Fix KDE media writer launch test 2023-04-06 11:23:57 -07:00
_addrepo_metalink_post.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
_advisory_post.pm Revert "Update live install tests: handle awkward install ordering" 2023-02-22 15:55:24 -08:00
_advisory_update.pm Revert "_advisory_update: stop the graphical desktop at the start" 2022-11-18 12:23:33 -08:00
_anaconda_network_static.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
_boot_to_anaconda.pm Update serial console handling for upstream changes 2023-05-02 12:24:26 -07:00
_check_install_source.pm _check_install_source: more fixes for upstream changes 2023-04-14 14:04:51 -07:00
_collect_data.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
_console_avc_crash.pm Don't snapshot after wait_login tests (usually) 2022-12-08 09:59:23 -08:00
_console_login.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
_console_shutdown.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
_console_wait_login.pm Don't snapshot after wait_login tests (usually) 2022-12-08 09:59:23 -08:00
_console_wait_login_2.pm Workaround issues with loading same module more than once 2017-04-18 10:38:16 -07:00
_coreos_install.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
_do_install_and_reboot.pm Update notes about clicking root password screen in anaconda 2022-12-13 14:34:34 -08:00
_graphical_input.pm graphical_input: also type hotkey on the *second* attempt 2023-03-03 10:28:43 -08:00
_graphical_input_2.pm Workaround issues with loading same module more than once 2017-04-18 10:38:16 -07:00
_graphical_wait_login.pm Drop similarity level on a wait_still_screen with a cursor 2023-02-23 15:06:07 -08:00
_graphical_wait_login_2.pm Workaround issues with loading same module more than once 2017-04-18 10:38:16 -07:00
_installer_build.pm Use buildroot repo for Rawhide image builds also 2022-12-12 08:42:18 -08:00
_iot_zezere_remote.pm Revert "zezere: tweak for web UI change" 2023-03-02 15:02:14 -08:00
_iot_zezere_server.pm Be a bit more defensive when setting admin pw in zezere server 2023-03-29 15:45:17 -07:00
_live_build.pm live_build: temporarily drop a newly-added group in KDE kickstart 2023-03-30 11:20:51 -07:00
_memcheck.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
_ostree_build.pm _ostree_build: use koji-rawhide.repo in lorax command 2023-03-18 08:37:01 -07:00
_podman_client.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
_post_network_static.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
_setup_browser.pm Clean up minimal browser environment setup 2023-03-02 13:51:08 -08:00
_snapshot_only.pm Don't snapshot after wait_login tests (usually) 2022-12-08 09:59:23 -08:00
_software_selection.pm Drop all handling of MODULAR 2022-12-15 11:10:40 -08:00
_support_server.pm Move most 'universal' tests to Server-dvd-iso 2023-05-03 16:29:38 -07:00
_vnc_client_connect.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
_vnc_client_connect_pre.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
_vncconnect_client_setup.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
_vncconnect_client_setup_pre.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
anaconda_help.pm Update notes about clicking root password screen in anaconda 2022-12-13 14:34:34 -08:00
apps_gnome_preset.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
autocloud.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
base_package_install_remove.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
base_reboot_unmount.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
base_selinux.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
base_service_manipulation.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
base_services_start.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
base_system_logging.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
base_update_cli.pm Use pandoc-common instead of python3-kickstart for package tests 2023-03-18 09:44:02 -07:00
btrfs_preserve_home_check_content.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
check_default_fonts.pm tidy lukas' change to the arabic fonts test 2022-10-24 14:56:30 -07:00
database_client.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
desktop_background.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
desktop_browser.pm desktop_browser: handle addon add button not always being visible 2023-01-26 22:58:14 -08:00
desktop_fprint.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
desktop_login.pm desktop_login: also give assert_shutdown longer 2023-02-18 12:27:52 -08:00
desktop_notifications.pm KDE doesn't show welcome tour on live any more, drop handling 2023-04-06 10:31:17 -07:00
desktop_printing.pm desktop_printing: drop gedit, F35 is EOL 2022-12-13 14:34:34 -08:00
desktop_terminal.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
desktop_update_graphical.pm Revert "Fix desktop_update_graphical tests for pykickstart updates" 2023-03-18 09:39:19 -07:00
disk_custom_blivet_btrfs.pm Create biosboot partitions in blivet tests 2022-08-16 15:39:38 -04:00
disk_custom_blivet_btrfs_preserve_home.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
disk_custom_blivet_lvm_ext4.pm Create biosboot partitions in blivet tests 2022-08-16 15:39:38 -04:00
disk_custom_blivet_lvmthin.pm Create biosboot partitions in blivet tests 2022-08-16 15:39:38 -04:00
disk_custom_blivet_resize_lvm.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
disk_custom_blivet_software_raid.pm Create biosboot partitions in blivet tests 2022-08-16 15:39:38 -04:00
disk_custom_blivet_standard_partition_ext4.pm Create biosboot partitions in blivet tests 2022-08-16 15:39:38 -04:00
disk_custom_blivet_standard_partition_ext4_postinstall.pm Create biosboot partitions in blivet tests 2022-08-16 15:39:38 -04:00
disk_custom_blivet_with_swap.pm Create biosboot partitions in blivet tests 2022-08-16 15:39:38 -04:00
disk_custom_blivet_xfs.pm Create biosboot partitions in blivet tests 2022-08-16 15:39:38 -04:00
disk_custom_btrfs.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
disk_custom_btrfs_postinstall.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
disk_custom_btrfs_preserve_home.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
disk_custom_iscsi.pm Move most 'universal' tests to Server-dvd-iso 2023-05-03 16:29:38 -07:00
disk_custom_iscsi_postinstall.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
disk_custom_lvm_ext4.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
disk_custom_lvm_ext4_postinstall.pm Create biosboot partitions in blivet tests 2022-08-16 15:39:38 -04:00
disk_custom_lvmthin.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
disk_custom_lvmthin_postinstall.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
disk_custom_resize_lvm.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
disk_custom_resize_lvm_postinstall.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
disk_custom_software_raid.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
disk_custom_software_raid_postinstall.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
disk_custom_standard_partition_ext4.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
disk_custom_standard_partition_ext4_postinstall.pm Create biosboot partitions in blivet tests 2022-08-16 15:39:38 -04:00
disk_custom_with_swap.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
disk_custom_with_swap_postinstall.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
disk_custom_xfs.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
disk_custom_xfs_postinstall.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
disk_guided_delete_all.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
disk_guided_delete_partial.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
disk_guided_delete_partial_postinstall.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
disk_guided_empty.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
disk_guided_encrypted.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
disk_guided_encrypted_postinstall.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
disk_guided_encrypted_postinstall_2.pm Workaround issues with loading same module more than once 2017-04-18 10:38:16 -07:00
disk_guided_free_space_postinstall.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
disk_guided_multi.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
disk_guided_multi_empty_all.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
disk_guided_multi_empty_all_postinstall.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
disk_guided_multi_postinstall.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
disk_guided_shrink.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
disk_guided_shrink_postinstall.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
fedora_release.pm Revert "Fix the os_release.pm and fedora_release.pm." 2022-02-09 09:59:45 -08:00
firewall_configured.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
firewall_disabled.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
freeipa_client.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
freeipa_password_change.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
freeipa_webui.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
install_source_graphical.pm More fixes to anaconda additional repository flow 2023-01-23 15:32:07 -08:00
install_text.pm Update serial console handling for upstream changes 2023-05-02 12:24:26 -07:00
iot_clevis.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
iot_greenboot.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
iot_zezere_ignition.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
mediakit_fileconflicts.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
mediakit_repoclosure.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
modularity_checkdefaults.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
modularity_enable_disable_module.pm Fix the modularity tests by selecting existing modules. 2022-08-17 14:18:39 +02:00
modularity_install_module.pm Fix the modularity tests by selecting existing modules. 2022-08-17 14:18:39 +02:00
modularity_module_list.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
modularity_update_norepo.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
os_release.pm os_release: drop a now-unneeded > 34 conditional 2022-12-13 12:45:20 -08:00
podman.pm Give podman a bit longer to install 2023-04-22 16:35:22 -07:00
preinstall_iso_in_hd.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
realmd_join_cockpit.pm cockpit: don't try and get admin privs when re-logging in 2022-11-25 11:24:52 -08:00
realmd_join_sssd.pm Re-enable dnssec for all FreeIPA tests 2022-09-19 12:28:17 -07:00
rescue_mode_encrypted.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
role_deploy_database_server.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
role_deploy_domain_controller.pm Simplify condition for disabling dnssec on FreeIPA upgrade test 2022-12-13 12:45:20 -08:00
role_deploy_domain_controller_check.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
rpmostree_overlay.pm rpmostree_overlay: try to cancel running operations 2023-01-26 17:02:49 -08:00
rpmostree_rebase.pm Disable audit messages on ostree rebase tests on aarch64 2023-03-29 14:29:52 -07:00
server_cockpit_autoupdate.pm cockpit_autoupdate: update note on the 30s sleep workaround 2022-12-13 14:34:05 -08:00
server_cockpit_basic.pm cockpit: don't try and get admin privs when re-logging in 2022-11-25 11:24:52 -08:00
server_cockpit_default.pm cockpit: don't try and get admin privs when re-logging in 2022-11-25 11:24:52 -08:00
server_cockpit_updates.pm cockpit: don't try and get admin privs when re-logging in 2022-11-25 11:24:52 -08:00
server_filesystem_default.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
server_firewall_default.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
server_remote_logging_client.pm ...and in the other file too. 2022-12-24 13:42:16 -08:00
server_remote_logging_server.pm remote_logging_server: sleep at the end 2022-12-24 14:30:03 -08:00
text_login_gui.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
uefi_postinstall.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
unwanted_packages.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
upgrade_boot.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
upgrade_postinstall.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
upgrade_preinstall.pm Disable updates-testing during upgrade_preinstall 2022-09-15 10:18:26 -07:00
upgrade_run.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00
workstation_core_applications.pm Add a perltidy check and apply it to the entire codebase 2022-07-28 14:38:38 -07:00