Template documentation [edit]
- This documentation is transcluded from Template:Installation test matrix/doc. It will not be transcluded on pages that use this template.
Wikitcms core pageThis page is a core component of the
Wikitcms system for storing
release validation testing results in the Fedora wiki. This system relies on specific expectations regarding page naming, contents, and categorization. Please
take special care when editing this page, especially if you change any element of wiki syntax, especially templating elements. If you are at all unsure about the consequences of your planned change, please contact the
QA group before applying it.
This template contains the Installation 'test matrix' of test cases that are usually executed as part of
release validation testing. It is pulled into release validation results pages using several nested templates, and can be used in other pages as appropriate. If all you need to do is add, remove or edit a Installation validation test case, though, don't worry about that stuff, and put it in here.
Please click [show] in each table to view the tests of each media installation, and click [edit] to post your test results using the syntax in Key Section.
Image sanity
Details
The result column titles are variants in Pungi/productmd parlance. For each variant, the checksums for all images in that variant can be checked; the maximum size for all images in that variant which have a maximum size can be checked; and repoclosure and fileconflicts can be checked for any DVD image in that variant. Any failure for any tested image should be filed as a bug and reported as a failure here. Please provide the bug ID and a short note of exactly which image(s) failed as a comment.
Default boot and install (x86_64)
Single test tableIn all of these tests, the test case used is
QA:Testcase_Boot_default_install. That is where the links point. The same test needs to be run for multiple images, target platforms, and install media. Note that the non-installer-based AArch64 disk images are covered by the later
#AArch64 disk images section. The
VM columns are for results from testing in a virtual machine. The
CD/DVD columns are for results from testing on a real system with the image written to a real CD or DVD. The
USB columns are for results from testing on a real system with the image written to a USB stick.
Expected coverageFor Beta, we expect a reasonable sampling of tests across the table, with at least some testing for VM and USB boot method, both firmware types, and each major class of deliverable (netinst, live and DVD). For Final, we expect full coverage for
Basic / Final rows with VM and USB boot method. Optical boot testing from physical media in Final is optional (but blocking if issues are found) for
supported images.
Default boot and install (aarch64)
Single test tableIn all of these tests, the test case used is
QA:Testcase_Boot_default_install. That is where the links point. The same test needs to be run for multiple targets. Note that the non-installer-based disk images are covered by the later
#AArch64 disk images section. The
VM UEFI column is for results from testing in a virtual machine. The
USB UEFI column is for results from testing on a real system with the image written to a USB stick.
Expected coverage
For Beta, we expect full coverage of the VM UEFI tests, and at least one USB UEFI test. For Final, we expect full coverage.
Fedora Media Writer
Milestone |
Test Case |
Fedora 39 |
Fedora 40 |
Fedora 41 |
Windows 10 |
Windows 11 |
macOS
|
Beta / Optional
|
QA:Testcase_USB_fmw
|
none
|
none
|
none
|
none
|
none
|
none
|
AArch64 disk images
Single test tableIn all of these tests, the test case used is
QA:Testcase_arm_image_deployment. That is where the links point. The same test needs to be run for multiple images and target platforms.
Milestone |
Image |
aarch64 VM |
aarch64 HW
|
Basic
|
Minimal
|
none
|
none
|
Basic / Optional
|
Workstation
|
none
|
none
|
Basic / Optional
|
Server
|
none
|
none
|
Basic / Optional
|
KDE
|
none
|
none
|
Optional
|
Xfce
|
none
|
none
|
Optional
|
SoaS
|
none
|
none
|
PXE boot
Virtualization
Storage devices
Guided storage configuration
Guided storage shrinking
Environments
For this test, the column headings refer to the storage volume type to be shrunk, not the one chosen to replace it for the new installation.
Custom storage configuration
Advanced custom storage configuration
User interface
Installation repositories
Package sets
Kickstart
Upgrade
Internationalization and Localization
Miscellaneous