From Fedora Project Wiki

(Testcase_base_initial_setup is now both Basic and Final)
(revise environments: split between rpm-based and rpm-ostree-based, update environment sets to reflect what's currently built, add rpm-ostree tests)
(6 intermediate revisions by 3 users not shown)
Line 19: Line 19:
| Basic
| Basic
| [[QA:Testcase_base_reboot_unmount]]
| [[QA:Testcase_base_reboot_unmount]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Basic
| [[QA:Testcase_base_selinux]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 55: Line 61:
| Final
| Final
| [[QA:Testcase_base_services_start]]
| [[QA:Testcase_base_services_start]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Final
| [[QA:Testcase_base_selinux]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 74: Line 74:
<references/>
<references/>


==== Release-blocking environments (ARM) ====
==== Release-blocking environments (aarch64) ====
{| class="wikitable sortable mw-collapsible" width=100%
{| class="wikitable sortable mw-collapsible" width=100%
! Milestone !! Test Case  !! Workstation !! Minimal
! Milestone !! Test Case  !! Workstation !! Server !! Minimal
|-
|-
| Basic/Final
| Basic/Final
| [[QA:Testcase_base_initial_setup]]
| [[QA:Testcase_base_initial_setup]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 85: Line 86:
| Basic
| Basic
| [[QA:Testcase_base_startup]]
| [[QA:Testcase_base_startup]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 90: Line 92:
| Basic
| Basic
| [[QA:Testcase_base_reboot_unmount]]
| [[QA:Testcase_base_reboot_unmount]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Basic
| [[QA:Testcase_base_selinux]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 95: Line 104:
| Basic
| Basic
| [[QA:Testcase_base_system_logging]]
| [[QA:Testcase_base_system_logging]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 100: Line 110:
| Basic
| Basic
| [[QA:Testcase_base_update_cli]]
| [[QA:Testcase_base_update_cli]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 105: Line 116:
| Basic / Beta
| Basic / Beta
| [[QA:Testcase_package_install_remove]]
| [[QA:Testcase_package_install_remove]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 110: Line 122:
| Basic / Final
| Basic / Final
| [[QA:Testcase_base_artwork_release_identification]]
| [[QA:Testcase_base_artwork_release_identification]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 115: Line 128:
| Final
| Final
| [[QA:Testcase_base_edition_self_identification]]
| [[QA:Testcase_base_edition_self_identification]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 121: Line 135:
| [[QA:Testcase_base_services_start]]
| [[QA:Testcase_base_services_start]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Final
| [[QA:Testcase_base_selinux]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 130: Line 140:
| Final
| Final
| [[QA:Testcase_base_service_manipulation]]
| [[QA:Testcase_base_service_manipulation]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 166: Line 177:
<references/>
<references/>


==== Non-blocking environments (x86_64) ====
==== RPM-based non-blocking environments (x86_64) ====
{| class="wikitable sortable mw-collapsible" width=100%
{| class="wikitable sortable mw-collapsible" width=100%
! Milestone !! Test Case  !! Xfce !! Cinnamon !! MATE !! LXDE !! LXqt !! Sugar !! Silverblue
! Milestone !! Test Case  !! Xfce !! Cinnamon !! MATE !! LXDE !! LXqt !! Sugar
|-
|-
| Optional
| Optional
| [[QA:Testcase_base_initial_setup]]
| [[QA:Testcase_base_initial_setup]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 182: Line 192:
| Optional
| Optional
| [[QA:Testcase_base_startup]]
| [[QA:Testcase_base_startup]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 192: Line 201:
| Optional
| Optional
| [[QA:Testcase_base_reboot_unmount]]
| [[QA:Testcase_base_reboot_unmount]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 202: Line 210:
| Optional
| Optional
| [[QA:Testcase_base_system_logging]]
| [[QA:Testcase_base_system_logging]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 212: Line 219:
| Optional
| Optional
| [[QA:Testcase_base_update_cli]]
| [[QA:Testcase_base_update_cli]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 228: Line 234:
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
|-
|-
| Optional
| Optional
| [[QA:Testcase_base_artwork_release_identification]]
| [[QA:Testcase_base_artwork_release_identification]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 242: Line 246:
| Optional
| Optional
| [[QA:Testcase_base_edition_self_identification]]
| [[QA:Testcase_base_edition_self_identification]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 252: Line 255:
| Optional
| Optional
| [[QA:Testcase_base_services_start]]
| [[QA:Testcase_base_services_start]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 262: Line 264:
| Optional
| Optional
| [[QA:Testcase_base_selinux]]
| [[QA:Testcase_base_selinux]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 272: Line 273:
| Optional
| Optional
| [[QA:Testcase_base_service_manipulation]]
| [[QA:Testcase_base_service_manipulation]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 283: Line 283:
<references/>
<references/>


==== Non-blocking environments (ARM) ====
==== rpm-ostree-based non-blocking environments (x86_64) ====
{| class="wikitable sortable mw-collapsible" width=100%
{| class="wikitable sortable mw-collapsible" width=100%
! Milestone !! Test Case  !! !! Server !! Cinnamon !! Xfce !! MATE !! LXDE !! LXqt !! Sugar
! Milestone !! Test Case  !! Silverblue !! Kinoite
|-
|-
| Optional
| Optional
| [[QA:Testcase_base_initial_setup]]
| [[QA:Testcase_base_initial_setup]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_base_startup]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_base_reboot_unmount]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_base_system_logging]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
|-
| Optional
| Optional
| [[QA:Testcase_base_startup]]
| [[QA:Testcase_RpmOstree_Rebase]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_RpmOstree_Package_Layering]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_base_artwork_release_identification]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_base_edition_self_identification]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
|-
| Optional
| Optional
| [[QA:Testcase_base_reboot_unmount]]
| [[QA:Testcase_base_services_start]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_base_selinux]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_base_service_manipulation]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
|}
<references/>
==== RPM-based non-blocking environments (ARM) ====
{| class="wikitable sortable mw-collapsible" width=100%
! Milestone !! Test Case !! KDE !! Xfce !! LXQt !! Sugar
|-
|-
| Optional
| Optional
| [[QA:Testcase_base_system_logging]]
| [[QA:Testcase_base_initial_setup]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_base_startup]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 328: Line 364:
|-
|-
| Optional
| Optional
| [[QA:Testcase_base_update_cli]]
| [[QA:Testcase_base_reboot_unmount]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_base_system_logging]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 338: Line 378:
|-
|-
| Optional
| Optional
| [[QA:Testcase_package_install_remove]]
| [[QA:Testcase_base_update_cli]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_package_install_remove]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 349: Line 393:
| Optional
| Optional
| [[QA:Testcase_base_artwork_release_identification]]
| [[QA:Testcase_base_artwork_release_identification]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 359: Line 400:
| Optional
| Optional
| [[QA:Testcase_base_edition_self_identification]]
| [[QA:Testcase_base_edition_self_identification]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 372: Line 410:
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_base_selinux]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 378: Line 420:
|-
|-
| Optional
| Optional
| [[QA:Testcase_base_selinux]]
| [[QA:Testcase_base_service_manipulation]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
|}
<references/></onlyinclude>
==== rpm-ostree-based non-blocking environments (ARM) ====
{| class="wikitable sortable mw-collapsible" width=100%
! Milestone !! Test Case  !! Kinoite
|-
| Optional
| [[QA:Testcase_base_initial_setup]]
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_base_startup]]
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_base_reboot_unmount]]
| {{result|none}}
| {{result|none}}
|-
|-
| Optional
| Optional
| [[QA:Testcase_base_service_manipulation]]
| [[QA:Testcase_base_system_logging]]
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_RpmOstree_Rebase]]
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_RpmOstree_Package_Layering]]
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_base_artwork_release_identification]]
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_base_edition_self_identification]]
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_base_services_start]]
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[QA:Testcase_base_selinux]]
| {{result|none}}
|-
| Optional
| [[QA:Testcase_base_service_manipulation]]
| {{result|none}}
| {{result|none}}
|-
|-
|}
|}
<references/></onlyinclude>
<references/>


[[Category:QA_test_matrix_templates|01]]
[[Category:QA_test_matrix_templates|01]]

Revision as of 17:24, 16 December 2022

Template documentation [edit]

This documentation is transcluded from Template:Base test matrix/doc. It will not be transcluded on pages that use this template.
Warning.png
Wikitcms core page
This page is a core component of the Wikitcms system for storing release validation testing results in the Fedora wiki. This system relies on specific expectations regarding page naming, contents, and categorization. Please take special care when editing this page, especially if you change any element of wiki syntax, especially templating elements. If you are at all unsure about the consequences of your planned change, please contact the QA group before applying it.
This template contains the Base 'test matrix' of test cases that are usually executed as part of release validation testing. It is pulled into release validation results pages using several nested templates, and can be used in other pages as appropriate. If all you need to do is add, remove or edit a Base validation test case, though, don't worry about that stuff, and put it in here.
Note.png
Cloud
The Cloud edition is not included on this page because all the same tests are present on the Cloud validation page.

Release-blocking environments (x86_64)

Milestone Test Case Workstation Server KDE
Basic/Final QA:Testcase_base_initial_setup
none
none
Basic QA:Testcase_base_startup
none
none
none
Basic QA:Testcase_base_reboot_unmount
none
none
none
Basic QA:Testcase_base_selinux
none
none
none
Basic QA:Testcase_base_system_logging
none
none
none
Basic QA:Testcase_base_update_cli
none
none
none
Basic / Beta QA:Testcase_package_install_remove
none
none
none
Basic / Final QA:Testcase_base_artwork_release_identification
none
none
none
Final QA:Testcase_base_edition_self_identification
none
none
none
Final QA:Testcase_base_services_start
none
none
none
Final QA:Testcase_base_service_manipulation
none
none
none


Release-blocking environments (aarch64)

Milestone Test Case Workstation Server Minimal
Basic/Final QA:Testcase_base_initial_setup
none
none
none
Basic QA:Testcase_base_startup
none
none
none
Basic QA:Testcase_base_reboot_unmount
none
none
none
Basic QA:Testcase_base_selinux
none
none
none
Basic QA:Testcase_base_system_logging
none
none
none
Basic QA:Testcase_base_update_cli
none
none
none
Basic / Beta QA:Testcase_package_install_remove
none
none
none
Basic / Final QA:Testcase_base_artwork_release_identification
none
none
none
Final QA:Testcase_base_edition_self_identification
none
none
none
Final QA:Testcase_base_services_start
none
none
none
Final QA:Testcase_base_service_manipulation
none
none
none


Modularity

Milestone Test Case Result
Optional QA:Testcase_Modularity_module_list
none
Optional QA:Testcase_Modularity_enable-disable_module
none
Optional QA:Testcase_Modularity_install_module
none
Optional QA:Testcase_Modularity_update_without_repos
none
Optional QA:Testcase_Modularity_update_module
none


RPM-based non-blocking environments (x86_64)

Milestone Test Case Xfce Cinnamon MATE LXDE LXqt Sugar
Optional QA:Testcase_base_initial_setup
none
none
none
none
none
none
Optional QA:Testcase_base_startup
none
none
none
none
none
none
Optional QA:Testcase_base_reboot_unmount
none
none
none
none
none
none
Optional QA:Testcase_base_system_logging
none
none
none
none
none
none
Optional QA:Testcase_base_update_cli
none
none
none
none
none
none
Optional QA:Testcase_package_install_remove
none
none
none
none
none
none
Optional QA:Testcase_base_artwork_release_identification
none
none
none
none
none
none
Optional QA:Testcase_base_edition_self_identification
none
none
none
none
none
none
Optional QA:Testcase_base_services_start
none
none
none
none
none
none
Optional QA:Testcase_base_selinux
none
none
none
none
none
none
Optional QA:Testcase_base_service_manipulation
none
none
none
none
none
none


rpm-ostree-based non-blocking environments (x86_64)

Milestone Test Case Silverblue Kinoite
Optional QA:Testcase_base_initial_setup
none
none
Optional QA:Testcase_base_startup
none
none
Optional QA:Testcase_base_reboot_unmount
none
none
Optional QA:Testcase_base_system_logging
none
none
Optional QA:Testcase_RpmOstree_Rebase
none
none
Optional QA:Testcase_RpmOstree_Package_Layering
none
none
Optional QA:Testcase_base_artwork_release_identification
none
none
Optional QA:Testcase_base_edition_self_identification
none
none
Optional QA:Testcase_base_services_start
none
none
Optional QA:Testcase_base_selinux
none
none
Optional QA:Testcase_base_service_manipulation
none
none


RPM-based non-blocking environments (ARM)

Milestone Test Case KDE Xfce LXQt Sugar
Optional QA:Testcase_base_initial_setup
none
none
none
none
Optional QA:Testcase_base_startup
none
none
none
none
Optional QA:Testcase_base_reboot_unmount
none
none
none
none
Optional QA:Testcase_base_system_logging
none
none
none
none
Optional QA:Testcase_base_update_cli
none
none
none
none
Optional QA:Testcase_package_install_remove
none
none
none
none
Optional QA:Testcase_base_artwork_release_identification
none
none
none
none
Optional QA:Testcase_base_edition_self_identification
none
none
none
none
Optional QA:Testcase_base_services_start
none
none
none
none
Optional QA:Testcase_base_selinux
none
none
none
none
Optional QA:Testcase_base_service_manipulation
none
none
none
none


rpm-ostree-based non-blocking environments (ARM)

Milestone Test Case Kinoite
Optional QA:Testcase_base_initial_setup
none
Optional QA:Testcase_base_startup
none
Optional QA:Testcase_base_reboot_unmount
none
Optional QA:Testcase_base_system_logging
none
Optional QA:Testcase_RpmOstree_Rebase
none
Optional QA:Testcase_RpmOstree_Package_Layering
none
Optional QA:Testcase_base_artwork_release_identification
none
Optional QA:Testcase_base_edition_self_identification
none
Optional QA:Testcase_base_services_start
none
Optional QA:Testcase_base_selinux
none
Optional QA:Testcase_base_service_manipulation
none
Retrieved from "https://fedoraproject.org/w/index.php?title=Template:Base_test_matrix&oldid=663567"