Template:Base test matrix: Difference between revisions

Revision as of 23:43, 29 October 2020

Template documentation [edit]

This documentation is transcluded from Template:Base test matrix/doc. It will not be transcluded on pages that use this template.

Wikitcms core page
This page is a core component of the Wikitcms system for storing release validation testing results in the Fedora wiki. This system relies on specific expectations regarding page naming, contents, and categorization. Please take special care when editing this page, especially if you change any element of wiki syntax, especially templating elements. If you are at all unsure about the consequences of your planned change, please contact the QA group before applying it.

This template contains the Base 'test matrix' of test cases that are usually executed as part of release validation testing. It is pulled into release validation results pages using several nested templates, and can be used in other pages as appropriate. If all you need to do is add, remove or edit a Base validation test case, though, don't worry about that stuff, and put it in here.

Cloud
The Cloud edition is not included on this page because all the same tests are present on the Cloud validation page.

Release-blocking environments (x86_64)

Milestone	Test Case	Workstation	Server	KDE
Basic/Final	QA:Testcase_base_initial_setup	none		none
Basic	QA:Testcase_base_startup	none	none	none
Basic	QA:Testcase_base_reboot_unmount	none	none	none
Basic	QA:Testcase_base_system_logging	none	none	none
Basic	QA:Testcase_base_update_cli	none	none	none
Basic / Beta	QA:Testcase_package_install_remove	none	none	none
Basic / Final	QA:Testcase_base_artwork_release_identification	none	none	none
Final	QA:Testcase_base_edition_self_identification	none	none	none
Final	QA:Testcase_base_services_start	none	none	none
Final	QA:Testcase_base_selinux	none	none	none
Final	QA:Testcase_base_service_manipulation	none	none	none

Release-blocking environments (aarch64)

Milestone	Test Case	Workstation	Server	Minimal
Basic/Final	QA:Testcase_base_initial_setup	none	none	none
Basic	QA:Testcase_base_startup	none	none	none
Basic	QA:Testcase_base_reboot_unmount	none	none	none
Basic	QA:Testcase_base_system_logging	none	none	none
Basic	QA:Testcase_base_update_cli	none	none	none
Basic / Beta	QA:Testcase_package_install_remove	none	none	none
Basic / Final	QA:Testcase_base_artwork_release_identification	none	none	none
Final	QA:Testcase_base_edition_self_identification	none	none	none
Final	QA:Testcase_base_services_start	none	none	none
Final	QA:Testcase_base_selinux	none	none	none
Final	QA:Testcase_base_service_manipulation	none	none	none

Release-blocking environments (armhfp)

Milestone	Test Case	Minimal
Basic/Final	QA:Testcase_base_initial_setup	none
Basic	QA:Testcase_base_startup	none
Basic	QA:Testcase_base_reboot_unmount	none
Basic	QA:Testcase_base_system_logging	none
Basic	QA:Testcase_base_update_cli	none
Basic / Beta	QA:Testcase_package_install_remove	none
Basic / Final	QA:Testcase_base_artwork_release_identification	none
Final	QA:Testcase_base_edition_self_identification	none
Final	QA:Testcase_base_services_start	none
Final	QA:Testcase_base_selinux	none
Final	QA:Testcase_base_service_manipulation	none

Modularity

Milestone	Test Case	Result
Optional	QA:Testcase_Modularity_module_list	none
Optional	QA:Testcase_Modularity_enable-disable_module	none
Optional	QA:Testcase_Modularity_install_module	none
Optional	QA:Testcase_Modularity_update_without_repos	none
Optional	QA:Testcase_Modularity_update_module	none

Non-blocking environments (x86_64)

Milestone	Test Case	Xfce	Cinnamon	MATE	LXDE	LXqt	Sugar	Silverblue
Optional	QA:Testcase_base_initial_setup	none	none	none	none	none	none	none
Optional	QA:Testcase_base_startup	none	none	none	none	none	none	none
Optional	QA:Testcase_base_reboot_unmount	none	none	none	none	none	none	none
Optional	QA:Testcase_base_system_logging	none	none	none	none	none	none	none
Optional	QA:Testcase_base_update_cli	none	none	none	none	none	none	none
Optional	QA:Testcase_package_install_remove	none	none	none	none	none	none
Optional	QA:Testcase_base_artwork_release_identification	none	none	none	none	none	none	none
Optional	QA:Testcase_base_edition_self_identification	none	none	none	none	none	none	none
Optional	QA:Testcase_base_services_start	none	none	none	none	none	none	none
Optional	QA:Testcase_base_selinux	none	none	none	none	none	none	none
Optional	QA:Testcase_base_service_manipulation	none	none	none	none	none	none	none

Non-blocking environments (ARM)

Milestone	Test Case	KDE	Cinnamon	Xfce	MATE	LXDE	LXqt	Sugar
Optional	QA:Testcase_base_initial_setup	none	none	none	none	none	none	none
Optional	QA:Testcase_base_startup	none	none	none	none	none	none	none
Optional	QA:Testcase_base_reboot_unmount	none	none	none	none	none	none	none
Optional	QA:Testcase_base_system_logging	none	none	none	none	none	none	none
Optional	QA:Testcase_base_update_cli	none	none	none	none	none	none	none
Optional	QA:Testcase_package_install_remove	none	none	none	none	none	none	none
Optional	QA:Testcase_base_artwork_release_identification	none	none	none	none	none	none	none
Optional	QA:Testcase_base_edition_self_identification	none	none	none	none	none	none	none
Optional	QA:Testcase_base_services_start	none	none	none	none	none	none	none
Optional	QA:Testcase_base_selinux	none	none	none	none	none	none	none
Optional	QA:Testcase_base_service_manipulation	none	none	none	none	none	none	none

@@ Line 1: / Line 1: @@
 {{tempdoc}}<onlyinclude>
+{{admon/note|Cloud|The Cloud edition is not included on this page because all the same tests are present on the Cloud validation page.}}
 ==== Release-blocking environments (x86_64) ====
 {| class="wikitable sortable mw-collapsible" width=100%
-! Milestone !! Test Case  !! Workstation !! Server !! Cloud !! KDE
+! Milestone !! Test Case  !! Workstation !! Server !! KDE
 |-
-| Basic
+| Basic/Final
 | [[QA:Testcase_base_initial_setup]]
 | {{result|none}}
-| style="background:lightgrey;"|
 | style="background:lightgrey;"|
 | {{result|none}}
@@ Line 15: / Line 15: @@
 | {{result|none}}
 | {{result|none}}
-| style="background:lightgrey;"|
 | {{result|none}}
 |-
 | Basic
 | [[QA:Testcase_base_reboot_unmount]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 27: / Line 25: @@
 | Basic
 | [[QA:Testcase_base_system_logging]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 34: / Line 31: @@
 | Basic
 | [[QA:Testcase_base_update_cli]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 40: / Line 36: @@
 |-
 | Basic / Beta
-| [[QA:Testcase package install remove]]
+| [[QA:Testcase_package_install_remove]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 48: / Line 43: @@
 | Basic / Final
 | [[QA:Testcase_base_artwork_release_identification]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 55: / Line 49: @@
 | Final
 | [[QA:Testcase_base_edition_self_identification]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 62: / Line 55: @@
 | Final
 | [[QA:Testcase_base_services_start]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 69: / Line 61: @@
 | Final
 | [[QA:Testcase_base_selinux]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 76: / Line 67: @@
 | Final
 | [[QA:Testcase_base_service_manipulation]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 84: / Line 74: @@
 <references/>
-==== Release-blocking environments (ARM) ====
+==== Release-blocking environments (aarch64) ====
 {| class="wikitable sortable mw-collapsible" width=100%
-! Milestone !! Test Case  !! Workstation !! Minimal
+! Milestone !! Test Case  !! Workstation !! Server !! Minimal
 |-
-| Basic
+| Basic/Final
 | [[QA:Testcase_base_initial_setup]]
+| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 95: / Line 86: @@
 | Basic
 | [[QA:Testcase_base_startup]]
+| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 100: / Line 92: @@
 | Basic
 | [[QA:Testcase_base_reboot_unmount]]
+| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 105: / Line 98: @@
 | Basic
 | [[QA:Testcase_base_system_logging]]
+| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 110: / Line 104: @@
 | Basic
 | [[QA:Testcase_base_update_cli]]
+| {{result|none}}
 | {{result|none}}
 | {{result|none}}
 |-
 | Basic / Beta
-| [[QA:Testcase package install remove]]
+| [[QA:Testcase_package_install_remove]]
+| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 120: / Line 116: @@
 | Basic / Final
 | [[QA:Testcase_base_artwork_release_identification]]
+| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 125: / Line 122: @@
 | Final
 | [[QA:Testcase_base_edition_self_identification]]
+| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 130: / Line 128: @@
 | Final
 | [[QA:Testcase_base_services_start]]
+| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 135: / Line 134: @@
 | Final
 | [[QA:Testcase_base_selinux]]
+| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 140: / Line 140: @@
 | Final
 | [[QA:Testcase_base_service_manipulation]]
+| {{result|none}}
 | {{result|none}}
+| {{result|none}}
+|-
+|}
+<references/>
+==== Release-blocking environments (armhfp) ====
+{| class="wikitable sortable mw-collapsible" width=100%
+! Milestone !! Test Case !! Minimal
+|-
+| Basic/Final
+| [[QA:Testcase_base_initial_setup]]
+| {{result|none}}
+|-
+| Basic
+| [[QA:Testcase_base_startup]]
+| {{result|none}}
+|-
+| Basic
+| [[QA:Testcase_base_reboot_unmount]]
+| {{result|none}}
+|-
+| Basic
+| [[QA:Testcase_base_system_logging]]
+| {{result|none}}
+|-
+| Basic
+| [[QA:Testcase_base_update_cli]]
+| {{result|none}}
+|-
+| Basic / Beta
+| [[QA:Testcase_package_install_remove]]
+| {{result|none}}
+|-
+| Basic / Final
+| [[QA:Testcase_base_artwork_release_identification]]
+| {{result|none}}
+|-
+| Final
+| [[QA:Testcase_base_edition_self_identification]]
+| {{result|none}}
+|-
+| Final
+| [[QA:Testcase_base_services_start]]
+| {{result|none}}
+|-
+| Final
+| [[QA:Testcase_base_selinux]]
+| {{result|none}}
+|-
+| Final
+| [[QA:Testcase_base_service_manipulation]]
 | {{result|none}}
 |-
@@ Line 147: / Line 199: @@
 ==== Modularity ====
-{{admon/note|Environment|These tests should be run using DNF, in any release-blocking environment, on any release-blocking arch.}}
 {| class="wikitable sortable mw-collapsible" width=100%
@@ Line 154: / Line 204: @@
 !style="width:10em"|Milestone !! Test Case !! Result
 |-
-| Beta
+| Optional
 | [[QA:Testcase_Modularity_module_list]]
 | {{result|none}}
 |-
-| Beta
+| Optional
 | [[QA:Testcase_Modularity_enable-disable_module]]
 | {{result|none}}
 |-
-| Beta
+| Optional
 | [[QA:Testcase_Modularity_install_module]]
 | {{result|none}}
 |-
-| Beta
+| Optional
 | [[QA:Testcase_Modularity_update_without_repos]]
 | {{result|none}}
@@ Line 233: / Line 283: @@
 |-
 | Optional
-| [[QA:Testcase package install remove]]
+| [[QA:Testcase_package_install_remove]]
 | {{result|none}}
 | {{result|none}}
@@ Line 297: / Line 347: @@
 ==== Non-blocking environments (ARM) ====
 {| class="wikitable sortable mw-collapsible" width=100%
-! Milestone !! Test Case  !! !! Server !! Cloud !! Cinnamon !! Xfce !! MATE !! LXDE !! LXqt !! Sugar
+! Milestone !! Test Case !! KDE !! Cinnamon !! Xfce !! MATE !! LXDE !! LXqt !! Sugar
 |-
 | Optional
 | [[QA:Testcase_base_initial_setup]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 312: / Line 361: @@
 | Optional
 | [[QA:Testcase_base_startup]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 323: / Line 371: @@
 | Optional
 | [[QA:Testcase_base_reboot_unmount]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 334: / Line 381: @@
 | Optional
 | [[QA:Testcase_base_system_logging]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 345: / Line 391: @@
 | Optional
 | [[QA:Testcase_base_update_cli]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 355: / Line 400: @@
 |-
 | Optional
-| [[QA:Testcase package install remove]]
+| [[QA:Testcase_package_install_remove]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 367: / Line 411: @@
 | Optional
 | [[QA:Testcase_base_artwork_release_identification]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 378: / Line 421: @@
 | Optional
 | [[QA:Testcase_base_edition_self_identification]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 389: / Line 431: @@
 | Optional
 | [[QA:Testcase_base_services_start]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 400: / Line 441: @@
 | Optional
 | [[QA:Testcase_base_selinux]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}
@@ Line 411: / Line 451: @@
 | Optional
 | [[QA:Testcase_base_service_manipulation]]
-| {{result|none}}
 | {{result|none}}
 | {{result|none}}

Search