From Fedora Project Wiki
 
(38 intermediate revisions by the same user not shown)
Line 24: Line 24:
| Alpha
| Alpha
| [[QA:Testcase_Mediakit_Repoclosure]]
| [[QA:Testcase_Mediakit_Repoclosure]]
| {{result|none}}
| {{result|pass|pwhalen}}
| style="background:lightgrey;"|   
| style="background:lightgrey;"|   
|-
|-
| Alpha
| Alpha
| [[QA:Testcase_Mediakit_FileConflicts]]
| [[QA:Testcase_Mediakit_FileConflicts]]
| {{result|none}}
| {{result|pass|pwhalen}}
| style="background:lightgrey;"|  
| style="background:lightgrey;"|  
|-
|-
Line 45: Line 45:
| Alpha
| Alpha
| [[QA:Testcase_Boot_default_install|Everything netinst]]
| [[QA:Testcase_Boot_default_install|Everything netinst]]
| {{result|none}}
| {{result|pass|pwhalen}}
|-
|-
| Alpha
| Alpha
Line 53: Line 53:
| Alpha
| Alpha
| [[QA:Testcase_Boot_default_install|Server dvd]]
| [[QA:Testcase_Boot_default_install|Server dvd]]
| {{result|none}}
| {{result|pass|pwhalen}}
|-
|-
|}
|}
Line 59: Line 59:


<div style="background-color: dodgerblue; text-align: center; border-style: solid; border-width: thin">
<div style="background-color: dodgerblue; text-align: center; border-style: solid; border-width: thin">
==== PXE boot ====
==== PXE boot ====
</div>
</div>
Line 67: Line 68:
| Beta
| Beta
| [[QA:Testcase_Boot_Methods_Pxeboot]]
| [[QA:Testcase_Boot_Methods_Pxeboot]]
| {{result|none}}
| {{result|pass|pwhalen}}<ref>seattle(server)</ref>
|-
|-
|}
|}
Line 81: Line 82:
| Alpha
| Alpha
| [[QA:Testcase_USB_dd]]
| [[QA:Testcase_USB_dd]]
| {{result|none}}
| {{result|pass|pwhalen}}
| {{result|none}}
| {{result|pass|pwhalen}}
| {{result|none}}
| {{result|none}}
|-
|-
Line 101: Line 102:
| Beta
| Beta
| [[QA:Testcase_Install_to_Current_KVM]]
| [[QA:Testcase_Install_to_Current_KVM]]
| {{result|none}}
| {{result|pass|pwhalen}}
|-
|-
|}
|}
<references/>
<references/>
<div style="background-color: orange; text-align: center; border-style: solid; border-width: thin">
<div style="background-color: orange; text-align: center; border-style: solid; border-width: thin">
==== Storage devices ====
==== Storage devices ====
</div>
</div>
Line 114: Line 116:
| Alpha
| Alpha
| [[QA:Testcase_install_to_SATA]]
| [[QA:Testcase_install_to_SATA]]
| {{result|none}}
| {{result|pass|pwhalen}}
|-
|-
| Alpha
| Alpha
Line 140: Line 142:
| Alpha
| Alpha
| [[QA:Testcase_partitioning_guided_empty]]
| [[QA:Testcase_partitioning_guided_empty]]
| {{result|none}}
| {{result|pass|pwhalen}}
|-
|-
| Alpha
| Alpha
| [[QA:Testcase_partitioning_guided_delete_all]]
| [[QA:Testcase_partitioning_guided_delete_all]]
| {{result|none}}
| {{result|pass|pwhalen}}
|-
|-
| Alpha
| Alpha
Line 160: Line 162:
| Beta
| Beta
| [[QA:Testcase_partitioning_guided_encrypted]]
| [[QA:Testcase_partitioning_guided_encrypted]]
| {{result|none}}
| {{result|pass|pwhalen}}
|-
|-
| Beta
| Beta
Line 175: Line 177:
{| class="wikitable sortable" width = 100%
{| class="wikitable sortable" width = 100%
|-
|-
!style="width:10em"|Milestone !! Test Case !! ext4 !! NTFS
!style="width:10em"|Milestone !! Test Case !! ext4
|-
|-
| Final
| Final
| [[QA:Testcase_partitioning_guided_shrink]]
| [[QA:Testcase_partitioning_guided_shrink]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
|-
Line 198: Line 199:
| Final
| Final
| [[QA:Testcase_partitioning_custom_btrfs]]
| [[QA:Testcase_partitioning_custom_btrfs]]
| {{result|none}}
| {{result|pass|pwhalen}}
|-
|-
| Final
| Final
| [[QA:Testcase_partitioning_custom_lvmthin]]
| [[QA:Testcase_partitioning_custom_lvmthin]]
| {{result|none}}
| {{result|pass|pwhalen}}
|-
|-
| Final
| Final
| [[QA:Testcase_partitioning_custom_standard_partition_ext3]]
| [[QA:Testcase_partitioning_custom_standard_partition_ext3]]
| {{result|none}}
| {{result|pass|pwhalen}}
|-
|-
| Final
| Final
| [[QA:Testcase_partitioning_custom_standard_partition_xfs]]
| [[QA:Testcase_partitioning_custom_standard_partition_xfs]]
| {{result|none}}
| {{result|pass|pwhalen}}
|-
|-
| Optional
| Optional
| [[QA:Testcase_partitioning_custom_no_swap]]
| [[QA:Testcase_partitioning_custom_no_swap]]
| {{result|none}}
| {{result|pass|pwhalen}}
|-
|-
|}
|}
Line 232: Line 233:
| Alpha
| Alpha
| [[QA:Testcase_Anaconda_User_Interface_Text]]
| [[QA:Testcase_Anaconda_User_Interface_Text]]
| {{result|none}}
| {{result|pass|pwhalen}}
|-
|-
| Alpha
| Alpha
| [[QA:Testcase_Anaconda_User_Interface_VNC]]
| [[QA:Testcase_Anaconda_User_Interface_VNC]]
| {{result|none}}
| {{result|pass|pwhalen}}
|-
|-
| Alpha
| Alpha
Line 249: Line 250:
| Beta
| Beta
| [[QA:Testcase_Anaconda_User_Interface_serial_console]]
| [[QA:Testcase_Anaconda_User_Interface_serial_console]]
| {{result|none}}
| {{result|pass|pwhalen}}
|-
|-
|}
|}
<references/>
<references/>
<div style="background-color: lavender; text-align: center; border-style: solid; border-width: thin">
<div style="background-color: lavender; text-align: center; border-style: solid; border-width: thin">
==== Package sets ====
==== Package sets ====
</div>
</div>
Line 262: Line 264:
| Beta
| Beta
| [[QA:Testcase_Package_Sets_Minimal_Package_Install]]
| [[QA:Testcase_Package_Sets_Minimal_Package_Install]]
| {{result|none}}
| {{result|pass|pwhalen}}
|-
| Optional
| [[QA:Testcase_Package_Sets_KDE_Package_Install]]
| {{result|none}}
|-
|-
|}
|}
<references/>
<references/>
<div style="background-color: coral; text-align: center; border-style: solid; border-width: thin">
<div style="background-color: coral; text-align: center; border-style: solid; border-width: thin">
==== Kickstart ====
==== Kickstart ====
</div>
</div>
Line 279: Line 278:
| Alpha
| Alpha
| [[QA:Testcase_kickstart_user_creation]]
| [[QA:Testcase_kickstart_user_creation]]
| {{result|none}}
| {{result|pass|pwhalen}}
|-
|-
| Beta
| Beta
| [[QA:Testcase_Kickstart_Http_Server_Ks_Cfg]]
| [[QA:Testcase_Kickstart_Http_Server_Ks_Cfg]]
| {{result|none}}
| {{result|pass|pwhalen}}
|-
|-
| Beta
| Beta
Line 300: Line 299:
<references/>
<references/>
<div style="background-color: pink; text-align: center; border-style: solid; border-width: thin">
<div style="background-color: pink; text-align: center; border-style: solid; border-width: thin">
==== Upgrade ====
==== Upgrade ====
</div>
</div>
Line 316: Line 316:
| Beta
| Beta
| [[QA:Testcase_upgrade_dnf_current_minimal]]
| [[QA:Testcase_upgrade_dnf_current_minimal]]
| {{result|none}}
| {{result|pass|pwhalen}}
|-
|-
| Beta
| Beta
| [[QA:Testcase_upgrade_dnf_previous_minimal]]
| [[QA:Testcase_upgrade_dnf_previous_minimal]]
| {{result|none}}
| {{result|pass|pwhalen}}
|-
|-
|}
|}
Line 334: Line 334:
| Alpha
| Alpha
| [[QA:Testcase_Anaconda_user_creation]]
| [[QA:Testcase_Anaconda_user_creation]]
| {{result|none}}
| {{result|pass|pwhalen}}
|-
| Alpha
| [[Docker Functionality with Base image]]
| {{result|pass|pwhalen}}<ref>seattle</ref>
|-
|-
|}
|}
Line 343: Line 347:
| Alpha
| Alpha
| [[QA:Testcase_Anaconda_save_traceback_to_bugzilla]] (GUI mode)
| [[QA:Testcase_Anaconda_save_traceback_to_bugzilla]] (GUI mode)
| {{result|none}}
| {{result|pass|pwhalen}}
|-
|-
| Alpha
| Alpha
| [[QA:Testcase_Anaconda_save_traceback_to_bugzilla]] (text mode)
| [[QA:Testcase_Anaconda_save_traceback_to_bugzilla]] (text mode)
| {{result|none}}
| {{result|pass|pwhalen}}
|-
|-
| Alpha
| Alpha
Line 363: Line 367:
| Final
| Final
| [[QA:Testcase_Anaconda_help]]
| [[QA:Testcase_Anaconda_help]]
| {{result|none}}
| {{result|pass|pwhalen}}
|-
|-
| Optional
| Optional
Line 380: Line 384:
| Beta
| Beta
| [[QA:Testcase_Anaconda_rescue_mode]]
| [[QA:Testcase_Anaconda_rescue_mode]]
|-
| {{result|pass|pwhalen}}
| Final
| [[QA:Testcase_dualboot_with_windows]]
| {{result|none}}
|-
|-
|}
|}
<references/></onlyinclude>
<references/></onlyinclude>
<div style="background-color: lightpink; text-align: center; border-style: solid; border-width: thin">
<div style="background-color: lightpink; text-align: center; border-style: solid; border-width: thin">
==== Base ====
==== Base ====
</div>
</div>
{| class="wikitable sortable collapsible" width=100%
{| class="wikitable sortable collapsible" width=100%
|-
! Milestone !! Test Case !! Result
!style="width:10em"|Milestone !! Test Case !! Result
|-
| Alpha
| [[QA:Testcase_base_startup]]
| {{result|pass|pwhalen}}
|-
| Alpha
| [[QA:Testcase_base_system_logging]]
| {{result|pass|pwhalen}}
|-
|-
| Beta
| Alpha
| [[QA:Testcase_upgrade_dnf_current_server]]
| [[QA:Testcase_base_update_cli]]
| {{result|none}}
| {{result|pass|pwhalen}}
|-
|-
| Beta
| Final
| [[QA:Testcase_upgrade_dnf_previous_server]]
| [[QA:Testcase_Services_start]]
| {{result|none}}
| {{result|pass|pwhalen}}
|-
|-
| Beta
| Final
| [[QA:Testcase_upgrade_dnf_current_minimal]]
| [[QA:Testcase_base_selinux]]
| {{result|none}}
| {{result|pass|pwhalen}}
|-
|-
| Beta
| Final
| [[QA:Testcase_upgrade_dnf_previous_minimal]]
| [[QA:Testcase_base_service_manipulation]]
| {{result|none}}
| {{result|none}}
|-
|-
Line 413: Line 422:
<references/>
<references/>
<div style="background-color: green; text-align: center; border-style: solid; border-width: thin">
<div style="background-color: green; text-align: center; border-style: solid; border-width: thin">
==== Server ====
==== Server ====
</div>
</div>
Line 430: Line 440:
| Alpha
| Alpha
| [[ QA:Testcase_Server_firewall_default]]
| [[ QA:Testcase_Server_firewall_default]]
| {{result|none}}
| {{result|pass|pwhalen}}
|-
|-
| Alpha
| Alpha
| [[QA:Testcase_Server_cockpit_default]]
| [[QA:Testcase_Server_cockpit_default]]
| {{result|none}}
| {{result|pass|pwhalen}}
|-
|-
| Beta
| Beta
| [[QA:Testcase_Server_cockpit_basic]]
| [[QA:Testcase_Server_cockpit_basic]]
| {{result|none}}
| {{result|pass|pwhalen}}
|-
|-
|}
|}

Latest revision as of 20:20, 28 October 2016

Test Matrix

Please click [show] in each table to view the tests of each media installation, and click [edit] to post your test results using the syntax in Key Section.

Image sanity

Milestone Test Case Server Everything
Alpha / Final QA:Testcase_Mediakit_Checksums
none
none
Beta QA:Testcase_Mediakit_ISO_Size
none
none
Alpha QA:Testcase_Mediakit_Repoclosure
Pass pass pwhalen
Alpha QA:Testcase_Mediakit_FileConflicts
Pass pass pwhalen

Default boot and install

Milestone Image Result
Alpha Everything netinst
Pass pass pwhalen
Alpha Server netinst
none
Alpha Server dvd
Pass pass pwhalen


PXE boot

Milestone Test Case Result
Beta QA:Testcase_Boot_Methods_Pxeboot
Pass pass pwhalen
[1]
  1. seattle(server)

USB media

Milestone Test Case Server DVD Server netinstall Everything netinstall
Alpha QA:Testcase_USB_dd
Pass pass pwhalen
Pass pass pwhalen
none

Virtualization

Milestone Test Case Result
Beta QA:Testcase_Install_to_Previous_KVM
none
Beta QA:Testcase_Install_to_Current_KVM
Pass pass pwhalen

Storage devices

Milestone Test Case Result
Alpha QA:Testcase_install_to_SATA
Pass pass pwhalen
Alpha QA:Testcase_install_to_SCSI
none
Beta QA:Testcase_install_to_VirtIO
Pass pass pwhalen
Final QA:Testcase_install_to_iSCSI_no_authentication
none

Guided storage configuration

Milestone Test Case Result
Alpha QA:Testcase_partitioning_guided_empty
Pass pass pwhalen
Alpha QA:Testcase_partitioning_guided_delete_all
Pass pass pwhalen
Alpha QA:Testcase_partitioning_guided_multi_select
Beta QA:Testcase_partitioning_guided_delete_partial
Beta QA:Testcase_partitioning_guided_free_space
Beta QA:Testcase_partitioning_guided_encrypted
Pass pass pwhalen
Beta QA:Testcase_partitioning_guided_multi_empty_all

Guided storage shrinking

Note.png
Environments
For this test, the column headings refer to the storage volume type to be shrunk, not the one chosen to replace it for the new installation.
Milestone Test Case ext4
Final QA:Testcase_partitioning_guided_shrink
none

Custom storage configuration

Milestone Test Case Result
Beta QA:Testcase_partitioning_custom_software_RAID
Final QA:Testcase_partitioning_custom_btrfs
Pass pass pwhalen
Final QA:Testcase_partitioning_custom_lvmthin
Pass pass pwhalen
Final QA:Testcase_partitioning_custom_standard_partition_ext3
Pass pass pwhalen
Final QA:Testcase_partitioning_custom_standard_partition_xfs
Pass pass pwhalen
Optional QA:Testcase_partitioning_custom_no_swap
Pass pass pwhalen

User interface

Milestone Test Case Result
Alpha QA:Testcase_Anaconda_User_Interface_Graphical
none
Alpha QA:Testcase_Anaconda_User_Interface_Text
Pass pass pwhalen
Alpha QA:Testcase_Anaconda_User_Interface_VNC
Pass pass pwhalen
Alpha QA:Testcase_Anaconda_User_Interface_VNC_Vncconnect
none
Milestone Test Case Result
Beta QA:Testcase_Anaconda_User_Interface_serial_console
Pass pass pwhalen

Package sets

Milestone Test Case Result
Beta QA:Testcase_Package_Sets_Minimal_Package_Install
Pass pass pwhalen

Kickstart

Milestone Test Case Result
Alpha QA:Testcase_kickstart_user_creation
Pass pass pwhalen
Beta QA:Testcase_Kickstart_Http_Server_Ks_Cfg
Pass pass pwhalen
Beta QA:Testcase_Kickstart_File_Path_Ks_Cfg
none
Beta QA:Testcase_Kickstart_Hd_Device_Path_Ks_Cfg
none
Beta QA:Testcase_Kickstart_Nfs_Server_Path_Ks_Cfg
none

Upgrade

Milestone Test Case Result
Beta QA:Testcase_upgrade_dnf_current_server
none
Beta QA:Testcase_upgrade_dnf_previous_server
none
Beta QA:Testcase_upgrade_dnf_current_minimal
Pass pass pwhalen
Beta QA:Testcase_upgrade_dnf_previous_minimal
Pass pass pwhalen

Miscellaneous

Milestone Test Case Result
Alpha QA:Testcase_Anaconda_user_creation
Pass pass pwhalen
Alpha Docker Functionality with Base image
Pass pass pwhalen
[1]
Milestone Test Case Result
Alpha QA:Testcase_Anaconda_save_traceback_to_bugzilla (GUI mode)
Pass pass pwhalen
Alpha QA:Testcase_Anaconda_save_traceback_to_bugzilla (text mode)
Pass pass pwhalen
Alpha QA:Testcase_Anaconda_updates.img_via_URL
none
Final QA:Testcase_Anaconda_updates.img_via_installation_source
none
Final QA:Testcase_Anaconda_updates.img_via_local_media
none
Final QA:Testcase_Anaconda_help
Pass pass pwhalen
Optional QA:Testcase_Anaconda_traceback_debug_mode (GUI mode)
none
Optional QA:Testcase_Anaconda_traceback_debug_mode (text mode)
none
Milestone Test Case Result
Beta QA:Testcase_Anaconda_rescue_mode
Pass pass pwhalen
  1. seattle

Base

Milestone Test Case Result
Alpha QA:Testcase_base_startup
Pass pass pwhalen
Alpha QA:Testcase_base_system_logging
Pass pass pwhalen
Alpha QA:Testcase_base_update_cli
Pass pass pwhalen
Final QA:Testcase_Services_start
Pass pass pwhalen
Final QA:Testcase_base_selinux
Pass pass pwhalen
Final QA:Testcase_base_service_manipulation
none

Server

General tests

Milestone Test Case Result
Alpha QA:Testcase_kickstart_firewall_disabled
none
Alpha QA:Testcase_kickstart_firewall_configured
none
Alpha QA:Testcase_Server_firewall_default
Pass pass pwhalen
Alpha QA:Testcase_Server_cockpit_default
Pass pass pwhalen
Beta QA:Testcase_Server_cockpit_basic
Pass pass pwhalen