From Fedora Project Wiki

 
(3 intermediate revisions by 3 users not shown)
Line 443: Line 443:
| [[QA:Testcase_Package_Sets_Minimal_Package_Install]]
| [[QA:Testcase_Package_Sets_Minimal_Package_Install]]
| {{result|pass|Wutao85}} 20140423
| {{result|pass|Wutao85}} 20140423
| {{result|pass|pschindl}} 20140417
| {{result|pass|pschindl}} 20140417 {{result|pass|lnie}} 20140504
| style="background:lightgrey;"|
| style="background:lightgrey;"|
| {{result|none}}
| {{result|none}}
Line 483: Line 483:
| [[QA:Testcase_anaconda_ext3_rootfs_on_disk_partition]]
| [[QA:Testcase_anaconda_ext3_rootfs_on_disk_partition]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|pass|lnie}}20140504
| style="background:lightgrey;"|
| style="background:lightgrey;"|
| {{result|none}}
| {{result|none}}
Line 780: Line 780:
<references/>
<references/>


[[Category:Fedora 21 Rawhide Test Results|I]]
[[Category:Fedora 21 Nightly Test Results|I]]

Latest revision as of 22:35, 19 December 2014

This page is intended to record installation validation test results for Rawhide nightly builds in the month of April 2014.

Idea.png
Not mandatory testing
This testing is not in any way mandatory, but rather precautionary / exploratory. No Fedora release depends on this testing being performed. Due to the longer Fedora 21 release cycle, we think it is a good idea to keep an eye on the status of Rawhide before we reach the Alpha milestone, however no-one should feel obliged in any way to participate in this testing, and certainly not to work excessively long, late or hard on it.

Instructions[edit]

This page tracks test results against April 2014 nightly Rawhide builds. Test results against other Fedora 21 milestones can be found at Category:Fedora_21_Test_Results.

What To Test[edit]

  • Tests requiring physical media (e.g. DVD or CD images) -- download the required Rawhide nightly live image, x86_64 or i386 network install image, or ARM or Cloud disk image. If you use the network install image, enter the date on which you downloaded it as the 'build date' in your results (see #Key.)

Note that if generation of the boot.iso images fails for a given day, the file will not be present on the mirrors (the last successful compose is not retained). In this case, you just have to wait for a successful compose, or use one of the other images/methods described on this page.

Add or Remove a Test Case[edit]

  1. Please request review for your changes by publishing your test case for review to test list.
  2. Once reviewed, make your changes to this document
  3. Finally, update QA:Fedora_21_Install_Results_Template with the same changes.

Key[edit]

See the table below for a sample format for test results. All test results are posted using the format specified Template:Result.

Test Results Format
Test Result Explanation Code Entered
none
Untested - This test has not been run, and is available for anyone to contribute feedback. {{result|none}}
Pass pass robatino
20140415
Passed - The test has been run and the tester determine the test met the expected results. The date of the build tested (not the date the test was run) should be included. {{result|pass|robatino}} 20140415
Inprogress inprogress adamwill
Inprogress - An inprogress result is often used for tests that take a long time to execute. Inprogress results should be temporary and change to pass, fail or warn. {{result|inprogress|adamwill}}
Fail fail jlaska [1] [2]
20140415
Failed - Indicates a failed test. A link to a bug must be provided. See Template:Result for details on providing bug information. The date of the build tested (not the date the test was run) should be included.
  1. RHBZ #XYZ
  2. RHBZ #ZXY
{{result|fail|jlaska|XYZ|ZXY}} 20140415
Warning warn rhe
[1] 20140415
Warning - This test completed and met the expected results of the test, but other issues were encountered during testing that warrant attention. The date of the build tested (not the date the test was run) should be included.
  1. Brief description about the warning status
{{result|warn|rhe}} <ref>Brief description about the warning status</ref> 20140415
Pass pass hongqing
20140415
Warning warn kparal
20140418
Multiple results - More people can easily provide results to a single test case. {{result|pass|hongqing}} 20140415 {{result|warn|kparal}} 20140418
Unsupported - An unsupported test or configuration. No testing is required.

Test Matrix[edit]

Please click [show] in each table to view the tests of each media installation, and click [edit] to post your test results using the syntax in Key Section.

Image sanity[edit]

Image sanity tests
Release Level Test Case netinst x86[1] Live x86 ARM Cloud
Alpha / Final QA:Testcase_Mediakit_Checksums
none
none
none
none
none
Beta QA:Testcase_Mediakit_ISO_Size
none
none
none
none
none
  1. 'x86' means 'x86_64 or i386'

Netinst image[edit]

netinst.iso (boot.iso) tests
Release Level Test Area Test Case i386 x86_64 EFI
Alpha Boot Methods QA:Testcase_Boot_Methods_Boot_Iso
none
Pass pass pschindl
20140417
Pass pass pschindl
20140417


Live image[edit]

Live.iso tests
Release Level Test Area Test Case i386 x86_64 EFI
Alpha Boot Methods QA:Testcase_Live_Image_Boot
none
Fail fail pschindl [1]
20140422
Pass pass adamwill
20140429
Fail fail pschindl [1]
20140416
Alpha Install Repository QA:Testcase_install_repository_Live_Image
none
Pass pass adamwill
20140429
none
  1. 1.0 1.1 RHBZ #1088990

USB stick[edit]

USB stick tests
Release Level Test Area Test Case i386 x86_64 EFI
Alpha Boot Methods QA:Testcase_USB_stick_Live LiveUSB-creator
none
none
none
Alpha Boot Methods QA:Testcase_USB_stick_Live Live-ISO-to-Disk
none
Fail fail pschindl [1]
20140422
Fail fail pschindl [1]
20140416
Alpha Boot Methods QA:Testcase_USB_stick_Live_dd
none
Fail fail pschindl [1]
20140422
Fail fail pschindl [1]
20140416
  1. 1.0 1.1 1.2 1.3 RHBZ #1088990

ARM disk images[edit]

In all of these tests, the test case used is QA:Testcase_arm_image_deployment. That is where the links point. The same test needs to be run for multiple images and target platforms.

ARM disk image functionality
Release Level Image Ext boot VFAT boot
Alpha Minimal
Warning warn pwhalen
[1] 20140410
none
Alpha KDE
none
Warning warn pwhalen
[2] 20140410
Optional Xfce
none
Warning warn pwhalen
[3] 20140410
Optional Desktop
none
none
Optional LXDE
none
none
Optional MATE
none
none
Optional SoaS
none
none
  1. SELinux needs to be disabled for initial-setup.
  2. SELinux needs to be disabled for initial-setup.
  3. SELinux needs to be disabled for initial-setup.

Cloud images[edit]

Cloud images
Release Level Test Case i386 x86_64
Alpha QA:Testcase_EC2_AMI_Validation
none
none
Alpha QA:Testcase_OpenStack_Image_Validation
none
none


PXE images[edit]

PXE boot tests
Release Level Test Area Test Case i386 x86_64 ARM
Alpha Boot Methods QA:Testcase_Boot_Methods_Pxeboot
none
none
none


Storage device tests[edit]

Release Level Test Case x86[1] ARM
Alpha QA:Testcase_install_to_SATA
none
none
Alpha QA:Testcase_install_to_PATA
none
none
Alpha QA:Testcase_install_to_SCSI
none
none
Alpha QA:Testcase_install_to_SAS
none
none
Beta QA:Testcase_install_to_firmware_RAID
none
none
Beta QA:Testcase_install_to_hardware_RAID
none
none
Beta QA:Testcase_install_to_VirtIO
Pass pass pschindl
20140417
none
Final QA:Testcase_install_to_iSCSI_no_authentication
none
none
Final QA:Testcase_install_to_multipath
none
none
Final QA:Testcase_install_to_FCoE_target
none
none
  1. 'x86' means 'x86_64 or i386'

Storage volume type tests[edit]

Guided installation[edit]

Release Level Test Case x86 BIOS[1] x86 UEFI ARM
Alpha QA:Testcase_partitioning_guided_empty
Pass pass pschindl
20140417
none
none
Alpha QA:Testcase_partitioning_guided_delete_all
Pass pass pschindl
20140417
Pass pass pschindl
20140417
none
Alpha QA:Testcase_partitioning_guided_multi_select
none
none
none
Beta QA:Testcase_partitioning_guided_delete_partial
none
none
none
Beta QA:Testcase_partitioning_guided_free_space
none
none
none
Beta QA:Testcase_partitioning_guided_encrypted
none
none
none
Beta QA:Testcase_partitioning_guided_multi_empty_all
none
none
none
  1. 'x86' means 'x86_64 or i386'

Guided shrinking[edit]

For this test, the column headings refer to the storage volume type to be shrunk, not the one chosen to replace it for the new installation.

Release Level Test Case LVM ext4 NTFS BTRFS
Final QA:Testcase_partitioning_guided_shrink
none
none
none
none


General Tests[edit]

Install Variations & General Tests
Release Level Test Area Test Case i386 x86_64 EFI ARM
Alpha Package Set QA:Testcase_Package_Sets_Default_Package_Install
Fail fail Wutao85 [1]
20140409
Pass pass lnie
20140504
Alpha Package Set QA:Testcase_Package_Sets_KDE_Package_Install
none
Pass pass pschindl
20140417
Alpha Package Set QA:Testcase_Package_Sets_Minimal_Package_Install
Pass pass Wutao85
20140423
Pass pass pschindl
20140417
Pass pass lnie
20140504
none
Beta Partitioning QA:Testcase_Anaconda_custom_partitioning
Pass pass Wutao85
20140423
Pass pass lnie
20140504
none
Beta Partitioning QA:Testcase_Partitioning_On_Software_RAID
none
none
Final Partitioning QA:Testcase_dualboot_with_windows
none
none
none
Final Partitioning QA:Testcase_anaconda_btrfs_rootfs_on_disk_partition
none
Pass pass pschindl
20140417
Final Partitioning QA:Testcase_anaconda_ext3_rootfs_on_disk_partition
none
Pass pass lnie
20140504
none
Final Partitioning QA:Testcase_anaconda_xfs_rootfs_on_disk_partition
none
none
Alpha User Interface QA:Testcase_Anaconda_User_Interface_Graphical
Pass pass Wutao85
20140423
Pass pass pschindl
20140417
Pass pass lnie
20140504
none
Alpha User Interface QA:Testcase_Anaconda_User_Interface_Basic_Video_Driver
none
Pass pass pschindl
20140417
none
Alpha User Interface QA:Testcase_Anaconda_User_Interface_Text
none
none
none
Alpha User Interface QA:Testcase_Anaconda_User_Interface_VNC
Pass pass Wutao85
20140423
Pass pass lnie
20140504
none
Alpha User Interface QA:Testcase_Anaconda_User_Interface_VNC_Vncconnect
Pass pass Wutao85
20140423
Pass pass lnie
20140504
Beta User Interface QA:Testcase_Anaconda_User_Interface_serial_console
none
none
none
Alpha Install Repository QA:Testcase_install_repository_Mirrorlist_default
none
Pass pass pschindl
20140417
Alpha Install Repository QA:Testcase_install_repository_Mirrorlist_graphical
none
Warning warn pschindl
20140417 [2]
Alpha Install Repository QA:Testcase_install_repository_HTTP/FTP_graphical
none
none
Alpha Install Repository QA:Testcase_install_repository_HTTP/FTP_variation
none
Warning warn pschindl
20140417 [3]
Beta Install Repository QA:Testcase_install_repository_NFS_graphical
none
none
Beta Install Repository QA:Testcase_install_repository_NFS_variation
none
none
Final Install Repository QA:Testcase_install_repository_NFSISO_variation
none
none
Final Install Repository QA:Testcase_install_repository_Hard_drive_variation
none
none
Beta Storage Devices QA:Testcase_Install_to_Previous_KVM
none
Pass pass pschindl
20140417
Beta Storage Devices QA:Testcase_Install_to_Current_KVM
none
none
Final Storage Devices QA:Testcase_Boot_Methods_Xen_Para_Virt
none
none
Alpha Recovery QA:Testcase_Anaconda_save_traceback_to_bugzilla
none
none
Alpha Recovery QA:Testcase_Anaconda_rescue_mode
none
none
none
Alpha Recovery QA:Testcase_Anaconda_updates.img_via_URL
none
Pass pass lnie
20140423
Final Recovery QA:Testcase_Anaconda_updates.img_via_installation_source
none
none
Final Recovery QA:Testcase_Anaconda_updates.img_via_local_media
none
none
Beta Kickstart Delivery QA:Testcase_Kickstart_Http_Server_Ks_Cfg
none
none
none
Beta Kickstart Delivery QA:Testcase_Kickstart_File_Path_Ks_Cfg
none
none
Beta Kickstart Delivery QA:Testcase_Kickstart_Hd_Device_Path_Ks_Cfg
none
none
Beta Kickstart Delivery QA:Testcase_Kickstart_Nfs_Server_Path_Ks_Cfg
none
none
none
Alpha User Creation QA:Testcase_Anaconda_user_creation
none
none
Beta Upgrade system QA:Testcase_upgrade_fedup_cli_previous_desktop
none
none
none
Beta Upgrade system QA:Testcase_upgrade_fedup_cli_previous_kde
none
none
none
Beta Upgrade system QA:Testcase_upgrade_fedup_cli_previous_minimal
none
none
none
Beta Upgrade system QA:Testcase_upgrade_fedup_cli_previous_desktop_encrypted
none
none
none
Optional Boot Methods QA:Testcase_Install_Image_Boot_Local
none
none
Optional Memory Test QA:Testcase_Memtest86
none
none
Optional Recovery QA:Testcase_Anaconda_traceback_debug_mode
none
none
Optional Partitioning QA:Testcase_Partitioning_No_Swap
none
Warning warn lnie
20140428 [4]
none
  1. RHBZ #1086662
  2. Used repositories can't be determined due to RHBZ #1089297
  3. Used repositories can't be determined due to RHBZ #1089297
  4. RHBZ #1090786