From Fedora Project Wiki

 
(8 intermediate revisions by 3 users not shown)
Line 109: Line 109:
| [[QA:Testcase_Boot_Methods_Boot_Iso]]
| [[QA:Testcase_Boot_Methods_Boot_Iso]]
| {{result|none}}
| {{result|none}}
| {{result|pass|satellit}} 20140507 <ref> bare metal install gnome 3.13.1 with anaconda 21.35-1</ref>{{result|pass|satellit}} 20140509 <ref> 1024 bridged requires 2 cores to boot Anaconda Install to Vb worked (default gnome)</ref>{{result|pass|satellit}} 20140513 <ref> 1024 bridged requires 2 cores to boot Anaconda Install to Vb worked (SoaS)</ref>{{result|warn|satellit}} 20140515 <ref> 21.36-1  1024 bridged requires 2 cores to boot Anaconda Install to Vb worked (LXDE) yum install @sugar-desktop - Bare metal: worked but "no network connection"</ref>{{result|pass|satellit}}20140524<ref>-VB (2 cores) and HD install; Custom Partitioning;standard ext4; cinnamon from DVD; wireless and wired work; yum install @sugar-network OK</ref> {{result|pass|michalv}} 20140526{{result|pass|satellit}} 201405031<ref>installed default Desktop in Virtualbox</ref>{{result|fail|satellit|1103496}} 20140601<ref>configuration screen blank  (no root or user shown) Virtualbox and bare metal</ref>
| {{result|pass|satellit}} 20140507 <ref> bare metal install gnome 3.13.1 with anaconda 21.35-1</ref>{{result|pass|satellit}} 20140509 <ref> 1024 bridged requires 2 cores to boot Anaconda Install to Vb worked (default gnome)</ref>{{result|pass|satellit}} 20140513 <ref> 1024 bridged requires 2 cores to boot Anaconda Install to Vb worked (SoaS)</ref>{{result|warn|satellit}} 20140515 <ref> 21.36-1  1024 bridged requires 2 cores to boot Anaconda Install to Vb worked (LXDE) yum install @sugar-desktop - Bare metal: worked but "no network connection"</ref>{{result|pass|satellit}}20140524<ref>-VB (2 cores) and HD install; Custom Partitioning;standard ext4; cinnamon from DVD; wireless and wired work; yum install @sugar-network OK</ref> {{result|pass|michalv}} 20140526{{result|pass|satellit}} 201405031<ref>installed default Desktop in Virtualbox</ref>
| {{result|none}}
| {{result|none}}
|-
|-
Line 210: Line 210:
| Optional
| Optional
| [[QA:Testcase_arm_image_deployment|Desktop]]
| [[QA:Testcase_arm_image_deployment|Desktop]]
| {{result|none}}
| {{result|pass|pwhalen}}20140608-Workstation
|-
|-
| Optional
| Optional
Line 438: Line 438:
| {{result|pass|lnie}}20140511 {{result|pass|pschindl}} 20140525 {{result|pass|michalv}} 20140527
| {{result|pass|lnie}}20140511 {{result|pass|pschindl}} 20140525 {{result|pass|michalv}} 20140527
| style="background:lightgrey;"|
| style="background:lightgrey;"|
| {{result|pass|pwhalen}}20140529  
| {{result|pass|pwhalen}}20140529
|-
|-
| Beta
| Beta
Line 518: Line 518:
| {{result|fail|lnie|1102496}}20140528
| {{result|fail|lnie|1102496}}20140528
| style="background:lightgrey;"|
| style="background:lightgrey;"|
| {{result|fail|pwhalen|1102793}}20140529  
| {{result|fail|pwhalen|1102793}}20140529
|-
|-
| Alpha
| Alpha
Line 773: Line 773:
<references/>
<references/>


[[Category:Fedora 21 Rawhide Test Results|I]]
[[Category:Fedora 21 Nightly Test Results|I]]

Latest revision as of 22:35, 19 December 2014

This page is intended to record installation validation test results for Rawhide nightly builds in the month of May 2014.

Idea.png
Not mandatory testing
This testing is not in any way mandatory, but rather precautionary / exploratory. No Fedora release depends on this testing being performed. Due to the longer Fedora 21 release cycle, we think it is a good idea to keep an eye on the status of Rawhide before we reach the Alpha milestone, however no-one should feel obliged in any way to participate in this testing, and certainly not to work excessively long, late or hard on it.

Instructions[edit]

This page tracks test results against May 2014 nightly Rawhide builds. Test results against other Fedora 21 milestones can be found at Category:Fedora_21_Test_Results.

What To Test[edit]

  • Tests requiring physical media (e.g. DVD or CD images) -- download the required Rawhide nightly live image, x86_64 or i386 network install image, or ARM or Cloud disk image. If you use the network install image, enter the date on which you downloaded it as the 'build date' in your results (see #Key.)

Note that if generation of the boot.iso images fails for a given day, the file will not be present on the mirrors (the last successful compose is not retained). In this case, you just have to wait for a successful compose, or use one of the other images/methods described on this page.

Add or Remove a Test Case[edit]

  1. Please request review for your changes by publishing your test case for review to test list.
  2. Once reviewed, make your changes to this document
  3. Finally, update QA:Fedora_21_Install_Results_Template with the same changes.

Key[edit]

See the table below for a sample format for test results. All test results are posted using the format specified Template:Result.

Test Results Format
Test Result Explanation Code Entered
none
Untested - This test has not been run, and is available for anyone to contribute feedback. {{result|none}}
Pass pass robatino
20140515
Passed - The test has been run and the tester determine the test met the expected results. The date of the build tested (not the date the test was run) should be included. {{result|pass|robatino}} 20140515
Inprogress inprogress adamwill
Inprogress - An inprogress result is often used for tests that take a long time to execute. Inprogress results should be temporary and change to pass, fail or warn. {{result|inprogress|adamwill}}
Fail fail jlaska [1] [2]
20140515
Failed - Indicates a failed test. A link to a bug must be provided. See Template:Result for details on providing bug information. The date of the build tested (not the date the test was run) should be included.
  1. RHBZ #XYZ
  2. RHBZ #ZXY
{{result|fail|jlaska|XYZ|ZXY}} 20140515
Warning warn rhe
[1] 20140415
Warning - This test completed and met the expected results of the test, but other issues were encountered during testing that warrant attention. The date of the build tested (not the date the test was run) should be included.
  1. Brief description about the warning status
{{result|warn|rhe}} <ref>Brief description about the warning status</ref> 20140515
Pass pass hongqing
20140515
Warning warn kparal
20140518
Multiple results - More people can easily provide results to a single test case. {{result|pass|hongqing}} 20140515 {{result|warn|kparal}} 20140518
Unsupported - An unsupported test or configuration. No testing is required.

Test Matrix[edit]

Please click [show] in each table to view the tests of each media installation, and click [edit] to post your test results using the syntax in Key Section.

Image sanity[edit]

Image sanity tests
Release Level Test Case netinst x86[1] Live x86 ARM Cloud
Alpha / Final QA:Testcase_Mediakit_Checksums
none
none
none
none
none
Beta QA:Testcase_Mediakit_ISO_Size
none
none
none
none
none
  1. 'x86' means 'x86_64 or i386'

Netinst image[edit]

netinst.iso (boot.iso) tests
Release Level Test Area Test Case i386 x86_64 EFI
Alpha Boot Methods QA:Testcase_Boot_Methods_Boot_Iso
none
Pass pass satellit
20140507 [1]
Pass pass satellit
20140509 [2]
Pass pass satellit
20140513 [3]
Warning warn satellit
20140515 [4]
Pass pass satellit
20140524[5]
Pass pass michalv
20140526
Pass pass satellit
201405031[6]
none
  1. bare metal install gnome 3.13.1 with anaconda 21.35-1
  2. 1024 bridged requires 2 cores to boot Anaconda Install to Vb worked (default gnome)
  3. 1024 bridged requires 2 cores to boot Anaconda Install to Vb worked (SoaS)
  4. 21.36-1 1024 bridged requires 2 cores to boot Anaconda Install to Vb worked (LXDE) yum install @sugar-desktop - Bare metal: worked but "no network connection"
  5. -VB (2 cores) and HD install; Custom Partitioning;standard ext4; cinnamon from DVD; wireless and wired work; yum install @sugar-network OK
  6. installed default Desktop in Virtualbox

Live image[edit]

Live.iso tests
Release Level Test Area Test Case i386 x86_64 EFI
Alpha Boot Methods QA:Testcase_Live_Image_Boot
Pass pass michalv
20140527
Pass pass satellit
20140530 [1]
Pass pass pschindl
20140524
Fail fail satellit
SoaS-20140529 [2]
none
Alpha Install Repository QA:Testcase_install_repository_Live_Image
none
Fail fail satellit
workstation-20140507 [3]
Fail fail satellit
workstation-20140517 [4]
Pass pass satellit
SoaS-20140517 [5]
Fail fail satellit [6]
Fedora-Live-MATE-Compiz-i686-rawhide-20140520 [7]
Fail fail michalv [8]
20140527
Fail fail satellit [9]
20140530 [10]
none
Pass pass satellit
SoaS-20140505
Pass pass satellit
Desktop-20140505
Fail fail satellit
workstation-20140507 [11]
Fail fail satellit
workstation-20140509 [12]
Pass pass satellit
SoaS-20140514 [13]
Fail fail satellit [6]
workstation-20140520 [14]
Pass pass satellit
SoaS-20140520 [15]
Pass pass satellit [6]
workstation-20140522 [16]
Warning warn pschindl
20140524 [17]
Warning warn satellit [8]
workstation-20140527 [18]
Warning warn satellit [8]
Fedora-Live-MATE-Compiz-20140528.iso[19]
Pass pass satellit
workstation 20140531 [20]
none
  1. workstation-KDE
  2. boots live Login screen pops up after first click of (>Next) locked in loop - in VirtualBox
  3. boots live but on install: "unaligned pointer 0x3fef79a"-Aborted Press any key to exit" (VirtualBox )
  4. boots live but on install to Virtualbox: "unaligned pointer 0x3fedfa61" INIT18: BOOT FAILURE liveinst 21.36-1
  5. VirtualBox(2 cores) Anaconda 21.36-1 liveinst
  6. 6.0 6.1 6.2 RHBZ #1099627
  7. boots live - fails install to Virtualbox: "unaligned pointer 0x3feefa81" INIT18: BOOT FAILURE liveinst 21.36-1
  8. 8.0 8.1 8.2 RHBZ #1101557
  9. RHBZ #1102793
  10. workstation - KDE install fails
  11. boots live but on install: "unaligned pointer 0x3feefa81"...Aborted (hard metal and VirtualBox 2 downloads)
  12. boots live in VirtualBox with 2 cores but no boot after install though anaconda indicates it completed
  13. Installs Bare Metal and VirtualBox(2 cores) Anaconda 21.36-1 liveinst
  14. boots live but on install to Virtualbox: "unaligned pointer 0x3feefa81" INIT18: BOOT FAILURE liveinst 21.36-1
  15. Installs on VirtualBox(2 cores) Anaconda 21.36-1 liveinst
  16. boots live DVD;installs to ext USB HD with reclaimdisk sucessfully liveinst 21.37-1
  17. RHBZ #1101020
  18. boots live DVD;fails install to ext USB HD with reclaimdisk both LVN and custom ext4 formatting 21.37-1
  19. boots .iso in VB;fails install with reclaimdisk both LVN and custom ext4 formatting 21.37-1
  20. installs to VB and bare metal

USB stick[edit]

USB stick tests
Release Level Test Area Test Case i386 x86_64 EFI
Alpha Boot Methods QA:Testcase_USB_stick_Live LiveUSB-creator
none
Pass pass satellit
workstation-20140522 [1]
none
Pass pass satellit
workstation-20140522 [2]
none
Alpha Boot Methods QA:Testcase_USB_stick_Live Live-ISO-to-Disk
none
none
none
Alpha Boot Methods QA:Testcase_USB_stick_Live_dd
none
Pass pass satellit
SoaS-20140517 [3]
none
none
  1. usb written in Workstation-live-(rawhide) installed to HD with 21.37-1 from DVD
  2. usb written in Workstation-live-(rawhide) installed to HD with 21.37-1 from DVD
  3. dd USB Boots

ARM disk images[edit]

In all of these tests, the test case used is QA:Testcase_arm_image_deployment. That is where the links point. The same test needs to be run for multiple images and target platforms.

ARM disk image functionality
Release Level Image Ext boot
Alpha Minimal
Pass pass pwhalen
20140527-Minimal
Pass pass pwhalen
20140529-Minimal
Alpha KDE
none
Optional Xfce
Fail fail pwhalen [1]
20140529-Xfce
Optional Desktop
Pass pass pwhalen
20140608-Workstation
Optional LXDE
none
Optional MATE
none
Optional SoaS
none
  1. RHBZ #1102793

Cloud images[edit]

Cloud images
Release Level Test Case i386 x86_64
Alpha QA:Testcase_EC2_AMI_Validation
none
none
Alpha QA:Testcase_OpenStack_Image_Validation
none
none


PXE images[edit]

PXE boot tests
Release Level Test Area Test Case i386 x86_64 ARM
Alpha Boot Methods QA:Testcase_Boot_Methods_Pxeboot
none
none
none


Storage device tests[edit]

Release Level Test Case x86[1] ARM
Alpha QA:Testcase_install_to_SATA
none
none
Alpha QA:Testcase_install_to_PATA
none
none
Alpha QA:Testcase_install_to_SCSI
none
none
Alpha QA:Testcase_install_to_SAS
none
none
Beta QA:Testcase_install_to_firmware_RAID
none
none
Beta QA:Testcase_install_to_hardware_RAID
none
none
Beta QA:Testcase_install_to_VirtIO
none
none
Final QA:Testcase_install_to_iSCSI_no_authentication
none
none
Final QA:Testcase_install_to_multipath
none
none
Final QA:Testcase_install_to_FCoE_target
none
none
  1. 'x86' means 'x86_64 or i386'

Storage volume type tests[edit]

Guided installation[edit]

Release Level Test Case x86 BIOS[1] x86 UEFI ARM
Alpha QA:Testcase_partitioning_guided_empty
Pass pass michalv
20140526
none
none
Alpha QA:Testcase_partitioning_guided_delete_all
none
Pass pass satellit
Desktop-20140505
none
none
Alpha QA:Testcase_partitioning_guided_multi_select
none
none
none
Beta QA:Testcase_partitioning_guided_delete_partial
none
none
none
Beta QA:Testcase_partitioning_guided_free_space
none
none
none
Beta QA:Testcase_partitioning_guided_encrypted
Pass pass michalv
20140529
Pass pass lnie
20140506
none
Beta QA:Testcase_partitioning_guided_multi_empty_all
none
none
none
  1. 'x86' means 'x86_64 or i386'

Guided shrinking[edit]

For this test, the column headings refer to the storage volume type to be shrunk, not the one chosen to replace it for the new installation.

Release Level Test Case LVM ext4 NTFS BTRFS
Final QA:Testcase_partitioning_guided_shrink
none
none
none
none


General Tests[edit]

Install Variations & General Tests
Release Level Test Area Test Case i386 x86_64 EFI ARM
Alpha Package Set QA:Testcase_Package_Sets_Default_Package_Install
none
Pass pass lnie
20140513
Fail fail michalv [1]
20140527
Alpha Package Set QA:Testcase_Package_Sets_KDE_Package_Install
none
Pass pass lnie
20140513
Pass pass michalv
20140526
Alpha Package Set QA:Testcase_Package_Sets_Minimal_Package_Install
Pass pass Wutao85
20140511,20140514
Pass pass lnie
20140511
Pass pass pschindl
20140525
Pass pass michalv
20140527
Pass pass pwhalen
20140529
Beta Partitioning QA:Testcase_Anaconda_custom_partitioning
Pass pass Wutao85
20140511,20140514
Pass pass lnie
20140513
Pass pass michalv
20140528
none
Beta Partitioning QA:Testcase_Partitioning_On_Software_RAID
Pass pass Wutao85
20140513
none
Final Partitioning QA:Testcase_dualboot_with_windows
none
none
none
Final Partitioning QA:Testcase_anaconda_btrfs_rootfs_on_disk_partition
Pass pass Wutao85
20140511
Pass pass lnie
20140506
Final Partitioning QA:Testcase_anaconda_ext3_rootfs_on_disk_partition
Pass pass Wutao85
20140513
Pass pass lnie
20140504
none
Final Partitioning QA:Testcase_anaconda_xfs_rootfs_on_disk_partition
none
none
Alpha User Interface QA:Testcase_Anaconda_User_Interface_Graphical
Pass pass Wutao85
20140514
Pass pass pschindl
20140525
Pass pass michalv
20140527
none
Alpha User Interface QA:Testcase_Anaconda_User_Interface_Basic_Video_Driver
Pass pass Wutao85
20140514
Pass pass michalv
20140529
none
Alpha User Interface QA:Testcase_Anaconda_User_Interface_Text
Pass pass Wutao85
20140514
Pass pass michalv
20140529
Pass pass pwhalen
20140529
Alpha User Interface QA:Testcase_Anaconda_User_Interface_VNC
Pass pass Wutao85
20140514
Fail fail lnie [2]
20140528
Fail fail pwhalen [3]
20140529
Alpha User Interface QA:Testcase_Anaconda_User_Interface_VNC_Vncconnect
Pass pass Wutao85
20140514
none
Beta User Interface QA:Testcase_Anaconda_User_Interface_serial_console
none
none
Pass pass pwhalen
20140529
Alpha Install Repository QA:Testcase_install_repository_Mirrorlist_default
none
Pass pass lnie
20140504
Pass pass michalv
20140530
Alpha Install Repository QA:Testcase_install_repository_Mirrorlist_graphical
Pass pass Wutao85
20140514
none
Alpha Install Repository QA:Testcase_install_repository_HTTP/FTP_graphical
none
Pass pass pschindl
20140525
Pass pass michalv
20140527
Alpha Install Repository QA:Testcase_install_repository_HTTP/FTP_variation
none
Pass pass michalv
20140529
Beta Install Repository QA:Testcase_install_repository_NFS_graphical
none
none
Beta Install Repository QA:Testcase_install_repository_NFS_variation
none
none
Final Install Repository QA:Testcase_install_repository_NFSISO_variation
none
none
Final Install Repository QA:Testcase_install_repository_Hard_drive_variation
none
none
Beta Storage Devices QA:Testcase_Install_to_Previous_KVM
none
Pass pass pschindl
20140525
Pass pass michalv
20140526
Beta Storage Devices QA:Testcase_Install_to_Current_KVM
none
Pass pass michalv
20140530
Final Storage Devices QA:Testcase_Boot_Methods_Xen_Para_Virt
none
none
Alpha Recovery QA:Testcase_Anaconda_save_traceback_to_bugzilla
none
none
Alpha Recovery QA:Testcase_Anaconda_rescue_mode
none
none
none
Alpha Recovery QA:Testcase_Anaconda_updates.img_via_URL
none
Pass pass lnie
20140528
Final Recovery QA:Testcase_Anaconda_updates.img_via_installation_source
none
none
Final Recovery QA:Testcase_Anaconda_updates.img_via_local_media
none
Warning warn lnie [4]
20140513
Beta Kickstart Delivery QA:Testcase_Kickstart_Http_Server_Ks_Cfg
none
none
none
Beta Kickstart Delivery QA:Testcase_Kickstart_File_Path_Ks_Cfg
none
none
Beta Kickstart Delivery QA:Testcase_Kickstart_Hd_Device_Path_Ks_Cfg
none
none
Beta Kickstart Delivery QA:Testcase_Kickstart_Nfs_Server_Path_Ks_Cfg
none
none
none
Alpha User Creation QA:Testcase_Anaconda_user_creation
none
Pass pass michalv
20140529
Beta Upgrade system QA:Testcase_upgrade_fedup_cli_previous_desktop
none
none
none
Beta Upgrade system QA:Testcase_upgrade_fedup_cli_previous_kde
none
none
none
Beta Upgrade system QA:Testcase_upgrade_fedup_cli_previous_minimal
none
none
none
Beta Upgrade system QA:Testcase_upgrade_fedup_cli_previous_desktop_encrypted
none
Fail fail mcatanzaro [5]
20140504
none
Optional Boot Methods QA:Testcase_Install_Image_Boot_Local
none
none
Optional Memory Test QA:Testcase_Memtest86
none
Pass pass michalv
20140530
Optional Recovery QA:Testcase_Anaconda_traceback_debug_mode
none
none
Optional Partitioning QA:Testcase_Partitioning_No_Swap
none
Pass pass lnie
20140528
none
  1. RHBZ #1101084
  2. RHBZ #1102496
  3. RHBZ #1102793
  4. RHBZ #1097606
  5. RHBZ #1038413