From Fedora Project Wiki

Warning: You are not logged in. Your IP address will be publicly visible if you make any edits. If you log in or create an account, your edits will be attributed to your username, along with other benefits.

The edit can be undone. Please check the comparison below to verify that this is what you want to do, and then save the changes below to finish undoing the edit.

Latest revision Your text
Line 19: Line 19:
  
 
The following cast of characters will be available testing, workarounds, bug fixes, and general discussion:
 
The following cast of characters will be available testing, workarounds, bug fixes, and general discussion:
* Development - [[User:Bcl|Brian Lane]] (bcl), David Cantrell (dcantrell), Vratislav Podzimek (vpodzime), Martin Kolman (mkolman)
+
* Development - [[User:Bcl|Brian Lane]] (bcl), David Cantrell (dcantrell)
 
* Quality Assurance - [[User:Adamwill|Adam Williamson]] (adamw), [[User:Roshi|Mike Ruckman]] (roshi)
 
* Quality Assurance - [[User:Adamwill|Adam Williamson]] (adamw), [[User:Roshi|Mike Ruckman]] (roshi)
  
 
== Prerequisite for Test Day ==  
 
== Prerequisite for Test Day ==  
  
* [[#Images|An image to test]]
+
* Rawhide nightly image(s) (links to come)
 
* Test system / drive or virtual machine (for this test day, you need something you can lose all the data from, non-destructive testing is not possible)
 
* Test system / drive or virtual machine (for this test day, you need something you can lose all the data from, non-destructive testing is not possible)
 
* (Optional) a server for hosting kickstarts
 
* (Optional) a server for hosting kickstarts
Line 30: Line 30:
 
== How to test? ==
 
== How to test? ==
  
=== Images ===
+
Download one of the nightly images to be used for testing, and run through one or more of the test cases listed [[#Test Results]] below. You can also do free form testing to exercise the package-related functions of the installer as much as possible: try different things in the '''INSTALLATION SOURCE''' and '''SOFTWARE SELECTION''' screens, and exercise the kickstart directives relating to repositories and package sets.
 
 
Please test with one of these images (the 2015-02-10 nightly builds). '''DO NOT USE 2015-02-11 OR LATER NIGHTLIES''' (Rawhide or Branched, including images found in {{filename|pub/fedora/linux/development/22/}} on the mirrors): they will fail to boot due to {{bz|1191713}}. Do not use ''unetbootin'' for live USB creation, it will not boot - see [[How to create and use Live USB]] for USB stick creation.
 
 
 
* [https://kojipkgs.fedoraproject.org/mash/rawhide-20150210/rawhide/x86_64/os/images/boot.iso 2015-02-10 x86_64 network install image]
 
* [https://kojipkgs.fedoraproject.org/mash/rawhide-20150210/rawhide/i386/os/images/boot.iso 2015-02-10 i386 network install image ('''32bit Gtk is broken''', graphical installations won't work)]
 
 
 
=== Known issues ===
 
 
 
For all testing described below, please note that there are some issues that are already known - no need to spend time reproducing these problems and filing new reports.
 
 
 
* 32bit Gtk is broken and segfaults if "suggested-action" buttons are used (see {{bz|1192020}})
 
* No proxy support. Proxies just won't be used
 
* kickstart repos additionally do not implement {{command|--cost}}, {{command|--excludepkgs}}, {{command|--includepkgs}}, {{command|--ignoregroups}}
 
* All of that, except proxy URL and cost, is also missing in the .repo files written with anaconda
 
* {{command|%packages --multilib}} is not implemented
 
* Language support selection is not saved in the dnf-langpacks configuration
 
* Excluding packages in a kickstart does not work
 
* In the GUI, the default package set is Cloud Server - this is caused by {{bz|1177002}}
 
* Booting 2015-02-11+ nightlies fails with "Failed to switch root": {{bz|1191713}}
 
 
 
=== Planned testing ===
 
 
 
Download one of the nightly images to be used for testing, and run through one or more of the test cases listed on the [http://testdays.qa.fedoraproject.org/testdays/show_event?event_id=22 results page]. [[#bugs|Report any bugs you encounter]], and enter your results on the [http://testdays.qa.fedoraproject.org/testdays/show_event?event_id=22 results page].
 
 
 
=== Exploratory testing ===
 
 
 
You can also do free form testing to exercise the package-related functions of the installer as much as possible: try different things in the '''INSTALLATION SOURCE''' and '''SOFTWARE SELECTION''' screens, and exercise the kickstart directives relating to repositories and package sets. Please add results to the [[#table|table below]]. Here are some ideas for exploratory testing from the installer developers:
 
 
 
* Try all environments (left-hand side choices) in '''SOFTWARE SELECTION''', with add-ons (right-hand side choices) left default: note dependency issues may be bugs in packages, not in anaconda or DNF, check the Rawhide Report emails to see
 
* Try ''Basic Desktop'', ''Minimal Install'' or ''KDE Plasma Workspaces'' environment and select all add-ons
 
* Test installation with the {{filename|/root/anaconda-ks.cfg}} file generated by any interactive install (e.g. those above), ensure it works and reproduces the same install options
 
* Test various options for {{code|%packages}}: {{code|--nocore}}, {{code|--multilib}}, {{code|--default}}, {{code|--nobase}}, {{code|<nowiki>--instLangs=LIST</nowiki>}}
 
* Test various options for {{code|@group}} definitions: {{code|--nodefaults}}, {{code|--optional}}
 
* Test various special entries in {{code|%packages}} sections:
 
*: {{code|*}} - all packages
 
*: {{code|-@group}} - exclude group
 
*: {{code|cloud*}} - wildcard package match
 
*: {{code|-cloud*}} - exclude wildcard package match
 
*: {{code|-kernel}} - exclude kernel (should work, with kernel-core)
 
*: {{code|-kernel*}} - exclude kernels (???)
 
 
 
=== Automatable kickstarts ===
 
 
 
It would be very valuable to the installer team for testers to help produce more kickstarts which can be used for automated testing. This is really just a regular kickstart with some shell script commands in {{code|%post}} that check whether the installed system matches the intent of the kickstart and place the result in the file {{filename|/root/RESULT}}. For a successful run, the file should contain only the text {{code|SUCCESS}}. For a failed run, the file should contain a short error message.
 
 
 
Please upload these kickstarts somewhere publicly accessible, or if you do not have access to a publicly accessible server, you can [[Special:Upload|upload them to this Wiki]]. Please add them to the [[#table|table below]].
 
 
 
Here is an example automatable kickstart, which sets some package groups and environment groups to be installed and checks that they are:
 
<pre>
 
url --mirrorlist=https://mirrors.fedoraproject.org/mirrorlist?repo=fedora-$releasever&arch=$basearch
 
install
 
network --bootproto=dhcp
 
 
 
bootloader --timeout=1
 
zerombr
 
clearpart --all
 
autopart
 
 
 
keyboard us
 
lang en
 
timezone America/New_York
 
rootpw qweqwe
 
shutdown
 
 
 
%packages
 
@core
 
@c-development
 
@^web-server-environment
 
%end
 
 
 
%post
 
# We don't have a way of determining if a group/env is installed or not.
 
# These sentinel packages will have to do.
 
rpm -q httpd
 
if [[ $? != 0 ]]; then
 
    echo '*** web-server-environment was not installed' > /root/RESULT
 
else
 
    rpm -q gcc
 
    if [[ $? != 0 ]]; then
 
      echo '*** c-development was not installed' > /root/RESULT
 
    else
 
      echo SUCCESS > /root/RESULT
 
    fi
 
fi
 
%end
 
</pre>
 
 
 
{{anchor|table}}
 
=== Exploratory / kickstart testing results ===
 
 
 
You can add test kickstarts and bugs you encounter in exploratory testing to the table below, following the example format. Please include all details and comments about the bug in the bug report and just include your name and the lists of bugs and kickstarts in the table. It's fine to only include bugs (if you only do interactive testing) or only kickstarts (if you tested kickstarts and didn't find any bugs). If you do not have access to a site or service to upload your kickstarts to, you can [[Special:Upload|upload them to this Wiki]].
 
 
 
{| class="wikitable collapsible" width=100%
 
|-
 
! Tester !! Bugs reported !! Kickstarts
 
|-
 
| [[User:Example|Example]]
 
| {{bz|123456}} {{bz|654321}}
 
| [https://www.happyassassin.net/ks/groups.ks groups.ks]
 
|-
 
| kparal
 
| {{bz|1192139}} {{bz|1192142}} {{bz|1192155}}
 
|
 
|-
 
| roshi
 
| text interface: {{bz|1192230}} {{bz|1192248}} {{bz|1192259}}
 
|
 
|}
 
 
 
{{anchor|bugs}}
 
  
 
== Reporting bugs ==
 
== Reporting bugs ==
Line 147: Line 37:
  
 
* [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&version=rawhide&component=anaconda anaconda]
 
* [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&version=rawhide&component=anaconda anaconda]
* [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&version=rawhide&component=gtk3 gtk3]
 
 
* [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&version=rawhide&component=dnf dnf]
 
* [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&version=rawhide&component=dnf dnf]
 
* [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&version=rawhide&component=librepo librepo]
 
* [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&version=rawhide&component=librepo librepo]
 
* [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&version=rawhide&component=hawkey hawkey]
 
* [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&version=rawhide&component=hawkey hawkey]
  
Please make sure you provide as much information as possible. In particular '''if an issue happened during the installation process or after reboot''' (during the first boot). Also '''please attach logs from the installation''' -- they are under ''/tmp'' during the installation process and under ''/var/log/anaconda'' on the installed system -- as '''single text/plain files''' (i.e. not as an archive). If "An unhandled error" window appears, please use the ''Report'' button and report bug this way.
+
If you are unsure about which component to report a bug against, exactly how to file the report, or what other information to include, just ask on IRC and we will help you.
  
If you are unsure about which component to report a bug against, exactly how to file the report, or what other information to include, just ask on IRC and we will help you.
+
Once you have completed the tests, add your results to the Results table below, following the example results from the first line as a template. The first column should be your name with a link to your User page in the Wiki if you have one. For each test case, use the [[Template:result|result template]] to enter your result, as shown in the example result line.
  
 
== Test Results ==
 
== Test Results ==
 
 
 
=== Repository tests ===
 
  
 
{|
 
{|
 
! User
 
! User
! Hardware
+
! [[QA:Testcase_sample_1|Sample test 1]]
! [[QA:Testcase_install_repository_HTTP/FTP_graphical|HTTP/FTP graphical]]
+
! [[QA:Testcase_sample_2|Sample test 2]]
! [[QA:Testcase_install_repository_HTTP/FTP_variation|HTTP/FTP variation]]
+
! [[QA:Testcase_sample_3|Sample test 3]]
! [[QA:Testcase_install_repository_Mirrorlist_graphical|Mirrorlist graphical]]
+
! [[QA:Testcase_sample_4|Sample test 4]]
! [[QA:Testcase_install_repository_NFS_graphical|NFS graphical]]
 
! [[QA:Testcase_install_repository_NFS_variation|NFS variation]]
 
! [[QA:Testcase_install_repository_NFSISO_variation|NFS ISO variation]]
 
! [[QA:Testcase_Ftp_Repository|FTP]]
 
! [[QA:Testcase_Additional_Ftp_Repository|FTP additional]]
 
 
! References
 
! References
 
|-
 
|-
| [[User:abcd|abcd]]
+
| [[User:SampleUser|Sample User]]
| asdf
+
| {{result|none}}  
| {{result|pass}} 
+
| {{result|pass}}
|
+
| {{result|warn}} <ref>Test pass, but also encountered {{bz|54321}}</ref>
|
+
| {{result|fail}} <ref>{{bz|12345}}</ref>
|
 
|
 
|
 
|
 
|
 
| <references/>
 
|-
 
| [[User:bcl|bcl]]
 
| UEFI+SecureBoot
 
|
 
|
 
| {{result|pass}}
 
|
 
|
 
|
 
|
 
|
 
| <references/>
 
|-
 
| [[User:amsharma|amsharma]]
 
| x86_64
 
| {{result|fail}}  <ref>{{bz|1191847}}</ref>
 
| {{result|fail}}  <ref>{{bz|1191847}}</ref>
 
| {{result|fail}}  {{result|pass}}
 
|
 
|
 
|
 
|
 
|
 
| <references/>
 
|-
 
| [[User:rjcobain|rjcobain]]
 
| MacbookPro-17inch-Mid2010
 
| {{result|pass}} 
 
|
 
|
 
|
 
|
 
|
 
|
 
|
 
| <references/>
 
|-
 
| [[User:juliuxpigface|juliuxpigface]]
 
| kvm (x86_64)
 
|
 
|
 
|
 
|
 
|
 
|
 
|
 
| {{result|fail}}  <ref>{{bz|1192323}}</ref><ref>comps from supplementary repository not used (may be due to error in comps format).</ref>
 
| <references/>
 
|-
 
| [[User:jskarvad|jskarvad]]
 
| Lenovo x220 (x86_64)
 
| {{result|pass}}  <ref>{{bz|1192104}}</ref><ref>{{bz|1192112}}</ref><ref>{{bz|1192117}}</ref><ref>{{bz|1192147}}</ref><ref>Server</ref>
 
|
 
|
 
|
 
|
 
|
 
|
 
|
 
| <references/>
 
|-
 
| [[User:aikidouke|aikidouke]]
 
| VirtualBox
 
| {{result|warn}}
 
|
 
|
 
|
 
|
 
|
 
|
 
|
 
| <references/>
 
|-
 
| [[User:rvykydal|rvykydal]]
 
| kvm
 
|
 
|
 
|
 
|
 
|
 
|
 
| {{result|pass}} 
 
|
 
| <references/>
 
|-
 
| [[User:kparal|kparal]]
 
| kvm
 
| {{result|pass}} 
 
| {{result|pass}} 
 
| {{result|pass}}  {{result|fail}}  <ref>fedora 22 mirrorlist not working yet</ref>
 
|
 
|
 
|
 
| {{result|pass}} 
 
|
 
| <references/>
 
|-
 
| [[User:sbueno|sbueno]]
 
| kvm
 
| {{result|pass}} 
 
| {{result|pass}} 
 
|
 
|
 
|
 
|
 
|
 
|
 
| <references/>
 
|-
 
| [[User:jsedlak|jsedlak]]
 
| kvm
 
| {{result|warn}}  <ref>{{bz|1191991}}</ref>
 
| {{result|pass}} 
 
|
 
|
 
|
 
|
 
|
 
|
 
| <references/>
 
|-
 
| [[User:sirdeiu|sirdeiu]]
 
| AMD-x86_64
 
| {{result|pass}}  <ref>Fedora Server product, installed from http source.</ref>
 
|
 
|
 
|
 
|
 
|
 
|
 
|
 
| <references/>
 
|-
 
| [[User:mkolman|mkolman]]
 
| kvm
 
| {{result|pass}}  <ref>{{bz|1192139}}</ref>{{result|pass}} 
 
|
 
|
 
| {{result|fail}} <ref>{{bz|1192448}}</ref><ref>Kickstart installation with NFS source fails in post installation phase.</ref>{{result|pass}} 
 
| {{result|fail}}  <ref>{{bz|1192448}}</ref><ref>Kickstart installation from NFS source failed in post installation phase.</ref>{{result|pass}} 
 
| {{result|pass}}  <ref>Worked fine with kickstart, boot option and even when manually entering the NFS address.</ref>
 
|
 
|
 
| <references/>
 
|-
 
| [[User:lbrabec|lbrabec]]
 
| x86_64
 
| {{result|pass}}  <ref>Fedora Server</ref>
 
|
 
| {{result|fail}} 
 
|
 
|
 
|
 
|
 
|
 
| <references/>
 
|-
 
| [[User:vpodzime|vpodzime]]
 
| x86_64 (KVM)
 
| {{result|pass}} 
 
| {{result|pass}} 
 
| {{result|warn}}  <ref>{{bz|1192100}}</ref>{{result|warn}}  <ref>{{bz|1191991}}</ref><ref>change from mirrorlist to metalink requires new software selection (a general issue with switching sources/repos)</ref>
 
|
 
|
 
|
 
| {{result|pass}} 
 
|
 
| <references/>
 
|-
 
| [[User:lnie|lnie]]
 
| KVM
 
| {{result|pass}} 
 
| {{result|pass}} 
 
|
 
|
 
|
 
|
 
|
 
|
 
| <references/>
 
|-
 
| [[User:BobLfoot|BobLfoot]]
 
| Centos7-X8664-KVM
 
| {{result|pass}}  <ref>Fedora Workstation Installed with default options elsewhere.  18 GB Disk and 1GB ram</ref>
 
|
 
|
 
|
 
|
 
|
 
|
 
|
 
| <references/>
 
|-
 
| [[User:pschindl|pschindl]]
 
| kvm
 
| {{result|pass}} 
 
| {{result|pass}} 
 
| {{result|pass}} 
 
|
 
|
 
|
 
| {{result|pass}}  <ref>graphical</ref>{{result|pass}} 
 
|
 
| <references/>
 
|-
 
|}
 
 
 
 
 
=== Package set tests ===
 
 
 
{|
 
! User
 
! Hardware
 
! [[QA:Testcase_Package_Sets_KDE_Package_Install|KDE]]
 
! [[QA:Testcase_Package_Sets_Minimal_Package_Install|Minimal]]
 
! References
 
|-
 
| [[User:xmrbrz|xmrbrz]]
 
| gnome-boxes(x86_64)
 
| {{result|pass}}  <ref>standard kde installation</ref>
 
| {{result|pass}}  <ref>standard minimal installation</ref>
 
| <references/>
 
|-
 
| [[User:jskarvad|jskarvad]]
 
| Lenovo x220 (x86_64)
 
|
 
| {{result|pass}} 
 
| <references/>
 
|-
 
| [[User:kparal|kparal]]
 
| kvm
 
| {{result|fail}}  <ref>{{bz|1191991}}</ref>
 
| {{result|pass}} 
 
| <references/>
 
|-
 
| [[User:sbueno|sbueno]]
 
| kvm
 
|
 
| {{result|pass}} 
 
| <references/>
 
|-
 
| [[User:vpodzime|vpodzime]]
 
| x86_64 (KVM)
 
| {{result|pass}} 
 
| {{result|pass}} 
 
| <references/>
 
|-
 
| [[User:lnie|lnie]]
 
| KVM
 
| {{result|fail}}  <ref>{{bz|1191991}}</ref>
 
| {{result|pass}} 
 
| <references/>
 
|-
 
| [[User:pschindl|pschindl]]
 
| kvm
 
| {{result|fail}}  <ref>{{bz|1191991}}</ref><ref>I tried to use rawhide mirrorlist, f22 mirrorlist and closest mirror and I had this problem with every of them.</ref>
 
| {{result|pass}} 
 
 
| <references/>
 
| <references/>
 
|-
 
|-
 
|}
 
|}
 
  
 
[[Category:Fedora 22 Test Days]]
 
[[Category:Fedora 22 Test Days]]

Please note that all contributions to Fedora Project Wiki are considered to be released under the Attribution-Share Alike 3.0 Unported (see Fedora Project Wiki:Copyrights for details). If you do not want your writing to be edited mercilessly and redistributed at will, then do not submit it here.
You are also promising us that you wrote this yourself, or copied it from a public domain or similar free resource. Do not submit copyrighted work without permission!

To edit this page, please solve the following task below and enter the answer in the box (more info):

Cancel Editing help (opens in new window)