From Fedora Project Wiki

(add notes to cover 02-11 nightlies failing and mirrormanager not working for 22)
m (internal link cleaning)
 
(18 intermediate revisions by 11 users not shown)
Line 19: Line 19:


The following cast of characters will be available testing, workarounds, bug fixes, and general discussion:
The following cast of characters will be available testing, workarounds, bug fixes, and general discussion:
* Development - [[User:Bcl|Brian Lane]] (bcl), David Cantrell (dcantrell), Vratislav Podzimek (vpodzime)
* Development - [[User:Bcl|Brian Lane]] (bcl), David Cantrell (dcantrell), Vratislav Podzimek (vpodzime), Martin Kolman (mkolman)
* Quality Assurance - [[User:Adamwill|Adam Williamson]] (adamw), [[User:Roshi|Mike Ruckman]] (roshi)
* Quality Assurance - [[User:Adamwill|Adam Williamson]] (adamw), [[User:Roshi|Mike Ruckman]] (roshi)


Line 32: Line 32:
=== Images ===
=== Images ===


Please test with one of these images (the 2015-02-10 nightly builds). '''DO NOT USE 2015-02-11 OR LATER NIGHTLIES''' (Rawhide or Branched, including images found in {{filename|pub/fedora/linux/development/22/}} on the mirrors): they will fail to boot due to {{bz|1191713}}.
Please test with one of these images (the 2015-02-10 nightly builds). '''DO NOT USE 2015-02-11 OR LATER NIGHTLIES''' (Rawhide or Branched, including images found in {{filename|pub/fedora/linux/development/22/}} on the mirrors): they will fail to boot due to {{bz|1191713}}. Do not use ''unetbootin'' for live USB creation, it will not boot - see [[How to create and use Live USB]] for USB stick creation.


* [https://kojipkgs.fedoraproject.org/mash/rawhide-20150210/rawhide/x86_64/os/images/boot.iso 2015-02-10 x86_64 network install image]
* [https://kojipkgs.fedoraproject.org/mash/rawhide-20150210/rawhide/x86_64/os/images/boot.iso 2015-02-10 x86_64 network install image]
* [https://kojipkgs.fedoraproject.org/mash/rawhide-20150210/rawhide/i386/os/images/boot.iso 2015-02-10 i386 network install image]
* [https://kojipkgs.fedoraproject.org/mash/rawhide-20150210/rawhide/i386/os/images/boot.iso 2015-02-10 i386 network install image ('''32bit Gtk is broken''', graphical installations won't work)]


=== Known issues ===
=== Known issues ===
Line 41: Line 41:
For all testing described below, please note that there are some issues that are already known - no need to spend time reproducing these problems and filing new reports.
For all testing described below, please note that there are some issues that are already known - no need to spend time reproducing these problems and filing new reports.


* 32bit Gtk is broken and segfaults if "suggested-action" buttons are used (see {{bz|1192020}})
* No proxy support. Proxies just won't be used
* No proxy support. Proxies just won't be used
* kickstart repos additionally do not implement {{command|--cost}}, {{command|--excludepkgs}}, {{command|--includepkgs}}, {{command|--ignoregroups}}
* kickstart repos additionally do not implement {{command|--cost}}, {{command|--excludepkgs}}, {{command|--includepkgs}}, {{command|--ignoregroups}}
Line 49: Line 50:
* In the GUI, the default package set is Cloud Server - this is caused by {{bz|1177002}}
* In the GUI, the default package set is Cloud Server - this is caused by {{bz|1177002}}
* Booting 2015-02-11+ nightlies fails with "Failed to switch root": {{bz|1191713}}
* Booting 2015-02-11+ nightlies fails with "Failed to switch root": {{bz|1191713}}
* Mirror manager is not currently set up for Fedora 22; a repo URL like {{code|<nowiki>http://mirrors.fedoraproject.org/mirrorlist?repo=fedora-22&arch=x86_64</nowiki>}} will fail. Use {{code|<nowiki>https://mirrors.fedoraproject.org/mirrorlist?repo=fedora-rawhide&arch=x86_64</nowiki>}} or {{code|<nowiki>https://mirrors.fedoraproject.org/mirrorlist?repo=fedora-$releasever&arch=$basearch</nowiki>}} (in a kickstart, with the 2015-02-10 nightly images) instead


=== Planned testing ===
=== Planned testing ===
Line 131: Line 131:
| [https://www.happyassassin.net/ks/groups.ks groups.ks]
| [https://www.happyassassin.net/ks/groups.ks groups.ks]
|-
|-
| kparal
| {{bz|1192139}} {{bz|1192142}} {{bz|1192155}}
|
|-
| roshi
| text interface: {{bz|1192230}} {{bz|1192248}} {{bz|1192259}}
|
|}
|}


{{anchor|bugs}}
{{anchor|bugs}}
== Reporting bugs ==
== Reporting bugs ==


Line 139: Line 147:


* [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&version=rawhide&component=anaconda anaconda]
* [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&version=rawhide&component=anaconda anaconda]
* [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&version=rawhide&component=gtk3 gtk3]
* [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&version=rawhide&component=dnf dnf]
* [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&version=rawhide&component=dnf dnf]
* [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&version=rawhide&component=librepo librepo]
* [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&version=rawhide&component=librepo librepo]
Line 149: Line 158:
== Test Results ==
== Test Results ==


Please enter results for the planned testing on [http://testdays.qa.fedoraproject.org/testdays/show_event?event_id=22 the results page]. The results will be transferred here some time after the Test Day concludes for the record.
 
 
=== Repository tests ===
 
{|
! User
! Hardware
! [[QA:Testcase_install_repository_HTTP/FTP_graphical|HTTP/FTP graphical]]
! [[QA:Testcase_install_repository_HTTP/FTP_variation|HTTP/FTP variation]]
! [[QA:Testcase_install_repository_Mirrorlist_graphical|Mirrorlist graphical]]
! [[QA:Testcase_install_repository_NFS_graphical|NFS graphical]]
! [[QA:Testcase_install_repository_NFS_variation|NFS variation]]
! [[QA:Testcase_install_repository_NFSISO_variation|NFS ISO variation]]
! [[QA:Testcase_Ftp_Repository|FTP]]
! [[QA:Testcase_Additional_Ftp_Repository|FTP additional]]
! References
|-
| [[User:abcd|abcd]]
| asdf
| {{result|pass}} 
|
|
|
|
|
|
|
| <references/>
|-
| [[User:bcl|bcl]]
| UEFI+SecureBoot
|
|
| {{result|pass}} 
|
|
|
|
|
| <references/>
|-
| [[User:amsharma|amsharma]]
| x86_64
| {{result|fail}}  <ref>{{bz|1191847}}</ref>
| {{result|fail}}  <ref>{{bz|1191847}}</ref>
| {{result|fail}}  {{result|pass}} 
|
|
|
|
|
| <references/>
|-
| [[User:rjcobain|rjcobain]]
| MacbookPro-17inch-Mid2010
| {{result|pass}} 
|
|
|
|
|
|
|
| <references/>
|-
| [[User:juliuxpigface|juliuxpigface]]
| kvm (x86_64)
|
|
|
|
|
|
|
| {{result|fail}}  <ref>{{bz|1192323}}</ref><ref>comps from supplementary repository not used (may be due to error in comps format).</ref>
| <references/>
|-
| [[User:jskarvad|jskarvad]]
| Lenovo x220 (x86_64)
| {{result|pass}}  <ref>{{bz|1192104}}</ref><ref>{{bz|1192112}}</ref><ref>{{bz|1192117}}</ref><ref>{{bz|1192147}}</ref><ref>Server</ref>
|
|
|
|
|
|
|
| <references/>
|-
| [[User:aikidouke|aikidouke]]
| VirtualBox
| {{result|warn}}
|
|
|
|
|
|
|
| <references/>
|-
| [[User:rvykydal|rvykydal]]
| kvm
|
|
|
|
|
|
| {{result|pass}} 
|
| <references/>
|-
| [[User:kparal|kparal]]
| kvm
| {{result|pass}} 
| {{result|pass}} 
| {{result|pass}}  {{result|fail}}  <ref>fedora 22 mirrorlist not working yet</ref>
|
|
|
| {{result|pass}} 
|
| <references/>
|-
| [[User:sbueno|sbueno]]
| kvm
| {{result|pass}} 
| {{result|pass}} 
|
|
|
|
|
|
| <references/>
|-
| [[User:jsedlak|jsedlak]]
| kvm
| {{result|warn}}  <ref>{{bz|1191991}}</ref>
| {{result|pass}} 
|
|
|
|
|
|
| <references/>
|-
| [[User:sirdeiu|sirdeiu]]
| AMD-x86_64
| {{result|pass}}  <ref>Fedora Server product, installed from http source.</ref>
|
|
|
|
|
|
|
| <references/>
|-
| [[User:mkolman|mkolman]]
| kvm
| {{result|pass}}  <ref>{{bz|1192139}}</ref>{{result|pass}} 
|
|
| {{result|fail}}  <ref>{{bz|1192448}}</ref><ref>Kickstart installation with NFS source fails in post installation phase.</ref>{{result|pass}} 
| {{result|fail}}  <ref>{{bz|1192448}}</ref><ref>Kickstart installation from NFS source failed in post installation phase.</ref>{{result|pass}} 
| {{result|pass}}  <ref>Worked fine with kickstart, boot option and even when manually entering the NFS address.</ref>
|
|
| <references/>
|-
| [[User:lbrabec|lbrabec]]
| x86_64
| {{result|pass}}  <ref>Fedora Server</ref>
|
| {{result|fail}} 
|
|
|
|
|
| <references/>
|-
| [[User:vpodzime|vpodzime]]
| x86_64 (KVM)
| {{result|pass}} 
| {{result|pass}} 
| {{result|warn}}  <ref>{{bz|1192100}}</ref>{{result|warn}}  <ref>{{bz|1191991}}</ref><ref>change from mirrorlist to metalink requires new software selection (a general issue with switching sources/repos)</ref>
|
|
|
| {{result|pass}} 
|
| <references/>
|-
| [[User:lnie|lnie]]
| KVM
| {{result|pass}} 
| {{result|pass}} 
|
|
|
|
|
|
| <references/>
|-
| [[User:BobLfoot|BobLfoot]]
| Centos7-X8664-KVM
| {{result|pass}}  <ref>Fedora Workstation Installed with default options elsewhere.  18 GB Disk and 1GB ram</ref>
|
|
|
|
|
|
|
| <references/>
|-
| [[User:pschindl|pschindl]]
| kvm
| {{result|pass}} 
| {{result|pass}} 
| {{result|pass}} 
|
|
|
| {{result|pass}}  <ref>graphical</ref>{{result|pass}} 
|
| <references/>
|-
|}
 
 
=== Package set tests ===
 
{|
! User
! Hardware
! [[QA:Testcase_Package_Sets_KDE_Package_Install|KDE]]
! [[QA:Testcase_Package_Sets_Minimal_Package_Install|Minimal]]
! References
|-
| [[User:xmrbrz|xmrbrz]]
| gnome-boxes(x86_64)
| {{result|pass}}  <ref>standard kde installation</ref>
| {{result|pass}}  <ref>standard minimal installation</ref>
| <references/>
|-
| [[User:jskarvad|jskarvad]]
| Lenovo x220 (x86_64)
|
| {{result|pass}} 
| <references/>
|-
| [[User:kparal|kparal]]
| kvm
| {{result|fail}}  <ref>{{bz|1191991}}</ref>
| {{result|pass}} 
| <references/>
|-
| [[User:sbueno|sbueno]]
| kvm
|
| {{result|pass}} 
| <references/>
|-
| [[User:vpodzime|vpodzime]]
| x86_64 (KVM)
| {{result|pass}} 
| {{result|pass}} 
| <references/>
|-
| [[User:lnie|lnie]]
| KVM
| {{result|fail}}  <ref>{{bz|1191991}}</ref>
| {{result|pass}} 
| <references/>
|-
| [[User:pschindl|pschindl]]
| kvm
| {{result|fail}}  <ref>{{bz|1191991}}</ref><ref>I tried to use rawhide mirrorlist, f22 mirrorlist and closest mirror and I had this problem with every of them.</ref>
| {{result|pass}} 
| <references/>
|-
|}
 


[[Category:Fedora 22 Test Days]]
[[Category:Fedora 22 Test Days]]

Latest revision as of 21:43, 19 September 2016

Fedora Test Days
Anaconda and Dnf

Date 2015-02-12
Time all day

Website Fedora Calendar
IRC #fedora-test-day (webirc)
Mailing list test


Can't make the date?
If you come to this page before or after the test day is completed, your testing is still valuable, and you can use the information on this page to test, file any bugs you find at Bugzilla, and add your results to the results section. If this page is more than a month old when you arrive here, please check the current schedule and see if a similar but more recent Test Day is planned or has already happened.

What to test?[edit]

Today's instalment of Fedora Test Day will focus on DNF use in Anaconda, the Fedora installer. DNF is the package manager intended to replace yum as the default for Fedora soon: part of the goal of this test day is to decide if it is in good enough shape to replace yum for Anaconda for Fedora 22.

Who's available[edit]

The following cast of characters will be available testing, workarounds, bug fixes, and general discussion:

Prerequisite for Test Day[edit]

  • An image to test
  • Test system / drive or virtual machine (for this test day, you need something you can lose all the data from, non-destructive testing is not possible)
  • (Optional) a server for hosting kickstarts

How to test?[edit]

Images[edit]

Please test with one of these images (the 2015-02-10 nightly builds). DO NOT USE 2015-02-11 OR LATER NIGHTLIES (Rawhide or Branched, including images found in pub/fedora/linux/development/22/ on the mirrors): they will fail to boot due to RHBZ #1191713. Do not use unetbootin for live USB creation, it will not boot - see How to create and use Live USB for USB stick creation.

Known issues[edit]

For all testing described below, please note that there are some issues that are already known - no need to spend time reproducing these problems and filing new reports.

  • 32bit Gtk is broken and segfaults if "suggested-action" buttons are used (see RHBZ #1192020)
  • No proxy support. Proxies just won't be used
  • kickstart repos additionally do not implement --cost, --excludepkgs, --includepkgs, --ignoregroups
  • All of that, except proxy URL and cost, is also missing in the .repo files written with anaconda
  • %packages --multilib is not implemented
  • Language support selection is not saved in the dnf-langpacks configuration
  • Excluding packages in a kickstart does not work
  • In the GUI, the default package set is Cloud Server - this is caused by RHBZ #1177002
  • Booting 2015-02-11+ nightlies fails with "Failed to switch root": RHBZ #1191713

Planned testing[edit]

Download one of the nightly images to be used for testing, and run through one or more of the test cases listed on the results page. Report any bugs you encounter, and enter your results on the results page.

Exploratory testing[edit]

You can also do free form testing to exercise the package-related functions of the installer as much as possible: try different things in the INSTALLATION SOURCE and SOFTWARE SELECTION screens, and exercise the kickstart directives relating to repositories and package sets. Please add results to the table below. Here are some ideas for exploratory testing from the installer developers:

  • Try all environments (left-hand side choices) in SOFTWARE SELECTION, with add-ons (right-hand side choices) left default: note dependency issues may be bugs in packages, not in anaconda or DNF, check the Rawhide Report emails to see
  • Try Basic Desktop, Minimal Install or KDE Plasma Workspaces environment and select all add-ons
  • Test installation with the /root/anaconda-ks.cfg file generated by any interactive install (e.g. those above), ensure it works and reproduces the same install options
  • Test various options for %packages: --nocore, --multilib, --default, --nobase, --instLangs=LIST
  • Test various options for @group definitions: --nodefaults, --optional
  • Test various special entries in %packages sections:
    * - all packages
    -@group - exclude group
    cloud* - wildcard package match
    -cloud* - exclude wildcard package match
    -kernel - exclude kernel (should work, with kernel-core)
    -kernel* - exclude kernels (???)

Automatable kickstarts[edit]

It would be very valuable to the installer team for testers to help produce more kickstarts which can be used for automated testing. This is really just a regular kickstart with some shell script commands in %post that check whether the installed system matches the intent of the kickstart and place the result in the file /root/RESULT. For a successful run, the file should contain only the text SUCCESS. For a failed run, the file should contain a short error message.

Please upload these kickstarts somewhere publicly accessible, or if you do not have access to a publicly accessible server, you can upload them to this Wiki. Please add them to the table below.

Here is an example automatable kickstart, which sets some package groups and environment groups to be installed and checks that they are:

url --mirrorlist=https://mirrors.fedoraproject.org/mirrorlist?repo=fedora-$releasever&arch=$basearch
install
network --bootproto=dhcp

bootloader --timeout=1
zerombr
clearpart --all
autopart

keyboard us
lang en
timezone America/New_York
rootpw qweqwe
shutdown

%packages
@core
@c-development
@^web-server-environment
%end

%post
# We don't have a way of determining if a group/env is installed or not.
# These sentinel packages will have to do.
rpm -q httpd
if [[ $? != 0 ]]; then
    echo '*** web-server-environment was not installed' > /root/RESULT
else
    rpm -q gcc
    if [[ $? != 0 ]]; then
       echo '*** c-development was not installed' > /root/RESULT
    else
       echo SUCCESS > /root/RESULT
    fi
fi
%end

Exploratory / kickstart testing results[edit]

You can add test kickstarts and bugs you encounter in exploratory testing to the table below, following the example format. Please include all details and comments about the bug in the bug report and just include your name and the lists of bugs and kickstarts in the table. It's fine to only include bugs (if you only do interactive testing) or only kickstarts (if you tested kickstarts and didn't find any bugs). If you do not have access to a site or service to upload your kickstarts to, you can upload them to this Wiki.

Tester Bugs reported Kickstarts
Example RHBZ #123456 RHBZ #654321 groups.ks
kparal RHBZ #1192139 RHBZ #1192142 RHBZ #1192155
roshi text interface: RHBZ #1192230 RHBZ #1192248 RHBZ #1192259

Reporting bugs[edit]

If you have problems with any of the tests, report a bug to Bugzilla for the appropriate component. Likely choices are:

Please make sure you provide as much information as possible. In particular if an issue happened during the installation process or after reboot (during the first boot). Also please attach logs from the installation -- they are under /tmp during the installation process and under /var/log/anaconda on the installed system -- as single text/plain files (i.e. not as an archive). If "An unhandled error" window appears, please use the Report button and report bug this way.

If you are unsure about which component to report a bug against, exactly how to file the report, or what other information to include, just ask on IRC and we will help you.

Test Results[edit]

Repository tests[edit]

User Hardware HTTP/FTP graphical HTTP/FTP variation Mirrorlist graphical NFS graphical NFS variation NFS ISO variation FTP FTP additional References
abcd asdf
Pass pass
bcl UEFI+SecureBoot
Pass pass
amsharma x86_64
Fail fail
[1]
Fail fail
[2]
Fail fail
Pass pass
  1. RHBZ #1191847
  2. RHBZ #1191847
rjcobain MacbookPro-17inch-Mid2010
Pass pass
juliuxpigface kvm (x86_64)
Fail fail
[1][2]
  1. RHBZ #1192323
  2. comps from supplementary repository not used (may be due to error in comps format).
jskarvad Lenovo x220 (x86_64)
Pass pass
[1][2][3][4][5]
  1. RHBZ #1192104
  2. RHBZ #1192112
  3. RHBZ #1192117
  4. RHBZ #1192147
  5. Server
aikidouke VirtualBox
Warning warn
rvykydal kvm
Pass pass
kparal kvm
Pass pass
Pass pass
Pass pass
Fail fail
[1]
Pass pass
  1. fedora 22 mirrorlist not working yet
sbueno kvm
Pass pass
Pass pass
jsedlak kvm
Warning warn
[1]
Pass pass
  1. RHBZ #1191991
sirdeiu AMD-x86_64
Pass pass
[1]
  1. Fedora Server product, installed from http source.
mkolman kvm
Pass pass
[1]
Pass pass
Fail fail
[2][3]
Pass pass
Fail fail
[4][5]
Pass pass
Pass pass
[6]
  1. RHBZ #1192139
  2. RHBZ #1192448
  3. Kickstart installation with NFS source fails in post installation phase.
  4. RHBZ #1192448
  5. Kickstart installation from NFS source failed in post installation phase.
  6. Worked fine with kickstart, boot option and even when manually entering the NFS address.
lbrabec x86_64
Pass pass
[1]
Fail fail
  1. Fedora Server
vpodzime x86_64 (KVM)
Pass pass
Pass pass
Warning warn
[1]
Warning warn
[2][3]
Pass pass
  1. RHBZ #1192100
  2. RHBZ #1191991
  3. change from mirrorlist to metalink requires new software selection (a general issue with switching sources/repos)
lnie KVM
Pass pass
Pass pass
BobLfoot Centos7-X8664-KVM
Pass pass
[1]
  1. Fedora Workstation Installed with default options elsewhere. 18 GB Disk and 1GB ram
pschindl kvm
Pass pass
Pass pass
Pass pass
Pass pass
[1]
Pass pass
  1. graphical


Package set tests[edit]

User Hardware KDE Minimal References
xmrbrz gnome-boxes(x86_64)
Pass pass
[1]
Pass pass
[2]
  1. standard kde installation
  2. standard minimal installation
jskarvad Lenovo x220 (x86_64)
Pass pass
kparal kvm
Fail fail
[1]
Pass pass
  1. RHBZ #1191991
sbueno kvm
Pass pass
vpodzime x86_64 (KVM)
Pass pass
Pass pass
lnie KVM
Fail fail
[1]
Pass pass
  1. RHBZ #1191991
pschindl kvm
Fail fail
[1][2]
Pass pass
  1. RHBZ #1191991
  2. I tried to use rawhide mirrorlist, f22 mirrorlist and closest mirror and I had this problem with every of them.