From Fedora Project Wiki

(rejig the results table a bit to place references afterwards (cleaner) and clean up the instructions)
(more misc. cleanups and improvements)
Line 1: Line 1:
{{Infobox_group
{{Infobox_group
| name = Fedora 21 Server Test Day
| name = Fedora 21 Server Test Day
| image = [[File:Echo-testing-48px.png|link=QA/Fedora_19_test_days]]
| image = [[File:Echo-testing-48px.png|link=QA/Test_Days]]
| caption = [[FIXME|FIXME]]
| date = November 7th, 2014
| date = November 7th, 2014
| time = all day
| time = all day
| website = [[QA/Fedora_21_test_days]]
| website = [[QA/Test_Days]]
| irc = [irc://irc.freenode.net/#fedora-test-day #fedora-test-day] ([http://webchat.freenode.net/?channels=fedora-test-day webirc])
| irc = [irc://irc.freenode.net/#fedora-test-day #fedora-test-day] ([http://webchat.freenode.net/?channels=fedora-test-day webirc])
| fedora_mailing_list = test
| fedora_mailing_list = test
Line 14: Line 13:
== What to test? ==
== What to test? ==
   
   
Today will be focusing on features of Rolekit, freeIPA, cockpit, and openLMI. We will be also testing for basic functionality. Please submit your findings to the table below.
Today will be focusing on the major Server features: [[Changes/FrameworkForServerRoleDeployment|Rolekit]], [[Changes/DomainControllerServerRole|FreeIPA (the 'Domain Controller role'), [[Changes/CockpitManagementConsole|Cockpit]], and [http://www.openlmi.org/ OpenLMI]. We will be also testing for basic functionality. Please submit your findings to the table below.


== Who's available ==
== Who's available ==
Line 24: Line 23:
* Test Day Organizer and Tester - [[User:Junland|John Unland]] (junland)  
* Test Day Organizer and Tester - [[User:Junland|John Unland]] (junland)  


== Prerequisite for Test Day ==  
== Requirements for testing ==  


* Extra Hard Disk Space
* A disposable test system (hardware or a virtual machine) with Fedora 21 Server (see  below for image downloads)
* Virtualbox, QEMU, or VMWare Player
* IRC Client (optional)
* IRC Client (Optional)
 
* x86 / x86-64 / ARM Hardware (Optional)
=== Getting the test image ===
 
We are using the Fedora 21 Final TC1 images as the reference testing images. You can find them here:
 
* [https://dl.fedoraproject.org/pub/alt/stage/21_TC1/Server/x86_64/iso/ x86_64]
* [https://dl.fedoraproject.org/pub/alt/stage/21_TC1/Server/i386/iso/ i686]
* [https://dl.fedoraproject.org/pub/alt/stage/21_TC1/Server/armhfp/iso/ ARM]


== How to test? ==
== How to test? ==


* Download Image for your particular Architecture.
* Download the image for your architecture
* Verify image through MD5 or SHA256 SUM. (VERY IMPORTANT)
* Verify the download using the CHECKSUM file in the download directory
* Install Image on USB / DVD if you are testing on physical hardware.
* Install the image to your test system (refer to the [https://docs.fedoraproject.org/en-US/Fedora/20/html/Installation_Guide/index.html Installation Guide] for installation instructions)
* Install image in a Virtual Machine or Physical Hardware.
* Run the test cases linked in the result table below
* Run through test cases.
* File bug reports for any bugs you encounter
* Submit bugs / results in the table below.
* Add your results to the table


=== '''Testing Image''' ===
== What to test? ==
 
Testing image can be found here: [http://dl.fedoraproject.org/pub/alt/stage/21_TC1/Server/ Fedora 21 Server Beta]


== Test Cases ==
For this Test Day, we will be running the test cases found in the following categories:


* 1. [https://fedoraproject.org/wiki/Category:Base_Acceptance_Test_Cases Base Test Cases]
# [[:Category:Base_Acceptance_Test_Cases Base Test Cases]]
* 2. [https://fedoraproject.org/wiki/QA:Testcase_Server_role_deploy Rolekit Test Case]
# [[QA:Testcase_Server_role_deploy|Rolekit Test Case]]
* 3. [https://fedoraproject.org/wiki/Category:FreeIPA_Test_Cases FreeIPA Test Cases]
# [[:Category:FreeIPA_Test_Cases FreeIPA Test Cases]]
* 4. [https://fedoraproject.org/wiki/Category:Realmd_Test_Cases Realmd Test Cases]
# [[:Category:Realmd_Test_Cases Realmd Test Cases]]
* 5. [https://fedoraproject.org/wiki/QA:Testcase_Docker_Base_Setup Docker Base Setup Test Case] (Optional Free-Form testing)
# [[QA:Testcase_Docker_Base_Setup|Docker Base Setup Test Case]]


{{admon/warning | Be aware of https://fedorahosted.org/freeipa/ticket/4705 which causes FreeIPA 4.1.1 to fail to install in SELinux enforcing mode}}
{{admon/warning | FreeIPA installation issue|Be aware of [https://fedorahosted.org/freeipa/ticket/4705 a bug which causes FreeIPA 4.1.1 to fail to install in SELinux enforcing mode]}}


== Test Results ==
== Test Results ==
Line 62: Line 65:
{|
{|
! User
! User
! [https://fedoraproject.org/wiki/Category:Base_Acceptance_Test_Cases Base Test Cases]
! [[:Category:Base_Acceptance_Test_Cases|Base Test Cases]]
! [https://fedoraproject.org/wiki/QA:Testcase_Server_role_deploy Rolekit Test Case]
! [[QA:Testcase_Server_role_deploy|Rolekit Test Case]]
! [https://fedoraproject.org/wiki/Category:FreeIPA_Test_Cases FreeIPA Test Cases]
! [[:Category:FreeIPA_Test_Cases|FreeIPA Test Cases]]
! [https://fedoraproject.org/wiki/Category:Realmd_Test_Cases Realmd Test Cases]
! [[:Category:Realmd_Test_Cases|Realmd Test Cases]]
! [https://fedoraproject.org/wiki/QA:Testcase_Docker_Base_Setup Docker Base Setup]
! [[QA:Testcase_Docker_Base_Setup|Docker Base Setup]]
|-
|-
| [[User:SampleUser|Sample User]]
| [[User:SampleUser|Sample User]]

Revision as of 09:05, 7 November 2014

Fedora 21 Server Test Day

Date November 7th, 2014
Time all day

Website QA/Test_Days
IRC #fedora-test-day (webirc)
Mailing list test


Can't make the date?
If you come to this page before or after the test day is completed, your testing is still valuable, and you can use the information on this page to test, file any bugs you find at Bugzilla, and add your results to the results section. If this page is more than a month old when you arrive here, please check the current schedule and see if a similar but more recent Test Day is planned or has already happened.

What to test?

Today will be focusing on the major Server features: Rolekit, [[Changes/DomainControllerServerRole|FreeIPA (the 'Domain Controller role'), Cockpit, and OpenLMI. We will be also testing for basic functionality. Please submit your findings to the table below.

Who's available

The following cast of characters will be available testing, workarounds, bug fixes, and general discussion ...

Requirements for testing

  • A disposable test system (hardware or a virtual machine) with Fedora 21 Server (see below for image downloads)
  • IRC Client (optional)

Getting the test image

We are using the Fedora 21 Final TC1 images as the reference testing images. You can find them here:

How to test?

  • Download the image for your architecture
  • Verify the download using the CHECKSUM file in the download directory
  • Install the image to your test system (refer to the Installation Guide for installation instructions)
  • Run the test cases linked in the result table below
  • File bug reports for any bugs you encounter
  • Add your results to the table

What to test?

For this Test Day, we will be running the test cases found in the following categories:

  1. Category:Base_Acceptance_Test_Cases Base Test Cases
  2. Rolekit Test Case
  3. Category:FreeIPA_Test_Cases FreeIPA Test Cases
  4. Category:Realmd_Test_Cases Realmd Test Cases
  5. Docker Base Setup Test Case

Test Results

If you have problems with any of the tests, report a bug to Bugzilla usually for the relevant component - e.g. cockpit, or rolekit.

If you are unsure about exactly how to file the report or what other information to include, just ask on IRC and we will help you. Once you have completed the tests, add your results to the Results table below, following the example results from the first line as a template. The first column should be your name with a link to your User page in the Wiki if you have one. For each test case, use the result template to enter your result, as shown in the example result line.

User Base Test Cases Rolekit Test Case FreeIPA Test Cases Realmd Test Cases Docker Base Setup
Sample User
none
none
Pass pass
Warning warn [1]
Fail fail [2]
User:satellit
none
Pass pass satellit
[3][4]
Pass pass satellit
[5]
Pass pass satellit
[6]
Inprogress inprogress satellit
[7]
none
none
none
none
  1. RHBZ #54321
  2. RHBZ #12345
  3. base initial setup -netinstall req root pswd setup in anaconda to finish
  4. login to root - No firstboot
  5. selinux Enforcing
  6. base_service_manipulation
  7. base_shutdown/reboot