Latest revision as of 06:50, 22 May 2013

General Instructions

follow steps in use cases
when you are busy then take use-case with the fewest attendee
fill the report in this form [1]
after the report from thus event are collected, QE team will work with UDX team on qualitative and quantitative analysis, share the results with developers and reports bugs/rfes in Bugzilla, in addition summary will be sent to all the contributors

Where to report results

https://docs.google.com/forms/d/1fNJdWyi1dnpkfpUf_t4wxDPgx3nyeu3CYfnk1K6FYeY/viewform

Initial setup

have a Fedora 19 Beta RC2 (virtual) machine owned by you, ISO image available at [2] or [3]
alternatively you can use prepared image available at [4]

Packages needed
you need to have python-virtinst, libvirt, virt-manager and virt-viewer installed on your computer

follow these steps to set up Virtual Machine images

# mv anaconda-usability.img.tar.bz2 /var/lib/libvirt/images/
# cd /var/lib/libvirt/images
# wget http://alt.fedoraproject.org/pub/alt/stage/19-Beta-RC2/Fedora/x86_64/iso/Fedora-19-Beta-x86_64-DVD.iso
# tar xjf anaconda-usability.img.tar.bz2
# chown qemu.qemu anaconda-usability*.img
# restorecon anaconda-usability*.img
# rm anaconda-usability.img.tar.bz2
# virt-install -n anaconda-usability -r 1024 --arch x86_64 --os-type linux --os-variant fedora18 --disk /var/lib/libvirt/images/anaconda-usability.img --disk /var/lib/libvirt/images/anaconda-usability-1.img --disk /var/lib/libvirt/images/anaconda-usability-2.img --disk /var/lib/libvirt/images/anaconda-usability-3.img --disk /var/lib/libvirt/images/anaconda-usability-4.img --disk /var/lib/libvirt/images/anaconda-usability-5.img --cdrom ./Fedora-19-Beta-x86_64-DVD.iso --serial pty --graphics spice

`iSCSI target` setup

prepare iSCSI volume on another VM (called here iscsi_target VM) which is reachable from VM where the installation will be performed
Alternatively, you can use prepared images that can be downloaded from [5]

Setting up iscsi_target virtual machine

Packages needed
you need to have python-virtinst, libvirt, virt-manager and virt-viewer installed on your computer

# mv anaconda-usability.img.tar.bz2 /var/lib/libvirt/images/
# cd /var/lib/libvirt/images
# tar xjf iscsi-target.img.tar.bz2
# chown qemu.qemu iscsi-target.img
# restorecon iscsi-target.img
# rm iscsi-target.img.tar.bz2
# virt-install -n iscsi-target -r 512 --arch x86_64 --import --os-type linux --os-variant fedora18 --disk /var/lib/libvirt/images/iscsi-target.img --serial pty --graphics spice

root password is fedora
if you want to use serial console use this command: virsh --connect qemu:///system console anaconda-usability

On iscsi_target VM do

Firewall settings
Ensure, port 3260 is available for incoming connection and there is no blocking firewall in the way between target and test machine.

Note
If you use provided iSCSI-target image you can ommit all steps up to the next note.
IP address of iscsi_target is set to 192.168.100.100

install scsi-target-utils package and start tgtd service

   # yum install scsi-target-utils

create empty 4GB file

   # dd if=/dev/zero of=/root/iscsi-lun.img bs=1 count=0 seek=4G

add new iSCSI target, target ID 1 (tid=1)

   # tgtadm --lld iscsi --op new --mode target --tid=1 --targetname iqn.2009-02.com.example:auth.chap

Add a new iSCSI logical unit with lun=1 to specific target with tid=1.

   # tgtadm --lld iscsi --op new --mode logicalunit --tid 1 --lun 1 -b /dev/loop0

Add the address to the access lists of the target, allow connection from all initiators

   # tgtadm --lld iscsi --op bind --mode target --tid 1 -I ALL

Setup new user consumer with password Longsw0rd

   # tgtadm --lld iscsi --op new --mode account --user consumer --password Longsw0rd

Bind newly created user to iSCSI target with tid=1

   # tgtadm --lld iscsi --op bind --mode account --tid 1 --user consumer

Note
If you use provided iSCSI-target image continue here.

attach iscsi-lun.img to /dev/loop0 and start tgtd

   # losetup /dev/loop0 /root/iscsi-lun.img
   # service tgtd start

Note
If tgtd refuses to start, try to start it one more time.

Usability scenarios

Text mode installation (anaconda-text-1)

Setup

power on anaconda-usability Virtual Machine

Action

Install Fedora using text mode (append text on kernel command line)
Text mode installation will offer you possibility to continue installation remotely using VNC, please don't use it and continue in the text mode
In the installer add new user john with admin rights
Finish the installation and reboot

Create multiple Volume Groups (anaconda-lvm-1)

Multiple hard drives required
You need a machine with 4 or more disks

Setup

power on anaconda-usability Virtual Machine

Action

Start Fedora 19 installation in graphical mode (default)
Use manual partitioning, choose LVM partitioning scheme
Create four volume groups, one volume group per disk drive
Create four mountpoints: /, /var, /tmp, /home and place each of them to separate volume group
Place swap partition to the same volume group as /
Finish the installation and reboot

iSCSI target is part of LVM Volume Group (anaconda-lvm-2)

Setup

have virtual machine (VM) with at least one disk ready
power on prepared iSCSI target virtual machine

Action

Install Fedora to VM using graphical user interface. In the installer:

find Installation Destination menu
search for iSCSI target and add it to the Advanced & Network disk section
use custom partitioning scheme, use LVM
Set up new LVM Volume Group that consists from at least one disk from Virtual Machine and at least one iSCSI target
boot installed system

LVM on top of RAID (anaconda-lvm-3)

Setup

have Virtual Machine with at least 2 disks ready

Action

Install Fedora to VM using graphical user interface. In the installer:

Use custom partitioning scheme
Use 2 disks and create RAID1 array
On the top of the RAID1 array use LVM,
create separate logical volumes for /, /home and swap
Finish the installation, reboot

CHAP authentication against iSCSI target (anaconda-iscsi-1)

CHAP
Challenge-Handshake Authentication Protocol (CHAP) authenticates a user or network host to an authenticating entity

iSCSI target
Internet Small Computer System Interface, an Internet Protocol (IP)-based storage networking standard for linking data storage facilities. An iSCSI target is often a dedicated network-connected hard disk storage device, but may also be a general-purpose computer

Setup

have virtual machine (VM) with at least one disk ready
power on prepared iSCSI target virtual machine

Action

Install Fedora to VM using graphical user interface. In the installer:

find Installation Destination menu
Search for iSCSI target and add it to the Advanced & Network disk section

Note
If you use provided iscsi-target image, the IP address of iSCSI target is set to 192.168.100.100
Use CHAP authentication. Username/password is consumer/Longsw0rd. Please note, that you may have another network set up in your libvirt service, default is 192.168.122.0/24. If this is your case, change IP of the iSCSI system either to fixed IP in your network or to DHCP.

Select another non-iSCSI(local) disk
Continue with iSCSI disk + local disk selected
Place /boot on local disk, / on iSCSI target, do not use LVM
Finish the installation, reboot

Search for specific device (anaconda-storage-1)

Setup

have Virtual Machine with at least 6 disks ready

Action

Install Fedora to VM using graphical user interface. In the installer:

find Installation Destination menu
find and select sdf disk
use automatic partitioning and finish the installation

@@ Line 1: / Line 1: @@
-{{Infobox_group
+== General Instructions ==
-| name = Fedora Test Days
+* follow steps in use cases
-| image = [[File:Echo-testing-48px.png|link=QA/Fedora_19_test_days]]
+* when you are busy then take use-case with the fewest attendee
-| caption = [[FIXME|FIXME]]
+* fill the report in this form [https://docs.google.com/forms/d/1fNJdWyi1dnpkfpUf_t4wxDPgx3nyeu3CYfnk1K6FYeY/viewform]
-| date = <<FIXME>>
+* after   the report from thus event are collected, QE team will work with UDX   team on qualitative and quantitative analysis, share the results with   developers and reports bugs/rfes in Bugzilla, in addition summary will   be sent to all the contributors
-| time = all day
-| website = [[QA/Fedora_19_test_days]]
-| irc = [irc://irc.freenode.net/#fedora-test-day #fedora-test-day] ([http://webchat.freenode.net/?channels=fedora-test-day webirc])
-| fedora_mailing_list = test
-}}
-{{admon/note | Can't make the date? | If you come to this page before or after the test day is completed, your testing is still valuable, and you can use the information on this page to test, file any bugs you find at [http://bugzilla.redhat.com Bugzilla], and add your results to the results section. If this page is more than a month old when you arrive here, please check the [[QA/Test_Days|current schedule]] and see if a similar but more recent Test Day is planned or has already happened.}}
+== Where to report results ==
+https://docs.google.com/forms/d/1fNJdWyi1dnpkfpUf_t4wxDPgx3nyeu3CYfnk1K6FYeY/viewform
-== What to test? ==
+== Initial setup ==
+* have a Fedora 19 Beta RC2 (virtual) machine owned by you, ISO image available at [http://alt.fedoraproject.org/pub/alt/stage/19-Beta-RC2/Fedora/x86_64/iso/Fedora-19-Beta-x86_64-DVD.iso] or [http://alt.fedoraproject.org/pub/alt/stage/19-Beta-RC2/Fedora/i386/iso/Fedora-19-Beta-i386-DVD.iso]
+* alternatively you can use prepared image available at [https://drive.google.com/uc?export=download&confirm=no_antivirus&id=0B_1DLrmpME2zY09vMzVCS1cwOTg]
+{{admon/important|Packages needed|you need to have python-virtinst, libvirt, virt-manager and virt-viewer installed on your computer}}
+* follow these steps to set up Virtual Machine images
+ # mv anaconda-usability.img.tar.bz2 /var/lib/libvirt/images/
+ # cd /var/lib/libvirt/images
+ # wget http://alt.fedoraproject.org/pub/alt/stage/19-Beta-RC2/Fedora/x86_64/iso/Fedora-19-Beta-x86_64-DVD.iso
+ # tar xjf anaconda-usability.img.tar.bz2
+ # chown qemu.qemu anaconda-usability*.img
+ # restorecon anaconda-usability*.img
+ # rm anaconda-usability.img.tar.bz2
+ # virt-install -n anaconda-usability -r 1024 --arch x86_64 --os-type linux --os-variant fedora18 --disk /var/lib/libvirt/images/anaconda-usability.img --disk /var/lib/libvirt/images/anaconda-usability-1.img --disk /var/lib/libvirt/images/anaconda-usability-2.img --disk /var/lib/libvirt/images/anaconda-usability-3.img --disk /var/lib/libvirt/images/anaconda-usability-4.img --disk /var/lib/libvirt/images/anaconda-usability-5.img --cdrom ./Fedora-19-Beta-x86_64-DVD.iso --serial pty --graphics spice
-Today's instalment of Fedora Test Day will focus on '''<<FIXME>>'''
+=== <code>iSCSI target</code> setup ===
+* prepare iSCSI volume on another VM (called here <code>iscsi_target</code> VM) which is reachable from VM where the installation will be performed
+* Alternatively, you can use prepared images that can be downloaded from [https://drive.google.com/uc?export=download&confirm=no_antivirus&id=0B_1DLrmpME2zWHN4X2pDQjdJTEU]
-== Who's available ==
+<b> Setting up <code>iscsi_target</code> virtual machine </b>
+{{admon/important|Packages needed|you need to have python-virtinst, libvirt, virt-manager and virt-viewer installed on your computer}}
+ # mv anaconda-usability.img.tar.bz2 /var/lib/libvirt/images/
+ # cd /var/lib/libvirt/images
+ # tar xjf iscsi-target.img.tar.bz2
+ # chown qemu.qemu iscsi-target.img
+ # restorecon iscsi-target.img
+ # rm iscsi-target.img.tar.bz2
+ # virt-install -n iscsi-target -r 512 --arch x86_64 --import --os-type linux --os-variant fedora18 --disk /var/lib/libvirt/images/iscsi-target.img --serial pty --graphics spice
-The following cast of characters will be available testing, workarounds, bug fixes, and general discussion ...
+* root password is <code>fedora</code>
-* Development - [[User:Developer1|Developer1]] (irc_nick1), [[User:Developer2|Developer2]] (irc_nick2)
+* if you want to use serial console use this command: <code>virsh --connect qemu:///system console anaconda-usability</code>
-* Quality Assurance - [[User:Tester1|Tester1]] (irc_nick3), [[User:Tester2|Tester2]] (irc_nick4), [[User:Tester3|Tester3]] (irc_nick5)
-== Prerequisite for Test Day ==
+<b> On <code>iscsi_target</code> VM do </b>
+{{admon/important|Firewall settings|Ensure, '''port 3260''' is available for incoming connection and there is no blocking firewall in the way between target and test machine.}}
+{{admon/note|Note|If you use provided <code>iSCSI-target</code> image you can ommit all steps up to the next note.<br>IP address of <code>iscsi_target</code> is set to <code>192.168.100.100</code>}}
+* install <code>scsi-target-utils</code> package and start <code> tgtd </code> service
+    # yum install scsi-target-utils
-List any prerequisite needs for the test event.  A fresh system, virtualized guest, a blank DVD ... a desire to break software?
+* create empty 4GB file
+    # dd if=/dev/zero of=/root/iscsi-lun.img bs=1 count=0 seek=4G
-* Usb key
+* add new iSCSI target, target ID 1 (<code>tid=1</code>)
-* Usb externally connected HD IDE/SATA
+    # tgtadm --lld iscsi --op new --mode target --tid=1 --targetname iqn.2009-02.com.example:auth.chap
-* Empty HD IDE/SATA/SCSI
+* Add a new iSCSI logical unit with <code>lun=1</code> to specific target with <code>tid=1</code>.
-* Free space on HD
+    # tgtadm --lld iscsi --op new --mode logicalunit --tid 1 --lun 1 -b /dev/loop0
-Here's a chunk which is commonly used for most Test Days. Replace XX with whatever Fedora release is pending:
+* Add the address to the access lists of the target, allow connection from all initiators
+    # tgtadm --lld iscsi --op bind --mode target --tid 1 -I ALL
-* An updated [http://fedoraproject.org/get-prerelease Fedora XX pre-release], [[Releases/Rawhide|Rawhide]] (tips on installing Rawhide below), or a [http://alt.fedoraproject.org/pub/alt/nightly-composes/desktop/ nightly live image]
+* Setup new user <code>consumer</code> with password <code>Longsw0rd</code>
+    # tgtadm --lld iscsi --op new --mode account --user consumer --password Longsw0rd
-== How to test? ==
+* Bind newly created user to iSCSI target with <code>tid=1</code>
+    # tgtadm --lld iscsi --op bind --mode account --tid 1 --user consumer
-High level details on how a contributor can get involved.  This can include (but not limited to):
+{{admon/note|Note|If you use provided <code>iSCSI-target</code> image continue here.}}
-* Areas to target with exploratory testing
+* attach iscsi-lun.img to /dev/loop0 and start <code>tgtd</code>
-* A list of pre-defined test cases to execute
+    # losetup /dev/loop0 /root/iscsi-lun.img
-* How to report back results
+    # service tgtd start
-Here's another common chunk (again, replace XX as above):
+{{admon/note|Note|If <code>tgtd</code> refuses to start, try to start it one more time.}}
-=== '''Update your machine''' ===
+= Usability scenarios =
+== Text mode installation (anaconda-text-1) ==
+=== Setup ===
+* power on <code>anaconda-usability</code> Virtual Machine
+=== Action ===
+* Install Fedora using text mode (append text on kernel command line)
+* Text mode installation will offer you possibility to continue installation remotely using VNC, please don't use it and continue in the text mode
+* In the installer add new user john with admin rights
+* Finish the installation and reboot
-If you're running Fedora XX, make sure you have all the current updates for it installed, using the update manager. If you want to try Rawhide, see the instructions on the [[Releases/Rawhide|Rawhide]] page on the various ways in which you can install or update to Rawhide. Or:
+== Create multiple Volume Groups (anaconda-lvm-1) ==
+{{admon/important|Multiple hard drives required|You need a machine with 4 or more disks}}
+=== Setup ===
+* power on <code>anaconda-usability</code> Virtual Machine
+=== Action ===
+* Start Fedora 19 installation in graphical mode (default)
+* Use manual partitioning, choose LVM partitioning scheme
+* Create four volume groups, one volume group per disk drive
+* Create four mountpoints: /, /var, /tmp, /home and place each of them to separate volume group
+* Place swap partition to the same volume group as /
+* Finish the installation and reboot
-=== '''Live image''' ===
+== iSCSI target is part of LVM Volume Group (anaconda-lvm-2) ==
+=== Setup ===
+* have virtual machine (VM) with at least one disk ready
+* power on prepared <code>iSCSI target</code> virtual machine
-Optionally, you may download a non-destructive Rawhide live image for your architecture. Tips on using a live image are available at [[FedoraLiveCD]]. Live images can be found [http://alt.fedoraproject.org/pub/alt/nightly-composes/desktop/ here].
+=== Action ===
+Install Fedora to VM using graphical user interface. In the installer:
-== Test Cases ==
+* find Installation Destination menu
+* search for iSCSI target and add it to the Advanced & Network disk section
+* use custom partitioning scheme, use LVM
+* Set up new LVM Volume Group that consists from at least one disk from Virtual Machine and at least one iSCSI target
+* boot installed system
-Provide a list of test areas or test cases that you'd like contributors to execute.  For other examples, see [[:Category:Test_Cases]].
+== LVM on top of RAID (anaconda-lvm-3) ==
+=== Setup ===
+* have Virtual Machine with at least 2 disks ready
-== Test Results ==
+=== Action ===
+Install Fedora to VM using graphical user interface. In the installer:
-Construct a table or list to allow testers to post results.  Each column should be a test case or configuration, and each row should consist of test results. Include some instructions on how to report bugs, and any special instructions. Here's an example, from a Palimpsest test day:
+* Use custom partitioning scheme
+* Use 2 disks and create RAID1 array
+* On the top of the RAID1 array use LVM,
+* create separate logical volumes for /, /home and swap
+* Finish the installation, reboot
-If you have problems with any of the tests, report a bug to [https://bugzilla.redhat.com Bugzilla] usually for the component [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&version=13&component=udisks udisks], or [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&version=13&component=gnome-disk-utility gnome-disk-utility] for bugs in the Palimpsest graphical front end itself. If you are unsure about exactly how to file the report or what other information to include, just ask on IRC and we will help you. Once you have completed the tests, add your results to the Results table below, following the example results from the first line as a template. The first column should be your name with a link to your User page in the Wiki if you have one. For each test case, use the [[Template:result|result template]] to enter your result, as shown in the example result line.
+== CHAP authentication against iSCSI target (anaconda-iscsi-1) ==
+{{admon/note|CHAP|Challenge-Handshake Authentication Protocol (CHAP) authenticates a user or network host to an authenticating entity}}
+{{admon/note|iSCSI target|Internet Small Computer System Interface, an Internet Protocol (IP)-based storage networking standard for linking data storage facilities. An iSCSI target is often a dedicated network-connected hard disk storage device, but may also be a general-purpose computer}}
+=== Setup ===
+* have virtual machine (VM) with at least one disk ready
+* power on prepared <code>iSCSI target</code> virtual machine
+=== Action ===
+Install Fedora to VM using graphical user interface. In the installer:
+* find Installation Destination menu
+* Search for iSCSI target and add it to the Advanced & Network disk section
+{{admon/note|Note|If you use provided <code>iscsi-target</code> image, the IP address of iSCSI target is set to <code>192.168.100.100</code><br> Use CHAP authentication. Username/password is <code>consumer/Longsw0rd</code>. Please note, that you may have another network set up in your libvirt service, default is 192.168.122.0/24. If this is your case, change IP of the iSCSI system either to fixed IP in your network or to DHCP.}}
+* Select another non-iSCSI(local) disk
+* Continue with iSCSI disk + local disk selected
+* Place /boot on local disk, / on iSCSI target, do not use LVM
+* Finish the installation, reboot
-{|
+== Search for specific device (anaconda-storage-1) ==
-! User
+=== Setup ===
-! [[QA:Testcase_sample_1|Sample test 1]]
+* have Virtual Machine with at least 6 disks ready
-! [[QA:Testcase_sample_2|Sample test 2]]
-! [[QA:Testcase_sample_3|Sample test 3]]
-! [[QA:Testcase_sample_4|Sample test 4]]
-! References
-|-
-| [[User:SampleUser|Sample User]]
-| {{result|none}}
-| {{result|pass}}
-| {{result|warn}} <ref>Test pass, but also encountered {{bz|54321}}</ref>
-| {{result|fail}} <ref>{{bz|12345}}</ref>
-| <references/>
-|-
-|}
-[[Category:Test Days]]
+=== Action ===
-[[Category:QA Templates]]
+Install Fedora to VM using graphical user interface. In the installer:
+* find Installation Destination menu
+* find and select <code>sdf</code> disk
+* use automatic partitioning and finish the installation
+[[Category:Test_Plans]]

Search

QA:2013-05-21 Anaconda usability Test Plan: Difference between revisions

Latest revision as of 06:50, 22 May 2013

Contents

General Instructions

Where to report results

Initial setup

`iSCSI target` setup

Usability scenarios

Text mode installation (anaconda-text-1)

Setup

Action

Create multiple Volume Groups (anaconda-lvm-1)

Setup

Action

iSCSI target is part of LVM Volume Group (anaconda-lvm-2)

Setup

Action

LVM on top of RAID (anaconda-lvm-3)

Setup

Action

CHAP authentication against iSCSI target (anaconda-iscsi-1)

Setup

Action

Search for specific device (anaconda-storage-1)

Setup

Action

Search

QA:2013-05-21 Anaconda usability Test Plan: Difference between revisions

Latest revision as of 06:50, 22 May 2013

General Instructions

Where to report results

Initial setup

iSCSI target setup

Usability scenarios

Text mode installation (anaconda-text-1)

Setup

Action

Create multiple Volume Groups (anaconda-lvm-1)

Setup

Action

iSCSI target is part of LVM Volume Group (anaconda-lvm-2)

Setup

Action

LVM on top of RAID (anaconda-lvm-3)

Setup

Action

CHAP authentication against iSCSI target (anaconda-iscsi-1)

Setup

Action

Search for specific device (anaconda-storage-1)

Setup

Action

`iSCSI target` setup