From Fedora Project Wiki

Warning: You are not logged in. Your IP address will be publicly visible if you make any edits. If you log in or create an account, your edits will be attributed to your username, along with other benefits.

The edit can be undone. Please check the comparison below to verify that this is what you want to do, and then publish the changes below to finish undoing the edit.

Latest revision Your text
Line 9: Line 9:
| fedora_mailing_list = cockpit-devel
| fedora_mailing_list = cockpit-devel
}}
}}
{{admon/warning | Under construction | The Test Day page is under construction. It will be ready in time for the Test Day (and this message will be removed).}}


{{admon/note | Can't make the date? | If you come to this page before or after the test day is completed, your testing is still valuable, and you can use the information on this page to test, file any bugs you find at [http://bugzilla.redhat.com Bugzilla], and add your results to the results section. If this page is more than a month old when you arrive here, please check the [[QA/Test_Days|current schedule]] and see if a similar but more recent Test Day is planned or has already happened.}}
{{admon/note | Can't make the date? | If you come to this page before or after the test day is completed, your testing is still valuable, and you can use the information on this page to test, file any bugs you find at [http://bugzilla.redhat.com Bugzilla], and add your results to the results section. If this page is more than a month old when you arrive here, please check the [[QA/Test_Days|current schedule]] and see if a similar but more recent Test Day is planned or has already happened.}}
Line 21: Line 23:


The following cast of characters will be available testing, workarounds, bug fixes, and general discussion ...
The following cast of characters will be available testing, workarounds, bug fixes, and general discussion ...
* Development - [[User:Stefw|Stef Walter]] (stefw), [[User:Mvo|Marius Vollmer]] (mvollmer), [[User:Andreasn|Andreas Nilsson]] (andreasn), [[User:Puiterwijk|Patrick Uiterwijk]] (puiterwijk)
* Development - [[User:Stefw|Stef Walter]] (stefw), [[User:Mvo|Marius Vollmer]] (mvollmer), [[User:Andreasn|Andreas Nillson]] (andraesn), [[User:Puiterwijk|Patrick Uiterwijk]] (puiterwijk)
* Quality Assurance - [[User:jscotka|Jan Ščotka]] (jscotka)
* Quality Assurance - [[User:jscotka|Jan Ščotka]] (jscotka), [[User:Tester2|Tester2]] (irc_nick4), [[User:Tester3|Tester3]] (irc_nick5)


== Prerequisite for Test Day ==  
== Prerequisite for Test Day ==  


A machine that can run Fedora 21 and that you can screw around with. This can be a virtual machine, but we are also very interested in test results on real hardware.
A Fedora 21 system which you can screw around with. Ideally this is a VM, because some of the actions below are destructive.


The test machine should ideally have multiple disks and multiple network interfaces.  If you use a virtual machine, just add some virtual disks and network adapters.
'''TODO:''' We will have Live CD images available.


* '''Install Fedora 21 Server.''' Make sure that your installation is recent enough.  Either install [http://dl.fedoraproject.org/pub/alt/stage/21_Alpha_TC7/Server/x86_64/iso/ Fedora 21 Server Alpha TC7] or run <code>yum update</code> in an older Fedora 21 Server installation.  You should have at least Cockpit 0.23.  In the Server variant of Fedora 21, Cockpit is enabled by default.  For other variants, please refer to the Notes at the end of this page.
* An updated [http://fedoraproject.org/get-prerelease Fedora 21 Server pre-release], [[Releases/Rawhide|Rawhide]] (tips on installing Rawhide below), or a [http://alt.fedoraproject.org/pub/alt/nightly-composes/desktop/ nightly live image]
* '''Prepared Live ISO images:''' (root have no password here by default, anything you type will access cockpit page)
** x86_64 - https://fedorapeople.org/groups/qa/20140916-Cockpit-Test-Day-Live-x86_64.iso
** i386 (without Docker) - https://fedorapeople.org/groups/qa/20140916-Cockpit-Test-Day-Live-i386.iso
* '''Image for virt-manager''' : http://fedorapeople.org/groups/qa/20140916-Cockpit-VM-disk-image.qcow2.xz
** user/password: test/test root/internal
<pre>
curl https://fedorapeople.org/groups/qa/20140916-Cockpit-VM-disk-image.qcow2.xz >20140916-Cockpit-VM-disk-image.qcow2.xz
unxz 20140916-Cockpit-VM-disk-image.qcow2.xz
yum -y install qemu\*
systemctl  restart libvirtd
virt-install --connect qemu:///system --ram 1024 -n cockpit --os-type=linux --os-variant=fedora20 --disk path=20140916-Cockpit-VM-disk-image.qcow2,device=disk,format=qcow2 --vcpus=1 --vnc --noautoconsole --import
virt-manager&
</pre>


Note that Docker is not enabled by default, but the test cases will tell you how to enable it.
== How to test? ==


== How to test? ==
'''TODO:'''' Complete this section. High level details on how a contributor can get involved.  This can include (but not limited to):


After boot, Cockpit is up and running and listens on port 9090.
* Areas to target with exploratory testing
* Point a browser at '''<code>http:</code><code>//<server-ip-address>:9090</code>'''.
* A list of pre-defined test cases to execute
* Cockpit's login page will load.
* How to report back results
* Cockpit uses a self-signed certificate, and your browser will very likely warn you about it.


(Here, <code><server-ip-address></code> is the IP address of your machine.  You can find it by logging into the machine on the text console as "root" and running <code>ip addr</code>.)
Here's another common chunk (again, replace XX as above):


Once the Cockpit log in screen is loaded in your browser, log in as "root".  You can log into Cockpit as any user that exists on the machine, but currently only "root" has enough privileges to execute the test cases.  Trying with any other user, even those that are in the "wheel" group, will likely lead to techno-babble error messages.  (This will be improved as Cockpit and its dependencies evolve, of course.)
=== '''Update your machine''' ===


The test cases are intentionally a bit vague.  They don't tell you exactly what button to click, and what to type into which field.  You have to figure that out yourself! :-) Cockpit should be `discoverable´, and your feedback about this is very valuable.
'''TODO:''' Complete this section.


Unfortunately, Cockpit is quite far from being finished.  There are so many things worth improving that it will be a lot of work to report them all.  For example, most of the dialogs don't do intelligent validation of user input. Thus, we can not ask you to be exhaustive.  Feel free to report only things that you consider `non-obvious´ or are particularily important to you.
If you're running Fedora XX, make sure you have all the current updates for it installed, using the update manager. If you want to try Rawhide, see the instructions on the [[Releases/Rawhide|Rawhide]] page on the various ways in which you can install or update to Rawhide. Or:


The test cases don't cover every feature of Cockpit.  Please stray from the test cases into whatever corner of Cockpit you want to explore!
=== '''Live image''' ===


When Cockpit encounters an internal '''error''', a '''red "Oops"''' label will appear at the top right.  Please report it when this happens.  It is not a good idea to continue using Cockpit after an "Oops",  but simply reloading the page should put you back on track.
'''TODO:''' Complete this section.


Please report your feedback either on [http://github.org/cockpit-project/cockpit/issues Github] or in [http://bugzilla.redhat.com/enter_bug.cgi?component=cockpit&product=Fedora&version=21 Bugzilla].
Optionally, you may download a non-destructive Rawhide live image for your architecture. Tips on using a live image are available at [[FedoraLiveCD]]. Live images can be found [http://alt.fedoraproject.org/pub/alt/nightly-composes/desktop/ here].


== Test Cases ==
== Test Cases ==


* '''Basic'''
* Basic
** [[QA:Testcase Cockpit Login|Password change]]
** Login and password change
** [[QA:Testcase Cockpit Account|Create user account]]
** Create user account
 
* Storage
** Monitor disk I/O
** Create a RAID Device
** Create a Logical Volume


* '''Storage'''
* Network
** [[QA:Testcase Cockpit DiskIO|Monitor disk I/O]]
** Monitor network I/O
** [[QA:Testcase Cockpit RAID|Create a RAID Device]]
** Create VLAN
** [[QA:Testcase Cockpit LVM|Create a Logical Volume]]
** Create Bond


* '''Network'''
* Docker
** [[QA:Testcase Cockpit NetworkIO|Monitor network I/O]]
** Enable docker, download image
** [[QA:Testcase Cockpit VLAN|Create VLAN]]
** Run image
** [[QA:Testcase Cockpit Bond|Create Bond]]
** Create new image


* '''Docker'''
* Free play
** [[QA:Testcase Cockpit DockerImage|Download and run image]]
** [[QA:Testcase Cockpit DockerCommit|Create a new image and run it]]


== Test Results ==
== Test Results ==


If you have problems with any of the tests, report a bug either on [http://github.org/cockpit-project/cockpit/issues Github] or in [http://bugzilla.redhat.com/enter_bug.cgi?component=cockpit&product=Fedora&version=21 Bugzilla].
'''TODO:''' Complete this section.
 
If you are unsure about exactly how to file the report or what other information to include, just ask on IRC and we will help you. Once you have completed the tests, add your results to the tables below, following the example results from the first line as a template. The first column should be your name with a link to your User page in the Wiki if you have one. For each test case, use the [[Template:result|result template]] to enter your result, as shown in the example result line.
 
=== Basic ===
 
{|
! User
! Hardware
! [[QA:Testcase_Cockpit_Login|Password change]]
! [[QA:Testcase_Cockpit_Account|Create user account]]
! References
|-
| [[User:Alich|Alich]]
| Hewlett-Packard HP xw4600 Workstation
| {{result|pass||1142175}}<ref>Useless logout message</ref>
| {{result|fail||1142234}}
| <references/>
|-
| [[User:jskladan|jskladan]]
| X230
| {{result|pass}} 
| {{result|pass}} 
| <references/>
|-
| [[User:lnie|lnie]]
| virt-manager
| {{result|pass}} 
| {{result|pass}} 
| <references/>
|-
| [[User:baoboa|baoboa]]
| HP workstation Z400
| {{result|pass}} 
| {{result|pass}} 
| <references/>
|-
| [[User:jprokes|jprokes]]
| VPS
| {{result|fail||1142208}}<ref>Problem with password change on multiple servers managed by cockpit.</ref>
| {{result|pass}} 
| <references/>
|-
| [[User:dspurek|dspurek]]
| Lenovo 440s (+VM)
| {{result|fail||1142154}}<ref>unprivileged user can't change own password</ref>
| {{result|pass}} 
| <references/>
|-
| [[User:roshi|roshi]]
| virt-manager
| {{result|pass}} 
| {{result|pass}} 
| <references/>
|-
| [[User:psklenar|psklenar]]
| virt image
| {{result|pass||1142210|1135444}}<ref>selinux, random log out</ref>
| {{result|pass}} 
| <references/>
|-
| [[User:elemc|elemc]]
| Gigabyte PH67-DS3-B3
| {{result|pass}} 
| {{result|pass}} 
| <references/>
|-
| [[User:lpol|lpol]]
| openstack instances
| {{result|pass}} 
| {{result|pass||1142229|1142215}}{{result|pass}} 
| <references/>
|-
| [[User:jscotka|jscotka]]
| lenovo T61
| {{result|pass}} 
| {{result|pass||1140562}}<ref>second trouble: https://github.com/cockpit-project/cockpit/issues/1160</ref>{{result|pass||1140562}}<ref>{{bz|}}</ref><ref>second trouble: https://github.com/cockpit-project/cockpit/issues/1160</ref>
| <references/>
|-
| [[User:omoris|omoris]]
| Lenovo 430s (+VM)
| {{result|pass}}  <ref>Password field should be cleared when incorrect password is used to log-in. </ref>
| {{result|pass}}  <ref>Not very helpful error messages when changing roles, terminating session or deleting when logged in as newly created user.</ref>
| <references/>
|-
| [[User:rskvaril|rskvaril]]
| Lenovo T440s
| {{result|pass}} 
| {{result|pass}}  <ref>user can't change own avatar</ref>
| <references/>
|-
| [[User:bblaskov|bblaskov]]
| openstack
| {{result|fail}}  <ref group="long">Some bugs which I found just by using cockpit (not relevant for this testcase)
https://github.com/cockpit-project/cockpit/issues/1175
https://github.com/cockpit-project/cockpit/issues/1179
https://github.com/cockpit-project/cockpit/issues/1182
</ref>
|
| <references/>
|-
| [[User:alikins|alikins]]
| f21-server-cockpit-virt-image
|
| {{result|warn||1142426}}<ref>Extemely long "Real Name" for user account creation works, but causes display text wrapping issues.</ref>
| <references/>
|-
| [[User:konstantinjch|konstantinjch]]
| ASRock P67 Extreme4
| {{result|pass}} 
| {{result|pass}} 
| <references/>
|-
| [[User:pschindl|pschindl]]
| Lenovo ThinkPad T540p
| {{result|pass}} 
| {{result|pass}} 
| <references/>
|-
|}
 
 
=== Storage ===
 
{|
! User
! Hardware
! [[QA:Testcase_Cockpit_DiskIO|Monitor disk I/O]]
! [[QA:Testcase_Cockpit_RAID|Create a RAID Device]]
! [[QA:Testcase_Cockpit_LVM|Create a Logical Volume]]
! References
|-
| [[User:Alich|Alich]]
| Hewlett-Packard HP xw4600 Workstation
| {{result|pass}}  <ref>Graphs have no scale, some issues with live image on USB (data didn't follow reading/writing)</ref>
| {{result|pass||1142396}}
| {{result|pass||1144472|1144481}}
| <references/>
|-
| [[User:jskladan|jskladan]]
| X230
| {{result|pass}} 
| {{result|pass}} 
| {{result|pass}} 
| <references/>
|-
| [[User:baoboa|baoboa]]
| HP workstation Z400
| {{result|pass}} 
| {{result|pass}} 
| {{result|pass}} 
| <references/>
|-
| [[User:jprokes|jprokes]]
| VPS
| {{result|pass||1142228}}
| {{result|pass||1142251}}
| {{result|fail||1142297}}
| <references/>
|-
| [[User:roshi|roshi]]
| virt-manager
| {{result|pass}} 
| {{result|pass}} 
| {{result|pass}} 
| <references/>
|-
| [[User:elemc|elemc]]
| Gigabyte PH67-DS3-B3
| {{result|pass}} 
| {{result|pass}} 
| {{result|pass}} 
| <references/>
|-
| [[User:jscotka|jscotka]]
| lenovo T61
| {{result|pass}} 
| {{result|pass}} 
| {{result|pass}} 
| <references/>
|-
| [[User:rskvaril|rskvaril]]
| Lenovo T440s
| {{result|pass}} 
| {{result|pass||1142248}}
| {{result|pass}} 
| <references/>
|-
| [[User:alikins|alikins]]
| f21-server-cockpit-virt-image
|
| {{result|fail||1142459}}<ref>Attempting to format a raid5 partition of loop devices that uses up all space fails mostly silently. </ref>{{result|warn}}  <ref group="long">Unclear if formatting needed to happen to the "Raid device" on the storage-detail page (Format is an option in it's drop down options) or the "Content"
(defaults to "Format" option).</ref>{{result|warn||1142443}}<ref>Works, but a cosmetic issue: available block devices are listed in lexical order, so that 'loop10' precedes 'loop2'</ref>
|
| <references/>
|-
| [[User:konstantinjch|konstantinjch]]
| ASRock P67 Extreme4
| {{result|pass}} 
| {{result|pass}} 
| {{result|pass}} 
| <references/>
|-
| [[User:pschindl|pschindl]]
| Lenovo ThinkPad T540p
| {{result|pass}}  <ref>When I hover over the graph nothing happens (step 4 in test case). Also graphs don't contain any information about scale.</ref>{{result|pass}} 
| {{result|warn||1142236}}
| {{result|pass||1142259}}<ref>It was hard to set size which would fill the whole volume (step 3).</ref>
| <references/>
|-
|}
 
 
=== Network ===
 
{|
! User
! Hardware
! [[QA:Testcase_Cockpit_NetworkIO|Monitor network I/O]]
! [[QA:Testcase_Cockpit_VLAN|Create VLAN]]
! [[QA:Testcase_Cockpit_Bond|Create Bond]]
! References
|-
| [[User:jskladan|jskladan]]
| X230
| {{result|pass}} 
| {{result|pass}} 
|
| <references/>
|-
| [[User:baoboa|baoboa]]
| HP workstation Z400
| {{result|pass}} 
| {{result|pass}} 
|
| <references/>
|-
| [[User:jprokes|jprokes]]
| VPS
| {{result|pass}} 
| {{result|pass}}  <ref>I didn't expect cidr format of netmask when the field for this is so long.</ref>
| {{result|pass}} 
| <references/>
|-
| [[User:todoleza|todoleza]]
| openstack/vps
| {{result|fail||1142798}}<ref>unmanaged NetworkManager dependency</ref>
|
|
| <references/>
|-
| [[User:roshi|roshi]]
| virt-manager
| {{result|pass}} 
|
|
| <references/>
|-
| [[User:elemc|elemc]]
| Gigabyte PH67-DS3-B3
| {{result|pass}} 
| {{result|pass}} 
| {{result|pass}} 
| <references/>
|-
| [[User:jscotka|jscotka]]
| lenovo T61
| {{result|pass}} 
| {{result|pass}} 
| {{result|pass}} 
| <references/>
|-
| [[User:omoris|omoris]]
| Lenovo 430s (+VM)
| {{result|pass}} 
| {{result|pass}} 
| {{result|pass}} 
| <references/>
|-
| [[User:rskvaril|rskvaril]]
| Lenovo T440s
| {{result|pass}} 
| {{result|pass}} 
|
| <references/>
|-
| [[User:konstantinjch|konstantinjch]]
| ASRock P67 Extreme4
| {{result|pass}} 
| {{result|pass}} 
| {{result|pass}} 
| <references/>
|-
| [[User:pschindl|pschindl]]
| Lenovo ThinkPad T540p
| {{result|pass}} 
|
|
| <references/>
|-
|}


Construct a table or list to allow testers to post results.  Each column should be a test case or configuration, and each row should consist of test results. Include some instructions on how to report bugs, and any special instructions. Here's an example, from a Palimpsest test day:


=== Docker ===
If you have problems with any of the tests, report a bug to [https://bugzilla.redhat.com Bugzilla] usually for the component [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&version=13&component=udisks udisks], or [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&version=13&component=gnome-disk-utility gnome-disk-utility] for bugs in the Palimpsest graphical front end itself. If you are unsure about exactly how to file the report or what other information to include, just ask on IRC and we will help you. Once you have completed the tests, add your results to the Results table below, following the example results from the first line as a template. The first column should be your name with a link to your User page in the Wiki if you have one. For each test case, use the [[Template:result|result template]] to enter your result, as shown in the example result line.


{|
{|
! User
! User
! Hardware
! [[QA:Testcase_sample_1|Sample test 1]]
! [[QA:Testcase_Cockpit_DockerImage|Download and run image]]
! [[QA:Testcase_sample_2|Sample test 2]]
! [[QA:Testcase_Cockpit_DockerCommit|Create a new image and run it]]
! [[QA:Testcase_sample_3|Sample test 3]]
! [[QA:Testcase_sample_4|Sample test 4]]
! References
! References
|-
|-
| [[User:baoboa|baoboa]]
| [[User:SampleUser|Sample User]]
| HP workstation Z400
| {{result|none}}  
| {{result|pass}} 
| {{result|pass}}
| {{result|pass}} 
| {{result|warn}} <ref>Test pass, but also encountered {{bz|54321}}</ref>
| <references/>
| {{result|fail}} <ref>{{bz|12345}}</ref>
|-
| [[User:jprokes|jprokes]]
| VPS
| {{result|pass||1142362}}{{result|pass}} 
| {{result|pass}}
| <references/>
|-
| [[User:dspurek|dspurek]]
| Lenovo 440s (+VM)
| {{result|pass||1142209}}<ref>downloaded image disappears after click on another tab</ref>
| {{result|pass}} 
| <references/>
|-
| [[User:roshi|roshi]]
| virt-manager
| {{result|pass}} 
| {{result|pass}}
| <references/>
|-
| [[User:elemc|elemc]]
| Gigabyte PH67-DS3-B3
| {{result|pass}} 
| {{result|pass}} 
| <references/>
|-
| [[User:lpol|lpol]]
| openstack instances
| {{result|pass||1142129}}
| {{result|pass}} 
| <references/>
|-
| [[User:jscotka|jscotka]]
| lenovo T61
| {{result|pass}}
| {{result|pass}} 
| <references/>
|-
| [[User:omoris|omoris]]
| Lenovo 430s (+VM)
| {{result|pass}} 
| {{result|pass}} 
| <references/>
| <references/>
|-
|-
|}
|}


== Notes ==
[[Category:Test Days]] [[Category:Fedora 21 Test Days]]
We recommend that you install Fedora 21 '''Server''' since we would like you to also test whether Cockpit really works out of the box.  Of course, if you would like to test Cockpit but would rather not go through the trouble of installing Fedora from scratch yet one more time, you can also add Cockpit to your existing Fedora system.
[[Category:QA Templates]]
 
<pre>
yum -y install cockpit docker-io fedora-dockerfiles wmdocker
firewall-cmd --permanent --add-service=cockpit
systemctl reload firewalld.service
systemctl start cockpit.socket
systemctl enable cockpit.socket
</pre>
 
== Long comments ==
<references group="long" />
 
 
[[Category:Fedora 21 Test Days|c]]
Please note that all contributions to Fedora Project Wiki are considered to be released under the Attribution-Share Alike 4.0 International (see Fedora Project Wiki:Copyrights for details). If you do not want your writing to be edited mercilessly and redistributed at will, then do not submit it here.
You are also promising us that you wrote this yourself, or copied it from a public domain or similar free resource. Do not submit copyrighted work without permission!

To edit this page, please solve the following task below and enter the answer in the box (more info):

Cancel Editing help (opens in new window)

Templates used on this page:

Retrieved from "https://fedoraproject.org/wiki/Test_Day:2014-09-16_Cockpit"