From Fedora Project Wiki

Warning: You are not logged in. Your IP address will be publicly visible if you make any edits. If you log in or create an account, your edits will be attributed to your username, along with other benefits.

The edit can be undone. Please check the comparison below to verify that this is what you want to do, and then publish the changes below to finish undoing the edit.

Latest revision Your text
Line 1: Line 1:
{{autolang|base=yes}}
{{autolang|base=yes}}


{{Infobox_group
{{Infobox_group
| name = Fedora Test Days
| name = Fedora Test Days
| caption = [[https://fedorahosted.org/abrt/wiki ABRT & libreport]]
| caption = [[https://fedorahosted.org/abrt/wiki ABRT & libreport]]
| date = 2012-10-01
| date = 2012-09-19
| time = 6:00 UTC - 16:00 UTC
| time = all day
| website = [https://fedorahosted.org/abrt/wiki ABRT homepage]
| website = [https://fedorahosted.org/abrt/wiki ABRT homepage]
| irc = [irc://irc.freenode.net/#fedora-test-day #fedora-test-day] ([http://webchat.freenode.net/?channels=fedora-test-day webirc])
| irc = [irc://irc.freenode.net/#fedora-test-day #fedora-test-day] ([http://webchat.freenode.net/?channels=fedora-test-day webirc])
Line 21: Line 19:
* '''Unified Problem Reporting UI ([[Features/Unified Problem Reporting UI|libreport]])'''
* '''Unified Problem Reporting UI ([[Features/Unified Problem Reporting UI|libreport]])'''
* '''Simplified crash reporting via ABRT Server ([[Features/SimplifiedCrashReporting|Fedora 18 Feature]])'''
* '''Simplified crash reporting via ABRT Server ([[Features/SimplifiedCrashReporting|Fedora 18 Feature]])'''
* '''Gnome-abrt'''


== Who's available ==
== Who's available ==
Line 36: Line 33:
== How to test? ==
== How to test? ==


=== Update your machine ===
=== '''Update your machine''' ===


If you're running Fedora 18, make sure you have all the current updates for it installed, using the update manager.
If you're running Fedora 18, make sure you have all the current updates for it installed, using the update manager.


=== Live image ===
=== '''Live image''' ===


You may download a non-destructive Fedora 18 live image for your architecture. Tips on using a live image are available at [[FedoraLiveCD]].
You may download a non-destructive Fedora 18 live image for your architecture. Tips on using a live image are available at [[FedoraLiveCD]].
Line 46: Line 43:
Download the [http://alt.fedoraproject.org/pub/alt/nightly-composes/ nightly Fedora 18 build] for your architecture. Choose the mainstream 'desktop' spin or any other desktop-like spin (kde, lxde, xfce).
Download the [http://alt.fedoraproject.org/pub/alt/nightly-composes/ nightly Fedora 18 build] for your architecture. Choose the mainstream 'desktop' spin or any other desktop-like spin (kde, lxde, xfce).


==== Get latest abrt/libreport packages ====
==== '''Get latest abrt/libreport packages''' ====


The latest versions are:
The latest versions are (FIXME - update):


abrt-2.0.13-1.fc18<br/>
abrt-2.0.12-1.fc18<br/>
libreport-2.0.14-1.fc18<br/>
libreport-2.0.13-1.fc18<br/>
btparser-0.19-1.fc18<br>
btparser-0.18-2.fc18
gnome-abrt-0.2.2-1.fc18


Use the following command to install/update all of them:
Use the following command to install/update all of them (FIXME - recheck):


<pre>
<pre>
yum -y install --enablerepo=updates-testing \
yum -y install --enablerepo=updates-testing \
   abrt abrt-addon-ccpp abrt-addon-kerneloops abrt-addon-python abrt-addon-vmcore abrt-addon-xorg \
   abrt abrt-addon-ccpp abrt-addon-kerneloops abrt-addon-python abrt-desktop \
   abrt-desktop abrt-dbus abrt-gui abrt-libs abrt-cli abrt-retrace-client abrt-plugin-bodhi abrt-tui \
   abrt-gui abrt-libs abrt-cli abrt-retrace-client \
   libreport libreport-compat libreport-filesystem libreport-cli libreport-gtk libreport-newt libreport-web \
   libreport libreport-cli libreport-gtk libreport-newt libreport-python \
   libreport-python libreport-plugin-mailx libreport-plugin-logger libreport-plugin-bugzilla \
   libreport-plugin-mailx libreport-plugin-logger libreport-plugin-bugzilla \
   libreport-plugin-kerneloops libreport-plugin-reportuploader libreport-plugin-rhtsupport libreport-plugin-ureport \
   libreport-plugin-kerneloops libreport-plugin-reportuploader
  btparser btparser-python \
  gnome-abrt elfutils
</pre>
</pre>
{{admon/note|Elfutils needed|Please make sure you have elfutils installed - abrt-ccpp is missing requires - [[https://bugzilla.redhat.com/show_bug.cgi?id=859674 Bug 859674]] }}


Make sure that:
Make sure that:
* '''abrtd''' and '''abrt-ccpp''' services are running:
* '''abrtd''' and '''abrt-ccpp''' services are running:
<pre>
<pre>
# systemctl start abrtd.service
# service abrtd start
# systemctl status abrtd.service
Starting abrtd (via systemctl):                            [  OK  ]
 
# service abrt-ccpp start
# systemctl start abrt-ccpp.service
Starting abrt-ccpp (via systemctl):                        [  OK  ]
# systemctl status abrt-ccpp.service
</pre>
</pre>
* file {{filename|/proc/sys/kernel/core_pattern}} contains following output:
* file {{filename|/proc/sys/kernel/core_pattern}} contains following output:
Line 87: Line 78:
== Test Cases ==
== Test Cases ==


 
Follow each of these test cases (FIXME - check old ones and add a few new ones):  
For better orientation there are several groups of test cases, top priority first.
# [[QA:Testcase_ABRT]] - default crash report
Follow each of these test cases, or just some group(s) of them in case of limited time for testing. 
 
=== New features or test cases ===
 
# [[Features/SimplifiedCrashReporting]] - Simplified Crash Reporting (F18 Feature)
# [[QA:Testcase ABRT Reporting Known Crash]] - reporting of known crash
# [[QA:Testcase ABRT ruby gem]] - ruby exceptions
# [[QA:Testcase GNOME ABRT MAIN]] - gnome-abrt
# [[QA:Testcase ABRT Configuration Storage]] - configuration storage
 
=== Basic functionality ===
 
# [[QA:Testcase_ABRT]] - Basic test
# [[QA:Testcase_ABRT_Logger]] - Logger plugin
# [[QA:Testcase_ABRT_Logger]] - Logger plugin
# [[QA:Testcase_ABRT_Bugzilla]] - Bugzilla plugin
# [[QA:Testcase_ABRT_Bugzilla]] - Bugzilla plugin
Line 107: Line 85:
# [[QA:Testcase ABRT CLI]] - CLI interface
# [[QA:Testcase ABRT CLI]] - CLI interface
# [[QA:Testcase ABRT kernel]] - kernel oops
# [[QA:Testcase ABRT kernel]] - kernel oops
# [[QA:Testcase ABRT vmcore]] - kernel oops
# [[QA:Testcase ABRT python]] - python tracebacks
# [[QA:Testcase ABRT python]] - python tracebacks
# [[QA:Testcase ABRT vmcore]] - kernel oops
# [[QA:Testcase ABRT Reporting Known Crash]] - reporting of known crash
 
=== Integration ===
 
# [[QA:Testcase Libreport sealert]] - sealert integration
# [[QA:Testcase Libreport sealert]] - sealert integration
# [[QA:Testcase Libreport anaconda]] - anaconda integration
# [[QA:Testcase Libreport anaconda]] - anaconda integration
# [[QA:Testcase Libreport Anaconda Install]] - anaconda integration (directly in install)
# [[QA:Testcase Libreport firstboot]] - firstboot integration
# [[QA:Testcase Libreport firstboot]] - firstboot integration
# [[QA:Testcase Retrace Server CLI]] - Retrace Server CLI
# [[QA:Testcase Retrace Server CLI]] - Retrace Server CLI
Line 122: Line 97:


{{admon/note|Report SELinux denials against ABRT|If you encounter some SELinux (AVC) denials during testing, please report them against the '''abrt''' package, not '''selinux''' package. Thanks.}}
{{admon/note|Report SELinux denials against ABRT|If you encounter some SELinux (AVC) denials during testing, please report them against the '''abrt''' package, not '''selinux''' package. Thanks.}}
{{admon/note|Try to break Abrt|Besides above test cases, fell free to experiment and try to break Abrt in your own ways. We will be happy with that :-).}}


== Test Results ==
== Test Results ==




If you have problems with any of the tests, report a bug to [https://bugzilla.redhat.com Bugzilla] usually for the component [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&version=18&component=abrt abrt], or [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&version=18&component=libreport libreport] for bugs in the libreport library, or [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&version=18&component=btparser btparser] for backtrace parser related bugs, or [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&version=18&component=gnome-abrt gnome-abrt] for new Gnome Abrt GUI. If you are unsure about exactly how to file the report or what other information to include, just ask on IRC and we will help you. Once you have completed the tests, add your results to the Results table below, following the example results from the first line as a template. The first column should be your name with a link to your User page in the Wiki if you have one. For each test case, use the [[Template:result|result template]] to enter your result, as shown in the example result line.
If you have problems with any of the tests, report a bug to [https://bugzilla.redhat.com Bugzilla] usually for the component [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&version=16&component=abrt abrt], or [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&version=16&component=libreport libreport] for bugs in the libreport library. If you are unsure about exactly how to file the report or what other information to include, just ask on IRC and we will help you. Once you have completed the tests, add your results to the Results table below, following the example results from the first line as a template. The first column should be your name with a link to your User page in the Wiki if you have one. For each test case, use the [[Template:result|result template]] to enter your result, as shown in the example result line.
 


==== New features or test cases ====
{|
! User
! [[QA:Testcase_ABRT|Simplified crash reporting]]
! [[QA:Testcase_ABRT_Logger|Reporting known crash]]
! [[QA:Testcase ABRT ruby gem|Ruby exceptions]]
! [[QA:Testcase GNOME ABRT MAIN|Gnome ABRT]]
! [[QA:Testcase_ABRT_Configuration_Storage|Configuration storage]]
! References
|-
| [[User:SampleUser|Sample User]]
| {{result|pass}}
| {{result|warn}} <ref>Test pass, but also encountered {{bz|54321}}</ref>
| {{result|fail}} <ref>{{bz|12345}}</ref>
| {{result|inprogress}}
| {{result|inprogress}}
| <references/>
|-
| [[User:dkutalek|David Kutalek]]
| {{result|inprogress}}
| {{result|pass}}
| {{result|inprogress}}
| {{result|inprogress}}
| {{result|pass}} <ref>Tested with gnome shell</ref>
| <references/>
|-
| [[User:mtoman|Michal Toman]]
| {{result|pass}}
| {{result|pass}}
| {{result|warn}} <ref>will-crash package is not built for F18, you need to install the F17 version from koji</ref>
| {{result|pass}}
| {{result|pass}}
| <references/>
|-
| [[User:mkyral|Martin Kyral]]
| {{result|warn}} <ref>Wrong BZ configuration leads to processing failure with no possibility of recovery {{bz|861899}}</ref>
| {{result|pass}}
| {{result|none}}
| {{result|pass}}
| {{result|pass}}
| <references/>
|-
| [[User:isenfeld|Iveta Senfeldova]]
| {{result|pass}} <ref>Problem with tabs highlighting, confusing warning message: {{bz|861880}}</ref>
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|fail}} <ref>Same as Brano Nater, popup does not show up.</ref>
| <references/>
|-
| [[User:bnater|Brano Nater]]
| {{result|pass}} <ref>note added to {{bz|861880}}</ref>
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|fail}} <ref group="long">No popup (step 7.) for gnome-keyring appear. A new record for report_Bugzilla appears in "Password and Keys" application, but it's incorrectly populated</ref>
| <references/>
|-
| [[User:jskarvad|Jaroslav Skarvada]]
| {{result|pass}}
| {{result|warn}} <ref>Processing failed. ---Running report_uReport --- (exited with 1), on second try it worked, thus no reproducer.</ref>
| {{result|warn}} <ref>No will-crash package, had to install from koji.</ref>
| {{result|pass}}
| {{result|fail}} <ref>Secret Service is not available, your settings won't be saved!</ref>
| <references/>
|-
| [[User:Adamjosephcook|Adam Joseph Cook]]
| {{result|pass}}
| {{result|pass}}
| {{result|pass}} <ref>All tests passed.</ref>
| {{result|pass}}
| {{result|pass}} <ref>All tests passed. Test instructions not clear. All password keyrings must be deleted before test for the popup to appear.</ref>
| <references/>
|}


==== Basic functionality ====
==== Abrt test cases ====


{|
{|
Line 222: Line 118:
! References
! References
|-
|-
| [[User:dkutalek|David Kutalek]]
| [[User:SampleUser|Sample User]]
| {{result|warn}} <ref>Test passed, but processing window is wider then screen {{bz|861872}}</ref>
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|fail}} <ref>Not able to report issue because of {{bz|854266}}</ref>
| {{result|pass}}
| {{result|pass}}
| {{result|warn}} <ref>Test pass, but also encountered {{bz|54321}}</ref>
| {{result|fail}} <ref>{{bz|12345}}</ref>
| {{result|inprogress}}
| {{result|inprogress}}
| {{result|inprogress}}
| {{result|inprogress}}
| <references/>
|-
| [[User:mtoman|Michal Toman]]
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|fail}} <ref>AVC {{bz|854266}}</ref><ref>In permissive doesn't work for the oops from the testcase, but works for all random oopses on my system.</ref>
| {{result|pass}}
| {{result|none}}
| <references/>
|-
| [[User:mtoman|Martin Kyral]]
| {{result|pass}}
| {{result|fail}}  <ref>Needed to repeat the procedure for the issue to be written in the log {{bz|861973}}</ref>
| {{result|warn}} <ref>Wrong BZ configuration leads to processing failure with no possibility of recovery {{bz|861899}}</ref>
| {{result|pass}}
| {{result|pass}}
| {{result|inprogress}}
| {{result|inprogress}}
| {{result|inprogress}}
| {{result|inprogress}}
| {{result|fail}} <ref>No kernel dump created (five tries in VirtualBox)</ref>
| <references/>
|-
| [[User:isenfeld|Iveta Senfeldova]]
| {{result|pass}}
| {{result|fail}} <ref>If I closed the Problem data window report-gtk got killed: {{bz|861989}}</ref>
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|fail}}<ref>AVC {{bz|854266}}</ref>
| {{result|pass}}
| {{result|none}}
| <references/>
|-
| [[User:jskarvad|Jaroslav Skarvada]]
| {{result|pass}}
| {{result|pass}}
| {{result|fail}} <ref>No bugzilla in the menu.</ref>
| {{result|pass}}
| {{result|pass}} <ref>Instructions are not clear about DIR location.</ref>
| {{result|warn}} <ref>'Can't find kernel package corresponding to '2.6.27.9-159.fc10.i686', but at least catched.</ref>
| {{result|pass}}
| N/A
| <references/>
|-
| [[User:Adamjosephcook|Adam Joseph Cook]]
| {{result|fail||863813}}
| {{result|warn||861973}}
| {{result|warn||861973}} <ref>Test instructions not clear. Bugzilla reporting under report-gui->Preferences.</ref>
| {{result|warn||861973}}
| {{result|pass}} <ref>Test instructions not clear. DIR is 'Directory' field in command 'abrt-cli list'.</ref>
| {{result|fail}} <ref>Crash notification did not appear per expected results of test.</ref>
| {{result|fail}} <ref>Python exception did not invoke abrt-gui per expected results of test. Many SELinux denials on python may have effected test.</ref>
| {{result|fail}} <ref>Kernel panic not caught by abrt. This could be due to significant SELinux denials. Kdump was difficult to configure on FC18.</ref>
| <references/>
| <references/>
|-
|-
|}
|}


==== Integration ====
==== Integration test cases ====


{|
{|
Line 296: Line 137:
! [[QA:Testcase Libreport sealert|sealert]]
! [[QA:Testcase Libreport sealert|sealert]]
! [[QA:Testcase Libreport anaconda|anaconda]]
! [[QA:Testcase Libreport anaconda|anaconda]]
! [[QA:Testcase Libreport Anaconda Install|anaconda install]]
! [[QA:Testcase Libreport firstboot|firstboot]]
! [[QA:Testcase Libreport firstboot|firstboot]]
! [[QA:Testcase Retrace Server CLI|Retrace cli]]
! [[QA:Testcase Retrace Server CLI|Retrace cli]]
Line 302: Line 142:
! References
! References
|-
|-
| [[User:dkutalek|David Kutalek]]
| [[User:SampleUser|Sample User]]
| {{result|pass}} <ref>Tested appending to existing bug - works with minor issue {{bz|864891}}</ref>
| {{result|inprogress}}
| {{result|inprogress}}
| {{result|inprogress}}
| {{result|inprogress}}
| {{result|inprogress}}
| {{result|inprogress}}
| {{result|inprogress}}
| {{result|pass}} <ref>client could handle corrupted problem dir better {{bz|861996}}</ref>
| {{result|inprogress}}
| {{result|inprogress}}
| <references/>
|-
| [[User:jskarvad|Jaroslav Skarvada]]
| {{result|pass}}
| {{result|fail}} <ref>Error not catched.</ref>
| N/A
| {{result|fail}} <ref>No crash but following error message: only root can do this</ref>
| {{result|pass}} <ref>Probably not a good practice to notify user about wrong password.</ref>
| {{result|pass}}
| <references/>
|-
| [[User:Adamjosephcook|Adam Joseph Cook]]
| {{result|pass}}
| {{result|warn||861973}} <ref>Passes test if abrt reporting is run twice per bug report.</ref>
| {{result|fail}} <ref>Ran test in VM. anaconda crashed with 'kill -USR1 <pid>', however, no mechanism to report problem available.</ref>
| {{result|fail}} <ref>firstboot will not crash - 'only root can do this' is returned to console.</ref>
| {{result|pass}}
| {{result|pass}}
| <references/>
| <references/>
|-
|-
|}
|}


== Long comments ==
[[Category:Test Days]]
<references group="long" />
 
  [[Category:Fedora 18 Test Days]]
Please note that all contributions to Fedora Project Wiki are considered to be released under the Attribution-Share Alike 4.0 International (see Fedora Project Wiki:Copyrights for details). If you do not want your writing to be edited mercilessly and redistributed at will, then do not submit it here.
You are also promising us that you wrote this yourself, or copied it from a public domain or similar free resource. Do not submit copyrighted work without permission!

To edit this page, please solve the following task below and enter the answer in the box (more info):

Cancel Editing help (opens in new window)

Templates used on this page:

Retrieved from "https://fedoraproject.org/wiki/Test_Day:2012-10-01_ABRT"