From Fedora Project Wiki

Warning: You are not logged in. Your IP address will be publicly visible if you make any edits. If you log in or create an account, your edits will be attributed to your username, along with other benefits.

The edit can be undone. Please check the comparison below to verify that this is what you want to do, and then publish the changes below to finish undoing the edit.

Latest revision Your text
Line 23: Line 23:
=== Prerequisite for Test Day ===  
=== Prerequisite for Test Day ===  


You will need either fully updated Fedora 15 system or a [http://alt.fedoraproject.org/pub/alt/nightly-composes/desktop/ LiveCD image] (download desktop spin).
You will need either fully updated Fedora 15 system or a live image for ABRT.


{{admon/important|If your system doesn't boot|There is currently some [https://bugzilla.redhat.com/show_bug.cgi?id{{=}}692436 problem] with SELinux that prevents system from booting on fully updated Fedora 15 installation. If that happens to you, add <code>enforcing{{=}}0</code> on kernel boot line in GRUB and the system should boot fine.}}
==== Fedora 15 installation ====
If you don't already have existing Fedora 15 installation, you may get [http://alt.fedoraproject.org/pub/alt/nightly-composes/desktop/ LiveCD].


=== How to test? ===
=== How to test? ===


Prior to test:
Prio to test: Make sure '''abrtd''' service is running as well as '''abrt-cpp''' service was started and /proc/sys/kernel/core_pattern contains e.g. ''|/usr/libexec/abrt-hook-ccpp /var/spool/abrt %s %c %p %u %g %t %h %e 636f726500''
* Fully update ABRT packages (even when running from LiveCD):
<pre>
# yum update 'abrt*' --enablerepo=updates-testing
</pre>
* Make sure '''abrtd''' and '''abrt-ccpp''' services are running:
<pre>
# service abrtd start
Starting abrtd (via systemctl):                            [  OK  ]
# service abrt-ccpp start
Starting abrt-ccpp (via systemctl):                        [  OK  ]
</pre>
* File {{filename|/proc/sys/kernel/core_pattern}} contains following output:
<pre>
# cat /proc/sys/kernel/core_pattern
|/usr/libexec/abrt-hook-ccpp /var/spool/abrt %s %c %p %u %g %t %h %e 636f726500
</pre>


Please follow each of following ABRT test cases and sum up the results in the table below:
Please follow each of following [[:Category:Package_abrt_test_cases|ABRT Test Cases]] and sum up the results in the table below:


# [[QA:Testcase ABRT CCPP addon]] - C/C++ tracebacks
# [[QA:Testcase ABRT CCPP addon]] - C/C++ tracebacks
# [[QA:Testcase ABRT python]] - python tracebacks
# [[QA:Testcase ABRT python]] - python tracebacks
# [[QA:Testcase ABRT python better debugging]] - tests how [[Features/EasierPythonDebugging|EasierPythonDebugging]] works with python (see [[Features/EasierPythonDebugging#How_To_Test|How to test]] for more info)
# [[QA:Testcase ABRT kernel]] - kernel oops
# [[QA:Testcase ABRT kernel]] - kernel oops
# [[QA:TestCase ABRT BlackList]] - package blacklist
# [[QA:TestCase ABRT BlackList]] - package blacklist
# [[QA:Testcase ABRT quota]] - limiting the space occupied by ABRT's cache
# [[QA:Testcase ABRT quota]] - limiting the space occupied by ABRT's cache
# [[QA:Testcase ABRT Plugins]] - configuring plugins
# [[QA:Testcase ABRT Bugzilla]] - Bugzilla plugin
# [[QA:Testcase ABRT Bugzilla]] - Bugzilla plugin
# [[QA:Testcase ABRT Logger]] - Logger plugin
# [[QA:Testcase ABRT Logger]] - Logger plugin
Line 64: Line 51:
# [[QA:Testcase Retrace Server CLI]] - Retrace Server CLI
# [[QA:Testcase Retrace Server CLI]] - Retrace Server CLI
# [[QA:Testcase Retrace Server GUI]] - Retrace Server in ABRT GUI
# [[QA:Testcase Retrace Server GUI]] - Retrace Server in ABRT GUI
# [[QA:Testcase ABRT third party event extension]] - event configuration


{{admon/important|Close all fake bugs you create!|During certain test cases you will be required to simulate application crashes and report these crashes into Bugzilla. It is '''very important''' that after every such fake report you open the link provided by ABRT and '''close that bug''' as NOTABUG with comment like ''"ABRT testing bug"''. Otherwise you would overload package developers with fake bug reports. Thank you.}}
{{admon/important|Close all fake bugs you create!|During certain test cases you will be required to simulate application crashes and report these crashes into Bugzilla. It is '''very important''' that after every such fake report you open the link provided by ABRT and '''close that bug''' as NOTABUG with comment like ''"ABRT testing bug"''. Otherwise you would overload package developers with fake bug reports. Thank you.}}
Line 71: Line 57:


=== Test Results ===
=== Test Results ===
If you have suggestions about UI, send them via email to developers and/or create a bug report.
Please report all bugs into [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&component=abrt Bugzilla] against the '''abrt''' component and Fedora 15 release.
Please report all bugs into [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&component=abrt Bugzilla] against the '''abrt''' component and Fedora 15 release.


{| style="font-size: smaller"
{|
! User
! User
! [[QA:Testcase ABRT CCPP addon|CCPP]]
! [[QA:Testcase ABRT CCPP addon|CCPP]]
! [[QA:Testcase ABRT python|python]]
! [[QA:Testcase ABRT python|python]]
! [[QA:Testcase ABRT python better debugging | pydebug ]]
! [[QA:Testcase ABRT kernel|kernel]]
! [[QA:Testcase ABRT kernel|kernel]]
! [[QA:TestCase ABRT BlackList|Blacklist]]
! [[QA:TestCase ABRT BlackList|Blacklist]]
! [[QA:Testcase ABRT quota|quota]]
! [[QA:Testcase ABRT quota|quota]]
! [[QA:Testcase ABRT Plugins|Plugins]]
! [[QA:Testcase_ABRT_Bugzilla|Bugzilla]]
! [[QA:Testcase_ABRT_Bugzilla|Bugzilla]]
! [[QA:Testcase_ABRT_Logger|Logger]]
! [[QA:Testcase_ABRT_Logger|Logger]]
Line 93: Line 78:
! [[QA:Testcase Retrace Server CLI|RS CLI]]
! [[QA:Testcase Retrace Server CLI|RS CLI]]
! [[QA:Testcase Retrace Server GUI|RS GUI]]
! [[QA:Testcase Retrace Server GUI|RS GUI]]
! [[QA:Testcase ABRT third party event extension|3rd-party]]
! References
! References
|-
|-
| [[User:Sample User|Sample User]]
| [[User:Sample User|Sample User]]
| {{result|none}}
| {{result|none}}
| {{result|pass}}
| {{result|warn}} <ref>Test pass, but also encountered {{bz|54321}}</ref>
| {{result|warn}} <ref>Test pass, but also encountered {{bz|54321}}</ref>
| {{result|fail}} <ref>{{bz|12345}}</ref>
| {{result|fail}} <ref>{{bz|12345}}</ref>
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|pass}}
| {{result|pass}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 113: Line 94:
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| <references/>
|-
| [[User:jskarvad|Jaroslav Škarvada]]
| {{result|warn}} <ref group="long">Got message: Need writable directory, but '/var/spool/abrt/ccpp-2011-03-31-11:52:18-1939' is not writable. Move it to '/home/yarda/.abrt/spool' and operate on the moved copy?<br/>But:<br/># rpm -V abrt<br/>.....UGM.    /var/run/abrt</ref>
<ref group="long">Got many: Certificate is signed by an untrusted issuer: 'E=mtoman@redhat.com,CN =retrace01.fedoraproject.org,OU=BaseOS,O=Red Hat,L=Brno,C=CZ'.</ref>
<ref>There is no "Open ABRT" button, only "Show".</ref>
<ref group="long">Got message: Missing separate debuginfo for
Try: yum --disablerepo='*' --enablerepo='*-debuginfo' install /usr/lib/debug/.build-id/45/190d029703ca464ad5c5eb6b7f99426a51a2e3</ref>
| {{result|pass}}
| {{result|warn}} <ref>There was no notification after the /var/log/messages modification.</ref>
| {{result|fail}}
| {{result|pass}}
| {{result|pass}} <ref group="long">Passed, but the UI is ugly and confusing, e.g. I would like to be able to enter the bugzilla credentials (or create new account) after clicking the last confirmation button.</ref>
| {{result|pass}}
| {{result|pass}} <ref group="long">Instructions about configuration of the abrt_event.conf and mailx plugin (Mailx.conf file needs to be created because it doesn't exist) are incomplete.</ref>
| {{result|pass}}
| {{result|warn}} <ref>There is no "Edit->Plugins", probably "Edit->Event configuration" was meant and it worked as expected.</ref>
| {{result|pass}} <ref group="long">I would prefer to be able to select reporter by e.g. number (or combination of numbers) and not to cycle Y/N through all available reporters.</ref>
<ref>In this test case several instructions are misplaced to "Expected results".</ref>
| {{result|fail}} <ref group="long">It is not fully localized to cs_CZ, e.g. "Problem", "Last Occurence", "Online Help", "Event Configuration" (and all strings in this dialog) strings are not localized.</ref>
| {{result|fail}} <ref>A lot of messages are not localized to cs_CZ, e.g. "is not writable", "Choose option", "Analyzing coredump" and much much more.</ref>
| {{result|pass}} <ref>It is not clear from the testcase where "batch" command stores downloaded data.</ref>
| {{result|pass}}
| {{result|pass}}
| <references/>
|-
| [[User:dkutalek|David Kutalek]]
| {{result|warn}} <ref>{{bz|692428}} - Report button in warning inside KDE info area does not work</ref> <ref>{{bz|692433}} - Cannot connect to Gnome keyring daemon dialog becomes annoying</ref>
| {{result|pass}}
| {{result|pass}} <ref>Event settings for kernel opps is located in /etc/abrt/events.d/koops_events.conf</ref> <ref>abrt-dump-opps log scanner has parameters -drwx (not -drw)</ref>
| {{result|warn}} <ref>[https://bugzilla.redhat.com/show_bug.cgi?id=692465#c5]</ref>
| {{result|pass}}
| {{result|fail}} <ref>{{bz|692574}} - Not possible to report to bugzilla without gnome keyring</ref>
| {{result|pass}} <ref>By default on Live CD there is this action:  abrt-action-print -o "${Log_File:-/tmp/abrt.log}" -a "${Append:-no}"</ref> <ref>Again because of missing gnome keyring, it is not possible to alter event config in gui.</ref>
| {{result|pass}}
| {{result|pass}}
| {{result|warn}} <ref>{{bz|692803}} - Bad integration with KDE - without gnome-keyring - see above</ref>
| {{result|pass}} <ref>Works, but after reporting using logger and/or Mailx, crash is not marked as reported. Same for GUI. Is it intended?</ref>
| {{result|warn}} <ref group="long">Not fully translated to Czech, but according to link to translation service, missing pieces were already translated - probably only not included in packages yet.</ref>
| {{result|warn}} <ref>Again some messages not translated</ref>
| {{result|pass}}
| {{result|warn}} <ref>{{bz|692802}} - Missing debuginfo for fedora15/sleep crash on abrt retrace server</ref>
| {{result|pass}}
| <references/>
|-
| [[User:vondruch|Vít Ondruch]]
| {{result|warn}} <ref>Same experience as jskarvad</ref>
<ref>{{bz|692442}} - Hi res image for "bug-reporting-window" and task switcher</ref>
<ref>{{bz|692444}} - "bug-reporting-window" should be shown as "part of the application"</ref>
| {{result|pass}}
| {{result|warn}}
<ref>abrt_event.conf does not contain the events mentioned in test case</ref>
<ref>abrt.conf contains -drwx instead of -drw</ref>
| {{result|fail}}
<ref>{{bz|692465}} - Blacklist doesn't work</ref>
| {{result|warn}}
<ref>{{bz|692474}} - Exceeded quota is not reported</ref>
| {{result|pass}}
<ref group="long">The "configure event" is far from intuitive for bugzilla account configuration. The credentials should be explicitly requested from user if they are not configured instead of some strange error report.</ref>
| {{result|pass}}
|
| {{result|fail}}
<ref>I have not /var/cache/abrt directory on my system. Even if I create one, nothing appears in there.</ref>
| {{result|warn}}
<ref>{{bz|692516}} - The ABRT icon is almost invisible in panel</ref>
|
|
|
|
|
|
| <references/>
|-
| [[User:kparal|kparal]]
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| <references/>
| <references/>
|-
| [[User:mnowak|Michal Nowak]]
| {{result|pass}}<ref>[https://fedorahosted.org/abrt/ticket/185 #185 Not very sane error message: '11' does not exist]</ref>
| {{result|pass}}<ref>[https://fedorahosted.org/abrt/ticket/186 #186 Problem notification from abrt won't pop-up in gnome-shell]</ref>
| {{result|pass}}
<ref>[https://fedorahosted.org/abrt/ticket/187 #187 exit code == 0 on "abrt-dump-oops: 1 errors while dumping oopses"]</ref>
<ref>[https://fedorahosted.org/abrt/ticket/188 #188 Option `-d` should be documented as a root-only, or made to work for user]</ref>
| {{result|fail}}<ref>{{bz|692465}} - Blacklist doesn't work</ref>
| {{result|pass}}
| {{result|pass}}<ref group="long">[https://fedorahosted.org/abrt/ticket/191 #191 When duplicate in Bugzilla is detected, abrt-gui should give more valuable information than "exit code = 139"]</ref>
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}<ref>[https://fedorahosted.org/abrt/ticket/193 #193 `abrt-cli -l` should not show reported cases]</ref>
| {{result|warn}}<ref>Not everything was translated, not sure it's abrt problem or that it's just not translated.</ref>
| {{result|warn}}<ref>Not everything was translated, not sure it's abrt problem or that it's just not translated.</ref>
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| '''Other issues'''
<ref>[https://fedorahosted.org/abrt/ticket/189 #189 abrtd should reload configuration when some of it's config files changes]</ref>
<ref>[https://fedorahosted.org/abrt/ticket/192 #192 @@LOCALSTATEDIR@@ should be populated by automake]</ref>
<references/>
|-
| [[User:lewis41|Luigi Votta]]
| {{result|warn}}<ref>Same problema as jskarvad</ref>
| {{result|warn}}<ref>Unable to catch in abrt the python error</ref>
| {{result|pass}}
| {{result|warn}}<ref>It doesn't seem working</ref>
| {{result|warn}}<ref>Same as previous {{bz|692474}}</ref>
| {{result|fail}}<ref>cannot retrieve debug-info from repo as in {{bz|681281}}</ref>
| {{result|}}
| {{result|}}
| {{result|}}
| {{result|}}
| {{result|}}
| {{result|}}
| {{result|}}
| {{result|}}
| {{result|}}
| {{result|}}
| <references/>
|-
| [[User:redwolfe|G.Wolfe Woodbury]]
| {{result|pass}}
| {{result|pass}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|pass}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|pass}} <ref>{{bz|692549}} {{bz|692554}} {{bz|692557}} real bugs</ref>
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|warn}} <ref>lots of PENDING notices, retreated to local gdb</ref>
| {{result|none}}
| <references/>
|-
| [[User:hhorak|Honza Horak]]
| {{result|warn}} <ref>Got message: Need writable directory, but /var/spool/abrt/ccpp-...10080/ is not writable</ref><ref group="long">there is no indications that something is being done during downloading debuginfo packages; some "loading..." message would prevent impatient user from closing the window untimely</ref>
| {{result|warn}} <ref>Empty login or password, please check /etc/abrt/plugins/Bugzilla.conf.. But there is both set, but not in abrt-gui.</ref>
| {{result|pass}}
| {{result|fail}} <ref>I still see strace's report when killing "strace sleep 5m".</ref>
| {{result|warn}} <ref>I see no notification about quota (maybe I cannot run applet). </ref>
| {{result|warn}} <ref>I cannot log in using manual edit of /etc/abrt/plugins/Bugzilla.conf, but it works using editting in abrt-gui.</ref>
| {{result|pass}}
| {{result|pass}}
| {{result|fail}} <ref>There is no "/var/cache/abrt/" at all.</ref>
| {{result|warn}} <ref>I see no siren logo in F15 - maybe not ABRT issue.</ref>
| {{result|pass}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| <references/>
|-
! User
! [[QA:Testcase ABRT CCPP addon|CCPP]]
! [[QA:Testcase ABRT python|python]]
! [[QA:Testcase ABRT kernel|kernel]]
! [[QA:TestCase ABRT BlackList|Blacklist]]
! [[QA:Testcase ABRT quota|quota]]
! [[QA:Testcase_ABRT_Bugzilla|Bugzilla]]
! [[QA:Testcase_ABRT_Logger|Logger]]
! [[QA:Testcase_ABRT_Mailx|Mailx]]
! [[QA:Testcase ABRT sosreport|sosreport]]
! [[QA:Testcase ABRT GUI MAIN|GUI]]
! [[QA:Testcase ABRT CLI|CLI]]
! [[QA:Testcase ABRT GUI Localized|GUI L10N]]
! [[QA:Testcase ABRT CLI Localized|CLI L10N]]
! [[QA:Testcase Retrace Server CLI|RS CLI]]
! [[QA:Testcase Retrace Server GUI|RS GUI]]
! [[QA:Testcase ABRT third party event extension|3rd-party]]
! References
|-
|-
|}
|}


== Long comments ==
[[Category:Fedora 15 Test Days]]
<references group="long" />
 
[[Category:Fedora 15 Test Days]]
Please note that all contributions to Fedora Project Wiki are considered to be released under the Attribution-Share Alike 4.0 International (see Fedora Project Wiki:Copyrights for details). If you do not want your writing to be edited mercilessly and redistributed at will, then do not submit it here.
You are also promising us that you wrote this yourself, or copied it from a public domain or similar free resource. Do not submit copyrighted work without permission!

To edit this page, please solve the following task below and enter the answer in the box (more info):

Cancel Editing help (opens in new window)

Templates used on this page:

Retrieved from "https://fedoraproject.org/wiki/Test_Day:2011-03-31_ABRT_Retrace_Server"