Editing Test Day:2009-08-20 ABRT

{|border="1"
|-style="color: white; background-color: #3074c2; border:1px; font-weight: bold" 
| DATE || TIME || WHERE
|-
| '''2009-08-20''' || From ''12:00'' to ''21:00'' UTC (8am - 5pm EDT, 14:00 - 23:00 CET) || [irc://irc.freenode.net/fedora-test-day #fedora-test-day] ([http://webchat.freenode.net/?channels=fedora-test-day webirc])
|-
|}


== What to test? ==

Today's installment of Fedora Test Day will focus on '''Automated Bug Reporting Tool ([[Features/ABRT|ABRT]])'''. This tool should help non-power users with bug reporting, making it as easy as a few mouse clicks. [[Features/ABRT|ABRT]] is a daemon that watches for application crashes. When a crash occurs, it collects the crash data (core file, application's command line etc.) and takes action according to the type of application that crashed and according to the configuration in the abrt.conf configuration file.
''Bottom line'': do not hunt the bugs with a pitchforks, rather use bugzappers/big light source to draw them from the dark and [http://fedorapeople.org/~dpravec/AsciiArt/MyBugZappers.html kill them easily at close range].

[[Features/ABRT|ABRT]] should be easy for users and very useful for developers and admins. Ease of crash/bug reporting and quick response from maintainers based on info from [[Features/ABRT|ABRT]] should make Fedora more stable and thus more attractive for users.

== Who's available ==

The following people will be available for testing, workarounds, bug fixes, and general discussion:
* Development - [[User:zprikryl|Zdeněk Přikryl]] (zprikryl), [[User:jmoskovc|Jiří Moskovčák]] (jmoskovc)
* Quality Assurance - [[User:dpravec|David Pravec]] (dpravec), [[User:kparal|Kamil Páral]] (kparal), [[User:jlaska|James Laska]] (jlaska), [[User:mnowak|Michal Nowak]] (mnowak)

== What's needed to be able to test ==

* A system with some kind of network connection
* '''Fully updated''' Rawhide or Fedora 11 installation  with ABRT installed or special [[#Live_Image|ABRT TestDay Live image]] (i686 or x86_64)

=== How to install ABRT ===
If you do not use the provided LiveCD, but you use your own Fedora 11 or Rawhide installation, you need to install latest ABRT packages by running following commands:

First add correct repository:
* '''Fedora 11:'''
<pre>
curl -o /etc/yum.repos.d/abrt.repo  http://jmoskovc.fedorapeople.org/abrt.repo
</pre>
* '''Rawhide:'''
<pre>
curl -o /etc/yum.repos.d/abrt-rawhide.repo  http://jmoskovc.fedorapeople.org/abrt-rawhide.repo
</pre>

Now install/update ABRT:
<pre>
su
rm -f /var/cache/abrt/abrt-db
yum remove kerneloops 
yum install abrt-desktop
reboot
</pre>

Please do not forget to '''reboot'''. It's needed after installing [[Features/ABRT|ABRT]].

{{admon/tip|ABRT packages were updated|Latest package version is 0.0.7.2-3. If yum doesn't see the update, you have to <code>yum clean all</code>. Restart the service <code>service abrt restart</code> after the update.}}

=== '''Live Image''' ===

Optionally, you may download a non-destructive rawhide live image for your architecture with latest ABRT pre-installed. Tips on using a live image are available at [[FedoraLiveCD]]. For Fedora on USB flash disk consult [[FedoraLiveCD/USBHowTo]].

{|
! Architecture !! SHA256 
|-
| [FIXME i686] || FIXME
|-
| [FIXME x86_64] || FIXME
|}

{{admon/important|Ensure you have latest images|There were older images available for some time, but after that they have been updated with newer ABRT version. Please ensure you have the latest image by verifying the checksum (run <code>sha256sum image.iso</code>), thanks.}}

== How to test ==

=== Test Cases ===

Follow each of following [[:Category:ABRT_Test_Cases|ABRT Test Cases]] and sum up the results in the tables below. Report your findings also in [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&component=abrt Bugzilla] or [https://fedorahosted.org/abrt/report/1 ABRT Trac] (enter FAS username/password). Please provide links to bugreports in results table.

# [[QA:Testcase_ABRT]] - default crash report
# [[QA:Testcase_ABRT_Logger]] - Logger plugin
# [[QA:Testcase_ABRT_Bugzilla]] - Bugzilla plugin
# [[QA:Testcase_ABRT_Mailx]] - Mailx plugin
# [[QA:TestCase ABRT BlackList]] - package blacklist
# [[QA:Testcase ABRT GPG check]] - reporting crashes of signed packages only
# [[QA:TestCase ABRT GPG Keys]] - additional keys for signing packages
# [[QA:Testcase ABRT Actions and Reporters]] - testing of action/reporting plugins
# [[QA:Testcase ABRT Cron]] - periodical plugins using Cron
# [[QA:Testcase ABRT Plugins]] - configuring plugins
# [[QA:Testcase ABRT CLI]] - CLI interface
# [[QA:Testcase ABRT kernel]] - kernel oops
# [[QA:Testcase ABRT python]] - python tracebacks

=== Known issues === 

Consult list of [https://fedorahosted.org/abrt/report/1 active tickets] before reporting an issue.  The most common issues are listed below:
* '''Applet (or other icons) in notification area is not visible''' - that's a known bug in Rawhide, please try to run <code>killall notification-area-applet</code> and reload it a few times, it may help
* '''Recreate report for same crash''' - if you want to recreate a report of same crash, you have to delete it using button in GUI and make a crash gain
* '''Nothing happened?''' - if it seems to do nothing, try to disable PGP checking and restart daemon
* '''Graphical warnings''' - gui writes some gtk warnings (it's gtk's fault)
* '''rpm %requires''' - it needs rpm >= 4.7.0-1
* ''' bug-buddy or other crash catching tools might take precedence over ABRT''' if you are using them. ABRT will catch only crashes which are not caught by other tools.
* '''Cannot catch OpenOffice.org, KDE and Java''' - these applications have a built-in method for capturing failures so it is the same as with BugBuddy etc.
* '''if you're updating from version <= 0.0.5-6''' - make sure you remove /var/cache/abrt/abrt-db (we've changed the db format and not yet implemented automatic updating mechanism)'''
* '''GUI doesn't inform you about success of failure of a reporting.''' - But you can find results in ABRT's db (default path /var/cache/abrt, it is sqlite3 db, table name is "abrt") - it should be fixed, but in case it's not try to look for these files

== Test Results ==

=== Issues that were identified ===

Don't report duplicates, thanks :) Just write a comment to the bugzilla that you have also noticed the bug.

{| class="wikitable sortable" border="1"
! Tester 
! Description 
! Bug references
|-
| [[User:kparal]]
| Right click on applet hides the applet but does nothing
| {{bz|518386}}
|-
| [[User:guaneryu]]
| OpenGPGCheck option takes no effect
| {{bz|518396}} CLOSED 
|-
| [[User:czhang]]
| testcase #1: no item can be selected after clicked abrt-gui icon if other user's application crashes.
| {{bz|518409}} CLOSED 
|-
| [[User:mhlavink]]
| continuous reporting of one kernel oops
| {{bz|518413}}
|-
| [[User:mhlavink]]
| ordinary user's applet shows up for root owned crashes
| {{bz|518420}}
|-
| [[User:mhlavink]]
| abrt silently starts when plugin is configured but not installed
| {{bz|518422}}
|-
| [[User:hdong]]
| testcase #8: CCpp:<APPNAME> doesn't work
| {{bz|518414}} CLOSED
|-
| [[User:azelinka]]
| report window larger that screen (no horizontal scrolling)
| {{bz|518425}} CLOSED
|-
| [[User:azelinka]]
|  bugzilla plugin can't detect correct component for a bug
| {{bz|518438}} CLOSED
|-
| [[User:tpelka]]
|  RunApp do not work - abrt-plugin-runapp installed
| {{bz|518465}} CLOSED 
|-
| [[User:vbenes]]
|  cannot use # in bugzilla password
| {{bz|518459}} CLOSED
|-
| [[User:vbenes]]
| crash while scanning syslog
| {{bz| 518472}}
|-
| [[User:vbenes]]
| missing python-sexy dependency
| FIXED no bz
|-
| [[User:dpravec]]
| it would be nice for some admins to be able to catch and process crashes of theirs own compiled (unpackaged, unsigned) applications. Not for Bugzilla plugin, but for some custom reporting/actions.
| Trac [https://fedorahosted.org/abrt/ticket/73 #73]
|-
| [[User:dpravec]]
| when abrt is upgrading from older version, the old database is making it confused. Dont force users to rm the file manually, detect this during upgrade and migrate the database, or just backup it.
| Trac [https://fedorahosted.org/abrt/ticket/74 #74]
|-
| [[User:tpelka]]
| Wouldn't be cool use keyring except plaintext passwords?
| TBD
|-
| [[User:azelinka]]
|  user configuration of plugins doesn't survive service restart 
| {{bz|518457}}
|-
| [[User:mnowak|Michal Nowak]]
| abrt-gui allows "sending" report which is not in existing anymore
| Trac [https://fedorahosted.org/abrt/ticket/75 #75]
|-
| [[User:jlaska]]
| Missing %requirse on python-sexy
| {{bz|518488}} -  Missing %requires python-sexy - ImportError: No module named sexy
|-
| [[User:jlaska]]
| /usr/sbin/abrt segfaults on startup (both abrt-0.0.7.1-1.fc12 and abrt-0.0.7.2-3.fc12)
| {{bz|518498}} -  Segmentation fault. 0x006aa95e in two_way_short_needle (needle_len=
|-
| [[User:jlaska]]
| The bugzilla plugin works great, however gdb segfaulted while trying to grab a backtrace from the original failure
| {{bz|FIXME}}
|-
| [[User:jkoten]]
| testcase #8 
  CCpp = Logger //logger is not silent for transmission, logs the crash   
  CCpp:transmission = Mailx("[abrt] Transmission") 
| {{bz|518606}}
|-
|| [[User:jkoten]]
| testcase #8 
  CCpp = Logger, Mailx 
  CCpp:transmission = Mailx("[abrt] Transmission") //abrt crashes when reporting transmission crash   
| {{bz|518609}}
|-
|}

=== Things that work alright ===

{| class="wikitable sortable" border="1"
! Tester 
! Description
|-
| [[User:guaneryu]] 
|
*1. Followed the testcase description, got the expected result 
*2. Followed the testcase description, got the expected result 
*3. Followed the testcase description, got the expected result 
*4. Followed the testcase description, got the expected result 
*5. Followed the testcase description, got the expected result 
*9. Followed the testcase description, added "5 = Logger" at the [cron] section, got expected result from "abrt -d" output 
*10.Followed the testcase description, changed "MaxCrashReportsSize" to 0 and no crash could be detected 
*11.Followed the testcase description, got the expected result 
*12.Followed the testcase description, got the expected result from command line, and abrt-applet popped up a notification but no items listed in abrt-gui 
|-
| [[User:kparal]]
| testcase #1 worked ok
|-
| [[User:hdong]]
|
*1.Testcase_ABRT            get expected results, but some crashed process icon miss in abrt-gui item list, others show
*2.Testcase_ABRT_Logger     PASS
*3.Testcase_ABRT_Bugzilla   PASS
*4.Testcase_ABRT_Mailx      PASS
*5.TestCase ABRT BlackList  PASS
*9.Testcase ABRT Cron       PASS
*10.Testcase ABRT Plugins   get expected results, set MaxCrashReportsSize to 0，no crash could be detected
*11.Testcase ABRT CLI       PASS
*12.Testcase ABRT kernel    get expected results, abrt-applet poped up the notification but no items listed in abrt-gui
|-
| [[User:czhang]]
| testcase #2~#5, #9~#12 work as what expected.
|-
| [[User:twaugh]] || Catching Python traceback
|-
| [[User:mvadkert]]
| testcase #2~#5 work as what expected.
|-
| [[User:vbenes]]
|
* testcase #1 PASS
* testcase #2 PASS
* testcase #3 PASS
* testcase #4 PASS
* testcase #5 PASS
* testcase #6 N/A
* testcase #7 N/A
* testcase #8 TBD
* testcase #9 TBD
* testcase #10 PASS
* testcase #11 TBD
* testcase #12 TBD
* testcase #13 TBD
|-
| [[User:jlaska]]
| PASS ([[QA:Testcase_ABRT_Bugzilla]], [[QA:Testcase_ABRT_Logger]])
|-
| [[User:jkoten]]
|
* testcases #1 - #5; #9 - #13 PASS  
* testcase #8 Partial success - ActionsAndReporters = Mailx("[abrt] !!!!crash was detected!!!!!"), Logger, RunApp("ls", "ls-output") // works as expected - plugins were activated immediately after a crash occurs.  
|-
|}

 [[Category:Fedora 12 Test Days]]