Latest revision |
Your text |
Line 55: |
Line 55: |
| gnome-abrt-0.2.2-1.fc18 | | gnome-abrt-0.2.2-1.fc18 |
|
| |
|
| Use the following command to install/update all of them: | | Use the following command to install/update all of them (FIXME - recheck): |
|
| |
|
| <pre> | | <pre> |
Line 65: |
Line 65: |
| libreport-plugin-kerneloops libreport-plugin-reportuploader libreport-plugin-rhtsupport libreport-plugin-ureport \ | | libreport-plugin-kerneloops libreport-plugin-reportuploader libreport-plugin-rhtsupport libreport-plugin-ureport \ |
| btparser btparser-python \ | | btparser btparser-python \ |
| gnome-abrt elfutils | | gnome-abrt |
| </pre> | | </pre> |
|
| |
| {{admon/note|Elfutils needed|Please make sure you have elfutils installed - abrt-ccpp is missing requires - [[https://bugzilla.redhat.com/show_bug.cgi?id=859674 Bug 859674]] }}
| |
|
| |
|
| Make sure that: | | Make sure that: |
Line 88: |
Line 86: |
|
| |
|
|
| |
|
| For better orientation there are several groups of test cases, top priority first. | | For better orientation there are three groups of test cases, top priority first. |
| Follow each of these test cases, or just some group(s) of them in case of limited time for testing. | | Follow each of these test cases, or just some group(s) of them in case of limited time for testing. |
| | (FIXME - check old ones and add a few new ones): |
|
| |
|
| === New features or test cases === | | === New features or test cases === |
Line 97: |
Line 96: |
| # [[QA:Testcase ABRT ruby gem]] - ruby exceptions | | # [[QA:Testcase ABRT ruby gem]] - ruby exceptions |
| # [[QA:Testcase GNOME ABRT MAIN]] - gnome-abrt | | # [[QA:Testcase GNOME ABRT MAIN]] - gnome-abrt |
| # [[QA:Testcase ABRT Configuration Storage]] - configuration storage
| |
|
| |
|
| === Basic functionality === | | === Basic functionality === |
|
| |
|
| # [[QA:Testcase_ABRT]] - Basic test | | # [[QA:Testcase_ABRT]] - default crash report |
| # [[QA:Testcase_ABRT_Logger]] - Logger plugin | | # [[QA:Testcase_ABRT_Logger]] - Logger plugin |
| # [[QA:Testcase_ABRT_Bugzilla]] - Bugzilla plugin | | # [[QA:Testcase_ABRT_Bugzilla]] - Bugzilla plugin |
Line 107: |
Line 105: |
| # [[QA:Testcase ABRT CLI]] - CLI interface | | # [[QA:Testcase ABRT CLI]] - CLI interface |
| # [[QA:Testcase ABRT kernel]] - kernel oops | | # [[QA:Testcase ABRT kernel]] - kernel oops |
| | # [[QA:Testcase ABRT vmcore]] - kernel oops |
| # [[QA:Testcase ABRT python]] - python tracebacks | | # [[QA:Testcase ABRT python]] - python tracebacks |
| # [[QA:Testcase ABRT vmcore]] - kernel oops
| |
|
| |
| === Integration ===
| |
|
| |
| # [[QA:Testcase Libreport sealert]] - sealert integration | | # [[QA:Testcase Libreport sealert]] - sealert integration |
| # [[QA:Testcase Libreport anaconda]] - anaconda integration | | # [[QA:Testcase Libreport anaconda]] - anaconda integration |
| # [[QA:Testcase Libreport Anaconda Install]] - anaconda integration (directly in install)
| |
| # [[QA:Testcase Libreport firstboot]] - firstboot integration | | # [[QA:Testcase Libreport firstboot]] - firstboot integration |
| | |
| | === Advanced & older functionality === |
| | |
| # [[QA:Testcase Retrace Server CLI]] - Retrace Server CLI | | # [[QA:Testcase Retrace Server CLI]] - Retrace Server CLI |
| # [[QA:Testcase Retrace Server GUI]] - Retrace Server in ABRT GUI | | # [[QA:Testcase Retrace Server GUI]] - Retrace Server in ABRT GUI |
Line 122: |
Line 119: |
|
| |
|
| {{admon/note|Report SELinux denials against ABRT|If you encounter some SELinux (AVC) denials during testing, please report them against the '''abrt''' package, not '''selinux''' package. Thanks.}} | | {{admon/note|Report SELinux denials against ABRT|If you encounter some SELinux (AVC) denials during testing, please report them against the '''abrt''' package, not '''selinux''' package. Thanks.}} |
|
| |
|
| |
| {{admon/note|Try to break Abrt|Besides above test cases, fell free to experiment and try to break Abrt in your own ways. We will be happy with that :-).}}
| |
|
| |
|
| == Test Results == | | == Test Results == |
Line 132: |
Line 126: |
|
| |
|
|
| |
|
| ==== New features or test cases ==== | | ==== Abrt test cases ==== |
| | |
| {|
| |
| ! User
| |
| ! [[QA:Testcase_ABRT|Simplified crash reporting]]
| |
| ! [[QA:Testcase_ABRT_Logger|Reporting known crash]]
| |
| ! [[QA:Testcase ABRT ruby gem|Ruby exceptions]]
| |
| ! [[QA:Testcase GNOME ABRT MAIN|Gnome ABRT]]
| |
| ! [[QA:Testcase_ABRT_Configuration_Storage|Configuration storage]]
| |
| ! References
| |
| |-
| |
| | [[User:SampleUser|Sample User]]
| |
| | {{result|pass}}
| |
| | {{result|warn}} <ref>Test pass, but also encountered {{bz|54321}}</ref>
| |
| | {{result|fail}} <ref>{{bz|12345}}</ref>
| |
| | {{result|inprogress}}
| |
| | {{result|inprogress}}
| |
| | <references/>
| |
| |-
| |
| | [[User:dkutalek|David Kutalek]]
| |
| | {{result|inprogress}}
| |
| | {{result|pass}}
| |
| | {{result|inprogress}}
| |
| | {{result|inprogress}}
| |
| | {{result|pass}} <ref>Tested with gnome shell</ref>
| |
| | <references/>
| |
| |-
| |
| | [[User:mtoman|Michal Toman]]
| |
| | {{result|pass}}
| |
| | {{result|pass}}
| |
| | {{result|warn}} <ref>will-crash package is not built for F18, you need to install the F17 version from koji</ref>
| |
| | {{result|pass}}
| |
| | {{result|pass}}
| |
| | <references/>
| |
| |-
| |
| | [[User:mkyral|Martin Kyral]]
| |
| | {{result|warn}} <ref>Wrong BZ configuration leads to processing failure with no possibility of recovery {{bz|861899}}</ref>
| |
| | {{result|pass}}
| |
| | {{result|none}}
| |
| | {{result|pass}}
| |
| | {{result|pass}}
| |
| | <references/>
| |
| |-
| |
| | [[User:isenfeld|Iveta Senfeldova]]
| |
| | {{result|pass}} <ref>Problem with tabs highlighting, confusing warning message: {{bz|861880}}</ref>
| |
| | {{result|pass}}
| |
| | {{result|pass}}
| |
| | {{result|pass}}
| |
| | {{result|fail}} <ref>Same as Brano Nater, popup does not show up.</ref>
| |
| | <references/>
| |
| |-
| |
| | [[User:bnater|Brano Nater]]
| |
| | {{result|pass}} <ref>note added to {{bz|861880}}</ref>
| |
| | {{result|pass}}
| |
| | {{result|pass}}
| |
| | {{result|pass}}
| |
| | {{result|fail}} <ref group="long">No popup (step 7.) for gnome-keyring appear. A new record for report_Bugzilla appears in "Password and Keys" application, but it's incorrectly populated</ref>
| |
| | <references/>
| |
| |-
| |
| | [[User:jskarvad|Jaroslav Skarvada]]
| |
| | {{result|pass}}
| |
| | {{result|warn}} <ref>Processing failed. ---Running report_uReport --- (exited with 1), on second try it worked, thus no reproducer.</ref>
| |
| | {{result|warn}} <ref>No will-crash package, had to install from koji.</ref>
| |
| | {{result|pass}}
| |
| | {{result|fail}} <ref>Secret Service is not available, your settings won't be saved!</ref>
| |
| | <references/>
| |
| |-
| |
| | [[User:Adamjosephcook|Adam Joseph Cook]]
| |
| | {{result|pass}}
| |
| | {{result|pass}}
| |
| | {{result|pass}} <ref>All tests passed.</ref>
| |
| | {{result|pass}}
| |
| | {{result|pass}} <ref>All tests passed. Test instructions not clear. All password keyrings must be deleted before test for the popup to appear.</ref>
| |
| | <references/>
| |
| |}
| |
| | |
| ==== Basic functionality ====
| |
|
| |
|
| {| | | {| |
Line 222: |
Line 140: |
| ! References | | ! References |
| |- | | |- |
| | [[User:dkutalek|David Kutalek]] | | | [[User:SampleUser|Sample User]] |
| | {{result|warn}} <ref>Test passed, but processing window is wider then screen {{bz|861872}}</ref>
| |
| | {{result|pass}}
| |
| | {{result|pass}}
| |
| | {{result|pass}}
| |
| | {{result|pass}}
| |
| | {{result|fail}} <ref>Not able to report issue because of {{bz|854266}}</ref>
| |
| | {{result|pass}} | | | {{result|pass}} |
| | | {{result|warn}} <ref>Test pass, but also encountered {{bz|54321}}</ref> |
| | | {{result|fail}} <ref>{{bz|12345}}</ref> |
| | | {{result|inprogress}} |
| | | {{result|inprogress}} |
| | {{result|inprogress}} | | | {{result|inprogress}} |
| | <references/>
| |
| |-
| |
| | [[User:mtoman|Michal Toman]]
| |
| | {{result|pass}}
| |
| | {{result|pass}}
| |
| | {{result|pass}}
| |
| | {{result|pass}}
| |
| | {{result|pass}}
| |
| | {{result|fail}} <ref>AVC {{bz|854266}}</ref><ref>In permissive doesn't work for the oops from the testcase, but works for all random oopses on my system.</ref>
| |
| | {{result|pass}}
| |
| | {{result|none}}
| |
| | <references/>
| |
| |-
| |
| | [[User:mtoman|Martin Kyral]]
| |
| | {{result|pass}}
| |
| | {{result|fail}} <ref>Needed to repeat the procedure for the issue to be written in the log {{bz|861973}}</ref>
| |
| | {{result|warn}} <ref>Wrong BZ configuration leads to processing failure with no possibility of recovery {{bz|861899}}</ref>
| |
| | {{result|pass}}
| |
| | {{result|pass}}
| |
| | {{result|inprogress}} | | | {{result|inprogress}} |
| | {{result|inprogress}} | | | {{result|inprogress}} |
| | {{result|fail}} <ref>No kernel dump created (five tries in VirtualBox)</ref>
| |
| | <references/>
| |
| |-
| |
| | [[User:isenfeld|Iveta Senfeldova]]
| |
| | {{result|pass}}
| |
| | {{result|fail}} <ref>If I closed the Problem data window report-gtk got killed: {{bz|861989}}</ref>
| |
| | {{result|pass}}
| |
| | {{result|pass}}
| |
| | {{result|pass}}
| |
| | {{result|fail}}<ref>AVC {{bz|854266}}</ref>
| |
| | {{result|pass}}
| |
| | {{result|none}}
| |
| | <references/>
| |
| |-
| |
| | [[User:jskarvad|Jaroslav Skarvada]]
| |
| | {{result|pass}}
| |
| | {{result|pass}}
| |
| | {{result|fail}} <ref>No bugzilla in the menu.</ref>
| |
| | {{result|pass}}
| |
| | {{result|pass}} <ref>Instructions are not clear about DIR location.</ref>
| |
| | {{result|warn}} <ref>'Can't find kernel package corresponding to '2.6.27.9-159.fc10.i686', but at least catched.</ref>
| |
| | {{result|pass}}
| |
| | N/A
| |
| | <references/>
| |
| |-
| |
| | [[User:Adamjosephcook|Adam Joseph Cook]]
| |
| | {{result|fail||863813}}
| |
| | {{result|warn||861973}}
| |
| | {{result|warn||861973}} <ref>Test instructions not clear. Bugzilla reporting under report-gui->Preferences.</ref>
| |
| | {{result|warn||861973}}
| |
| | {{result|pass}} <ref>Test instructions not clear. DIR is 'Directory' field in command 'abrt-cli list'.</ref>
| |
| | {{result|fail}} <ref>Crash notification did not appear per expected results of test.</ref>
| |
| | {{result|fail}} <ref>Python exception did not invoke abrt-gui per expected results of test. Many SELinux denials on python may have effected test.</ref>
| |
| | {{result|fail}} <ref>Kernel panic not caught by abrt. This could be due to significant SELinux denials. Kdump was difficult to configure on FC18.</ref>
| |
| | <references/> | | | <references/> |
| |- | | |- |
| |} | | |} |
|
| |
|
| ==== Integration ==== | | ==== Integration test cases ==== |
|
| |
|
| {| | | {| |
Line 296: |
Line 159: |
| ! [[QA:Testcase Libreport sealert|sealert]] | | ! [[QA:Testcase Libreport sealert|sealert]] |
| ! [[QA:Testcase Libreport anaconda|anaconda]] | | ! [[QA:Testcase Libreport anaconda|anaconda]] |
| ! [[QA:Testcase Libreport Anaconda Install|anaconda install]]
| |
| ! [[QA:Testcase Libreport firstboot|firstboot]] | | ! [[QA:Testcase Libreport firstboot|firstboot]] |
| ! [[QA:Testcase Retrace Server CLI|Retrace cli]] | | ! [[QA:Testcase Retrace Server CLI|Retrace cli]] |
Line 302: |
Line 164: |
| ! References | | ! References |
| |- | | |- |
| | [[User:dkutalek|David Kutalek]] | | | [[User:SampleUser|Sample User]] |
| | {{result|pass}} <ref>Tested appending to existing bug - works with minor issue {{bz|864891}}</ref> | | | {{result|inprogress}} |
| | {{result|inprogress}} | | | {{result|inprogress}} |
| | {{result|inprogress}} | | | {{result|inprogress}} |
| | {{result|inprogress}} | | | {{result|inprogress}} |
| | {{result|pass}} <ref>client could handle corrupted problem dir better {{bz|861996}}</ref>
| |
| | {{result|inprogress}} | | | {{result|inprogress}} |
| | <references/>
| |
| |-
| |
| | [[User:jskarvad|Jaroslav Skarvada]]
| |
| | {{result|pass}}
| |
| | {{result|fail}} <ref>Error not catched.</ref>
| |
| | N/A
| |
| | {{result|fail}} <ref>No crash but following error message: only root can do this</ref>
| |
| | {{result|pass}} <ref>Probably not a good practice to notify user about wrong password.</ref>
| |
| | {{result|pass}}
| |
| | <references/>
| |
| |-
| |
| | [[User:Adamjosephcook|Adam Joseph Cook]]
| |
| | {{result|pass}}
| |
| | {{result|warn||861973}} <ref>Passes test if abrt reporting is run twice per bug report.</ref>
| |
| | {{result|fail}} <ref>Ran test in VM. anaconda crashed with 'kill -USR1 <pid>', however, no mechanism to report problem available.</ref>
| |
| | {{result|fail}} <ref>firstboot will not crash - 'only root can do this' is returned to console.</ref>
| |
| | {{result|pass}}
| |
| | {{result|pass}}
| |
| | <references/> | | | <references/> |
| |- | | |- |
| |} | | |} |
|
| |
|
| == Long comments ==
| | [[Category:Test Days]] |
| <references group="long" />
| |
| | |
| [[Category:Fedora 18 Test Days]]
| |