(Created page with "{{Infobox_group | name = Fedora Test Days | image = link=QA/Fedora_16_test_days | caption = FIXME | date = <<FIXME>> | time = all day | w...") |
(Drop direct Test Days category membership) |
||
(16 intermediate revisions by 4 users not shown) | |||
Line 1: | Line 1: | ||
{{Infobox_group | {{Infobox_group | ||
| name = Fedora Test Days | | name = Fedora Test Days | ||
| image = [[File:Echo-testing-48px.png|link=QA/ | | image = [[File:Echo-testing-48px.png|link=QA/Fedora_17_test_days]] | ||
| caption = [[ | | caption = [[Features/ABRT|ABRT]] & [[Features/ABRTBacktraceDeduplication|Backtrace Deduplication]] | ||
| date = | | date = 2012-04-26 | ||
| time = all day | | time = all day | ||
| website = [[QA/Fedora_17_test_days]] | | website = [[QA/Fedora_17_test_days]] | ||
Line 14: | Line 14: | ||
== What to test? == | == What to test? == | ||
Today's instalment of Fedora Test Day will focus on ''' | Today's instalment of Fedora Test Day will focus on '''Automated Bug Reporting Tool ([[Features/ABRT|ABRT]])''' and '''[[Features/ABRTBacktraceDeduplication|Backtrace Deduplication]] service''' | ||
== Who's available == | == Who's available == | ||
The following cast of characters will be available testing, workarounds, bug fixes, and general discussion ... | The following cast of characters will be available testing, workarounds, bug fixes, and general discussion ... | ||
* Development - [[User: | * Development - [[User:Jmoskovc|Jiří Moskovčák]] (jmoskovc), [[User:Npajkovs|Nikola Pajkovsky]] (npajkovs), [[User:dvlasenk|Denys Vlasenko]] (dvlasenk), [[User:Kklic|Karel Klíč]] (kklic), [[User:Mtoman|Michal Toman]] (mtoman), [[User:Mlichvar|Miroslav Lichvár]] (mlichvar), [[User:Mmilata|Martin Milata]] (mmilata), [[User:Jfilak|Jakub Filák]] (jfilak) | ||
* Quality Assurance - [[User:Rmarko|Richard Marko]] (rmarko), [[User:Mnowak|Michal Nowak]] | |||
== Prerequisite for Test Day == | == Prerequisite for Test Day == | ||
* Physical machine or a virtual machine | |||
* Fedora 17 TC1 [http://dl.fedoraproject.org/pub/alt/stage/17.TC1/] or an updated [http://alt.fedoraproject.org/pub/alt/nightly-composes/ Fedora 17 pre-release] | |||
=== How to test? === | |||
==== '''Update your machine''' ==== | |||
If you're running Fedora 17, make sure you have all the current updates for it installed, using the update manager. | |||
== | ==== '''Live image''' ==== | ||
You may download a non-destructive Fedora 17 live image for your architecture. Tips on using a live image are available at [[FedoraLiveCD]]. | |||
Download the [http://alt.fedoraproject.org/pub/alt/nightly-composes/ nightly Fedora 17 build] for your architecture (choose the desktop spin). | |||
==== '''Get latest abrt/libreport packages''' ==== | |||
== | The latest versions are: | ||
abrt-2.0.10-1.fc17 | |||
libreport-2.0.10-2.fc17 | |||
- in case these are not available in the official repo, Download them from Koji: [http://koji.fedoraproject.org/koji/packageinfo?packageID=7861 abrt] [http://koji.fedoraproject.org/koji/packageinfo?packageID=12092 libreport] | |||
Use the following command to install/udpate all of them: | |||
yum -y install --enablerepo=updates-testing abrt abrt-addon-ccpp abrt-addon-kerneloops abrt-addon-python abrt-desktop abrt-gui abrt-libs abrt-cli abrt-retrace-client libreport libreport-cli libreport-gtk libreport-newt libreport-python libreport-plugin-mailx libreport-plugin-logger libreport-plugin-bugzilla libreport-plugin-kerneloops libreport-plugin-reportuploader | |||
Make sure '''abrtd''' and '''abrt-ccpp''' services are running: | |||
<pre> | |||
# service abrtd start | |||
Starting abrtd (via systemctl): [ OK ] | |||
# service abrt-ccpp start | |||
Starting abrt-ccpp (via systemctl): [ OK ] | |||
</pre> | |||
* File {{filename|/proc/sys/kernel/core_pattern}} contains following output: | |||
<pre> | |||
# cat /proc/sys/kernel/core_pattern | |||
|/usr/libexec/abrt-hook-ccpp %s %c %p %u %g %t e | |||
</pre> | |||
== | ==== Testing ==== | ||
Follow each of these test cases: | |||
# [[QA:Testcase_ABRT]] - default crash report | |||
# [[QA:Testcase_ABRT_Logger]] - Logger plugin | |||
# [[QA:Testcase_ABRT_Bugzilla]] - Bugzilla plugin | |||
# [[QA:Testcase_ABRT_Mailx]] - Mailx plugin | |||
# [[QA:Testcase ABRT CLI]] - CLI interface | |||
# [[QA:Testcase ABRT kernel]] - kernel oops | |||
# [[QA:Testcase ABRT vmcore]] - kernel oops | |||
# [[QA:Testcase ABRT python]] - python tracebacks | |||
# [[QA:Testcase Libreport anaconda]] - anaconda integration | |||
# [[QA:Testcase Libreport firstboot]] - firstboot integration | |||
# [[QA:Testcase Retrace Server CLI]] - Retrace Server CLI | |||
# [[QA:Testcase Retrace Server GUI]] - Retrace Server in ABRT GUI | |||
{{admon/important|Close all fake bugs you create!|During certain test cases you will be required to simulate application crashes and report these crashes into Bugzilla. It is '''very important''' that after every such fake report you open the link provided by ABRT and '''close that bug''' as NOTABUG with comment like ''"ABRT testing bug"''. Otherwise you would overload package developers with fake bug reports. Thank you.}} | |||
{{admon/note|Report SELinux denials against ABRT|If you encounter some SELinux (AVC) denials during testing, please report them against the '''abrt''' package, not '''selinux''' package. Thanks.}} | |||
If you have problems with any of the tests, report a bug to [https://bugzilla.redhat.com Bugzilla] usually for the component [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&version= | === Test Results === | ||
If you have problems with any of the tests, report a bug to [https://bugzilla.redhat.com Bugzilla] usually for the component [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&version=17&component=abrt abrt], or [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&version=17&component=libreport libreport] for bugs in the libreport library. If you are unsure about exactly how to file the report or what other information to include, just ask on IRC and we will help you. Once you have completed the tests, add your results to the Results table below, following the example results from the first line as a template. The first column should be your name with a link to your User page in the Wiki if you have one. For each test case, use the [[Template:result|result template]] to enter your result, as shown in the example result line. | |||
==== Abrt test cases ==== | |||
{| | {| | ||
! User | ! User | ||
! | ! [[QA:Testcase_ABRT|Basic test]] | ||
! [[QA: | ! [[QA:Testcase_ABRT_Logger|Logger reporting]] | ||
! [[QA: | ! [[QA:Testcase_ABRT_Bugzilla|Bugzilla reporting]] | ||
! [[QA: | ! [[QA:Testcase_ABRT_Mailx|Mailx plugin]] | ||
! [[QA: | ! [[QA:Testcase ABRT CLI|CLI interface]] | ||
! [[QA:Testcase ABRT kernel|Kernel oops]] | |||
! [[QA:Testcase ABRT python|Python crash]] | |||
! [[QA:Testcase ABRT vmcore|Kernel panic(vmcore)]] | |||
! References | ! References | ||
|- | |- | ||
| [[User:SampleUser|Sample User]] | | [[User:SampleUser|Sample User]] | ||
| {{result|pass}} | | {{result|pass}} | ||
| {{result|warn}} <ref>Test pass, but also encountered {{bz|54321}}</ref> | | {{result|warn}} <ref>Test pass, but also encountered {{bz|54321}}</ref> | ||
| {{result|fail}} <ref>{{bz|12345}}</ref> | | {{result|fail}} <ref>{{bz|12345}}</ref> | ||
| {{result|inprogress}} | |||
| {{result|inprogress}} | |||
| {{result|inprogress}} | |||
| {{result|inprogress}} | |||
| {{result|inprogress}} | |||
| <references/> | |||
|- | |||
| [[User:Rmarko]] | |||
| {{result|pass||816186}} | |||
| {{result|pass}} | |||
| {{result|pass}} | |||
| {{result|pass}} | |||
| {{result|pass}} | |||
| {{result|pass}} | |||
| {{result|pass}} | |||
| {{result|fail||816230}}<ref>No crash record in /var/crash/</ref> | |||
| <references/> | |||
|- | |||
| [[User:mnowak|Michal Nowak]] | |||
| {{result|pass||816595|816617}} | |||
| {{result|pass}} | |||
| {{result|pass}} | |||
| {{result|pass||816607}} | |||
| {{result|pass}} | |||
| {{result|pass}} | |||
| {{result|pass}} | |||
| {{result|fail}} | |||
| <references/> | |||
|} | |||
==== Integration test cases ==== | |||
{| | |||
! User | |||
! [[QA:Testcase Libreport anaconda|anaconda]] | |||
! [[QA:Testcase Libreport firstboot|firstboot]] | |||
! [[QA:Testcase Retrace Server CLI|Retrace cli]] | |||
! [[QA:Testcase Retrace Server GUI|Retrace gui]] | |||
! References | |||
|- | |||
| [[User:SampleUser|Sample User]] | |||
| {{result|inprogress}} | |||
| {{result|inprogress}} | |||
| {{result|inprogress}} | |||
| {{result|inprogress}} | |||
| <references/> | |||
|- | |||
| [[User:Rmarko]] | |||
| {{result|pass}} | |||
| {{result|pass}} | |||
| {{result|pass}} | |||
| {{result|pass}} | |||
| <references/> | | <references/> | ||
|- | |- | ||
| [[User:mnowak|Michal Nowak]] | |||
| {{result|pass}} | |||
| {{result|pass||816628}} | |||
| {{result|pass}} | |||
| {{result|pass}} | |||
| <references/> | |||
|} | |} | ||
[[Category:Test Days | |||
[[Category:Fedora 17 Test Days|a]] |
Latest revision as of 21:34, 26 June 2015
Fedora Test Days | |
---|---|
ABRT & Backtrace Deduplication | |
Date | 2012-04-26 |
Time | all day |
Website | QA/Fedora_17_test_days |
IRC | #fedora-test-day (webirc) |
Mailing list | test |
What to test?[edit]
Today's instalment of Fedora Test Day will focus on Automated Bug Reporting Tool (ABRT) and Backtrace Deduplication service
Who's available[edit]
The following cast of characters will be available testing, workarounds, bug fixes, and general discussion ...
- Development - Jiří Moskovčák (jmoskovc), Nikola Pajkovsky (npajkovs), Denys Vlasenko (dvlasenk), Karel Klíč (kklic), Michal Toman (mtoman), Miroslav Lichvár (mlichvar), Martin Milata (mmilata), Jakub Filák (jfilak)
- Quality Assurance - Richard Marko (rmarko), Michal Nowak
Prerequisite for Test Day[edit]
- Physical machine or a virtual machine
- Fedora 17 TC1 [1] or an updated Fedora 17 pre-release
How to test?[edit]
Update your machine[edit]
If you're running Fedora 17, make sure you have all the current updates for it installed, using the update manager.
Live image[edit]
You may download a non-destructive Fedora 17 live image for your architecture. Tips on using a live image are available at FedoraLiveCD.
Download the nightly Fedora 17 build for your architecture (choose the desktop spin).
Get latest abrt/libreport packages[edit]
The latest versions are: abrt-2.0.10-1.fc17 libreport-2.0.10-2.fc17 - in case these are not available in the official repo, Download them from Koji: abrt libreport
Use the following command to install/udpate all of them:
yum -y install --enablerepo=updates-testing abrt abrt-addon-ccpp abrt-addon-kerneloops abrt-addon-python abrt-desktop abrt-gui abrt-libs abrt-cli abrt-retrace-client libreport libreport-cli libreport-gtk libreport-newt libreport-python libreport-plugin-mailx libreport-plugin-logger libreport-plugin-bugzilla libreport-plugin-kerneloops libreport-plugin-reportuploader
Make sure abrtd and abrt-ccpp services are running:
# service abrtd start Starting abrtd (via systemctl): [ OK ] # service abrt-ccpp start Starting abrt-ccpp (via systemctl): [ OK ]
- File
/proc/sys/kernel/core_pattern
contains following output:
# cat /proc/sys/kernel/core_pattern |/usr/libexec/abrt-hook-ccpp %s %c %p %u %g %t e
Testing[edit]
Follow each of these test cases:
- QA:Testcase_ABRT - default crash report
- QA:Testcase_ABRT_Logger - Logger plugin
- QA:Testcase_ABRT_Bugzilla - Bugzilla plugin
- QA:Testcase_ABRT_Mailx - Mailx plugin
- QA:Testcase ABRT CLI - CLI interface
- QA:Testcase ABRT kernel - kernel oops
- QA:Testcase ABRT vmcore - kernel oops
- QA:Testcase ABRT python - python tracebacks
- QA:Testcase Libreport anaconda - anaconda integration
- QA:Testcase Libreport firstboot - firstboot integration
- QA:Testcase Retrace Server CLI - Retrace Server CLI
- QA:Testcase Retrace Server GUI - Retrace Server in ABRT GUI
Test Results[edit]
If you have problems with any of the tests, report a bug to Bugzilla usually for the component abrt, or libreport for bugs in the libreport library. If you are unsure about exactly how to file the report or what other information to include, just ask on IRC and we will help you. Once you have completed the tests, add your results to the Results table below, following the example results from the first line as a template. The first column should be your name with a link to your User page in the Wiki if you have one. For each test case, use the result template to enter your result, as shown in the example result line.
Abrt test cases[edit]
User | Basic test | Logger reporting | Bugzilla reporting | Mailx plugin | CLI interface | Kernel oops | Python crash | Kernel panic(vmcore) | References |
---|---|---|---|---|---|---|---|---|---|
Sample User | |||||||||
User:Rmarko | [3] | ||||||||
Michal Nowak |
Integration test cases[edit]
User | anaconda | firstboot | Retrace cli | Retrace gui | References |
---|---|---|---|---|---|
Sample User | |||||
User:Rmarko | |||||
Michal Nowak |