|
|
| Line 10: |
Line 10: |
| === Test Days === | | === Test Days === |
|
| |
|
| The Fedora 15 Test Day calendar is starting to take shape, and you can see what events are planned so far on the Wiki page<ref>http://fedoraproject.org/wiki/QA/Fedora_15_test_days</ref>. The first Test Day slot is 2011-01-27. If you would like to propose a main track Test Day for the Fedora 15 cycle, please contact the QA team via email or IRC, or file a ticket in QA Trac<ref>http://fedorahosted.org/fedora-qa/</ref>. | | The Fedora 15 Test Day calendar is starting to take shape, and you can see what events are planned so far on the Wiki page<ref>http://fedoraproject.org/wiki/QA/Fedora_15_test_days</ref>. The first Test Day slot is 2011-01-27. If you would like to propose a main track Test Day for the Fedora 15 cycle, please contact the QA team via email or IRC, or file a ticket in QA Trac<ref>http://fedorahosted.org/fedora-qa/</ref>. This week, [[User:Adamwill|Adam Williamson]] rescheduled the Graphics Test Week to late February and created the pages for it<ref>http://fedorahosted.org/fedora-qa/ticket/156</ref>. [[User:Rhe|Rui He]] proposed a preupgrade Test Day<ref>http://fedorahosted.org/fedora-qa/ticket/161</ref>. |
| | |
| <references/>
| |
| | |
| === Refining Bugzilla messages on updated packages ===
| |
| | |
| [[User:Fcami|François Cami]] posted a refined version of his Bodhi patch<ref>http://lists.fedoraproject.org/pipermail/test/2010-December/096017.html</ref> which improves the messages it posts to Bugzilla when an update is sent to updates-testing and then to stable. The updated patch reflects feedback from other team members at QA meetings. | |
| | |
| <references/>
| |
| | |
| === Package-specific and critical path test case process ===
| |
| | |
| Following up on his earlier proposals (see this beat in FWN #255) [[User:Adamwill|Adam Williamson]] announced<ref>http://lists.fedoraproject.org/pipermail/test/2010-December/096095.html</ref> two draft Wiki pages<ref>http://fedoraproject.org/wiki/User:Adamwill/Draft_QA_SOP_test_case_creation</ref> <ref>http://fedoraproject.org/wiki/User:Adamwill/Draft_QA_SOP_package_test_plan_creation</ref> that would implement a process for creating and categorizing test cases such that they can be identified as related to specific packages and/or related to critical path functionality. Following useful feedback from [[User:Jlaska|James Laska]]<ref>http://lists.fedoraproject.org/pipermail/test/2010-December/096098.html</ref>, Adam revised the proposals, and continues to do so based on further feedback on the mailing lists and the trac ticket<ref>http://fedorahosted.org/fedora-qa/ticket/154</ref>.
| |
|
| |
|
| <references/> | | <references/> |
| Line 28: |
Line 16: |
| === Test case management system proposal and requirements === | | === Test case management system proposal and requirements === |
|
| |
|
| [[User:Rhe|Rui He]] has been working on the possibility of implementing a test case management system (TCMS) for Fedora. This is being tracked in a trac ticket<ref>http://fedorahosted.org/fedora-qa/ticket/152</ref> and she has now started drafting the requirements any TCMS would have to satisfy to replace the use of the Fedora Wiki to store test cases<ref>http://fedoraproject.org/wiki/Rhe/tcms_requirements_proposal</ref>. | | [[User:Rhe|Rui He]] continued to work on evaluating the possibility of a test case management system (TCMS) for Fedora. There was some useful feedback on the trac ticket<ref>http://fedorahosted.org/fedora-qa/ticket/152</ref> and Rui updated the Wiki page comparing the current Wiki-based system with the Nitrate TCMS<ref>http://fedoraproject.org/wiki/Rhe/tcms_Comparison</ref>. |
| | |
| <references/>
| |
| | |
| === AutoQA ===
| |
| | |
| Work on AutoQA continues to progress apace - there is much more than I am able to reliably relay in these newsletters, those who are very interested are recommended to follow the mailing list<ref>http://fedorahosted.org/mailman/listinfo/autoqa-devel</ref>. The anaconda storage tests contributed by [[User:Clumens|Chris Lumens]] have been reviewed and are ready for merging<ref>http://fedorahosted.org/pipermail/autoqa-devel/2010-December/001422.html</ref>. Martin Krizek's patch for allowing results to be reported to Bodhi<ref>http://fedorahosted.org/pipermail/autoqa-devel/2010-December/001411.html</ref> has been reviewed and accepted<ref>http://fedorahosted.org/autoqa/changeset/5d37e59128c1913946c02e6a1d899a5576f37801</ref>. Martin and [[User:Kparal|Kamil Paral]] have been working on implementing a staging server for results, and [[User:Wwoods|Will Woods]] continues to work on dependency check testing. He has now decided to serialize dependency check tests to avoid the complexity involved in supporting parallel tests, having worked out that even at the busiest point, dependency check testing will only be needed, on average, once every 33 minutes.
| |
| | |
| <references/>
| |
| | |
| === Consequences of negative karma ===
| |
| | |
| [[User:bsjones|Brendan Jones]] asked about the consequences of negative karma, wondering whether test updates he filed negative karma against should be immediately un-pushed, or prevented from being sent to the stable update repository<ref>http://lists.fedoraproject.org/pipermail/test/2010-December/096057.html</ref>. [[User:Kevin|Kevin Fenzi]]<ref>http://lists.fedoraproject.org/pipermail/test/2010-December/096058.html</ref> and [[User:Adamwill|Adam Williamson]]<ref>http://lists.fedoraproject.org/pipermail/test/2010-December/096059.html</ref> both explained that negative feedback was considered advisory in nature, and maintainers are able to push updates despite the existence of negative feedback, if they believe it is proper to do so. They both suggested that Brendan could alert FESCo if he felt a packager was ignoring negative feedback inappropriately. Brendan replied that he had asked only for clarification, and did not feel the cases in question were inappropriate<ref>http://lists.fedoraproject.org/pipermail/test/2010-December/096060.html</ref>.
| |
|
| |
|
| <references/> | | <references/> |
QualityAssurance
In this section, we cover the activities of the QA team[1]. For more information on the work of the QA team and how you can get involved, see the Joining page[2].
Contributing Writer: Adam Williamson
Test Days
The Fedora 15 Test Day calendar is starting to take shape, and you can see what events are planned so far on the Wiki page[1]. The first Test Day slot is 2011-01-27. If you would like to propose a main track Test Day for the Fedora 15 cycle, please contact the QA team via email or IRC, or file a ticket in QA Trac[2]. This week, Adam Williamson rescheduled the Graphics Test Week to late February and created the pages for it[3]. Rui He proposed a preupgrade Test Day[4].
Test case management system proposal and requirements
Rui He continued to work on evaluating the possibility of a test case management system (TCMS) for Fedora. There was some useful feedback on the trac ticket[1] and Rui updated the Wiki page comparing the current Wiki-based system with the Nitrate TCMS[2].
