(qa beat for 213) |
(fwn 214 beat) |
||
| Line 10: | Line 10: | ||
=== Test Days === | === Test Days === | ||
Last week's Test Day was on color management<ref>http://fedoraproject.org/wiki/Features/ColorManagement</ref>. Turnout was moderate, but those who did come helped us resolve several problems in gnome-color-manager. With the fixes introduced by [[User:Hughsient|Richard Hughes]] throughout the day, all testers reported success in using the application to import and apply color profiles. Unfortunately no testers had the extra hardware and/or accessories needed to test generation of accurate profiles for monitors, webcams and scanners, but we tested these features as far as possible without them. | |||
Next week's Test Day<ref>http://fedoraproject.org/wiki/Test_Day:2010-02-25_YumLangpackPlugin</ref> will be on the langpack plugin for yum<ref>http://fedoraproject.org/wiki/Features/YumLangpackPlugin</ref>. This feature is intended to automatically install langpacks - packages containing translations for a particular language - for packages which use them. So if your system is configured with French support, when installing a package which keeps its French translation in a separate langpack, the langpack will be automatically installed. This is a great convenience feature for all those who use languages other than English, so please come out and help us test it! The Test Day will run all day on Thursday 2010-02-25 in the #fedora-test-day IRC channel. | |||
If you would like to propose a main track Test Day for the Fedora 13 cycle, please contact the QA team via email or IRC, or file a ticket in QA Trac<ref>http://fedorahosted.org/fedora-qa/</ref>. | If you would like to propose a main track Test Day for the Fedora 13 cycle, please contact the QA team via email or IRC, or file a ticket in QA Trac<ref>http://fedorahosted.org/fedora-qa/</ref>. | ||
| Line 18: | Line 20: | ||
=== Weekly meetings === | === Weekly meetings === | ||
The QA group weekly meeting<ref>http://fedoraproject.org/wiki/QA/Meetings</ref> was held on 2010-02- | The QA group weekly meeting<ref>http://fedoraproject.org/wiki/QA/Meetings</ref> was held on 2010-02-15. The full logs are available<ref>http://fedoraproject.org/wiki/QA/Meetings/20100215</ref>. [[User:Jlaska|James Laska]] reported that [[User:Kevin|Kevin Fenzi]] had set up watchers for the IRC bot zodbot for the Fedora 13 blocker bug trackers. [[User:poelstra|John Poelstra]] had updated the wording on the group calendars slightly to refer to test milestones rather than specifically to installation testing. | ||
[[User:Jlaska|James Laska]] | [[User:Jlaska|James Laska]] gave an update on the third automated Rawhide testing milestone. He had also sent a recap to the mailing list<ref>http://lists.fedoraproject.org/pipermail/test/2010-February/088407.html</ref>. As well as finding some more installer bugs, the test run had exposed some areas for improvement in the test scripts, so James and [[User:Wwoods|Will Woods]] would be working on those. | ||
[[User:Jlaska|James Laska]], | [[User:Jlaska|James Laska]] noted that the second build of the Alpha test compose was now available for testing, and result matrices for installation<ref>http://fedoraproject.org/wiki/QA:Fedora_13_Alpha_TC_Install_Test_Results</ref> and desktop<ref>http://fedoraproject.org/wiki/QA:Fedora_13_Alpha_TC_Desktop_Test_Results</ref> validation testing were now available. | ||
[[User:Jlaska|James Laska]] | [[User:Jlaska|James Laska]] raised [[User:Adamwill|Adam Williamson's]] suggestion that live images be provided along with traditional installer images for specific testing points - pre-releases and candidate builds - to assist in desktop validation testing and live installation testing. [[User:jkeating|Jesse Keating]] felt this would be an unnecessary complication, as the nightly live images could be used instead, and would in fact ultimately be closer to the final release. Adam pointed out that this made it harder to co-ordinate testing across multiple testers and be confident they were all testing the same code, but was willing to let it slide. | ||
[[User:Kparal|Kamil Paral]] explained his idea of giving candidate builds different names from the final builds (currently, Alpha candidate images have the same name as the final Alpha image, and so on). [[User:jkeating|Jesse Keating]] felt this could potentially lead to a case where a bug would only happen with the final image name, and not with the candidate name. It was also difficult in that the name of the built image is tightly linked to the image building process. In the end there was a consensus not to try and uniquely name candidate builds. | |||
[[User: | [[User:Kparal|Kamil Paral]] reported that the AutoQA group had discussed plans for the prospective results database, and logged the discussion on the mailing list<ref>http://fedorahosted.org/pipermail/autoqa-devel/2010-February/000201.html</ref>. They are currently studying other similar projects for ideas and welcome any feedback on the mailing list. [[User:Wwoods|Will Woods]] recapped the general outline of the project: to provide a unified database where all AutoQA tests will report results, for ease of viewing and analysis. He mentioned that use cases for viewing the AutoQA results were one useful type of feedback that would be welcome. | ||
[[User:Jskladan|Josef Skladanka]] explained he had been working with [[User:Kparal|Kamil Paral]] on the potential use of beakerlib<ref>http://fedorahosted.org/beakerlib/</ref> in AutoQA. They had created a simple example test<ref>http://jskladan.fedorapeople.org/beakerlib_helloworld.tar</ref> to demonstrate the use of beakerlib in AutoQA. They hope to test migrating some of the existing tests to use beakerlib soon. | |||
[[User: | [[User:Jlaska|James Laska]] noted that [[User:Liam|Liam Li]] had updated the status of automated DVD installation testing on the mailing list<ref>http://fedorahosted.org/pipermail/autoqa-devel/2010-February/000199.html</ref>. He had continued to work on techniques for providing boot arguments in automated installations, and welcomed ideas on that front. | ||
[[User: | Finally, [[User:Jlaska|James Laska]] gave an update on the status of gwt packaging, where he had continued to work on the dependency list with the assistance of the Java team. He was aiming to make a start on packaging in the upcoming week. | ||
No Bugzappers group weekly meeting was held on 2010-02-16 as there were no items needing discussion. | |||
The next QA weekly meeting will be held on 2010-02-22 at 1600 UTC in #fedora-meeting. The next Bugzappers weekly meeting will be held on 2010-02-23 at 1500 UTC in #fedora-meeting. | |||
<references/> | |||
=== Fedora 13 Alpha test compose validation === | |||
[[User:Kparal|Kamil Paral]] announced<ref>http://lists.fedoraproject.org/pipermail/test/2010-February/088444.html</ref> the availability of the initial Alpha test compose images. However, these turned out to be unusable<ref>http://lists.fedoraproject.org/pipermail/test/2010-February/088453.html</ref>, and a second set of images was announced<ref>http://lists.fedoraproject.org/pipermail/test/2010-February/088476.html</ref> by [[User:Jlaska|James Laska]]. Finally, James announced a supplementary update image<ref>http://lists.fedoraproject.org/pipermail/test/2010-February/088494.html</ref> to fix some major issues encountered in the second test compose. With the second test compose and updates image, group members helped to fill out the installation<ref>http://fedoraproject.org/wiki/QA:Fedora_13_Alpha_TC_Install_Test_Results</ref> and desktop<ref>http://fedoraproject.org/wiki/QA:Fedora_13_Alpha_TC_Desktop_Test_Results</ref> results matrices. Andre Robatino provided deltaisos for both F12 to TC1<ref>http://lists.fedoraproject.org/pipermail/test/2010-February/088445.html</ref> and TC1 to TC2<ref>http://lists.fedoraproject.org/pipermail/test/2010-February/088471.html</ref>. | |||
<references/> | <references/> | ||
=== | === Privilege escalation policy === | ||
[[User: | [[User:Adamwill|Adam Williamson]] announced that the privilege escalation policy the group had worked on had been accepted by FESCo. It was now in place on the wiki<ref>http://fedoraproject.org/wiki/Privilege_escalation_policy</ref>. | ||
<references/> | <references/> | ||
=== | === Security spin QA === | ||
[[User:maxamillion|Adam Miller]] presented an outline<ref>http://lists.fedoraproject.org/pipermail/test/2010-February/088554.html</ref> for testing efforts for the new security spin<ref>http://fedoraproject.org/wiki/Security_Spin</ref>. He asked the group for help in contributing test cases for the applications that would be specific to the spin. | |||
<references/> | <references/> | ||
Revision as of 22:26, 19 February 2010
QualityAssurance
In this section, we cover the activities of the QA team[1].
Contributing Writer: Adam Williamson
Test Days
Last week's Test Day was on color management[1]. Turnout was moderate, but those who did come helped us resolve several problems in gnome-color-manager. With the fixes introduced by Richard Hughes throughout the day, all testers reported success in using the application to import and apply color profiles. Unfortunately no testers had the extra hardware and/or accessories needed to test generation of accurate profiles for monitors, webcams and scanners, but we tested these features as far as possible without them.
Next week's Test Day[2] will be on the langpack plugin for yum[3]. This feature is intended to automatically install langpacks - packages containing translations for a particular language - for packages which use them. So if your system is configured with French support, when installing a package which keeps its French translation in a separate langpack, the langpack will be automatically installed. This is a great convenience feature for all those who use languages other than English, so please come out and help us test it! The Test Day will run all day on Thursday 2010-02-25 in the #fedora-test-day IRC channel.
If you would like to propose a main track Test Day for the Fedora 13 cycle, please contact the QA team via email or IRC, or file a ticket in QA Trac[4].
Weekly meetings
The QA group weekly meeting[1] was held on 2010-02-15. The full logs are available[2]. James Laska reported that Kevin Fenzi had set up watchers for the IRC bot zodbot for the Fedora 13 blocker bug trackers. John Poelstra had updated the wording on the group calendars slightly to refer to test milestones rather than specifically to installation testing.
James Laska gave an update on the third automated Rawhide testing milestone. He had also sent a recap to the mailing list[3]. As well as finding some more installer bugs, the test run had exposed some areas for improvement in the test scripts, so James and Will Woods would be working on those.
James Laska noted that the second build of the Alpha test compose was now available for testing, and result matrices for installation[4] and desktop[5] validation testing were now available.
James Laska raised Adam Williamson's suggestion that live images be provided along with traditional installer images for specific testing points - pre-releases and candidate builds - to assist in desktop validation testing and live installation testing. Jesse Keating felt this would be an unnecessary complication, as the nightly live images could be used instead, and would in fact ultimately be closer to the final release. Adam pointed out that this made it harder to co-ordinate testing across multiple testers and be confident they were all testing the same code, but was willing to let it slide.
Kamil Paral explained his idea of giving candidate builds different names from the final builds (currently, Alpha candidate images have the same name as the final Alpha image, and so on). Jesse Keating felt this could potentially lead to a case where a bug would only happen with the final image name, and not with the candidate name. It was also difficult in that the name of the built image is tightly linked to the image building process. In the end there was a consensus not to try and uniquely name candidate builds.
Kamil Paral reported that the AutoQA group had discussed plans for the prospective results database, and logged the discussion on the mailing list[6]. They are currently studying other similar projects for ideas and welcome any feedback on the mailing list. Will Woods recapped the general outline of the project: to provide a unified database where all AutoQA tests will report results, for ease of viewing and analysis. He mentioned that use cases for viewing the AutoQA results were one useful type of feedback that would be welcome.
Josef Skladanka explained he had been working with Kamil Paral on the potential use of beakerlib[7] in AutoQA. They had created a simple example test[8] to demonstrate the use of beakerlib in AutoQA. They hope to test migrating some of the existing tests to use beakerlib soon.
James Laska noted that Liam Li had updated the status of automated DVD installation testing on the mailing list[9]. He had continued to work on techniques for providing boot arguments in automated installations, and welcomed ideas on that front.
Finally, James Laska gave an update on the status of gwt packaging, where he had continued to work on the dependency list with the assistance of the Java team. He was aiming to make a start on packaging in the upcoming week.
No Bugzappers group weekly meeting was held on 2010-02-16 as there were no items needing discussion.
The next QA weekly meeting will be held on 2010-02-22 at 1600 UTC in #fedora-meeting. The next Bugzappers weekly meeting will be held on 2010-02-23 at 1500 UTC in #fedora-meeting.
- ↑ http://fedoraproject.org/wiki/QA/Meetings
- ↑ http://fedoraproject.org/wiki/QA/Meetings/20100215
- ↑ http://lists.fedoraproject.org/pipermail/test/2010-February/088407.html
- ↑ http://fedoraproject.org/wiki/QA:Fedora_13_Alpha_TC_Install_Test_Results
- ↑ http://fedoraproject.org/wiki/QA:Fedora_13_Alpha_TC_Desktop_Test_Results
- ↑ http://fedorahosted.org/pipermail/autoqa-devel/2010-February/000201.html
- ↑ http://fedorahosted.org/beakerlib/
- ↑ http://jskladan.fedorapeople.org/beakerlib_helloworld.tar
- ↑ http://fedorahosted.org/pipermail/autoqa-devel/2010-February/000199.html
Fedora 13 Alpha test compose validation
Kamil Paral announced[1] the availability of the initial Alpha test compose images. However, these turned out to be unusable[2], and a second set of images was announced[3] by James Laska. Finally, James announced a supplementary update image[4] to fix some major issues encountered in the second test compose. With the second test compose and updates image, group members helped to fill out the installation[5] and desktop[6] results matrices. Andre Robatino provided deltaisos for both F12 to TC1[7] and TC1 to TC2[8].
- ↑ http://lists.fedoraproject.org/pipermail/test/2010-February/088444.html
- ↑ http://lists.fedoraproject.org/pipermail/test/2010-February/088453.html
- ↑ http://lists.fedoraproject.org/pipermail/test/2010-February/088476.html
- ↑ http://lists.fedoraproject.org/pipermail/test/2010-February/088494.html
- ↑ http://fedoraproject.org/wiki/QA:Fedora_13_Alpha_TC_Install_Test_Results
- ↑ http://fedoraproject.org/wiki/QA:Fedora_13_Alpha_TC_Desktop_Test_Results
- ↑ http://lists.fedoraproject.org/pipermail/test/2010-February/088445.html
- ↑ http://lists.fedoraproject.org/pipermail/test/2010-February/088471.html
Privilege escalation policy
Adam Williamson announced that the privilege escalation policy the group had worked on had been accepted by FESCo. It was now in place on the wiki[1].
Security spin QA
Adam Miller presented an outline[1] for testing efforts for the new security spin[2]. He asked the group for help in contributing test cases for the applications that would be specific to the spin.