From Fedora Project Wiki

< FWN‎ | Beats

(missed a references tag)
(fwn 207 beat in)
Line 16: Line 16:
=== Weekly meetings ===
=== Weekly meetings ===


As the QA beat was unfortunately not present for Fedora Weekly News #205, we will cover two weeks' worth of events below.
The QA group weekly meeting<ref>http://fedoraproject.org/wiki/QA/Meetings</ref> was held on 2009-12-14. The full log is available<ref>http://fedoraproject.org/wiki/QA/Meetings/20091214</ref>. [[User:Adamwill|Adam Williamson]] reported that the note on hardware-dependent issues as relating to the release criteria which he had promised to write was done, and added to the blocker bug FAQ<ref>http://fedoraproject.org/wiki/Blocker_Bug_FAQ#What_about_hardware_and_local_configuration_dependent_issues.3F</ref>.  


A QA group weekly meeting<ref>http://fedoraproject.org/wiki/QA/Meetings</ref> was held on 2009-11-30. No meeting was held on 2009-12-07 due to many group members being absent at FUDCon or elsewhere. The full log of the 2009-11-30 meeting is available<ref>http://meetbot.fedoraproject.org/fedora-meeting/2009-11-30/qa.2009-11-30-16.00.log.html</ref>. [[User:Adamwill|Adam Williamson]] reported that he had started a development mailing list conversation regarding the proposed privilege escalation policy<ref>http://www.redhat.com/archives/fedora-devel-list/2009-November/msg01745.html</ref>.
[[User:Jlaska|James Laska]] reported that he was still working on a list of recommendations based on the Fedora 12 retrospective, but expected to have it finished within the next few days.


[[User:Jlaska|James Laska]] thanked the group for their feedback on [[User:poelstra|John Poelstra's]] plan to improve the release criteria<ref>http://www.redhat.com/archives/fedora-test-list/2009-November/msg00926.html</ref>, and asked for comments on the planned next steps. John said he was planning to work in all the received feedback, send a revised draft of the page to the mailing list for comment, and do the final touches in a hackfest at the upcoming FUDCon. [[User:Adamwill|Adam Williamson]] volunteered to write a proposed paragraph to cover subjective judgment of configuration-dependent problems.
[[User:Adamwill|Adam Williamson]] gave an update on the release criteria improvement process. As planned, a group had gathered to finalize work on the new criteria at FUDCon, and the new criteria were now officially in place<ref>http://fedoraproject.org/wiki/Fedora_Release_Criteria</ref>. No-one felt there was significant additional work to do on the criteria themselves for the Fedora 13 cycle.


[[User:Adamwill|Adam Williamson]] gave a more detailed update on the privilege escalation policy topic. He said the development mailing list discussion had generated some useful points and potential issues that should be dealt with by any policy, but no clear road forward. With some help from [[User:Kevin|Kevin Fenzi]], a plan was made for Adam to escalate the issue for consideration by FESco with reference to the previous discussion, and possibly a proposed policy created with the help of the security team.
[[User:Adamwill|Adam Williamson]] gave an update on the privilege escalation policy topic. He had not received any practical feedback or suggestions from the Red Hat security group, so intended to escalate the issue to FESCo without an actual proposed policy. [[User:Wwoods|Will Woods]] noted that he had had some discussions at FUDCon about how to implement AutoQA tests for builds which added or removed setuid binaries, consolehelper configuration files, or PolicyKit policies.


[[User:Jlaska|James Laska]] gave an update on the Fedora 12 QA retrospective. He thanked the group for their feedback, and outlined his plans. He intends to organize the feedback into topic groups to try and identify trends, and then discuss what can be improved for the Fedora 13 cycle based on that feedback.
[[User:Wwoods|Will Woods]] and [[User:Kparal|Kamil Paral]] reported on the progress of the AutoQA project. Will mentioned that he had given a talk on AutoQA at FUDCon, and pointed to the slides<ref>http://wwoods.fedorapeople.org/files/AutoQA-FUDCon-Toronto-2009.odp</ref>. He had returned with several good ideas for future improvements to AutoQA suggested by other participants, and a clearer plan for implementing the much-needed dependency checking test. Kamil said that he had been working on integrating rpmguard as an AutoQA test, and this initial work was available in the 'kparal/rpmguard-integration' git branch. He had posted an email announcement<ref>http://fedorahosted.org/pipermail/autoqa-devel/2009-December/000047.html</ref> of this, containing some example output.


[[User:Wwoods|Will Woods]] and [[User:Kparal|Kamil Paral]] reported on the progress of the AutoQA project. Kamil had written some patches intended to make test development easier, providing --help and --dry-run parameters for each watcher. He now plans to document these improvements in the wiki once they are accepted. He had also worked on integrating rpmguard into AutoQA. Will had added --local and --dry-run parameters to the test harness so that tests can be run locally by developers. He had fixed various watchers to run tests only once when repositories are changed or builds are run, even if multiple architectures are changed. He was planning to write some notes on AutoQA for Fedora developrs for use at the upcoming FUDCon, and help Kamil with rpmguard integration. [[User:Jlaska|James Laska]] reported that packaging of the israwhidebroken code was now complete, with help from [[ToshioKuratomi|Toshio Kuratomi]].
[[User:Jlaska|James Laska]] noted the work [User:Rhe|Rui He]] and [[User:Liam|Liam Li]] had been doing on the 'is anaconda broken?' proposal<ref>http://fedoraproject.org/wiki/Is_anaconda_broken_proposal</ref>. He also said he was planning a release sprint to revise the release validation test plans for the new release criteria.


[[User:Adamwill|Adam Williamson]] proposed that Glögg<ref>http://loupgaroublond.blogspot.com/2009/11/glogg.html</ref> be adopted as the official QA team drink. [[User:jkeating|Jesse Keating]] suggested magic hobo gravy<ref>http://hijinksensue.com/2009/11/27/the-special-sauce/</ref> as an alternative. No clear consensus was reached on the issue.
The Bugzappers group weekly meeting<ref>http://fedoraproject.org/wiki/BugZappers/Meetings</ref> was held on 2009-12-15. The full log is available<ref>http://meetbot.fedoraproject.org/fedora-meeting/2009-12-15/fedora-meeting.2009-12-15-15.18.log.html</ref>. [[User:Mcepl|Matej Cepl]] reported that he was planning to replace the current GreaseMonkey script used to enhance Bugzilla pages for the benefit of triagers with Jetpacks<ref>http://jetpack.mozillalabs.com/</ref>. He asked for volunteers to test the initial versions of the Jetpacks, available from his space<ref>http://mcepl.fedorapeople.org/scripts/install.html</ref>.


A Bugzappers group weekly meeting<ref>http://fedoraproject.org/wiki/BugZappers/Meetings</ref> was held on 2009-12-01. No meeting was held on 2009-12-08 due to many members being absent. The full log of the 2009-12-01 meeting is available<ref>http://meetbot.fedoraproject.org/fedora-meeting/2009-12-01/fedora-meeting.2009-12-01-15.06.log.html</ref>. [[User:Rjune|Richard June]] noted that updating the components and triagers page<ref>http://fedoraproject.org/wiki/BugZappers/Components_and_Triagers</ref> had been left with [[User:Tk009|Edward Kirk]], who was not present to report on it. [[User:Adamwill|Adam Williamson]] encouraged all group members to make sure they were listed on the page next to the correct components.
The next QA weekly meeting will be held on 2009-12-21 at 1600 UTC in #fedora-meeting. The next Bugzappers weekly meeting will be held on 2009-12-22 at 1500 UTC in #fedora-meeting.
 
[[User:Adamwill|Adam Williamson]] started a discussion on the topic of anaconda triage. He explained that the anaconda team could benefit from having a triage volunteer, as [[User:andyl|Andy Lindeberg]] was no longer working on anaconda triage. This would take a significant amount of time and require knowledge of anaconda, but the anaconda team was prepared to help train volunteers. [[User:Rjune|Richard June]] volunteered to send a mail to the mailing list with details of the requirements, to ask for volunteers.
 
[[User:Adamwill|Adam Williamson]] took another look at the triage metrics situation. No-one had heard from Brennan Ashton lately, but Adam would try to check in with him at the upcoming FUDCon event. Adam also pointed out the fairly new statistics system within Bugzilla<ref>http://bugzilla.redhat.com/browse.cgi</ref> as a possibility for the group to explore.
 
[[User:Mcepl|Matej Cepl]] reported that he had completed the agreed plan to add the Triaged keyword to all ASSIGNED bugs in Fedora 10 through 12.
 
The next QA weekly meeting may be held on 2009-11-07 at 1600 UTC in #fedora-meeting, although several group members are at FUDCon during that time and may not be able to attend. The next Bugzappers weekly meeting will be held on 2009-12-08 at 1500 UTC in #fedora-meeting.
 
<references/>
 
=== FUDCon Toronto ===
 
The QA and BugZappers groups were both well represented at FUDCon Toronto<ref>http://fedoraproject.org/wiki/FUDCon:Toronto_2009</ref>. [[User:Jlaska|James Laska]], [[User:Wwoods|Will Woods]], [[User:Adamwill|Adam Williamson]], [[User:poelstra|John Poelstra]], [[User:StevenParrish|Steven M. Parrish]], [[User:Bashton|Brennan Ashton (comphappy)]] all attended, and a brand new BugZapper - Patrick Ian - was welcomed during the event. Steven, Will and Adam all gave talks: Steven<ref>http://meetbot.fedoraproject.org/fudcon-room-5/2009-12-05/fudcon-room-5.2009-12-05-17.11.log.html</ref> on effective bug reporting, Will<ref>http://meetbot.fedoraproject.org/fudcon-room-2/2009-12-05/fudcon-room-2.2009-12-05-21.12.log.html</ref> on AutoQA, and Adam<ref>http://meetbot.fedoraproject.org/fudcon-room-5/2009-12-05/fudcon-room-5.2009-12-05-19.09.log.html</ref> on getting involved with QA and BugZappers. Several group members also posted write-ups of the event: John<ref>http://poelcat.wordpress.com/2009/12/09/fudcon-toronto-trip-report/</ref>, Steven<ref>http://smparrish.livejournal.com/11639.html</ref>, and Adam<ref>http://www.happyassassin.net/2009/12/10/fudcon-toronto-2009-wrap-up/</ref>.
 
<references/>
 
=== BugZappers triaged bugs policy change ===
 
[[User:Adamwill|Adam Williamson]] announced<ref>http://www.redhat.com/archives/fedora-test-list/2009-November/msg01228.html</ref> a small modification to the recently-implemented triaged bug policy change. To make searching easier, triagers should now add the Triaged keyword to all Fedora 11 and Fedora 12 bugs when they have been triaged, as well as marking them as ASSIGNED.
 
<references/>
 
=== Release criteria revision ===
 
[[User:poelstra|John Poelstra]] posted a final request<ref>http://www.redhat.com/archives/fedora-test-list/2009-December/msg00047.html</ref> for feedback on the proposed new release criteria<ref>https://fedoraproject.org/wiki/Fedora_Release_Criteria</ref>, noting that the pages would be finalized and made active at the upcoming FUDCon Toronto. At FUDCon, a group including John, [[User:Jlaska|James Laska]], [[User:Adamwill|Adam Williamson]], [[User:Notting|Bill Nottingham]] and [[User:tburke|Tim Burke]] revised the pages including all feedback provided from the list, and then made further revisions based on feedback by the anaconda and desktop teams. Adam announced the changes to the list<ref>http://www.redhat.com/archives/fedora-test-list/2009-December/msg00137.html</ref>. Some further changes were then made based on suggestions from A. Mani<ref>http://www.redhat.com/archives/fedora-test-list/2009-December/msg00140.html</ref> and others.
 
<references/>
 
=== Bugzilla 3.4 public beta ===
 
[[User:Jlaska|James Laska]] passed on an announcement<ref>http://www.redhat.com/archives/fedora-test-list/2009-December/msg00099.html</ref> from Red Hat's Bugzilla team that a public beta of Bugzilla 3.4 for the Red Hat Bugzilla instance (which Fedora shares) is now available<ref>http://partner-bugzilla.redhat.com/</ref>. Later, James passed on the announcement for the second beta<ref>http://www.redhat.com/archives/fedora-test-list/2009-December/msg00212.html</ref>.


<references/>
<references/>


=== Fedora 13 schedule ===
=== Increasing the grub timeout ===


[[User:poelstra|John Poelstra]] provided<ref>http://www.redhat.com/archives/fedora-test-list/2009-December/msg00101.html</ref> a draft schedule of QA tasks for the Fedora 13 release. He later provided an updated schedule<ref>http://www.redhat.com/archives/fedora-test-list/2009-December/msg00176.html</ref> based on discussion at FUDCon Toronto. [[User:Jlaska|James Laska]] requested<ref>http://www.redhat.com/archives/fedora-test-list/2009-December/msg00177.html</ref> an extra pre-alpha acceptance milestone on 2009-01-21.
Scott Robbins started a long thread<ref>http://www.redhat.com/archives/fedora-test-list/2009-November/msg01012.html</ref> with the suggestion to increase the default timeout for the Fedora boot loader from its current default setting of 0 (which causes the boot loader menu never to be shown at all). There were many opinions on this idea, but the general response was positive enough for Scott to file a feature request<ref>http://bugzilla.redhat.com/show_bug.cgi?id=541315</ref> on the idea, where some compromises were suggested. Richard Ryniker suggested having the system detect unclean shutdowns and force the boot menu to be displayed on the next boot (much as Windows does). Stewart Adam suggested having grub initially installed with a non-zero timeout, and have firstboot change it to zero on the assumption that a system that can get to firstboot must have a properly configured bootloader.


<references/>
<references/>


=== Fedora 13 Alpha release notes ===
=== X.org server testing ===


[[User:Sundaram|Rahul Sundaram]] posted<ref>http://www.redhat.com/archives/fedora-test-list/2009-December/msg00138.html</ref> a preliminary draft of the Fedora 13 Alpha release notes for comment and discussion.
[[User:Adamwill|Adam Williamson]] posted a request<ref>http://www.redhat.com/archives/fedora-test-list/2009-December/msg00278.html</ref> for group members to test a recent Fedora 12 X.org server build provided by the Fedora X development team, to provide some assurance that it worked acceptably before it would be submitted as a candidate update. Many members submitted useful reports in response, with a generally positive character. However, one potential issue with the nouveau driver emerged thanks to the report of Mike Chambers<ref>http://www.redhat.com/archives/fedora-test-list/2009-December/msg00305.html</ref>, and was passed back to the developers for investigation.


<references/>
<references/>

Revision as of 20:53, 18 December 2009

QualityAssurance

In this section, we cover the activities of the QA team[1].

Contributing Writer: Adam Williamson

Test Days

There was no Test Day last week, and no Test Day is currently planned for this week. If you would like to propose a main track Test Day for the Fedora 13 cycle, please contact the QA team via email or IRC, or file a ticket in QA Trac[1].

Weekly meetings

The QA group weekly meeting[1] was held on 2009-12-14. The full log is available[2]. Adam Williamson reported that the note on hardware-dependent issues as relating to the release criteria which he had promised to write was done, and added to the blocker bug FAQ[3].

James Laska reported that he was still working on a list of recommendations based on the Fedora 12 retrospective, but expected to have it finished within the next few days.

Adam Williamson gave an update on the release criteria improvement process. As planned, a group had gathered to finalize work on the new criteria at FUDCon, and the new criteria were now officially in place[4]. No-one felt there was significant additional work to do on the criteria themselves for the Fedora 13 cycle.

Adam Williamson gave an update on the privilege escalation policy topic. He had not received any practical feedback or suggestions from the Red Hat security group, so intended to escalate the issue to FESCo without an actual proposed policy. Will Woods noted that he had had some discussions at FUDCon about how to implement AutoQA tests for builds which added or removed setuid binaries, consolehelper configuration files, or PolicyKit policies.

Will Woods and Kamil Paral reported on the progress of the AutoQA project. Will mentioned that he had given a talk on AutoQA at FUDCon, and pointed to the slides[5]. He had returned with several good ideas for future improvements to AutoQA suggested by other participants, and a clearer plan for implementing the much-needed dependency checking test. Kamil said that he had been working on integrating rpmguard as an AutoQA test, and this initial work was available in the 'kparal/rpmguard-integration' git branch. He had posted an email announcement[6] of this, containing some example output.

James Laska noted the work [User:Rhe|Rui He]] and Liam Li had been doing on the 'is anaconda broken?' proposal[7]. He also said he was planning a release sprint to revise the release validation test plans for the new release criteria.

The Bugzappers group weekly meeting[8] was held on 2009-12-15. The full log is available[9]. Matej Cepl reported that he was planning to replace the current GreaseMonkey script used to enhance Bugzilla pages for the benefit of triagers with Jetpacks[10]. He asked for volunteers to test the initial versions of the Jetpacks, available from his space[11].

The next QA weekly meeting will be held on 2009-12-21 at 1600 UTC in #fedora-meeting. The next Bugzappers weekly meeting will be held on 2009-12-22 at 1500 UTC in #fedora-meeting.

Increasing the grub timeout

Scott Robbins started a long thread[1] with the suggestion to increase the default timeout for the Fedora boot loader from its current default setting of 0 (which causes the boot loader menu never to be shown at all). There were many opinions on this idea, but the general response was positive enough for Scott to file a feature request[2] on the idea, where some compromises were suggested. Richard Ryniker suggested having the system detect unclean shutdowns and force the boot menu to be displayed on the next boot (much as Windows does). Stewart Adam suggested having grub initially installed with a non-zero timeout, and have firstboot change it to zero on the assumption that a system that can get to firstboot must have a properly configured bootloader.

X.org server testing

Adam Williamson posted a request[1] for group members to test a recent Fedora 12 X.org server build provided by the Fedora X development team, to provide some assurance that it worked acceptably before it would be submitted as a candidate update. Many members submitted useful reports in response, with a generally positive character. However, one potential issue with the nouveau driver emerged thanks to the report of Mike Chambers[2], and was passed back to the developers for investigation.