From Fedora Project Wiki

< FWN‎ | Beats

(create beat for fwn 168)
(create fwn 169 qa beat)
Line 10: Line 10:
=== Test Days ===
=== Test Days ===


This week we had two test days, far more exciting than the boring regular one! The first<ref>http://fedoraproject.org/wiki/QA/Test_Days/2009-03-17</ref> was on DeviceKit<ref>http://fedoraproject.org/wiki/Features/DeviceKit</ref>, which will replace HAL for disk and power management in Fedora 11. Turnout was not the highest, but those who came along were able to find several issues which are being addressed with the help of some of the developers involved, including [[User:Davidz|David Zeuthen]] and [[User:Mclasen|Matthias Clasen]]. The second test day<ref>http://fedoraproject.org/wiki/QA/Test_Days/2009-03-19</ref> was on Xfce<ref>http://fedoraproject.org/wiki/Xfce</ref>, which is being updated to a major new release (4.6) in Fedora 11. A group of enthusiastic Xfce users showed up and were able to do some productive testing and refining of the Xfce environment together with the lead packager for Fedora, [[User:Kevin|Kevin Fenzi]].
This week's<ref>http://fedoraproject.org/wiki/QA/Test_Days/2009-03-26</ref> was on the Noveau driver<ref>https://fedoraproject.org/wiki/Features/NouveauAsDefault</ref>for NVIDIA video cards, which will become the default in Fedora 11. Thanks to an excellent turnout, over 80 sets of results were reported, and several bug reports were made: some of the issues have already been resolved. The developer present was [[User:bskeggs|Ben Skeggs]], and [[User:Adamwill|Adam Williamson]], [[User:Jlaska|James Laska]] and [[User:Wwoods|Will Woods]] were present for the QA team.


Next week's test day<ref>http://fedoraproject.org/wiki/QA/Test_Days/2009-03-26</ref> will be on Nouveau<ref>http://fedoraproject.org/wiki/Features/NouveauAsDefault</ref>, the new default video driver for NVIDIA cards for Fedora 11. This is a very important event, as NVIDIA graphics cards are the most popular type, and the new driver is a fairly big change, so we need testing on a wide range of hardware to make sure it's ready. A live CD will be available for the day so you'll be able to test without a Rawhide installation. It will be held on Thursday (2009-03-26) in the #fedora-qa channel on Freenode IRC. If you have an NVIDIA graphics card, please make sure to come along, or - if you can't make it on the day - do the tests and fill out your results on the page another day.
Next week again will see two test days. The first<ref>https://fedoraproject.org/wiki/QA/Test_Days/2009-04-01</ref> will be on the radeon driver for ATI graphics cards, while the second<ref>https://fedoraproject.org/wiki/QA/Test_Days/2009-04-02</ref> will be on <ref>https://fedoraproject.org/wiki/Features/PowerManagement</ref> power management. Live CDs will be available for both test days so you'll be able to test without a Rawhide installation. The Radeon test day will be held on Wednesday (2009-03-01) and the Power Management test day on Thursday (2009-03-02) in the #fedora-qa channel on Freenode IRC. If you have a Radeon graphics card, please make sure to come along to the first test day; if you have a laptop, please come to the second. If you can't make it on the day, please do the tests and fill out your results on the page another day.


<references/>
<references/>
Line 18: Line 18:
=== Weekly meetings ===
=== Weekly meetings ===


The QA group weekly meeting<ref>http://fedoraproject.org/wiki/QA/Meetings</ref> was held on 2009-03-18. The full log is available<ref>http://wwoods.fedorapeople.org/fedora-qa/fedora-qa-20090318.log.html</ref>. [[User:Jlaska|James Laska]] reported good progress in his work on the Semantic test result reporting extension for mediawiki. Packaging is complete and he is next planning to put up a test instance of mediawiki with the plugin enabled.
The QA group weekly meeting<ref>http://fedoraproject.org/wiki/QA/Meetings</ref> was held on 2009-03-25. [[User:Wwoods|Will Woods]] reported that the Fedora 11 beta release had slipped.


[[User:Adamwill|Adam Williamson]] reported that the Intel graphics adapter test day had been a success, and a follow-up event was in the works. He also reported that a Radeon test day had not yet been planned and promised to follow that up with the appropriate developers.
[[User:Jlaska|James Laska]] reported that packaging work on the Semantic extension for Mediawiki was progressing, and one package had already passed review. He also noted that he had created a test Mediawiki instance with the extension enabled, but had not yet been able to do much testing. [[User:Adamwill|Adam Williamson]] confirmed that he also had not had time to do much testing.


[[User:jkeating|Jesse Keating]] was asked to report on the status of the beta release. He said that current Rawhide and particularly Anaconda was still too unstable and said he expected the beta release would slip if he could not get a Rawhide tree with a good Anaconda soon. He requested further testing of Rawhide installation from the QA group, and some help from the main QA group and the Bugzappers group on organizing and checking existing bug reports against Anaconda.
[[User:Adamwill|Adam Williamson]] reported that planning for the Radeon test day was still in progress. He also reported that Bugzappers team review of Anaconda bugs for the Fedora 11 beta release had been successfully completed.


[[User:Adamwill|Adam Williamson]] reported that the Xfce test day was fully planned, and [[User:Kevin|Kevin Fenzi]] reported that he had successfully generated some live CD images for the test day. Adam asked if someone could make sure these images would be available for download.
[[User:Adamwill|Adam Williamson]] reported that the Xfce test day was fully planned, and [[User:Kevin|Kevin Fenzi]] reported that he had successfully generated some live CD images for the test day. Adam asked if someone could make sure these images would be available for download.


The Bugzappers group weekly meeting<ref>http://fedoraproject.org/wiki/BugZappers/Meetings</ref> was held on 2009-03-17. The full log is available<ref>http://fedoraproject.org/wiki/BugZappers/Meetings/Minutes-2009-Mar-17</ref>. [[User:Poelstra|John Poelstra]] asked for feedback on the draft Standard Operating Procedure for new memberships which he had sent to the mailing list. The group generally approved of the draft. It was also agreed that the 'triagers' and 'fedorabugs' groups in FAS should be merged or linked, so that anyone who joined the triagers group automatically becomes a member of fedorabugs. [[User:Tk009|Edward Kirk]] proposed not putting the SOP online and into operation until the appropriate changes have been made in FAS, and this was agreed. Christopher said he will send a draft of the new 'How to Triage' page to the mailing list for discussion in the coming week.
[[User:Wwoods|Will Woods]] reported that he had been testing upgrade scenarios for the Fedora 11 beta release and had found several bugs in this area.


The group discussed [[User:Adamwill|Adam Williamson's]] draft front page for the Wiki area. Discussion centred on the links in the Tools and Procedures section. Adam explained that he expected further work on the Wiki to clean up and merge the pages linked to in that section, so the number of links would be smaller. [[User:Beland|Christopher Beland]] fixed the links in the draft which were broken. Christopher proposed putting up the new page immediately and then working to clean up the pages further down the hierarchy, and this was agreed by the group.
[[User:Jlaska|James Laska]] noted that most critical bugs for the beta release were already known and being tracked, and re-testing was not necessary for any known issues. A long discussion followed on the correct place and format in which to note known issues. The group agreed that known issues for the beta release should be noted within the beta release notes as separate sub-headings, and a concerted effort should be made to make sure that the release notes were referred to in all official, semi-official and unofficial communications regarding the beta release. [[User:Wwoods|Will Woods']] suggestion that this was a job for the <marquee> tag was roundly rejected.


The group discussed the revised Components and Triagers<ref>https://fedoraproject.org/wiki/BugZappers/Components_and_Triagers</ref> wiki page and agreed the new layout was good. [[User:Poelstra|John Poelstra]] did not like the static statistics. [[User:Adamwill|Adam Williamson]] pointed out that it is planned to replace them with dynamically updated data from Brennan Ashton's metrics tool once it is complete.  
The Bugzappers group weekly meeting<ref>http://fedoraproject.org/wiki/BugZappers/Meetings</ref> was held on 2009-03-24. It was a short meeting as several key group members were not able to attend. Matej Cepl reported that he had consolidated his RHEL and Fedora triage and signature scripts into a single Greasemonkey script<ref>http://mcepl.fedorapeople.org/scripts/greasemonkey/bugzillaBugTriage.user.js</ref>. Other topics were deferred to future meetings or the mailing list for lack of a reasonable number of group members to make binding decisions.


[[User:Poelstra|John Poelstra]] brought up the potential meeting time and date change. [[User:Adamwill|Adam Williamson]] promised to send a mail to the mailing list summarising the results of the matrix survey to see if a definite conclusion could be made about whether to move the meeting.
The next QA weekly meeting will be held on 2009-04-02 at 1600 UTC (note reversion to previous meeting time) in #fedora-meeting, and the next Bugzappers weekly meeting on 2009-04-01 at 1500 UTC in #fedora-meeting.


The next QA weekly meeting will be held on 2009-03-25 at 1700 UTC (note changed time, in UTC reference frame) in #fedora-meeting, and the next Bugzappers weekly meeting on 2009-03-18 at 1500 UTC in #fedora-meeting.
<references/>
 
=== Wiki changes ===
 
The group discussed [[User:Beland|Christopher Beland's]] new How to Triage draft<ref>https://fedoraproject.org/wiki/User:Beland/How_to_Triage</ref>, and Chris made several revisions and improvements. Chris summarized<ref>https://www.redhat.com/archives/fedora-test-list/2009-March/msg01105.html</ref> several remaining questions relating to the page, and Adam Williamson<ref>http://www.redhat.com/archives/fedora-test-list/2009-March/msg01125.html</ref> and [[User:Tk009|Edward Kirk]] provided feedback<ref>http://www.redhat.com/archives/fedora-test-list/2009-March/msg01110.html</ref>.


<references/>
<references/>


=== Wiki changes ===
=== Bugzappers meeting schedule  ===


[[User:Adamwill|Adam Williamson]] announced<ref>http://www.redhat.com/archives/fedora-test-list/2009-March/msg00885.html</ref> that he had added a new column to the Components and Triagers<ref>https://fedoraproject.org/wiki/BugZappers/Components_and_Triagers</ref> wiki page to make it easy to find out who is the maintainer of a given component (and other information on it). [[User:Beland|Christopher Beland]] changed<ref>http://www.redhat.com/archives/fedora-test-list/2009-March/msg00926.html</ref> the stock response text for EOL bugs in an attempt to make it friendlier. Adam pointed out<ref>http://www.redhat.com/archives/fedora-test-list/2009-March/msg00937.html</ref> that changes to the stock responses should be mirrored in the GreaseMonkey script. Chris also announced<ref>http://www.redhat.com/archives/fedora-test-list/2009-March/msg00931.html</ref> a draft of a new How to Triage page for the group's feedback. Adam and Milos Jakubicek both approved of Chris' work and provided some suggestions to improve it.
[[User:Adamwill|Adam Williamson]] requested<ref>https://www.redhat.com/archives/fedora-test-list/2009-March/msg01108.html</ref> a final decision on re-scheduling the Bugzappers group movement, but no final conclusion was yet reached.


<references/>
<references/>


=== Bugzilla status, priority and severity procedures ===
=== Triage Days on the Wiki ===


[[User:Beland|Christopher Beland]] began a discussion<ref>http://www.redhat.com/archives/fedora-test-list/2009-March/msg00942.html</ref> about the use of various statuses, resolutions and the priority and severity fields in Bugzilla. [[User:Adamwill|Adam Williamson]] pointed out<ref>http://www.redhat.com/archives/fedora-test-list/2009-March/msg00943.html</ref> that some of the more unconventional statuses and resolutions come from the RHEL side, where there is a specific and carefully defined workflow, and these statuses do not always mean exactly what they might appear to. Further to this, [[TomLane|Tom Lane]] noted<ref>http://www.redhat.com/archives/fedora-test-list/2009-March/msg00949.html</ref> that the Bugzilla page defining each status<ref>https://bugzilla.redhat.com/page.cgi?id=fields.html#status</ref> contains accurate information on the RHEL workflow. He then suggested<ref>http://www.redhat.com/archives/fedora-test-list/2009-March/msg00960.html</ref> that a similar page should be created to define a standard workflow for Fedora bugs, and included in Bugzilla. [[User:jkeating|Jesse Keating]] suggested<ref>http://www.redhat.com/archives/fedora-test-list/2009-March/msg00962.html</ref> that instead, the Fedora and RHEL workflows should be merged so that both would use the same statuses and resolutions in the same ways.
[[User:Adamwill|Adam Williamson]] apologized for the delay, and announced <ref>https://www.redhat.com/archives/fedora-test-list/2009-March/msg01129.html</ref> that a Triage Day page was now available on the Wiki, explaining the existence and function of the Bugzappers group's weekly Triage Day.


<references/>
<references/>

Revision as of 02:02, 30 March 2009

QualityAssurance

In this section, we cover the activities of the QA team[1].

Contributing Writer: Adam Williamson

Test Days

This week's[1] was on the Noveau driver[2]for NVIDIA video cards, which will become the default in Fedora 11. Thanks to an excellent turnout, over 80 sets of results were reported, and several bug reports were made: some of the issues have already been resolved. The developer present was Ben Skeggs, and Adam Williamson, James Laska and Will Woods were present for the QA team.

Next week again will see two test days. The first[3] will be on the radeon driver for ATI graphics cards, while the second[4] will be on [5] power management. Live CDs will be available for both test days so you'll be able to test without a Rawhide installation. The Radeon test day will be held on Wednesday (2009-03-01) and the Power Management test day on Thursday (2009-03-02) in the #fedora-qa channel on Freenode IRC. If you have a Radeon graphics card, please make sure to come along to the first test day; if you have a laptop, please come to the second. If you can't make it on the day, please do the tests and fill out your results on the page another day.

Weekly meetings

The QA group weekly meeting[1] was held on 2009-03-25. Will Woods reported that the Fedora 11 beta release had slipped.

James Laska reported that packaging work on the Semantic extension for Mediawiki was progressing, and one package had already passed review. He also noted that he had created a test Mediawiki instance with the extension enabled, but had not yet been able to do much testing. Adam Williamson confirmed that he also had not had time to do much testing.

Adam Williamson reported that planning for the Radeon test day was still in progress. He also reported that Bugzappers team review of Anaconda bugs for the Fedora 11 beta release had been successfully completed.

Adam Williamson reported that the Xfce test day was fully planned, and Kevin Fenzi reported that he had successfully generated some live CD images for the test day. Adam asked if someone could make sure these images would be available for download.

Will Woods reported that he had been testing upgrade scenarios for the Fedora 11 beta release and had found several bugs in this area.

James Laska noted that most critical bugs for the beta release were already known and being tracked, and re-testing was not necessary for any known issues. A long discussion followed on the correct place and format in which to note known issues. The group agreed that known issues for the beta release should be noted within the beta release notes as separate sub-headings, and a concerted effort should be made to make sure that the release notes were referred to in all official, semi-official and unofficial communications regarding the beta release. Will Woods' suggestion that this was a job for the <marquee> tag was roundly rejected.

The Bugzappers group weekly meeting[2] was held on 2009-03-24. It was a short meeting as several key group members were not able to attend. Matej Cepl reported that he had consolidated his RHEL and Fedora triage and signature scripts into a single Greasemonkey script[3]. Other topics were deferred to future meetings or the mailing list for lack of a reasonable number of group members to make binding decisions.

The next QA weekly meeting will be held on 2009-04-02 at 1600 UTC (note reversion to previous meeting time) in #fedora-meeting, and the next Bugzappers weekly meeting on 2009-04-01 at 1500 UTC in #fedora-meeting.

Wiki changes

The group discussed Christopher Beland's new How to Triage draft[1], and Chris made several revisions and improvements. Chris summarized[2] several remaining questions relating to the page, and Adam Williamson[3] and Edward Kirk provided feedback[4].

Bugzappers meeting schedule

Adam Williamson requested[1] a final decision on re-scheduling the Bugzappers group movement, but no final conclusion was yet reached.

Triage Days on the Wiki

Adam Williamson apologized for the delay, and announced [1] that a Triage Day page was now available on the Wiki, explaining the existence and function of the Bugzappers group's weekly Triage Day.