From Fedora Project Wiki

< FWN‎ | Beats

(s/https/http/)
(create fwn 242 qa beat)
Line 10: Line 10:
=== Test Days ===
=== Test Days ===


Last week's Test Day<ref>http://fedoraproject.org/wiki/Test_Day:2010-08-26_OpenSCAP</ref>, held on 2010-08-26, was on OpenSCAP<ref>http://fedoraproject.org/wiki/Features/OpenSCAP</ref>, an open implementation of SCAP, which aims to provide a standardized approach to maintaining the security of systems. There was a good turnout for the Test Day, and it was successful in discovering five significant bugs for the developers to work on, one of which has already been fixed.
Last week's Test Day<ref>http://fedoraproject.org/wiki/Test_Day:2010-09-02_Preupgrade</ref> on 2010-09-02 was on preupgrade<ref>http://fedoraproject.org/wiki/Preupgrade</ref>, the Fedora in-place upgrade system. There was a good turnout for the Test Day, and it exposed several serious bugs to be resolved for the Beta and final releases of Fedora 14. [[User:Rhe|Rui He]] provided a recap of the event<ref>http://lists.fedoraproject.org/pipermail/test/2010-September/093329.html</ref> with a list of the bugs discovered.


This week's Test Day<ref>http://fedoraproject.org/wiki/Test_Day:2010-09-02_Preupgrade</ref> on 2010-09-02 will be on preupgrade<ref>http://fedoraproject.org/wiki/Preupgrade</ref>, the Fedora in-place upgrade system. This is always an important test day as we attempt to ensure the upgrade mechanisms for the next release work as expected. As upgrading is a complex process and highly dependent on the installed system, it would help to have as many testers as possible to help track down any bugs we can find. As always, the Test Day will run all day in the #fedora-test-day IRC channel. You will need to have an installed Fedora 13 system you don't mind hurting in order to help out with the testing - but remember, testing in a virtual machine is easy and non-destructive!
This week's Test Day<ref>http://fedoraproject.org/wiki/Test_Day:2010-09-07_Systemd</ref> on systemd<ref>http://fedoraproject.org/wiki/Features/systemd</ref>, the new initialization system being introduced in Fedora 14, has happened already, since it was moved up from the usual Thursday slot to Tuesday 2010-09-07. A great turnout of testers exercised systemd extensively and did a good job of discovering bugs to be fixed. Even though the test day itself is past, further testing of systemd would be valuable, so if you have some free time, do check out the page and contribute your results!


Next week's Test Day<ref>http://fedoraproject.org/wiki/Test_Day:2010-09-09_Systemd</ref> on 2010-09-09 will be on systemd<ref>http://fedoraproject.org/wiki/Features/systemd</ref>, the new initialization system being introduced in Fedora 14. This is a major change which will affect every user of Fedora 14, so it would help to have as many testers as possible to help track down any bugs we can find. As always, the Test Day will run all day in the #fedora-test-day IRC channel. You can help out with testing using a live image or a virtual machine, so there's no need to alter your main system. Please drop by and help test systemd if you can!
Next week's Test Day<ref>http://fedoraproject.org/wiki/Test_Day:2010-09-16_AnacondaTranslationKeyboard</ref> on 2010-09-16 will be on translations and keyboard layout support in the Fedora installer. These features are key for Fedora users outside the United States, which is most of you! As always, the Test Day will run all day in the #fedora-test-day IRC channel. You can help out with testing using a live image or a virtual machine, so there's no need to alter your main system, although some of the tests do require you to complete an installation and check the installed system. Please drop by and help make sure as many languages and keyboard layouts as possible will be correctly supported in Fedora 14!


If you would like to propose a main track Test Day for the Fedora 14 cycle, please contact the QA team via email or IRC, or file a ticket in QA Trac<ref>http://fedorahosted.org/fedora-qa/</ref>.
If you would like to propose a main track Test Day for the Fedora 14 cycle, please contact the QA team via email or IRC, or file a ticket in QA Trac<ref>http://fedorahosted.org/fedora-qa/</ref>.
Line 20: Line 20:
<references/>
<references/>


=== Fedora 14 Beta blocker review ===
=== Proven testers ===


The first blocker review meeting for Fedora 14 Beta took place on Friday 2010-08-27<ref>http://meetbot.fedoraproject.org/fedora-bugzappers/2010-08-27/f-14-beta-blocker-review.2010-08-27-16.00.html</ref>, and [[User:Jlaska|James Laska]] posted a recap<ref>http://lists.fedoraproject.org/pipermail/test/2010-August/093084.html</ref>. The group considered the eight open blockers for the Beta release and accepted two, rejected two, and left four on the list without confirming them, pending further information.
During the QA weekly meeting of 2010-08-30<ref>http://fedoraproject.org/wiki/QA/Meetings/20100830</ref>, [[User:Jlaska|James Laska]] asked what to do about an email from a proven tester asking to become a group sponsor so he could sponsor new proven testers members. [[User:Adamwill|Adam Williamson]] pointed out the proven tester wiki page already has a procedure for this<ref>http://fedoraproject.org/wiki/Proven_tester#Becoming_a_mentor</ref>, albeit a fairly casual one. He recommended simply accepting the request for now, and suggested that if anyone wanted to make the process more systematic, they should send a proposal to the mailing list. James also asked about the progress of proven tester metrics, and Adam pointed out that a ticket requesting support from the Bodhi team already existed<ref>http://fedorahosted.org/bodhi/ticket/456</ref>, and promised to follow up on the ticket for the next meeting.


<references/>
<references/>


=== AutoQA ===
=== Outdated Firefox package in Fedora 14 ===


[[User:Jskladan|Josef Skladanka]] psoted a draft<ref>http://fedorahosted.org/pipermail/autoqa-devel/2010-August/001038.html</ref> of a guide to writing AutoQA tests<ref>http://fedoraproject.org/wiki/User:Jskladan/Sandbox:Writing_autoqa_tests</ref>. Josef, [[User:Kparal|Kamil Paral]] and [[User:Jlaska|James Laska]] continued to revise and refine the page over the next few days.
David Boles pointed out<ref>http://lists.fedoraproject.org/pipermail/test/2010-August/093178.html</ref> that the Firefox package in Fedora 14 was somewhat old. [[User:Adamwill|Adam Williamson]] contacted the maintainers and passed on their explanation<ref>http://lists.fedoraproject.org/pipermail/test/2010-September/093205.html</ref> that they had forgotten that Fedora 14 updates now had to be submitted through Bodhi, and that they would soon submit a newer Firefox package.


Vojtěch Aschenbrenner improved the upgrade path test<ref>http://fedorahosted.org/pipermail/autoqa-devel/2010-August/001037.html</ref> to run automatically on post-bodhi-hook and to improve the output format.
<references/>
 
=== Bugzilla voting disabled ===
 
[[User:Kparal|Kamil Paral]] wondered why he had recieved a mail about votes being removed<ref>http://lists.fedoraproject.org/pipermail/test/2010-September/093243.html</ref>. [[User:Kevin|Kevin Fenzi]] explained that this was due to the Bugzilla voting feature being disabled<ref>http://lists.fedoraproject.org/pipermail/test/2010-September/093263.html</ref>. FESCo had decided the system was so flawed it provided no useful data, and so should be disabled. They had not known Bugzilla would send out notification emails about this. He explained that FESCo was now looking at using CC lists or comment quantities to provide an indication of 'popular' bugs, but that this too was proving problematic, and pointed out a ticket where this was being tracked<ref>http://fedorahosted.org/fedora-engineering-services/ticket/24</ref>.


<references/>
<references/>

Revision as of 18:18, 8 September 2010

QualityAssurance

In this section, we cover the activities of the QA team[1]. For more information on the work of the QA team and how you can get involved, see the Joining page[2].

Contributing Writer: Adam Williamson

Test Days

Last week's Test Day[1] on 2010-09-02 was on preupgrade[2], the Fedora in-place upgrade system. There was a good turnout for the Test Day, and it exposed several serious bugs to be resolved for the Beta and final releases of Fedora 14. Rui He provided a recap of the event[3] with a list of the bugs discovered.

This week's Test Day[4] on systemd[5], the new initialization system being introduced in Fedora 14, has happened already, since it was moved up from the usual Thursday slot to Tuesday 2010-09-07. A great turnout of testers exercised systemd extensively and did a good job of discovering bugs to be fixed. Even though the test day itself is past, further testing of systemd would be valuable, so if you have some free time, do check out the page and contribute your results!

Next week's Test Day[6] on 2010-09-16 will be on translations and keyboard layout support in the Fedora installer. These features are key for Fedora users outside the United States, which is most of you! As always, the Test Day will run all day in the #fedora-test-day IRC channel. You can help out with testing using a live image or a virtual machine, so there's no need to alter your main system, although some of the tests do require you to complete an installation and check the installed system. Please drop by and help make sure as many languages and keyboard layouts as possible will be correctly supported in Fedora 14!

If you would like to propose a main track Test Day for the Fedora 14 cycle, please contact the QA team via email or IRC, or file a ticket in QA Trac[7].

Proven testers

During the QA weekly meeting of 2010-08-30[1], James Laska asked what to do about an email from a proven tester asking to become a group sponsor so he could sponsor new proven testers members. Adam Williamson pointed out the proven tester wiki page already has a procedure for this[2], albeit a fairly casual one. He recommended simply accepting the request for now, and suggested that if anyone wanted to make the process more systematic, they should send a proposal to the mailing list. James also asked about the progress of proven tester metrics, and Adam pointed out that a ticket requesting support from the Bodhi team already existed[3], and promised to follow up on the ticket for the next meeting.

Outdated Firefox package in Fedora 14

David Boles pointed out[1] that the Firefox package in Fedora 14 was somewhat old. Adam Williamson contacted the maintainers and passed on their explanation[2] that they had forgotten that Fedora 14 updates now had to be submitted through Bodhi, and that they would soon submit a newer Firefox package.

Bugzilla voting disabled

Kamil Paral wondered why he had recieved a mail about votes being removed[1]. Kevin Fenzi explained that this was due to the Bugzilla voting feature being disabled[2]. FESCo had decided the system was so flawed it provided no useful data, and so should be disabled. They had not known Bugzilla would send out notification emails about this. He explained that FESCo was now looking at using CC lists or comment quantities to provide an indication of 'popular' bugs, but that this too was proving problematic, and pointed out a ticket where this was being tracked[3].