From Fedora Project Wiki

< FWN‎ | Beats

(create fwn 265 qa beat)
(create fwn 266 qa beat)
Line 14: Line 14:
The week of 2011-02-21 saw the traditional Graphics Test Week. [[User:Adamwill|Adam Williamson]] posted a full recap of the event to the mailing list<ref>http://lists.fedoraproject.org/pipermail/test-announce/2011-March/000200.html</ref>. He noted that participation was up again compared to the Fedora 14 events and that some important testing had been carried out, but also noted a worrying trend in status of bugs from previous events, with many bugs reported during the Fedora 13 and 14 events remaining unfixed. He promised to investigate the causes of this.
The week of 2011-02-21 saw the traditional Graphics Test Week. [[User:Adamwill|Adam Williamson]] posted a full recap of the event to the mailing list<ref>http://lists.fedoraproject.org/pipermail/test-announce/2011-March/000200.html</ref>. He noted that participation was up again compared to the Fedora 14 events and that some important testing had been carried out, but also noted a worrying trend in status of bugs from previous events, with many bugs reported during the Fedora 13 and 14 events remaining unfixed. He promised to investigate the causes of this.


This week (and next Tuesday!) is internationalization and localization Test Week, and [[User:Adamwill|Adam Williamson]] put up a blog post<ref>http://www.happyassassin.net/2011/02/28/internationalization-and-localization-test-week-this-week/</ref> explaining the three Test Days this includes: the Anaconda i18n and l10n Test Day on 2011-03-01<ref>http://fedoraproject.org/wiki/Test_Day:2011-03-01_L10n_i18n_Installation</ref>, the desktop i18n Test Day on 2011-03-03<ref>http://fedoraproject.org/wiki/Test_Day:2011-03-03_I18n_Desktop</ref> and the desktop l10n Test Day on 2011-03-08<ref>http://fedoraproject.org/wiki/Test_Day:2011-03-08_L10n_Desktop</ref>. All these events are very important to ensure that non-US-English-speaking users of Fedora get a great experience with Fedora 15.
Last week and this Tuesday saw three Test Days under the internationalization and localization Test Week banner: the Anaconda i18n and l10n Test Day on 2011-03-01<ref>http://fedoraproject.org/wiki/Test_Day:2011-03-01_L10n_i18n_Installation</ref>, the desktop i18n Test Day on 2011-03-03<ref>http://fedoraproject.org/wiki/Test_Day:2011-03-03_I18n_Desktop</ref> and the desktop l10n Test Day on 2011-03-08<ref>http://fedoraproject.org/wiki/Test_Day:2011-03-08_L10n_Desktop</ref>. These events were expertly organized and run by [[User:Igor|Igor Pires Soares]], [[User:Rhe|Rui He]] and [[User:Aalam|Aman Alam]], and were great successes with good turnouts and a lot of useful testing. Igor posted a recap<ref>http://lists.fedoraproject.org/pipermail/test/2011-March/097613.html</ref> to the list, thanking all those who came to test.


Thursday 2011-03-10 will be the second of three planned GNOME 3 Test Days<ref>http://fedoraproject.org/wiki/Test_Day:2011-03-10_GNOME3_Beta</ref>, where we'll continue to work with the GNOME team to test GNOME 3.0 and its integration with Fedora 15 as rigorously as we can before the final release of both. We'll be repeating the tests from the previous event to see how things have progressed, and also running some new tests which have been added for this event. As before, this is a very important event for both Fedora and GNOME and affects most Fedora users, so if you have a few minutes to spare, please come along and help testing. Once again, live images will be available to make it easier to test, and we'll have a new process in place for reporting crasher bugs without the trouble of trying to install debuginfo packages on a live image!
Thursday 2011-03-10 is the second of three planned GNOME 3 Test Days<ref>http://fedoraproject.org/wiki/Test_Day:2011-03-10_GNOME3_Beta</ref>, where we are continuing to work with the GNOME team to test GNOME 3.0 and its integration with Fedora 15 as rigorously as we can before the final release of both.


<references/>
Next Thursday, 2011-03-17, will be preupgrade Test Day<ref>http://fedoraproject.org/wiki/Test_Day:2011-03-17_Preupgrade</ref>, where we will be testing this important mechanism for upgrading to Fedora 15. Upgrading is always one of the thorniest areas of a Fedora release, so if it's important to you and you can come along and help test, please do - the more testing we can get early on, the better the final result will be.
 
=== Fedora 15 Alpha preparation ===
 
The QA team has been busy over the last two weeks validating the Fedora 15 Alpha release, with TC2<ref>http://lists.fedoraproject.org/pipermail/test-announce/2011-February/000186.html</ref>, RC1<ref>http://lists.fedoraproject.org/pipermail/test-announce/2011-February/000190.html</ref>, and RC2<ref>http://lists.fedoraproject.org/pipermail/test-announce/2011-February/000194.html</ref> candidate builds being posted and tested. As always, the whole team chipped in with the all-important testing. In the end the RC1 image was not accepted and the release delayed for a week<ref>http://lists.fedoraproject.org/pipermail/devel-announce/2011-February/000759.html</ref> due to a significant bug with many non-English keyboard layouts which was exposed during the testing. With this bug fixed, the RC2 image was accepted as gold at the go/no-go meeting of 2011-03-02<ref>http://meetbot.fedoraproject.org/fedora-meeting/2011-03-02/fedora_15_alpha_gono-go_meeting.2011-03-02-22.00.html</ref>.
 
=== Bodhi improvements ===
 
At the weekly meeting of 2011-02-28<ref>http://fedoraproject.org/wiki/QA/Meetings/20110228</ref>, [[User:Lmacken|Luke Macken]] announced that package-specific test case integration into Bodhi is now live, meaning that packages which have test cases associated with them according to the package test plan SOP<ref>http://fedoraproject.org/wiki/QA:SOP_package_test_plan_creation</ref> will now have the test cases displayed in Bodhi when an update for the package is under review. Also going live in the new Bodhi release are the improvements to the automated messages Bodhi sends to Bugzilla when an update's status changes, improvements discussed in previous issues of this newsletter.
 
<references/>
 
=== FreeIPA Test Day problems and proposals ===
 
Dmitri Pal posted a comment to the FreeIPA Test Day trac ticket<ref>http://fedorahosted.org/fedora-qa/ticket/163#comment:10</ref> noting that he was unhappy with the way the event had turned out. [[User:Adamwill|Adam Williamson]], [[User:Jlaska|James Laska]] and [[User:Johannbg|Jóhann Guðmundsson]] joined in with suggestions to try and learn from this experience. Dmitri is considering re-running the event with some tweaks.
 
<references/>
 
=== Complications for DeltaISO users ===
 
Andre Robatino provided some detailed information<ref>http://lists.fedoraproject.org/pipermail/test/2011-February/097009.html</ref> on what a change to the xz compression scheme would mean for users of DeltaISOs. In a nutshell, users trying to use Fedora 14 -> Fedora 15 DeltaISOs will need to use a workaround, detailed in the post, if applying the ISO on a Fedora 14 system. Andre followed up later with a refinement of the workaround<ref>http://lists.fedoraproject.org/pipermail/test/2011-February/097284.html</ref>.


<references/>
<references/>


=== IPv6 testing ===
=== Official Fedora hosting of DeltaISO images ===


A.J. Werkman provided a recap of some very solid testing he had performed on Fedora's out-of-the-box IPv6 capabilities<ref>http://lists.fedoraproject.org/pipermail/test/2011-February/097153.html</ref>. He identified some significant problems and reported them as bugs, including anaconda refusing to work without an IPv4 DHCP lease, and Fedora's Bugzilla not being available in the IPv6 domain.
Andre Robatino has been building and hosting DeltaISO images for Fedora releases and pre-releases for some time now, assisting users with limited bandwidth to install and test Fedora. At the weekly meeting of 2011-03-07<ref>http://fedoraproject.org/wiki/QA/Meetings/20110307</ref>, it was announced that thanks to help from the Infrastructure team, from now on these images will be hosted within the Fedora project, making them much easier to access. They can now be found on the serverbeach1 site<ref>http://serverbeach1.fedoraproject.org/pub/alt/stage/deltaisos/</ref>.


<references/>
<references/>


=== Using abrt during Test Days ===
=== Installation test updates ===


A thread<ref>http://lists.fedoraproject.org/pipermail/test/2011-February/097271.html</ref> started by [[User:Mcloaked|Mike Cloaked]] highlighted the issue of abrt being difficult or impossible to use successfully from live images (such as during Test Days), in large part due to the size of debuginfo packages. [[User:Adamwill|Adam Williamson]] pointed out<ref>http://lists.fedoraproject.org/pipermail/test/2011-February/097289.html</ref> that the abrt team's retrace server project<ref>http://fedoraproject.org/wiki/Features/RetraceServer</ref> would be a perfect solution for this, but noted that he had not yet tested using it. When he did, it seemed not yet to be ready for Fedora 15<ref>http://lists.fedoraproject.org/pipermail/test/2011-February/097299.html</ref>. [[User:Jmoskovc|Jiri Moskovc]] said that the Fedora 15 support would soon be available<ref>http://lists.fedoraproject.org/pipermail/test/2011-February/097314.html</ref>.
[[User:Kparal|Kamil Paral]] and [[User:Rhe|Rui He]] were engaged in reviewing the installation test matrix and test cases and suggesting fixes and improvements: clarifying when results have been transferred from previous test runs<ref>http://fedorahosted.org/fedora-qa/ticket/175</ref>, updating a test case for the systemd switch<ref>http://fedorahosted.org/fedora-qa/ticket/176</ref> and obsoleting some tests<ref>http://fedorahosted.org/fedora-qa/ticket/173</ref>.


<references/>
<references/>

Revision as of 21:40, 10 March 2011

QualityAssurance

In this section, we cover the activities of the QA team[1]. For more information on the work of the QA team and how you can get involved, see the Joining page[2].

Contributing Writer: Adam Williamson

  1. ↑ http://fedoraproject.org/wiki/QA
  2. ↑ http://fedoraproject.org/wiki/QA/Join

Test Days

Thursday 2011-02-17 was Xfce 4.8[1] Test Day[2]. The event was well organized by the Xfce team, and a dedicated group of testers was able to expose some important bugs to be fixed.

The week of 2011-02-21 saw the traditional Graphics Test Week. Adam Williamson posted a full recap of the event to the mailing list[3]. He noted that participation was up again compared to the Fedora 14 events and that some important testing had been carried out, but also noted a worrying trend in status of bugs from previous events, with many bugs reported during the Fedora 13 and 14 events remaining unfixed. He promised to investigate the causes of this.

Last week and this Tuesday saw three Test Days under the internationalization and localization Test Week banner: the Anaconda i18n and l10n Test Day on 2011-03-01[4], the desktop i18n Test Day on 2011-03-03[5] and the desktop l10n Test Day on 2011-03-08[6]. These events were expertly organized and run by Igor Pires Soares, Rui He and Aman Alam, and were great successes with good turnouts and a lot of useful testing. Igor posted a recap[7] to the list, thanking all those who came to test.

Thursday 2011-03-10 is the second of three planned GNOME 3 Test Days[8], where we are continuing to work with the GNOME team to test GNOME 3.0 and its integration with Fedora 15 as rigorously as we can before the final release of both.

Next Thursday, 2011-03-17, will be preupgrade Test Day[9], where we will be testing this important mechanism for upgrading to Fedora 15. Upgrading is always one of the thorniest areas of a Fedora release, so if it's important to you and you can come along and help test, please do - the more testing we can get early on, the better the final result will be.

  1. ↑ http://fedoraproject.org/wiki/Features/Xfce48
  2. ↑ http://fedoraproject.org/wiki/Test_Day:2011-02-17_Xfce
  3. ↑ http://lists.fedoraproject.org/pipermail/test-announce/2011-March/000200.html
  4. ↑ http://fedoraproject.org/wiki/Test_Day:2011-03-01_L10n_i18n_Installation
  5. ↑ http://fedoraproject.org/wiki/Test_Day:2011-03-03_I18n_Desktop
  6. ↑ http://fedoraproject.org/wiki/Test_Day:2011-03-08_L10n_Desktop
  7. ↑ http://lists.fedoraproject.org/pipermail/test/2011-March/097613.html
  8. ↑ http://fedoraproject.org/wiki/Test_Day:2011-03-10_GNOME3_Beta
  9. ↑ http://fedoraproject.org/wiki/Test_Day:2011-03-17_Preupgrade

Official Fedora hosting of DeltaISO images

Andre Robatino has been building and hosting DeltaISO images for Fedora releases and pre-releases for some time now, assisting users with limited bandwidth to install and test Fedora. At the weekly meeting of 2011-03-07[1], it was announced that thanks to help from the Infrastructure team, from now on these images will be hosted within the Fedora project, making them much easier to access. They can now be found on the serverbeach1 site[2].

  1. ↑ http://fedoraproject.org/wiki/QA/Meetings/20110307
  2. ↑ http://serverbeach1.fedoraproject.org/pub/alt/stage/deltaisos/

Installation test updates

Kamil Paral and Rui He were engaged in reviewing the installation test matrix and test cases and suggesting fixes and improvements: clarifying when results have been transferred from previous test runs[1], updating a test case for the systemd switch[2] and obsoleting some tests[3].

  1. ↑ http://fedorahosted.org/fedora-qa/ticket/175
  2. ↑ http://fedorahosted.org/fedora-qa/ticket/176
  3. ↑ http://fedorahosted.org/fedora-qa/ticket/173
Retrieved from "https://fedoraproject.org/w/index.php?title=FWN/Beats/QualityAssurance&oldid=226233"