From Fedora Project Wiki

(update openQA links and correct name, drop AutoQA text)
(link to relval and wikitcms separately, add testdays link and info)
Line 24: Line 24:
== Release validation testing ==
== Release validation testing ==


; [https://www.happyassassin.net/wikitcms/ python-wikitcms and relval]: A Python library and CLI based upon it for performing various [[QA:Release_validation_test_plan|release validation testing]] tasks in the [[Wikitcms]] 'test management system' (the set of wiki pages in which release validation test results are stored).
; [https://www.happyassassin.net/wikitcms/ python-wikitcms], [https://www.happyassassin.net/relval/ relval] and [https://www.happyassassin.net/testdays/ testdays]: A Python library and CLI based upon it for performing various [[QA:Release_validation_test_plan|release validation testing]] tasks in the [[Wikitcms]] 'test management system' (the set of wiki pages in which release validation test results are stored). testdays can perform a few basic operations on [[Test_Days|Test Day]] pages.


== Test case reporting ==
== Test case reporting ==

Revision as of 09:16, 6 February 2016

The QA team develops tools to make testing easier and more repeatable. Developing open source quality assurance tools is complex and challenging stuff at the cutting edge of the field. Contact Tim Flink if you're up to the challenge of building new tools for Fedora QA.

QA tools

Test Automation

Taskotron
Taskotron is our current in-development framework for automatically executing a number of Fedora related tests. Both Fedora infrastructure generic and Fedora packages specific tests should be supported. Package maintainers should have an easy way of providing tests for their packages. This framework is intended to obsolete AutoQA.
ResultsDB
A generic storage of (automated) test results. Designed to be lightweight, simple, scalable and fast. It's used by our automation frameworks (AutoQA and Taskotron).
ExecDB
This database with a front-end allows us to track tasks which are scheduled, running and finished in Taskotron. It provides a simple way to navigate people (mostly admin and developer-type folks) into different corners of the Taskotron infrastructure - BuildBot job details, ResultsDB results, logs and artifacts directories. Read some design concepts.
openQA
We use this tool (developed by our friends at SUSE, now with contributions from us too) to automate certain release test cases, especially installation with Anaconda. We develop Fedora tests for openQA, along with some helper tools.
Beaker
Beaker is an up and coming fully automated test framework that provides bare metal hardware provisioning including console and power management, and job scheduling and execution. Learn more at Beaker homepage.

Installation

SNAKE
Smart Network Automated Kickstart Environment. A small tool to assist with installing and pykickstart-based library for modeling sustainable kickstarts.

Release validation testing

python-wikitcms, relval and testdays
A Python library and CLI based upon it for performing various release validation testing tasks in the Wikitcms 'test management system' (the set of wiki pages in which release validation test results are stored). testdays can perform a few basic operations on Test Day pages.

Test case reporting

Test Days Frontend
A web application for providing results from Test Days events. It uses ResultsDB (legacy) as a backend.

Bug reporting

Blocker Bugs App
A web application to display current blocker bugs during our pre-release cycle.
python-bugzilla
Command-line interaction with Bugzilla. Supports searching, creating and modifying bugs.

Test update feedback

Fedora Gooey Karma
A graphical tool that makes it easy to report feedback for any updates-testing packages currently installed.
Fedora Easy Karma
A command line tool that makes it easy to report feedback for any updates-testing packages currently installed.

Mixed bag

Fedora QA scripts
A git repository containing various small scripts.


Infrastructure tools

These tools we use as our support infrastructure during QA tools development.

Bitbucket team repository
A list of repositories that are related to our tools and needs.
Phabricator
Our main issue and code review tracker for most of our projects.