Tcms Comparison: Difference between revisions

Latest revision as of 06:25, 15 March 2011

This page is a draft only
It is still under construction and content may change. Do not rely on the information on this page.

This page objectively compares feature sets of Wiki and Nitrate systems in relation to the important workflows. Instead of displaying a long feature lists, it is divided into groups by use cases. To avoid overlaps, features compared in former use cases are not listed in later cases again.

Key Section

Icon	Explanation
pass	Supported
fail	Unsupported currently
File:Artwork EchoDevelopment dialog-question16.png unknown	Unknown/Research needed
warn	Partly supported
P1	Must-Have missing Feature in Nitrate
P2	Nice-To-Have missing Feature in Nitrate

Wiki vs Nitrate Feature Comparison

Creating A Generic Page

Priority	Feature	fedoraproject.org/wiki	nitrate
	Any page creation	pass	fail Can only create test case/plan/run
P2	Readable link names	pass human-readable link names	fail use ID for identification
	Data entry format	pass mediawiki markup	pass tinyMCE
	Moving a Page	pass by redirect links	pass by cloning or changing the summary(name) of case/plan/run
	Templates creation/use	pass such as Special:MostLinkedTemplates	fail
	Editing preview	pass	warn 'save and continue editing'
	Supports data entry using a form	fail wiki syntax	pass
P2	Discussion page	pass Talk page	fail Can only add comments in test cases
P1	History rollback(Undo changes)	pass	fail
P1	History comparison	pass	fail
	History logs	pass	pass Only offer change logs and text version history of plan and case
	Subpage using	pass	File:Artwork EchoDevelopment dialog-question16.png unknown by Tree View?
	Bookmarks/watchlist	pass watch the page	pass bookmark the page

Creating A Test Case

Priority	Feature	fedoraproject.org/wiki	nitrate
	Renaming a case	warn move to another page	pass change the summary
	Test case format template	pass Template:QA/Test_Case	pass Defined
	Linking files/packages/images	pass Upload somewhere and link to it	pass Test cases/plans support attachments or link to wiki
	Case draft status	warn manually add draft category/note	pass Set as PROPOSED or NEED_UPDATE
	Case review status	fail approved in ticket or somewhere else	pass Set as CONFIRMED
	Categorizing cases	pass manually add to category	pass add category or use tag or add to plan to group cases
P2	Categories creation	pass user can create it with certain permission	fail cases categories can only be added by Admin
P1	Description part in test case	pass	warn write in 'Notes' part, where syntax editing is needed.
	Tests that impact multiple packages	warn Categories could be used to organize this data, but get messy	pass allows linking tests to the packages they are designed to test
	Test case re-use (write once, link anywhere)	pass search from Category and link to it	pass test runs re-use cases from a plan, plans clone them from other plans
P2	The time historical test case results be available	pass all history?	File:Artwork EchoDevelopment dialog-question16.png unknown unknown
P2	Re-use old versioned test case	pass by linking to its history	fail can view text history and version only

Creating A Test Plan

Priority	Feature	fedoraproject.org/wiki	nitrate
	Test Plan re-use/update	pass copy contents from previous	pass clone previous plans
	Linking test cases	pass link to cases section on test result template page	pass clone from other plans/create new tests
P2	Plan draft status	warn manually add draft category/note	fail Set as non-active?
P2	Plan review status	warn manually add reviewer and review time	fail Set as active?
	Categorizing plans	pass manually add to category	pass no category for plan but have Plan Type and Tag etc.

Creating A Test Result Page(Test Run) Template

Priority	Feature	fedoraproject.org/wiki	nitrate
	Result Page(Test Run) Template	pass	fail doesn't support template creation. Test run(result page) can be cloned from previous run with modifications.
	Sortable table	pass	pass using sort
	Collapse table	warn hard to manage as a whole	pass
P1	Group cases (by media)	pass flexible wiki design	fail diff test runs;sorting;diff tags

Creating A Test Result Page(Test Run)

Priority	Feature	fedoraproject.org/wiki	nitrate
	Test result page(Test run) creation	pass	warn Create from plans
P1	documents in test result page	pass flexible wiki markup design	warn write in 'Notes' field without any syntax
P1	Moving test results	pass manually copy	fail manually add one by one?
P2	Directing to current test run	pass redirect links to current result page	fail set test run as running or finished
	Categorizing runs/result pages	pass manually add to category	pass Can set 'product', 'version' and 'tag' etc

Posting Test Results

Priority	Feature	fedoraproject.org/wiki	nitrate
P2	Quick access to active test runs	pass Open 'current' links	fail search the run's ID or search my runs(assigned to me in advance)
P1	Result format	pass use Template:Result	warn Idle, Passed, Failed, Running, Paused, Blocked, Error
	Comment as references	pass	pass
	Bug posting	pass use Template:Bz	pass
P1	Multiple contributions for each case	pass	fail only display the last modified one and logs
	*Signatures using	pass ~~~~ -> Rhe 09:59, 18 January 2011 (UTC)	fail

Searching Test Results/Cases/Plans

Priority	Feature	fedoraproject.org/wiki	nitrate
	Searching cases/plans/runs	fail only by searching from categories or name	pass advanced search
	Toolbox(what links to here)	pass	pass plans, cases, and runs related to each other

Uploading Files

Priority	Feature	fedoraproject.org/wiki	nitrate
P2	Upload files/packages/images	pass upload somewhere and link to it	warn test cases/plans support attachments, test runs don't
P2	Upload updates.img/repo to certain server	pass fedorapeople server	fail link to wiki.

Generating A Test Summary

Priority	Feature	fedoraproject.org/wiki	nitrate
	Result summary/report generation	fail run curl command	pass automaticly

Administrating

Priority	Feature	fedoraproject.org/wiki	nitrate
P1	Authorities for pages	pass Use namespaces	File:Artwork EchoDevelopment dialog-question16.png unknown Can admin configure it?
	Supporting anonymous user read-only access	pass	pass
P1	Supporting anonymous user read-write access	pass	fail
	Feature extension	pass	pass
P1	Page protection	pass by Admin	File:Artwork EchoDevelopment dialog-question16.png unknown
	Case/plan/run deletion	pass by Admin	pass Set as DISABLED. Test run can be deleted.
	Licensing	pass	pass
P1	License the content	pass	File:Artwork EchoDevelopment dialog-question16.png unknown should match wiki
	Integration with FAS	pass	File:Artwork EchoDevelopment dialog-question16.png unknown
P2	Integration between update tools (bodhi/f-e-k) and our test infrastructure.	pass investigating	File:Artwork EchoDevelopment dialog-question16.png unknown
P1	Upstream project community	pass upstream wiki list	warn upstream nitrate list

Test Days

Priority	Feature	fedoraproject.org/wiki	nitrate
	Test day main/intro page	pass	warn link to wiki
	Test day SOP guide page	pass	warn link to wiki
	Test day/event result template page	pass	fail Clone from previous test run
	Test day schedule	pass	warn link to wiki
P1	Test day page(run) creation	pass	fail test runs can only be created from plans
P1	Test day page documented contents	pass	fail write all intro to 'Notes' field will be too crowded!
P2	Test day notification	fail send out announcement manually	warn can assign through mail, but mail content is little.

Release Validation Test Event

Priority	Feature	fedoraproject.org/wiki	nitrate
	Test event Main/intro page	pass	warn link to wiki
	Test event SOP guide page	pass	warn link to wiki
	Test event Result template page	pass	fail Clone from previous test run.
	Release Criteria page	pass	warn link to wiki
P1	Test cases priority	fail manually add priority before each case link	warn from P1 to P5, need change to: Alpha, Beta, Final.
P1	Each case with different platforms	pass	fail two test runs for both platforms or clone each case for another platform
	Test result page(Test run) creation	pass	pass created from plans
P1	Test result page documented contents	pass	warn write intro to 'Notes' field without any syntax
P2	Test event notification	fail send out announcement manually	warn can assign through mail, but the content is little.
	Progress bar for each run	fail	pass

@@ Line 1: / Line 1: @@
-This page objectively compares feature sets of Wiki and Nitrate systems in relation to the [[Rhe/tcms_use_cases|important workflows]]. Instead of displaying a long feature lists, it is divided into groups by use cases. Click ''[show]'' button on each item to view the detailed comparison. To avoid overlaps, features compared in former use cases are not listed in later cases again.
+{{draft}}
-{| class="wikitable collapsible collapsed"  border="1" width="100%"
+This page objectively compares feature sets of Wiki and Nitrate systems in relation to the [[Tcms_use_cases|important workflows]]. Instead of displaying a long feature lists, it is divided into groups by use cases. To avoid overlaps, features compared in former use cases are not listed in later cases again.
+== Key Section ==
+{| class="wikitable sortable" border="0"
+! Icon !! Explanation
+|-
+| style="background-color:lightgreen;"|{{result|pass}}
+| Supported
+|-
+| style="background-color:tomato;"|{{result|fail}}
+| Unsupported currently
+|-
+| style="background-color:yellow;"|{{result|unknown}}
+| Unknown/Research needed
+|-
+| style="background-color:lightgreen;"|{{result|warn}}
+| Partly supported
+|-
+| P1
+| Must-Have missing Feature in Nitrate
+|-
+| P2
+| Nice-To-Have missing Feature in Nitrate
+|-
+|}
+== Wiki vs Nitrate Feature Comparison==
+{| class="wikitable collapsible"  border="1" width="90%"
 |-
-! colspan=3 style="background-color: lightblue;"|Creating A Common Page
+! colspan=4 style="background-color: darkgrey;"|Creating A Generic Page
 |-
-! width="20%"|Feature !! width="40%"|fedoraproject.org/wiki !! width="40%"|nitrate
+|
+{| class="wikitable sortable" width=100% style="border: solid 2px white"
+|-
+! width="10%"|Priority !! width="20%"|Feature !! width="35%"|fedoraproject.org/wiki !! width="35%"|nitrate
 |-
+|
 | Any page creation
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}}
-|style="background-color:tomato;"| {{result|fail}} Can only create test case/plan/run
+| style="background-color:tomato;"| {{result|fail}} Can only create test case/plan/run
 |-
+| P2
 | Readable link names
-|style="background-color:lightgreen;"| {{result|pass}} human-readable link names
+| style="background-color:lightgreen;"| {{result|pass}} human-readable link names
-|style="background-color:tomato;"| {{result|fail}} use ID for identification
+| style="background-color:tomato;"| {{result|fail}} use ID for identification
 |-
+|
 | Data entry format
-|style="background-color:lightgreen;"| [http://www.mediawiki.org/wiki/Help:Formatting mediawiki markup]
+| style="background-color:lightgreen;"| {{result|pass}}[http://www.mediawiki.org/wiki/Help:Formatting mediawiki markup]
-|style="background-color:lightgreen;"| [http://tinymce.moxiecode.com/ tinyMCE]
+| style="background-color:lightgreen;"| {{result|pass}}[http://tinymce.moxiecode.com/ tinyMCE]
 |-
+|
 | Moving a Page
-|style="background-color:lightgreen;"| {{result|pass}} by redirect links
+| style="background-color:lightgreen;"| {{result|pass}} by redirect links
-|style="background-color:lightgreen;"| {{result|pass}} by cloning or changing the summary(name) of case/plan/run
+| style="background-color:lightgreen;"| {{result|pass}} by cloning or changing the summary(name) of case/plan/run
 |-
+|
 | Templates creation/use
-|style="background-color:lightgreen;"| {{result|pass}} such as [[Special:MostLinkedTemplates]]
+| style="background-color:lightgreen;"| {{result|pass}} such as [[Special:MostLinkedTemplates]]
-|style="background-color:tomato;"| {{result|fail}}
+| style="background-color:tomato;"| {{result|fail}}
-|-
-| Editting preview
-|style="background-color:lightgreen;"| {{result|pass}}
-|style="background-color:tomato;"| {{result|fail}}
 |-
-| Submitting format
+|
-|style="background-color:tomato;"| {{result|fail}} wiki syntax
+| Editing preview
-|style="background-color:lightgreen;"| {{result|pass}} form format
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|warn}} 'save and continue editing'
 |-
-| Talk page
+|
-|style="background-color:lightgreen;"| {{result|pass}}
+| Supports data entry using a form
-|style="background-color:tomato;"| {{result|warn}} Can only add comments in test cases
+| style="background-color:tomato;"| {{result|fail}} wiki syntax
+| style="background-color:lightgreen;"| {{result|pass}}
 |-
-| History rollback
+| P2
-|style="background-color:lightgreen;"| {{result|pass}}
+| Discussion page
-|style="background-color:tomato;"| {{result|fail}} Only offer change logs
+| style="background-color:lightgreen;"| {{result|pass}} Talk page
+| style="background-color:tomato;"| {{result|fail}} Can only add comments in test cases
 |-
-| Changes comparison
+| P1
-|style="background-color:lightgreen;"| {{result|pass}}
+| History rollback(Undo changes)
-|style="background-color:tomato;"| {{result|warn}} Only offer change logs
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:tomato;"| {{result|fail}}
 |-
-| Categories creation
+| P1
-|style="background-color:lightgreen;"| {{result|pass}} manually add new category
+| History comparison
-|style="background-color:tomato;"| {{result|warn}} cases categories can be added by Admin
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:tomato;"| {{result|fail}}
 |-
-| Adding pages to categories
+|
-|style="background-color:lightgreen;"| {{result|pass}} manually add category
+| History logs
-|style="background-color:tomato;"| {{result|warn}} Only cases have categories
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}} Only offer change logs and text version history of plan and case
 |-
+|
 | Subpage using
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}}
-|style="background-color:white;"| {{result|unknown}} by Tree View?
+| style="background-color:yellow;"| {{result|unknown}} by Tree View?
 |-
+|
 | Bookmarks/watchlist
-|style="background-color:lightgreen;"| {{result|pass}} watch the page
+| style="background-color:lightgreen;"| {{result|pass}} watch the page
-|style="background-color:lightgreen;"| {{result|pass}} bookmark the page
+| style="background-color:lightgreen;"| {{result|pass}} bookmark the page
 |-
 |}
-{| class="wikitable collapsible collapsed"  border="1" width="100%"
+|}
+{| class="wikitable collapsible collapsed"  border="1" width="90%"
 |-
-! colspan=3 style="background-color: yellow;"|Creating A Test Case
+! colspan=4 style="background-color: darkgrey;"|Creating A Test Case
 |-
-! width="20%"|Feature !! width="40%"|fedoraproject.org/wiki !! width="40%"|nitrate
+|
+{| class="wikitable sortable" width=100% style="border: solid 2px white"
+|-
+! width="10%"|Priority !! width="20%"|Feature !! width="35%"|fedoraproject.org/wiki !! width="35%"|nitrate
 |-
+|
 | Renaming a case
-|style="background-color:tomato;"| {{result|fail}} move to another page
+| style="background-color:lightgreen;"| {{result|warn}} move to another page
-|style="background-color:lightgreen;"| {{result|pass}}change the summary
+| style="background-color:lightgreen;"| {{result|pass}} change the summary
 |-
-| Test case template
+|
-|style="background-color:lightgreen;"| {{result|pass}} [[Template:QA/Test_Case]]
+| Test case format template
-|style="background-color:lightgreen;"| {{result|pass}} Defined
+| style="background-color:lightgreen;"| {{result|pass}} [[Template:QA/Test_Case]]
+| style="background-color:lightgreen;"| {{result|pass}} Defined
 |-
+|
 | Linking files/packages/images
-|style="background-color:lightgreen;"| {{result|pass}} Upload somewhere and link to it
+| style="background-color:lightgreen;"| {{result|pass}} Upload somewhere and link to it
-|style="background-color:lightgreen;"| {{result|pass}} Test cases/plans support attachments
+| style="background-color:lightgreen;"| {{result|pass}} Test cases/plans support attachments or link to wiki
 |-
+|
 | Case draft status
-|style="background-color:tomato;"| {{result|fail}} manually add draft category/note
+| style="background-color:lightgreen;"| {{result|warn}} manually add draft category/note
-|style="background-color:lightgreen;"| {{result|pass}} Set as PROPOSED or NEED_UPDATE
+| style="background-color:lightgreen;"| {{result|pass}} Set as PROPOSED or NEED_UPDATE
 |-
+|
 | Case review status
-|style="background-color:tomato;"| {{result|fail}} approved in ticket or somewhere else
+| style="background-color:tomato;"| {{result|fail}} approved in ticket or somewhere else
-|style="background-color:lightgreen;"| {{result|pass}} Set as CONFIRMED
+| style="background-color:lightgreen;"| {{result|pass}} Set as CONFIRMED
 |-
+|
 | Categorizing cases
-|style="background-color:lightgreen;"| {{result|pass}} manually add to category
+| style="background-color:lightgreen;"| {{result|pass}} manually add to category
-|style="background-color:lightgreen;"| {{result|pass}} add category or use tag or add to plan to group cases
+| style="background-color:lightgreen;"| {{result|pass}} add category or use tag or add to plan to group cases
 |-
+| P2
+| Categories creation
+| style="background-color:lightgreen;"| {{result|pass}} user can create it with certain permission
+| style="background-color:tomato;"| {{result|fail}} cases categories can only be added by Admin
+|-
+| P1
 | Description part in test case
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}}
-|style="background-color:tomato;"| {{result|fail}} only have setup and notes parts
+| style="background-color:lightgreen;"| {{result|warn}} write in 'Notes' part, where syntax editing is needed.
 |-
+|
 | Tests that impact multiple packages
-|style="background-color:lightgreen;"| {{result|warn}} Categories could be used to organize this data, but get messy
+| style="background-color:lightgreen;"| {{result|warn}} Categories could be used to organize this data, but get messy
-|style="background-color:lightgreen;"| {{result|pass}} allows linking tests to the packages they are designed to test
+| style="background-color:lightgreen;"| {{result|pass}} allows linking tests to the packages they are designed to test
 |-
+|
 | Test case re-use (write once, link anywhere)
-|style="background-color:lightgreen;"| {{result|pass}} search from Category and link to it
+| style="background-color:lightgreen;"| {{result|pass}} search from Category and link to it
-|style="background-color:lightgreen;"| {{result|pass}} clone from other plans
+| style="background-color:lightgreen;"| {{result|pass}} test runs re-use cases from a plan, plans clone them from other plans
+|-
+| P2
+| The time historical test case results be available
+| style="background-color:lightgreen;"| {{result|pass}} all history?
+| style="background-color:yellow;"| {{result|unknown}} unknown
+|-
+| P2
+| Re-use old versioned test case
+| style="background-color:lightgreen;"| {{result|pass}} by linking to its history
+| style="background-color:tomato;"| {{result|fail}} can view text history and version only
 |-
 |}
-{| class="wikitable collapsible collapsed"  border="1" width="100%"
+|}
+{| class="wikitable collapsible collapsed"  border="1" width="90%"
+|-
+! colspan=4 style="background-color: darkgrey;"| Creating A Test Plan
 |-
-! colspan=3 style="background-color: lightblue;"|Creating A Test Plan
+|
-|-
+{| class="wikitable sortable" width=100% style="border: solid 2px white"
-! width="20%"|Feature !! width="40%"|fedoraproject.org/wiki !! width="40%"|nitrate
+|-
+! width="10%"|Priority !! width="20%"|Feature !! width="35%"|fedoraproject.org/wiki !! width="35%"|nitrate
 |-
+|
 | Test Plan re-use/update
-|style="background-color:lightgreen;"| {{result|pass}} copy contents from previous
+| style="background-color:lightgreen;"| {{result|pass}} copy contents from previous
-|style="background-color:lightgreen;"| {{result|pass}} clone previous plans
+| style="background-color:lightgreen;"| {{result|pass}} clone previous plans
 |-
+|
 | Linking test cases
-|style="background-color:lightgreen;"| {{result|pass}} linking to cases section on test result template page
+| style="background-color:lightgreen;"| {{result|pass}} link to cases section on test result template page
-|style="background-color:lightgreen;"| {{result|pass}} clone from other plans
+| style="background-color:lightgreen;"| {{result|pass}} clone from other plans/create new tests
 |-
+| P2
 | Plan draft status
-|style="background-color:tomato;"| {{result|fail}} manually add draft category/note
+| style="background-color:lightgreen;"| {{result|warn}} manually add draft category/note
-|style="background-color:tomato;"| {{result|fail}} Set as non-active?
+| style="background-color:tomato;"| {{result|fail}} Set as non-active?
 |-
+| P2
 | Plan review status
-|style="background-color:tomato;"| {{result|fail}} manually add reviewer and review time
+| style="background-color:lightgreen;"| {{result|warn}} manually add reviewer and review time
-|style="background-color:tomato;"| {{result|fail}} Set as active
+| style="background-color:tomato;"| {{result|fail}} Set as active?
 |-
+|
 | Categorizing plans
-|style="background-color:lightgreen;"| {{result|pass}} manually add to category
+| style="background-color:lightgreen;"| {{result|pass}} manually add to category
-|style="background-color:lightgreen;"| {{result|pass}} no category for plan but have Plan Type and Tag etc.
+| style="background-color:lightgreen;"| {{result|pass}} no category for plan but have Plan Type and Tag etc.
 |-
 |}
-{| class="wikitable collapsible collapsed"  border="1" width="100%"
+|}
+{| class="wikitable collapsible collapsed"  border="1" width="90%"
+|-
+! colspan=4 style="background-color: darkgrey;"| Creating A Test Result Page(Test Run) Template
 |-
-! colspan=3 style="background-color: yellow;"| Creating A Test Result Page Template
+|
-|-
+{| class="wikitable sortable" width=100% style="border: solid 2px white"
-! width="20%"|Feature !! width="40%"|fedoraproject.org/wiki !! width="40%"|nitrate
+|-
+! width="10%"|Priority !! width="20%"|Feature !! width="35%"|fedoraproject.org/wiki !! width="35%"|nitrate
 |-
-| Result Page Template
+|
-|style="background-color:lightgreen;"| {{result|pass}}
+| Result Page(Test Run) Template
-|style="background-color:tomato;"| {{result|fail}} doesn't support result page template creation. Test run(result page) can be cloned from previous run with modifications.
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:tomato;"| {{result|fail}} doesn't support template creation. Test run(result page) can be cloned from previous run with modifications.
 |-
+|
 | Sortable table
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}}
-|style="background-color:lightgreen;"| {{result|pass}} using sort
+| style="background-color:lightgreen;"| {{result|pass}} using sort
 |-
+|
 | Collapse table
-|style="background-color:lightgreen;"| {{result|warn}} hard to manage as a whole
+| style="background-color:lightgreen;"| {{result|warn}} hard to manage as a whole
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}}
 |-
+| P1
 | Group cases (by media)
-|style="background-color:lightgreen;"| {{result|pass}}flexible wiki design
+| style="background-color:lightgreen;"| {{result|pass}}flexible wiki design
-|style="background-color:tomato;"| {{result|fail}}
+| style="background-color:tomato;"| {{result|fail}} diff test runs;sorting;diff tags
 |-
 |}
-{| class="wikitable collapsible collapsed"  border="1" width="100%"
+|}
-|-
-! colspan=3 style="background-color: lightblue;"|Creating A Test Result Page
+{| class="wikitable collapsible collapsed"  border="1" width="90%"
+|-
+! colspan=4 style="background-color: darkgrey;"| Creating A Test Result Page(Test Run)
 |-
-! width="20%"|Feature !! width="40%"|fedoraproject.org/wiki !! width="40%"|nitrate
+|
+{| class="wikitable sortable" width=100% style="border: solid 2px white"
+|-
+! width="10%"|Priority !! width="20%"|Feature !! width="35%"|fedoraproject.org/wiki !! width="35%"|nitrate
 |-
-| Test result page creation
+|
-|style="background-color:lightgreen;"| {{result|pass}}
+| Test result page(Test run) creation
-|style="background-color:lightgreen;"| {{result|warn}} Create from plans
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|warn}} Create from plans
 |-
-| Contents in test result page
+| P1
-|style="background-color:lightgreen;"| {{result|pass}} flexible wiki markup design
+| documents in test result page
-|style="background-color:tomato;"| {{result|warn}} write in 'Notes' field without any syntax except cases
+| style="background-color:lightgreen;"| {{result|pass}} flexible wiki markup design
+| style="background-color:lightgreen;"| {{result|warn}} write in 'Notes' field without any syntax
 |-
+| P1
 | Moving test results
-|style="background-color:lightgreen;"| {{result|pass}} manually copy
+| style="background-color:lightgreen;"| {{result|pass}} manually copy
-|style="background-color:tomato;"| {{result|fail}} manually add one by one?
+| style="background-color:tomato;"| {{result|fail}} manually add one by one?
 |-
-| Redirecting links
+| P2
-|style="background-color:lightgreen;"| {{result|pass}} redirect links to current result page
+| Directing to current test run
-|style="background-color:tomato;"| {{result|fail}} set test run as running or finished
+| style="background-color:lightgreen;"| {{result|pass}} redirect links to current result page
+| style="background-color:tomato;"| {{result|fail}} set test run as running or finished
 |-
+|
 | Categorizing runs/result pages
-|style="background-color:lightgreen;"| {{result|pass}} manually add to category
+| style="background-color:lightgreen;"| {{result|pass}} manually add to category
-|style="background-color:lightgreen;"| {{result|pass}} Can set 'product', 'version' and 'tag' etc
+| style="background-color:lightgreen;"| {{result|pass}} Can set 'product', 'version' and 'tag' etc
 |-
 |}
-{| class="wikitable collapsible collapsed"  border="1" width="100%"
+|}
+{| class="wikitable collapsible collapsed"  border="1" width="90%"
+|-
+! colspan=4 style="background-color: darkgrey;"| Posting Test Results
 |-
-!colspan=3 style="background-color: yellow;"|Posting Test Results
+|
-|-
+{| class="wikitable sortable" width=100% style="border: solid 2px white"
-! width="20%"|Feature !! width="40%"|fedoraproject.org/wiki !! width="40%"|nitrate
+|-
-|-
+! width="10%"|Priority !! width="20%"|Feature !! width="35%"|fedoraproject.org/wiki !! width="35%"|nitrate
-| Opening 'current' links
-|style="background-color:lightgreen;"| {{result|pass}} Open current links
-|style="background-color:tomato;"| {{result|fail}} search my runs(how?) or the run's ID
 |-
+| P2
+| Quick access to active test runs
+| style="background-color:lightgreen;"| {{result|pass}} Open 'current' links
+| style="background-color:tomato;"| {{result|fail}} search the run's ID or search my runs(assigned to me in advance)
+|-
+| P1
 | Result format
-|style="background-color:lightgreen;"| {{result|pass}} use [[Template:Result]]
+| style="background-color:lightgreen;"| {{result|pass}} use [[Template:Result]]
-|style="background-color:lightgreen;"| {{result|pass}} defined
+| style="background-color:lightgreen;"| {{result|warn}} Idle, Passed, Failed, Running, Paused, Blocked, Error
 |-
+|
 | Comment as references
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}}
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}}
 |-
+|
 | Bug posting
-|style="background-color:lightgreen;"| {{result|pass}} use [[Template:Bz]]
+| style="background-color:lightgreen;"| {{result|pass}} use [[Template:Bz]]
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}}
 |-
+| P1
 | Multiple contributions for each case
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}}
-|style="background-color:tomato;"| {{result|fail}} only display the last modified one
+| style="background-color:tomato;"| {{result|fail}} only display the last modified one and logs
 |-
+|
 | *Signatures using
-|style="background-color:lightgreen;"| {{result|pass}} <nowiki>~~~~</nowiki> -> [[User:Rhe|Rhe]] 09:59, 18 January 2011 (UTC)
+| style="background-color:lightgreen;"| {{result|pass}} <nowiki>~~~~</nowiki> -> [[User:Rhe|Rhe]] 09:59, 18 January 2011 (UTC)
-|style="background-color:tomato;"| {{result|fail}}
+| style="background-color:tomato;"| {{result|fail}}
 |-
 |}
-{| class="wikitable collapsible collapsed"  border="1" width="100%"
+|}
+{| class="wikitable collapsible collapsed"  border="1" width="90%"
+|-
+! colspan=4 style="background-color: darkgrey;"| Searching Test Results/Cases/Plans
 |-
-! colspan=3 style="background-color: lightblue;"|Searching Test Results/Cases/Plans
+|
-|-
+{| class="wikitable sortable" width=100% style="border: solid 2px white"
-! width="20%"|Feature !! width="40%"|fedoraproject.org/wiki !! width="40%"|nitrate
+|-
+! width="10%"|Priority !! width="20%"|Feature !! width="35%"|fedoraproject.org/wiki !! width="35%"|nitrate
 |-
+|
 | Searching cases/plans/runs
-|style="background-color:tomato;"| {{result|fail}} only by searching from categories or name
+| width="30%" style="background-color:tomato;"| {{result|fail}} only by searching from categories or name
-|style="background-color:lightgreen;"| {{result|pass}} advanced search
+| width="35%" style="background-color:lightgreen;"| {{result|pass}} advanced search
 |-
+|
 | Toolbox(what links to here)
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}}
-|style="background-color:lightgreen;"| {{result|pass}} plans, cases, and runs related to each other
+| style="background-color:lightgreen;"| {{result|pass}} plans, cases, and runs related to each other
 |-
 |}
-{| class="wikitable collapsible collapsed"  border="1" width="100%"
+|}
+{| class="wikitable collapsible collapsed"  border="1" width="90%"
+|-
+! colspan=4 style="background-color: darkgrey;"| Uploading Files
 |-
-! colspan=3 style="background-color: yellow;"|Uploading Files
+|
-|-
+{| class="wikitable sortable" width=100% style="border: solid 2px white"
-! width="20%"|Feature !! width="40%"|fedoraproject.org/wiki !! width="40%"|nitrate
+|-
+! width="10%"|Priority !! width="20%"|Feature !! width="35%"|fedoraproject.org/wiki !! width="35%"|nitrate
 |-
+| P2
 | Upload files/packages/images
-|style="background-color:lightgreen;"| {{result|pass}} upload somewhere and link to it
+| style="background-color:lightgreen;"| {{result|pass}} upload somewhere and link to it
-|style="background-color:lightgreen;"| {{result|warn}} test cases/plans support attachments(test run doesn't)
+| style="background-color:lightgreen;"| {{result|warn}} test cases/plans support attachments, test runs don't
 |-
+| P2
 | Upload updates.img/repo to certain server
-|style="background-color:lightgreen;"| {{result|pass}} fedorapeople server
+| style="background-color:lightgreen;"| {{result|pass}} fedorapeople server
-|style="background-color:tomato;"| {{result|fail}} link to wiki.
+| style="background-color:tomato;"| {{result|fail}} link to wiki.
 |-
 |}
-{| class="wikitable collapsible collapsed"  border="1" width="100%"
+|}
-|-
-! colspan=3 style="background-color: lightblue;"|Generating A Test Summary
+{| class="wikitable collapsible collapsed"  border="1" width="90%"
+|-
+! colspan=4 style="background-color: darkgrey;"| Generating A Test Summary
 |-
-! width="20%"|Feature !! width="40%"|fedoraproject.org/wiki !! width="40%"|nitrate
+|
+{| class="wikitable sortable" width=100% style="border: solid 2px white"
+|-
+! width="10%"|Priority !! width="20%"|Feature !! width="35%"|fedoraproject.org/wiki !! width="35%"|nitrate
 |-
+|
 | Result summary/report generation
-|style="background-color:tomato;"| {{result|fail}} run curl command
+| style="background-color:tomato;"| {{result|fail}} run curl command
-|style="background-color:lightgreen;"| {{result|pass}} automatic
+| style="background-color:lightgreen;"| {{result|pass}} automaticly
 |-
 |}
-{| class="wikitable collapsible collapsed"  border="1" width="100%"
+|}
+{| class="wikitable collapsible collapsed"  border="1" width="90%"
+|-
+! colspan=4 style="background-color: darkgrey;"| Administrating
 |-
-! colspan=3 style="background-color: yellow;"|Administrating
+|
-|-
+{| class="wikitable sortable" width=100% style="border: solid 2px white"
-! width="20%"|Feature !! width="40%"|fedoraproject.org/wiki !! width="40%"|nitrate
+|-
+! width="10%"|Priority !! width="20%"|Feature !! width="35%"|fedoraproject.org/wiki !! width="35%"|nitrate
 |-
+| P1
 | Authorities for pages
-|style="background-color:lightgreen;"| {{result|pass}} Use namespaces
+| style="background-color:lightgreen;"| {{result|pass}} Use namespaces
-|style="background-color:white;"| {{result|unknown}} Can admin configure it?
+| style="background-color:yellow;"| {{result|unknown}} Can admin configure it?
 |-
+|
 | Supporting anonymous user read-only access
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}}
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}}
 |-
+| P1
 | Supporting anonymous user read-write access
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}}
-|style="background-color:tomato;"| {{result|fail}}
+| style="background-color:tomato;"| {{result|fail}}
-|-
-| Integration with [https://admin.fedoraproject.org/accounts/ FAS]
-|style="background-color:lightgreen;"| {{result|pass}}
-|style="background-color:white;"| {{result|unknown}}
 |-
+|
 | Feature extension
-|style="background-color:lightgreen;"| {{result|pass}} Add plugin
+| style="background-color:lightgreen;"| {{result|pass}}
-|style="background-color:white;"| {{result|unknown}} Add plugin?
+| style="background-color:lightgreen;"| {{result|pass}}
 |-
+| P1
 | Page protection
-|style="background-color:lightgreen;"| {{result|pass}} by Admin
+| style="background-color:lightgreen;"| {{result|pass}} by Admin
-|style="background-color:white;"| {{result|unknown}}
+| style="background-color:yellow;"| {{result|unknown}}
+|-
+|
+| Case/plan/run deletion
+| style="background-color:lightgreen;"| {{result|pass}} by Admin
+| style="background-color:lightgreen;"| {{result|pass}} Set as DISABLED. Test run can be deleted.
+|-
+|
+| Licensing
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}}
+|-
+| P1
+| License the content
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:yellow;"| {{result|unknown}} should match wiki
 |-
-| Case/plan deletion
+|
-|style="background-color:lightgreen;"| {{result|pass}} by Admin
+| Integration with [https://admin.fedoraproject.org/accounts/ FAS]
-|style="background-color:lightgreen;"| {{result|pass}} Set as DISABLED. Test run can be deleted.
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:yellow;"| {{result|unknown}}
 |-
-| License
+| P2
-|style="background-color:white;"| {{result|unknown}}
+| Integration between update tools (bodhi/f-e-k) and our test infrastructure.
-|style="background-color:white;"| {{result|unknown}}
+| style="background-color:lightgreen;"| {{result|pass}} investigating
+| style="background-color:yellow;"| {{result|unknown}}
+|-
+| P1
+| Upstream project community
+| style="background-color:lightgreen;"| {{result|pass}} upstream wiki list
+| style="background-color:lightgreen;"| {{result|warn}} upstream nitrate list
 |-
 |}
-{| class="wikitable collapsible collapsed"  border="1" width="100%"
+|}
+{| class="wikitable collapsible collapsed"  border="1" width="90%"
+|-
+! colspan=4 style="background-color: darkgrey;"| Test Days
 |-
-! colspan=3 style="background-color: lightblue;"|Test Days
+|
-|-
+{| class="wikitable sortable" width=100% style="border: solid 2px white"
-! width="20%"|Feature !! width="40%"|fedoraproject.org/wiki !! width="40%"|nitrate
+|-
+! width="10%"|Priority !! width="20%"|Feature !! width="35%"|fedoraproject.org/wiki !! width="35%"|nitrate
 |-
+|
 | Test day main/intro page
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}}
-|style="background-color:tomato;"| {{result|fail}} link to wiki.
+| style="background-color:lightgreen;"| {{result|warn}} link to wiki
 |-
+|
 | Test day SOP guide page
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}}
-|style="background-color:tomato;"| {{result|fail}}link to wiki.
+| style="background-color:lightgreen;"| {{result|warn}}link to wiki
 |-
+|
 | Test day/event result template page
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}}
-|style="background-color:tomato;"| {{result|fail}} Clone from previous test run.
+| style="background-color:tomato;"| {{result|fail}} Clone from previous test run
 |-
+|
 | Test day schedule
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}}
-|style="background-color:tomato;"| {{result|fail}} link to wiki.
+| style="background-color:lightgreen;"| {{result|warn}} link to wiki
 |-
-| Test day page creation
+| P1
-|style="background-color:lightgreen;"| {{result|pass}}
+| Test day page(run) creation
-|style="background-color:tomato;"| {{result|fail}} test runs can only be created from plans
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:tomato;"| {{result|fail}} test runs can only be created from plans
 |-
-| Test day page contents
+| P1
-|style="background-color:lightgreen;"| {{result|pass}}
+| Test day page documented contents
-|style="background-color:tomato;"| {{result|fail}} write all to 'Notes' field will be too crowded!
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:tomato;"| {{result|fail}} write all intro to 'Notes' field will be too crowded!
 |-
+| P2
 | Test day notification
-|style="background-color:tomato;"| {{result|fail}} send out announcement manually
+| style="background-color:tomato;"| {{result|fail}} send out announcement manually
-|style="background-color:lightgreen;"| {{result|warn}} Assign through mail, but the content is very brief.
+| style="background-color:lightgreen;"| {{result|warn}} can assign through mail, but mail content is little.
 |-
 |}
-{| class="wikitable collapsible collapsed"  border="1" width="100%"
+|}
+{| class="wikitable collapsible collapsed"  border="1" width="90%"
+|-
+! colspan=4 style="background-color: darkgrey;"| Release Validation Test Event
 |-
-! colspan=3 style="background-color: yellow;"|Release Validation Test Event
+|
-|-
+{| class="wikitable sortable" width=100% style="border: solid 2px white"
-! width="20%"|Feature !! width="40%"|fedoraproject.org/wiki !! width="40%"|nitrate
+|-
+! width="10%"|Priority !! width="20%"|Feature !! width="35%"|fedoraproject.org/wiki !! width="35%"|nitrate
 |-
+|
 | Test event Main/intro page
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}}
-|style="background-color:tomato;"| {{result|fail}} link to wiki.
+| style="background-color:lightgreen;"| {{result|warn}} link to wiki
 |-
+|
 | Test event SOP guide page
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}}
-|style="background-color:tomato;"| {{result|fail}}link to wiki.
+| style="background-color:lightgreen;"| {{result|warn}}link to wiki
 |-
-| test event Result template page
+|
-|style="background-color:lightgreen;"| {{result|pass}}
+| Test event Result template page
-|style="background-color:tomato;"| {{result|fail}} Clone from previous test run.
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:tomato;"| {{result|fail}} Clone from previous test run.
 |-
+|
 | Release Criteria page
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}}
-|style="background-color:tomato;"| {{result|fail}} link to wiki.
+| style="background-color:lightgreen;"| {{result|warn}} link to wiki
 |-
+| P1
 | Test cases priority
-|style="background-color:tomato;"| {{result|fail}} manually add priority before each case link
+| style="background-color:tomato;"| {{result|fail}} manually add priority before each case link
-|style="background-color:lightgreen;"| {{result|warn}} from P1 to P5, need change to: Alpha, Beta, Final.
+| style="background-color:lightgreen;"| {{result|warn}} from P1 to P5, need change to: Alpha, Beta, Final.
 |-
+| P1
 | Each case with different platforms
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}}
-|style="background-color:tomato;"| {{result|fail}} ?? two test runs for both platforms?
+| style="background-color:tomato;"| {{result|fail}} two test runs for both platforms or clone each case for another platform
 |-
-| Test result page creation
+|
-|style="background-color:lightgreen;"| {{result|pass}}
+| Test result page(Test run) creation
-|style="background-color:lightgreen;"| {{result|pass}} created from plans
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}} created from plans
 |-
-| Test day page contents
+| P1
-|style="background-color:lightgreen;"| {{result|pass}}
+| Test result page documented contents
-|style="background-color:tomato;"| {{result|warn}} write all to 'Notes' field without any syntax
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|warn}} write intro to 'Notes' field without any syntax
 |-
-| Roadmap for each run
+| P2
-|style="background-color:tomato;"| {{result|fail}}
+| Test event notification
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:tomato;"| {{result|fail}} send out announcement manually
+| style="background-color:lightgreen;"| {{result|warn}} can assign through mail, but the content is little.
+|-
+|
+| Progress bar for each run
+| style="background-color:tomato;"| {{result|fail}}
+| style="background-color:lightgreen;"| {{result|pass}}
+|}
 |}