Tcms Comparison: Difference between revisions

Latest revision as of 06:25, 15 March 2011

This page is a draft only
It is still under construction and content may change. Do not rely on the information on this page.

This page objectively compares feature sets of Wiki and Nitrate systems in relation to the important workflows. Instead of displaying a long feature lists, it is divided into groups by use cases. To avoid overlaps, features compared in former use cases are not listed in later cases again.

Key Section

Icon	Explanation
pass	Supported
fail	Unsupported currently
File:Artwork EchoDevelopment dialog-question16.png unknown	Unknown/Research needed
warn	Partly supported
P1	Must-Have missing Feature in Nitrate
P2	Nice-To-Have missing Feature in Nitrate

Wiki vs Nitrate Feature Comparison

Creating A Generic Page

Priority	Feature	fedoraproject.org/wiki	nitrate
	Any page creation	pass	fail Can only create test case/plan/run
P2	Readable link names	pass human-readable link names	fail use ID for identification
	Data entry format	pass mediawiki markup	pass tinyMCE
	Moving a Page	pass by redirect links	pass by cloning or changing the summary(name) of case/plan/run
	Templates creation/use	pass such as Special:MostLinkedTemplates	fail
	Editing preview	pass	warn 'save and continue editing'
	Supports data entry using a form	fail wiki syntax	pass
P2	Discussion page	pass Talk page	fail Can only add comments in test cases
P1	History rollback(Undo changes)	pass	fail
P1	History comparison	pass	fail
	History logs	pass	pass Only offer change logs and text version history of plan and case
	Subpage using	pass	File:Artwork EchoDevelopment dialog-question16.png unknown by Tree View?
	Bookmarks/watchlist	pass watch the page	pass bookmark the page

Creating A Test Case

Priority	Feature	fedoraproject.org/wiki	nitrate
	Renaming a case	warn move to another page	pass change the summary
	Test case format template	pass Template:QA/Test_Case	pass Defined
	Linking files/packages/images	pass Upload somewhere and link to it	pass Test cases/plans support attachments or link to wiki
	Case draft status	warn manually add draft category/note	pass Set as PROPOSED or NEED_UPDATE
	Case review status	fail approved in ticket or somewhere else	pass Set as CONFIRMED
	Categorizing cases	pass manually add to category	pass add category or use tag or add to plan to group cases
P2	Categories creation	pass user can create it with certain permission	fail cases categories can only be added by Admin
P1	Description part in test case	pass	warn write in 'Notes' part, where syntax editing is needed.
	Tests that impact multiple packages	warn Categories could be used to organize this data, but get messy	pass allows linking tests to the packages they are designed to test
	Test case re-use (write once, link anywhere)	pass search from Category and link to it	pass test runs re-use cases from a plan, plans clone them from other plans
P2	The time historical test case results be available	pass all history?	File:Artwork EchoDevelopment dialog-question16.png unknown unknown
P2	Re-use old versioned test case	pass by linking to its history	fail can view text history and version only

Creating A Test Plan

Priority	Feature	fedoraproject.org/wiki	nitrate
	Test Plan re-use/update	pass copy contents from previous	pass clone previous plans
	Linking test cases	pass link to cases section on test result template page	pass clone from other plans/create new tests
P2	Plan draft status	warn manually add draft category/note	fail Set as non-active?
P2	Plan review status	warn manually add reviewer and review time	fail Set as active?
	Categorizing plans	pass manually add to category	pass no category for plan but have Plan Type and Tag etc.

Creating A Test Result Page(Test Run) Template

Priority	Feature	fedoraproject.org/wiki	nitrate
	Result Page(Test Run) Template	pass	fail doesn't support template creation. Test run(result page) can be cloned from previous run with modifications.
	Sortable table	pass	pass using sort
	Collapse table	warn hard to manage as a whole	pass
P1	Group cases (by media)	pass flexible wiki design	fail diff test runs;sorting;diff tags

Creating A Test Result Page(Test Run)

Priority	Feature	fedoraproject.org/wiki	nitrate
	Test result page(Test run) creation	pass	warn Create from plans
P1	documents in test result page	pass flexible wiki markup design	warn write in 'Notes' field without any syntax
P1	Moving test results	pass manually copy	fail manually add one by one?
P2	Directing to current test run	pass redirect links to current result page	fail set test run as running or finished
	Categorizing runs/result pages	pass manually add to category	pass Can set 'product', 'version' and 'tag' etc

Posting Test Results

Priority	Feature	fedoraproject.org/wiki	nitrate
P2	Quick access to active test runs	pass Open 'current' links	fail search the run's ID or search my runs(assigned to me in advance)
P1	Result format	pass use Template:Result	warn Idle, Passed, Failed, Running, Paused, Blocked, Error
	Comment as references	pass	pass
	Bug posting	pass use Template:Bz	pass
P1	Multiple contributions for each case	pass	fail only display the last modified one and logs
	*Signatures using	pass ~~~~ -> Rhe 09:59, 18 January 2011 (UTC)	fail

Searching Test Results/Cases/Plans

Priority	Feature	fedoraproject.org/wiki	nitrate
	Searching cases/plans/runs	fail only by searching from categories or name	pass advanced search
	Toolbox(what links to here)	pass	pass plans, cases, and runs related to each other

Uploading Files

Priority	Feature	fedoraproject.org/wiki	nitrate
P2	Upload files/packages/images	pass upload somewhere and link to it	warn test cases/plans support attachments, test runs don't
P2	Upload updates.img/repo to certain server	pass fedorapeople server	fail link to wiki.

Generating A Test Summary

Priority	Feature	fedoraproject.org/wiki	nitrate
	Result summary/report generation	fail run curl command	pass automaticly

Administrating

Priority	Feature	fedoraproject.org/wiki	nitrate
P1	Authorities for pages	pass Use namespaces	File:Artwork EchoDevelopment dialog-question16.png unknown Can admin configure it?
	Supporting anonymous user read-only access	pass	pass
P1	Supporting anonymous user read-write access	pass	fail
	Feature extension	pass	pass
P1	Page protection	pass by Admin	File:Artwork EchoDevelopment dialog-question16.png unknown
	Case/plan/run deletion	pass by Admin	pass Set as DISABLED. Test run can be deleted.
	Licensing	pass	pass
P1	License the content	pass	File:Artwork EchoDevelopment dialog-question16.png unknown should match wiki
	Integration with FAS	pass	File:Artwork EchoDevelopment dialog-question16.png unknown
P2	Integration between update tools (bodhi/f-e-k) and our test infrastructure.	pass investigating	File:Artwork EchoDevelopment dialog-question16.png unknown
P1	Upstream project community	pass upstream wiki list	warn upstream nitrate list

Test Days

Priority	Feature	fedoraproject.org/wiki	nitrate
	Test day main/intro page	pass	warn link to wiki
	Test day SOP guide page	pass	warn link to wiki
	Test day/event result template page	pass	fail Clone from previous test run
	Test day schedule	pass	warn link to wiki
P1	Test day page(run) creation	pass	fail test runs can only be created from plans
P1	Test day page documented contents	pass	fail write all intro to 'Notes' field will be too crowded!
P2	Test day notification	fail send out announcement manually	warn can assign through mail, but mail content is little.

Release Validation Test Event

Priority	Feature	fedoraproject.org/wiki	nitrate
	Test event Main/intro page	pass	warn link to wiki
	Test event SOP guide page	pass	warn link to wiki
	Test event Result template page	pass	fail Clone from previous test run.
	Release Criteria page	pass	warn link to wiki
P1	Test cases priority	fail manually add priority before each case link	warn from P1 to P5, need change to: Alpha, Beta, Final.
P1	Each case with different platforms	pass	fail two test runs for both platforms or clone each case for another platform
	Test result page(Test run) creation	pass	pass created from plans
P1	Test result page documented contents	pass	warn write intro to 'Notes' field without any syntax
P2	Test event notification	fail send out announcement manually	warn can assign through mail, but the content is little.
	Progress bar for each run	fail	pass

@@ Line 1: / Line 1: @@
-== Comparison ==
+{{draft}}
-<!-- Objectively compare feature sets of both tools in relation to
+This page objectively compares feature sets of Wiki and Nitrate systems in relation to the [[Tcms_use_cases|important workflows]]. Instead of displaying a long feature lists, it is divided into groups by use cases. To avoid overlaps, features compared in former use cases are not listed in later cases again.
-        the important workflows-->
-{| class="wikitable sortable"
+== Key Section ==
+{| class="wikitable sortable" border="0"
+! Icon !! Explanation
+|-
+| style="background-color:lightgreen;"|{{result|pass}}
+| Supported
+|-
+| style="background-color:tomato;"|{{result|fail}}
+| Unsupported currently
+|-
+| style="background-color:yellow;"|{{result|unknown}}
+| Unknown/Research needed
+|-
+| style="background-color:lightgreen;"|{{result|warn}}
+| Partly supported
+|-
+| P1
+| Must-Have missing Feature in Nitrate
+|-
+| P2
+| Nice-To-Have missing Feature in Nitrate
+|-
+|}
+== Wiki vs Nitrate Feature Comparison==
+{| class="wikitable collapsible"  border="1" width="90%"
+|-
+! colspan=4 style="background-color: darkgrey;"|Creating A Generic Page
+|-
+|
+{| class="wikitable sortable" width=100% style="border: solid 2px white"
+|-
+! width="10%"|Priority !! width="20%"|Feature !! width="35%"|fedoraproject.org/wiki !! width="35%"|nitrate
+|-
+|
+| Any page creation
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:tomato;"| {{result|fail}} Can only create test case/plan/run
+|-
+| P2
+| Readable link names
+| style="background-color:lightgreen;"| {{result|pass}} human-readable link names
+| style="background-color:tomato;"| {{result|fail}} use ID for identification
+|-
+|
+| Data entry format
+| style="background-color:lightgreen;"| {{result|pass}}[http://www.mediawiki.org/wiki/Help:Formatting mediawiki markup]
+| style="background-color:lightgreen;"| {{result|pass}}[http://tinymce.moxiecode.com/ tinyMCE]
+|-
+|
+| Moving a Page
+| style="background-color:lightgreen;"| {{result|pass}} by redirect links
+| style="background-color:lightgreen;"| {{result|pass}} by cloning or changing the summary(name) of case/plan/run
+|-
+|
+| Templates creation/use
+| style="background-color:lightgreen;"| {{result|pass}} such as [[Special:MostLinkedTemplates]]
+| style="background-color:tomato;"| {{result|fail}}
+|-
+|
+| Editing preview
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|warn}} 'save and continue editing'
+|-
+|
+| Supports data entry using a form
+| style="background-color:tomato;"| {{result|fail}} wiki syntax
+| style="background-color:lightgreen;"| {{result|pass}}
+|-
+| P2
+| Discussion page
+| style="background-color:lightgreen;"| {{result|pass}} Talk page
+| style="background-color:tomato;"| {{result|fail}} Can only add comments in test cases
+|-
+| P1
+| History rollback(Undo changes)
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:tomato;"| {{result|fail}}
+|-
+| P1
+| History comparison
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:tomato;"| {{result|fail}}
+|-
+|
+| History logs
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}} Only offer change logs and text version history of plan and case
+|-
+|
+| Subpage using
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:yellow;"| {{result|unknown}} by Tree View?
+|-
+|
+| Bookmarks/watchlist
+| style="background-color:lightgreen;"| {{result|pass}} watch the page
+| style="background-color:lightgreen;"| {{result|pass}} bookmark the page
+|-
+|}
+|}
+{| class="wikitable collapsible collapsed"  border="1" width="90%"
 |-
-! Feature !! fedoraproject.org/wiki !! nitrate
+! colspan=4 style="background-color: darkgrey;"|Creating A Test Case
+|-
+|
+{| class="wikitable sortable" width=100% style="border: solid 2px white"
+|-
+! width="10%"|Priority !! width="20%"|Feature !! width="35%"|fedoraproject.org/wiki !! width="35%"|nitrate
+|-
+|
+| Renaming a case
+| style="background-color:lightgreen;"| {{result|warn}} move to another page
+| style="background-color:lightgreen;"| {{result|pass}} change the summary
+|-
+|
+| Test case format template
+| style="background-color:lightgreen;"| {{result|pass}} [[Template:QA/Test_Case]]
+| style="background-color:lightgreen;"| {{result|pass}} Defined
+|-
+|
+| Linking files/packages/images
+| style="background-color:lightgreen;"| {{result|pass}} Upload somewhere and link to it
+| style="background-color:lightgreen;"| {{result|pass}} Test cases/plans support attachments or link to wiki
+|-
+|
+| Case draft status
+| style="background-color:lightgreen;"| {{result|warn}} manually add draft category/note
+| style="background-color:lightgreen;"| {{result|pass}} Set as PROPOSED or NEED_UPDATE
 |-
-| Wiki markup
+|
-|style="background-color:lightgreen;"| {{result|pass}}
+| Case review status
-|style="background-color:tomato;"| {{result|fail}}
+| style="background-color:tomato;"| {{result|fail}} approved in ticket or somewhere else
+| style="background-color:lightgreen;"| {{result|pass}} Set as CONFIRMED
 |-
-| Rename the links
+|
-|style="background-color:lightgreen;"| {{result|pass}}
+| Categorizing cases
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}} manually add to category
+| style="background-color:lightgreen;"| {{result|pass}} add category or use tag or add to plan to group cases
 |-
-| Review status
+| P2
-|style="background-color:tomato;"| {{result|fail}} manually add reviewer
+| Categories creation
-|style="background-color:lightgreen;"| {{result|pass}} Set as CONFIRMED
+| style="background-color:lightgreen;"| {{result|pass}} user can create it with certain permission
+| style="background-color:tomato;"| {{result|fail}} cases categories can only be added by Admin
 |-
-| Draft status
+| P1
-|style="background-color:tomato;"| {{result|fail}} manually add draft template/note
+| Description part in test case
-|style="background-color:lightgreen;"| {{result|pass}} Set as PROPOSED or NEED_UPDATE
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|warn}} write in 'Notes' part, where syntax editing is needed.
 |-
-| Templates
+|
-|style="background-color:lightgreen;"| {{result|pass}} such as result,case format, fedora version
+| Tests that impact multiple packages
-|style="background-color:tomato;"| {{result|fail}} Defined
+| style="background-color:lightgreen;"| {{result|warn}} Categories could be used to organize this data, but get messy
+| style="background-color:lightgreen;"| {{result|pass}} allows linking tests to the packages they are designed to test
 |-
+|
 | Test case re-use (write once, link anywhere)
-|style="background-color:lightgreen;"| {{result|pass}} using Category
+| style="background-color:lightgreen;"| {{result|pass}} search from Category and link to it
-|style="background-color:white;"| {{result|unknown}} Using test plans
+| style="background-color:lightgreen;"| {{result|pass}} test runs re-use cases from a plan, plans clone them from other plans
 |-
-| Add categories
+| P2
-|style="background-color:lightgreen;"| {{result|pass}} manually add category
+| The time historical test case results be available
-|style="background-color:white;"| {{result|unknown}} Or use tag instead?
+| style="background-color:lightgreen;"| {{result|pass}} all history?
+| style="background-color:yellow;"| {{result|unknown}} unknown
 |-
-| Add cases to categories
+| P2
-|style="background-color:lightgreen;"| {{result|pass}} manually add category
+| Re-use old versioned test case
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}} by linking to its history
+| style="background-color:tomato;"| {{result|fail}} can view text history and version only
 |-
+|}
+|}
+{| class="wikitable collapsible collapsed"  border="1" width="90%"
+|-
+! colspan=4 style="background-color: darkgrey;"| Creating A Test Plan
+|-
+|
+{| class="wikitable sortable" width=100% style="border: solid 2px white"
+|-
+! width="10%"|Priority !! width="20%"|Feature !! width="35%"|fedoraproject.org/wiki !! width="35%"|nitrate
+|-
+|
+| Test Plan re-use/update
+| style="background-color:lightgreen;"| {{result|pass}} copy contents from previous
+| style="background-color:lightgreen;"| {{result|pass}} clone previous plans
+|-
+|
+| Linking test cases
+| style="background-color:lightgreen;"| {{result|pass}} link to cases section on test result template page
+| style="background-color:lightgreen;"| {{result|pass}} clone from other plans/create new tests
+|-
+| P2
+| Plan draft status
+| style="background-color:lightgreen;"| {{result|warn}} manually add draft category/note
+| style="background-color:tomato;"| {{result|fail}} Set as non-active?
+|-
+| P2
+| Plan review status
+| style="background-color:lightgreen;"| {{result|warn}} manually add reviewer and review time
+| style="background-color:tomato;"| {{result|fail}} Set as active?
+|-
+|
+| Categorizing plans
+| style="background-color:lightgreen;"| {{result|pass}} manually add to category
+| style="background-color:lightgreen;"| {{result|pass}} no category for plan but have Plan Type and Tag etc.
+|-
+|}
+|}
+{| class="wikitable collapsible collapsed"  border="1" width="90%"
+|-
+! colspan=4 style="background-color: darkgrey;"| Creating A Test Result Page(Test Run) Template
+|-
+|
+{| class="wikitable sortable" width=100% style="border: solid 2px white"
+|-
+! width="10%"|Priority !! width="20%"|Feature !! width="35%"|fedoraproject.org/wiki !! width="35%"|nitrate
+|-
+|
+| Result Page(Test Run) Template
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:tomato;"| {{result|fail}} doesn't support template creation. Test run(result page) can be cloned from previous run with modifications.
+|-
+|
 | Sortable table
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}}
-|style="background-color:lightgreen;"| {{result|pass}} reorder cases?
+| style="background-color:lightgreen;"| {{result|pass}} using sort
 |-
+|
 | Collapse table
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|warn}} hard to manage as a whole
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}}
 |-
-| test case template
+| P1
-|style="background-color:lightgreen;"| {{result|pass}}
+| Group cases (by media)
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}}flexible wiki design
+| style="background-color:tomato;"| {{result|fail}} diff test runs;sorting;diff tags
 |-
-| links to the package
+|}
-|style="background-color:lightgreen;"| {{result|pass}}
+|}
-|style="background-color:white;"| {{result|unknown}}
+{| class="wikitable collapsible collapsed"  border="1" width="90%"
+|-
+! colspan=4 style="background-color: darkgrey;"| Creating A Test Result Page(Test Run)
 |-
-| Rename a case
+|
-|style="background-color:lightgreen;"| {{result|pass}}move to another page
+{| class="wikitable sortable" width=100% style="border: solid 2px white"
-|style="background-color:white;"| {{result|unknown}}
+|-
+! width="10%"|Priority !! width="20%"|Feature !! width="35%"|fedoraproject.org/wiki !! width="35%"|nitrate
 |-
-| Use template page
+|
-|style="background-color:lightgreen;"| {{result|pass}}
+| Test result page(Test run) creation
-|style="background-color:lightgreen;"| {{result|pass}} clone?
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|warn}} Create from plans
 |-
-| Redirect links
+| P1
-|style="background-color:lightgreen;"| {{result|pass}}
+| documents in test result page
-|style="background-color:tomato;"| {{result|fail}} set test run as running or finished
+| style="background-color:lightgreen;"| {{result|pass}} flexible wiki markup design
+| style="background-color:lightgreen;"| {{result|warn}} write in 'Notes' field without any syntax
 |-
-| Move test results
+| P1
-|style="background-color:lightgreen;"| {{result|pass}} manually copy
+| Moving test results
-|style="background-color:white;"| {{result|unknown}}
+| style="background-color:lightgreen;"| {{result|pass}} manually copy
+| style="background-color:tomato;"| {{result|fail}} manually add one by one?
 |-
-| History rollback
+| P2
-|style="background-color:lightgreen;"| {{result|pass}}
+| Directing to current test run
-|style="background-color:tomato;"| {{result|fail}}
+| style="background-color:lightgreen;"| {{result|pass}} redirect links to current result page
+| style="background-color:tomato;"| {{result|fail}} set test run as running or finished
 |-
-| Editting preview
+|
-|style="background-color:lightgreen;"| {{result|pass}}
+| Categorizing runs/result pages
-|style="background-color:white;"| {{result|unknown}}
+| style="background-color:lightgreen;"| {{result|pass}} manually add to category
+| style="background-color:lightgreen;"| {{result|pass}} Can set 'product', 'version' and 'tag' etc
 |-
-| changes comparison
+|}
-|style="background-color:lightgreen;"| {{result|pass}}
+|}
-|style="background-color:lightgreen;"| {{result|warn}} Only have change logs
+{| class="wikitable collapsible collapsed"  border="1" width="90%"
+|-
+! colspan=4 style="background-color: darkgrey;"| Posting Test Results
 |-
-| Subpage using
+|
-|style="background-color:lightgreen;"| {{result|pass}}
+{| class="wikitable sortable" width=100% style="border: solid 2px white"
-|style="background-color:lightgreen;"| {{result|warn}} by Tree View?
+|-
+! width="10%"|Priority !! width="20%"|Feature !! width="35%"|fedoraproject.org/wiki !! width="35%"|nitrate
 |-
-| Result summary/report
+| P2
-|style="background-color:tomato;"| {{result|fail}}
+| Quick access to active test runs
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}} Open 'current' links
-|-
+| style="background-color:tomato;"| {{result|fail}} search the run's ID or search my runs(assigned to me in advance)
-| Results for diff platforms
+|-
-|style="background-color:lightgreen;"| {{result|pass}}
+| P1
-|style="background-color:lightgreen;"| {{result|pass}}
+| Result format
+| style="background-color:lightgreen;"| {{result|pass}} use [[Template:Result]]
+| style="background-color:lightgreen;"| {{result|warn}} Idle, Passed, Failed, Running, Paused, Blocked, Error
 |-
+|
 | Comment as references
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}}
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}}
-|-
-| Result format
-|style="background-color:lightgreen;"| {{result|pass}} use result template
-|style="background-color:lightgreen;"| {{result|pass}} defined
 |-
+|
 | Bug posting
-|style="background-color:lightgreen;"| {{result|pass}} use bug template
+| style="background-color:lightgreen;"| {{result|pass}} use [[Template:Bz]]
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}}
 |-
+| P1
 | Multiple contributions for each case
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}}
-|style="background-color:white;"| {{result|unknown}}
+| style="background-color:tomato;"| {{result|fail}} only display the last modified one and logs
 |-
+|
 | *Signatures using
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}} <nowiki>~~~~</nowiki> -> [[User:Rhe|Rhe]] 09:59, 18 January 2011 (UTC)
-|style="background-color:white;"| {{result|unknown}}
+| style="background-color:tomato;"| {{result|fail}}
 |-
-| Search tests/plans
+|}
-|style="background-color:tomato;"| {{result|fail}} by categories or name
+|}
-|style="background-color:lightgreen;"| {{result|pass}}
+{| class="wikitable collapsible collapsed"  border="1" width="90%"
+|-
+! colspan=4 style="background-color: darkgrey;"| Searching Test Results/Cases/Plans
 |-
-| Main/intro page
+|
-|style="background-color:lightgreen;"| {{result|pass}}
+{| class="wikitable sortable" width=100% style="border: solid 2px white"
-|style="background-color:tomato;"| {{result|fail}} link to wiki?
+|-
+! width="10%"|Priority !! width="20%"|Feature !! width="35%"|fedoraproject.org/wiki !! width="35%"|nitrate
 |-
+|
+| Searching cases/plans/runs
+| width="30%" style="background-color:tomato;"| {{result|fail}} only by searching from categories or name
+| width="35%" style="background-color:lightgreen;"| {{result|pass}} advanced search
+|-
+|
 | Toolbox(what links to here)
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}}
-|style="background-color:white;"| {{result|unknown}}
+| style="background-color:lightgreen;"| {{result|pass}} plans, cases, and runs related to each other
 |-
+|}
+|}
+{| class="wikitable collapsible collapsed"  border="1" width="90%"
+|-
+! colspan=4 style="background-color: darkgrey;"| Uploading Files
+|-
+|
+{| class="wikitable sortable" width=100% style="border: solid 2px white"
+|-
+! width="10%"|Priority !! width="20%"|Feature !! width="35%"|fedoraproject.org/wiki !! width="35%"|nitrate
+|-
+| P2
 | Upload files/packages/images
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}} upload somewhere and link to it
-|style="background-color:white;"| {{result|unknown}}
+| style="background-color:lightgreen;"| {{result|warn}} test cases/plans support attachments, test runs don't
 |-
+| P2
 | Upload updates.img/repo to certain server
-|style="background-color:lightgreen;"| {{result|pass}} fedorapeople server
+| style="background-color:lightgreen;"| {{result|pass}} fedorapeople server
-|style="background-color:tomato;"| {{result|fail}} link to wiki?
+| style="background-color:tomato;"| {{result|fail}} link to wiki.
+|-
+|}
+|}
+{| class="wikitable collapsible collapsed"  border="1" width="90%"
+|-
+! colspan=4 style="background-color: darkgrey;"| Generating A Test Summary
+|-
+|
+{| class="wikitable sortable" width=100% style="border: solid 2px white"
+|-
+! width="10%"|Priority !! width="20%"|Feature !! width="35%"|fedoraproject.org/wiki !! width="35%"|nitrate
+|-
+|
+| Result summary/report generation
+| style="background-color:tomato;"| {{result|fail}} run curl command
+| style="background-color:lightgreen;"| {{result|pass}} automaticly
+|-
+|}
+|}
+{| class="wikitable collapsible collapsed"  border="1" width="90%"
+|-
+! colspan=4 style="background-color: darkgrey;"| Administrating
+|-
+|
+{| class="wikitable sortable" width=100% style="border: solid 2px white"
+|-
+! width="10%"|Priority !! width="20%"|Feature !! width="35%"|fedoraproject.org/wiki !! width="35%"|nitrate
 |-
+| P1
 | Authorities for pages
-|style="background-color:lightgreen;"| {{result|pass}} Use namespaces
+| style="background-color:lightgreen;"| {{result|pass}} Use namespaces
-|style="background-color:white;"| {{result|unknown}}
+| style="background-color:yellow;"| {{result|unknown}} Can admin configure it?
 |-
-| Feature enhancement
+|
-|style="background-color:lightgreen;"| {{result|pass}} Add plugin
+| Supporting anonymous user read-only access
-|style="background-color:white;"| {{result|unknown}}
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}}
 |-
+| P1
+| Supporting anonymous user read-write access
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:tomato;"| {{result|fail}}
+|-
+|
+| Feature extension
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}}
+|-
+| P1
 | Page protection
-|style="background-color:lightgreen;"| {{result|pass}} by Admin
+| style="background-color:lightgreen;"| {{result|pass}} by Admin
-|style="background-color:white;"| {{result|unknown}}
+| style="background-color:yellow;"| {{result|unknown}}
+|-
+|
+| Case/plan/run deletion
+| style="background-color:lightgreen;"| {{result|pass}} by Admin
+| style="background-color:lightgreen;"| {{result|pass}} Set as DISABLED. Test run can be deleted.
+|-
+|
+| Licensing
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}}
+|-
+| P1
+| License the content
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:yellow;"| {{result|unknown}} should match wiki
 |-
-| Case/plan deletion
+|
-|style="background-color:lightgreen;"| {{result|pass}} by Admin
+| Integration with [https://admin.fedoraproject.org/accounts/ FAS]
-|style="background-color:lightgreen;"| {{result|pass}} Set as DISABLED?
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:yellow;"| {{result|unknown}}
 |-
-| SOP guide page
+| P2
-|style="background-color:lightgreen;"| {{result|pass}}
+| Integration between update tools (bodhi/f-e-k) and our test infrastructure.
-|style="background-color:tomato;"| {{result|fail}}link to wiki?
+| style="background-color:lightgreen;"| {{result|pass}} investigating
+| style="background-color:yellow;"| {{result|unknown}}
 |-
-| Test day/result template page
+| P1
-|style="background-color:lightgreen;"| {{result|pass}}
+| Upstream project community
-|style="background-color:white;"| {{result|unknown}}
+| style="background-color:lightgreen;"| {{result|pass}} upstream wiki list
+| style="background-color:lightgreen;"| {{result|warn}} upstream nitrate list
 |-
+|}
+|}
+{| class="wikitable collapsible collapsed"  border="1" width="90%"
+|-
+! colspan=4 style="background-color: darkgrey;"| Test Days
+|-
+|
+{| class="wikitable sortable" width=100% style="border: solid 2px white"
+|-
+! width="10%"|Priority !! width="20%"|Feature !! width="35%"|fedoraproject.org/wiki !! width="35%"|nitrate
+|-
+|
+| Test day main/intro page
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|warn}} link to wiki
+|-
+|
+| Test day SOP guide page
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|warn}}link to wiki
+|-
+|
+| Test day/event result template page
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:tomato;"| {{result|fail}} Clone from previous test run
+|-
+|
 | Test day schedule
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}}
-|style="background-color:tomato;"| {{result|fail}} link to wiki?
+| style="background-color:lightgreen;"| {{result|warn}} link to wiki
 |-
-| Test notification
+| P1
-|style="background-color:tomato;"| {{result|fail}} send out announcement manually
+| Test day page(run) creation
-|style="background-color:lightgreen;"| {{result|fail}} assign through mail
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:tomato;"| {{result|fail}} test runs can only be created from plans
 |-
-| Table format
+| P1
-|style="background-color:lightgreen;"| {{result|pass}}
+| Test day page documented contents
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:tomato;"| {{result|fail}} write all intro to 'Notes' field will be too crowded!
 |-
-| Form format
+| P2
-|style="background-color:tomato;"| {{result|fail}} wiki syntax
+| Test day notification
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:tomato;"| {{result|fail}} send out announcement manually
+| style="background-color:lightgreen;"| {{result|warn}} can assign through mail, but mail content is little.
 |-
-| Talk page
+|}
-|style="background-color:lightgreen;"| {{result|pass}}
+|}
-|style="background-color:tomato;"| {{result|fail}}
+{| class="wikitable collapsible collapsed"  border="1" width="90%"
+|-
+! colspan=4 style="background-color: darkgrey;"| Release Validation Test Event
 |-
-| Release Criteria page
+|
-|style="background-color:lightgreen;"| {{result|pass}}
+{| class="wikitable sortable" width=100% style="border: solid 2px white"
-|style="background-color:tomato;"| {{result|fail}} link to wiki?
+|-
+! width="10%"|Priority !! width="20%"|Feature !! width="35%"|fedoraproject.org/wiki !! width="35%"|nitrate
+|-
+|
+| Test event Main/intro page
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|warn}} link to wiki
+|-
+|
+| Test event SOP guide page
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|warn}}link to wiki
 |-
-| License
+|
-|style="background-color:white;"| {{result|unknown}}
+| Test event Result template page
-|style="background-color:white;"| {{result|unknown}}
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:tomato;"| {{result|fail}} Clone from previous test run.
 |-
-| Integration with [https://admin.fedoraproject.org/accounts/ FAS]
+|
-|style="background-color:lightgreen;"| {{result|pass}}
+| Release Criteria page
-|style="background-color:tomato;"| {{result|fail}}
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|warn}} link to wiki
 |-
-| Supports anonymous user read-only access
+| P1
-|style="background-color:lightgreen;"| {{result|pass}}
+| Test cases priority
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:tomato;"| {{result|fail}} manually add priority before each case link
+| style="background-color:lightgreen;"| {{result|warn}} from P1 to P5, need change to: Alpha, Beta, Final.
 |-
-| Supports anonymous user read-write access
+| P1
-|style="background-color:lightgreen;"| {{result|pass}}
+| Each case with different platforms
-|style="background-color:tomato;"| {{result|fail}}
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:tomato;"| {{result|fail}} two test runs for both platforms or clone each case for another platform
 |-
-| Data entry format
+|
-|style="background-color:lightgreen;"| [http://www.mediawiki.org/wiki/Help:Formatting mediawiki markup]
+| Test result page(Test run) creation
-|style="background-color:white;"| {{result|unknown}} [http://tinymce.moxiecode.com/ tinyMCE]?
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}} created from plans
 |-
-| Test case re-use (write once, link anywhere)
+| P1
-|style="background-color:lightgreen;"| {{result|pass}} using Category
+| Test result page documented contents
-|style="background-color:white;"| {{result|unknown}} Using test plans
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|warn}} write intro to 'Notes' field without any syntax
 |-
-| Test case tags
+| P2
-|style="background-color:tomato;"| {{result|fail}}
+| Test event notification
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:tomato;"| {{result|fail}} send out announcement manually
+| style="background-color:lightgreen;"| {{result|warn}} can assign through mail, but the content is little.
 |-
+|
+| Progress bar for each run
+| style="background-color:tomato;"| {{result|fail}}
+| style="background-color:lightgreen;"| {{result|pass}}
+|}
 |}