Tcms Comparison: Difference between revisions

Latest revision as of 06:25, 15 March 2011

This page is a draft only
It is still under construction and content may change. Do not rely on the information on this page.

This page objectively compares feature sets of Wiki and Nitrate systems in relation to the important workflows. Instead of displaying a long feature lists, it is divided into groups by use cases. To avoid overlaps, features compared in former use cases are not listed in later cases again.

Key Section

Icon	Explanation
pass	Supported
fail	Unsupported currently
File:Artwork EchoDevelopment dialog-question16.png unknown	Unknown/Research needed
warn	Partly supported
P1	Must-Have missing Feature in Nitrate
P2	Nice-To-Have missing Feature in Nitrate

Wiki vs Nitrate Feature Comparison

Creating A Generic Page

Priority	Feature	fedoraproject.org/wiki	nitrate
	Any page creation	pass	fail Can only create test case/plan/run
P2	Readable link names	pass human-readable link names	fail use ID for identification
	Data entry format	pass mediawiki markup	pass tinyMCE
	Moving a Page	pass by redirect links	pass by cloning or changing the summary(name) of case/plan/run
	Templates creation/use	pass such as Special:MostLinkedTemplates	fail
	Editing preview	pass	warn 'save and continue editing'
	Supports data entry using a form	fail wiki syntax	pass
P2	Discussion page	pass Talk page	fail Can only add comments in test cases
P1	History rollback(Undo changes)	pass	fail
P1	History comparison	pass	fail
	History logs	pass	pass Only offer change logs and text version history of plan and case
	Subpage using	pass	File:Artwork EchoDevelopment dialog-question16.png unknown by Tree View?
	Bookmarks/watchlist	pass watch the page	pass bookmark the page

Creating A Test Case

Priority	Feature	fedoraproject.org/wiki	nitrate
	Renaming a case	warn move to another page	pass change the summary
	Test case format template	pass Template:QA/Test_Case	pass Defined
	Linking files/packages/images	pass Upload somewhere and link to it	pass Test cases/plans support attachments or link to wiki
	Case draft status	warn manually add draft category/note	pass Set as PROPOSED or NEED_UPDATE
	Case review status	fail approved in ticket or somewhere else	pass Set as CONFIRMED
	Categorizing cases	pass manually add to category	pass add category or use tag or add to plan to group cases
P2	Categories creation	pass user can create it with certain permission	fail cases categories can only be added by Admin
P1	Description part in test case	pass	warn write in 'Notes' part, where syntax editing is needed.
	Tests that impact multiple packages	warn Categories could be used to organize this data, but get messy	pass allows linking tests to the packages they are designed to test
	Test case re-use (write once, link anywhere)	pass search from Category and link to it	pass test runs re-use cases from a plan, plans clone them from other plans
P2	The time historical test case results be available	pass all history?	File:Artwork EchoDevelopment dialog-question16.png unknown unknown
P2	Re-use old versioned test case	pass by linking to its history	fail can view text history and version only

Creating A Test Plan

Priority	Feature	fedoraproject.org/wiki	nitrate
	Test Plan re-use/update	pass copy contents from previous	pass clone previous plans
	Linking test cases	pass link to cases section on test result template page	pass clone from other plans/create new tests
P2	Plan draft status	warn manually add draft category/note	fail Set as non-active?
P2	Plan review status	warn manually add reviewer and review time	fail Set as active?
	Categorizing plans	pass manually add to category	pass no category for plan but have Plan Type and Tag etc.

Creating A Test Result Page(Test Run) Template

Priority	Feature	fedoraproject.org/wiki	nitrate
	Result Page(Test Run) Template	pass	fail doesn't support template creation. Test run(result page) can be cloned from previous run with modifications.
	Sortable table	pass	pass using sort
	Collapse table	warn hard to manage as a whole	pass
P1	Group cases (by media)	pass flexible wiki design	fail diff test runs;sorting;diff tags

Creating A Test Result Page(Test Run)

Priority	Feature	fedoraproject.org/wiki	nitrate
	Test result page(Test run) creation	pass	warn Create from plans
P1	documents in test result page	pass flexible wiki markup design	warn write in 'Notes' field without any syntax
P1	Moving test results	pass manually copy	fail manually add one by one?
P2	Directing to current test run	pass redirect links to current result page	fail set test run as running or finished
	Categorizing runs/result pages	pass manually add to category	pass Can set 'product', 'version' and 'tag' etc

Posting Test Results

Priority	Feature	fedoraproject.org/wiki	nitrate
P2	Quick access to active test runs	pass Open 'current' links	fail search the run's ID or search my runs(assigned to me in advance)
P1	Result format	pass use Template:Result	warn Idle, Passed, Failed, Running, Paused, Blocked, Error
	Comment as references	pass	pass
	Bug posting	pass use Template:Bz	pass
P1	Multiple contributions for each case	pass	fail only display the last modified one and logs
	*Signatures using	pass ~~~~ -> Rhe 09:59, 18 January 2011 (UTC)	fail

Searching Test Results/Cases/Plans

Priority	Feature	fedoraproject.org/wiki	nitrate
	Searching cases/plans/runs	fail only by searching from categories or name	pass advanced search
	Toolbox(what links to here)	pass	pass plans, cases, and runs related to each other

Uploading Files

Priority	Feature	fedoraproject.org/wiki	nitrate
P2	Upload files/packages/images	pass upload somewhere and link to it	warn test cases/plans support attachments, test runs don't
P2	Upload updates.img/repo to certain server	pass fedorapeople server	fail link to wiki.

Generating A Test Summary

Priority	Feature	fedoraproject.org/wiki	nitrate
	Result summary/report generation	fail run curl command	pass automaticly

Administrating

Priority	Feature	fedoraproject.org/wiki	nitrate
P1	Authorities for pages	pass Use namespaces	File:Artwork EchoDevelopment dialog-question16.png unknown Can admin configure it?
	Supporting anonymous user read-only access	pass	pass
P1	Supporting anonymous user read-write access	pass	fail
	Feature extension	pass	pass
P1	Page protection	pass by Admin	File:Artwork EchoDevelopment dialog-question16.png unknown
	Case/plan/run deletion	pass by Admin	pass Set as DISABLED. Test run can be deleted.
	Licensing	pass	pass
P1	License the content	pass	File:Artwork EchoDevelopment dialog-question16.png unknown should match wiki
	Integration with FAS	pass	File:Artwork EchoDevelopment dialog-question16.png unknown
P2	Integration between update tools (bodhi/f-e-k) and our test infrastructure.	pass investigating	File:Artwork EchoDevelopment dialog-question16.png unknown
P1	Upstream project community	pass upstream wiki list	warn upstream nitrate list

Test Days

Priority	Feature	fedoraproject.org/wiki	nitrate
	Test day main/intro page	pass	warn link to wiki
	Test day SOP guide page	pass	warn link to wiki
	Test day/event result template page	pass	fail Clone from previous test run
	Test day schedule	pass	warn link to wiki
P1	Test day page(run) creation	pass	fail test runs can only be created from plans
P1	Test day page documented contents	pass	fail write all intro to 'Notes' field will be too crowded!
P2	Test day notification	fail send out announcement manually	warn can assign through mail, but mail content is little.

Release Validation Test Event

Priority	Feature	fedoraproject.org/wiki	nitrate
	Test event Main/intro page	pass	warn link to wiki
	Test event SOP guide page	pass	warn link to wiki
	Test event Result template page	pass	fail Clone from previous test run.
	Release Criteria page	pass	warn link to wiki
P1	Test cases priority	fail manually add priority before each case link	warn from P1 to P5, need change to: Alpha, Beta, Final.
P1	Each case with different platforms	pass	fail two test runs for both platforms or clone each case for another platform
	Test result page(Test run) creation	pass	pass created from plans
P1	Test result page documented contents	pass	warn write intro to 'Notes' field without any syntax
P2	Test event notification	fail send out announcement manually	warn can assign through mail, but the content is little.
	Progress bar for each run	fail	pass

@@ Line 1: / Line 1: @@
-== Comparison ==
+{{draft}}
-<!-- Objectively compare feature sets of both tools in relation to
+This page objectively compares feature sets of Wiki and Nitrate systems in relation to the [[Tcms_use_cases|important workflows]]. Instead of displaying a long feature lists, it is divided into groups by use cases. To avoid overlaps, features compared in former use cases are not listed in later cases again.
-        the important workflows-->
-{| class="wikitable sortable"
+== Key Section ==
+{| class="wikitable sortable" border="0"
+! Icon !! Explanation
+|-
+| style="background-color:lightgreen;"|{{result|pass}}
+| Supported
+|-
+| style="background-color:tomato;"|{{result|fail}}
+| Unsupported currently
+|-
+| style="background-color:yellow;"|{{result|unknown}}
+| Unknown/Research needed
+|-
+| style="background-color:lightgreen;"|{{result|warn}}
+| Partly supported
+|-
+| P1
+| Must-Have missing Feature in Nitrate
+|-
+| P2
+| Nice-To-Have missing Feature in Nitrate
+|-
+|}
+== Wiki vs Nitrate Feature Comparison==
+{| class="wikitable collapsible"  border="1" width="90%"
 |-
-! Feature !! fedoraproject.org/wiki !! nitrate
+! colspan=4 style="background-color: darkgrey;"|Creating A Generic Page
 |-
-| Wiki markup
+|
-|style="background-color:lightgreen;"| {{result|pass}}
+{| class="wikitable sortable" width=100% style="border: solid 2px white"
-|style="background-color:tomato;"| {{result|fail}}
+|-
+! width="10%"|Priority !! width="20%"|Feature !! width="35%"|fedoraproject.org/wiki !! width="35%"|nitrate
 |-
-| Rename the links
+|
-|style="background-color:lightgreen;"| {{result|pass}}
+| Any page creation
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:tomato;"| {{result|fail}} Can only create test case/plan/run
 |-
-| Review status
+| P2
-|style="background-color:tomato;"| {{result|fail}} manually add review time
+| Readable link names
-|style="background-color:lightgreen;"| {{result|pass}} Set as CONFIRMED
+| style="background-color:lightgreen;"| {{result|pass}} human-readable link names
+| style="background-color:tomato;"| {{result|fail}} use ID for identification
 |-
-| Draft status
+|
-|style="background-color:tomato;"| {{result|fail}} manually add draft category/note
+| Data entry format
-|style="background-color:lightgreen;"| {{result|pass}} Set as PROPOSED or NEED_UPDATE
+| style="background-color:lightgreen;"| {{result|pass}}[http://www.mediawiki.org/wiki/Help:Formatting mediawiki markup]
+| style="background-color:lightgreen;"| {{result|pass}}[http://tinymce.moxiecode.com/ tinyMCE]
 |-
-| Templates
+|
-|style="background-color:lightgreen;"| {{result|pass}} such as result, case format, fedora version
+| Moving a Page
-|style="background-color:tomato;"| {{result|fail}} Defined
+| style="background-color:lightgreen;"| {{result|pass}} by redirect links
+| style="background-color:lightgreen;"| {{result|pass}} by cloning or changing the summary(name) of case/plan/run
 |-
+|
+| Templates creation/use
+| style="background-color:lightgreen;"| {{result|pass}} such as [[Special:MostLinkedTemplates]]
+| style="background-color:tomato;"| {{result|fail}}
+|-
+|
+| Editing preview
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|warn}} 'save and continue editing'
+|-
+|
+| Supports data entry using a form
+| style="background-color:tomato;"| {{result|fail}} wiki syntax
+| style="background-color:lightgreen;"| {{result|pass}}
+|-
+| P2
+| Discussion page
+| style="background-color:lightgreen;"| {{result|pass}} Talk page
+| style="background-color:tomato;"| {{result|fail}} Can only add comments in test cases
+|-
+| P1
+| History rollback(Undo changes)
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:tomato;"| {{result|fail}}
+|-
+| P1
+| History comparison
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:tomato;"| {{result|fail}}
+|-
+|
+| History logs
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}} Only offer change logs and text version history of plan and case
+|-
+|
+| Subpage using
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:yellow;"| {{result|unknown}} by Tree View?
+|-
+|
+| Bookmarks/watchlist
+| style="background-color:lightgreen;"| {{result|pass}} watch the page
+| style="background-color:lightgreen;"| {{result|pass}} bookmark the page
+|-
+|}
+|}
+{| class="wikitable collapsible collapsed"  border="1" width="90%"
+|-
+! colspan=4 style="background-color: darkgrey;"|Creating A Test Case
+|-
+|
+{| class="wikitable sortable" width=100% style="border: solid 2px white"
+|-
+! width="10%"|Priority !! width="20%"|Feature !! width="35%"|fedoraproject.org/wiki !! width="35%"|nitrate
+|-
+|
+| Renaming a case
+| style="background-color:lightgreen;"| {{result|warn}} move to another page
+| style="background-color:lightgreen;"| {{result|pass}} change the summary
+|-
+|
+| Test case format template
+| style="background-color:lightgreen;"| {{result|pass}} [[Template:QA/Test_Case]]
+| style="background-color:lightgreen;"| {{result|pass}} Defined
+|-
+|
+| Linking files/packages/images
+| style="background-color:lightgreen;"| {{result|pass}} Upload somewhere and link to it
+| style="background-color:lightgreen;"| {{result|pass}} Test cases/plans support attachments or link to wiki
+|-
+|
+| Case draft status
+| style="background-color:lightgreen;"| {{result|warn}} manually add draft category/note
+| style="background-color:lightgreen;"| {{result|pass}} Set as PROPOSED or NEED_UPDATE
+|-
+|
+| Case review status
+| style="background-color:tomato;"| {{result|fail}} approved in ticket or somewhere else
+| style="background-color:lightgreen;"| {{result|pass}} Set as CONFIRMED
+|-
+|
+| Categorizing cases
+| style="background-color:lightgreen;"| {{result|pass}} manually add to category
+| style="background-color:lightgreen;"| {{result|pass}} add category or use tag or add to plan to group cases
+|-
+| P2
+| Categories creation
+| style="background-color:lightgreen;"| {{result|pass}} user can create it with certain permission
+| style="background-color:tomato;"| {{result|fail}} cases categories can only be added by Admin
+|-
+| P1
+| Description part in test case
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|warn}} write in 'Notes' part, where syntax editing is needed.
+|-
+|
+| Tests that impact multiple packages
+| style="background-color:lightgreen;"| {{result|warn}} Categories could be used to organize this data, but get messy
+| style="background-color:lightgreen;"| {{result|pass}} allows linking tests to the packages they are designed to test
+|-
+|
 | Test case re-use (write once, link anywhere)
-|style="background-color:lightgreen;"| {{result|pass}} using Category
+| style="background-color:lightgreen;"| {{result|pass}} search from Category and link to it
-|style="background-color:lightgreen;"| {{result|pass}} clone from other plans
+| style="background-color:lightgreen;"| {{result|pass}} test runs re-use cases from a plan, plans clone them from other plans
+|-
+| P2
+| The time historical test case results be available
+| style="background-color:lightgreen;"| {{result|pass}} all history?
+| style="background-color:yellow;"| {{result|unknown}} unknown
+|-
+| P2
+| Re-use old versioned test case
+| style="background-color:lightgreen;"| {{result|pass}} by linking to its history
+| style="background-color:tomato;"| {{result|fail}} can view text history and version only
+|-
+|}
+|}
+{| class="wikitable collapsible collapsed"  border="1" width="90%"
+|-
+! colspan=4 style="background-color: darkgrey;"| Creating A Test Plan
+|-
+|
+{| class="wikitable sortable" width=100% style="border: solid 2px white"
+|-
+! width="10%"|Priority !! width="20%"|Feature !! width="35%"|fedoraproject.org/wiki !! width="35%"|nitrate
+|-
+|
+| Test Plan re-use/update
+| style="background-color:lightgreen;"| {{result|pass}} copy contents from previous
+| style="background-color:lightgreen;"| {{result|pass}} clone previous plans
+|-
+|
+| Linking test cases
+| style="background-color:lightgreen;"| {{result|pass}} link to cases section on test result template page
+| style="background-color:lightgreen;"| {{result|pass}} clone from other plans/create new tests
+|-
+| P2
+| Plan draft status
+| style="background-color:lightgreen;"| {{result|warn}} manually add draft category/note
+| style="background-color:tomato;"| {{result|fail}} Set as non-active?
+|-
+| P2
+| Plan review status
+| style="background-color:lightgreen;"| {{result|warn}} manually add reviewer and review time
+| style="background-color:tomato;"| {{result|fail}} Set as active?
+|-
+|
+| Categorizing plans
+| style="background-color:lightgreen;"| {{result|pass}} manually add to category
+| style="background-color:lightgreen;"| {{result|pass}} no category for plan but have Plan Type and Tag etc.
+|-
+|}
+|}
+{| class="wikitable collapsible collapsed"  border="1" width="90%"
+|-
+! colspan=4 style="background-color: darkgrey;"| Creating A Test Result Page(Test Run) Template
 |-
-| Categories adding
+|
-|style="background-color:lightgreen;"| {{result|pass}} manually add new category
+{| class="wikitable sortable" width=100% style="border: solid 2px white"
-|style="background-color:lightgreen;"| {{result|pass}} by Admin
+|-
+! width="10%"|Priority !! width="20%"|Feature !! width="35%"|fedoraproject.org/wiki !! width="35%"|nitrate
 |-
-| Add cases to categories
+|
-|style="background-color:lightgreen;"| {{result|pass}} manually add category
+| Result Page(Test Run) Template
-|style="background-color:lightgreen;"| {{result|pass}} Either add category or use tag or add to plan
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:tomato;"| {{result|fail}} doesn't support template creation. Test run(result page) can be cloned from previous run with modifications.
 |-
+|
 | Sortable table
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}}
-|style="background-color:lightgreen;"| {{result|pass}} using sort
+| style="background-color:lightgreen;"| {{result|pass}} using sort
 |-
+|
 | Collapse table
-|style="background-color:lightgreen;"| {{result|warn}} hard to manage as a whole
+| style="background-color:lightgreen;"| {{result|warn}} hard to manage as a whole
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}}
 |-
-| Test case template
+| P1
-|style="background-color:lightgreen;"| {{result|pass}}
+| Group cases (by media)
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}}flexible wiki design
+| style="background-color:tomato;"| {{result|fail}} diff test runs;sorting;diff tags
 |-
-| Rename a case
+|}
-|style="background-color:tomato;"| {{result|fail}} move to another page
+|}
-|style="background-color:lightgreen;"| {{result|pass}}
+{| class="wikitable collapsible collapsed"  border="1" width="90%"
+|-
+! colspan=4 style="background-color: darkgrey;"| Creating A Test Result Page(Test Run)
 |-
-| Use template page
+|
-|style="background-color:lightgreen;"| {{result|pass}}
+{| class="wikitable sortable" width=100% style="border: solid 2px white"
-|style="background-color:lightgreen;"| {{result|pass}} Clone from previous run
+|-
+! width="10%"|Priority !! width="20%"|Feature !! width="35%"|fedoraproject.org/wiki !! width="35%"|nitrate
 |-
-| Redirect links
+|
-|style="background-color:lightgreen;"| {{result|pass}}
+| Test result page(Test run) creation
-|style="background-color:tomato;"| {{result|fail}} set test run as running or finished
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|warn}} Create from plans
 |-
-| Move test results
+| P1
-|style="background-color:lightgreen;"| {{result|pass}} manually copy
+| documents in test result page
-|style="background-color:tomato;"| {{result|fail}} manually add one by one?
+| style="background-color:lightgreen;"| {{result|pass}} flexible wiki markup design
+| style="background-color:lightgreen;"| {{result|warn}} write in 'Notes' field without any syntax
 |-
-| History rollback
+| P1
-|style="background-color:lightgreen;"| {{result|pass}}
+| Moving test results
-|style="background-color:tomato;"| {{result|fail}}  only have change log for reference
+| style="background-color:lightgreen;"| {{result|pass}} manually copy
+| style="background-color:tomato;"| {{result|fail}} manually add one by one?
 |-
-| Editting preview
+| P2
-|style="background-color:lightgreen;"| {{result|pass}}
+| Directing to current test run
-|style="background-color:tomato;"| {{result|fail}}
+| style="background-color:lightgreen;"| {{result|pass}} redirect links to current result page
+| style="background-color:tomato;"| {{result|fail}} set test run as running or finished
 |-
-| changes comparison
+|
-|style="background-color:lightgreen;"| {{result|pass}}
+| Categorizing runs/result pages
-|style="background-color:lightgreen;"| {{result|warn}} Only have change logs
+| style="background-color:lightgreen;"| {{result|pass}} manually add to category
+| style="background-color:lightgreen;"| {{result|pass}} Can set 'product', 'version' and 'tag' etc
 |-
-| Subpage using
+|}
-|style="background-color:lightgreen;"| {{result|pass}}
+|}
-|style="background-color:lightgreen;"| {{result|warn}} by Tree View?
+{| class="wikitable collapsible collapsed"  border="1" width="90%"
+|-
+! colspan=4 style="background-color: darkgrey;"| Posting Test Results
 |-
-| Result summary/report
+|
-|style="background-color:tomato;"| {{result|fail}}
+{| class="wikitable sortable" width=100% style="border: solid 2px white"
-|style="background-color:lightgreen;"| {{result|pass}}
+|-
+! width="10%"|Priority !! width="20%"|Feature !! width="35%"|fedoraproject.org/wiki !! width="35%"|nitrate
 |-
-| Results for diff platforms
+| P2
-|style="background-color:lightgreen;"| {{result|pass}}
+| Quick access to active test runs
-|style="background-color:tomato;"| {{result|fail}} ?? two test runs for both platforms?
+| style="background-color:lightgreen;"| {{result|pass}} Open 'current' links
+| style="background-color:tomato;"| {{result|fail}} search the run's ID or search my runs(assigned to me in advance)
+|-
+| P1
+| Result format
+| style="background-color:lightgreen;"| {{result|pass}} use [[Template:Result]]
+| style="background-color:lightgreen;"| {{result|warn}} Idle, Passed, Failed, Running, Paused, Blocked, Error
 |-
+|
 | Comment as references
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}}
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}}
-|-
-| Result format
-|style="background-color:lightgreen;"| {{result|pass}} use result template
-|style="background-color:lightgreen;"| {{result|pass}} defined
 |-
+|
 | Bug posting
-|style="background-color:lightgreen;"| {{result|pass}} use bug template
+| style="background-color:lightgreen;"| {{result|pass}} use [[Template:Bz]]
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}}
 |-
+| P1
 | Multiple contributions for each case
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}}
-|style="background-color:tomato;"| {{result|fail}} only display the last modified one
+| style="background-color:tomato;"| {{result|fail}} only display the last modified one and logs
 |-
+|
 | *Signatures using
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}} <nowiki>~~~~</nowiki> -> [[User:Rhe|Rhe]] 09:59, 18 January 2011 (UTC)
-|style="background-color:white;"| {{result|unknown}}
+| style="background-color:tomato;"| {{result|fail}}
 |-
-| Search tests/plans
+|}
-|style="background-color:tomato;"| {{result|fail}} by categories or name
+|}
-|style="background-color:lightgreen;"| {{result|pass}}
+{| class="wikitable collapsible collapsed"  border="1" width="90%"
+|-
+! colspan=4 style="background-color: darkgrey;"| Searching Test Results/Cases/Plans
 |-
-| Main/intro page
+|
-|style="background-color:lightgreen;"| {{result|pass}}
+{| class="wikitable sortable" width=100% style="border: solid 2px white"
-|style="background-color:tomato;"| {{result|fail}} link to wiki?
+|-
+! width="10%"|Priority !! width="20%"|Feature !! width="35%"|fedoraproject.org/wiki !! width="35%"|nitrate
 |-
+|
+| Searching cases/plans/runs
+| width="30%" style="background-color:tomato;"| {{result|fail}} only by searching from categories or name
+| width="35%" style="background-color:lightgreen;"| {{result|pass}} advanced search
+|-
+|
 | Toolbox(what links to here)
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}}
-|style="background-color:white;"| {{result|unknown}}
+| style="background-color:lightgreen;"| {{result|pass}} plans, cases, and runs related to each other
 |-
+|}
+|}
+{| class="wikitable collapsible collapsed"  border="1" width="90%"
+|-
+! colspan=4 style="background-color: darkgrey;"| Uploading Files
+|-
+|
+{| class="wikitable sortable" width=100% style="border: solid 2px white"
+|-
+! width="10%"|Priority !! width="20%"|Feature !! width="35%"|fedoraproject.org/wiki !! width="35%"|nitrate
+|-
+| P2
 | Upload files/packages/images
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}} upload somewhere and link to it
-|style="background-color:white;"| {{result|unknown}}
+| style="background-color:lightgreen;"| {{result|warn}} test cases/plans support attachments, test runs don't
 |-
+| P2
 | Upload updates.img/repo to certain server
-|style="background-color:lightgreen;"| {{result|pass}} fedorapeople server
+| style="background-color:lightgreen;"| {{result|pass}} fedorapeople server
-|style="background-color:tomato;"| {{result|fail}} link to wiki?
+| style="background-color:tomato;"| {{result|fail}} link to wiki.
 |-
+|}
+|}
+{| class="wikitable collapsible collapsed"  border="1" width="90%"
+|-
+! colspan=4 style="background-color: darkgrey;"| Generating A Test Summary
+|-
+|
+{| class="wikitable sortable" width=100% style="border: solid 2px white"
+|-
+! width="10%"|Priority !! width="20%"|Feature !! width="35%"|fedoraproject.org/wiki !! width="35%"|nitrate
+|-
+|
+| Result summary/report generation
+| style="background-color:tomato;"| {{result|fail}} run curl command
+| style="background-color:lightgreen;"| {{result|pass}} automaticly
+|-
+|}
+|}
+{| class="wikitable collapsible collapsed"  border="1" width="90%"
+|-
+! colspan=4 style="background-color: darkgrey;"| Administrating
+|-
+|
+{| class="wikitable sortable" width=100% style="border: solid 2px white"
+|-
+! width="10%"|Priority !! width="20%"|Feature !! width="35%"|fedoraproject.org/wiki !! width="35%"|nitrate
+|-
+| P1
 | Authorities for pages
-|style="background-color:lightgreen;"| {{result|pass}} Use namespaces
+| style="background-color:lightgreen;"| {{result|pass}} Use namespaces
-|style="background-color:white;"| {{result|unknown}}
+| style="background-color:yellow;"| {{result|unknown}} Can admin configure it?
 |-
-| Feature enhancement
+|
-|style="background-color:lightgreen;"| {{result|pass}} Add plugin
+| Supporting anonymous user read-only access
-|style="background-color:white;"| {{result|unknown}}
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}}
 |-
+| P1
+| Supporting anonymous user read-write access
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:tomato;"| {{result|fail}}
+|-
+|
+| Feature extension
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}}
+|-
+| P1
 | Page protection
-|style="background-color:lightgreen;"| {{result|pass}} by Admin
+| style="background-color:lightgreen;"| {{result|pass}} by Admin
-|style="background-color:white;"| {{result|unknown}}
+| style="background-color:yellow;"| {{result|unknown}}
 |-
-| Case/plan deletion
+|
-|style="background-color:lightgreen;"| {{result|pass}} by Admin
+| Case/plan/run deletion
-|style="background-color:lightgreen;"| {{result|pass}} Set as DISABLED?
+| style="background-color:lightgreen;"| {{result|pass}} by Admin
+| style="background-color:lightgreen;"| {{result|pass}} Set as DISABLED. Test run can be deleted.
 |-
-| SOP guide page
+|
-|style="background-color:lightgreen;"| {{result|pass}}
+| Licensing
-|style="background-color:tomato;"| {{result|fail}}link to wiki?
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}}
+|-
+| P1
+| License the content
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:yellow;"| {{result|unknown}} should match wiki
+|-
+|
+| Integration with [https://admin.fedoraproject.org/accounts/ FAS]
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:yellow;"| {{result|unknown}}
+|-
+| P2
+| Integration between update tools (bodhi/f-e-k) and our test infrastructure.
+| style="background-color:lightgreen;"| {{result|pass}} investigating
+| style="background-color:yellow;"| {{result|unknown}}
+|-
+| P1
+| Upstream project community
+| style="background-color:lightgreen;"| {{result|pass}} upstream wiki list
+| style="background-color:lightgreen;"| {{result|warn}} upstream nitrate list
+|-
+|}
+|}
+{| class="wikitable collapsible collapsed"  border="1" width="90%"
+|-
+! colspan=4 style="background-color: darkgrey;"| Test Days
 |-
-| Test day/result template page
+|
-|style="background-color:lightgreen;"| {{result|pass}}
+{| class="wikitable sortable" width=100% style="border: solid 2px white"
-|style="background-color:white;"| {{result|unknown}}
+|-
+! width="10%"|Priority !! width="20%"|Feature !! width="35%"|fedoraproject.org/wiki !! width="35%"|nitrate
 |-
-| Test day schedule
+|
-|style="background-color:lightgreen;"| {{result|pass}}
+| Test day main/intro page
-|style="background-color:tomato;"| {{result|fail}} link to wiki?
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|warn}} link to wiki
 |-
-| Test notification
+|
-|style="background-color:tomato;"| {{result|fail}} send out announcement manually
+| Test day SOP guide page
-|style="background-color:lightgreen;"| {{result|fail}} assign through mail
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|warn}}link to wiki
 |-
-| Table format
+|
-|style="background-color:lightgreen;"| {{result|pass}}
+| Test day/event result template page
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:tomato;"| {{result|fail}} Clone from previous test run
 |-
-| Form format
+|
-|style="background-color:tomato;"| {{result|fail}} wiki syntax
+| Test day schedule
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|warn}} link to wiki
 |-
-| Talk page
+| P1
-|style="background-color:lightgreen;"| {{result|pass}}
+| Test day page(run) creation
-|style="background-color:tomato;"| {{result|warn}} User can add comments in test cases
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:tomato;"| {{result|fail}} test runs can only be created from plans
 |-
-| Release Criteria page
+| P1
-|style="background-color:lightgreen;"| {{result|pass}}
+| Test day page documented contents
-|style="background-color:tomato;"| {{result|fail}} link to wiki?
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:tomato;"| {{result|fail}} write all intro to 'Notes' field will be too crowded!
 |-
-| License
+| P2
-|style="background-color:white;"| {{result|unknown}}
+| Test day notification
-|style="background-color:white;"| {{result|unknown}}
+| style="background-color:tomato;"| {{result|fail}} send out announcement manually
+| style="background-color:lightgreen;"| {{result|warn}} can assign through mail, but mail content is little.
 |-
-| Integration with [https://admin.fedoraproject.org/accounts/ FAS]
+|}
-|style="background-color:lightgreen;"| {{result|pass}}
+|}
-|style="background-color:tomato;"| {{result|fail}}
+{| class="wikitable collapsible collapsed"  border="1" width="90%"
+|-
+! colspan=4 style="background-color: darkgrey;"| Release Validation Test Event
 |-
-| Supports anonymous user read-only access
+|
-|style="background-color:lightgreen;"| {{result|pass}}
+{| class="wikitable sortable" width=100% style="border: solid 2px white"
-|style="background-color:lightgreen;"| {{result|pass}}
+|-
+! width="10%"|Priority !! width="20%"|Feature !! width="35%"|fedoraproject.org/wiki !! width="35%"|nitrate
 |-
-| Supports anonymous user read-write access
+|
-|style="background-color:lightgreen;"| {{result|pass}}
+| Test event Main/intro page
-|style="background-color:tomato;"| {{result|fail}}
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|warn}} link to wiki
 |-
-| Data entry format
+|
-|style="background-color:lightgreen;"| [http://www.mediawiki.org/wiki/Help:Formatting mediawiki markup]
+| Test event SOP guide page
-|style="background-color:white;"| {{result|unknown}} [http://tinymce.moxiecode.com/ tinyMCE]?
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|warn}}link to wiki
 |-
-| Test case re-use (write once, link anywhere)
+|
-|style="background-color:lightgreen;"| {{result|pass}} using Category
+| Test event Result template page
-|style="background-color:white;"| {{result|unknown}} Using test plans
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:tomato;"| {{result|fail}} Clone from previous test run.
 |-
-| Test case/plans tags
+|
-|style="background-color:tomato;"| {{result|fail}}
+| Release Criteria page
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|warn}} link to wiki
 |-
-| Bookmarks
+| P1
-|style="background-color:tomato;"| {{result|fail}}
+| Test cases priority
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:tomato;"| {{result|fail}} manually add priority before each case link
+| style="background-color:lightgreen;"| {{result|warn}} from P1 to P5, need change to: Alpha, Beta, Final.
 |-
-| Test case priority
+| P1
-|style="background-color:tomato;"| {{result|fail}} manually add priority before each case link
+| Each case with different platforms
-|style="background-color:lightgreen;"| {{result|warn}} from P1 to P5
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:tomato;"| {{result|fail}} two test runs for both platforms or clone each case for another platform
 |-
-| Tests that impact multiple packages
+|
-|style="background-color:lightgreen;"| {{result|warn}} Categories could be used to organize this data, but get messy
+| Test result page(Test run) creation
-|style="background-color:lightgreen;"| {{result|pass}} allows linking tests to the packages they are designed to test
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}} created from plans
 |-
-| Test case/plan attachments
+| P1
-|style="background-color:tomato;"| {{result|fail}} uploaded somewhere and link to it
+| Test result page documented contents
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:lightgreen;"| {{result|warn}} write intro to 'Notes' field without any syntax
 |-
-| Road map for each run
+| P2
-|style="background-color:tomato;"| {{result|fail}}
+| Test event notification
-|style="background-color:lightgreen;"| {{result|pass}}
+| style="background-color:tomato;"| {{result|fail}} send out announcement manually
+| style="background-color:lightgreen;"| {{result|warn}} can assign through mail, but the content is little.
 |-
-| Group cases by media
+|
-|style="background-color:lightgreen;"| {{result|pass}}flexible design
+| Progress bar for each run
-|style="background-color:tomato;"| {{result|fail}}
+| style="background-color:tomato;"| {{result|fail}}
+| style="background-color:lightgreen;"| {{result|pass}}
+|}
 |}