From Fedora Project Wiki

No edit summary
 
(40 intermediate revisions by 6 users not shown)
Line 7: Line 7:


== Purpose ==
== Purpose ==
{{admon/important| Technical goals TBD | This should be completed by technical participants as we scope the FAD, to meet the general goals above.}}
# Our purpose is to complete the following '''primary''' goals:
# Our purpose is to complete the following '''primary''' goals:
#* Create repositories and workflow for code collaboration including patch review
#* Create repositories and workflow for code collaboration including patch review
#** Where will the code be stored? Where will patches and commit messages go?
#** Who can approve patches? How does one get commit access? (Note: This should be ''as many responsible/trusted committers as possible'', in accordance with good community practice)
#* Complete any remaining architecture/design details for new release tools
#* Complete any remaining architecture/design details for new release tools
#** As much of this should be worked out on mailing list and IRC ''before'' the FAD as possible
#** If additional VMs are needed, complete RFRs for infrastructure
#* Hack (possibly fedmsg-based) framework for product compose
#* Hack (possibly fedmsg-based) framework for product compose
#* (stand up VMs and/or ansible playbooks for required systems?)
#* (stand up VMs and/or ansible playbooks for required systems?)
#* ...
#* ...
# In addition, we will attempt to complete the following '''secondary''' goals as time allows:
# In addition, we will attempt to complete the following '''secondary''' goals as time allows:
#* Early sessions on Fedora Hubs design/user stories - Thursday, [[Fedora Engineering]] team members
#* Early sessions on Fedora Hubs design/user stories - Thursday, [[Fedora Engineering]] team members + [[User:Decause | Remy]]
#* ...
#* ...


== Potential Attendees ==
== Detailed Work Items & Final Attendees ==
 
=== Priorities ===
 
As per the [https://lists.fedoraproject.org/pipermail/rel-eng/2015-June/020298.html rel-eng FAD priority mailing list thread]
 
{|
{|
! Contributor !! Travel, Local, or Remote !! Dates you cannot do (May/June)
! Priorities: Current Gen Tooling !! Task Owner !! Done
|-
|-
|[[User:Ausil| Dennis Gilmore]] || Travel (Illinois) || June 11-13
| working pungi 4 || [[User:Maxamillion | Adam Miller]], [[User:ausil | Dennis Gilmore]], [[User:Parasense | John Disnard]], Dan Mach || [https://pagure.io/pungi/pull-request/4 Mostly done], still debugging a createrepo issue though.
|-
|-
|<strike>[[User:till|Till Maas]]</strike> || <strike>Travel (from Europe)</strike> || (can't attend due to sudden work conflict)
| rawhide looking like a TC/RC || [[User:Maxamillion | Adam Miller]], [[User:ausil | Dennis Gilmore ]] || Blocked on Pungi4
|-
|-
|[[User:pbrobinson|Peter Robinson]] || Travel (from Europe) || TBD
| Determine how stage koji needs to be setup/configured to be useful as a place to deploy dev versions of rel-eng tooling and then get it setup/deployed, ansiblized. || Ralph Bean || [https://lists.fedoraproject.org/pipermail/infrastructure/2015-June/016377.html DONE] [https://lists.fedoraproject.org/pipermail/buildsys/2015-June/004779.html Follow Up]
|-
|-
|[[User:sharkcz|Dan Horák]] || Remote (CZ) || TBD
! Prorities: Next Gen Tooling !! Task Owner !! Done
|-
|-
|[[User:dgregor|Dennis Gregorovic]] || Local (Westford) || May 29, June 5, June 23-26
| define what [[Compose_Database | composedb]] should be || [[User:Maxamillion | Adam Miller]], Ralph Bean || Work in progress, proposal to mailing list pending write up
|-
|-
|[[User:ralph|Ralph Bean]] || Travel (Rochester, NY) || June 3
| koji 2.0 Draft document (Discussion has begun [https://lists.fedoraproject.org/pipermail/buildsys/2015-June/004763.html here]. Deliverable would be a well documented plan that can begin to be executed upon. || [[User:mikem | Mike McLean]], [[User:mikeb | Mike Bonnett]] || DONE - Awaiting proposal/writeup to [https://lists.fedorahosted.org/mailman/listinfo/koji-devel koji-devel mailing list]
|-
|-
|[[User:decause|Remy DeCausemaker]] || Travel (Rochester, NY) || TBD
| koji [[Koji/ContentGenerators | content generators]] and the metadata format (How does this fit into koji 1.x, how can it fit into koji 2.x, roadmap/development work on getting it into koji 1.x) || [[User:mikem | Mike McLean]], [[User:mikeb | Mike Bonnett]] || DONE - Awaiting proposal/writeup to [https://lists.fedorahosted.org/mailman/listinfo/koji-devel koji-devel mailing list] - Also a lot of documentation [[Koji/ContentGenerators | here]].
|-
|-
| [[User:Lmacken|Luke Macken]] || Travel (Denver, CO) || June 18-25
|}
 
=== Deliverables ===
 
{|
! Nice to haves: Current Gen Tooling Deliverable !! Task Owner !! Done
|-
|-
|[[User:jgreguske|Jay Greguske]] || Local (Westford, MA) || Having a kid around June 22nd
| Stage koji setup/deployed, ansiblized. (To enable dev/test of rel-eng tooling)|| Ralph Bean || Work in Progress
|-
|-
| [[User:mikem|Mike McLean]] || Local (Raleigh) || May 1, 22-25, 30; Jun 3, 18
| integrated ability to make atomic installer and pxe to live in pungi || [[User:Maxamillion | Adam Miller]] || Work in Progress, currently blocked on Pungi4
|-
|-
| [[User:gsterlin|Greg Sterling]] || Local (Westford) || Jun 25, 31
| mash ported to createrepo_c || [[User:Ausil | Dennis Gilmore]], [[User:Parasense | Jon Disnard]], Ian Mcleod, Dan Mach || Not done at FAD, will be followed up on.
|-
|-
| [[User:maxamillion|Adam Miller]] || Travel (Fort Worth, TX) || TBD
| bodhi2 able to trigger atomic installer and pxe to live as part of the update push process. || [[User:Lmacken | Luke Macken ]] || Currently blocking on Pungi4
|-
|-
| [[User:Wwoods|Will Woods]] || Travel (Raleigh) || ?
| livemedia-creator koji integration || ||
|-
|-
| [[User:Walters|Colin Walters]] || Local (Westford, MA) || TBD
| koji able to manage the url line in kickstarts so that we can do real builds || [[User:bstinson | Brian Stinson]] || DONE [https://lists.fedorahosted.org/pipermail/koji-devel/2015-June/000026.html Patch submitted upstream]
|-
|-
| [[User:imcleod|Ian McLeod]] || Travel (Chicago) || Soft-May 30,31; June 6,12  Hard-June 13
| run-root plugin configured || Dan Mach, Ralph Bean || [https://lists.fedorahosted.org/pipermail/koji-devel/2015-June/000026.html Patches required], [http://koji.stg.fedoraproject.org/koji/taskinfo?taskID=537343 fixed and pushed in Stage]. Ansible configs in and committed for Stage. Ralph to follow up on PROD.
|-
|-
| [[User:parasense|Jon Disnard]] || Travel (Dallas) || May 13th
| Secondary arches working exactly the same as primary || [[User:Ausil | Dennis Gilmore]], [[User:Pbrobinson | Peter Robinson]] ||
|-
| port pungi to dnf || Dan Mach || Some progress made, 18/45 test cases still failing. Dan Mach to follow to completion.
|-
| make headway and plan to port to python 3 || Dan Mach ||
|-
| have koji be able to specify the backend for installing packages into chroots on a per target basis. we will need to use yum/yum-deprecated for most but we will want to use dnf for rawhide and new releases. yum-deprecated will be needed when we move builders to f22 || [[User:Mikem | Mike McLean]] ||
|-
! Nice to haves: Next Gen Tooling Deliverable !! Task Owner !! Done
|-
| koji 2.0 prototype || [[User:Mikem | Mike McLean]], [[User:Mikeb | Mike Bonnett]] ||  
|-,
|}


=== Attendees and Travel Details ===
{|
! Contributor !! Arrival !! Departure !! Roommate
|-
|[[User:Ausil| Dennis Gilmore]] || Sun 2015-05-31, AA #1299, 12:02 || Mon 2015-06-08, AA #40, 19:30 || Peter Robinson
|-
|[[User:pbrobinson|Peter Robinson]] || Sun 2015-05-31, VS #011, 15:25 || Mon, 2015-06-08, VS #012, 21:50 || Dennis Gilmore
|-
|[[User:ralph|Ralph Bean]] ||  ||  || n/a
|-
|[[User:decause|Remy DeCausemaker]] || Wed 2015-06-03, US #3916, 16:55 || Tues, 2015-06-09, US #3807, 17:20  || TBD
|-
| [[User:Lmacken|Luke Macken]] || Wed 2015-06-03, JB #494, 18:47 || Tue 2015-06-09, JB #993, 19:40 || Adam Miller
|-
| [[User:mikem|Mike McLean]] || Sun 2015-05-31, JB #984, 18:45 || Mon 2015-06-08, JB #1583, 18:00 ||
|-
| [[User:maxamillion|Adam Miller]] || Wed 2015-06-03, US #1389, 18:17 || Mon 2015-06-08, AA #1288, 12:54 || Luke Macken
|-
| [[User:Wwoods|Will Woods]] || Thu 2015-06-04, DL #3504, 11:10 || Mon 2015-06-08, DL #3765, 19:30 || Ian McLeod
|-
| [[User:Walters|Colin Walters]] || n/a || n/a || n/a
|-
| [[User:imcleod|Ian McLeod]] || Thu 2015-06-04, AA #1240, 10:24 || Mon 2015-06-08, AA #40, 19:30 || Will Woods
|-
| [[User:parasense|Jon Disnard]] || Sun 2015-05-31, AA #1429, 16:39 || Mon 2015-06-08, AA #1178, 16:16 || TBD
|-
| [[User:Lkocman|Luboš Kočman]] || Sun 2015-05-31, AA #6227, 18:55 || Mon 2015-06-08, AA #6163, 19:10 || Daniel Mach
|-
| [[User:bstinson|Brian Stinson]] || Thu 2015-06-04, US #1299, 12:05 || Mon 2015-06-08, US #197, 17:35 ||
|-
! colspan=4 | Remote attendees
|-
| colspan=4 | [[User:sharkcz|Dan Horak]] (TBD)
|}
|}


== Detailed Work Items & Final Attendees ==
<!--
* TBD


== Planning Prerequisites ==
== Planning Prerequisites ==
Line 63: Line 120:
See the [[How to organize a FAD]] list; you can keep your to-do list here.
See the [[How to organize a FAD]] list; you can keep your to-do list here.


* Work out budget
* <strike>Work out budget</strike>
* <strike>Decide on Dates and Location</strike>
* <strike>Decide on Dates and Location</strike>
* <strike>Arrange Facilities</strike>
* <strike>Arrange Facilities</strike>
* List Resources
* <strike>List Resources</strike>
* Be Somewhat Structured
* <strike>Be Somewhat Structured</strike>
* Arrange Lodging
* <strike>Arrange Lodging</strike>
* Arrange Refreshments
* Arrange Refreshments
* Arrange a Social Event
* Arrange a Social Event
* Another action item
 
* Another action item
-->
* Another action item


== Plan ==
== Plan ==
# '''Location:''' Red Hat, Westford, MA USA
# '''Location:''' Red Hat, Westford, MA USA
# '''Date:''' Jun-04 to Jun-08
# '''Date:''' Jun-04 to Jun-08
#* Considerations:
#* Jun-04 -- Fedora Hubs workshop (for Fedora team members) -- in Mount Greylock CR (3rd floor)
#** F22 release date is heavily time-driven, 2015-May-19, but our record is not good :-)
#* Jun-05 -- 09:00am - 6:00pm - Waterford Valley CR (1st floor)
#** Red Hat Summit is 2015-Jun-26 to 2015-Jun-29
#* Jun-06 -- 10:00am - 6:00pm - Waterford Valley CR (1st floor)
#** Don't want to wait too long for hackfest after Adam Miller is on board (2015-Apr-13), strike while iron is hot
#* Jun-07 -- 10:00am - 6:00pm - Waterford Valley CR (1st floor)
#** Don't want to drag PyCon attendees (Apr 6-16?) around the country too much at one time
#* Jun-08 -- departure date
# '''Remote Attendees:''' https://redhat.bluejeans.com/4332589184
# '''Schedule'''
# '''Schedule'''
#* International participants arrive Wed before
#* Fedora Engineering team domestic participants arrive Wed before (for Thu Hubs session)
#* Fedora Engineering team domestic participants arrive Wed before (for Thu Hubs session)
#* Non-Fedora Engineering team domestic participants arrive Thu before
#* Non-Fedora Engineering team domestic participants arrive Thu before
Line 91: Line 147:
#* Sun -- Work day
#* Sun -- Work day
#* Participants leave Mon (or Sunday night if required)
#* Participants leave Mon (or Sunday night if required)
# Important skills
#* Python (vital!)
#* bash
#* understanding of release deliverables
#* knowledge of fedmsg and other backend technologies helpful
#* knowledge of Koji processes and internals helpful
#* Will Woods from Anaconda team
# Other considerations
#* Raleigh was site of [[FAD MirrorManager2 FAS3 2014 | a previous FAD]] and is probably a good cost-based option.
#** Did the space last time work out OK?
#* Paul can drive to the event and possibly do some airport pickups.
#* International community members need as much as advance notice as possible


== Logistics ==
== Logistics ==
Line 112: Line 156:
'''Lunch:'''
'''Lunch:'''
* Days other than Thu/Fri/Sat/Sun to be covered by attendees.
* Days other than Thu/Fri/Sat/Sun to be covered by attendees.
* Thu: Use office facility, cost covered (est. $75)
* Thu: Order in, cost covered (est. $125)
* Fri: Use office facility, cost covered (est. $100)
* Fri: Order in, cost covered (est. $125)
* Sat: Order in, cost covered (est. $125)
* Sat: Order in, cost covered (est. $125)
* Sun: Order in, cost covered (est. $125)
* Sun: Order in, cost covered (est. $125)
Line 121: Line 165:
* Thu: ad-hoc
* Thu: ad-hoc
* Fri: Team @ local venue (est. $300)
* Fri: Team @ local venue (est. $300)
* Sat: Team @ local venue (est. $300 - covered by Fedora Engineering)
* Sat: Team @ local venue (est. $300)
* Sun: Team @ local venue (est. $300)
* Sun: Team @ local venue (est. $300)


'''Total food: est. $1325'''
'''Total food: est. $1400'''


== Travel estimates ==
== Travel estimates ==
Line 135: Line 179:
| Peter Robinson  || -    || -    || -    || -    || covered by RCM
| Peter Robinson  || -    || -    || -    || -    || covered by RCM
|-
|-
| Ralph Bean      ||    || $200 ||      || $ 50 || (parking from F-Eng budget)
| Ralph Bean      ||    || $100 (gas) ||      || $ 50 || (parking from F-Eng budget)
|-
|-
| Daniel Mach      || -    || -    || -    || -    || covered by RCM
| Daniel Mach      || -    || -    || -    || -    || covered by RCM
|-
|-
| Luke Macken    ||    || $335 ||      || $ 50 || (parking from F-Eng budget)
| Luke Macken    ||    || $390 ||      || $ 50 || (parking from F-Eng budget)
|-
|-
| Mike McLean  || -    || -    || -    || -    || covered by RCM
| Mike McLean  || -    || -    || -    || -    || covered by RCM
Line 152: Line 196:
|}
|}


# '''Travel:''' $500 rental minivan + $970 above = $1470
# '''Travel:''' $500 rental minivan + $1175 above = $1675
# '''Housing:''' $2090
# '''Housing:''' $1185
#* based on 8 domestic + 2 international participants
#* Hampton Inn Westford/Chelmsford, <http://ur1.ca/ka20d> -- $117/night
#* Radisson Heritage, Chelmsford MA: $99/night * 4 nights * 1 rooms; $99/night * 5 nights * 5 rooms
#** for FAD budget: 1 room 4 nights, 1 room 5 nights = 9 nights + tax = ~$1185
#* (other possibilities)
#* Ralph Bean: $65 * 5 nights = $325
# '''Space:'''
# '''Space:'''
#* $0 if Supplied by Red Hat
#* $0 if Supplied by Red Hat
# '''Supplies:'''
# '''Supplies:'''
#* N/A
#* N/A
# '''Food:''' $1325 (from above)
# '''Food:''' $1400 (from above)
 
''Total budget:  $4,585''


''Total budget:  $4,835''


[[Category:FAD]]
[[Category:FAD]]

Latest revision as of 17:57, 12 June 2015

This is the main page for FAD Release Tools and Infrastructure 2015. This hackathon is intended to take release tools and process to the next level in Fedora for F23/F24 and beyond.

  • Modularize the compose process
  • Replace serial bash script with easier to hack and maintain Python tools
  • Establish dependency management of compose deliverables
  • Cut time to provide updates to users for critical security fixes

Purpose

  1. Our purpose is to complete the following primary goals:
    • Create repositories and workflow for code collaboration including patch review
      • Where will the code be stored? Where will patches and commit messages go?
      • Who can approve patches? How does one get commit access? (Note: This should be as many responsible/trusted committers as possible, in accordance with good community practice)
    • Complete any remaining architecture/design details for new release tools
      • As much of this should be worked out on mailing list and IRC before the FAD as possible
      • If additional VMs are needed, complete RFRs for infrastructure
    • Hack (possibly fedmsg-based) framework for product compose
    • (stand up VMs and/or ansible playbooks for required systems?)
    • ...
  2. In addition, we will attempt to complete the following secondary goals as time allows:

Detailed Work Items & Final Attendees

Priorities

As per the rel-eng FAD priority mailing list thread

Priorities: Current Gen Tooling Task Owner Done
working pungi 4 Adam Miller, Dennis Gilmore, John Disnard, Dan Mach Mostly done, still debugging a createrepo issue though.
rawhide looking like a TC/RC Adam Miller, Dennis Gilmore Blocked on Pungi4
Determine how stage koji needs to be setup/configured to be useful as a place to deploy dev versions of rel-eng tooling and then get it setup/deployed, ansiblized. Ralph Bean DONE Follow Up
Prorities: Next Gen Tooling Task Owner Done
define what composedb should be Adam Miller, Ralph Bean Work in progress, proposal to mailing list pending write up
koji 2.0 Draft document (Discussion has begun here. Deliverable would be a well documented plan that can begin to be executed upon. Mike McLean, Mike Bonnett DONE - Awaiting proposal/writeup to koji-devel mailing list
koji content generators and the metadata format (How does this fit into koji 1.x, how can it fit into koji 2.x, roadmap/development work on getting it into koji 1.x) Mike McLean, Mike Bonnett DONE - Awaiting proposal/writeup to koji-devel mailing list - Also a lot of documentation here.

Deliverables

Nice to haves: Current Gen Tooling Deliverable Task Owner Done
Stage koji setup/deployed, ansiblized. (To enable dev/test of rel-eng tooling) Ralph Bean Work in Progress
integrated ability to make atomic installer and pxe to live in pungi Adam Miller Work in Progress, currently blocked on Pungi4
mash ported to createrepo_c Dennis Gilmore, Jon Disnard, Ian Mcleod, Dan Mach Not done at FAD, will be followed up on.
bodhi2 able to trigger atomic installer and pxe to live as part of the update push process. Luke Macken Currently blocking on Pungi4
livemedia-creator koji integration
koji able to manage the url line in kickstarts so that we can do real builds Brian Stinson DONE Patch submitted upstream
run-root plugin configured Dan Mach, Ralph Bean Patches required, fixed and pushed in Stage. Ansible configs in and committed for Stage. Ralph to follow up on PROD.
Secondary arches working exactly the same as primary Dennis Gilmore, Peter Robinson
port pungi to dnf Dan Mach Some progress made, 18/45 test cases still failing. Dan Mach to follow to completion.
make headway and plan to port to python 3 Dan Mach
have koji be able to specify the backend for installing packages into chroots on a per target basis. we will need to use yum/yum-deprecated for most but we will want to use dnf for rawhide and new releases. yum-deprecated will be needed when we move builders to f22 Mike McLean
Nice to haves: Next Gen Tooling Deliverable Task Owner Done
koji 2.0 prototype Mike McLean, Mike Bonnett

Attendees and Travel Details

Contributor Arrival Departure Roommate
Dennis Gilmore Sun 2015-05-31, AA #1299, 12:02 Mon 2015-06-08, AA #40, 19:30 Peter Robinson
Peter Robinson Sun 2015-05-31, VS #011, 15:25 Mon, 2015-06-08, VS #012, 21:50 Dennis Gilmore
Ralph Bean n/a
Remy DeCausemaker Wed 2015-06-03, US #3916, 16:55 Tues, 2015-06-09, US #3807, 17:20 TBD
Luke Macken Wed 2015-06-03, JB #494, 18:47 Tue 2015-06-09, JB #993, 19:40 Adam Miller
Mike McLean Sun 2015-05-31, JB #984, 18:45 Mon 2015-06-08, JB #1583, 18:00
Adam Miller Wed 2015-06-03, US #1389, 18:17 Mon 2015-06-08, AA #1288, 12:54 Luke Macken
Will Woods Thu 2015-06-04, DL #3504, 11:10 Mon 2015-06-08, DL #3765, 19:30 Ian McLeod
Colin Walters n/a n/a n/a
Ian McLeod Thu 2015-06-04, AA #1240, 10:24 Mon 2015-06-08, AA #40, 19:30 Will Woods
Jon Disnard Sun 2015-05-31, AA #1429, 16:39 Mon 2015-06-08, AA #1178, 16:16 TBD
Luboš Kočman Sun 2015-05-31, AA #6227, 18:55 Mon 2015-06-08, AA #6163, 19:10 Daniel Mach
Brian Stinson Thu 2015-06-04, US #1299, 12:05 Mon 2015-06-08, US #197, 17:35
Remote attendees
Dan Horak (TBD)


Plan

  1. Location: Red Hat, Westford, MA USA
  2. Date: Jun-04 to Jun-08
    • Jun-04 -- Fedora Hubs workshop (for Fedora team members) -- in Mount Greylock CR (3rd floor)
    • Jun-05 -- 09:00am - 6:00pm - Waterford Valley CR (1st floor)
    • Jun-06 -- 10:00am - 6:00pm - Waterford Valley CR (1st floor)
    • Jun-07 -- 10:00am - 6:00pm - Waterford Valley CR (1st floor)
    • Jun-08 -- departure date
  3. Remote Attendees: https://redhat.bluejeans.com/4332589184
  4. Schedule
    • Fedora Engineering team domestic participants arrive Wed before (for Thu Hubs session)
    • Non-Fedora Engineering team domestic participants arrive Thu before
    • Fri -- Work day
    • Sat -- Work day
    • Sun -- Work day
    • Participants leave Mon (or Sunday night if required)

Logistics

Snacks/Beverages: Can be snarfed from Westford office

Breakfast:

  • Covered at hotel

Lunch:

  • Days other than Thu/Fri/Sat/Sun to be covered by attendees.
  • Thu: Order in, cost covered (est. $125)
  • Fri: Order in, cost covered (est. $125)
  • Sat: Order in, cost covered (est. $125)
  • Sun: Order in, cost covered (est. $125)

Dinner:

  • Days other than Thu/Fri/Sat/Sun to be covered by attendees
  • Thu: ad-hoc
  • Fri: Team @ local venue (est. $300)
  • Sat: Team @ local venue (est. $300)
  • Sun: Team @ local venue (est. $300)

Total food: est. $1400

Travel estimates

Contributor Taxi/transport (to/from home) Airfare Taxi/transport (to/from site) Parking Other
Dennis Gilmore - - - - covered by RCM
Peter Robinson - - - - covered by RCM
Ralph Bean $100 (gas) $ 50 (parking from F-Eng budget)
Daniel Mach - - - - covered by RCM
Luke Macken $390 $ 50 (parking from F-Eng budget)
Mike McLean - - - - covered by RCM
Adam Miller $225 $ 50 (parking from F-Eng budget)
Will Woods $210 $ 50 (parking from Anaconda or F-Eng budget)
Ian McLeod $250 $ 50
Jon Disnard - - - - covered by RCM
  1. Travel: $500 rental minivan + $1175 above = $1675
  2. Housing: $1185
    • Hampton Inn Westford/Chelmsford, <http://ur1.ca/ka20d> -- $117/night
      • for FAD budget: 1 room 4 nights, 1 room 5 nights = 9 nights + tax = ~$1185
    • Ralph Bean: $65 * 5 nights = $325
  3. Space:
    • $0 if Supplied by Red Hat
  4. Supplies:
    • N/A
  5. Food: $1400 (from above)

Total budget: $4,585