From Fedora Project Wiki

Monthly Status for Priority Pipeline Projects

17OCT2017

Committed F27 Changes

Change Priority Status Now Next
Modularity High Blocked #1900 Masher is currently being integrated with Bodhi to ship modules. #7074 Compose configuration changes complete for modular Fedora. #7054 Koji upgraded to 1.14.0. #60 Modular server replicated to mirrors correctly. #7056 Information on modular composes in PDC. #7057, #7058 Blocked on compose request for setup and generating torrents which is the remaining known rel eng work for this effort.
Flatpaks Medium Blocked Blocked on modularity work - in particularly #6192 ODCS. OCI support for registry.fedoraproject.org; an index for registry.fedoraproject.org; OSBS support.
Shipping without an alpha Medium At risk Greenwave to give results on the gating criteria. Investigation on implementing policy change.
Porting to Python 3- rpkg and fedpkg Medium Off target rpkg and fedpkg currently being ported in parallel, but will not be complete in F27 cycle. No major impact of miss b/c python 2 will be EOL in 2019. Continue to push for implementation in F28 cycle.
Porting to Python 3- rel eng scripts Medium Off target Critical rel eng scripts have been ported to Python 3. Not all rel eng scripts will be ported in F27. No major impact of miss b/c python 2 will be EOL in 2019. Continue to push for implementation in F28 cycle.
Porting to Python 3- rel eng scripts to DNF Medium Off target Critical rel eng scripts have been ported to use DNF. Not all rel eng scripts will be ported to DNF in F27. No major impact of miss b/c python 2 will be EOL in 2019. Continue to push for implementation in F28 cycle.
Porting to Python 3- pungi Medium Blocked Waiting for Kobo release for work to complete. No major impact of miss b/c python 2 will be EOL in 2019.
#300 Support for accelerating the Fedora Atomic Host: Consolidate ostree generation process for pre-GA and post-GA OSTree generation / support for multi arch ostrees / better versioning of ostrees High Complete Differences in Bodhi mash file hierarchy and Pungi repo hierarchy have been resolved; support for bodhi-backend01to run Pungi composes completed; Mirrormanager now handle changes to updates repos file hierarchy output by Bodhi
Koji hub consolidation for s390 Low Complete
compose IDs closely match Low Complete

Other

15AUG2017

Committed F27 Changes

Change Priority Status Risks/Open Issues Next
#300 Support for accelerating the Fedora Atomic Host: Consolidate ostree generation process for pre-GA and post-GA OSTree generation / support for multi arch ostrees / better versioning of ostrees High On target Almost there; bodhi+pungi running in stage #6192 Need support for bodhi-backend01 to run pungi composes and #6193 to resolve differences in bodhi mash file hierarchy and pungi repo hierarchy
Modularity High On target Bodhi is waiting on PR #1697 masher which is underway; still on target for release
Flatpaks Medium Some risk Wrangling code into upstream projects; marking this at risk since a good amount of work is left to complete here #6182 The On Demand Compose Server (ODCS) needs to be deployed. Once the changes to the OSBS components (atomic-reactor, osbs-client, koji-containerbuild) have landed, they need to be updated within Fedora. [https://github.com/docker/distribution/pull/2076, #2076 needs to land. We need to allow people to easily install the built flatpaks, we need to generate a static downloadable index of registry.fedoraproject.org.
Shipping without an alpha Medium On target Need to make composes gating Rel eng working to write configuration to do so
Porting to Python 3- rpkg and fedpkg Medium Off target rpkg and fedpkg currently being ported in parallel Major goal is to complete this work in next one or two versions after rpkg-1.50 and fedpkg-1.29.
Porting to Python 3- rel eng scripts Medium Off target Large amount of linting errors to work through Will focus on trying to get most "critical" scripts (e.g. scripts that run compose) ported before beta freeze
Porting to Python 3- rel eng scripts to DNF Medium On schedule Conversion to DNF scripts well underway; working on ancilliary tasks Switching DNF configs to use Pungi
Porting to Python 3- pungi Medium Some risk Currently have a branch that passes all unit tests on Python 3, but no full compose with that branch Need for Kobo.
Koji hub consolidation for s390 Low On target Compose host to be setup with correct mounts
compose IDs closely match Low Complete

Other


14JUNE2017

Committed F26 Changes

Change Priority Status Risks/Open Issues Next
Kerberos support in koji, fedpkg, OSBS High Done
Public hardware for AutoCloud Low Done
Distgit: Check when people add Exclude/ExclusiveArch to packages, notify the arch teams Low Done
Taskotron High Done
Atomic release reorientation High Done
Fedora dockerfiles support for Beta Medium Done
Bodhi: Design for supporting for containers Low Done
F26 Hub consolidation: aarch64 & Power64 koji merged; prep to import s390x in F27 Medium Done
ARM Disk Images, aarch64 and PXE2Live are created using LMC High Done Kernel bug is causing image creation to fail but dev work complete
Pungi changes to allow non-blocking artifacts to fail without failing the compose Medium Done
Ansible: Docker 2 week build/test/release workflow automated High Blocked Working the OSBS team to leverage existing mechanisms to build layered images to handle parent image inheritance and monitor the "image stream" of updates. Work is dependent on "orchestrator cluster" and "worker cluster" OSBS architecture which is still under active development. Deliverable will miss 6-27 date due to dependency on OSBS work. Loopable is deployed in stage and planned to roll out after freeze is lifted.
OSBS has redundancy and support for multi-master / multi-node High In progress Current multi-node environment can be scaled as necessary. Collaborating with the Fedora Infrastructure Team to request more resources for OSBS in order to scale the masters.
OSBS: Fedora Docker Registry High Delayed Deployed to stage. Will be deployed to production after F26 beta freeze and before F26 final.

Other

  • F27 planning is finalized; the major themes will be support for modularity, allowing Fedora to ship with alpha, accelerating the Fedora Atomic Host, and porting to Python 3

02MAY2017

Committed F26 Changes

Change Priority Status Risks/Open Issues Next
Kerberos support in koji, fedpkg, OSBS High Done
Public hardware for AutoCloud Low Done
Distgit: Check when people add Exclude/ExclusiveArch to packages, notify the arch teams Low Done
Taskotron High Done
Atomic release reorientation High Done
Fedora dockerfiles support for Beta Medium Done
Bodhi: Design for supporting for containers Low Done
F26 Hub consolidation: aarch64 & Power64 koji merged; prep to import s390x in F27 Medium Done
ARM Disk Images, aarch64 and PXE2Live are created using LMC High Done Kernel bug is causing image creation to fail but dev work complete
Pungi changes to allow non-blocking artifacts to fail without failing the compose Medium Done
Ansible: Docker 2 week build/test/release workflow automated High In-Progress Final loopabull patch has been submitted. Planning for stage deployment the week after summit (5/15)
OSBS has redundancy and support for multi-master / multi-node High In progress Scale testing dropped Remaining work is only to get metrics stood up using hawkular
OSBS: Fedora Docker Registry High In progress no change here; awaiting stage testing & monitoring and a prod VM deploy Now that the minimal registry is deployed, next step is scaling

Other

  • Support for non x86_64 ostrees as part of standard build & release process moved to F27
  • Move releng, mash & pungi from yum to dnf
    • The work for pungi is done, but not turned on in production; will be working to finalize this in F27
  • F27 planning is just about finalized; the major themes will be support for modularity, allowing Fedora to ship with alpha, accelerating the Fedora Atomic Host, and porting to Python 3

20MAR2017

Committed F26 Changes

Change Priority Status Risks/Open Issues Next
Kerberos support in koji, fedpkg, OSBS High Done
Public hardware for AutoCloud Low Done
Distgit: Check when people add Exclude/ExclusiveArch to packages, notify the arch teams Low Done
Taskotron High Done
Atomic release reorientation High Done
Fedora dockerfiles support for Beta Medium Done
Bodhi: Design for supporting for containers Low Done
F26 Hub consolidation: aarch64 & Power64 koji merged; prep to import s390x in F27 Medium Done
ARM Disk Images, aarch64 and PXE2Live are created using LMC High Done Kernel bug is causing image creation to fail but dev work complete
Pungi changes to allow non-blocking artifacts to fail without failing the compose Medium In progress Will be blocked on a new Koji release that has been planned for April 5 Update Koji in Stage after April 5 & Prod after freeze lifts
Move releng, mash & pungi from yum to dnf High In progress Rust support requirements from advanced functionality in DNF are not included in this work but are being requested; need to route those to the right owner for decision making and prioritization; need to get some sort of "shadow" compose created to begin comparing dnf output to yum releng scripts not started; Mash update is in progress; python-mutlilib ported to support DNF; Pungi support is almost done
Ansible: Docker 2 week build/test/release workflow automated High In-Progress Rewriting some pieces for better future tooling integration based on feedback from releng Build, test, release automation exist individually; next step is wiring them all together
OSBS has redundancy and support for multi-master / multi-node High In progress None Multi node infra is live in prod. Pending scale testing on multi node infra.
OSBS: Fedora Docker Registry High In progress awaiting stage testing & monitoring and a prod VM deploy Now that the minimal registry is deployed, next step is scaling
Support for non x86_64 ostrees as part of standard build & release process Medium Not started Resourcing Awaiting confirmation from Atomic WG that this is desirable & a priority

Other

  • In the process of deploying a UI for our container registry - hoping to demo in April
  • F27 planning will be scheduled in April

06MAR2017

Committed F26 Changes

Change Priority Status Risks/Open Issues Next
Kerberos support in koji, fedpkg, OSBS High Done Live in stage & prod
Public hardware for AutoCloud Low Done
Distgit: Check when people add Exclude/ExclusiveArch to packages, notify the arch teams Low Done
Taskotron High Done Feedback from users
Atomic release reorientation High Done
Fedora dockerfiles support for Beta Medium Done
Bodhi: Design for supporting for containers Low Done
Pungi changes to allow non-blocking artifacts to fail without failing the compose Medium Blocked UPDATE 15MAR16 - temporarily unblocked but will be blocked on a new Koji release that has been planned for April 5 Bug identifed in Koji#306 that requires a release & update; blocked on deploying update in stage for testing
ARM Disk Images, aarch64 and PXE2Live are created using LMC High Delayed UPDATE 15MAR16 - image composes are working in ImageFactory except for one arch that has a kernel bug
Move releng, mash & pungi from yum to dnf High In progress Rust support requirements from advanced functionality in DNF are not included in this work but are being requested; need to route those to the right owner for decision making and prioritization releng scripts not started; Mash update is in progress; python-mutlilib ported to support DNF; Pungi support is almost done
Ansible: Docker 2 week build/test/release workflow automated High In-Progress None Build, test, release automation exist individually; next step is wiring them all together
OSBS has redundancy and support for multi-master / multi-node High In progress None Multi node infra is live in prod. Pending scale testing on multi node infra.
OSBS: Fedora Docker Registry High In progress awaiting stage testing & monitoring and a prod VM deploy Now that the minimal registry is deployed, next step is scaling
F26 Hub consolidation: aarch64 & Power64 koji merged; prep to import s390x in F27 Medium In Progress None Requirements for aarch64 & Power are complete; s390 import is running and may make it in for F26 also
Support for non x86_64 ostrees as part of standard build & release process Medium Not started Resourcing Awaiting confirmation from Atomic WG that this is desirable & a priority

Other

08FEB2017

Committed F26 Changes

Change Priority Status Risks/Open Issues Next
Kerberos support in koji, fedpkg, OSBS High Done None Live in stage & prod
Public hardware for AutoCloud Low Done None
Distgit: Check when people add Exclude/ExclusiveArch to packages, notify the arch teams Low Done None
ARM Disk Images, aarch64 and PXE2Live are created using LMC High Delayed Decision to focus on moving from appliance creator to Image Factory temporarily
Taskotron High Delayed Remaining work Stage update live; prod update pending decision about storing tests in dist-git and
Pungi changes to allow non-blocking artifacts to fail without failing the compose Medium Delayed Koji updates deployed; bug identifed in Koji#306 that requires a release & update
Ansible: Docker 2 week build/test/release workflow automated High In-Progress None Automation Notes and Action Items Etherpad
Atomic release reorientation High In progress Deployment is in progress this week
OSBS has redundancy and support for multi-master / multi-node High In progress None Multi node infra is live in prod. Pending scale testing on multi node infra.
Move releng, mash & pungi from yum to dnf High In progress None releng scripts & pungi port in progress; pending work to port python multi-lib to dnf instead of updating mash itself
OSBS: Fedora Docker Registry High In progress Decision made to run registry in OSD; planning completed Dec 14; implementation in progress
F26 Hub consolidation: aarch64 & Power64 koji merged; prep to import s390x in F27 Medium In Progress Pending hardware configuration for aarch64/Power; s390 prep on target & may make it in early
Fedora dockerfiles support for Beta Medium Not started Planned for February activity day
Bodhi: Design for supporting for containers Low Not started Resourcing
Support for non x86_64 ostrees as part of standard build & release process Medium Not started Resourcing

Other

14DEC2016

Committed F26 Changes


Change Priority Status Risks/Open Issues Next
Kerberos support in koji, fedpkg, OSBS High Done None Live in stage & prod
Atomic release reorientation High Blocked No available resources to work on this issue; open as a high priority for a year ???
ARM Disk Images, aarch64 and PXE2Live are created using LMC High Blocked Mohan's testing is failing - requires fixes from LMC team
Live cd creator is very fragile and could break at any moment, moving off is crucial
Create problem report for LMC to review
Taskotron High Blocked Remaining work Dev update live; prod update pending decision about storing tests in dist-git and fixing fedmsg events
Ansible: Docker 2 week build/test/release workflow automated High In-Progress None Automation Notes and Action Items Etherpad
OSBS has redundancy and support for multi-master / multi-node High In progress None Multi node infra is live in prod. Scale testing on multi node infra.
Move releng, mash & pungi from yum to dnf High In progress DGilmore is the only active contributor to Mash Identify backup for Mash work; begin to update releng scripts
OSBS: Fedora Docker Registry High In progress Decision made to run registry in OSD; planning completed Dec 14; implementation to begin before shut down
Koji support for disk images High Not started Resourcing & prioritization from Brew Pending functional disk image builds in LMC
Deploy koji signed repo support - scope work for Pungi & Bodhi to use it Medium Blocked Need PR revisions due to the amount of elapsed time
Also need to support DNF in PR
ongoing delays on the merge will impact our ability to scope work for Pungi & Bodhi
Pungi changes to allow non-blocking artifacts to fail without failing the compose Medium Blocked Need koji updates deployed to stage for testing and dev
F26 Hub consolidation: aarch64 & Power64 koji merged; prep to import s390x in F27 Medium In Progress Need status update from Mohan
add index.asc files for cloud images for virt-builder Medium Not started Resourcing
Fedora dockerfiles support for Beta Medium Not started Resourcing
ostree mirroring Medium Not started Resourcing
Distgit: Check when people add Exclude/ExclusiveArch to packages, notify the arch teams Low In Progress None Tweaking setup to reflect requirements
Public hardware for AutoCloud Low In Progress None Hardware is in hand, pending powering up and handing off to Autocloud folks
Bodhi: Design for supporting for containers Low Not started Resourcing
Automate 2 week Power ostree releases & testing Low Not started Resourcing
Ansible: Atomic 2 week build/test/release workflow automated Low Not started Resourcing Will not begin until Docker ansible automation is complete

Other

* 3 F25 deliverables have been carried over to F26 as they were not fully completed on the F25 schedule
  ** OSBS Scale out
  ** Container automation
  ** Taskotron automated testing for containers
* Note that status updates for modularity work will not be reported here

07NOV2016

Committed F25 Changes

Change Status Risks/Open Issues Next
Layered image builds Done None Pending 1 bugfix release next week for additional container testing by Cockpit owners
Koji: Koji hub consolidation groundwork Done None
New Releng Deliverable: Windows & OSX tools in Fedora Done None Additional requests for improved support after Beta have been filed
Content signing can be automated Done None
Container Signing in Sigul Done None
Bodhi release 2.3 Done None
OSBS has redundancy and support for multi-master / multi-node In progress None Multi node support deployed in stage; pending firewall updates and then release to prod after F25 GA Freeze
Taskotron Delayed Remaining work Dev update live; prod update pending decision about storing tests in dist-git and fixing fedmsg events
Ansible: Docker 2 week build/test/release workflow automated Blocked Blocked by what tool to use for automation


In Progress F26 Changes

Change Status Risks/Open Issues Next
Distgit: Check when people add Exclude/ExclusiveArch to packages, notify the arch teams In Progress None Tweaking setup to reflect requirements
Deploy koji signed repo support - scope work for Pungi & Bodhi to use it Blocked Need PR revisions due to the amount of elapsed time
Also need to support DNF in PR
ongoing delays on the merge will impact our ability to scope work for Pungi & Bodhi
Kerberos support in koji, fedpkg, OSBS In Progress None Live in stage & prod, will be requesting testing this week
F26 Hub consolidation: aarch64 & Power64 koji merged; prep to import s390x in F27 In Progress Merge introduced a number of issues that are mostly fixed now
Public hardware for AutoCloud In Progress None Hardware is in hand, pending powering up and handing off to Autocloud folks


Other

  • New Deliverables (not covered above)
    • Atomic for Power - Blocked; builds are not completing successfully
  • Testing koji updates (1, 2) in stage
  • Atomic ostree repo management is in progress again; autocloud testing has been updated to run per compose rather than per build; will move on to revising the 2 week script to deliver these requirements next
  • I have added a section for F26 deliverables that have started this month and will add the full set of committed changes next month

13OCT2016

Committed Changes

Change Status Risks/Open Issues Next
Layered image builds Done None Pending 1 bugfix release next week for additional container testing by Cockpit owners
Koji: Koji hub consolidation groundwork Done None
New Releng Deliverable: Windows & OSX tools in Fedora Done None Additional requests for improved support after Beta have been filed
Content signing can be automated In Progress None Pending updates / bugfix release planned for this week after beta freeze
Container Signing in Sigul In Progress None Pending final release this week after beta freeze
Taskotron Delayed Remaining work Dev update live; prod update pending decision about storing tests in dist-git
Ansible: Docker 2 week build/test/release workflow automated Blocked Blocked by what tool to use for automation & where to run playbooks
OSBS has redundancy and support for multi-master / multi-node Blocked Blocked by where to run playbooks Run playbooks on deployed VMs
Bodhi release 2.2; 2.3 (?) 2.2.4 is in production 2.3 is in progress and could realistically happen in October

Other

  • New Deliverables (not covered above)
    • WS OSTree - In Rawhide and 25 Nightlies
    • Atomic for Power - In progress; planned for Beta
  • Koji #48 has a proposed patch and is pending testing in stage - this was a very nice to have for Koji Hub Consolidation
  • OSBS: Fedora Docker Registry has been delayed for F26 as we assess the impact of signing & decide on final design
  • Atomic ostree repo management
  • Beginning F26 planning with the team - if you have input, please contact us - plan to share these priorities in our next status update

13SEP2016

Committed Changes

Change Status Risks/Open Issues Next
Layered image builds complete but working on 1 remaining bug No path to resolution of nss bug Dominik Perpeet will lead getting Cockpit builds into the Fedora toolchain week of Sept 12
Taskotron Completion delayed Remaining work -
Ansible: Docker 2 week build/test/release workflow automated Loopabull ready for use
POC release playbook created
Need decision from RCM about Pungi Docker support
Need sign off & input from infra team on running playbooks somewhere
At risk of missing beta delivery date
Create playbooks
Content signing can be automated Code complete, deployed to Stage Awaiting getting yubikeys in place in Prod Deploy to Prod approx Sept 14
OSBS: Fedora Docker Registry Blocked (short term registry solution in place for F25) Image signing may break our planned design Meeting with signing stakeholders to determine if we need to revise our plans
Koji: Koji hub consolidation groundwork Moonshot chassis is functionally deployed, aarch64 merged & imported last week Koji #48 will be needed soon
creating aarch64 disk images in LMC is a blocker - updates were made to support this but have not yet been tested
LMC Disk Images for aarch64 & armv7
OSBS has redundancy and support for multi-master / multi-node Working through multi-host ansible now No requests for extra VMs submitted yet
At risk of missing beta delivery date
Apply multi host updates to existing infra
New Releng Deliverable: Windows & OSX tools in Fedora Dev complete from engineering; OSX Beta will be built outside of koji / Windows will be built in koji
Signing key for Windows purchased
Initial builds have completed but testing is ongoing
Need signing keys for OSX
No testing of signed images has been done yet
Resourcing for OSX work is now up in the air again - discussion ongoing with managers
Need to have initial images built by week of Sept 13
Upcoming Bodhi 2.2.0 release, beta deployed to stg Waiting one week for it to go through stg testing

Other

  • New Deliverables (not covered above)
    • WS OSTree - In Rawhide; pending addition to compose for Beta
    • Atomic for Power - In progress; planned for Beta
  • Atomic ostree repo management - feedback period on proposal has closed; work targeted to be live for one of the October 2 week updates
  • Pungi got better validation for configuration.
   $ pungi-config-validate fedora.conf
   Unrecognized config option: link_files. Did you mean link_type?
   Unrecognized config option: notification_script.
   Deprecated config option: pkgset_koji_url; use koji_profile instead.
   Failed validation in ostree_installer.0.1.x86_64:
       Additional properties are not allowed ('filename' was unexpected)