From Fedora Project Wiki
(Further simplify the Version: section.)
(Further simplify and add section on transitioning to these guidelines from the old ones.)
Line 49: Line 49:
* snapshot information (<code><snapinfo></code>)
* snapshot information (<code><snapinfo></code>)


Those items which are present are combined to construct the final <code>Version:</code>in the following form.  The usual convention where items in square brackets might not be present applies.
Those items which are present are combined to construct the final <code>Version:</code>in the following form.  Square brackets are used to indicate that a component may not be present if it does not apply.


* <code><upstreamrel>[~<upsteamprerel>][^<snapinfo>]</code>
* <code><upstreamrel>[~<upsteamprerel>][^<snapinfo>]</code>
Line 59: Line 59:
=== Prerelease versions ===
=== Prerelease versions ===


In the <code>Version:</code> tag, use the following construction: <code><upstreamrel>~[<upstreamprerel>]</code>.  That is a literal tilde ( <code>~</code>) which instructs RPM to sort this <code>Version:</code> before (older than) a package with the same version but no tilde.
When packaging a prerelease:


* <code><upstreamrel></code> should contain the version which upstream has decided this line of development will become once it has been released.
* <code><upstreamrel></code> should contain the version which upstream has decided this line of development will become once it has been released.
* <code><upstreamprerel></code> should contain a string which upstream has chosen to version the prereleases in this line of development.  Usually this will be something like "alpha3" or "pre2", and may need to be altered such that it includes no invalid characters.  (See [[#Upstream_uses_invalid_characters_in_the_version|below]].)  Note that it is possible that upstream has decided on the next release version but has not yet tagged a prerelease.  In this case you would be packaging a snapshot (see [[#Snapshots|below]]) and you would simply leave <code><upsteamprerel></code> empty while still including the tilde.
* <code><upstreamrel></code> is followed by a tilde.
* <code><upstreamprerel></code> should contain a string which upstream has chosen to version the prereleases in this line of development.  Usually this will be something like "alpha3" or "pre2", and may need to be altered such that it includes no invalid characters.  (See [[#Upstream_uses_invalid_characters_in_the_version|below]].)  Note that it is possible that upstream has decided on the next release version but has not yet tagged a prerelease.  In this case you would be packaging a snapshot (see [[#Snapshots|below]]) and you would simply leave <code><upsteamprerel></code> empty '''while still including the tilde'''.  This ensures that everything sorts properly.


=== Snapshots ===
=== Snapshots ===


All snapshots MUST contain a snapshot information field (<code><snapinfo></code>) in the <code>Version:</code> tag (for prerelease snapshots) or the <code>Release:</code> tag (for post-release snapshots).  That field must at minimum consist of the date in eight-digit "YYYYMMDD" format.  The packager MAY include up to 17 characters of additional information after the date.  The following formats are suggested:
When packaging a snapshot <code><snapinfo></code>) must at minimum consist of the date in eight-digit "YYYYMMDD" format.  The packager MAY include up to 17 characters of additional information after the date.  The following formats are suggested:


* <code>YYYYMMDD.<revision></code>
* <code>YYYYMMDD.<revision></code>
Line 73: Line 74:
Where <code><scm></code> is a short string identifying the source code control system upstream uses (e.g. "git", "svn", "hg") or the string "snap".  <code><revision></code> is either a short git commit hash, a subversion revision number, or something else useful in identifying the precise revision in upstream's source code control system.  Obviously if CVS is used, no such revision information exists, so it would be omitted, but otherwise it SHOULD be included.
Where <code><scm></code> is a short string identifying the source code control system upstream uses (e.g. "git", "svn", "hg") or the string "snap".  <code><revision></code> is either a short git commit hash, a subversion revision number, or something else useful in identifying the precise revision in upstream's source code control system.  Obviously if CVS is used, no such revision information exists, so it would be omitted, but otherwise it SHOULD be included.


Note that if you take a snapshot which comes after a prerelease, the <code>Version:</code> MUST still include the prerelease information.  So a snapshot taken after beta1 has been released (but before beta2 or rc1 or the final release is tagged) still indicates "beta1" in the <code>Version:</code> tag.  If you are packaging a prerelease snapshot where upstream has chosen the next version but not yet tagged any prerelease, the <code>Version:</code> tag still includes the tilde and the caret, as in "1.2~^20180101.abcdef".
In the <code>Version:</code> tag, <code><snapinfo></code> MUST be preceeded by a caret ('<code>^</code>).
 
If you take a snapshot which comes after a prerelease, the <code>Version:</code> MUST still include the prerelease information as indicated [[#Prerelease versions|above]].  So a snapshot taken after beta1 has been released (but before beta2 or rc1 or the final release is tagged) still indicates "beta1" in the <code>Version:</code> tag.  If you are packaging a prerelease snapshot where upstream has chosen the next version but not yet tagged any prerelease, the <code>Version:</code> tag '''still includes both the tilde and the caret''', as in "1.2~^20180101.abcdef".  If upstream later releases "1.2beta1" then things will sort properly if these rules are followed.


=== Upstream makes unsortable changes ===
=== Upstream makes unsortable changes ===
Line 92: Line 95:


When upstream has never chosen a version, you MUST use <code>0</code> for <code><upstreamrel></code> and otherwise follow the guidelines for prerelease snapshots. This will give  you something similar to "<code>0~^20180101.abcde</code>".  Then if upstream releases "version 0.1" (or "0.0.1" or something similar) then you can immediately move to using <code>Version: 0.1</code> and <code>Release: 1%{?dist}</code> with no ordering issues.
When upstream has never chosen a version, you MUST use <code>0</code> for <code><upstreamrel></code> and otherwise follow the guidelines for prerelease snapshots. This will give  you something similar to "<code>0~^20180101.abcde</code>".  Then if upstream releases "version 0.1" (or "0.0.1" or something similar) then you can immediately move to using <code>Version: 0.1</code> and <code>Release: 1%{?dist}</code> with no ordering issues.
Note: if you were following previous guidelines which did not make use of tilde in this situation, you will not be able to switch to using this method as it will result in packages which are older.  In this case, simply omit the tilde.  While the tilde is useful for indicating prereleases, the end result should be the same as long as upstream does not release "version 0".


=== Upstream uses invalid characters in the version ===
=== Upstream uses invalid characters in the version ===
Line 100: Line 101:


After altering the version to be free of invalid characters, see [[#Unsortable versions]] below if the modifications, when applied to successive releases from upstream, will not order properly.  It is, however, often the case that a simple modification will give a scheme appropriate for [[#Simple versioning]].
After altering the version to be free of invalid characters, see [[#Unsortable versions]] below if the modifications, when applied to successive releases from upstream, will not order properly.  It is, however, often the case that a simple modification will give a scheme appropriate for [[#Simple versioning]].
== Transitioning from previous guidelines ==
These guidelines, when followed closely, should provide for proper package ordering for all reasonable upstream versioning schemes.  However, previous versions of the Fedora versioning guidelines did not permit the use of tilde, and so before applying these guidelines to an existing package it is important to ensure that the versioning does not go "backwards."
For post-release snapshots, there should be no issues.
Prereleases will generally have versioning problems, because where the old guidelines would give a version-release pair of something like "1.2-0.1.beta1" or "1.2-0.2.20180101.abcde", the new guidelines would require the use of a tilde.  As "1.2~anything" is seen by RPM as older than "1.2", you cannot switch a prerelease to these guidelines and must continue to follow the old guidelines.  (XXX Link to them.)  Once upstream has made an actual release, any later prereleases of the next version can make use of tilde.
The case where upstream has never made a release is similar, as "0~anything" is older than "0".  In this case, you can simply omit the tilde and still indicate the snapshot using the caret.  While the tilde is useful for indicating prereleases, the end result should be the same as long as upstream does not release "version 0".  If for some reason they do, you will either need to introduce <code>Epoch:</code> or fabricate a version like "0.0".


== Rawhide is allowed to lag temporarily ==
== Rawhide is allowed to lag temporarily ==


A package MAY temporarily have a lower EVR in Rawhide when compared to a release branch of Fedora ONLY in the case where the package fails to build in Rawhide.  This permits important updates to be pushed to existing Fedora releases regardless of the current state of Rawhide.
A package MAY temporarily have a lower EVR in Rawhide when compared to a release branch of Fedora ONLY in the case where the package fails to build in Rawhide.  This permits important updates to be pushed to existing Fedora releases regardless of the current state of Rawhide.

Revision as of 16:45, 21 November 2018

This is a a draft which uses both tilde and the proposed ([[1]]) caret notation for versioning. The idea is to leverage these to the maximum amount possible in order to extract the greatest amount of simplification. This seems to me to be simpler, though it may be longer because I've added more explanatory text.

Fedora's package versioning scheme encompasses both the Version: and Release: tags, as well as Epoch:. The overriding goal is to provide sequence of packages which are treated as updates by RPM's version comparison algorithm while accommodating varied and often inconsistent upstream versioning schemes.

Some definitions

Note that upstreams may each have their own terminology and it is in general impossible to define these terms with complete generality. For some upstreams, every commit is itself considered a version. Many upstreams never make releases, instead just letting users take whatever is in the code repository at any given time.

release version
A version of the software which upstream has decided give a version and call "released". The act of releasing the software can be as simple as adding a git tag. This includes so-called "point releases" or "patchlevels" which some upstreams make, since those are actually assigned versions and released, but it doesn't include so called "prerelease versions".
prerelease version
Before a release happens, many upstreams will decide which version that will release will have, and then produce "alphas", "betas", "release candidates", or the like which carry that new version but indicate that the final release of that version has not yet been made. These we call prerelease versions. The importance is that upstream is basically "counting down" towards some version number. Fedora needs to indicate that, but needs to make sure that the ordering is correct so that the Fedora package will properly upgrade to that version when it is actually released.
snapshot
An archive taken from upstream's source code control system which is not equivalent to any release version.
non-sorting version sequence
A sequence of version strings which is not ordered in the same way that RPM's version comparison function would order it. RPM has a somewhat complicated version comparison function which it will use to determine if a package is "newer". If upstream's idea of what constitutes a "newer" version differs from RPM's implementation then simply using upstream's versions directly will result in updates which don't actually update any packages because to RPM they look "older".

Examples

Examples of many possible versioning scenarios and tips on making your own version comparison tests are available from Package Versioning Examples.

Epoch: tag

The Epoch: tag provides the most significant input to RPM's version comparison function. If present, it MUST consist of a positive integer. It SHOULD ONLY be introduced or incremented when necessary to avoid ordering issues. The Epoch: tag, once introduced to a package, MUST NOT ever remove or be decreased in any way.

Release: tag

The Release: tag provides the least significant input to RPM's version comparison function. MUST consist of a positive integer, with the Dist tag appended. This integer MUST begin at 1 and MUST be incremented for each change made to the package that does not involve a change to the Version: tag. When a change is made that does change the Version: tag, the integer MUST be reset to 1.

In the case that you need to make a change to an older branch without rebuilding the newer branches and wish to preserve the ordering between branches, you MAY append a period and a second positive integer, beginning at 1. This goes after the Dist tag:

Release: 3%{?dist}.1

Version: tag

The Version: tag is where upsteam's chosen version information is placed. In most cases (where you are not packaging a prerelease or a snapshot) you can just use the version information from upstream directly in Version: and you're done. If upstream uses dashes, you may need to remove them or change them to either periods or underscores. When you do want to package a prerelease or snapshot, or your upstream uses a very odd versioning scheme, you may need to modify the version information provided by upstream to make a complete version tag.

There are potentially three fields which comprise the structured Version: tag:

  • Upstream release version (<upstreamrel>)
  • Upstream prerelease identifier (<upstreamprerel>)
  • snapshot information (<snapinfo>)

Those items which are present are combined to construct the final Version:in the following form. Square brackets are used to indicate that a component may not be present if it does not apply.

  • <upstreamrel>[~<upsteamprerel>][^<snapinfo>]

A tilde ('~') indicates a prerelease and a caret ('^') indicates a snapshot. The tilde, if present, always comes before the caret. These characters are special to RPM and provide for special version comparisons. See Package Versioning Examples for more information on how these work.

The actual values to be used for those fields are given in the sections below.

Prerelease versions

When packaging a prerelease:

  • <upstreamrel> should contain the version which upstream has decided this line of development will become once it has been released.
  • <upstreamrel> is followed by a tilde.
  • <upstreamprerel> should contain a string which upstream has chosen to version the prereleases in this line of development. Usually this will be something like "alpha3" or "pre2", and may need to be altered such that it includes no invalid characters. (See below.) Note that it is possible that upstream has decided on the next release version but has not yet tagged a prerelease. In this case you would be packaging a snapshot (see below) and you would simply leave <upsteamprerel> empty while still including the tilde. This ensures that everything sorts properly.

Snapshots

When packaging a snapshot <snapinfo>) must at minimum consist of the date in eight-digit "YYYYMMDD" format. The packager MAY include up to 17 characters of additional information after the date. The following formats are suggested:

  • YYYYMMDD.<revision>
  • YYYYMMDD<scm><revision>

Where <scm> is a short string identifying the source code control system upstream uses (e.g. "git", "svn", "hg") or the string "snap". <revision> is either a short git commit hash, a subversion revision number, or something else useful in identifying the precise revision in upstream's source code control system. Obviously if CVS is used, no such revision information exists, so it would be omitted, but otherwise it SHOULD be included.

In the Version: tag, <snapinfo> MUST be preceeded by a caret ('^).

If you take a snapshot which comes after a prerelease, the Version: MUST still include the prerelease information as indicated above. So a snapshot taken after beta1 has been released (but before beta2 or rc1 or the final release is tagged) still indicates "beta1" in the Version: tag. If you are packaging a prerelease snapshot where upstream has chosen the next version but not yet tagged any prerelease, the Version: tag still includes both the tilde and the caret, as in "1.2~^20180101.abcdef". If upstream later releases "1.2beta1" then things will sort properly if these rules are followed.

Upstream makes unsortable changes

It is possible that upstream simply adopts a different versioning scheme, fails to follow an expected pattern, or even simply resets their version to some lower value. If none of the above operations can help with giving a version which sorts properly, or give you a version which simply sorts lower than the packages already in Fedora, then you have little recourse but to increment the Epoch: tag, or to begin using it by adding Epoch: 1. At the same time, try to work with upstream to hopefully minimize the need to involve Epoch: in the future.

In the rare case that upstream uses unsortable prerelease tags, there may be an alternative to introducing Epoch:. You can instead insert an integer in the Version: tag before the prerelease information. So from the following sequence:

  • 1.2 beta, 1.2 gamma, 1.2 delta

You can use the following vesions:

  • 1.2~beta, 1.2~gamma, 1.2~1.delta

In general, if it is possible to insert an integer into a version sequence in such a way that it doesn't imply a version not actually released by upstream, then doing this is preferable to introducing Epoch:.

Upstream has never chosen a version

When upstream has never chosen a version, you MUST use 0 for <upstreamrel> and otherwise follow the guidelines for prerelease snapshots. This will give you something similar to "0~^20180101.abcde". Then if upstream releases "version 0.1" (or "0.0.1" or something similar) then you can immediately move to using Version: 0.1 and Release: 1%{?dist} with no ordering issues.

Upstream uses invalid characters in the version

It's possible that upstream uses characters besides digits, ASCII letters (upper and lower case), periods and underscores in its version. They must be removed and potentially replaced with valid characters. Any such alterations MUST be documented in the specfile. It is not possible to cover all potential situations here, so it is left to the packager to alter the upstream versioning scheme consistently. It is common, however, to either remove dashes or replace them with underscores or periods (which RPM treats identically).

After altering the version to be free of invalid characters, see #Unsortable versions below if the modifications, when applied to successive releases from upstream, will not order properly. It is, however, often the case that a simple modification will give a scheme appropriate for #Simple versioning.

Transitioning from previous guidelines

These guidelines, when followed closely, should provide for proper package ordering for all reasonable upstream versioning schemes. However, previous versions of the Fedora versioning guidelines did not permit the use of tilde, and so before applying these guidelines to an existing package it is important to ensure that the versioning does not go "backwards."

For post-release snapshots, there should be no issues.

Prereleases will generally have versioning problems, because where the old guidelines would give a version-release pair of something like "1.2-0.1.beta1" or "1.2-0.2.20180101.abcde", the new guidelines would require the use of a tilde. As "1.2~anything" is seen by RPM as older than "1.2", you cannot switch a prerelease to these guidelines and must continue to follow the old guidelines. (XXX Link to them.) Once upstream has made an actual release, any later prereleases of the next version can make use of tilde.

The case where upstream has never made a release is similar, as "0~anything" is older than "0". In this case, you can simply omit the tilde and still indicate the snapshot using the caret. While the tilde is useful for indicating prereleases, the end result should be the same as long as upstream does not release "version 0". If for some reason they do, you will either need to introduce Epoch: or fabricate a version like "0.0".

Rawhide is allowed to lag temporarily

A package MAY temporarily have a lower EVR in Rawhide when compared to a release branch of Fedora ONLY in the case where the package fails to build in Rawhide. This permits important updates to be pushed to existing Fedora releases regardless of the current state of Rawhide.