From Fedora Project Wiki

< Changes

Revision as of 14:38, 10 February 2016 by Peter (talk | contribs) (Erlang NIF/BIF libraries status update.)

Erlang 18

Summary

Update Erlang/OTP to version 18.2.x, and improve Erlang support in Fedora.

Owner

Current status

Detailed Description

Upgrade Erlang to version 18 which brings a lot of good stuff. Just a few highlights:

  • A lot of scalability and performance improvements.
  • Even better Ellyptic Curve Crypto support.
  • Initial support for IPv6 Erlang clustering. See these GitHub pull requests - #1 and #2.
  • New language feature - maps.
  • Better, production-ready HiPE support.

Aside from this, we plan to improve quality of Erlang and related packages. These are shortcomings we want to address:

  • We should enable so-called dirty NIF scheduler which is disabled currently.
  • Every daemon written in Erlang has its own logging solution which doesn't use neither syslog nor Journald. We should start switching them to Journald.
  • Erlang packaging is quite complex and mostly undocumented.
  • Improve coredump producing (see this patch for further details) and investigating.

Benefit to Fedora

Fedora users, both developers and end-users, will have visible benefits from using Fedora-provided packages. Namely:

  • Even better EC support in Erlang. Enough to start experimenting with cryptocurrencies using Erlang out of the box.
  • More scalable and reliable applications with better performance.
  • Better support for running Erlang apps in a fully IPv6 environments.
  • Improved logging, better unified with the rest of system.
  • Improved post-mortem Erlang applications analysis.
  • Packagers won't be afraid of packaging Erlang-related applications anymore. Also they will spend less time on packaging.

Scope

  • Proposal owners:
    • Upgrade Erlang to the latest version (18.2.2). Done!
    • We must rebuild every package which requires NIF or Driver version (listed below in the Dependencies section) against Erlang 18.2.x.
    • Every Erlang daemon's systemd unit must require epmd.socket.
    • Allow EPMD implementation switching - Erlang is about choice!
    • We need to fill new review request for erlang-ejournald
    • Add another default directory to look for Erlang *.beam files.
    • Every Erlang package must require erlang-rpm-macros.
    • Upgrade outdated packages:
      • Package-x-generic-16.pngEjabberd
        • We'd better to package all the bundled libraries Package-x-generic-16.pngEjabberd requires. This bug has all of the needed review requests marked as blockers.
      • Package-x-generic-16.pngRiak
        • Package-x-generic-16.pngRiak has growing Bugzilla backlog, and badly outdated. We have to address all of these issues and package some additional libraries required by new Package-x-generic-16.pngRiak version.
      • Package-x-generic-16.pngWings3D
  • Other developers: N/A
  • Release engineering: N/A
  • Policies and guidelines:
    • We should create Erlang Packaging Guidelines which doesn't exist yet.

Upgrade/compatibility impact

Every Erlang upgrade requires the rebuilding of modules which contains ports or NIFs, and we will rebuild all such modules in Fedora. However if a user has some additional modules not available in a Fedora repository, then these modules must be rebuilt manually.

How To Test

  • Ensure that high-grade Erlang applications are still working:
Name Tested
Package-x-generic-16.pngcouchdb No
Package-x-generic-16.pngejabberd No
Package-x-generic-16.pngmochiweb No
Package-x-generic-16.pngrabbitmq-server Yes
Package-x-generic-16.pngriak No (broken currently :( )
Package-x-generic-16.pngwings No
  • Collect feedback from volunteers regarding their experience with this Erlang/OTP version

User Experience

Users will get more robust, scalable, and fast Erlang applications.

Dependencies

The following packages must be rebuilt:

Name Rebuilt
Package-x-generic-16.pngcouchdb No
Package-x-generic-16.pngejabberd No
Package-x-generic-16.pngerlang-basho_metrics No
Package-x-generic-16.pngerlang-bitcask No
Package-x-generic-16.pngerlang-cl Yes
Package-x-generic-16.pngerlang-ebloom No
Package-x-generic-16.pngerlang-eleveldb No
Package-x-generic-16.pngerlang-emmap Yes
Package-x-generic-16.pngerlang-erlsyslog Yes
Package-x-generic-16.pngerlang-esasl Yes
Package-x-generic-16.pngerlang-esdl Yes
Package-x-generic-16.pngerlang-js Yes
Package-x-generic-16.pngerlang-sd_notify Yes
Package-x-generic-16.pngerlang-skerl Yes
Package-x-generic-16.pngerlang-snappy Yes
Package-x-generic-16.pngwings Yes

Contingency Plan

  • Contingency mechanism: None necessary. Instead of falling back to the previous version we should fix existing packages in order to help the Community. We should also monitor upstream development process for potentially discovered issues and proactively apply patches (as we already did with Erlang R14, Erlang R15, Erlang R16, and Erlang 17). It should be noted that this change consists from an independent or loosely coupled smaller changes. If we fail to deliver some changes in time, we should reschedule these exact changes to the future Fedora release while keeping already implemented ones.
  • Contingency deadline: N/A
  • Blocks release? N/A
  • Blocks product? N/A

Documentation

Release Notes

Erlang/OTP 18.2.2 is available in Fedora 21.