From Fedora Project Wiki
 
(57 intermediate revisions by 9 users not shown)
Line 3: Line 3:
== Mission ==
== Mission ==
To encourage the packaging and accessibility of heterogeneous computing projects in Fedora and EPEL. This includes machine learning, OpenCL, and scientific computing.
To encourage the packaging and accessibility of heterogeneous computing projects in Fedora and EPEL. This includes machine learning, OpenCL, and scientific computing.
== Communication ==
While separate from the [[SIGs/AI-ML|AI/ML SIG]], we do share communication channels for now. If you're interested, please join us on:
* [https://matrix.to/#/#ai-ml:fedoraproject.org #ai-ml@fedoraproject.org Matrix room]
* #fedora-ai-ml on [https://libera.chat libera.chat IRC] ('''NOTE:''' With [https://discussion.fedoraproject.org/t/matrix-to-libera-chat-irc-bridge-unavailable/87081 the recent Matrix/IRC bridge issues], there may not be much activity on IRC. More conversation happens in the Matrix room)
* [https://discussion.fedoraproject.org/tags/c/project/7/ai-ml-sig #ai-ml-sig on Fedora's Discourse instance]


== Members/Packagers/Reviewers ==
== Members/Packagers/Reviewers ==
Line 8: Line 15:
* [[User:Fschwarz|Felix Schwarz]] (currently busy with certbot, borgbackup, WeasyPrint)
* [[User:Fschwarz|Felix Schwarz]] (currently busy with certbot, borgbackup, WeasyPrint)
* Benson Muite
* Benson Muite
* [[User:mhough|Morgan Hough]] (Intel related while testing SODECL on Intel NUCs)
* [[User:trix|Tom Rix]] (Misc)
* [[User:Tflink|Tim Flink]]
* [[User:Greencappuccino|Brian Lu]]
* [[User:jsteffan|Jonathan Steffan]]
* [[User:davdunc| David DUncan]] (currently working on Fedora Cloud Edition and want to build Deep Learning Images for public cloud)


Please add your name above if you want to help.
Please add your name above if you want to help.


== Tasks ==
== Tasks ==
* Package and make HC related projects more accessible to users (such as OpenCL, AMD's ROCm HIP, Intel oneAPI, etc.)
* Package and make HC related projects more accessible to users (such as OpenCL, AMD's ROCm HIP, Intel oneAPI, SYCL, Vulkan, OpenGL, etc.)
* Document installation, packages, and general use cases
* Document installation, packages, and general use cases
* Translation of wiki pages and documentation (if applicable)
* Translation of wiki pages and documentation (if applicable)


= AMD's ROCm (OpenCL/HIP) =
= AMD's ROCm (OpenCL/HIP) =
{{Admon/warning | Upstream only officially supports x86_64, but they are open to pcc64le and arm64 patches}}
== Package status ==
== Package status ==
Below is a list of ROCm packages with their status.
Below is a list of ROCm packages with their status.
If something isn't packaged in Fedora or EPEL, feel free to take it!
If something isn't packaged in Fedora or EPEL, feel free to take it!


This reference might be helpful for those attempting to package:
For reference, '''pytorch''' still requires:
https://gist.github.com/cgmb/edb7b790ab55681fb2ba5385ee02489b
rocblas, miopen, rocfft, hipfft, hipsparse, rccl, rocprim, hipcub, rocthrust


{| border="1"
{| border="1"
| '''Name''' || '''Fedora Package''' || '''EPEL?''' || '''Upstream package name''' || '''Upstream URL''' || '''Notes'''  ||
| '''Name''' || '''Fedora Package''' || '''EPEL?''' || '''Upstream package name''' || '''Upstream URL''' || '''Notes'''  ||
|-
|-
| roct-thunk-interface || {{ package|rocm-runtime|hsakmt}} || Yes || hsakmt-roct || https://github.com/radeonopencompute/roct-thunk-interface || ||
| roct-thunk-interface || {{ package|hsakmt|hsakmt}} || Yes || hsakmt-roct || https://github.com/radeonopencompute/roct-thunk-interface || ||
|-
|-
| rocr-runtime || {{ package|rocm-runtime|rocm-runtime}} || Yes || hsa-rocr || https://github.com/radeonopencompute/rocr-runtime || ||
| rocr-runtime || {{ package|rocm-runtime|rocm-runtime}} || Yes || hsa-rocr || https://github.com/radeonopencompute/rocr-runtime || ||
Line 40: Line 52:
| opencl-icd-loader || || || rocm-ocl-icd || https://github.com/KhronosGroup/OpenCL-ICD-Loader || Fedora already has {{ package|ocl-icd|ocl-icd}}, but the khronos version is required for GL-CL interop support ||
| opencl-icd-loader || || || rocm-ocl-icd || https://github.com/KhronosGroup/OpenCL-ICD-Loader || Fedora already has {{ package|ocl-icd|ocl-icd}}, but the khronos version is required for GL-CL interop support ||
|-
|-
| rocm-opencl-runtime || '''In Review''' || || rocm-opencl || https://github.com/radeonopencompute/rocm-opencl-runtime || https://bugzilla.redhat.com/show_bug.cgi?id=2090823 ||
| rocm-opencl-runtime || {{ package|rocclr|rocm-opencl}} || Yes || rocm-opencl || https://github.com/radeonopencompute/rocm-opencl-runtime || rocm-opencl is now a sub-package of {{ package|rocclr}} in Fedora 38+ ||
|-
| rocm_smi_lib || {{ package|rocm-smi}} || || rocm-smi-lib || https://github.com/radeonopencompute/rocm_smi_lib ||
|-
| hipamd || {{ package|rocclr|rocm-hip}} || || hip-runtime-amd || https://github.com/rocm-developer-tools/hipamd || rocm-hip is a subpackage of {{ package|rocclr}} ||
|-
| hipcc || {{ package|rocclr|hipcc}} || || hip-[devel,docs] || https://github.com/rocm-developer-tools/HIP || hipcc is a subpackage of {{ package|rocclr}} ||
|-
|-
| rocm_smi_lib || '''See notes''' || || rocm-smi-lib || https://github.com/radeonopencompute/rocm_smi_lib || The deprecated {{ package|rocm-smi|rocm-smi}} should be replaced by this
| hip-samples || || || hip-samples || https://github.com/ROCm-Developer-Tools/HIP-Examples | requires better cmake infra from upstream ||
|-
|-
| hip || || || hip-[runtime,devel,docs,samples] || https://github.com/rocm-developer-tools/HIP || Upstream doesn't cleanly separate the cmake logic with hipamd, we should send upstream patches ||
| rocm-cmake || {{ package|rocm-cmake}} || || rocm-cmake || https://github.com/radeonopencompute/rocm-cmake || Needed by most of the roc* and hip* packages below ||
|-
|-
| hipamd || || || rocm-hip-runtime || https://github.com/rocm-developer-tools/hipamd || Upstream wants to merge this with OpenCL's sources, so it might be worth waiting to package, or adding as a subpackage for rocm-opencl. Testing version in mystro256's COPR: https://copr.fedorainfracloud.org/coprs/mystro256/rocm-hip/ using rocm-hip to avoid amd branding in Fedora package name. ||
| hipblas || {{ package|hipblas}} || hipblas || https://github.com/rocmsoftwareplatform/hipblas || ||
|-
|-
| rocm-cmake || || || rocm-cmake || https://github.com/radeonopencompute/rocm-cmake || Needed by most of the roc* and hip* packages below ||
| hipsparse || {{ package|hipsparse}} || hipsparse || https://github.com/rocmsoftwareplatform/hipsparse || ||
|-
|-
| hipblas || || || hipblas || https://github.com/rocmsoftwareplatform/hipblas || ||
| rocalution || {{ package|rocalution}} || rocalution || https://github.com/rocmsoftwareplatform/rocalution || ||
|-
|-
| hipsparse || || || hipsparse || https://github.com/rocmsoftwareplatform/hipsparse || ||
| rocblas || {{ package|rocblas}} || || rocblas || https://github.com/rocmsoftwareplatform/rocblas || ||
|-
|-
| rocalution || || || rocalutio || https://github.com/rocmsoftwareplatform/rocalution || ||
| rocfft || '''In Review''' || || rocfft || https://github.com/rocmsoftwareplatform/rocfft || [https://bugzilla.redhat.com/show_bug.cgi?id=2251086 Review Link] ||  
|-
|-
| rocblas || || || rocblas || https://github.com/rocmsoftwareplatform/rocblas || ||
| hipfft || || || ? || https://github.com/rocmsoftwareplatform/hipfft || '''Requires rocfft''' ||
|-
|-
| rocfft || || || rocfft || https://github.com/rocmsoftwareplatform/rocfft || ||
| rocmvalidationsuite || || || rocm-validation-suite || https://github.com/rocm-developer-tools/rocmvalidationsuite || '''requires rocblas, rocm_smi_lib''' ||
|-
|-
| rocmvalidationsuite || || || rocm-validation-suite || https://github.com/rocm-developer-tools/rocmvalidationsuite || ||
| rocprim || {{ package|rocprim }} || || rocprim || https://github.com/rocmsoftwareplatform/rocprim || ||
|-
|-
| rocprim || || || rocprim || https://github.com/rocmsoftwareplatform/rocprim || ||
| rocrand ||{{ package|rocrand}} || || rocrand || https://github.com/rocmsoftwareplatform/rocrand || ||
|-
|-
| rocrand || || || rocrand || https://github.com/rocmsoftwareplatform/rocrand || ||
| hiprand ||{{ package|hiprand}} || || rocrand || https://github.com/rocmsoftwareplatform/rocrand || Used to be a subpackage of {{ package|rocrand}} ||
|-
|-
| rocsolver || || || rocsolver || https://github.com/rocmsoftwareplatform/rocsolver || ||
| rocsolver || || || rocsolver || https://github.com/rocmsoftwareplatform/rocsolver || ||
|-
|-
| rocsparse || || || rocsparse || https://github.com/rocmsoftwareplatform/rocsparse || ||
| rocsparse || {{ package|rocsparse}} || || rocsparse || https://github.com/rocmsoftwareplatform/rocsparse || ||
|-
| rocthrust || {{ package|rocthrust }} || || rocthrust || https://github.com/rocmsoftwareplatform/rocthrust || ||
|-
| hipcub || {{ package|hipcub}} || || hipcub  || https://github.com/rocmsoftwareplatform/hipcub || ||
|-
| rccl || || || ? || https://github.com/rocmsoftwareplatform/rccl || requires hipify ||
|-
| miopen || || || ? || https://github.com/rocmsoftwareplatform/miopen || requires rocblas ||
|-
| tensile || {{ package|python-tensile }} || || ? || https://github.com/rocmsoftwareplatform/tensile || ||
|-
| rocdbgapi || '''In Review || || rocm-dbgapi || https://github.com/rocm-developer-tools/rocdbgapi || [https://bugzilla.redhat.com/show_bug.cgi?id=2246661 Review Link] ||
|-
|-
| tensile || || || ? || https://github.com/rocmsoftwareplatform/tensile || ||
| rocgdb || '''In Review''' || || rocm-gdb || https://github.com/rocm-developer-tools/rocgdb || A fork of {{ package|gdb|gdb}} with ROCm related addons, '''Requires rocdbgapi''' [https://bugzilla.redhat.com/show_bug.cgi?id=2246670 Review Link] ||
|-
|-
| rocdbgapi || || || rocm-dbgapi || https://github.com/rocm-developer-tools/rocdbgapi || ||
| rocprofiler || || || rocprofiler || https://github.com/rocm-developer-tools/rocprofiler || BLOCKED - requires hsa-amd-aqlprofile, a closed source package ||
|-
|-
| rocgdb || || || rocm-gdb || https://github.com/rocm-developer-tools/rocgdb || A fork of {{ package|gdb|gdb}} with ROCm related addons ||
| roctracer || {{ package|roctracer }} || || roctracer || https://github.com/rocm-developer-tools/roctracer || ||
|-
|-
| rocprofiler || || || rocprofiler || https://github.com/rocm-developer-tools/rocprofiler || ||
| composable_kernel || || || composable_kernel ||https://github.com/ROCmSoftwarePlatform/composable_kernel || trix is working on this ||
|-
|-
| roctracer || || || roctracer || https://github.com/rocm-developer-tools/roctracer || ||
| hipify || {{ package|hipify}} || || hipify || https://github.com/ROCm-Developer-Tools/HIPIFY || ||
|}
|}
== HW Support ==
{{Admon/warning | Upstream only officially supports x86_64, but they are open to pcc64le and arm64 patches}}
Some ROCm packages in Fedora are built for all 64bit little endian systems (x86_64, arm64, ppc64le), but official support is for x86_64.
HW support is highly dependent on LLVM version included in Fedora, so if you have newer HW, you might need to wait for newer LLVM versions to be introduced to Fedora (usually in the spring and the autumn).
{{Admon/warning | Note that your millage may vary, as pre vega HW on ROCm is experimental, missing functionality, and not guaranteed to work on all HW }}


== Installation ==
== Installation ==


=== Setup ===
=== Setup ===
For non-root usage, the user must be added to the vendor group:
To enable access to GPU resources for non-root users, the users must be added to the `video` (graphics) and `render` (compute) group. The [https://rocm.docs.amd.com/projects/install-on-linux/en/docs-6.0.0/how-to/prerequisites.html#setting-permissions-for-groups AMD ROCm Installation Guide (6.0.0)] recommends the `video` and `render` group for all ROCm-supported operating systems.
 
To add the current user to the `render` group:


     sudo usermod -a -G vendor myusername
     sudo usermod -a -G render,video $LOGNAME


To check for rocm support of the running HW, install and run rocminfo:
To check for ROCm support of the running HW, you can install and run `rocminfo`:


     sudo dnf install rocminfo
     sudo dnf install rocminfo
     rocminfo
     rocminfo


'''TODO''': Update once rocm-opencl or rocm-hip is added into Fedora/EPEL
=== OpenCL ===
 
ROCm OpenCL can be installed with:
 
    sudo dnf install rocm-opencl
 
As well, `rocm-clinfo` or `clinfo` can be installed to verify it is working, e.g.:
 
    sudo dnf install rocm-clinfo
    rocm-clinfo
 
=== HIP ===
 
HIP is included in Fedora 39 and is pending for Fedora 38.
For Fedora 38, you will need to add --enable-repo=updates-testing to dnf if it's not available yet.
 
Install with:
 
    sudo dnf install rocm-hip
 
For use with '''Blender''', you might need to also install "rocm-hip-devel" if it does not detect HIP.
 
= Intel =
 
TODO: incomplete, take me!
 
= Packages =
Packages that use HC
 
== Blender ==
Build with:
    rpmbuild --with rocm


[[Category:SIGs]]
[[Category:SIGs]]
[[Category:Language-specific SIGs]]
[[Category:Language-specific SIGs]]
[[Category:Fedora special-interest groups]]
[[Category:Fedora special-interest groups]]

Latest revision as of 17:52, 14 January 2024

Heterogeneous Computing Special Interest Group

Mission

To encourage the packaging and accessibility of heterogeneous computing projects in Fedora and EPEL. This includes machine learning, OpenCL, and scientific computing.

Communication

While separate from the AI/ML SIG, we do share communication channels for now. If you're interested, please join us on:

Members/Packagers/Reviewers

Please add your name above if you want to help.

Tasks

  • Package and make HC related projects more accessible to users (such as OpenCL, AMD's ROCm HIP, Intel oneAPI, SYCL, Vulkan, OpenGL, etc.)
  • Document installation, packages, and general use cases
  • Translation of wiki pages and documentation (if applicable)

AMD's ROCm (OpenCL/HIP)

Package status

Below is a list of ROCm packages with their status. If something isn't packaged in Fedora or EPEL, feel free to take it!

For reference, pytorch still requires: rocblas, miopen, rocfft, hipfft, hipsparse, rccl, rocprim, hipcub, rocthrust

Name Fedora Package EPEL? Upstream package name Upstream URL Notes
roct-thunk-interface Package-x-generic-16.pnghsakmt Yes hsakmt-roct https://github.com/radeonopencompute/roct-thunk-interface
rocr-runtime Package-x-generic-16.pngrocm-runtime Yes hsa-rocr https://github.com/radeonopencompute/rocr-runtime
rocminfo Package-x-generic-16.pngrocminfo Yes rocminfo https://github.com/radeonopencompute/rocminfo
rocm-compilersupport Package-x-generic-16.pngrocm-compilersupport Yes comgr https://github.com/radeonopencompute/rocm-compilersupport
rocm-device-libs Package-x-generic-16.pngrocm-device-libs Yes rocm-device-libs https://github.com/radeonopencompute/rocm-device-libs
opencl-icd-loader rocm-ocl-icd https://github.com/KhronosGroup/OpenCL-ICD-Loader Fedora already has Package-x-generic-16.pngocl-icd, but the khronos version is required for GL-CL interop support
rocm-opencl-runtime Package-x-generic-16.pngrocm-opencl Yes rocm-opencl https://github.com/radeonopencompute/rocm-opencl-runtime rocm-opencl is now a sub-package of Package-x-generic-16.pngrocclr in Fedora 38+
rocm_smi_lib Package-x-generic-16.pngrocm-smi rocm-smi-lib https://github.com/radeonopencompute/rocm_smi_lib
hipamd Package-x-generic-16.pngrocm-hip hip-runtime-amd https://github.com/rocm-developer-tools/hipamd rocm-hip is a subpackage of Package-x-generic-16.pngrocclr
hipcc Package-x-generic-16.pnghipcc hip-[devel,docs] https://github.com/rocm-developer-tools/HIP hipcc is a subpackage of Package-x-generic-16.pngrocclr
hip-samples hip-samples requires better cmake infra from upstream
rocm-cmake Package-x-generic-16.pngrocm-cmake rocm-cmake https://github.com/radeonopencompute/rocm-cmake Needed by most of the roc* and hip* packages below
hipblas Package-x-generic-16.pnghipblas hipblas https://github.com/rocmsoftwareplatform/hipblas
hipsparse Package-x-generic-16.pnghipsparse hipsparse https://github.com/rocmsoftwareplatform/hipsparse
rocalution Package-x-generic-16.pngrocalution rocalution https://github.com/rocmsoftwareplatform/rocalution
rocblas Package-x-generic-16.pngrocblas rocblas https://github.com/rocmsoftwareplatform/rocblas
rocfft In Review rocfft https://github.com/rocmsoftwareplatform/rocfft Review Link
hipfft ? https://github.com/rocmsoftwareplatform/hipfft Requires rocfft
rocmvalidationsuite rocm-validation-suite https://github.com/rocm-developer-tools/rocmvalidationsuite requires rocblas, rocm_smi_lib
rocprim Package-x-generic-16.pngrocprim rocprim https://github.com/rocmsoftwareplatform/rocprim
rocrand Package-x-generic-16.pngrocrand rocrand https://github.com/rocmsoftwareplatform/rocrand
hiprand Package-x-generic-16.pnghiprand rocrand https://github.com/rocmsoftwareplatform/rocrand Used to be a subpackage of Package-x-generic-16.pngrocrand
rocsolver rocsolver https://github.com/rocmsoftwareplatform/rocsolver
rocsparse Package-x-generic-16.pngrocsparse rocsparse https://github.com/rocmsoftwareplatform/rocsparse
rocthrust Package-x-generic-16.pngrocthrust rocthrust https://github.com/rocmsoftwareplatform/rocthrust
hipcub Package-x-generic-16.pnghipcub hipcub https://github.com/rocmsoftwareplatform/hipcub
rccl ? https://github.com/rocmsoftwareplatform/rccl requires hipify
miopen ? https://github.com/rocmsoftwareplatform/miopen requires rocblas
tensile Package-x-generic-16.pngpython-tensile ? https://github.com/rocmsoftwareplatform/tensile
rocdbgapi In Review rocm-dbgapi https://github.com/rocm-developer-tools/rocdbgapi Review Link
rocgdb In Review rocm-gdb https://github.com/rocm-developer-tools/rocgdb A fork of Package-x-generic-16.pnggdb with ROCm related addons, Requires rocdbgapi Review Link
rocprofiler rocprofiler https://github.com/rocm-developer-tools/rocprofiler BLOCKED - requires hsa-amd-aqlprofile, a closed source package
roctracer Package-x-generic-16.pngroctracer roctracer https://github.com/rocm-developer-tools/roctracer
composable_kernel composable_kernel https://github.com/ROCmSoftwarePlatform/composable_kernel trix is working on this
hipify Package-x-generic-16.pnghipify hipify https://github.com/ROCm-Developer-Tools/HIPIFY

HW Support

Warning.png
Upstream only officially supports x86_64, but they are open to pcc64le and arm64 patches

Some ROCm packages in Fedora are built for all 64bit little endian systems (x86_64, arm64, ppc64le), but official support is for x86_64.

HW support is highly dependent on LLVM version included in Fedora, so if you have newer HW, you might need to wait for newer LLVM versions to be introduced to Fedora (usually in the spring and the autumn).

Warning.png
Note that your millage may vary, as pre vega HW on ROCm is experimental, missing functionality, and not guaranteed to work on all HW

Installation

Setup

To enable access to GPU resources for non-root users, the users must be added to the video (graphics) and render (compute) group. The AMD ROCm Installation Guide (6.0.0) recommends the video and render group for all ROCm-supported operating systems.

To add the current user to the render group: 

   sudo usermod -a -G render,video $LOGNAME

To check for ROCm support of the running HW, you can install and run rocminfo: 

   sudo dnf install rocminfo
   rocminfo

OpenCL

ROCm OpenCL can be installed with: 

   sudo dnf install rocm-opencl

As well, rocm-clinfo or clinfo can be installed to verify it is working, e.g.: 

   sudo dnf install rocm-clinfo
   rocm-clinfo

HIP

HIP is included in Fedora 39 and is pending for Fedora 38. For Fedora 38, you will need to add --enable-repo=updates-testing to dnf if it's not available yet.

Install with: 

   sudo dnf install rocm-hip

For use with Blender, you might need to also install "rocm-hip-devel" if it does not detect HIP.

Intel

TODO: incomplete, take me!

Packages

Packages that use HC

Blender

Build with: 

   rpmbuild --with rocm
Retrieved from "https://fedoraproject.org/w/index.php?title=SIGs/HC&oldid=698517"