Latest revision as of 17:52, 14 January 2024

Heterogeneous Computing Special Interest Group

Mission

To encourage the packaging and accessibility of heterogeneous computing projects in Fedora and EPEL. This includes machine learning, OpenCL, and scientific computing.

Communication

While separate from the AI/ML SIG, we do share communication channels for now. If you're interested, please join us on:

#ai-ml@fedoraproject.org Matrix room
#fedora-ai-ml on libera.chat IRC (NOTE: With the recent Matrix/IRC bridge issues, there may not be much activity on IRC. More conversation happens in the Matrix room)
#ai-ml-sig on Fedora's Discourse instance

Members/Packagers/Reviewers

Jeremy Newton (ROCm related)
Felix Schwarz (currently busy with certbot, borgbackup, WeasyPrint)
Benson Muite
Morgan Hough (Intel related while testing SODECL on Intel NUCs)
Tom Rix (Misc)
Tim Flink
Brian Lu
Jonathan Steffan
David DUncan (currently working on Fedora Cloud Edition and want to build Deep Learning Images for public cloud)

Please add your name above if you want to help.

Tasks

Package and make HC related projects more accessible to users (such as OpenCL, AMD's ROCm HIP, Intel oneAPI, SYCL, Vulkan, OpenGL, etc.)
Document installation, packages, and general use cases
Translation of wiki pages and documentation (if applicable)

AMD's ROCm (OpenCL/HIP)

Package status

Below is a list of ROCm packages with their status. If something isn't packaged in Fedora or EPEL, feel free to take it!

For reference, pytorch still requires: rocblas, miopen, rocfft, hipfft, hipsparse, rccl, rocprim, hipcub, rocthrust

Name	Fedora Package	EPEL?	Upstream package name	Upstream URL	Notes
roct-thunk-interface	`hsakmt`	Yes	hsakmt-roct	https://github.com/radeonopencompute/roct-thunk-interface
rocr-runtime	`rocm-runtime`	Yes	hsa-rocr	https://github.com/radeonopencompute/rocr-runtime
rocminfo	`rocminfo`	Yes	rocminfo	https://github.com/radeonopencompute/rocminfo
rocm-compilersupport	`rocm-compilersupport`	Yes	comgr	https://github.com/radeonopencompute/rocm-compilersupport
rocm-device-libs	`rocm-device-libs`	Yes	rocm-device-libs	https://github.com/radeonopencompute/rocm-device-libs
opencl-icd-loader			rocm-ocl-icd	https://github.com/KhronosGroup/OpenCL-ICD-Loader	Fedora already has `ocl-icd`, but the khronos version is required for GL-CL interop support
rocm-opencl-runtime	`rocm-opencl`	Yes	rocm-opencl	https://github.com/radeonopencompute/rocm-opencl-runtime	rocm-opencl is now a sub-package of `rocclr` in Fedora 38+
rocm_smi_lib	`rocm-smi`		rocm-smi-lib	https://github.com/radeonopencompute/rocm_smi_lib
hipamd	`rocm-hip`		hip-runtime-amd	https://github.com/rocm-developer-tools/hipamd	rocm-hip is a subpackage of `rocclr`
hipcc	`hipcc`		hip-[devel,docs]	https://github.com/rocm-developer-tools/HIP	hipcc is a subpackage of `rocclr`
hip-samples			hip-samples	requires better cmake infra from upstream
rocm-cmake	`rocm-cmake`		rocm-cmake	https://github.com/radeonopencompute/rocm-cmake	Needed by most of the roc* and hip* packages below
hipblas	`hipblas`	hipblas	https://github.com/rocmsoftwareplatform/hipblas
hipsparse	`hipsparse`	hipsparse	https://github.com/rocmsoftwareplatform/hipsparse
rocalution	`rocalution`	rocalution	https://github.com/rocmsoftwareplatform/rocalution
rocblas	`rocblas`		rocblas	https://github.com/rocmsoftwareplatform/rocblas
rocfft	In Review		rocfft	https://github.com/rocmsoftwareplatform/rocfft	Review Link
hipfft			?	https://github.com/rocmsoftwareplatform/hipfft	Requires rocfft
rocmvalidationsuite			rocm-validation-suite	https://github.com/rocm-developer-tools/rocmvalidationsuite	requires rocblas, rocm_smi_lib
rocprim	`rocprim`		rocprim	https://github.com/rocmsoftwareplatform/rocprim
rocrand	`rocrand`		rocrand	https://github.com/rocmsoftwareplatform/rocrand
hiprand	`hiprand`		rocrand	https://github.com/rocmsoftwareplatform/rocrand	Used to be a subpackage of `rocrand`
rocsolver			rocsolver	https://github.com/rocmsoftwareplatform/rocsolver
rocsparse	`rocsparse`		rocsparse	https://github.com/rocmsoftwareplatform/rocsparse
rocthrust	`rocthrust`		rocthrust	https://github.com/rocmsoftwareplatform/rocthrust
hipcub	`hipcub`		hipcub	https://github.com/rocmsoftwareplatform/hipcub
rccl			?	https://github.com/rocmsoftwareplatform/rccl	requires hipify
miopen			?	https://github.com/rocmsoftwareplatform/miopen	requires rocblas
tensile	`python-tensile`		?	https://github.com/rocmsoftwareplatform/tensile
rocdbgapi	In Review		rocm-dbgapi	https://github.com/rocm-developer-tools/rocdbgapi	Review Link
rocgdb	In Review		rocm-gdb	https://github.com/rocm-developer-tools/rocgdb	A fork of `gdb` with ROCm related addons, Requires rocdbgapi Review Link
rocprofiler			rocprofiler	https://github.com/rocm-developer-tools/rocprofiler	BLOCKED - requires hsa-amd-aqlprofile, a closed source package
roctracer	`roctracer`		roctracer	https://github.com/rocm-developer-tools/roctracer
composable_kernel			composable_kernel	https://github.com/ROCmSoftwarePlatform/composable_kernel	trix is working on this
hipify	`hipify`		hipify	https://github.com/ROCm-Developer-Tools/HIPIFY

HW Support

Upstream only officially supports x86_64, but they are open to pcc64le and arm64 patches

Some ROCm packages in Fedora are built for all 64bit little endian systems (x86_64, arm64, ppc64le), but official support is for x86_64.

HW support is highly dependent on LLVM version included in Fedora, so if you have newer HW, you might need to wait for newer LLVM versions to be introduced to Fedora (usually in the spring and the autumn).

Note that your millage may vary, as pre vega HW on ROCm is experimental, missing functionality, and not guaranteed to work on all HW

Installation

Setup

To enable access to GPU resources for non-root users, the users must be added to the video (graphics) and render (compute) group. The AMD ROCm Installation Guide (6.0.0) recommends the video and render group for all ROCm-supported operating systems.

To add the current user to the render group:

   sudo usermod -a -G render,video $LOGNAME

To check for ROCm support of the running HW, you can install and run rocminfo:

   sudo dnf install rocminfo
   rocminfo

OpenCL

ROCm OpenCL can be installed with:

   sudo dnf install rocm-opencl

As well, rocm-clinfo or clinfo can be installed to verify it is working, e.g.:

   sudo dnf install rocm-clinfo
   rocm-clinfo

HIP

HIP is included in Fedora 39 and is pending for Fedora 38. For Fedora 38, you will need to add --enable-repo=updates-testing to dnf if it's not available yet.

Install with:

   sudo dnf install rocm-hip

For use with Blender, you might need to also install "rocm-hip-devel" if it does not detect HIP.

Intel

TODO: incomplete, take me!

Packages

Packages that use HC

Blender

Build with:

   rpmbuild --with rocm

@@ Line 3: / Line 3: @@
 == Mission ==
 To encourage the packaging and accessibility of heterogeneous computing projects in Fedora and EPEL. This includes machine learning, OpenCL, and scientific computing.
+== Communication ==
+While separate from the [[SIGs/AI-ML|AI/ML SIG]], we do share communication channels for now. If you're interested, please join us on:
+* [https://matrix.to/#/#ai-ml:fedoraproject.org #ai-ml@fedoraproject.org Matrix room]
+* #fedora-ai-ml on [https://libera.chat libera.chat IRC] ('''NOTE:''' With [https://discussion.fedoraproject.org/t/matrix-to-libera-chat-irc-bridge-unavailable/87081 the recent Matrix/IRC bridge issues], there may not be much activity on IRC. More conversation happens in the Matrix room)
+* [https://discussion.fedoraproject.org/tags/c/project/7/ai-ml-sig #ai-ml-sig on Fedora's Discourse instance]
 == Members/Packagers/Reviewers ==
@@ Line 9: / Line 16: @@
 * Benson Muite
 * [[User:mhough|Morgan Hough]] (Intel related while testing SODECL on Intel NUCs)
-* [[User:trix|Tom Rix]] (CUDA, OpenCL, Vulkan Compute, Misc)
+* [[User:trix|Tom Rix]] (Misc)
 * [[User:Tflink|Tim Flink]]
 * [[User:Greencappuccino|Brian Lu]]
+* [[User:jsteffan|Jonathan Steffan]]
+* [[User:davdunc| David DUncan]] (currently working on Fedora Cloud Edition and want to build Deep Learning Images for public cloud)
 Please add your name above if you want to help.
@@ Line 43: / Line 52: @@
 | opencl-icd-loader || || || rocm-ocl-icd || https://github.com/KhronosGroup/OpenCL-ICD-Loader || Fedora already has {{ package|ocl-icd|ocl-icd}}, but the khronos version is required for GL-CL interop support ||
 |-
-| rocm-opencl-runtime || {{ package|rocclr|rocm-opencl}} (F38 or newer), {{ package|rocm-opencl|rocm-opencl}} (F37 or older) || Yes || rocm-opencl || https://github.com/radeonopencompute/rocm-opencl-runtime || rocm-opencl is now a sub-package of rocclr in Fedora 38+ ||
+| rocm-opencl-runtime || {{ package|rocclr|rocm-opencl}} || Yes || rocm-opencl || https://github.com/radeonopencompute/rocm-opencl-runtime || rocm-opencl is now a sub-package of {{ package|rocclr}} in Fedora 38+ ||
 |-
-| rocm_smi_lib || '''See notes''' || || rocm-smi-lib || https://github.com/radeonopencompute/rocm_smi_lib || The deprecated {{ package|rocm-smi|rocm-smi}} should be replaced by this
+| rocm_smi_lib || {{ package|rocm-smi}} || || rocm-smi-lib || https://github.com/radeonopencompute/rocm_smi_lib ||
 |-
-| hipamd || {{ package|rocclr|rocm-hip}} || || hip-runtime-amd || https://github.com/rocm-developer-tools/hipamd || rocm-hip is a subpackage of rocclr, currently in f38 updates testing: https://bodhi.fedoraproject.org/updates/FEDORA-2023-a53dd0f60b ||
+| hipamd || {{ package|rocclr|rocm-hip}} || || hip-runtime-amd || https://github.com/rocm-developer-tools/hipamd || rocm-hip is a subpackage of {{ package|rocclr}} ||
 |-
-| hip || {{ package|rocclr|hip}} || || hip-[devel,docs] || https://github.com/rocm-developer-tools/HIP || hip-devel is a subpackage of rocclr ||
+| hipcc || {{ package|rocclr|hipcc}} || || hip-[devel,docs] || https://github.com/rocm-developer-tools/HIP || hipcc is a subpackage of {{ package|rocclr}} ||
 |-
-| hip-samples || || || hip-samples || https://github.com/ROCm-Developer-Tools/HIP-Examples | ||
+| hip-samples || || || hip-samples || https://github.com/ROCm-Developer-Tools/HIP-Examples | requires better cmake infra from upstream ||
 |-
 | rocm-cmake || {{ package|rocm-cmake}} || || rocm-cmake || https://github.com/radeonopencompute/rocm-cmake || Needed by most of the roc* and hip* packages below ||
 |-
-| hipblas || || || hipblas || https://github.com/rocmsoftwareplatform/hipblas || '''requires rocblas, rocsolver, rocsparse, tensile''' ||
+| hipblas || {{ package|hipblas}} || hipblas || https://github.com/rocmsoftwareplatform/hipblas || ||
 |-
-| hipsparse || || || hipsparse || https://github.com/rocmsoftwareplatform/hipsparse || Requires rocsparse? ||
+| hipsparse || {{ package|hipsparse}} || hipsparse || https://github.com/rocmsoftwareplatform/hipsparse ||  ||
 |-
-| rocalution || || || rocalutio || https://github.com/rocmsoftwareplatform/rocalution || ||
+| rocalution || {{ package|rocalution}} || rocalution || https://github.com/rocmsoftwareplatform/rocalution ||  ||
 |-
-| rocblas || || || rocblas || https://github.com/rocmsoftwareplatform/rocblas || similar requires as hipblas? ||
+| rocblas || {{ package|rocblas}} || || rocblas || https://github.com/rocmsoftwareplatform/rocblas ||  ||
 |-
-| rocfft || || || rocfft || https://github.com/rocmsoftwareplatform/rocfft || [[User:Tflink|tflink]] is working on this ||
+| rocfft || '''In Review''' || || rocfft || https://github.com/rocmsoftwareplatform/rocfft || [https://bugzilla.redhat.com/show_bug.cgi?id=2251086 Review Link] ||
 |-
 | hipfft || || || ? || https://github.com/rocmsoftwareplatform/hipfft || '''Requires rocfft''' ||
 |-
-| rocmvalidationsuite || || || rocm-validation-suite || https://github.com/rocm-developer-tools/rocmvalidationsuite || ||
+| rocmvalidationsuite || || || rocm-validation-suite || https://github.com/rocm-developer-tools/rocmvalidationsuite || '''requires rocblas, rocm_smi_lib''' ||
+|-
+| rocprim || {{ package|rocprim }} || || rocprim || https://github.com/rocmsoftwareplatform/rocprim ||  ||
 |-
-| rocprim || [https://bugzilla.redhat.com/show_bug.cgi?id=2215174 review in progress] || || rocprim || https://github.com/rocmsoftwareplatform/rocprim || [[User:Mystro256|Jeremy Newton]] is working on this ||
+| rocrand ||{{ package|rocrand}} || || rocrand || https://github.com/rocmsoftwareplatform/rocrand ||  ||
 |-
-| rocrand ||{{ package|rocrand}} || || rocrand || https://github.com/rocmsoftwareplatform/rocrand || Also includes {{ package|rocrand|hiprand}} subpackage ||
+| hiprand ||{{ package|hiprand}} || || rocrand || https://github.com/rocmsoftwareplatform/rocrand || Used to be a subpackage of {{ package|rocrand}} ||
 |-
 | rocsolver || || || rocsolver || https://github.com/rocmsoftwareplatform/rocsolver || ||
 |-
-| rocsparse || || || rocsparse || https://github.com/rocmsoftwareplatform/rocsparse || '''Requires rocprim''' ||
+| rocsparse || {{ package|rocsparse}} || || rocsparse || https://github.com/rocmsoftwareplatform/rocsparse || ||
+|-
+| rocthrust || {{ package|rocthrust }} || || rocthrust || https://github.com/rocmsoftwareplatform/rocthrust || ||
+|-
+| hipcub || {{ package|hipcub}} || || hipcub  || https://github.com/rocmsoftwareplatform/hipcub || ||
 |-
-| rocthrust || || || ? || https://github.com/rocmsoftwareplatform/rocthrust || '''Requires rocprim''' ||
+| rccl || || || ? || https://github.com/rocmsoftwareplatform/rccl || requires hipify ||
 |-
-| hipcub || || || ? || https://github.com/rocmsoftwareplatform/hipcub || '''Requires rocprim''' ||
+| miopen || || || ? || https://github.com/rocmsoftwareplatform/miopen || requires rocblas ||
 |-
-| rccl || || || ? || https://github.com/rocmsoftwareplatform/rccl || ||
+| tensile || {{ package|python-tensile }} || || ? || https://github.com/rocmsoftwareplatform/tensile || ||
 |-
-| miopen || || || ? || https://github.com/rocmsoftwareplatform/miopen || ||
+| rocdbgapi || '''In Review || || rocm-dbgapi || https://github.com/rocm-developer-tools/rocdbgapi || [https://bugzilla.redhat.com/show_bug.cgi?id=2246661 Review Link] ||
 |-
-| tensile || || || ? || https://github.com/rocmsoftwareplatform/tensile || ||
+| rocgdb || '''In Review''' || || rocm-gdb || https://github.com/rocm-developer-tools/rocgdb || A fork of {{ package|gdb|gdb}} with ROCm related addons, '''Requires rocdbgapi''' [https://bugzilla.redhat.com/show_bug.cgi?id=2246670 Review Link] ||
 |-
-| rocdbgapi || || || rocm-dbgapi || https://github.com/rocm-developer-tools/rocdbgapi ||[[User:Tflink|tflink]] has started this to help debug another problem I'm hitting, not quite ready for review yet ||
+| rocprofiler || || || rocprofiler || https://github.com/rocm-developer-tools/rocprofiler || BLOCKED - requires hsa-amd-aqlprofile, a closed source package ||
 |-
-| rocgdb || || || rocm-gdb || https://github.com/rocm-developer-tools/rocgdb || A fork of {{ package|gdb|gdb}} with ROCm related addons, '''Requires rocdbgapi''' ||
+| roctracer || {{ package|roctracer }} || || roctracer || https://github.com/rocm-developer-tools/roctracer || ||
 |-
-| rocprofiler || || || rocprofiler || https://github.com/rocm-developer-tools/rocprofiler || ||
+| composable_kernel || || || composable_kernel ||https://github.com/ROCmSoftwarePlatform/composable_kernel || trix is working on this ||
 |-
-| roctracer || || || roctracer || https://github.com/rocm-developer-tools/roctracer || ||
+| hipify || {{ package|hipify}} || || hipify || https://github.com/ROCm-Developer-Tools/HIPIFY ||  ||
 |}
@@ Line 99: / Line 114: @@
 {{Admon/warning | Upstream only officially supports x86_64, but they are open to pcc64le and arm64 patches}}
-The ROCm packages in Fedora are built for all 64bit little endian systems (x86_64, arm64, ppc64le), but official support is for x86_64.
+Some ROCm packages in Fedora are built for all 64bit little endian systems (x86_64, arm64, ppc64le), but official support is for x86_64.
 HW support is highly dependent on LLVM version included in Fedora, so if you have newer HW, you might need to wait for newer LLVM versions to be introduced to Fedora (usually in the spring and the autumn).
@@ Line 108: / Line 123: @@
 === Setup ===
-To enable access to GPU resources for non-root users, the users must be added to the `video` or `render` group. The [https://docs.amd.com/bundle/ROCm-Installation-Guide-v5.2/page/Prerequisite_Actions.html#d3685e735 AMD ROCm Installation Guide (v5.2)] and [https://docs.amd.com/bundle/ROCm-Installation_FAQ/page/Frequently_Asked_Questions.html#d2e165 FAQs] recommend the `video` group for all ROCm-supported operating systems.
+To enable access to GPU resources for non-root users, the users must be added to the `video` (graphics) and `render` (compute) group. The [https://rocm.docs.amd.com/projects/install-on-linux/en/docs-6.0.0/how-to/prerequisites.html#setting-permissions-for-groups AMD ROCm Installation Guide (6.0.0)] recommends the `video` and `render` group for all ROCm-supported operating systems.
-{{admon/note|Note:| The `render` group is only required for Ubuntu v20.04.}}
-To add the current user to the `video` group:
+To add the current user to the `render` group:
-     sudo usermod -a -G video $LOGNAME
+     sudo usermod -a -G render,video $LOGNAME
 To check for ROCm support of the running HW, you can install and run `rocminfo`:
@@ Line 146: / Line 159: @@
 TODO: incomplete, take me!
+= Packages =
+Packages that use HC
+== Blender ==
+Build with:
+    rpmbuild --with rocm
 [[Category:SIGs]]
 [[Category:Language-specific SIGs]]
 [[Category:Fedora special-interest groups]]

Search

SIGs/HC: Difference between revisions