Skip to content

Commit

Permalink
Update UCX to version 1.12.1
Browse files Browse the repository at this point in the history
Enable additional libraries in UCX:
  - enable the use of xpmem for intra-node communication;
  - enable the use of ROCm for AMD gpus;
  - remove the ROCm GDR module, which is not compatible with GDRCopy v2.x.

Update UCX to version 1.12.1:
  - change the default for UCX_MEM_CUDA_HOOK_MODE from "reloc" to "bistro";
  - various bug fixes for CUDA and ROCm;
  - see https://github.com/openucx/ucx/releases/tag/v1.12.1 for the full
    change log.
  • Loading branch information
fwyzard committed Apr 20, 2022
1 parent 8420306 commit ef20ef1
Showing 1 changed file with 16 additions and 10 deletions.
26 changes: 16 additions & 10 deletions ucx.spec
Original file line number Diff line number Diff line change
@@ -1,19 +1,24 @@
### RPM external ucx 1.12.0
### RPM external ucx 1.12.1
Source: https://github.com/openucx/%{n}/releases/download/v%{realversion}/%{n}-%{realversion}.tar.gz
BuildRequires: autotools
Requires: cuda gdrcopy
Requires: numactl
Requires: gdrcopy cuda
Requires: rdma-core
Requires: rocm
Requires: xpmem
AutoReq: no
# external libraries are needed for additional protocols:
# --with-rocm: AMD ROCm platform for accelerated compute
# --with-cm: Userspace InfiniBand Communication Managment library: deprecated and removed from RDMA core v17 on December 2017
# --with-knem: KNEM High-Performance Intra-Node MPI Communication
# etc.

%prep
%setup -q -n %{n}-%{realversion}

# remove the ROCm GDR module, because it is not compatible with GDRCopy v2.x
sed -e'/SUBDIRS/s/ *\<gdr\>//' -i src/uct/rocm/Makefile.am
sed -e'/src\/uct\/rocm\/gdr\/configure\.m4/d' -i src/uct/rocm/configure.m4
rm -rf src/uct/rocm/gdr

# regenerate the configure files and Makefiles
./autogen.sh

./configure \
--prefix=%i \
--disable-dependency-tracking \
Expand All @@ -32,9 +37,10 @@ AutoReq: no
--with-avx \
--with-sse41 \
--with-sse42 \
--without-go \
--without-java \
--with-cuda=$CUDA_ROOT \
--without-rocm \
--with-rocm=$ROCM_ROOT \
--with-gdrcopy=$GDRCOPY_ROOT \
--with-verbs=$RDMA_CORE_ROOT \
--with-rc \
Expand All @@ -43,10 +49,10 @@ AutoReq: no
--with-mlx5-dv \
--with-ib-hw-tm \
--with-dm \
--without-cm \
--with-rdmacm=$RDMA_CORE_ROOT \
--without-knem \
--with-xpmem \
--with-xpmem=$XPMEM_ROOT \
--without-ugni \
CFLAGS="-Wno-error=array-bounds" \
CPPFLAGS="-I$NUMACTL_ROOT/include" \
LDFLAGS="-L$NUMACTL_ROOT/lib"
Expand Down

0 comments on commit ef20ef1

Please sign in to comment.