| ... | ... | @@ -42,56 +42,26 @@ refer to those script help (`-h`) option for more details. |
|
|
|
|
|
|
|
# Jean Zay (Idris)
|
|
|
|
|
|
|
|
## Environment
|
|
|
|
## Production Cuda
|
|
|
|
|
|
|
|
On October 2019, the code can build with the following environment (as usual with python, the module order is important):
|
|
|
|
We assume the repository is in `<srcdir>` and you are in `<builddir>`
|
|
|
|
|
|
|
|
* Environment
|
|
|
|
```
|
|
|
|
File Edit Options Buffers Tools Help
|
|
|
|
module purge
|
|
|
|
|
|
|
|
module use --append /gpfslocalsup/pub/module-rh/modulefiles
|
|
|
|
module use --append /gpfslocalsup/pub/modules-idris-env4/modulefiles/linux-rhel7-x86_64
|
|
|
|
#module load python/3.7.3
|
|
|
|
module load gcc/9.1.0
|
|
|
|
module load --notuasked intel-compilers/19.0.5
|
|
|
|
module load --notuasked intel-mkl/19.0.5
|
|
|
|
module load --notuasked intel-mpi/19.0.5
|
|
|
|
module load --notuasked intel-vtune/19.0.5
|
|
|
|
module load --notuasked intel-advisor/19.0.5
|
|
|
|
module load --notuasked intel-tbb/19.0.5
|
|
|
|
module load --notuasked intel-itac/19.0.5
|
|
|
|
module load intel-all/19.0.5
|
|
|
|
module load boost/1.70.0-mpi
|
|
|
|
module load hdf5/1.10.5
|
|
|
|
module load cmake
|
|
|
|
module load git-lfs
|
|
|
|
|
|
|
|
export CC=icc
|
|
|
|
export CXX=icpc
|
|
|
|
export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/gpfslocalsys/intel/parallel_studio_xe_2019_update5_cluster_edition/compilers_and_libraries_2019.5.28\
|
|
|
|
1/linux/ipp/lib/intel64_lin/threaded/
|
|
|
|
|
|
|
|
$ source ../contrib/build/Jean_Zay/env.sh
|
|
|
|
```
|
|
|
|
|
|
|
|
Notes:
|
|
|
|
* We need to explicitly update the **LD_LIBRARY_PATH** so that the binaries can find the `ipp` support (needed in release mode).
|
|
|
|
Support is working on that.
|
|
|
|
* Idris does not provide libs with c++11 string ABI enabled (see the [gnu team explanation](https://gcc.gnu.org/onlinedocs/libstdc++/manual/using_dual_abi.html) if you're interested in the gory details). As a result, you need to explicitly disable it. The esiest way is to set **_GLIBCXX_USE_CXX11_ABI** to 0 in the CMakeCache.txt of the build directory:
|
|
|
|
* Configuration
|
|
|
|
```
|
|
|
|
CMAKE_CXX_FLAGS:STRING=-D_GLIBCXX_USE_CXX11_ABI=0 -axCOMMON-AVX512
|
|
|
|
```
|
|
|
|
|
|
|
|
## Build
|
|
|
|
|
|
|
|
As usual:
|
|
|
|
$ source <srcdir> cmake -DCMAKE_BUILD_TYPE=Release -DKokkos_ENABLE_CUDA=On -DKokkos_ARCH_VOLTA70=On -DGEN_DOC=Off <srcdir>
|
|
|
|
```
|
|
|
|
$ cmake <srcpath>
|
|
|
|
....
|
|
|
|
$ make
|
|
|
|
* Build
|
|
|
|
```
|
|
|
|
$ make
|
|
|
|
```
|
|
|
|
or
|
|
|
|
```
|
|
|
|
$ srun -p compil --cpus-per-task=10 --time=0:10:0 -A oth@gpu make -j10
|
|
|
|
```
|
|
|
|
## Testing
|
|
|
|
Has it's own `jzayTest.sh` and `jzayTrackTest.sh` test scripts for distributed testing.
|
|
|
|
|
|
|
|
# Aurora (Lund)
|
|
|
|
|
| ... | ... | |
