View Source

TEMS is to be retired at the end of October 2021. See more information here .

The system is composed of 60 nodes:

40 compute nodes, for parallel jobs
20 GPIL (General Purpose and Interactive Login) nodes, which are devised to integrate the interactive and post-processing work that is being currently done on the Cray HPCF, ECGATE and Linux Clusters.

Each node on TEMS comes with:

2 x AMD EPYC Rome 7H12
512 GiB memory

The node configuration of this cluster differs slightly from the future main systems. See below for more details.

Main differences with the previous Cray XC40 system

The most notorious change is on the processor architecture, from Intel to AMD. Although both implement the x86_64 instruction set, the latter has many more cores.

	Cray (CCA/CCB)	Atos (TEMS)	Atos future main systems
CPU Architecture	Intel Broadwell	AMD EPYC Rome	AMD EPYC Rome
Core Frequency	2.1 GHz	2.6 GHz	2.5 GHz (GPIL) / 2.25 GHz (compute)
Cores per node (HT)	36 (72)	128 (256)	128 (256)
Memory per node	128 GiB	512 GiB	512 GiB (GPIL) / 256 GiB (compute)
Fabric interconnect	Cray Aries	Mellanox HDR Infiniband - 100 Gbps	Mellanox HDR Infiniband - 100 Gbps (GPIL) / 200 Gbps (compute)
Operating System	Based on SLES 11	Based on RHEL 8	Based on RHEL 8
Batch system	PBS with ALPS	SLURM	SLURM
Parallel Filesystem	Lustre	Lustre	Lustre
Compilers	Cray, GNU, Intel	GNU, Intel, AOCC	GNU, Intel, AOCC
MPI	Cray MPICH	Intel MPI, OpenMPI	Intel MPI, OpenMPI