What is the SHARK HPC cluster?
<some general description of SHARK and its place within the LUMC>SHARK is the high-performance computing cluster of the LUMC.
| Table of Contents | ||||
|---|---|---|---|---|
|
Cluster overview
OS (Linux): CentOS 8 Stream
Workload manager: Slurm version 20.11
Hardware configuration
List of Nodes
Login and control nodes
Hostname | IP address | CPU | Cores | Memory | GPUs | Purpose | Type machine |
|---|---|---|---|---|---|---|---|
res-hpc-lo02 | 145.88.76.217 | Intel Gold 6248 | 80 | 128Gb | 0 | Login node + Remote Visualization | PowerEdge R740 |
res-hpc-lo03 | 145.88.76.201 | Intel Platinum 8280 | 4 | 8Gb | 0 | Diagnostic Login node | VMware |
res-hpc-lo04 | 145.88.76.219 | Intel Platinum 8280 | 8 | 32Gb | 0 | Login node | VMware |
res-hpc-ma01 | 145.88.76.246 | Intel Platinum 8280 | 2 | 4Gb | 0 | Controller node 1 | VMware |
res-hpc-ma02 | 145.88.76.249 | Intel Platinum 8280 | 1 | 4Gb | 0 | Controller node 2 | VMware |
res-hpc-db01 | 145.88.76.245 | Intel Platinum 8280 | 2 | 16Gb | 0 | Slurm DB node | VMware |
res-hpc-ood01 | 145.88.76.231 | Intel Platinum 8280 | 2 | 4Gb | 0 | OpenOnDemand portal | VMware |
Execution nodes
Hostname | IP address | CPU | Cores | Memory | GPUs | Purpose | Type machine |
|---|---|---|---|---|---|---|---|
res-hpc-exe001 | 145.88.76.212 | Intel E5-2690 | 24 | 384Gb | 0 | Execution node | Dell PowerEdge M630 |
res-hpc-exe002 | 145.88.76.244 | Intel E5-2697 | 48 | 128Gb | 0 | Execution node | Dell PowerEdge M620 |
res-hpc-exe003 | 145.88.76.243 | Intel E5-2690 | 48 | 128Gb | 0 | Execution node | Dell PowerEdge M620 |
res-hpc-exe005 | 145.88.76.211 | Intel E5-2697 | 48 | 384Gb | 0 | Execution node | Dell PowerEdge M620 |
res-hpc-exe007 | 145.88.76.220 | Intel E5-2697 | 24 | 384Gb | 0 | Execution node | Dell PowerEdge M620 |
res-hpc-exe008 | 145.88.76.224 | Intel E5-2697 | 24 | 384Gb | 0 | Execution node | Dell PowerEdge M620 |
res-hpc-exe009 | 145.88.76.221 | Intel E5-2690 | 24 | 384Gb | 0 | Execution node | Dell PowerEdge M630 |
res-hpc-exe011 | 145.88.76.223 | Intel E5-2697 | 24 | 384Gb | 0 | Execution node | Dell PowerEdge M620 |
res-hpc-exe012 | 145.88.76.233 | Intel E5-2690 | 24 | 384Gb | 0 | Execution node | Dell PowerEdge M630 |
res-hpc-exe014 | 145.88.76.242 | Intel E5-2697 | 24 | 384Gb | 0 | Execution node | Dell PowerEdge M620 |
res-hpc-exe027 | 145.88.76.209 | Intel E5-2690 | 28 | 128Gb | 0 | Execution node | Dell PowerEdge M630 |
res-hpc-exe013 | 145.88.76.247 | Intel E5-2670 | 16 | 128Gb | 0 | Execution node | Dell PowerEdge M620 |
res-hpc-exe024 | 145.88.76.232 | Intel E5-2690 | 24 | 128Gb | 0 | Execution node | Dell PowerEdge M630 |
res-hpc-exe029 | 145.88.76.210 | Intel E5-2690 | 28 | 384Gb | 0 | Execution node | Dell PowerEdge M630 |
res-hpc-exe030 | 145.88.76.215 | Intel E5-2697 | 24 | 384Gb | 0 | Execution node | Dell PowerEdge M620 |
res-hpc-exe031 | 145.88.76.214 | Intel E5-2697 | 24 | 512Gb | 0 | Execution node | Dell PowerEdge M620 |
res-hpc-exe032 | 145.88.76.235 | Intel E5-4650 | 48 | 1024Gb | 0 | Execution node | Dell PowerEdge M830 |
res-hpc-exe033 | 145.88.76.227 | Intel E5-4650 | 48 | 1024Gb | 0 | Execution node | Dell PowerEdge M830 |
res-hpc-exe034 | 145.88.76.207 | Intel E5-2697 | 24 | 512Gb | 0 | Execution node | Dell PowerEdge M620 |
res-hpc-exe035 | 145.88.76.239 | Intel E5-2690 | 24 | 384Gb | 0 | Execution node | Dell PowerEdge M630 |
res-hpc-exe036 | 145.88.76.204 | Intel E5-2690 | 28 | 384Gb | 0 | Execution node | Dell PowerEdge M630 |
res-hpc-exe039 | 145.88.76.206 | Intel E5-2690 | 24 | 384Gb | 0 | Execution node | Dell PowerEdge M630 |
res-hpc-exe040 | 145.88.76.228 | Intel E5-2690 | 24 | 384Gb | 0 | Execution node | Dell PowerEdge M630 |
res-hpc-exe041 | 145.88.76.208 | Intel E5-2690 | 24 | 384Gb | 0 | Execution node | Dell PowerEdge M630 |
res-hpc-exe042 | 145.88.76.182 | Intel Gold 6252 | 24 | 96Gb | 0 | Execution node | VMware |
res-hpc-exe043 | 145.88.76.181 | Intel Gold 6252 | 24 | 96Gb | 0 | Execution node | VMware |
res-hpc-gpu01 | 145.88.76.237 | Intel Platinum 8160 | 48 | 512Gb | 3 | GPU node, Execution node | Dell PowerEdge R740 |
res-hpc-gpu02 | 145.88.76.234 | Intel Platinum 8160 | 48 | 512Gb | 2 | GPU node, Execution node | Dell PowerEdge R740 |
res-hpc-mem01 | 145.88.76.200 | Intel E7-4890 | 60 | 3072Gb | 0 | Execution node | Dell PowerEdge R920 |
res-hpc-mem02 | 145.88.76.218 | Intel E5-4657L | 48 | 1024Gb | 0 | Execution node | Dell PowerEdge M820 |
GPU-equipped nodes
Hostname | IP address | CPU | Cores | Memory | GPUs | Purpose | Type machine |
|---|---|---|---|---|---|---|---|
res-hpc-gpu01 | 145.88.76.237 | Intel Platinum 8160 | 48 | 512Gb | 3 | GPU node, Execution node | Dell PowerEdge R740 |
res-hpc-gpu02 | 145.88.76.234 | Intel Platinum 8160 | 48 | 512Gb | 2 | GPU node, Execution node | Dell PowerEdge R740 |
res-hpc-gpu03 | 145.88.76.190 | Intel Gold 6252 | 6 | 48Gb | 1 | GPU node | VMware |
res-hpc-gpu04 | 145.88.76.189 | Intel Gold 6252 | 6 | 48Gb | 1 | GPU node | VMware |
res-hpc-gpu05 | 145.88.76.188 | Intel Gold 6252 | 6 | 48Gb | 1 | GPU node | VMware |
res-hpc-gpu06 | 145.88.76.187 | Intel Gold 6252 | 6 | 48Gb | 1 | GPU node | VMware |
res-hpc-gpu07 | 145.88.76.186 | Intel Gold 6252 | 12 | 96Gb | 2 | GPU node | VMware |
res-hpc-gpu08 | 145.88.76.185 | Intel Gold 6252 | 12 | 96Gb | 1 | GPU node | VMware |
res-hpc-gpu09 | 145.88.76.184 | Intel Gold 6252 | 6 | 48Gb | 1 | GPU node | VMware |
res-hpc-gpu10 | 145.88.76.180 | Intel Gold 6252 | 6 | 48Gb | 1 | GPU node | VMware |
res-hpc-gpu11 | 145.88.76.179 | Intel Gold 6252 | 6 | 48Gb | 1 | GPU node | VMware |
res-hpc-lkeb03 | 145.88.76.226 | Intel E5-2698 | 40 | 256Gb | 4 | GPU node | NVIDIA DGX Station |
res-hpc-lkeb04 | 145.88.76.248 | Intel E5-1650 | 12 | 256Gb | 4 | GPU node | ASUS All Series |
res-hpc-lkeb05 | 145.88.76.194 | Intel Gold 6134 | 16 | 256Gb | 3 | GPU node | Precision 7920 Rack |
res-hpc-lkeb06 | 145.88.76.225 | Intel Gold 6234 | 16 | 256Gb | 3 | GPU node | Precision 7920 Rack |
res-hpc-lkeb07 | 145.88.76.203 | Intel Gold 6234 | 16 | 256Gb | 3 | GPU node | Precision 7920 Rack |
res-hpc-path01 | 145.88.76.197 | Intel Gold 6234 | 16 | 256b | 3 | GPU node | Precision 7920 Rack |
res-hpc-path02 | 145.88.76.222 | Intel Gold 6234 | 16 | 256Gb | 3 | GPU node | Precision 7920 Rack |
GPU overview
The table below lists the types of GPUs available on the GPU-equipped nodes.
Hostname | Access | GPU 0 (cores/mem) | GPU 1 (cores/mem) | GPU 2 (cores/mem) | GPU 3 (cores/mem) |
|---|---|---|---|---|---|
res-hpc-lo02 | Everyone | Tesla T4 (2560/16Gb) | |||
res-hpc-gpu0[1-2] | Everyone | TITAN Xp (3840/12Gb) | TITAN Xp (3840/12Gb) | TITAN Xp (3840/12Gb) | |
res-hpc-lkeb03 | LKEB | Tesla V100-DGXS (5120/16Gb) | Tesla V100-DGXS (5120/16Gb) | Tesla V100-DGXS (5120/16Gb) | Tesla V100-DGXS (5120/16Gb) |
res-hpc-lkeb04 | LKEB | GeForce GTX 1080 Ti (3584/12Gb) | GeForce GTX 1080 Ti (3584/12Gb) | GeForce GTX 1080 Ti (3584/12Gb) | GeForce GTX 1080 Ti (3584/12Gb) |
res-hpc-lkeb0[5-7] | LKEB | Quadro RTX 6000 (4608/24Gb) | Quadro RTX 6000 (4608/24Gb) | Quadro RTX 6000 (4608/24Gb) | |
res-hpc-path0[1-2] | Pathologie | Quadro RTX 6000 (4608/24Gb) | Quadro RTX 6000 (4608/24Gb) | Quadro RTX 6000 (4608/24Gb) | |
res-hpc-gpu03 | Everyone | GRID V100D-16Q (16384/16Gb) | |||
res-hpc-gpu04 | Everyone | Quadro RTX 6000 (4608/24Gb) | Quadro RTX 6000 (4608/24Gb) | Quadro RTX 6000 (4608/24Gb) | |
res-hpc-gpu0[5-6] | Radio Therapy | GRID V100D-16Q (16384/16Gb) | |||
res-hpc-gpu07 | Everyone | GRID V100S-32Q (32768/32Gb) | GRID V100S-32Q (32768/32Gb) | ||
res-hpc-gpu08 | Radio Therapy | GRID V100S-32Q (32768/32Gb) | |||
res-hpc-gpu09 | Everyone | GRID V100D-16Q (16384/16Gb) | |||
res-hpc-gpu[10-11] | Radio Therapy | GRID V100S-16Q (16384/16Gb) |
Network overview
