Hardware

LoBoS makes a wide variety of modern hardware available to participating researchers. The current list of hardware is:

Compute Nodes


  • GPU nodes

    • 1 node with 8xH100 NVIDIA GPUs (80 GB), 48-core AMD Epyc 9454 CPU

    • 2 nodes with 8xA100 NVIDIA GPUs (80 GB), 2x32-core AMD Epyc 7513 CPU

    • 13 nodes with 4xA100 NVIDIA GPUs (80 GB), 2x48-core AMD Epyc 7413 CPU

    • 20 nodes with 2xA100 NVIDIA GPUs, eight-core AMD Epyc 7232P CPU, 64 GB of RAM

    • 25 nodes with 2xV100 NVIDIA GPUs, six-core Intel Xeon Bronze CPU, 48 GB of RAM

    • 2 nodes with 4xP100 NVIDIA GPUs, 2x twelve-core Intel Broadwell CPUs, 64 GB of RAM, FDR Infiniband

    • 4 nodes with 4xTitanXp NVIDIA GPUs, 2x twelve-core Intel Broadwell CPUs, 64 GB of RAM, FDR Infiniband

    • 2 node with 8xBlackwell NVIDIA GPUs (96 GB), 64-core AMD Epyc 9354 CPU

  • CPU nodes

    • 28 nodes with 2x twenty-four-core 2.2 GHz, 8 GT/s QPI Intel Silver (Emerald) CPUs and 256 GB of RAM, NDR Infiniband

    • 36 nodes with 2x twelve-core 2.1 GHz, 9.6 GT/s QPI Intel Silver (Skylake) CPUs and 48 GB of RAM, FDR Infiniband

    • 20 nodes with 2x ten-core 2.4 GHz, 8 GT/s QPI Intel Xeon (Broadwell) CPUs and 64 GB of RAM, FDR Infiniband

    • 72 nodes with 2x eigth-core 2.4 GHz, 7.2 GT/s QPI Intel Xeon (Haswell) CPUs and 32 GB of RAM, FDR Infiniband

    • 5 "Pods", each with 32 2x eigth-core 2.4 GHz, 7.2 GT/s QPI Intel Xeon (Haswell) CPUs and 32 GB of RAM, FDR Infiniband

    • 48 nodes with 2x six-core 2.6 GHz, 7.2 GT/s QPI Intel Xeon (Ivy Bridge) CPUs and 16 GB of RAM, QDR Infiniband


Analysis Nodes


  • 1 node with 2x 14 core Intel Skylake CPUs, 384 GB of RAM, 400 GB of fast SSD storage mounted under /scratch, and a 10 Gbps NIC

  • 1 node with 8 core AMD Epyc 7232 CPU, 64 GB of RAM, and a 2.5 Gbps NIC

  • 2 nodes with 2x 12 core Intel Haswell CPUs, 256 GB RAM, 800 GB SSD /scratch, 40 Gb NICs

  • 2 nodes with 2x 12 core Intel Ivybridge CPUs, 256 GB of RAM, 450 GB of fast SSD storage mounted under /scratch, and a 10 Gbps NIC

  • GPU analysis nodes

    • 1 node with 16 core AMD Epyc 7282 CPU, 500 GB of RAM, and a 10 Gbps NIC

    • 2 node with 2x 32 core Intel Xeon CPUs, 500 GB of RAM, and a 10 Gbps NIC

    • One with 4x Tesla M2090

    • Two with 2x K20m


Storage


  • 1 PB of combined primary storage/global scratch space. provided by a VAST Data flash storage system

  • 1.3 PB of archive storage provided by a FreeBSD based ZFS filesystem.

  • 500 TB of offsite backup storage provided by a FreeBSD based ZFS filesystem


NVIDIA 4-way NVLINK machines