Hardware

LoBoS makes a wide variety of modern hardware available to participating researchers. The current list of hardware is:

Compute Nodes


  • GPU nodes

    • 20 nodes with 2xA100 NVIDIA GPUs, eight-core AMD Epyc 7232P CPU, 64 GB of RAM

    • 25 nodes with 2xV100 NVIDIA GPUs, six-core Intel Xeon Bronze CPU, 48 GB of RAM

    • 2 nodes with 4xP100 NVIDIA GPUs, 2x twelve-core Intel Broadwell CPUs, 64 GB of RAM, FDR Infiniband

    • 4 nodes with 4xTitanXp NVIDIA GPUs, 2x twelve-core Intel Broadwell CPUs, 64 GB of RAM, FDR Infiniband

    • 24 nodes with 2xK40m NVIDIA GPUs, 2x ten-core Intel Broadwell CPUs, 64 GB of RAM, FDR Infiniband

    • 48 nodes with 1xK20Xm NVIDIA GPU, 2x six-core Intel Ivybridge CPUs, 32 GB of RAM, FDR Infiniband

  • CPU nodes

    • 36 nodes with 2x twelve-core 2.1 GHz, 9.6 GT/s QPI Intel Silver (Skylake) CPUs and 48 GB of RAM, FDR Infiniband

    • 72 nodes with 2x eigth-core 2.4 GHz, 7.2 GT/s QPI Intel Xeon (Haswell) CPUs and 32 GB of RAM, FDR Infiniband

    • 80 nodes with 2x six-core 2.6 GHz, 7.2 GT/s QPI Intel Xeon (Ivy Bridge) CPUs and 16 GB of RAM, QDR Infiniband

    • 8 "Pods", each with 32 2x six-core 2.3 GHz, 7.2 GT/s QPI Intel Xeon (Sandy Bridge) CPUs and 16 GB of RAM, QDR Infiniband

    • 5 "Pods", each with 32 2x eigth-core 2.4 GHz, 7.2 GT/s QPI Intel Xeon (Haswell) CPUs and 32 GB of RAM, FDR Infiniband

  • Miscellaneous

    • 1 Intel Xeon Phi 7210 (Knights Landing), 64 cores (256 threads) and 128 GB of RAM


Analysis Nodes


  • 1 node with 2x 14 core Intel Skylake CPUs, 384 GB of RAM, 400 GB of fast SSD storage mounted under /scratch, and a 10 Gbps NIC

  • 2 nodes with 2x 12 core Intel Haswell CPUs, 256 GB RAM, 800 GB SSD /scratch, 40 Gb NICs

  • 2 nodes with 2x 12 core Intel Ivybridge CPUs, 256 GB of RAM, 450 GB of fast SSD storage mounted under /scratch, and a 10 Gbps NIC

  • GPU analysis nodes

    • One with 4x Tesla M2090

    • Two with 2x K20m


Storage


  • 768 TB of primary storage. provided by a clustered NetApp FAS8300 system

  • 300 TB of global scratch space. provided by a VAST Data flash storage system

  • 1.3 PB of archive storage provided by a FreeBSD based ZFS filesystem.

  • 500 TB of offsite backup storage provided by a FreeBSD based ZFS filesystem


cabinets in Fishers Lane