SCG Cluster Hardware Resources

Summary

Compute

  • 78 Compute servers
  • 3,760 CPUs (cores)
  • 1 Supercomputer (320 cores/10TB RAM)
  • 4 Login nodes

Storage

  • 7 Petabytes of high performance, distributed storage (provided by the SRCC‘s Oak service)
  • 1.5 Petabytes of object storage, designed for sharing data

Memory

  • Minimum of 10 GiB of RAM per CPU
  • 6 nodes with 32 GiB of RAM per CPU

Networking

  • 10 Gigabit Ethernet throughout
  • Some nodes have 25 Gigabit Ethernet
  • Interconnections are 40 and 100 Gigabit

Compute Nodes Specs

AMD EPYC 7402 Nodes

10 Supermicro 2124BT-HNTR 2U quad-server units (40 total compute nodes)

  • Dual AMD EPYC 7402 processors, 2.8 GHz, 24-cores/48-threads
  • 1TB DDR4 3200Mhz Registered ECC memory
  • 3x 2TB NVMe SSDs, 1x 240GB SSD — approx. 3.5 TiB fast local scratch space
  • 25 Gigabit Ethernet

AMD EPYC 7713 Nodes

  • Dual AMD EPYC 7713 processors, 2.0 GHz, 64-cores/128-threads
  • 4TB DDR4 3200Mhz Registered ECC memory
  • 2x 15TB NVMe SSDs, 1x 240GB SSD for very fast local scratch space
  • 25 Gigabit Ethernet

AMD EPYC 7401 Nodes

12 Dell PowerEdge R7425 2U servers

  • Dual AMD EPYC 7401 processors, 2.0 GHz, 24-cores/48-threads
  • 512GB DDR4 2666Mhz Registered ECC memory
  • 12x 2TB HDD, 2x 120GB SSDs — approx. 5 TiB local scratch space
  • 10 Gigabit Ethernet

Intel Xeon Broadwell Nodes

1 SGI UV300 Supercomputer

  • Twenty Intel E7-8867 v4 processors, 2.4 GHz, 18-cores
  • 10TB DDR4 1600MHz Registered ECC DRAM
  • Approx. 138 TiB fast local scratch space
  • 10 Gigabit Ethernet
  • 4x NVIDIA Tesla P100 GPUs

Intel Xeon Haswell Nodes

1 Dell PowerEdge R930 4U server

  • Quad Intel Xeon E7-4830 v3 processors, 2.10GHz, 12-cores/24-threads
  • 1500GB DDR4 2133Mhz Registered ECC memory
  • 8x 2TB SATA HDD, 1x 200GB PCIe SSD — approx. 9 TiB scratch space
  • 10 Gigabit Ethernet

20 Dell PowerEdge R730xd 2U servers

  • Dual Intel Xeon E5-2683 v3 processors, 2.00GH, 14-cores/28-threads
  • 384GB DDR4 2133Mhz Registered ECC memory
  • 12x 2TB HDD, 2x 120GB SSDs — approx. 13 TiB scratch space
  • 10 Gigabit Ethernet

Intel Xeon Ivy Bridge Nodes

1 SGI UV20 2U server

  • Quad Intel Xeon E5-4657L v2 processors, 2.40GHz 12-cores/24-threads
  • 1500GB DDR3 1867Mhz Registered ECC memory
  • 7x 2TB HDD, 2x 120GB SSDs — approx. 2 TiB scratch space
  • 10 Gigabit Ethernet

Login nodes Specs

AMD EPYC 7301

4 Supermicro 1123US-TR4 1U servers

  • Dual AMD EPYC 7301 processors, 2.2 GHz, 16-cores/32-threads
  • 512GB DDR4 2666Mhz Registered ECC SDRAM
  • 2x2TB SATA3 HDD, 2x 1TB NVMe SSDs
  • 40 Gigabit Ethernet
  • 1x NVIDIA Quadro P400 GPU