SCG Cluster Hardware Resources

Summary

Compute

  • 83 Compute servers
  • 3,824 CPUs (cores)
  • 1 Supercomputer (320 cores/10TB RAM)
  • 4 Login nodes

Storage

  • 7 Petabytes of high performance, distributed storage (provided by the SRCC Oak service)
  • 1.5 Petabytes of object storage, designed for sharing data

Memory

  • Minimum of 10 GiB of RAM per CPU
  • 6 nodes with 32 GiB of RAM per CPU

Networking

  • 10 Gigabit Ethernet throughout
  • Some nodes have 25 Gigabit Ethernet
  • Interconnections are 40 and 100 Gigabit

Compute Node Specifications

AMD EPYC 7402 Nodes

10 Supermicro 2124BT-HNTR 2U quad-server units (40 total compute nodes)
Names: cfx22885s-srcf-d11-*-east, cfx22885s-srcf-d11-*-west

  • Dual AMD EPYC 7402 processors, 2.8 GHz, 24-cores/48-threads
  • 1TB DDR4 3200Mhz Registered ECC memory
  • 3x 2TB NVMe SSDs, 1x 240GB SSD — approx. 3.5 TiB fast local scratch space
  • 25 Gigabit Ethernet

AMD EPYC 7713 Nodes

Names: cfx1265s-srcf-d11-27, cfx4860s-srcf-d11-23

  • Dual AMD EPYC 7713 processors, 2.0 GHz, 64-cores/128-threads
  • 4TB DDR4 3200Mhz Registered ECC memory
  • 2x 15TB NVMe SSDs, 1x 240GB SSD for very fast local scratch space
  • 25 Gigabit Ethernet

AMD EPYC 7401 Nodes

10 Dell PowerEdge R7425 2U servers
Names: dper7425-srcf-d15-13 through -31 (odd)

  • Dual AMD EPYC 7401 processors, 2.0 GHz, 24-cores/48-threads
  • 512GB DDR4 2666Mhz Registered ECC memory
  • 12x 2TB HDD, 2x 120GB SSDs — approx. 5 TiB local scratch space
  • 10 Gigabit Ethernet

2 Dell PowerEdge R7425 2U servers
Names: dper7425-srcf-d15-9, dper7425-srcf-d15-11

  • Dual AMD EPYC 7401 processors, 2.0 GHz, 24-cores/48-threads
  • 1TB DDR4 2666Mhz Registered ECC memory
  • 12x 2TB HDD, 2x 120GB SSDs — approx. 5 TiB local scratch space
  • 10 Gigabit Ethernet

Intel Xeon Broadwell Nodes

1 SGI UV300 Supercomputer
Name: sgiuv300-srcf-d10-01

  • Twenty Intel E7-8867 v4 processors, 2.4 GHz, 18-cores
  • 10TB DDR4 1600MHz Registered ECC DRAM
  • Approx. 138 TiB fast local scratch space
  • 10 Gigabit Ethernet
  • 4x NVIDIA Tesla P100 GPUs

Intel Xeon Haswell Nodes

1 Dell PowerEdge R930 4U server
Name: dper930-srcf-d15-05

  • Quad Intel Xeon E7-4830 v3 processors, 2.10GHz, 12-cores/24-threads
  • 1500GB DDR4 2133Mhz Registered ECC memory
  • 8x 2TB SATA HDD, 1x 200GB PCIe SSD — approx. 9 TiB scratch space
  • 10 Gigabit Ethernet

20 Dell PowerEdge R730xd 2U servers
Names: dper730xd-srcf-d16-*

  • Dual Intel Xeon E5-2683 v3 processors, 2.00GH, 14-cores/28-threads
  • 384GB DDR4 2133Mhz Registered ECC memory
  • 12x 2TB HDD, 2x 120GB SSDs — approx. 13 TiB scratch space
  • 10 Gigabit Ethernet

Intel Xeon Ivy Bridge Nodes

1 SGI UV20 2U server
Name: sgiuv20-rcf-111-32

  • Quad Intel Xeon E5-4657L v2 processors, 2.40GHz 12-cores/24-threads
  • 1500GB DDR3 1867Mhz Registered ECC memory
  • 7x 2TB HDD, 2x 120GB SSDs — approx. 2 TiB scratch space
  • 10 Gigabit Ethernet

Login Node Specifications

AMD EPYC 7301

4 Supermicro 1123US-TR4 1U servers
Names: smsh11dsu-srcf-d15-*

  • Dual AMD EPYC 7301 processors, 2.2 GHz, 16-cores/32-threads
  • 512GB DDR4 2666Mhz Registered ECC SDRAM
  • 2x2TB SATA3 HDD, 2x 1TB NVMe SSDs
  • 40 Gigabit Ethernet
  • 1x NVIDIA Quadro P400 GPU