SCG Cluster Hardware Resources¶

Summary¶

Compute

• 78 Compute servers
• 3,760 CPUs (cores)
• 1 Supercomputer (320 cores/10TB RAM)
• 4 Login nodes

Storage

• 7 Petabytes of high performance, distributed storage (provided by the SRCC‘s Oak service)
• 1.5 Petabytes of object storage, designed for sharing data

Memory

• Minimum of 10 GiB of RAM per CPU
• 6 nodes with 32 GiB of RAM per CPU

Networking

• 10 Gigabit Ethernet throughout
• Some nodes have 25 Gigabit Ethernet
• Interconnections are 40 and 100 Gigabit

Compute Nodes Specs¶

AMD EPYC 7402 Nodes¶

10 Supermicro 2124BT-HNTR 2U quad-server units (40 total compute nodes)

• Dual AMD EPYC 7402 processors, 2.8 GHz, 24-cores/48-threads
• 1TB DDR4 3200Mhz Registered ECC memory
• 3x 2TB NVMe SSDs, 1x 240GB SSD — approx. 3.5 TiB fast local scratch space
• 25 Gigabit Ethernet

AMD EPYC 7713 Nodes¶

• Dual AMD EPYC 7713 processors, 2.0 GHz, 64-cores/128-threads
• 4TB DDR4 3200Mhz Registered ECC memory
• 2x 15TB NVMe SSDs, 1x 240GB SSD for very fast local scratch space
• 25 Gigabit Ethernet

AMD EPYC 7401 Nodes¶

12 Dell PowerEdge R7425 2U servers

• Dual AMD EPYC 7401 processors, 2.0 GHz, 24-cores/48-threads
• 512GB DDR4 2666Mhz Registered ECC memory
• 12x 2TB HDD, 2x 120GB SSDs — approx. 5 TiB local scratch space
• 10 Gigabit Ethernet

Intel Xeon Broadwell Nodes¶

1 SGI UV300 Supercomputer

• Twenty Intel E7-8867 v4 processors, 2.4 GHz, 18-cores
• 10TB DDR4 1600MHz Registered ECC DRAM
• Approx. 138 TiB fast local scratch space
• 10 Gigabit Ethernet
• 4x NVIDIA Tesla P100 GPUs

Intel Xeon Haswell Nodes¶

1 Dell PowerEdge R930 4U server

• Quad Intel Xeon E7-4830 v3 processors, 2.10GHz, 12-cores/24-threads
• 1500GB DDR4 2133Mhz Registered ECC memory
• 8x 2TB SATA HDD, 1x 200GB PCIe SSD — approx. 9 TiB scratch space
• 10 Gigabit Ethernet

20 Dell PowerEdge R730xd 2U servers

• Dual Intel Xeon E5-2683 v3 processors, 2.00GH, 14-cores/28-threads
• 384GB DDR4 2133Mhz Registered ECC memory
• 12x 2TB HDD, 2x 120GB SSDs — approx. 13 TiB scratch space
• 10 Gigabit Ethernet

Intel Xeon Ivy Bridge Nodes¶

1 SGI UV20 2U server

• Quad Intel Xeon E5-4657L v2 processors, 2.40GHz 12-cores/24-threads
• 1500GB DDR3 1867Mhz Registered ECC memory
• 7x 2TB HDD, 2x 120GB SSDs — approx. 2 TiB scratch space
• 10 Gigabit Ethernet

Login nodes Specs¶

AMD EPYC 7301¶

4 Supermicro 1123US-TR4 1U servers

• Dual AMD EPYC 7301 processors, 2.2 GHz, 16-cores/32-threads
• 512GB DDR4 2666Mhz Registered ECC SDRAM
• 2x2TB SATA3 HDD, 2x 1TB NVMe SSDs
• 40 Gigabit Ethernet
• 1x NVIDIA Quadro P400 GPU