====== Goethe-NHR ====== Goethe-NHR is a general-purpose computer cluster based on several CPU/GPU architectures. The system was installed in Industriepark Höchst in 2019 and extended with GPU nodes in 2020. **Cluster performance:** * Cluster performance peak: 1,449.98 TFlop/s (with 472 nodes) * Cluster performance HPL (2018): 958.67 TFlop/s (with 472 nodes) * GPU cluster performance HPL (2023): 9,087.00 TFlop/s (with 105 nodes) **Hardware:** * 730 compute nodes in water-cooled racks * initially 472 at the end of 2018 * thousands of CPU cores * 864 AMD Radeon Instinct MI210 GPUs * 192, 768, 128 or 512 GB of RAM per node * EDR and FDR InfiniBand interconnects (2:1 blocking fat tree network) * a parallel scratch filesystem with a capacity of 2.4 PB and an aggregated bandwidth of 27 GB/s ^ Nodes ^ CPU ^ Cores \\ per CPU ^ Cores \\ per Node ^ Threads \\ per Node ^ RAM \\ per Node ^ IB ^ GPU ^ | 412 |2x Intel Xeon Gold 6148 (Skylake) | 20 | 40| 80| 192 GB | EDR |n/a | | 72 |2x Intel Xeon Gold 6148 (Skylake) | 20 | 40| 80| 768 GB | EDR |n/a | | 138 |2x Intel Xeon E5-2640 v4 (Broadwell) | 10 | 20| 40| 128 GB | FDR |n/a | | 108 |2x AMD EPYC 7452 | 32 | 64| 128| 512 GB | EDR |8xAMD Instinct MI210 64 GB| \\