Results

Datacenter Category: Available submissions in Closed division

ID System Submitter Accelerator LLAMA2-70B-99 LLAMA2-70B-99.9 GPTJ-99 GPTJ-99.9 Bert-99 Bert-99.9 Stable Diffusion DLRM-v2-99 DLRM-v2-99.9 Retinanet ResNet50 3d-unet-99 3d-unet-99.9
Server Offline Server Offline Server Offline Server Offline Server Offline Server Offline Server Offline Server Offline Server Offline Server Offline Server Offline Offline Offline
ID System Submitter Accelerator LLAMA2-70B-99 LLAMA2-70B-99.9 GPTJ-99 GPTJ-99.9 Bert-99 Bert-99.9 Stable Diffusion DLRM-v2-99 DLRM-v2-99.9 Retinanet ResNet50 3d-unet-99 3d-unet-99.9
Server Offline Server Offline Server Offline Server Offline Server Offline Server Offline Server Offline Server Offline Server Offline Server Offline Server Offline Offline Offline
4.0-0001 ESC8000-E11P (8x H100-PCIe-80GB, TensorRT) ASUSTeK NVIDIA H100-PCIe-80GB x 8 35349.5 45227.2 31993.0 38577.4 7.9 8.7 279993.0 336637.0 199999.0 201726.0 8394.3 9286.4 368024.0 445908.0 37.2 37.2
4.0-0002 ESC8000-E11 (8x L40S, TensorRT) ASUSTeK NVIDIA L40S x 8 97.8 99.0 97.8 98.4 25120.8 26077.4 11995.1 13709.5 5.0 5.0 179985.0 196999.0 94969.0 101691.0 5797.6 6401.1 355029.0 369341.0 31.1 31.1
4.0-0003 ESC8000-E11 (8x L4, TensorRT) ASUSTeK NVIDIA L4 x 8 7305.1 7597.7 5008.7 5189.9
4.0-0004 NC80adis_H100_v5 (2x H100-NVL-94GB, TensorRT) Azure NVIDIA H100 NVL x 2 11.8 3900.3 42.1 43.6 10.4 10.4
4.0-0005 Cirrascale_QUAD_AI100 (4x QAIC Pro) CTuning Qualcomm Cloud AI 100 Pro x 4 2551.1 3150.7
4.0-0006 GATEOverflow Intel Saphhire Rapids CTuning 279.3 370.0
4.0-0007 AWS_EC2_DL2Q (8x QAIC Standard) CTuning Qualcomm Cloud AI 100 Standard x 8 2199.1 2493.9 148979.0 153133.0
4.0-0022 1-node-2S-C240M7-EMR-PyTorch-INT4 Cisco 1.0 2.4
4.0-0023 1-node-2S-C240M7-EMR-PyTorch-INT8 Cisco 1318.5 1693.2 303.8 389.3 19807.2 25704.9
4.0-0024 1-node-2S-C240M7-EMR-PyTorch-MIX Cisco
4.0-0025 Dell PowerEdge R750xa (4x A100-PCIe-80GB, TensorRT) Dell NVIDIA A100-PCIe-80GB x 4 11854.2 12669.6 5797.6 6491.3 2831.6 2947.6 144586.0 157826.0 14.2 14.2
4.0-0026 Dell PowerEdge R760 Dell 1.0 2.4 1318.5 1701.4 8993.6 9239.7 299.0 382.6 19807.2 25016.0 1.9
4.0-0027 Dell PowerEdge R760 (2x L40S, TensorRT) Dell NVIDIA L40S x 2 6696.4 6603.3 3351.2 3507.7 1523.8 1642.0 88074.3 90387.7 7.8 7.8
4.0-0028 Dell PowerEdge R760xa (4x L40S, TensorRT) Dell NVIDIA L40S x 4 51.0 50.5 51.0 50.5 13695.6 13538.2 6916.0 7308.2 2.6 2.7 3062.3 3196.8 179615.0 175746.0 15.6 15.6
4.0-0029 Dell PowerEdge R7615 (2x L40S, TensorRT) Dell NVIDIA L40S x 2 25.0 25.0 25.0 25.0 6666.6 6576.1 3326.4 3514.4 1.2 1.3 1508.7 1618.5 90571.1 88893.1 7.8 7.8
4.0-0030 Dell PowerEdge XE8640 (4x H100-SXM-80GB, TensorRT) Dell NVIDIA H100-SXM-80GB x 4 31.0 9896.8 115.1 117.0 115.1 117.0 28553.7 35790.6 25385.3 31462.0 6.5 6.3 258743.0 278414.0 169980.0 174149.0 6759.2 7081.6 310282.0 353746.0 25.9 25.9
4.0-0031 Dell PowerEdge XE9640 (4x H100-SXM-80GB, TensorRT) Dell NVIDIA H100-SXM-80GB x 4 30.2 9248.4 112.1 117.9 112.1 117.9 28338.0 36146.0 24846.4 31417.9 6.4 6.6 6733.2 7025.6 305775.0 352757.0 25.8 25.8
4.0-0032 Dell PowerEdge XE9680 (8x H100-SXM-80GB, TensorRT) Dell NVIDIA H100-SXM-80GB x 8 71.8 21884.2 233.3 231.0 233.3 231.0 57083.3 70189.3 51186.9 62310.8 13.0 12.6 512410.0 554313.0 331018.0 347289.0 13615.6 14160.9 630172.0 705088.0 52.0 52.0
4.0-0033 Dell PowerEdge XE9680 (8x H100-SXM-80GB, MaxQ, TensorRT) Dell NVIDIA H100-SXM-80GB x 8 49.2 17098.6 149.9 174.0 149.9 174.0 8.8 9.3 400031.0 456575.0 37.4 37.4
4.0-0034 Dell PowerEdge XE9680 (8x H100-SXM-80GB, TensorRT,VMware ESXi 8.0.2) Dell Virtualized NVIDIA H100-SXM-80GB x 8 55982.7 69897.7 13.5 13.1 12876.2 14091.2 51.7 51.7
4.0-0035 Dell PowerEdge R760 (2x L40S, TensorRT, VMware ESXi 8.0.2) Dell Virtualized NVIDIA L40S x 2 5996.1 6082.8 1.1 1.3 1473.6 1584.8 7.7 7.7
4.0-0039 PRIMERGY CDI (16x L40S, TensorRT) Fujitsu NVIDIA L40S x 16 10.1 10.1
4.0-0040 PRIMERGY CDI (8x L40S, TensorRT) Fujitsu NVIDIA L40S x 8 95.8 95.5 95.8 95.5
4.0-0041 PRIMERGY CDI (8x L40S, MaxQ, TensorRT) Fujitsu NVIDIA L40S x 8 4.1 4.2
4.0-0042 GX2560M7_H100_SXM_80GBx4 (4x H100-SXM-80GB, TensorRT) Fujitsu NVIDIA H100-SXM-80GB x 4 27.7 8436.0 85.9 112.0 85.9 112.0 6.1 6.5 295002.0 352326.0
4.0-0043 GIGABYTE G593-SD1 GigaComputing NVIDIA H100-SXM-80GB x 8 72.4 22289.7 229.7 240.9 229.7 240.9 57292.6 70438.4 51186.9 61805.5 13.5 13.2 327017.0 558571.0 327017.0 347454.0 12995.7 14259.6 630172.0 704559.0 51.8 51.8
4.0-0044 NVIDIA DGX H100 (8x H100-SXM-80GB, TensorRT) Google NVIDIA H100-SXM-80GB x 8 69.5 20992.0 229.7 235.7 229.7 235.7 55982.7 69671.7 49586.7 61292.5 13.2 12.9 312469.0 341111.0 12876.2 14031.2 51.3 51.2
4.0-0045 tpu-v5e-4 Google TPU v5e x 4 7.2 10.2
4.0-0046 HPE Cray XD670 (8x H100-SXM-80GB, TensorRT) HPE NVIDIA H100-SXM-80GB x 8 64.8 20973.2 57183.2 70758.8 13.5 13.2 13675.6 14291.2 621165.0 705059.0 51.7 51.7
4.0-0047 HPE ProLiant DL380a Gen11 (4x H100-PCIe-80GB, TensorRT) HPE NVIDIA H100-PCIe-80GB x 4 19.7 6335.7 4299.6 4367.4 203997.0 215959.0 18.0 18.0
4.0-0048 HPE ProLiant DL380a Gen11 (4x L40S, TensorRT) HPE NVIDIA L40S x 4 11594.8 12928.7 2.2 2.6 2801.9 3148.9 160379.0 156816.0 15.5 15.5
4.0-0049 1-node-2S-EMR-ITREX Intel 1.6 3.6
4.0-0050 1-node-2S-EMR-PyTorch Intel 1318.5 1668.5 8993.6 9111.1 274.3 371.1 19807.2 25289.6 2.0
4.0-0052 HLS-Gaudi2-PT Intel-HabanaLabs Intel® Gaudi® 2 AI Accelerator x 8 21.6 8034.9 6.3 6.3
4.0-0053 GIGABYTE G292-Z43 (16x QAIC100 Pro) Krai QUALCOMM Cloud AI 100 Pro x 16 0.9 1.2
4.0-0054 Lenovo SE455 (2x NVIDIA L40, TensorRT) Lenovo NVIDIA L40 x 2 1699.3 1699.7 949.0 888.4 59982.6 47155.1 6.0 6.0
4.0-0057 NVIDIA DGX H100 (1x H100-SXM-80GB, TensorRT) NVIDIA NVIDIA H100-SXM-80GB x 1 29.5 31.1 29.5 31.1 6995.6 9081.5 6095.7 7939.8 1.6 1.6 65982.4 70346.2 42985.8 44022.7 1618.7 1728.3 72976.9 88714.3 6.4 6.4
4.0-0058 NVIDIA DGX H100 (2x H100-SXM-80GB, TensorRT) NVIDIA NVIDIA H100-SXM-80GB x 2 18.1 5539.5
4.0-0059 NVIDIA DGX H100 (8x H100-SXM-80GB, TensorRT) NVIDIA NVIDIA H100-SXM-80GB x 8 70.4 21805.8 229.7 239.9 229.7 239.9 55982.7 70116.2 49586.7 62182.5 13.5 13.1 500098.0 568422.0 330016.0 354151.0 12876.2 14194.4 584147.0 703770.0 51.5 51.5
4.0-0060 NVIDIA DGX H100 (8x H100-SXM-80GB, MaxQ, TensorRT) NVIDIA NVIDIA H100-SXM-80GB x 8 53.1 17561.6 149.9 178.9 149.9 178.9 42386.4 53726.9 39186.7 50998.9 8.8 9.6 400031.0 458408.0 255995.0 283714.0 8794.2 10105.9 400031.0 473737.0 38.2 38.2
4.0-0061 NVIDIA GH200-GraceHopper-Superchip (1x GH200-96GB_aarch64, TensorRT) NVIDIA NVIDIA GH200-GraceHopper-Superchip x 1 31.4 31.9 31.4 31.9 1.7 1.8 78702.4 80118.5 48788.3 49651.0
4.0-0062 SYS-521GE-TNRT (8x H100-NVL-94GB, TensorRT) NVIDIA NVIDIA H100 NVL x 8 48.9 15085.7
4.0-0063 ASROCKRACK 4U8G-ROME2/4E (8x L40S, TensorRT) NVIDIA NVIDIA L40S x 8 95.8 94.6 95.8 94.6 4.9 5.0 179985.0 175953.0 84976.6 85117.6
4.0-0065 BM.GPU.H100.8 Oracle NVIDIA H100-SXM-80GB x 8 69.8 21032.4 229.7 237.1 229.7 235.8 55982.7 69820.8 49586.7 61817.5 13.0 13.1 500098.0 557592.0 315013.0 347177.0 12876.2 13997.0 584147.0 699409.0 51.5 51.5
4.0-0067 1-node-2S-EMR-PyTorch-INT8 Quanta_Cloud_Technology 1.0 2.3 1288.5 1660.8 8193.8 9245.8 279.3 379.8 23198.7 25173.0 2.0
4.0-0068 D54U_3U_H100_PCIe_80GBx4_TRT Quanta_Cloud_Technology NVIDIA H100-PCIe-80GB x 4 13.8 4407.8 79.9 82.3 79.9 82.3 17997.2 23347.0 15996.4 19441.4 4.1 4.4 97970.4 102225.0 4001.1 4534.3 187992.0 222035.0 18.4 18.4
4.0-0069 D54U_3U_L40S_PCIe_48GBx4_TRT Quanta_Cloud_Technology NVIDIA L40S x 4 45.0 50.3 45.0 50.3 11995.1 13226.2 5397.6 6845.1 2.2 2.6 84376.0 97314.9 47988.2 51318.5 3002.1 3181.3 149980.0 176074.0 15.5 15.5
4.0-0070 GH200-GraceHopper-Superchip_GH200-96GB_aarch64x1_TRT Quanta_Cloud_Technology NVIDIA GH200-GraceHopper-Superchip x 1 31.6 32.7 1.7 1.8 47688.9 48403.1
4.0-0072 1-node-2S-EMR-PyTorch-INT8 Supermicro 19807.2 24146.0 2.0
4.0-0073 SYS-521GE-TNRT (8xL40S-PCIe-48GB) Supermicro NVIDIA L40S x 8 11995.1 26430.1 10994.1 14002.1 1999.5 6379.2 127980.0 345124.0 31.7 31.7
4.0-0074 SYS-821GE-TNHR (8x H100-SXM-80GB, TensorRT) Supermicro NVIDIA H100-SXM-80GB x 8 73.7 22202.2 239.9 243.0 239.9 243.0 56775.6 70342.2 50659.1 62226.4 13.6 13.2 516110.0 560530.0 333218.0 350225.0 12940.3 13756.1 595963.0 705887.0 52.0 52.0
4.0-0075 Wiwynn ES200G2 (1-node-1S-EMR-PyTorch) Wiwynn 0.3 0.6 328.9 467.9 61.2 109.1 4951.1 7402.9 0.7

Datacenter Category: Preview submissions in Closed division

ID System Submitter Accelerator LLAMA2-70B-99 LLAMA2-70B-99.9 GPTJ-99 GPTJ-99.9 Bert-99 Bert-99.9 Stable Diffusion DLRM-v2-99 DLRM-v2-99.9 Retinanet ResNet50 3d-unet-99 3d-unet-99.9
Server Offline Server Offline Server Offline Server Offline Server Offline Server Offline Server Offline Server Offline Server Offline Server Offline Server Offline Offline Offline
ID System Submitter Accelerator LLAMA2-70B-99 LLAMA2-70B-99.9 GPTJ-99 GPTJ-99.9 Bert-99 Bert-99.9 Stable Diffusion DLRM-v2-99 DLRM-v2-99.9 Retinanet ResNet50 3d-unet-99 3d-unet-99.9
Server Offline Server Offline Server Offline Server Offline Server Offline Server Offline Server Offline Server Offline Server Offline Server Offline Server Offline Offline Offline
4.0-0077 Dell PowerEdge R760xa (4x QAIC100 Ultra) Dell QUALCOMM Cloud AI 100 Ultra x 4 6246.4 7262.2 2099.5 4147.8 3126.7 3536.1 215003.0 218095.0
4.0-0078 HPE ProLiant DL380a Gen11 (8x Qualcomm QAIC100 Ultra) HPE QUALCOMM Cloud AI 100 Ultra x 8 12871.3 13132.4 370025.0 391186.0
4.0-0079 Lenovo ThinkSystem SR670 V2 (4x QAIC100 Ultra) Lenovo QUALCOMM Cloud AI 100 Ultra x 4 5996.1 7286.3 3501.8 4140.9 3002.1 3489.2 210000.0 215016.0
4.0-0080 NVIDIA GH200-GraceHopper-Superchip (1x GH200-144GB_aarch64, TensorRT) NVIDIA NVIDIA GH200-GraceHopper-Superchip x 1 12.3 3871.5
4.0-0081 NVIDIA H200 (1x H200-SXM-141GB-CTS, TensorRT) NVIDIA NVIDIA H200-SXM-141GB-CTS x 1 12.7 4020.3
4.0-0082 NVIDIA H200 (8x H200-SXM-141GB-CTS, TensorRT) NVIDIA NVIDIA H200-SXM-141GB-CTS x 8 100.7 31712.0
4.0-0083 NVIDIA H200 (1x H200-SXM-141GB, TensorRT) NVIDIA NVIDIA H200-SXM-141GB x 1 29.8 30.8 29.8 30.8
4.0-0084 NVIDIA H200 (8x H200-SXM-141GB, TensorRT) NVIDIA NVIDIA H200-SXM-141GB x 8 90.4 27738.3 238.2 241.3 238.2 241.3 13.8 13.7 530116.0 572867.0 340028.0 359104.0
4.0-0085 GIGABYTE G293-Z43 (16x QAIC100 Ultra, EE) Qualcomm QUALCOMM Cloud AI 100 Ultra x 16 26495.2 30022.2 14120.5 16511.0 12495.8 15105.1 575143.0 887855.0
4.0-0086 GIGABYTE G293-Z43 (16x QAIC100 Ultra, PP) Qualcomm QUALCOMM Cloud AI 100 Ultra x 16 27694.9 30965.7 14245.7 16468.2 13745.9 15476.6 625167.0 902482.0

Count of Results

Submitter LLAMA2-70B-99 LLAMA2-70B-99.9 GPTJ-99 GPTJ-99.9 Bert-99 Bert-99.9 Stable Diffusion DLRM-v2-99 DLRM-v2-99.9 Retinanet ResNet50 3d-unet-99 3d-unet-99.9 Total
ASUSTeK 0 0 2 2 6 6 4 4 4 4 4 2 2 40
Azure 0 2 2 0 0 0 0 0 0 0 0 1 1 6
CTuning 0 0 0 0 4 0 0 0 0 2 2 0 0 8
Cisco 0 0 2 0 2 0 0 0 0 2 2 0 0 8
Dell 0 8 14 12 22 16 16 4 6 22 20 10 11 161
Fujitsu 0 2 4 4 0 0 6 0 0 0 2 0 0 18
GigaComputing 0 2 2 2 2 2 2 2 2 2 2 1 1 22
Google 0 2 4 2 2 2 2 0 2 2 0 1 1 20
HPE 0 4 0 0 6 0 4 0 0 6 8 3 3 34
Intel 0 0 2 0 2 0 0 0 2 2 2 0 1 11
Intel-HabanaLabs 0 2 0 0 0 0 2 0 0 0 0 0 0 4
Krai 0 0 0 0 0 0 2 0 0 0 0 0 0 2
Lenovo 0 0 0 0 2 4 0 0 0 4 4 1 1 16
NVIDIA 0 16 14 14 6 6 12 12 12 6 6 3 3 110
Oracle 0 2 2 2 2 2 2 2 2 2 2 1 1 22
Quanta_Cloud_Technology 0 2 8 4 6 4 6 2 8 6 6 2 3 57
Supermicro 0 2 2 2 4 4 2 2 2 4 6 2 3 35
Wiwynn 0 0 2 0 2 0 0 0 0 2 2 0 1 9
Qualcomm 0 0 0 0 4 4 0 0 0 4 4 0 0 16
Total 0 44 60 44 72 50 60 28 40 70 72 27 32 599

Select Category and Division