Compare

Comparing Offline scenario for v4.0: ESC8000_E11P_H100x8_TRT and v4.0: ESC8000_E11_L40Sx8_TRT

Model v4.0: ESC8000_E11P_H100x8_TRT v4.0: ESC8000_E11_L40Sx8_TRT Performance Delta
3d-unet-9937.231.1-19.6%
3d-unet-99.937.231.1-19.6%
bert-9945227.226077.4-73.4%
bert-99.938577.413709.5-181.4%
dlrm-v2-99336637.0196999.0-70.9%
dlrm-v2-99.9201726.0101691.0-98.4%
resnet445908.0369341.0-20.7%
retinanet9286.46401.1-45.1%
rnnt124636.091782.0-35.8%
stable-diffusion-xl8.75.0-74.0%

Comparing Server scenario for v4.0: ESC8000_E11P_H100x8_TRT and v4.0: ESC8000_E11_L40Sx8_TRT

Model v4.0: ESC8000_E11P_H100x8_TRT v4.0: ESC8000_E11_L40Sx8_TRT Performance Delta
bert-9935349.525120.8-40.7%
bert-99.931993.011995.1-166.7%
dlrm-v2-99279993.0179985.0-55.6%
dlrm-v2-99.9199999.094969.0-110.6%
resnet368024.0355029.0-3.7%
retinanet8394.35797.6-44.8%
rnnt99973.387974.4-13.6%
stable-diffusion-xl7.95.0-58.0%

Compare Results