[Converge] TensorFlow Performance with 1-4 GPUs
CNN [ResNet-50] fp32, fp16 and RNN [Big LSTM] job Batch Sizes for the GPU's tested
GPU | ResNet-50 FP32 batch size | RedNet-50 FP16 (Tensor-cores) batch size | Big LSTM batch size |
---|---|---|---|
RTX Titan | 192 | 384 | 640 |
RTX 2080 Ti | 64 | 128 | 448 |
RTX 2080 | 64 | 128 | 256 |
RTX 2070 | 64 | 128 | 256 |
GTX 1660 Ti | 32 | 64 | 128 |
Titan V | 64 | 128 | 448 |
GTX 1080 Ti | 64 | N/A | 448 |
GTX 1070 | 64 | N/A | 256 |