New Result Comparison single 2080ti gpu Total(train) Half Single Double Total(inference) Half Single Double densenet(train) Half Single Double densenet(inference) Half Single Double vgg(train) Half Single Double vgg(inference) Half Single Double squeezenet(train) Half Single Double squeezenet(inference) Half Single Double shufflenetv2(train) Half Single Double shufflenetv2(inference) Half Single Double resnet(train) Half Single Double resnet(inference) Half Single Double mobilenet(train) Half Single Double mobilenet(inference) Half Single Double mnasnet(train) Half Single Double mnasnet(inference) Half Single Double Comparison multi gpu ( using 2 2080ti gpus) Total(train) Half Single Double Total(inference) Half Single Double densenet(train) Half Single Double densenet(inference) Half Single Double vgg(train) Half Single Double vgg(inference) Half Single Double squeezenet(train) Half Single Double squeezenet(inference) Half Single Double shufflenetv2(train) Half Single Double shufflenetv2(inference) Half Single Double resnet(train) Half Single Double resnet(inference) Half Single Double mobilenet(train) Half Single Double mobilenet(inference) Half Single Double mnasnet(train) Half Single Double mnasnet(inference) Half Single Double Comparison multi gpu ( using 3 2080ti gpus) Total(train) Half Single Double Total(inference) Half Single Double densenet(train) Half Single Double densenet(inference) Half Single Double vgg(train) Half Single Double vgg(inference) Half Single Double squeezenet(train) Half Single Double squeezenet(inference) Half Single Double shufflenetv2(train) Half Single Double shufflenetv2(inference) Half Single Double resnet(train) Half Single Double resnet(inference) Half Single Double mobilenet(train) Half Single Double mobilenet(inference) Half Single Double mnasnet(train) Half Single Double mnasnet(inference) Half Single Double Comparison multi gpu ( using 4 2080ti gpus) Total(train) Half Single Double Total(inference) Half Single Double densenet(train) Half Single Double densenet(inference) Half Single Double vgg(train) Half Single Double vgg(inference) Half Single Double squeezenet(train) Half Single Double squeezenet(inference) Half Single Double shufflenetv2(train) Half Single Double shufflenetv2(inference) Half Single Double resnet(train) Half Single Double resnet(inference) Half Single Double mobilenet(train) Half Single Double mobilenet(inference) Half Single Double mnasnet(train) Half Single Double mnasnet(inference) Half Single Double