NOTE: You can use the master branch of the YOLOv5 repo to convert all model versions.
NOTE: The yaml file is not required.
- Convert model
- Compile the lib
- Edit the config_infer_primary_yoloV5 file
- Edit the deepstream_app_config file
- Testing the model
git clone https://github.com/ultralytics/yolov5.git
cd yolov5
pip3 install -r requirements.txt
pip3 install onnx onnxsim onnxruntime
NOTE: It is recommended to use Python virtualenv.
Copy the export_yoloV5.py
file from DeepStream-Yolo/utils
directory to the yolov5
folder.
Download the pt
file from YOLOv5 releases (example for YOLOv5s 7.0)
wget https://github.com/ultralytics/yolov5/releases/download/v7.0/yolov5s.pt
NOTE: You can use your custom model.
Generate the ONNX model file (example for YOLOv5s)
python3 export_yoloV5.py -w yolov5s.pt --simplify
NOTE: To convert a P6 model
--p6
NOTE: To change the inference size (defaut: 640)
-s SIZE
--size SIZE
-s HEIGHT WIDTH
--size HEIGHT WIDTH
Example for 1280
-s 1280
or
-s 1280 1280
Copy the generated ONNX model file to the DeepStream-Yolo
folder.
Open the DeepStream-Yolo
folder and compile the lib
-
DeepStream 6.2 on x86 platform
CUDA_VER=11.8 make -C nvdsinfer_custom_impl_Yolo
-
DeepStream 6.1.1 on x86 platform
CUDA_VER=11.7 make -C nvdsinfer_custom_impl_Yolo
-
DeepStream 6.1 on x86 platform
CUDA_VER=11.6 make -C nvdsinfer_custom_impl_Yolo
-
DeepStream 6.0.1 / 6.0 on x86 platform
CUDA_VER=11.4 make -C nvdsinfer_custom_impl_Yolo
-
DeepStream 6.2 / 6.1.1 / 6.1 on Jetson platform
CUDA_VER=11.4 make -C nvdsinfer_custom_impl_Yolo
-
DeepStream 6.0.1 / 6.0 on Jetson platform
CUDA_VER=10.2 make -C nvdsinfer_custom_impl_Yolo
Edit the config_infer_primary_yoloV5.txt
file according to your model (example for YOLOv5s with 80 classes)
[property]
...
onnx-file=yolov5s.onnx
model-engine-file=yolov5s.onnx_b1_gpu0_fp32.engine
...
num-detected-classes=80
...
parse-bbox-func-name=NvDsInferParseYolo
...
NOTE: The YOLOv5 resizes the input with center padding. To get better accuracy, use
maintain-aspect-ratio=1
symmetric-padding=1
...
[primary-gie]
...
config-file=config_infer_primary_yoloV5.txt
deepstream-app -c deepstream_app_config.txt
NOTE: The TensorRT engine file may take a very long time to generate (sometimes more than 10 minutes).
NOTE: For more information about custom models configuration (batch-size
, network-mode
, etc), please check the docs/customModels.md
file.