Skip to main content

Posts

Showing posts with the label TensorRT

Export your custom YOLOv7 model to TensorRT

  Another post starts with you beautiful people! Thanks for the great response to my  last post  where we successfully exported a custom-trained YOLOv7 model to ONNX format.  In this post, we are going to move one step further to achieve high-performance inference using  NVIDIA TensorRT . We will learn how can we export our YOLOv7 ONNX model to a TensorRT format. NVIDIA TensorRT is an SDK for high-performance deep learning inference, includes a deep learning inference optimizer and runtime that delivers low latency and high throughput for inference applications. This file format is widely used in case you need to deploy your model into edge devices but with high inference speed. So knowledge of exporting your YOLOv7 model to TensorRT format is very beneficial learning. Please note the exportation of the model is environmentally sensitive. It is recommended to use the same environment where you have trained the original YOLOv7 model. For this post as well I ...