I did an experiment to compare how model performance change when converted to TensorRT engine. These are the steps I took. 1. Train Several Binary Segmentation Model 2. Randomly Choose 30 images from the dataset 3. Run inference with the…
I was finally able to fine-tune a model and get decent results. I’ve used a new dataset from kaggle. This has more and simple images of water surfaces so that helped a lot. Results The model was able to learn…
Here is 1 way to Generate an engine file with Unet Pre-requisites – Deepstream 5.0.1 – TensorRT 7.1.3 – Jetson XAVIER NX – CUDA 10.2 Load Model import torch unet = torch.hub.load(‘milesial/Pytorch-UNet’, ‘unet_carvana’, pretrained=True) unet.eval() Export Model path_to_onnx =”” dummy…
Before you deploy your model, you might want to run a test inference with the exported file, just in case to confirm your model was exported successfully. Here is how you can do it for Deeplab. NOTE: I am running…
4 Challenges of Edge AI Vulnerable Security Feature Due to scattered locations, more security is required. Limited Machine-Learning Power Edge device with low computing power (compared with the cloud) leads to under-delivery considering performance. Model Sync Delay when updating the…
Yeah, this wasn’t supposed to happen. I trained an Instance segmentation model using NVIDIA’s Transfer Learning Toolkit to detect cars and deployed it on a Jetson. It seems I messed up with either the settings for the threshold or with…
When detecting objects, the method to display the detected boxes can affect the inference speed. One of the models I’m working on uses a clustering method to display those boxes and it is SUPER SLOW.I’ve noticed something when I was…
OPTIMIZING YOUR MODELThere is a machine learning framework called, TensorRT to “optimize” your model for faster inference. I’ve been converting many models to a TensorRT engine for a while, but I didn’t really know how it was optimizing the model.…
EVALUATING PERFORMANCEI’ve been able to create several successful routes to deploy models using the Deepstream app. So for my next step, before retraining models, I compared the performance depending on the GPU METRICS ＆ NOTES– Model: YOLOV3– I’m comparing JetsonTX2…
Configuring The AppIt was so hard for me to understand what was going on when I first touched the DeepStream SDK, so for this post, I want to share how the DeepStream App is configured VISUALLY. (Hoping I’m understanding it…