I’ve compared the performance between the model before and after converting to TensorRT engine.
The output from the TensorRT engine is flattened to a 1d array, so I had to convert that back to a 2d array to display the results and calculate the IoU.
As you can see, the model which had been converted to a TensorRT engine seemed to be suffering from precision loss as a tradeoff for optimizing speed.
