Model Optimization Tasks: Stage 1

[Ishaan-Datta]

Examples can be found under /examples/Nvidia TRT Clean, Old Example Conversion, Ultralytics Module, Notebook Tutorials, ONNX Runtime, conversion_tools

Stage 1: Optimizing Model Conversion

• Finish the code (/conversion_tools/) for running ONNX models using onnxuntime and include functionality for comparing results with true values
• Research ONNX GraphSurgeon and how we should use it to optimize model architecture/layers
• Conversion Blog
• Explore techniques like test-time augmentation (TTA) for predictions (improving detection accuracy at inference cost)
• ONNX Runtime API Documentation
• TensorRT runtime ONNX API
• Ultralytics Model Benchmarking Guide