Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CUDA Operations Tasks: Stage 3 #39

Open
14 tasks
Ishaan-Datta opened this issue Nov 19, 2024 · 0 comments
Open
14 tasks

CUDA Operations Tasks: Stage 3 #39

Ishaan-Datta opened this issue Nov 19, 2024 · 0 comments
Assignees

Comments

@Ishaan-Datta
Copy link
Collaborator

Stage 3: TensorRT Engine Conversion/Inference

  • Investigate using TensorRT Engine Plugins to bake the pre/post processing into the engine file itself (with amy)
  • Repair the comparison scripts under /python_wip and /conversion_tools and report on results of different methods
  • For all the verify functions run them for a few random inputs and average values (warmup)
  • Copy logic for comparing the prediction consistency and confidence independently using valery's functions in ONNX_verify
  • MNIST Inference Example
  • QuickStart Guide
  • Take a look at the Google Drive for Nvidia Examples

Specific Engine Plugins/Extras for Viewing in Drive:

  • crop and resize
  • efficientNMS
  • flattenConcat
  • NMS plugin
  • nvpluginfasterRCNN
  • resizeNearest
  • polygraphy
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants