New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

大佬您好，我想问一下如何能够调用GPU进行推理而不是CPU呢? #7

Open

SGLSSHJM opened this issue Dec 14, 2024 · 1 comment

SGLSSHJM commented Dec 14, 2024

我在yaml中更改为GPU后，推理好像仍然使用CPU。

Owner

TalkUHulk commented Dec 25, 2024

我在yaml中更改为GPU后，推理好像仍然使用CPU。

不好意思没及时回复，精力原因，gpu版本的没有做实现，以onnxruntime举例，需要使用支持gpu的libonnxruntime.so，简单修改下代码，使用Cuda的ExecutionProvider

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment