ran docker example but got No CUDA runtime is found, using CUDA_HOME='/usr/local/cuda' error #287

Unanswered

hiqsociety asked this question in Q&A

hiqsociety
Sep 14, 2023

ran docker example but got

docker run --gpus all -p 5000:5000 -v /usr/local/src/model/:/data/model/ -v /usr/local/src/exllama_sessions:/data/exllama_sessions --rm -it exllama-web --host 0.0.0.0:5000

No CUDA runtime is found, using CUDA_HOME='/usr/local/cuda' error
...
/app/webui/app.py", line 4
...
..
IndexError: list index out of range

how to resolve?

Replies: 0 comments

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment