Skip to content

Issues: InternLM/lmdeploy

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

362 Open 1,345 Closed
362 Open 1,345 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

lmdeploy Internvl2.5-2B 偶尔出现cuDNN error
#3168 opened Feb 21, 2025 by nzomi
[Bug] serve does nothing when launching Mistral Small 3 AWQ
#3167 opened Feb 20, 2025 by anunknowperson
3 tasks done
[Bug] Qwen2.5-72B-Instruct generated unexpected codes
#3165 opened Feb 20, 2025 by Epochyy
3 tasks done
@AllentDan
[Bug] non-async call in async fn
#3160 opened Feb 19, 2025 by lz1998
3 tasks done
@grimoire
1
lmdeploy对DeepSeek-R1-Distill-Llama-70B进行api推理时，使用H100的两张显卡，共160G，会出现out of memory
#3154 opened Feb 19, 2025 by winni0
3 tasks done
@lvhan028
2
[Bug] Encountering torch.OutOfMemoryError During int8 Quantization
#3145 opened Feb 16, 2025 by SolomonLeon
3 tasks done
@AllentDan
1
OOM when use InternVL2_5-1B-MPO
#3143 opened Feb 14, 2025 by BobHo5474
@lvhan028
8
[Feature] old version of outlines 0.0.46, break other packages awaiting response
#3141 opened Feb 13, 2025 by devops724
@AllentDan
1
[Bug] Dockerfile_aarch64_ascend cannot work for docker 18.09 awaiting response
#3140 opened Feb 13, 2025 by bingps
3 tasks done
@jinminxi104
1
[Bug] ERROR - engine.py:904 - Task <MainLoopBackground> failed
#3138 opened Feb 12, 2025 by xiezhipeng-git
3 tasks done
@grimoire
4
Qwen2.5-VL-72B-Instruct can be supported now?
#3132 opened Feb 12, 2025 by lijingcheng2021
@CUHKSZzxy
7
[Feature] 目前无法有效的获得停止词stop_words，需要获得停止词功能
#3131 opened Feb 11, 2025 by xiezhipeng-git
1
[Bug] lmdeploy Turbomind 推理导致jupyter 崩溃
#3128 opened Feb 10, 2025 by xiezhipeng-git
3 tasks done
@lzhangzz
4
LMDeploy目前支持MiniCPM-o模型吗
#3127 opened Feb 10, 2025 by daihuidai
1
[Bug] 在昇腾310P上加载Qwen AWQ模型时出现参数传递错误
#3124 opened Feb 9, 2025 by cccccya
3 tasks
@jinminxi104
1
[Bug] structed_output cannot be used in cu118 with the lated docker images
#3120 opened Feb 8, 2025 by zhulinJulia24
3 tasks
@CUHKSZzxy
[Feature] ascend 310p上执行图模式
#3119 opened Feb 7, 2025 by yezekun
@jinminxi104 @yao-fengchen
8
310P疑似不支持dist.broadcast操作，如何支持多卡
#3118 opened Feb 7, 2025 by yezekun
@jinminxi104 @yao-fengchen
2
关于InternVL TurbomindEngine 的疑惑
#3111 opened Feb 6, 2025 by chenzhengda
@lvhan028
1
[Bug] pipeline 加载模型时无限期挂起 而命令行部署正常
#3107 opened Jan 31, 2025 by NB-Group
3 tasks done
4
Closing PyTorchEngine gracefully
#3104 opened Jan 30, 2025 by AvisP
@grimoire
3
[Bug] CUDA error with Qwen/Qwen2-VL-7B-Instruct
#3101 opened Jan 29, 2025 by andoorve
3 tasks done
1
[Bug] LogitsWarper deprecated in transformers? (trying to run Qwen/Qwen2.5-VL-72B-Instruct) awaiting response
#3100 opened Jan 29, 2025 by josephrocca
7
[Feature] 建议官方在kaggle上使用lmdeploy完整安装资源开放一个公共笔记本用来展示lmdeploy的推理性能
#3098 opened Jan 29, 2025 by xiezhipeng-git
@lvhan028
10
[Feature] Automatically Free pipeline of Prompts awaiting response Stale
#3095 opened Jan 27, 2025 by richardjonker2000
2
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.