Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

FEAT: support qwen2vl run on ascend npu #2741

Merged
merged 1 commit into from
Jan 8, 2025
Merged

Conversation

Xu-pixel
Copy link
Contributor

@Xu-pixel Xu-pixel commented Jan 7, 2025

只对代码做了小改动

支持的环境:
torch_npu-2.10.post8
pip install attr

安装cann否则有算子不支持:

# replace the url according to your CANN version and devices
# install CANN Toolkit
wget https://ascend-repo.obs.cn-east-2.myhuaweicloud.com/Milan-ASL/Milan-ASL%20V100R001C17SPC701/Ascend-cann-toolkit_8.0.RC1.alpha001_linux-"$(uname -i)".run
bash Ascend-cann-toolkit_8.0.RC1.alpha001_linux-"$(uname -i)".run --install

# install CANN Kernels
wget https://ascend-repo.obs.cn-east-2.myhuaweicloud.com/Milan-ASL/Milan-ASL%20V100R001C17SPC701/Ascend-cann-kernels-910b_8.0.RC1.alpha001_linux.run
bash Ascend-cann-kernels-910b_8.0.RC1.alpha001_linux.run --install

# set env variables
source /usr/local/Ascend/ascend-toolkit/set_env.sh

使用torch_npu-2.10.post8的原因是该版本支持了isin
https://gitee.com/ascend/pytorch/issues/I9JGYU

@qinxuye
Copy link
Contributor

qinxuye commented Jan 7, 2025

Before commit, you can run pre-commit install at xinference directory, when committing, code format e.g. black and flake8 will be done on your machine.

@Xu-pixel
Copy link
Contributor Author

Xu-pixel commented Jan 7, 2025

@qinxuye I'm sorry for ignoring this work. I will commit it as required later.

Copy link
Contributor

@qinxuye qinxuye left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@qinxuye qinxuye merged commit 9dbaec1 into xorbitsai:main Jan 8, 2025
13 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants