FEAT: support deepseek-r1-distill-qwen (#2781)

xorbitsai · Jan 24, 2025 · a57b99b · a57b99b
1 parent 121c08a
commit a57b99b
Show file tree

Hide file tree

Showing 12 changed files with 748 additions and 25 deletions.
diff --git a/README.md b/README.md
@@ -14,7 +14,6 @@
 [![License](https://img.shields.io/pypi/l/xinference.svg?style=for-the-badge)](https://github.com/xorbitsai/inference/blob/main/LICENSE)
 [![Build Status](https://img.shields.io/github/actions/workflow/status/xorbitsai/inference/python.yaml?branch=main&style=for-the-badge&label=GITHUB%20ACTIONS&logo=github)](https://actions-badge.atrox.dev/xorbitsai/inference/goto?ref=main)
 [![Discord](https://img.shields.io/badge/join_Discord-5462eb.svg?logo=discord&style=for-the-badge&logoColor=%23f5f5f5)](https://discord.gg/Xw9tszSkr5)
-[![Slack](https://img.shields.io/badge/join_Slack-781FF5.svg?logo=slack&style=for-the-badge)](https://join.slack.com/t/xorbitsio/shared_invite/zt-1o3z9ucdh-RbfhbPVpx7prOVdM1CAuxg)
 [![Twitter](https://img.shields.io/twitter/follow/xorbitsio?logo=x&style=for-the-badge)](https://twitter.com/xorbitsio)
 
 <p align="center">
@@ -177,11 +176,11 @@ Once Xinference is running, there are multiple ways you can try it: via the web
 
 ## Getting involved
 
-| Platform                                                                                      | Purpose                                            |
-|-----------------------------------------------------------------------------------------------|----------------------------------------------------|
-| [Github Issues](https://github.com/xorbitsai/inference/issues)                                | Reporting bugs and filing feature requests.        |
-| [Slack](https://join.slack.com/t/xorbitsio/shared_invite/zt-1o3z9ucdh-RbfhbPVpx7prOVdM1CAuxg) | Collaborating with other Xorbits users.            |
-| [Twitter](https://twitter.com/xorbitsio)                                                      | Staying up-to-date on new features.                |
+| Platform                                                                                        | Purpose                                     |
+|-------------------------------------------------------------------------------------------------|---------------------------------------------|
+| [Github Issues](https://github.com/xorbitsai/inference/issues)                                  | Reporting bugs and filing feature requests. |
+| [Discord](https://discord.gg/Xw9tszSkr5) | Collaborating with other Xinference users.  |
+| [Twitter](https://twitter.com/xorbitsio)                                                        | Staying up-to-date on new features.         |
 
 ## Citation
 

diff --git a/README_ja_JP.md b/README_ja_JP.md
@@ -6,7 +6,7 @@
 [![PyPI Latest Release](https://img.shields.io/pypi/v/xinference.svg?style=for-the-badge)](https://pypi.org/project/xinference/)
 [![License](https://img.shields.io/pypi/l/xinference.svg?style=for-the-badge)](https://github.com/xorbitsai/inference/blob/main/LICENSE)
 [![Build Status](https://img.shields.io/github/actions/workflow/status/xorbitsai/inference/python.yaml?branch=main&style=for-the-badge&label=GITHUB%20ACTIONS&logo=github)](https://actions-badge.atrox.dev/xorbitsai/inference/goto?ref=main)
-[![Slack](https://img.shields.io/badge/join_Slack-781FF5.svg?logo=slack&style=for-the-badge)](https://join.slack.com/t/xorbitsio/shared_invite/zt-1o3z9ucdh-RbfhbPVpx7prOVdM1CAuxg)
+[![Discord](https://img.shields.io/badge/join_Discord-5462eb.svg?logo=discord&style=for-the-badge&logoColor=%23f5f5f5)](https://discord.gg/Xw9tszSkr5)
 [![Twitter](https://img.shields.io/twitter/follow/xorbitsio?logo=x&style=for-the-badge)](https://twitter.com/xorbitsio)
 
 <p align="center">
@@ -24,7 +24,7 @@ Xorbits Inference(Xinference) は、言語、音声認識、マルチモーダ
 研究者、開発者、データサイエンティストを問わず、最先端の AI モデルの可能性を最大限に引き出すことができます。
 
 <div align="center">
-<i><a href="https://join.slack.com/t/xorbitsio/shared_invite/zt-1z3zsm9ep-87yI9YZ_B79HLB2ccTq4WA">👉 Slack コミュニティにご参加ください！</a></i>
+<i><a href="https://discord.gg/Xw9tszSkr5">👉 Discord コミュニティにご参加ください！</a></i>
 </div>
 
 
@@ -98,11 +98,11 @@ Xinferenceが実行されると、Web UI、cURL、コマンドライン、また
 
 ## 関与する
 
-| プラットフォーム                                                                                   | 目的                                              |
-|---------------------------------------------------------------------------------------------------|--------------------------------------------------|
-| [Github イシュー](https://github.com/xorbitsai/inference/issues)                                  | バグ報告と機能リクエストの提出。                  |
-| [Slack](https://join.slack.com/t/xorbitsio/shared_invite/zt-1o3z9ucdh-RbfhbPVpx7prOVdM1CAuxg)      | 他のXorbitsユーザーとの協力。                      |
-| [Twitter](https://twitter.com/xorbitsio)                                                          | 新機能に関する最新情報の入手。                    |
+| プラットフォーム                                                                                        | 目的                    |
+|-------------------------------------------------------------------------------------------------|-----------------------|
+| [Github イシュー](https://github.com/xorbitsai/inference/issues)                                    | バグ報告と機能リクエストの提出。      |
+| [Discord](https://discord.gg/Xw9tszSkr5) | 他のXinferenceユーザーとの協力。 |
+| [Twitter](https://twitter.com/xorbitsio)                                                        | 新機能に関する最新情報の入手。       |
 
 ## 引用
 

diff --git a/README_zh_CN.md b/README_zh_CN.md
@@ -158,13 +158,13 @@ $ xinference-local
 
 ## 参与其中
 
-| 平台                                                                                          | 目的                                              |
-|------------------------------------------------------------------------------------------------|--------------------------------------------------|
-| [Github 问题](https://github.com/xorbitsai/inference/issues)                                  | 报告错误和提交功能请求。                          |
-| [Slack](https://join.slack.com/t/xorbitsio/shared_invite/zt-1o3z9ucdh-RbfhbPVpx7prOVdM1CAuxg)   | 与其他 Xorbits 用户合作。                          |
-| [Twitter](https://twitter.com/xorbitsio)                                                     | 及时了解新功能。                                  |
-| [微信社群](https://xorbits.cn/assets/images/wechat_work_qr.png)                                     | 与其他 Xorbits 用户交流。                         |
-| [知乎](https://zhihu.com/org/xorbits)                                                         | 了解团队最新的进展。                                  |
+| 平台                                                                                              | 目的                   |
+|-------------------------------------------------------------------------------------------------|----------------------|
+| [Github 问题](https://github.com/xorbitsai/inference/issues)                                      | 报告错误和提交功能请求。         |
+| [Discord](https://discord.gg/Xw9tszSkr5) | 与其他 Xinference 用户合作。 |
+| [Twitter](https://twitter.com/xorbitsio)                                                        | 及时了解新功能。             |
+| [微信社群](https://xorbits.cn/assets/images/wechat_work_qr.png)                                     | 与其他 Xinference 用户交流。 |
+| [知乎](https://zhihu.com/org/xorbits)                                                             | 了解团队最新的进展。           |
 
 ## 引用
 

diff --git a/doc/source/getting_started/installation.rst b/doc/source/getting_started/installation.rst
@@ -44,7 +44,7 @@ Currently, supported models include:
 - ``codestral-v0.1``
 - ``Yi``, ``Yi-1.5``, ``Yi-chat``, ``Yi-1.5-chat``, ``Yi-1.5-chat-16k``
 - ``code-llama``, ``code-llama-python``, ``code-llama-instruct``
-- ``deepseek``, ``deepseek-coder``, ``deepseek-chat``, ``deepseek-coder-instruct``, ``deepseek-v2-chat``, ``deepseek-v2-chat-0628``, ``deepseek-v2.5``
+- ``deepseek``, ``deepseek-coder``, ``deepseek-chat``, ``deepseek-coder-instruct``, ``deepseek-r1-distill-qwen``, ``deepseek-v2-chat``, ``deepseek-v2-chat-0628``, ``deepseek-v2.5``
 - ``yi-coder``, ``yi-coder-chat``
 - ``codeqwen1.5``, ``codeqwen1.5-chat``
 - ``qwen2.5``, ``qwen2.5-coder``, ``qwen2.5-instruct``, ``qwen2.5-coder-instruct``