Skip to content

Commit 31a5b2b

Browse files
committed
fix
Signed-off-by: MengqingCao <[email protected]>
1 parent fa968f4 commit 31a5b2b

File tree

1 file changed

+5
-5
lines changed

1 file changed

+5
-5
lines changed

_posts/2025-03-12-hardware-plugin.md

+5-5
Original file line numberDiff line numberDiff line change
@@ -35,7 +35,7 @@ Before introducing the vLLM Hardware Plugin, let's first look at two prerequisit
3535

3636
Based on these RFCs, we proposed [[RFC] Hardware Pluggable](https://github.com/vllm-project/vllm/issues/11162), which integrates the `Platform` module into vLLM as a plugin. Additionally, we refactored `Executor`, `Worker`, `ModelRunner`, `AttentionBackend`, and `Communicator` to support hardware plugins more flexibly.
3737

38-
Currently, the vLLM team, collaborate with vLLM Ascend developers, has successfully implemented the Platform module introduced in the RFC. We also validated the functionality through the [vllm-project/vllm-ascend](https://github.com/vllm-project/vllm-ascend) project. Using this plugin mechanism, we successfully integrated vLLM with the Ascend NPU backend.
38+
Currently, the vLLM team, collaborate with vLLM Ascend developers, has successfully implemented the Platform module introduced in the RFC. We also validated the functionality through the [vllm-project/vllm-ascend](https://github.com/vllm-project/vllm-ascend) and [vllm-project/vllm-spyre](https://github.com/vllm-project/vllm-spyre) projects. Using this plugin mechanism, we successfully integrated vLLM with the Ascend NPU and IBM Spyre backends.
3939

4040
---
4141

@@ -55,7 +55,7 @@ You can refer to the [`platform.py`](https://github.com/vllm-project/vllm-ascend
5555

5656
#### Step 2: Implement Custom Worker, Model Runner, Attention Backend, and Communicator Modules
5757

58-
Depending on the new backends requirements, implement the following modules:
58+
Depending on the new backend's requirements, implement the following modules:
5959

6060
```python
6161
from vllm.worker.worker_base import WorkerBase
@@ -64,11 +64,11 @@ from vllm.attention.backends.abstract import AttentionBackend
6464
from vllm.distributed.device_communicators.base_communicator import CommunicatorBase
6565
```
6666

67-
Each of these classes has a corresponding base class in vLLM. Again, you can refer to [vLLM Ascends implementation](https://github.com/vllm-project/vllm-ascend/tree/main/vllm_ascend) for an example.
67+
Each of these classes has a corresponding base class in vLLM. Again, you can refer to [vLLM Ascend's implementation](https://github.com/vllm-project/vllm-ascend/tree/main/vllm_ascend) for an example.
6868

6969
#### Step 3: Register the Plugin
7070

71-
Register the plugin in `setup.py` using Python’s entry point mechanism:
71+
Register the plugin in `setup.py` using entrypoint mechanism of python:
7272

7373
```python
7474
setup(
@@ -132,7 +132,7 @@ INFO 02-06 15:49:01 __init__.py:181] Platform plugin ascend is activated
132132

133133
---
134134

135-
## Whats Next?
135+
## What's Next?
136136

137137
Moving forward, we will continue collaborating with developers in the vLLM community to enhance the following aspects:
138138

0 commit comments

Comments
 (0)