Skip to content

Commit e2d47fd

Browse files
committed
Update 2025-05-25 00:03:25
1 parent 80f5fe8 commit e2d47fd

File tree

84 files changed

+7742
-7898
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

84 files changed

+7742
-7898
lines changed

README.html

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -53,7 +53,7 @@
5353
<link rel="search" title="Search" href="search.html" />
5454
<meta name="viewport" content="width=device-width, initial-scale=1"/>
5555
<meta name="docsearch:language" content="en"/>
56-
<meta name="docbuild:last-update" content="May 24, 2025"/>
56+
<meta name="docbuild:last-update" content="May 25, 2025"/>
5757
</head>
5858

5959

@@ -645,7 +645,7 @@ <h3><strong>Prompt Alignment Example</strong><a class="headerlink" href="#prompt
645645

646646
<div class="footer-item">
647647
<p class="last-updated">
648-
Last updated on May 24, 2025.
648+
Last updated on May 25, 2025.
649649
<br/>
650650
</p>
651651
</div>

_sources/backend/function_calling.ipynb

Lines changed: 222 additions & 203 deletions
Large diffs are not rendered by default.

_sources/backend/lora.ipynb

Lines changed: 243 additions & 272 deletions
Large diffs are not rendered by default.

_sources/backend/native_api.ipynb

Lines changed: 256 additions & 283 deletions
Large diffs are not rendered by default.

_sources/backend/offline_engine_api.ipynb

Lines changed: 441 additions & 446 deletions
Large diffs are not rendered by default.

_sources/backend/openai_api_completions.ipynb

Lines changed: 240 additions & 231 deletions
Large diffs are not rendered by default.

_sources/backend/openai_api_embeddings.ipynb

Lines changed: 60 additions & 66 deletions
Large diffs are not rendered by default.

_sources/backend/openai_api_vision.ipynb

Lines changed: 91 additions & 98 deletions
Large diffs are not rendered by default.

_sources/backend/send_request.ipynb

Lines changed: 77 additions & 89 deletions
Large diffs are not rendered by default.

_sources/backend/separate_reasoning.ipynb

Lines changed: 117 additions & 111 deletions
Large diffs are not rendered by default.

_sources/backend/speculative_decoding.ipynb

Lines changed: 366 additions & 349 deletions
Large diffs are not rendered by default.

_sources/backend/structured_outputs.ipynb

Lines changed: 138 additions & 145 deletions
Large diffs are not rendered by default.

_sources/backend/structured_outputs_for_reasoning_models.ipynb

Lines changed: 324 additions & 373 deletions
Large diffs are not rendered by default.

_sources/backend/vlm_query.ipynb

Lines changed: 189 additions & 187 deletions
Large diffs are not rendered by default.

_sources/frontend/frontend.ipynb

Lines changed: 230 additions & 215 deletions
Large diffs are not rendered by default.

backend/attention_backend.html

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -55,7 +55,7 @@
5555
<link rel="prev" title="Hyperparameter Tuning" href="hyperparameter_tuning.html" />
5656
<meta name="viewport" content="width=device-width, initial-scale=1"/>
5757
<meta name="docsearch:language" content="en"/>
58-
<meta name="docbuild:last-update" content="May 24, 2025"/>
58+
<meta name="docbuild:last-update" content="May 25, 2025"/>
5959
</head>
6060

6161

@@ -641,7 +641,7 @@ <h3>Launch command for different attention backends.<a class="headerlink" href="
641641

642642
<div class="footer-item">
643643
<p class="last-updated">
644-
Last updated on May 24, 2025.
644+
Last updated on May 25, 2025.
645645
<br/>
646646
</p>
647647
</div>

backend/custom_chat_template.html

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -55,7 +55,7 @@
5555
<link rel="prev" title="Structured Outputs For Reasoning Models" href="structured_outputs_for_reasoning_models.html" />
5656
<meta name="viewport" content="width=device-width, initial-scale=1"/>
5757
<meta name="docsearch:language" content="en"/>
58-
<meta name="docbuild:last-update" content="May 24, 2025"/>
58+
<meta name="docbuild:last-update" content="May 25, 2025"/>
5959
</head>
6060

6161

@@ -576,7 +576,7 @@ <h2>Jinja Format<a class="headerlink" href="#jinja-format" title="Link to this h
576576

577577
<div class="footer-item">
578578
<p class="last-updated">
579-
Last updated on May 24, 2025.
579+
Last updated on May 25, 2025.
580580
<br/>
581581
</p>
582582
</div>

backend/function_calling.html

Lines changed: 131 additions & 130 deletions
Large diffs are not rendered by default.

backend/function_calling.ipynb

Lines changed: 222 additions & 203 deletions
Large diffs are not rendered by default.

backend/hyperparameter_tuning.html

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -55,7 +55,7 @@
5555
<link rel="prev" title="Sampling Parameters" href="sampling_params.html" />
5656
<meta name="viewport" content="width=device-width, initial-scale=1"/>
5757
<meta name="docsearch:language" content="en"/>
58-
<meta name="docbuild:last-update" content="May 24, 2025"/>
58+
<meta name="docbuild:last-update" content="May 25, 2025"/>
5959
</head>
6060

6161

@@ -612,7 +612,7 @@ <h2>Tune <code class="docutils literal notranslate"><span class="pre">--schedule
612612

613613
<div class="footer-item">
614614
<p class="last-updated">
615-
Last updated on May 24, 2025.
615+
Last updated on May 25, 2025.
616616
<br/>
617617
</p>
618618
</div>

backend/lora.html

Lines changed: 210 additions & 209 deletions
Large diffs are not rendered by default.

backend/lora.ipynb

Lines changed: 243 additions & 272 deletions
Large diffs are not rendered by default.

backend/native_api.html

Lines changed: 171 additions & 174 deletions
Large diffs are not rendered by default.

backend/native_api.ipynb

Lines changed: 256 additions & 283 deletions
Large diffs are not rendered by default.

backend/offline_engine_api.html

Lines changed: 48 additions & 48 deletions
Large diffs are not rendered by default.

backend/offline_engine_api.ipynb

Lines changed: 441 additions & 446 deletions
Large diffs are not rendered by default.

backend/openai_api_completions.html

Lines changed: 175 additions & 165 deletions
Large diffs are not rendered by default.

backend/openai_api_completions.ipynb

Lines changed: 240 additions & 231 deletions
Large diffs are not rendered by default.

backend/openai_api_embeddings.html

Lines changed: 39 additions & 39 deletions
Large diffs are not rendered by default.

backend/openai_api_embeddings.ipynb

Lines changed: 60 additions & 66 deletions
Large diffs are not rendered by default.

backend/openai_api_vision.html

Lines changed: 59 additions & 60 deletions
Large diffs are not rendered by default.

backend/openai_api_vision.ipynb

Lines changed: 91 additions & 98 deletions
Large diffs are not rendered by default.

backend/pd_disaggregation.html

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -55,7 +55,7 @@
5555
<link rel="prev" title="LoRA Serving" href="lora.html" />
5656
<meta name="viewport" content="width=device-width, initial-scale=1"/>
5757
<meta name="docsearch:language" content="en"/>
58-
<meta name="docbuild:last-update" content="May 24, 2025"/>
58+
<meta name="docbuild:last-update" content="May 25, 2025"/>
5959
</head>
6060

6161

@@ -609,7 +609,7 @@ <h3>DeepSeek Multi-Node<a class="headerlink" href="#deepseek-multi-node" title="
609609

610610
<div class="footer-item">
611611
<p class="last-updated">
612-
Last updated on May 24, 2025.
612+
Last updated on May 25, 2025.
613613
<br/>
614614
</p>
615615
</div>

backend/quantization.html

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -55,7 +55,7 @@
5555
<link rel="prev" title="Custom Chat Template" href="custom_chat_template.html" />
5656
<meta name="viewport" content="width=device-width, initial-scale=1"/>
5757
<meta name="docsearch:language" content="en"/>
58-
<meta name="docbuild:last-update" content="May 24, 2025"/>
58+
<meta name="docbuild:last-update" content="May 25, 2025"/>
5959
</head>
6060

6161

@@ -693,7 +693,7 @@ <h2>Reference<a class="headerlink" href="#reference" title="Link to this heading
693693

694694
<div class="footer-item">
695695
<p class="last-updated">
696-
Last updated on May 24, 2025.
696+
Last updated on May 25, 2025.
697697
<br/>
698698
</p>
699699
</div>

backend/sampling_params.html

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -55,7 +55,7 @@
5555
<link rel="prev" title="Server Arguments" href="server_arguments.html" />
5656
<meta name="viewport" content="width=device-width, initial-scale=1"/>
5757
<meta name="docsearch:language" content="en"/>
58-
<meta name="docbuild:last-update" content="May 24, 2025"/>
58+
<meta name="docbuild:last-update" content="May 25, 2025"/>
5959
</head>
6060

6161

@@ -981,7 +981,7 @@ <h3>Custom logit processor<a class="headerlink" href="#custom-logit-processor" t
981981

982982
<div class="footer-item">
983983
<p class="last-updated">
984-
Last updated on May 24, 2025.
984+
Last updated on May 25, 2025.
985985
<br/>
986986
</p>
987987
</div>

backend/send_request.html

Lines changed: 48 additions & 48 deletions
Large diffs are not rendered by default.

backend/send_request.ipynb

Lines changed: 77 additions & 89 deletions
Large diffs are not rendered by default.

backend/separate_reasoning.html

Lines changed: 67 additions & 67 deletions
Large diffs are not rendered by default.

backend/separate_reasoning.ipynb

Lines changed: 117 additions & 111 deletions
Large diffs are not rendered by default.

backend/server_arguments.html

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -55,7 +55,7 @@
5555
<link rel="prev" title="Offline Engine API" href="offline_engine_api.html" />
5656
<meta name="viewport" content="width=device-width, initial-scale=1"/>
5757
<meta name="docsearch:language" content="en"/>
58-
<meta name="docbuild:last-update" content="May 24, 2025"/>
58+
<meta name="docbuild:last-update" content="May 25, 2025"/>
5959
</head>
6060

6161

@@ -1203,7 +1203,7 @@ <h2>Optimization<a class="headerlink" href="#optimization" title="Link to this h
12031203

12041204
<div class="footer-item">
12051205
<p class="last-updated">
1206-
Last updated on May 24, 2025.
1206+
Last updated on May 25, 2025.
12071207
<br/>
12081208
</p>
12091209
</div>

0 commit comments

Comments
 (0)