Issue Station
Sign In
Tools hereToolbox

vllm - 💡(How to fix) Fix [Doc]: Documentation falsely claims chat_template_kwargs support for the Responses API

Official PRs (…)
ON THIS PAGE

Recommended Tools

×6

Utilities matched from this issue’s tags and category — try them while you read without losing context.

GitHub issue graph ai analysis

Paste a GitHub issue URL. We fetch that issue, discover linked issues from bodies/comments/timeline, collect linked pull requests, and produce a structured English report.

The report is written in English Markdown for sharing and archival.

Helpful · Quick feedback

Loading…

Code Example

extra_body={"chat_template_kwargs": {"enable_thinking": False}}
RAW_BUFFERClick to expand / collapse

📚 The doc issue

In the documentation for the Responses API, the Extra parameters section claims support for chat_template_kwargs in the Response API. However, when I tried to suppress reasoning in Qwen3.6-27B by adding

extra_body={"chat_template_kwargs": {"enable_thinking": False}}

to the request, it got ignored and I got back the reasoning output as well. The same parameter works fine in the chat.completions endpoint.

Suggest a potential alternative/fix

The obviously correct solution would be to implement the functionality. As I understand, there is an open issue that addresses this, although it seems to have gone stale. Until that (hopefully) gets implemented, the documentation should be updated to remove the false claim; or better yet, add a warning for arguments not yet (fully) implemented.

Before submitting a new issue...

  • Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

Vote matrix · Quick signals

Works
Did the solution work? Tap to confirm.
Easy Fix
Was it a quick fix?
Time Saver
Did it save you time?
Blocking
Was it severely blocking?
Common Issue
Are others likely hitting this too?
Flaky / Intermittent
Is it intermittent?
Verified / Reproducible
Can you reproduce it reliably?
Loading…
#api#ssr#memory leak#API versioning#request timeout

Still need to ship something?

×6

Another batch ranked right after the header list — different links, same matching logic.

Back to top recommendations

TRENDING