litellm - 💡(How to fix) Fix [Bug]: The litellm call will disconnect after 60-70 seconds.

Official PRs (…)
ON THIS PAGE

Recommended Tools

×6

Utilities matched from this issue’s tags and category — try them while you read without losing context.

GitHub issue graph ai analysis

Paste a GitHub issue URL. We fetch that issue, discover linked issues from bodies/comments/timeline, collect linked pull requests, and produce a structured English report.

The report is written in English Markdown for sharing and archival.

Helpful · Quick feedback

Loading…

Error Message

ERROR Unexpected error calling OpenAI API: peer closed connection without 2026-05-21 21:44:55.244 | ERROR | [ca5938997c8d7888ad43432549115297] | app.model_runtime.load_balancing.base:_log_failure:206 - [LoadBalancer] 端点调用失败 deployment_id=178331601741025280 endpoint_id=178331601761996800 base_url=https://litellm.xxxx.xyz/v1 endpoint_key=openai/completions duration_ms=65556.16 attempts=1 error_type=ModelProviderError error_message=peer closed connection without sending complete message body (incomplete chunked read) 2026-05-21 21:44:55.430 | ERROR | [ca5938997c8d7888ad43432549115297] | app.tasks.chat.agent_worker:execute_agent_run:107 - Agent run run_id: 183211722939568129 failed

RAW_BUFFERClick to expand / collapse

Check for existing issues

  • I have searched the existing issues and checked that my issue is not a duplicate.

What happened?

ERROR Unexpected error calling OpenAI API: peer closed connection without
sending complete message body (incomplete chunked read)
2026-05-21 21:44:55.244 | ERROR | [ca5938997c8d7888ad43432549115297] | app.model_runtime.load_balancing.base:_log_failure:206 - [LoadBalancer] 端点调用失败 deployment_id=178331601741025280 endpoint_id=178331601761996800 base_url=https://litellm.xxxx.xyz/v1 endpoint_key=openai/completions duration_ms=65556.16 attempts=1 error_type=ModelProviderError error_message=peer closed connection without sending complete message body (incomplete chunked read) 2026-05-21 21:44:55.251 | INFO | [ca5938997c8d7888ad43432549115297] | app.agentic.agent.agent_runner:_construct_run_output_from_stream_context:390 - [Cancelled Run] Constructing RunOutput from StreamContext, run_id=23cbfe1f-fbc8-4b3c-93b2-09d9038fa9b4 2026-05-21 21:44:55.251 | WARNING | [ca5938997c8d7888ad43432549115297] | app.agentic.agent.agent_runner:_append_missing_failed_tool_calls:476 - 工具调用参数 JSON 解析失败, tool_call_id=tooluse_1EQ5EjyGUOZdbWW5rRlj6t: Expecting value: line 1 column 1 (char 0) 2026-05-21 21:44:55.430 | ERROR | [ca5938997c8d7888ad43432549115297] | app.tasks.chat.agent_worker:execute_agent_run:107 - Agent run run_id: 183211722939568129 failed

Steps to Reproduce

Relevant log output

What part of LiteLLM is this about?

No response

What LiteLLM version are you on ?

v1.85.1

Twitter / LinkedIn details

No response

Vote matrix · Quick signals

Works
Did the solution work? Tap to confirm.
Easy Fix
Was it a quick fix?
Time Saver
Did it save you time?
Blocking
Was it severely blocking?
Common Issue
Are others likely hitting this too?
Flaky / Intermittent
Is it intermittent?
Verified / Reproducible
Can you reproduce it reliably?
Loading…

Still need to ship something?

×6

Another batch ranked right after the header list — different links, same matching logic.

Back to top recommendations

TRENDING