claude-code - ✅(Solved) Fix docs: Add MLflow AI Gateway to LLM gateway configuration page [1 pull requests, 1 participants]

Official PRs (…)
ON THIS PAGE

Recommended Tools

×6

Utilities matched from this issue’s tags and category — try them while you read without losing context.

GitHub issue graph ai analysis

Paste a GitHub issue URL. We fetch that issue, discover linked issues from bodies/comments/timeline, collect linked pull requests, and produce a structured English report.

The report is written in English Markdown for sharing and archival.

Helpful · Quick feedback

Loading…
GitHub stats
anthropics/claude-code#51893Fetched 2026-04-23 07:42:05
View on GitHub
Comments
0
Participants
1
Timeline
3
Reactions
0
Author
Participants
Timeline (top)
labeled ×3

We're from the MLflow team and are adding gateway integration guides across major agent frameworks. We already have merged/open PRs for LlamaIndex, AutoGen, CrewAI, Haystack, and Google ADK. We also have an example PR for the Claude Agent SDK at https://github.com/anthropics/claude-agent-sdk-python/pull/852.

Since the code.claude.com docs don't appear to be in a public repo, we're filing this issue instead of a PR. Happy to provide any additional content or review a draft.

Root Cause

We're from the MLflow team and are adding gateway integration guides across major agent frameworks. We already have merged/open PRs for LlamaIndex, AutoGen, CrewAI, Haystack, and Google ADK. We also have an example PR for the Claude Agent SDK at https://github.com/anthropics/claude-agent-sdk-python/pull/852.

Since the code.claude.com docs don't appear to be in a public repo, we're filing this issue instead of a PR. Happy to provide any additional content or review a draft.

PR fix notes

PR #852: docs: add MLflow AI Gateway example

Description (problem / solution / changelog)

Summary

Adds examples/mlflow_gateway.py showing how to use Claude Agent SDK with MLflow AI Gateway's Anthropic-compatible passthrough.

How it works

Sets ANTHROPIC_BASE_URL via ClaudeAgentOptions.env to point to http://localhost:5000/gateway/anthropic, which routes requests through the gateway's Anthropic passthrough API.

AI Disclosure

This pull request was AI-assisted by Claude. All content was reviewed and validated by a human contributor.

Changed files

  • examples/mlflow_gateway.py (added, +68/-0)

Code Example

export ANTHROPIC_BASE_URL=http://localhost:5000/gateway/anthropic
export ANTHROPIC_API_KEY=unused  # provider keys are managed by the gateway
RAW_BUFFERClick to expand / collapse

Request

Add MLflow AI Gateway as a supported LLM gateway on the LLM gateway configuration page, alongside the existing LiteLLM section.

What is MLflow AI Gateway?

MLflow AI Gateway (MLflow ≥ 3.0) is an open-source, database-backed LLM proxy built into the MLflow tracking server. It provides:

  • Unified API across 20+ providers (OpenAI, Anthropic, Gemini, Mistral, Bedrock, Ollama, etc.)
  • Encrypted secrets management — provider API keys stored on the server
  • Fallback/retry, traffic splitting, budget tracking
  • Built-in usage tracing
  • OpenAI-compatible and Anthropic-compatible passthrough endpoints

How it works with Claude Code

MLflow AI Gateway exposes an Anthropic-compatible passthrough at /gateway/anthropic/v1. Configuration is straightforward:

export ANTHROPIC_BASE_URL=http://localhost:5000/gateway/anthropic
export ANTHROPIC_API_KEY=unused  # provider keys are managed by the gateway

This follows the same pattern as the LiteLLM pass-through endpoint section on the current docs page.

Context

We're from the MLflow team and are adding gateway integration guides across major agent frameworks. We already have merged/open PRs for LlamaIndex, AutoGen, CrewAI, Haystack, and Google ADK. We also have an example PR for the Claude Agent SDK at https://github.com/anthropics/claude-agent-sdk-python/pull/852.

Since the code.claude.com docs don't appear to be in a public repo, we're filing this issue instead of a PR. Happy to provide any additional content or review a draft.

extent analysis

TL;DR

Add MLflow AI Gateway as a supported LLM gateway on the LLM gateway configuration page with the provided configuration settings.

Guidance

  • Review the MLflow AI Gateway documentation to understand its features and benefits, such as unified API, encrypted secrets management, and built-in usage tracing.
  • Update the LLM gateway configuration page to include MLflow AI Gateway alongside the existing LiteLLM section, using the provided configuration example as a guide.
  • Verify that the MLflow AI Gateway is properly integrated by testing the Anthropic-compatible passthrough endpoint at /gateway/anthropic/v1.
  • Consider reviewing the example PR for the Claude Agent SDK to ensure consistency in the integration.

Example

export ANTHROPIC_BASE_URL=http://localhost:5000/gateway/anthropic
export ANTHROPIC_API_KEY=unused  # provider keys are managed by the gateway

Notes

The MLflow AI Gateway requires MLflow version 3.0 or later, so ensure that the version is compatible before integrating.

Recommendation

Apply the workaround by adding MLflow AI Gateway to the LLM gateway configuration page, as it provides a unified API and encrypted secrets management, making it a valuable addition to the existing LiteLLM section.

Vote matrix · Quick signals

Works
Did the solution work? Tap to confirm.
Easy Fix
Was it a quick fix?
Time Saver
Did it save you time?
Blocking
Was it severely blocking?
Common Issue
Are others likely hitting this too?
Flaky / Intermittent
Is it intermittent?
Verified / Reproducible
Can you reproduce it reliably?
Loading…

Still need to ship something?

×6

Another batch ranked right after the header list — different links, same matching logic.

Back to top recommendations

TRENDING