litellm - 💡(How to fix) Fix LiteLLM doesn't strip double quotes [1 comments, 2 participants]

First try on LiteLLM. Took me a while to figure out how to configure Azure's endpoints when following the tutorial. Claude finally cracked it.

● Found it. The .env file wraps the values in double quotes, and LiteLLM's os.environ/ loader passes those literal " characters into the URL. Removing the quotes fixes it.

NOTE

Using double quotes in a .env file is primarily used to handle whitespace and enable variable expansion (interpolation). While many modern parsers like dotenv and dotenvx automatically strip them, their behavior can change based on the tool or operating system.

Docker: In some versions, using docker run --env-file may preserve the literal quotes as part of the value, which can cause issues with your application code.

MY COMMAND

docker run \
    -v $(pwd)/litellm_config.yaml:/app/config.yaml \
    --env-file .env \
    -p 4000:4000 \
    docker.litellm.ai/berriai/litellm:main-latest \
    --config /app/config.yaml --detailed_debug

WRONG

$ cat .env

AZURE_API_BASE="https://***.services.ai.azure.com/openai/v1"
AZURE_API_KEY="***"

RIGHT

$ cat .env

AZURE_API_BASE=https://***.services.ai.azure.com/openai/v1
AZURE_API_KEY=***

I'd appreciate a note in the tutorial towards this.