openclaw - 💡(How to fix) Fix [Bug]: Setup Wizard - Silent misconfiguration when using LLM proxy (LiteLLM, vLLM, LM Studio) [1 participants]

TL;DR

The OpenClaw setup wizard needs to be updated to handle proxied LLM endpoints correctly, prompting users for the base URL and API key when using a proxy.

Guidance

• The issue arises from the VLLM_BASE_URL field being specific to vLLM and not accounting for other proxied endpoints, leading to silent misconfiguration.
• To mitigate this, users can manually edit the ~/.openclaw/openclaw.json file after installation to correctly configure their proxied LLM endpoint.
• The setup wizard should be modified to include a prompt for users to indicate if they are using a proxied endpoint, and then request the necessary configuration details (base URL and API key) accordingly.
• The default behavior of silently defaulting to localhost:8000 when the VLLM_BASE_URL field is skipped should be changed to either prompt the user for the correct information or handle the field in a way that does not lead to misconfiguration.

Example

No code example is provided as the issue description does not include specific code snippets that need modification, but the setup wizard's logic for handling proxied LLM endpoints needs adjustment.

Notes

The solution involves updating the OpenClaw setup wizard to properly handle proxied LLM endpoints, which may require changes to the wizard's UI and backend logic to correctly prompt and configure these endpoints.

Recommendation

Apply workaround: Manually editing the ~/.openclaw/openclaw.json file after installation is a temporary solution until the setup wizard is updated to correctly handle proxied LLM endpoints. This is because the current workaround requires manual intervention post-installation, which could be error-prone and less user-friendly than an updated setup wizard that prompts for the necessary information directly.