litellm - 💡(How to fix) Fix [Bug]: pg_vector cannot add or update llm_params

TL;DR

Update the vector store using the API and then manually create or update it on pg_vector, or edit the JSON field in the database after creation to work around the issue with updating credentials in the litellm_params map.

Guidance

• The issue seems to be related to a UI confusion between the Metadata and litellm_params fields when updating or adding a pg_vector vector store.
• To verify the issue, try creating or updating a vector store through the UI and then check the actual fields stored in the database or viewed afterwards.
• As a workaround, use the API to create or update the vector store and then manually ensure the correct configuration on pg_vector.
• Editing the JSON field in the database after creation is another possible workaround, but this may require direct database access and should be done with caution.

Example

No specific code example is provided due to the nature of the issue being more related to UI and configuration rather than code.

Notes

The provided workarounds suggest that the issue might be specific to the UI interaction with the vector store configuration, and using the API or direct database edits can circumvent the problem. However, these workarounds may not be ideal for all users and could introduce additional steps or risks.

Recommendation

Apply the workaround of using the API for vector store creation or updates and then manually ensuring the correct configuration on pg_vector, as this method is explicitly mentioned and seems to be a reliable, though not ideal, solution to the problem.