litellm - 💡(How to fix) Fix [feature request] Hope to support dashscope embedding and rerank [1 participants]

Provider List: https://docs.litellm.ai/docs/providers

ERROR LiteLLM rerank error: litellm.APIConnectionError: Unsupported provider: dashscope
Traceback (most recent call last):
File "/Users/kylin/work/code/github/openfox/.venv/lib/python3.12/site-packages/litellm/rerank_api/main.py", line 511, in rerank
raise ValueError(f"Unsupported provider: {_custom_llm_provider}")
ValueError: Unsupported provider: dashscope
. Returning original documents

TL;DR

The error indicates that the dashscope provider is not supported by the current implementation of LiteLLM, so a workaround or update to support this provider is needed.

Guidance

• Check the LiteLLM documentation and code to see if there's an existing way to add support for custom providers like dashscope.
• Verify if the dashscope provider is listed in the Provider List (https://docs.litellm.ai/docs/providers) and if there are any specific instructions for integration.
• Consider reaching out to the LiteLLM community or developers to inquire about plans for supporting dashscope or to request guidance on implementing a custom provider.
• Review the error handling in the rerank_api/main.py file to understand how unsupported providers are handled and if there's a way to extend this logic to include dashscope.

Example

No code example is provided as the issue does not imply a straightforward code fix without more context on the LiteLLM API and dashscope integration requirements.

Notes

The solution may involve updating the LiteLLM library to a version that supports dashscope, modifying the library to add support, or using a different library that supports dashscope. Without more information on the library's architecture and the dashscope API, a precise fix cannot be determined.

Recommendation

Apply workaround: Given the error message and the lack of information on a fixed version that supports dashscope, the best course of action is to explore workarounds such as implementing custom support for dashscope or using an alternative library that supports this provider.