Issue Station
Sign In
Tools hereToolbox

litellm - 💡(How to fix) Fix [Bug]: pg-vector vector store has no proper support [1 comments, 1 participants]

Official PRs (…)
ON THIS PAGE

Recommended Tools

×6

Utilities matched from this issue’s tags and category — try them while you read without losing context.

GitHub issue graph ai analysis

Paste a GitHub issue URL. We fetch that issue, discover linked issues from bodies/comments/timeline, collect linked pull requests, and produce a structured English report.

The report is written in English Markdown for sharing and archival.

Helpful · Quick feedback

Loading…
GitHub stats
BerriAI/litellm#26771•Fetched 2026-04-30 06:20:11
View on GitHub
Comments
1
Participants
1
Timeline
4
Reactions
0
Author
sujal011sujal011
Participants
sujal011sujal011
Timeline (top)
labeled ×3commented ×1

Error Message

INFO: 192.168.16.8:59878 - "GET /organization/list HTTP/1.1" 200 OK INFO: 192.168.16.8:59892 - "GET /team/list HTTP/1.1" 200 OK 06:42:21 - LiteLLM Proxy:ERROR: endpoints.py:435 - RAG Ingest failed: litellm.APIConnectionError: Provider 'pg_vector' is not supported for RAG ingestion. Supported providers: openai, bedrock, gemini, s3_vectors, vertex_ai Traceback (most recent call last): File "/usr/lib/python3.13/site-packages/litellm/rag/main.py", line 179, in aingest response = await init_response ^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/site-packages/litellm/rag/main.py", line 106, in _execute_ingest_pipeline ingestion_class = get_ingestion_class(provider) File "/usr/lib/python3.13/site-packages/litellm/rag/main.py", line 74, in get_ingestion_class

Code Example

INFO:     192.168.16.8:59878 - "GET /organization/list HTTP/1.1" 200 OK
INFO:     192.168.16.8:59892 - "GET /team/list HTTP/1.1" 200 OK
06:42:21 - LiteLLM Proxy:ERROR: endpoints.py:435 - RAG Ingest failed: litellm.APIConnectionError: Provider 'pg_vector' is not supported for RAG ingestion. Supported providers: openai, bedrock, gemini, s3_vectors, vertex_ai
Traceback (most recent call last):
  File "/usr/lib/python3.13/site-packages/litellm/rag/[main.py](http://main.py)", line 179, in aingest
    response = await init_response
               ^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.13/site-packages/litellm/rag/[main.py](http://main.py)", line 106, in _execute_ingest_pipeline
    ingestion_class = get_ingestion_class(provider)
  File "/usr/lib/python3.13/site-packages/litellm/rag/[main.py](http://main.py)", line 74, in get_ingestion_class

---

INFO:     192.168.16.8:59878 - "GET /organization/list HTTP/1.1" 200 OK
INFO:     192.168.16.8:59892 - "GET /team/list HTTP/1.1" 200 OK
06:42:21 - LiteLLM Proxy:ERROR: endpoints.py:435 - RAG Ingest failed: litellm.APIConnectionError: Provider 'pg_vector' is not supported for RAG ingestion. Supported providers: openai, bedrock, gemini, s3_vectors, vertex_ai
Traceback (most recent call last):
  File "/usr/lib/python3.13/site-packages/litellm/rag/[main.py](http://main.py)", line 179, in aingest
    response = await init_response
               ^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.13/site-packages/litellm/rag/[main.py](http://main.py)", line 106, in _execute_ingest_pipeline
    ingestion_class = get_ingestion_class(provider)
  File "/usr/lib/python3.13/site-packages/litellm/rag/[main.py](http://main.py)", line 74, in get_ingestion_class

---

INFO:     192.168.16.8:59878 - "GET /organization/list HTTP/1.1" 200 OK
INFO:     192.168.16.8:59892 - "GET /team/list HTTP/1.1" 200 OK
06:42:21 - LiteLLM Proxy:ERROR: endpoints.py:435 - RAG Ingest failed: litellm.APIConnectionError: Provider 'pg_vector' is not supported for RAG ingestion. Supported providers: openai, bedrock, gemini, s3_vectors, vertex_ai
Traceback (most recent call last):
  File "/usr/lib/python3.13/site-packages/litellm/rag/[main.py](http://main.py)", line 179, in aingest
    response = await init_response
               ^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.13/site-packages/litellm/rag/[main.py](http://main.py)", line 106, in _execute_ingest_pipeline
    ingestion_class = get_ingestion_class(provider)
  File "/usr/lib/python3.13/site-packages/litellm/rag/[main.py](http://main.py)", line 74, in get_ingestion_class
RAW_BUFFERClick to expand / collapse

Check for existing issues

  • I have searched the existing issues and checked that my issue is not a duplicate.

What happened?

INFO:     192.168.16.8:59878 - "GET /organization/list HTTP/1.1" 200 OK
INFO:     192.168.16.8:59892 - "GET /team/list HTTP/1.1" 200 OK
06:42:21 - LiteLLM Proxy:ERROR: endpoints.py:435 - RAG Ingest failed: litellm.APIConnectionError: Provider 'pg_vector' is not supported for RAG ingestion. Supported providers: openai, bedrock, gemini, s3_vectors, vertex_ai
Traceback (most recent call last):
  File "/usr/lib/python3.13/site-packages/litellm/rag/[main.py](http://main.py)", line 179, in aingest
    response = await init_response
               ^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.13/site-packages/litellm/rag/[main.py](http://main.py)", line 106, in _execute_ingest_pipeline
    ingestion_class = get_ingestion_class(provider)
  File "/usr/lib/python3.13/site-packages/litellm/rag/[main.py](http://main.py)", line 74, in get_ingestion_class

Steps to Reproduce

  1. clone and run this openai compatible vector store api server https://github.com/[BerriAI/litellm-pgvector](https://github.com/BerriAI/litellm-pgvector)
  2. create vector store in the litellm proxy ui
<img width="1318" height="562" alt="Image" src="https://github.com/user-attachments/assets/eb513d77-1b51-4273-ace9-89fed48600be" />
  1. when clicking on the creat vector stire button you will get this error-
INFO:     192.168.16.8:59878 - "GET /organization/list HTTP/1.1" 200 OK
INFO:     192.168.16.8:59892 - "GET /team/list HTTP/1.1" 200 OK
06:42:21 - LiteLLM Proxy:ERROR: endpoints.py:435 - RAG Ingest failed: litellm.APIConnectionError: Provider 'pg_vector' is not supported for RAG ingestion. Supported providers: openai, bedrock, gemini, s3_vectors, vertex_ai
Traceback (most recent call last):
  File "/usr/lib/python3.13/site-packages/litellm/rag/[main.py](http://main.py)", line 179, in aingest
    response = await init_response
               ^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.13/site-packages/litellm/rag/[main.py](http://main.py)", line 106, in _execute_ingest_pipeline
    ingestion_class = get_ingestion_class(provider)
  File "/usr/lib/python3.13/site-packages/litellm/rag/[main.py](http://main.py)", line 74, in get_ingestion_class

Relevant log output

INFO:     192.168.16.8:59878 - "GET /organization/list HTTP/1.1" 200 OK
INFO:     192.168.16.8:59892 - "GET /team/list HTTP/1.1" 200 OK
06:42:21 - LiteLLM Proxy:ERROR: endpoints.py:435 - RAG Ingest failed: litellm.APIConnectionError: Provider 'pg_vector' is not supported for RAG ingestion. Supported providers: openai, bedrock, gemini, s3_vectors, vertex_ai
Traceback (most recent call last):
  File "/usr/lib/python3.13/site-packages/litellm/rag/[main.py](http://main.py)", line 179, in aingest
    response = await init_response
               ^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.13/site-packages/litellm/rag/[main.py](http://main.py)", line 106, in _execute_ingest_pipeline
    ingestion_class = get_ingestion_class(provider)
  File "/usr/lib/python3.13/site-packages/litellm/rag/[main.py](http://main.py)", line 74, in get_ingestion_class

What part of LiteLLM is this about?

UI Dashboard

What LiteLLM version are you on ?

v1.82.3

Twitter / LinkedIn details

No response

extent analysis

TL;DR

The error message indicates that the 'pg_vector' provider is not supported for RAG ingestion, suggesting a compatibility issue with the LiteLLM Proxy and the vector store API server.

Guidance

  • Verify that the 'pg_vector' provider is correctly configured and supported in the LiteLLM Proxy version v1.82.3.
  • Check the documentation for LiteLLM Proxy to see if there are any specific requirements or limitations for using the 'pg_vector' provider with RAG ingestion.
  • Consider using a different provider that is supported by LiteLLM Proxy, such as 'openai', 'bedrock', 'gemini', 's3_vectors', or 'vertex_ai'.
  • Review the code in endpoints.py and main.py to understand how the provider is being selected and used for RAG ingestion.

Example

No code example is provided as the issue seems to be related to configuration and compatibility rather than a specific code error.

Notes

The error message clearly indicates that 'pg_vector' is not a supported provider, so the focus should be on either using a supported provider or updating the LiteLLM Proxy to support 'pg_vector' if it is a valid provider.

Recommendation

Apply workaround by using a supported provider, as the 'pg_vector' provider is not supported for RAG ingestion in the current version of LiteLLM Proxy.

Vote matrix · Quick signals

Works
Did the solution work? Tap to confirm.
Easy Fix
Was it a quick fix?
Time Saver
Did it save you time?
Blocking
Was it severely blocking?
Common Issue
Are others likely hitting this too?
Flaky / Intermittent
Is it intermittent?
Verified / Reproducible
Can you reproduce it reliably?
Loading…
#api#prompt formatting#chain error#conversation history#vector store

Still need to ship something?

×6

Another batch ranked right after the header list — different links, same matching logic.

Back to top recommendations

TRENDING

litellm - 💡(How to fix) Fix [Bug]: pg-vector vector store has no proper support [1 comments, 1 participants]