litellm - 💡(How to fix) Fix [Bug] ResetBudgetJob crashes globally due to budget_limits list not being serialized to JSON in jsonify_object [1 participants]

def jsonify_object(data: dict) -> dict: db_data = copy.deepcopy(data) for k, v in db_data.items(): if isinstance(v, dict): # <--- MISSING LIST CHECK try: db_data[k] = json.dumps(v) except Exception: db_data[k] = "failed-to-serialize-json" return db_data

TL;DR

Update the jsonify_object function in litellm/proxy/utils.py to handle lists by changing the isinstance check to isinstance(v, (dict, list)).

Guidance

• Verify the issue by checking the proxy logs for the error message "Unable to match input value to any allowed input type for the field" when ResetBudgetJob runs.
• Update the jsonify_object function as proposed to handle lists and prevent the crash.
• Test the fix by creating a key with a budget_limits array and triggering the ResetBudgetJob to ensure it no longer crashes.
• Review the Prisma documentation to understand the expected input types for the budget_limits field and ensure the updated jsonify_object function meets these requirements.

Example

The updated jsonify_object function should look like this:

def jsonify_object(dict) -> dict:
    db_data = copy.deepcopy(data)
    for k, v in db_data.items():
        if isinstance(v, (dict, list)): 
            try:
                db_data[k] = json.dumps(v)
            except Exception:
                db_data[k] = "failed-to-serialize-json"
    return db_data

Notes

This fix assumes that the budget_limits field is expected to be a JSON string in the Prisma database. If this is not the case, further investigation may be required to determine the correct data type and handling for this field.

Recommendation

Apply the proposed workaround by updating the jsonify_object function to handle lists, as this should prevent the crash and allow the ResetBudgetJob to run successfully.