[Feature]: ChatLiteLLMRouter to support json_schema

[eilam-stream]

The Feature

Currently ChatLiteLLMRouter does not support json_schema method which is the gold standard for Structured Output using OpenAI.

Langchain's ChatOpenAI supports chat.with_structured_output(pydantic_model, method="json_schema") but if chat is ChatLiteLLMRouter the following error is received:

langchain_core/language_models/chat_models.py", line 1303, in with_structured_output
    raise ValueError(msg)
ValueError: Received unsupported arguments {'method': 'json_schema'}

Motivation, pitch

Langchain is a standard in the industry and supporting this functionality will not just improve user's reliability since Structured Output using json_mode, as opposed to json_schema, is frequently faulty and causes issues in production.

Are you a ML Ops Team?

No

Twitter / LinkedIn details

No response

[krrishdholakia]

Hi @eilam-stream litellm supports json_schema - https://docs.litellm.ai/docs/completion/json_mode#2-check-if-model-supports-json_schema.

I believe chatlitellmrouter is a community langfuse integration - we would welcome any PR to https://github.com/langchain-ai/langchain