CustomLlmInfo — open-eval-api/v1

Contains information to override the default LLM endpoint and credentials.

Properties

Name	Type	Required	Description
name	string	true	The name of the custom LLM provider (claude, gemini, openai).
model_version	string	false	The specific model version to use (e.g., "gemini-2.5-pro-preview-03-25"). If not provided, falls back to the provider name.
url	string	true	The custom LLM endpoint URL.
api_key	string	false	The API key to access the custom LLM.

Complete Schema

{
  "required": [
    "name",
    "url"
  ],
  "type": "object",
  "properties": {
    "name": {
      "minLength": 1,
      "type": "string",
      "description": "The name of the custom LLM provider (claude, gemini, openai)."
    },
    "model_version": {
      "type": "string",
      "description": "The specific model version to use (e.g., \"gemini-2.5-pro-preview-03-25\").\nIf not provided, falls back to the provider name.",
      "nullable": true
    },
    "url": {
      "minLength": 1,
      "type": "string",
      "description": "The custom LLM endpoint URL."
    },
    "api_key": {
      "type": "string",
      "description": "The API key to access the custom LLM.",
      "nullable": true
    }
  },
  "additionalProperties": false,
  "description": "Contains information to override the default LLM endpoint and credentials."
}