semantic_router.llms.openrouter - Aurelio AI

OpenRouterLLM Objects

class OpenRouterLLM(BaseLLM)

LLM for OpenRouter. Requires an OpenRouter API key, see here for more information https://openrouter.ai/docs/api-reference/authentication#using-an-api-key

init

def __init__(name: Optional[str] = None,
             openrouter_api_key: Optional[str] = None,
             base_url: str = "https://openrouter.ai/api/v1",
             temperature: float = 0.01,
             max_tokens: int = 200)

Initialize the OpenRouterLLM. Arguments:

name (Optional[str]): The name of the OpenRouter model to use.
openrouter_api_key (Optional[str]): The OpenRouter API key.
base_url (str): The base URL for the OpenRouter API.
temperature (float): The temperature of the LLM.
max_tokens (int): The maximum number of tokens to generate.

call

def __call__(messages: List[Message]) -> str

Call the OpenRouterLLM. Arguments:

messages (List[Message]): The messages to pass to the OpenRouterLLM.

Returns: str: The response from the OpenRouterLLM.

⌘I