semantic_router.llms.openrouter

OpenRouterLLM Objects

class OpenRouterLLM(BaseLLM)

LLM for OpenRouter. Requires an OpenRouter API key, see here for more information https://openrouter.ai/docs/api-reference/authentication#using-an-api-key

__init__

def __init__(name: Optional[str] = None,
             openrouter_api_key: Optional[str] = None,
             base_url: str = "https://openrouter.ai/api/v1",
             temperature: float = 0.01,
             max_tokens: int = 200)

Initialize the OpenRouterLLM.

Arguments:

• name (Optional[str]): The name of the OpenRouter model to use.
• openrouter_api_key (Optional[str]): The OpenRouter API key.
• base_url (str): The base URL for the OpenRouter API.
• temperature (float): The temperature of the LLM.
• max_tokens (int): The maximum number of tokens to generate.

__call__

def __call__(messages: List[Message]) -> str

Call the OpenRouterLLM.

Arguments:

• messages (List[Message]): The messages to pass to the OpenRouterLLM.

Returns:

str: The response from the OpenRouterLLM.