semantic_router.llms.mistral

MistralAILLM Objects

class MistralAILLM(BaseLLM)

LLM for MistralAI. Requires a MistralAI API key from https://console.mistral.ai/api-keys/

__init__

def __init__(name: Optional[str] = None,
             mistralai_api_key: Optional[str] = None,
             temperature: float = 0.01,
             max_tokens: int = 200)

Initialize the MistralAILLM.

Arguments:

• name (Optional[str]): The name of the MistralAI model to use.
• mistralai_api_key (Optional[str]): The MistralAI API key.
• temperature (float): The temperature of the LLM.
• max_tokens (int): The maximum number of tokens to generate.

__call__

def __call__(messages: List[Message]) -> str

Call the MistralAILLM.

Arguments:

• messages (List[Message]): The messages to pass to the MistralAILLM.

Returns:

str: The response from the MistralAILLM.