​
MistralAILLM Objects

class MistralAILLM(BaseLLM)

LLM for MistralAI. Requires a MistralAI API key from https://console.mistral.ai/api-keys/

​
__init__

def __init__(name: Optional[str] = None,
             mistralai_api_key: Optional[str] = None,
             temperature: float = 0.01,
             max_tokens: int = 200)

Initialize the MistralAILLM.

Arguments:

  • name (Optional[str]): The name of the MistralAI model to use.
  • mistralai_api_key (Optional[str]): The MistralAI API key.
  • temperature (float): The temperature of the LLM.
  • max_tokens (int): The maximum number of tokens to generate.

​
__call__

def __call__(messages: List[Message]) -> str

Call the MistralAILLM.

Arguments:

  • messages (List[Message]): The messages to pass to the MistralAILLM.

Returns:

str: The response from the MistralAILLM.

llamacppollama