semantic_router.llms.zure

AzureOpenAILLM Objects

class AzureOpenAILLM(BaseLLM)

LLM for Azure OpenAI. Requires an Azure OpenAI API key.

__init__

def __init__(name: Optional[str] = None,
             openai_api_key: Optional[str] = None,
             azure_endpoint: Optional[str] = None,
             temperature: float = 0.01,
             max_tokens: int = 200,
             api_version="2023-07-01-preview")

Initialize the AzureOpenAILLM.

Arguments:

• name (Optional[str]): The name of the Azure OpenAI model to use.
• openai_api_key (Optional[str]): The Azure OpenAI API key.
• azure_endpoint (Optional[str]): The Azure OpenAI endpoint.
• temperature (float): The temperature of the LLM.
• max_tokens (int): The maximum number of tokens to generate.
• Optional[str]0 (Optional[str]1): The API version to use.

__call__

def __call__(messages: List[Message]) -> str

Call the AzureOpenAILLM.

Arguments:

• messages (List[Message]): The messages to pass to the AzureOpenAILLM.

Returns:

str: The response from the AzureOpenAILLM.