semantic_router.llms.base

BaseLLM Objects

class BaseLLM(BaseModel)

Base class for LLMs typically used by dynamic routes. This class provides a base implementation for LLMs. It defines the common configuration and methods for all LLM classes.

init

def __init__(name: str, **kwargs)

Initialize the BaseLLM. Arguments:

name (str): The name of the LLM.
**kwargs (dict): Additional keyword arguments for the LLM.

call

def __call__(messages: List[Message]) -> Optional[str]

Call the LLM. Must be implemented by subclasses. Arguments:

messages (List[Message]): The messages to pass to the LLM.

Returns: Optional[str]: The response from the LLM.

extract_function_inputs

def extract_function_inputs(
        query: str, function_schemas: List[Dict[str,
                                                Any]]) -> List[Dict[str, Any]]

Extract the function inputs from the query. Arguments:

query (str): The query to extract the function inputs from.
function_schemas (List[Dict[str, Any]]): The function schemas to extract the function inputs from.

Returns: List[Dict[str, Any]]: The function inputs.

​BaseLLM Objects

​__init__

​__call__

​extract_function_inputs

BaseLLM Objects

init

call

extract_function_inputs