Skip to main content

OpenAIEncoder Objects

OpenAI encoder class for generating embeddings using OpenAI API. The OpenAIEncoder class is a subclass of DenseEncoder and utilizes the OpenAI API to generate embeddings for given documents. It requires an OpenAI API key and supports customization of the score threshold for filtering or processing the embeddings.

token_limit

default value, should be replaced by config

__init__

Initialize the OpenAIEncoder. Arguments:
  • name (str): The name of the embedding model to use.
  • openai_base_url (str): The base URL for the OpenAI API.
  • openai_api_key (str): The OpenAI API key.
  • openai_org_id (str): The OpenAI organization ID.
  • score_threshold (float): The score threshold for the embeddings.
  • str0 (str1): The dimensions of the embeddings.
  • str2 (str1): The maximum number of retries for the OpenAI API call.

__call__

Encode a list of text documents into embeddings using OpenAI API. Arguments:
  • docs: List of text documents to encode.
  • truncate: Whether to truncate the documents to token limit. If False and a document exceeds the token limit, an error will be raised.
Returns: List of embeddings for each document.

acall

Encode a list of text documents into embeddings using OpenAI API asynchronously. Arguments:
  • docs: List of text documents to encode.
  • truncate: Whether to truncate the documents to token limit. If False and a document exceeds the token limit, an error will be raised.
Returns: List of embeddings for each document.