WeaviateEx.Batch.BatchRetry (WeaviateEx v0.7.4)

Retry logic for batch operations with rate limit detection.

Provides exponential backoff and automatic retry for transient failures, especially rate limit errors from vectorizer APIs (OpenAI, Cohere, etc.).

Examples

if BatchRetry.should_retry?(error_message, retry_count) do
  Process.sleep(BatchRetry.calculate_backoff(retry_count))
  retry_operation()
end

Calculate the backoff delay in milliseconds for a given retry attempt.

max_retries()

Get the maximum number of retry attempts.

Check if an error message indicates a rate limit error.

Determine if an operation should be retried based on the error and attempt count.

Execute a function with automatic retry on rate limit errors.

@spec calculate_backoff(non_neg_integer()) :: non_neg_integer()

Calculate the backoff delay in milliseconds for a given retry attempt.

Uses exponential backoff: 2^attempt * 1000 ms, capped at max_backoff.

@spec max_retries() :: non_neg_integer()

Get the maximum number of retry attempts.

@spec rate_limit_error?(String.t() | nil) :: boolean()

Check if an error message indicates a rate limit error.

Detects rate limit errors from various vectorizer APIs including OpenAI, Cohere, and others.

@spec should_retry?(String.t() | nil, non_neg_integer()) :: boolean()

Determine if an operation should be retried based on the error and attempt count.

Only rate limit errors are eligible for retry, and only up to max_retries.

@spec with_retry(
  (-> {:ok, term()} | {:error, term()}),
  keyword()
) :: {:ok, term()} | {:error, term()}

Execute a function with automatic retry on rate limit errors.

BatchRetry.with_retry(fn ->
  send_batch(objects)
end)