Braintrust (Braintrust v0.3.0)

Unofficial Elixir SDK for the Braintrust AI evaluation and observability platform.

Installation

Add braintrust to your list of dependencies in mix.exs:

def deps do
  [
    {:braintrust, "~> 0.1.0"}
  ]
end

Configuration

Set your API key via environment variable:

export BRAINTRUST_API_KEY="sk-your-api-key"

Or configure in your application:

# config/config.exs
config :braintrust,
  api_key: System.get_env("BRAINTRUST_API_KEY"),
  timeout: 30_000

Or configure at runtime:

Braintrust.configure(api_key: "sk-your-api-key")

Usage

See the individual resource modules for API operations:

Braintrust.Project - Manage projects
Braintrust.Experiment - Run evaluations and track results
Braintrust.Dataset - Manage test datasets
Braintrust.Log - Log production traces and spans
Braintrust.Prompt - Version-controlled prompt management
Braintrust.Function - Manage tools, scorers, and callable functions
Braintrust.LangChainCallbacks - LangChain callback handler for observability

Resources

Summary

Functions

configure(opts)

Configures the Braintrust SDK for the current process.

Functions

configure(opts)

@spec configure(keyword()) :: :ok

Configures the Braintrust SDK for the current process.

Configuration set via this function takes precedence over application config and environment variables, but is overridden by options passed directly to API functions.

Options

:api_key - API key for authentication (prefix: sk- or bt-st-)
:base_url - Base URL for API (default: https://api.braintrust.dev)
:timeout - Request timeout in milliseconds (default: 60000)
:max_retries - Maximum retry attempts (default: 2)

Examples

iex> Braintrust.configure(api_key: "sk-test123")
:ok

iex> Braintrust.configure(api_key: "sk-test", timeout: 30_000, max_retries: 3)
:ok