Snakepit.Hardware.Selector (Snakepit v0.8.7)

View Source

Device selection logic for hardware abstraction.

Provides intelligent device selection based on availability, preferences, and fallback strategies.

Summary

Types

device()
device_preference()

Functions

device_info(arg1)

Returns information about a selected device.

select(arg1)

Selects a device based on preference.

select_with_fallback(list)

Selects the first available device from a preference list.

Types

device()

@type device() ::
  :cpu
  | :cuda
  | :mps
  | :rocm
  | {:cuda, non_neg_integer()}
  | {:rocm, non_neg_integer()}

device_preference()

@type device_preference() ::
  :auto | :cpu | :cuda | :mps | :rocm | {:cuda, non_neg_integer()}

Functions

device_info(arg1)

@spec device_info(device()) :: map()

Returns information about a selected device.

Returns a map with device details useful for logging and telemetry.

select(arg1)

@spec select(device_preference()) :: {:ok, device()} | {:error, :device_not_available}

Selects a device based on preference.

Options

  • :auto - Automatically select the best available accelerator
  • :cpu - Select CPU (always available)
  • :cuda - Select CUDA (fails if not available)
  • :mps - Select MPS (fails if not available or not on macOS)
  • :rocm - Select ROCm (fails if not available)
  • {:cuda, device_id} - Select specific CUDA device

Returns

  • {:ok, device} on success
  • {:error, :device_not_available} if requested device is unavailable

select_with_fallback(list)

@spec select_with_fallback([device_preference()]) ::
  {:ok, device()} | {:error, :no_device}

Selects the first available device from a preference list.

Tries each device in order until one is available, returning that device. If no devices are available, returns {:error, :no_device}.

Examples

iex> Hardware.Selector.select_with_fallback([:cuda, :mps, :cpu])
{:ok, :cpu}  # if CUDA and MPS unavailable