HfHub.InferenceEndpoints.ComputeConfig (HfHub v0.2.0)

Copy Markdown View Source

Compute configuration for an inference endpoint.

Summary

Types

accelerator()
t()

Functions

from_response(response)

Creates a ComputeConfig struct from an API response.

Types

accelerator()

@type accelerator() :: :cpu | :gpu

t()

@type t() :: %HfHub.InferenceEndpoints.ComputeConfig{
  accelerator: accelerator() | nil,
  instance_size: String.t() | nil,
  instance_type: String.t() | nil,
  scaling: HfHub.InferenceEndpoints.ScalingConfig.t() | nil
}

Functions

from_response(response)

@spec from_response(map()) :: t()

Creates a ComputeConfig struct from an API response.