HfHub.InferenceEndpoints.ScalingConfig (HfHub v0.2.0)

Copy Markdown View Source

Scaling configuration for an inference endpoint.

Summary

Types

t()

Functions

from_response(response)

Creates a ScalingConfig struct from an API response.

Types

t()

@type t() :: %HfHub.InferenceEndpoints.ScalingConfig{
  max_replica: pos_integer() | nil,
  min_replica: non_neg_integer() | nil,
  scale_to_zero_timeout: non_neg_integer() | nil
}

Functions

from_response(response)

@spec from_response(map()) :: t()

Creates a ScalingConfig struct from an API response.