Vllm.PoolingParams.RequestOutputKind (VLLM v0.3.0)

Copy Markdown View Source

Enum members for RequestOutputKind.

Members:

  • CUMULATIVE = 0
  • DELTA = 1
  • FINAL_ONLY = 2

Summary

Types

t()

Functions

cumulative(ref)
delta(ref)
final_only(ref)
name(ref)
new(opts \\ [])

Constructs RequestOutputKind.

value(ref)

Types

t()

@opaque t()

Functions

cumulative(ref)

@spec cumulative(SnakeBridge.Ref.t()) :: {:ok, term()} | {:error, Snakepit.Error.t()}

delta(ref)

@spec delta(SnakeBridge.Ref.t()) :: {:ok, term()} | {:error, Snakepit.Error.t()}

final_only(ref)

@spec final_only(SnakeBridge.Ref.t()) :: {:ok, term()} | {:error, Snakepit.Error.t()}

name(ref)

@spec name(SnakeBridge.Ref.t()) :: {:ok, term()} | {:error, Snakepit.Error.t()}

new(opts \\ [])

@spec new(keyword()) :: {:ok, SnakeBridge.Ref.t()} | {:error, Snakepit.Error.t()}

Constructs RequestOutputKind.

value(ref)

@spec value(SnakeBridge.Ref.t()) :: {:ok, term()} | {:error, Snakepit.Error.t()}