Vllm.Outputs.EmbeddingOutput (VLLM v0.3.0)

Copy Markdown View Source

The output data of one embedding output of a request.

Parameters

  • embedding - The embedding vector, which is a list of floats. Its length depends on the hidden dimension of the model.

Summary

Functions

Python method EmbeddingOutput.from_base.

Initialize self. See help(type(self)) for accurate signature.

Types

t()

@opaque t()

Functions

from_base(ref, pooling_output, opts \\ [])

@spec from_base(SnakeBridge.Ref.t(), Vllm.Outputs.PoolingOutput.t(), keyword()) ::
  {:ok, term()} | {:error, Snakepit.Error.t()}

Python method EmbeddingOutput.from_base.

Parameters

  • pooling_output (Vllm.Outputs.PoolingOutput.t())

Returns

  • term()

hidden_size(ref)

@spec hidden_size(SnakeBridge.Ref.t()) :: {:ok, term()} | {:error, Snakepit.Error.t()}

new(embedding, opts \\ [])

@spec new(
  [float()],
  keyword()
) :: {:ok, SnakeBridge.Ref.t()} | {:error, Snakepit.Error.t()}

Initialize self. See help(type(self)) for accurate signature.

Parameters

  • embedding (list(float()))