Vllm.BeamSearch.BeamSearchInstance (VLLM v0.3.0)

Copy Markdown View Source

Wrapper for Python class BeamSearchInstance.

Summary

Types

t()

Functions

new(prompt_tokens, args, opts \\ [])

Initialize self. See help(type(self)) for accurate signature.

Types

t()

@opaque t()

Functions

new(prompt_tokens, args, opts \\ [])

@spec new([integer()], [term()], keyword()) ::
  {:ok, SnakeBridge.Ref.t()} | {:error, Snakepit.Error.t()}

Initialize self. See help(type(self)) for accurate signature.

Parameters

  • prompt_tokens (list(integer()))
  • lora_request (term() default: None)
  • logprobs (term() default: None)
  • kwargs (term())