Vllm.Distributed.GraphCaptureContext (VLLM v0.3.0)

Copy Markdown View Source

GraphCaptureContext(stream: torch.cuda.streams.Stream)

Summary

Functions

Initialize self. See help(type(self)) for accurate signature.

Types

t()

@opaque t()

Functions

new(stream, opts \\ [])

@spec new(
  term(),
  keyword()
) :: {:ok, SnakeBridge.Ref.t()} | {:error, Snakepit.Error.t()}

Initialize self. See help(type(self)) for accurate signature.

Parameters

  • stream (term())