Submodule bindings for vllm.platforms.
Version
- Requested: 0.14.0
- Observed at generation: 0.14.0
Runtime Options
All functions accept a __runtime__ option for controlling execution behavior:
Vllm.Platforms.some_function(args, __runtime__: [timeout: 120_000])Supported runtime options
:timeout- Call timeout in milliseconds (default: 120,000ms / 2 minutes):timeout_profile- Use a named profile (:default,:ml_inference,:batch_job,:streaming):stream_timeout- Timeout for streaming operations (default: 1,800,000ms / 30 minutes):session_id- Override the session ID for this call:pool_name- Target a specific Snakepit pool (multi-pool setups):affinity- Override session affinity (:hint,:strict_queue,:strict_fail_fast)
Timeout Profiles
:default- 2 minute timeout for regular calls:ml_inference- 10 minute timeout for ML/LLM workloads:batch_job- Unlimited timeout for long-running jobs:streaming- 2 minute timeout, 30 minute stream_timeout
Example with timeout override
# For a long-running ML inference call
Vllm.Platforms.predict(data, __runtime__: [timeout_profile: :ml_inference])
# Or explicit timeout
Vllm.Platforms.predict(data, __runtime__: [timeout: 600_000])
# Route to a pool and enforce strict affinity
Vllm.Platforms.predict(data, __runtime__: [pool_name: :strict_pool, affinity: :strict_queue])See SnakeBridge.Defaults for global timeout configuration.
Summary
Functions
Python module attribute vllm.platforms.__all__.
Python binding for vllm.platforms.__getattr__.
Python binding for vllm.platforms.__setattr__.
Python binding for vllm.platforms._current_platform.
Python module attribute vllm.platforms._init_trace.
Python module attribute vllm.platforms.builtin_platform_plugins.
Python binding for vllm.platforms.cpu_platform_plugin.
Python binding for vllm.platforms.cuda_platform_plugin.
Python module attribute vllm.platforms.current_platform.
Python binding for vllm.platforms.load_plugins_by_group.
Python module attribute vllm.platforms.logger.
Python module attribute vllm.platforms.PLATFORM_PLUGINS_GROUP.
Python binding for vllm.platforms.resolve_current_platform_cls_qualname.
Resolve an object by its fully-qualified class name.
Python binding for vllm.platforms.rocm_platform_plugin.
Python binding for vllm.platforms.supports_xccl.
Python binding for vllm.platforms.tpu_platform_plugin.
Check to see if the vLLM version matches a substring.
Python binding for vllm.platforms.xpu_platform_plugin.
Functions
@spec __all__() :: {:ok, [term()]} | {:error, Snakepit.Error.t()}
Python module attribute vllm.platforms.__all__.
Returns
list(term())
@spec __getattr__( String.t(), keyword() ) :: {:ok, term()} | {:error, Snakepit.Error.t()}
Python binding for vllm.platforms.__getattr__.
Parameters
name(String.t())
Returns
term()
@spec __setattr__(String.t(), term(), keyword()) :: {:ok, term()} | {:error, Snakepit.Error.t()}
Python binding for vllm.platforms.__setattr__.
Parameters
name(String.t())value(term())
Returns
term()
@spec _current_platform() :: {:ok, term()} | {:error, Snakepit.Error.t()}
Python binding for vllm.platforms._current_platform.
Returns
term()
@spec _init_trace() :: {:ok, String.t()} | {:error, Snakepit.Error.t()}
Python module attribute vllm.platforms._init_trace.
Returns
String.t()
@spec builtin_platform_plugins() :: {:ok, %{optional(term()) => term()}} | {:error, Snakepit.Error.t()}
Python module attribute vllm.platforms.builtin_platform_plugins.
Returns
%{optional(term()) => term()}
@spec cpu_platform_plugin(keyword()) :: {:ok, term()} | {:error, Snakepit.Error.t()}
Python binding for vllm.platforms.cpu_platform_plugin.
Returns
term()
@spec cuda_platform_plugin(keyword()) :: {:ok, term()} | {:error, Snakepit.Error.t()}
Python binding for vllm.platforms.cuda_platform_plugin.
Returns
term()
@spec current_platform() :: {:ok, term()} | {:error, Snakepit.Error.t()}
Python module attribute vllm.platforms.current_platform.
Returns
term()
@spec load_plugins_by_group( String.t(), keyword() ) :: {:ok, %{optional(String.t()) => term()}} | {:error, Snakepit.Error.t()}
Python binding for vllm.platforms.load_plugins_by_group.
Parameters
group(String.t())
Returns
%{optional(String.t()) => term()}
@spec logger() :: {:ok, term()} | {:error, Snakepit.Error.t()}
Python module attribute vllm.platforms.logger.
Returns
term()
@spec platform_plugins_group() :: {:ok, String.t()} | {:error, Snakepit.Error.t()}
Python module attribute vllm.platforms.PLATFORM_PLUGINS_GROUP.
Returns
String.t()
@spec resolve_current_platform_cls_qualname(keyword()) :: {:ok, String.t()} | {:error, Snakepit.Error.t()}
Python binding for vllm.platforms.resolve_current_platform_cls_qualname.
Returns
String.t()
@spec resolve_obj_by_qualname( String.t(), keyword() ) :: {:ok, term()} | {:error, Snakepit.Error.t()}
Resolve an object by its fully-qualified class name.
Parameters
qualname(String.t())
Returns
term()
@spec rocm_platform_plugin(keyword()) :: {:ok, term()} | {:error, Snakepit.Error.t()}
Python binding for vllm.platforms.rocm_platform_plugin.
Returns
term()
@spec supports_xccl(keyword()) :: {:ok, boolean()} | {:error, Snakepit.Error.t()}
Python binding for vllm.platforms.supports_xccl.
Returns
boolean()
@spec tpu_platform_plugin(keyword()) :: {:ok, term()} | {:error, Snakepit.Error.t()}
Python binding for vllm.platforms.tpu_platform_plugin.
Returns
term()
@spec vllm_version_matches_substr( String.t(), keyword() ) :: {:ok, boolean()} | {:error, Snakepit.Error.t()}
Check to see if the vLLM version matches a substring.
Parameters
substr(String.t())
Returns
boolean()
@spec xpu_platform_plugin(keyword()) :: {:ok, term()} | {:error, Snakepit.Error.t()}
Python binding for vllm.platforms.xpu_platform_plugin.
Returns
term()