LLama CPP Nif Wrapper v0.0.2

ExLLama.ModelOptions (LLama CPP Nif Wrapper v0.0.2)

Link to this section Summary

Types

t()

Functions

new()

Link to this section Types

Link to this type

t()

@type t() :: %ExLLama.ModelOptions{
  main_gpu: non_neg_integer(),
  n_gpu_layers: non_neg_integer(),
  split_mode: String.t(),
  use_mlock: boolean(),
  use_mmap: boolean(),
  vocab_only: boolean()
}

Link to this section Functions

Link to this function

new()