ExLLama.Session (LLama CPP Nif Wrapper v0.2.1)

Copy Markdown

Summary

Functions

advance_context(session, context)

advance_context_with_tokens(session, context)

completion(session, max_tokens, stop)

context(session)

context_size(session)

deep_copy(session)

default_options()

model(session)

params(session)

set_context(session, context)

set_context_to_tokens(session, tokens)

start_completing_with(session, options)

truncate_context(session, n_tokens)