ExLLama (LLama CPP Nif Wrapper v0.2.1)

Copy Markdown

Summary

Functions

advance_context(session, content)

chat_completion(model, thread, options)

completion(session, max_tokens, stop)

create_session(model)

create_session(model, options)

load_model(path)

load_model(path, opts)