LLama CPP Nif Wrapper v0.0.2

ExLLama (LLama CPP Nif Wrapper v0.0.2)

Link to this section Summary

Functions

advance_context(session, content)
chat_completion(model, thread, options)
completion(session, max_tokens, stop)
create_session(model)
create_session(model, options)
load_model(path)
load_model(path, opts)

Link to this section Functions

Link to this function

advance_context(session, content)

Link to this function

chat_completion(model, thread, options)

Link to this function

completion(session, max_tokens, stop)

Link to this function

create_session(model)

Link to this function

create_session(model, options)

Link to this function

load_model(path)

Link to this function

load_model(path, opts)