GenAI.Provider.Ollama.Encoder (Noizu Labs, GenAI Wrapper v0.2.4)
Link to this section Summary
Functions
Get the base URL for Ollama API endpoints. Allows override via settings.
Callback implementation for GenAI.Model.EncoderBehaviour.completion_response/6.
Callback implementation for GenAI.Model.EncoderBehaviour.default_hyper_params/5.
Format message for provider/model type.
Format tool for provider/model type.
Prepare endpoint and method to make inference call to
Define the endpoint for Ollama chat API.
Prepare request headers
Obtain list of hyper params supported by given model including mapping and conditional rules/alterations
Callback implementation for GenAI.Model.EncoderBehaviour.normalize_messages/5.
Prepare request body to be passed to inference call.
Set setting with dynamic model based logic.
Callback implementation for GenAI.Model.EncoderBehaviour.with_dynamic_setting/5.
Set setting as_setting with dynamic model based logic.
Link to this section Functions
base_url(settings \\ [])
Get the base URL for Ollama API endpoints. Allows override via settings.
completion_choice(id, json, model, settings, session, context, options)
completion_choices(id, json, model, settings, session, context, options)
completion_response(json, model, settings, session, context, options)
Callback implementation for GenAI.Model.EncoderBehaviour.completion_response/6.
default_hyper_params(model, settings, session, context, options)
Callback implementation for GenAI.Model.EncoderBehaviour.default_hyper_params/5.
encode_message(message, model, session, context, options)
Format message for provider/model type.
encode_tool(tool, model, session, context, options)
Format tool for provider/model type.
encoder_protocol(model, session, context, options)
Prepare endpoint and method to make inference call to
endpoint(model, settings, session, context, options)
Define the endpoint for Ollama chat API.
headers(model, settings, session, context, options)
Prepare request headers
hyper_params(model, settings, session, context, options)
Obtain list of hyper params supported by given model including mapping and conditional rules/alterations
normalize_messages(messages, model, session, context, options)
Callback implementation for GenAI.Model.EncoderBehaviour.normalize_messages/5.
request_body(model, messages, tools, settings, session, context, options)
Prepare request body to be passed to inference call.
with_dynamic_setting(body, setting, model, settings)
Set setting with dynamic model based logic.
with_dynamic_setting(body, setting, model, settings, default)
Callback implementation for GenAI.Model.EncoderBehaviour.with_dynamic_setting/5.
with_dynamic_setting_as(body, as_setting, setting, model, settings)
Set setting as_setting with dynamic model based logic.
with_dynamic_setting_as(body, as_setting, setting, model, settings, default)
Callback implementation for GenAI.Model.EncoderBehaviour.with_dynamic_setting_as/6.