GenAI.Provider.Ollama.Encoder (Noizu Labs, GenAI Wrapper v0.3.0)

Summary

Functions

base_url(settings \\ [])

Get the base URL for Ollama API endpoints. Allows override via settings.

completion_choice(id, json, model, settings, session, context, options)

completion_choices(id, json, model, settings, session, context, options)

completion_response(json, model, settings, session, context, options)

Callback implementation for GenAI.Model.EncoderBehaviour.completion_response/6.

default_hyper_params(model, settings, session, context, options)

Callback implementation for GenAI.Model.EncoderBehaviour.default_hyper_params/5.

encode_message(message, model, session, context, options)

Format message for provider/model type.

encode_tool(tool, model, session, context, options)

Format tool for provider/model type.

encoder_protocol(model, session, context, options)

Prepare endpoint and method to make inference call to

endpoint(model, settings, session, context, options)

Define the endpoint for Ollama chat API.

headers(model, settings, session, context, options)

Prepare request headers

hyper_params(model, settings, session, context, options)

Obtain list of hyper params supported by given model including mapping and conditional rules/alterations

normalize_messages(messages, model, session, context, options)

Callback implementation for GenAI.Model.EncoderBehaviour.normalize_messages/5.

request_body(model, messages, tools, settings, session, context, options)

Prepare request body to be passed to inference call.

with_dynamic_setting(body, setting, model, settings)

Set setting with dynamic model based logic.

with_dynamic_setting(body, setting, model, settings, default)

Callback implementation for GenAI.Model.EncoderBehaviour.with_dynamic_setting/5.

with_dynamic_setting_as(body, as_setting, setting, model, settings)

Set setting as_setting with dynamic model based logic.

with_dynamic_setting_as(body, as_setting, setting, model, settings, default)

Callback implementation for GenAI.Model.EncoderBehaviour.with_dynamic_setting_as/6.