GenAI.Provider.Groq.Encoder (Noizu Labs, GenAI Wrapper v0.3.0)

Copy Markdown

Summary

Functions

completion_choice(id, json, model, settings, session, context, options)
completion_choices(id, json, model, settings, session, context, options)
completion_response(json, model, settings, session, context, options)

Callback implementation for GenAI.Model.EncoderBehaviour.completion_response/6.

default_hyper_params(model, settings, session, context, options)

Callback implementation for GenAI.Model.EncoderBehaviour.default_hyper_params/5.

encode_message(message, model, session, context, options)

Format message for provider/model type.

encode_tool(tool, model, session, context, options)

Format tool for provider/model type.

encoder_protocol(model, session, context, options)

Prepare endpoint and method to make inference call to

endpoint(model, settings, session, context, options)

Prepare endpoint and method to make inference call to

headers(model, settings, session, context, options)

Prepare request headers

hyper_params(model, settings, session, context, options)

Obtain list of hyper params supported by given model including mapping and conditional rules/alterations

normalize_messages(messages, model, session, context, options)

Callback implementation for GenAI.Model.EncoderBehaviour.normalize_messages/5.

request_body(model, messages, tools, settings, session, context, options)

Prepare request body to be passed to inference call.

with_dynamic_setting(body, setting, model, settings)

Set setting with dynamic model based logic.

with_dynamic_setting(body, setting, model, settings, default)

Callback implementation for GenAI.Model.EncoderBehaviour.with_dynamic_setting/5.

with_dynamic_setting_as(body, as_setting, setting, model, settings)

Set setting as_setting with dynamic model based logic.

with_dynamic_setting_as(body, as_setting, setting, model, settings, default)

Callback implementation for GenAI.Model.EncoderBehaviour.with_dynamic_setting_as/6.

Functions

completion_choice(id, json, model, settings, session, context, options)

completion_choices(id, json, model, settings, session, context, options)

completion_response(json, model, settings, session, context, options)

Callback implementation for GenAI.Model.EncoderBehaviour.completion_response/6.

default_hyper_params(model, settings, session, context, options)

Callback implementation for GenAI.Model.EncoderBehaviour.default_hyper_params/5.

encode_message(message, model, session, context, options)

Format message for provider/model type.

encode_tool(tool, model, session, context, options)

Format tool for provider/model type.

encoder_protocol(model, session, context, options)

Prepare endpoint and method to make inference call to

endpoint(model, settings, session, context, options)

Prepare endpoint and method to make inference call to

headers(model, settings, session, context, options)

Prepare request headers

hyper_params(model, settings, session, context, options)

Obtain list of hyper params supported by given model including mapping and conditional rules/alterations

normalize_messages(messages, model, session, context, options)

Callback implementation for GenAI.Model.EncoderBehaviour.normalize_messages/5.

request_body(model, messages, tools, settings, session, context, options)

Prepare request body to be passed to inference call.

with_dynamic_setting(body, setting, model, settings)

Set setting with dynamic model based logic.

with_dynamic_setting(body, setting, model, settings, default)

Callback implementation for GenAI.Model.EncoderBehaviour.with_dynamic_setting/5.

with_dynamic_setting_as(body, as_setting, setting, model, settings)

Set setting as_setting with dynamic model based logic.

with_dynamic_setting_as(body, as_setting, setting, model, settings, default)

Callback implementation for GenAI.Model.EncoderBehaviour.with_dynamic_setting_as/6.