GenAI.Provider.Groq (Noizu Labs, GenAI Wrapper v0.2.3)
This module implements the GenAI provider for Groq AI.
Link to this section Summary
Functions
Callback implementation for GenAI.InferenceProviderBehaviour.chat/7.
Return config_key inference provide application config stored under :genai entry
Obtain map of effective settings: settings, model_settings, provider_settings, config_settings, etc.
Prepare endpoint and method to make inference call to
Prepare request headers
Retrieves a list of available Groq models.
Prepare request body to be passed to inference call.
Build and run inference thread
Callback implementation for GenAI.InferenceProviderBehaviour.standardize_model/1.
Link to this section Functions
chat(messages, tools, settings)
chat(model, messages, tools, hyper_parameters, provider_settings \\ [], context \\ nil, options \\ nil)
Callback implementation for GenAI.InferenceProviderBehaviour.chat/7.
config_key()
Return config_key inference provide application config stored under :genai entry
default_encoder()
effective_settings(model, session, context, options \\ nil)
Obtain map of effective settings: settings, model_settings, provider_settings, config_settings, etc.
endpoint(model, settings, session, context, options \\ nil)
Prepare endpoint and method to make inference call to
headers(options)
headers(model, settings, session, context, options \\ nil)
Prepare request headers
models(settings \\ [])
Retrieves a list of available Groq models.
This function calls the Groq API to retrieve a list of models and returns them as a list of GenAI.Model structs.
request_body(model, messages, tools, settings, session, context, options \\ nil)
Prepare request body to be passed to inference call.
run(session, context, options \\ nil)
Build and run inference thread
standardize_model(model)
Callback implementation for GenAI.InferenceProviderBehaviour.standardize_model/1.