View Source Rag.Loading (rag v0.1.0)

Functions to load and transform data from various sources and formats.

Summary

Functions

chunk_text(ingestion, text_key, opts \\ [])

Chunks the content at document in ingestion using TextChunker.split/2. Returns a list with the chunk stored in chunk in ingestion for each of the chunks.

load_file(ingestion)

Reads the file from the filepath at source in ingestion and puts it in ingestion at document.

Functions

chunk_text(ingestion, text_key, opts \\ [])

Chunks the content at document in ingestion using TextChunker.split/2. Returns a list with the chunk stored in chunk in ingestion for each of the chunks.

load_file(ingestion)

@spec load_file(map()) :: map()

Reads the file from the filepath at source in ingestion and puts it in ingestion at document.