Module kflow_wf_chunks_to_s3

This workflow assembles chunked transmissions into local files.

Copyright © 2019 Klarna Bank AB (publ)

Description

This workflow assembles chunked transmissions into local files.

Data Types

config()

config() = #{kafka_client => atom(), consumer_config => proplists:proplist(), kafka_topic := brod:topic(), group_id := brod:group_id(), s3_bucket := file:filename_all(), prefix => string() | binary(), filter => predicate()}

predicate()

predicate() = fun((Key::binary()) -> boolean())

Function Index

workflow/2Create a workflow specification.

Function Details

workflow/2

workflow(Id::atom(), Config::config()) -> kflow:workflow()

Create a workflow specification


Generated by EDoc