Overviewerlang logo

Module kflow_kafka_retransmit

This workflow consumes messages from one topic and retransmits them to a different one.

Copyright © 2019 Klarna Bank AB (publ)

Description

This workflow consumes messages from one topic and retransmits them to a different one. Partitions are chosen by hashing the Kafka message key

Data Types

config()

config() = #{from_client => atom(), to_client => atom(), from_topic := brod:topic(), to_topic := brod:topic(), n_partitions := integer(), group_id := brod:group_id(), preprocess => kflow:pipe(), part_fun => part_fun(), max_messages => non_neg_integer(), max_size => non_neg_integer(), flush_interval => timeout()}

part_fun()

part_fun() = fun((NumPartitions::non_neg_integer(), term()) -> brod:partition())

Function Index

workflow/2Create a workflow specification.

Function Details

workflow/2

workflow(Id::atom(), Config0::config()) -> kflow:workflow()

Create a workflow specification

Overviewerlang logo

Generated by EDoc