Kaffe.GroupManager (Kaffe v1.26.0) View Source

This is the main process for bootstrapping the full supervision tree to consume a Kafka topic via a subscriber/worker combo per topic per partition as part of a consumer group.

See Kaffe.GroupMemberSupervisor for distinct components.

The process begins by starting the client connection to Kafka. Then group members are created for each of the configured topics.

Note that this module is is not involved in any message processing, rather it's role is to ensure that all of the relevant services are running.

Link to this section Summary

Functions

Returns a specification to start this module under a supervisor.

List the currently subscribed topics

Start the subscribers and workers to process message sets

Callback implementation for GenServer.init/1.

List of currently subscribed topics.

Dynamically subscribe to topics in addition to the configured topics. Returns the newly subscribed topics. This may not include all values if any are already subscribed to.

Link to this section Functions

Returns a specification to start this module under a supervisor.

See Supervisor.

Link to this function

handle_call(msg, from, state)

View Source

List the currently subscribed topics

Start the subscribers and workers to process message sets

Worker are booted before the subscribers so when the subscribers receive the first messages, we know there will be a worker to do the actual processing work

Callback implementation for GenServer.init/1.

Link to this function

list_subscribed_topics()

View Source

List of currently subscribed topics.

Link to this function

subscribe_to_topics(topics)

View Source

Dynamically subscribe to topics in addition to the configured topics. Returns the newly subscribed topics. This may not include all values if any are already subscribed to.