Kaffe.GroupMemberSupervisor (Kaffe v1.25.0) View Source

The top-level supervisor for consumer group members.

Consuming messages from a Kafka topic as part of a consumer group is broken out into the following distinct components:

  • GroupMember
  • Subscriber
  • Worker
  • WorkerManager
  • WorkerSupervisor

The GroupMember implements the :brod_group_member behaviour and is responsible for receiving assignments from Kafka and managing how subscribers and workers are configured and allocated. All message processing is then delegated to the created Subscribers and Workers.

Subscribers subscribe to Kafka topics and are responsble for receiving lists of messages, passing messages to workers for processing, and committing offsets after processing.

Workers wrap application message handlers and notify subscribers about whether or not commit offsets back to Kafka.

Link to this section Summary

Link to this section Functions

Returns a specification to start this module under a supervisor.

See Supervisor.

Callback implementation for Supervisor.init/1.

Link to this function

start_group_member(supervisor_pid, subscriber_name, consumer_group, worker_manager_pid, topic)

View Source
Link to this function

start_worker_supervisor(supervisor_pid, subscriber_name)

View Source