misha_cafex v0.0.5 API Reference

Modules

Consumer worker implementation specification

The implementation of Kafka Client-side Assignment Proposal

This depends on ZooKeeper to rebalancing and managing consumer group

Balance partition assignment between Cafex consumers

A simple Cafex.Consumer implementation

This module is the main manager for a high-level kafka consumer

Manage consumers under the supervisor tree

The partitions and their corresponding worker pids

A general, backend-pluggable lock implementation

Distributed Lock implementation with Consul

Partitioner implementation specification for Kafka produce request API

Hashed partitioner implementation

Random partitioner implementation

Kafka producer

Manage producers under the supervisor tree

This module provide encode/decode functions for common structures in Kafka protocol

Kafka protocol request encoder and server response decoder implementation specification

Kafka server response decoder implementation specification

Use atom to represent the numeric error codes

This api saves out the consumer’s position in the stream for one or more partitions

This api reads back a consumer position previously written using the OffsetCommit api

Leader Election implementation with ZooKeeper

Distributed lock based on ZooKeeper

ZooKeeper Utilities

List/Describe kafka consumer groups

Commit consumer group offsets. You should really carful in using this task

Fetch consumer group offsets

Reset consumer group’s offsets. You should really carful in using this task

This is a tool that reads topic metadata from Kafka and outputs it to standard output

Protocols

The Cafex.Protocol.Request protocol used by Cafex.Protocol module