Skip to main content

Module checkpoint

Module checkpoint 

Source
Expand description

Periodic checkpoint task: translates and emits consumer-group offset checkpoints.

Reads committed consumer-group offsets from the SOURCE cluster, translates them to TARGET offsets with an OffsetSyncStore, and writes MM2-compatible Checkpoint records to <source>.checkpoints.internal on the TARGET cluster.

Structs§

CheckpointParams
Parameters required to run the checkpoint task.
CheckpointTask
Background task that incrementally updates an OffsetSyncStore from the target cluster’s offset-syncs topic and then calls run_once.

Functions§

run_once
One translation pass: reads source group offsets, translates them with store, and writes Checkpoint records to the target checkpoints topic.
run_once_with_policy
Run one checkpoint pass with the deployment’s client resource policy.