Skip to main content

Module checkpoint_store

Module checkpoint_store 

Source
Expand description

Position recovery: persist the worker’s [SourceOffset] to a compacted internal topic on the TARGET cluster, keyed by flow name.

On restart, InternalTopicCheckpointStore::load reads the last value for the flow’s key out of the compacted topic. It recovers the exact position that the worker had reached before it stopped.

Structs§

InternalTopicCheckpointStore
A [CheckpointStore] backed by a compacted internal Kafka topic on the target cluster.