Tiered Storage Architecture
Cloud object storage offloading via krabka-remote-storage and krabka-object-store.
Tiered storage decouples high-throughput real-time streaming from historical data retention. Log segments rolled on local NVMe SSDs are sealed and asynchronously offloaded to Amazon S3, Google Cloud Storage, or MinIO.
Remote Log Metadata Manager (RLMM)
Metadata for offloaded segments is stored durably in the internal compacted topic __remote_log_metadata (krabka-remote-storage-topic), ensuring zero external catalog database dependencies.