conduktor.io ↗

KIP-107 — Add deleteRecordsBefore() API in AdminClient

Accepted Kafka 1.0 Admin

Adds a deleteRecords(Map<TopicPartition, RecordsToDelete>) API to AdminClient that issues DeleteRecordsRequest to leaders, truncating partition logs before a given offset. Kafka only offered time-based and size-based log retention, which are consumer-agnostic and unsuitable for stream-processing pipelines that need to reclaim disk space immediately after downstream consumption.

Protocol Impact

Produce · Fetch · DeleteRecords

Details

AuthorDong Lin
StatusAccepted
Kafka Version1.0
JIRAKAFKA-4586
WikiView on Apache Wiki
Created2017-01-03
Last Modified2018-03-26
Explore how this KIP affects the Kafka protocol in the Protocol Explorer, or see the full KIP database.