[
https://issues.apache.org/jira/browse/KAFKA-15301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mital Awachat updated KAFKA-15301:
----------------------------------
Summary: [Tiered Storage] Historically compacted topics send request to
remote for active segment during consume (was: [Tiered Storage] Historically
compacted topics send request to remote for acive segment)
> [Tiered Storage] Historically compacted topics send request to remote for
> active segment during consume
> -------------------------------------------------------------------------------------------------------
>
> Key: KAFKA-15301
> URL: https://issues.apache.org/jira/browse/KAFKA-15301
> Project: Kafka
> Issue Type: Bug
> Components: core
> Affects Versions: 3.6.0
> Reporter: Mital Awachat
> Priority: Minor
>
> In AWS MSK (Kafka 2.8) tiered storage a case surfaced where tiered storage
> plugin received requests for active segments. The topics for which it
> happened were historically compacted topics for which compaction was disabled
> and tiering was enabled.
> Create topic with compact cleanup policy -> Produce data with few repeat keys
> and create multiple segments -> let compaction happen -> change cleanup
> policy to delete -> produce some more data for segment rollover -> enable
> tiering on topic -> wait for segments to be uploaded to s3 and cleanup from
> local (active segment would remain), consume from beginning -> Observe logs.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
