Chia-Ping Tsai created KAFKA-21562:
--------------------------------------
Summary: Use kafka-delete-records.sh to rewrite move_start_offset
Key: KAFKA-21562
URL: https://issues.apache.org/jira/browse/KAFKA-21562
Project: Kafka
Issue Type: Improvement
Reporter: Chia-Ping Tsai
Assignee: Chia-Ping Tsai
{code:java}
def move_start_offset(self):
"""We move the start offset of the topic by writing really old messages
and waiting for them to be cleaned up.
"""
producer = VerifiableProducer(self.test_context, 1, self.kafka,
self.topic,
throughput=-1, enable_idempotence=True,
create_time=1000)
producer.start()
wait_until(lambda: producer.num_acked > 0,
timeout_sec=30,
err_msg="Failed to get an acknowledgement for %ds" % 30)
# Wait 8 seconds to let the topic be seeded with messages that will
# be deleted. The 8 seconds is important, since we should get 2 deleted
# segments in this period based on the configured log roll time and the
# retention check interval.
time.sleep(8)
producer.stop()
self.logger.info("Seeded topic with %d messages which will be deleted"
%\
producer.num_acked)
# Since the configured check interval is 5 seconds, we wait another
# 12 seconds to ensure that at least one more cleaning so that the last
# segment is deleted. An alternate to using timeouts is to poll each
# partition until the log start offset matches the end offset. The
# latter is more robust.
time.sleep(12)
{code}
It produces “old records” and then prays for retention. Maybe we could use
kafka-delete-records.sh to handle that. It means we can remove the waiting from
the test.
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)