Sudarshan Vasudevan created GOBBLIN-684:
-------------------------------------------
Summary: Ensure buffered messages are flushed before close() in
KafkaProducerPusher
Key: GOBBLIN-684
URL: https://issues.apache.org/jira/browse/GOBBLIN-684
Project: Apache Gobblin
Issue Type: Improvement
Components: gobblin-metrics
Affects Versions: 0.15.0
Reporter: Sudarshan Vasudevan
Assignee: Sudarshan Vasudevan
Fix For: 0.15.0
Currently, when KafkaProducerPusher is closed, it invokes
KafkaProducer#close(). However,close() only guarantees delivery of in-flight
messages, not the messages in the producer buffer waiting to be sent out. This
results in data loss.
The fix ensures that we call flush() before close(). As a result, any buffered
messages are immediately pushed out and we block until the messages are acked.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
