[
https://issues.apache.org/jira/browse/KAFKA-6217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ashok Bala updated KAFKA-6217:
------------------------------
Description:
we have a use case(real time customer facing application) to support high
throughput(reduced latency) & high volume of transactions through Kafka. During
performance testing, we noted that consumer listening to single replicated
partition topics get messages faster than the consumers listening to replicated
partitions.
Make messages to be visible immediately to consumer rather than waiting for
high water mark. Make change in consumer & core, based on consumer
configuration, LEO messages to be visible to consumer like followers. It is the
risk of consumer to lose messages during fail over of leader for which we are
OK.
was:
we have a use case(real time customer facing application) to support high
throughput(reduced latency) & high volume of transactions through Kafka. During
performance testing, we noted that consumer listening to single partition
topics get messages faster than the consumers listening to replicated
partitions.
Make messages to be visible immediately to consumer rather than waiting for
high water mark. Make change in consumer & core, based on consumer
configuration, LEO messages to be visible to consumer like followers. It is the
risk of consumer to lose messages during fail over of leader for which we are
OK.
> Allow consumers to read messages from LEO
> -----------------------------------------
>
> Key: KAFKA-6217
> URL: https://issues.apache.org/jira/browse/KAFKA-6217
> Project: Kafka
> Issue Type: Improvement
> Components: consumer, core
> Reporter: Ashok Bala
> Priority: Major
>
> we have a use case(real time customer facing application) to support high
> throughput(reduced latency) & high volume of transactions through Kafka.
> During performance testing, we noted that consumer listening to single
> replicated partition topics get messages faster than the consumers listening
> to replicated partitions.
> Make messages to be visible immediately to consumer rather than waiting for
> high water mark. Make change in consumer & core, based on consumer
> configuration, LEO messages to be visible to consumer like followers. It is
> the risk of consumer to lose messages during fail over of leader for which we
> are OK.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
