Did you try out Kafka Streams API instead of wrapping the consumer? It
does support Lambdas already:

https://github.com/confluentinc/examples/blob/3.2.x/kafka-streams/src/main/java/io/confluent/examples/streams/MapFunctionLambdaExample.java#L126

Full docs: http://docs.confluent.io/current/streams/index.html


-Matthias

On 5/17/17 1:45 PM, Robert Quinlivan wrote:
> Hello,
> 
> I've been looking at writing a Java 8 streams API wrapper for the Kafka
> consumer. Since this seems like a common use case I was wondering if
> someone in the user community had already begun a project like this.
> 
> My goal is to be able to get back a Stream<ConsumerRecord<K, V>> wrapping
> the results of #poll() which can then be passed into a map/filter pipeline.
> I am using an underlying blocking queue data structure to buffer in memory
> and using Stream.generate() to pull records. Any recommendations on a best
> approach here?
> 
> Thanks
> 

Attachment: signature.asc
Description: OpenPGP digital signature

Reply via email to