Did you try out Kafka Streams API instead of wrapping the consumer? It does support Lambdas already:
https://github.com/confluentinc/examples/blob/3.2.x/kafka-streams/src/main/java/io/confluent/examples/streams/MapFunctionLambdaExample.java#L126 Full docs: http://docs.confluent.io/current/streams/index.html -Matthias On 5/17/17 1:45 PM, Robert Quinlivan wrote: > Hello, > > I've been looking at writing a Java 8 streams API wrapper for the Kafka > consumer. Since this seems like a common use case I was wondering if > someone in the user community had already begun a project like this. > > My goal is to be able to get back a Stream<ConsumerRecord<K, V>> wrapping > the results of #poll() which can then be passed into a map/filter pipeline. > I am using an underlying blocking queue data structure to buffer in memory > and using Stream.generate() to pull records. Any recommendations on a best > approach here? > > Thanks >
signature.asc
Description: OpenPGP digital signature