RE: New Consumer APIs , Hight level API , Simple API regarding offset management

2016-05-11 Thread Natarajan, Rajeswari
PM To: users@kafka.apache.org Subject: New Consumer APIs Hi, Would like to if New Consumer API is GAed. Regards, Rajeswari

New Consumer APIs

2016-05-10 Thread Natarajan, Rajeswari
Hi, Would like to if New Consumer API is GAed. Regards, Rajeswari

Re: New consumer APIs

2014-05-17 Thread Jun Rao
; > However, I'd also like to understand your use case better. Are you trying > > to use the consumer for group management (auto rebalancing) and at the > same > > time, control per partition commit()? In general, before proposing any > > changes, I'd like to understand wh

Re: New consumer APIs

2014-05-16 Thread Jay Kreps
the streams for things that consume multiple inputs. Not sure how much of that makes sense... -Jay On Fri, May 9, 2014 at 1:19 PM, Eric Sammer wrote: > All: > > I've been going over the new consumer APIs and it seems like we're > squishing a lot of different concerns toge

Re: New consumer APIs

2014-05-16 Thread Timothy Chen
2014 at 8:42 AM, Timothy Chen wrote: > >> Also going to add that I know a per stream commit is a strong requirement >> for folks I know using Kafka, and seen custom code done just to do so. >> >> Tim >> >> > On May 9, 2014, at 1:19 PM, Eric Sammer wrote: &g

Re: New consumer APIs

2014-05-16 Thread Eric Sammer
commit()? In general, before proposing any > changes, I'd like to understand what you are hoping to achieve with the > consumer APIs. > > Thanks, > Neha > > > On Fri, May 9, 2014 at 1:19 PM, Eric Sammer > wrote: > > > All: > > > > I've been

Re: New consumer APIs

2014-05-16 Thread Jun Rao
een going over the new consumer APIs and it seems like we're > squishing a lot of different concerns together into a single class. The > scope of the new Consumer is kind of all over the place. Managing the > lifecycle - and especially the thread safety - seems challenging. > Specif

Re: New consumer APIs

2014-05-16 Thread Neha Narkhede
; > All: > > > > I've been going over the new consumer APIs and it seems like we're > > squishing a lot of different concerns together into a single class. The > > scope of the new Consumer is kind of all over the place. Managing the > > lifecycle - and especia

Re: New consumer APIs

2014-05-16 Thread Neha Narkhede
osing any changes, I'd like to understand what you are hoping to achieve with the consumer APIs. Thanks, Neha On Fri, May 9, 2014 at 1:19 PM, Eric Sammer wrote: > All: > > I've been going over the new consumer APIs and it seems like we're > squishing a lot of differen

Re: New consumer APIs

2014-05-16 Thread Timothy Chen
Also going to add that I know a per stream commit is a strong requirement for folks I know using Kafka, and seen custom code done just to do so. Tim > On May 9, 2014, at 1:19 PM, Eric Sammer wrote: > > All: > > I've been going over the new consumer APIs and it seems like

New consumer APIs

2014-05-11 Thread Eric Sammer
All: I've been going over the new consumer APIs and it seems like we're squishing a lot of different concerns together into a single class. The scope of the new Consumer is kind of all over the place. Managing the lifecycle - and especially the thread safety - seems challenging. Sp

Re: Review for the new consumer APIs

2014-05-05 Thread Bhavesh Mistry
Hi Neha, How will new Consumer help us with implementing following use case? We have heartbeat as one of topics and all application servers publish metric to this topic. We have to meet near real-time consume SLA (less than 30 seconds). 1) We would like to find out what is latest message per

Re: Review for the new consumer APIs

2014-04-12 Thread Neha Narkhede
Why cant we pass a callback in subscribe itself? Mainly because it will make the processing kind of awkward since you need to access the other consumer APIs while processing the messages. Your suggestion does point out a problem with the poll() API though. Here is the initial proposal of the poll(

Re: Review for the new consumer APIs

2014-04-08 Thread pushkar priyadarshi
Was trying to understand when we have subscribe then why poll is a separate API.Why cant we pass a callback in subscribe itself? On Mon, Apr 7, 2014 at 9:51 PM, Neha Narkhede wrote: > Hi, > > I'm looking for people to review the new consumers APIs. Patch is posted at > https://issues.apache.org/

Review for the new consumer APIs

2014-04-07 Thread Neha Narkhede
Hi, I'm looking for people to review the new consumers APIs. Patch is posted at https://issues.apache.org/jira/browse/KAFKA-1328 Thanks, Neha