Which record is processed when topology restart ?

2018-02-05 Thread Saïd Bouras
fka streams (consumers retry to read the last offset of the internal topic when the topology restart). Is the actual behavior not correct or I am missing something here ? Thanks, regards -- *Saïd Bouras*

Re: [DISCUSS] KIP-247: Add public test utils for Kafka Streams

2018-01-17 Thread Saïd Bouras
e discussion early on. > >> > >> An initial WIP PR can be found here: > >> https://github.com/apache/kafka/pull/4402 > >> > >> I also included the user-list (please hit "reply-all" to include both > >> lists in this KIP discussion). > >> > >> Thanks a lot. > >> > >> > >> -Matthias > >> > >> > >> Email had 1 attachment: > >> + signature.asc > >> 1k (application/pgp-signature) > > -- *Saïd Bouras*

Re: [DISCUSS] KIP-247: Add public test utils for Kafka Streams

2018-01-15 Thread Saïd Bouras
this asap. Just wanted to start > the discussion early on. > > An initial WIP PR can be found here: > https://github.com/apache/kafka/pull/4402 > > I also included the user-list (please hit "reply-all" to include both > lists in this KIP discussion). > > Thanks a

Re: Consumer Offsets Being Deleted by Broker

2017-12-10 Thread Saïd Bouras
n with default "offset" related > configurations. > Issue: > Consumer offsets are being deleted and we are not using auto commits at > consumer side. > Is there any configuration we need to add for consumer offset retention ?? > > Please help us. > > > >

Re: Kafka Streams app error while rebalancing

2017-12-06 Thread Saïd Bouras
ms.processor.internals. > > StreamThread.run(StreamThread.java:361) > > > 17/12/04 18:34:58 WARN StreamThread: Could not create task 0_8. Will > > retry. > > > org.apache.kafka.streams.errors.LockException: task [0_8] Failed to > lock > > > the state directory for task 0_8 > > > > > > > > > kafka-consumer-groups --new-consumer --bootstrap-server <...> > --describe > > > --group GeoTest > > > Note: This will only show information about consumers that use the Java > > > consumer API (non-ZooKeeper-based consumers). > > > > > > Warning: Consumer group 'GeoTest' is rebalancing. > > > > > > I keep seeing the above lock exception continuously and app is not > making > > > any progress. Any idea why it is stuck? > > > I read a few suggestions that required me to manually delete state > > > directory. I'd like to avoid that. > > > > > > Thanks, > > > Srikanth > > > > > > > > -- Saïd BOURAS Consultant Big Data Mobile: 0662988731 Zenika Paris 10 rue de Milan 75009 Paris Standard : +33(0)1 45 26 19 15 <+33(0)145261915> - Fax : +33(0)1 72 70 45 10 <+33(0)172704510>

Re: Kafka Performance testing

2017-11-30 Thread Saïd Bouras
i can start > with. > > Could you explain or point me to document it would be great. > Also which performance loading tool would be best to test kafka, I prefer > Jmeter though. > > regards, > -- Saïd BOURAS Consultant Big Data Mobile: 0662988731 Zenika Paris 10 rue de Milan 75009 Paris