Event Sourcing question

2019-05-08 Thread Pavel Molchanov
, died, crashed, etc.). Upon startup, Tranformer process needs to check 'events' topic for documents that were received but not transformed. Should it read all events from the 'events' topic? Should it join 'received' and 'transformed' events somehow to understand what was received but not transformed? I don't have a clear idea of how it should behave. Please help. *Pavel Molchanov*

Re: Event Sourcing question

2019-05-08 Thread Pavel Molchanov
send events on the same bus it will be easier to replay the event sequence later. Say, I will have 4 other steps later on in the pipeline. Should I create 4 more topics? Or should all other step transformers listen to the same bus and pick up events they need? *Pavel Molchanov* Director of Sof

Doing something wrong

2019-05-08 Thread Pavel Molchanov
08e2fdf422a-StreamThread-1] State transition from PARTITIONS_ASSIGNED to RUNNING 2019-05-08 19:19:36.853 INFO 18380 --- [-StreamThread-1] org.apache.kafka.streams.KafkaStreams: stream-client [test-a2d0314e-c872-469e-b34c-c08e2fdf422a] State transition from REBALANCING to RUNNING It's staying in the RUNNING state and doesn't move forward. What I am doing wrong? *Pavel Molchanov*

Re: Kafka delaying message

2019-05-22 Thread Pavel Molchanov
Andrien, Thank you for asking this question! I have the same problem and wanted to ask the same question. I hope that someone will answer soon. *Pavel Molchanov* On Wed, May 22, 2019 at 9:54 AM Adrien Ruffie wrote: > Hello all, > > I have a specific need and I don't kno

Re: Kafka delaying message

2019-05-22 Thread Pavel Molchanov
This solution will block receiving polling thread for 15 minutes. Not good. What should we do if a topic has messages that should be processed immediately and delayed messages at the same time? *Pavel Molchanov* On Wed, May 22, 2019 at 2:41 PM Peter Bukowinski wrote: > There is no out

Re: All topic are assigned to same consumer in a consumer group

2019-06-13 Thread Pavel Molchanov
example, 2 partitions will allow 2 consumers to work in parallel, others will be standby. *Pavel Molchanov* Director of Software Development InfoDesk www.infodesk.com 1 Bridge Street | Suite 105 | Irvington | New York | 10551 <https://maps.google.com/?q=660+White+Plains+Road+%7C+Suite+300+