Re: Request to suggest alternative approaches for side input use cases in apache beam

2022-10-26 Thread Alexey Romanenko
Well, it depends on how you do use a Redis cache and how often it’s changing. For example, if you need to request a cache for a group of input records then you can group them into batches and do only one remote call to cache before processing this batch, like explained here [1] In any case,

Re: RabbitMQ Message Print

2022-10-26 Thread Alexey Romanenko
Hi Hitesh, Let me ask you some questions on this: 1) Did you try to run this pipeline with Direct runner locally? 2) Can you make sure that output messages were successfully written in the same queue as you read from after? 3) Can you make sure that your “processElement()” has been called while