Hello, have implemented Java based custom receiver, which consumes from messaging system say JMS. once received message, I call store(object) ... Im storing spark Row object.
it run for around 8 hrs, and then goes OOM, and OOM is happening in receiver nodes. I also tried to run multiple receivers, to distribute the load but faces the same issue. something fundamentally we are doing wrong, which tells custom receiver/spark to release the memory. but Im not able to crack that, atleast till now. any help is appreciated !! Regards, Manish
