Im also facing same problem.
I have implemented Java based custom receiver, which consumes from
messaging system say JMS.
once received message, I call store(object) ... Im storing spark Row object.
it run for around 8 hrs, and then goes OOM, and OOM is happening in
receiver nodes.
I also tried
Hello all,
I have a strange behaviour I can't understand. I have a streaming job using a
custom java receiver that pull data from a jms queue that I process and then
write to HDFS as parquet and avro files. For some reason my job keeps failing
after 1hr and 30 minutes. When It fails I get an
