Hi, Currently I am trying to optimize my spark application and in that process, I am trying to figure out if at any stage in the code, I am recomputing a large RDD (so that I can optimize it by persisting/checkpointing it).
Is there any indication in the event logs that tells us about an RDD being computed? If anyone has done similar analysis, can you please share how you went about it. Thanks in advance, Souri
