Hi, I have two big RDD, and I need to do some math against each pair of them. Traditionally, it is like a nested for-loop. But for RDD, it cause a nested RDD which is prohibited.
Currently, I am collecting one of them, then do a nested for-loop, so to avoid nested RDD. But would like to know if there's spark-way to do this. Thanks, David