> > I think to use *toLocalIterator* method and something like that, but I > have doubts about memory and parallelism and sure there is a better way to > do it. >
It will still run all earlier parts of the job in parallel. Only the actual retrieving of the final partitions will be serial. This is how we do pagination in the Spark SQL JDBC server.
