Github user lonelytrooper commented on the issue:
https://github.com/apache/spark/pull/19274
lonelytrooper... : P will more executors be used in RDD#mapPartitions
way ? I'll try that later to see if it works. I think if Spark provides a
convenient way for this , it would help users a lot and reduce their work ,
that still make sense. LOL
Besides , this feature achieves very good performance promotion in our
production env.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
