Github user viirya commented on the issue:
https://github.com/apache/spark/pull/19229
I don't think re-using shuffle is the reason behind the numbers. If you
looked at the previous comments, you will find that I ran the test before
without `count` after `model.transform`. Namely the dataframe operations
haven't been triggered.--- --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
