Github user countmdm commented on the issue:
https://github.com/apache/spark/pull/21811
Thank you very much for your responses, @squito. I agree with all you said.
@kiszk the heap dump that prompted me to make this change was obtained from
a customer, who probably ran into some unusual situation. So, not being a spark
expert, I am not sure how to reproduce this problem. Of course, normally I am
all for measuring the app's memory before and after the change to make sure it
worked.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
