Github user mridulm commented on the issue:
https://github.com/apache/spark/pull/19184
Thanks to @jerryshao for pointing me to SPARK-21595.
The tests which @rajeshbalamohan did were with a version which did not
include the changes in SPARK-21595; and unfortunately my local repo was not
updated to reflect this too.
Given the changes in #18843 this PR is no longer relevant.
Can you close this @rajeshbalamohan ? Thanks.
In your tests, you can set the threshold to 512M - since that is the value
going forward in spark 2.3
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
