Github user ConeyLiu commented on the issue:
https://github.com/apache/spark/pull/19135
Here
https://github.com/apache/spark/pull/19135/files?diff=unified#diff-870cd3693df7a5add2ac3119d7d91d34L373,
we call `reserveAdditionalMemoryIfNecessary()` for every record write.--- --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
