Github user eatoncys commented on the issue:
https://github.com/apache/spark/pull/21084
@jiangxb1987 It does not take significant time to serialize the
taskMemoryManager, because the value is null in driver side, but I think it is
better to keep same to other fields in the Task class, which are only used in
executor side, like '@volatile @transient private var _reasonIfKilled: String =
null'.
In my test, the serialized size reduced from 8392 bytes to 8325 bytes.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
