GitHub user eatoncys opened a pull request:
https://github.com/apache/spark/pull/21084
[SPARK-23998][Core]It may be better to add @transient to field
'taskMemoryManager' in class Task, for it is only be set and used in executor
side
Add @transient to field 'taskMemoryManager' in class Task, for it is only
be set and used in executor side and it will be set before used in class
Executor like this:
task.setTaskMemoryManager(taskMemoryManager)
before task.run
## What changes were proposed in this pull request?
(Please fill in changes proposed in this fix)
## How was this patch tested?
(Please explain how this patch was tested. E.g. unit tests, integration
tests, manual tests)
(If this patch involves UI changes, please attach a screenshot; otherwise,
remove this)
Please review http://spark.apache.org/contributing.html before opening a
pull request.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/eatoncys/spark transient
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/21084.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #21084
----
commit 283e1ac91996e375cb9d1775fef39ea29eb85325
Author: 10129659 <chen.yanshan@...>
Date: 2018-04-17T08:20:38Z
It may be better to add @transient to field 'taskMemoryManager' in class
Task, for it is only be setted and used in executor
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
