GitHub user ifilonenko opened a pull request:
https://github.com/apache/spark/pull/22298
[SPARK-25021][K8S] Add spark.executor.pyspark.memory limit for K8S
## What changes were proposed in this pull request?
Add spark.executor.pyspark.memory limit for K8S
## How was this patch tested?
Unit and Integration tests
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/ifilonenko/spark SPARK-25021
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/22298.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #22298
----
commit b54a039da08aec93a6db9d1470d0b2eaaec08814
Author: Ilan Filonenko <if56@...>
Date: 2018-08-30T00:19:40Z
initial WIP push for SPARK-25021
commit 75742a37687a7eb3ebaa34069ac7a62521a4e2f8
Author: Ilan Filonenko <if56@...>
Date: 2018-08-30T05:26:27Z
add python.worker.reuse
commit 46c30cc27cd3a7279a116ec6a70a937b8502cd73
Author: Ilan Filonenko <if56@...>
Date: 2018-08-31T04:32:22Z
final checks with e2e tests
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
