GitHub user foxish opened a pull request:
https://github.com/apache/spark/pull/20032
[SPARK-22845] [Scheduler] Modify spark.kubernetes.allocation.batch.delay to
take time instead of int
## What changes were proposed in this pull request?
Fixing configuration that was taking an int which should take time.
Discussion in https://github.com/apache/spark/pull/19946#discussion_r156682354
Made the granularity milliseconds as opposed to seconds since there's a
use-case for sub-second reactions to scale-up rapidly especially with dynamic
allocation.
## How was this patch tested?
TODO: manual run of integration tests against this PR.
PTAL
cc/ @mccheah @liyinan926 @kimoonkim @vanzin @mridulm @jiangxb1987 @ueshin
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/apache-spark-on-k8s/spark fix-time-conf
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/20032.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #20032
----
commit 48a3326faaea69bf74d97d028bffdd0552777ffe
Author: foxish <ramanathana@...>
Date: 2017-12-20T12:03:07Z
Change config to support millisecond based timeconf
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
