[
https://issues.apache.org/jira/browse/SPARK-4341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14207793#comment-14207793
]
Sean Owen commented on SPARK-4341:
--
The problem is that the number of executors is then
[
https://issues.apache.org/jira/browse/SPARK-4341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14207816#comment-14207816
]
Hong Shen commented on SPARK-4341:
--
After the first action computed, we can set set
[
https://issues.apache.org/jira/browse/SPARK-4341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14207885#comment-14207885
]
Sean Owen commented on SPARK-4341:
--
So I think some of this is already done by Spark. For
[
https://issues.apache.org/jira/browse/SPARK-4341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14207899#comment-14207899
]
Hong Shen commented on SPARK-4341:
--
My main point is when running spark (especially spark
[
https://issues.apache.org/jira/browse/SPARK-4341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14209393#comment-14209393
]
Hong Shen commented on SPARK-4341:
--
Hi, Sean Owen. Even spark can increasing/decreasing
[
https://issues.apache.org/jira/browse/SPARK-4341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14206216#comment-14206216
]
Sean Owen commented on SPARK-4341:
--
I don't agree with this. How would Spark know a
[
https://issues.apache.org/jira/browse/SPARK-4341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14206263#comment-14206263
]
Hong Shen commented on SPARK-4341:
--
There must be some relation between inputSplits,
[
https://issues.apache.org/jira/browse/SPARK-4341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14206288#comment-14206288
]
Sean Owen commented on SPARK-4341:
--
Yes, but, the executors live as long as the app does.
[
https://issues.apache.org/jira/browse/SPARK-4341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14207770#comment-14207770
]
Hong Shen commented on SPARK-4341:
--
1. Add a configuration spark.executor.auto.set to
