[jira] [Commented] (SPARK-33447) Stage level scheduling, allow specifying other spark configs via ResourceProfile

2023-11-17 Thread Jeroen Dries (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17787455#comment-17787455 ] Jeroen Dries commented on SPARK-33447: -- Another use case: we would like to modify speculation

[jira] [Created] (SPARK-39717) Spark on YARN + preemption: "Not removing executor 304 because the ResourceProfile was UNKNOWN"

2022-07-08 Thread Jeroen Dries (Jira)
Jeroen Dries created SPARK-39717: Summary: Spark on YARN + preemption: "Not removing executor 304 because the ResourceProfile was UNKNOWN" Key: SPARK-39717 URL: https://issues.apache.org/jira/browse/SPARK-39717

[jira] [Commented] (SPARK-29965) Race in executor shutdown handling can lead to executor never fully unregistering

2020-07-15 Thread Jeroen Dries (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157936#comment-17157936 ] Jeroen Dries commented on SPARK-29965: -- We seem to see the same (or similar?) issue on Spark 2.4.4.