[jira] [Commented] (SPARK-44581) ShutdownHookManager get wrong hadoop user group information

[ https://issues.apache.org/jira/browse/SPARK-44581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17750229#comment-17750229 ] liang yu commented on SPARK-44581: -- I found that the ShutDownHook Manager will start a new Thread when

[jira] [Updated] (SPARK-44581) ShutdownHookManager get wrong hadoop user group information

[ https://issues.apache.org/jira/browse/SPARK-44581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liang yu updated SPARK-44581: - Priority: Major (was: Minor) > ShutdownHookManager get wrong hadoop user group information >

[jira] [Updated] (SPARK-44581) ShutdownHookManager get wrong hadoop user group information

[ https://issues.apache.org/jira/browse/SPARK-44581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liang yu updated SPARK-44581: - Description:  I use spark 3.2.1 to run a job on yarn in cluster mode.  when the job is finished, there

[jira] [Created] (SPARK-44581) ShutdownHookManager get wrong hadoop user group information

liang yu created SPARK-44581: Summary: ShutdownHookManager get wrong hadoop user group information Key: SPARK-44581 URL: https://issues.apache.org/jira/browse/SPARK-44581 Project: Spark Issue

[jira] [Commented] (SPARK-42972) ExecutorAllocationManager cannot allocate new instances when all executors down.

[ https://issues.apache.org/jira/browse/SPARK-42972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744092#comment-17744092 ] liang yu commented on SPARK-42972: -- [~tdas]  I created a PR

[jira] [Commented] (SPARK-42972) ExecutorAllocationManager cannot allocate new instances when all executors down.

[ https://issues.apache.org/jira/browse/SPARK-42972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17707177#comment-17707177 ] liang yu commented on SPARK-42972: -- I created a PR

[jira] [Comment Edited] (SPARK-42972) ExecutorAllocationManager cannot allocate new instances when all executors down.

[ https://issues.apache.org/jira/browse/SPARK-42972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17707143#comment-17707143 ] liang yu edited comment on SPARK-42972 at 3/31/23 7:16 AM: --- Using structured

[jira] [Comment Edited] (SPARK-42972) ExecutorAllocationManager cannot allocate new instances when all executors down.

[ https://issues.apache.org/jira/browse/SPARK-42972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17707143#comment-17707143 ] liang yu edited comment on SPARK-42972 at 3/31/23 7:13 AM: --- Using structured

[jira] [Commented] (SPARK-42972) ExecutorAllocationManager cannot allocate new instances when all executors down.

[ https://issues.apache.org/jira/browse/SPARK-42972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17707143#comment-17707143 ] liang yu commented on SPARK-42972: -- When the ratio is lower than the scalingDownRatio, the client will