[jira] [Commented] (SPARK-45101) Spark UI: A stage is still active even when all of it's tasks are succeeded
[ https://issues.apache.org/jira/browse/SPARK-45101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17852025#comment-17852025 ] RickyMa commented on SPARK-45101: - No. It's just a Spark SQL. > Spark UI: A stage is still active even when all of it's tasks are succeeded > --- > > Key: SPARK-45101 > URL: https://issues.apache.org/jira/browse/SPARK-45101 > Project: Spark > Issue Type: Bug > Components: Spark Core >Affects Versions: 3.4.1, 3.5.0, 4.0.0 >Reporter: RickyMa >Priority: Critical > Attachments: 1.png, 2.png, 3.png > > > In the stage UI, we can see all the tasks' statuses are SUCCESS. > But the stage is still marked as active. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-45101) Spark UI: A stage is still active even when all of it's tasks are succeeded
[ https://issues.apache.org/jira/browse/SPARK-45101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] RickyMa updated SPARK-45101: Priority: Critical (was: Major) > Spark UI: A stage is still active even when all of it's tasks are succeeded > --- > > Key: SPARK-45101 > URL: https://issues.apache.org/jira/browse/SPARK-45101 > Project: Spark > Issue Type: Bug > Components: Spark Core >Affects Versions: 3.4.1, 3.5.0, 4.0.0 >Reporter: RickyMa >Priority: Critical > Attachments: 1.png, 2.png, 3.png > > > In the stage UI, we can see all the tasks' statuses are SUCCESS. > But the stage is still marked as active. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-45101) Spark UI: A stage is still active even when all of it's tasks are succeeded
[ https://issues.apache.org/jira/browse/SPARK-45101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] RickyMa updated SPARK-45101: Affects Version/s: 3.5.0 4.0.0 > Spark UI: A stage is still active even when all of it's tasks are succeeded > --- > > Key: SPARK-45101 > URL: https://issues.apache.org/jira/browse/SPARK-45101 > Project: Spark > Issue Type: Bug > Components: Spark Core >Affects Versions: 3.4.1, 3.5.0, 4.0.0 >Reporter: RickyMa >Priority: Major > Attachments: 1.png, 2.png, 3.png > > > In the stage UI, we can see all the tasks' statuses are SUCCESS. > But the stage is still marked as active. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-25689) Move token renewal logic to driver in yarn-client mode
[ https://issues.apache.org/jira/browse/SPARK-25689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17765477#comment-17765477 ] RickyMa commented on SPARK-25689: - I've added a follow up pull request for this issue: https://github.com/apache/spark/pull/42890 > Move token renewal logic to driver in yarn-client mode > -- > > Key: SPARK-25689 > URL: https://issues.apache.org/jira/browse/SPARK-25689 > Project: Spark > Issue Type: Improvement > Components: Spark Core, YARN >Affects Versions: 2.4.0 >Reporter: Marcelo Masiero Vanzin >Assignee: Marcelo Masiero Vanzin >Priority: Minor > Labels: pull-request-available > Fix For: 3.0.0 > > > Currently, both in yarn-cluster and yarn-client mode, the YARN AM is > responsible for renewing delegation tokens. That differs from other RMs > (Mesos and later k8s when it supports this functionality), and is one of the > roadblocks towards fully sharing the same delegation token-related code. > We should look at keeping the renewal logic within the driver in yarn-client > mode. That would also remove the need to distribute the user's keytab to the > AM when running in that particular mode. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-45101) Spark UI: A stage is still active even when all of it's tasks are succeeded
[ https://issues.apache.org/jira/browse/SPARK-45101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] RickyMa updated SPARK-45101: Summary: Spark UI: A stage is still active even when all of it's tasks are succeeded (was: Spark UI: A stage is still active even all of it's tasks are succeeded) > Spark UI: A stage is still active even when all of it's tasks are succeeded > --- > > Key: SPARK-45101 > URL: https://issues.apache.org/jira/browse/SPARK-45101 > Project: Spark > Issue Type: Bug > Components: Spark Core >Affects Versions: 3.4.1 >Reporter: RickyMa >Priority: Major > Attachments: 1.png, 2.png, 3.png > > > In the stage UI, we can see all the tasks' statuses are SUCCESS. > But the stage is still marked as active. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-45101) Spark UI: A stage is still active even all of it's tasks are succeeded
[ https://issues.apache.org/jira/browse/SPARK-45101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] RickyMa updated SPARK-45101: Description: In the stage UI, we can see all the tasks' statuses are SUCCESS. But the stage is still marked as active. was: Go into the stage UI, we can see all the tasks' statuses are SUCCESS. But the stage is still marked as active. > Spark UI: A stage is still active even all of it's tasks are succeeded > -- > > Key: SPARK-45101 > URL: https://issues.apache.org/jira/browse/SPARK-45101 > Project: Spark > Issue Type: Bug > Components: Spark Core >Affects Versions: 3.4.1 >Reporter: RickyMa >Priority: Major > Attachments: 1.png, 2.png, 3.png > > > In the stage UI, we can see all the tasks' statuses are SUCCESS. > But the stage is still marked as active. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-45101) Spark UI: A stage is still active even all of it's tasks are succeeded
[ https://issues.apache.org/jira/browse/SPARK-45101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] RickyMa updated SPARK-45101: Description: Go into the stage UI, we can see all the tasks' statuses are SUCCESS. But the stage is still marked as active. was: A task is already killed. But it is still marked as succeeded, which causes the stage never stops. Go into the stage UI, we can see all the tasks' statuses are SUCCESS. > Spark UI: A stage is still active even all of it's tasks are succeeded > -- > > Key: SPARK-45101 > URL: https://issues.apache.org/jira/browse/SPARK-45101 > Project: Spark > Issue Type: Bug > Components: Spark Core >Affects Versions: 3.4.1 >Reporter: RickyMa >Priority: Major > Attachments: 1.png, 2.png, 3.png > > > Go into the stage UI, we can see all the tasks' statuses are SUCCESS. > But the stage is still marked as active. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-45101) Spark UI: A stage is still active even all of it's tasks are succeeded
[ https://issues.apache.org/jira/browse/SPARK-45101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] RickyMa updated SPARK-45101: Summary: Spark UI: A stage is still active even all of it's tasks are succeeded (was: Spark UI: A killed task should not be marked as succeeded) > Spark UI: A stage is still active even all of it's tasks are succeeded > -- > > Key: SPARK-45101 > URL: https://issues.apache.org/jira/browse/SPARK-45101 > Project: Spark > Issue Type: Bug > Components: Spark Core >Affects Versions: 3.4.1 >Reporter: RickyMa >Priority: Major > Attachments: 1.png, 2.png, 3.png > > > A task is already killed. But it is still marked as succeeded, which causes > the stage never stops. > Go into the stage UI, we can see all the tasks' statuses are SUCCESS. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-45101) Spark UI: A killed task should not be marked as succeeded
[ https://issues.apache.org/jira/browse/SPARK-45101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] RickyMa updated SPARK-45101: Attachment: 2.png 1.png 3.png > Spark UI: A killed task should not be marked as succeeded > - > > Key: SPARK-45101 > URL: https://issues.apache.org/jira/browse/SPARK-45101 > Project: Spark > Issue Type: Bug > Components: Spark Core >Affects Versions: 3.4.1 >Reporter: RickyMa >Priority: Major > Attachments: 1.png, 2.png, 3.png > > > A task is already killed. But it is still marked as succeeded, which causes > the stage never stops. > Go into the stage UI, we can see all the tasks' statuses are SUCCESS. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-45101) Spark UI: A killed task should not be marked as succeeded
[ https://issues.apache.org/jira/browse/SPARK-45101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] RickyMa updated SPARK-45101: Description: A task is already killed. But it is still marked as succeeded, which causes the stage never stops. Go into the stage UI, we can see all the tasks' statuses are SUCCESS. was: A task is already killed. But it is still marked as succeeded, which causes the stage never stops. Go into the stage UI, we can see all the tasks' statuses are SUCCESS. !image-2023-09-07-21-45-08-667.png! !image-2023-09-07-21-44-39-394.png! !image-2023-09-07-21-59-54-033.png! !image-2023-09-07-21-59-50-002.png! > Spark UI: A killed task should not be marked as succeeded > - > > Key: SPARK-45101 > URL: https://issues.apache.org/jira/browse/SPARK-45101 > Project: Spark > Issue Type: Bug > Components: Spark Core >Affects Versions: 3.4.1 >Reporter: RickyMa >Priority: Major > > A task is already killed. But it is still marked as succeeded, which causes > the stage never stops. > Go into the stage UI, we can see all the tasks' statuses are SUCCESS. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-45101) Spark UI: A killed task should not be marked as succeeded
RickyMa created SPARK-45101: --- Summary: Spark UI: A killed task should not be marked as succeeded Key: SPARK-45101 URL: https://issues.apache.org/jira/browse/SPARK-45101 Project: Spark Issue Type: Bug Components: Spark Core Affects Versions: 3.4.1 Reporter: RickyMa A task is already killed. But it is still marked as succeeded, which causes the stage never stops. Go into the stage UI, we can see all the tasks' statuses are SUCCESS. !image-2023-09-07-21-45-08-667.png! !image-2023-09-07-21-44-39-394.png! !image-2023-09-07-21-59-54-033.png! !image-2023-09-07-21-59-50-002.png! -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
