[jira] [Commented] (SPARK-40021) `Cancel workflow` can not cancel some jobs
[ https://issues.apache.org/jira/browse/SPARK-40021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17578278#comment-17578278 ] Yikun Jiang commented on SPARK-40021: - FYI: [https://github.com/orgs/community/discussions/24932] > `Cancel workflow` can not cancel some jobs > -- > > Key: SPARK-40021 > URL: https://issues.apache.org/jira/browse/SPARK-40021 > Project: Spark > Issue Type: Test > Components: Project Infra, Tests >Affects Versions: 3.4.0 >Reporter: Ruifeng Zheng >Priority: Minor > Attachments: Screen Shot 2022-08-09 at 22.49.13.png, Screen Shot > 2022-08-11 at 10.07.24.png > > > I have been observing this behavior for a long time: > sometime I want to cancel the workflow to release resource for other > workflows, so I click the {{*{color:red}Cancel workflow{color}*}} button, > most jobs in current workflow will be canceled in several minutes, but some > jobs can never be killed, including: > * Run / Build modules: pyspark-sql, pyspark-mllib, pyspark-resource > * Run / Build modules: pyspark-core, pyspark-streaming, pyspark-ml > * Run / Build modules: pyspark-pandas > * Run / Build modules: pyspark-pandas-slow > * Run / Linters, licenses, dependencies and documentation generation -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-40021) `Cancel workflow` can not cancel some jobs
[ https://issues.apache.org/jira/browse/SPARK-40021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17578212#comment-17578212 ] Ruifeng Zheng commented on SPARK-40021: --- Did you try to kill those Python jobs individually? > `Cancel workflow` can not cancel some jobs > -- > > Key: SPARK-40021 > URL: https://issues.apache.org/jira/browse/SPARK-40021 > Project: Spark > Issue Type: Test > Components: Project Infra, Tests >Affects Versions: 3.4.0 >Reporter: Ruifeng Zheng >Priority: Minor > Attachments: Screen Shot 2022-08-09 at 22.49.13.png > > > I have been observing this behavior for a long time: > sometime I want to cancel the workflow to release resource for other > workflows, so I click the {{*{color:red}Cancel workflow{color}*}} button, > most jobs in current workflow will be canceled in several minutes, but some > jobs can never be killed, including: > * Run / Build modules: pyspark-sql, pyspark-mllib, pyspark-resource > * Run / Build modules: pyspark-core, pyspark-streaming, pyspark-ml > * Run / Build modules: pyspark-pandas > * Run / Build modules: pyspark-pandas-slow > * Run / Linters, licenses, dependencies and documentation generation -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-40021) `Cancel workflow` can not cancel some jobs
[ https://issues.apache.org/jira/browse/SPARK-40021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17577683#comment-17577683 ] Hyukjin Kwon commented on SPARK-40021: -- I was thinking that it's more related to GitHub Actions behaviour but didn't have a change to take a deeper look. > `Cancel workflow` can not cancel some jobs > -- > > Key: SPARK-40021 > URL: https://issues.apache.org/jira/browse/SPARK-40021 > Project: Spark > Issue Type: Test > Components: Project Infra, Tests >Affects Versions: 3.4.0 >Reporter: Ruifeng Zheng >Priority: Minor > Attachments: Screen Shot 2022-08-09 at 22.49.13.png > > > I have been observing this behavior for a long time: > sometime I want to cancel the workflow to release resource for other > workflows, so I click the {{*{color:red}Cancel workflow{color}*}} button, > most jobs in current workflow will be canceled in several minutes, but some > jobs can never be killed, including: > * Run / Build modules: pyspark-sql, pyspark-mllib, pyspark-resource > * Run / Build modules: pyspark-core, pyspark-streaming, pyspark-ml > * Run / Build modules: pyspark-pandas > * Run / Build modules: pyspark-pandas-slow > * Run / Linters, licenses, dependencies and documentation generation -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-40021) `Cancel workflow` can not cancel some jobs
[ https://issues.apache.org/jira/browse/SPARK-40021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17577604#comment-17577604 ] Dongjoon Hyun commented on SPARK-40021: --- Thank you for pinging me. I'm also not aware of that symptom. Did you try to kill those Python jobs individually, [~podongfeng]? > `Cancel workflow` can not cancel some jobs > -- > > Key: SPARK-40021 > URL: https://issues.apache.org/jira/browse/SPARK-40021 > Project: Spark > Issue Type: Test > Components: Project Infra, Tests >Affects Versions: 3.4.0 >Reporter: Ruifeng Zheng >Priority: Minor > Attachments: Screen Shot 2022-08-09 at 22.49.13.png > > > I have been observing this behavior for a long time: > sometime I want to cancel the workflow to release resource for other > workflows, so I click the {{*{color:red}Cancel workflow{color}*}} button, > most jobs in current workflow will be canceled in several minutes, but some > jobs can never be killed, including: > * Run / Build modules: pyspark-sql, pyspark-mllib, pyspark-resource > * Run / Build modules: pyspark-core, pyspark-streaming, pyspark-ml > * Run / Build modules: pyspark-pandas > * Run / Build modules: pyspark-pandas-slow > * Run / Linters, licenses, dependencies and documentation generation -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-40021) `Cancel workflow` can not cancel some jobs
[ https://issues.apache.org/jira/browse/SPARK-40021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17577513#comment-17577513 ] Yikun Jiang commented on SPARK-40021: - This might related to container-based job[1], but according the doc it will force to close in 5 mins[2], so I feel more like a bug in github action? [1][https://docs.github.com/en/actions/using-jobs/running-jobs-in-a-container] [2][https://docs.github.com/en/actions/managing-workflow-runs/canceling-a-workflow#steps-github-takes-to-cancel-a-workflow-run] > `Cancel workflow` can not cancel some jobs > -- > > Key: SPARK-40021 > URL: https://issues.apache.org/jira/browse/SPARK-40021 > Project: Spark > Issue Type: Test > Components: Project Infra, Tests >Affects Versions: 3.4.0 >Reporter: Ruifeng Zheng >Priority: Minor > Attachments: Screen Shot 2022-08-09 at 22.49.13.png > > > I have been observing this behavior for a long time: > sometime I want to cancel the workflow to release resource for other > workflows, so I click the {{*{color:red}Cancel workflow{color}*}} button, > most jobs in current workflow will be canceled in several minutes, but some > jobs can never be killed, including: > * Run / Build modules: pyspark-sql, pyspark-mllib, pyspark-resource > * Run / Build modules: pyspark-core, pyspark-streaming, pyspark-ml > * Run / Build modules: pyspark-pandas > * Run / Build modules: pyspark-pandas-slow > * Run / Linters, licenses, dependencies and documentation generation -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-40021) `Cancel workflow` can not cancel some jobs
[ https://issues.apache.org/jira/browse/SPARK-40021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17577466#comment-17577466 ] Ruifeng Zheng commented on SPARK-40021: --- cc [~dongjoon] [~hyukjin.kwon] [~yikunkero] do you have some ideas? > `Cancel workflow` can not cancel some jobs > -- > > Key: SPARK-40021 > URL: https://issues.apache.org/jira/browse/SPARK-40021 > Project: Spark > Issue Type: Test > Components: Project Infra, Tests >Affects Versions: 3.4.0 >Reporter: Ruifeng Zheng >Priority: Minor > > I have been observing this behavior for a long time: > sometime I want to cancel the workflow to release resource for other > workflows, so I click the {{*{color:red}Cancel workflow{color}*}} button, > most jobs in current workflow will be canceled in several minutes, but some > jobs can never be killed, including: > * Run / Build modules: pyspark-sql, pyspark-mllib, pyspark-resource > * Run / Build modules: pyspark-core, pyspark-streaming, pyspark-ml > * Run / Build modules: pyspark-pandas > * Run / Build modules: pyspark-pandas-slow > * Run / Linters, licenses, dependencies and documentation generation -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org