[
https://issues.apache.org/jira/browse/LIVY-786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17190055#comment-17190055
]
Naman Mishra commented on LIVY-786:
-----------------------------------
This happens because cancel API doesn't cancel anything running on the Spark
driver. Only jobs running on executors are terminated. I will soon raise a PR
to fix this.
> Cancelling statement does not work
> ----------------------------------
>
> Key: LIVY-786
> URL: https://issues.apache.org/jira/browse/LIVY-786
> Project: Livy
> Issue Type: Bug
> Components: Core
> Affects Versions: 0.6.0
> Environment: emr-5.29.0
> Reporter: Quentin Lemaire
> Priority: Blocker
>
> Hi!
> I am running into troubles when trying to cancel a statement during an
> interactive session.
> The code I am running is:
> {code:java}
> Thread.sleep(600000)
> val r = 1 + 1
> {code}
> When I cancel the statement, I see the status of the statement changing to
> "Cancelling" in the Livy UI. After 30s (I left the default timeout), it
> changes to "Cancelled" and I see "Failed to cancel statement 1" in the logs.
> The session is still "Busy" and it finishes to run the code. Therefore, the
> cancellation didn't work and I can even see the result "r: Int = 2" after the
> sleep.
> Do you have any idea why it doesn't manage to cancel the statement (the code
> I am running is pretty basic). I didn't manage to find other information/logs
> on why the cancellation did not work correctly.
> The only solution I found to cancel such a statement is to kill the session.
> Thanks!
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
