[
https://issues.apache.org/jira/browse/HUDI-6989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ethan Guo updated HUDI-6989:
----------------------------
Component/s: spark
> Stop handling more data if task is aborted & clean partial files if possible
> in task side
> -----------------------------------------------------------------------------------------
>
> Key: HUDI-6989
> URL: https://issues.apache.org/jira/browse/HUDI-6989
> Project: Apache Hudi
> Issue Type: Improvement
> Components: spark
> Reporter: Hui An
> Assignee: Hui An
> Priority: Major
> Labels: pull-request-available
>
> Spark would set interrupt status in TaskContext if the task is aborted, HUDI
> needs to respect that to stop immediately. Also, we can clean partial files
> at task side to ensure these files won't be left.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
