[
https://issues.apache.org/jira/browse/HUDI-4415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17569838#comment-17569838
]
Rajesh Mahindra commented on HUDI-4415:
---------------------------------------
[~minihippo] are you planning to work on it and raise a PR?
> Support spark writer running on thrift server
> ---------------------------------------------
>
> Key: HUDI-4415
> URL: https://issues.apache.org/jira/browse/HUDI-4415
> Project: Apache Hudi
> Issue Type: New Feature
> Components: spark-sql
> Reporter: XiaoyuGeng
> Priority: Major
>
> Spark thrift server manages a sql by running with the thread local spark
> session. It identifies the jobs belong to the sql by setting the job group
> Id. If user wants to cancel the sql running, thrift server will call
> session.cancelJobGroup. However, the implementation of hudi spark writer uses
> different job group Ids to distinguish the different proccesing part of the
> writing progress, like workprofile, compaction, rollback and so on. There is
> an Incompatibility
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
