hudi-bot opened a new issue, #15284: URL: https://github.com/apache/hudi/issues/15284
Spark thrift server manages a sql by running with the thread local spark session. It identifies the jobs belong to the sql by setting the job group Id. If user wants to cancel the sql running, thrift server will call session.cancelJobGroup. However, the implementation of hudi spark writer uses different job group Ids to distinguish the different proccesing part of the writing progress, like workprofile, compaction, rollback and so on. There is an Incompatibility ## JIRA info - Link: https://issues.apache.org/jira/browse/HUDI-4415 - Type: New Feature --- ## Comments 22/Jul/22 06:42;rmahindra;[~minihippo] are you planning to work on it and raise a PR?;;; --- 25/Jul/22 07:25;minihippo;[~rmahindra] If the problem has high priority according to the feedback, i will raise a pr to solve it. By now, i get a simple implementation as a workaround;;; -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
