lrz created HUDI-1749:
-------------------------
Summary: Clean/Compaction/Rollback command maybe never exit when
operation fail
Key: HUDI-1749
URL: https://issues.apache.org/jira/browse/HUDI-1749
Project: Apache Hudi
Issue Type: Bug
Reporter: lrz
There are two issues:
1) After Clean/Compaction/Rollback command finish, yarn application will always
show fail because the command exit directly without waitting for sparkContext
stop.
2)when Clean/Compaction/Rollback command failed because of some exception, the
command will never exit because of sparkContext didn't stop. This is because
sparkUI use jetty, and introduce non-daemon thread, and sparkContext.stop will
stopUI to stop the non-daemon thread.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
