lrz created HUDI-1749: ------------------------- Summary: Clean/Compaction/Rollback command maybe never exit when operation fail Key: HUDI-1749 URL: https://issues.apache.org/jira/browse/HUDI-1749 Project: Apache Hudi Issue Type: Bug Reporter: lrz
There are two issues: 1) After Clean/Compaction/Rollback command finish, yarn application will always show fail because the command exit directly without waitting for sparkContext stop. 2)when Clean/Compaction/Rollback command failed because of some exception, the command will never exit because of sparkContext didn't stop. This is because sparkUI use jetty, and introduce non-daemon thread, and sparkContext.stop will stopUI to stop the non-daemon thread. -- This message was sent by Atlassian Jira (v8.3.4#803005)