sivabalan narayanan created HUDI-5065:
-----------------------------------------

             Summary: HoodieCleaner does not exit after completion
                 Key: HUDI-5065
                 URL: https://issues.apache.org/jira/browse/HUDI-5065
             Project: Apache Hudi
          Issue Type: Bug
          Components: cleaning
            Reporter: sivabalan narayanan


use org.apache.hudi.utilities.hoodieCleaner realize asynchronous cleaning, 
after the completion of the spark-submit don't quit, need CTRL + c to exit

 
/opt/spark-3.2.2-bin-3.0.0-cdh6.2.1/bin/spark-submit \ --class 
org.apache.hudi.utilities.HoodieCleaner \ --jars 
/opt/hudi-utilities-bundle_2.12-0.12.1.jar \ 
/opt/hudi-utilities-bundle_2.12-0.12.1.jar \ --target-base-path 
/db/dwm_http_scan \ --spark-master yarn \ --hoodie-conf 
hoodie.cleaner.policy=KEEP_LATEST_BY_HOURS \ --hoodie-conf 
hoodie.cleaner.hours.retained=1
 
 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to