Hi Jianhui, It is NOT safe to delete those folders manually. The HDFS folder not only has Cuboid files for further merge, but also may have other files. So please don't delete them unless you know the impact.
You mentioned that running StorageCleanupJob doesn't get cleaned up; Did you check the logs of this? It will print out the detail info about each folder if it couldn't be deleted. If you can provide the log, we can investigate that. 2017-06-21 11:49 GMT+08:00 jianhui.yi <jianhui...@zhiyoubao.com>: > Hi all, > > Since the upgrade to v2.0 I noticed that the HDFS usage had increased every > time we rebuild the cube and the space is not cleared up. > > This is although we run both the StorageCleanupJob and metastore clean > command. > > When looking into HDFS to see where the increase is I see that the > accumulated data is at: /kylin/kylin_metadata/ > > Is it safe to delete these folders manually and how to cleanup with kylin? > > Thanks. > > -- Best regards, Shaofeng Shi 史少锋
