[GitHub] [hudi] bithw1 commented on issue #2299: [SUPPORT]What is the functionality that hudi cleaner provides.

2020-12-07 Thread GitBox
bithw1 commented on issue #2299: URL: https://github.com/apache/hudi/issues/2299#issuecomment-739806481 Thanks @bvaradar . What does `cleaning older file versions` mean? Does this operation also delete data? Task the following operations as an example(15 commits and each

[GitHub] [hudi] bithw1 commented on issue #2299: [SUPPORT]What is the functionality that hudi cleaner provides.

2020-12-07 Thread GitBox
bithw1 commented on issue #2299: URL: https://github.com/apache/hudi/issues/2299#issuecomment-739782716 Thanks @bvaradar. In my case, I would keep all the data since the hoodie table is created. Should I set `hoodie.cleaner.commits.retained` to a large value, eg, Integer.MAX_VALUE,