nsivabalan edited a comment on issue #3739:
URL: https://github.com/apache/hudi/issues/3739#issuecomment-936729727
let me illustrate w/ an example.
archival works with timeline, where as cleaner deals with data files. this
difference is important to understand the interplays here.
nsivabalan edited a comment on issue #3739:
URL: https://github.com/apache/hudi/issues/3739#issuecomment-932199950
awesome, good to know. So here is the thing.
Hudi has something called active timeline and archived timeline. Archival
will kick in for every commit and move some older
nsivabalan edited a comment on issue #3739:
URL: https://github.com/apache/hudi/issues/3739#issuecomment-931533803
sorry, I see that you do have 5 compactions. Let me dig in more.
Can you enable info logs and share it here. I don't even see cleaning
getting triggered. else we would
nsivabalan edited a comment on issue #3739:
URL: https://github.com/apache/hudi/issues/3739#issuecomment-931533803
sorry, I see that you do have 5 compactions. Let me dig in more.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
nsivabalan edited a comment on issue #3739:
URL: https://github.com/apache/hudi/issues/3739#issuecomment-931525996
thanks. Here is what is possibly happening. If you can tigger more updates,
eventually you will see cleaning kicking in.
In short, this has something to do w/ MOR table.
nsivabalan edited a comment on issue #3739:
URL: https://github.com/apache/hudi/issues/3739#issuecomment-931525996
thanks. Here is what is possibly happening. If you can tigger more updates,
eventually you will see cleaning kicking in.
In short, this has something to do w/ MOR table.
