Re: [I] [SUPPORT] Metadata table not cleaned / compacted, log files growing rapidly [hudi]

2024-04-15 Thread via GitHub
danny0405 commented on issue #8567: URL: https://github.com/apache/hudi/issues/8567#issuecomment-2058029478 > 2a0969c9972ef746d377dbddd278ef13bf3d299d For mor table, it should be fine if it is the upsert semantics. -- This is an automated message from the Apache Git Service. To

Re: [I] [SUPPORT] Metadata table not cleaned / compacted, log files growing rapidly [hudi]

2024-04-15 Thread via GitHub
Qiuzhuang commented on issue #8567: URL: https://github.com/apache/hudi/issues/8567#issuecomment-2057270718 > if you have any pending/inflight in data table timeline, metadata table compaction will stalled until that gets to completion. may be there is some lingering pending operation

Re: [I] [SUPPORT] Metadata table not cleaned / compacted, log files growing rapidly [hudi]

2024-04-02 Thread via GitHub
danny0405 commented on issue #8567: URL: https://github.com/apache/hudi/issues/8567#issuecomment-2033341535 There might be no good solutions for 0..x release, recently we have merged a PR that address this issue on master branch: https://github.com/apache/hudi/pull/10874, it would be

Re: [I] [SUPPORT] Metadata table not cleaned / compacted, log files growing rapidly [hudi]

2024-04-02 Thread via GitHub
Qiuzhuang commented on issue #8567: URL: https://github.com/apache/hudi/issues/8567#issuecomment-2032292630 I also run into this issue with hud 0.14.0. Can we have fsck/repair for those cases? - I finally corrupt this table:) -- This is an automated message from the Apache Git Service.