cmmp6 opened a new issue, #9849: URL: https://github.com/apache/hudi/issues/9849
**Describe the problem you faced** 1. using Flink job to consume kafka data and upsert to Hudi (MOR table, bucket index). 2. flink job checkpoint is blocked and timeout finally. 3. find file compaction in jobmanager when checkpoint hanging. 4. same result when trying online/offline compaction and num_commits/time_elapsed compaction strategy. **To Reproduce** Steps to reproduce the behavior: 1. Create MOR hudi table, using bucket index, upsert write mode, online/offline compaction, num_commits/time_elapsed compaction strategy. 2. Start Flink job to consume kafka source and sink to Hudi table. 3. Find JobManager log when checkpoint is blocked.     **Expected behavior** Compaction should be done in compaction task. **Environment Description** * Hudi version : 0.13.1 * Flink version : 1.15.1 * Hive version : 1.2.1 * Hadoop version : 2.7.3 * Storage (HDFS/S3/GCS..) : S3 * Running on Docker? (yes/no) : no -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
