rangareddy commented on issue #13834: URL: https://github.com/apache/hudi/issues/13834#issuecomment-3253208861
Hi @nguyetlt1012 For structured streaming jobs on Merge-On-Read tables, the system enables async compactions by default[1]. This issue arises when there are pending compaction commits. Could you please share the full Spark application logs for review? Please refer to the [Spark Streaming documentation](https://hudi.apache.org/docs/compaction#spark-structured-streaming) for additional details. **References:** 1. https://hudi.apache.org/docs/compaction#async-execution-within-the-same-process 2. https://github.com/apache/hudi/blob/release-1.0.2/hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/BaseHoodieTableServiceClient.java#L1197 3. https://github.com/apache/hudi/blob/release-1.0.2/hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/BaseHoodieTableServiceClient.java#L346 4. https://hudi.apache.org/docs/compaction#spark-structured-streaming -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
