manhhuuha opened a new issue, #13513: URL: https://github.com/apache/hudi/issues/13513
I have an issue when reading CDC from a Hudi MOR (Merge-On-Read) table. Even though I’ve configured the following options: ``` 'hoodie.table.cdc.enabled': 'true', 'hoodie.table.cdc.supplemental.logging.mode': 'DATA_BEFORE_AFTER' ``` When I try to read CDC from that table, I encounter this error: ``` 25/07/02 16:45:59 ERROR Executor: Exception in task 4.0 in stage 0.0 (TID 4) java.io.FileNotFoundException: No such file or directory: s3a://ndc-hudi/test3/partition_id=9/.8d65e8e2-551a-40d9-b95a-09e898dd84b4-0_20250702035214716.log.1_0-1035-8955.cdc ``` The issue is that Hudi has cleaned up all the CDC files that were too old. Is there any Hudi configuration that allows me to continue compacting the MOR table periodically while still preserving all CDC files, so I can view changes at any point in time? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
