michael1991 commented on issue #10906: URL: https://github.com/apache/hudi/issues/10906#issuecomment-2014457103
> yeah, can you check the metadata file state under `.hoodie` dir? Oh, I found some empty files there. <img width="768" alt="image" src="https://github.com/apache/hudi/assets/6918592/ba956bf2-3337-48b5-a6ed-db0c9bcbc641"> And if I enable metadata in reader side, warning thrown as below: ``` 24/03/22 06:30:09 WARN AbstractHoodieLogRecordReader: TargetInstantTime 20240322043545698 invalid or extra rollback command block in gs://bucket/tables_prod/ods/hudi_log_events/.hoodie/metadata/files/.files-0000-0_20240322033640958001.log.5_1-0-1 24/03/22 06:30:10 WARN BaseTableMetadata: Metadata record for log_date=2024-03-20 encountered some files to be deleted which was not added before. Ignoring the spurious deletes as the `_hoodie.metadata.ignore.spurious.deletes` config is set to true java.io.FileNotFoundException: File not found: gs://bucket/tables_prod/ods/hudi_log_events/log_date=2024-03-20/62c503f0-0fca-463a-8643-c1fa688412e5-0_0-8-211_20240320203557276.parquet ``` How to avoid this error? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
