yihua commented on issue #7533: URL: https://github.com/apache/hudi/issues/7533#issuecomment-1362057544
@szingerpeter Thanks for reporting the issue. On Hudi 0.11.0 release, the metadata table is enabled by default. After you deleted the `s3://<table_path>/.hoodie/metadata`, the next write operation doing upserts should reinitialize the metadata table automatically, with all files in the table, not just the ones from the last upsert operation. To help triage the issue, could you share the write configs for the upsert job, and the active timeline of the metadata table (under `s3://<table_path>/.hoodie/metadata/.hoodie`)? Based on the information, it looks like you're using EMR 6.7.0 release. Could you try EMR 6.8.0 release which has Hudi 0.11.1 release and see if you hit the same problem? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
