jackye1995 commented on issue #6758: URL: https://github.com/apache/iceberg/issues/6758#issuecomment-1421233502
If we add this enforcement and still want backwards compatibility, it seems like we will need to do that as a feature flag. And this cannot just be an engine level feature flag, because such enforcement will lead to some tables having hybrid file paths, and some are stored in posix style and some are stored literally. So it seems necessary to: 1. introduce this flag in all the places that stores a file path (catalog, table metadata, manifest list, manifest file), so the reader understands how to parse the file paths differently. 2. add an engine level config to turn this feature on for subsequent writes. 3. add some migration procedure to fix tables with broken file paths. Would you agree with the actions above? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
