pavibhai commented on issue #1617: URL: https://github.com/apache/iceberg/issues/1617#issuecomment-730523094
@jackye1995 and @rdblue Thanks for your feedback. Our current thought process is as follows: 1. Only the Table Path be an absolute path, with all other paths in the metadata files being relative paths 2. The relative path should not be visible outside of the metadata component i.e. the relative path should be translated to an absolute path using the table path for other areas of Iceberg to consume, so only the metadata files shall store the relative path. 3. The relative path references shall be confined to be within the table path i.e `../` shall not be allowed. I don't think the scenario called out about a wrong HDFS location being cleaned will be worsened or improved as a result of this change. If the absolute path of the table is incorrectly interpreted to be something else then problems shall still happen. We will explore the option of FileIO in parallel while we discuss further the complications of using relative paths. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
