aokolnychyi commented on issue #422: Consider building a HadoopCatalog URL: https://github.com/apache/incubator-iceberg/issues/422#issuecomment-527381701 @chenjunjiedada it would be great if you could work on this! One of the ideas was to use smth like this: `hdfs://nn:8020/iceberg/warehouse/(DB).db/(TABLE)`. I think the challenge with `renameTable` is that Iceberg keeps absolute paths in the metadata. So, we might need to keep data files somewhere else (controlled by `write.folder-storage.path`). Also, we need to avoid rewriting manifests while renaming a table. I think if we keep only `*.metadata.json` files under those locations, it should work (maybe `write.metadata.path` can help). Alternatively, we can consider using relative paths in the metadata. I haven't thought a lot about what's best. @rdblue what are you thoughts on this?
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
