jackye1995 commented on issue #2168: URL: https://github.com/apache/iceberg/issues/2168#issuecomment-769670937
The interface only allows defining a single FileIO for both operations. However, if you read the interface, you will realize that you can check the file path to see if it is metadata file or not, and then choose to write metadata and data differently. It is a very flexible interface. In fact, the `HadoopFileIO` is doing such a thing right now for `HiveCatalog`. If you define a s3 path for your `warehouse`, then all your data files goes to s3, but by default all your metadata files are stored in the HDFS that the Hive metastore operates on. btw, just to be clear, I am not advocating you to use mysql, that's just an example. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
