jackye1995 commented on issue #3546: URL: https://github.com/apache/iceberg/issues/3546#issuecomment-968504150
You can use any other catalog with S3FileIO standalone, except for HadoopCatalog, since it requires a Hadoop FileSystem initialization. If you have to use HadoopCatalog, then as long as you register the scheme you want to use it can work, no matter `s3://` or `s3a://`, and they can point to the same implementation class. But I actually don't recommend HadoopCatalog especially on S3, because you will have all table information shared under the same storage prefix, and S3 is throttled by prefix. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
