jackye1995 edited a comment on issue #3546: URL: https://github.com/apache/iceberg/issues/3546#issuecomment-968586593
Hadoop catalog uses the `warehouse/db/table` path pattern to figure out what are the databases and tables in the catalog. This is the internal implementation detail of the Hadoop catalog. This is equivalent to Hive catalog using Hive metastore, or DynamoDB catalog stores a row in a DynamoDB table to store such information. The object storage mode defines how new data files are stored in Iceberg, this is the same feature across all catalogs. By the way, another issue with using Hadoop catalog with S3 is that S3 does not support atomic file write, but Hadoop catalog relies on the atomic write of a table version hint file to ensure transaction. So it is definitely not recommended for production usage. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
