kbendick commented on issue #2607: URL: https://github.com/apache/iceberg/issues/2607#issuecomment-844454452
When looking at this, I too was thinking that it would be anything from `hadoop.*`, as Russell mentioned. This way it's in line with the SparkConf. So `iceberg.catalog.other_catalog.hadoop.hive.metastore.connect.retries` -> parsed out per catalog and mapped to `hive.metastore.connect.retries` in Spark. I'm much less familiar with the Hive codebase, but I imagine the same issue would also come up? For reference, the places in the code where this issue comes up that I can see (at least for Spark) are here for the core Catalog code https://github.com/apache/iceberg/blob/90225d6c9413016d611e2ce5eff37db1bc1b4fc5/core/src/main/java/org/apache/iceberg/CatalogUtil.java#L179-L181 as well as here for the SparkCatalog (where we just pull the active sessions hadoop configuration): https://github.com/apache/iceberg/blob/98011e162b1837bf9153cfe14dfd3277c4fd3d1e/spark3/src/main/java/org/apache/iceberg/spark/SparkCatalog.java#L96-L101 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
