[ https://issues.apache.org/jira/browse/IMPALA-10626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zoltán Borók-Nagy updated IMPALA-10626: --------------------------------------- Description: Some engines (e.g. Spark and Hive) use different table properties for defining catalog properties. In the main hive configuration they store the following properties: * {{iceberg.catalog.<catalog_name>.type = hadoop}} * {{iceberg.catalog.<catalog_name>.warehouse = somelocation}} On the table level they have the following properties: * {{iceberg.catalog = <catalog_name>}} * {{name = <database.table_name>}} To load tables that use these kind of configurations we should use Iceberg's Catalogs class: [https://github.com/apache/iceberg/blob/master/mr/src/main/java/org/apache/iceberg/mr/Catalogs.java] Probably we'll also want to use these properties by default in the future. was: Some engines (e.g. Spark and Hive) use different table properties for defining catalog properties. In the main hive configuration they store the following properties: * {{iceberg.catalog.<catalog_name>.type = hadoop}} * {{iceberg.catalog.<catalog_name>.warehouse = somelocation}} On the table level they have the following properties: * {{iceberg.mr.table.catalog = <catalog_name>}} * {{iceberg.mr.table.identifier = <database.table_name>}} To load tables that use these kind of configurations we should use Iceberg's Catalogs class: [https://github.com/apache/iceberg/blob/master/mr/src/main/java/org/apache/iceberg/mr/Catalogs.java] Probably we'll also want to use these properties by default in the future. > Add support for Iceberg's Catalogs API > -------------------------------------- > > Key: IMPALA-10626 > URL: https://issues.apache.org/jira/browse/IMPALA-10626 > Project: IMPALA > Issue Type: Bug > Components: Frontend > Reporter: Zoltán Borók-Nagy > Assignee: Zoltán Borók-Nagy > Priority: Major > Labels: impala-iceberg > > Some engines (e.g. Spark and Hive) use different table properties for > defining catalog properties. > In the main hive configuration they store the following properties: > * {{iceberg.catalog.<catalog_name>.type = hadoop}} > * {{iceberg.catalog.<catalog_name>.warehouse = somelocation}} > On the table level they have the following properties: > * {{iceberg.catalog = <catalog_name>}} > * {{name = <database.table_name>}} > To load tables that use these kind of configurations we should use Iceberg's > Catalogs class: > [https://github.com/apache/iceberg/blob/master/mr/src/main/java/org/apache/iceberg/mr/Catalogs.java] > Probably we'll also want to use these properties by default in the future. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org For additional commands, e-mail: issues-all-h...@impala.apache.org