[
https://issues.apache.org/jira/browse/HUDI-6550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shawn Chang updated HUDI-6550:
------------------------------
Description:
We need to have hiveConf load hadoopConf so properties like "--conf
spark.hadoop.hive.metastore.client.factory.class=com.amazonaws.glue.catalog.metastore.AWSGlueDataCatalogHiveClientFactory"
can be passed via Spark.
This was the case until recently this PR removed the line to add hadoopConf to
hiveConf: [https://github.com/apache/hudi/pull/8050]
was:
We need to have hiveConf load hadoopConf so properties like `
--conf
spark.hadoop.hive.metastore.client.factory.class=com.amazonaws.glue.catalog.metastore.AWSGlueDataCatalogHiveClientFactory`
can be passed via Spark
> Load Hadoop Conf into Hive Conf for Hive Sync
> ---------------------------------------------
>
> Key: HUDI-6550
> URL: https://issues.apache.org/jira/browse/HUDI-6550
> Project: Apache Hudi
> Issue Type: Bug
> Reporter: Shawn Chang
> Priority: Major
>
> We need to have hiveConf load hadoopConf so properties like "--conf
> spark.hadoop.hive.metastore.client.factory.class=com.amazonaws.glue.catalog.metastore.AWSGlueDataCatalogHiveClientFactory"
> can be passed via Spark.
>
> This was the case until recently this PR removed the line to add hadoopConf
> to hiveConf: [https://github.com/apache/hudi/pull/8050]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
