Gatsby-Lee commented on issue #5484: URL: https://github.com/apache/hudi/issues/5484#issuecomment-1137892349
> @xushiyan I tried with sync mode as glue and it also didn't work. "hoodie.datasource.hive_sync.mode" : "glue" > > https://github.com/apache/hudi/blob/master/hudi-sync/hudi-hive-sync/src/main/java/org/apache/hudi/hive/HiveSyncConfig.java > > {"--sync-mode"}, description = "Mode to choose for Hive ops. Valid values are **hms,glue,jdbc and hiveql**) I tried the same config as well. Although GLUE is one of Enum value in "HiveSyncMode.java", It doesn't look fully being supported. If you set "hoodie.datasource.hive_sync.mode" : "glue", you will get exception raised from here. https://github.com/apache/hudi/blob/master/hudi-sync/hudi-hive-sync/src/main/java/org/apache/hudi/hive/HoodieHiveClient.java#L71-L82 So far, based on my investigation, AWS Glue sets/overrides this config. However, somehow, Hudi or sth doesn't use the assigned factory class to create MetaStoreCient ``` spark.hadoop.hive.metastore.client.factory.class=com.amazonaws.glue.catalog.metastore.AWSGlueDataCatalogHiveClientFactory ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
