Re: Hudi on EMR syncing GLUE catalog issue

2020-02-18 Thread Mehrotra, Udit
Hi Igor, As of current implementation, Hudi submits queries like creating table, syncing partitions etc directly to the hive server instead of directly communicating with the metastore. Thus while launching the EMR cluster, you should install Hive on the cluster as well. Also enable glue

Hudi on EMR syncing GLUE catalog issue

2020-02-18 Thread Igor Basko
Hi Dear List, I'm trying to catalog Hudi files in GLUE catalog using the sync hive tool, while using the spark save function (and not the standalone version). I've created an EMR with Spark application only (without Hive). Also added the following hive metastore client factory class