Limess edited a comment on issue #2688:
URL: https://github.com/apache/hudi/issues/2688#issuecomment-845222296
Turns out I only see this when submitting a job step using EMR in clustered
mode:
```shell
--steps
"[{\"Args\":[\"spark-submit\",\"--deploy-mode\",\"cluster\",\"--jars\",\"/usr/lib/hudi/hudi-spark-bundle.jar,/usr/lib/spark/external/lib/spark-avro.jar\",\"$SPARK_JOB_S3_BUCKET_PATH/recreate_datalake.py\"],\"Type\":\"CUSTOM_JAR\",\"ActionOnFailure\":\"CONTINUE\",\"Jar\":\"command-runner.jar\",\"Properties\":\"\",\"Name\":\"Spark
application\"}]" \
```
If I run things in a spark shell on the master node I have no issues
updating the glue metastore.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
