bvaradar commented on issue #2273: URL: https://github.com/apache/hudi/issues/2273#issuecomment-732374613
Can you try this format (Example below) spark-submit --deploy-mode cluster --master yarn --driver-memory 4G --executor-memory 8G --num-executors 32 --executor-cores 2 --conf spark.yarn.driver.memoryOverhead=1024 --conf spark.yarn.executor.memoryOverhead=3072 --conf spark.driver.maxResultSize=2G --conf spark.serializer=org.apache.spark.serializer.KryoSerializer --class org.apache.hudi.utilities.HoodieCompactor /path/to/hudi-utilities-bundle_2.11-0.6.0.jar \ --base-path $BASE_PATH \ --table-name $TABLE_NAME \ --instant-time 20201120102911 \ --schema-file $SCHEMA_FILE ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
