chengshiwen commented on issue #4907: URL: https://github.com/apache/incubator-dolphinscheduler/issues/4907#issuecomment-812494261
@MrZhangZetao Please check the following logs, the `__spark_conf__.zip` uploaded error. ``` yarn.SparkRackResolver: Got an error when resolving hostNames. Falling back to /default-rack for all 21/03/01 17:12:33 INFO yarn.Client: Uploading resource file:/tmp/spark-2509cd96-9e16-428d-8a42-94c4beef7779/__spark_conf__6955750791632555999.zip -> file:/home/dolphinscheduler/.sparkStaging/application_1614585492052_0012/spark_conf.zip ``` By the way, Please check if `SparkPi` can run normally (Pay attention to replace `spark-examples_2.11-2.4.7.jar` with the actual jar file): ``` $SPARK_HOME2/bin/spark-submit --master yarn --deploy-mode client --num-executors 1 --executor-cores 1 --executor-memory 1G --class org.apache.spark.examples.SparkPi $SPARK_HOME2/examples/jars/spark-examples_2.11-2.4.7.jar ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
