cocdkl commented on issue #406:
URL: https://github.com/apache/incubator-livy/issues/406#issuecomment-1552807723
这是通过spark 3.2.4 提交任务报的错：
23/05/18 17:43:00 INFO SparkEntries: Created Spark session.
23/05/18 17:43:00 INFO BlockManagerMasterEndpoint: Registering block manager
localhost:33381 with 912.3 MiB RAM, BlockManagerId(2, localhost, 33381, None)
23/05/18 17:43:25 ERROR PythonInterpreter: Process has died with 1
23/05/18 17:43:25 ERROR PythonInterpreter: Traceback (most recent call last):
File "/tmp/8001765088071541442", line 722, in <module>
sys.exit(main())
File "/tmp/8001765088071541442", line 570, in main
exec('from pyspark.sql import HiveContext', global_dict)
File "<string>", line 1, in <module>
File
"/home/cocdkl/soft/spark-3.2.4-bin-hadoop2.7/python/lib/pyspark.zip/pyspark/__init__.py",
line 53, in <module>
File
"/home/cocdkl/soft/spark-3.2.4-bin-hadoop2.7/python/lib/pyspark.zip/pyspark/rdd.py",
line 34, in <module>
File
"/home/cocdkl/soft/spark-3.2.4-bin-hadoop2.7/python/lib/pyspark.zip/pyspark/java_gateway.py",
line 31, in <module>
File
"/home/cocdkl/soft/spark-3.2.4-bin-hadoop2.7/python/lib/pyspark.zip/pyspark/find_spark_home.py",
line 68
print("Could not find valid SPARK_HOME while searching
{0}".format(paths), file=sys.stderr)
^
SyntaxError: invalid syntax
奇怪的是在yarn ，spark的集群是启动的，但是一提交具体代码作业，就会报错。
希望得到解决，谢谢
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
