wangyum edited a comment on issue #26848: [WIP][SPARK-30216][INFRA] Use python3 in Docker release image URL: https://github.com/apache/spark/pull/26848#issuecomment-564446802 ``` Generating markdown files for SQL documentation. 19/12/11 08:57:10 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable Traceback (most recent call last): File "/opt/spark-rm/output/spark/sql/gen-sql-markdown.py", line 222, in <module> from pyspark.java_gateway import launch_gateway File "/opt/spark-rm/output/spark/python/lib/pyspark.zip/pyspark/__init__.py", line 51, in <module> File "/opt/spark-rm/output/spark/python/lib/pyspark.zip/pyspark/context.py", line 22, in <module> ImportError: No module named threading log4j:WARN No appenders could be found for logger (org.apache.spark.util.ShutdownHookManager). log4j:WARN Please initialize the log4j system properly. log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info. jekyll 3.8.6 | Error: SQL doc generation failed ``` ``` spark-rm@324cfefd4d06:/opt/spark-rm/output$ python3 Python 3.6.9 (default, Nov 7 2019, 10:44:02) [GCC 8.3.0] on linux Type "help", "copyright", "credits" or "license" for more information. >>> import threading >>> exit() spark-rm@324cfefd4d06:/opt/spark-rm/output$ python Python 2.7.15+ (default, Oct 7 2019, 17:39:04) [GCC 7.4.0] on linux2 Type "help", "copyright", "credits" or "license" for more information. >>> import threading Traceback (most recent call last): File "<stdin>", line 1, in <module> ImportError: No module named threading >>> exit() ``` It seems we need to use python3 to build documentation.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
