Github user kiszk commented on the issue: https://github.com/apache/spark/pull/22501 Thanks, when it was successful, this is a part of log from [this](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97378/consoleText) ``` copying pyspark/streaming/util.py -> pyspark-3.0.0.dev0/pyspark/streaming Writing pyspark-3.0.0.dev0/setup.cfg Creating tar archive removing 'pyspark-3.0.0.dev0' (and everything under it) Installing dist into virtual env Obtaining file:///home/jenkins/workspace/SparkPullRequestBuilder/python Collecting py4j==0.10.7 (from pyspark==3.0.0.dev0) Downloading https://files.pythonhosted.org/packages/e3/53/c737818eb9a7dc32a7cd4f1396e787bd94200c3997c72c1dbe028587bd76/py4j-0.10.7-py2.py3-none-any.whl (197kB) mkl-random 1.0.1 requires cython, which is not installed. Installing collected packages: py4j, pyspark Running setup.py develop for pyspark Successfully installed py4j-0.10.7 pyspark You are using pip version 10.0.1, however version 18.1 is available. You should consider upgrading via the 'pip install --upgrade pip' command. Run basic sanity check on pip installed version with spark-submit ``` Now, we are seeing the following ``` copying pyspark/streaming/util.py -> pyspark-3.0.0.dev0/pyspark/streaming Writing pyspark-3.0.0.dev0/setup.cfg Creating tar archive removing 'pyspark-3.0.0.dev0' (and everything under it) Installing dist into virtual env Obtaining file:///home/jenkins/workspace/SparkPullRequestBuilder/python Collecting py4j==0.10.7 (from pyspark==3.0.0.dev0) Downloading https://files.pythonhosted.org/packages/e3/53/c737818eb9a7dc32a7cd4f1396e787bd94200c3997c72c1dbe028587bd76/py4j-0.10.7-py2.py3-none-any.whl (197kB) mkl-random 1.0.1 requires cython, which is not installed. Installing collected packages: py4j, pyspark Running setup.py develop for pyspark Complete output from command /tmp/tmp.EWtmCOYUBn/3.5/bin/python -c "import setuptools, tokenize;__file__='/home/jenkins/workspace/SparkPullRequestBuilder/python/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" develop --no-deps: running develop running egg_info writing dependency_links to pyspark.egg-info/dependency_links.txt writing pyspark.egg-info/PKG-INFO writing requirements to pyspark.egg-info/requires.txt writing top-level names to pyspark.egg-info/top_level.txt Could not import pypandoc - required to package PySpark package init file 'deps/bin/__init__.py' not found (or not a regular file) package init file 'deps/jars/__init__.py' not found (or not a regular file) package init file 'pyspark/python/pyspark/__init__.py' not found (or not a regular file) package init file 'lib/__init__.py' not found (or not a regular file) package init file 'deps/data/__init__.py' not found (or not a regular file) package init file 'deps/licenses/__init__.py' not found (or not a regular file) package init file 'deps/examples/__init__.py' not found (or not a regular file) reading manifest file 'pyspark.egg-info/SOURCES.txt' reading manifest template 'MANIFEST.in' warning: no previously-included files matching '*.py[cod]' found anywhere in distribution warning: no previously-included files matching '__pycache__' found anywhere in distribution warning: no previously-included files matching '.DS_Store' found anywhere in distribution writing manifest file 'pyspark.egg-info/SOURCES.txt' running build_ext Creating /tmp/tmp.EWtmCOYUBn/3.5/lib/python3.5/site-packages/pyspark.egg-link (link to .) Adding pyspark 3.0.0.dev0 to easy-install.pth file Installing load-spark-env.cmd script to /tmp/tmp.EWtmCOYUBn/3.5/bin Installing spark-submit script to /tmp/tmp.EWtmCOYUBn/3.5/bin Installing spark-class.cmd script to /tmp/tmp.EWtmCOYUBn/3.5/bin Installing beeline.cmd script to /tmp/tmp.EWtmCOYUBn/3.5/bin Installing find-spark-home.cmd script to /tmp/tmp.EWtmCOYUBn/3.5/bin Installing run-example script to /tmp/tmp.EWtmCOYUBn/3.5/bin Installing spark-shell2.cmd script to /tmp/tmp.EWtmCOYUBn/3.5/bin Installing pyspark script to /tmp/tmp.EWtmCOYUBn/3.5/bin Installing sparkR script to /tmp/tmp.EWtmCOYUBn/3.5/bin Installing spark-sql script to /tmp/tmp.EWtmCOYUBn/3.5/bin Installing spark-submit.cmd script to /tmp/tmp.EWtmCOYUBn/3.5/bin Installing spark-shell script to /tmp/tmp.EWtmCOYUBn/3.5/bin Installing beeline script to /tmp/tmp.EWtmCOYUBn/3.5/bin Installing spark-submit2.cmd script to /tmp/tmp.EWtmCOYUBn/3.5/bin Installing find-spark-home script to /tmp/tmp.EWtmCOYUBn/3.5/bin Installing sparkR.cmd script to /tmp/tmp.EWtmCOYUBn/3.5/bin Installing run-example.cmd script to /tmp/tmp.EWtmCOYUBn/3.5/bin Installing sparkR2.cmd script to /tmp/tmp.EWtmCOYUBn/3.5/bin Installing spark-shell.cmd script to /tmp/tmp.EWtmCOYUBn/3.5/bin Installing spark-sql.cmd script to /tmp/tmp.EWtmCOYUBn/3.5/bin Installing spark-class2.cmd script to /tmp/tmp.EWtmCOYUBn/3.5/bin Traceback (most recent call last): File "<string>", line 1, in <module> File "/home/jenkins/workspace/SparkPullRequestBuilder/python/setup.py", line 224, in <module> 'Programming Language :: Python :: Implementation :: PyPy'] File "/tmp/tmp.EWtmCOYUBn/3.5/lib/python3.5/site-packages/setuptools/__init__.py", line 140, in setup return distutils.core.setup(**attrs) File "/tmp/tmp.EWtmCOYUBn/3.5/lib/python3.5/distutils/core.py", line 148, in setup dist.run_commands() File "/tmp/tmp.EWtmCOYUBn/3.5/lib/python3.5/distutils/dist.py", line 955, in run_commands self.run_command(cmd) File "/tmp/tmp.EWtmCOYUBn/3.5/lib/python3.5/distutils/dist.py", line 974, in run_command cmd_obj.run() File "/tmp/tmp.EWtmCOYUBn/3.5/lib/python3.5/site-packages/setuptools/command/develop.py", line 38, in run self.install_for_development() File "/tmp/tmp.EWtmCOYUBn/3.5/lib/python3.5/site-packages/setuptools/command/develop.py", line 154, in install_for_development self.process_distribution(None, self.dist, not self.no_deps) File "/tmp/tmp.EWtmCOYUBn/3.5/lib/python3.5/site-packages/setuptools/command/easy_install.py", line 729, in process_distribution self.install_egg_scripts(dist) File "/tmp/tmp.EWtmCOYUBn/3.5/lib/python3.5/site-packages/setuptools/command/develop.py", line 189, in install_egg_scripts script_text = strm.read() File "/tmp/tmp.EWtmCOYUBn/3.5/lib/python3.5/encodings/ascii.py", line 26, in decode return codecs.ascii_decode(input, self.errors)[0] UnicodeDecodeError: 'ascii' codec can't decode byte 0xc2 in position 2719: ordinal not in range(128) ---------------------------------------- ```
--- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org