[
https://issues.apache.org/jira/browse/SPARK-21573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16107733#comment-16107733
]
shane knapp commented on SPARK-21573:
-------------------------------------
that's odd that it's only failing on -04, as it's configured identically to all
the other workers, and the anaconda installation is working fine (i just
confirmed).
anaconda's bin directory must be on the PATH, otherwise it'll pick up the
default/system python (2.6). i set it in the worker's config, but when you
kick off a bash shell (to launch the python tests), it doesn't carry PATH over
correctly. i'm pretty certain that my PR will address this issue.
> Tests failing with run-tests.py SyntaxError occasionally in Jenkins
> -------------------------------------------------------------------
>
> Key: SPARK-21573
> URL: https://issues.apache.org/jira/browse/SPARK-21573
> Project: Spark
> Issue Type: Test
> Components: Tests
> Affects Versions: 2.3.0
> Reporter: Hyukjin Kwon
> Priority: Minor
>
> It looks default {{python}} in the path at few places such as
> {{./dev/run-tests}} use Python 2.6 in Jenkins and it fails to execute
> {{run-tests.py}}:
> {code}
> python2.6 run-tests.py
> File "run-tests.py", line 124
> {m: set(m.dependencies).intersection(modules_to_test) for m in
> modules_to_test}, sort=True)
> ^
> SyntaxError: invalid syntax
> {code}
> It looks there are quite some places to fix to support Python 2.6 in
> {{run-tests.py}} and related Python scripts.
> We might just try to set Python 2.7 in few other scripts running this if
> available.
> Please also see
> http://apache-spark-developers-list.1001551.n3.nabble.com/Tests-failing-with-run-tests-py-SyntaxError-td22030.html
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
