[
https://issues.apache.org/jira/browse/SPARK-21573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16107713#comment-16107713
]
Sean Owen commented on SPARK-21573:
-----------------------------------
[~shaneknapp] does it matter that this and one other script are the only ones
referring to python2? I wonder if that's picking up something besides the
Python3 that I assume 'py3k' is providing.
I am pretty sure it's specific to a machine or machines, maybe? For example
this failed 3 times in a row on amp-jenkins-worker-04
https://amplab.cs.berkeley.edu/jenkins/view/Spark%20QA%20Test%20(Dashboard)/job/spark-branch-2.1-test-sbt-hadoop-2.6/
> Tests failing with run-tests.py SyntaxError occasionally in Jenkins
> -------------------------------------------------------------------
>
> Key: SPARK-21573
> URL: https://issues.apache.org/jira/browse/SPARK-21573
> Project: Spark
> Issue Type: Test
> Components: Tests
> Affects Versions: 2.3.0
> Reporter: Hyukjin Kwon
> Priority: Minor
>
> It looks default {{python}} in the path at few places such as
> {{./dev/run-tests}} use Python 2.6 in Jenkins and it fails to execute
> {{run-tests.py}}:
> {code}
> python2.6 run-tests.py
> File "run-tests.py", line 124
> {m: set(m.dependencies).intersection(modules_to_test) for m in
> modules_to_test}, sort=True)
> ^
> SyntaxError: invalid syntax
> {code}
> It looks there are quite some places to fix to support Python 2.6 in
> {{run-tests.py}} and related Python scripts.
> We might just try to set Python 2.7 in few other scripts running this if
> available.
> Please also see
> http://apache-spark-developers-list.1001551.n3.nabble.com/Tests-failing-with-run-tests-py-SyntaxError-td22030.html
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
