[ https://issues.apache.org/jira/browse/SPARK-32303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dongjoon Hyun resolved SPARK-32303. ----------------------------------- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29102 [https://github.com/apache/spark/pull/29102] > Remove leftover from editable mode installation in PIP test > ----------------------------------------------------------- > > Key: SPARK-32303 > URL: https://issues.apache.org/jira/browse/SPARK-32303 > Project: Spark > Issue Type: Test > Components: PySpark > Affects Versions: 2.4.6, 3.0.0, 3.1.0 > Reporter: Hyukjin Kwon > Assignee: Hyukjin Kwon > Priority: Major > Fix For: 3.1.0 > > > Jenkins fails as below: > {code} > Installing dist into virtual env > Processing ./python/dist/pyspark-3.1.0.dev0.tar.gz > Collecting py4j==0.10.9 (from pyspark==3.1.0.dev0) > Downloading > https://files.pythonhosted.org/packages/9e/b6/6a4fb90cd235dc8e265a6a2067f2a2c99f0d91787f06aca4bcf7c23f3f80/py4j-0.10.9-py2.py3-none-any.whl > (198kB) > Installing collected packages: py4j, pyspark > Found existing installation: py4j 0.10.9 > Uninstalling py4j-0.10.9: > Successfully uninstalled py4j-0.10.9 > Found existing installation: pyspark 3.1.0.dev0 > Exception: > Traceback (most recent call last): > File > "/home/anaconda/envs/py36/lib/python3.6/site-packages/pip/_internal/cli/base_command.py", > line 179, in main > status = self.run(options, args) > File > "/home/anaconda/envs/py36/lib/python3.6/site-packages/pip/_internal/commands/install.py", > line 393, in run > use_user_site=options.use_user_site, > File > "/home/anaconda/envs/py36/lib/python3.6/site-packages/pip/_internal/req/__init__.py", > line 50, in install_given_reqs > auto_confirm=True > File > "/home/anaconda/envs/py36/lib/python3.6/site-packages/pip/_internal/req/req_install.py", > line 816, in uninstall > uninstalled_pathset = UninstallPathSet.from_dist(dist) > File > "/home/anaconda/envs/py36/lib/python3.6/site-packages/pip/_internal/req/req_uninstall.py", > line 505, in from_dist > '(at %s)' % (link_pointer, dist.project_name, dist.location) > AssertionError: Egg-link > /home/jenkins/workspace/SparkPullRequestBuilder@3/python does not match > installed > {code} > Seems like the editable mode from other installations affect. We should > better remove the symbolic link. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org