[
https://issues.apache.org/jira/browse/BEAM-8793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kyle Weaver updated BEAM-8793:
------------------------------
Summary: installGcpTest task flakes (python setup.py egg_info fails) (was:
installGcpTest task flakes)
> installGcpTest task flakes (python setup.py egg_info fails)
> -----------------------------------------------------------
>
> Key: BEAM-8793
> URL: https://issues.apache.org/jira/browse/BEAM-8793
> Project: Beam
> Issue Type: Improvement
> Components: test-failures
> Reporter: Kyle Weaver
> Priority: Major
>
> This seems to affect the installGcpTest task for all python versions. There
> are a few different failure modes, but they look like they might be related.
> == 1 ==
> 11:01:38 > Task :sdks:python:test-suites:direct:py35:installGcpTest FAILED
> 11:01:38 Obtaining
> file:///home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/sdks/python
> 11:01:38 ERROR: Command errored out with exit status 1:
> 11:01:38 command:
> /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/bin/python3.5
> -c 'import sys, setuptools, tokenize; sys.argv[0] =
> '"'"'/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/sdks/python/setup.py'"'"';
>
> __file__='"'"'/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/sdks/python/setup.py'"'"';f=getattr(tokenize,
> '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"',
> '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))'
> egg_info
> 11:01:38 cwd:
> /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/sdks/python/
> 11:01:38 Complete output (37 lines):
> 11:01:38 Traceback (most recent call last):
> 11:01:38 File "<string>", line 1, in <module>
> 11:01:38 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/sdks/python/setup.py",
> line 264, in <module>
> 11:01:38 'test': generate_protos_first(test),
> 11:01:38 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/__init__.py",
> line 144, in setup
> 11:01:38 _install_setup_requires(attrs)
> 11:01:38 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/__init__.py",
> line 139, in _install_setup_requires
> 11:01:38 dist.fetch_build_eggs(dist.setup_requires)
> 11:01:38 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/dist.py",
> line 720, in fetch_build_eggs
> 11:01:38 replace_conflicting=True,
> 11:01:38 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/pkg_resources/__init__.py",
> line 782, in resolve
> 11:01:38 replace_conflicting=replace_conflicting
> 11:01:38 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/pkg_resources/__init__.py",
> line 1065, in best_match
> 11:01:38 return self.obtain(req, installer)
> 11:01:38 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/pkg_resources/__init__.py",
> line 1077, in obtain
> 11:01:38 return installer(requirement)
> 11:01:38 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/dist.py",
> line 787, in fetch_build_egg
> 11:01:38 return cmd.easy_install(req)
> 11:01:38 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/command/easy_install.py",
> line 679, in easy_install
> 11:01:38 return self.install_item(spec, dist.location, tmpdir, deps)
> 11:01:38 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/command/easy_install.py",
> line 705, in install_item
> 11:01:38 dists = self.install_eggs(spec, download, tmpdir)
> 11:01:38 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/command/easy_install.py",
> line 855, in install_eggs
> 11:01:38 return [self.install_wheel(dist_filename, tmpdir)]
> 11:01:38 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/command/easy_install.py",
> line 1073, in install_wheel
> 11:01:38 os.path.dirname(destination)
> 11:01:38 File "/usr/lib/python3.5/distutils/cmd.py", line 336, in
> execute
> 11:01:38 util.execute(func, args, msg, dry_run=self.dry_run)
> 11:01:38 File "/usr/lib/python3.5/distutils/util.py", line 301, in
> execute
> 11:01:38 func(*args)
> 11:01:38 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/wheel.py",
> line 101, in install_as_egg
> 11:01:38 self._install_as_egg(destination_eggdir, zf)
> 11:01:38 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/wheel.py",
> line 109, in _install_as_egg
> 11:01:38 self._convert_metadata(zf, destination_eggdir, dist_info,
> egg_info)
> 11:01:38 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/wheel.py",
> line 154, in _convert_metadata
> 11:01:38 os.rename(dist_info, egg_info)
> 11:01:38 FileNotFoundError: [Errno 2] No such file or directory:
> '/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/sdks/python/.eggs/pytest_runner-5.2-py3.5.egg/pytest_runner-5.2.dist-info'
> ->
> '/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/sdks/python/.eggs/pytest_runner-5.2-py3.5.egg/EGG-INFO'
> 11:01:38 ----------------------------------------
> 11:01:38 ERROR: Command errored out with exit status 1: python setup.py
> egg_info Check the logs for full command output.
> Another error I saw was:
> == 2 ==
> 12:35:25 > Task :sdks:python:test-suites:direct:py37:installGcpTest FAILED
> 12:35:25 Obtaining
> file:///home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/sdks/python
> 12:35:25 ERROR: Command errored out with exit status 1:
> 12:35:25 command:
> /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/bin/python3.7
> -c 'import sys, setuptools, tokenize; sys.argv[0] =
> '"'"'/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/sdks/python/setup.py'"'"';
>
> __file__='"'"'/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/sdks/python/setup.py'"'"';f=getattr(tokenize,
> '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"',
> '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))'
> egg_info
> 12:35:25 cwd:
> /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/sdks/python/
> 12:35:25 Complete output (29 lines):
> 12:35:25 Traceback (most recent call last):
> 12:35:25 File "<string>", line 1, in <module>
> 12:35:25 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/sdks/python/setup.py",
> line 259, in <module>
> 12:35:25 'test': generate_protos_first(test),
> 12:35:25 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/__init__.py",
> line 144, in setup
> 12:35:25 _install_setup_requires(attrs)
> 12:35:25 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/__init__.py",
> line 139, in _install_setup_requires
> 12:35:25 dist.fetch_build_eggs(dist.setup_requires)
> 12:35:25 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/dist.py",
> line 720, in fetch_build_eggs
> 12:35:25 replace_conflicting=True,
> 12:35:25 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/pkg_resources/__init__.py",
> line 782, in resolve
> 12:35:25 replace_conflicting=replace_conflicting
> 12:35:25 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/pkg_resources/__init__.py",
> line 1065, in best_match
> 12:35:25 return self.obtain(req, installer)
> 12:35:25 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/pkg_resources/__init__.py",
> line 1077, in obtain
> 12:35:25 return installer(requirement)
> 12:35:25 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/dist.py",
> line 787, in fetch_build_egg
> 12:35:25 return cmd.easy_install(req)
> 12:35:25 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/command/easy_install.py",
> line 679, in easy_install
> 12:35:25 return self.install_item(spec, dist.location, tmpdir, deps)
> 12:35:25 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/command/easy_install.py",
> line 705, in install_item
> 12:35:25 dists = self.install_eggs(spec, download, tmpdir)
> 12:35:25 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/command/easy_install.py",
> line 855, in install_eggs
> 12:35:25 return [self.install_wheel(dist_filename, tmpdir)]
> 12:35:25 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/command/easy_install.py",
> line 1079, in install_wheel
> 12:35:25 return self.egg_distribution(destination)
> 12:35:25 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/command/easy_install.py",
> line 897, in egg_distribution
> 12:35:25 metadata = EggMetadata(zipimport.zipimporter(egg_path))
> 12:35:25 zipimport.ZipImportError: not a Zip file
> 12:35:25 ----------------------------------------
> 12:35:25 ERROR: Command errored out with exit status 1: python setup.py
> egg_info Check the logs for full command output.
> == 3 ==
> 07:56:50 > Task :sdks:python:test-suites:portable:py2:installGcpTest FAILED
> ...
> 07:56:50 File
> "/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Portable_Python_Phrase/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/setuptools/wheel.py",
> line 110, in _install_as_egg
> 07:56:50 self._convert_metadata(zf, destination_eggdir, dist_info,
> egg_info)
> 07:56:50 File
> "/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Portable_Python_Phrase/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/setuptools/wheel.py",
> line 131, in _convert_metadata
> 07:56:50 os.mkdir(destination_eggdir)
> 07:56:50 OSError: [Errno 17] File exists:
> '/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Portable_Python_Phrase/src/sdks/python/.eggs/pytest_runner-5.2-py2.7.egg'
> 07:56:50 ----------------------------------------
> 07:56:50 ERROR: Command errored out with exit status 1: python setup.py
> egg_info Check the logs for full command output.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
