tvalentyn commented on pull request #14145:
URL: https://github.com/apache/beam/pull/14145#issuecomment-791099215


   ```
   18:09:37     Running setup.py (path:/tmp/pip-req-build-kxmdxkxz/setup.py) 
egg_info for package from file:///opt/apache/beam/tars/apache-beam.tar.gz
   18:09:37     Created temporary directory: /tmp/pip-pip-egg-info-cw3flwuy
   18:09:37     Running command python setup.py egg_info
   18:09:38     Traceback (most recent call last):
   18:09:38       File "<string>", line 1, in <module>
   18:09:38       File "/usr/local/lib/python3.6/tokenize.py", line 452, in open
   18:09:38         buffer = _builtin_open(filename, 'rb')
   18:09:38     FileNotFoundError: [Errno 2] No such file or directory: 
'/tmp/pip-req-build-kxmdxkxz/setup.py'
   18:09:38 WARNING: Discarding 
file:///opt/apache/beam/tars/apache-beam.tar.gz. Command errored out with exit 
status 1: python setup.py egg_info Check the logs for full command output.
   18:09:38 ERROR: Command errored out with exit status 1: python setup.py 
egg_info Check the logs for full command output.
   ```
   Looks like some bits of the shell script may have parallelization issues. I 
vaguely recall having issues with either creating virtualenv or in parallel, 
and or building sdk tarball sdist in parallel, which we solved by configuring 
dependency chains in common python tasks. 
   
   Adding
   ```
       dependsOn 'installGcpTest'
       dependsOn ':sdks:python:sdist'
   ```
   Instead of  
https://github.com/y1chi/beam/blob/python_valcon/sdks/python/container/run_validatescontainer.sh#L109-L118
 
   
   might resolve it.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]


Reply via email to