[
https://issues.apache.org/jira/browse/BEAM-10244?focusedWorklogId=445066&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-445066
]
ASF GitHub Bot logged work on BEAM-10244:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 12/Jun/20 17:56
Start Date: 12/Jun/20 17:56
Worklog Time Spent: 10m
Work Description: acrites opened a new pull request #12003:
URL: https://github.com/apache/beam/pull/12003
This is done for the Dataflow runner for both Python and Java. We need the
transform id so we can look up relevant info (like environment) in the pipeline
proto.
@lukecwik
------------------------
Thank you for your contribution! Follow this checklist to help us
incorporate your contribution quickly and easily:
- [ ] [**Choose
reviewer(s)**](https://beam.apache.org/contribute/#make-your-change) and
mention them in a comment (`R: @username`).
- [ ] Format the pull request title like `[BEAM-XXX] Fixes bug in
ApproximateQuantiles`, where you replace `BEAM-XXX` with the appropriate JIRA
issue, if applicable. This will automatically link the pull request to the
issue.
- [ ] Update `CHANGES.md` with noteworthy changes.
- [ ] If this contribution is large, please file an Apache [Individual
Contributor License Agreement](https://www.apache.org/licenses/icla.pdf).
See the [Contributor Guide](https://beam.apache.org/contribute) for more
tips on [how to make review process
smoother](https://beam.apache.org/contribute/#make-reviewers-job-easier).
Post-Commit Tests Status (on master branch)
------------------------------------------------------------------------------------------------
Lang | SDK | Apex | Dataflow | Flink | Samza | Spark
--- | --- | --- | --- | --- | --- | ---
Go | [](https://builds.apache.org/job/beam_PostCommit_Go/lastCompletedBuild/)
| --- | --- | [](https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/lastCompletedBuild/)
| --- | [](https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/lastCompletedBuild/)
Java | [](https://builds.apache.org/job/beam_PostCommit_Java/lastCompletedBuild/)
| [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex/lastCompletedBuild/)
| [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow/lastCompletedBuild/)<br>[](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Java11/lastCompletedBuild/)
| [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink/lastCompletedBuild/)<br>[](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink_Java11/lastCompletedBuild/)<br>[](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink_Batch/lastCompletedBuild/)<br>[](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink_Streaming/lastCompletedBuild/)
| [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza/lastCompletedBuild/)
| [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark/lastCompletedBuild/)<br>[](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/lastCompletedBuild/)<br>[](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_SparkStructuredStreaming/lastCompletedBuild/)
Python | [](https://builds.apache.org/job/beam_PostCommit_Python2/lastCompletedBuild/)<br>[](https://builds.apache.org/job/beam_PostCommit_Python35/lastCompletedBuild/)<br>[](https://builds.apache.org/job/beam_PostCommit_Python36/lastCompletedBuild/)<br>[](https://builds.apache.org/job/beam_PostCommit_Python37/lastCompletedBuild/)
| --- | [](https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/lastCompletedBuild/)<br>[](https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow_V2/lastCompletedBuild/)<br>[](https://builds.apache.org/job/beam_PostCommit_Py_ValCont/lastCompletedBuild/)
| [](https://builds.apache.org/job/beam_PreCommit_Python2_PVR_Flink_Cron/lastCompletedBuild/)<br>[](https://builds.apache.org/job/beam_PostCommit_Python35_VR_Flink/lastCompletedBuild/)
| --- | [](https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/lastCompletedBuild/)
XLang | --- | --- | --- | [](https://builds.apache.org/job/beam_PostCommit_XVR_Flink/lastCompletedBuild/)
| --- | --- | [](https://builds.apache.org/job/beam_PostCommit_XVR_Spark/lastCompletedBuild/)
Pre-Commit Tests Status (on master branch)
------------------------------------------------------------------------------------------------
--- |Java | Python | Go | Website
--- | --- | --- | --- | ---
Non-portable | [](https://builds.apache.org/job/beam_PreCommit_Java_Cron/lastCompletedBuild/)
| [](https://builds.apache.org/job/beam_PreCommit_Python_Cron/lastCompletedBuild/)<br>[](https://builds.apache.org/job/beam_PreCommit_PythonLint_Cron/lastCompletedBuild/)
| [](https://builds.apache.org/job/beam_PreCommit_Go_Cron/lastCompletedBuild/)
| [](https://builds.apache.org/job/beam_PreCommit_Website_Cron/lastCompletedBuild/)
Portable | --- | [](https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/lastCompletedBuild/)
| --- | ---
See
[.test-infra/jenkins/README](https://github.com/apache/beam/blob/master/.test-infra/jenkins/README.md)
for trigger phrase, status and link of all Jenkins jobs.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 445066)
Remaining Estimate: 0h
Time Spent: 10m
> Populate requirements cache fails on poetry-based packages
> ----------------------------------------------------------
>
> Key: BEAM-10244
> URL: https://issues.apache.org/jira/browse/BEAM-10244
> Project: Beam
> Issue Type: Bug
> Components: sdk-py-core
> Reporter: Udi Meiri
> Priority: P0
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Sample command to recreate:
> {code}
> pip download rsa==4.1 --no-binary :all:
> {code}
> {code}
> Collecting rsa==4.1
> File was already downloaded
> /usr/local/google/home/ehudm/so_srcs/b158725078/rsa-4.1.tar.gz
> Installing build dependencies ... error
> ERROR: Command errored out with exit status 1:
> command:
> /usr/local/google/home/ehudm/.pyenv/versions/3.7.5/envs/b158725078/bin/python3.7
>
> /usr/local/google/home/ehudm/.pyenv/versions/3.7.5/envs/b158725078/lib/python3.7/site-packages/pip
> install --ignore-installed --no-user --prefix
> /tmp/pip-build-env-l4iugm_b/overlay --no-warn-script-location --no-binary
> :all: --only-binary :none: -i https://pypi.org/simple -- 'poetry>=0.12'
> cwd: None
> Complete output (50 lines):
> Collecting poetry>=0.12
> Using cached
> https://files.pythonhosted.org/packages/65/76/3ce57248bc821634955ffd43eb58e7ea17ed5cf6c15f94059885cb1b6155/poetry-1.0.9.tar.gz
> Installing build dependencies: started
> Installing build dependencies: finished with status 'done'
> Getting requirements to build wheel: started
> Getting requirements to build wheel: finished with status 'error'
> ERROR: Command errored out with exit status 1:
> command:
> /usr/local/google/home/ehudm/.pyenv/versions/3.7.5/envs/b158725078/bin/python3.7
>
> /usr/local/google/home/ehudm/.pyenv/versions/3.7.5/envs/b158725078/lib/python3.7/site-packages/pip/_vendor/pep517/_in_process.py
> get_requires_for_build_wheel /tmp/tmpqizpa3_5
> cwd: /tmp/pip-install-idj3pvty/poetry
> Complete output (36 lines):
> Traceback (most recent call last):
> File
> "/usr/local/google/home/ehudm/.pyenv/versions/3.7.5/envs/b158725078/lib/python3.7/site-packages/pip/_vendor/pep517/_in_process.py",
> line 207, in <module>
> main()
> File
> "/usr/local/google/home/ehudm/.pyenv/versions/3.7.5/envs/b158725078/lib/python3.7/site-packages/pip/_vendor/pep517/_in_process.py",
> line 197, in main
> json_out['return_val'] = hook(**hook_input['kwargs'])
> File
> "/usr/local/google/home/ehudm/.pyenv/versions/3.7.5/envs/b158725078/lib/python3.7/site-packages/pip/_vendor/pep517/_in_process.py",
> line 54, in get_requires_for_build_wheel
> return hook(config_settings)
> File
> "/tmp/pip-build-env-igoypwpj/overlay/lib/python3.7/site-packages/intreehooks.py",
> line 53, in get_requires_for_build_wheel
> return self._backend.get_requires_for_build_sdist(config_settings)
> File
> "/tmp/pip-build-env-igoypwpj/overlay/lib/python3.7/site-packages/intreehooks.py",
> line 38, in _backend
> obj = self._module_from_dir(modname)
> File
> "/tmp/pip-build-env-igoypwpj/overlay/lib/python3.7/site-packages/intreehooks.py",
> line 25, in _module_from_dir
> mod = importlib.import_module(modname)
> File
> "/usr/local/google/home/ehudm/.pyenv/versions/3.7.5/lib/python3.7/importlib/__init__.py",
> line 127, in import_module
> return _bootstrap._gcd_import(name[level:], package, level)
> File "<frozen importlib._bootstrap>", line 1006, in _gcd_import
> File "<frozen importlib._bootstrap>", line 983, in _find_and_load
> File "<frozen importlib._bootstrap>", line 953, in
> _find_and_load_unlocked
> File "<frozen importlib._bootstrap>", line 219, in
> _call_with_frames_removed
> File "<frozen importlib._bootstrap>", line 1006, in _gcd_import
> File "<frozen importlib._bootstrap>", line 983, in _find_and_load
> File "<frozen importlib._bootstrap>", line 967, in
> _find_and_load_unlocked
> File "<frozen importlib._bootstrap>", line 677, in _load_unlocked
> File "<frozen importlib._bootstrap_external>", line 728, in exec_module
> File "<frozen importlib._bootstrap>", line 219, in
> _call_with_frames_removed
> File "/tmp/pip-install-idj3pvty/poetry/poetry/masonry/__init__.py",
> line 10, in <module>
> from .builder import Builder
> File "/tmp/pip-install-idj3pvty/poetry/poetry/masonry/builder.py", line
> 1, in <module>
> from .builders.complete import CompleteBuilder
> File
> "/tmp/pip-install-idj3pvty/poetry/poetry/masonry/builders/__init__.py", line
> 1, in <module>
> from .complete import CompleteBuilder
> File
> "/tmp/pip-install-idj3pvty/poetry/poetry/masonry/builders/complete.py", line
> 6, in <module>
> from poetry.factory import Factory
> File "/tmp/pip-install-idj3pvty/poetry/poetry/factory.py", line 10, in
> <module>
> from clikit.api.io.io import IO
> ModuleNotFoundError: No module named 'clikit'
> ----------------------------------------
> ERROR: Command errored out with exit status 1:
> /usr/local/google/home/ehudm/.pyenv/versions/3.7.5/envs/b158725078/bin/python3.7
>
> /usr/local/google/home/ehudm/.pyenv/versions/3.7.5/envs/b158725078/lib/python3.7/site-packages/pip/_vendor/pep517/_in_process.py
> get_requires_for_build_wheel /tmp/tmpqizpa3_5 Check the logs for full
> command output.
> WARNING: You are using pip version 19.2.3, however version 20.1.1 is
> available.
> You should consider upgrading via the 'pip install --upgrade pip' command.
> ----------------------------------------
> ERROR: Command errored out with exit status 1:
> /usr/local/google/home/ehudm/.pyenv/versions/3.7.5/envs/b158725078/bin/python3.7
>
> /usr/local/google/home/ehudm/.pyenv/versions/3.7.5/envs/b158725078/lib/python3.7/site-packages/pip
> install --ignore-installed --no-user --prefix
> /tmp/pip-build-env-l4iugm_b/overlay --no-warn-script-location --no-binary
> :all: --only-binary :none: -i https://pypi.org/simple -- 'poetry>=0.12' Check
> the logs for full command output.
> WARNING: You are using pip version 19.2.3, however version 20.1.1 is
> available.
> You should consider upgrading via the 'pip install --upgrade pip' command.
> {code}
> Trying to download poetry directly also gives the same error.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
