[
https://issues.apache.org/jira/browse/BEAM-6765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Barry Hart updated BEAM-6765:
-----------------------------
Description:
When trying to run a Beam 2.10.0 job in Google Cloud DataFlow, I get the
following error:
{noformat}
Collecting pyarrow==0.11.1 (from -r requirements.txt (line 51))
Could not find a version that satisfies the requirement pyarrow==0.11.1 (from
-r requirements.txt (line 51)) (from versions: 0.9.0, 0.10.0, 0.11.0, 0.12.1)
No matching distribution found for pyarrow==0.11.1 (from -r requirements.txt
(line 51))
{noformat}
This version, while it exists, cannot be installed in Google Cloud DataFlow,
because it is only available on PyPI as a wheel, and DataFlow does not allow
installing binary packages, only source packages.
was:
When trying to run a Beam 2.10.0 job, I get the following error:
{noformat}
Collecting pyarrow==0.11.1 (from -r requirements.txt (line 51))
Could not find a version that satisfies the requirement pyarrow==0.11.1 (from
-r requirements.txt (line 51)) (from versions: 0.9.0, 0.10.0, 0.11.0, 0.12.1)
No matching distribution found for pyarrow==0.11.1 (from -r requirements.txt
(line 51))
{noformat}
It appears this version does not exist.
In fact, given [this
requirement|https://github.com/apache/beam/blob/v2.10.0/sdks/python/setup.py#L119]
in {{setup.py}}, it appears no compatible version exists at this time. (See
the list of available versions above.)
{code}
('pyarrow>=0.11.1,<0.12.0; python_version >= "3.0" or '
'platform_system != "Windows"'),
{code}
> Beam 2.10.0 for Python requires pyarrow 0.11.1, which is not installable in
> Google Cloud DataFlow
> -------------------------------------------------------------------------------------------------
>
> Key: BEAM-6765
> URL: https://issues.apache.org/jira/browse/BEAM-6765
> Project: Beam
> Issue Type: Bug
> Components: sdk-py-core
> Affects Versions: 2.10.0
> Reporter: Barry Hart
> Priority: Major
> Fix For: 2.10.0
>
>
> When trying to run a Beam 2.10.0 job in Google Cloud DataFlow, I get the
> following error:
> {noformat}
> Collecting pyarrow==0.11.1 (from -r requirements.txt (line 51))
> Could not find a version that satisfies the requirement pyarrow==0.11.1 (from
> -r requirements.txt (line 51)) (from versions: 0.9.0, 0.10.0, 0.11.0, 0.12.1)
> No matching distribution found for pyarrow==0.11.1 (from -r requirements.txt
> (line 51))
> {noformat}
> This version, while it exists, cannot be installed in Google Cloud DataFlow,
> because it is only available on PyPI as a wheel, and DataFlow does not allow
> installing binary packages, only source packages.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
