[ 
https://issues.apache.org/jira/browse/BEAM-3950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16416012#comment-16416012
 ] 

Ahmet Altay commented on BEAM-3950:
-----------------------------------

I believe this has a few components:
1. In the worker side support installing whl files. This should be as simple as 
doing the same pip install with the wheel file. The SDK needs to change to stop 
renaming all files pointed by -sdk_location to a .tar file. (More in here: 
https://issues.apache.org/jira/browse/BEAM-3933)
2. Detect the target and pick a suitable whl file. This is easy in case of 
Dataflow since target is known. For other runners the default may still be the 
source files.
3. Finally, there is Beam SDK and its redistribution Dataflow SDK. The 
difference is mainly in SDK naming. Dataflow runner stages Dataflow SDK which 
depends on Beam but does not have wheel files. It is possible that simple 
solution would be to change Dataflow SDK to install binary version of the Beam 
SDK.

> Dataflow Runner should supply a wheel version of Python SDK if it is available
> ------------------------------------------------------------------------------
>
>                 Key: BEAM-3950
>                 URL: https://issues.apache.org/jira/browse/BEAM-3950
>             Project: Beam
>          Issue Type: Improvement
>          Components: runner-dataflow, sdk-py-core
>            Reporter: Valentyn Tymofieiev
>            Assignee: Valentyn Tymofieiev
>            Priority: Major
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to