[
https://issues.apache.org/jira/browse/BEAM-4833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16802006#comment-16802006
]
Jiayi Zhao commented on BEAM-4833:
----------------------------------
Hi, I meet the same issue when trying the flink runner, what am I doing right
now is adding my "pip install xxx" in
~/beam/sdks/python/container/base_image_requirements.txt to make it work,
what's the correct way of doing it other than change the source code?
> Add support for users specifying a requirements.txt for their Python portable
> container
> ---------------------------------------------------------------------------------------
>
> Key: BEAM-4833
> URL: https://issues.apache.org/jira/browse/BEAM-4833
> Project: Beam
> Issue Type: Improvement
> Components: sdk-py-core
> Reporter: holdenk
> Assignee: holdenk
> Priority: Minor
> Labels: triaged
> Time Spent: 2.5h
> Remaining Estimate: 0h
>
> It's pretty common that Python scripts require extra dependencies, even the
> tensorflow model analysis TFMA example requires a different version of TF
> than the one we install by default. While users can roll their own container
> or edit the Dockerfile, it would probably be useful to provide an easier path
> to integrating their dependencies.
> While we support automatically installing the dependencies at runtime on the
> workers, this can be very slow, especially for things like tensorflow, arrow,
> or other numeric heavy code.
> Another alternative could be a simple script to augment the existing base
> image.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
