[
https://issues.apache.org/jira/browse/BEAM-4833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17262838#comment-17262838
]
Yichi Zhang commented on BEAM-4833:
-----------------------------------
Yes, prebuilding the portable container with requirements is addressed with
https://github.com/apache/beam/pull/12727
> Add support for users specifying a requirements.txt for their Python portable
> container
> ---------------------------------------------------------------------------------------
>
> Key: BEAM-4833
> URL: https://issues.apache.org/jira/browse/BEAM-4833
> Project: Beam
> Issue Type: Improvement
> Components: sdk-py-core
> Reporter: Holden Karau
> Assignee: Yichi Zhang
> Priority: P3
> Time Spent: 2.5h
> Remaining Estimate: 0h
>
> It's pretty common that Python scripts require extra dependencies, even the
> tensorflow model analysis TFMA example requires a different version of TF
> than the one we install by default. While users can roll their own container
> or edit the Dockerfile, it would probably be useful to provide an easier path
> to integrating their dependencies.
> While we support automatically installing the dependencies at runtime on the
> workers, this can be very slow, especially for things like tensorflow, arrow,
> or other numeric heavy code.
> Another alternative could be a simple script to augment the existing base
> image.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
