[
https://issues.apache.org/jira/browse/BEAM-10844?focusedWorklogId=477465&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-477465
]
ASF GitHub Bot logged work on BEAM-10844:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 01/Sep/20 21:25
Start Date: 01/Sep/20 21:25
Worklog Time Spent: 10m
Work Description: y1chi commented on pull request #12727:
URL: https://github.com/apache/beam/pull/12727#issuecomment-685141545
> Could we have a design discussion about this first? This looks very
Dataflow specific. I do not believe we had enough chance to discuss this. And
it is also overlapping with work @emilymye and @tysonjh working on.
yeah, I previously had a discussion with @tvalentyn and @emilymye, and looks
like no one's working on this.
also shared a doc
https://docs.google.com/document/d/11iPwS94t-kXK3ybp3NEUshcu3bxyg94MJHYOqIZ-Fd0/edit
to a few people.
Right now this is only intended to provide an experimental shortcut for
dataflow job to use dependencies preinstalled custom container. I believe the
change doesn't cause any disruption for how currently dataflow or portable job
runs.
I can also set up meeting if further discussion is needed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 477465)
Time Spent: 1h (was: 50m)
> Add a way to prebuild python sdk container with dependencies
> ------------------------------------------------------------
>
> Key: BEAM-10844
> URL: https://issues.apache.org/jira/browse/BEAM-10844
> Project: Beam
> Issue Type: New Feature
> Components: runner-dataflow
> Reporter: Yichi Zhang
> Assignee: Yichi Zhang
> Priority: P2
> Time Spent: 1h
> Remaining Estimate: 0h
>
> We should add a way to prebuild python sdk container on top of latest public
> sdk image, and have all the dependencies installed, so that the setup steps
> won't need to be executed again every time a new worker vm is launched, on
> dataflow.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
