[
https://issues.apache.org/jira/browse/BEAM-5440?focusedWorklogId=274292&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-274292
]
ASF GitHub Bot logged work on BEAM-5440:
----------------------------------------
Author: ASF GitHub Bot
Created on: 09/Jul/19 18:39
Start Date: 09/Jul/19 18:39
Worklog Time Spent: 10m
Work Description: lukecwik commented on issue #8982: [BEAM-5440] Pass
docker run options to SDK harness containers
URL: https://github.com/apache/beam/pull/8982#issuecomment-509684557
In this PR is that we assume that `docker run` is the only way to start a
docker container which means that users who pass in `run_options` will only
work with runners that use `docker run` to launch the containers. Otherwise the
runners will need to either reject jobs with run options or interpret all the
options found and either ignore them if they aren't important or map them onto
something meaningful that they use themselves.
Also, does `docker run` maintain backwards compatibility for their flags or
will users who run their pipeline locally then have issues when deploying them
on a cluster based runner with a potentially different version of docker (is
there a concept of min docker version needed?)?
It may be worthwhile to bring this back to the dev@ list to get consensus on
the approach.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 274292)
Time Spent: 2h 20m (was: 2h 10m)
> Add option to mount a directory inside SDK harness containers
> -------------------------------------------------------------
>
> Key: BEAM-5440
> URL: https://issues.apache.org/jira/browse/BEAM-5440
> Project: Beam
> Issue Type: New Feature
> Components: java-fn-execution, sdk-java-core
> Reporter: Maximilian Michels
> Priority: Major
> Labels: portability, portability-flink
> Time Spent: 2h 20m
> Remaining Estimate: 0h
>
> While experimenting with the Python SDK locally, I found it inconvenient that
> I can't mount a host directory to the Docker containers, i.e. the input must
> already be in the container and the results of a Write remain inside the
> container. For local testing, users may want to mount a host directory.
> Since BEAM-5288 the {{Environment}} carries explicit environment information,
> we could a) add volume args to the {{DockerPayload}}, or b) provide a general
> Docker arguments field.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
