[
https://issues.apache.org/jira/browse/BEAM-8239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Benjamin Tan updated BEAM-8239:
-------------------------------
Description:
{{I'm trying to mount a directory by providing additional arguments via
–environment_config in the PipelineOptions:}}
{{pipeline_options =
PipelineOptions([{color:#6a8759}"--runner=PortableRunner"{color}{color:#cc7832},{color}
{color:#6a8759}"--job_endpoint=localhost:8099"{color}{color:#cc7832},{color}
{color:#6a8759}"--environment_config=-v /tmp:/tmp
benjamintan-docker-apache.bintray.io/beam/python3:latest"{color}]{color:#cc7832},{color}
{color:#aa4926}pipeline_type_check{color}={color:#cc7832}True{color})}}
However, the command fails with the following:
{{RuntimeError: Pipeline
BeamApp-benjamintan-0916144446-839e633f_994659f0-7da9-412e-91e2-f32dd4f24b5c
failed in state FAILED: java.io.IOException: Received exit code 125 for command
'docker run -d --mount
type=bind,src=/home/benjamintan/.config/gcloud,dst=/root/.config/gcloud
--network=host --env=DOCKER_MAC_CONTAINER=null -v /tmp:/tmp
benjamintan-docker-apache.bintray.io/beam/python3:latest --id=7-1
--logging_endpoint=localhost:41835 --artifact_endpoint=localhost:40063
--provision_endpoint=localhost:39827 --control_endpoint=localhost:45355'.
stderr: unknown flag: --idSee 'docker run --help'.}}
However, if I were to copy and paste the `docker run ...` command, the command
seems OK (no syntax errors)
This seems related to BEAM-5440. It isn't clear if there's a "right" way to
pass in additional Docker run arguments.
was:
I'm trying to mount a directory by providing additional arguments via
`–environment_config` in the `PipelineOptions`:
```
pipeline_options =
PipelineOptions([{color:#6a8759}"--runner=PortableRunner"{color}{color:#cc7832},
{color} {color:#6a8759}"--job_endpoint=localhost:8099"{color}{color:#cc7832},
{color} {color:#6a8759}"--environment_config=-v /tmp:/tmp
benjamintan-docker-apache.bintray.io/beam/python3:latest"{color}]{color:#cc7832},
{color} {color:#aa4926}pipeline_type_check{color}={color:#cc7832}True{color})
```
However, the command fails with the following:
```
RuntimeError: Pipeline
BeamApp-benjamintan-0916144446-839e633f_994659f0-7da9-412e-91e2-f32dd4f24b5c
failed in state FAILED: java.io.IOException: Received exit code 125 for command
'docker run -d --mount
type=bind,src=/home/benjamintan/.config/gcloud,dst=/root/.config/gcloud
--network=host --env=DOCKER_MAC_CONTAINER=null -v /tmp:/tmp
benjamintan-docker-apache.bintray.io/beam/python3:latest --id=7-1
--logging_endpoint=localhost:41835 --artifact_endpoint=localhost:40063
--provision_endpoint=localhost:39827 --control_endpoint=localhost:45355'.
stderr: unknown flag: --idSee 'docker run --help'.
```
However, if I were to copy and paste the `docker run ...` command, the command
seems OK (no syntax errors)
This seems related to BEAM-5440. It isn't clear if there's a "right" way to
pass in additional Docker run arguments.
> Docker options in --environment_config
> --------------------------------------
>
> Key: BEAM-8239
> URL: https://issues.apache.org/jira/browse/BEAM-8239
> Project: Beam
> Issue Type: Bug
> Components: sdk-py-harness
> Affects Versions: 2.15.0
> Reporter: Benjamin Tan
> Priority: Minor
>
> {{I'm trying to mount a directory by providing additional arguments via
> –environment_config in the PipelineOptions:}}
>
> {{pipeline_options =
> PipelineOptions([{color:#6a8759}"--runner=PortableRunner"{color}{color:#cc7832},{color}
> {color:#6a8759}"--job_endpoint=localhost:8099"{color}{color:#cc7832},{color}
> {color:#6a8759}"--environment_config=-v /tmp:/tmp
> benjamintan-docker-apache.bintray.io/beam/python3:latest"{color}]{color:#cc7832},{color}
> {color:#aa4926}pipeline_type_check{color}={color:#cc7832}True{color})}}
>
> However, the command fails with the following:
>
>
> {{RuntimeError: Pipeline
> BeamApp-benjamintan-0916144446-839e633f_994659f0-7da9-412e-91e2-f32dd4f24b5c
> failed in state FAILED: java.io.IOException: Received exit code 125 for
> command 'docker run -d --mount
> type=bind,src=/home/benjamintan/.config/gcloud,dst=/root/.config/gcloud
> --network=host --env=DOCKER_MAC_CONTAINER=null -v /tmp:/tmp
> benjamintan-docker-apache.bintray.io/beam/python3:latest --id=7-1
> --logging_endpoint=localhost:41835 --artifact_endpoint=localhost:40063
> --provision_endpoint=localhost:39827 --control_endpoint=localhost:45355'.
> stderr: unknown flag: --idSee 'docker run --help'.}}
>
> However, if I were to copy and paste the `docker run ...` command, the
> command seems OK (no syntax errors)
>
> This seems related to BEAM-5440. It isn't clear if there's a "right" way to
> pass in additional Docker run arguments.
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
