Benjamin Tan created BEAM-8239:
----------------------------------

             Summary: Docker options in --environment_config
                 Key: BEAM-8239
                 URL: https://issues.apache.org/jira/browse/BEAM-8239
             Project: Beam
          Issue Type: Bug
          Components: sdk-py-harness
    Affects Versions: 2.15.0
            Reporter: Benjamin Tan


I'm trying to mount a directory by providing additional arguments via 
`–environment_config` in the `PipelineOptions`:

```

pipeline_options = 
PipelineOptions([{color:#6a8759}"--runner=PortableRunner"{color}{color:#cc7832},
{color} {color:#6a8759}"--job_endpoint=localhost:8099"{color}{color:#cc7832},
{color} {color:#6a8759}"--environment_config=-v /tmp:/tmp 
benjamintan-docker-apache.bintray.io/beam/python3:latest"{color}]{color:#cc7832},
{color} {color:#aa4926}pipeline_type_check{color}={color:#cc7832}True{color})

```

However,  the command fails with the following:

 

```

RuntimeError: Pipeline 
BeamApp-benjamintan-0916144446-839e633f_994659f0-7da9-412e-91e2-f32dd4f24b5c 
failed in state FAILED: java.io.IOException: Received exit code 125 for command 
'docker run -d --mount 
type=bind,src=/home/benjamintan/.config/gcloud,dst=/root/.config/gcloud 
--network=host --env=DOCKER_MAC_CONTAINER=null -v /tmp:/tmp 
benjamintan-docker-apache.bintray.io/beam/python3:latest --id=7-1 
--logging_endpoint=localhost:41835 --artifact_endpoint=localhost:40063 
--provision_endpoint=localhost:39827 --control_endpoint=localhost:45355'. 
stderr: unknown flag: --idSee 'docker run --help'.

```

However, if I were to copy and paste the `docker run ...` command, the command 
seems OK (no syntax errors)

 

This seems related to BEAM-5440. It isn't clear if there's a "right" way to 
pass in additional Docker run arguments.



--
This message was sent by Atlassian Jira
(v8.3.2#803003)

Reply via email to