[
https://issues.apache.org/jira/browse/BEAM-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16896951#comment-16896951
]
Robert Bradshaw commented on BEAM-7857:
---------------------------------------
This is because the writer writes files to the (local) docker filesystem.
How to let docker workers interact well with (outside-of-docker) local files is
still an open problem in general.
> Portable Wordcount on Flink runner finishes but does not produce output files
> in DOCKER execution mode
> ------------------------------------------------------------------------------------------------------
>
> Key: BEAM-7857
> URL: https://issues.apache.org/jira/browse/BEAM-7857
> Project: Beam
> Issue Type: Bug
> Components: runner-flink, sdk-py-core
> Reporter: Valentyn Tymofieiev
> Priority: Major
>
> Repro steps:
> {noformat}
> ./gradlew :runners:flink:1.5:job-server:runShadow
> ./gradlew :sdks:python:container:py3:docker
> rm -rf /tmp/py-wordcount-direct*
> ./gradlew :sdks:python:test-suites:portable:py35:portableWordCountBatch
> -PjobEndpoint=localhost:8099 -PenvironmentType=DOCKER
> cat /tmp/py-wordcount-direct* # to verify results.
> # Output: No such file or directory
> {noformat}
> Switching to -PenvironmentType=LOOPBACK produces output.
> The issue is reproducible both on Py2 and Py3 on master.
> cc: [~altay] [~angoenka] [~ibzib] [~robertwb]
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
