[
https://issues.apache.org/jira/browse/BEAM-1886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15968548#comment-15968548
]
Jingsong Lee commented on BEAM-1886:
------------------------------------
Flink WriteAsText and Beam native TextIO There are two main differences:
1.TextIO's localFile is not prefixed, and writeAsText needs to be URI format.
2. The file name of TextIO default is in accordance with the format of
ShardNameTemplate, and writeAsText is the original file name.
> Remove TextIO override in Flink runner
> --------------------------------------
>
> Key: BEAM-1886
> URL: https://issues.apache.org/jira/browse/BEAM-1886
> Project: Beam
> Issue Type: Bug
> Components: runner-flink
> Reporter: Kenneth Knowles
> Fix For: First stable release
>
>
> Today, the Flink runner replaces TextIO with a customized version. I believe
> this is related to adequate support for files HDFS.
> However, the capabilities are less, in particular the recent support for
> window-and-pane sharded writes of unbounded collections.
> Concretely, we have had to remove WindowedWordCountIT from the precommit
> Jenkins run.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
