[
https://issues.apache.org/jira/browse/BEAM-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17416760#comment-17416760
]
Tim Clemons commented on BEAM-12665:
------------------------------------
Can we expand this issue so that it includes the Java API as well? Certainly a
useful feature as often a process needs to calculate metadata which is only
useful if the original filename is known, such as when generating storage
catalogs. This is currently available for text files but not any other format.
> Add option to return filename from ReadAll transforms
> -----------------------------------------------------
>
> Key: BEAM-12665
> URL: https://issues.apache.org/jira/browse/BEAM-12665
> Project: Beam
> Issue Type: New Feature
> Components: io-py-common
> Reporter: Inigo San Jose Visiers
> Priority: P2
> Time Spent: 5h 50m
> Remaining Estimate: 0h
>
> When using ReadAll transforms (as `ReadAllFromText` and similar), it would be
> great to add the option to also return the filename.
> This would help with an use case of reading multiple files that are not known
> at launch time and perform aggregations by file
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
