[
https://issues.apache.org/jira/browse/BEAM-2150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15995050#comment-15995050
]
Daniel Halperin commented on BEAM-2150:
---------------------------------------
Take a look at {{GcsFileSystem}}. In general, {{FileSystem}} API defines globs
on the level of the underlying storage system – so we exactly use GCS globs for
what they are. I do not think GCS APIs directly support recursive expansion.
I'd rather suspect you should build a utility in {{FileSystems}} that is able
to do recursive expansion (using {{ResourceId#isDirectory}}) and then it will
apply to any filesystem.
(That said, if you consider the issues and have a different recommendation
please comment / open a PR / etc.)
> Support for recursive wildcards in GcsPath
> ------------------------------------------
>
> Key: BEAM-2150
> URL: https://issues.apache.org/jira/browse/BEAM-2150
> Project: Beam
> Issue Type: New Feature
> Components: sdk-java-core, sdk-java-gcp
> Reporter: Devon Meunier
> Assignee: Devon Meunier
> Priority: Minor
>
> When working with heavily nested folder structures in Google Cloud Storage,
> it's great to make use of recursive wildcards, which the current API
> explicitly does not support.
> This code hasn't been touched in 2 years so it's likely that simply no one's
> gotten around to it yet.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
