[
https://issues.apache.org/jira/browse/BEAM-6851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tim Robertson closed BEAM-6851.
-------------------------------
Resolution: Fixed
Fix Version/s: 2.12.0
Thanks for opening this and supplying the fix [~winkelman.kyle]
> HadoopFileSystem doesn't Support Recursive Globs (**)
> -----------------------------------------------------
>
> Key: BEAM-6851
> URL: https://issues.apache.org/jira/browse/BEAM-6851
> Project: Beam
> Issue Type: Improvement
> Components: io-java-hadoop
> Reporter: Kyle Winkelman
> Priority: Minor
> Fix For: 2.12.0
>
> Time Spent: 50m
> Remaining Estimate: 0h
>
> The LocalFileSystem supports recursive globs, **, through use of the [glob
> syntax|https://docs.oracle.com/javase/tutorial/essential/io/fileOps.html#glob]
> and it would be nice to similarly allow it in the HadoopFileSystem.
> The FileSystem docs say:
> {code:java}
> All FileSystem implementations should support glob in the final hierarchical
> path component of ResourceIdT. This allows SDK libraries to construct file
> system agnostic spec. FileSystems can support additional patterns for
> user-provided specs.
> {code}
> This clearly points out that recursive globs aren't required but may be
> supported as an additional pattern for user-provided specs.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)