[
https://issues.apache.org/jira/browse/GIRAPH-761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manuel Lagang updated GIRAPH-761:
---------------------------------
Description:
If a folder is given as an input path to GiraphFileInputFormat, the default
hidden file filter is not applied to the files in the folder. That is, hidden
files (e.g. files preceded by underscores) that would not normally be handled
if targeted directly are unexpectedly being passed as input if the parent
folder is targeted instead.
I would expect that when a folder is specified as input, only *non-hidden*
files in that folder will be processed. This is consistent with the base hadoop
FileInputFormat.
was:
If a folder is given as an input path to GiraphFileInputFormat, the default
hidden file filter is not applied to the files in the folder. That is, hidden
files (e.g. files preceded by underscores) that would not normally be handled
if targeted directly are unexpectedly being passed as input if the parent
folder is passed instead.
I would expect that when a folder is specified as input, only *non-hidden*
files in that folder will be processed. This is consistent with the base hadoop
FileInputFormat.
> GiraphFileInputFormat ignores hidden file filter in folders
> -----------------------------------------------------------
>
> Key: GIRAPH-761
> URL: https://issues.apache.org/jira/browse/GIRAPH-761
> Project: Giraph
> Issue Type: Bug
> Components: graph
> Affects Versions: 1.1.0
> Reporter: Manuel Lagang
> Priority: Minor
> Fix For: 1.1.0
>
> Attachments: GIRAPH-761.patch
>
>
> If a folder is given as an input path to GiraphFileInputFormat, the default
> hidden file filter is not applied to the files in the folder. That is, hidden
> files (e.g. files preceded by underscores) that would not normally be handled
> if targeted directly are unexpectedly being passed as input if the parent
> folder is targeted instead.
> I would expect that when a folder is specified as input, only *non-hidden*
> files in that folder will be processed. This is consistent with the base
> hadoop FileInputFormat.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira