[
https://issues.apache.org/jira/browse/PIG-3717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13880337#comment-13880337
]
Rohini Palaniswamy commented on PIG-3717:
-----------------------------------------
I actually fixed this and couple of other issues with AvroStorage as part of
PIG-3661. Also did some cleanup w.r.t to getAllSubDirs() method. Had the patch
done for 0.11. Will rebase and put up the patch soon.
> AvroStorage is not filtering hidden files on directory recursion
> ----------------------------------------------------------------
>
> Key: PIG-3717
> URL: https://issues.apache.org/jira/browse/PIG-3717
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.12.0
> Reporter: Jarek Jarcec Cecho
> Assignee: Jarek Jarcec Cecho
> Fix For: 0.13.0
>
> Attachments: PIG-3717.patch, PIG-3717.patch
>
>
> We've noticed that when we generate couple of sub-directories with Oozie and
> then use AvroStorage (the older version from PiggyBank) to load those
> directories, hidden files such as {{_SUCCESS}} won't get ignored as they
> should be and in turn will cause failures in the Pig job. This seems to be
> regression caused by PIG-3223.
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)
