[
https://issues.apache.org/jira/browse/PIG-3717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jarek Jarcec Cecho updated PIG-3717:
------------------------------------
Description: We've noticed that when we generate couple of sub-directories
with Oozie and then use AvroStorage (the older version from PiggyBank) to load
those directories, hidden files such as {{_SUCCESS}} won't get ignored as they
should be and in turn will cause failures in the Pig job. This seems to be
regression caused by PIG-3223. (was: We've noticed that when we generate
couple of sub-directories with Oozie and then use AvroStorage (the older
version from PiggyBank) to load those directories, hidden files such as
{{_SUCCESS}} won't get ignored as they should be and in turn will cause
failures in the Pig job.)
> AvroStorage is not filtering hidden files on directory recursion
> ----------------------------------------------------------------
>
> Key: PIG-3717
> URL: https://issues.apache.org/jira/browse/PIG-3717
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.12.0
> Reporter: Jarek Jarcec Cecho
> Assignee: Jarek Jarcec Cecho
> Fix For: 0.13.0
>
> Attachments: PIG-3717.patch
>
>
> We've noticed that when we generate couple of sub-directories with Oozie and
> then use AvroStorage (the older version from PiggyBank) to load those
> directories, hidden files such as {{_SUCCESS}} won't get ignored as they
> should be and in turn will cause failures in the Pig job. This seems to be
> regression caused by PIG-3223.
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)