[ 
https://issues.apache.org/jira/browse/PIG-1298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Richard Ding updated PIG-1298:
------------------------------

    Attachment: PIG-1298.patch

This patch added PigFileInputFormat, PigTextInputFormat and 
PigSequenceFileInputFormat to support multi-level/recursive file listing for 
the loaders. This is a stopgap until MAPREDUCE-1577 is fixed.

As a consequence, custom loaders (existing or new) that use Hadoop text-based 
InputFormat and would like to support this feature should use the corresponding 
Pig InputFormat.

> Restore file traversal behavior to Pig loaders
> ----------------------------------------------
>
>                 Key: PIG-1298
>                 URL: https://issues.apache.org/jira/browse/PIG-1298
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.7.0
>            Reporter: Richard Ding
>            Assignee: Richard Ding
>             Fix For: 0.7.0
>
>         Attachments: PIG-1298.patch
>
>
> Given a location to a Pig loader, it is expected to recursively load all the 
> files under the location (i.e., all the files returned with  "ls -R" 
> command). However, after the transition to using Hadoop 20 API,  only files 
> returned with "ls" command are loaded.
>  
>   

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply via email to