[ 
https://issues.apache.org/jira/browse/PIG-3299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Daniel Dai updated PIG-3299:
----------------------------

    Attachment: PIG-3299-2.patch

Get TestHBaseStorage failure, but that even fail on trunk:
    [junit] Running org.apache.pig.test.TestHBaseStorage
    [junit] Tests run: 26, Failures: 5, Errors: 19, Time elapsed: 595.821 sec

I will open a separate Jira for it.

Reattach patch with resync and upgrade to Hadoop 1.0.4.

However, the patch will break users with old version of Hadoop. Can we make it 
not breaking them?

> Provide support for LazyOutputFormat to avoid creating empty files
> ------------------------------------------------------------------
>
>                 Key: PIG-3299
>                 URL: https://issues.apache.org/jira/browse/PIG-3299
>             Project: Pig
>          Issue Type: Improvement
>    Affects Versions: 0.11.1
>            Reporter: Rohini Palaniswamy
>            Assignee: Lorand Bendig
>         Attachments: PIG-3299-2.patch, PIG-3299.patch
>
>
> LazyOutputFormat (HADOOP-4927) in hadoop is a wrapper to avoid creating part 
> files if there is no records output. It would be good to add support for that 
> by having a configuration in pig which wraps storeFunc.getOutputFormat() with 
> LazyOutputFormat. 



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Reply via email to