Matthew Hayes closed DATAFU-71.
    Resolution: Won't Do

Closing this as it is quite old and there have been no updates.

> Create IncrementalAvroStorage UDF for incrementally processing date 
> partitioned data
> ------------------------------------------------------------------------------------
>                 Key: DATAFU-71
>                 URL: https://issues.apache.org/jira/browse/DATAFU-71
>             Project: DataFu
>          Issue Type: New Feature
>            Reporter: Matthew Hayes
>            Assignee: Matthew Hayes
>            Priority: Major
>         Attachments: DATAFU-71.patch
> Data can sometimes be stored in HDFS in a time-partitioned manner, e.g. 
> /some/input/yyyy/mm/dd.  You may want to process this data incrementally, 
> where the output has a format like /some/output/yyyy/mm/dd.  It be useful if 
> there is a UDF that handles the incremental processing for you.

This message was sent by Atlassian Jira

Reply via email to