[ 
https://issues.apache.org/jira/browse/DATAFU-71?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Matthew Hayes closed DATAFU-71.
-------------------------------
    Resolution: Won't Do

Closing this as it is quite old and there have been no updates.

> Create IncrementalAvroStorage UDF for incrementally processing date 
> partitioned data
> ------------------------------------------------------------------------------------
>
>                 Key: DATAFU-71
>                 URL: https://issues.apache.org/jira/browse/DATAFU-71
>             Project: DataFu
>          Issue Type: New Feature
>            Reporter: Matthew Hayes
>            Assignee: Matthew Hayes
>            Priority: Major
>         Attachments: DATAFU-71.patch
>
>
> Data can sometimes be stored in HDFS in a time-partitioned manner, e.g. 
> /some/input/yyyy/mm/dd.  You may want to process this data incrementally, 
> where the output has a format like /some/output/yyyy/mm/dd.  It be useful if 
> there is a UDF that handles the incremental processing for you.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to