[
https://issues.apache.org/jira/browse/PIG-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhijie Shen updated PIG-1314:
-----------------------------
Attachment: PIG-1314-7.patch
Hi Thejas,
I've updated the patch again. I'll be sorry if it disturbs your review of the
code. In the latest version, I added three more datetime related UDFs and
related test cases according to Russell's suggestion:
1. WeeksBetween
2. GetWeek
3. GetWeekYear
In addition, I modify the code of XXXXBetween UDFs. Previously, all the UDFs in
this category leverages joda to compute the interval. While joda can only
return the integer interval, the actual interval is likely to be so big that it
has to be stored in a long variable. Therefore, for the datetime fields of
fixed length:
1. MilliSecondsBetween
2. SecondsBetween
3. MinutesBetween
4. HoursBetween
5. DaysBetween
6. WeeksBetween
I adopted my our computation methods. On the other side, fot the datetime
fields of flexible length:
1. MonthsBetween
2. YearsBetween
I keep to the joda methods. We may improve this later.
At last, I remove the DiffDate UDF, because it is the same as DaysBetween.
> Add DateTime Support to Pig
> ---------------------------
>
> Key: PIG-1314
> URL: https://issues.apache.org/jira/browse/PIG-1314
> Project: Pig
> Issue Type: Bug
> Components: data
> Affects Versions: 0.7.0
> Reporter: Russell Jurney
> Assignee: Zhijie Shen
> Labels: gsoc2012
> Attachments: joda_vs_builtin.zip, PIG-1314-1.patch, PIG-1314-2.patch,
> PIG-1314-3.patch, PIG-1314-4.patch, PIG-1314-5.patch, PIG-1314-6.patch,
> PIG-1314-7.patch
>
> Original Estimate: 672h
> Remaining Estimate: 672h
>
> Hadoop/Pig are primarily used to parse log data, and most logs have a
> timestamp component. Therefore Pig should support dates as a primitive.
> Can someone familiar with adding types to pig comment on how hard this is?
> We're looking at doing this, rather than use UDFs. Is this a patch that
> would be accepted?
> This is a candidate project for Google summer of code 2012. More information
> about the program can be found at
> https://cwiki.apache.org/confluence/display/PIG/GSoc2012
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
