[
https://issues.apache.org/jira/browse/OOZIE-1741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13946459#comment-13946459
]
Satish Mittal commented on OOZIE-1741:
--------------------------------------
Adding comments from reviewboard:
{noformat}
*Rohini Palaniswamy Posted 4 days, 19 hours ago (March 20, 2014, 4:57 p.m.)*
What is the expected string to be returned from the function, when the data-in
has current(0) to current(-23)? Can you give some examples where more than one
instance of the dataset is involved?
*Satish Mittal 4 days, 5 hours ago (March 21, 2014, 7:08 a.m.)*
Hi, This function is intended to be used when there is only one data-set
instance. E.g. for current(0), a sample output is:
(year='2014',month='03',day='11',hour='09',minute='00')
I haven't added a check for multiple instances scenario. Will do that in the
updated patch.
{noformat}
{noformat}
*Ryota Egashira Posted 17 hours, 27 minutes ago (March 24, 2014, 7:11 p.m.)*
in addition to rohini's comment.
how about making it more generic EL funct, where user can specify
separator(e.,g ',' 'AND' 'OR') and equal symbol (e.g, '=', '==', etc) in
argument?, since there could be new requirement in future more than "," "="
pair for hive export/import.
current dataInPartitionFilter somehow trying to hide the detail, only asking
user to specify action type to make it easy. but also good to provide new
configurable EL funct for those who know what they are doing.
*Satish Mittal 7 minutes ago (March 25, 2014, 12:32 p.m.)*
Hi Ryota,
I like your idea of generalizing various aspects of new EL function (separator,
equal symbol) so that it can handle newer use-cases to generate single
partition value in future, without the need to add a new function for each of
them. Will do that.
{noformat}
> Add new coord EL function to get input partitions value string
> --------------------------------------------------------------
>
> Key: OOZIE-1741
> URL: https://issues.apache.org/jira/browse/OOZIE-1741
> Project: Oozie
> Issue Type: Improvement
> Reporter: Satish Mittal
> Assignee: Satish Mittal
> Attachments: OOZIE-1741.patch.txt
>
>
> Currently oozie provides coord EL functions to get partition filter string
> (where key-values are separated by AND) for various action types -
> java/pig/hive. However this doesn't work in other cases, e.g. hive action
> that performs export/import of hive partition. In that case, the partition
> value is expected to be in a different format:
> (col1="value1",col2="value2"...). We need to add a new EL function that
> returns partition value in the above format.
--
This message was sent by Atlassian JIRA
(v6.2#6252)