[jira] [Commented] (HIVE-4019) Ability to create and drop temporary partition function
[ https://issues.apache.org/jira/browse/HIVE-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13643649#comment-13643649 ] Brock Noland commented on HIVE-4019: [~le...@hortonworks.com] Nice work on the docs! [~rhbutani] Just checking, was the +1 in response to the patch or Lefty's document comment? Ability to create and drop temporary partition function --- Key: HIVE-4019 URL: https://issues.apache.org/jira/browse/HIVE-4019 Project: Hive Issue Type: New Feature Components: PTF-Windowing Reporter: Ashutosh Chauhan Assignee: Brock Noland Attachments: HIVE-4019-1.patch, HIVE-4019.2.patch, HIVE-4019-3.patch, HIVE-4019-4.patch, HIVE-4019-5.patch, HIVE-4019-6.patch, HIVE-4019-7.patch, hive-4019.q Just like udf/udaf/udtf functions, user should be able to add and drop custom partitioning functions. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4019) Ability to create and drop temporary partition function
[ https://issues.apache.org/jira/browse/HIVE-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13643701#comment-13643701 ] Harish Butani commented on HIVE-4019: - +1 for the patch Ability to create and drop temporary partition function --- Key: HIVE-4019 URL: https://issues.apache.org/jira/browse/HIVE-4019 Project: Hive Issue Type: New Feature Components: PTF-Windowing Reporter: Ashutosh Chauhan Assignee: Brock Noland Attachments: HIVE-4019-1.patch, HIVE-4019.2.patch, HIVE-4019-3.patch, HIVE-4019-4.patch, HIVE-4019-5.patch, HIVE-4019-6.patch, HIVE-4019-7.patch, hive-4019.q Just like udf/udaf/udtf functions, user should be able to add and drop custom partitioning functions. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4019) Ability to create and drop temporary partition function
[ https://issues.apache.org/jira/browse/HIVE-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13643773#comment-13643773 ] Hudson commented on HIVE-4019: -- Integrated in Hive-trunk-h0.21 #2082 (See [https://builds.apache.org/job/Hive-trunk-h0.21/2082/]) HIVE-4019 : Ability to create and drop temporary partition function (Brock Noland via Ashutosh Chauhan) (Revision 1476646) Result = FAILURE hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1476646 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/FunctionInfo.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/FunctionRegistry.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/PTFFunctionInfo.java * /hive/trunk/ql/src/test/queries/clientpositive/ptf_register_tblfn.q * /hive/trunk/ql/src/test/results/clientpositive/ptf_register_tblfn.q.out * /hive/trunk/ql/src/test/results/clientpositive/show_functions.q.out Ability to create and drop temporary partition function --- Key: HIVE-4019 URL: https://issues.apache.org/jira/browse/HIVE-4019 Project: Hive Issue Type: New Feature Components: PTF-Windowing Reporter: Ashutosh Chauhan Assignee: Brock Noland Fix For: 0.12.0 Attachments: HIVE-4019-1.patch, HIVE-4019.2.patch, HIVE-4019-3.patch, HIVE-4019-4.patch, HIVE-4019-5.patch, HIVE-4019-6.patch, HIVE-4019-7.patch, hive-4019.q Just like udf/udaf/udtf functions, user should be able to add and drop custom partitioning functions. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4019) Ability to create and drop temporary partition function
[ https://issues.apache.org/jira/browse/HIVE-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13643777#comment-13643777 ] Hudson commented on HIVE-4019: -- Integrated in Hive-trunk-hadoop2 #179 (See [https://builds.apache.org/job/Hive-trunk-hadoop2/179/]) HIVE-4019 : Ability to create and drop temporary partition function (Brock Noland via Ashutosh Chauhan) (Revision 1476646) Result = FAILURE hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1476646 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/FunctionInfo.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/FunctionRegistry.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/PTFFunctionInfo.java * /hive/trunk/ql/src/test/queries/clientpositive/ptf_register_tblfn.q * /hive/trunk/ql/src/test/results/clientpositive/ptf_register_tblfn.q.out * /hive/trunk/ql/src/test/results/clientpositive/show_functions.q.out Ability to create and drop temporary partition function --- Key: HIVE-4019 URL: https://issues.apache.org/jira/browse/HIVE-4019 Project: Hive Issue Type: New Feature Components: PTF-Windowing Reporter: Ashutosh Chauhan Assignee: Brock Noland Fix For: 0.12.0 Attachments: HIVE-4019-1.patch, HIVE-4019.2.patch, HIVE-4019-3.patch, HIVE-4019-4.patch, HIVE-4019-5.patch, HIVE-4019-6.patch, HIVE-4019-7.patch, hive-4019.q Just like udf/udaf/udtf functions, user should be able to add and drop custom partitioning functions. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4019) Ability to create and drop temporary partition function
[ https://issues.apache.org/jira/browse/HIVE-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13642949#comment-13642949 ] Harish Butani commented on HIVE-4019: - +1 Ability to create and drop temporary partition function --- Key: HIVE-4019 URL: https://issues.apache.org/jira/browse/HIVE-4019 Project: Hive Issue Type: New Feature Components: PTF-Windowing Reporter: Ashutosh Chauhan Assignee: Brock Noland Attachments: HIVE-4019-1.patch, HIVE-4019.2.patch, HIVE-4019-3.patch, HIVE-4019-4.patch, HIVE-4019-5.patch, HIVE-4019-6.patch, HIVE-4019-7.patch, hive-4019.q Just like udf/udaf/udtf functions, user should be able to add and drop custom partitioning functions. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4019) Ability to create and drop temporary partition function
[
https://issues.apache.org/jira/browse/HIVE-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13642965#comment-13642965
]
Harish Butani commented on HIVE-4019:
-
[~le...@hortonworks.com] thanks for starting the documentation.
Not sure, maybe this works:
{noformat}
*** [Windowing and Analytics Functions|LanguageManual Windowingamp;Analytics]
{noformat}
Ability to create and drop temporary partition function
---
Key: HIVE-4019
URL: https://issues.apache.org/jira/browse/HIVE-4019
Project: Hive
Issue Type: New Feature
Components: PTF-Windowing
Reporter: Ashutosh Chauhan
Assignee: Brock Noland
Attachments: HIVE-4019-1.patch, HIVE-4019.2.patch, HIVE-4019-3.patch,
HIVE-4019-4.patch, HIVE-4019-5.patch, HIVE-4019-6.patch, HIVE-4019-7.patch,
hive-4019.q
Just like udf/udaf/udtf functions, user should be able to add and drop custom
partitioning functions.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4019) Ability to create and drop temporary partition function
[ https://issues.apache.org/jira/browse/HIVE-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13643546#comment-13643546 ] Lefty Leverenz commented on HIVE-4019: -- [Taking this off the JIRA] Thanks for the suggestion, Harish. I gave it a try, but found out we can't use semicolons or backslashes: So I abandoned the ampersand and spelled out WindowingAndAnalytics. The system fixed the link on the Language Manual page automatically. Now following the link gives the right URL: https://cwiki.apache.org/confluence/display/Hive/LanguageManual+WindowingAndAnalytics Good enough. – Lefty On Fri, Apr 26, 2013 at 11:42 AM, Harish Butani (JIRA) j...@apache.orgwrote: Ability to create and drop temporary partition function --- Key: HIVE-4019 URL: https://issues.apache.org/jira/browse/HIVE-4019 Project: Hive Issue Type: New Feature Components: PTF-Windowing Reporter: Ashutosh Chauhan Assignee: Brock Noland Attachments: HIVE-4019-1.patch, HIVE-4019.2.patch, HIVE-4019-3.patch, HIVE-4019-4.patch, HIVE-4019-5.patch, HIVE-4019-6.patch, HIVE-4019-7.patch, hive-4019.q Just like udf/udaf/udtf functions, user should be able to add and drop custom partitioning functions. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4019) Ability to create and drop temporary partition function
[ https://issues.apache.org/jira/browse/HIVE-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13643548#comment-13643548 ] Lefty Leverenz commented on HIVE-4019: -- Hm, so replying to an email thread doesn't take a conversation off the JIRA. Live learn. Ability to create and drop temporary partition function --- Key: HIVE-4019 URL: https://issues.apache.org/jira/browse/HIVE-4019 Project: Hive Issue Type: New Feature Components: PTF-Windowing Reporter: Ashutosh Chauhan Assignee: Brock Noland Attachments: HIVE-4019-1.patch, HIVE-4019.2.patch, HIVE-4019-3.patch, HIVE-4019-4.patch, HIVE-4019-5.patch, HIVE-4019-6.patch, HIVE-4019-7.patch, hive-4019.q Just like udf/udaf/udtf functions, user should be able to add and drop custom partitioning functions. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4019) Ability to create and drop temporary partition function
[ https://issues.apache.org/jira/browse/HIVE-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13642078#comment-13642078 ] Harish Butani commented on HIVE-4019: - - ok, glad you agree about isInternal. - a minor thing: FunctionRegistry::isTableFunction(String name) should also have the tFInfo.isTableFunction() check. - There is a several documents on Windowing PTFs; would be nice to extract pieces from them and update the wiki. - For windowing the doc attached on Jira 4197 has useful information on behavior. The function list should also be updated with the new ranking and navigation functions. - Will be great if you take this on; happy to support in anyway... Ability to create and drop temporary partition function --- Key: HIVE-4019 URL: https://issues.apache.org/jira/browse/HIVE-4019 Project: Hive Issue Type: New Feature Components: PTF-Windowing Reporter: Ashutosh Chauhan Assignee: Brock Noland Attachments: HIVE-4019-1.patch, HIVE-4019.2.patch, HIVE-4019-3.patch, HIVE-4019-4.patch, HIVE-4019-5.patch, HIVE-4019-6.patch, hive-4019.q Just like udf/udaf/udtf functions, user should be able to add and drop custom partitioning functions. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4019) Ability to create and drop temporary partition function
[ https://issues.apache.org/jira/browse/HIVE-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13642106#comment-13642106 ] Lefty Leverenz commented on HIVE-4019: -- Regarding the DOC issue -- there _will be_ a wiki for PTF-Windowing, I just need to convert it to wiki markup. So I'll tackle that task today, stay tuned Ability to create and drop temporary partition function --- Key: HIVE-4019 URL: https://issues.apache.org/jira/browse/HIVE-4019 Project: Hive Issue Type: New Feature Components: PTF-Windowing Reporter: Ashutosh Chauhan Assignee: Brock Noland Attachments: HIVE-4019-1.patch, HIVE-4019.2.patch, HIVE-4019-3.patch, HIVE-4019-4.patch, HIVE-4019-5.patch, HIVE-4019-6.patch, hive-4019.q Just like udf/udaf/udtf functions, user should be able to add and drop custom partitioning functions. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4019) Ability to create and drop temporary partition function
[ https://issues.apache.org/jira/browse/HIVE-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13642115#comment-13642115 ] Brock Noland commented on HIVE-4019: Updated patch with that last feedback item. Ability to create and drop temporary partition function --- Key: HIVE-4019 URL: https://issues.apache.org/jira/browse/HIVE-4019 Project: Hive Issue Type: New Feature Components: PTF-Windowing Reporter: Ashutosh Chauhan Assignee: Brock Noland Attachments: HIVE-4019-1.patch, HIVE-4019.2.patch, HIVE-4019-3.patch, HIVE-4019-4.patch, HIVE-4019-5.patch, HIVE-4019-6.patch, HIVE-4019-7.patch, hive-4019.q Just like udf/udaf/udtf functions, user should be able to add and drop custom partitioning functions. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4019) Ability to create and drop temporary partition function
[ https://issues.apache.org/jira/browse/HIVE-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13642252#comment-13642252 ] Lefty Leverenz commented on HIVE-4019: -- The wiki doc is ready for your additions and improvements: [Windowing and Analytics Functions|https://cwiki.apache.org/confluence/display/Hive/LanguageManual+WindowingAnalytics]. Off topic: Does the ampersand that I used in the wiki name LanguageManual WindowingAnalytics need to be escaped in order to get the address LanguageManual+WindowingAnalytics via a link? (I've figured out that there can't be any spaces except between LanguageManual and the title, but I don't understand how this works.) When I navigate to this wiki from the Language Manual page, it gets a generic address: https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=31819589. But the URL https://cwiki.apache.org/confluence/display/Hive/LanguageManual+WindowingAnalytics works too, and I'd like it to appear as the page address. Is this wiki feature documented anywhere? Ability to create and drop temporary partition function --- Key: HIVE-4019 URL: https://issues.apache.org/jira/browse/HIVE-4019 Project: Hive Issue Type: New Feature Components: PTF-Windowing Reporter: Ashutosh Chauhan Assignee: Brock Noland Attachments: HIVE-4019-1.patch, HIVE-4019.2.patch, HIVE-4019-3.patch, HIVE-4019-4.patch, HIVE-4019-5.patch, HIVE-4019-6.patch, HIVE-4019-7.patch, hive-4019.q Just like udf/udaf/udtf functions, user should be able to add and drop custom partitioning functions. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4019) Ability to create and drop temporary partition function
[ https://issues.apache.org/jira/browse/HIVE-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13640629#comment-13640629 ] Brock Noland commented on HIVE-4019: Added a few questions about the comments on RB. I also created HIVE-4415 to move the functions to contrib. I can pick that up when this is finished if no one else wants it. Ability to create and drop temporary partition function --- Key: HIVE-4019 URL: https://issues.apache.org/jira/browse/HIVE-4019 Project: Hive Issue Type: New Feature Components: PTF-Windowing Reporter: Ashutosh Chauhan Assignee: Ashutosh Chauhan Attachments: HIVE-4019-1.patch, HIVE-4019.2.patch, HIVE-4019-3.patch, HIVE-4019-4.patch, hive-4019.q Just like udf/udaf/udtf functions, user should be able to add and drop custom partitioning functions. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4019) Ability to create and drop temporary partition function
[ https://issues.apache.org/jira/browse/HIVE-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13641289#comment-13641289 ] Harish Butani commented on HIVE-4019: - Having problems logging into Phabricator today. So here are my comments: - Line 44: I agree - regarding isInternal vs isNative. isInternal was added to capture the fact that the WindowingTableFunction it is not available in a Query; so User's cannot directly use it, but a QuerySpec may contain it. Doesn't smell right to use isNative to capture this fact; but at this point it is a minor issue, will go with whatever you choose. - Line 184: yes its a documentation issue Ability to create and drop temporary partition function --- Key: HIVE-4019 URL: https://issues.apache.org/jira/browse/HIVE-4019 Project: Hive Issue Type: New Feature Components: PTF-Windowing Reporter: Ashutosh Chauhan Assignee: Brock Noland Attachments: HIVE-4019-1.patch, HIVE-4019.2.patch, HIVE-4019-3.patch, HIVE-4019-4.patch, HIVE-4019-5.patch, hive-4019.q Just like udf/udaf/udtf functions, user should be able to add and drop custom partitioning functions. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4019) Ability to create and drop temporary partition function
[ https://issues.apache.org/jira/browse/HIVE-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638515#comment-13638515 ] Harish Butani commented on HIVE-4019: - ok got it. Let me see how to do this. Should we do this in a separate Jira, though? Ability to create and drop temporary partition function --- Key: HIVE-4019 URL: https://issues.apache.org/jira/browse/HIVE-4019 Project: Hive Issue Type: New Feature Components: PTF-Windowing Reporter: Ashutosh Chauhan Assignee: Ashutosh Chauhan Attachments: HIVE-4019-1.patch, HIVE-4019.2.patch, HIVE-4019-3.patch, HIVE-4019-4.patch, hive-4019.q Just like udf/udaf/udtf functions, user should be able to add and drop custom partitioning functions. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4019) Ability to create and drop temporary partition function
[ https://issues.apache.org/jira/browse/HIVE-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638518#comment-13638518 ] Ashutosh Chauhan commented on HIVE-4019: Yeah.. that sounds alright. We can do it in separate jira. Ability to create and drop temporary partition function --- Key: HIVE-4019 URL: https://issues.apache.org/jira/browse/HIVE-4019 Project: Hive Issue Type: New Feature Components: PTF-Windowing Reporter: Ashutosh Chauhan Assignee: Ashutosh Chauhan Attachments: HIVE-4019-1.patch, HIVE-4019.2.patch, HIVE-4019-3.patch, HIVE-4019-4.patch, hive-4019.q Just like udf/udaf/udtf functions, user should be able to add and drop custom partitioning functions. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4019) Ability to create and drop temporary partition function
[
https://issues.apache.org/jira/browse/HIVE-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13637363#comment-13637363
]
Ashutosh Chauhan commented on HIVE-4019:
I think we should move {{noop}} and {{noopwithmap}} out of the core and into
the contrib. On their own they are not much useful apart from testing. Than we
should register contrib jar in our test and than all existing test should run.
That will also be a good test of this functionality.
Ability to create and drop temporary partition function
---
Key: HIVE-4019
URL: https://issues.apache.org/jira/browse/HIVE-4019
Project: Hive
Issue Type: New Feature
Components: PTF-Windowing
Reporter: Ashutosh Chauhan
Assignee: Ashutosh Chauhan
Attachments: HIVE-4019-1.patch, HIVE-4019.2.patch, HIVE-4019-3.patch,
HIVE-4019-4.patch, hive-4019.q
Just like udf/udaf/udtf functions, user should be able to add and drop custom
partitioning functions.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4019) Ability to create and drop temporary partition function
[ https://issues.apache.org/jira/browse/HIVE-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13637416#comment-13637416 ] Harish Butani commented on HIVE-4019: - But they let us test a lot of different combinations : join with ptf, view with ptf, ptf chains, map-side ptf, lateral view with ptf etc. Uncomfortable removing all these tests... Ability to create and drop temporary partition function --- Key: HIVE-4019 URL: https://issues.apache.org/jira/browse/HIVE-4019 Project: Hive Issue Type: New Feature Components: PTF-Windowing Reporter: Ashutosh Chauhan Assignee: Ashutosh Chauhan Attachments: HIVE-4019-1.patch, HIVE-4019.2.patch, HIVE-4019-3.patch, HIVE-4019-4.patch, hive-4019.q Just like udf/udaf/udtf functions, user should be able to add and drop custom partitioning functions. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4019) Ability to create and drop temporary partition function
[ https://issues.apache.org/jira/browse/HIVE-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13637462#comment-13637462 ] Ashutosh Chauhan commented on HIVE-4019: Nah.. I am not suggesting to remove the tests. I am suggesting to move noop and noopwithmap to contrib/ and then register them in .q file and use. None of the tests should get affected by it. Only that instead of prepackaging those functions in core, we keep them in contrib and use them in our tests. Ability to create and drop temporary partition function --- Key: HIVE-4019 URL: https://issues.apache.org/jira/browse/HIVE-4019 Project: Hive Issue Type: New Feature Components: PTF-Windowing Reporter: Ashutosh Chauhan Assignee: Ashutosh Chauhan Attachments: HIVE-4019-1.patch, HIVE-4019.2.patch, HIVE-4019-3.patch, HIVE-4019-4.patch, hive-4019.q Just like udf/udaf/udtf functions, user should be able to add and drop custom partitioning functions. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4019) Ability to create and drop temporary partition function
[ https://issues.apache.org/jira/browse/HIVE-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13635470#comment-13635470 ] Brock Noland commented on HIVE-4019: https://reviews.facebook.net/D10353 Ability to create and drop temporary partition function --- Key: HIVE-4019 URL: https://issues.apache.org/jira/browse/HIVE-4019 Project: Hive Issue Type: New Feature Components: PTF-Windowing Reporter: Ashutosh Chauhan Assignee: Ashutosh Chauhan Attachments: HIVE-4019-1.patch, HIVE-4019.2.patch, HIVE-4019-3.patch, HIVE-4019-4.patch, hive-4019.q Just like udf/udaf/udtf functions, user should be able to add and drop custom partitioning functions. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4019) Ability to create and drop temporary partition function
[ https://issues.apache.org/jira/browse/HIVE-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13634087#comment-13634087 ] Brock Noland commented on HIVE-4019: Hi, Thanks! Too be honest, I haven't looked at noop much. It was just used in the original patch. I'look at your updated patch and see what more work needs to be done. Ability to create and drop temporary partition function --- Key: HIVE-4019 URL: https://issues.apache.org/jira/browse/HIVE-4019 Project: Hive Issue Type: New Feature Components: PTF-Windowing Reporter: Ashutosh Chauhan Assignee: Ashutosh Chauhan Attachments: HIVE-4019-1.patch, HIVE-4019.2.patch, hive-4019.q Just like udf/udaf/udtf functions, user should be able to add and drop custom partitioning functions. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4019) Ability to create and drop temporary partition function
[ https://issues.apache.org/jira/browse/HIVE-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13633237#comment-13633237 ] Brock Noland commented on HIVE-4019: Hi, Yes I am taking a look at this at present. I'll update this later today with my progress. Ability to create and drop temporary partition function --- Key: HIVE-4019 URL: https://issues.apache.org/jira/browse/HIVE-4019 Project: Hive Issue Type: New Feature Components: PTF-Windowing Reporter: Ashutosh Chauhan Assignee: Ashutosh Chauhan Attachments: hive-4019.q Just like udf/udaf/udtf functions, user should be able to add and drop custom partitioning functions. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4019) Ability to create and drop temporary partition function
[ https://issues.apache.org/jira/browse/HIVE-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13633694#comment-13633694 ] Harish Butani commented on HIVE-4019: - Yes don't use Noop. It is special; since it doesn't change the data in anyway the PTFOp just hands over what it gets to the next Op. The Translation layer knows about it and treats it in a special way. Noop and NoopMap are there just to test the framework. Just changed your test to use Npath. It works. Patch is attached. Ability to create and drop temporary partition function --- Key: HIVE-4019 URL: https://issues.apache.org/jira/browse/HIVE-4019 Project: Hive Issue Type: New Feature Components: PTF-Windowing Reporter: Ashutosh Chauhan Assignee: Ashutosh Chauhan Attachments: HIVE-4019-1.patch, HIVE-4019.2.patch, hive-4019.q Just like udf/udaf/udtf functions, user should be able to add and drop custom partitioning functions. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4019) Ability to create and drop temporary partition function
[ https://issues.apache.org/jira/browse/HIVE-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13631869#comment-13631869 ] Ashutosh Chauhan commented on HIVE-4019: [~brocknoland] Are you still interested in this? If possible, it will be good to have this in 0.10 release. Ability to create and drop temporary partition function --- Key: HIVE-4019 URL: https://issues.apache.org/jira/browse/HIVE-4019 Project: Hive Issue Type: New Feature Components: PTF-Windowing Reporter: Ashutosh Chauhan Assignee: Ashutosh Chauhan Attachments: hive-4019.q Just like udf/udaf/udtf functions, user should be able to add and drop custom partitioning functions. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4019) Ability to create and drop temporary partition function
[ https://issues.apache.org/jira/browse/HIVE-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13623724#comment-13623724 ] Brock Noland commented on HIVE-4019: I'll pick this up! Ability to create and drop temporary partition function --- Key: HIVE-4019 URL: https://issues.apache.org/jira/browse/HIVE-4019 Project: Hive Issue Type: New Feature Components: PTF-Windowing Reporter: Ashutosh Chauhan Assignee: Ashutosh Chauhan Attachments: hive-4019.q Just like udf/udaf/udtf functions, user should be able to add and drop custom partitioning functions. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4019) Ability to create and drop temporary partition function
[
https://issues.apache.org/jira/browse/HIVE-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13577843#comment-13577843
]
Ashutosh Chauhan commented on HIVE-4019:
Stack-trace:
{code}
java.lang.RuntimeException: Error in configuring object
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at
org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at
org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:484)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:419)
at org.apache.hadoop.mapred.Child$4.run(Child.java:259)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
at org.apache.hadoop.mapred.Child.main(Child.java:253)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 9 more
Caused by: java.lang.RuntimeException: Reduce operator initialization failed
at
org.apache.hadoop.hive.ql.exec.ExecReducer.configure(ExecReducer.java:160)
... 14 more
Caused by: java.lang.NullPointerException
at
org.apache.hadoop.hive.ql.exec.FunctionRegistry.getTableFunctionResolver(FunctionRegistry.java:1462)
at
org.apache.hadoop.hive.ql.parse.PTFTranslator$PTFDefDeserializer.preVisit(PTFTranslator.java:2568)
at
org.apache.hadoop.hive.ql.parse.PTFTranslator$PTFDefWalker.walk(PTFTranslator.java:2329)
at
org.apache.hadoop.hive.ql.parse.PTFTranslator$PTFDefWalker.walkInputChain(PTFTranslator.java:2305)
at
org.apache.hadoop.hive.ql.parse.PTFTranslator$PTFDefWalker.walk(PTFTranslator.java:2268)
at
org.apache.hadoop.hive.ql.exec.PTFOperator.reconstructQueryDef(PTFOperator.java:159)
at
org.apache.hadoop.hive.ql.exec.PTFOperator.initializeOp(PTFOperator.java:70)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:377)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:481)
at
org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:409)
at
org.apache.hadoop.hive.ql.exec.ExtractOperator.initializeOp(ExtractOperator.java:40)
at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:377)
at
org.apache.hadoop.hive.ql.exec.ExecReducer.configure(ExecReducer.java:152)
... 14 more
{code}
Since the way how PTFOperator is initialized in map/reduce tasks at runtime is
refactored by Harish at the moment, I will wait till that refactoring completes
to see if this issue still exists after that work is complete.
Ability to create and drop temporary partition function
---
Key: HIVE-4019
URL: https://issues.apache.org/jira/browse/HIVE-4019
Project: Hive
Issue Type: New Feature
Components: PTF-Windowing
Reporter: Ashutosh Chauhan
Assignee: Ashutosh Chauhan
Attachments: hive-4019.q
Just like udf/udaf/udtf functions, user should be able to add and drop custom
partitioning functions.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
