date:20130904

[jira] [Commented] (HIVE-5049) Create an ORC test case that has a 0.11 ORC file

2013-09-04 Thread Hudson (JIRA)


[ 
https://issues.apache.org/jira/browse/HIVE-5049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13758029#comment-13758029
 ] 

Hudson commented on HIVE-5049:
--

SUCCESS: Integrated in Hive-trunk-h0.21 #2309 (See 
[https://builds.apache.org/job/Hive-trunk-h0.21/2309/])
HIVE-5049 : Create an ORC test case that has a 0.11 ORC file (Prasanth J via 
Ashutosh Chauhan) (hashutosh: 
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519868)
* /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/io/orc/TestOrcFile.java
* /hive/trunk/ql/src/test/resources/orc-file-11-format.orc


 Create an ORC test case that has a 0.11 ORC file
 

 Key: HIVE-5049
 URL: https://issues.apache.org/jira/browse/HIVE-5049
 Project: Hive
  Issue Type: Bug
Reporter: Owen O'Malley
Assignee: Prasanth J
 Fix For: 0.12.0

 Attachments: HIVE-5049.patch.txt, orc-file-11-format.orc


 We should add a test case that includes a 0.11.0 ORC file to ensure 
 compatibility for reading old ORC files is kept correct.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-5129) Multiple table insert fails on count(distinct)

2013-09-04 Thread Hudson (JIRA)


[ 
https://issues.apache.org/jira/browse/HIVE-5129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13758024#comment-13758024
 ] 

Hudson commented on HIVE-5129:
--

SUCCESS: Integrated in Hive-trunk-h0.21 #2309 (See 
[https://builds.apache.org/job/Hive-trunk-h0.21/2309/])
HIVE-5129 Multiple table insert fails on count distinct (Vikram Dixit via 
Harish Butani) (rhbutani: 
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519764)
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java
* /hive/trunk/ql/src/test/queries/clientpositive/multi_insert_gby3.q
* /hive/trunk/ql/src/test/results/clientpositive/multi_insert_gby3.q.out


 Multiple table insert fails on count(distinct)
 --

 Key: HIVE-5129
 URL: https://issues.apache.org/jira/browse/HIVE-5129
 Project: Hive
  Issue Type: Bug
  Components: Query Processor
Affects Versions: 0.11.0
Reporter: Vikram Dixit K
Assignee: Vikram Dixit K
 Fix For: 0.12.0

 Attachments: aggrTestMultiInsertData1.txt, 
 aggrTestMultiInsertData.txt, aggrTestMultiInsert.q, HIVE-5129.1.patch.txt, 
 HIVE-5129.2.WIP.patch.txt, HIVE-5129.3.patch.txt, HIVE-5129.4.patch, 
 HIVE-5129.4.patch.txt


 Hive fails with a class cast exception on queries of the form:
 {noformat}
 from studenttab10k
 insert overwrite table multi_insert_2_1
 select name, avg(age) as avgage
 group by name
 insert overwrite table multi_insert_2_2
 select name, age, sum(gpa) as sumgpa
 group by name, age
 insert overwrite table multi_insert_2_3
 select name, count(distinct age) as distage
 group by name;
 {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-4750) Fix TestCliDriver.list_bucket_dml_{6,7,8}.q on 0.23

2013-09-04 Thread Hudson (JIRA)


[ 
https://issues.apache.org/jira/browse/HIVE-4750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13758020#comment-13758020
 ] 

Hudson commented on HIVE-4750:
--

SUCCESS: Integrated in Hive-trunk-h0.21 #2309 (See 
[https://builds.apache.org/job/Hive-trunk-h0.21/2309/])
HIVE-4750 : Fix TestCliDriver.list_bucket_dml_{6,7,8}.q on 0.23 (Prasanth J via 
Ashutosh Chauhan) (hashutosh: 
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519857)
* /hive/trunk/ql/src/test/queries/clientpositive/list_bucket_dml_6.q
* /hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_6.q.out


 Fix TestCliDriver.list_bucket_dml_{6,7,8}.q on 0.23
 ---

 Key: HIVE-4750
 URL: https://issues.apache.org/jira/browse/HIVE-4750
 Project: Hive
  Issue Type: Sub-task
Affects Versions: 0.12.0
Reporter: Brock Noland
Assignee: Prasanth J
 Fix For: 0.12.0

 Attachments: HIVE-4750.2.patch, HIVE-4750.patch


 Removing 6,7,8 from the scope of HIVE-4746.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Re: HIVE-5104 patch status?

2013-09-04 Thread Sushanth Sowmyan

Hi Karl,

Looks like we crossed streams. :)

I started reviewing your patch last thursday, and committed it
yesterday. I had to run some tests before incorporating your patch. I
did initially comment up asking for patch regeneration since your
patch did not apply cleanly for me on trunk, and also had some
whitespacing errors, but I decided to go ahead and tidy up the patch
to apply instead of holding you up.

Since 0.11 has been released, unless it's an important bugfix, or
unless we do a re-release of 0.11, we would not be applying it on that
branch. In this case, since it's more akin to a feature introduction,
it should be part of our next 0.12 release.

Thanks for your contribution!




On Wed, Sep 4, 2013 at 9:21 AM, Edward Capriolo edlinuxg...@gmail.com wrote:
 I'm not sure I understand what you are saying I see plenty of comments on
 your ticket.

 http://www.apache.org/dev/committers.html#committer-responsibilities

 Applying patches
 In order to grow and maintain healthy communities, committers need to
 discuss, review and apply patches submitted by volunteers. The Committers
 are also responsible for the quality and IP clearance of the code that goes
 into ASF repositories.
 Helping users
 Committers should monitor both the dev and user lists for the projects that
 they work on and (collectively) provide prompt and useful responses to
 questions from users.
 Monitoring commits and issues
 Committers should review commit email messages for their projects and point
 out anything that looks funny or that may bring in IP issues. Monitoring
 Bugzilla / Jira for bugs or enhancement requests is also a responsibility
 of Committers.

 Generally we (committers  pmc) attempt to wade though the open jira issues
 and review and commit open issues. Not all of us are full time, and not all
 of us specialize across the entire code base, so the length of time a patch
 can stay out there is variable.

 My process is this:
 Review jira for things marked PATCH AVAILABLE
 If I understand the scope of the issue I review it and leave comments.
 If ready I wait for the test and then commit.

 I personally try to maintain a balance of 75% writing code 25% review but
 lately I am about 80% review 20% code. I would like us to move to a road
 map and feature based releases with smaller tuck-in issues. At the moment
 everything that flows into our jira looks the same to me as we have
 people going into several different directions, it makes it fairly hard to
 order the incoming issues in priority.





 On Wed, Sep 4, 2013 at 8:42 AM, Brock Noland br...@cloudera.com wrote:

 Hi,

 Looks like your patch has been committed, but I just wanted to confirm
 for those lurking. If you have a patch up on a JIRA, emailing the dev
 list is one of the correct ways of engaging a committer. IRC is also a
 viable strategy.

 Thanks for your contribution!!

 Cheers,
 Brock

 On Tue, Sep 3, 2013 at 1:59 PM, Karl Gierach k...@sourcethought.com
 wrote:
  Hi,
 
  We at Sourcethought have contributed at patch to fix JIRA issue
 HIVE-5104 about 2 weeks back, although it appears that this patch has not
 received any comments.
 
  The patch is relevant for the both github Hive branch-0.11 and the
 trunk, as both source files were not changed since the 0.11 branch was
 created.
 
  What steps need to be taken to incorporate this patch into the next
 release?  Do we need to request approval from a committer?
 
  Best Regards,
 
  Karl Gierach
  Lead Engineer
  SourceThought, Inc.



 --
 Apache MRUnit - Unit testing MapReduce - http://mrunit.apache.org

[jira] [Commented] (HIVE-4442) [HCatalog] WebHCat should not override user.name parameter for Queue call

2013-09-04 Thread Hudson (JIRA)


[ 
https://issues.apache.org/jira/browse/HIVE-4442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13758022#comment-13758022
 ] 

Hudson commented on HIVE-4442:
--

SUCCESS: Integrated in Hive-trunk-h0.21 #2309 (See 
[https://builds.apache.org/job/Hive-trunk-h0.21/2309/])
HIVE-4442: WebHCat should not override user.name parameter for Queue call 
(Daniel Dai) (daijy: 
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519875)
* /hive/trunk/RELEASE_NOTES.txt
* 
/hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/DeleteDelegator.java
* 
/hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/ListDelegator.java
* 
/hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/Server.java
* 
/hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/StatusDelegator.java
* 
/hive/trunk/shims/src/0.20/java/org/apache/hadoop/hive/shims/Hadoop20Shims.java
* 
/hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/shims/Hadoop20SShims.java
* 
/hive/trunk/shims/src/0.20S/java/org/apache/hadoop/mapred/WebHCatJTShim20S.java
* 
/hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java
* /hive/trunk/shims/src/0.23/java/org/apache/hadoop/mapred/WebHCatJTShim23.java
* 
/hive/trunk/shims/src/common/java/org/apache/hadoop/hive/shims/HadoopShims.java


 [HCatalog] WebHCat should not override user.name parameter for Queue call
 -

 Key: HIVE-4442
 URL: https://issues.apache.org/jira/browse/HIVE-4442
 Project: Hive
  Issue Type: Bug
  Components: HCatalog
Reporter: Daniel Dai
Assignee: Daniel Dai
 Fix For: 0.12.0

 Attachments: HIVE-4442-1.patch, HIVE-4442-2.patch, HIVE-4442-3.patch


 Currently templeton for the Queue call uses the user.name to filter the 
 results of the call in addition to the default security.
 Ideally the filter is an optional parameter to the call independent of the 
 security check.
 I would suggest a parameter in addition to GET queue (jobs) give you all the 
 jobs a user have permission:
 GET queue?showall=true

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-4586) [HCatalog] WebHCat should return 404 error for undefined resource

2013-09-04 Thread Hudson (JIRA)


[ 
https://issues.apache.org/jira/browse/HIVE-4586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13758027#comment-13758027
 ] 

Hudson commented on HIVE-4586:
--

SUCCESS: Integrated in Hive-trunk-h0.21 #2309 (See 
[https://builds.apache.org/job/Hive-trunk-h0.21/2309/])
[HIVE-4586] - WebHCat should return 404 error for undefined resource (Daniel 
Dai) (daijy: 
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519818)
* /hive/trunk/RELEASE_NOTES.txt
* 
/hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/CatchallExceptionMapper.java
* 
/hive/trunk/hcatalog/webhcat/svr/src/test/java/org/apache/hcatalog/templeton/TestWebHCatE2e.java


 [HCatalog] WebHCat should return 404 error for undefined resource
 -

 Key: HIVE-4586
 URL: https://issues.apache.org/jira/browse/HIVE-4586
 Project: Hive
  Issue Type: Bug
  Components: HCatalog
Affects Versions: 0.11.0
Reporter: Daniel Dai
Assignee: Daniel Dai
 Fix For: 0.12.0

 Attachments: HIVE-4586-1.patch, HIVE-4586-2.patch




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-5145) Fix TestCliDriver.list_bucket_query_multiskew_2.q on hadoop 0.23

2013-09-04 Thread Hudson (JIRA)


[ 
https://issues.apache.org/jira/browse/HIVE-5145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13758026#comment-13758026
 ] 

Hudson commented on HIVE-5145:
--

SUCCESS: Integrated in Hive-trunk-h0.21 #2309 (See 
[https://builds.apache.org/job/Hive-trunk-h0.21/2309/])
HIVE-5145 : Fix TestCliDriver.list_bucket_query_multiskew_2.q on hadoop 0.23 
(Prasanth J via Ashutosh Chauhan) (hashutosh: 
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519862)
* /hive/trunk/ql/src/test/queries/clientpositive/list_bucket_query_multiskew_2.q
* 
/hive/trunk/ql/src/test/results/clientpositive/list_bucket_query_multiskew_2.q.out


 Fix TestCliDriver.list_bucket_query_multiskew_2.q on hadoop 0.23
 

 Key: HIVE-5145
 URL: https://issues.apache.org/jira/browse/HIVE-5145
 Project: Hive
  Issue Type: Bug
  Components: Tests
Reporter: Prasanth J
Assignee: Prasanth J
 Fix For: 0.12.0

 Attachments: HIVE-5145.2.patch, HIVE-5145.patch


 there is some determinism related to the output of 
 list_bucket_query_multiskew_2.q test case. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-5096) Add q file tests for ORC predicate pushdown

2013-09-04 Thread Hudson (JIRA)


[ 
https://issues.apache.org/jira/browse/HIVE-5096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13758028#comment-13758028
 ] 

Hudson commented on HIVE-5096:
--

SUCCESS: Integrated in Hive-trunk-h0.21 #2309 (See 
[https://builds.apache.org/job/Hive-trunk-h0.21/2309/])
HIVE-5096 : Add q file tests for ORC predicate pushdown (Prasanth J via 
Ashutosh Chauhan) (hashutosh: 
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519883)
* /hive/trunk/data/files/over1k
* /hive/trunk/ql/src/test/queries/clientpositive/orc_predicate_pushdown.q
* /hive/trunk/ql/src/test/results/clientpositive/orc_predicate_pushdown.q.out


 Add q file tests for ORC predicate pushdown
 ---

 Key: HIVE-5096
 URL: https://issues.apache.org/jira/browse/HIVE-5096
 Project: Hive
  Issue Type: Test
  Components: CLI, File Formats, StorageHandler
Affects Versions: 0.12.0
Reporter: Prasanth J
Assignee: Prasanth J
  Labels: orcfile
 Fix For: 0.12.0

 Attachments: HIVE-5096.patch


 Add q file tests that checks the validity of the results when predicate 
 pushdown is turned on and off. Also test for filter expressions in table scan 
 operator when predicate pushdown is turned on for ORC. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-5149) ReduceSinkDeDuplication can pick the wrong partitioning columns

2013-09-04 Thread Hudson (JIRA)


[ 
https://issues.apache.org/jira/browse/HIVE-5149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13758030#comment-13758030
 ] 

Hudson commented on HIVE-5149:
--

SUCCESS: Integrated in Hive-trunk-h0.21 #2309 (See 
[https://builds.apache.org/job/Hive-trunk-h0.21/2309/])
HIVE-5149 : ReduceSinkDeDuplication can pick the wrong partitioning columns 
(Yin Huai via Ashutosh Chauhan) (hashutosh: 
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519805)
* 
/hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/correlation/ReduceSinkDeDuplication.java
* /hive/trunk/ql/src/test/results/clientpositive/groupby2.q.out
* /hive/trunk/ql/src/test/results/clientpositive/groupby2_map_skew.q.out
* /hive/trunk/ql/src/test/results/clientpositive/groupby_cube1.q.out
* /hive/trunk/ql/src/test/results/clientpositive/groupby_rollup1.q.out
* 
/hive/trunk/ql/src/test/results/clientpositive/reduce_deduplicate_extended.q.out


 ReduceSinkDeDuplication can pick the wrong partitioning columns
 ---

 Key: HIVE-5149
 URL: https://issues.apache.org/jira/browse/HIVE-5149
 Project: Hive
  Issue Type: Bug
  Components: Query Processor
Affects Versions: 0.11.0, 0.12.0
Reporter: Yin Huai
Assignee: Yin Huai
Priority: Blocker
 Fix For: 0.12.0

 Attachments: HIVE-5149.1.patch, HIVE-5149.2.patch, HIVE-5149.3.patch


 https://mail-archives.apache.org/mod_mbox/hive-user/201308.mbox/%3CCAG6Lhyex5XPwszpihKqkPRpzri2k=m4qgc+cpar5yvr8sjt...@mail.gmail.com%3E

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-5014) [HCatalog] Fix HCatalog build issue on Windows

2013-09-04 Thread Hudson (JIRA)


[ 
https://issues.apache.org/jira/browse/HIVE-5014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13758025#comment-13758025
 ] 

Hudson commented on HIVE-5014:
--

SUCCESS: Integrated in Hive-trunk-h0.21 #2309 (See 
[https://builds.apache.org/job/Hive-trunk-h0.21/2309/])
HIVE-5014 : Fix HCatalog build issue on Windows (Daniel Dai via Sushanth 
Sowmyan) (khorgath: 
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519853)
* /hive/trunk/hcatalog/build.xml


 [HCatalog] Fix HCatalog build issue on Windows
 --

 Key: HIVE-5014
 URL: https://issues.apache.org/jira/browse/HIVE-5014
 Project: Hive
  Issue Type: Sub-task
  Components: HCatalog
Reporter: Daniel Dai
Assignee: Daniel Dai
 Fix For: 0.12.0

 Attachments: HIVE-5014-1.patch




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-4441) [HCatalog] WebHCat does not honor user home directory

2013-09-04 Thread Hudson (JIRA)


[ 
https://issues.apache.org/jira/browse/HIVE-4441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13758023#comment-13758023
 ] 

Hudson commented on HIVE-4441:
--

SUCCESS: Integrated in Hive-trunk-h0.21 #2309 (See 
[https://builds.apache.org/job/Hive-trunk-h0.21/2309/])
HIVE-4441: WebHCat does not honor user home directory (Daniel Dai) (daijy: 
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519897)
* 
/hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/tool/TempletonUtils.java
HIVE-4441: WebHCat does not honor user home directory (Daniel Dai) (daijy: 
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519884)
* /hive/trunk/RELEASE_NOTES.txt
* 
/hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/tool/TempletonUtils.java


 [HCatalog] WebHCat does not honor user home directory
 -

 Key: HIVE-4441
 URL: https://issues.apache.org/jira/browse/HIVE-4441
 Project: Hive
  Issue Type: Bug
  Components: HCatalog
Reporter: Daniel Dai
Assignee: Daniel Dai
 Fix For: 0.12.0

 Attachments: HIVE-4441-1.patch, HIVE-4441-2.patch, HIVE-4441-3.patch, 
 HIVE-4441-4.patch


 If I submit a job as user A and I specify statusdir as a relative path, I 
 would expect results to be stored in the folder relative to the user A's home 
 folder.
 For example, if I run:
 {code}curl -s -d user.name=hdinsightuser -d execute=show+tables; -d 
 statusdir=pokes.output 'http://localhost:50111/templeton/v1/hive'{code}
 I get the results under:
 {code}/user/hdp/pokes.output{code}
 And I expect them to be under:
 {code}/user/hdinsightuser/pokes.output{code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-5104) HCatStorer fails to store boolean type

2013-09-04 Thread Hudson (JIRA)


[ 
https://issues.apache.org/jira/browse/HIVE-5104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13758021#comment-13758021
 ] 

Hudson commented on HIVE-5104:
--

SUCCESS: Integrated in Hive-trunk-h0.21 #2309 (See 
[https://builds.apache.org/job/Hive-trunk-h0.21/2309/])
HIVE-5104 : HCatStorer fails to store boolean type (Karl D. Gierach via 
Sushanth Sowmyan) (khorgath: 
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1519839)
* 
/hive/trunk/hcatalog/hcatalog-pig-adapter/src/main/java/org/apache/hcatalog/pig/HCatBaseStorer.java
* 
/hive/trunk/hcatalog/hcatalog-pig-adapter/src/test/java/org/apache/hcatalog/pig/TestHCatStorer.java


 HCatStorer fails to store boolean type
 --

 Key: HIVE-5104
 URL: https://issues.apache.org/jira/browse/HIVE-5104
 Project: Hive
  Issue Type: Bug
  Components: HCatalog
Affects Versions: 0.11.0
Reporter: Ron Frohock
Assignee: Karl D. Gierach
 Fix For: 0.12.0

 Attachments: HIVE-5104.1.patch.txt, HIVE-5104.2.patch


 Unable to store boolean values to HCat table 
 Assume in Hive you have two tables...
 CREATE TABLE btest(test as boolean);
 CREATE TABLE btest2(test as boolean);
 Then in Pig 
 A = LOAD 'btest' USING org.apache.hcatalog.pig.HCatLoader();
 STORE A INTO 'btest2' USING org.apache.hcatalog.pig.HCatStorer();
 You will get an ERROR 115: Unsupported type 5: in Pig's Schema  
 Checking HCatBaseStorer.java, the case for data types doesn't check for 
 booleans.  Might have been overlooked in adding boolean to Pig in 0.10

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Re: [ANNOUNCE] New Hive Committer - Yin Huai

2013-09-04 Thread Daniel Dai

Congratulation!


On Wed, Sep 4, 2013 at 10:39 AM, yongqiang he heyongqiang...@gmail.comwrote:

 Congrats!

 On Wed, Sep 4, 2013 at 10:23 AM, Jason Dere jd...@hortonworks.com wrote:
  Yin, congrats!
 
  Jason
 
  On Sep 4, 2013, at 7:54 AM, Eugene Koifman ekoif...@hortonworks.com
 wrote:
 
  Congrats!
 
 
  On Wed, Sep 4, 2013 at 5:23 AM, Brock Noland br...@cloudera.com
 wrote:
 
  Congrats Yin!!
 
  On Wed, Sep 4, 2013 at 4:14 AM, Lefty Leverenz 
 leftylever...@gmail.com
  wrote:
  Bravo, Yin!
 
  -- Lefty
 
 
  On Wed, Sep 4, 2013 at 4:17 AM, Sushanth Sowmyan khorg...@gmail.com
  wrote:
 
  Congrats, Yin! :)
  On Sep 4, 2013 1:13 AM, Alexander Alten-Lorenz 
 wget.n...@gmail.com
  wrote:
 
  Amazing news, congratz Yin! Well deserved!
 
  On Sep 4, 2013, at 6:49 AM, Carl Steinbach c...@apache.org wrote:
 
  The Apache Hive PMC has voted to make Yin Huai a committer on the
  Apache
  Hive project.
 
  Please join me in congratulating Yin!
 
  Thanks.
 
  Carl
 
  --
  Alexander Alten-Lorenz
  http://mapredit.blogspot.com
  German Hadoop LinkedIn Group: http://goo.gl/N8pCF
 
 
 
 
 
 
  --
  Apache MRUnit - Unit testing MapReduce - http://mrunit.apache.org
 
 
  --
  CONFIDENTIALITY NOTICE
  NOTICE: This message is intended for the use of the individual or
 entity to
  which it is addressed and may contain information that is confidential,
  privileged and exempt from disclosure under applicable law. If the
 reader
  of this message is not the intended recipient, you are hereby notified
 that
  any printing, copying, dissemination, distribution, disclosure or
  forwarding of this communication is strictly prohibited. If you have
  received this communication in error, please contact the sender
 immediately
  and delete it from your system. Thank You.
 
 
  --
  CONFIDENTIALITY NOTICE
  NOTICE: This message is intended for the use of the individual or entity
 to
  which it is addressed and may contain information that is confidential,
  privileged and exempt from disclosure under applicable law. If the reader
  of this message is not the intended recipient, you are hereby notified
 that
  any printing, copying, dissemination, distribution, disclosure or
  forwarding of this communication is strictly prohibited. If you have
  received this communication in error, please contact the sender
 immediately
  and delete it from your system. Thank You.


-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

Re: [ANNOUNCE] New Hive Committer - Yin Huai

2013-09-04 Thread Yin Huai

Thanks everybody! This is awesome!


On Wed, Sep 4, 2013 at 1:58 PM, Daniel Dai da...@hortonworks.com wrote:

 Congratulation!


 On Wed, Sep 4, 2013 at 10:39 AM, yongqiang he heyongqiang...@gmail.com
 wrote:

  Congrats!
 
  On Wed, Sep 4, 2013 at 10:23 AM, Jason Dere jd...@hortonworks.com
 wrote:
   Yin, congrats!
  
   Jason
  
   On Sep 4, 2013, at 7:54 AM, Eugene Koifman ekoif...@hortonworks.com
  wrote:
  
   Congrats!
  
  
   On Wed, Sep 4, 2013 at 5:23 AM, Brock Noland br...@cloudera.com
  wrote:
  
   Congrats Yin!!
  
   On Wed, Sep 4, 2013 at 4:14 AM, Lefty Leverenz 
  leftylever...@gmail.com
   wrote:
   Bravo, Yin!
  
   -- Lefty
  
  
   On Wed, Sep 4, 2013 at 4:17 AM, Sushanth Sowmyan 
 khorg...@gmail.com
   wrote:
  
   Congrats, Yin! :)
   On Sep 4, 2013 1:13 AM, Alexander Alten-Lorenz 
  wget.n...@gmail.com
   wrote:
  
   Amazing news, congratz Yin! Well deserved!
  
   On Sep 4, 2013, at 6:49 AM, Carl Steinbach c...@apache.org
 wrote:
  
   The Apache Hive PMC has voted to make Yin Huai a committer on the
   Apache
   Hive project.
  
   Please join me in congratulating Yin!
  
   Thanks.
  
   Carl
  
   --
   Alexander Alten-Lorenz
   http://mapredit.blogspot.com
   German Hadoop LinkedIn Group: http://goo.gl/N8pCF
  
  
  
  
  
  
   --
   Apache MRUnit - Unit testing MapReduce - http://mrunit.apache.org
  
  
   --
   CONFIDENTIALITY NOTICE
   NOTICE: This message is intended for the use of the individual or
  entity to
   which it is addressed and may contain information that is
 confidential,
   privileged and exempt from disclosure under applicable law. If the
  reader
   of this message is not the intended recipient, you are hereby notified
  that
   any printing, copying, dissemination, distribution, disclosure or
   forwarding of this communication is strictly prohibited. If you have
   received this communication in error, please contact the sender
  immediately
   and delete it from your system. Thank You.
  
  
   --
   CONFIDENTIALITY NOTICE
   NOTICE: This message is intended for the use of the individual or
 entity
  to
   which it is addressed and may contain information that is confidential,
   privileged and exempt from disclosure under applicable law. If the
 reader
   of this message is not the intended recipient, you are hereby notified
  that
   any printing, copying, dissemination, distribution, disclosure or
   forwarding of this communication is strictly prohibited. If you have
   received this communication in error, please contact the sender
  immediately
   and delete it from your system. Thank You.
 

 --
 CONFIDENTIALITY NOTICE
 NOTICE: This message is intended for the use of the individual or entity to
 which it is addressed and may contain information that is confidential,
 privileged and exempt from disclosure under applicable law. If the reader
 of this message is not the intended recipient, you are hereby notified that
 any printing, copying, dissemination, distribution, disclosure or
 forwarding of this communication is strictly prohibited. If you have
 received this communication in error, please contact the sender immediately
 and delete it from your system. Thank You.

[jira] [Updated] (HIVE-5182) log more stuff via PerfLogger

2013-09-04 Thread Phabricator (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-5182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Phabricator updated HIVE-5182:
--

Attachment: HIVE-5182.D12639.2.patch

sershe updated the revision HIVE-5182 [jira] log more stuff via PerfLogger.

  More perflogs based on CR feedback

Reviewers: JIRA

REVISION DETAIL
  https://reviews.facebook.net/D12639

CHANGE SINCE LAST DIFF
  https://reviews.facebook.net/D12639?vs=39333id=39495#toc

AFFECTED FILES
  ql/src/java/org/apache/hadoop/hive/ql/Driver.java
  ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java
  ql/src/java/org/apache/hadoop/hive/ql/io/CombineHiveInputFormat.java
  ql/src/java/org/apache/hadoop/hive/ql/io/HiveInputFormat.java
  ql/src/java/org/apache/hadoop/hive/ql/log/PerfLogger.java

To: JIRA, sershe


 log more stuff via PerfLogger
 -

 Key: HIVE-5182
 URL: https://issues.apache.org/jira/browse/HIVE-5182
 Project: Hive
  Issue Type: Improvement
Reporter: Sergey Shelukhin
Assignee: Sergey Shelukhin
 Attachments: HIVE-5182.D12639.1.patch, HIVE-5182.D12639.2.patch


 PerfLogger output is useful in understanding perf. There are large gaps in 
 it, however, and it's not clear what is going on during these. Some sections 
 are large and have no breakdown. It would be nice to add more stuff. At this 
 point I'm not certain where exactly, whoever makes the patch (me?) will just 
 need to look at the above gaps and fill them in.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-5206) Support parameterized primitive types

2013-09-04 Thread Edward Capriolo (JIRA)

[
https://issues.apache.org/jira/browse/HIVE-5206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13758099#comment-13758099
]

Edward Capriolo commented on HIVE-5206:
---

Unifying the integral types is surely out of scope for this issue. However,

We are making the justification for doing this for string, char, varchar. The
same argument would hold for the integral types? I mean if someone was a fresh
reader to the code and saw that all the string types work one way, but all the
int types work another, what would they conclude is the right way?

Are we thinking too patch driven development? Sure your end goal is to have
this varchar support (and it is a good goal and this is a good feature) but who
cares about all the existing stuff? Is it not sexy not worth touching? I am
just thinking out loud here. But I notice we are starting to add many types,
some like decimal are special purpose versions of other types. I want to make
sure we are thinking about the big picture here. I am not sure we should just
be adding a new type every time there is something we do not like about the
existing type. What if someone wants nvarchar, or BigInteger, or BigDecimal?

Support parameterized primitive types
-

Key: HIVE-5206
URL: https://issues.apache.org/jira/browse/HIVE-5206
Project: Hive
Issue Type: Improvement
Components: Types
Reporter: Jason Dere
Assignee: Jason Dere
Attachments: HIVE-5206.1.patch, HIVE-5206.D12693.1.patch

Support for parameterized types is needed for char/varchar/decimal support.
This adds a type parameters value to the
PrimitiveTypeEntry/PrimitiveTypeInfo/PrimitiveObjectInspector objects.
NO PRECOMMIT TESTS - dependent on HIVE-5203/HIVE-5204

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-5203) FunctionRegistry.getMethodInternal() should prefer method arguments with closer affinity to the original argument types

2013-09-04 Thread Jason Dere (JIRA)


[ 
https://issues.apache.org/jira/browse/HIVE-5203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13758102#comment-13758102
 ] 

Jason Dere commented on HIVE-5203:
--

Hi Edward, did you have a particular comment around the first code section you 
highlighted in your previous comment? It looks like your comments were directed 
against the 2nd code section.

{code}
 for (Method m: udfMethods) {
+currentScore = 0;
+ListTypeInfo argumentsAccepted =
+TypeInfoUtils.getParameterTypeInfos(m, argumentsPassed.size());
+IteratorTypeInfo argsPassedIter = argumentsPassed.iterator();
{code}



 FunctionRegistry.getMethodInternal() should prefer method arguments with 
 closer affinity to the original argument types
 ---

 Key: HIVE-5203
 URL: https://issues.apache.org/jira/browse/HIVE-5203
 Project: Hive
  Issue Type: Bug
  Components: Types, UDF
Reporter: Jason Dere
Assignee: Jason Dere
 Attachments: HIVE-5203.1.patch


 When the function registry is trying to determine the best version of UDF 
 evaluate() to use based on a set of arguments passed in, it should prefer 
 methods where the argument types are more related to the original types. For 
 example if varchar is used with UDFFromUnixTime(), varchar is convertible to 
 both the double and string versions of evaluate() for that UDF.  In this case 
 we would prefer that the function registry select the string version over the 
 double version, since varchar and string are both string types.
 This doesn't really affect any of the existing types, but comes into play 
 with the addition of the varchar type (HIVE-4844).

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-5060) JDBC driver assumes executeStatement is synchronous

2013-09-04 Thread Vaibhav Gumashta (JIRA)


[ 
https://issues.apache.org/jira/browse/HIVE-5060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13758113#comment-13758113
 ] 

Vaibhav Gumashta commented on HIVE-5060:


[~henryr] Thanks for posting this to rb. There has been some more progress on 
the async execution part of 
[HIVE-4569|https://issues.apache.org/jira/browse/HIVE-4569] here: 
[HIVE-4617|https://issues.apache.org/jira/browse/HIVE-4617]. I'll post my 
comments soon.



 JDBC driver assumes executeStatement is synchronous
 ---

 Key: HIVE-5060
 URL: https://issues.apache.org/jira/browse/HIVE-5060
 Project: Hive
  Issue Type: Bug
  Components: JDBC
Affects Versions: 0.11.0
Reporter: Henry Robinson
 Fix For: 0.11.1, 0.12.0

 Attachments: 
 0001-HIVE-5060-JDBC-driver-assumes-executeStatement-is-sy.patch, 
 HIVE-5060.patch


 The JDBC driver seems to assume that {{ExecuteStatement}} is a synchronous 
 call when performing updates via {{executeUpdate}}, where the following 
 comment on the RPC in the Thrift file indicates otherwise:
 {code}
 // ExecuteStatement()
 //
 // Execute a statement.
 // The returned OperationHandle can be used to check on the
 // status of the statement, and to fetch results once the
 // statement has finished executing.
 {code}
 I understand that Hive's implementation of {{ExecuteStatement}} is blocking 
 (see https://issues.apache.org/jira/browse/HIVE-4569), but presumably other 
 implementations of the HiveServer2 API (and I'm talking specifically about 
 Impala here, but others might have a similar concern) should be free to 
 return a pollable {{OperationHandle}} per the specification.
 The JDBC driver's {{executeUpdate}} is as follows:
 {code}
 public int executeUpdate(String sql) throws SQLException {
 execute(sql);
 return 0;
   }
 {code}
 {{execute(sql)}} discards the {{OperationHandle}} that it gets from the 
 server after determining whether there are results to be fetched.
 This is problematic for us, because Impala will cancel queries that are 
 running when a session executes, but there's no easy way to be sure that an 
 {{INSERT}} statement has completed before terminating a session on the client.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

< 1 2 3 >

101 - 200 of 224 matches

Mail list logo