Re: [ANNOUNCE] New Hive Committer - Siddharth Seth

[Lefty Leverenz]

Congratulations, Sirddharth!

-- Lefty

On Thu, Oct 22, 2015 at 11:53 AM, Siddharth Seth  wrote:

> Thanks everyone!
>
> On Thu, Oct 22, 2015 at 12:54 AM, Navis Ryu  wrote:
>
> > Congratulations!
> >
> > 2015-10-22 16:49 GMT+09:00 Chinna Rao Lalam  >:
> > > Congratulations!
> > >
> > > On Thu, Oct 22, 2015 at 12:18 PM, Santlal J Gupta <
> > > santlal.gu...@bitwiseglobal.com> wrote:
> > >
> > >> Congratulations !!
> > >>
> > >> -Original Message-
> > >> From: Chetna C [mailto:chetna@gmail.com]
> > >> Sent: Thursday, October 22, 2015 8:58 AM
> > >> To: dev@hive.apache.org
> > >> Cc: Siddharth Seth
> > >> Subject: Re: [ANNOUNCE] New Hive Committer - Siddharth Seth
> > >>
> > >> Congratulations !!
> > >> On Oct 22, 2015 5:13 AM, "Pengcheng Xiong"  wrote:
> > >>
> > >> > Congrats Sid!
> > >> >
> > >> > On Wed, Oct 21, 2015 at 2:14 PM, Sergey Shelukhin
> > >> > 
> > >> > wrote:
> > >> >
> > >> > > The Apache Hive PMC has voted to make Siddharth Seth a committer
> on
> > >> > > the Apache Hive Project.
> > >> > >
> > >> > > Please join me in congratulating Sid!
> > >> > >
> > >> > > Thanks,
> > >> > > Sergey.
> > >> > >
> > >> > >
> > >> >
> > >>
> > >
> > >
> > >
> > > --
> > > Hope It Helps,
> > > Chinna
> >
>

Re: [ANNOUNCE] New Hive Committer- Aihua Xu

[Lefty Leverenz]

Congratulations Aihua!

-- Lefty

On Thu, Oct 22, 2015 at 3:54 AM, Navis Ryu  wrote:

> Congratulations!
>
> 2015-10-22 16:48 GMT+09:00 Chinna Rao Lalam :
> > Congrats Aihua!
> >
> > On Thu, Oct 22, 2015 at 10:45 AM, Vaibhav Gumashta <
> > vgumas...@hortonworks.com> wrote:
> >
> >> Congrats Aihua!
> >>
> >> ‹Vaibhav
> >>
> >> On 10/21/15, 4:42 PM, "Pengcheng Xiong"  wrote:
> >>
> >> >Congrats Aihua!
> >> >
> >> >On Wed, Oct 21, 2015 at 2:09 PM, Szehon Ho 
> wrote:
> >> >
> >> >> The Apache Hive PMC has voted to make Aihua Xu a committer on the
> Apache
> >> >> Hive Project.
> >> >>
> >> >> Please join me in congratulating Aihua!
> >> >>
> >> >> Thanks,
> >> >> Szehon
> >> >>
> >>
> >>
> >
> >
> > --
> > Hope It Helps,
> > Chinna
>

Re: Review Request 38211: HIVE-11684

[John Pullokkaran]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/38211/#review103715
---



ql/src/java/org/apache/hadoop/hive/ql/parse/CalcitePlanner.java (line 962)


Pushing just limit without pushing orderby is not sufficent.

Limit almost always will have preceeding order by.
Order by pushdown also nneds to be handled.


- John Pullokkaran


On Oct. 23, 2015, 3:21 a.m., Jesús Camacho Rodríguez wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/38211/
> ---
> 
> (Updated Oct. 23, 2015, 3:21 a.m.)
> 
> 
> Review request for hive and John Pullokkaran.
> 
> 
> Bugs: HIVE-11684
> https://issues.apache.org/jira/browse/HIVE-11684
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> Implement limit pushdown through outer join in CBO
> 
> 
> Diffs
> -
> 
>   common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 
> 23ae0dcca405bfe5521b1638f5c7f4e720c1a493 
>   itests/src/test/resources/testconfiguration.properties 
> fa1d89d2169023b3842829e762e02b896909b4b0 
>   
> ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/reloperators/HiveSortLimit.java
>  82fdc0e04011aa585912ce5aae5e3245e5e5bb01 
>   
> ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/rules/HiveProjectSortTransposeRule.java
>  PRE-CREATION 
>   
> ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/rules/HiveSortJoinReduceRule.java
>  PRE-CREATION 
>   
> ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/rules/HiveSortProjectTransposeRule.java
>  PRE-CREATION 
>   
> ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/rules/HiveSortRemoveRule.java
>  PRE-CREATION 
>   
> ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/stats/HiveRelMdRowCount.java
>  6948fb16c6a3c9ce456a900536bee4c0d9b1614e 
>   
> ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/stats/HiveRelMdSelectivity.java
>  715f24fc1872a54637a47bf80bb29e4a2e053779 
>   ql/src/java/org/apache/hadoop/hive/ql/parse/CalcitePlanner.java 
> e13356ce16626bda1d9b6553ac5f191a65243394 
>   ql/src/test/queries/clientpositive/limit_join_transpose.q PRE-CREATION 
>   ql/src/test/queries/clientpositive/tez_dynpart_hashjoin_3.q PRE-CREATION 
>   ql/src/test/results/clientpositive/limit_join_transpose.q.out PRE-CREATION 
>   ql/src/test/results/clientpositive/tez/tez_dynpart_hashjoin_3.q.out 
> PRE-CREATION 
> 
> Diff: https://reviews.apache.org/r/38211/diff/
> 
> 
> Testing
> ---
> 
> Two new tests added: limit_join_transpose.q and tez_dynpart_hashjoin_3.q 
> (only Tez)
> 
> 
> Thanks,
> 
> Jesús Camacho Rodríguez
> 
>

Re: Review Request 38211: HIVE-11684

[John Pullokkaran]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/38211/#review103714
---



common/src/java/org/apache/hadoop/hive/conf/HiveConf.java (line 1307)


May be all the config should be changed to LimitPushDown instead of using 
join; since limit can be pushed down below outer joins, projects, union, Map 
Side GB...


- John Pullokkaran


On Oct. 23, 2015, 3:21 a.m., Jesús Camacho Rodríguez wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/38211/
> ---
> 
> (Updated Oct. 23, 2015, 3:21 a.m.)
> 
> 
> Review request for hive and John Pullokkaran.
> 
> 
> Bugs: HIVE-11684
> https://issues.apache.org/jira/browse/HIVE-11684
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> Implement limit pushdown through outer join in CBO
> 
> 
> Diffs
> -
> 
>   common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 
> 23ae0dcca405bfe5521b1638f5c7f4e720c1a493 
>   itests/src/test/resources/testconfiguration.properties 
> fa1d89d2169023b3842829e762e02b896909b4b0 
>   
> ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/reloperators/HiveSortLimit.java
>  82fdc0e04011aa585912ce5aae5e3245e5e5bb01 
>   
> ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/rules/HiveProjectSortTransposeRule.java
>  PRE-CREATION 
>   
> ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/rules/HiveSortJoinReduceRule.java
>  PRE-CREATION 
>   
> ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/rules/HiveSortProjectTransposeRule.java
>  PRE-CREATION 
>   
> ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/rules/HiveSortRemoveRule.java
>  PRE-CREATION 
>   
> ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/stats/HiveRelMdRowCount.java
>  6948fb16c6a3c9ce456a900536bee4c0d9b1614e 
>   
> ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/stats/HiveRelMdSelectivity.java
>  715f24fc1872a54637a47bf80bb29e4a2e053779 
>   ql/src/java/org/apache/hadoop/hive/ql/parse/CalcitePlanner.java 
> e13356ce16626bda1d9b6553ac5f191a65243394 
>   ql/src/test/queries/clientpositive/limit_join_transpose.q PRE-CREATION 
>   ql/src/test/queries/clientpositive/tez_dynpart_hashjoin_3.q PRE-CREATION 
>   ql/src/test/results/clientpositive/limit_join_transpose.q.out PRE-CREATION 
>   ql/src/test/results/clientpositive/tez/tez_dynpart_hashjoin_3.q.out 
> PRE-CREATION 
> 
> Diff: https://reviews.apache.org/r/38211/diff/
> 
> 
> Testing
> ---
> 
> Two new tests added: limit_join_transpose.q and tez_dynpart_hashjoin_3.q 
> (only Tez)
> 
> 
> Thanks,
> 
> Jesús Camacho Rodríguez
> 
>

[jira] [Created] (HIVE-12239) Constants in hive.common.metrics.common.MetricsConstant are not final

[Aleksei Statkevich (JIRA)]

Aleksei Statkevich created HIVE-12239:
-

 Summary: Constants in hive.common.metrics.common.MetricsConstant 
are not final
 Key: HIVE-12239
 URL: https://issues.apache.org/jira/browse/HIVE-12239
 Project: Hive
  Issue Type: Task
Reporter: Aleksei Statkevich
Priority: Trivial


Constants defined in 
org.apache.hadoop.hive.common.metrics.common.MetricsConstant are not marked as 
final.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Review Request 39577: support unicode table name and column name

[richard du]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/39577/
---

(Updated 十月 23, 2015, 3:26 a.m.)


Review request for hive and pengcheng xiong.


Changes
---

remove redundant space


Repository: hive-git


Description
---

[HIVE-12157](https://issues.apache.org/jira/browse/HIVE-12157)
support unicode table name and column name


Diffs (updated)
-

  common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 0fcd39b 
  metastore/src/java/org/apache/hadoop/hive/metastore/MetaStoreUtils.java 
12f3f16 
  ql/src/java/org/apache/hadoop/hive/ql/parse/HiveLexer.g 9f8cfd1 
  ql/src/test/org/apache/hadoop/hive/ql/parse/TestUnicodeParse.java 
PRE-CREATION 
  ql/src/test/queries/clientpositive/unicode_identifier.q PRE-CREATION 
  ql/src/test/results/clientpositive/unicode_identifier.q.out PRE-CREATION 

Diff: https://reviews.apache.org/r/39577/diff/


Testing
---


Thanks,

richard du

Review Request 39578: Remove hadoop-1 support from master branch

[Alan Gates]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/39578/
---

Review request for hive, Ashutosh Chauhan and Sergey Shelukhin.


Bugs: HIVE-11378
https://issues.apache.org/jira/browse/HIVE-11378


Repository: hive-git


Description
---

When we branched branch-1 one of the goals was the ability to remove hadoop1 
support from master. I propose to do this softly at first by removing it from 
the poms removing the 20S implementation of the shims.
I am not going to remove the shim layer. That would be much more disruptive. 
Also, I haven't done the homework to see if we could, as there may still be 
incompatibility issues between various versions of hadoop2.


Diffs
-

  accumulo-handler/pom.xml 4e3a087 
  beeline/pom.xml d46ac3c 
  cli/pom.xml 88a815c 
  common/pom.xml dba814d 
  contrib/pom.xml 8f2ffe4 
  hbase-handler/pom.xml a4a9752 
  hcatalog/core/pom.xml 58ddeee 
  hcatalog/hcatalog-pig-adapter/pom.xml ca9039a 
  
hcatalog/hcatalog-pig-adapter/src/test/java/org/apache/hive/hcatalog/pig/TestHCatLoaderEncryption.java
 df3b72a 
  hcatalog/pom.xml 2e145b8 
  hcatalog/server-extensions/pom.xml 3cd2813 
  hcatalog/streaming/pom.xml ba9f731 
  hcatalog/webhcat/java-client/pom.xml b3f3122 
  hcatalog/webhcat/svr/pom.xml e635cc6 
  hplsql/pom.xml fc1c527 
  hwi/pom.xml d0533ff 
  itests/custom-serde/pom.xml 078549d 
  itests/hcatalog-unit/pom.xml eb330e1 
  itests/hive-jmh/pom.xml 56f4016 
  itests/hive-minikdc/pom.xml 3098dac 
  itests/hive-unit-hadoop2/pom.xml 83ef97c 
  
itests/hive-unit-hadoop2/src/test/java/org/apache/hadoop/hive/thrift/TestHadoopAuthBridge23.java
 40b161a 
  itests/hive-unit/pom.xml 5295840 
  itests/pom.xml acce713 
  itests/qtest-accumulo/pom.xml 09ae2a2 
  itests/qtest-spark/pom.xml 05a3c9f 
  itests/qtest/pom.xml d5c3009 
  itests/test-serde/pom.xml 7a1c622 
  itests/util/pom.xml fdab72c 
  jdbc/pom.xml 371d709 
  llap-client/pom.xml b7b5803 
  llap-server/pom.xml dd8dd7b 
  metastore/pom.xml f209d50 
  pom.xml 6a96391 
  ql/pom.xml 83b9ebf 
  serde/pom.xml b6c0d0c 
  service/pom.xml 07eeb9a 
  shims/0.20S/pom.xml 565dd5e 
  shims/0.20S/src/main/java/org/apache/hadoop/hive/shims/Hadoop20SShims.java 
f60e8f0 
  shims/0.20S/src/main/java/org/apache/hadoop/hive/shims/Jetty20SShims.java 
75659ff 
  shims/0.20S/src/main/java/org/apache/hadoop/mapred/WebHCatJTShim20S.java 
367ea60 
  shims/0.23/pom.xml 3b1fb97 
  shims/common/pom.xml dfdec2b 
  shims/common/src/main/java/org/apache/hadoop/hive/shims/ShimLoader.java 
c7fa11b 
  
shims/common/src/main/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge.java
 7ed7265 
  shims/pom.xml 12113d5 
  shims/scheduler/pom.xml 407d57d 
  storage-api/pom.xml 71b79f1 

Diff: https://reviews.apache.org/r/39578/diff/


Testing
---

Tested that I can build and run tests.


Thanks,

Alan Gates

Re: Review Request 38211: HIVE-11684

[Jesús Camacho Rodríguez]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/38211/
---

(Updated Oct. 23, 2015, 3:21 a.m.)


Review request for hive and John Pullokkaran.


Bugs: HIVE-11684
https://issues.apache.org/jira/browse/HIVE-11684


Repository: hive-git


Description
---

Implement limit pushdown through outer join in CBO


Diffs (updated)
-

  common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 
23ae0dcca405bfe5521b1638f5c7f4e720c1a493 
  itests/src/test/resources/testconfiguration.properties 
fa1d89d2169023b3842829e762e02b896909b4b0 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/reloperators/HiveSortLimit.java
 82fdc0e04011aa585912ce5aae5e3245e5e5bb01 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/rules/HiveProjectSortTransposeRule.java
 PRE-CREATION 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/rules/HiveSortJoinReduceRule.java
 PRE-CREATION 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/rules/HiveSortProjectTransposeRule.java
 PRE-CREATION 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/rules/HiveSortRemoveRule.java
 PRE-CREATION 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/stats/HiveRelMdRowCount.java
 6948fb16c6a3c9ce456a900536bee4c0d9b1614e 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/stats/HiveRelMdSelectivity.java
 715f24fc1872a54637a47bf80bb29e4a2e053779 
  ql/src/java/org/apache/hadoop/hive/ql/parse/CalcitePlanner.java 
e13356ce16626bda1d9b6553ac5f191a65243394 
  ql/src/test/queries/clientpositive/limit_join_transpose.q PRE-CREATION 
  ql/src/test/queries/clientpositive/tez_dynpart_hashjoin_3.q PRE-CREATION 
  ql/src/test/results/clientpositive/limit_join_transpose.q.out PRE-CREATION 
  ql/src/test/results/clientpositive/tez/tez_dynpart_hashjoin_3.q.out 
PRE-CREATION 

Diff: https://reviews.apache.org/r/38211/diff/


Testing
---

Two new tests added: limit_join_transpose.q and tez_dynpart_hashjoin_3.q (only 
Tez)


Thanks,

Jesús Camacho Rodríguez

[jira] [Created] (HIVE-12238) Vectorization: Empty date parsing to NULL

[Gopal V (JIRA)]

Gopal V created HIVE-12238:
--

 Summary: Vectorization: Empty date parsing to NULL
 Key: HIVE-12238
 URL: https://issues.apache.org/jira/browse/HIVE-12238
 Project: Hive
  Issue Type: Bug
  Components: Vectorization
Affects Versions: 1.2.1, 1.3.0, 2.0.0
Reporter: Gopal V


{code}
Caused by: java.lang.NumberFormatException: For input string: ""
at 
java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
at java.lang.Long.parseLong(Long.java:601)
at java.lang.Long.parseLong(Long.java:631)
at java.text.DigitList.getLong(DigitList.java:195)
at java.text.DecimalFormat.parse(DecimalFormat.java:2051)
at java.text.SimpleDateFormat.subParse(SimpleDateFormat.java:1869)
at java.text.SimpleDateFormat.parse(SimpleDateFormat.java:1514)
at java.text.DateFormat.parse(DateFormat.java:364)
at 
org.apache.hadoop.hive.ql.exec.vector.expressions.VectorUDFDateString$1.evaluate(VectorUDFDateString.java:48)
at 
org.apache.hadoop.hive.ql.exec.vector.expressions.StringUnaryUDF.evaluate(StringUnaryUDF.java:90)
at 
org.apache.hadoop.hive.ql.exec.vector.expressions.VectorExpression.evaluateChildren(VectorExpression.java:121)
at 
org.apache.hadoop.hive.ql.exec.vector.expressions.StringGroupColConcatStringScalar.evaluate(StringGroupColConcatStringScalar.java:50)
at 
org.apache.hadoop.hive.ql.exec.vector.expressions.VectorExpression.evaluateChildren(VectorExpression.java:121)
at 
org.apache.hadoop.hive.ql.exec.vector.udf.VectorUDFAdaptor.evaluate(VectorUDFAdaptor.java:112)
at 
org.apache.hadoop.hive.ql.exec.vector.expressions.VectorExpression.evaluateChildren(VectorExpression.java:121)
at 
org.apache.hadoop.hive.ql.exec.vector.expressions.VectorUDFTimestampFieldLong.evaluate(VectorUDFTimestampFieldLong.java:93)
at 
org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator.process(VectorSelectOperator.java:123)
... 22 more
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-12237) Replace log4j direct references with slf4j facade

[Ashutosh Chauhan (JIRA)]

Ashutosh Chauhan created HIVE-12237:
---

 Summary: Replace log4j direct references with slf4j facade
 Key: HIVE-12237
 URL: https://issues.apache.org/jira/browse/HIVE-12237
 Project: Hive
  Issue Type: Task
  Components: Logging
Reporter: Ashutosh Chauhan
Assignee: Ashutosh Chauhan






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Review Request 29199: HIVE-9013: Hive set command exposes metastore db password

[Thejas Nair]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/29199/#review103701
---



common/src/java/org/apache/hadoop/hive/conf/HiveConf.java (line 78)


would Set be more suitable as we are mainly doing .contains() check 
at run time ?


- Thejas Nair


On Oct. 23, 2015, 12:12 a.m., Binglin Chang wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/29199/
> ---
> 
> (Updated Oct. 23, 2015, 12:12 a.m.)
> 
> 
> Review request for hive.
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> HIVE-9013: Hive set command exposes metastore db password
> 
> 
> Diffs
> -
> 
>   common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 6c7adbd 
>   ql/src/java/org/apache/hadoop/hive/ql/processors/SetProcessor.java 06a83ae 
> 
> Diff: https://reviews.apache.org/r/29199/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Binglin Chang
> 
>

Re: Review Request 29199: HIVE-9013: Hive set command exposes metastore db password

[Binglin Chang]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/29199/
---

(Updated Oct. 23, 2015, 8:12 a.m.)


Review request for hive.


Repository: hive-git


Description
---

HIVE-9013: Hive set command exposes metastore db password


Diffs (updated)
-

  common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 6c7adbd 
  ql/src/java/org/apache/hadoop/hive/ql/processors/SetProcessor.java 06a83ae 

Diff: https://reviews.apache.org/r/29199/diff/


Testing
---


Thanks,

Binglin Chang

[jira] [Created] (HIVE-12236) LLAP: Prevent metadata queries from thrashing LLAP cache

[Gopal V (JIRA)]

Gopal V created HIVE-12236:
--

 Summary: LLAP: Prevent metadata queries from thrashing LLAP cache
 Key: HIVE-12236
 URL: https://issues.apache.org/jira/browse/HIVE-12236
 Project: Hive
  Issue Type: Improvement
  Components: Physical Optimizer
Affects Versions: 1.3.0, 2.0.0
Reporter: Gopal V
Assignee: Gopal V
 Fix For: 1.3.0, 2.0.0


Currently, metadata queries fired by BI tools tend to thrash LLAP's cache.

Bypass the cache and process metadata queries directly from HiveServer2



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Review Request 39522: HIVE-12220 LLAP: Usability issues with hive.llap.io.cache.orc.size

[Sergey Shelukhin]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/39522/
---

(Updated Oct. 22, 2015, 10:33 p.m.)


Review request for hive and Gopal V.


Repository: hive-git


Description
---

see jira


Diffs (updated)
-

  common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 6c7adbd 
  llap-server/src/java/org/apache/hadoop/hive/llap/cache/BuddyAllocator.java 
ae64d20 
  
llap-server/src/java/org/apache/hadoop/hive/llap/cache/LowLevelCacheMemoryManager.java
 4a256ee 
  
llap-server/src/java/org/apache/hadoop/hive/llap/cache/LowLevelLrfuCachePolicy.java
 f551edb 
  llap-server/src/java/org/apache/hadoop/hive/llap/cli/LlapServiceDriver.java 
05fecc7 
  llap-server/src/java/org/apache/hadoop/hive/llap/daemon/impl/LlapDaemon.java 
6f75001 
  
llap-server/src/java/org/apache/hadoop/hive/llap/io/encoded/OrcEncodedDataReader.java
 86a56ab 
  
llap-server/src/test/org/apache/hadoop/hive/llap/cache/TestBuddyAllocator.java 
d4d4bb2 
  
llap-server/src/test/org/apache/hadoop/hive/llap/cache/TestLowLevelLrfuCachePolicy.java
 a423eeb 

Diff: https://reviews.apache.org/r/39522/diff/


Testing
---


Thanks,

Sergey Shelukhin

Re: Review Request 38211: HIVE-11684

[John Pullokkaran]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/38211/#review103668
---



ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/stats/HiveRelMdRowCount.java
 (line 39)


We should enhance Join cardinality estimation for outer joins.

Outer Join cardinality should be: max(outer side cardinality, inner join 
cardinality)


- John Pullokkaran


On Oct. 11, 2015, 12:57 p.m., Jesús Camacho Rodríguez wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/38211/
> ---
> 
> (Updated Oct. 11, 2015, 12:57 p.m.)
> 
> 
> Review request for hive and John Pullokkaran.
> 
> 
> Bugs: HIVE-11684
> https://issues.apache.org/jira/browse/HIVE-11684
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> Implement limit pushdown through outer join in CBO
> 
> 
> Diffs
> -
> 
>   common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 
> bf48f69dd8914020dcd4eeba8dd448f4ee8d5b24 
>   itests/src/test/resources/testconfiguration.properties 
> ad47fac2e3e5716f2cdf4b9c25ee2d6d14eab5ec 
>   
> ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/reloperators/HiveSortLimit.java
>  82fdc0e04011aa585912ce5aae5e3245e5e5bb01 
>   
> ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/rules/HiveProjectSortTransposeRule.java
>  PRE-CREATION 
>   
> ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/rules/HiveSortJoinReduceRule.java
>  PRE-CREATION 
>   
> ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/rules/HiveSortProjectTransposeRule.java
>  PRE-CREATION 
>   
> ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/rules/HiveSortRemoveRule.java
>  PRE-CREATION 
>   
> ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/stats/HiveRelMdRowCount.java
>  6948fb16c6a3c9ce456a900536bee4c0d9b1614e 
>   ql/src/java/org/apache/hadoop/hive/ql/parse/CalcitePlanner.java 
> 61ee2bdf21000aa20d9fff02a3d926a1031410bc 
>   ql/src/test/queries/clientpositive/limit_join_transpose.q PRE-CREATION 
>   ql/src/test/queries/clientpositive/tez_dynpart_hashjoin_3.q PRE-CREATION 
>   ql/src/test/results/clientpositive/limit_join_transpose.q.out PRE-CREATION 
>   ql/src/test/results/clientpositive/tez/tez_dynpart_hashjoin_3.q.out 
> PRE-CREATION 
> 
> Diff: https://reviews.apache.org/r/38211/diff/
> 
> 
> Testing
> ---
> 
> Two new tests added: limit_join_transpose.q and tez_dynpart_hashjoin_3.q 
> (only Tez)
> 
> 
> Thanks,
> 
> Jesús Camacho Rodríguez
> 
>

Re: Review Request 38211: HIVE-11684

[John Pullokkaran]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/38211/#review103667
---



ql/src/java/org/apache/hadoop/hive/ql/parse/CalcitePlanner.java (line 997)


Redundant Limit removal should happen bottom up.


- John Pullokkaran


On Oct. 11, 2015, 12:57 p.m., Jesús Camacho Rodríguez wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/38211/
> ---
> 
> (Updated Oct. 11, 2015, 12:57 p.m.)
> 
> 
> Review request for hive and John Pullokkaran.
> 
> 
> Bugs: HIVE-11684
> https://issues.apache.org/jira/browse/HIVE-11684
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> Implement limit pushdown through outer join in CBO
> 
> 
> Diffs
> -
> 
>   common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 
> bf48f69dd8914020dcd4eeba8dd448f4ee8d5b24 
>   itests/src/test/resources/testconfiguration.properties 
> ad47fac2e3e5716f2cdf4b9c25ee2d6d14eab5ec 
>   
> ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/reloperators/HiveSortLimit.java
>  82fdc0e04011aa585912ce5aae5e3245e5e5bb01 
>   
> ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/rules/HiveProjectSortTransposeRule.java
>  PRE-CREATION 
>   
> ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/rules/HiveSortJoinReduceRule.java
>  PRE-CREATION 
>   
> ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/rules/HiveSortProjectTransposeRule.java
>  PRE-CREATION 
>   
> ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/rules/HiveSortRemoveRule.java
>  PRE-CREATION 
>   
> ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/stats/HiveRelMdRowCount.java
>  6948fb16c6a3c9ce456a900536bee4c0d9b1614e 
>   ql/src/java/org/apache/hadoop/hive/ql/parse/CalcitePlanner.java 
> 61ee2bdf21000aa20d9fff02a3d926a1031410bc 
>   ql/src/test/queries/clientpositive/limit_join_transpose.q PRE-CREATION 
>   ql/src/test/queries/clientpositive/tez_dynpart_hashjoin_3.q PRE-CREATION 
>   ql/src/test/results/clientpositive/limit_join_transpose.q.out PRE-CREATION 
>   ql/src/test/results/clientpositive/tez/tez_dynpart_hashjoin_3.q.out 
> PRE-CREATION 
> 
> Diff: https://reviews.apache.org/r/38211/diff/
> 
> 
> Testing
> ---
> 
> Two new tests added: limit_join_transpose.q and tez_dynpart_hashjoin_3.q 
> (only Tez)
> 
> 
> Thanks,
> 
> Jesús Camacho Rodríguez
> 
>

Re: Review Request 39522: HIVE-12220 LLAP: Usability issues with hive.llap.io.cache.orc.size

[Sergey Shelukhin]

> On Oct. 21, 2015, 8:11 p.m., Gopal V wrote:
> > common/src/java/org/apache/hadoop/hive/conf/HiveConf.java, line 2291
> > 
> >
> > Remove the .ll.?

it stands for low-level


- Sergey


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/39522/#review103461
---


On Oct. 21, 2015, 8:04 p.m., Sergey Shelukhin wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/39522/
> ---
> 
> (Updated Oct. 21, 2015, 8:04 p.m.)
> 
> 
> Review request for hive and Gopal V.
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> see jira
> 
> 
> Diffs
> -
> 
>   common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 6c7adbd 
>   llap-server/src/java/org/apache/hadoop/hive/llap/cache/BuddyAllocator.java 
> ae64d20 
>   
> llap-server/src/java/org/apache/hadoop/hive/llap/cache/LowLevelCacheMemoryManager.java
>  4a256ee 
>   
> llap-server/src/java/org/apache/hadoop/hive/llap/cache/LowLevelLrfuCachePolicy.java
>  f551edb 
>   llap-server/src/java/org/apache/hadoop/hive/llap/cli/LlapServiceDriver.java 
> 05fecc7 
>   
> llap-server/src/java/org/apache/hadoop/hive/llap/daemon/impl/LlapDaemon.java 
> 6f75001 
>   
> llap-server/src/java/org/apache/hadoop/hive/llap/io/encoded/OrcEncodedDataReader.java
>  86a56ab 
>   
> llap-server/src/test/org/apache/hadoop/hive/llap/cache/TestBuddyAllocator.java
>  d4d4bb2 
>   
> llap-server/src/test/org/apache/hadoop/hive/llap/cache/TestLowLevelLrfuCachePolicy.java
>  a423eeb 
> 
> Diff: https://reviews.apache.org/r/39522/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Sergey Shelukhin
> 
>

[DISCUSS] Re: deprecating MR in the first release of Hive 2.0

[Thejas Nair]

(Adding [DISCUSS] to subject to bring it to attention of wider audience.)

+1 Given how much investment is going into Tez and Spark execution
modes, it makes sense to convey that better to the user community and
recommend the use of the new modes over MR. Users who choose those
modes are going to get better experience, and it will help to improve
the overall perception of Hive.

Once most users have moved to the new modes, we can start looking into
removing MR support. (Though that is likely to take a while).


On Wed, Oct 21, 2015 at 9:44 PM, Sergey Shelukhin
 wrote:
> We have discussed the removal of hadoop-1 and MR support in Hive 2 line in 
> the past..
> Hadoop-1 removal seems to be non-controversial and on track; before we cut 
> the first release of Hive 2, I propose we deprecate MR.
>
> Tez and Spark engines provide vast perf improvements over MR;
> Execution optimization work by most contributors for a long time has been 
> done for these engines and is not portable to MR, so it is languishing 
> further;
> At the same time, supporting additional code has other development costs for 
> new features or bugs, plus we have to run tests for it both in Apache and for 
> local changes and to deploy code.
>
> However, MR is hard to remove. Plus, it may provide a baseline for some bugs 
> in other engines (which is not bulletproof since MR logic can be incorrect), 
> or to mock during perf benchmarks.
>
> Therefore, I propose that for now we add deprecation warnings suggesting the 
> other alternatives:
>
>   *   to Hive configuration documentation.
>   *   to Hive wiki.
>   *   to release notes on Hive 2.
>   *   in Beeline and CLI when using MR.
>
> Additionally, I propose we remove Minimr test driver from HiveQA runs for 
> master.
>
> What do you think?

[jira] [Created] (HIVE-12235) Improve beeline logging for dynamic service discovery

[Szehon Ho (JIRA)]

Szehon Ho created HIVE-12235:


 Summary: Improve beeline logging for dynamic service discovery
 Key: HIVE-12235
 URL: https://issues.apache.org/jira/browse/HIVE-12235
 Project: Hive
  Issue Type: Bug
Reporter: Szehon Ho


It maybe nice to see which host it tried to, and ended up, connecting to.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-12234) Beeline quit tries to connect again if no existing connections

[Szehon Ho (JIRA)]

Szehon Ho created HIVE-12234:


 Summary: Beeline quit tries to connect again if no existing 
connections
 Key: HIVE-12234
 URL: https://issues.apache.org/jira/browse/HIVE-12234
 Project: Hive
  Issue Type: Bug
Reporter: Szehon Ho
Priority: Minor


Beeline !quit calls close, which calls close(), which then does the following 
check:

{noformat}
beeLine.getDatabaseConnection().getConnection() != null
{noformat}

This inadvertently tries to connect again.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Review Request 39199: HIVE-12084 : Hive queries with ORDER BY and large LIMIT fails with OutOfMemoryError Java heap space

[John Pullokkaran]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/39199/#review103649
---

Ship it!


Ship It!

- John Pullokkaran


On Oct. 22, 2015, 12:41 a.m., Hari Sankar Sivarama Subramaniyan wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/39199/
> ---
> 
> (Updated Oct. 22, 2015, 12:41 a.m.)
> 
> 
> Review request for hive, Ashutosh Chauhan and John Pullokkaran.
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> Please look at https://issues.apache.org/jira/browse/HIVE-12084
> 
> 
> Diffs
> -
> 
>   ql/src/java/org/apache/hadoop/hive/ql/exec/TopNHash.java 484006a 
>   ql/src/test/queries/clientpositive/topn.q PRE-CREATION 
>   ql/src/test/results/clientpositive/topn.q.out PRE-CREATION 
> 
> Diff: https://reviews.apache.org/r/39199/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Hari Sankar Sivarama Subramaniyan
> 
>

Re: Review Request 34713: Invalidate basic stats for insert queries if autogather=false

[Ashutosh Chauhan]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/34713/
---

(Updated Oct. 22, 2015, 7:53 p.m.)


Review request for hive and Gopal V.


Bugs: HIVE-10807
https://issues.apache.org/jira/browse/HIVE-10807


Repository: hive-git


Description
---

Invalidate basic stats for insert queries if autogather=false


Diffs (updated)
-

  ql/src/java/org/apache/hadoop/hive/ql/QueryProperties.java e8f7fba 
  ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java 4e3be0d 
  ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMapRedUtils.java 109b938 
  ql/src/java/org/apache/hadoop/hive/ql/optimizer/StatsOptimizer.java 5a21e6b 
  ql/src/java/org/apache/hadoop/hive/ql/parse/QBParseInfo.java 14a7e9c 
  ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java 3262887 
  ql/src/test/queries/clientpositive/insert_into1.q af82e3a 
  ql/src/test/queries/clientpositive/insert_into2.q 7183c75 
  ql/src/test/results/clientpositive/bucket_map_join_1.q.out ce0df01 
  ql/src/test/results/clientpositive/bucket_map_join_2.q.out 791e606 
  
ql/src/test/results/clientpositive/encrypted/encryption_insert_partition_dynamic.q.out
 3ed1fdb 
  
ql/src/test/results/clientpositive/encrypted/encryption_join_unencrypted_tbl.q.out
 7997fcb 
  ql/src/test/results/clientpositive/insert_into1.q.out cf627a6 
  ql/src/test/results/clientpositive/insert_into2.q.out cc7e135 
  ql/src/test/results/clientpositive/spark/bucket_map_join_1.q.out d3f433d 
  ql/src/test/results/clientpositive/spark/bucket_map_join_2.q.out 3d850db 
  ql/src/test/results/clientpositive/spark/insert_into1.q.out 38134a1 
  ql/src/test/results/clientpositive/spark/insert_into2.q.out 578fae2 
  ql/src/test/results/clientpositive/spark/stats3.q.out 2afb76e 
  ql/src/test/results/clientpositive/stats3.q.out 2afb76e 
  ql/src/test/results/clientpositive/tez/insert_into1.q.out b24b407 
  ql/src/test/results/clientpositive/tez/insert_into2.q.out 2c7ec63 

Diff: https://reviews.apache.org/r/34713/diff/


Testing
---

Existing tests + added new tests


Thanks,

Ashutosh Chauhan

Re: Review Request 39556: HIVE-12187 Release plan once a query is executed

[Jimmy Xiang]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/39556/
---

(Updated Oct. 22, 2015, 4:25 p.m.)


Review request for hive and Chaoyu Tang.


Bugs: HIVE-12187
https://issues.apache.org/jira/browse/HIVE-12187


Repository: hive-git


Description
---

Release plans right after a query is done.


Diffs
-

  ql/src/java/org/apache/hadoop/hive/ql/Driver.java 218b9c8 
  ql/src/java/org/apache/hadoop/hive/ql/exec/Task.java e584e6e 

Diff: https://reviews.apache.org/r/39556/diff/


Testing
---

Unit test. Live cluster testing and profiling.


Thanks,

Jimmy Xiang

Review Request 39556: HIVE-12187 Release plan once a query is executed

[Jimmy Xiang]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/39556/
---

Review request for hive and Chaoyu Tang.


Repository: hive-git


Description
---

Release plans right after a query is done.


Diffs
-

  ql/src/java/org/apache/hadoop/hive/ql/Driver.java 218b9c8 
  ql/src/java/org/apache/hadoop/hive/ql/exec/Task.java e584e6e 

Diff: https://reviews.apache.org/r/39556/diff/


Testing
---

Unit test. Live cluster testing and profiling.


Thanks,

Jimmy Xiang

Review Request 39555: HIVE-12224

[Ashutosh Chauhan]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/39555/
---

Review request for hive and pengcheng xiong.


Bugs: HIVE-12224
https://issues.apache.org/jira/browse/HIVE-12224


Repository: hive-git


Description
---

Remove HOLD_DDLTIME


Diffs
-

  
itests/hive-unit/src/test/java/org/apache/hadoop/hive/ql/history/TestHiveHistory.java
 76c1636 
  ql/src/java/org/apache/hadoop/hive/ql/ErrorMsg.java 87c2830 
  ql/src/java/org/apache/hadoop/hive/ql/exec/MoveTask.java 7e257e5 
  ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java 4e3be0d 
  ql/src/java/org/apache/hadoop/hive/ql/parse/HiveLexer.g 9f8cfd1 
  ql/src/java/org/apache/hadoop/hive/ql/parse/HiveParser.g 5eededd 
  ql/src/java/org/apache/hadoop/hive/ql/parse/SelectClauseParser.g 1dcf392 
  ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java 3262887 
  ql/src/java/org/apache/hadoop/hive/ql/plan/LoadTableDesc.java 3e74d95 
  ql/src/test/org/apache/hadoop/hive/ql/exec/TestExecDriver.java ca59e90 
  ql/src/test/queries/clientnegative/ddltime.q 3517a60 
  ql/src/test/queries/clientpositive/ddltime.q 3eead6f 
  ql/src/test/results/clientnegative/ddltime.q.out 25d9af6 
  ql/src/test/results/clientpositive/ddltime.q.out ec8938d 

Diff: https://reviews.apache.org/r/39555/diff/


Testing
---


Thanks,

Ashutosh Chauhan

Re: [ANNOUNCE] New Hive Committer - Siddharth Seth

[Siddharth Seth]

Thanks everyone!

On Thu, Oct 22, 2015 at 12:54 AM, Navis Ryu  wrote:

> Congratulations!
>
> 2015-10-22 16:49 GMT+09:00 Chinna Rao Lalam :
> > Congratulations!
> >
> > On Thu, Oct 22, 2015 at 12:18 PM, Santlal J Gupta <
> > santlal.gu...@bitwiseglobal.com> wrote:
> >
> >> Congratulations !!
> >>
> >> -Original Message-
> >> From: Chetna C [mailto:chetna@gmail.com]
> >> Sent: Thursday, October 22, 2015 8:58 AM
> >> To: dev@hive.apache.org
> >> Cc: Siddharth Seth
> >> Subject: Re: [ANNOUNCE] New Hive Committer - Siddharth Seth
> >>
> >> Congratulations !!
> >> On Oct 22, 2015 5:13 AM, "Pengcheng Xiong"  wrote:
> >>
> >> > Congrats Sid!
> >> >
> >> > On Wed, Oct 21, 2015 at 2:14 PM, Sergey Shelukhin
> >> > 
> >> > wrote:
> >> >
> >> > > The Apache Hive PMC has voted to make Siddharth Seth a committer on
> >> > > the Apache Hive Project.
> >> > >
> >> > > Please join me in congratulating Sid!
> >> > >
> >> > > Thanks,
> >> > > Sergey.
> >> > >
> >> > >
> >> >
> >>
> >
> >
> >
> > --
> > Hope It Helps,
> > Chinna
>

[jira] [Created] (HIVE-12233) NullPointerException when trying to get grants with StdSQLAuthorizer via Hive CLI

[Hari Sekhon (JIRA)]

Hari Sekhon created HIVE-12233:
--

 Summary: NullPointerException when trying to get grants with 
StdSQLAuthorizer via Hive CLI
 Key: HIVE-12233
 URL: https://issues.apache.org/jira/browse/HIVE-12233
 Project: Hive
  Issue Type: Bug
 Environment: HDP 2.2 + Kerberos
Reporter: Hari Sekhon
Priority: Critical


When trying to see the grants in Hive CLI the following NullPointerException 
bug occurs:
{code}
2015-10-22 16:36:31,535 INFO  [main]: ql.Driver (Driver.java:launchTask(1604)) 
- Starting task [Stage-0:DDL] in serial mode
2015-10-22 16:36:31,536 ERROR [main]: exec.DDLTask (DDLTask.java:failed(511)) - 
org.apache.hadoop.hive.ql.security.authorization.plugin.HiveAuthzPluginException:
 Error showing privileges: null
at 
org.apache.hadoop.hive.ql.security.authorization.plugin.sqlstd.SQLAuthorizationUtils.getPluginException(SQLAuthorizationUtils.java:419)
at 
org.apache.hadoop.hive.ql.security.authorization.plugin.sqlstd.SQLStdHiveAccessController.showPrivileges(SQLStdHiveAccessController.java:445)
at 
org.apache.hadoop.hive.ql.security.authorization.plugin.sqlstd.SQLStdHiveAccessControllerWrapper.showPrivileges(SQLStdHiveAccessControllerWrapper.java:141)
at 
org.apache.hadoop.hive.ql.security.authorization.plugin.HiveAuthorizerImpl.showPrivileges(HiveAuthorizerImpl.java:96)
at org.apache.hadoop.hive.ql.exec.DDLTask.showGrants(DDLTask.java:649)
at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:465)
at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160)
at 
org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:85)
at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1606)
at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1367)
at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1179)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1006)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:996)
at 
org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:247)
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:199)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:410)
at 
org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:783)
at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:677)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:616)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
Caused by: java.lang.NullPointerException
at 
org.apache.hadoop.hive.ql.security.authorization.plugin.sqlstd.SQLStdHiveAccessController.isUserAdmin(SQLStdHiveAccessController.java:561)
at 
org.apache.hadoop.hive.ql.security.authorization.plugin.sqlstd.SQLStdHiveAccessController.showPrivileges(SQLStdHiveAccessController.java:387)
... 23 more
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-12232) Create external table failed when enabled StorageBasedAuthorization

[WangMeng (JIRA)]

WangMeng created HIVE-12232:
---

 Summary: Create external table failed when enabled 
StorageBasedAuthorization
 Key: HIVE-12232
 URL: https://issues.apache.org/jira/browse/HIVE-12232
 Project: Hive
  Issue Type: Bug
Affects Versions: 1.2.1
Reporter: WangMeng
Assignee: WangMeng


Please look at the stacktrace, when enabled StorageBasedAuthorization, creating 
external table will failed with write permission about the default warehouse 
path "/user/hive/warehouse": 

> CREATE EXTERNAL TABLE test(id int) LOCATION '/tmp/wangmeng/test'  ;
Error: Error while compiling statement: FAILED: HiveException 
java.security.AccessControlException: Permission denied: user=wangmeng, 
access=WRITE, inode="/user/hive/warehouse":hive:hive:drwxr-x--t.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Build failed in Jenkins: HIVE-TRUNK-JAVA8 #125

[hiveqa]

See 


Changes:

[chinnaraol] HIVE-12026 : Add test case to check permissions when truncating 
partition

[pxiong] HIVE-12210: Fix a few failing tests: testCliDriver_udf_explode and 
testCliDriver_udtf_explode (Aleksei S via Pengcheng Xiong)

[Jimmy Xiang] HIVE-12200 INSERT INTO table using a select statement w/o a FROM 
clause fails (Jimmy, reviewed by Chaoyu)

[sershe] HIVE-11565 : LLAP: Some counters are incorrect (Siddharth Seth, 
reviewed by Sergey Shelukhin)

[jdere] HIVE-12179: Add option to not add spark-assembly.jar to Hive classpath 
(Jason Dere, reviewed by Ashutosh Chauhan)

[vikram] HIVE-11829: Create test for HIVE-11216 (Vikram Dixit K, reviewed by 
Jason Dere)

[Xuefu Zhang] HIVE-12218: Unable to create a like table for an hbase backed 
table (Chaoyu via Xuefu)

[Alan Gates] HIVE-12170 normalize HBase metastore connection configuration 
(gates, reviewed by Sergey Shelukhin)

--
[...truncated 310 lines...]
Aptest2/src/main/java/org/apache/hive/ptest/execution/conf/TestBatch.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/conf/UnitTestBatch.java
Aptest2/src/main/java/org/apache/hive/ptest/execution/JIRAService.java
Aptest2/src/main/java/org/apache/hive/ptest/execution/Drone.java
Aptest2/src/main/java/org/apache/hive/ptest/execution/Constants.java
Aptest2/src/main/java/org/apache/hive/ptest/execution/ssh
Aptest2/src/main/java/org/apache/hive/ptest/execution/ssh/RSyncCommand.java
Aptest2/src/main/java/org/apache/hive/ptest/execution/ssh/RSyncResult.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/ssh/NonZeroExitCodeException.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/ssh/AbstractSSHCommand.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/ssh/AbstractSSHResult.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/ssh/SSHExecutionException.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/ssh/RemoteCommandResult.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/ssh/SSHCommandExecutor.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/ssh/RSyncCommandExecutor.java
Aptest2/src/main/java/org/apache/hive/ptest/execution/ssh/SSHCommand.java
Aptest2/src/main/java/org/apache/hive/ptest/execution/ssh/SSHResult.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/AbortDroneException.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/LocalCommandFactory.java
Aptest2/src/main/java/org/apache/hive/ptest/api
Aptest2/src/main/java/org/apache/hive/ptest/api/client
Aptest2/src/main/java/org/apache/hive/ptest/api/client/PTestClient.java
Aptest2/src/main/java/org/apache/hive/ptest/api/response
A
ptest2/src/main/java/org/apache/hive/ptest/api/response/TestStatusResponse.java
Aptest2/src/main/java/org/apache/hive/ptest/api/response/TestStatus.java
A
ptest2/src/main/java/org/apache/hive/ptest/api/response/TestStopResponse.java
A
ptest2/src/main/java/org/apache/hive/ptest/api/response/TestListResponse.java
A
ptest2/src/main/java/org/apache/hive/ptest/api/response/GenericResponse.java
A
ptest2/src/main/java/org/apache/hive/ptest/api/response/TestStartResponse.java
A
ptest2/src/main/java/org/apache/hive/ptest/api/response/TestLogResponse.java
Aptest2/src/main/java/org/apache/hive/ptest/api/Status.java
Aptest2/src/main/java/org/apache/hive/ptest/api/server
A
ptest2/src/main/java/org/apache/hive/ptest/api/server/ExecutionController.java
Aptest2/src/main/java/org/apache/hive/ptest/api/server/TestExecutor.java
Aptest2/src/main/java/org/apache/hive/ptest/api/server/Test.java
Aptest2/src/main/java/org/apache/hive/ptest/api/server/TestLogger.java
Aptest2/src/main/java/org/apache/hive/ptest/api/request
Aptest2/src/main/java/org/apache/hive/ptest/api/request/TestListRequest.java
A
ptest2/src/main/java/org/apache/hive/ptest/api/request/TestStartRequest.java
Aptest2/src/main/java/org/apache/hive/ptest/api/request/TestLogRequest.java
A
ptest2/src/main/java/org/apache/hive/ptest/api/request/TestStatusRequest.java
Aptest2/src/main/java/org/apache/hive/ptest/api/request/TestStopRequest.java
Checked out revision 1709974.
+ cd ptest2
+ mvn clean package -DskipTests -Drat.numUnapprovedLicenses=1000 
-Dmaven.repo.local=
[INFO] Scanning for projects...
[INFO] 
[INFO] 
[INFO] Building hive-ptest 1.0
[INFO] 
Downloading: 
http://people.apache.org/~brock/approvals-maven-repository/net/schmizz/sshj/maven-metadata.xml
Downloading: 
http://repo.springsour

Re: [ANNOUNCE] New Hive Committer - Siddharth Seth

[Navis Ryu]

Congratulations!

2015-10-22 16:49 GMT+09:00 Chinna Rao Lalam :
> Congratulations!
>
> On Thu, Oct 22, 2015 at 12:18 PM, Santlal J Gupta <
> santlal.gu...@bitwiseglobal.com> wrote:
>
>> Congratulations !!
>>
>> -Original Message-
>> From: Chetna C [mailto:chetna@gmail.com]
>> Sent: Thursday, October 22, 2015 8:58 AM
>> To: dev@hive.apache.org
>> Cc: Siddharth Seth
>> Subject: Re: [ANNOUNCE] New Hive Committer - Siddharth Seth
>>
>> Congratulations !!
>> On Oct 22, 2015 5:13 AM, "Pengcheng Xiong"  wrote:
>>
>> > Congrats Sid!
>> >
>> > On Wed, Oct 21, 2015 at 2:14 PM, Sergey Shelukhin
>> > 
>> > wrote:
>> >
>> > > The Apache Hive PMC has voted to make Siddharth Seth a committer on
>> > > the Apache Hive Project.
>> > >
>> > > Please join me in congratulating Sid!
>> > >
>> > > Thanks,
>> > > Sergey.
>> > >
>> > >
>> >
>>
>
>
>
> --
> Hope It Helps,
> Chinna

Re: [ANNOUNCE] New Hive Committer- Aihua Xu

[Navis Ryu]

Congratulations!

2015-10-22 16:48 GMT+09:00 Chinna Rao Lalam :
> Congrats Aihua!
>
> On Thu, Oct 22, 2015 at 10:45 AM, Vaibhav Gumashta <
> vgumas...@hortonworks.com> wrote:
>
>> Congrats Aihua!
>>
>> ‹Vaibhav
>>
>> On 10/21/15, 4:42 PM, "Pengcheng Xiong"  wrote:
>>
>> >Congrats Aihua!
>> >
>> >On Wed, Oct 21, 2015 at 2:09 PM, Szehon Ho  wrote:
>> >
>> >> The Apache Hive PMC has voted to make Aihua Xu a committer on the Apache
>> >> Hive Project.
>> >>
>> >> Please join me in congratulating Aihua!
>> >>
>> >> Thanks,
>> >> Szehon
>> >>
>>
>>
>
>
> --
> Hope It Helps,
> Chinna

Re: [ANNOUNCE] New Hive Committer - Siddharth Seth

[Chinna Rao Lalam]

Congratulations!

On Thu, Oct 22, 2015 at 12:18 PM, Santlal J Gupta <
santlal.gu...@bitwiseglobal.com> wrote:

> Congratulations !!
>
> -Original Message-
> From: Chetna C [mailto:chetna@gmail.com]
> Sent: Thursday, October 22, 2015 8:58 AM
> To: dev@hive.apache.org
> Cc: Siddharth Seth
> Subject: Re: [ANNOUNCE] New Hive Committer - Siddharth Seth
>
> Congratulations !!
> On Oct 22, 2015 5:13 AM, "Pengcheng Xiong"  wrote:
>
> > Congrats Sid!
> >
> > On Wed, Oct 21, 2015 at 2:14 PM, Sergey Shelukhin
> > 
> > wrote:
> >
> > > The Apache Hive PMC has voted to make Siddharth Seth a committer on
> > > the Apache Hive Project.
> > >
> > > Please join me in congratulating Sid!
> > >
> > > Thanks,
> > > Sergey.
> > >
> > >
> >
>



-- 
Hope It Helps,
Chinna

Re: [ANNOUNCE] New Hive Committer- Aihua Xu

[Chinna Rao Lalam]

Congrats Aihua!

On Thu, Oct 22, 2015 at 10:45 AM, Vaibhav Gumashta <
vgumas...@hortonworks.com> wrote:

> Congrats Aihua!
>
> ‹Vaibhav
>
> On 10/21/15, 4:42 PM, "Pengcheng Xiong"  wrote:
>
> >Congrats Aihua!
> >
> >On Wed, Oct 21, 2015 at 2:09 PM, Szehon Ho  wrote:
> >
> >> The Apache Hive PMC has voted to make Aihua Xu a committer on the Apache
> >> Hive Project.
> >>
> >> Please join me in congratulating Aihua!
> >>
> >> Thanks,
> >> Szehon
> >>
>
>


-- 
Hope It Helps,
Chinna

[jira] [Created] (HIVE-12231) StorageBasedAuthorization requires write permission of default Warehouse PATH when execute "CREATE DATABASE $Name LOCATION '$ExternalPath' "

[WangMeng (JIRA)]

WangMeng created HIVE-12231:
---

 Summary: StorageBasedAuthorization requires write permission of 
default Warehouse PATH when execute "CREATE DATABASE $Name LOCATION 
'$ExternalPath' "
 Key: HIVE-12231
 URL: https://issues.apache.org/jira/browse/HIVE-12231
 Project: Hive
  Issue Type: Bug
Affects Versions: 1.2.1
Reporter: WangMeng


Please look at the stacktrace, when enabled StorageBasedAuthorization ,  I set 
external Location of creating database, it will also check write permission of 
default Warehouse "/user/hive/warehouse" :
> create  database test  location '/tmp/wangmeng/test'  ;
Error: Error while compiling statement: FAILED: HiveException 
java.security.AccessControlException: Permission denied: user=wangmeng, 
access=WRITE, inode="/user/hive/warehouse":hive:hive:drwxr-x--t
at 
org.apache.hadoop.hdfs.server.namenode.DefaultAuthorizationProvider.checkFsPermission(DefaultAuthorizationProvider.java:255)
at 
org.apache.hadoop.hdfs.server.namenode.DefaultAuthorizationProvider.check(DefaultAuthorizationProvider.java:236)
at 
org.apache.hadoop.hdfs.server.namenode.DefaultAuthorizationProvider.checkPermission(DefaultAuthorizationProvider.java:151)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)