[jira] [Created] (HIVE-19022) Hive Beeline can not read user define environment variables

2018-03-21 Thread KaiXu (JIRA)
KaiXu created HIVE-19022: Summary: Hive Beeline can not read user define environment variables Key: HIVE-19022 URL: https://issues.apache.org/jira/browse/HIVE-19022 Project: Hive Issue Type: Bug

Re: Hive 3.0 release

2018-03-21 Thread Lefty Leverenz
+1. Could some attention be given to documentation? This would need to come from developers, since I've cut back my participation. -- Lefty On Wed, Mar 21, 2018 at 6:00 PM Alan Gates wrote: > +1. And +1 to Vihang's comment that this will be helpful for the >

[jira] [Created] (HIVE-19021) WM counters are not properly propagated from LLAP to AM

2018-03-21 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created HIVE-19021: --- Summary: WM counters are not properly propagated from LLAP to AM Key: HIVE-19021 URL: https://issues.apache.org/jira/browse/HIVE-19021 Project: Hive

Re: PTest stuck

2018-03-21 Thread Vihang Karajgaonkar
Yeah. Looks like there was something wrong since the job was running over 5 hrs. I aborted the job and updated that JIRA informing the author about the same. Lets monitor if the issue happens with other jobs as well. On Wed, Mar 21, 2018 at 5:46 PM, Prasanth Jayachandran <

Re: Review Request 66185: JDBC: Provide an option to simplify beeline usage by supporting default and named URL for beeline

2018-03-21 Thread Thejas Nair
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/66185/#review199704 --- beeline/src/java/org/apache/hive/beeline/BeeLine.java Lines 321

[jira] [Created] (HIVE-19020) Vectorization: When vectorized, orc_null_check.q throws NPE in VectorExpressionWriterFactory

2018-03-21 Thread Matt McCline (JIRA)
Matt McCline created HIVE-19020: --- Summary: Vectorization: When vectorized, orc_null_check.q throws NPE in VectorExpressionWriterFactory Key: HIVE-19020 URL: https://issues.apache.org/jira/browse/HIVE-19020

PTest stuck

2018-03-21 Thread Prasanth Jayachandran
https://builds.apache.org/view/H-L/view/Hive/job/PreCommit-HIVE-Build/9735/ seems to be stuck in git gc loop. Anyone know what might be happening? Should we kill it and see if it happens again? Thanks Prasanth

Re: Review Request 66204: HIVE-19017: Add util function to determine if 2 ValidWriteIdLists are at the same committed ID

2018-03-21 Thread Jason Dere
> On March 22, 2018, 12:26 a.m., Jesús Camacho Rodríguez wrote: > > storage-api/src/java/org/apache/hive/common/util/TxnIdUtils.java > > Lines 41 (patched) > > > > > > Can minOpenId be null for both lists? What's the

[jira] [Created] (HIVE-19019) Vectorization and Parquet: When vectorized, parquet_schema_evolution.q throws HiveException "Not implemented yet"

2018-03-21 Thread Matt McCline (JIRA)
Matt McCline created HIVE-19019: --- Summary: Vectorization and Parquet: When vectorized, parquet_schema_evolution.q throws HiveException "Not implemented yet" Key: HIVE-19019 URL:

[jira] [Created] (HIVE-19018) beeline -e now requires semicolon even when used with query from command line

2018-03-21 Thread Aihua Xu (JIRA)
Aihua Xu created HIVE-19018: --- Summary: beeline -e now requires semicolon even when used with query from command line Key: HIVE-19018 URL: https://issues.apache.org/jira/browse/HIVE-19018 Project: Hive

Re: Review Request 66204: HIVE-19017: Add util function to determine if 2 ValidWriteIdLists are at the same committed ID

2018-03-21 Thread Jesús Camacho Rodríguez
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/66204/#review199731 --- storage-api/src/java/org/apache/hive/common/util/TxnIdUtils.java

Review Request 66204: HIVE-19017: Add util function to determine if 2 ValidWriteIdLists are at the same committed ID

2018-03-21 Thread Jason Dere
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/66204/ --- Review request for hive, Eugene Koifman, Gopal V, and Jesús Camacho Rodríguez.

[jira] [Created] (HIVE-19017) Add util function to determine if 2 ValidWriteIdLists are at the same committed ID

2018-03-21 Thread Jason Dere (JIRA)
Jason Dere created HIVE-19017: - Summary: Add util function to determine if 2 ValidWriteIdLists are at the same committed ID Key: HIVE-19017 URL: https://issues.apache.org/jira/browse/HIVE-19017 Project:

Re: Review Request 66183: HIVE-18953 Implement CHECK constraint

2018-03-21 Thread Vineet Garg
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/66183/ --- (Updated March 22, 2018, 12:05 a.m.) Review request for hive, Ashutosh Chauhan

Re: Review Request 66179: HIVE-18979

2018-03-21 Thread Ashutosh Chauhan
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/66179/#review199579 ---

[jira] [Created] (HIVE-19016) Vectorization and Parquet: When vectorized, parquet_nested_complex.q produces RuntimeException: Unsupported type used

2018-03-21 Thread Matt McCline (JIRA)
Matt McCline created HIVE-19016: --- Summary: Vectorization and Parquet: When vectorized, parquet_nested_complex.q produces RuntimeException: Unsupported type used Key: HIVE-19016 URL:

[jira] [Created] (HIVE-19015) Vectorization and Parquet: When vectorized, parquet_map_of_arrays_of_ints.q gets a ClassCastException

2018-03-21 Thread Matt McCline (JIRA)
Matt McCline created HIVE-19015: --- Summary: Vectorization and Parquet: When vectorized, parquet_map_of_arrays_of_ints.q gets a ClassCastException Key: HIVE-19015 URL: https://issues.apache.org/jira/browse/HIVE-19015

Review Request 66201: HIVE-19014 utilize YARN-8028 (queue ACL check) in Hive Tez session pool

2018-03-21 Thread Sergey Shelukhin
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/66201/ --- Review request for hive and Thejas Nair. Repository: hive-git Description

[jira] [Created] (HIVE-19014) utilize YARN-8028 (queue ACL check) in Hive Tez session pool

2018-03-21 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created HIVE-19014: --- Summary: utilize YARN-8028 (queue ACL check) in Hive Tez session pool Key: HIVE-19014 URL: https://issues.apache.org/jira/browse/HIVE-19014 Project: Hive

[GitHub] hive pull request #323: HIVE-19013. Fix various storage-api build issues.

2018-03-21 Thread omalley
GitHub user omalley opened a pull request: https://github.com/apache/hive/pull/323 HIVE-19013. Fix various storage-api build issues. Fix some minor issues. You can merge this pull request into a Git repository by running: $ git pull https://github.com/omalley/hive hive-19013

[jira] [Created] (HIVE-19013) Fix some minor build issues in storage-api

2018-03-21 Thread Owen O'Malley (JIRA)
Owen O'Malley created HIVE-19013: Summary: Fix some minor build issues in storage-api Key: HIVE-19013 URL: https://issues.apache.org/jira/browse/HIVE-19013 Project: Hive Issue Type: Bug

Re: Review Request 66183: HIVE-18953 Implement CHECK constraint

2018-03-21 Thread Vineet Garg
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/66183/ --- (Updated March 21, 2018, 10:33 p.m.) Review request for hive, Ashutosh Chauhan

Re: Hive 3.0 release

2018-03-21 Thread Alan Gates
+1. And +1 to Vihang's comment that this will be helpful for the standalone-metastore. We should work on producing a standalone-metastore release in the same time frame so that the schema's, etc. match. I can RM that unless someone else wants to. Alan. On Wed, Mar 21, 2018 at 12:05 PM, Andrew

Re: Review Request 66167: HIVE-18952 Tez session disconnect and reconnect on HS2 HA failover

2018-03-21 Thread Eric Wohlstadter
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/66167/#review199620 --- pom.xml Line 198 (original), 198 (patched)

[jira] [Created] (HIVE-19012) Support ARM and PPC arch

2018-03-21 Thread Vi On (JIRA)
Vi On created HIVE-19012: Summary: Support ARM and PPC arch Key: HIVE-19012 URL: https://issues.apache.org/jira/browse/HIVE-19012 Project: Hive Issue Type: Bug Affects Versions: 3.0.0

[jira] [Created] (HIVE-19011) Druid Storage Handler returns conflicting results for Qtest druidmini_dynamic_partition.q

2018-03-21 Thread slim bouguerra (JIRA)
slim bouguerra created HIVE-19011: - Summary: Druid Storage Handler returns conflicting results for Qtest druidmini_dynamic_partition.q Key: HIVE-19011 URL: https://issues.apache.org/jira/browse/HIVE-19011

Re: Hive 3.0 release

2018-03-21 Thread Andrew Sherman
+1 -Andrew On Wed, Mar 21, 2018 at 11:33 AM, Jesus Camacho Rodriguez < jcama...@apache.org> wrote: > +1 > > -Jesús > > On 3/21/18, 10:44 AM, "Prasanth Jayachandran" < > pjayachand...@hortonworks.com> wrote: > > +1 > > Thanks > Prasanth > > > > On Wed, Mar 21, 2018 at 9:59 AM

[jira] [Created] (HIVE-19010) Improve column stats update

2018-03-21 Thread Aihua Xu (JIRA)
Aihua Xu created HIVE-19010: --- Summary: Improve column stats update Key: HIVE-19010 URL: https://issues.apache.org/jira/browse/HIVE-19010 Project: Hive Issue Type: Improvement

Re: Review Request 66188: HIVE-18986 Table rename will run java.lang.StackOverflowError in dataNucleus if the table contains large number of columns

2018-03-21 Thread Aihua Xu via Review Board
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/66188/ --- (Updated March 21, 2018, 6:57 p.m.) Review request for hive, Alexander

Re: Hive 3.0 release

2018-03-21 Thread Jesus Camacho Rodriguez
+1 -Jesús On 3/21/18, 10:44 AM, "Prasanth Jayachandran" wrote: +1 Thanks Prasanth On Wed, Mar 21, 2018 at 9:59 AM -0700, "Vihang Karajgaonkar" > wrote: +1 on

Integration testing for clients

2018-03-21 Thread Matt Burgess
I'm looking into writing integration tests for our Hive processors in Apache NiFi to be able to test against a "real" Hive Server 2, Hive Metastore, etc. I see in Hive 3.0 there's a MiniHMS and other test classes, but I couldn't find them in a Maven repo anywhere. Are there artifacts published

Re: Hive 3.0 release

2018-03-21 Thread Prasanth Jayachandran
+1 Thanks Prasanth On Wed, Mar 21, 2018 at 9:59 AM -0700, "Vihang Karajgaonkar" > wrote: +1 on releasing Hive 3.0.0. This would be useful for standalone-metastore work as well. On Wed, Mar 21, 2018 at 8:49 AM, Gunther Hagleitner <

[jira] [Created] (HIVE-19009) Retain and use runtime statistics thru out a session

2018-03-21 Thread Zoltan Haindrich (JIRA)
Zoltan Haindrich created HIVE-19009: --- Summary: Retain and use runtime statistics thru out a session Key: HIVE-19009 URL: https://issues.apache.org/jira/browse/HIVE-19009 Project: Hive

[jira] [Created] (HIVE-19008) Improve Spark session id logging

2018-03-21 Thread Sahil Takiar (JIRA)
Sahil Takiar created HIVE-19008: --- Summary: Improve Spark session id logging Key: HIVE-19008 URL: https://issues.apache.org/jira/browse/HIVE-19008 Project: Hive Issue Type: Sub-task

Re: Hive 3.0 release

2018-03-21 Thread Vihang Karajgaonkar
+1 on releasing Hive 3.0.0. This would be useful for standalone-metastore work as well. On Wed, Mar 21, 2018 at 8:49 AM, Gunther Hagleitner < ghagleit...@hortonworks.com> wrote: > +1 > > Thank you, > Gunther > > > > On Tue, Mar 20, 2018 at 11:07 PM -0700, "Thejas Nair" < >

Re: how beeline operations going to same thread in HiveMetaStore

2018-03-21 Thread Vihang Karajgaonkar
What version of Hive are you using? I am actually surprised that set metaconf:fs.s3a.access.key=xx; works from beeline. Based on my knowledge this config is not settable in metastore which is why I had created this JIRA HIVE-16913 some time

Re: Review Request 66069: HIVE-18926 Imporve operator-tree matching

2018-03-21 Thread Zoltan Haindrich
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/66069/ --- (Updated March 21, 2018, 3:49 p.m.) Review request for hive and Ashutosh

Re: Hive 3.0 release

2018-03-21 Thread Gunther Hagleitner
+1 Thank you, Gunther On Tue, Mar 20, 2018 at 11:07 PM -0700, "Thejas Nair" > wrote: +1 On Tue, Mar 20, 2018 at 4:46 PM, Ashutosh Chauhan wrote: > Hi all, > > It's almost a year since we branched off branch-2 Since then there are more >

Re: Review Request 66069: HIVE-18926 Imporve operator-tree matching

2018-03-21 Thread Zoltan Haindrich
> On March 20, 2018, 12:08 a.m., Ashutosh Chauhan wrote: > > ql/src/java/org/apache/hadoop/hive/ql/optimizer/stats/annotation/StatsRulesProcFactory.java > > Line 2501 (original), 2507 (patched) > > > > > > I think

how beeline operations going to same thread in HiveMetaStore

2018-03-21 Thread Venkata ramana gollamudi
Hi, when i run following commands from beeline set metaconf:fs.s3a.access.key=xx; set metaconf:fs.s3a.secret.key=xx; create table t1(a string) location "s3a://bucket1/loc1"; all these commands are being executed by same thread in hivemetastore service. so HiveMetaStore.setmetaconf

Re: Review Request 65686: HIVE-18728 Secure webHCat with SSL

2018-03-21 Thread Oleksiy Sayankin
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/65686/ --- (Updated March 21, 2018, 12:57 p.m.) Review request for hive, Lefty Leverenz,

[jira] [Created] (HIVE-19007) REPL LOAD should set the Hive configs obtained through WITH clause into the tasks created..

2018-03-21 Thread Sankar Hariappan (JIRA)
Sankar Hariappan created HIVE-19007: --- Summary: REPL LOAD should set the Hive configs obtained through WITH clause into the tasks created.. Key: HIVE-19007 URL: https://issues.apache.org/jira/browse/HIVE-19007

[jira] [Created] (HIVE-19006) upgrade log4j2 to 2.11.0

2018-03-21 Thread Saijin Huang (JIRA)
Saijin Huang created HIVE-19006: --- Summary: upgrade log4j2 to 2.11.0 Key: HIVE-19006 URL: https://issues.apache.org/jira/browse/HIVE-19006 Project: Hive Issue Type: Improvement

[jira] [Created] (HIVE-19005) Maximum Session Per User

2018-03-21 Thread BELUGA BEHR (JIRA)
BELUGA BEHR created HIVE-19005: -- Summary: Maximum Session Per User Key: HIVE-19005 URL: https://issues.apache.org/jira/browse/HIVE-19005 Project: Hive Issue Type: New Feature

Re: Review Request 66127: HIVE-18982: Provide a CLI option to manually trigger failover

2018-03-21 Thread j . prasanth . j
> On March 20, 2018, 6:59 p.m., Sergey Shelukhin wrote: > > service/src/java/org/apache/hive/service/servlet/HS2LeadershipStatus.java > > Lines 46 (patched) > > > > > > hmm... some testing will be needed for this,

Re: Review Request 66127: HIVE-18982: Provide a CLI option to manually trigger failover

2018-03-21 Thread j . prasanth . j
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/66127/ --- (Updated March 21, 2018, 7:31 a.m.) Review request for hive and Sergey

Re: Hive 3.0 release

2018-03-21 Thread Thejas Nair
Hi Igor, For many of the steps in release management, you need to be a Hive committer. Thanks, Thejas On Tue, Mar 20, 2018 at 10:59 PM, Кривенко Ігор wrote: > Are there any requirements for being RM ? > May i be Release manager for 3.0? > > Thanks, > Igor Kryvenko > >

Re: Hive 3.0 release

2018-03-21 Thread Thejas Nair
+1 On Tue, Mar 20, 2018 at 4:46 PM, Ashutosh Chauhan wrote: > Hi all, > > It's almost a year since we branched off branch-2 Since then there are more > than 1700 commits which master has received. There are lots of new features > hidden in these commits. I think its about