[jira] [Created] (HIVE-12246) Orc FileDump fails with Missing CLI jar

2015-10-23 Thread Prasanth Jayachandran (JIRA) 
Prasanth Jayachandran created HIVE-12246:


 Summary: Orc FileDump fails with Missing CLI jar
 Key: HIVE-12246
 URL: https://issues.apache.org/jira/browse/HIVE-12246
 Project: Hive
  Issue Type: Bug
Affects Versions: 2.0.0
Reporter: Prasanth Jayachandran
Assignee: Prasanth Jayachandran


Running hive --orcfiledump fails with "Missing CLI jar"



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-12240) Hive when not doAs put username in job name for viewing in RM

2015-10-23 Thread Hari Sekhon (JIRA) 
Hari Sekhon created HIVE-12240:
--

 Summary: Hive when not doAs put username in job name for viewing 
in RM
 Key: HIVE-12240
 URL: https://issues.apache.org/jira/browse/HIVE-12240
 Project: Hive
  Issue Type: Improvement
  Components: HiveServer2
Affects Versions: 0.14.0
 Environment: HDP 2.2
Reporter: Hari Sekhon


When using HiveServer2 with SQLStdAuthorizer and doAs=false please put the 
username in the HIVE- job submission so that we can see which user 
submitted which job in the RM queues as all the jobs just show as 'hive' user.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Review Request 29199: HIVE-9013: Hive set command exposes metastore db password

2015-10-23 Thread Binglin Chang 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/29199/
---

(Updated Oct. 23, 2015, 5:02 p.m.)


Review request for hive.


Repository: hive-git


Description
---

HIVE-9013: Hive set command exposes metastore db password


Diffs (updated)
-

  common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 6c7adbd 
  common/src/test/org/apache/hadoop/hive/conf/TestHiveConf.java e9bde21 
  ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java eb2ab56 
  ql/src/java/org/apache/hadoop/hive/ql/exec/mr/ExecDriver.java b799a17 
  ql/src/java/org/apache/hadoop/hive/ql/exec/tez/DagUtils.java d250b82 
  ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionState.java 48231be 
  ql/src/java/org/apache/hadoop/hive/ql/processors/SetProcessor.java 06a83ae 
  ql/src/test/org/apache/hadoop/hive/ql/processors/TestSetProcessor.java 
PRE-CREATION 

Diff: https://reviews.apache.org/r/29199/diff/


Testing
---


Thanks,

Binglin Chang

[jira] [Created] (HIVE-12244) Refactoring code for avoiding of comparison of Strings and do comparison on Path

2015-10-23 Thread Alina Abramova (JIRA) 
Alina Abramova created HIVE-12244:
-

 Summary: Refactoring code for avoiding of comparison of Strings 
and do comparison on Path
 Key: HIVE-12244
 URL: https://issues.apache.org/jira/browse/HIVE-12244
 Project: Hive
  Issue Type: Improvement
Reporter: Alina Abramova
Priority: Minor


In Hive often String is used for representation path and it causes new issues.
We need to compare it with equals() but comparing Strings often is not right in 
terms comparing paths .
I think if we used Path from org.apache.hadoop.fs we avoid new problems in 
future.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Review Request 39601: HIVE-12244

2015-10-23 Thread Alina Abramova 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/39601/
---

Review request for hive.


Repository: hive-git


Description
---

Refactoring code for avoiding of comparison of Strings and do comparison on Path


Diffs
-

  
metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java
 cdbae95 
  ql/src/java/org/apache/hadoop/hive/ql/Context.java ca0d487 
  ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java a8c6aca 
  ql/src/java/org/apache/hadoop/hive/ql/exec/MapOperator.java d5ea96a 
  ql/src/java/org/apache/hadoop/hive/ql/exec/MoveTask.java 8eb6c97 
  ql/src/java/org/apache/hadoop/hive/ql/exec/Operator.java 69ee076 
  ql/src/java/org/apache/hadoop/hive/ql/exec/ScriptOperator.java 465c508 
  ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java 973456b 
  ql/src/java/org/apache/hadoop/hive/ql/exec/mr/ExecDriver.java a2cf712 
  
ql/src/java/org/apache/hadoop/hive/ql/exec/spark/SparkDynamicPartitionPruner.java
 52913e0 
  ql/src/java/org/apache/hadoop/hive/ql/exec/tez/DagUtils.java 19da1c3 
  ql/src/java/org/apache/hadoop/hive/ql/exec/tez/DynamicPartitionPruner.java 
7abd94d 
  ql/src/java/org/apache/hadoop/hive/ql/exec/tez/SplitGrouper.java c169677 
  ql/src/java/org/apache/hadoop/hive/ql/exec/vector/VectorizedRowBatchCtx.java 
82d4a8f 
  ql/src/java/org/apache/hadoop/hive/ql/hooks/HookContext.java bed17e9 
  ql/src/java/org/apache/hadoop/hive/ql/io/BucketizedHiveInputFormat.java 
edcc3b6 
  ql/src/java/org/apache/hadoop/hive/ql/io/CombineHiveInputFormat.java e13c4dd 
  ql/src/java/org/apache/hadoop/hive/ql/io/HiveContextAwareRecordReader.java 
9b3f8ec 
  ql/src/java/org/apache/hadoop/hive/ql/io/HiveFileFormatUtils.java 06d3df7 
  ql/src/java/org/apache/hadoop/hive/ql/io/HiveInputFormat.java 27499ad 
  ql/src/java/org/apache/hadoop/hive/ql/io/IOPrepareCache.java f4a21f8 
  ql/src/java/org/apache/hadoop/hive/ql/io/SymbolicInputFormat.java feef854 
  ql/src/java/org/apache/hadoop/hive/ql/io/avro/AvroGenericRecordReader.java 
1381514 
  ql/src/java/org/apache/hadoop/hive/ql/io/merge/MergeFileWork.java fbc87e8 
  ql/src/java/org/apache/hadoop/hive/ql/io/parquet/ProjectionPusher.java 
4480600 
  ql/src/java/org/apache/hadoop/hive/ql/io/rcfile/stats/PartialScanWork.java 
c0a8ae7 
  
ql/src/java/org/apache/hadoop/hive/ql/io/rcfile/truncate/ColumnTruncateWork.java
 d63aa29 
  ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMapRedUtils.java 693d8c7 
  ql/src/java/org/apache/hadoop/hive/ql/optimizer/MapJoinProcessor.java f8f2b7b 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/AbstractJoinTaskDispatcher.java
 a3a7f42 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/BucketingSortingCtx.java
 296fecb 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/BucketingSortingOpProcFactory.java
 aa41200 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/CommonJoinTaskDispatcher.java
 1f6b5d7 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/GenMRSkewJoinProcessor.java
 15f0d70 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/GenSparkSkewJoinProcessor.java
 f88fd0a 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/NullScanTaskDispatcher.java
 f901812 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/SortMergeJoinTaskDispatcher.java
 3b09c2f 
  ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/Vectorizer.java 
8171139 
  
ql/src/java/org/apache/hadoop/hive/ql/optimizer/spark/SparkSkewJoinProcFactory.java
 5990d17 
  ql/src/java/org/apache/hadoop/hive/ql/plan/ConditionalResolverCommonJoin.java 
1da7f85 
  ql/src/java/org/apache/hadoop/hive/ql/plan/ConditionalResolverMergeFiles.java 
3f07ea7 
  ql/src/java/org/apache/hadoop/hive/ql/plan/MapWork.java 2cb9257 
  ql/src/java/org/apache/hadoop/hive/ql/plan/PartitionDesc.java 864301c 
  ql/src/test/org/apache/hadoop/hive/ql/exec/TestExecDriver.java ca59e90 
  ql/src/test/org/apache/hadoop/hive/ql/exec/TestOperators.java bf122e0 
  ql/src/test/org/apache/hadoop/hive/ql/exec/TestPlan.java 1364888 
  ql/src/test/org/apache/hadoop/hive/ql/exec/tez/TestTezTask.java 858cca0 
  
ql/src/test/org/apache/hadoop/hive/ql/io/TestHiveBinarySearchRecordReader.java 
7a1748c 
  ql/src/test/org/apache/hadoop/hive/ql/io/TestHiveFileFormatUtils.java efc18ee 
  ql/src/test/org/apache/hadoop/hive/ql/io/TestSymlinkTextInputFormat.java 
6f0b9df 
  ql/src/test/org/apache/hadoop/hive/ql/io/orc/TestInputOutputFormat.java 
b9d6c27 
  
ql/src/test/org/apache/hadoop/hive/ql/plan/TestConditionalResolverCommonJoin.java
 ef846a6 

Diff: https://reviews.apache.org/r/39601/diff/


Testing
---


Thanks,

Alina Abramova

[jira] [Created] (HIVE-12243) NPE in HiveMetaStoreClient

2015-10-23 Thread Steve Loughran (JIRA) 
Steve Loughran created HIVE-12243:
-

 Summary: NPE in HiveMetaStoreClient
 Key: HIVE-12243
 URL: https://issues.apache.org/jira/browse/HIVE-12243
 Project: Hive
  Issue Type: Bug
  Components: Metastore
Affects Versions: 1.2.1
Reporter: Steve Loughran
Priority: Minor


While writing a test for SPARK-11265, I can trigger an NPE if the principal is 
set to "bob" and the metastore uri = "localhost:-1", due to a null thrift 
transport.

presumably one of the arguments is invalid



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-12241) SQLStdAuth grant on .* not recognized

2015-10-23 Thread Hari Sekhon (JIRA) 
Hari Sekhon created HIVE-12241:
--

 Summary: SQLStdAuth grant on .* not recognized
 Key: HIVE-12241
 URL: https://issues.apache.org/jira/browse/HIVE-12241
 Project: Hive
  Issue Type: Bug
  Components: Parser
Affects Versions: 0.14.0
 Environment: HDP 2.2
Reporter: Hari Sekhon


Using SQLStdAuthorizer Hive doesn't recognize doing a grant on all tables like 
I've done before in RDBMS. If having a lot of tables this becomes very 
inconvenient to grant on a table-by-table basis and granting on database 
succeeds but still doesn't allow user to query tables in that database:
{code}
> grant all on myDB.* to user hari;
Error: Error while compiling statement: FAILED: ParseException line 1:15 
mismatched input '.' expecting TO near 'myDB' in grant privileges 
(state=42000,code=4)

> grant all on myDB.`*` to user hari;
Error: Error while compiling statement: FAILED: SemanticException [Error 
10001]: Table not found myDB.* (state=42S02,code=10001)

> grant all on `myDB.*` to user hari;  
Error: Error while compiling statement: FAILED: SemanticException [Error 
10001]: Table not found myDB.* (state=42S02,code=10001)

> grant all on all to user hari;   
Error: Error while compiling statement: FAILED: SemanticException [Error 
10001]: Table not found myDB.all (state=42S02,code=10001)
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-12242) SQLStdAuth map roles to groups (ldap)

2015-10-23 Thread Hari Sekhon (JIRA) 
Hari Sekhon created HIVE-12242:
--

 Summary: SQLStdAuth map roles to groups (ldap)
 Key: HIVE-12242
 URL: https://issues.apache.org/jira/browse/HIVE-12242
 Project: Hive
  Issue Type: New Feature
  Components: SQLStandardAuthorization
Affects Versions: 0.14.0
 Environment: HDP 2.2
Reporter: Hari Sekhon


Feature request to be able to map Hive roles to groups so that LDAP groups can 
be reused rather than having to recreate all the information in Hive.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-12245) Support column comments for an HBase backed table

2015-10-23 Thread Chaoyu Tang (JIRA) 
Chaoyu Tang created HIVE-12245:
--

 Summary: Support column comments for an HBase backed table
 Key: HIVE-12245
 URL: https://issues.apache.org/jira/browse/HIVE-12245
 Project: Hive
  Issue Type: Improvement
  Components: HBase Handler
Reporter: Chaoyu Tang
Assignee: Chaoyu Tang
Priority: Minor


Currently the column comments of an HBase backed table are always returned as 
"from deserializer". For example,
{code}
CREATE TABLE hbasetbl 
(key string comment 'It is key', 
state string comment 'It is state', 
country string comment 'It is country', 
country_id int comment 'It is country_id')
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES (
"hbase.columns.mapping" = "info:state,info:country,info:country_id"
);
hive> describe hbasetbl;
key string  from deserializer   
state   string  from deserializer   
country string  from deserializer   
country_id  int from deserializer  
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-12248) The rawStore used in DBTokenStore should be thread-safe

2015-10-23 Thread Chaoyu Tang (JIRA) 
Chaoyu Tang created HIVE-12248:
--

 Summary: The rawStore used in DBTokenStore should be thread-safe
 Key: HIVE-12248
 URL: https://issues.apache.org/jira/browse/HIVE-12248
 Project: Hive
  Issue Type: Bug
  Components: Authentication
Reporter: Chaoyu Tang
Assignee: Chaoyu Tang


A non-thread-safe implementation of RawStore, particularly ObjectStore, set in 
DBTokenStore is being shared by multi-threads, which causes the race condition 
in DataNuclues to access the backend DB. 
The DN PersistenceManager(PM) in ObjectStore is not thread safe, so 
DBTokenStore should use a ThreadLocal ObjectStore.
Following errors might be root caused by the race condition in DN PM.
{code}
Object of type "org.apache.hadoop.hive.metastore.model.MDelegationToken" is 
detached. Detached objects cannot be used with this operation.
org.datanucleus.exceptions.ObjectDetachedException: Object of type 
"org.apache.hadoop.hive.metastore.model.MDelegationToken" is detached. Detached 
objects cannot be used with this operation.
at 
org.datanucleus.ExecutionContextImpl.assertNotDetached(ExecutionContextImpl.java:5728)
at 
org.datanucleus.ExecutionContextImpl.retrieveObject(ExecutionContextImpl.java:1859)
at 
org.datanucleus.ExecutionContextThreadedImpl.retrieveObject(ExecutionContextThreadedImpl.java:203)
at 
org.datanucleus.api.jdo.JDOPersistenceManager.jdoRetrieve(JDOPersistenceManager.java:605)
at 
org.datanucleus.api.jdo.JDOPersistenceManager.retrieveAll(JDOPersistenceManager.java:693)
at 
org.datanucleus.api.jdo.JDOPersistenceManager.retrieveAll(JDOPersistenceManager.java:713)
at 
org.apache.hadoop.hive.metastore.ObjectStore.getAllTokenIdentifiers(ObjectStore.java:6517)
 
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-12257) Enhance ORC FileDump utility to handle flush_length files

2015-10-23 Thread Prasanth Jayachandran (JIRA) 
Prasanth Jayachandran created HIVE-12257:


 Summary: Enhance ORC FileDump utility to handle flush_length files
 Key: HIVE-12257
 URL: https://issues.apache.org/jira/browse/HIVE-12257
 Project: Hive
  Issue Type: Bug
Affects Versions: 1.3.0, 2.0.0
Reporter: Prasanth Jayachandran
Assignee: Prasanth Jayachandran
 Attachments: HIVE-12257.1.patch

ORC file dump utility currently does not handle delta directories that contain 
*_flush_length files. These files contains offsets to footer in the 
corresponding delta file.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: [ANNOUNCE] New Hive Committer - Siddharth Seth

2015-10-23 Thread Lefty Leverenz 
Congratulations, Sirddharth!

-- Lefty

On Thu, Oct 22, 2015 at 11:53 AM, Siddharth Seth  wrote:

> Thanks everyone!
>
> On Thu, Oct 22, 2015 at 12:54 AM, Navis Ryu  wrote:
>
> > Congratulations!
> >
> > 2015-10-22 16:49 GMT+09:00 Chinna Rao Lalam  >:
> > > Congratulations!
> > >
> > > On Thu, Oct 22, 2015 at 12:18 PM, Santlal J Gupta <
> > > santlal.gu...@bitwiseglobal.com> wrote:
> > >
> > >> Congratulations !!
> > >>
> > >> -Original Message-
> > >> From: Chetna C [mailto:chetna@gmail.com]
> > >> Sent: Thursday, October 22, 2015 8:58 AM
> > >> To: dev@hive.apache.org
> > >> Cc: Siddharth Seth
> > >> Subject: Re: [ANNOUNCE] New Hive Committer - Siddharth Seth
> > >>
> > >> Congratulations !!
> > >> On Oct 22, 2015 5:13 AM, "Pengcheng Xiong"  wrote:
> > >>
> > >> > Congrats Sid!
> > >> >
> > >> > On Wed, Oct 21, 2015 at 2:14 PM, Sergey Shelukhin
> > >> > 
> > >> > wrote:
> > >> >
> > >> > > The Apache Hive PMC has voted to make Siddharth Seth a committer
> on
> > >> > > the Apache Hive Project.
> > >> > >
> > >> > > Please join me in congratulating Sid!
> > >> > >
> > >> > > Thanks,
> > >> > > Sergey.
> > >> > >
> > >> > >
> > >> >
> > >>
> > >
> > >
> > >
> > > --
> > > Hope It Helps,
> > > Chinna
> >
>

[jira] [Created] (HIVE-12255) Estimated task count should make use of SplitSizeEstimator

2015-10-23 Thread Siddharth Seth (JIRA) 
Siddharth Seth created HIVE-12255:
-

 Summary: Estimated task count should make use of SplitSizeEstimator
 Key: HIVE-12255
 URL: https://issues.apache.org/jira/browse/HIVE-12255
 Project: Hive
  Issue Type: Bug
Reporter: Siddharth Seth
 Fix For: 2.0.0


Estimating the number of initial tasks for a query makes use of the size of the 
splits being processed. This should consider the estimatedSize for columnar 
files when possible, instead of the fixed size of the split.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

PreCommit-HIVE-TRUNK-Build

2015-10-23 Thread Eugene Koifman 
Does anyone know what is going on here?  All the runs are failing to build

http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/


2015-10-23 19:02:11,706  INFO LocalCommand$CollectLogPolicy.handleOutput:69 
[ERROR] 
/data/hive-ptest/working/apache-github-source-source/metastore/src/java/org/apache/hadoop/hive/metastore/hbase/HBaseReadWrite.java:[27,30]
 error: package org.apache.hadoop.hbase does not exist

[jira] [Created] (HIVE-12256) Move LLAP registry into llap-client module

2015-10-23 Thread Siddharth Seth (JIRA) 
Siddharth Seth created HIVE-12256:
-

 Summary: Move LLAP registry into llap-client module
 Key: HIVE-12256
 URL: https://issues.apache.org/jira/browse/HIVE-12256
 Project: Hive
  Issue Type: Task
Reporter: Siddharth Seth
Assignee: Siddharth Seth
 Fix For: 2.0.0


The registry may need to be accessed by the client to figure out the available 
nodes. (ql module needs access)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: PreCommit-HIVE-TRUNK-Build

2015-10-23 Thread Ashutosh Chauhan 
https://issues.apache.org/jira/browse/HIVE-12253

On Fri, Oct 23, 2015 at 5:34 PM, Eugene Koifman 
wrote:

> Does anyone know what is going on here?  All the runs are failing to build
>
>
> http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/
>
>
> 2015-10-23 19:02:11,706  INFO
> LocalCommand$CollectLogPolicy.handleOutput:69 [ERROR]
> /data/hive-ptest/working/apache-github-source-source/metastore/src/java/org/apache/hadoop/hive/metastore/hbase/HBaseReadWrite.java:[27,30]
> error: package org.apache.hadoop.hbase does not exist
>
>

[jira] [Created] (HIVE-12252) HiveEndPoint can be created w/o partitionVals for partitioned table

2015-10-23 Thread Eugene Koifman (JIRA) 
Eugene Koifman created HIVE-12252:
-

 Summary: HiveEndPoint can be created w/o partitionVals for 
partitioned table
 Key: HIVE-12252
 URL: https://issues.apache.org/jira/browse/HIVE-12252
 Project: Hive
  Issue Type: Bug
  Components: HCatalog, Transactions
Affects Versions: 0.14.0
Reporter: Eugene Koifman
Assignee: Eugene Koifman


When this happens, the write from Streaming API to this end point will succeed 
but it will place the data in the table directory which is not correct
Need to make the API throw in this case.





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: [ANNOUNCE] New Hive Committer - Siddharth Seth

2015-10-23 Thread Rajesh Balamohan 
Congratulations Sid!!

~Rajesh.B

On Fri, Oct 23, 2015 at 3:55 PM, Eugene Koifman 
wrote:

> Congratulations!
>
> On 10/22/15, 10:59 PM, "Lefty Leverenz"  wrote:
>
> >Congratulations, Sirddharth!
> >
> >-- Lefty
> >
> >On Thu, Oct 22, 2015 at 11:53 AM, Siddharth Seth 
> wrote:
> >
> >> Thanks everyone!
> >>
> >> On Thu, Oct 22, 2015 at 12:54 AM, Navis Ryu  wrote:
> >>
> >> > Congratulations!
> >> >
> >> > 2015-10-22 16:49 GMT+09:00 Chinna Rao Lalam
> >> >> >:
> >> > > Congratulations!
> >> > >
> >> > > On Thu, Oct 22, 2015 at 12:18 PM, Santlal J Gupta <
> >> > > santlal.gu...@bitwiseglobal.com> wrote:
> >> > >
> >> > >> Congratulations !!
> >> > >>
> >> > >> -Original Message-
> >> > >> From: Chetna C [mailto:chetna@gmail.com]
> >> > >> Sent: Thursday, October 22, 2015 8:58 AM
> >> > >> To: dev@hive.apache.org
> >> > >> Cc: Siddharth Seth
> >> > >> Subject: Re: [ANNOUNCE] New Hive Committer - Siddharth Seth
> >> > >>
> >> > >> Congratulations !!
> >> > >> On Oct 22, 2015 5:13 AM, "Pengcheng Xiong" 
> >>wrote:
> >> > >>
> >> > >> > Congrats Sid!
> >> > >> >
> >> > >> > On Wed, Oct 21, 2015 at 2:14 PM, Sergey Shelukhin
> >> > >> > 
> >> > >> > wrote:
> >> > >> >
> >> > >> > > The Apache Hive PMC has voted to make Siddharth Seth a
> >>committer
> >> on
> >> > >> > > the Apache Hive Project.
> >> > >> > >
> >> > >> > > Please join me in congratulating Sid!
> >> > >> > >
> >> > >> > > Thanks,
> >> > >> > > Sergey.
> >> > >> > >
> >> > >> > >
> >> > >> >
> >> > >>
> >> > >
> >> > >
> >> > >
> >> > > --
> >> > > Hope It Helps,
> >> > > Chinna
> >> >
> >>
>
>

[jira] [Created] (HIVE-12253) revert HIVE-12061

2015-10-23 Thread Sergey Shelukhin (JIRA) 
Sergey Shelukhin created HIVE-12253:
---

 Summary: revert HIVE-12061
 Key: HIVE-12253
 URL: https://issues.apache.org/jira/browse/HIVE-12253
 Project: Hive
  Issue Type: Bug
Reporter: Sergey Shelukhin
Assignee: Sergey Shelukhin


Breaks the build on HiveQA. I cannot repro these build errors.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-12254) Improve logging with yarn/hdfs

2015-10-23 Thread Vikram Dixit K (JIRA) 
Vikram Dixit K created HIVE-12254:
-

 Summary: Improve logging with yarn/hdfs
 Key: HIVE-12254
 URL: https://issues.apache.org/jira/browse/HIVE-12254
 Project: Hive
  Issue Type: Bug
  Components: Shims
Affects Versions: 1.2.1
Reporter: Vikram Dixit K
Assignee: Vikram Dixit K


In extension to HIVE-12249, adding info for Yarn/HDFS as well. Both HIVE-12249 
and HDFS-9184 are required before this can be resolved.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-12249) Improve logging with tez

2015-10-23 Thread Vikram Dixit K (JIRA) 
Vikram Dixit K created HIVE-12249:
-

 Summary: Improve logging with tez
 Key: HIVE-12249
 URL: https://issues.apache.org/jira/browse/HIVE-12249
 Project: Hive
  Issue Type: Bug
  Components: Tez
Affects Versions: 1.2.1
Reporter: Vikram Dixit K
Assignee: Vikram Dixit K


We need to improve logging across the board. TEZ-2851 added a caller context so 
that one can correlate logs with the application. This jira adds a new 
configuration for users that can be used to correlate the logs.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-12251) hive configuration hive.exec.orc.split.strategy does not exists

2015-10-23 Thread Takahiko Saito (JIRA) 
Takahiko Saito created HIVE-12251:
-

 Summary: hive configuration hive.exec.orc.split.strategy does not 
exists
 Key: HIVE-12251
 URL: https://issues.apache.org/jira/browse/HIVE-12251
 Project: Hive
  Issue Type: Bug
Affects Versions: 0.14.0
Reporter: Takahiko Saito
Assignee: Prasanth Jayachandran
 Fix For: 0.14.0


hive.exec.orc.split.strategy does not seem to be defined:
{noformat}
hive> set hive.exec.orc.split.strategy;
hive.exec.orc.split.strategy is undefined
hive> set hive.exec.orc.split.strategy=ETL;
Query returned non-zero code: 1, cause: hive configuration 
hive.exec.orc.split.strategy does not exists.
{noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-12250) Zookeeper connection leaks in Hive's HBaseHandler.

2015-10-23 Thread Naveen Gangam (JIRA) 
Naveen Gangam created HIVE-12250:


 Summary: Zookeeper connection leaks in Hive's HBaseHandler.
 Key: HIVE-12250
 URL: https://issues.apache.org/jira/browse/HIVE-12250
 Project: Hive
  Issue Type: Bug
  Components: HiveServer2
Affects Versions: 1.1.0
Reporter: Naveen Gangam
Assignee: Naveen Gangam


HiveServer2 performance regresses severely due to what appears to be a leak in 
the ZooKeeper connections. lsof output on the HS2 process shows about 8000 TCP 
connections to the ZK ensemble nodes.

grep TCP lsof-hive-node11 | grep node11 | grep -E "node03|node04|node05" | wc -l
7866 
grep TCP lsof-hive-node11 | grep node11 | grep -E "node03" | wc -l
2615
grep TCP lsof-hive-node11 | grep node11 | grep -E "node04" | wc -l
2622
grep TCP lsof-hive-node11 | grep node11 | grep -E "node05" | wc -l
2629


node11 - HMS node
node03, node04 and node05 are the hosts for zookeeper ensemble.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: [ANNOUNCE] New Hive Committer - Siddharth Seth

2015-10-23 Thread Eugene Koifman 
Congratulations!

On 10/22/15, 10:59 PM, "Lefty Leverenz"  wrote:

>Congratulations, Sirddharth!
>
>-- Lefty
>
>On Thu, Oct 22, 2015 at 11:53 AM, Siddharth Seth  wrote:
>
>> Thanks everyone!
>>
>> On Thu, Oct 22, 2015 at 12:54 AM, Navis Ryu  wrote:
>>
>> > Congratulations!
>> >
>> > 2015-10-22 16:49 GMT+09:00 Chinna Rao Lalam
>>> >:
>> > > Congratulations!
>> > >
>> > > On Thu, Oct 22, 2015 at 12:18 PM, Santlal J Gupta <
>> > > santlal.gu...@bitwiseglobal.com> wrote:
>> > >
>> > >> Congratulations !!
>> > >>
>> > >> -Original Message-
>> > >> From: Chetna C [mailto:chetna@gmail.com]
>> > >> Sent: Thursday, October 22, 2015 8:58 AM
>> > >> To: dev@hive.apache.org
>> > >> Cc: Siddharth Seth
>> > >> Subject: Re: [ANNOUNCE] New Hive Committer - Siddharth Seth
>> > >>
>> > >> Congratulations !!
>> > >> On Oct 22, 2015 5:13 AM, "Pengcheng Xiong" 
>>wrote:
>> > >>
>> > >> > Congrats Sid!
>> > >> >
>> > >> > On Wed, Oct 21, 2015 at 2:14 PM, Sergey Shelukhin
>> > >> > 
>> > >> > wrote:
>> > >> >
>> > >> > > The Apache Hive PMC has voted to make Siddharth Seth a
>>committer
>> on
>> > >> > > the Apache Hive Project.
>> > >> > >
>> > >> > > Please join me in congratulating Sid!
>> > >> > >
>> > >> > > Thanks,
>> > >> > > Sergey.
>> > >> > >
>> > >> > >
>> > >> >
>> > >>
>> > >
>> > >
>> > >
>> > > --
>> > > Hope It Helps,
>> > > Chinna
>> >
>>

[jira] [Created] (HIVE-12247) HiveServer2 in HTTP mode should print a relevant error message when it's threadpool is configured such that it cannot create appropriate acceptor threads while starting u

2015-10-23 Thread Vaibhav Gumashta (JIRA) 
Vaibhav Gumashta created HIVE-12247:
---

 Summary: HiveServer2 in HTTP mode should print a relevant error 
message when it's threadpool is configured such that it cannot create 
appropriate acceptor threads while starting up
 Key: HIVE-12247
 URL: https://issues.apache.org/jira/browse/HIVE-12247
 Project: Hive
  Issue Type: Bug
  Components: HiveServer2
Affects Versions: 1.1.0, 1.2.0
Reporter: Vaibhav Gumashta


When run in HTTP mode, HS2 uses embedded jetty. The number of acceptor threads 
created are based on this formula 
(http://grepcode.com/file/repo1.maven.org/maven2/org.eclipse.jetty.aggregate/jetty-plus/7.6.0.v20120127/org/eclipse/jetty/server/nio/SelectChannelConnector.java#80):
{code}
(Math.max(1,(Runtime.getRuntime().availableProcessors()+3)/4));
{code}
In cases where {{hive.server2.thrift.max.worker.threads}} is set to a lower 
value than the above, we should print out a relevant error message.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)