[jira] [Created] (HIVE-13169) HiveServer2: Support delegation token based connection when using http transport

2016-02-25 Thread Vaibhav Gumashta (JIRA)
Vaibhav Gumashta created HIVE-13169:
---

 Summary: HiveServer2: Support delegation token based connection 
when using http transport
 Key: HIVE-13169
 URL: https://issues.apache.org/jira/browse/HIVE-13169
 Project: Hive
  Issue Type: Bug
  Components: HiveServer2, JDBC
Reporter: Vaibhav Gumashta
Assignee: Vaibhav Gumashta


[HIVE-5155|https://issues.apache.org/jira/browse/HIVE-5155] introduced support 
for delegation token based connection. However, it was intended for tcp 
transport mode. We need to have similar mechanisms for http transport.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (HIVE-13168) LLAP: On voluntary restart daemons should unregister itself

2016-02-25 Thread Prasanth Jayachandran (JIRA)
Prasanth Jayachandran created HIVE-13168:


 Summary: LLAP: On voluntary restart daemons should unregister 
itself
 Key: HIVE-13168
 URL: https://issues.apache.org/jira/browse/HIVE-13168
 Project: Hive
  Issue Type: Bug
  Components: llap
Affects Versions: 2.1.0
Reporter: Prasanth Jayachandran
Assignee: Prasanth Jayachandran


On voluntary restart case, it might be faster for the daemon to unregister 
itself and propagate notification instead of waiting for zookeeper detecting it 
and notifying watchers.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (HIVE-13167) LLAP: Remove yarn-site resource from zookeeper based registry

2016-02-25 Thread Prasanth Jayachandran (JIRA)
Prasanth Jayachandran created HIVE-13167:


 Summary: LLAP: Remove yarn-site resource from zookeeper based 
registry
 Key: HIVE-13167
 URL: https://issues.apache.org/jira/browse/HIVE-13167
 Project: Hive
  Issue Type: Bug
  Components: llap
Affects Versions: 2.1.0
Reporter: Prasanth Jayachandran
Assignee: Prasanth Jayachandran


With zookeeper registry adding yarn-site.xml resource is no longer required.

Following line should be removed from LlapZookeeperRegistryImpl
{code}
this.conf.addResource(YarnConfiguration.YARN_SITE_CONFIGURATION_FILE);
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Re: Review Request 40415: HIVE-11675 make use of file footer PPD API in ETL strategy or separate strategy

2016-02-25 Thread Sergey Shelukhin

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/40415/
---

(Updated Feb. 26, 2016, 5:04 a.m.)


Review request for hive, Gopal V, Prasanth_J, and Vikram Dixit Kumaraswamy.


Repository: hive-git


Description
---

see jira


Diffs (updated)
-

  common/src/java/org/apache/hadoop/hive/conf/HiveConf.java e868500 
  metastore/src/java/org/apache/hadoop/hive/metastore/FileMetadataHandler.java 
bd4e188 
  metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStoreClient.java 
b5c4d1d 
  metastore/src/java/org/apache/hadoop/hive/metastore/IMetaStoreClient.java 
cb092d1 
  
metastore/src/java/org/apache/hadoop/hive/metastore/filemeta/OrcFileMetadataHandler.java
 1b388aa 
  orc/src/java/org/apache/orc/impl/InStream.java b1c6de5 
  ql/src/java/org/apache/hadoop/hive/ql/io/AcidUtils.java 520ae74 
  ql/src/java/org/apache/hadoop/hive/ql/io/HdfsUtils.java af64fc8 
  ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcFileFormatProxy.java ef76723 
  ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcInputFormat.java d175d2d 
  ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcNewInputFormat.java 2782d7e 
  ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java aa1c925 
  ql/src/test/org/apache/hadoop/hive/ql/io/orc/TestInputOutputFormat.java 
6f84708 
  ql/src/test/org/apache/hadoop/hive/ql/io/orc/TestOrcSplitElimination.java 
7a93b54 
  storage-api/src/java/org/apache/hadoop/hive/ql/io/sarg/PredicateLeaf.java 
dc71db4 
  
storage-api/src/java/org/apache/hadoop/hive/ql/io/sarg/SearchArgumentImpl.java 
be5e67b 

Diff: https://reviews.apache.org/r/40415/diff/


Testing
---


Thanks,

Sergey Shelukhin



[jira] [Created] (HIVE-13166) Log the selection from llap decider

2016-02-25 Thread Siddharth Seth (JIRA)
Siddharth Seth created HIVE-13166:
-

 Summary: Log the selection from llap decider
 Key: HIVE-13166
 URL: https://issues.apache.org/jira/browse/HIVE-13166
 Project: Hive
  Issue Type: Improvement
  Components: llap
Reporter: Siddharth Seth


llap decider logs when it considers a vertex, however the actual placement 
(llap, container, etc) is not logged.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (HIVE-13165) resultset which query sql add 'order by' or 'sort by' return is different from not add it

2016-02-25 Thread chillon_m (JIRA)
chillon_m created HIVE-13165:


 Summary: resultset which query sql add 'order by' or 'sort by' 
return is different from not add it 
 Key: HIVE-13165
 URL: https://issues.apache.org/jira/browse/HIVE-13165
 Project: Hive
  Issue Type: Bug
  Components: Clients
Affects Versions: 1.2.1
 Environment: hadoop 2.5.2 hive 1.2.1 
Reporter: chillon_m
Assignee: Vaibhav Gumashta
 Attachments: Hql not order.png, Hql order.png

resultset which query sql add 'order by' or 'sort by' return is different from 
not add it .size of resultset  and value of row is returned is different.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (HIVE-13164) Predicate pushdown may cause cross-product in left semi join

2016-02-25 Thread Chaoyu Tang (JIRA)
Chaoyu Tang created HIVE-13164:
--

 Summary: Predicate pushdown may cause cross-product in left semi 
join
 Key: HIVE-13164
 URL: https://issues.apache.org/jira/browse/HIVE-13164
 Project: Hive
  Issue Type: Bug
  Components: Query Processor
Reporter: Chaoyu Tang
Assignee: Chaoyu Tang


For some left semi join queries like followings:
select count(1) from (select value from t1 where key = 0) t1 left semi join 
(select value from t2 where key = 0) t2 on t2.value = 'val_0';
or 
select count(1) from (select value from t1 where key = 0) t1 left semi join 
(select value from t2 where key = 0) t2 on t1.value = 'val_0';
Their plans show that they have been converted to keyless cross-product due to 
the predicate pushdown and the dropping of the on condition.
{code}
LOGICAL PLAN:
t1:t1 
  TableScan (TS_0)
alias: t1
Statistics: Num rows: 1453 Data size: 5812 Basic stats: COMPLETE Column 
stats: NONE
Filter Operator (FIL_18)
  predicate: (key = 0) (type: boolean)
  Statistics: Num rows: 726 Data size: 2904 Basic stats: COMPLETE Column 
stats: NONE
  Select Operator (SEL_2)
Statistics: Num rows: 726 Data size: 2904 Basic stats: COMPLETE Column 
stats: NONE
Reduce Output Operator (RS_9)
  sort order: 
  Statistics: Num rows: 726 Data size: 2904 Basic stats: COMPLETE 
Column stats: NONE
  Join Operator (JOIN_11)
condition map:
 Left Semi Join 0 to 1
keys:
  0 
  1 
Statistics: Num rows: 798 Data size: 3194 Basic stats: COMPLETE 
Column stats: NONE
Group By Operator (GBY_13)
  aggregations: count(1)
  mode: hash
  outputColumnNames: _col0
  Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column 
stats: NONE
  Reduce Output Operator (RS_14)
sort order: 
Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE 
Column stats: NONE
value expressions: _col0 (type: bigint)
Group By Operator (GBY_15)
  aggregations: count(VALUE._col0)
  mode: mergepartial
  outputColumnNames: _col0
  Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE 
Column stats: NONE
  File Output Operator (FS_17)
compressed: false
Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE 
Column stats: NONE
table:
input format: 
org.apache.hadoop.mapred.SequenceFileInputFormat
output format: 
org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat
serde: 
org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
t2:t2 
  TableScan (TS_3)
alias: t2
Statistics: Num rows: 645 Data size: 5812 Basic stats: COMPLETE Column 
stats: NONE
Filter Operator (FIL_19)
  predicate: ((key = 0) and (value = 'val_0')) (type: boolean)
  Statistics: Num rows: 161 Data size: 1450 Basic stats: COMPLETE Column 
stats: NONE
  Select Operator (SEL_5)
Statistics: Num rows: 161 Data size: 1450 Basic stats: COMPLETE Column 
stats: NONE
Group By Operator (GBY_8)
  keys: 'val_0' (type: string)
  mode: hash
  outputColumnNames: _col0
  Statistics: Num rows: 161 Data size: 1450 Basic stats: COMPLETE 
Column stats: NONE
  Reduce Output Operator (RS_10)
sort order: 
Statistics: Num rows: 161 Data size: 1450 Basic stats: COMPLETE 
Column stats: NONE
Join Operator (JOIN_11)
  condition map:
   Left Semi Join 0 to 1
  keys:
0 
1 
  Statistics: Num rows: 798 Data size: 3194 Basic stats: COMPLETE 
Column stats: NONE
{code}
[~gopalv], do you think these plans are valid or not? Thanks 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (HIVE-13163) ORC MemoryManager thread checks are fatal, should WARN

2016-02-25 Thread Gopal V (JIRA)
Gopal V created HIVE-13163:
--

 Summary: ORC MemoryManager thread checks are fatal, should WARN 
 Key: HIVE-13163
 URL: https://issues.apache.org/jira/browse/HIVE-13163
 Project: Hive
  Issue Type: Bug
  Components: ORC
Affects Versions: 2.0.0, 2.1.0
Reporter: Gopal V
Assignee: Gopal V


The MemoryManager is tied to a WriterOptions on create, which can occur in a 
different thread from the writer calls.

This is unexpected, but safe and needs a warning not a fatal.

{code}
  /**
   * Light weight thread-safety check for multi-threaded access patterns
   */
  private void checkOwner() {
Preconditions.checkArgument(ownerLock.isHeldByCurrentThread(),
"Owner thread expected %s, got %s",
ownerLock.getOwner(),
Thread.currentThread());
  }
{code}





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (HIVE-13162) Fixes for LlapDump and FileSinkoperator

2016-02-25 Thread Gunther Hagleitner (JIRA)
Gunther Hagleitner created HIVE-13162:
-

 Summary: Fixes for LlapDump and FileSinkoperator
 Key: HIVE-13162
 URL: https://issues.apache.org/jira/browse/HIVE-13162
 Project: Hive
  Issue Type: Sub-task
Reporter: Gunther Hagleitner
Assignee: Gunther Hagleitner
 Fix For: llap






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (HIVE-13161) ORC: Always do sloppy overlaps for DiskRanges

2016-02-25 Thread Gopal V (JIRA)
Gopal V created HIVE-13161:
--

 Summary: ORC: Always do sloppy overlaps for DiskRanges
 Key: HIVE-13161
 URL: https://issues.apache.org/jira/browse/HIVE-13161
 Project: Hive
  Issue Type: Bug
Affects Versions: 1.3.0, 2.1.0
Reporter: Gopal V
Assignee: Prasanth Jayachandran


The selected columns are sometimes only a few bytes apart (particularly for 
nulls which compresses tightly) and the reads aren't merged 

The WORST_UNCOMPRESSED_SLOP is only applied in the PPD case and is applied more 
for safety than reducing total number of round-trip calls to filesystem.

{code}
 /**
   * Update the disk ranges to collapse adjacent or overlapping ranges. It
   * assumes that the ranges are sorted.
   * @param ranges the list of disk ranges to merge
   */
  static void mergeDiskRanges(List ranges) {
DiskRange prev = null;
for(int i=0; i < ranges.size(); ++i) {
  DiskRange current = ranges.get(i);
  if (prev != null && overlap(prev.offset, prev.end,
  current.offset, current.end)) {
prev.offset = Math.min(prev.offset, current.offset);
prev.end = Math.max(prev.end, current.end);
ranges.remove(i);
i -= 1;
  } else {
prev = current;
  }
}
  }
...
  private static boolean overlap(long leftA, long rightA, long leftB, long 
rightB) {
if (leftA <= leftB) {
  return rightA >= leftB;
}
return rightB >= leftA;
  }

{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (HIVE-13160) HS2 unable to load UDFs on startup when HMS is not ready

2016-02-25 Thread Eric Lin (JIRA)
Eric Lin created HIVE-13160:
---

 Summary: HS2 unable to load UDFs on startup when HMS is not ready
 Key: HIVE-13160
 URL: https://issues.apache.org/jira/browse/HIVE-13160
 Project: Hive
  Issue Type: Bug
  Components: HiveServer2
Affects Versions: 1.2.1
Reporter: Eric Lin
Assignee: Vaibhav Gumashta


The error looks like this:

{code}
2016-02-24 21:16:09,901 INFO  hive.metastore: [main]: Trying to connect to 
metastore with URI thrift://host-10-17-81-201.coe.cloudera.com:9083
2016-02-24 21:16:09,971 WARN  hive.metastore: [main]: Failed to connect to the 
MetaStore Server...
2016-02-24 21:16:09,971 INFO  hive.metastore: [main]: Waiting 1 seconds before 
next connection attempt.
2016-02-24 21:16:10,971 INFO  hive.metastore: [main]: Trying to connect to 
metastore with URI thrift://host-10-17-81-201.coe.cloudera.com:9083
2016-02-24 21:16:10,975 WARN  hive.metastore: [main]: Failed to connect to the 
MetaStore Server...
2016-02-24 21:16:10,976 INFO  hive.metastore: [main]: Waiting 1 seconds before 
next connection attempt.
2016-02-24 21:16:11,976 INFO  hive.metastore: [main]: Trying to connect to 
metastore with URI thrift://host-10-17-81-201.coe.cloudera.com:9083
2016-02-24 21:16:11,979 WARN  hive.metastore: [main]: Failed to connect to the 
MetaStore Server...
2016-02-24 21:16:11,979 INFO  hive.metastore: [main]: Waiting 1 seconds before 
next connection attempt.
2016-02-24 21:16:12,987 WARN  hive.ql.metadata.Hive: [main]: Failed to register 
all functions.
java.lang.RuntimeException: Unable to instantiate 
org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
.
2016-02-24 21:16:12,995 INFO  hive.metastore: [main]: Trying to connect to 
metastore with URI thrift://host-10-17-81-201.coe.cloudera.com:9083
2016-02-24 21:16:13,004 WARN  hive.metastore: [main]: Failed to connect to the 
MetaStore Server...
2016-02-24 21:16:13,004 INFO  hive.metastore: [main]: Waiting 1 seconds before 
next connection attempt.
2016-02-24 21:16:14,004 INFO  hive.metastore: [main]: Trying to connect to 
metastore with URI thrift://host-10-17-81-201.coe.cloudera.com:9083
2016-02-24 21:16:14,007 WARN  hive.metastore: [main]: Failed to connect to the 
MetaStore Server...
2016-02-24 21:16:14,007 INFO  hive.metastore: [main]: Waiting 1 seconds before 
next connection attempt.
2016-02-24 21:16:15,007 INFO  hive.metastore: [main]: Trying to connect to 
metastore with URI thrift://host-10-17-81-201.coe.cloudera.com:9083
2016-02-24 21:16:15,010 WARN  hive.metastore: [main]: Failed to connect to the 
MetaStore Server...
2016-02-24 21:16:15,010 INFO  hive.metastore: [main]: Waiting 1 seconds before 
next connection attempt.
2016-02-24 21:16:16,012 INFO  org.apache.hive.service.server.HiveServer2: 
[main]: Shutting down HiveServer2
2016-02-24 21:16:16,014 INFO  org.apache.hive.service.server.HiveServer2: 
[main]: Exception caught when calling stop of HiveServer2 before retrying start
java.lang.NullPointerException
at org.apache.hive.service.server.HiveServer2.stop(HiveServer2.java:283)
at 
org.apache.hive.service.server.HiveServer2.startHiveServer2(HiveServer2.java:351)
at 
org.apache.hive.service.server.HiveServer2.access$400(HiveServer2.java:69)
at 
org.apache.hive.service.server.HiveServer2$StartOptionExecutor.execute(HiveServer2.java:545)
at org.apache.hive.service.server.HiveServer2.main(HiveServer2.java:418)

2016-02-24 21:16:16,014 WARN  org.apache.hive.service.server.HiveServer2: 
[main]: Error starting HiveServer2 on attempt 1, will retry in 60 seconds
..
2016-02-24 21:17:16,016 INFO  org.apache.hive.service.server.HiveServer2: 
[main]: Starting HiveServer2
2016-02-24 21:17:16,131 WARN  org.apache.hadoop.hive.conf.HiveConf: [main]: 
HiveConf of name hive.sentry.conf.url does not exist
2016-02-24 21:17:16,132 WARN  org.apache.hadoop.hive.conf.HiveConf: [main]: 
HiveConf of name hive.entity.capture.input.URI does not exist
2016-02-24 21:17:16,150 INFO  org.apache.hadoop.security.UserGroupInformation: 
[main]: Login successful for user 
hive/host-10-17-81-201.coe.cloudera@yshi.com using keytab file hive.keytab
2016-02-24 21:17:16,150 INFO  org.apache.hive.service.cli.CLIService: [main]: 
SPNego httpUGI not created, spNegoPrincipal: , ketabFile:
2016-02-24 21:17:16,154 INFO  hive.metastore: [main]: Trying to connect to 
metastore with URI thrift://host-10-17-81-201.coe.cloudera.com:9083
2016-02-24 21:17:16,217 INFO  hive.metastore: [main]: Opened a connection to 
metastore, current connections: 1
2016-02-24 21:17:16,218 INFO  hive.metastore: [main]: Connected to metastore.
{code}

And then none of the functions will be available for use as HS2 does not 
re-register them after HMS is up and ready.

This is not desired behaviour, we shouldn't allow HS2 to be in a servicing 
state if function list is not ready. Or, maybe instead of initialize 

Re: Review Request 43145: HIVE-12994

2016-02-25 Thread Jesús Camacho Rodríguez

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/43145/
---

(Updated Feb. 25, 2016, 11:04 p.m.)


Review request for hive and Ashutosh Chauhan.


Bugs: HIVE-12994
https://issues.apache.org/jira/browse/HIVE-12994


Repository: hive-git


Description
---

Implement support for NULLS FIRST/NULLS LAST


Diffs (updated)
-

  data/files/over4_null PRE-CREATION 
  itests/src/test/resources/testconfiguration.properties 
58d0a45fde7fbfb8f20518fd549dfc64a3b89b64 
  metastore/if/hive_metastore.thrift e8f0a68fd640fddf6f711e1063bf97195a42f83d 
  metastore/scripts/upgrade/derby/034-HIVE-12994.derby.sql PRE-CREATION 
  metastore/scripts/upgrade/derby/hive-schema-2.1.0.derby.sql 
42f4eb643d0073a80f4ba505e788abb19f31fb4c 
  metastore/scripts/upgrade/derby/upgrade-2.0.0-to-2.1.0.derby.sql 
a0bac3ced7024afff964b298da52c1aa4f77bb2e 
  metastore/scripts/upgrade/mssql/019-HIVE-12994.mssql.sql PRE-CREATION 
  metastore/scripts/upgrade/mssql/hive-schema-2.1.0.mssql.sql 
cf5a6620610461eed9aa1b35cc282ced3c2e877f 
  metastore/scripts/upgrade/mssql/upgrade-2.0.0-to-2.1.0.mssql.sql 
f25daf26bea2d6c8abb8f40803f2e99307813462 
  metastore/scripts/upgrade/mysql/034-HIVE-12994.mysql.sql PRE-CREATION 
  metastore/scripts/upgrade/mysql/hive-schema-2.1.0.mysql.sql 
6fd32095af797c0a0925ab6b9ebce528bc42cb3e 
  metastore/scripts/upgrade/mysql/upgrade-2.0.0-to-2.1.0.mysql.sql 
e7906368efb490f7c8951a1b8e6a4ec45890d475 
  metastore/scripts/upgrade/oracle/034-HIVE-12994.oracle.sql PRE-CREATION 
  metastore/scripts/upgrade/oracle/hive-schema-2.1.0.oracle.sql 
774f6bea712ed2a1def8ab502a3f957c31c87d6d 
  metastore/scripts/upgrade/oracle/upgrade-2.0.0-to-2.1.0.oracle.sql 
8368d088c9332d43b62aa0f29802e81e896635ec 
  metastore/scripts/upgrade/postgres/033-HIVE-12994.postgres.sql PRE-CREATION 
  metastore/scripts/upgrade/postgres/hive-schema-2.1.0.postgres.sql 
7463a373384bb1b3ff0944566971f65c9faf144d 
  metastore/scripts/upgrade/postgres/upgrade-2.0.0-to-2.1.0.postgres.sql 
6172407b18c235a39fc7b85720b3aa04455e9cf6 
  
metastore/src/gen/protobuf/gen-java/org/apache/hadoop/hive/metastore/Metastore.java
 416ae9d68d99110a2d9c2524e4156a43aac18ea6 
  
metastore/src/gen/protobuf/gen-java/org/apache/hadoop/hive/metastore/hbase/HbaseMetastoreProto.java
 3b2d7b5db638dc6b35f968279d6b5129977e6f1d 
  metastore/src/gen/thrift/gen-cpp/hive_metastore_types.h 
97c07a568a1b8451fa9843552eebdc828d122aaf 
  metastore/src/gen/thrift/gen-cpp/hive_metastore_types.cpp 
2695ffa17c5d3fccf8d1e99b7d78846f7b8a8f20 
  
metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/Order.java
 cc0e2dd027d2e909ea4a39a742b33218c3f8411f 
  metastore/src/gen/thrift/gen-php/metastore/Types.php 
488a920e2fe1c6d9f9d966ec98f16d82c12b74d5 
  metastore/src/gen/thrift/gen-py/hive_metastore/ttypes.py 
10eaf4a01f1ee8130b0f67340635ed462a24ab77 
  metastore/src/gen/thrift/gen-rb/hive_metastore_types.rb 
1cf40ae568bc2749ee1775d165da6685351694e3 
  metastore/src/java/org/apache/hadoop/hive/metastore/MetaStoreDirectSql.java 
6da295e246e2259647e32d8ba33c783b28d41550 
  metastore/src/java/org/apache/hadoop/hive/metastore/ObjectStore.java 
d4852b025503eb0087555fa3ca9a72cbafa6a22e 
  metastore/src/java/org/apache/hadoop/hive/metastore/hbase/HBaseUtils.java 
d6d01bdbb879397d1b28675f5dfaa345d9b1066f 
  metastore/src/model/org/apache/hadoop/hive/metastore/model/MOrder.java 
1fa82a4fde9d315d4955ee5698796f58ce8a0921 
  
metastore/src/protobuf/org/apache/hadoop/hive/metastore/hbase/hbase_metastore_proto.proto
 466fdf9dc0b0e9d1c58c9b44977896780963e2ac 
  metastore/src/test/org/apache/hadoop/hive/metastore/hbase/TestHBaseStore.java 
29d5a64154fdb9ab9586fb919fbeae7106b1a874 
  
metastore/src/test/org/apache/hadoop/hive/metastore/hbase/TestHBaseStoreBitVector.java
 b0d76620b94b25c66b8e0857100e6a8c8343 
  
metastore/src/test/org/apache/hadoop/hive/metastore/hbase/TestSharedStorageDescriptor.java
 e0d8ce4dede474ad1b752794379342993bf89fa4 
  ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java 
6fca9f7ec86574a6053af3672c551c6a63aa4870 
  ql/src/java/org/apache/hadoop/hive/ql/exec/MapJoinOperator.java 
4d2447b683c529479b523878a4da0eb4e5202d55 
  ql/src/java/org/apache/hadoop/hive/ql/exec/MoveTask.java 
27e7b43ca92cf081e34415002c2b2f6ecc7a18d9 
  
ql/src/java/org/apache/hadoop/hive/ql/exec/persistence/HybridHashTableContainer.java
 fdc1dfffd977ef3a71fcf56da19a3b2b91538921 
  
ql/src/java/org/apache/hadoop/hive/ql/exec/persistence/MapJoinBytesTableContainer.java
 5c2ff9276b575f93a3df0fd2da378b85f7074a22 
  ql/src/java/org/apache/hadoop/hive/ql/exec/persistence/MapJoinKey.java 
cfb9abc380880da2cefe6968fd81dc3b974ec1ed 
  ql/src/java/org/apache/hadoop/hive/ql/exec/tez/DynamicPartitionPruner.java 
1510fdd555223514786dfd9137103c1339c4fc2a 
  
ql/src/java/org/apache/hadoop/hive/ql/exec/vector/reducesink/VectorReduceSinkCommonOperator.java
 

[jira] [Created] (HIVE-13159) TxnHandler should support datanucleus.connectionPoolingType = None

2016-02-25 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created HIVE-13159:
---

 Summary: TxnHandler should support 
datanucleus.connectionPoolingType = None
 Key: HIVE-13159
 URL: https://issues.apache.org/jira/browse/HIVE-13159
 Project: Hive
  Issue Type: Bug
Reporter: Sergey Shelukhin


Right now, one has to choose bonecp or dbcp.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (HIVE-13158) HiveServer should pick AMs which are already ready from the pool

2016-02-25 Thread Siddharth Seth (JIRA)
Siddharth Seth created HIVE-13158:
-

 Summary: HiveServer should pick AMs which are already ready from 
the pool
 Key: HIVE-13158
 URL: https://issues.apache.org/jira/browse/HIVE-13158
 Project: Hive
  Issue Type: Bug
Reporter: Siddharth Seth


Scenario. Start HiveServer2 with 3 sessions. At startup there's capacity for 
this.
All 3 sessions time out.
There's capacity for one session only.
The first query submitted will start a session and use it.
The second query submitted (after the first one is submitted) ends up trying to 
launch a new session as well - instead of using the existing free session. 
Since there's no capacity, this ends up blocking.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Review Request 44031: HIVE-13130: API calls for retrieving primary keys and foreign keys information

2016-02-25 Thread Hari Sankar Sivarama Subramaniyan

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/44031/
---

Review request for hive and Ashutosh Chauhan.


Repository: hive-git


Description
---

API calls for retrieving primary keys and foreign keys information. Changes 
without the generated thrift files.


Diffs
-

  jdbc/src/java/org/apache/hive/jdbc/HiveDatabaseMetaData.java 7e54d1f 
  metastore/if/hive_metastore.thrift e8f0a68 
  metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java 
bfebfdc 
  metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStoreClient.java 
b5c4d1d 
  metastore/src/java/org/apache/hadoop/hive/metastore/IMetaStoreClient.java 
cb092d1 
  service-rpc/if/TCLIService.thrift 0aa9d13 
  service/src/java/org/apache/hive/service/cli/CLIService.java cc6e138 
  service/src/java/org/apache/hive/service/cli/EmbeddedCLIServiceClient.java 
9cad5be 
  service/src/java/org/apache/hive/service/cli/ICLIService.java 0a54bdd 
  
service/src/java/org/apache/hive/service/cli/operation/GetCrossReferenceOperation.java
 PRE-CREATION 
  
service/src/java/org/apache/hive/service/cli/operation/GetPrimaryKeysOperation.java
 PRE-CREATION 
  service/src/java/org/apache/hive/service/cli/operation/OperationManager.java 
56a9c18 
  service/src/java/org/apache/hive/service/cli/session/HiveSession.java 4f4e92d 
  service/src/java/org/apache/hive/service/cli/session/HiveSessionImpl.java 
4aa1875 
  
service/src/java/org/apache/hive/service/cli/thrift/RetryingThriftCLIServiceClient.java
 a81c600 
  service/src/java/org/apache/hive/service/cli/thrift/ThriftCLIService.java 
8dff264 
  
service/src/java/org/apache/hive/service/cli/thrift/ThriftCLIServiceClient.java 
5f01165 

Diff: https://reviews.apache.org/r/44031/diff/


Testing
---


Thanks,

Hari Sankar Sivarama Subramaniyan



Review Request 44017: HIVE-13096

2016-02-25 Thread Jesús Camacho Rodríguez

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/44017/
---

Review request for hive and Ashutosh Chauhan.


Bugs: HIVE-13096
https://issues.apache.org/jira/browse/HIVE-13096


Repository: hive-git


Description
---

HIVE-13096


Diffs
-

  ql/src/java/org/apache/hadoop/hive/ql/optimizer/ConvertJoinMapJoin.java 
00bc193090e32f9c959223fbf7b10f4cb4ec8f12 
  ql/src/test/results/clientpositive/llap/bucket_map_join_tez1.q.out 
c743edcc1dcf5de84d5f22147dce10ee6a3fd173 
  ql/src/test/results/clientpositive/llap/dynamic_partition_pruning.q.out 
729e96326f5556326806afe0e67e61b11c0733de 
  
ql/src/test/results/clientpositive/llap/vectorized_dynamic_partition_pruning.q.out
 42f21fbd17898d18ba8184ff4f7f9dcca2ee843a 
  ql/src/test/results/clientpositive/tez/auto_sortmerge_join_10.q.out 
5df187d277b4bf71001955e2ae2499ed9fa6040c 
  ql/src/test/results/clientpositive/tez/bucket_map_join_tez1.q.out 
882eff3e15e527eb78f44307fe7adecf4725bc06 
  ql/src/test/results/clientpositive/tez/cross_product_check_2.q.out 
f00be43165adcd35ee9e0a0d8ba670dea795df31 
  ql/src/test/results/clientpositive/tez/dynamic_partition_pruning.q.out 
fb16b4062658779f05505d0f69f1f84298fee8f2 
  ql/src/test/results/clientpositive/tez/explainuser_2.q.out 
f2b225d5cdcf99bc4d917656c70c07efb5a66994 
  ql/src/test/results/clientpositive/tez/vector_groupby_mapjoin.q.out 
037c33813e7455362a13f90af82244a32d5c6fd3 
  ql/src/test/results/clientpositive/tez/vector_inner_join.q.out 
5ff2cd1c1a2b100e61893c12459119d650e0d3b9 
  
ql/src/test/results/clientpositive/tez/vectorized_dynamic_partition_pruning.q.out
 46e17e0ba86793efc9d3667145ad4b3d2b9cbfe6 

Diff: https://reviews.apache.org/r/44017/diff/


Testing
---


Thanks,

Jesús Camacho Rodríguez



[jira] [Created] (HIVE-13157) MetaStoreEventListener.onAlter triggered for INSERT and SELECT

2016-02-25 Thread Eugen Stoianovici (JIRA)
Eugen Stoianovici created HIVE-13157:


 Summary: MetaStoreEventListener.onAlter triggered for INSERT and 
SELECT
 Key: HIVE-13157
 URL: https://issues.apache.org/jira/browse/HIVE-13157
 Project: Hive
  Issue Type: Bug
  Components: Metastore
Affects Versions: 1.2.1
Reporter: Eugen Stoianovici
Priority: Critical


The event onAlter from org.apache.hadoop.hive.metastore.MetaStoreEventListener 
is triggered when INSERT or SELECT statements are executed on the target table.

Furthermore, the value of transient_lastDdl is updated in table properties for 
INSERT statements.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)