[jira] [Created] (HIVE-13169) HiveServer2: Support delegation token based connection when using http transport
Vaibhav Gumashta created HIVE-13169: --- Summary: HiveServer2: Support delegation token based connection when using http transport Key: HIVE-13169 URL: https://issues.apache.org/jira/browse/HIVE-13169 Project: Hive Issue Type: Bug Components: HiveServer2, JDBC Reporter: Vaibhav Gumashta Assignee: Vaibhav Gumashta [HIVE-5155|https://issues.apache.org/jira/browse/HIVE-5155] introduced support for delegation token based connection. However, it was intended for tcp transport mode. We need to have similar mechanisms for http transport. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HIVE-13168) LLAP: On voluntary restart daemons should unregister itself
Prasanth Jayachandran created HIVE-13168: Summary: LLAP: On voluntary restart daemons should unregister itself Key: HIVE-13168 URL: https://issues.apache.org/jira/browse/HIVE-13168 Project: Hive Issue Type: Bug Components: llap Affects Versions: 2.1.0 Reporter: Prasanth Jayachandran Assignee: Prasanth Jayachandran On voluntary restart case, it might be faster for the daemon to unregister itself and propagate notification instead of waiting for zookeeper detecting it and notifying watchers. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HIVE-13167) LLAP: Remove yarn-site resource from zookeeper based registry
Prasanth Jayachandran created HIVE-13167: Summary: LLAP: Remove yarn-site resource from zookeeper based registry Key: HIVE-13167 URL: https://issues.apache.org/jira/browse/HIVE-13167 Project: Hive Issue Type: Bug Components: llap Affects Versions: 2.1.0 Reporter: Prasanth Jayachandran Assignee: Prasanth Jayachandran With zookeeper registry adding yarn-site.xml resource is no longer required. Following line should be removed from LlapZookeeperRegistryImpl {code} this.conf.addResource(YarnConfiguration.YARN_SITE_CONFIGURATION_FILE); {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Re: Review Request 40415: HIVE-11675 make use of file footer PPD API in ETL strategy or separate strategy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/40415/ --- (Updated Feb. 26, 2016, 5:04 a.m.) Review request for hive, Gopal V, Prasanth_J, and Vikram Dixit Kumaraswamy. Repository: hive-git Description --- see jira Diffs (updated) - common/src/java/org/apache/hadoop/hive/conf/HiveConf.java e868500 metastore/src/java/org/apache/hadoop/hive/metastore/FileMetadataHandler.java bd4e188 metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStoreClient.java b5c4d1d metastore/src/java/org/apache/hadoop/hive/metastore/IMetaStoreClient.java cb092d1 metastore/src/java/org/apache/hadoop/hive/metastore/filemeta/OrcFileMetadataHandler.java 1b388aa orc/src/java/org/apache/orc/impl/InStream.java b1c6de5 ql/src/java/org/apache/hadoop/hive/ql/io/AcidUtils.java 520ae74 ql/src/java/org/apache/hadoop/hive/ql/io/HdfsUtils.java af64fc8 ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcFileFormatProxy.java ef76723 ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcInputFormat.java d175d2d ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcNewInputFormat.java 2782d7e ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java aa1c925 ql/src/test/org/apache/hadoop/hive/ql/io/orc/TestInputOutputFormat.java 6f84708 ql/src/test/org/apache/hadoop/hive/ql/io/orc/TestOrcSplitElimination.java 7a93b54 storage-api/src/java/org/apache/hadoop/hive/ql/io/sarg/PredicateLeaf.java dc71db4 storage-api/src/java/org/apache/hadoop/hive/ql/io/sarg/SearchArgumentImpl.java be5e67b Diff: https://reviews.apache.org/r/40415/diff/ Testing --- Thanks, Sergey Shelukhin
[jira] [Created] (HIVE-13166) Log the selection from llap decider
Siddharth Seth created HIVE-13166: - Summary: Log the selection from llap decider Key: HIVE-13166 URL: https://issues.apache.org/jira/browse/HIVE-13166 Project: Hive Issue Type: Improvement Components: llap Reporter: Siddharth Seth llap decider logs when it considers a vertex, however the actual placement (llap, container, etc) is not logged. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HIVE-13165) resultset which query sql add 'order by' or 'sort by' return is different from not add it
chillon_m created HIVE-13165: Summary: resultset which query sql add 'order by' or 'sort by' return is different from not add it Key: HIVE-13165 URL: https://issues.apache.org/jira/browse/HIVE-13165 Project: Hive Issue Type: Bug Components: Clients Affects Versions: 1.2.1 Environment: hadoop 2.5.2 hive 1.2.1 Reporter: chillon_m Assignee: Vaibhav Gumashta Attachments: Hql not order.png, Hql order.png resultset which query sql add 'order by' or 'sort by' return is different from not add it .size of resultset and value of row is returned is different. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HIVE-13164) Predicate pushdown may cause cross-product in left semi join
Chaoyu Tang created HIVE-13164: -- Summary: Predicate pushdown may cause cross-product in left semi join Key: HIVE-13164 URL: https://issues.apache.org/jira/browse/HIVE-13164 Project: Hive Issue Type: Bug Components: Query Processor Reporter: Chaoyu Tang Assignee: Chaoyu Tang For some left semi join queries like followings: select count(1) from (select value from t1 where key = 0) t1 left semi join (select value from t2 where key = 0) t2 on t2.value = 'val_0'; or select count(1) from (select value from t1 where key = 0) t1 left semi join (select value from t2 where key = 0) t2 on t1.value = 'val_0'; Their plans show that they have been converted to keyless cross-product due to the predicate pushdown and the dropping of the on condition. {code} LOGICAL PLAN: t1:t1 TableScan (TS_0) alias: t1 Statistics: Num rows: 1453 Data size: 5812 Basic stats: COMPLETE Column stats: NONE Filter Operator (FIL_18) predicate: (key = 0) (type: boolean) Statistics: Num rows: 726 Data size: 2904 Basic stats: COMPLETE Column stats: NONE Select Operator (SEL_2) Statistics: Num rows: 726 Data size: 2904 Basic stats: COMPLETE Column stats: NONE Reduce Output Operator (RS_9) sort order: Statistics: Num rows: 726 Data size: 2904 Basic stats: COMPLETE Column stats: NONE Join Operator (JOIN_11) condition map: Left Semi Join 0 to 1 keys: 0 1 Statistics: Num rows: 798 Data size: 3194 Basic stats: COMPLETE Column stats: NONE Group By Operator (GBY_13) aggregations: count(1) mode: hash outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE Reduce Output Operator (RS_14) sort order: Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE value expressions: _col0 (type: bigint) Group By Operator (GBY_15) aggregations: count(VALUE._col0) mode: mergepartial outputColumnNames: _col0 Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE File Output Operator (FS_17) compressed: false Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE table: input format: org.apache.hadoop.mapred.SequenceFileInputFormat output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe t2:t2 TableScan (TS_3) alias: t2 Statistics: Num rows: 645 Data size: 5812 Basic stats: COMPLETE Column stats: NONE Filter Operator (FIL_19) predicate: ((key = 0) and (value = 'val_0')) (type: boolean) Statistics: Num rows: 161 Data size: 1450 Basic stats: COMPLETE Column stats: NONE Select Operator (SEL_5) Statistics: Num rows: 161 Data size: 1450 Basic stats: COMPLETE Column stats: NONE Group By Operator (GBY_8) keys: 'val_0' (type: string) mode: hash outputColumnNames: _col0 Statistics: Num rows: 161 Data size: 1450 Basic stats: COMPLETE Column stats: NONE Reduce Output Operator (RS_10) sort order: Statistics: Num rows: 161 Data size: 1450 Basic stats: COMPLETE Column stats: NONE Join Operator (JOIN_11) condition map: Left Semi Join 0 to 1 keys: 0 1 Statistics: Num rows: 798 Data size: 3194 Basic stats: COMPLETE Column stats: NONE {code} [~gopalv], do you think these plans are valid or not? Thanks -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HIVE-13163) ORC MemoryManager thread checks are fatal, should WARN
Gopal V created HIVE-13163: -- Summary: ORC MemoryManager thread checks are fatal, should WARN Key: HIVE-13163 URL: https://issues.apache.org/jira/browse/HIVE-13163 Project: Hive Issue Type: Bug Components: ORC Affects Versions: 2.0.0, 2.1.0 Reporter: Gopal V Assignee: Gopal V The MemoryManager is tied to a WriterOptions on create, which can occur in a different thread from the writer calls. This is unexpected, but safe and needs a warning not a fatal. {code} /** * Light weight thread-safety check for multi-threaded access patterns */ private void checkOwner() { Preconditions.checkArgument(ownerLock.isHeldByCurrentThread(), "Owner thread expected %s, got %s", ownerLock.getOwner(), Thread.currentThread()); } {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HIVE-13162) Fixes for LlapDump and FileSinkoperator
Gunther Hagleitner created HIVE-13162: - Summary: Fixes for LlapDump and FileSinkoperator Key: HIVE-13162 URL: https://issues.apache.org/jira/browse/HIVE-13162 Project: Hive Issue Type: Sub-task Reporter: Gunther Hagleitner Assignee: Gunther Hagleitner Fix For: llap -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HIVE-13161) ORC: Always do sloppy overlaps for DiskRanges
Gopal V created HIVE-13161: -- Summary: ORC: Always do sloppy overlaps for DiskRanges Key: HIVE-13161 URL: https://issues.apache.org/jira/browse/HIVE-13161 Project: Hive Issue Type: Bug Affects Versions: 1.3.0, 2.1.0 Reporter: Gopal V Assignee: Prasanth Jayachandran The selected columns are sometimes only a few bytes apart (particularly for nulls which compresses tightly) and the reads aren't merged The WORST_UNCOMPRESSED_SLOP is only applied in the PPD case and is applied more for safety than reducing total number of round-trip calls to filesystem. {code} /** * Update the disk ranges to collapse adjacent or overlapping ranges. It * assumes that the ranges are sorted. * @param ranges the list of disk ranges to merge */ static void mergeDiskRanges(List ranges) { DiskRange prev = null; for(int i=0; i < ranges.size(); ++i) { DiskRange current = ranges.get(i); if (prev != null && overlap(prev.offset, prev.end, current.offset, current.end)) { prev.offset = Math.min(prev.offset, current.offset); prev.end = Math.max(prev.end, current.end); ranges.remove(i); i -= 1; } else { prev = current; } } } ... private static boolean overlap(long leftA, long rightA, long leftB, long rightB) { if (leftA <= leftB) { return rightA >= leftB; } return rightB >= leftA; } {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HIVE-13160) HS2 unable to load UDFs on startup when HMS is not ready
Eric Lin created HIVE-13160: --- Summary: HS2 unable to load UDFs on startup when HMS is not ready Key: HIVE-13160 URL: https://issues.apache.org/jira/browse/HIVE-13160 Project: Hive Issue Type: Bug Components: HiveServer2 Affects Versions: 1.2.1 Reporter: Eric Lin Assignee: Vaibhav Gumashta The error looks like this: {code} 2016-02-24 21:16:09,901 INFO hive.metastore: [main]: Trying to connect to metastore with URI thrift://host-10-17-81-201.coe.cloudera.com:9083 2016-02-24 21:16:09,971 WARN hive.metastore: [main]: Failed to connect to the MetaStore Server... 2016-02-24 21:16:09,971 INFO hive.metastore: [main]: Waiting 1 seconds before next connection attempt. 2016-02-24 21:16:10,971 INFO hive.metastore: [main]: Trying to connect to metastore with URI thrift://host-10-17-81-201.coe.cloudera.com:9083 2016-02-24 21:16:10,975 WARN hive.metastore: [main]: Failed to connect to the MetaStore Server... 2016-02-24 21:16:10,976 INFO hive.metastore: [main]: Waiting 1 seconds before next connection attempt. 2016-02-24 21:16:11,976 INFO hive.metastore: [main]: Trying to connect to metastore with URI thrift://host-10-17-81-201.coe.cloudera.com:9083 2016-02-24 21:16:11,979 WARN hive.metastore: [main]: Failed to connect to the MetaStore Server... 2016-02-24 21:16:11,979 INFO hive.metastore: [main]: Waiting 1 seconds before next connection attempt. 2016-02-24 21:16:12,987 WARN hive.ql.metadata.Hive: [main]: Failed to register all functions. java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient . 2016-02-24 21:16:12,995 INFO hive.metastore: [main]: Trying to connect to metastore with URI thrift://host-10-17-81-201.coe.cloudera.com:9083 2016-02-24 21:16:13,004 WARN hive.metastore: [main]: Failed to connect to the MetaStore Server... 2016-02-24 21:16:13,004 INFO hive.metastore: [main]: Waiting 1 seconds before next connection attempt. 2016-02-24 21:16:14,004 INFO hive.metastore: [main]: Trying to connect to metastore with URI thrift://host-10-17-81-201.coe.cloudera.com:9083 2016-02-24 21:16:14,007 WARN hive.metastore: [main]: Failed to connect to the MetaStore Server... 2016-02-24 21:16:14,007 INFO hive.metastore: [main]: Waiting 1 seconds before next connection attempt. 2016-02-24 21:16:15,007 INFO hive.metastore: [main]: Trying to connect to metastore with URI thrift://host-10-17-81-201.coe.cloudera.com:9083 2016-02-24 21:16:15,010 WARN hive.metastore: [main]: Failed to connect to the MetaStore Server... 2016-02-24 21:16:15,010 INFO hive.metastore: [main]: Waiting 1 seconds before next connection attempt. 2016-02-24 21:16:16,012 INFO org.apache.hive.service.server.HiveServer2: [main]: Shutting down HiveServer2 2016-02-24 21:16:16,014 INFO org.apache.hive.service.server.HiveServer2: [main]: Exception caught when calling stop of HiveServer2 before retrying start java.lang.NullPointerException at org.apache.hive.service.server.HiveServer2.stop(HiveServer2.java:283) at org.apache.hive.service.server.HiveServer2.startHiveServer2(HiveServer2.java:351) at org.apache.hive.service.server.HiveServer2.access$400(HiveServer2.java:69) at org.apache.hive.service.server.HiveServer2$StartOptionExecutor.execute(HiveServer2.java:545) at org.apache.hive.service.server.HiveServer2.main(HiveServer2.java:418) 2016-02-24 21:16:16,014 WARN org.apache.hive.service.server.HiveServer2: [main]: Error starting HiveServer2 on attempt 1, will retry in 60 seconds .. 2016-02-24 21:17:16,016 INFO org.apache.hive.service.server.HiveServer2: [main]: Starting HiveServer2 2016-02-24 21:17:16,131 WARN org.apache.hadoop.hive.conf.HiveConf: [main]: HiveConf of name hive.sentry.conf.url does not exist 2016-02-24 21:17:16,132 WARN org.apache.hadoop.hive.conf.HiveConf: [main]: HiveConf of name hive.entity.capture.input.URI does not exist 2016-02-24 21:17:16,150 INFO org.apache.hadoop.security.UserGroupInformation: [main]: Login successful for user hive/host-10-17-81-201.coe.cloudera@yshi.com using keytab file hive.keytab 2016-02-24 21:17:16,150 INFO org.apache.hive.service.cli.CLIService: [main]: SPNego httpUGI not created, spNegoPrincipal: , ketabFile: 2016-02-24 21:17:16,154 INFO hive.metastore: [main]: Trying to connect to metastore with URI thrift://host-10-17-81-201.coe.cloudera.com:9083 2016-02-24 21:17:16,217 INFO hive.metastore: [main]: Opened a connection to metastore, current connections: 1 2016-02-24 21:17:16,218 INFO hive.metastore: [main]: Connected to metastore. {code} And then none of the functions will be available for use as HS2 does not re-register them after HMS is up and ready. This is not desired behaviour, we shouldn't allow HS2 to be in a servicing state if function list is not ready. Or, maybe instead of initialize
Re: Review Request 43145: HIVE-12994
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/43145/ --- (Updated Feb. 25, 2016, 11:04 p.m.) Review request for hive and Ashutosh Chauhan. Bugs: HIVE-12994 https://issues.apache.org/jira/browse/HIVE-12994 Repository: hive-git Description --- Implement support for NULLS FIRST/NULLS LAST Diffs (updated) - data/files/over4_null PRE-CREATION itests/src/test/resources/testconfiguration.properties 58d0a45fde7fbfb8f20518fd549dfc64a3b89b64 metastore/if/hive_metastore.thrift e8f0a68fd640fddf6f711e1063bf97195a42f83d metastore/scripts/upgrade/derby/034-HIVE-12994.derby.sql PRE-CREATION metastore/scripts/upgrade/derby/hive-schema-2.1.0.derby.sql 42f4eb643d0073a80f4ba505e788abb19f31fb4c metastore/scripts/upgrade/derby/upgrade-2.0.0-to-2.1.0.derby.sql a0bac3ced7024afff964b298da52c1aa4f77bb2e metastore/scripts/upgrade/mssql/019-HIVE-12994.mssql.sql PRE-CREATION metastore/scripts/upgrade/mssql/hive-schema-2.1.0.mssql.sql cf5a6620610461eed9aa1b35cc282ced3c2e877f metastore/scripts/upgrade/mssql/upgrade-2.0.0-to-2.1.0.mssql.sql f25daf26bea2d6c8abb8f40803f2e99307813462 metastore/scripts/upgrade/mysql/034-HIVE-12994.mysql.sql PRE-CREATION metastore/scripts/upgrade/mysql/hive-schema-2.1.0.mysql.sql 6fd32095af797c0a0925ab6b9ebce528bc42cb3e metastore/scripts/upgrade/mysql/upgrade-2.0.0-to-2.1.0.mysql.sql e7906368efb490f7c8951a1b8e6a4ec45890d475 metastore/scripts/upgrade/oracle/034-HIVE-12994.oracle.sql PRE-CREATION metastore/scripts/upgrade/oracle/hive-schema-2.1.0.oracle.sql 774f6bea712ed2a1def8ab502a3f957c31c87d6d metastore/scripts/upgrade/oracle/upgrade-2.0.0-to-2.1.0.oracle.sql 8368d088c9332d43b62aa0f29802e81e896635ec metastore/scripts/upgrade/postgres/033-HIVE-12994.postgres.sql PRE-CREATION metastore/scripts/upgrade/postgres/hive-schema-2.1.0.postgres.sql 7463a373384bb1b3ff0944566971f65c9faf144d metastore/scripts/upgrade/postgres/upgrade-2.0.0-to-2.1.0.postgres.sql 6172407b18c235a39fc7b85720b3aa04455e9cf6 metastore/src/gen/protobuf/gen-java/org/apache/hadoop/hive/metastore/Metastore.java 416ae9d68d99110a2d9c2524e4156a43aac18ea6 metastore/src/gen/protobuf/gen-java/org/apache/hadoop/hive/metastore/hbase/HbaseMetastoreProto.java 3b2d7b5db638dc6b35f968279d6b5129977e6f1d metastore/src/gen/thrift/gen-cpp/hive_metastore_types.h 97c07a568a1b8451fa9843552eebdc828d122aaf metastore/src/gen/thrift/gen-cpp/hive_metastore_types.cpp 2695ffa17c5d3fccf8d1e99b7d78846f7b8a8f20 metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/Order.java cc0e2dd027d2e909ea4a39a742b33218c3f8411f metastore/src/gen/thrift/gen-php/metastore/Types.php 488a920e2fe1c6d9f9d966ec98f16d82c12b74d5 metastore/src/gen/thrift/gen-py/hive_metastore/ttypes.py 10eaf4a01f1ee8130b0f67340635ed462a24ab77 metastore/src/gen/thrift/gen-rb/hive_metastore_types.rb 1cf40ae568bc2749ee1775d165da6685351694e3 metastore/src/java/org/apache/hadoop/hive/metastore/MetaStoreDirectSql.java 6da295e246e2259647e32d8ba33c783b28d41550 metastore/src/java/org/apache/hadoop/hive/metastore/ObjectStore.java d4852b025503eb0087555fa3ca9a72cbafa6a22e metastore/src/java/org/apache/hadoop/hive/metastore/hbase/HBaseUtils.java d6d01bdbb879397d1b28675f5dfaa345d9b1066f metastore/src/model/org/apache/hadoop/hive/metastore/model/MOrder.java 1fa82a4fde9d315d4955ee5698796f58ce8a0921 metastore/src/protobuf/org/apache/hadoop/hive/metastore/hbase/hbase_metastore_proto.proto 466fdf9dc0b0e9d1c58c9b44977896780963e2ac metastore/src/test/org/apache/hadoop/hive/metastore/hbase/TestHBaseStore.java 29d5a64154fdb9ab9586fb919fbeae7106b1a874 metastore/src/test/org/apache/hadoop/hive/metastore/hbase/TestHBaseStoreBitVector.java b0d76620b94b25c66b8e0857100e6a8c8343 metastore/src/test/org/apache/hadoop/hive/metastore/hbase/TestSharedStorageDescriptor.java e0d8ce4dede474ad1b752794379342993bf89fa4 ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java 6fca9f7ec86574a6053af3672c551c6a63aa4870 ql/src/java/org/apache/hadoop/hive/ql/exec/MapJoinOperator.java 4d2447b683c529479b523878a4da0eb4e5202d55 ql/src/java/org/apache/hadoop/hive/ql/exec/MoveTask.java 27e7b43ca92cf081e34415002c2b2f6ecc7a18d9 ql/src/java/org/apache/hadoop/hive/ql/exec/persistence/HybridHashTableContainer.java fdc1dfffd977ef3a71fcf56da19a3b2b91538921 ql/src/java/org/apache/hadoop/hive/ql/exec/persistence/MapJoinBytesTableContainer.java 5c2ff9276b575f93a3df0fd2da378b85f7074a22 ql/src/java/org/apache/hadoop/hive/ql/exec/persistence/MapJoinKey.java cfb9abc380880da2cefe6968fd81dc3b974ec1ed ql/src/java/org/apache/hadoop/hive/ql/exec/tez/DynamicPartitionPruner.java 1510fdd555223514786dfd9137103c1339c4fc2a ql/src/java/org/apache/hadoop/hive/ql/exec/vector/reducesink/VectorReduceSinkCommonOperator.java
[jira] [Created] (HIVE-13159) TxnHandler should support datanucleus.connectionPoolingType = None
Sergey Shelukhin created HIVE-13159: --- Summary: TxnHandler should support datanucleus.connectionPoolingType = None Key: HIVE-13159 URL: https://issues.apache.org/jira/browse/HIVE-13159 Project: Hive Issue Type: Bug Reporter: Sergey Shelukhin Right now, one has to choose bonecp or dbcp. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HIVE-13158) HiveServer should pick AMs which are already ready from the pool
Siddharth Seth created HIVE-13158: - Summary: HiveServer should pick AMs which are already ready from the pool Key: HIVE-13158 URL: https://issues.apache.org/jira/browse/HIVE-13158 Project: Hive Issue Type: Bug Reporter: Siddharth Seth Scenario. Start HiveServer2 with 3 sessions. At startup there's capacity for this. All 3 sessions time out. There's capacity for one session only. The first query submitted will start a session and use it. The second query submitted (after the first one is submitted) ends up trying to launch a new session as well - instead of using the existing free session. Since there's no capacity, this ends up blocking. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Review Request 44031: HIVE-13130: API calls for retrieving primary keys and foreign keys information
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/44031/ --- Review request for hive and Ashutosh Chauhan. Repository: hive-git Description --- API calls for retrieving primary keys and foreign keys information. Changes without the generated thrift files. Diffs - jdbc/src/java/org/apache/hive/jdbc/HiveDatabaseMetaData.java 7e54d1f metastore/if/hive_metastore.thrift e8f0a68 metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java bfebfdc metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStoreClient.java b5c4d1d metastore/src/java/org/apache/hadoop/hive/metastore/IMetaStoreClient.java cb092d1 service-rpc/if/TCLIService.thrift 0aa9d13 service/src/java/org/apache/hive/service/cli/CLIService.java cc6e138 service/src/java/org/apache/hive/service/cli/EmbeddedCLIServiceClient.java 9cad5be service/src/java/org/apache/hive/service/cli/ICLIService.java 0a54bdd service/src/java/org/apache/hive/service/cli/operation/GetCrossReferenceOperation.java PRE-CREATION service/src/java/org/apache/hive/service/cli/operation/GetPrimaryKeysOperation.java PRE-CREATION service/src/java/org/apache/hive/service/cli/operation/OperationManager.java 56a9c18 service/src/java/org/apache/hive/service/cli/session/HiveSession.java 4f4e92d service/src/java/org/apache/hive/service/cli/session/HiveSessionImpl.java 4aa1875 service/src/java/org/apache/hive/service/cli/thrift/RetryingThriftCLIServiceClient.java a81c600 service/src/java/org/apache/hive/service/cli/thrift/ThriftCLIService.java 8dff264 service/src/java/org/apache/hive/service/cli/thrift/ThriftCLIServiceClient.java 5f01165 Diff: https://reviews.apache.org/r/44031/diff/ Testing --- Thanks, Hari Sankar Sivarama Subramaniyan
Review Request 44017: HIVE-13096
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/44017/ --- Review request for hive and Ashutosh Chauhan. Bugs: HIVE-13096 https://issues.apache.org/jira/browse/HIVE-13096 Repository: hive-git Description --- HIVE-13096 Diffs - ql/src/java/org/apache/hadoop/hive/ql/optimizer/ConvertJoinMapJoin.java 00bc193090e32f9c959223fbf7b10f4cb4ec8f12 ql/src/test/results/clientpositive/llap/bucket_map_join_tez1.q.out c743edcc1dcf5de84d5f22147dce10ee6a3fd173 ql/src/test/results/clientpositive/llap/dynamic_partition_pruning.q.out 729e96326f5556326806afe0e67e61b11c0733de ql/src/test/results/clientpositive/llap/vectorized_dynamic_partition_pruning.q.out 42f21fbd17898d18ba8184ff4f7f9dcca2ee843a ql/src/test/results/clientpositive/tez/auto_sortmerge_join_10.q.out 5df187d277b4bf71001955e2ae2499ed9fa6040c ql/src/test/results/clientpositive/tez/bucket_map_join_tez1.q.out 882eff3e15e527eb78f44307fe7adecf4725bc06 ql/src/test/results/clientpositive/tez/cross_product_check_2.q.out f00be43165adcd35ee9e0a0d8ba670dea795df31 ql/src/test/results/clientpositive/tez/dynamic_partition_pruning.q.out fb16b4062658779f05505d0f69f1f84298fee8f2 ql/src/test/results/clientpositive/tez/explainuser_2.q.out f2b225d5cdcf99bc4d917656c70c07efb5a66994 ql/src/test/results/clientpositive/tez/vector_groupby_mapjoin.q.out 037c33813e7455362a13f90af82244a32d5c6fd3 ql/src/test/results/clientpositive/tez/vector_inner_join.q.out 5ff2cd1c1a2b100e61893c12459119d650e0d3b9 ql/src/test/results/clientpositive/tez/vectorized_dynamic_partition_pruning.q.out 46e17e0ba86793efc9d3667145ad4b3d2b9cbfe6 Diff: https://reviews.apache.org/r/44017/diff/ Testing --- Thanks, Jesús Camacho Rodríguez
[jira] [Created] (HIVE-13157) MetaStoreEventListener.onAlter triggered for INSERT and SELECT
Eugen Stoianovici created HIVE-13157: Summary: MetaStoreEventListener.onAlter triggered for INSERT and SELECT Key: HIVE-13157 URL: https://issues.apache.org/jira/browse/HIVE-13157 Project: Hive Issue Type: Bug Components: Metastore Affects Versions: 1.2.1 Reporter: Eugen Stoianovici Priority: Critical The event onAlter from org.apache.hadoop.hive.metastore.MetaStoreEventListener is triggered when INSERT or SELECT statements are executed on the target table. Furthermore, the value of transient_lastDdl is updated in table properties for INSERT statements. -- This message was sent by Atlassian JIRA (v6.3.4#6332)