Re: Integrating HMS microbenchmarks with standalone metastore

2018-06-13 Thread Alexander Kolbasov
I was planning to drop JMH because it isn't really useful. I experimented with initially and it doesn't really support HMS use case, so I just kept it around for reference. This should take care of GPL part. I think the rest should be fine. - Alex On Wed, Jun 13, 2018 at 8:35 PM Owen O'Malley

Re: Integrating HMS microbenchmarks with standalone metastore

2018-06-13 Thread Owen O'Malley
I think that having benchmarks is a really good idea. You will need to make them a separate submodule of the standalone Metastore that isn't built by default, because we can't have a dependency on JMH, which is GPL licensed. .. Owen > On Jun 14, 2018, at 02:55, Alexander Kolbasov wrote: >

Integrating HMS microbenchmarks with standalone metastore

2018-06-13 Thread Alexander Kolbasov
I have a collection of Hive Metastore tools that talk to metastore over Thrift. The most useful part of these is a collection of metastore micro-benchmarks. Currently tools live in my private repo (https://github.com/akolb1/hclient) and I think that now when we have standalone metastore it makes

[jira] [Created] (HIVE-19891) inserting into external tables with custom partition directories may cause data loss

2018-06-13 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created HIVE-19891: --- Summary: inserting into external tables with custom partition directories may cause data loss Key: HIVE-19891 URL: https://issues.apache.org/jira/browse/HIVE-19891

[jira] [Created] (HIVE-19890) ACID: Inherit bucket-id from original ROW_ID for delete deltas

2018-06-13 Thread Gopal V (JIRA)
Gopal V created HIVE-19890: -- Summary: ACID: Inherit bucket-id from original ROW_ID for delete deltas Key: HIVE-19890 URL: https://issues.apache.org/jira/browse/HIVE-19890 Project: Hive Issue Type:

[jira] [Created] (HIVE-19889) Wrong results due to PPD of non deterministic functions with CBO

2018-06-13 Thread Janaki Lahorani (JIRA)
Janaki Lahorani created HIVE-19889: -- Summary: Wrong results due to PPD of non deterministic functions with CBO Key: HIVE-19889 URL: https://issues.apache.org/jira/browse/HIVE-19889 Project: Hive

[jira] [Created] (HIVE-19888) Misleading "METASTORE_FILTER_HOOK will be ignored" warning from SessionState

2018-06-13 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created HIVE-19888: - Summary: Misleading "METASTORE_FILTER_HOOK will be ignored" warning from SessionState Key: HIVE-19888 URL: https://issues.apache.org/jira/browse/HIVE-19888

[jira] [Created] (HIVE-19887) One item in pom.xml still has 3.1.0 causing Metastore releated tables related test failures.

2018-06-13 Thread Steve Yeom (JIRA)
Steve Yeom created HIVE-19887: - Summary: One item in pom.xml still has 3.1.0 causing Metastore releated tables related test failures. Key: HIVE-19887 URL: https://issues.apache.org/jira/browse/HIVE-19887

[jira] [Created] (HIVE-19886) Logs may be directed to 2 files if --hiveconf hive.log.file is used

2018-06-13 Thread Prasanth Jayachandran (JIRA)
Prasanth Jayachandran created HIVE-19886: Summary: Logs may be directed to 2 files if --hiveconf hive.log.file is used Key: HIVE-19886 URL: https://issues.apache.org/jira/browse/HIVE-19886

[jira] [Created] (HIVE-19885) Druid Kafka Ingestion - Allow user to set kafka consumer properties via table properties

2018-06-13 Thread Nishant Bangarwa (JIRA)
Nishant Bangarwa created HIVE-19885: --- Summary: Druid Kafka Ingestion - Allow user to set kafka consumer properties via table properties Key: HIVE-19885 URL: https://issues.apache.org/jira/browse/HIVE-19885

Re: Precommit branch patches pickup order

2018-06-13 Thread Prasanth Jayachandran
Thanks! > On Jun 13, 2018, at 1:50 PM, Vihang Karajgaonkar > wrote: > > Based on my knowledge, it picks up only one which is the latest. > > On Wed, Jun 13, 2018 at 1:33 PM, Prasanth Jayachandran < > pjayachand...@hortonworks.com> wrote: > >> Does anyone know if 2 patches are uploaded for a

Re: Precommit branch patches pickup order

2018-06-13 Thread Vihang Karajgaonkar
Based on my knowledge, it picks up only one which is the latest. On Wed, Jun 13, 2018 at 1:33 PM, Prasanth Jayachandran < pjayachand...@hortonworks.com> wrote: > Does anyone know if 2 patches are uploaded for a jira (say > HIVE-12345.patch and HIVE-12345-branch-3.patch) for different branches, >

[jira] [Created] (HIVE-19884) Invalidation cache may throw NPE when there is no data in table used by materialized view

2018-06-13 Thread Jesus Camacho Rodriguez (JIRA)
Jesus Camacho Rodriguez created HIVE-19884: -- Summary: Invalidation cache may throw NPE when there is no data in table used by materialized view Key: HIVE-19884 URL:

Precommit branch patches pickup order

2018-06-13 Thread Prasanth Jayachandran
Does anyone know if 2 patches are uploaded for a jira (say HIVE-12345.patch and HIVE-12345-branch-3.patch) for different branches, will precommit pickup both patches for test run or will it only pickup the latest regardless of the branch? Thanks Prasanth

Re: Cleaning up old version in dist

2018-06-13 Thread Owen O'Malley
The more accurate guidance is to keep the latest release from each branch that is being actively maintained. At this point, that means 2.3 and 3.0 for Hive. I'd propose that we keep those versions of storage-api that match those versions of Hive. That means we should keep 2.4 and 2.6 for storage

[jira] [Created] (HIVE-19883) QTestUtil: initDataset() can be affected by the settings of the previous test

2018-06-13 Thread Jason Dere (JIRA)
Jason Dere created HIVE-19883: - Summary: QTestUtil: initDataset() can be affected by the settings of the previous test Key: HIVE-19883 URL: https://issues.apache.org/jira/browse/HIVE-19883 Project: Hive

Re: Review Request 67485: HIVE-19783 Retrieve only locations in HiveMetaStore.dropPartitionsAndGetLocations

2018-06-13 Thread Vihang Karajgaonkar via Review Board
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/67485/#review204700 ---

[GitHub] hive pull request #374: HIVE-19880 : Repl Load to return recoverable vs non-...

2018-06-13 Thread maheshk114
GitHub user maheshk114 opened a pull request: https://github.com/apache/hive/pull/374 HIVE-19880 : Repl Load to return recoverable vs non-recoverable error… … You can merge this pull request into a Git repository by running: $ git pull https://github.com/maheshk114/hive

[GitHub] hive pull request #373: HIVE-19881 : Allow metadata dump for database which ...

2018-06-13 Thread maheshk114
GitHub user maheshk114 opened a pull request: https://github.com/apache/hive/pull/373 HIVE-19881 : Allow metadata dump for database which are not source of replication … You can merge this pull request into a Git repository by running: $ git pull

Re: Review Request 67351: HIVE-19718 Adding partitions in bulk also fetches table for each partition

2018-06-13 Thread Vihang Karajgaonkar via Review Board
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/67351/#review204697 --- Ship it! Ship It! - Vihang Karajgaonkar On June 6, 2018,

[jira] [Created] (HIVE-19882) Fix QTestUtil session lifecycle

2018-06-13 Thread Zoltan Haindrich (JIRA)
Zoltan Haindrich created HIVE-19882: --- Summary: Fix QTestUtil session lifecycle Key: HIVE-19882 URL: https://issues.apache.org/jira/browse/HIVE-19882 Project: Hive Issue Type: Bug

[jira] [Created] (HIVE-19881) Allow metadata dump for database which are not source of replication

2018-06-13 Thread mahesh kumar behera (JIRA)
mahesh kumar behera created HIVE-19881: -- Summary: Allow metadata dump for database which are not source of replication Key: HIVE-19881 URL: https://issues.apache.org/jira/browse/HIVE-19881

[jira] [Created] (HIVE-19880) Repl Load to return recoverable vs non-recoverable error codes

2018-06-13 Thread mahesh kumar behera (JIRA)
mahesh kumar behera created HIVE-19880: -- Summary: Repl Load to return recoverable vs non-recoverable error codes Key: HIVE-19880 URL: https://issues.apache.org/jira/browse/HIVE-19880 Project:

[jira] [Created] (HIVE-19879) Remove unused calcite sql operator.

2018-06-13 Thread slim bouguerra (JIRA)
slim bouguerra created HIVE-19879: - Summary: Remove unused calcite sql operator. Key: HIVE-19879 URL: https://issues.apache.org/jira/browse/HIVE-19879 Project: Hive Issue Type: Bug

[jira] [Created] (HIVE-19878) Hive On Spark support AM shut down when there is no job submit

2018-06-13 Thread Song Jun (JIRA)
Song Jun created HIVE-19878: --- Summary: Hive On Spark support AM shut down when there is no job submit Key: HIVE-19878 URL: https://issues.apache.org/jira/browse/HIVE-19878 Project: Hive Issue