[jira] [Created] (HIVE-18713) Optimize: Transform IN clauses to = when there's only one element

2018-02-13 Thread Gopal V (JIRA)
Gopal V created HIVE-18713: -- Summary: Optimize: Transform IN clauses to = when there's only one element Key: HIVE-18713 URL: https://issues.apache.org/jira/browse/HIVE-18713 Project: Hive Issue

[DISCUSS] HMS Apiv2

2018-02-13 Thread Alexander Kolbasov
Hello, I would like to start a discussion of Hive Metastore APIs version 2. HIVE-18712 is a placeholder JIRA to keep everything in one place. Please put your thoughts there unless there is a proposal of better forum for discussions. Best, - Alex

[jira] [Created] (HIVE-18712) Design HMS Api v2

2018-02-13 Thread Alexander Kolbasov (JIRA)
Alexander Kolbasov created HIVE-18712: - Summary: Design HMS Api v2 Key: HIVE-18712 URL: https://issues.apache.org/jira/browse/HIVE-18712 Project: Hive Issue Type: Improvement

Re: Review Request 65478: HIVE-18553 VectorizedParquetReader fails after adding a new column to table

2018-02-13 Thread Vihang Karajgaonkar via Review Board
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/65478/#review197464 --- Ship it! Thanks for the changes Ferdinand. Patch looks good to

Re: Review Request 65478: HIVE-18553 VectorizedParquetReader fails after adding a new column to table

2018-02-13 Thread cheng xu
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/65478/ --- (Updated Feb. 14, 2018, 9:51 a.m.) Review request for hive. Repository:

[jira] [Created] (HIVE-18711) Add percentile_cont and percentile_disc udaf

2018-02-13 Thread Ashutosh Chauhan (JIRA)
Ashutosh Chauhan created HIVE-18711: --- Summary: Add percentile_cont and percentile_disc udaf Key: HIVE-18711 URL: https://issues.apache.org/jira/browse/HIVE-18711 Project: Hive Issue Type:

Re: Review Request 65478: HIVE-18553 VectorizedParquetReader fails after adding a new column to table

2018-02-13 Thread cheng xu
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/65478/ --- (Updated Feb. 14, 2018, 9:30 a.m.) Review request for hive. Repository:

[jira] [Created] (HIVE-18710) extend inheritPerms to ACID in Hive 2.X

2018-02-13 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created HIVE-18710: --- Summary: extend inheritPerms to ACID in Hive 2.X Key: HIVE-18710 URL: https://issues.apache.org/jira/browse/HIVE-18710 Project: Hive Issue Type: Bug

Re: Test scripts for various metastore databases

2018-02-13 Thread Vineet Garg
+1 to running automated tests whenever a patch introduces schema changes. This could act as safeguard in case a contributor forget to run these tests. I think the extra running time is worth the testing in this case. Vineet > On Feb 13, 2018, at 3:48 PM, Vihang Karajgaonkar

Re: Test scripts for various metastore databases

2018-02-13 Thread Vihang Karajgaonkar
We used to have a job which ran some tests when there were schema changes in the patch. It ran scripts from testutils/metastore to setup and run some basic validation checks (primarily to detect incompatible schema changes and schema upgrades). I think we should run similar tests whenever schema

Re: Test scripts for various metastore databases

2018-02-13 Thread Alan Gates
They aren’t currently. I don’t know if we want to add them as part of it or not. They take a little while to run in a fresh environment like the precommit testing because they have to download the docker images. The Oracle one is 2.4G. We can set it up to do it if we want to. Or maybe we

Re: Test scripts for various metastore databases

2018-02-13 Thread Vineet Garg
Hi Alan, Will these tests be run as part of pre commit testing job? Thanks, Vineet G > On Feb 12, 2018, at 9:56 AM, Alan Gates wrote: > > With the commit of HIVE-17983 to master there are now tests for install and > upgrade scripts for the metastore database for all 4 of

[jira] [Created] (HIVE-18709) Enable Compaction to work on more than one partition per job

2018-02-13 Thread Eugene Koifman (JIRA)
Eugene Koifman created HIVE-18709: - Summary: Enable Compaction to work on more than one partition per job Key: HIVE-18709 URL: https://issues.apache.org/jira/browse/HIVE-18709 Project: Hive

[jira] [Created] (HIVE-18708) Vectorization: Delay out-of-tree fixups till whole work is vectorized

2018-02-13 Thread Gopal V (JIRA)
Gopal V created HIVE-18708: -- Summary: Vectorization: Delay out-of-tree fixups till whole work is vectorized Key: HIVE-18708 URL: https://issues.apache.org/jira/browse/HIVE-18708 Project: Hive

Re: Review Request 65250: HIVE-18387

2018-02-13 Thread Ashutosh Chauhan
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/65250/#review197423 --- ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java Lines

[jira] [Created] (HIVE-18707) Dropping database via HiveMetastoreClient involves useless work

2018-02-13 Thread Alexander Kolbasov (JIRA)
Alexander Kolbasov created HIVE-18707: - Summary: Dropping database via HiveMetastoreClient involves useless work Key: HIVE-18707 URL: https://issues.apache.org/jira/browse/HIVE-18707 Project:

Re: [DISCUSS] deprecation policy

2018-02-13 Thread Alan Gates
+1 to Ed’s comments. Alan. On Tue, Feb 13, 2018 at 7:08 AM, Edward Capriolo wrote: > I do not think we should remove: > > https://issues.apache.org/jira/browse/HIVE-18692 > > One of the challenges of HQL is not having a procedure language. This > forces users into

[jira] [Created] (HIVE-18706) Ensure each Yetus execution has its own separate working dir

2018-02-13 Thread Adam Szita (JIRA)
Adam Szita created HIVE-18706: - Summary: Ensure each Yetus execution has its own separate working dir Key: HIVE-18706 URL: https://issues.apache.org/jira/browse/HIVE-18706 Project: Hive Issue

[jira] [Created] (HIVE-18705) Improve HiveMetaStoreClient.dropDatabase

2018-02-13 Thread Adam Szita (JIRA)
Adam Szita created HIVE-18705: - Summary: Improve HiveMetaStoreClient.dropDatabase Key: HIVE-18705 URL: https://issues.apache.org/jira/browse/HIVE-18705 Project: Hive Issue Type: Improvement

[jira] [Created] (HIVE-18704) Add test.groups parameter setting to ptest

2018-02-13 Thread Adam Szita (JIRA)
Adam Szita created HIVE-18704: - Summary: Add test.groups parameter setting to ptest Key: HIVE-18704 URL: https://issues.apache.org/jira/browse/HIVE-18704 Project: Hive Issue Type: Improvement

[jira] [Created] (HIVE-18703) Make Operator comparision to be based on some primitive

2018-02-13 Thread Zoltan Haindrich (JIRA)
Zoltan Haindrich created HIVE-18703: --- Summary: Make Operator comparision to be based on some primitive Key: HIVE-18703 URL: https://issues.apache.org/jira/browse/HIVE-18703 Project: Hive

Re: [DISCUSS] deprecation policy

2018-02-13 Thread Edward Capriolo
I do not think we should remove: https://issues.apache.org/jira/browse/HIVE-18692 One of the challenges of HQL is not having a procedure language. This forces users into oozie/airflow/spark even to orchestrate simple flows. Lets give that one some time to marinate, but I agree technically it

[DISCUSS] deprecation policy

2018-02-13 Thread Peter Vary
Hi Team, I am seeing several jiras proposing removing functions from Hive: HIVE-18691 Drop Support for Explicit Table Lock From Apache Hive HIVE-18692 Remove HPL/SQL From Apache Hive HIVE-18448 Drop Support For Indexes From Apache Hive I generally agree with removing unused functions. Especially

[jira] [Created] (HIVE-18702) "Insert overwrite table" doesn't clean the table directory before overwriting

2018-02-13 Thread Oleksiy Sayankin (JIRA)
Oleksiy Sayankin created HIVE-18702: --- Summary: "Insert overwrite table" doesn't clean the table directory before overwriting Key: HIVE-18702 URL: https://issues.apache.org/jira/browse/HIVE-18702

[jira] [Created] (HIVE-18701) Fix TestMiniSparkOnYarnCliDriver#testCliDriver[spark_opt_shuffle_serde]

2018-02-13 Thread Zoltan Haindrich (JIRA)
Zoltan Haindrich created HIVE-18701: --- Summary: Fix TestMiniSparkOnYarnCliDriver#testCliDriver[spark_opt_shuffle_serde] Key: HIVE-18701 URL: https://issues.apache.org/jira/browse/HIVE-18701 Project:

[jira] [Created] (HIVE-18700) qtests: authorization_update_own_table.q breaks row__id.q

2018-02-13 Thread Zoltan Haindrich (JIRA)
Zoltan Haindrich created HIVE-18700: --- Summary: qtests: authorization_update_own_table.q breaks row__id.q Key: HIVE-18700 URL: https://issues.apache.org/jira/browse/HIVE-18700 Project: Hive

[jira] [Created] (HIVE-18699) Check for duplicate partitions in HiveMetastore.exchange_partitions

2018-02-13 Thread Marta Kuczora (JIRA)
Marta Kuczora created HIVE-18699: Summary: Check for duplicate partitions in HiveMetastore.exchange_partitions Key: HIVE-18699 URL: https://issues.apache.org/jira/browse/HIVE-18699 Project: Hive

Review Request 65634: HIVE-18264: CachedStore: Store cached partitions/col stats within the table cache

2018-02-13 Thread Vaibhav Gumashta
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/65634/ --- Review request for hive, Daniel Dai and Thejas Nair. Bugs: HIVE-18264

[jira] [Created] (HIVE-18698) Fix TestMiniLlapLocalCliDriver#testCliDriver[bucket_map_join_tez1]

2018-02-13 Thread Zoltan Haindrich (JIRA)
Zoltan Haindrich created HIVE-18698: --- Summary: Fix TestMiniLlapLocalCliDriver#testCliDriver[bucket_map_join_tez1] Key: HIVE-18698 URL: https://issues.apache.org/jira/browse/HIVE-18698 Project: Hive

[jira] [Created] (HIVE-18697) The HiveMetastore.exchange_partitions method throws FileNotFoundException if the given partition doesn't exist in the source table

2018-02-13 Thread Marta Kuczora (JIRA)
Marta Kuczora created HIVE-18697: Summary: The HiveMetastore.exchange_partitions method throws FileNotFoundException if the given partition doesn't exist in the source table Key: HIVE-18697 URL:

[jira] [Created] (HIVE-18696) The partition folders might not get cleaned up properly in the HiveMetaStore.add_partitions_core method if an exception occurs

2018-02-13 Thread Marta Kuczora (JIRA)
Marta Kuczora created HIVE-18696: Summary: The partition folders might not get cleaned up properly in the HiveMetaStore.add_partitions_core method if an exception occurs Key: HIVE-18696 URL:

Review Request 65631: HIVE-18635 hooks

2018-02-13 Thread Zoltan Haindrich
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/65631/ --- Review request for hive and Ashutosh Chauhan. Bugs: HIVE-18635

[jira] [Created] (HIVE-18695) fix TestAccumuloCliDriver.testCliDriver[accumulo_queries]

2018-02-13 Thread Zoltan Haindrich (JIRA)
Zoltan Haindrich created HIVE-18695: --- Summary: fix TestAccumuloCliDriver.testCliDriver[accumulo_queries] Key: HIVE-18695 URL: https://issues.apache.org/jira/browse/HIVE-18695 Project: Hive

[jira] [Created] (HIVE-18694) Fix TestHiveCli test

2018-02-13 Thread Zoltan Haindrich (JIRA)
Zoltan Haindrich created HIVE-18694: --- Summary: Fix TestHiveCli test Key: HIVE-18694 URL: https://issues.apache.org/jira/browse/HIVE-18694 Project: Hive Issue Type: Improvement