[jira] [Created] (HIVE-16099) java.lang.NoClassDefFoundError: Lorg/apache/hive/spark/counter/SparkCounters;

2017-03-02 Thread balaji krishnan (JIRA)
balaji krishnan created HIVE-16099: -- Summary: java.lang.NoClassDefFoundError: Lorg/apache/hive/spark/counter/SparkCounters; Key: HIVE-16099 URL: https://issues.apache.org/jira/browse/HIVE-16099

[DISCUSS] Looking to the future hivemall graduation

2017-03-02 Thread Edward Capriolo
Hivemall in the incubator has a fairly impressive set of features that do machine learning directly from hive. http://hivemall.incubator.apache.org/overview.html https://github.com/myui/hivemall/wiki/Logistic-regression-dataset-generation While we can not put the cart before the horse, i can

[jira] [Created] (HIVE-16098) Describe table doesn't show stats for partitioned tables

2017-03-02 Thread Ashutosh Chauhan (JIRA)
Ashutosh Chauhan created HIVE-16098: --- Summary: Describe table doesn't show stats for partitioned tables Key: HIVE-16098 URL: https://issues.apache.org/jira/browse/HIVE-16098 Project: Hive

[jira] [Created] (HIVE-16097) minor fixes to metrics and logs in LlapTaskScheduler

2017-03-02 Thread Siddharth Seth (JIRA)
Siddharth Seth created HIVE-16097: - Summary: minor fixes to metrics and logs in LlapTaskScheduler Key: HIVE-16097 URL: https://issues.apache.org/jira/browse/HIVE-16097 Project: Hive Issue

[jira] [Created] (HIVE-16096) Predicate `__time` In ("date", "date") is not pused

2017-03-02 Thread slim bouguerra (JIRA)
slim bouguerra created HIVE-16096: - Summary: Predicate `__time` In ("date", "date") is not pused Key: HIVE-16096 URL: https://issues.apache.org/jira/browse/HIVE-16096 Project: Hive Issue

[jira] [Created] (HIVE-16095) Filter generation is not taking into account the column type.

2017-03-02 Thread slim bouguerra (JIRA)
slim bouguerra created HIVE-16095: - Summary: Filter generation is not taking into account the column type. Key: HIVE-16095 URL: https://issues.apache.org/jira/browse/HIVE-16095 Project: Hive

[jira] [Created] (HIVE-16094) queued containers may timeout if they don't get to run for a long time

2017-03-02 Thread Siddharth Seth (JIRA)
Siddharth Seth created HIVE-16094: - Summary: queued containers may timeout if they don't get to run for a long time Key: HIVE-16094 URL: https://issues.apache.org/jira/browse/HIVE-16094 Project: Hive

[jira] [Created] (HIVE-16093) LLAP: Slider placement policy gets ignored since we destroy application

2017-03-02 Thread Prasanth Jayachandran (JIRA)
Prasanth Jayachandran created HIVE-16093: Summary: LLAP: Slider placement policy gets ignored since we destroy application Key: HIVE-16093 URL: https://issues.apache.org/jira/browse/HIVE-16093

Re: Review Request 56810: Compute table stats when user computes column stats

2017-03-02 Thread pengcheng xiong
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/56810/ --- (Updated March 2, 2017, 10:37 p.m.) Review request for hive and Ashutosh

[jira] [Created] (HIVE-16092) Generate and use universal mmId instead of per db/table

2017-03-02 Thread Wei Zheng (JIRA)
Wei Zheng created HIVE-16092: Summary: Generate and use universal mmId instead of per db/table Key: HIVE-16092 URL: https://issues.apache.org/jira/browse/HIVE-16092 Project: Hive Issue Type:

Re: [DISCUSS] Spark's fork of hive

2017-03-02 Thread Alan Gates
I think the issues you point out fall into a couple of different buckets: 1) Spark forking Hive code. As you point out, based on the license, there's nothing wrong with this (see naming concerns below). I agree it's crappy technical practice because in the long term Hive and Spark will

Re: [DISCUSS] Spark's fork of hive

2017-03-02 Thread Edward Capriolo
On Thu, Mar 2, 2017 at 12:35 PM, Gopal Vijayaraghavan wrote: > > > Had the original Spark proposal implied they wished to fork portions of > the hive > > code base, I would have considered it a hostile fork. (this is open to > interpretation). > > FYI, I did ask bluntly

[jira] [Created] (HIVE-16091) Support scalar subqueries in project/select

2017-03-02 Thread Vineet Garg (JIRA)
Vineet Garg created HIVE-16091: -- Summary: Support scalar subqueries in project/select Key: HIVE-16091 URL: https://issues.apache.org/jira/browse/HIVE-16091 Project: Hive Issue Type: Sub-task

[jira] [Created] (HIVE-16090) TestHiveMetastoreChecker should use METASTORE_FS_HANDLER_THREADS_COUNT instead of HIVE_MOVE_FILES_THREAD_COUNT

2017-03-02 Thread Vihang Karajgaonkar (JIRA)
Vihang Karajgaonkar created HIVE-16090: -- Summary: TestHiveMetastoreChecker should use METASTORE_FS_HANDLER_THREADS_COUNT instead of HIVE_MOVE_FILES_THREAD_COUNT Key: HIVE-16090 URL:

Re: [DISCUSS] Spark's fork of hive

2017-03-02 Thread Gopal Vijayaraghavan
> Had the original Spark proposal implied they wished to fork portions of the > hive > code base, I would have considered it a hostile fork. (this is open to > interpretation). FYI, I did ask bluntly whether Spark intends to cut-paste Hive code into their repos previously & got an affirmative

Re: Review Request 54065: HIVE-15282: Different modification times are used when an index is built and when its staleness is checked

2017-03-02 Thread Marta Kuczora
> On Jan. 27, 2017, 4:18 p.m., Sergio Pena wrote: > > ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java > > Line 967 (original), 978 (patched) > > > > > > Agree with Peter. Should we use the dataLocation

Re: Review Request 54065: HIVE-15282: Different modification times are used when an index is built and when its staleness is checked

2017-03-02 Thread Marta Kuczora
> On Nov. 24, 2016, 5:15 p.m., Barna Zsombor Klara wrote: > > Thanks for the patch. > > I haven't looked into it closely, but I guess there is no way to write a > > junit test to cover it? I tried to figure out how this could be unit tested. The problem was that a lot of things had to be

Re: Review Request 54065: HIVE-15282: Different modification times are used when an index is built and when its staleness is checked

2017-03-02 Thread Marta Kuczora
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/54065/ --- (Updated March 2, 2017, 3:32 p.m.) Review request for hive, Aihua Xu, Chaoyu

Re: Review Request 54065: HIVE-15282: Different modification times are used when an index is built and when its staleness is checked

2017-03-02 Thread Marta Kuczora
> On Jan. 27, 2017, 4:18 p.m., Sergio Pena wrote: > > ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java > > Lines 972 (patched) > > > > > > If this condition does not happen ever, then lastModificationTime

Re: Review Request 54065: HIVE-15282: Different modification times are used when an index is built and when its staleness is checked

2017-03-02 Thread Marta Kuczora
> On Jan. 27, 2017, 4:18 p.m., Sergio Pena wrote: > > ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java > > Lines 968 (patched) > > > > > > shouldn't be easier if we set the dataLocation modification time

Re: Review Request 54065: HIVE-15282: Different modification times are used when an index is built and when its staleness is checked

2017-03-02 Thread Marta Kuczora
> On Nov. 24, 2016, 5:15 p.m., Barna Zsombor Klara wrote: > > Thanks for the patch. > > I haven't looked into it closely, but I guess there is no way to write a > > junit test to cover it? > > Marta Kuczora wrote: > I tried to figure out how this could be unit tested. The problem was that

Re: Review Request 54065: HIVE-15282: Different modification times are used when an index is built and when its staleness is checked

2017-03-02 Thread Marta Kuczora
> On Nov. 28, 2016, 11:10 a.m., Peter Vary wrote: > > ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java > > Line 967 (original), 978 (patched) > > > > > > We might want to use the dataLocation local variable

Re: Review Request 53845: 'like any' and 'like all' operators in hive

2017-03-02 Thread Simanchal Das
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/53845/ --- (Updated March 2, 2017, 3:26 p.m.) Review request for hive, Carl Steinbach and

Re: Review Request 53845: 'like any' and 'like all' operators in hive

2017-03-02 Thread Simanchal Das
> On March 2, 2017, 4:57 a.m., Carl Steinbach wrote: > > ql/src/java/org/apache/hadoop/hive/ql/parse/HiveLexer.g > > Line 2 (original), 2 (patched) > > > > > > Please make whitespace fixes in a separate patch.

[DISCUSS] Spark's fork of hive

2017-03-02 Thread Edward Capriolo
All, I have compiled a short (non exhaustive) list of items related to Spark's forking of Apache Hive code and usage of Apache Hive trademarks. 1) The original spark proposal repeatedly claims that Spark "inter operates" with hive.

[jira] [Created] (HIVE-16089) "trustStorePassword" is logged as part of jdbc connection url

2017-03-02 Thread Sebastian (JIRA)
Sebastian created HIVE-16089: Summary: "trustStorePassword" is logged as part of jdbc connection url Key: HIVE-16089 URL: https://issues.apache.org/jira/browse/HIVE-16089 Project: Hive Issue

[jira] [Created] (HIVE-16088) Fix hive conf property name introduced in HIVE-12767

2017-03-02 Thread Barna Zsombor Klara (JIRA)
Barna Zsombor Klara created HIVE-16088: -- Summary: Fix hive conf property name introduced in HIVE-12767 Key: HIVE-16088 URL: https://issues.apache.org/jira/browse/HIVE-16088 Project: Hive

[jira] [Created] (HIVE-16087) Remove multi append of log4j.configurationFile in hive script

2017-03-02 Thread Prasanth Jayachandran (JIRA)
Prasanth Jayachandran created HIVE-16087: Summary: Remove multi append of log4j.configurationFile in hive script Key: HIVE-16087 URL: https://issues.apache.org/jira/browse/HIVE-16087 Project: