Re: Questions related to HBase general use

2015-05-14 Thread kulkarni.swar...@gmail.com
+ hive-dev Thanks for your question. We recently have been busy adding quite a few features on top on Hive/HBase Integration to make it more stable and easy to use. We also did a talk very recently at HBaseCon 2015 showing off the latest improvements. Slides here[1]. Like Jerry mentioned, if you

Re: Review Request 34197: HIVE-10706 Make vectorized_timestamp_funcs test more stable

2015-05-14 Thread Swarnim Kulkarni
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34197/#review83782 --- Ship it! Ship It! - Swarnim Kulkarni On May 14, 2015, 6:28

[jira] [Created] (HIVE-10709) Update Avro version to 1.7.7

2015-05-14 Thread Swarnim Kulkarni (JIRA)
Swarnim Kulkarni created HIVE-10709: --- Summary: Update Avro version to 1.7.7 Key: HIVE-10709 URL: https://issues.apache.org/jira/browse/HIVE-10709 Project: Hive Issue Type: Improvement

Re: Review Request 34143: Fix stats annotation

2015-05-14 Thread pengcheng xiong
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34143/ --- (Updated May 14, 2015, 4:50 p.m.) Review request for hive, Ashutosh Chauhan

[jira] [Created] (HIVE-10710) Delete GenericUDF.getConstantLongValue

2015-05-14 Thread Alexander Pivovarov (JIRA)
Alexander Pivovarov created HIVE-10710: -- Summary: Delete GenericUDF.getConstantLongValue Key: HIVE-10710 URL: https://issues.apache.org/jira/browse/HIVE-10710 Project: Hive Issue Type:

Re: [DISCUSS] Supporting Hadoop-1 and experimental features

2015-05-14 Thread Gopal Vijayaraghavan
Hi, +1 on the idea. Having a stable release branch with ongoing fixes where we do not drop major features would be good all around. It lets us accelerate the pace of development, drop major features or rewrite them entirely without dragging everyone else kicking screaming into that release.

Re: JIRA notifications

2015-05-14 Thread Prasanth Jayachandran
@Swarnim.. Generating patch with git diff needs to include the full index for it to be uploaded to review board. “git diff —full-index”. https://code.google.com/p/reviewboard/issues/detail?id=3115 - Prasanth On May 14, 2015, at 9:14 AM, Thejas Nair thejas.n...@gmail.com wrote: Now that we

Re: [DISCUSS] Hive API passivity

2015-05-14 Thread Thejas Nair
By passivity do you mean backward compatibility ? Not all API's have same level of maturity, and the audience for them can also be different. Public api's are supposed to be marked with the annotations under org.apache.hadoop.hive.common.classification.InterfaceAudience as Public, and the

Review Request 34223: HIVE-10710 Delete GenericUDF.getConstantLongValue

2015-05-14 Thread Alexander Pivovarov
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34223/ --- Review request for hive, Ashutosh Chauhan and Jason Dere. Bugs: HIVE-10710

Re: JIRA notifications

2015-05-14 Thread Alexander Pivovarov
You can use the following command to create new review. It takes about 3-5 sec $ rbt post -g yes To update the review you can run. $ rbt post -u -g yes On Thu, May 14, 2015 at 10:48 AM, Prasanth Jayachandran pjayachand...@hortonworks.com wrote: @Swarnim.. Generating patch with git diff needs

[jira] [Created] (HIVE-10711) Tez HashTableLoader attempts to allocate more memory than available when HIVECONVERTJOINNOCONDITIONALTASKTHRESHOLD exceeds process max mem

2015-05-14 Thread Jason Dere (JIRA)
Jason Dere created HIVE-10711: - Summary: Tez HashTableLoader attempts to allocate more memory than available when HIVECONVERTJOINNOCONDITIONALTASKTHRESHOLD exceeds process max mem Key: HIVE-10711 URL:

Re: JIRA notifications

2015-05-14 Thread kulkarni.swar...@gmail.com
Also not sure if it's related but seems like RB has been pretty sluggish lately too for me. It takes forever for a patch to submitted and a review request created(the latest one is still running for past 30 minutes with no output) On Wed, May 13, 2015 at 4:26 PM, Lefty Leverenz

Re: Review Request 33881: HIVE-10623 Implement hive cli options using beeline functionality

2015-05-14 Thread cheng xu
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/33881/ --- (Updated May 14, 2015, 3:28 p.m.) Review request for hive and Xuefu Zhang.

[DISCUSS] Hive API passivity

2015-05-14 Thread kulkarni.swar...@gmail.com
While reviewing some of the recent patches, I came across a few with non-passive changes and or discussion around them. I was wondering what kind of passivity guarantees should we provide to our consumers? I understand that Hive API is probably not as widely used as some of its peers in the

[jira] [Created] (HIVE-10708) Add SchemaCompatibility check to AvroDeserializer

2015-05-14 Thread Swarnim Kulkarni (JIRA)
Swarnim Kulkarni created HIVE-10708: --- Summary: Add SchemaCompatibility check to AvroDeserializer Key: HIVE-10708 URL: https://issues.apache.org/jira/browse/HIVE-10708 Project: Hive Issue

Re: JIRA notifications

2015-05-14 Thread Thejas Nair
Now that we have moved to git, you can try using github pull request instead. It also integrates with jira. More git instructions - http://accumulo.apache.org/git.html On Thu, May 14, 2015 at 8:01 AM, kulkarni.swar...@gmail.com kulkarni.swar...@gmail.com wrote: Also not sure if it's related

[jira] [Created] (HIVE-10712) Hive on Apache Flink

2015-05-14 Thread Greg Senia (JIRA)
Greg Senia created HIVE-10712: - Summary: Hive on Apache Flink Key: HIVE-10712 URL: https://issues.apache.org/jira/browse/HIVE-10712 Project: Hive Issue Type: Wish Reporter: Greg

[jira] [Created] (HIVE-10713) Update to HBase 1.0

2015-05-14 Thread Swarnim Kulkarni (JIRA)
Swarnim Kulkarni created HIVE-10713: --- Summary: Update to HBase 1.0 Key: HIVE-10713 URL: https://issues.apache.org/jira/browse/HIVE-10713 Project: Hive Issue Type: Improvement

[jira] [Created] (HIVE-10714) Bloom filter column names specification should be case insensitive

2015-05-14 Thread Prasanth Jayachandran (JIRA)
Prasanth Jayachandran created HIVE-10714: Summary: Bloom filter column names specification should be case insensitive Key: HIVE-10714 URL: https://issues.apache.org/jira/browse/HIVE-10714

Re: Review Request 34059: HIVE-10673 Dynamically partitioned hash join for Tez

2015-05-14 Thread Jason Dere
On May 12, 2015, 6:04 a.m., Alexander Pivovarov wrote: ql/src/java/org/apache/hadoop/hive/ql/exec/tez/KeyValuesFromKeyValue.java, line 33 https://reviews.apache.org/r/34059/diff/1/?file=955664#file955664line33 booleans in java are false by default I find this provides better

Re: Review Request 34059: HIVE-10673 Dynamically partitioned hash join for Tez

2015-05-14 Thread Jason Dere
On May 12, 2015, 6:42 a.m., Alexander Pivovarov wrote: ql/src/java/org/apache/hadoop/hive/ql/parse/GenTezWork.java, line 439 https://reviews.apache.org/r/34059/diff/1/?file=955675#file955675line439 trailing space will fix On May 12, 2015, 6:42 a.m., Alexander Pivovarov wrote:

Re: Review Request 34059: HIVE-10673 Dynamically partitioned hash join for Tez

2015-05-14 Thread Jason Dere
On May 12, 2015, 5:51 a.m., Alexander Pivovarov wrote: ql/src/java/org/apache/hadoop/hive/ql/exec/MapJoinOperator.java, line 674 https://reviews.apache.org/r/34059/diff/1/?file=955661#file955661line674 I think it's better to use Map.Entry here to avoid unnecessary lookup get(pos)

Re: Review Request 34059: HIVE-10673 Dynamically partitioned hash join for Tez

2015-05-14 Thread Jason Dere
On May 12, 2015, 6:26 a.m., Alexander Pivovarov wrote: ql/src/java/org/apache/hadoop/hive/ql/optimizer/MapJoinProcessor.java, line 95 https://reviews.apache.org/r/34059/diff/1/?file=955671#file955671line95 usually static Log should be private because superclass static methods

Re: Review Request 34059: HIVE-10673 Dynamically partitioned hash join for Tez

2015-05-14 Thread Jason Dere
On May 12, 2015, 6:35 a.m., Alexander Pivovarov wrote: ql/src/java/org/apache/hadoop/hive/ql/parse/GenTezProcContext.java, line 109 https://reviews.apache.org/r/34059/diff/1/?file=955673#file955673line109 trailing space will fix On May 12, 2015, 6:35 a.m., Alexander Pivovarov

Review Request 34238: HIVE-10709 Update avro dependency to 1.7.7

2015-05-14 Thread Swarnim Kulkarni
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34238/ --- Review request for hive and Alexander Pivovarov. Bugs: HIVE-10709

fixed couple q tests which failed in recent builds. Need committer review

2015-05-14 Thread Alexander Pivovarov
HIVE-10665 https://issues.apache.org/jira/browse/HIVE-10665 udaf_percentile_approx_23.q HIVE-10706 https://issues.apache.org/jira/browse/HIVE-10706 vectorized_timestamp_funcs.q

Re: Review Request 34059: HIVE-10673 Dynamically partitioned hash join for Tez

2015-05-14 Thread Alexander Pivovarov
On May 12, 2015, 6:26 a.m., Alexander Pivovarov wrote: ql/src/java/org/apache/hadoop/hive/ql/optimizer/ReduceSinkMapJoinProc.java, line 107 https://reviews.apache.org/r/34059/diff/1/?file=955672#file955672line107 ReduceSinkOperator uses Object.hashCode() and equals() methods.

Re: [VOTE] Apache Hive 1.2.0 release candidate 4

2015-05-14 Thread Gunther Hagleitner
?+1 ditto. same checks as last time. From: Alan Gates alanfga...@gmail.com Sent: Wednesday, May 13, 2015 1:35 PM To: dev@hive.apache.org Subject: Re: [VOTE] Apache Hive 1.2.0 release candidate 4 +1, same checks as last vote. Alan.

Re: [VOTE] Apache Hive 1.2.0 release candidate 4

2015-05-14 Thread Thejas Nair
+1 Verfied the signature and checksum Build the src.tar.gz , ran queries from both newly built package and bin.tar.gz. Ran hive cli and beeline queries in local mode. Checked RELEASE_NOTES.txt , README.txt, LICENSE, NOTICE On Wed, May 13, 2015 at 1:35 PM, Alan Gates alanfga...@gmail.com wrote:

Review Request 34235: HIVE-10687 Fix avro deserialization issues for evolved unions

2015-05-14 Thread Swarnim Kulkarni
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34235/ --- Review request for hive and Brock Noland. Bugs: HIVE-10687

Re: Review Request 34059: HIVE-10673 Dynamically partitioned hash join for Tez

2015-05-14 Thread Alexander Pivovarov
On May 12, 2015, 6:26 a.m., Alexander Pivovarov wrote: ql/src/java/org/apache/hadoop/hive/ql/optimizer/ReduceSinkMapJoinProc.java, line 107 https://reviews.apache.org/r/34059/diff/1/?file=955672#file955672line107 ReduceSinkOperator uses Object.hashCode() and equals() methods.

[jira] [Created] (HIVE-10715) RAT failures - many files do not have ASF licenses

2015-05-14 Thread Sushanth Sowmyan (JIRA)
Sushanth Sowmyan created HIVE-10715: --- Summary: RAT failures - many files do not have ASF licenses Key: HIVE-10715 URL: https://issues.apache.org/jira/browse/HIVE-10715 Project: Hive Issue

Re: Review Request 34059: HIVE-10673 Dynamically partitioned hash join for Tez

2015-05-14 Thread Jason Dere
On May 12, 2015, 6:26 a.m., Alexander Pivovarov wrote: ql/src/java/org/apache/hadoop/hive/ql/optimizer/ReduceSinkMapJoinProc.java, line 107 https://reviews.apache.org/r/34059/diff/1/?file=955672#file955672line107 ReduceSinkOperator uses Object.hashCode() and equals() methods.

Review Request 34248: HIVE-10684 Fix the unit test failures for HIVE-7553 after HIVE-10674 removed the binary jar files

2015-05-14 Thread cheng xu
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34248/ --- Review request for hive and Sushanth Sowmyan. Bugs: HIVE-10684

[jira] [Created] (HIVE-10717) Fix failed qtest encryption_insert_partition_static test in Jenkin

2015-05-14 Thread Ferdinand Xu (JIRA)
Ferdinand Xu created HIVE-10717: --- Summary: Fix failed qtest encryption_insert_partition_static test in Jenkin Key: HIVE-10717 URL: https://issues.apache.org/jira/browse/HIVE-10717 Project: Hive

Re: JIRA notifications

2015-05-14 Thread kulkarni.swar...@gmail.com
Yeah I was having issues with both the manual method as well as with rbt. But seems like things are back to normal now. Thanks guys! On May 14, 2015 12:51 PM, Alexander Pivovarov apivova...@gmail.com wrote: You can use the following command to create new review. It takes about 3-5 sec $ rbt

Re: Review Request 34059: HIVE-10673 Dynamically partitioned hash join for Tez

2015-05-14 Thread Jason Dere
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34059/ --- (Updated May 15, 2015, 1:02 a.m.) Review request for hive, Matt McCline and

Review Request 34249: Case folding with nulls in expression with filter operator

2015-05-14 Thread Ashutosh Chauhan
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34249/ --- Review request for hive and Gopal V. Bugs: HIVE-10716

Re: [VOTE] Apache Hive 1.2.0 release candidate 4

2015-05-14 Thread Sushanth Sowmyan
Sorry folks, we discovered one more issue with the RC - ASF headers were missing in a couple of files. I'm in the process of spinning out an RC5 with the fix. And since we already have functional testing of the RC done, and these are trivial changes from the previous RC, I again propose a

Re: [VOTE] Apache Hive 1.2.0 release candidate 5

2015-05-14 Thread Vikram Dixit K
I built against hadoop1 and hadoop2 and ran the rat tool as well. Ran a couple of queries. +1 Thanks Vikram. On Thu, May 14, 2015 at 6:30 PM, Sushanth Sowmyan khorg...@gmail.com wrote: Hi Folks, We've cleared all the blockers listed for 1.2.0 release, either committing them, or deferring

Re: Review Request 34235: HIVE-10687 Fix avro deserialization issues for evolved unions

2015-05-14 Thread cheng xu
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34235/#review83883 ---

[jira] [Created] (HIVE-10716) Fold case/when udf for expression involving nulls in filter operator.

2015-05-14 Thread Ashutosh Chauhan (JIRA)
Ashutosh Chauhan created HIVE-10716: --- Summary: Fold case/when udf for expression involving nulls in filter operator. Key: HIVE-10716 URL: https://issues.apache.org/jira/browse/HIVE-10716 Project:

[VOTE] Apache Hive 1.2.0 release candidate 5

2015-05-14 Thread Sushanth Sowmyan
Hi Folks, We've cleared all the blockers listed for 1.2.0 release, either committing them, or deferring out to an eventual 1.2.1 stabilization release. (Any deferrals were a result of discussion between myself and the committer responsible for the issue.) More details are available here :

[jira] [Created] (HIVE-10719) Hive metastore failure when alter table rename is attempted.

2015-05-14 Thread Vikram Dixit K (JIRA)
Vikram Dixit K created HIVE-10719: - Summary: Hive metastore failure when alter table rename is attempted. Key: HIVE-10719 URL: https://issues.apache.org/jira/browse/HIVE-10719 Project: Hive

Review Request 34197: HIVE-10706 Make vectorized_timestamp_funcs test more stable

2015-05-14 Thread Alexander Pivovarov
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34197/ --- Review request for hive and Jason Dere. Bugs: HIVE-10706

[jira] [Created] (HIVE-10707) CBO: debug logging OOMs

2015-05-14 Thread Gopal V (JIRA)
Gopal V created HIVE-10707: -- Summary: CBO: debug logging OOMs Key: HIVE-10707 URL: https://issues.apache.org/jira/browse/HIVE-10707 Project: Hive Issue Type: Bug Components: CBO

Re: Review Request 33881: HIVE-10623 Implement hive cli options using beeline functionality

2015-05-14 Thread Alexander Pivovarov
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/33881/#review83724 --- beeline/src/test/org/apache/hive/beeline/cli/TestHiveCli.java

[jira] [Created] (HIVE-10718) Update committer list - Add Ferdinand Xu

2015-05-14 Thread Ferdinand Xu (JIRA)
Ferdinand Xu created HIVE-10718: --- Summary: Update committer list - Add Ferdinand Xu Key: HIVE-10718 URL: https://issues.apache.org/jira/browse/HIVE-10718 Project: Hive Issue Type: Bug

Re: [VOTE] Apache Hive 1.2.0 release candidate 5

2015-05-14 Thread Gunther Hagleitner
One more time, with feeling :-) +1, same verification as last time. From: Vikram Dixit K vikram.di...@gmail.com Sent: Thursday, May 14, 2015 6:51 PM To: dev@hive.apache.org Cc: hive-...@hadoop.apache.org Subject: Re: [VOTE] Apache Hive 1.2.0 release

FAILED: IndexOutOfBoundsException Index: 3, Size: 3

2015-05-14 Thread lushuai2...@139.com
Hello, Man! When I execute the hql ,for example: FROM INPUT INSERT OVERWRITE TABLE temp2 partition(dt='2015-05-15',type='type1') SELECT key,ip, count(distinct(value)) as uv, count(distinct(val1)) as pv where ip='2015-05-13' and key='dstdomain1' GROUP BY key,ip INSERT

Review Request 34261: query on view results fails with table not found error if view is created with subquery alias (CTE).

2015-05-14 Thread pengcheng xiong
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34261/ --- Review request for hive, Ashutosh Chauhan and John Pullokkaran. Repository: