Request to add to contributor list

2014-12-11 Thread Binglin Chang
Hi, I fire some jira related to hiveserver2(HIVE-9005, HIVE-9006, HIVE-9013), please help adding me to contributor list so I can assign jira and create review requests. id: decster Thanks Binglin

[jira] [Created] (HIVE-9080) ORC Concatenate fails on: Column has wrong number of index entries found: 0 expected: 1

2014-12-11 Thread Daniel Haviv (JIRA)
Daniel Haviv created HIVE-9080: -- Summary: ORC Concatenate fails on: Column has wrong number of index entries found: 0 expected: 1 Key: HIVE-9080 URL: https://issues.apache.org/jira/browse/HIVE-9080

[jira] [Updated] (HIVE-9080) ORC Concatenate fails on: Column has wrong number of index entries found: 0 expected: 1

2014-12-11 Thread Daniel Haviv (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Haviv updated HIVE-9080: --- Attachment: ORC_TABLE.sql test_table.sql test_table.txt To reproduce:

Re: Review Request 28936: Set completer in CliDriver is not working

2014-12-11 Thread cheng xu
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28936/#review64714 --- cli/src/java/org/apache/hadoop/hive/cli/CliDriver.java

Re: Review Request 28934: HIVE-9078 Hive should not submit second SparkTask while previous one has failed.[Spark Branch]

2014-12-11 Thread Xuefu Zhang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28934/#review64717 --- Ship it! Ship It! - Xuefu Zhang On Dec. 11, 2014, 6:51 a.m.,

[jira] [Updated] (HIVE-9046) Skip child tasks if parent task failed [Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9046: -- Issue Type: Sub-task (was: Bug) Parent: HIVE-7292 Skip child tasks if parent task failed

[jira] [Resolved] (HIVE-9046) Skip child tasks if parent task failed [Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved HIVE-9046. --- Resolution: Duplicate Dupe of HIVE-9078. Skip child tasks if parent task failed [Spark Branch]

[jira] [Commented] (HIVE-9078) Hive should not submit second SparkTask while previous one has failed.[Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242447#comment-14242447 ] Xuefu Zhang commented on HIVE-9078: --- +1 pending on tests. Hive should not submit second

[jira] [Updated] (HIVE-8508) UT: fix bucketsort_insert tests - related to SMBMapJoinOperator

2014-12-11 Thread Chinna Rao Lalam (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chinna Rao Lalam updated HIVE-8508: --- Attachment: HIVE-8508.1-spark.patch UT: fix bucketsort_insert tests - related to

[jira] [Updated] (HIVE-8508) UT: fix bucketsort_insert tests - related to SMBMapJoinOperator

2014-12-11 Thread Chinna Rao Lalam (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chinna Rao Lalam updated HIVE-8508: --- Status: Patch Available (was: Open) Verified these tests and these are working on current

[jira] [Commented] (HIVE-8508) UT: fix bucketsort_insert tests - related to SMBMapJoinOperator

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242455#comment-14242455 ] Xuefu Zhang commented on HIVE-8508: --- +1 pending on tests. UT: fix bucketsort_insert

[jira] [Commented] (HIVE-9079) Hive hangs while failed to get executorCount[Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242456#comment-14242456 ] Xuefu Zhang commented on HIVE-9079: --- Hi [~chengxiang li], are you sure that you uploaded

How to find Optimize query plan for given Query?

2014-12-11 Thread Akash Mishra
Hi All, I am trying to understand the details of how query is optimize in the system? Is there anything other than EXPLAIN system. As per my understanding Abstract Syntax tree is not optimize. Is the plan in stage is the optimize physical plan ? -- With Sincere Regards, Your's Sincerely,

[jira] [Commented] (HIVE-8508) UT: fix bucketsort_insert tests - related to SMBMapJoinOperator

2014-12-11 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242544#comment-14242544 ] Hive QA commented on HIVE-8508: --- {color:red}Overall{color}: -1 at least one tests failed

Review Request 28941: HIVE-8988

2014-12-11 Thread Jesús Camacho Rodríguez
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28941/ --- Review request for hive, John Pullokkaran and Julian Hyde. Bugs: HIVE-8988

[jira] [Work started] (HIVE-8988) Support advanced aggregation in Hive to Calcite path

2014-12-11 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-8988 started by Jesus Camacho Rodriguez. - Support advanced aggregation in Hive to Calcite path

Re: Review Request 28941: HIVE-8988

2014-12-11 Thread Jesús Camacho Rodríguez
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28941/ --- (Updated Dec. 11, 2014, 2:24 p.m.) Review request for hive, John Pullokkaran

[jira] [Updated] (HIVE-8988) Support advanced aggregation in Hive to Calcite path

2014-12-11 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-8988: -- Attachment: HIVE-8988.patch Support advanced aggregation in Hive to Calcite

[jira] [Updated] (HIVE-8988) Support advanced aggregation in Hive to Calcite path

2014-12-11 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-8988: -- Status: Patch Available (was: In Progress) The patch implements the AST-Calcite

[jira] [Commented] (HIVE-8988) Support advanced aggregation in Hive to Calcite path

2014-12-11 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242596#comment-14242596 ] Jesus Camacho Rodriguez commented on HIVE-8988: --- [~jpullokkaran],

[jira] [Updated] (HIVE-8508) UT: fix bucketsort_insert tests - related to SMBMapJoinOperator

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8508: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available)

[jira] [Commented] (HIVE-8508) UT: fix bucketsort_insert tests - related to SMBMapJoinOperator

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242646#comment-14242646 ] Xuefu Zhang commented on HIVE-8508: --- Committed to Spark branch. Thanks, Chinna. UT: fix

[jira] [Commented] (HIVE-8578) Investigate test failures related to HIVE-8545 [Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242649#comment-14242649 ] Xuefu Zhang commented on HIVE-8578: --- Another occurrence of the problem:

[jira] [Commented] (HIVE-4847) add rename database functionality

2014-12-11 Thread Aaron Dossett (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242674#comment-14242674 ] Aaron Dossett commented on HIVE-4847: - Hi -- Is it expected that this patch will be

[jira] [Updated] (HIVE-9078) Hive should not submit second SparkTask while previous one has failed.[Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9078: -- Attachment: HIVE-9078.1-spark.patch Reload the same patch to trigger test run. Hive should not submit

[jira] [Resolved] (HIVE-8751) Null Pointer Exception when counter is used for stats during inserting overwrite partitioned tables [Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved HIVE-8751. --- Resolution: Cannot Reproduce Cannot reproduce the problem in the latest branch. It must have been

[jira] [Resolved] (HIVE-8405) Research Bucket Map Join [Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved HIVE-8405. --- Resolution: Fixed Fix Version/s: spark-branch Research is done with the attached doc.

[jira] [Resolved] (HIVE-7382) Create a MiniSparkCluster and set up a testing framework [Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved HIVE-7382. --- Resolution: Fixed Fix Version/s: spark-branch Fixed via HIVE-8836. Create a MiniSparkCluster

[jira] [Comment Edited] (HIVE-7382) Create a MiniSparkCluster and set up a testing framework [Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242715#comment-14242715 ] Xuefu Zhang edited comment on HIVE-7382 at 12/11/14 3:53 PM: -

[jira] [Commented] (HIVE-7593) Instantiate SparkClient per user session [Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242726#comment-14242726 ] Xuefu Zhang commented on HIVE-7593: --- [~chengxiang li], With RSC, this shouldn't be a

[jira] [Resolved] (HIVE-7516) Add capacity control over queries running on Spark cluster [Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved HIVE-7516. --- Resolution: Won't Fix This and HIVE-7768 seem to be duplicates. Close this one and let work start on

[jira] [Assigned] (HIVE-7768) Integrate with Spark executor scaling [Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang reassigned HIVE-7768: - Assignee: Chengxiang Li (was: Szehon Ho) Since Szehon is busy with SMB-MJ conversion and

[jira] [Commented] (HIVE-9078) Hive should not submit second SparkTask while previous one has failed.[Spark Branch]

2014-12-11 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242736#comment-14242736 ] Chao commented on HIVE-9078: {quote} We may need to move all spark branch issues as subtask of

[jira] [Commented] (HIVE-7816) Enable map-join tests which Tez executes [Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242744#comment-14242744 ] Xuefu Zhang commented on HIVE-7816: --- It seems that not all test in the list are added for

[jira] [Resolved] (HIVE-7613) Research optimization of auto convert join to map join [Spark branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved HIVE-7613. --- Resolution: Fixed Fix Version/s: spark-branch Since MJ is already in place (via HIVE-8699) and

[jira] [Updated] (HIVE-7816) Enable map-join tests which Tez executes [Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7816: -- Assignee: Rui Li Enable map-join tests which Tez executes [Spark Branch]

[jira] [Assigned] (HIVE-7874) Support multiple concurrent users

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang reassigned HIVE-7874: - Assignee: Chengxiang Li With RSC, this shouldn't be a problem any more. [~chengxiang li], could

[jira] [Commented] (HIVE-8982) IndexOutOfBounds exception in mapjoin [Spark Branch]

2014-12-11 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242786#comment-14242786 ] Chao commented on HIVE-8982: This one is quite interesting: in

[jira] [Commented] (HIVE-8913) Make SparkMapJoinResolver handle runtime skew join [Spark Branch]

2014-12-11 Thread Jimmy Xiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242788#comment-14242788 ] Jimmy Xiang commented on HIVE-8913: --- bq. maybe IOContext.inputNameIOContextMap should be

[jira] [Commented] (HIVE-9078) Hive should not submit second SparkTask while previous one has failed.[Spark Branch]

2014-12-11 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242795#comment-14242795 ] Hive QA commented on HIVE-9078: --- {color:red}Overall{color}: -1 at least one tests failed

[jira] [Commented] (HIVE-8913) Make SparkMapJoinResolver handle runtime skew join [Spark Branch]

2014-12-11 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242813#comment-14242813 ] Chao commented on HIVE-8913: different record handler threads should process different

[jira] [Updated] (HIVE-9062) Explain plan doesn't print join keys for Tez shuffle join

2014-12-11 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-9062: --- Resolution: Fixed Fix Version/s: 0.15.0 Status: Resolved (was: Patch

[jira] [Commented] (HIVE-9078) Hive should not submit second SparkTask while previous one has failed.[Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242834#comment-14242834 ] Xuefu Zhang commented on HIVE-9078: --- I'm wondering if, by removing the trying logic, we

[jira] [Assigned] (HIVE-8849) Hive/Spark/Yarn integration [Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang reassigned HIVE-8849: - Assignee: Chengxiang Li Assign to Chengxiang as he is taking care of all integration related

[jira] [Updated] (HIVE-9043) HiveException: Conflict on row inspector for {table}

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9043: -- Attachment: HIVE-9043.1.patch Attache the same patch to trigger test run. HiveException: Conflict on

[jira] [Commented] (HIVE-8639) Convert SMBJoin to MapJoin [Spark Branch]

2014-12-11 Thread Jimmy Xiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242858#comment-14242858 ] Jimmy Xiang commented on HIVE-8639: --- [~szehon], looked into the auto_sortmerge_join_9

[jira] [Created] (HIVE-9081) Bucket mapjoin should use the new alias in posToAliasMap [Spark Branch]

2014-12-11 Thread Jimmy Xiang (JIRA)
Jimmy Xiang created HIVE-9081: - Summary: Bucket mapjoin should use the new alias in posToAliasMap [Spark Branch] Key: HIVE-9081 URL: https://issues.apache.org/jira/browse/HIVE-9081 Project: Hive

[jira] [Commented] (HIVE-9081) Bucket mapjoin should use the new alias in posToAliasMap [Spark Branch]

2014-12-11 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242872#comment-14242872 ] Chao commented on HIVE-9081: Maybe we can do it in {{MapJoinProcessor#convertJoinOpMapJoinOp}}

[jira] [Commented] (HIVE-8639) Convert SMBJoin to MapJoin [Spark Branch]

2014-12-11 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242891#comment-14242891 ] Szehon Ho commented on HIVE-8639: - Thanks a lot, Jimmy. Convert SMBJoin to MapJoin [Spark

[jira] [Updated] (HIVE-9081) Bucket mapjoin should use the new alias in posToAliasMap [Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9081: -- Issue Type: Sub-task (was: Bug) Parent: HIVE-7292 Bucket mapjoin should use the new alias in

[jira] [Commented] (HIVE-9037) Improve explain plan to show joining keys for shuffle join

2014-12-11 Thread Laljo John Pullokkaran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242914#comment-14242914 ] Laljo John Pullokkaran commented on HIVE-9037: -- +1 Improve explain plan to

[jira] [Updated] (HIVE-9060) Fix child operator references after NonBlockingOpDeDupProc

2014-12-11 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szehon Ho updated HIVE-9060: Attachment: HIVE-9060.3.patch Ptest framework had some intermittent issues, submitting again. Fix child

[jira] [Updated] (HIVE-9025) join38.q (without map join) produces incorrect result when testing with multiple reducers

2014-12-11 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-9025: --- Resolution: Fixed Fix Version/s: 0.14.1 0.15.0 Status:

[jira] [Commented] (HIVE-9025) join38.q (without map join) produces incorrect result when testing with multiple reducers

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242956#comment-14242956 ] Xuefu Zhang commented on HIVE-9025: --- Also merged to Spark branch. join38.q (without map

[jira] [Commented] (HIVE-9026) Re-enable remaining tests after HIVE-8970 [Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242957#comment-14242957 ] Xuefu Zhang commented on HIVE-9026: --- [~csun] HIVE-9025 is fixed and merged to Spark

[jira] [Commented] (HIVE-9026) Re-enable remaining tests after HIVE-8970 [Spark Branch]

2014-12-11 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242958#comment-14242958 ] Chao commented on HIVE-9026: [~xuefuz] OK, I'll do that now. Re-enable remaining tests after

[jira] [Commented] (HIVE-8609) Move beeline to jline2

2014-12-11 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242978#comment-14242978 ] Thejas M Nair commented on HIVE-8609: - Adding the exception that gets thrown, so that

[jira] [Comment Edited] (HIVE-8609) Move beeline to jline2

2014-12-11 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242978#comment-14242978 ] Thejas M Nair edited comment on HIVE-8609 at 12/11/14 7:16 PM:

[jira] [Updated] (HIVE-9066) temporarily disable CBO for non-deterministic functions

2014-12-11 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-9066: --- Resolution: Invalid Status: Resolved (was: Patch Available) temporarily disable CBO

[jira] [Commented] (HIVE-9035) CBO: Disable PPD when functions are non-deterministic (ppd_random.q - non-deterministic udf rand() pushed above join)

2014-12-11 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242996#comment-14242996 ] Sergey Shelukhin commented on HIVE-9035: +1; one nit on RB CBO: Disable PPD when

[jira] [Commented] (HIVE-8395) CBO: enable by default

2014-12-11 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14243002#comment-14243002 ] Sergey Shelukhin commented on HIVE-8395: Hmm... I saw this in HiveQA queue, and now

[jira] [Commented] (HIVE-9026) Re-enable remaining tests after HIVE-8970 [Spark Branch]

2014-12-11 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14243014#comment-14243014 ] Chao commented on HIVE-9026: Hmm.. {{subquery_in}} is still giving different result, and

[jira] [Resolved] (HIVE-9056) Describe Avro Table Partition Fails

2014-12-11 Thread Chaoyu Tang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chaoyu Tang resolved HIVE-9056. --- Resolution: Cannot Reproduce Describe Avro Table Partition Fails ---

HiveQA is broken

2014-12-11 Thread Sergey Shelukhin
It looks like all the builds are failing and nothing gets posted to the JIRAs, random example: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2040/console -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity

Review Request 28963: HIVE-8121 Create micro-benchmarks for ParquetSerde and evaluate performance

2014-12-11 Thread Sergio Pena
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28963/ --- Review request for hive. Bugs: HIVE-8121 None Description --- This

Re: Review Request 28963: HIVE-8121 Create micro-benchmarks for ParquetSerde and evaluate performance

2014-12-11 Thread Sergio Pena
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28963/ --- (Updated Dic. 11, 2014, 7:46 p.m.) Review request for hive. Bugs: HIVE-8121

[jira] [Commented] (HIVE-9043) HiveException: Conflict on row inspector for {table}

2014-12-11 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14243018#comment-14243018 ] Hive QA commented on HIVE-9043: --- {color:red}Overall{color}: -1 at least one tests failed

Re: HiveQA is broken

2014-12-11 Thread Szehon Ho
Yea we looked at that, it was stuck seems due to some EC2 issues. Now Brock reset it this morning, and it's going now. People in that interval (last night to now) might need to re-submit the patch. Thanks Szehon On Thu, Dec 11, 2014 at 11:41 AM, Sergey Shelukhin ser...@hortonworks.com wrote:

Review Request 28964: HIVE-8121 Create micro-benchmarks for ParquetSerde and evaluate performance

2014-12-11 Thread Sergio Pena
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28964/ --- Review request for hive. Bugs: HIVE-8121

[jira] [Updated] (HIVE-9034) CBO: type change in literal_ints.q

2014-12-11 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-9034: --- Attachment: HIVE-9034.03.patch Exact same file again, HiveQA was busted CBO: type change in

[jira] [Updated] (HIVE-8395) CBO: enable by default

2014-12-11 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-8395: --- Attachment: HIVE-8395.31.patch Exact same file, HiveQA was busted CBO: enable by default

[jira] [Commented] (HIVE-8121) Create micro-benchmarks for ParquetSerde and evaluate performance

2014-12-11 Thread JIRA
[ https://issues.apache.org/jira/browse/HIVE-8121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14243031#comment-14243031 ] Sergio Peña commented on HIVE-8121: --- You can run ORC and PARQUET tests in the patch

[jira] [Commented] (HIVE-8911) Enable mapjoin hints [Spark Branch]

2014-12-11 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14243034#comment-14243034 ] Szehon Ho commented on HIVE-8911: - Hi Chao, patch looks great. My only preference would be

[jira] [Commented] (HIVE-8955) alter partition should check for hive.stats.autogather in hiveConf

2014-12-11 Thread Pankit Thapar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14243037#comment-14243037 ] Pankit Thapar commented on HIVE-8955: - [~ashutoshc] , do you have any insight on this?

[jira] [Commented] (HIVE-8911) Enable mapjoin hints [Spark Branch]

2014-12-11 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14243042#comment-14243042 ] Chao commented on HIVE-8911: [~szehon] Thanks for the review. You mean create some class like

[jira] [Updated] (HIVE-8988) Support advanced aggregation in Hive to Calcite path

2014-12-11 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-8988: -- Attachment: HIVE-8988.patch Support advanced aggregation in Hive to Calcite

[jira] [Updated] (HIVE-8988) Support advanced aggregation in Hive to Calcite path

2014-12-11 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-8988: -- Attachment: (was: HIVE-8988.patch) Support advanced aggregation in Hive to

Re: Review Request 28964: HIVE-8121 Create micro-benchmarks for ParquetSerde and evaluate performance

2014-12-11 Thread Brock Noland
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28964/#review64785 --- Hi, This is absolutely awesome! Your code is very clean and cuts

[jira] [Updated] (HIVE-9037) Improve explain plan to show joining keys for shuffle join

2014-12-11 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-9037: --- Resolution: Fixed Fix Version/s: 0.15.0 Status: Resolved (was: Patch

[jira] [Created] (HIVE-9082) Update Accumulo storage handler to build against Accumulo 1.7

2014-12-11 Thread Josh Elser (JIRA)
Josh Elser created HIVE-9082: Summary: Update Accumulo storage handler to build against Accumulo 1.7 Key: HIVE-9082 URL: https://issues.apache.org/jira/browse/HIVE-9082 Project: Hive Issue

[jira] [Updated] (HIVE-9043) HiveException: Conflict on row inspector for {table}

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9043: -- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to trunk and merged to

[jira] [Commented] (HIVE-9060) Fix child operator references after NonBlockingOpDeDupProc

2014-12-11 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14243139#comment-14243139 ] Hive QA commented on HIVE-9060: --- {color:red}Overall{color}: -1 at least one tests failed

[jira] [Commented] (HIVE-8121) Create micro-benchmarks for ParquetSerde and evaluate performance

2014-12-11 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14243141#comment-14243141 ] Sergey Shelukhin commented on HIVE-8121: Have you considered using some standard

[jira] [Commented] (HIVE-8121) Create micro-benchmarks for ParquetSerde and evaluate performance

2014-12-11 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14243152#comment-14243152 ] Prasanth Jayachandran commented on HIVE-8121: - IMO, there are many pitfalls of

Re: Review Request 28964: HIVE-8121 Create micro-benchmarks for ParquetSerde and evaluate performance

2014-12-11 Thread Sergio Pena
On Dic. 11, 2014, 8:16 p.m., Brock Noland wrote: ql/src/test/org/apache/hadoop/hive/ql/io/TestHiveStoragePerformance.java, line 105 https://reviews.apache.org/r/28964/diff/1/?file=789655#file789655line105 Since we don't actually use the data, should we just re-use the same

[jira] [Updated] (HIVE-8866) Vectorization on partitioned table throws ArrayIndexOutOfBoundsException when partitions are not of same #of columns

2014-12-11 Thread Matt McCline (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt McCline updated HIVE-8866: --- Status: In Progress (was: Patch Available) Builds are not running... Vectorization on partitioned

Re: Review Request 28964: HIVE-8121 Create micro-benchmarks for ParquetSerde and evaluate performance

2014-12-11 Thread Brock Noland
On Dec. 11, 2014, 8:16 p.m., Brock Noland wrote: ql/src/test/org/apache/hadoop/hive/ql/io/TestHiveStoragePerformance.java, line 105 https://reviews.apache.org/r/28964/diff/1/?file=789655#file789655line105 Since we don't actually use the data, should we just re-use the same

[jira] [Updated] (HIVE-9033) Fix ordering differences due to Java8 (part 2)

2014-12-11 Thread JIRA
[ https://issues.apache.org/jira/browse/HIVE-9033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergio Peña updated HIVE-9033: -- Status: Open (was: Patch Available) Fix ordering differences due to Java8 (part 2)

[jira] [Updated] (HIVE-9033) Fix ordering differences due to Java8 (part 2)

2014-12-11 Thread JIRA
[ https://issues.apache.org/jira/browse/HIVE-9033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergio Peña updated HIVE-9033: -- Attachment: HIVE-9033.3.patch Fix ordering differences due to Java8 (part 2)

[jira] [Updated] (HIVE-9033) Fix ordering differences due to Java8 (part 2)

2014-12-11 Thread JIRA
[ https://issues.apache.org/jira/browse/HIVE-9033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergio Peña updated HIVE-9033: -- Status: Patch Available (was: Open) Fix ordering differences due to Java8 (part 2)

[jira] [Comment Edited] (HIVE-9043) HiveException: Conflict on row inspector for {table}

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14243125#comment-14243125 ] Xuefu Zhang edited comment on HIVE-9043 at 12/11/14 10:19 PM: --

Re: Review Request 28964: HIVE-8121 Create micro-benchmarks for ParquetSerde and evaluate performance

2014-12-11 Thread Sergio Pena
On Dic. 11, 2014, 8:16 p.m., Brock Noland wrote: ql/src/test/org/apache/hadoop/hive/ql/io/TestHiveStoragePerformance.java, line 379 https://reviews.apache.org/r/28964/diff/1/?file=789655#file789655line379 Since we don't care about the data output, would it be useful to write

[jira] [Commented] (HIVE-9034) CBO: type change in literal_ints.q

2014-12-11 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14243262#comment-14243262 ] Hive QA commented on HIVE-9034: --- {color:red}Overall{color}: -1 at least one tests failed

[jira] [Commented] (HIVE-8395) CBO: enable by default

2014-12-11 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14243263#comment-14243263 ] Hive QA commented on HIVE-8395: --- {color:red}Overall{color}: -1 no tests executed Here are

[jira] [Updated] (HIVE-9060) Fix child operator references after NonBlockingOpDeDupProc

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9060: -- Resolution: Fixed Fix Version/s: 0.15.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HIVE-8911) Enable mapjoin hints [Spark Branch]

2014-12-11 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14243269#comment-14243269 ] Chao commented on HIVE-8911: BTW, I saw {{mapjoin_filter_onejoin.q.out}} and

[jira] [Commented] (HIVE-8988) Support advanced aggregation in Hive to Calcite path

2014-12-11 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14243272#comment-14243272 ] Hive QA commented on HIVE-8988: --- {color:red}Overall{color}: -1 no tests executed Here are

[jira] [Updated] (HIVE-8911) Enable mapjoin hints [Spark Branch]

2014-12-11 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao updated HIVE-8911: --- Attachment: HIVE-8911.3-spark.patch Addressing comments. Enable mapjoin hints [Spark Branch]

Re: Review Request 28889: HIVE-8911 - Enable mapjoin hints [Spark Branch]

2014-12-11 Thread Chao Sun
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28889/ --- (Updated Dec. 11, 2014, 10:36 p.m.) Review request for hive, Szehon Ho and

Re: Review Request 28964: HIVE-8121 Create micro-benchmarks for ParquetSerde and evaluate performance

2014-12-11 Thread Sergio Pena
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28964/ --- (Updated Dic. 11, 2014, 10:42 p.m.) Review request for hive. Changes ---

  1   2   3   >