[jira] [Commented] (HIVE-9035) CBO: Disable PPD when functions are non-deterministic (ppd_random.q - non-deterministic udf rand() pushed above join)

2014-12-11 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14243437#comment-14243437 ] Ashutosh Chauhan commented on HIVE-9035: Ok. +1 pending tests. You need to reupload

[jira] [Commented] (HIVE-9081) Bucket mapjoin should use the new alias in posToAliasMap [Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14243426#comment-14243426 ] Xuefu Zhang commented on HIVE-9081: --- Since this patch is applying to trunk, is there way

[jira] [Commented] (HIVE-8913) Make SparkMapJoinResolver handle runtime skew join [Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14243414#comment-14243414 ] Xuefu Zhang commented on HIVE-8913: --- I have moved the discussion to emails. I created HIV

[jira] [Updated] (HIVE-9033) Fix ordering differences due to Java8 (part 2)

2014-12-11 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szehon Ho updated HIVE-9033: Resolution: Fixed Fix Version/s: 0.15.0 Status: Resolved (was: Patch Available) Committed

[jira] [Updated] (HIVE-9084) Investigate IOContext object initialization problem [Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9084: -- Attachment: HIVE-9084.1-spark.patch Patch #1 is for experimental only. It changed the the HashMap to Con

[jira] [Updated] (HIVE-9084) Investigate IOContext object initialization problem [Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9084: -- Status: Patch Available (was: Open) > Investigate IOContext object initialization problem [Spark Branch]

[jira] [Commented] (HIVE-8982) IndexOutOfBounds exception in mapjoin [Spark Branch]

2014-12-11 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14243395#comment-14243395 ] Chao commented on HIVE-8982: ... or we could protect these two methods with locks. > IndexOutO

[jira] [Updated] (HIVE-9084) Investigate IOContext object initialization problem [Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9084: -- Description: In recent ptest run (Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkin

[jira] [Commented] (HIVE-8982) IndexOutOfBounds exception in mapjoin [Spark Branch]

2014-12-11 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14243389#comment-14243389 ] Chao commented on HIVE-8982: Think more on this issue, imaging there are two threads (A and B)

[jira] [Updated] (HIVE-9084) Investigate IOContext object initialization problem [Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9084: -- Issue Type: Sub-task (was: Bug) Parent: HIVE-7292 > Investigate IOContext object initialization

[jira] [Created] (HIVE-9084) Investigate IOContext object initialization problem [Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created HIVE-9084: - Summary: Investigate IOContext object initialization problem [Spark Branch] Key: HIVE-9084 URL: https://issues.apache.org/jira/browse/HIVE-9084 Project: Hive Issu

[jira] [Commented] (HIVE-9033) Fix ordering differences due to Java8 (part 2)

2014-12-11 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14243383#comment-14243383 ] Hive QA commented on HIVE-9033: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Commented] (HIVE-9035) CBO: Disable PPD when functions are non-deterministic (ppd_random.q - non-deterministic udf rand() pushed above join)

2014-12-11 Thread Laljo John Pullokkaran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14243382#comment-14243382 ] Laljo John Pullokkaran commented on HIVE-9035: -- Calcite doesn't want to restri

[jira] [Commented] (HIVE-8982) IndexOutOfBounds exception in mapjoin [Spark Branch]

2014-12-11 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14243363#comment-14243363 ] Chao commented on HIVE-8982: The problem seems to be related to the static {{HashTableSinkOper

[jira] [Commented] (HIVE-9035) CBO: Disable PPD when functions are non-deterministic (ppd_random.q - non-deterministic udf rand() pushed above join)

2014-12-11 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14243357#comment-14243357 ] Ashutosh Chauhan commented on HIVE-9035: Instead of extending Calcite rules and tha

[jira] [Commented] (HIVE-6623) Add "owner" tag to ptest2 created instances

2014-12-11 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14243355#comment-14243355 ] Szehon Ho commented on HIVE-6623: - +1 thanks for figuring this out > Add "owner" tag to pt

Review Request 28973: select constant in union all followed by group by gives wrong result

2014-12-11 Thread pengcheng xiong
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28973/ --- Review request for hive, Ashutosh Chauhan and John Pullokkaran. Repository: hiv

[jira] [Updated] (HIVE-9083) Support to purge partition-data directly in dropPartitions().

2014-12-11 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-9083: --- Attachment: HIVE-9083.1.patch > Support to purge partition-data directly in dropPartiti

[jira] [Updated] (HIVE-9053) select constant in union all followed by group by gives wrong result

2014-12-11 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pengcheng Xiong updated HIVE-9053: -- Attachment: HIVE-9053.01.patch > select constant in union all followed by group by gives wrong re

[jira] [Updated] (HIVE-9053) select constant in union all followed by group by gives wrong result

2014-12-11 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pengcheng Xiong updated HIVE-9053: -- Status: Patch Available (was: Open) > select constant in union all followed by group by gives wr

[jira] [Created] (HIVE-9083) Support to purge partition-data directly in dropPartitions().

2014-12-11 Thread Mithun Radhakrishnan (JIRA)
Mithun Radhakrishnan created HIVE-9083: -- Summary: Support to purge partition-data directly in dropPartitions(). Key: HIVE-9083 URL: https://issues.apache.org/jira/browse/HIVE-9083 Project: Hive

[jira] [Assigned] (HIVE-6623) Add "owner" tag to ptest2 created instances

2014-12-11 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland reassigned HIVE-6623: -- Assignee: Brock Noland > Add "owner" tag to ptest2 created instances > -

[jira] [Updated] (HIVE-6623) Add "owner" tag to ptest2 created instances

2014-12-11 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-6623: --- Attachment: HIVE-6623.patch > Add "owner" tag to ptest2 created instances > ---

[jira] [Commented] (HIVE-9081) Bucket mapjoin should use the new alias in posToAliasMap [Spark Branch]

2014-12-11 Thread Jimmy Xiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14243323#comment-14243323 ] Jimmy Xiang commented on HIVE-9081: --- Yes, attached patch v1 that handles all scenarios. I

Review Request 28972: HIVE-9081 Bucket mapjoin should use the new alias in posToAliasMap [Spark Branch]

2014-12-11 Thread Jimmy Xiang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28972/ --- Review request for hive and Xuefu Zhang. Bugs: HIVE-9081 https://issues.apa

[jira] [Updated] (HIVE-9081) Bucket mapjoin should use the new alias in posToAliasMap [Spark Branch]

2014-12-11 Thread Jimmy Xiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jimmy Xiang updated HIVE-9081: -- Fix Version/s: spark-branch Status: Patch Available (was: Open) > Bucket mapjoin should use t

[jira] [Updated] (HIVE-9081) Bucket mapjoin should use the new alias in posToAliasMap [Spark Branch]

2014-12-11 Thread Jimmy Xiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jimmy Xiang updated HIVE-9081: -- Attachment: HIVE-9081.1-spark.patch > Bucket mapjoin should use the new alias in posToAliasMap [Spark Bra

[jira] [Commented] (HIVE-8911) Enable mapjoin hints [Spark Branch]

2014-12-11 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14243310#comment-14243310 ] Chao commented on HIVE-8911: Yes, moving all join optimizations into one place sounds good to m

[jira] [Commented] (HIVE-8911) Enable mapjoin hints [Spark Branch]

2014-12-11 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14243285#comment-14243285 ] Szehon Ho commented on HIVE-8911: - This looks ok for now to me. We might consider cleaning

Re: Review Request 28964: HIVE-8121 Create micro-benchmarks for ParquetSerde and evaluate performance

2014-12-11 Thread Sergio Pena
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28964/ --- (Updated Dic. 11, 2014, 10:42 p.m.) Review request for hive. Changes ---

Re: Review Request 28889: HIVE-8911 - Enable mapjoin hints [Spark Branch]

2014-12-11 Thread Chao Sun
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28889/ --- (Updated Dec. 11, 2014, 10:36 p.m.) Review request for hive, Szehon Ho and Xuef

[jira] [Updated] (HIVE-8911) Enable mapjoin hints [Spark Branch]

2014-12-11 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao updated HIVE-8911: --- Attachment: HIVE-8911.3-spark.patch Addressing comments. > Enable mapjoin hints [Spark Branch] > -

[jira] [Commented] (HIVE-8988) Support advanced aggregation in Hive to Calcite path

2014-12-11 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14243272#comment-14243272 ] Hive QA commented on HIVE-8988: --- {color:red}Overall{color}: -1 no tests executed Here are

[jira] [Commented] (HIVE-8911) Enable mapjoin hints [Spark Branch]

2014-12-11 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14243269#comment-14243269 ] Chao commented on HIVE-8911: BTW, I saw {{mapjoin_filter_onejoin.q.out}} and {{mapjoin_tester.q

[jira] [Updated] (HIVE-9060) Fix child operator references after NonBlockingOpDeDupProc

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9060: -- Resolution: Fixed Fix Version/s: 0.15.0 Status: Resolved (was: Patch Available) Commit

[jira] [Commented] (HIVE-8395) CBO: enable by default

2014-12-11 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14243263#comment-14243263 ] Hive QA commented on HIVE-8395: --- {color:red}Overall{color}: -1 no tests executed Here are

[jira] [Commented] (HIVE-9034) CBO: type change in literal_ints.q

2014-12-11 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14243262#comment-14243262 ] Hive QA commented on HIVE-9034: --- {color:red}Overall{color}: -1 at least one tests failed H

Re: Review Request 28964: HIVE-8121 Create micro-benchmarks for ParquetSerde and evaluate performance

2014-12-11 Thread Sergio Pena
> On Dic. 11, 2014, 8:16 p.m., Brock Noland wrote: > > ql/src/test/org/apache/hadoop/hive/ql/io/TestHiveStoragePerformance.java, > > line 379 > > > > > > Since we don't care about the data output, would it be useful t

[jira] [Comment Edited] (HIVE-9043) HiveException: Conflict on row inspector for {table}

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14243125#comment-14243125 ] Xuefu Zhang edited comment on HIVE-9043 at 12/11/14 10:19 PM: --

[jira] [Updated] (HIVE-9033) Fix ordering differences due to Java8 (part 2)

2014-12-11 Thread JIRA
[ https://issues.apache.org/jira/browse/HIVE-9033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergio Peña updated HIVE-9033: -- Status: Patch Available (was: Open) > Fix ordering differences due to Java8 (part 2) > -

[jira] [Updated] (HIVE-9033) Fix ordering differences due to Java8 (part 2)

2014-12-11 Thread JIRA
[ https://issues.apache.org/jira/browse/HIVE-9033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergio Peña updated HIVE-9033: -- Attachment: HIVE-9033.3.patch > Fix ordering differences due to Java8 (part 2) >

[jira] [Updated] (HIVE-9033) Fix ordering differences due to Java8 (part 2)

2014-12-11 Thread JIRA
[ https://issues.apache.org/jira/browse/HIVE-9033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergio Peña updated HIVE-9033: -- Status: Open (was: Patch Available) > Fix ordering differences due to Java8 (part 2) > -

Re: Review Request 28964: HIVE-8121 Create micro-benchmarks for ParquetSerde and evaluate performance

2014-12-11 Thread Brock Noland
> On Dec. 11, 2014, 8:16 p.m., Brock Noland wrote: > > ql/src/test/org/apache/hadoop/hive/ql/io/TestHiveStoragePerformance.java, > > line 105 > > > > > > Since we don't actually use the data, should we just re-use the

[jira] [Updated] (HIVE-8866) Vectorization on partitioned table throws ArrayIndexOutOfBoundsException when partitions are not of same #of columns

2014-12-11 Thread Matt McCline (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt McCline updated HIVE-8866: --- Status: In Progress (was: Patch Available) Builds are not running... > Vectorization on partitioned t

Re: Review Request 28964: HIVE-8121 Create micro-benchmarks for ParquetSerde and evaluate performance

2014-12-11 Thread Sergio Pena
> On Dic. 11, 2014, 8:16 p.m., Brock Noland wrote: > > ql/src/test/org/apache/hadoop/hive/ql/io/TestHiveStoragePerformance.java, > > line 105 > > > > > > Since we don't actually use the data, should we just re-use the

[jira] [Commented] (HIVE-8121) Create micro-benchmarks for ParquetSerde and evaluate performance

2014-12-11 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14243152#comment-14243152 ] Prasanth Jayachandran commented on HIVE-8121: - IMO, there are many pitfalls of

[jira] [Commented] (HIVE-8121) Create micro-benchmarks for ParquetSerde and evaluate performance

2014-12-11 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14243141#comment-14243141 ] Sergey Shelukhin commented on HIVE-8121: Have you considered using some standard mi

[jira] [Commented] (HIVE-9060) Fix child operator references after NonBlockingOpDeDupProc

2014-12-11 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14243139#comment-14243139 ] Hive QA commented on HIVE-9060: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Updated] (HIVE-9043) HiveException: Conflict on row inspector for {table}

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9043: -- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to trunk and merged to Spark

[jira] [Created] (HIVE-9082) Update Accumulo storage handler to build against Accumulo 1.7

2014-12-11 Thread Josh Elser (JIRA)
Josh Elser created HIVE-9082: Summary: Update Accumulo storage handler to build against Accumulo 1.7 Key: HIVE-9082 URL: https://issues.apache.org/jira/browse/HIVE-9082 Project: Hive Issue Type:

[jira] [Updated] (HIVE-9037) Improve explain plan to show joining keys for shuffle join

2014-12-11 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-9037: --- Resolution: Fixed Fix Version/s: 0.15.0 Status: Resolved (was: Patch Availabl

Re: Review Request 28964: HIVE-8121 Create micro-benchmarks for ParquetSerde and evaluate performance

2014-12-11 Thread Brock Noland
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28964/#review64785 --- Hi, This is absolutely awesome! Your code is very clean and cuts ri

[jira] [Updated] (HIVE-8988) Support advanced aggregation in Hive to Calcite path

2014-12-11 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-8988: -- Attachment: (was: HIVE-8988.patch) > Support advanced aggregation in Hive to

[jira] [Updated] (HIVE-8988) Support advanced aggregation in Hive to Calcite path

2014-12-11 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-8988: -- Attachment: HIVE-8988.patch > Support advanced aggregation in Hive to Calcite pat

[jira] [Commented] (HIVE-8911) Enable mapjoin hints [Spark Branch]

2014-12-11 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14243042#comment-14243042 ] Chao commented on HIVE-8911: [~szehon] Thanks for the review. You mean create some class like

[jira] [Commented] (HIVE-8955) alter partition should check for "hive.stats.autogather" in hiveConf

2014-12-11 Thread Pankit Thapar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14243037#comment-14243037 ] Pankit Thapar commented on HIVE-8955: - [~ashutoshc] , do you have any insight on this?

[jira] [Commented] (HIVE-8911) Enable mapjoin hints [Spark Branch]

2014-12-11 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14243034#comment-14243034 ] Szehon Ho commented on HIVE-8911: - Hi Chao, patch looks great. My only preference would be

[jira] [Commented] (HIVE-8121) Create micro-benchmarks for ParquetSerde and evaluate performance

2014-12-11 Thread JIRA
[ https://issues.apache.org/jira/browse/HIVE-8121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14243031#comment-14243031 ] Sergio Peña commented on HIVE-8121: --- You can run ORC and PARQUET tests in the patch attac

[jira] [Updated] (HIVE-8395) CBO: enable by default

2014-12-11 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-8395: --- Attachment: HIVE-8395.31.patch Exact same file, HiveQA was busted > CBO: enable by default > -

[jira] [Updated] (HIVE-9034) CBO: type change in literal_ints.q

2014-12-11 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-9034: --- Attachment: HIVE-9034.03.patch Exact same file again, HiveQA was busted > CBO: type change in

Review Request 28964: HIVE-8121 Create micro-benchmarks for ParquetSerde and evaluate performance

2014-12-11 Thread Sergio Pena
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28964/ --- Review request for hive. Bugs: HIVE-8121 https://issues.apache.org/jira/bro

Re: HiveQA is broken

2014-12-11 Thread Szehon Ho
Yea we looked at that, it was stuck seems due to some EC2 issues. Now Brock reset it this morning, and it's going now. People in that interval (last night to now) might need to re-submit the patch. Thanks Szehon On Thu, Dec 11, 2014 at 11:41 AM, Sergey Shelukhin wrote: > It looks like all the

[jira] [Commented] (HIVE-9043) HiveException: Conflict on row inspector for {table}

2014-12-11 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14243018#comment-14243018 ] Hive QA commented on HIVE-9043: --- {color:red}Overall{color}: -1 at least one tests failed H

Re: Review Request 28963: HIVE-8121 Create micro-benchmarks for ParquetSerde and evaluate performance

2014-12-11 Thread Sergio Pena
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28963/ --- (Updated Dic. 11, 2014, 7:46 p.m.) Review request for hive. Bugs: HIVE-8121

Review Request 28963: HIVE-8121 Create micro-benchmarks for ParquetSerde and evaluate performance

2014-12-11 Thread Sergio Pena
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28963/ --- Review request for hive. Bugs: HIVE-8121 None Description --- This i

HiveQA is broken

2014-12-11 Thread Sergey Shelukhin
It looks like all the builds are failing and nothing gets posted to the JIRAs, random example: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2040/console -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity t

[jira] [Resolved] (HIVE-9056) Describe Avro Table Partition Fails

2014-12-11 Thread Chaoyu Tang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chaoyu Tang resolved HIVE-9056. --- Resolution: Cannot Reproduce > Describe Avro Table Partition Fails > --

[jira] [Commented] (HIVE-9026) Re-enable remaining tests after HIVE-8970 [Spark Branch]

2014-12-11 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14243014#comment-14243014 ] Chao commented on HIVE-9026: Hmm.. {{subquery_in}} is still giving different result, and {{ppd

[jira] [Commented] (HIVE-8395) CBO: enable by default

2014-12-11 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14243002#comment-14243002 ] Sergey Shelukhin commented on HIVE-8395: Hmm... I saw this in HiveQA queue, and now

[jira] [Commented] (HIVE-9035) CBO: Disable PPD when functions are non-deterministic (ppd_random.q - non-deterministic udf rand() pushed above join)

2014-12-11 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242996#comment-14242996 ] Sergey Shelukhin commented on HIVE-9035: +1; one nit on RB > CBO: Disable PPD when

[jira] [Updated] (HIVE-9066) temporarily disable CBO for non-deterministic functions

2014-12-11 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-9066: --- Resolution: Invalid Status: Resolved (was: Patch Available) > temporarily disable CBO

[jira] [Comment Edited] (HIVE-8609) Move beeline to jline2

2014-12-11 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242978#comment-14242978 ] Thejas M Nair edited comment on HIVE-8609 at 12/11/14 7:16 PM: --

[jira] [Commented] (HIVE-8609) Move beeline to jline2

2014-12-11 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242978#comment-14242978 ] Thejas M Nair commented on HIVE-8609: - Adding the exception that gets thrown, so that s

[jira] [Commented] (HIVE-9026) Re-enable remaining tests after HIVE-8970 [Spark Branch]

2014-12-11 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242958#comment-14242958 ] Chao commented on HIVE-9026: [~xuefuz] OK, I'll do that now. > Re-enable remaining tests after

[jira] [Commented] (HIVE-9026) Re-enable remaining tests after HIVE-8970 [Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242957#comment-14242957 ] Xuefu Zhang commented on HIVE-9026: --- [~csun] HIVE-9025 is fixed and merged to Spark branc

[jira] [Commented] (HIVE-9025) join38.q (without map join) produces incorrect result when testing with multiple reducers

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242956#comment-14242956 ] Xuefu Zhang commented on HIVE-9025: --- Also merged to Spark branch. > join38.q (without ma

[jira] [Updated] (HIVE-9025) join38.q (without map join) produces incorrect result when testing with multiple reducers

2014-12-11 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-9025: --- Resolution: Fixed Fix Version/s: 0.14.1 0.15.0 Status: Reso

[jira] [Updated] (HIVE-9060) Fix child operator references after NonBlockingOpDeDupProc

2014-12-11 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szehon Ho updated HIVE-9060: Attachment: HIVE-9060.3.patch Ptest framework had some intermittent issues, submitting again. > Fix child op

[jira] [Commented] (HIVE-9037) Improve explain plan to show joining keys for shuffle join

2014-12-11 Thread Laljo John Pullokkaran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242914#comment-14242914 ] Laljo John Pullokkaran commented on HIVE-9037: -- +1 > Improve explain plan to

[jira] [Updated] (HIVE-9081) Bucket mapjoin should use the new alias in posToAliasMap [Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9081: -- Issue Type: Sub-task (was: Bug) Parent: HIVE-7292 > Bucket mapjoin should use the new alias in p

[jira] [Commented] (HIVE-8639) Convert SMBJoin to MapJoin [Spark Branch]

2014-12-11 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242891#comment-14242891 ] Szehon Ho commented on HIVE-8639: - Thanks a lot, Jimmy. > Convert SMBJoin to MapJoin [Spar

[jira] [Commented] (HIVE-9081) Bucket mapjoin should use the new alias in posToAliasMap [Spark Branch]

2014-12-11 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242872#comment-14242872 ] Chao commented on HIVE-9081: Maybe we can do it in {{MapJoinProcessor#convertJoinOpMapJoinOp}}

[jira] [Created] (HIVE-9081) Bucket mapjoin should use the new alias in posToAliasMap [Spark Branch]

2014-12-11 Thread Jimmy Xiang (JIRA)
Jimmy Xiang created HIVE-9081: - Summary: Bucket mapjoin should use the new alias in posToAliasMap [Spark Branch] Key: HIVE-9081 URL: https://issues.apache.org/jira/browse/HIVE-9081 Project: Hive

[jira] [Commented] (HIVE-8639) Convert SMBJoin to MapJoin [Spark Branch]

2014-12-11 Thread Jimmy Xiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242858#comment-14242858 ] Jimmy Xiang commented on HIVE-8639: --- [~szehon], looked into the auto_sortmerge_join_9 fai

[jira] [Updated] (HIVE-9043) HiveException: Conflict on row inspector for {table}

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9043: -- Attachment: HIVE-9043.1.patch Attache the same patch to trigger test run. > HiveException: Conflict on

[jira] [Assigned] (HIVE-8849) Hive/Spark/Yarn integration [Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang reassigned HIVE-8849: - Assignee: Chengxiang Li Assign to Chengxiang as he is taking care of all integration related issue

[jira] [Commented] (HIVE-9078) Hive should not submit second SparkTask while previous one has failed.[Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242834#comment-14242834 ] Xuefu Zhang commented on HIVE-9078: --- I'm wondering if, by removing the trying logic, we a

[jira] [Updated] (HIVE-9062) Explain plan doesn't print join keys for Tez shuffle join

2014-12-11 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-9062: --- Resolution: Fixed Fix Version/s: 0.15.0 Status: Resolved (was: Patch Availabl

[jira] [Commented] (HIVE-8913) Make SparkMapJoinResolver handle runtime skew join [Spark Branch]

2014-12-11 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242813#comment-14242813 ] Chao commented on HIVE-8913: different record handler threads should process different partitio

[jira] [Commented] (HIVE-9078) Hive should not submit second SparkTask while previous one has failed.[Spark Branch]

2014-12-11 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242795#comment-14242795 ] Hive QA commented on HIVE-9078: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Commented] (HIVE-8913) Make SparkMapJoinResolver handle runtime skew join [Spark Branch]

2014-12-11 Thread Jimmy Xiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242788#comment-14242788 ] Jimmy Xiang commented on HIVE-8913: --- bq. maybe IOContext.inputNameIOContextMap should be

[jira] [Commented] (HIVE-8982) IndexOutOfBounds exception in mapjoin [Spark Branch]

2014-12-11 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242786#comment-14242786 ] Chao commented on HIVE-8982: This one is quite interesting: in {{MapJoinEagerRowContainer#first

[jira] [Assigned] (HIVE-7874) Support multiple concurrent users

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang reassigned HIVE-7874: - Assignee: Chengxiang Li With RSC, this shouldn't be a problem any more. [~chengxiang li], could yo

[jira] [Updated] (HIVE-7816) Enable map-join tests which Tez executes [Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7816: -- Assignee: Rui Li > Enable map-join tests which Tez executes [Spark Branch] >

[jira] [Resolved] (HIVE-7613) Research optimization of auto convert join to map join [Spark branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved HIVE-7613. --- Resolution: Fixed Fix Version/s: spark-branch Since MJ is already in place (via HIVE-8699) and I

[jira] [Commented] (HIVE-7816) Enable map-join tests which Tez executes [Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242744#comment-14242744 ] Xuefu Zhang commented on HIVE-7816: --- It seems that not all test in the list are added for

[jira] [Commented] (HIVE-9078) Hive should not submit second SparkTask while previous one has failed.[Spark Branch]

2014-12-11 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242736#comment-14242736 ] Chao commented on HIVE-9078: {quote} We may need to move all spark branch issues as subtask of

[jira] [Assigned] (HIVE-7768) Integrate with Spark executor scaling [Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang reassigned HIVE-7768: - Assignee: Chengxiang Li (was: Szehon Ho) Since Szehon is busy with SMB->MJ conversion and Chengxi

[jira] [Resolved] (HIVE-7516) Add capacity control over queries running on Spark cluster [Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved HIVE-7516. --- Resolution: Won't Fix This and HIVE-7768 seem to be duplicates. Close this one and let work start on H

[jira] [Commented] (HIVE-7593) Instantiate SparkClient per user session [Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242726#comment-14242726 ] Xuefu Zhang commented on HIVE-7593: --- [~chengxiang li], With RSC, this shouldn't be a prob

<    1   2   3   >