[jira] [Updated] (HIVE-11363) Prewarm Hive on Spark containers [Spark Branch]

2015-08-01 Thread Lefty Leverenz (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lefty Leverenz updated HIVE-11363: -- Labels: TODOC-SPARK (was: ) Prewarm Hive on Spark containers [Spark Branch]

[jira] [Commented] (HIVE-11363) Prewarm Hive on Spark containers [Spark Branch]

2015-08-01 Thread Lefty Leverenz (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650174#comment-14650174 ] Lefty Leverenz commented on HIVE-11363: --- Doc note: This changes the descriptions of

[jira] [Updated] (HIVE-11433) NPE for a multiple inner join query

2015-08-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-11433: --- Attachment: HIVE-11433.patch Attached patch, which adds a null check in the offensive code, seems

[jira] [Commented] (HIVE-10166) Merge Spark branch to master 7/30/2015

2015-08-01 Thread Lefty Leverenz (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650178#comment-14650178 ] Lefty Leverenz commented on HIVE-10166: --- Doc note: This creates four configuration

[jira] [Commented] (HIVE-11363) Prewarm Hive on Spark containers [Spark Branch]

2015-08-01 Thread Lefty Leverenz (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650177#comment-14650177 ] Lefty Leverenz commented on HIVE-11363: --- I see the commit to Spark branch also

[jira] [Commented] (HIVE-10166) Merge Spark branch to master 7/30/2015

2015-08-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650185#comment-14650185 ] Xuefu Zhang commented on HIVE-10166: Thank you very much, [~leftylev]. You are

[jira] [Commented] (HIVE-11434) Followup for HIVE-10166: reuse existing configurations for prewarming Spark executors

2015-08-01 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650430#comment-14650430 ] Hive QA commented on HIVE-11434: {color:red}Overall{color}: -1 no tests executed Here

[jira] [Commented] (HIVE-11413) Error in detecting availability of HiveSemanticAnalyzerHooks

2015-08-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650324#comment-14650324 ] Xuefu Zhang commented on HIVE-11413: +1 Error in detecting availability of

[jira] [Updated] (HIVE-11434) Followup for HIVE-10166: reuse existing configurations for prewarming Spark executors

2015-08-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-11434: --- Description: It appears that the patch other than the latest from HIVE-11363 was committed. (was: It

[jira] [Updated] (HIVE-11434) Followup for HIVE-10166: reuse existing configurations for prewarming Spark executors

2015-08-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-11434: --- Attachment: HIVE-11434.patch Attached patch fixed the issue. In addition, it adjusted the max wait

[jira] [Commented] (HIVE-11430) Followup HIVE-10166: investigate and fix the two test failures

2015-08-01 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650378#comment-14650378 ] Hive QA commented on HIVE-11430: {color:red}Overall{color}: -1 no tests executed Here

[jira] [Updated] (HIVE-11430) Followup HIVE-10166: investigate and fix the two test failures

2015-08-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-11430: --- Attachment: HIVE-11430.patch Followup HIVE-10166: investigate and fix the two test failures

[jira] [Commented] (HIVE-10166) Merge Spark branch to master 7/30/2015

2015-08-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650319#comment-14650319 ] Xuefu Zhang commented on HIVE-10166: I created HIVE-11434 to fix the configuration

[jira] [Commented] (HIVE-10594) Remote Spark client doesn't use Kerberos keytab to authenticate [Spark Branch]

2015-08-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650577#comment-14650577 ] Xuefu Zhang commented on HIVE-10594: Merged to master and cherry-picked to branch-1.

[jira] [Updated] (HIVE-8342) Potential null dereference in ColumnTruncateMapper#jobClose()

2015-08-01 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HIVE-8342: - Description: {code} Utilities.mvFileToFinalPath(outputPath, job, success, LOG, dynPartCtx, null,

[jira] [Updated] (HIVE-10989) HoS can't control number of map tasks for runtime skew join [Spark Branch]

2015-08-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-10989: --- Fix Version/s: 2.0.0 1.3.0 HoS can't control number of map tasks for runtime skew

[jira] [Commented] (HIVE-10999) Upgrade Spark dependency to 1.4 [Spark Branch]

2015-08-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650579#comment-14650579 ] Xuefu Zhang commented on HIVE-10999: Merged to master and cherry-picked to branch-1.

[jira] [Updated] (HIVE-10844) Combine equivalent Works for HoS[Spark Branch]

2015-08-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-10844: --- Fix Version/s: 2.0.0 1.3.0 Combine equivalent Works for HoS[Spark Branch]

[jira] [Updated] (HIVE-10999) Upgrade Spark dependency to 1.4 [Spark Branch]

2015-08-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-10999: --- Fix Version/s: 2.0.0 1.3.0 Upgrade Spark dependency to 1.4 [Spark Branch]

[jira] [Commented] (HIVE-10844) Combine equivalent Works for HoS[Spark Branch]

2015-08-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650580#comment-14650580 ] Xuefu Zhang commented on HIVE-10844: Merged to master and cherry-picked to branch-1.

[jira] [Updated] (HIVE-11108) HashTableSinkOperator doesn't support vectorization [Spark Branch]

2015-08-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-11108: --- Fix Version/s: 2.0.0 1.3.0 HashTableSinkOperator doesn't support vectorization

[jira] [Updated] (HIVE-11138) Query fails when there isn't a comparator for an operator [Spark Branch]

2015-08-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-11138: --- Fix Version/s: 2.0.0 1.3.0 Query fails when there isn't a comparator for an

[jira] [Commented] (HIVE-11108) HashTableSinkOperator doesn't support vectorization [Spark Branch]

2015-08-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650591#comment-14650591 ] Xuefu Zhang commented on HIVE-11108: Merged to master and cherry-picked to branch-1.

[jira] [Commented] (HIVE-11138) Query fails when there isn't a comparator for an operator [Spark Branch]

2015-08-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650592#comment-14650592 ] Xuefu Zhang commented on HIVE-11138: Merged to master and cherry-picked to branch-1.

[jira] [Updated] (HIVE-10855) Make HIVE-10568 work with Spark [Spark Branch]

2015-08-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-10855: --- Fix Version/s: 2.0.0 1.3.0 Make HIVE-10568 work with Spark [Spark Branch]

[jira] [Updated] (HIVE-11109) Replication factor is not properly set in SparkHashTableSinkOperator [Spark Branch]

2015-08-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-11109: --- Fix Version/s: 2.0.0 1.3.0 Replication factor is not properly set in

[jira] [Commented] (HIVE-11082) Support multi edge between nodes in SparkPlan[Spark Branch]

2015-08-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650586#comment-14650586 ] Xuefu Zhang commented on HIVE-11082: Merged to master and cherry-picked to branch-1.

[jira] [Commented] (HIVE-11053) Add more tests for HIVE-10844[Spark Branch]

2015-08-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650584#comment-14650584 ] Xuefu Zhang commented on HIVE-11053: Merged to master and cherry-picked to branch-1.

[jira] [Updated] (HIVE-11182) Enable optimized hash tables for spark [Spark Branch]

2015-08-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-11182: --- Fix Version/s: 2.0.0 1.3.0 Enable optimized hash tables for spark [Spark Branch]

[jira] [Commented] (HIVE-11109) Replication factor is not properly set in SparkHashTableSinkOperator [Spark Branch]

2015-08-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650583#comment-14650583 ] Xuefu Zhang commented on HIVE-11109: Merged to master and cherry-picked to branch-1.

[jira] [Updated] (HIVE-11053) Add more tests for HIVE-10844[Spark Branch]

2015-08-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-11053: --- Fix Version/s: 2.0.0 1.3.0 Add more tests for HIVE-10844[Spark Branch]

[jira] [Commented] (HIVE-11099) Add support for running negative q-tests [Spark Branch]

2015-08-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650582#comment-14650582 ] Xuefu Zhang commented on HIVE-11099: Merged to master and cherry-picked to branch-1.

[jira] [Updated] (HIVE-11099) Add support for running negative q-tests [Spark Branch]

2015-08-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-11099: --- Fix Version/s: 2.0.0 1.3.0 Add support for running negative q-tests [Spark

[jira] [Updated] (HIVE-11314) Print Execution completed successfully as part of spark job info [Spark Branch]

2015-08-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-11314: --- Fix Version/s: 2.0.0 1.3.0 Print Execution completed successfully as part of

[jira] [Updated] (HIVE-9152) Dynamic Partition Pruning [Spark Branch]

2015-08-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9152: -- Fix Version/s: 2.0.0 1.3.0 Dynamic Partition Pruning [Spark Branch]

[jira] [Updated] (HIVE-11363) Prewarm Hive on Spark containers [Spark Branch]

2015-08-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-11363: --- Fix Version/s: 2.0.0 1.3.0 Prewarm Hive on Spark containers [Spark Branch]

[jira] [Commented] (HIVE-9152) Dynamic Partition Pruning [Spark Branch]

2015-08-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650589#comment-14650589 ] Xuefu Zhang commented on HIVE-9152: --- Merged to master and cherry-picked to branch-1.

[jira] [Commented] (HIVE-11314) Print Execution completed successfully as part of spark job info [Spark Branch]

2015-08-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650590#comment-14650590 ] Xuefu Zhang commented on HIVE-11314: Merged to master and cherry-picked to branch-1.

[jira] [Commented] (HIVE-11363) Prewarm Hive on Spark containers [Spark Branch]

2015-08-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650587#comment-14650587 ] Xuefu Zhang commented on HIVE-11363: Merged to master and cherry-picked to branch-1.

[jira] [Commented] (HIVE-11432) Hive macro give same result for different arguments

2015-08-01 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650593#comment-14650593 ] Hive QA commented on HIVE-11432: {color:red}Overall{color}: -1 at least one tests failed

[jira] [Commented] (HIVE-11416) CBO: Calcite Operator To Hive Operator (Calcite Return Path): Groupby Optimizer assumes the schema can match after removing RS and GBY

2015-08-01 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650574#comment-14650574 ] Hive QA commented on HIVE-11416: {color:red}Overall{color}: -1 no tests executed Here

[jira] [Updated] (HIVE-11416) CBO: Calcite Operator To Hive Operator (Calcite Return Path): Groupby Optimizer assumes the schema can match after removing RS and GBY

2015-08-01 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pengcheng Xiong updated HIVE-11416: --- Attachment: HIVE-11416.03.patch CBO: Calcite Operator To Hive Operator (Calcite Return

[jira] [Commented] (HIVE-11430) Followup HIVE-10166: investigate and fix the two test failures

2015-08-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650306#comment-14650306 ] Xuefu Zhang commented on HIVE-11430: 1. Diff on convert_enum_to_string.q seems due to

[jira] [Commented] (HIVE-11087) DbTxnManager exceptions should include txnid

2015-08-01 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650532#comment-14650532 ] Hive QA commented on HIVE-11087: {color:red}Overall{color}: -1 no tests executed Here

[jira] [Updated] (HIVE-11416) CBO: Calcite Operator To Hive Operator (Calcite Return Path): Groupby Optimizer assumes the schema can match after removing RS and GBY

2015-08-01 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pengcheng Xiong updated HIVE-11416: --- Attachment: HIVE-11416.02.patch address test case failure CBO: Calcite Operator To Hive

[jira] [Assigned] (HIVE-11432) Hive macro give same result for different arguments

2015-08-01 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pengcheng Xiong reassigned HIVE-11432: -- Assignee: Pengcheng Xiong Hive macro give same result for different arguments

[jira] [Updated] (HIVE-11432) Hive macro give same result for different arguments

2015-08-01 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pengcheng Xiong updated HIVE-11432: --- Attachment: HIVE-11432.01.patch [~mendax], could you please try the patch and see if the

[jira] [Updated] (HIVE-11087) DbTxnManager exceptions should include txnid

2015-08-01 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-11087: -- Attachment: HIVE-11087.2.patch DbTxnManager exceptions should include txnid

[jira] [Commented] (HIVE-11397) Parse Hive OR clauses as they are written into the AST

2015-08-01 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650249#comment-14650249 ] Jesus Camacho Rodriguez commented on HIVE-11397: I checked the code and it