[jira] [Commented] (HIVE-7816) Enable map-join tests which Tez executes [Spark Branch]

2014-12-14 Thread Hive QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14245876#comment-14245876
 ] 

Hive QA commented on HIVE-7816:
---



{color:red}Overall{color}: -1 at least one tests failed

Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12687107/HIVE-7816.2-spark.patch

{color:red}ERROR:{color} -1 due to 3 failed/errored test(s), 7237 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_sample_islocalmode_hook
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_optimize_nullscan
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_vector_cast_constant
{noformat}

Test results: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/541/testReport
Console output: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/541/console
Test logs: 
http://ec2-50-18-27-0.us-west-1.compute.amazonaws.com/logs/PreCommit-HIVE-SPARK-Build-541/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 3 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12687107 - PreCommit-HIVE-SPARK-Build

 Enable map-join tests which Tez executes [Spark Branch]
 ---

 Key: HIVE-7816
 URL: https://issues.apache.org/jira/browse/HIVE-7816
 Project: Hive
  Issue Type: Sub-task
  Components: Spark
Reporter: Brock Noland
Assignee: Rui Li
 Attachments: HIVE-7816.1-spark.patch, HIVE-7816.2-spark.patch


  
 {noformat}
   auto_join0.q,\
   auto_join1.q,\
   cross_join.q,\
   cross_product_check_1.q,\
   cross_product_check_2.q,\
 {noformat}
 {noformat}
 filter_join_breaktask.q,\
 filter_join_breaktask2.q
 {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-7816) Enable map-join tests which Tez executes [Spark Branch]

2014-12-14 Thread Rui Li (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14246268#comment-14246268
 ] 

Rui Li commented on HIVE-7816:
--

[~xuefuz] - shall we wait a little bit? That's just a couple of more lines of 
code. I'm running tests on my machine.

 Enable map-join tests which Tez executes [Spark Branch]
 ---

 Key: HIVE-7816
 URL: https://issues.apache.org/jira/browse/HIVE-7816
 Project: Hive
  Issue Type: Sub-task
  Components: Spark
Reporter: Brock Noland
Assignee: Rui Li
 Fix For: spark-branch

 Attachments: HIVE-7816.1-spark.patch, HIVE-7816.2-spark.patch


  
 {noformat}
   auto_join0.q,\
   auto_join1.q,\
   cross_join.q,\
   cross_product_check_1.q,\
   cross_product_check_2.q,\
 {noformat}
 {noformat}
 filter_join_breaktask.q,\
 filter_join_breaktask2.q
 {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-7816) Enable map-join tests which Tez executes [Spark Branch]

2014-12-14 Thread Xuefu Zhang (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14246271#comment-14246271
 ] 

Xuefu Zhang commented on HIVE-7816:
---

Sorry, Rui. Now we have to do it as a followup. :(

 Enable map-join tests which Tez executes [Spark Branch]
 ---

 Key: HIVE-7816
 URL: https://issues.apache.org/jira/browse/HIVE-7816
 Project: Hive
  Issue Type: Sub-task
  Components: Spark
Reporter: Brock Noland
Assignee: Rui Li
 Fix For: spark-branch

 Attachments: HIVE-7816.1-spark.patch, HIVE-7816.2-spark.patch


  
 {noformat}
   auto_join0.q,\
   auto_join1.q,\
   cross_join.q,\
   cross_product_check_1.q,\
   cross_product_check_2.q,\
 {noformat}
 {noformat}
 filter_join_breaktask.q,\
 filter_join_breaktask2.q
 {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-7816) Enable map-join tests which Tez executes [Spark Branch]

2014-12-14 Thread Rui Li (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14246273#comment-14246273
 ] 

Rui Li commented on HIVE-7816:
--

That's OK. No worries, I'll take care of that.

 Enable map-join tests which Tez executes [Spark Branch]
 ---

 Key: HIVE-7816
 URL: https://issues.apache.org/jira/browse/HIVE-7816
 Project: Hive
  Issue Type: Sub-task
  Components: Spark
Reporter: Brock Noland
Assignee: Rui Li
 Fix For: spark-branch

 Attachments: HIVE-7816.1-spark.patch, HIVE-7816.2-spark.patch


  
 {noformat}
   auto_join0.q,\
   auto_join1.q,\
   cross_join.q,\
   cross_product_check_1.q,\
   cross_product_check_2.q,\
 {noformat}
 {noformat}
 filter_join_breaktask.q,\
 filter_join_breaktask2.q
 {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-7816) Enable map-join tests which Tez executes [Spark Branch]

2014-12-13 Thread Hive QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14245858#comment-14245858
 ] 

Hive QA commented on HIVE-7816:
---



{color:red}Overall{color}: -1 at least one tests failed

Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12687094/HIVE-7816.1-spark.patch

{color:red}ERROR:{color} -1 due to 22 failed/errored test(s), 7237 tests 
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_sample_islocalmode_hook
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_optimize_nullscan
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_vector_cast_constant
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_auto_join0
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_auto_join23
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_auto_join_filters
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_auto_join_nulls
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_auto_sortmerge_join_12
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_cross_join
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_ctas
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_join0
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_join23
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_join_alt_syntax
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_join_cond_pushdown_1
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_join_cond_pushdown_3
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_join_cond_pushdown_unqual1
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_join_cond_pushdown_unqual3
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_multi_insert_lateral_view
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_optimize_nullscan
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_parallel_join0
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_ppd_join5
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_subquery_multiinsert
{noformat}

Test results: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/540/testReport
Console output: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/540/console
Test logs: 
http://ec2-50-18-27-0.us-west-1.compute.amazonaws.com/logs/PreCommit-HIVE-SPARK-Build-540/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 22 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12687094 - PreCommit-HIVE-SPARK-Build

 Enable map-join tests which Tez executes [Spark Branch]
 ---

 Key: HIVE-7816
 URL: https://issues.apache.org/jira/browse/HIVE-7816
 Project: Hive
  Issue Type: Sub-task
  Components: Spark
Reporter: Brock Noland
Assignee: Rui Li
 Attachments: HIVE-7816.1-spark.patch


  
 {noformat}
   auto_join0.q,\
   auto_join1.q,\
   cross_join.q,\
   cross_product_check_1.q,\
   cross_product_check_2.q,\
 {noformat}
 {noformat}
 filter_join_breaktask.q,\
 filter_join_breaktask2.q
 {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-7816) Enable map-join tests which Tez executes [Spark Branch]

2014-12-12 Thread Rui Li (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14243892#comment-14243892
 ] 

Rui Li commented on HIVE-7816:
--

We already have golden files for {{filter_join_breaktask.q}} and 
{{filter_join_breaktask2.q}}, but they're not added to 
{{testconfiguration.properties}}.
We actually haven't implemented cross product check for spark, so the test 
output is not correct. I'll look into this.

 Enable map-join tests which Tez executes [Spark Branch]
 ---

 Key: HIVE-7816
 URL: https://issues.apache.org/jira/browse/HIVE-7816
 Project: Hive
  Issue Type: Sub-task
  Components: Spark
Reporter: Brock Noland
Assignee: Rui Li

  
 {noformat}
   auto_join0.q,\
   auto_join1.q,\
   cross_join.q,\
   cross_product_check_1.q,\
   cross_product_check_2.q,\
 {noformat}
 {noformat}
 filter_join_breaktask.q,\
 filter_join_breaktask2.q
 {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-7816) Enable map-join tests which Tez executes [Spark Branch]

2014-12-12 Thread Xuefu Zhang (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14244704#comment-14244704
 ] 

Xuefu Zhang commented on HIVE-7816:
---

Patch looks good. One question though, do we need to handle conditional task, 
since we added it for skew join?

 Enable map-join tests which Tez executes [Spark Branch]
 ---

 Key: HIVE-7816
 URL: https://issues.apache.org/jira/browse/HIVE-7816
 Project: Hive
  Issue Type: Sub-task
  Components: Spark
Reporter: Brock Noland
Assignee: Rui Li
 Attachments: HIVE-7816.1-spark.patch, HIVE-7816.1-spark.patch


  
 {noformat}
   auto_join0.q,\
   auto_join1.q,\
   cross_join.q,\
   cross_product_check_1.q,\
   cross_product_check_2.q,\
 {noformat}
 {noformat}
 filter_join_breaktask.q,\
 filter_join_breaktask2.q
 {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-7816) Enable map-join tests which Tez executes [Spark Branch]

2014-12-12 Thread Hive QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14244909#comment-14244909
 ] 

Hive QA commented on HIVE-7816:
---



{color:red}Overall{color}: -1 at least one tests failed

Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12686930/HIVE-7816.1-spark.patch

{color:red}ERROR:{color} -1 due to 25 failed/errored test(s), 7265 tests 
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_sample_islocalmode_hook
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_optimize_nullscan
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_vector_cast_constant
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_auto_join0
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_auto_join23
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_auto_join_filters
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_auto_join_nulls
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_auto_sortmerge_join_12
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_cross_join
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_join0
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_join23
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_join_alt_syntax
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_join_cond_pushdown_1
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_join_cond_pushdown_3
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_join_cond_pushdown_unqual1
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_join_cond_pushdown_unqual3
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_join_filters
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_join_map_ppr
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_join_nulls
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_optimize_nullscan
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_parallel_join0
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_ppd_join4
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_ppd_join5
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_smb_mapjoin_25
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_subquery_multiinsert
{noformat}

Test results: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/528/testReport
Console output: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/528/console
Test logs: 
http://ec2-50-18-27-0.us-west-1.compute.amazonaws.com/logs/PreCommit-HIVE-SPARK-Build-528/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 25 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12686930 - PreCommit-HIVE-SPARK-Build

 Enable map-join tests which Tez executes [Spark Branch]
 ---

 Key: HIVE-7816
 URL: https://issues.apache.org/jira/browse/HIVE-7816
 Project: Hive
  Issue Type: Sub-task
  Components: Spark
Reporter: Brock Noland
Assignee: Rui Li
 Attachments: HIVE-7816.1-spark.patch, HIVE-7816.1-spark.patch


  
 {noformat}
   auto_join0.q,\
   auto_join1.q,\
   cross_join.q,\
   cross_product_check_1.q,\
   cross_product_check_2.q,\
 {noformat}
 {noformat}
 filter_join_breaktask.q,\
 filter_join_breaktask2.q
 {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-7816) Enable map-join tests which Tez executes [Spark Branch]

2014-12-11 Thread Xuefu Zhang (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242744#comment-14242744
 ] 

Xuefu Zhang commented on HIVE-7816:
---

It seems that not all test in the list are added for Spark yet. [~lirui], could 
you help take a look? Thanks.

 Enable map-join tests which Tez executes [Spark Branch]
 ---

 Key: HIVE-7816
 URL: https://issues.apache.org/jira/browse/HIVE-7816
 Project: Hive
  Issue Type: Sub-task
  Components: Spark
Reporter: Brock Noland

  
 {noformat}
   auto_join0.q,\
   auto_join1.q,\
   cross_join.q,\
   cross_product_check_1.q,\
   cross_product_check_2.q,\
 {noformat}
 {noformat}
 filter_join_breaktask.q,\
 filter_join_breaktask2.q
 {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-7816) Enable map-join tests which Tez executes [Spark Branch]

2014-12-11 Thread Rui Li (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14243589#comment-14243589
 ] 

Rui Li commented on HIVE-7816:
--

OK I'm on it.

 Enable map-join tests which Tez executes [Spark Branch]
 ---

 Key: HIVE-7816
 URL: https://issues.apache.org/jira/browse/HIVE-7816
 Project: Hive
  Issue Type: Sub-task
  Components: Spark
Reporter: Brock Noland
Assignee: Rui Li

  
 {noformat}
   auto_join0.q,\
   auto_join1.q,\
   cross_join.q,\
   cross_product_check_1.q,\
   cross_product_check_2.q,\
 {noformat}
 {noformat}
 filter_join_breaktask.q,\
 filter_join_breaktask2.q
 {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)