[jira] [Commented] (HIVE-7816) Enable map-join tests which Tez executes [Spark Branch]
[ https://issues.apache.org/jira/browse/HIVE-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14245876#comment-14245876 ] Hive QA commented on HIVE-7816: --- {color:red}Overall{color}: -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12687107/HIVE-7816.2-spark.patch {color:red}ERROR:{color} -1 due to 3 failed/errored test(s), 7237 tests executed *Failed tests:* {noformat} org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_sample_islocalmode_hook org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_optimize_nullscan org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_vector_cast_constant {noformat} Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/541/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/541/console Test logs: http://ec2-50-18-27-0.us-west-1.compute.amazonaws.com/logs/PreCommit-HIVE-SPARK-Build-541/ Messages: {noformat} Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 3 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12687107 - PreCommit-HIVE-SPARK-Build Enable map-join tests which Tez executes [Spark Branch] --- Key: HIVE-7816 URL: https://issues.apache.org/jira/browse/HIVE-7816 Project: Hive Issue Type: Sub-task Components: Spark Reporter: Brock Noland Assignee: Rui Li Attachments: HIVE-7816.1-spark.patch, HIVE-7816.2-spark.patch {noformat} auto_join0.q,\ auto_join1.q,\ cross_join.q,\ cross_product_check_1.q,\ cross_product_check_2.q,\ {noformat} {noformat} filter_join_breaktask.q,\ filter_join_breaktask2.q {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-7816) Enable map-join tests which Tez executes [Spark Branch]
[ https://issues.apache.org/jira/browse/HIVE-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14246268#comment-14246268 ] Rui Li commented on HIVE-7816: -- [~xuefuz] - shall we wait a little bit? That's just a couple of more lines of code. I'm running tests on my machine. Enable map-join tests which Tez executes [Spark Branch] --- Key: HIVE-7816 URL: https://issues.apache.org/jira/browse/HIVE-7816 Project: Hive Issue Type: Sub-task Components: Spark Reporter: Brock Noland Assignee: Rui Li Fix For: spark-branch Attachments: HIVE-7816.1-spark.patch, HIVE-7816.2-spark.patch {noformat} auto_join0.q,\ auto_join1.q,\ cross_join.q,\ cross_product_check_1.q,\ cross_product_check_2.q,\ {noformat} {noformat} filter_join_breaktask.q,\ filter_join_breaktask2.q {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-7816) Enable map-join tests which Tez executes [Spark Branch]
[ https://issues.apache.org/jira/browse/HIVE-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14246271#comment-14246271 ] Xuefu Zhang commented on HIVE-7816: --- Sorry, Rui. Now we have to do it as a followup. :( Enable map-join tests which Tez executes [Spark Branch] --- Key: HIVE-7816 URL: https://issues.apache.org/jira/browse/HIVE-7816 Project: Hive Issue Type: Sub-task Components: Spark Reporter: Brock Noland Assignee: Rui Li Fix For: spark-branch Attachments: HIVE-7816.1-spark.patch, HIVE-7816.2-spark.patch {noformat} auto_join0.q,\ auto_join1.q,\ cross_join.q,\ cross_product_check_1.q,\ cross_product_check_2.q,\ {noformat} {noformat} filter_join_breaktask.q,\ filter_join_breaktask2.q {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-7816) Enable map-join tests which Tez executes [Spark Branch]
[ https://issues.apache.org/jira/browse/HIVE-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14246273#comment-14246273 ] Rui Li commented on HIVE-7816: -- That's OK. No worries, I'll take care of that. Enable map-join tests which Tez executes [Spark Branch] --- Key: HIVE-7816 URL: https://issues.apache.org/jira/browse/HIVE-7816 Project: Hive Issue Type: Sub-task Components: Spark Reporter: Brock Noland Assignee: Rui Li Fix For: spark-branch Attachments: HIVE-7816.1-spark.patch, HIVE-7816.2-spark.patch {noformat} auto_join0.q,\ auto_join1.q,\ cross_join.q,\ cross_product_check_1.q,\ cross_product_check_2.q,\ {noformat} {noformat} filter_join_breaktask.q,\ filter_join_breaktask2.q {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-7816) Enable map-join tests which Tez executes [Spark Branch]
[ https://issues.apache.org/jira/browse/HIVE-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14245858#comment-14245858 ] Hive QA commented on HIVE-7816: --- {color:red}Overall{color}: -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12687094/HIVE-7816.1-spark.patch {color:red}ERROR:{color} -1 due to 22 failed/errored test(s), 7237 tests executed *Failed tests:* {noformat} org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_sample_islocalmode_hook org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_optimize_nullscan org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_vector_cast_constant org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_auto_join0 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_auto_join23 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_auto_join_filters org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_auto_join_nulls org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_auto_sortmerge_join_12 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_cross_join org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_ctas org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_join0 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_join23 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_join_alt_syntax org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_join_cond_pushdown_1 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_join_cond_pushdown_3 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_join_cond_pushdown_unqual1 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_join_cond_pushdown_unqual3 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_multi_insert_lateral_view org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_optimize_nullscan org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_parallel_join0 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_ppd_join5 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_subquery_multiinsert {noformat} Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/540/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/540/console Test logs: http://ec2-50-18-27-0.us-west-1.compute.amazonaws.com/logs/PreCommit-HIVE-SPARK-Build-540/ Messages: {noformat} Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 22 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12687094 - PreCommit-HIVE-SPARK-Build Enable map-join tests which Tez executes [Spark Branch] --- Key: HIVE-7816 URL: https://issues.apache.org/jira/browse/HIVE-7816 Project: Hive Issue Type: Sub-task Components: Spark Reporter: Brock Noland Assignee: Rui Li Attachments: HIVE-7816.1-spark.patch {noformat} auto_join0.q,\ auto_join1.q,\ cross_join.q,\ cross_product_check_1.q,\ cross_product_check_2.q,\ {noformat} {noformat} filter_join_breaktask.q,\ filter_join_breaktask2.q {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-7816) Enable map-join tests which Tez executes [Spark Branch]
[ https://issues.apache.org/jira/browse/HIVE-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14243892#comment-14243892 ] Rui Li commented on HIVE-7816: -- We already have golden files for {{filter_join_breaktask.q}} and {{filter_join_breaktask2.q}}, but they're not added to {{testconfiguration.properties}}. We actually haven't implemented cross product check for spark, so the test output is not correct. I'll look into this. Enable map-join tests which Tez executes [Spark Branch] --- Key: HIVE-7816 URL: https://issues.apache.org/jira/browse/HIVE-7816 Project: Hive Issue Type: Sub-task Components: Spark Reporter: Brock Noland Assignee: Rui Li {noformat} auto_join0.q,\ auto_join1.q,\ cross_join.q,\ cross_product_check_1.q,\ cross_product_check_2.q,\ {noformat} {noformat} filter_join_breaktask.q,\ filter_join_breaktask2.q {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-7816) Enable map-join tests which Tez executes [Spark Branch]
[ https://issues.apache.org/jira/browse/HIVE-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14244704#comment-14244704 ] Xuefu Zhang commented on HIVE-7816: --- Patch looks good. One question though, do we need to handle conditional task, since we added it for skew join? Enable map-join tests which Tez executes [Spark Branch] --- Key: HIVE-7816 URL: https://issues.apache.org/jira/browse/HIVE-7816 Project: Hive Issue Type: Sub-task Components: Spark Reporter: Brock Noland Assignee: Rui Li Attachments: HIVE-7816.1-spark.patch, HIVE-7816.1-spark.patch {noformat} auto_join0.q,\ auto_join1.q,\ cross_join.q,\ cross_product_check_1.q,\ cross_product_check_2.q,\ {noformat} {noformat} filter_join_breaktask.q,\ filter_join_breaktask2.q {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-7816) Enable map-join tests which Tez executes [Spark Branch]
[ https://issues.apache.org/jira/browse/HIVE-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14244909#comment-14244909 ] Hive QA commented on HIVE-7816: --- {color:red}Overall{color}: -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12686930/HIVE-7816.1-spark.patch {color:red}ERROR:{color} -1 due to 25 failed/errored test(s), 7265 tests executed *Failed tests:* {noformat} org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_sample_islocalmode_hook org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_optimize_nullscan org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_vector_cast_constant org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_auto_join0 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_auto_join23 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_auto_join_filters org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_auto_join_nulls org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_auto_sortmerge_join_12 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_cross_join org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_join0 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_join23 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_join_alt_syntax org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_join_cond_pushdown_1 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_join_cond_pushdown_3 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_join_cond_pushdown_unqual1 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_join_cond_pushdown_unqual3 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_join_filters org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_join_map_ppr org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_join_nulls org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_optimize_nullscan org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_parallel_join0 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_ppd_join4 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_ppd_join5 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_smb_mapjoin_25 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_subquery_multiinsert {noformat} Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/528/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/528/console Test logs: http://ec2-50-18-27-0.us-west-1.compute.amazonaws.com/logs/PreCommit-HIVE-SPARK-Build-528/ Messages: {noformat} Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 25 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12686930 - PreCommit-HIVE-SPARK-Build Enable map-join tests which Tez executes [Spark Branch] --- Key: HIVE-7816 URL: https://issues.apache.org/jira/browse/HIVE-7816 Project: Hive Issue Type: Sub-task Components: Spark Reporter: Brock Noland Assignee: Rui Li Attachments: HIVE-7816.1-spark.patch, HIVE-7816.1-spark.patch {noformat} auto_join0.q,\ auto_join1.q,\ cross_join.q,\ cross_product_check_1.q,\ cross_product_check_2.q,\ {noformat} {noformat} filter_join_breaktask.q,\ filter_join_breaktask2.q {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-7816) Enable map-join tests which Tez executes [Spark Branch]
[ https://issues.apache.org/jira/browse/HIVE-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242744#comment-14242744 ] Xuefu Zhang commented on HIVE-7816: --- It seems that not all test in the list are added for Spark yet. [~lirui], could you help take a look? Thanks. Enable map-join tests which Tez executes [Spark Branch] --- Key: HIVE-7816 URL: https://issues.apache.org/jira/browse/HIVE-7816 Project: Hive Issue Type: Sub-task Components: Spark Reporter: Brock Noland {noformat} auto_join0.q,\ auto_join1.q,\ cross_join.q,\ cross_product_check_1.q,\ cross_product_check_2.q,\ {noformat} {noformat} filter_join_breaktask.q,\ filter_join_breaktask2.q {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-7816) Enable map-join tests which Tez executes [Spark Branch]
[ https://issues.apache.org/jira/browse/HIVE-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14243589#comment-14243589 ] Rui Li commented on HIVE-7816: -- OK I'm on it. Enable map-join tests which Tez executes [Spark Branch] --- Key: HIVE-7816 URL: https://issues.apache.org/jira/browse/HIVE-7816 Project: Hive Issue Type: Sub-task Components: Spark Reporter: Brock Noland Assignee: Rui Li {noformat} auto_join0.q,\ auto_join1.q,\ cross_join.q,\ cross_product_check_1.q,\ cross_product_check_2.q,\ {noformat} {noformat} filter_join_breaktask.q,\ filter_join_breaktask2.q {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)