[jira] [Commented] (HIVE-6447) Bucket map joins in hive-tez
[ https://issues.apache.org/jira/browse/HIVE-6447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13977945#comment-13977945 ] Lefty Leverenz commented on HIVE-6447: -- *hive.convert.join.bucket.mapjoin.tez* is documented in the wiki here: * [Configuration Properties -- Tez -- hive.convert.join.bucket.mapjoin.tez |https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-hive.convert.join.bucket.mapjoin.tez] Bucket map joins in hive-tez Key: HIVE-6447 URL: https://issues.apache.org/jira/browse/HIVE-6447 Project: Hive Issue Type: Bug Components: Tez Affects Versions: tez-branch Reporter: Vikram Dixit K Assignee: Vikram Dixit K Fix For: 0.13.0, 0.14.0 Attachments: HIVE-6447.1.patch, HIVE-6447.10.patch, HIVE-6447.11.patch, HIVE-6447.12.patch, HIVE-6447.13.patch, HIVE-6447.2.patch, HIVE-6447.3.patch, HIVE-6447.4.patch, HIVE-6447.5.patch, HIVE-6447.6.patch, HIVE-6447.7.patch, HIVE-6447.8.patch, HIVE-6447.9.patch, HIVE-6447.WIP.patch Support bucket map joins in tez. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HIVE-6447) Bucket map joins in hive-tez
[ https://issues.apache.org/jira/browse/HIVE-6447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13967266#comment-13967266 ] Vikram Dixit K commented on HIVE-6447: -- Hi Chris, I completely cleaned my .m2 and built this and it passes. I think the tez folks fixed this spelling issue in 0.4.0-incubating-SNAPSHOT and beyond. Hive is currently dependent on 0.4.0-incubating only. This works with that version of tez. Thanks Vikram. Bucket map joins in hive-tez Key: HIVE-6447 URL: https://issues.apache.org/jira/browse/HIVE-6447 Project: Hive Issue Type: Bug Components: Tez Affects Versions: tez-branch Reporter: Vikram Dixit K Assignee: Vikram Dixit K Fix For: 0.13.0, 0.14.0 Attachments: HIVE-6447.1.patch, HIVE-6447.10.patch, HIVE-6447.11.patch, HIVE-6447.12.patch, HIVE-6447.13.patch, HIVE-6447.2.patch, HIVE-6447.3.patch, HIVE-6447.4.patch, HIVE-6447.5.patch, HIVE-6447.6.patch, HIVE-6447.7.patch, HIVE-6447.8.patch, HIVE-6447.9.patch, HIVE-6447.WIP.patch Support bucket map joins in tez. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HIVE-6447) Bucket map joins in hive-tez
[ https://issues.apache.org/jira/browse/HIVE-6447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13967268#comment-13967268 ] Vikram Dixit K commented on HIVE-6447: -- Hi Chris, I completely cleaned my .m2 and built this and it passes. I think the tez folks fixed this spelling issue in 0.4.0-incubating-SNAPSHOT and beyond. Hive is currently dependent on 0.4.0-incubating only. This works with that version of tez. Thanks Vikram. -- Nothing better than when appreciated for hard work. -Mark Bucket map joins in hive-tez Key: HIVE-6447 URL: https://issues.apache.org/jira/browse/HIVE-6447 Project: Hive Issue Type: Bug Components: Tez Affects Versions: tez-branch Reporter: Vikram Dixit K Assignee: Vikram Dixit K Fix For: 0.13.0, 0.14.0 Attachments: HIVE-6447.1.patch, HIVE-6447.10.patch, HIVE-6447.11.patch, HIVE-6447.12.patch, HIVE-6447.13.patch, HIVE-6447.2.patch, HIVE-6447.3.patch, HIVE-6447.4.patch, HIVE-6447.5.patch, HIVE-6447.6.patch, HIVE-6447.7.patch, HIVE-6447.8.patch, HIVE-6447.9.patch, HIVE-6447.WIP.patch Support bucket map joins in tez. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HIVE-6447) Bucket map joins in hive-tez
[ https://issues.apache.org/jira/browse/HIVE-6447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13967287#comment-13967287 ] Chris Drome commented on HIVE-6447: --- Thanks for the clarification. We are using a newer version of Tez, which caused the problem. Bucket map joins in hive-tez Key: HIVE-6447 URL: https://issues.apache.org/jira/browse/HIVE-6447 Project: Hive Issue Type: Bug Components: Tez Affects Versions: tez-branch Reporter: Vikram Dixit K Assignee: Vikram Dixit K Fix For: 0.13.0, 0.14.0 Attachments: HIVE-6447.1.patch, HIVE-6447.10.patch, HIVE-6447.11.patch, HIVE-6447.12.patch, HIVE-6447.13.patch, HIVE-6447.2.patch, HIVE-6447.3.patch, HIVE-6447.4.patch, HIVE-6447.5.patch, HIVE-6447.6.patch, HIVE-6447.7.patch, HIVE-6447.8.patch, HIVE-6447.9.patch, HIVE-6447.WIP.patch Support bucket map joins in tez. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HIVE-6447) Bucket map joins in hive-tez
[ https://issues.apache.org/jira/browse/HIVE-6447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13959765#comment-13959765 ] Vikram Dixit K commented on HIVE-6447: -- Hi Lefty, This would be the change to the template file: {code} property namehive.convert.join.bucket.mapjoin.tez/name valuefalse/value descriptionWhether joins can be automatically converted to bucket map joins in hive when tez is used as the execution engine./description /property {code} Thanks Vikram. Bucket map joins in hive-tez Key: HIVE-6447 URL: https://issues.apache.org/jira/browse/HIVE-6447 Project: Hive Issue Type: Bug Components: Tez Affects Versions: tez-branch Reporter: Vikram Dixit K Assignee: Vikram Dixit K Fix For: 0.13.0, 0.14.0 Attachments: HIVE-6447.1.patch, HIVE-6447.10.patch, HIVE-6447.11.patch, HIVE-6447.12.patch, HIVE-6447.13.patch, HIVE-6447.2.patch, HIVE-6447.3.patch, HIVE-6447.4.patch, HIVE-6447.5.patch, HIVE-6447.6.patch, HIVE-6447.7.patch, HIVE-6447.8.patch, HIVE-6447.9.patch, HIVE-6447.WIP.patch Support bucket map joins in tez. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HIVE-6447) Bucket map joins in hive-tez
[ https://issues.apache.org/jira/browse/HIVE-6447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13950427#comment-13950427 ] Vikram Dixit K commented on HIVE-6447: -- Committed to trunk and branch-0.13. Thanks for the reviews [~sseth], [~hagleitn], [~rhbutani]. Thanks [~alangates] [~thejas] for the test runs. Bucket map joins in hive-tez Key: HIVE-6447 URL: https://issues.apache.org/jira/browse/HIVE-6447 Project: Hive Issue Type: Bug Components: Tez Affects Versions: tez-branch Reporter: Vikram Dixit K Assignee: Vikram Dixit K Fix For: 0.13.0, 0.14.0 Attachments: HIVE-6447.1.patch, HIVE-6447.10.patch, HIVE-6447.11.patch, HIVE-6447.12.patch, HIVE-6447.13.patch, HIVE-6447.2.patch, HIVE-6447.3.patch, HIVE-6447.4.patch, HIVE-6447.5.patch, HIVE-6447.6.patch, HIVE-6447.7.patch, HIVE-6447.8.patch, HIVE-6447.9.patch, HIVE-6447.WIP.patch Support bucket map joins in tez. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HIVE-6447) Bucket map joins in hive-tez
[ https://issues.apache.org/jira/browse/HIVE-6447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13951707#comment-13951707 ] Lefty Leverenz commented on HIVE-6447: -- This adds *hive.convert.join.bucket.mapjoin.tez* to HiveConf.java without a description. If you write a release note and include the description, I'll put it in the wiki and make sure it's added to the new HiveConf.java hive-default.xml.template via HIVE-6586 after HIVE-6037 gets committed. Bucket map joins in hive-tez Key: HIVE-6447 URL: https://issues.apache.org/jira/browse/HIVE-6447 Project: Hive Issue Type: Bug Components: Tez Affects Versions: tez-branch Reporter: Vikram Dixit K Assignee: Vikram Dixit K Fix For: 0.13.0, 0.14.0 Attachments: HIVE-6447.1.patch, HIVE-6447.10.patch, HIVE-6447.11.patch, HIVE-6447.12.patch, HIVE-6447.13.patch, HIVE-6447.2.patch, HIVE-6447.3.patch, HIVE-6447.4.patch, HIVE-6447.5.patch, HIVE-6447.6.patch, HIVE-6447.7.patch, HIVE-6447.8.patch, HIVE-6447.9.patch, HIVE-6447.WIP.patch Support bucket map joins in tez. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HIVE-6447) Bucket map joins in hive-tez
[ https://issues.apache.org/jira/browse/HIVE-6447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13950243#comment-13950243 ] Harish Butani commented on HIVE-6447: - +1 for 0.13 Bucket map joins in hive-tez Key: HIVE-6447 URL: https://issues.apache.org/jira/browse/HIVE-6447 Project: Hive Issue Type: Bug Components: Tez Affects Versions: tez-branch Reporter: Vikram Dixit K Assignee: Vikram Dixit K Attachments: HIVE-6447.1.patch, HIVE-6447.10.patch, HIVE-6447.11.patch, HIVE-6447.12.patch, HIVE-6447.13.patch, HIVE-6447.2.patch, HIVE-6447.3.patch, HIVE-6447.4.patch, HIVE-6447.5.patch, HIVE-6447.6.patch, HIVE-6447.7.patch, HIVE-6447.8.patch, HIVE-6447.9.patch, HIVE-6447.WIP.patch Support bucket map joins in tez. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HIVE-6447) Bucket map joins in hive-tez
[ https://issues.apache.org/jira/browse/HIVE-6447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13950271#comment-13950271 ] Thejas M Nair commented on HIVE-6447: - Ran tests in my setup and the tests passed. Bucket map joins in hive-tez Key: HIVE-6447 URL: https://issues.apache.org/jira/browse/HIVE-6447 Project: Hive Issue Type: Bug Components: Tez Affects Versions: tez-branch Reporter: Vikram Dixit K Assignee: Vikram Dixit K Attachments: HIVE-6447.1.patch, HIVE-6447.10.patch, HIVE-6447.11.patch, HIVE-6447.12.patch, HIVE-6447.13.patch, HIVE-6447.2.patch, HIVE-6447.3.patch, HIVE-6447.4.patch, HIVE-6447.5.patch, HIVE-6447.6.patch, HIVE-6447.7.patch, HIVE-6447.8.patch, HIVE-6447.9.patch, HIVE-6447.WIP.patch Support bucket map joins in tez. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HIVE-6447) Bucket map joins in hive-tez
[ https://issues.apache.org/jira/browse/HIVE-6447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13947588#comment-13947588 ] Alan Gates commented on HIVE-6447: -- Saw following failures when running tests: 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer1 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer10 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer11 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer14 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer15 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer2 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer3 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer4 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer5 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer6 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer7 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer8 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer9 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_innerjoin 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_input20 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_input33 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_insert_into3 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_lateral_view 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_limit_pushdown_negative 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mapreduce1 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mapreduce3 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mapreduce4 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mapreduce5 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mapreduce6 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mapreduce7 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mapreduce8 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_multiMapJoin2 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_multi_insert_gby 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_quotedid_skew 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt1 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt10 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt11 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt12 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt14 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt15 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt16 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt17 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt19 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt2 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt20 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt3 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt4 2014-03-26 02:40:03 WARN PTest:205 -
[jira] [Commented] (HIVE-6447) Bucket map joins in hive-tez
[ https://issues.apache.org/jira/browse/HIVE-6447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13948074#comment-13948074 ] Hive QA commented on HIVE-6447: --- {color:red}Overall{color}: -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12636844/HIVE-6447.10.patch {color:red}ERROR:{color} -1 due to 49 failed/errored test(s), 5457 tests executed *Failed tests:* {noformat} org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer1 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer10 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer11 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer14 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer15 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer2 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer3 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer4 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer5 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer6 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer7 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer8 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer9 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_innerjoin org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_input20 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_input33 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_insert_into3 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_lateral_view org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_limit_pushdown_negative org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mapreduce1 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mapreduce3 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mapreduce4 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mapreduce5 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mapreduce6 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mapreduce7 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mapreduce8 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_multiMapJoin2 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_multi_insert_gby org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_quotedid_skew org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt1 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt10 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt11 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt12 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt14 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt15 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt16 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt17 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt19 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt2 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt20 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt3 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt4 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt5 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt6 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt7 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt8 org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_bucket5 org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_bucketmapjoin6 org.apache.hive.service.cli.thrift.TestThriftHttpCLIService.testExecuteStatementAsync {noformat} Test results: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1965/testReport Console output: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1965/console Messages: {noformat} Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 49 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12636844 Bucket map joins in hive-tez Key: HIVE-6447 URL: https://issues.apache.org/jira/browse/HIVE-6447 Project: Hive Issue Type: Bug Components: Tez Affects Versions: tez-branch Reporter: Vikram Dixit K Assignee: Vikram Dixit K Attachments: HIVE-6447.1.patch, HIVE-6447.10.patch, HIVE-6447.2.patch, HIVE-6447.3.patch,
[jira] [Commented] (HIVE-6447) Bucket map joins in hive-tez
[ https://issues.apache.org/jira/browse/HIVE-6447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13948862#comment-13948862 ] Hive QA commented on HIVE-6447: --- {color:red}Overall{color}: -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12637022/HIVE-6447.12.patch {color:red}ERROR:{color} -1 due to 2 failed/errored test(s), 5491 tests executed *Failed tests:* {noformat} org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_parallel_orderby org.apache.hadoop.hive.cli.TestNegativeMinimrCliDriver.testNegativeCliDriver_mapreduce_stack_trace_hadoop20 {noformat} Test results: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1974/testReport Console output: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1974/console Messages: {noformat} Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 2 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12637022 Bucket map joins in hive-tez Key: HIVE-6447 URL: https://issues.apache.org/jira/browse/HIVE-6447 Project: Hive Issue Type: Bug Components: Tez Affects Versions: tez-branch Reporter: Vikram Dixit K Assignee: Vikram Dixit K Attachments: HIVE-6447.1.patch, HIVE-6447.10.patch, HIVE-6447.11.patch, HIVE-6447.12.patch, HIVE-6447.2.patch, HIVE-6447.3.patch, HIVE-6447.4.patch, HIVE-6447.5.patch, HIVE-6447.6.patch, HIVE-6447.7.patch, HIVE-6447.8.patch, HIVE-6447.9.patch, HIVE-6447.WIP.patch Support bucket map joins in tez. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HIVE-6447) Bucket map joins in hive-tez
[ https://issues.apache.org/jira/browse/HIVE-6447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13948917#comment-13948917 ] Vikram Dixit K commented on HIVE-6447: -- Failures unrelated. They pass locally. Bucket map joins in hive-tez Key: HIVE-6447 URL: https://issues.apache.org/jira/browse/HIVE-6447 Project: Hive Issue Type: Bug Components: Tez Affects Versions: tez-branch Reporter: Vikram Dixit K Assignee: Vikram Dixit K Attachments: HIVE-6447.1.patch, HIVE-6447.10.patch, HIVE-6447.11.patch, HIVE-6447.12.patch, HIVE-6447.2.patch, HIVE-6447.3.patch, HIVE-6447.4.patch, HIVE-6447.5.patch, HIVE-6447.6.patch, HIVE-6447.7.patch, HIVE-6447.8.patch, HIVE-6447.9.patch, HIVE-6447.WIP.patch Support bucket map joins in tez. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HIVE-6447) Bucket map joins in hive-tez
[ https://issues.apache.org/jira/browse/HIVE-6447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13946241#comment-13946241 ] Siddharth Seth commented on HIVE-6447: -- The tez side of things in the CustomEdge and CustomVertex look good. +1. Left some minor comments. Bucket map joins in hive-tez Key: HIVE-6447 URL: https://issues.apache.org/jira/browse/HIVE-6447 Project: Hive Issue Type: Bug Components: Tez Affects Versions: tez-branch Reporter: Vikram Dixit K Assignee: Vikram Dixit K Attachments: HIVE-6447.1.patch, HIVE-6447.2.patch, HIVE-6447.3.patch, HIVE-6447.4.patch, HIVE-6447.5.patch, HIVE-6447.6.patch, HIVE-6447.WIP.patch Support bucket map joins in tez. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HIVE-6447) Bucket map joins in hive-tez
[ https://issues.apache.org/jira/browse/HIVE-6447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13947330#comment-13947330 ] Harish Butani commented on HIVE-6447: - lgtm, +1 for the traits propagation and Join conversion pieces. Bucket map joins in hive-tez Key: HIVE-6447 URL: https://issues.apache.org/jira/browse/HIVE-6447 Project: Hive Issue Type: Bug Components: Tez Affects Versions: tez-branch Reporter: Vikram Dixit K Assignee: Vikram Dixit K Attachments: HIVE-6447.1.patch, HIVE-6447.2.patch, HIVE-6447.3.patch, HIVE-6447.4.patch, HIVE-6447.5.patch, HIVE-6447.6.patch, HIVE-6447.7.patch, HIVE-6447.8.patch, HIVE-6447.9.patch, HIVE-6447.WIP.patch Support bucket map joins in tez. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HIVE-6447) Bucket map joins in hive-tez
[ https://issues.apache.org/jira/browse/HIVE-6447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13944475#comment-13944475 ] Hive QA commented on HIVE-6447: --- {color:green}Overall{color}: +1 all checks pass Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12635732/HIVE-6447.4.patch {color:green}SUCCESS:{color} +1 5440 tests passed Test results: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1921/testReport Console output: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1921/console Messages: {noformat} Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase {noformat} This message is automatically generated. ATTACHMENT ID: 12635732 Bucket map joins in hive-tez Key: HIVE-6447 URL: https://issues.apache.org/jira/browse/HIVE-6447 Project: Hive Issue Type: Bug Components: Tez Affects Versions: tez-branch Reporter: Vikram Dixit K Assignee: Vikram Dixit K Attachments: HIVE-6447.1.patch, HIVE-6447.2.patch, HIVE-6447.3.patch, HIVE-6447.4.patch, HIVE-6447.WIP.patch Support bucket map joins in tez. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HIVE-6447) Bucket map joins in hive-tez
[ https://issues.apache.org/jira/browse/HIVE-6447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13936125#comment-13936125 ] Hive QA commented on HIVE-6447: --- {color:red}Overall{color}: -1 no tests executed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12634499/HIVE-6447.3.patch Test results: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1823/testReport Console output: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1823/console Messages: {noformat} Executing org.apache.hive.ptest.execution.PrepPhase Tests exited with: NonZeroExitCodeException Command 'bash /data/hive-ptest/working/scratch/source-prep.sh' failed with exit status 1 and output '+ [[ -n '' ]] + export 'ANT_OPTS=-Xmx1g -XX:MaxPermSize=256m ' + ANT_OPTS='-Xmx1g -XX:MaxPermSize=256m ' + export 'M2_OPTS=-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost -Dhttp.proxyPort=3128' + M2_OPTS='-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost -Dhttp.proxyPort=3128' + cd /data/hive-ptest/working/ + tee /data/hive-ptest/logs/PreCommit-HIVE-Build-1823/source-prep.txt + [[ false == \t\r\u\e ]] + mkdir -p maven ivy + [[ svn = \s\v\n ]] + [[ -n '' ]] + [[ -d apache-svn-trunk-source ]] + [[ ! -d apache-svn-trunk-source/.svn ]] + [[ ! -d apache-svn-trunk-source ]] + cd apache-svn-trunk-source + svn revert -R . ++ egrep -v '^X|^Performing status on external' ++ awk '{print $2}' ++ svn status --no-ignore + rm -rf + svn update Fetching external item into 'hcatalog/src/test/e2e/harness' External at revision 1577820. At revision 1577820. + patchCommandPath=/data/hive-ptest/working/scratch/smart-apply-patch.sh + patchFilePath=/data/hive-ptest/working/scratch/build.patch + [[ -f /data/hive-ptest/working/scratch/build.patch ]] + chmod +x /data/hive-ptest/working/scratch/smart-apply-patch.sh + /data/hive-ptest/working/scratch/smart-apply-patch.sh /data/hive-ptest/working/scratch/build.patch The patch does not appear to apply with p0, p1, or p2 + exit 1 ' {noformat} This message is automatically generated. ATTACHMENT ID: 12634499 Bucket map joins in hive-tez Key: HIVE-6447 URL: https://issues.apache.org/jira/browse/HIVE-6447 Project: Hive Issue Type: Bug Components: Tez Affects Versions: tez-branch Reporter: Vikram Dixit K Assignee: Vikram Dixit K Attachments: HIVE-6447.1.patch, HIVE-6447.2.patch, HIVE-6447.3.patch, HIVE-6447.WIP.patch Support bucket map joins in tez. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HIVE-6447) Bucket map joins in hive-tez
[ https://issues.apache.org/jira/browse/HIVE-6447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13932388#comment-13932388 ] Hive QA commented on HIVE-6447: --- {color:red}Overall{color}: -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12633855/HIVE-6447.2.patch {color:red}ERROR:{color} -1 due to 7 failed/errored test(s), 5387 tests executed *Failed tests:* {noformat} org.apache.hadoop.hive.ql.exec.tez.TestTezTask.testBuildDag org.apache.hadoop.hive.ql.exec.tez.TestTezTask.testClose org.apache.hadoop.hive.ql.exec.tez.TestTezTask.testEmptyWork org.apache.hadoop.hive.ql.exec.tez.TestTezTask.testSubmit org.apache.hadoop.hive.ql.plan.TestTezWork.testBroadcastConnect org.apache.hadoop.hive.ql.plan.TestTezWork.testConnect org.apache.hive.service.cli.TestEmbeddedThriftBinaryCLIService.testExecuteStatementAsync {noformat} Test results: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1714/testReport Console output: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1714/console Messages: {noformat} Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 7 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12633855 Bucket map joins in hive-tez Key: HIVE-6447 URL: https://issues.apache.org/jira/browse/HIVE-6447 Project: Hive Issue Type: Bug Components: Tez Affects Versions: tez-branch Reporter: Vikram Dixit K Assignee: Vikram Dixit K Attachments: HIVE-6447.1.patch, HIVE-6447.2.patch, HIVE-6447.WIP.patch Support bucket map joins in tez. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HIVE-6447) Bucket map joins in hive-tez
[ https://issues.apache.org/jira/browse/HIVE-6447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13903146#comment-13903146 ] Vikram Dixit K commented on HIVE-6447: -- Cannot create a review request at this time for some reason. Will try again and update the jira. Bucket map joins in hive-tez Key: HIVE-6447 URL: https://issues.apache.org/jira/browse/HIVE-6447 Project: Hive Issue Type: Bug Components: Tez Affects Versions: tez-branch Reporter: Vikram Dixit K Assignee: Vikram Dixit K Attachments: HIVE-6447.WIP.patch Support bucket map joins in tez. -- This message was sent by Atlassian JIRA (v6.1.5#6160)