[jira] [Commented] (HIVE-16421) Runtime filtering breaks user-level explain
[
https://issues.apache.org/jira/browse/HIVE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15980237#comment-15980237
]
Hive QA commented on HIVE-16421:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12864657/HIVE-16421.02.patch
{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 2 failed/errored test(s), 10627 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestAccumuloCliDriver.testCliDriver[accumulo_index]
(batchId=225)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[vector_if_expr]
(batchId=143)
{noformat}
Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/4851/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/4851/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-4851/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 2 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12864657 - PreCommit-HIVE-Build
> Runtime filtering breaks user-level explain
> ---
>
> Key: HIVE-16421
> URL: https://issues.apache.org/jira/browse/HIVE-16421
> Project: Hive
> Issue Type: Bug
>Reporter: Pengcheng Xiong
>Assignee: Pengcheng Xiong
> Attachments: HIVE-16421.01.patch, HIVE-16421.02.patch
>
>
> Query:
> {noformat}
> SELECT LAG(COALESCE(t2.int_col_14, t1.int_col_80),22) OVER (ORDER BY
> t1.tinyint_col_52 DESC) AS int_col FROM table_6 t1 INNER JOIN table_14 t2 ON
> ((t2.decimal0101_col_55) = (t1.decimal0101_col_9));
> {noformat}
> Without runtime filtering
> {noformat}
> +-+--+
> |
> Explain
> |
> +-+--+
> | Plan not optimized by CBO.
>
> |
> |
>
> |
> | Vertex dependency in root stage
>
> |
> | Map 1 <- Map 3 (BROADCAST_EDGE)
>
> |
> | Reducer 2 <- Map 1 (SIMPLE_EDGE)
>
> |
> |
>
> |
> | Stage-0
>
> |
> |Fetch Operator
>
> |
> | limit:-1
>
> |
> | Stage-1
>
[jira] [Commented] (HIVE-16421) Runtime filtering breaks user-level explain
[
https://issues.apache.org/jira/browse/HIVE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975639#comment-15975639
]
Ashutosh Chauhan commented on HIVE-16421:
-
ok.. +1
> Runtime filtering breaks user-level explain
> ---
>
> Key: HIVE-16421
> URL: https://issues.apache.org/jira/browse/HIVE-16421
> Project: Hive
> Issue Type: Bug
>Reporter: Pengcheng Xiong
>Assignee: Pengcheng Xiong
> Attachments: HIVE-16421.01.patch, HIVE-16421.02.patch
>
>
> Query:
> {noformat}
> SELECT LAG(COALESCE(t2.int_col_14, t1.int_col_80),22) OVER (ORDER BY
> t1.tinyint_col_52 DESC) AS int_col FROM table_6 t1 INNER JOIN table_14 t2 ON
> ((t2.decimal0101_col_55) = (t1.decimal0101_col_9));
> {noformat}
> Without runtime filtering
> {noformat}
> +-+--+
> |
> Explain
> |
> +-+--+
> | Plan not optimized by CBO.
>
> |
> |
>
> |
> | Vertex dependency in root stage
>
> |
> | Map 1 <- Map 3 (BROADCAST_EDGE)
>
> |
> | Reducer 2 <- Map 1 (SIMPLE_EDGE)
>
> |
> |
>
> |
> | Stage-0
>
> |
> |Fetch Operator
>
> |
> | limit:-1
>
> |
> | Stage-1
>
> |
> | Reducer 2
>
> |
> | File Output Operator [FS_364]
>
> |
> | compressed:false
>
> |
> | Statistics:Num rows: 74781721 Data size: 299126884 Basic stats:
> COMPLETE Column stats: COMPLETE
> |
> | table:{"input
> format:":"org.apache.hadoop.mapred.TextInputFormat","output
>
[jira] [Commented] (HIVE-16421) Runtime filtering breaks user-level explain
[
https://issues.apache.org/jira/browse/HIVE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975574#comment-15975574
]
Pengcheng Xiong commented on HIVE-16421:
[~ashutoshc], this is for userlevel explain only. I will open another jira for
explain formatted. thanks.
> Runtime filtering breaks user-level explain
> ---
>
> Key: HIVE-16421
> URL: https://issues.apache.org/jira/browse/HIVE-16421
> Project: Hive
> Issue Type: Bug
>Reporter: Pengcheng Xiong
>Assignee: Pengcheng Xiong
> Attachments: HIVE-16421.01.patch, HIVE-16421.02.patch
>
>
> Query:
> {noformat}
> SELECT LAG(COALESCE(t2.int_col_14, t1.int_col_80),22) OVER (ORDER BY
> t1.tinyint_col_52 DESC) AS int_col FROM table_6 t1 INNER JOIN table_14 t2 ON
> ((t2.decimal0101_col_55) = (t1.decimal0101_col_9));
> {noformat}
> Without runtime filtering
> {noformat}
> +-+--+
> |
> Explain
> |
> +-+--+
> | Plan not optimized by CBO.
>
> |
> |
>
> |
> | Vertex dependency in root stage
>
> |
> | Map 1 <- Map 3 (BROADCAST_EDGE)
>
> |
> | Reducer 2 <- Map 1 (SIMPLE_EDGE)
>
> |
> |
>
> |
> | Stage-0
>
> |
> |Fetch Operator
>
> |
> | limit:-1
>
> |
> | Stage-1
>
> |
> | Reducer 2
>
> |
> | File Output Operator [FS_364]
>
> |
> | compressed:false
>
> |
> | Statistics:Num rows: 74781721 Data size: 299126884 Basic stats:
> COMPLETE Column stats: COMPLETE
> |
> |
[jira] [Commented] (HIVE-16421) Runtime filtering breaks user-level explain
[
https://issues.apache.org/jira/browse/HIVE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975464#comment-15975464
]
Ashutosh Chauhan commented on HIVE-16421:
-
Can you also add explain formatted in test cases?
> Runtime filtering breaks user-level explain
> ---
>
> Key: HIVE-16421
> URL: https://issues.apache.org/jira/browse/HIVE-16421
> Project: Hive
> Issue Type: Bug
>Reporter: Pengcheng Xiong
>Assignee: Pengcheng Xiong
> Attachments: HIVE-16421.01.patch
>
>
> Query:
> {noformat}
> SELECT LAG(COALESCE(t2.int_col_14, t1.int_col_80),22) OVER (ORDER BY
> t1.tinyint_col_52 DESC) AS int_col FROM table_6 t1 INNER JOIN table_14 t2 ON
> ((t2.decimal0101_col_55) = (t1.decimal0101_col_9));
> {noformat}
> Without runtime filtering
> {noformat}
> +-+--+
> |
> Explain
> |
> +-+--+
> | Plan not optimized by CBO.
>
> |
> |
>
> |
> | Vertex dependency in root stage
>
> |
> | Map 1 <- Map 3 (BROADCAST_EDGE)
>
> |
> | Reducer 2 <- Map 1 (SIMPLE_EDGE)
>
> |
> |
>
> |
> | Stage-0
>
> |
> |Fetch Operator
>
> |
> | limit:-1
>
> |
> | Stage-1
>
> |
> | Reducer 2
>
> |
> | File Output Operator [FS_364]
>
> |
> | compressed:false
>
> |
> | Statistics:Num rows: 74781721 Data size: 299126884 Basic stats:
> COMPLETE Column stats: COMPLETE
> |
> | table:{"input
> format:":"org.apache.hadoop.mapred.TextInputFormat","output
>
[jira] [Commented] (HIVE-16421) Runtime filtering breaks user-level explain
[
https://issues.apache.org/jira/browse/HIVE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15973888#comment-15973888
]
Hive QA commented on HIVE-16421:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12863895/HIVE-16421.01.patch
{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 3 failed/errored test(s), 10582 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[dynamic_semijoin_user_level]
(batchId=63)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[vector_order_null]
(batchId=28)
org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver[explainuser_2]
(batchId=140)
{noformat}
Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/4746/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/4746/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-4746/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 3 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12863895 - PreCommit-HIVE-Build
> Runtime filtering breaks user-level explain
> ---
>
> Key: HIVE-16421
> URL: https://issues.apache.org/jira/browse/HIVE-16421
> Project: Hive
> Issue Type: Bug
>Reporter: Pengcheng Xiong
>Assignee: Pengcheng Xiong
> Attachments: HIVE-16421.01.patch
>
>
> Query:
> {noformat}
> SELECT LAG(COALESCE(t2.int_col_14, t1.int_col_80),22) OVER (ORDER BY
> t1.tinyint_col_52 DESC) AS int_col FROM table_6 t1 INNER JOIN table_14 t2 ON
> ((t2.decimal0101_col_55) = (t1.decimal0101_col_9));
> {noformat}
> Without runtime filtering
> {noformat}
> +-+--+
> |
> Explain
> |
> +-+--+
> | Plan not optimized by CBO.
>
> |
> |
>
> |
> | Vertex dependency in root stage
>
> |
> | Map 1 <- Map 3 (BROADCAST_EDGE)
>
> |
> | Reducer 2 <- Map 1 (SIMPLE_EDGE)
>
> |
> |
>
> |
> | Stage-0
>
> |
> |Fetch Operator
>
> |
> | limit:-1
>
> |
> | Stage-1
>
