[jira] [Updated] (HIVE-16421) Runtime filtering breaks user-level explain
[
https://issues.apache.org/jira/browse/HIVE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pengcheng Xiong updated HIVE-16421:
---
Resolution: Fixed
Status: Resolved (was: Patch Available)
> Runtime filtering breaks user-level explain
> ---
>
> Key: HIVE-16421
> URL: https://issues.apache.org/jira/browse/HIVE-16421
> Project: Hive
> Issue Type: Bug
>Affects Versions: 2.1.0
>Reporter: Pengcheng Xiong
>Assignee: Pengcheng Xiong
> Fix For: 3.0.0
>
> Attachments: HIVE-16421.01.patch, HIVE-16421.02.patch
>
>
> Query:
> {noformat}
> SELECT LAG(COALESCE(t2.int_col_14, t1.int_col_80),22) OVER (ORDER BY
> t1.tinyint_col_52 DESC) AS int_col FROM table_6 t1 INNER JOIN table_14 t2 ON
> ((t2.decimal0101_col_55) = (t1.decimal0101_col_9));
> {noformat}
> Without runtime filtering
> {noformat}
> +-+--+
> |
> Explain
> |
> +-+--+
> | Plan not optimized by CBO.
>
> |
> |
>
> |
> | Vertex dependency in root stage
>
> |
> | Map 1 <- Map 3 (BROADCAST_EDGE)
>
> |
> | Reducer 2 <- Map 1 (SIMPLE_EDGE)
>
> |
> |
>
> |
> | Stage-0
>
> |
> |Fetch Operator
>
> |
> | limit:-1
>
> |
> | Stage-1
>
> |
> | Reducer 2
>
> |
> | File Output Operator [FS_364]
>
> |
> | compressed:false
>
> |
> | Statistics:Num rows: 74781721 Data size: 299126884 Basic stats:
> COMPLETE Column stats: COMPLETE
> |
> | table:{"input
>
[jira] [Updated] (HIVE-16421) Runtime filtering breaks user-level explain
[
https://issues.apache.org/jira/browse/HIVE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pengcheng Xiong updated HIVE-16421:
---
Affects Version/s: 2.1.0
> Runtime filtering breaks user-level explain
> ---
>
> Key: HIVE-16421
> URL: https://issues.apache.org/jira/browse/HIVE-16421
> Project: Hive
> Issue Type: Bug
>Affects Versions: 2.1.0
>Reporter: Pengcheng Xiong
>Assignee: Pengcheng Xiong
> Fix For: 3.0.0
>
> Attachments: HIVE-16421.01.patch, HIVE-16421.02.patch
>
>
> Query:
> {noformat}
> SELECT LAG(COALESCE(t2.int_col_14, t1.int_col_80),22) OVER (ORDER BY
> t1.tinyint_col_52 DESC) AS int_col FROM table_6 t1 INNER JOIN table_14 t2 ON
> ((t2.decimal0101_col_55) = (t1.decimal0101_col_9));
> {noformat}
> Without runtime filtering
> {noformat}
> +-+--+
> |
> Explain
> |
> +-+--+
> | Plan not optimized by CBO.
>
> |
> |
>
> |
> | Vertex dependency in root stage
>
> |
> | Map 1 <- Map 3 (BROADCAST_EDGE)
>
> |
> | Reducer 2 <- Map 1 (SIMPLE_EDGE)
>
> |
> |
>
> |
> | Stage-0
>
> |
> |Fetch Operator
>
> |
> | limit:-1
>
> |
> | Stage-1
>
> |
> | Reducer 2
>
> |
> | File Output Operator [FS_364]
>
> |
> | compressed:false
>
> |
> | Statistics:Num rows: 74781721 Data size: 299126884 Basic stats:
> COMPLETE Column stats: COMPLETE
> |
> | table:{"input
>
[jira] [Updated] (HIVE-16421) Runtime filtering breaks user-level explain
[
https://issues.apache.org/jira/browse/HIVE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pengcheng Xiong updated HIVE-16421:
---
Fix Version/s: 3.0.0
> Runtime filtering breaks user-level explain
> ---
>
> Key: HIVE-16421
> URL: https://issues.apache.org/jira/browse/HIVE-16421
> Project: Hive
> Issue Type: Bug
>Reporter: Pengcheng Xiong
>Assignee: Pengcheng Xiong
> Fix For: 3.0.0
>
> Attachments: HIVE-16421.01.patch, HIVE-16421.02.patch
>
>
> Query:
> {noformat}
> SELECT LAG(COALESCE(t2.int_col_14, t1.int_col_80),22) OVER (ORDER BY
> t1.tinyint_col_52 DESC) AS int_col FROM table_6 t1 INNER JOIN table_14 t2 ON
> ((t2.decimal0101_col_55) = (t1.decimal0101_col_9));
> {noformat}
> Without runtime filtering
> {noformat}
> +-+--+
> |
> Explain
> |
> +-+--+
> | Plan not optimized by CBO.
>
> |
> |
>
> |
> | Vertex dependency in root stage
>
> |
> | Map 1 <- Map 3 (BROADCAST_EDGE)
>
> |
> | Reducer 2 <- Map 1 (SIMPLE_EDGE)
>
> |
> |
>
> |
> | Stage-0
>
> |
> |Fetch Operator
>
> |
> | limit:-1
>
> |
> | Stage-1
>
> |
> | Reducer 2
>
> |
> | File Output Operator [FS_364]
>
> |
> | compressed:false
>
> |
> | Statistics:Num rows: 74781721 Data size: 299126884 Basic stats:
> COMPLETE Column stats: COMPLETE
> |
> | table:{"input
> format:":"org.apache.hadoop.mapred.TextInputFormat","output
>
[jira] [Updated] (HIVE-16421) Runtime filtering breaks user-level explain
[
https://issues.apache.org/jira/browse/HIVE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pengcheng Xiong updated HIVE-16421:
---
Status: Open (was: Patch Available)
> Runtime filtering breaks user-level explain
> ---
>
> Key: HIVE-16421
> URL: https://issues.apache.org/jira/browse/HIVE-16421
> Project: Hive
> Issue Type: Bug
>Reporter: Pengcheng Xiong
>Assignee: Pengcheng Xiong
> Attachments: HIVE-16421.01.patch, HIVE-16421.02.patch
>
>
> Query:
> {noformat}
> SELECT LAG(COALESCE(t2.int_col_14, t1.int_col_80),22) OVER (ORDER BY
> t1.tinyint_col_52 DESC) AS int_col FROM table_6 t1 INNER JOIN table_14 t2 ON
> ((t2.decimal0101_col_55) = (t1.decimal0101_col_9));
> {noformat}
> Without runtime filtering
> {noformat}
> +-+--+
> |
> Explain
> |
> +-+--+
> | Plan not optimized by CBO.
>
> |
> |
>
> |
> | Vertex dependency in root stage
>
> |
> | Map 1 <- Map 3 (BROADCAST_EDGE)
>
> |
> | Reducer 2 <- Map 1 (SIMPLE_EDGE)
>
> |
> |
>
> |
> | Stage-0
>
> |
> |Fetch Operator
>
> |
> | limit:-1
>
> |
> | Stage-1
>
> |
> | Reducer 2
>
> |
> | File Output Operator [FS_364]
>
> |
> | compressed:false
>
> |
> | Statistics:Num rows: 74781721 Data size: 299126884 Basic stats:
> COMPLETE Column stats: COMPLETE
> |
> | table:{"input
> format:":"org.apache.hadoop.mapred.TextInputFormat","output
>
[jira] [Updated] (HIVE-16421) Runtime filtering breaks user-level explain
[
https://issues.apache.org/jira/browse/HIVE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pengcheng Xiong updated HIVE-16421:
---
Status: Patch Available (was: Open)
> Runtime filtering breaks user-level explain
> ---
>
> Key: HIVE-16421
> URL: https://issues.apache.org/jira/browse/HIVE-16421
> Project: Hive
> Issue Type: Bug
>Reporter: Pengcheng Xiong
>Assignee: Pengcheng Xiong
> Attachments: HIVE-16421.01.patch, HIVE-16421.02.patch
>
>
> Query:
> {noformat}
> SELECT LAG(COALESCE(t2.int_col_14, t1.int_col_80),22) OVER (ORDER BY
> t1.tinyint_col_52 DESC) AS int_col FROM table_6 t1 INNER JOIN table_14 t2 ON
> ((t2.decimal0101_col_55) = (t1.decimal0101_col_9));
> {noformat}
> Without runtime filtering
> {noformat}
> +-+--+
> |
> Explain
> |
> +-+--+
> | Plan not optimized by CBO.
>
> |
> |
>
> |
> | Vertex dependency in root stage
>
> |
> | Map 1 <- Map 3 (BROADCAST_EDGE)
>
> |
> | Reducer 2 <- Map 1 (SIMPLE_EDGE)
>
> |
> |
>
> |
> | Stage-0
>
> |
> |Fetch Operator
>
> |
> | limit:-1
>
> |
> | Stage-1
>
> |
> | Reducer 2
>
> |
> | File Output Operator [FS_364]
>
> |
> | compressed:false
>
> |
> | Statistics:Num rows: 74781721 Data size: 299126884 Basic stats:
> COMPLETE Column stats: COMPLETE
> |
> | table:{"input
> format:":"org.apache.hadoop.mapred.TextInputFormat","output
>
[jira] [Updated] (HIVE-16421) Runtime filtering breaks user-level explain
[
https://issues.apache.org/jira/browse/HIVE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pengcheng Xiong updated HIVE-16421:
---
Attachment: (was: HIVE-16421.02.patch)
> Runtime filtering breaks user-level explain
> ---
>
> Key: HIVE-16421
> URL: https://issues.apache.org/jira/browse/HIVE-16421
> Project: Hive
> Issue Type: Bug
>Reporter: Pengcheng Xiong
>Assignee: Pengcheng Xiong
> Attachments: HIVE-16421.01.patch, HIVE-16421.02.patch
>
>
> Query:
> {noformat}
> SELECT LAG(COALESCE(t2.int_col_14, t1.int_col_80),22) OVER (ORDER BY
> t1.tinyint_col_52 DESC) AS int_col FROM table_6 t1 INNER JOIN table_14 t2 ON
> ((t2.decimal0101_col_55) = (t1.decimal0101_col_9));
> {noformat}
> Without runtime filtering
> {noformat}
> +-+--+
> |
> Explain
> |
> +-+--+
> | Plan not optimized by CBO.
>
> |
> |
>
> |
> | Vertex dependency in root stage
>
> |
> | Map 1 <- Map 3 (BROADCAST_EDGE)
>
> |
> | Reducer 2 <- Map 1 (SIMPLE_EDGE)
>
> |
> |
>
> |
> | Stage-0
>
> |
> |Fetch Operator
>
> |
> | limit:-1
>
> |
> | Stage-1
>
> |
> | Reducer 2
>
> |
> | File Output Operator [FS_364]
>
> |
> | compressed:false
>
> |
> | Statistics:Num rows: 74781721 Data size: 299126884 Basic stats:
> COMPLETE Column stats: COMPLETE
> |
> | table:{"input
> format:":"org.apache.hadoop.mapred.TextInputFormat","output
>
[jira] [Updated] (HIVE-16421) Runtime filtering breaks user-level explain
[
https://issues.apache.org/jira/browse/HIVE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pengcheng Xiong updated HIVE-16421:
---
Status: Open (was: Patch Available)
> Runtime filtering breaks user-level explain
> ---
>
> Key: HIVE-16421
> URL: https://issues.apache.org/jira/browse/HIVE-16421
> Project: Hive
> Issue Type: Bug
>Reporter: Pengcheng Xiong
>Assignee: Pengcheng Xiong
> Attachments: HIVE-16421.01.patch, HIVE-16421.02.patch
>
>
> Query:
> {noformat}
> SELECT LAG(COALESCE(t2.int_col_14, t1.int_col_80),22) OVER (ORDER BY
> t1.tinyint_col_52 DESC) AS int_col FROM table_6 t1 INNER JOIN table_14 t2 ON
> ((t2.decimal0101_col_55) = (t1.decimal0101_col_9));
> {noformat}
> Without runtime filtering
> {noformat}
> +-+--+
> |
> Explain
> |
> +-+--+
> | Plan not optimized by CBO.
>
> |
> |
>
> |
> | Vertex dependency in root stage
>
> |
> | Map 1 <- Map 3 (BROADCAST_EDGE)
>
> |
> | Reducer 2 <- Map 1 (SIMPLE_EDGE)
>
> |
> |
>
> |
> | Stage-0
>
> |
> |Fetch Operator
>
> |
> | limit:-1
>
> |
> | Stage-1
>
> |
> | Reducer 2
>
> |
> | File Output Operator [FS_364]
>
> |
> | compressed:false
>
> |
> | Statistics:Num rows: 74781721 Data size: 299126884 Basic stats:
> COMPLETE Column stats: COMPLETE
> |
> | table:{"input
> format:":"org.apache.hadoop.mapred.TextInputFormat","output
>
[jira] [Updated] (HIVE-16421) Runtime filtering breaks user-level explain
[
https://issues.apache.org/jira/browse/HIVE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pengcheng Xiong updated HIVE-16421:
---
Attachment: HIVE-16421.02.patch
> Runtime filtering breaks user-level explain
> ---
>
> Key: HIVE-16421
> URL: https://issues.apache.org/jira/browse/HIVE-16421
> Project: Hive
> Issue Type: Bug
>Reporter: Pengcheng Xiong
>Assignee: Pengcheng Xiong
> Attachments: HIVE-16421.01.patch, HIVE-16421.02.patch
>
>
> Query:
> {noformat}
> SELECT LAG(COALESCE(t2.int_col_14, t1.int_col_80),22) OVER (ORDER BY
> t1.tinyint_col_52 DESC) AS int_col FROM table_6 t1 INNER JOIN table_14 t2 ON
> ((t2.decimal0101_col_55) = (t1.decimal0101_col_9));
> {noformat}
> Without runtime filtering
> {noformat}
> +-+--+
> |
> Explain
> |
> +-+--+
> | Plan not optimized by CBO.
>
> |
> |
>
> |
> | Vertex dependency in root stage
>
> |
> | Map 1 <- Map 3 (BROADCAST_EDGE)
>
> |
> | Reducer 2 <- Map 1 (SIMPLE_EDGE)
>
> |
> |
>
> |
> | Stage-0
>
> |
> |Fetch Operator
>
> |
> | limit:-1
>
> |
> | Stage-1
>
> |
> | Reducer 2
>
> |
> | File Output Operator [FS_364]
>
> |
> | compressed:false
>
> |
> | Statistics:Num rows: 74781721 Data size: 299126884 Basic stats:
> COMPLETE Column stats: COMPLETE
> |
> | table:{"input
> format:":"org.apache.hadoop.mapred.TextInputFormat","output
>
[jira] [Updated] (HIVE-16421) Runtime filtering breaks user-level explain
[
https://issues.apache.org/jira/browse/HIVE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pengcheng Xiong updated HIVE-16421:
---
Status: Patch Available (was: Open)
> Runtime filtering breaks user-level explain
> ---
>
> Key: HIVE-16421
> URL: https://issues.apache.org/jira/browse/HIVE-16421
> Project: Hive
> Issue Type: Bug
>Reporter: Pengcheng Xiong
>Assignee: Pengcheng Xiong
> Attachments: HIVE-16421.01.patch, HIVE-16421.02.patch
>
>
> Query:
> {noformat}
> SELECT LAG(COALESCE(t2.int_col_14, t1.int_col_80),22) OVER (ORDER BY
> t1.tinyint_col_52 DESC) AS int_col FROM table_6 t1 INNER JOIN table_14 t2 ON
> ((t2.decimal0101_col_55) = (t1.decimal0101_col_9));
> {noformat}
> Without runtime filtering
> {noformat}
> +-+--+
> |
> Explain
> |
> +-+--+
> | Plan not optimized by CBO.
>
> |
> |
>
> |
> | Vertex dependency in root stage
>
> |
> | Map 1 <- Map 3 (BROADCAST_EDGE)
>
> |
> | Reducer 2 <- Map 1 (SIMPLE_EDGE)
>
> |
> |
>
> |
> | Stage-0
>
> |
> |Fetch Operator
>
> |
> | limit:-1
>
> |
> | Stage-1
>
> |
> | Reducer 2
>
> |
> | File Output Operator [FS_364]
>
> |
> | compressed:false
>
> |
> | Statistics:Num rows: 74781721 Data size: 299126884 Basic stats:
> COMPLETE Column stats: COMPLETE
> |
> | table:{"input
> format:":"org.apache.hadoop.mapred.TextInputFormat","output
>
[jira] [Updated] (HIVE-16421) Runtime filtering breaks user-level explain
[
https://issues.apache.org/jira/browse/HIVE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pengcheng Xiong updated HIVE-16421:
---
Status: Open (was: Patch Available)
> Runtime filtering breaks user-level explain
> ---
>
> Key: HIVE-16421
> URL: https://issues.apache.org/jira/browse/HIVE-16421
> Project: Hive
> Issue Type: Bug
>Reporter: Pengcheng Xiong
>Assignee: Pengcheng Xiong
> Attachments: HIVE-16421.01.patch, HIVE-16421.02.patch
>
>
> Query:
> {noformat}
> SELECT LAG(COALESCE(t2.int_col_14, t1.int_col_80),22) OVER (ORDER BY
> t1.tinyint_col_52 DESC) AS int_col FROM table_6 t1 INNER JOIN table_14 t2 ON
> ((t2.decimal0101_col_55) = (t1.decimal0101_col_9));
> {noformat}
> Without runtime filtering
> {noformat}
> +-+--+
> |
> Explain
> |
> +-+--+
> | Plan not optimized by CBO.
>
> |
> |
>
> |
> | Vertex dependency in root stage
>
> |
> | Map 1 <- Map 3 (BROADCAST_EDGE)
>
> |
> | Reducer 2 <- Map 1 (SIMPLE_EDGE)
>
> |
> |
>
> |
> | Stage-0
>
> |
> |Fetch Operator
>
> |
> | limit:-1
>
> |
> | Stage-1
>
> |
> | Reducer 2
>
> |
> | File Output Operator [FS_364]
>
> |
> | compressed:false
>
> |
> | Statistics:Num rows: 74781721 Data size: 299126884 Basic stats:
> COMPLETE Column stats: COMPLETE
> |
> | table:{"input
> format:":"org.apache.hadoop.mapred.TextInputFormat","output
>
[jira] [Updated] (HIVE-16421) Runtime filtering breaks user-level explain
[
https://issues.apache.org/jira/browse/HIVE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pengcheng Xiong updated HIVE-16421:
---
Status: Patch Available (was: Open)
> Runtime filtering breaks user-level explain
> ---
>
> Key: HIVE-16421
> URL: https://issues.apache.org/jira/browse/HIVE-16421
> Project: Hive
> Issue Type: Bug
>Reporter: Pengcheng Xiong
>Assignee: Pengcheng Xiong
> Attachments: HIVE-16421.01.patch, HIVE-16421.02.patch
>
>
> Query:
> {noformat}
> SELECT LAG(COALESCE(t2.int_col_14, t1.int_col_80),22) OVER (ORDER BY
> t1.tinyint_col_52 DESC) AS int_col FROM table_6 t1 INNER JOIN table_14 t2 ON
> ((t2.decimal0101_col_55) = (t1.decimal0101_col_9));
> {noformat}
> Without runtime filtering
> {noformat}
> +-+--+
> |
> Explain
> |
> +-+--+
> | Plan not optimized by CBO.
>
> |
> |
>
> |
> | Vertex dependency in root stage
>
> |
> | Map 1 <- Map 3 (BROADCAST_EDGE)
>
> |
> | Reducer 2 <- Map 1 (SIMPLE_EDGE)
>
> |
> |
>
> |
> | Stage-0
>
> |
> |Fetch Operator
>
> |
> | limit:-1
>
> |
> | Stage-1
>
> |
> | Reducer 2
>
> |
> | File Output Operator [FS_364]
>
> |
> | compressed:false
>
> |
> | Statistics:Num rows: 74781721 Data size: 299126884 Basic stats:
> COMPLETE Column stats: COMPLETE
> |
> | table:{"input
> format:":"org.apache.hadoop.mapred.TextInputFormat","output
>
[jira] [Updated] (HIVE-16421) Runtime filtering breaks user-level explain
[
https://issues.apache.org/jira/browse/HIVE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pengcheng Xiong updated HIVE-16421:
---
Status: Open (was: Patch Available)
> Runtime filtering breaks user-level explain
> ---
>
> Key: HIVE-16421
> URL: https://issues.apache.org/jira/browse/HIVE-16421
> Project: Hive
> Issue Type: Bug
>Reporter: Pengcheng Xiong
>Assignee: Pengcheng Xiong
> Attachments: HIVE-16421.01.patch, HIVE-16421.02.patch
>
>
> Query:
> {noformat}
> SELECT LAG(COALESCE(t2.int_col_14, t1.int_col_80),22) OVER (ORDER BY
> t1.tinyint_col_52 DESC) AS int_col FROM table_6 t1 INNER JOIN table_14 t2 ON
> ((t2.decimal0101_col_55) = (t1.decimal0101_col_9));
> {noformat}
> Without runtime filtering
> {noformat}
> +-+--+
> |
> Explain
> |
> +-+--+
> | Plan not optimized by CBO.
>
> |
> |
>
> |
> | Vertex dependency in root stage
>
> |
> | Map 1 <- Map 3 (BROADCAST_EDGE)
>
> |
> | Reducer 2 <- Map 1 (SIMPLE_EDGE)
>
> |
> |
>
> |
> | Stage-0
>
> |
> |Fetch Operator
>
> |
> | limit:-1
>
> |
> | Stage-1
>
> |
> | Reducer 2
>
> |
> | File Output Operator [FS_364]
>
> |
> | compressed:false
>
> |
> | Statistics:Num rows: 74781721 Data size: 299126884 Basic stats:
> COMPLETE Column stats: COMPLETE
> |
> | table:{"input
> format:":"org.apache.hadoop.mapred.TextInputFormat","output
>
[jira] [Updated] (HIVE-16421) Runtime filtering breaks user-level explain
[
https://issues.apache.org/jira/browse/HIVE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pengcheng Xiong updated HIVE-16421:
---
Attachment: HIVE-16421.02.patch
> Runtime filtering breaks user-level explain
> ---
>
> Key: HIVE-16421
> URL: https://issues.apache.org/jira/browse/HIVE-16421
> Project: Hive
> Issue Type: Bug
>Reporter: Pengcheng Xiong
>Assignee: Pengcheng Xiong
> Attachments: HIVE-16421.01.patch, HIVE-16421.02.patch
>
>
> Query:
> {noformat}
> SELECT LAG(COALESCE(t2.int_col_14, t1.int_col_80),22) OVER (ORDER BY
> t1.tinyint_col_52 DESC) AS int_col FROM table_6 t1 INNER JOIN table_14 t2 ON
> ((t2.decimal0101_col_55) = (t1.decimal0101_col_9));
> {noformat}
> Without runtime filtering
> {noformat}
> +-+--+
> |
> Explain
> |
> +-+--+
> | Plan not optimized by CBO.
>
> |
> |
>
> |
> | Vertex dependency in root stage
>
> |
> | Map 1 <- Map 3 (BROADCAST_EDGE)
>
> |
> | Reducer 2 <- Map 1 (SIMPLE_EDGE)
>
> |
> |
>
> |
> | Stage-0
>
> |
> |Fetch Operator
>
> |
> | limit:-1
>
> |
> | Stage-1
>
> |
> | Reducer 2
>
> |
> | File Output Operator [FS_364]
>
> |
> | compressed:false
>
> |
> | Statistics:Num rows: 74781721 Data size: 299126884 Basic stats:
> COMPLETE Column stats: COMPLETE
> |
> | table:{"input
> format:":"org.apache.hadoop.mapred.TextInputFormat","output
>
[jira] [Updated] (HIVE-16421) Runtime filtering breaks user-level explain
[
https://issues.apache.org/jira/browse/HIVE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pengcheng Xiong updated HIVE-16421:
---
Status: Patch Available (was: Open)
> Runtime filtering breaks user-level explain
> ---
>
> Key: HIVE-16421
> URL: https://issues.apache.org/jira/browse/HIVE-16421
> Project: Hive
> Issue Type: Bug
>Reporter: Pengcheng Xiong
>Assignee: Pengcheng Xiong
> Attachments: HIVE-16421.01.patch, HIVE-16421.02.patch
>
>
> Query:
> {noformat}
> SELECT LAG(COALESCE(t2.int_col_14, t1.int_col_80),22) OVER (ORDER BY
> t1.tinyint_col_52 DESC) AS int_col FROM table_6 t1 INNER JOIN table_14 t2 ON
> ((t2.decimal0101_col_55) = (t1.decimal0101_col_9));
> {noformat}
> Without runtime filtering
> {noformat}
> +-+--+
> |
> Explain
> |
> +-+--+
> | Plan not optimized by CBO.
>
> |
> |
>
> |
> | Vertex dependency in root stage
>
> |
> | Map 1 <- Map 3 (BROADCAST_EDGE)
>
> |
> | Reducer 2 <- Map 1 (SIMPLE_EDGE)
>
> |
> |
>
> |
> | Stage-0
>
> |
> |Fetch Operator
>
> |
> | limit:-1
>
> |
> | Stage-1
>
> |
> | Reducer 2
>
> |
> | File Output Operator [FS_364]
>
> |
> | compressed:false
>
> |
> | Statistics:Num rows: 74781721 Data size: 299126884 Basic stats:
> COMPLETE Column stats: COMPLETE
> |
> | table:{"input
> format:":"org.apache.hadoop.mapred.TextInputFormat","output
>
[jira] [Updated] (HIVE-16421) Runtime filtering breaks user-level explain
[
https://issues.apache.org/jira/browse/HIVE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pengcheng Xiong updated HIVE-16421:
---
Status: Open (was: Patch Available)
> Runtime filtering breaks user-level explain
> ---
>
> Key: HIVE-16421
> URL: https://issues.apache.org/jira/browse/HIVE-16421
> Project: Hive
> Issue Type: Bug
>Reporter: Pengcheng Xiong
>Assignee: Pengcheng Xiong
> Attachments: HIVE-16421.01.patch, HIVE-16421.02.patch
>
>
> Query:
> {noformat}
> SELECT LAG(COALESCE(t2.int_col_14, t1.int_col_80),22) OVER (ORDER BY
> t1.tinyint_col_52 DESC) AS int_col FROM table_6 t1 INNER JOIN table_14 t2 ON
> ((t2.decimal0101_col_55) = (t1.decimal0101_col_9));
> {noformat}
> Without runtime filtering
> {noformat}
> +-+--+
> |
> Explain
> |
> +-+--+
> | Plan not optimized by CBO.
>
> |
> |
>
> |
> | Vertex dependency in root stage
>
> |
> | Map 1 <- Map 3 (BROADCAST_EDGE)
>
> |
> | Reducer 2 <- Map 1 (SIMPLE_EDGE)
>
> |
> |
>
> |
> | Stage-0
>
> |
> |Fetch Operator
>
> |
> | limit:-1
>
> |
> | Stage-1
>
> |
> | Reducer 2
>
> |
> | File Output Operator [FS_364]
>
> |
> | compressed:false
>
> |
> | Statistics:Num rows: 74781721 Data size: 299126884 Basic stats:
> COMPLETE Column stats: COMPLETE
> |
> | table:{"input
> format:":"org.apache.hadoop.mapred.TextInputFormat","output
>
[jira] [Updated] (HIVE-16421) Runtime filtering breaks user-level explain
[
https://issues.apache.org/jira/browse/HIVE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pengcheng Xiong updated HIVE-16421:
---
Status: Patch Available (was: Open)
> Runtime filtering breaks user-level explain
> ---
>
> Key: HIVE-16421
> URL: https://issues.apache.org/jira/browse/HIVE-16421
> Project: Hive
> Issue Type: Bug
>Reporter: Pengcheng Xiong
>Assignee: Pengcheng Xiong
> Attachments: HIVE-16421.01.patch, HIVE-16421.02.patch
>
>
> Query:
> {noformat}
> SELECT LAG(COALESCE(t2.int_col_14, t1.int_col_80),22) OVER (ORDER BY
> t1.tinyint_col_52 DESC) AS int_col FROM table_6 t1 INNER JOIN table_14 t2 ON
> ((t2.decimal0101_col_55) = (t1.decimal0101_col_9));
> {noformat}
> Without runtime filtering
> {noformat}
> +-+--+
> |
> Explain
> |
> +-+--+
> | Plan not optimized by CBO.
>
> |
> |
>
> |
> | Vertex dependency in root stage
>
> |
> | Map 1 <- Map 3 (BROADCAST_EDGE)
>
> |
> | Reducer 2 <- Map 1 (SIMPLE_EDGE)
>
> |
> |
>
> |
> | Stage-0
>
> |
> |Fetch Operator
>
> |
> | limit:-1
>
> |
> | Stage-1
>
> |
> | Reducer 2
>
> |
> | File Output Operator [FS_364]
>
> |
> | compressed:false
>
> |
> | Statistics:Num rows: 74781721 Data size: 299126884 Basic stats:
> COMPLETE Column stats: COMPLETE
> |
> | table:{"input
> format:":"org.apache.hadoop.mapred.TextInputFormat","output
>
[jira] [Updated] (HIVE-16421) Runtime filtering breaks user-level explain
[
https://issues.apache.org/jira/browse/HIVE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pengcheng Xiong updated HIVE-16421:
---
Attachment: HIVE-16421.02.patch
> Runtime filtering breaks user-level explain
> ---
>
> Key: HIVE-16421
> URL: https://issues.apache.org/jira/browse/HIVE-16421
> Project: Hive
> Issue Type: Bug
>Reporter: Pengcheng Xiong
>Assignee: Pengcheng Xiong
> Attachments: HIVE-16421.01.patch, HIVE-16421.02.patch
>
>
> Query:
> {noformat}
> SELECT LAG(COALESCE(t2.int_col_14, t1.int_col_80),22) OVER (ORDER BY
> t1.tinyint_col_52 DESC) AS int_col FROM table_6 t1 INNER JOIN table_14 t2 ON
> ((t2.decimal0101_col_55) = (t1.decimal0101_col_9));
> {noformat}
> Without runtime filtering
> {noformat}
> +-+--+
> |
> Explain
> |
> +-+--+
> | Plan not optimized by CBO.
>
> |
> |
>
> |
> | Vertex dependency in root stage
>
> |
> | Map 1 <- Map 3 (BROADCAST_EDGE)
>
> |
> | Reducer 2 <- Map 1 (SIMPLE_EDGE)
>
> |
> |
>
> |
> | Stage-0
>
> |
> |Fetch Operator
>
> |
> | limit:-1
>
> |
> | Stage-1
>
> |
> | Reducer 2
>
> |
> | File Output Operator [FS_364]
>
> |
> | compressed:false
>
> |
> | Statistics:Num rows: 74781721 Data size: 299126884 Basic stats:
> COMPLETE Column stats: COMPLETE
> |
> | table:{"input
> format:":"org.apache.hadoop.mapred.TextInputFormat","output
>
[jira] [Updated] (HIVE-16421) Runtime filtering breaks user-level explain
[
https://issues.apache.org/jira/browse/HIVE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pengcheng Xiong updated HIVE-16421:
---
Status: Patch Available (was: Open)
> Runtime filtering breaks user-level explain
> ---
>
> Key: HIVE-16421
> URL: https://issues.apache.org/jira/browse/HIVE-16421
> Project: Hive
> Issue Type: Bug
>Reporter: Pengcheng Xiong
>Assignee: Pengcheng Xiong
> Attachments: HIVE-16421.01.patch
>
>
> Query:
> {noformat}
> SELECT LAG(COALESCE(t2.int_col_14, t1.int_col_80),22) OVER (ORDER BY
> t1.tinyint_col_52 DESC) AS int_col FROM table_6 t1 INNER JOIN table_14 t2 ON
> ((t2.decimal0101_col_55) = (t1.decimal0101_col_9));
> {noformat}
> Without runtime filtering
> {noformat}
> +-+--+
> |
> Explain
> |
> +-+--+
> | Plan not optimized by CBO.
>
> |
> |
>
> |
> | Vertex dependency in root stage
>
> |
> | Map 1 <- Map 3 (BROADCAST_EDGE)
>
> |
> | Reducer 2 <- Map 1 (SIMPLE_EDGE)
>
> |
> |
>
> |
> | Stage-0
>
> |
> |Fetch Operator
>
> |
> | limit:-1
>
> |
> | Stage-1
>
> |
> | Reducer 2
>
> |
> | File Output Operator [FS_364]
>
> |
> | compressed:false
>
> |
> | Statistics:Num rows: 74781721 Data size: 299126884 Basic stats:
> COMPLETE Column stats: COMPLETE
> |
> | table:{"input
> format:":"org.apache.hadoop.mapred.TextInputFormat","output
>
[jira] [Updated] (HIVE-16421) Runtime filtering breaks user-level explain
[
https://issues.apache.org/jira/browse/HIVE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pengcheng Xiong updated HIVE-16421:
---
Attachment: HIVE-16421.01.patch
> Runtime filtering breaks user-level explain
> ---
>
> Key: HIVE-16421
> URL: https://issues.apache.org/jira/browse/HIVE-16421
> Project: Hive
> Issue Type: Bug
>Reporter: Pengcheng Xiong
>Assignee: Pengcheng Xiong
> Attachments: HIVE-16421.01.patch
>
>
> Query:
> {noformat}
> SELECT LAG(COALESCE(t2.int_col_14, t1.int_col_80),22) OVER (ORDER BY
> t1.tinyint_col_52 DESC) AS int_col FROM table_6 t1 INNER JOIN table_14 t2 ON
> ((t2.decimal0101_col_55) = (t1.decimal0101_col_9));
> {noformat}
> Without runtime filtering
> {noformat}
> +-+--+
> |
> Explain
> |
> +-+--+
> | Plan not optimized by CBO.
>
> |
> |
>
> |
> | Vertex dependency in root stage
>
> |
> | Map 1 <- Map 3 (BROADCAST_EDGE)
>
> |
> | Reducer 2 <- Map 1 (SIMPLE_EDGE)
>
> |
> |
>
> |
> | Stage-0
>
> |
> |Fetch Operator
>
> |
> | limit:-1
>
> |
> | Stage-1
>
> |
> | Reducer 2
>
> |
> | File Output Operator [FS_364]
>
> |
> | compressed:false
>
> |
> | Statistics:Num rows: 74781721 Data size: 299126884 Basic stats:
> COMPLETE Column stats: COMPLETE
> |
> | table:{"input
> format:":"org.apache.hadoop.mapred.TextInputFormat","output
>
[jira] [Updated] (HIVE-16421) Runtime filtering breaks user-level explain
[
https://issues.apache.org/jira/browse/HIVE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aswathy Chellammal Sreekumar updated HIVE-16421:
Description:
Query:
SELECT LAG(COALESCE(t2.int_col_14, t1.int_col_80),22) OVER (ORDER BY
t1.tinyint_col_52 DESC) AS int_col FROM table_6 t1 INNER JOIN table_14 t2 ON
((t2.decimal0101_col_55) = (t1.decimal0101_col_9));
Without runtime filtering
+-+--+
|
Explain
|
+-+--+
| Plan not optimized by CBO.
|
|
|
| Vertex dependency in root stage
|
| Map 1 <- Map 3 (BROADCAST_EDGE)
|
| Reducer 2 <- Map 1 (SIMPLE_EDGE)
|
|
|
| Stage-0
|
|Fetch Operator
|
| limit:-1
|
| Stage-1
|
| Reducer 2
|
| File Output Operator [FS_364]
|
| compressed:false
|
| Statistics:Num rows: 74781721 Data size: 299126884 Basic stats:
COMPLETE Column stats: COMPLETE
|
| table:{"input
format:":"org.apache.hadoop.mapred.TextInputFormat","output
format:":"org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat","serde:":"org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe"}
|
| Select Operator [SEL_362]
|
|outputColumnNames:["_col0"]
