[jira] [Updated] (HIVE-17276) Check max shuffle size when converting to dynamically partitioned hash join
[ https://issues.apache.org/jira/browse/HIVE-17276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lefty Leverenz updated HIVE-17276: -- Labels: TODOC3.0 (was: ) > Check max shuffle size when converting to dynamically partitioned hash join > --- > > Key: HIVE-17276 > URL: https://issues.apache.org/jira/browse/HIVE-17276 > Project: Hive > Issue Type: Bug > Components: Physical Optimizer >Affects Versions: 3.0.0 >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez > Labels: TODOC3.0 > Fix For: 3.0.0 > > Attachments: HIVE-17276.01.patch, HIVE-17276.02.patch, > HIVE-17276.03.patch, HIVE-17276.patch > > > Currently we only check that the max number of entries in the hashmap for a > MapJoin surpasses a certain threshold to decide whether to execute a > dynamically partitioned hash join. > We would like to factor the size of the large input that we will shuffle for > the dynamically partitioned hash join into the cost model too. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HIVE-17276) Check max shuffle size when converting to dynamically partitioned hash join
[ https://issues.apache.org/jira/browse/HIVE-17276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-17276: --- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available) Pushed to master, thanks for the review [~ashutoshc]! > Check max shuffle size when converting to dynamically partitioned hash join > --- > > Key: HIVE-17276 > URL: https://issues.apache.org/jira/browse/HIVE-17276 > Project: Hive > Issue Type: Bug > Components: Physical Optimizer >Affects Versions: 3.0.0 >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez > Fix For: 3.0.0 > > Attachments: HIVE-17276.01.patch, HIVE-17276.02.patch, > HIVE-17276.03.patch, HIVE-17276.patch > > > Currently we only check that the max number of entries in the hashmap for a > MapJoin surpasses a certain threshold to decide whether to execute a > dynamically partitioned hash join. > We would like to factor the size of the large input that we will shuffle for > the dynamically partitioned hash join into the cost model too. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HIVE-17276) Check max shuffle size when converting to dynamically partitioned hash join
[ https://issues.apache.org/jira/browse/HIVE-17276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-17276: --- Attachment: HIVE-17276.03.patch > Check max shuffle size when converting to dynamically partitioned hash join > --- > > Key: HIVE-17276 > URL: https://issues.apache.org/jira/browse/HIVE-17276 > Project: Hive > Issue Type: Bug > Components: Physical Optimizer >Affects Versions: 3.0.0 >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez > Attachments: HIVE-17276.01.patch, HIVE-17276.02.patch, > HIVE-17276.03.patch, HIVE-17276.patch > > > Currently we only check that the max number of entries in the hashmap for a > MapJoin surpasses a certain threshold to decide whether to execute a > dynamically partitioned hash join. > We would like to factor the size of the large input that we will shuffle for > the dynamically partitioned hash join into the cost model too. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HIVE-17276) Check max shuffle size when converting to dynamically partitioned hash join
[ https://issues.apache.org/jira/browse/HIVE-17276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-17276: --- Attachment: HIVE-17276.02.patch Rebasing patch and triggering ptest again. > Check max shuffle size when converting to dynamically partitioned hash join > --- > > Key: HIVE-17276 > URL: https://issues.apache.org/jira/browse/HIVE-17276 > Project: Hive > Issue Type: Bug > Components: Physical Optimizer >Affects Versions: 3.0.0 >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez > Attachments: HIVE-17276.01.patch, HIVE-17276.02.patch, > HIVE-17276.patch > > > Currently we only check that the max number of entries in the hashmap for a > MapJoin surpasses a certain threshold to decide whether to execute a > dynamically partitioned hash join. > We would like to factor the size of the large input that we will shuffle for > the dynamically partitioned hash join into the cost model too. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HIVE-17276) Check max shuffle size when converting to dynamically partitioned hash join
[ https://issues.apache.org/jira/browse/HIVE-17276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-17276: --- Attachment: HIVE-17276.01.patch > Check max shuffle size when converting to dynamically partitioned hash join > --- > > Key: HIVE-17276 > URL: https://issues.apache.org/jira/browse/HIVE-17276 > Project: Hive > Issue Type: Bug > Components: Physical Optimizer >Affects Versions: 3.0.0 >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez > Attachments: HIVE-17276.01.patch, HIVE-17276.patch > > > Currently we only check that the max number of entries in the hashmap for a > MapJoin surpasses a certain threshold to decide whether to execute a > dynamically partitioned hash join. > We would like to factor the size of the large input that we will shuffle for > the dynamically partitioned hash join into the cost model too. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HIVE-17276) Check max shuffle size when converting to dynamically partitioned hash join
[ https://issues.apache.org/jira/browse/HIVE-17276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-17276: --- Attachment: HIVE-17276.patch > Check max shuffle size when converting to dynamically partitioned hash join > --- > > Key: HIVE-17276 > URL: https://issues.apache.org/jira/browse/HIVE-17276 > Project: Hive > Issue Type: Bug > Components: Physical Optimizer >Affects Versions: 3.0.0 >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez > Attachments: HIVE-17276.patch > > > Currently we only check that the max number of entries in the hashmap for a > MapJoin surpasses a certain threshold to decide whether to execute a > dynamically partitioned hash join. > We would like to factor the size of the large input that we will shuffle for > the dynamically partitioned hash join into the cost model too. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HIVE-17276) Check max shuffle size when converting to dynamically partitioned hash join
[ https://issues.apache.org/jira/browse/HIVE-17276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-17276: --- Status: Patch Available (was: In Progress) > Check max shuffle size when converting to dynamically partitioned hash join > --- > > Key: HIVE-17276 > URL: https://issues.apache.org/jira/browse/HIVE-17276 > Project: Hive > Issue Type: Bug > Components: Physical Optimizer >Affects Versions: 3.0.0 >Reporter: Jesus Camacho Rodriguez >Assignee: Jesus Camacho Rodriguez > Attachments: HIVE-17276.patch > > > Currently we only check that the max number of entries in the hashmap for a > MapJoin surpasses a certain threshold to decide whether to execute a > dynamically partitioned hash join. > We would like to factor the size of the large input that we will shuffle for > the dynamically partitioned hash join into the cost model too. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
