[jira] [Updated] (HIVE-22492) Amortize lock contention due to LRFU accounting
[ https://issues.apache.org/jira/browse/HIVE-22492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal Vijayaraghavan updated HIVE-22492: Fix Version/s: 4.0.0 > Amortize lock contention due to LRFU accounting > --- > > Key: HIVE-22492 > URL: https://issues.apache.org/jira/browse/HIVE-22492 > Project: Hive > Issue Type: Improvement >Reporter: Slim Bouguerra >Assignee: Slim Bouguerra >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-22492.2.patch, HIVE-22492.patch, > llap-lock-contention.svg > > > LRFU eviction policy can be a major source of contention under high load. > This can be see on the following profiles. > To fix this the idea is to use a batching wrapper to amortize the locking > contention. > The trick i a common way to amortize locking as explained here > http://www.ece.eng.wayne.edu/~sjiang/pubs/papers/ding-09-BP-Wrapper.pdf -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22492) Amortize lock contention due to LRFU accounting
[ https://issues.apache.org/jira/browse/HIVE-22492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Slim Bouguerra updated HIVE-22492: -- Resolution: Fixed Status: Resolved (was: Patch Available) https://git-wip-us.apache.org/repos/asf?p=hive.git;a=commit;h=0781cf2c5104dafd0c5496631cafabac9d59df67 > Amortize lock contention due to LRFU accounting > --- > > Key: HIVE-22492 > URL: https://issues.apache.org/jira/browse/HIVE-22492 > Project: Hive > Issue Type: Improvement >Reporter: Slim Bouguerra >Assignee: Slim Bouguerra >Priority: Major > Attachments: HIVE-22492.2.patch, HIVE-22492.patch, > llap-lock-contention.svg > > > LRFU eviction policy can be a major source of contention under high load. > This can be see on the following profiles. > To fix this the idea is to use a batching wrapper to amortize the locking > contention. > The trick i a common way to amortize locking as explained here > http://www.ece.eng.wayne.edu/~sjiang/pubs/papers/ding-09-BP-Wrapper.pdf -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22492) Amortize lock contention due to LRFU accounting
[ https://issues.apache.org/jira/browse/HIVE-22492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Slim Bouguerra updated HIVE-22492: -- Attachment: HIVE-22492.2.patch > Amortize lock contention due to LRFU accounting > --- > > Key: HIVE-22492 > URL: https://issues.apache.org/jira/browse/HIVE-22492 > Project: Hive > Issue Type: Improvement >Reporter: Slim Bouguerra >Assignee: Slim Bouguerra >Priority: Major > Attachments: HIVE-22492.2.patch, HIVE-22492.patch, > llap-lock-contention.svg > > > LRFU eviction policy can be a major source of contention under high load. > This can be see on the following profiles. > To fix this the idea is to use a batching wrapper to amortize the locking > contention. > The trick i a common way to amortize locking as explained here > http://www.ece.eng.wayne.edu/~sjiang/pubs/papers/ding-09-BP-Wrapper.pdf -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22492) Amortize lock contention due to LRFU accounting
[ https://issues.apache.org/jira/browse/HIVE-22492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Slim Bouguerra updated HIVE-22492: -- Attachment: HIVE-22492.patch > Amortize lock contention due to LRFU accounting > --- > > Key: HIVE-22492 > URL: https://issues.apache.org/jira/browse/HIVE-22492 > Project: Hive > Issue Type: Improvement >Reporter: Slim Bouguerra >Assignee: Slim Bouguerra >Priority: Major > Attachments: HIVE-22492.patch, llap-lock-contention.svg > > > LRFU eviction policy can be a major source of contention under high load. > This can be see on the following profiles. > To fix this the idea is to use a batching wrapper to amortize the locking > contention. > The trick i a common way to amortize locking as explained here > http://www.ece.eng.wayne.edu/~sjiang/pubs/papers/ding-09-BP-Wrapper.pdf -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22492) Amortize lock contention due to LRFU accounting
[ https://issues.apache.org/jira/browse/HIVE-22492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Slim Bouguerra updated HIVE-22492: -- Status: Patch Available (was: Open) > Amortize lock contention due to LRFU accounting > --- > > Key: HIVE-22492 > URL: https://issues.apache.org/jira/browse/HIVE-22492 > Project: Hive > Issue Type: Improvement >Reporter: Slim Bouguerra >Assignee: Slim Bouguerra >Priority: Major > Attachments: HIVE-22492.patch, llap-lock-contention.svg > > > LRFU eviction policy can be a major source of contention under high load. > This can be see on the following profiles. > To fix this the idea is to use a batching wrapper to amortize the locking > contention. > The trick i a common way to amortize locking as explained here > http://www.ece.eng.wayne.edu/~sjiang/pubs/papers/ding-09-BP-Wrapper.pdf -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HIVE-22492) Amortize lock contention due to LRFU accounting
[ https://issues.apache.org/jira/browse/HIVE-22492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Slim Bouguerra updated HIVE-22492: -- Attachment: llap-lock-contention.svg > Amortize lock contention due to LRFU accounting > --- > > Key: HIVE-22492 > URL: https://issues.apache.org/jira/browse/HIVE-22492 > Project: Hive > Issue Type: Improvement >Reporter: Slim Bouguerra >Assignee: Slim Bouguerra >Priority: Major > Attachments: llap-lock-contention.svg > > > LRFU eviction policy can be a major source of contention under high load. > This can be see on the following profiles. > To fix this the idea is to use a batching wrapper to amortize the locking > contention. > The trick i a common way to amortize locking as explained here > http://www.ece.eng.wayne.edu/~sjiang/pubs/papers/ding-09-BP-Wrapper.pdf -- This message was sent by Atlassian Jira (v8.3.4#803005)
