[jira] [Work logged] (ARTEMIS-2224) Reduce contention on LivePageCacheImpl

Thu, 17 Jan 2019 00:38:40 -0800 


     [ 
https://issues.apache.org/jira/browse/ARTEMIS-2224?focusedWorklogId=186220&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-186220
 ]

ASF GitHub Bot logged work on ARTEMIS-2224:
-------------------------------------------

                Author: ASF GitHub Bot
            Created on: 17/Jan/19 08:37
            Start Date: 17/Jan/19 08:37
    Worklog Time Spent: 10m 
      Work Description: qihongxu commented on issue #2494: ARTEMIS-2224 Reduce 
contention on LivePageCacheImpl
URL: https://github.com/apache/activemq-artemis/pull/2494#issuecomment-455086939
 
 
   @franz1981 
   Here's the result of single and 400 consumers.
   With these settings applied: 
   max-size-bytes = 950MB, 
   page-size = 900MB, 
   Produced 2,000,000 msgs in a new queue (make it a ~700MB page file as 
‘livePage’ + 950MB in journal), then closed producer, started consumer.
   
   **single consumer: avg 1k tps**
   ![1 consumer 1k 
tps](https://user-images.githubusercontent.com/10609615/51303793-6afb6e00-1a71-11e9-9228-e15c48a66c59.png)
   
   **400 consumers: avg 5.3k tps**
   ![400 consumer 5 4k 
tps](https://user-images.githubusercontent.com/10609615/51303961-dd6c4e00-1a71-11e9-9c48-75b7fd81e342.png)
   
   Their flamegraphes are similar like this.
   
![image](https://user-images.githubusercontent.com/10609615/51304005-012f9400-1a72-11e9-98e9-44dedccb0f6d.png)
   
   As we can see `getChunkOf(index, lastIndex)` is most costy in both cases, 
and 400 consumers didn't perform better than 200. Also, we found that once most 
journal msgs have been consumed and all paged msgs loaded to memory, tps can 
rocket to 30k just like we have shown in other tests before.  
   
 
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


Issue Time Tracking
-------------------

    Worklog Id:     (was: 186220)
    Time Spent: 3.5h  (was: 3h 20m)

> Reduce contention on LivePageCacheImpl
> --------------------------------------
>
>                 Key: ARTEMIS-2224
>                 URL: https://issues.apache.org/jira/browse/ARTEMIS-2224
>             Project: ActiveMQ Artemis
>          Issue Type: Improvement
>          Components: Broker
>    Affects Versions: 2.7.0
>            Reporter: Francesco Nigro
>            Assignee: Francesco Nigro
>            Priority: Major
>          Time Spent: 3.5h
>  Remaining Estimate: 0h
>
> Has been measured that LIvePageCacheImpl operations are a source of 
> contention on producer side while paging. 
> This contention decrease the scalability of the broker in an evident way 
> while using topics, because the page cache is been accessed concurrently by 
> several producers to ack transactions while the messages are being appended.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to