Barry Oglesby created GEODE-6186:
------------------------------------
Summary: Reduce the number of EntryNotFoundExceptions during
AsyncEventQueue batch processing with conflation enabled
Key: GEODE-6186
URL: https://issues.apache.org/jira/browse/GEODE-6186
Project: Geode
Issue Type: Bug
Components: wan
Reporter: Barry Oglesby
Reduce the number of EntryNotFoundExceptions during AsyncEventQueue batch
processing with conflation enabled
This test:
3000 iterations of putAlls with the same 1500 keys into a partitioned region
attached to async-event-queue:
<async-event-queue id="test" batch-size="100000" batch-time-interval="250"
dispatcher-threads="1" parallel="true" enable-batch-conflation="true">
Produces these numbers in the current code (4 different runs):
{noformat}
numBatches=645; numENFEs=8622196; totalPeekTime=178517; averagePeekTime=276;
totalProcessBatchTime=38936; averageProcessBatchTime=60
numBatches=660; numENFEs=8467986; totalPeekTime=182985; averagePeekTime=277;
totalProcessBatchTime=34335; averageProcessBatchTime=52
numBatches=646; numENFEs=8563364; totalPeekTime=179624; averagePeekTime=278;
totalProcessBatchTime=37342; averageProcessBatchTime=57
numBatches=632; numENFEs=8716942; totalPeekTime=175570; averagePeekTime=277;
totalProcessBatchTime=39732; averageProcessBatchTime=62
{noformat}
After some changes mainly in BucketRegionQueue:
{noformat}
numBatches=782; numENFEs=3621039; totalPeekTime=195760; averagePeekTime=250;
totalProcessBatchTime=18724; averageProcessBatchTime=23
numBatches=791; numENFEs=3604933; totalPeekTime=197980; averagePeekTime=250;
totalProcessBatchTime=18587; averageProcessBatchTime=23
numBatches=790; numENFEs=3600038; totalPeekTime=197774; averagePeekTime=250;
totalProcessBatchTime=18611; averageProcessBatchTime=23
numBatches=795; numENFEs=3584490; totalPeekTime=199060; averagePeekTime=250;
totalProcessBatchTime=18063; averageProcessBatchTime=22
{noformat}
numBatches is the number of batches peeked
numENFEs is the number of EntryNotFoundExceptions thrown
totalPeekTime is the total time to peek all batches
averagePeekTime is the average time to peek a batch
totalProcessBatchTime is the total time to process all batches
averageProcessBatchTime is the average time to process a batch (includes
listener callback and remove from queue)
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
