Chetan Mehrotra created OAK-5472:
------------------------------------

             Summary: Use relaxed write concern for document deletion
                 Key: OAK-5472
                 URL: https://issues.apache.org/jira/browse/OAK-5472
             Project: Jackrabbit Oak
          Issue Type: Improvement
          Components: mongomk
            Reporter: Chetan Mehrotra
             Fix For: 1.8


On some setups having w=2 the VersionGC is running slowly taking upto 3-4 hrs 
for ~200k docs 

{noformat}
17.01.2017 05:47:26.845 *INFO* [sling-oak-observation-15098] 
org.apache.jackrabbit.oak.plugins.document.VersionGarbageCollector Revision 
garbage collection finished in 3.783 h. 
VersionGCStats{ignoredGCDueToCheckPoint=false, deletedDocGCCount=191573, 
splitDocGCCount=380, intermediateSplitDocGCCount=32, 
timeToCollectDeletedDocs=3.771 h, timeTakenToDeleteDeletedDocs=40.35 s, 
timeTakenToCollectAndDeleteSplitDocs=1.487 s}
16.01.2017 04:14:26.001 *INFO* [sling-oak-observation-10770] 
org.apache.jackrabbit.oak.plugins.document.VersionGarbageCollector Revision 
garbage collection finished in 2.236 h. 
VersionGCStats{ignoredGCDueToCheckPoint=false, deletedDocGCCount=260292, 
splitDocGCCount=699, intermediateSplitDocGCCount=53, 
timeToCollectDeletedDocs=2.220 h, timeTakenToDeleteDeletedDocs=55.27 s, 
timeTakenToCollectAndDeleteSplitDocs=2.051 s}
{noformat}

Compared to that as can be seen in OAK-2613 that ~500k docs were being 
collected in ~30 mins. 

I think the increase in time is due to specifying w=2. For deletion it should 
ok to specify a custom write concern of w=1 or more relaxed as consistency here 
is not that critical



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to