[
https://issues.apache.org/jira/browse/OAK-5192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16006202#comment-16006202
]
Chetan Mehrotra commented on OAK-5192:
--------------------------------------
[~mduerig] mentioned that FDS config has minRecordLength of 16KB so binaries
less than 16KB are getting inlined which can possibly explain why the size of
diff is larger i.e. due to large inlined binaries
{noformat}
PID = org.apache.jackrabbit.oak.plugins.blob.datastore.FileDataStore
BundleLocation = Unbound
minRecordLength = 16384
path = /mnt/blobstore
service.pid = org.apache.jackrabbit.oak.plugins.blob.datastore.FileDataStore
{noformat}
> Reduce Lucene related growth of repository size
> -----------------------------------------------
>
> Key: OAK-5192
> URL: https://issues.apache.org/jira/browse/OAK-5192
> Project: Jackrabbit Oak
> Issue Type: Improvement
> Components: lucene, segment-tar
> Reporter: Michael Dürig
> Assignee: Tommaso Teofili
> Labels: perfomance, scalability
> Fix For: 1.8, 1.7.3
>
> Attachments: added-bytes-zoom.png, diff.txt.zip
>
>
> I observed Lucene indexing contributing to up to 99% of repository growth.
> While the size of the index itself is well inside reasonable bounds, the
> overall turnover of data being written and removed again can be as much as
> 99%.
> In the case of the TarMK this negatively impacts overall system performance
> due to fast growing number of tar files / segments, bad locality of
> reference, cache misses/thrashing when looking up segments and vastly
> prolonged garbage collection cycles.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
