[
https://issues.apache.org/jira/browse/SOLR-4941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15242322#comment-15242322
]
David Smiley commented on SOLR-4941:
------------------------------------
Before I go file a new issue, I at least want to comment here to see what you
think [~hossman] and of course anyone else who may notice ( [~cpoerschke]
touched this stuff too I think?). I claim that "useCompoundFile" in
solrconfig.xml (directly within <indexConfig>) is named in a way that is
misleading, and Solr chooses a default that is not ideal.
<useCompoundFile> is only about flushed segments from newly indexed documents,
yet its setting name doesn't reflect it's limited to just those new segments.
We don't even say this in comments or the ref guide (I'll happily fix this). I
can understand how this came to be, it's mimicking a like-setting in Lucene
IndexWriter which arguably is also misleading for the same reason. But I don't
think we need to mimick the name Lucene chose. I could propose alternative
names but I just want to throw this statement out there to see if it resonates
or not.
Secondly, note that Solr defaults to useCompoundFile=false; Lucene does true.
Given a merge policy with a noCFSRatio of > 0 (by default we use
TieredMergePolicy which uses 0.1), merged segments with fewer than 10% of the
index will become CFS. This is a schizophrenic configuration! Segments start
off non-CFS, then get merged to CFS (assuming it's still small enough), and
then eventually become non-CFS again. It flipped back then forth. That's
weird. Instead, I propose that only if noCFSRatio is 0, _then_ default
useCompoundFile to false since it'll never flip-flop. Otherwise, default
useCompoundFile=true (which given default MP settings, this will generally be
the case).
Make sense?
> useCompoundFile default has changed, simple config option no longer seems to
> work
> ---------------------------------------------------------------------------------
>
> Key: SOLR-4941
> URL: https://issues.apache.org/jira/browse/SOLR-4941
> Project: Solr
> Issue Type: Bug
> Reporter: Hoss Man
> Assignee: Hoss Man
> Fix For: 4.4, master
>
> Attachments: SOLR-4941.patch, SOLR-4941.patch, infostream.txt
>
>
> Spin off of SOLR-4934. We should updated tests to ensure that the various
> ways of specifying useCompoundFile as well as the expected default are
> working properly after LUCENE-5038
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
