There is not a silver bullet solution. More handles you allow more
memory is consumed by it and few more CPU cycles are possibly wasted in
maintaining those handles. The low number set by default by most of the
systems is just a precaution to detect leaks of the handles by
applications soon enough and it is safe to increase the number as
necessary if you know the cause of the issue and are sure that it is not
a leak.

The fact that you got the error while indexing the content doesn't
necessarily mean that the indexer is the cause of the problem (just the
unlucky to be the first one requesting file handle when none were left).
Maybe you are using data store or keeping your blobs in FS as well?

Or maybe it is the indexer ... can you look how many subdirectories and
files you have in the index subfolder of each workspace (total count
incl. sub dirs)
IF you have too many in one of the workspaces you can fine tune the
SearchIndexer configuration in your workspace.xml. The parameters you
would want to change are maxMergeDocs and mergeFactor.
MaxMergeDocs controls how many "documents" (not real files, just what
Lucene considers doc in a JR context) are merged together, so you might
want to increase this value to reduce the number of index files created.
Side effects are two: larger index file means more efficient query but
also longer time to generate the index (e.g. it takes longer before
newly added content becomes searchable). The default 100000 is supposed
to be optimal in most cases.
The mergeFactor controls how many index files are compiled into the
segment ... more files in a segment longer it takes to search the
segment, the slower the search will be. Default value is 10.

If you change any of those values you need to delete index in given
workspace and regenerate it.

HTH,
Jan




On Tue, 2010-01-05 at 05:32 -0800, rainer wrote:
> 
> i just saw that the WIKI page is meant for Derby DB Users ... in our case -
> we got the "too many open files" error while indexing of content, running a
> MySQL DB for persistence.
> 
> We had set it to 1024 files - and it was obviously not enough ;)
> If 10000 open files are allowed - it seems to work fine for the moment.
> 
> But what is recommend / or at least needed?
> 
> thx
> rainer
> 
> 
> 
> rainer wrote:
> > 
> > hi,
> > 
> > i have looked here
> > http://wiki.magnolia-cms.com/display/WIKI/Too+Many+Open+Files
> > 
> > but it is not clear what setting is recommended: 400.000 or 5.000?
> > 
> > thx
> > rainer
> > 
> 


----------------------------------------------------------------
For list details see
http://www.magnolia-cms.com/home/community/mailing-lists.html
To unsubscribe, E-mail to: <[email protected]>
----------------------------------------------------------------

Reply via email to