Hoss Man created SOLR-4589:
------------------------------
Summary: 4.x + enableLazyFieldLoading + large nultivalued fields +
varying fl = pathalogical CPU load & response time
Key: SOLR-4589
URL: https://issues.apache.org/jira/browse/SOLR-4589
Project: Solr
Issue Type: Bug
Affects Versions: 4.2, 4.1, 4.0
Reporter: Hoss Man
Following up on a [user report of exterme CPU usage in
4.1|http://mail-archives.apache.org/mod_mbox/lucene-solr-user/201302.mbox/%[email protected]%3E],
I've discovered that the following combination of factors can result in
extreme CPU usage and excessively HTTP response times...
* Solr 4.x (tested 3.6.1, 4.0.0, and 4.2.0)
* enableLazyFieldLoading == true (included in example solrconfig.xml)
* documents with a large number of values in multivalued fields (eg: tested
~10-15K values)
* multiple requests returning the same doc with different "fl" lists
I haven't dug into the route cause yet, but the essential observations is: if
lazyloading is used in 4.x, then once a document has been fetched with an
initial fl list X, subsequent requests for that document using a differnet fl
list Y can be many orders of magnitute slower (while pegging the CPU) -- even
if those same requests using fl Y uncached (or w/o lazy laoding) would be
extremely fast.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]