Hoss Man created SOLR-4589:
------------------------------

             Summary: 4.x + enableLazyFieldLoading + large nultivalued fields + 
varying fl = pathalogical CPU load & response time
                 Key: SOLR-4589
                 URL: https://issues.apache.org/jira/browse/SOLR-4589
             Project: Solr
          Issue Type: Bug
    Affects Versions: 4.2, 4.1, 4.0
            Reporter: Hoss Man


Following up on a [user report of exterme CPU usage in 
4.1|http://mail-archives.apache.org/mod_mbox/lucene-solr-user/201302.mbox/%[email protected]%3E],
 I've discovered that the following combination of factors can result in 
extreme CPU usage and excessively HTTP response times...

* Solr 4.x (tested 3.6.1, 4.0.0, and 4.2.0)
* enableLazyFieldLoading == true (included in example solrconfig.xml)
* documents with a large number of values in multivalued fields (eg: tested 
~10-15K values)
* multiple requests returning the same doc with different "fl" lists

I haven't dug into the route cause yet, but the essential observations is: if 
lazyloading is used in 4.x, then once a document has been fetched with an 
initial fl list X, subsequent requests for that document using a differnet fl 
list Y can be many orders of magnitute slower (while pegging the CPU) -- even 
if those same requests using fl Y uncached (or w/o lazy laoding) would be 
extremely fast.


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to