Re: shard query return 500 on large data set

2013-04-19 Thread Dmitry Kan
Can you instead use paging mechanism?


On Thu, Apr 18, 2013 at 8:03 PM, Jie Sun jsun5...@yahoo.com wrote:

 Hi -

 when I execute a shard query like:


 [myhost]:8080/solr/mycore/select?q=type:messagerows=14...qt=standardwt=standardexplainOther=hl.fl=shards=solrserver1:8080/solr/mycore,solrserver2:8080/solr/mycore,solrserver3:8080/solr/mycore

 everything works fine until I query against a large set of data ( 100k
 documents),
 when the number of rows returned exceeds about 50k.

 by the way I am using HttpClient GET method to send the solr shard query
 over.

 In the above scenario, the query fails with a 500 server error as returned
 status code.

 I am using solr 3.5.

 I encountered a 404 before, when one of the shard servers does not have the
 core (404) the whole shard query will return 404 to me; so I expect if one
 of the server encounter a timeout (408?),  the shard query should return
 time out status code?

 I guess I am not sure what will be the shard query results with various
 error scenario... guess i could look into solr code, but if you have any
 input, it will be appreciated. thanks

 Renee



 --
 View this message in context:
 http://lucene.472066.n3.nabble.com/shard-query-return-500-on-large-data-set-tp4057038.html
 Sent from the Solr - User mailing list archive at Nabble.com.



shard query return 500 on large data set

2013-04-18 Thread Jie Sun
Hi -

when I execute a shard query like:

[myhost]:8080/solr/mycore/select?q=type:messagerows=14...qt=standardwt=standardexplainOther=hl.fl=shards=solrserver1:8080/solr/mycore,solrserver2:8080/solr/mycore,solrserver3:8080/solr/mycore
 

everything works fine until I query against a large set of data ( 100k
documents), 
when the number of rows returned exceeds about 50k.

by the way I am using HttpClient GET method to send the solr shard query
over.

In the above scenario, the query fails with a 500 server error as returned
status code.

I am using solr 3.5.

I encountered a 404 before, when one of the shard servers does not have the
core (404) the whole shard query will return 404 to me; so I expect if one
of the server encounter a timeout (408?),  the shard query should return
time out status code? 

I guess I am not sure what will be the shard query results with various
error scenario... guess i could look into solr code, but if you have any
input, it will be appreciated. thanks

Renee



--
View this message in context: 
http://lucene.472066.n3.nabble.com/shard-query-return-500-on-large-data-set-tp4057038.html
Sent from the Solr - User mailing list archive at Nabble.com.