Re: Indexing timeout issues with SolrCloud 7.1

2018-03-01 Thread Tom Peters
Thanks Erick. I found an older mailing list thread online where someone had similar issues to what I was experiencing (http://lucene.472066.n3.nabble.com/SolrCloud-delete-by-query-performance-td4206726.html

Re: Indexing timeout issues with SolrCloud 7.1

2018-02-26 Thread Shawn Heisey
On 2/23/2018 2:40 PM, Tom Peters wrote: > I included the last 25 lines from the logs from each of the five nodes during > that time period. Did you perhaps grep for "ERROR" and include the last 25 lines of that?  This excludes the vast majority of the information from the error, information that

Re: Indexing timeout issues with SolrCloud 7.1

2018-02-25 Thread Erick Erickson
DBQ is something of a heavyweight action. Basically in order to preserve ordering it has to lock out updates while it executes since all docs (which may live on all shards) have to be deleted before subsequent adds of one of the affected docs is processed. In order to do that, things need to be loc

Re: Indexing timeout issues with SolrCloud 7.1

2018-02-24 Thread Deepak Goel
>From the error list, i can see multiple errors: 1. Failure to recover replica 2. Peer sync error 3. Failure to download file On 24 Feb 2018 03:10, "Tom Peters" wrote: I included the last 25 lines from the logs from each of the five nodes during that time period. I _think_ I'm running into iss

Re: Indexing timeout issues with SolrCloud 7.1

2018-02-23 Thread Tom Peters
I included the last 25 lines from the logs from each of the five nodes during that time period. I _think_ I'm running into issues with bulking up deleteByQuery. Quick background: we have objects in our system that may have multiple availability windows. So when we index an object, will store it

Re: Indexing timeout issues with SolrCloud 7.1

2018-02-23 Thread Deepak Goel
Can you please post all the errors? The current error is only for the node 'solr-2d' On 23 Feb 2018 09:42, "Tom Peters" wrote: I'm trying to debug why indexing in SolrCloud 7.1 is having so many issues. It will hang most of the time, and timeout the rest. Here's an example: time curl -s 'm

Re: Indexing timeout issues with SolrCloud 7.1

2018-02-23 Thread Rick Leir
Tom I think you are saying that all updates fail? Need to do a bit of troubleshooting. How about queries? What else is in the logs? Cheers -- Rick -- Sorry for being brief. Alternate email is rickleir at yahoo dot com

Indexing timeout issues with SolrCloud 7.1

2018-02-22 Thread Tom Peters
I'm trying to debug why indexing in SolrCloud 7.1 is having so many issues. It will hang most of the time, and timeout the rest. Here's an example: time curl -s 'myhost:8080/solr/mycollection/update/json/docs' -d '{"solr_id":"test_001", "data_type":"test"}'|jq . { "responseHeader"