Solr 7.3 suggest dictionary building fails in cloud mode with large number of rows

2018-06-03 Thread Yogendra Kumar Soni
I have 130 million documents and each document has unique document id. I want to build suggester on document id. suggest dictionary building is failing for 130 millions. while testing it was successful with 50 million documents. 8 nodes with 50 GB head for each node and total 600 gb ram heap usag

Re: Mysterious Solr crash

2018-06-03 Thread Shawn Heisey
On 6/3/2018 7:52 AM, Nawab Zada Asad Iqbal wrote: I am running a batch indexing job and Solr core mysteriously shut down without any particular error. How can I investigate this? I am focusing on the line which mentions "Shutting down CoreContainer instance". There are errors soon after that, bu

Re: URL to call ZooKeeper instead of Solr directly in SolrCloud

2018-06-03 Thread Shawn Heisey
On 6/3/2018 10:44 AM, Zheng Lin Edwin Yeo wrote: I am running Solr in Cloud Mode, there is a fault tolerant ZK setup. I understand that we can use CloudSolrClient, and it will automatically adjust when servers go down. However, I would like to check if there is a way for this to work if we are u

Re: Mysterious Solr crash

2018-06-03 Thread Stephen Lewis
*update, not impasse (apologies) On Sun, Jun 3, 2018, 12:19 PM Stephen Lewis wrote: > And early EOF in the middle of an impasse usually indicates a timeout > either from client to server or between servers in an update chain. Try > increasing the timeout. > > On Sun, Jun 3, 2018, 9:57 AM Andrea

Re: Mysterious Solr crash

2018-06-03 Thread Stephen Lewis
And early EOF in the middle of an impasse usually indicates a timeout either from client to server or between servers in an update chain. Try increasing the timeout. On Sun, Jun 3, 2018, 9:57 AM Andrea Gazzarini wrote: > Looking at the stack trace, which seem truncated, I would start from here >

Building features in solr

2018-06-03 Thread Roee T
Hi all, I am trying to compute feature values for some features. i need some examples on how to form the following features in the feature file and if needed in the URL: 1. number of overlapping terms between the query and another field (the document). 2. query likelihood probability. 3. maximum

Re: Mysterious Solr crash

2018-06-03 Thread Andrea Gazzarini
Looking at the stack trace, which seem truncated, I would start from here o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: Early EOF at org.apache.solr.handler.loader.XMLLoader.load(XMLLoader.java:190) Could you please expand a bit your context (e.g. solr version, cloud /

URL to call ZooKeeper instead of Solr directly in SolrCloud

2018-06-03 Thread Zheng Lin Edwin Yeo
Hi, I am running Solr in Cloud Mode, there is a fault tolerant ZK setup. I understand that we can use CloudSolrClient, and it will automatically adjust when servers go down. However, I would like to check if there is a way for this to work if we are using URL from browser? Is there any URL that

Re: Mysterious Solr crash

2018-06-03 Thread Zheng Lin Edwin Yeo
Hi, Which version of Solr are you running on? And also, are you running on SolrCloud or Standalone Solr? Regards, Edwin On 3 June 2018 at 21:52, Nawab Zada Asad Iqbal wrote: > Good morning > > I am running a batch indexing job and Solr core mysteriously shut down > without any particular error

Mysterious Solr crash

2018-06-03 Thread Nawab Zada Asad Iqbal
Good morning I am running a batch indexing job and Solr core mysteriously shut down without any particular error. How can I investigate this? I am focusing on the line which mentions "Shutting down CoreContainer instance". There are errors soon after that, but they seemed to be caused by the core