Core is not getting loaded with copied index.

Hi, I indexed few documents under a core of Solr 4.6.1 instance deployed on Tomcat and copied the same index to other Solr instance with a core having same configurations. Before copying the index, source Solr instance was stopped. But when I start the other instance with the copied index it

Re: Core is not getting loaded with copied index.

corename at org.apache.solr.core.SolrCore.init(SolrCore.java:834) at org.apache.solr.core.SolrCore.init(SolrCore.java:625) Thanks, Modassar On Mon, Apr 14, 2014 at 11:08 AM, Shawn Heisey s...@elyograg.org wrote: On 4/13/2014 10:05 PM, Modassar Ather wrote: I indexed few

Re: Core is not getting loaded with copied index.

...@elyograg.org wrote: On 4/14/2014 10:25 PM, Modassar Ather wrote: Caused by: org.apache.lucene.store.LockObtainFailedException: Lock obtain timed out: NativeFSLock@path/data/index/write.lock: java.io.FileNotFoundException: path/data/index/write.lock (Permission denied) This sounds like

Adding router.field property to an existing collection.

Hi, I have a setup of two shard with embedded zookeeper and one collection on two tomcat instances. I cannot use uniqueKey i.e the compositeId routing for document routing as per my understanding it will change the uniqueKey. There is another way mentioned on Solr wiki is by using router.field. I

Search results not as expected.

Hi, I have two documents indexed. With following query I am getting a search result based on AND clauses. *ab:(system entity)* : Number of results returned 1, as expected. *ab:(system entity)* *AND ab:authorization* : Number of results returned 1, as expected. But following query returns a

Re: Adding router.field property to an existing collection.

?action=CREATEname=my_collectionrouter.name=implicitrouter.field=shard_name Good luck, Damien On 05/06/2014 05:59 AM, Modassar Ather wrote: Hi, I have a setup of two shard with embedded zookeeper and one collection on two tomcat instances. I cannot use uniqueKey i.e the compositeId

Re: Search results not as expected.

Thanks for the details Chris. Regards, Modassar On Fri, Jun 27, 2014 at 3:33 AM, Chris Hostetter hossman_luc...@fucit.org wrote: : *ab:(system entity) OR ab:authorization* : Number of results returned 2 : which is not expected. : It seems this query makes the previous terms as OR if the

Parallel optimize of index on SolrCloud.

Hi, Need to optimize index created using CloudSolrServer APIs under SolrCloud setup of 3 instances on separate machines. Currently it optimizes sequentially if I invoke cloudSolrServer.optimize(). To make it parallel I tried making three separate HttpSolrServer instances and invoked

Re: Parallel optimize of index on SolrCloud.

reindex every night. If you need Solr Cloud, I cannot think of a situation where you would want a forced merge. wunder On Jul 8, 2014, at 2:01 AM, Modassar Ather modather1...@gmail.com wrote: Hi, Need to optimize index created using CloudSolrServer APIs under SolrCloud setup of 3

Re: Parallel optimize of index on SolrCloud.

, forced merges have usually caused problems. Stop doing forced merges. wunder On Jul 8, 2014, at 10:09 PM, Modassar Ather modather1...@gmail.com wrote: Thanks Walter for your inputs. Our use case and performance benchmark requires us to invoke optimize. Here we see a chance

Re: Parallel optimize of index on SolrCloud.

manual sharding. wunder On Jul 8, 2014, at 10:55 PM, Modassar Ather modather1...@gmail.com wrote: Our index has almost 100M documents running on SolrCloud of 3 shards and each shard has an index size of about 700GB (for the record, we are not using stored fields - our documents

Modifying date format when using TrieDateField.

Hi, I have a TrieDateField where I want to store a date in -MM-dd format as my source contains the date in same format. As I understand TrieDateField stores date in -MM-dd'T'HH:mm:ss format hence the date is getting formatted to the same. Kindly let me know: How can I change the

Re: Modifying date format when using TrieDateField.

-Original Message- From: Modassar Ather Sent: Tuesday, August 12, 2014 7:24 AM To: solr-user@lucene.apache.org Subject: Modifying date format when using TrieDateField. Hi, I have a TrieDateField where I want to store a date in -MM-dd format as my source contains the date in same

Re: Modifying date format when using TrieDateField.

a DocTransformer to change it on the way out. You cannot change the way the dates are stored internally. The DateTransformer is just there to allow different inputs, it has no effect on the stored data at all. Best, Erick On Tue, Aug 12, 2014 at 5:33 AM, Modassar Ather modather1...@gmail.com

Log message zkClient has disconnected.

Hi, I am getting following INFO log messages many a times during my indexing. The indexing process read records from database and using multiple threads sends them for indexing in batches. There are four shards and one embedded Zookeeper on one of the shards.

Re: unable to build solr 4.10.1

The following link might help. https://wiki.apache.org/solr/HowToCompileSolr You might need to run ant ivy-bootstrap as described in the link above. On Tue, Oct 28, 2014 at 12:20 PM, Karunakar Reddy karunaka...@gmail.com wrote: Hi Martin, Thanks for your quick response. Yes specified file is

Re: Log message zkClient has disconnected.

will necessarily suffer. Re Will -Original Message- From: Modassar Ather [mailto:modather1...@gmail.com] Sent: Tuesday, October 28, 2014 2:12 AM To: solr-user@lucene.apache.org Subject: Log message zkClient has disconnected. Hi, I am getting following INFO log messages many a times during

Re: Log message zkClient has disconnected.

Thanks Shawn for your response and the link of GC tuning. Regards, Modassar On Tue, Oct 28, 2014 at 7:01 PM, Shawn Heisey apa...@elyograg.org wrote: On 10/28/2014 1:48 AM, Modassar Ather wrote: These Solrcloud instances are 8-core machines with a RAM of 24 GB each assigned to tomcat

edismax and default boolean operator.

Hi, The default boolean operator is hard-coded in ExtendedDismaxQParser. Solr version is 4.10.1. Below is the code snippet from ExtendedDismaxQParser. public ExtendedSolrQueryParser(QParser parser, String defaultField) { super(parser, defaultField); // don't trust that our parent

Solr server becomes non-responsive.

Hi, I have a setup of 4 shard Solr cluster with embedded zookeeper on one of them. The zkClient time out is set to 30 seconds, -Xms is 20g and -Xms is 24g. When executing a huge query with many wildcards inside it the server crashes and becomes non-responsive. Even the dashboard does not responds

Re: Solr server becomes non-responsive.

To add to the details of above issue the query as soon it is executed, even before the OutOfMemory error causes the solr servers to become non-responsive. On Tue, Dec 23, 2014 at 5:04 PM, Modassar Ather modather1...@gmail.com wrote: Hi, I have a setup of 4 shard Solr cluster with embedded

Re: Solr server becomes non-responsive.

large with many unique terms it's even worse, but you haven't really told us about that yet. Best, Erick On Tue, Dec 23, 2014 at 8:30 AM, Shawn Heisey apa...@elyograg.org wrote: On 12/23/2014 4:34 AM, Modassar Ather wrote: Hi, I have a setup of 4 shard Solr cluster

Re: Solr server becomes non-responsive.

, …? How are configured cache in solrconfig.xml ? What are the size attribute value for each cache ? Can you provide a sample of the query ? Does it fail immediately after solrcloud startup or after several hours ? Dominique 2014-12-24 6:20 GMT+01:00 Modassar Ather modather1

Re: Solr server becomes non-responsive.

I've seen people insist on entering queries that wildcarded _everything_ both pre and post wildcards because they didn't realize that Solr tokenizes... Once you hit an OOM, all bets are off as Shawn outlined. Best, Erick On Wed, Dec 24, 2014 at 1:57 AM, Modassar Ather modather1...@gmail.com

Re: Solr server becomes non-responsive.

at 1:02 AM, Modassar Ather modather1...@gmail.com wrote: Thanks for your suggestions Erick. This may be one of those situations where you really have to push back at the users and understand why they insist on these kinds of queries. They must be very patient since it won't be very

Re: Solr server becomes non-responsive.

Hi, In the query having lots of wildcard can we put a limitation on number of expansion of terms done against a wildcard token something like maxBooleanClauses? Thanks, Modassar On Mon, Dec 29, 2014 at 11:15 AM, Modassar Ather modather1...@gmail.com wrote: Thanks Jack for your suggestions

Re: Solr server becomes non-responsive.

On Tue, Dec 30, 2014 at 6:16 AM, Modassar Ather modather1...@gmail.com wrote: Hi, In the query having lots of wildcard can we put a limitation on number of expansion of terms done against a wildcard token something like maxBooleanClauses? Thanks, Modassar On Mon, Dec 29, 2014

Re: WordDelimiterFilterFactory and position increment.

Hi, No I am not using WordDelimiterFilter on query side. Regards, Modassar On Fri, Jan 30, 2015 at 5:12 PM, Dmitry Kan solrexp...@gmail.com wrote: Hi, Do you use WordDelimiterFilter on query side as well? On Fri, Jan 30, 2015 at 12:51 PM, Modassar Ather modather1...@gmail.com wrote

WordDelimiterFilterFactory and position increment.

Hi, I am using WordDelimiterFilter while indexing. Parser used is edismax. Phrase search is failing for terms like 3d image. On the analysis page it shows following four tokens for *3d* and there positions. *token position* 3d 1 3 1 3d 1 d

Regarding behavior of docValues.

Hi, Kindly help me understand the behavior of following field. field name=manu_exact type=string indexed=true stored=false docValues=true / For a field like above where indexed=true and docValues=true, is it that: 1) For sorting/faceting on *manu_exact* the docValues will be used. 2) For

Re: Regarding behavior of docValues.

Thanks for your response Mikhail. On Tue, Feb 24, 2015 at 5:35 PM, Mikhail Khludnev mkhlud...@griddynamics.com wrote: Both statements seem true to me. On Tue, Feb 24, 2015 at 2:49 PM, Modassar Ather modather1...@gmail.com wrote: Hi, Kindly help me understand the behavior of following

Re: Regarding behavior of docValues.

if you want a rule of thumb, make it a docValues field if you're updating your index rapidly. Otherwise whether a field is docValues or not is largely irrelevant. Best, Erick On Tue, Feb 24, 2015 at 9:09 PM, Modassar Ather modather1...@gmail.com wrote: So for a requirement where I have

Re: Regarding behavior of docValues.

in a conveniently-loadable form. So AFAIK, the field is stored only once and used for all three, sorting, faceting and searching. Best, Erick On Tue, Feb 24, 2015 at 4:13 AM, Modassar Ather modather1...@gmail.com wrote: Thanks for your response Mikhail. On Tue, Feb 24, 2015 at 5:35

Re: WordDelimiterFilterFactory and position increment.

Hi, An insight in the behavior of WordDelimiterFilter will be very helpful. Please share your inputs. Thanks, Modassar On Thu, Jan 22, 2015 at 2:54 PM, Modassar Ather modather1...@gmail.com wrote: Hi, I am using WordDelimiterFilter while indexing. Parser used is edismax. Phrase search

Nno servers hosting shard.

Hi, I have a setup of 5 node SolrCloud (Lucene/Solr version 5.1.0) without replicas. When I am executing complex and large queries with wild-cards after some time I am getting following exceptions. The index size on each of the node is around 170GB and the memory is set to -Xms20g -Xmx24g on each

Re: Nno servers hosting shard.

Hi, Any suggestion will be really helpful. Kindly provide your inputs. Thanks, Modassar On Thu, Apr 16, 2015 at 4:27 PM, Modassar Ather modather1...@gmail.com wrote: Hi, I have a setup of 5 node SolrCloud (Lucene/Solr version 5.1.0) without replicas. When I am executing complex and large

Sorting and grouping performance.

Hi, I have 4 node SolrCloud without replicas with solr-4-10-3. If I add a 5th node (i.e 5 node SolrCloud without replicas) and do a re-indexing kindly let me know: What effect we can expect in sorting and grouping performance as compared to 4 node SolrCloud VS 5 node SolrCloud? The document is

Re: Index optimize runs in background.

Hi, Please provide your inputs on optimize and commit running as background. Your suggestion will be really helpful. Thanks, Modassar On Tue, Jun 2, 2015 at 6:05 PM, Modassar Ather modather1...@gmail.com wrote: Erick! I could not find any underlying setting of 10 minutes. It is not only

Re: Index optimize runs in background.

On Thu, Jun 4, 2015 at 3:17 AM, Modassar Ather modather1...@gmail.com wrote: Hi, Please provide your inputs on optimize and commit running as background. Your suggestion will be really helpful. Thanks, Modassar On Tue, Jun 2, 2015 at 6:05 PM, Modassar Ather modather1...@gmail.com

Re: Index optimize runs in background.

On Wed, May 27, 2015 at 4:00 AM, Upayavira u...@odoko.co.uk wrote: In this case, optimising makes sense, once the index is generated, you are not updating It. Upayavira On Wed, May 27, 2015, at 06:14 AM, Modassar Ather wrote: Our index has almost 100M documents running on SolrCloud

Re: Index optimize runs in background.

Shot in the dark. Erick On Thu, May 28, 2015 at 10:31 PM, Modassar Ather modather1...@gmail.com wrote: I could not notice it but with my past experience of commit which used to take around 2 minutes is now taking around 8 seconds. I think this is also running as background

Re: Index optimize runs in background.

I could not notice it but with my past experience of commit which used to take around 2 minutes is now taking around 8 seconds. I think this is also running as background. On Fri, May 29, 2015 at 10:52 AM, Modassar Ather modather1...@gmail.com wrote: The indexer takes almost 2 hours to optimize

Re: Index optimize runs in background.

). 8,000 cycles later there aren't any problems reported. Siiigh. On Tue, May 26, 2015 at 1:51 AM, Modassar Ather modather1...@gmail.com wrote: Hi, Erick you mentioned about a unit test to test the optimize running in background. Kindly share your findings if any. Thanks, Modassar

Re: Index optimize runs in background.

...@gmail.com wrote: I'm not talking about you setting a timeout, but the underlying connection timing out... The 10 minutes then the indexer exits comment points in that direction. Best, Erick On Thu, May 28, 2015 at 11:43 PM, Modassar Ather modather1...@gmail.com wrote: I have

Re: Index optimize runs in background.

PM, Shawn Heisey wrote: On 5/21/2015 6:21 AM, Modassar Ather wrote: I am using Solr-5.1.0. I have an indexer class which invokes cloudSolrClient.optimize(true, true, 1). My indexer exits after the invocation of optimize and the optimization keeps on running in the background. Kindly

Re: Index optimize runs in background.

Hi, Erick you mentioned about a unit test to test the optimize running in background. Kindly share your findings if any. Thanks, Modassar On Mon, May 25, 2015 at 11:47 AM, Modassar Ather modather1...@gmail.com wrote: Thanks everybody for your replies. I have noticed the optimization running

Index optimize runs in background.

Hi, I am using Solr-5.1.0. I have an indexer class which invokes cloudSolrClient.optimize(true, true, 1). My indexer exits after the invocation of optimize and the optimization keeps on running in the background. Kindly let me know if it is per design and how can I make my indexer to wait until

Re: Index optimize runs in background.

Hi An insight on the question will be really helpful. Thanks, Modassar On Thu, May 21, 2015 at 5:51 PM, Modassar Ather modather1...@gmail.com wrote: Hi, I am using Solr-5.1.0. I have an indexer class which invokes cloudSolrClient.optimize(true, true, 1). My indexer exits after

Re: Clarification on WordDelimiterFilter.

: Modassar Ather [mailto:modather1...@gmail.com] Sent: Friday, August 07, 2015 12:21 AM To: solr-user@lucene.apache.org Subject: Re: Clarification on WordDelimiterFilter. Hi, Any suggestion will be really helpful. Kindly provide your inputs. Thanks, Modassar On Thu, Aug 6, 2015 at 2:06 PM

Re: Query time out. Solr node goes down.

of things to do, so our settings are probably not that relevant. On 18 August 2015 at 09:04, Toke Eskildsen t...@statsbiblioteket.dk wrote: On Tue, 2015-08-18 at 10:38 +0530, Modassar Ather wrote: Kindly help me understand, even if there is a a GC pause why the solr node will go down

Re: Query time out. Solr node goes down.

collection.Please provide your inputs. On Tue, Aug 18, 2015 at 10:38 AM, Modassar Ather modather1...@gmail.com wrote: Shawn! The container I am using is jetty only and the JVM setting I am using is the default one which comes with Solr startup scripts. Yes I have changed the JVM memory setting

Re: Query time out. Solr node goes down.

reported in the logs (e.g. OutOfMemoryError)? On Mon, Aug 17, 2015, at 12:29 PM, Modassar Ather wrote: Hi, I have a Solr cluster which hosts around 200 GB of index on each node and are 6 nodes. Solr version is 5.2.1. When a huge query is fired, it times out *(The request took too long

Query time out. Solr node goes down.

Hi, I have a Solr cluster which hosts around 200 GB of index on each node and are 6 nodes. Solr version is 5.2.1. When a huge query is fired, it times out *(The request took too long to iterate over terms.)*, which I can see in the log but at same time the one of the Solr node goes down and the

Re: Query time out. Solr node goes down.

that, I'd expect that to improve performance, not to cause JVM crashes. It might also help to know what version of Java you are running. Upayavira On Mon, Aug 17, 2015, at 12:45 PM, Modassar Ather wrote: The servers have 32g memory each. Solr JVM memory is set to -Xms20g -Xmx24g

Re: Query time out. Solr node goes down.

timeout), the JVM stops, the whole machine crashes? On 17 August 2015 at 14:17, Shawn Heisey apa...@elyograg.org wrote: On 8/17/2015 5:45 AM, Modassar Ather wrote: The servers have 32g memory each. Solr JVM memory is set to -Xms20g -Xmx24g. There are no OOM in logs. Are you starting Solr

Re: Exception while using {!cardinality=1.0}.

Any suggestions please. Regards, Modassar On Thu, Aug 13, 2015 at 4:25 PM, Modassar Ather modather1...@gmail.com wrote: Hi, I am getting following exception for the query : *q=field:querystats=truestats.field={!cardinality=1.0}field*. The exception is not seen once the cardinality is set

Re: Exception while using {!cardinality=1.0}.

Ahmet/Chris! Thanks for your replies. Ahmet I think net.agkn.hll.serialization is used by hll() function implementation of Solr. Chris I will try to create sample data and create a jira ticket with details. Regards, Modassar On Tue, Aug 18, 2015 at 9:58 PM, Chris Hostetter

Re: Exception while using {!cardinality=1.0}.

Hi Chris, I have added a method in SOLR-7954 jira ticket to index sample data which can be used to reproduce the issue. Regards, Modassar On Fri, Aug 21, 2015 at 11:49 AM, Modassar Ather modather1...@gmail.com wrote: Hi Chris, I have raised https://issues.apache.org/jira/browse/SOLR-7954

Re: How to add second Zookeeper to same machine?

You might want to look into the following documentation. These documents have explanation on how to setup Zookeeper ensemble and Zookeeper administration. https://cwiki.apache.org/confluence/display/solr/Setting+Up+an+External+ZooKeeper+Ensemble

Re: How to configure solr to not bind at 8983

I think you need to add the port number in solr.xml too under hostPort attribute. STOP.PORT is SOLR.PORT-1000 and set under SOLR_HOME/bin/solr file. As far as I understand this can not be changed but I am not sure. Regards, Modassar On Thu, Aug 20, 2015 at 11:39 AM, Samy Ateia

Re: Exception while using {!cardinality=1.0}.

given with stats.field={!cardinality=1.0}field. Regards, Modassar On Wed, Aug 19, 2015 at 10:24 AM, Modassar Ather modather1...@gmail.com wrote: Ahmet/Chris! Thanks for your replies. Ahmet I think net.agkn.hll.serialization is used by hll() function implementation of Solr. Chris I will try

Re: Exception while using {!cardinality=1.0}.

re-review the code configs you posted and see if you can reproduce using the *exact* same data in two different fields, and if the choice of query makes a differnce in the behavior you see. : : Regards, : Modassar : : On Wed, Aug 19, 2015 at 10:24 AM, Modassar Ather modather1...@gmail.com

Re: Zookeeper state and its effect on Solr cluster.

, Modassar Ather wrote: If we upgrade zookeeper we need to restart. This upgrade process is automated for future releases/changes of zookeeper. This is a single external zookeeper which is completely stopped/shutdown. No Solr node are restarted/shutdown. What I have understanding that even

Re: Count of distinct values in faceting.

Please read docVlaues as docValues in my mail above. Regards, Modassar On Tue, Aug 11, 2015 at 4:01 PM, Modassar Ather modather1...@gmail.com wrote: Hi, Count of distinct values can be retrieved by following ways. Please note that the Solr version is 5.2.1. 1. Using cardinality=true. 2

Count of distinct values in faceting.

Hi, Count of distinct values can be retrieved by following ways. Please note that the Solr version is 5.2.1. 1. Using cardinality=true. 2. Using hll() facet function. Kindly help me understand: 1. How accurate are them comparatively and better performance wise with millions of documents? 2.

Re: Clarification on WordDelimiterFilter.

Hi, Any suggestion will be really helpful. Kindly provide your inputs. Thanks, Modassar On Thu, Aug 6, 2015 at 2:06 PM, Modassar Ather modather1...@gmail.com wrote: I am using WordDelimiterFilter while indexing and searching both with the following attributes. Parser used is edismax. Solr

Re: Renaming Solr webapp in release 5.2.1

May be you can look at solr-jetty-context.xml present under server/context folder of solr. Regards, Modassar On Mon, Aug 10, 2015 at 2:42 PM, saurabh tewari saurabh.iitc...@gmail.com wrote: Hi, Is there any way through which one can change the name of solr webapp? I used to name my

Clarification on WordDelimiterFilter.

I am using WordDelimiterFilter while indexing and searching both with the following attributes. Parser used is edismax. Solr version is 5.2.1. *filter class=solr.WordDelimiterFilterFactory generateWordParts=1 generateNumberParts=1 catenateWords=1 catenateNumbers=1 catenateAll=1

Zookeeper state and its effect on Solr cluster.

Hi, Kindly help me understand following with respect to Solr version 5.2.1. 1. What happens to the solr cluster if the standalone external zookeeper is stopped/restarted with some changes done in zoo_data during the restart? E.g After restarting the zookeeper the solr configs are reloaded

Re: Zookeeper state and its effect on Solr cluster.

, Modassar On Mon, Jul 27, 2015 at 8:45 PM, Shawn Heisey apa...@elyograg.org wrote: On 7/27/2015 6:17 AM, Modassar Ather wrote: Kindly help me understand following with respect to Solr version 5.2.1. 1. What happens to the solr cluster if the standalone external zookeeper is stopped/restarted

Re: Zookeeper state and its effect on Solr cluster.

, after restart the Solr nodes should come insync with the ZK state. Please correct me if I am wrong. On Tue, Jul 28, 2015 at 10:22 AM, Shawn Heisey apa...@elyograg.org wrote: On 7/27/2015 10:21 PM, Modassar Ather wrote: Erick I am using the ZK upload process only. It is just that it is added

Re: Zookeeper state and its effect on Solr cluster.

that's well established and tested for maintaining the Solr specific data? Best, Erick On Mon, Jul 27, 2015 at 9:48 AM, Modassar Ather modather1...@gmail.com wrote: Thanks for your response Erick and Shawn. We had automated the solr/zookeeper future upgrades using scripts. So for any

Re: Exception in grouping with docValues enable field.

Hi, Any input will be really helpful. Regards, Modassar On Fri, Nov 6, 2015 at 11:20 AM, Modassar Ather <modather1...@gmail.com> wrote: > Hi, > > I have following docValues enabled field. > > *Field : * > *Type: * sortMissingLast="true" stored="

Re: Solr Cloud and Multiple Indexes

ter in some > sense, such as performance? > > Which version of solr are you using? > Currently, I am using Solr 5.3. btw, I could not find segment info link. Is > it under Core Admin? > > Regards, > Salman > > > On Fri, Nov 6, 2015 at 7:26 AM, Modassar Ather <modat

Re: Exception in grouping with docValues enable field.

similar. You also did not mention the version of Solr. > > Regards, >Alex. > > Solr Analyzers, Tokenizers, Filters, URPs and even a newsletter: > http://www.solr-start.com/ > > > On 8 November 2015 at 22:59, Modassar Ather <modather1...@gmail.com> > w

Re: [Help]Solr_Not_Responding

The information given is not sufficient to conclude a cause. You can check the solr logs for details for any exception. Regards, Modassar On Fri, Oct 30, 2015 at 10:12 AM, Franky Parulian Silalahi < fra...@telunjuk.com> wrote: > I have problem with my solr and i run in centos 7. > sometime my

Re: warning

wrote: > Thanks Modassar for replying , > > could u please elaborate ..what wuld have happened when we were getting > this kind of warning ds > > Regards, > Abhishek Tiwari > > On Mon, Nov 2, 2015 at 6:00 PM, Modassar Ather <modather1...@gmail.com> > wrote: > > &g

Re: Very high memory and CPU utilization.

> wunder > Walter Underwood > wun...@wunderwood.org > http://observer.wunderwood.org/ (my blog) > > > > On Nov 2, 2015, at 5:17 AM, Toke Eskildsen <t...@statsbiblioteket.dk> > wrote: > > > > On Mon, 2015-11-02 at 17:27 +0530, Modassar Ather wrote: > > >

Very high memory and CPU utilization.

Hi, I have a setup of 12 shard cluster started with 28gb memory each on a single server. There are no replica. The size of index is around 90gb on each shard. The Solr version is 5.2.1. When I query "network se*", the memory utilization goes upto 24-26 gb and the query takes around 3+ minutes to

Re: Solr Cloud and Multiple Indexes

What is your index size? How much memory is used? What type of queries are slow? Are there GC pauses as they can be a cause of slowness? Are document updates/additions happening in parallel? The queries are very slow to run so I was thinking to distribute the indexes into multiple indexes and

Re: Solr Cloud and Multiple Indexes

> article https://wiki.apache.org/solr/DistributedSearch. What I was looking > for how this is handled in Solr Cloud? > > > Regards, > Salman > > > > > > On Thu, Nov 5, 2015 at 12:06 PM, Modassar Ather <modather1...@gmail.com> > wrote: > > > What

Re: Very high memory and CPU utilization.

a good for other system activities. Thanks, Modassar On Mon, Nov 2, 2015 at 1:30 PM, Toke Eskildsen <t...@statsbiblioteket.dk> wrote: > On Mon, 2015-11-02 at 12:00 +0530, Modassar Ather wrote: > > I have a setup of 12 shard cluster started with 28gb memory each on a &g

Re: Very high memory and CPU utilization.

Just to add one more point that one external Zookeeper instance is also running on this particular machine. Regards, Modassar On Mon, Nov 2, 2015 at 2:34 PM, Modassar Ather <modather1...@gmail.com> wrote: > Hi Toke, > Thanks for your response. My comments in-line. > > T

Re: Very high memory and CPU utilization.

iblioteket.dk> wrote: > On Mon, 2015-11-02 at 16:25 +0530, Modassar Ather wrote: > > The remaining size after you removed the heap usage should be reserved > for > > the index (not only the other system activities). > > I am not able to get the above point. So whe

Re: Very high memory and CPU utilization.

t; This seems impossible if you are sure that only one query is played at a > > time and no indexing is performed. Best thing to do is to dump stack > trace > > of the solr nodes during the query and to check what the threads are > doing. > > > > Jim > > > >

Re: Very high memory and CPU utilization.

gb RAM and 140 gb of index on each node. Regards, Modassar On Mon, Nov 2, 2015 at 5:27 PM, Modassar Ather <modather1...@gmail.com> wrote: > Okay. I guess your observation of 400% for a single core is with top and > looking at that core's entry? If so, the 400% can be explained by

Re: warning

Normally tlog is replayed in case if solr server crashes for some reason and when restarted it tries to recover from the crash gracefully. You can look into following documentation which explains about transaction logs and related stuff of Solr.

Re: Very high memory and CPU utilization.

gt; > index. If not then you rely on the speed of your disk, if you have SSDs > > it's better but reads are still significantly slower with SSDs than with > > direct RAM access. Another thing to keep in mind is that mmap will always > > tries to put things in RAM, this is why I sus

Exception in grouping with docValues enable field.

Hi, I have following docValues enabled field. *Field : * *Type: * When I am grouping on this field I am getting following exception. Kindly let me know if I am missing something or it is an issue. org.apache.solr.common.SolrException; java.lang.NullPointerException at

Re: Solr Cloud and Multiple Indexes

onsumption is 1.58 GB > > How many segments are there in the index? The more the segment the slower > is > the search. > How do I check how many segments are there in the index? > > Is this after you moved to solrcloud? > I have been using SolrCloud from the beginning. > &g

Re: Behavior of grouping on a field with same value spread across shards.

confusing group.ngroups and group.facet with just grouping? See the ref guide: https://cwiki.apache.org/confluence/display/solr/Result+Grouping#ResultGrouping-DistributedResultGroupingCaveats Best, Erick On Tue, Aug 25, 2015 at 4:51 AM, Modassar Ather modather1...@gmail.com wrote: Hi

Re: Behavior of grouping on a field with same value spread across shards.

Thanks Erick. On Wed, Aug 26, 2015 at 12:11 PM, Erick Erickson erickerick...@gmail.com wrote: That should be the case. Best, Erick On Tue, Aug 25, 2015 at 8:55 PM, Modassar Ather modather1...@gmail.com wrote: Thanks Erick, I saw the link. So is it that the grouping functionality

Query timeAllowed and its behavior.

Hi, Kindly help me understand the query time allowed attribute. The following is set in solrconfig.xml. int name=timeAllowed30/int Does this setting stop the query from running after the timeAllowed is reached? If not is there a way to stop it as it will occupy resources in background for no

Behavior of grouping on a field with same value spread across shards.

Hi, As per my understanding, to group on a field all documents with the same value in the field have to be in the same shard. Can we group by a field where the documents with the same value in that field will be distributed across shards? Please let me know what are the limitations, feature not

Re: Query timeAllowed and its behavior.

Thanks for your response Jonathon. Please correct me if I am wrong in following points. -query actually ceases to run once time allowed is reached and releases all the resources. -query expansion is stopped and the query is terminated from execution releasing all the resources. Thanks,

Re: Search results differs with sorting on pagination.

at 12:52 PM, Upayavira <u...@odoko.co.uk> wrote: > Add fl=id,score,[shard] to your query, and show us the results of two > differing executions. > > Perhaps we will be able to see the cause of the difference. > > Upayavira > > On Thu, Sep 10, 2015, at 05:35 AM, Mo

Re: Search results differs with sorting on pagination.

from all shard and then based on their score it should be sorted. But here I see that every time I hit the sort query I am getting results from different shard which has different scores. Thanks, Modassar On Thu, Sep 10, 2015 at 2:59 PM, Modassar Ather <modather1...@gmail.com> wrote: >

Search results differs with sorting on pagination.

Hi, Search results are changed every time the following query is hit. Please note that it is 7 shard cluster of Solr-5.2.1. Query: q=network=50=50=f_sort asc=true=id Following are the fields and their types in my schema.xml. As per my understanding it seems to be the issue of tie among

Re: Search results differs with sorting on pagination.

different > shards with the same score, the order would not be predictable - > probably down to which shard responds first. > > Fix it with something like sort=score,timestamp or some other time > related field. > > Upayavira > > On Thu, Sep 10, 2015, at 11:01 AM, Modassar At

Re: Search results differs with sorting on pagination.

es > due to a zillion possible causes, network latency, a minor GC pause on one > of the shards, whether all the caches are loaded, whatever. So subsequent > calls will happen to get some _other_ shards docs in the list first. > > Does that make sense? > > On Thu, Sep 10, 2015 at

  1   2   >