RE: Solr Cloud leader propagates slow to other nodes

2016-03-04 Thread Cool Techi
Any suggestion here would be highly appreciated, this is hampering our production performance and we are not able to pin point any reason. > From: cooltec...@outlook.com > To: solr-user@lucene.apache.org > Subject: Solr Cloud leader propagates slow to other nodes > Date: Fri, 4 Mar 2016

Solr Cloud leader propagates slow to other nodes

2016-03-04 Thread Cool Techi
Hi, We are using solr 4.8.1 cloud and have a single shard core and 3 replicas in total. We are noticing the following issues, 1) Master propagates slow to to the other nodes/replicas.2) This increase over a period of time, i.e the data propagation time increase as the time from which leader

RE: Delay in replication between cloud servers

2016-02-21 Thread Cool Techi
Hi, Can someone point in the right direction to check this. Regards,Rohit > From: cooltec...@outlook.com > To: solr-user@lucene.apache.org > Subject: RE: Delay in replication between cloud servers > Date: Tue, 16 Feb 2016 22:16:23 +0530 > > Further we have noticed that the delay increase a

RE: Delay in replication between cloud servers

2016-02-16 Thread Cool Techi
Further we have noticed that the delay increase a couple of hours after restart. Details related to sorlconfig.xml are given below, 15000 25000 false 1000 Regards,Rohit > From: cooltec...@outlook.com > To: solr-user@lucene.apache.org > Subject: Delay in

Delay in replication between cloud servers

2016-02-16 Thread Cool Techi
We are using solr cloud with 1 shard and replication factor as 3. We are noticing that the time for data to become available across all replicas from the leader is very high. The data rate is not very high, is there anyway to control this. In master-slave setup with give a replication time.

SolrCloud Issues

2014-07-17 Thread Cool Techi
Hi, We have moved to SolrCloud (version 4.8) and are facing several issues in this setup compared to the master/slave setup we have had for a while now, 1) We have a 2 shard set-up with one replica each, we notice that most of the time the replica's are in recovering status. What could be

RE: SolrCloud Issues

2014-07-17 Thread Cool Techi
Message- From: Shawn Heisey [mailto:s...@elyograg.org] Sent: 17 July 2014 14:25 To: solr-user@lucene.apache.org Subject: Re: SolrCloud Issues On 7/17/2014 6:57 AM, Cool Techi wrote: We have moved to SolrCloud (version 4.8) and are facing several issues in this setup compared

Inconsistant result's on solr cloud 4.8

2014-07-16 Thread Cool Techi
Hi, We are using solr cloud with solr version 4.8, we have 2 shard/2 replica servers in Solr Cloud. During two consecutive request to the solr cloud, the total results number varies. 1) As per my understanding this can happen when the leader and the replica have inconsistant number of results.

Storing tweets For WC2014

2014-05-15 Thread Cool Techi
Hi, We have a requirement from one of our customers to provide search and analytics on the upcoming Soccer World cup, given the sheer volume of tweet's that would be generated at such an event I cannot imagine what would be required to store this in solr. It would be great if there can be some

RE: Inconsistent response from Cloud Query

2014-05-14 Thread Cool Techi
We have noticed Solr returns in-consistent results during replica recovery and not all replicas are in the same state, so when your query goes to a replica which might be recovering or still copying the index then the counts may differ. regards,Ayush Date: Tue, 6 May 2014 16:14:36 +0530

RE: Fails to index if unique field has special characters

2014-04-11 Thread Cool Techi
, as it distinguishes the prefix used to determine which shard to direct the document to. https://cwiki.apache.org/confluence/display/solr/Shards+and+Indexing+Data+in+SolrCloud On Thursday, April 10, 2014 2:35 PM, Cool Techi cooltec...@outlook.com wrote: Hi, We are migrating from

Fails to index if unique field has special characters

2014-04-10 Thread Cool Techi
Hi, We are migrating from Solr 4.6 standalone to Solr 4.7 cloud version, while reindexing the document we are getting the following error. This is happening when the unique key has special character, this was not noticed in version 4.6 standalone mode, so we are not sure if this is a version

Search in URL

2014-03-28 Thread Cool Techi
Hi, We have several tweets stored in our system which are of the following nature, https://twitter.com/SharFairies/status/448992742257881088 I am searching for keywords like starcinema or abs-cbn.com, but these results are not returned, how can I search in this setup. My field type is defined

Solr replicating at 5 mb/sec

2014-02-22 Thread Cool Techi
Hi, I am running solr replication between two machine which are connected by a 1 gb network speed. The best speed I am getting for replication is 5mb/sec, how can this be increased. The replication keeps failing and this is the first time replication of an index over 300Gb in size. We are using

Unknow Query exception

2013-12-14 Thread Cool Techi
I am seeing the following exception in solr logs after regular intervals, we are not firing any query to have such error, what could be causing this? ERROR - 2013-12-14 05:35:52.722; org.apache.solr.common.SolrException; org.apache.solr.common.SolrException:

RE: Faceting within groups

2013-12-08 Thread Cool Techi
Any help here? From: cooltec...@outlook.com To: solr-user@lucene.apache.org Subject: Faceting within groups Date: Sat, 7 Dec 2013 14:00:20 +0530 Hi, I am not sure if faceting with groups is supported, the documents do seem to suggest it works, but cant seem to get the intended results.

Faceting within groups

2013-12-07 Thread Cool Techi
Hi, I am not sure if faceting with groups is supported, the documents do seem to suggest it works, but cant seem to get the intended results. str name=q(Amazon Cloud OR (IBM Cloud)/strstr name=group.fieldsourceId/strstr name=facet.fieldsentiment/strstr name=grouptrue/strstr

Solr Result Tagging

2013-10-25 Thread Cool Techi
Hi, My search queries to solr are of the following nature, (A OR B OR C) OR (X AND Y AND Z) OR ((ABC AND DEF) - XYZ) What I am trying to achieve is when I fire the query the results returned should be able to tagged with which part or the OR resulted in the result. In case all three parts above

RE: Autowarming last 15 days data

2013-08-01 Thread Cool Techi
Thanks Shwan, get the point. Regards, Ayush Date: Wed, 31 Jul 2013 09:46:49 -0600 From: s...@elyograg.org To: solr-user@lucene.apache.org Subject: Re: Autowarming last 15 days data On 7/31/2013 9:21 AM, Cool Techi wrote: Would it make sense if we open a newSearcher with the last 15 days

Autowarming last 15 days data

2013-07-31 Thread Cool Techi
Hi, We have a solr master slave set up with close to 30 million records. Our index changes/updates very frequently and replication is set up at 60 seconds delay. Now every time replication completes, the new searches take a time. How can this be improved? I have come across that warming would

solr cloud index corruption

2013-07-09 Thread Cool Techi
Hi, We are frequently getting issues of index corruption on the cloud, this used to not happen in our master slave setup with solr 3.6. I have tried to check the logs, but don't see an exact reason. I have run the index checker and it recovers, but I am not able to understand as to why this

Backup stops replication

2013-07-06 Thread Cool Techi
Hi, We migrated from solr 3.6 to solr 4.3, when we fire a backup command (/replication?command=backuplocation=/disk4/backups ) on the salve the slave stops replicating OR starts full replication from the master. This was not the behavior in the earlier version or solr, I have check the logs

RE: Solr 4.3 Master/Slave Issues

2013-07-06 Thread Cool Techi
fixing. Best Erick On Fri, Jul 5, 2013 at 11:54 AM, Cool Techi cooltec...@outlook.com wrote: The normal tomcat shutdown doesn't stop the server and take a long time, so i do issue a kill -9 command. Any other suggestion to do this without the locking. I would initiate a backup

Solr 4.3 Master/Slave Issues

2013-07-05 Thread Cool Techi
We have set up solr 4.3 with master/setup and are facing a couple of issues, Index locking, the index on slave hangs at time and when we restart the core the core get's locked up. I have checked the logs and there are no OOM error or anything else other than the error given below,Caused by:

RE: Solr 4.3 Master/Slave Issues

2013-07-05 Thread Cool Techi
. You have more than one Solr core pointing to the same data directory 3. A solr process is already running and you are trying to start another one with the same config. On Fri, Jul 5, 2013 at 2:34 PM, Cool Techi cooltec...@outlook.com wrote: We have set up solr 4.3 with master/setup

RE: Solr 4.3 Master/Slave Issues

2013-07-05 Thread Cool Techi
/Slave Issues From: shalinman...@gmail.com To: solr-user@lucene.apache.org On Fri, Jul 5, 2013 at 6:14 PM, Cool Techi cooltec...@outlook.com wrote: 1) That was my initial suspicion, but when I run ps -aux | grep java, but there it doesn't show any other program running. I kill the process

Solr Hangs on startup

2013-06-14 Thread Cool Techi
Hi, We are using solr4.3 cloud setup, but for some reason solr fails to startup, I see the following in the log file, post this there are no logs., org.apache.solr.search.SolrIndexSearcher ? Opening Searcher@17586ed7 main 15293 [coreLoadExecutor-3-thread-1] INFO org.apache.solr.core.SolrCore

Solr Cloud OR Load Balancing

2013-04-20 Thread Cool Techi
We are currently using Solr 3.6 with 1:1 replication on our production servers, but now out data has increased a lot and were looking to migrate to something more scalable. We have been experimenting with Solr Cloud over the past 2 months and noticed servers issues, most of them have been

RE: Document Missing from Share in Solr cloud

2013-04-17 Thread Cool Techi
be easier to track down the root cause. On Tue, Apr 16, 2013 at 12:08 PM, Cool Techi cooltec...@outlook.comwrote: That's what I am trying to say, the document is not replicated across all the replicas for a specific shard, hence the query show different results on every refresh

RE: Document Missing from Share in Solr cloud

2013-04-17 Thread Cool Techi
, at 09:14 AM, Cool Techi wrote: Shouldnt the number of docs across shards be same, I can see a difference Shard 1 Last Modified:about 2 hours agoNum Docs:26236135Max Doc:26592164Deleted Docs:356029Version:6672183Segment Count:34Shard1 Replica Last Modified: about 2 hours agoNum Docs

Document Missing from Share in Solr cloud

2013-04-16 Thread Cool Techi
Hi, We noticed a strange behavior in our solr cloud setup, we are using solr4.2 with 1:3 replication setting. We noticed that some of the documents were showing up in search sometimes and not at other, the reason being the document was not present in all the shards. We have restarted

RE: Document Missing from Share in Solr cloud

2013-04-16 Thread Cool Techi
is not replicated across all the replicas for a specific shard? If so, that's definitely a problem ... On Tue, Apr 16, 2013 at 11:22 AM, Cool Techi cooltec...@outlook.com wrote: Hi, We noticed a strange behavior in our solr cloud setup, we are using solr4.2 with 1:3 replication setting

SEVERE RecoveryStrategy Recovery failed - trying again... (9)

2013-02-18 Thread Cool Techi
I am seeing the following error in my Admin console and the core/ cloud status is taking forever to load. SEVERERecoveryStrategyRecovery failed - trying again... (9) What causes this and how can I recover from this mode? Regards, Rohit

RE: SEVERE RecoveryStrategy Recovery failed - trying again... (9)

2013-02-18 Thread Cool Techi
RecoveryStrategyRecovery failed - trying again... (9) From: markrmil...@gmail.com Date: Mon, 18 Feb 2013 10:21:53 -0500 To: solr-user@lucene.apache.org We need to see more of your logs to determine why - there should be some exceptions logged. - Mark On Feb 18, 2013, at 9:47 AM, Cool Techi

Not condition not working for Korean search

2013-02-10 Thread Cool Techi
Any help here, still not able to understand what might be causing this. I have tried all combinations below, but to no avail, (stnostem:((옵티머스 OR 엘지 스마트폰) AND NOT stnostem:(옵티머스 프라임 OR 프라임))) (stnostem:((옵티머스 OR 엘지 스마트폰) AND - stnostem:(옵티머스 프라임 OR 프라임))) What could be wrong here. From:

RE: Not condition not working for Korean search

2013-02-10 Thread Cool Techi
with debugQuery=true Actually this may be the pure negative bug where you need to change: A AND -B into A AND (*:* -B) -- Jack Krupansky -Original Message- From: Cool Techi Sent: Monday, February 11, 2013 12:30 AM To: solr-user@lucene.apache.org Subject: Not condition not working

Hourly Faceting

2013-02-08 Thread Cool Techi
Hi, I want to facet results on an hourly basis, the following query gives me an hourly breakdown, but with the date part. I want just the hour part across the days. Is there any other way of doing this, lst name=params str name=facet.date.start2013-02-01T00:00:00Z-330MINUTES/str str

Not condition not working for Korean search

2013-02-07 Thread Cool Techi
Hi, I am no Korean expert and am finding it difficult to fix this, my client is searching for the following query, but the NOT condition doesn't seem to be working. (stnostem:((옵티머스 OR 엘지 스마트폰) AND NOT (옵티머스 프라임 OR 프라임))) the search result (xml attached ) return result with the not condition

Solr commit taking too long

2013-01-16 Thread Cool Techi
Hi, We have an index of approximately 400GB in size, indexing 5000 documents was taking 20 seconds. But lately, the indexing is taking very long, committing the same amount of document is taking 5-20 mins. On checking the logs I can see that their a frequent merges happening, which I am

Searching for Solr Stop Words

2013-01-05 Thread Cool Techi
On of my solr fields is configured in the following manned, fieldType name=text_exact class=solr.TextField positionIncrementGap=100 autoGeneratePhraseQueries=true analyzer type=index charFilter class=solr.HTMLStripCharFilterFactory/ tokenizer

Solr Cloud 4.0 Production Ready?

2012-12-17 Thread Cool Techi
Hi, We have been using solr 3.5 in our production for sometime now and facing the problems faced by a large solr index. We wanted to migrate to Solr Cloud and have started some experimentation. But in the mean time also following the user forum and seem to be noticing a lot of bugs which were

Reloading config to zookeeper

2012-11-22 Thread Cool Techi
When we make changes to our config files, how do we reload the files into zookeeper. Also, I understand that we would need to reload the collection, would we need to do this at a per shard level or just at the cloud level. Regards, Ayush

RE: Reloading config to zookeeper

2012-11-22 Thread Cool Techi
:23, Cool Techi cooltec...@outlook.com wrote: When we make changes to our config files, how do we reload the files into zookeeper. Also, I understand that we would need to reload the collection, would we need to do this at a per shard level or just at the cloud level. Regards

Single Tomcat Multiple Shards

2012-11-21 Thread Cool Techi
Hey Guys, We are experimenting with solr cloud, this is what we want to set up as, 2 Machines each having have 8 master shards, so total of 16 shards. The assumption is we want to store approximately 4-5 TB data over a period of 1 year of so. Replication factor of 1 which are again

Architecture Question

2012-11-16 Thread Cool Techi
Hi, I am not sure if this is the right forum for this question, but it would be great if I could be pointed in the right direction. We have been using a combination of MySql and Solr for all our company full text and query needs. But as our customers have grow so has the amount of data and

RE: Architecture Question

2012-11-16 Thread Cool Techi
Hi Otis, Thanks for your reply, just wanted to check what NoSql structure would be best suited to store data and use the least amount of memory, since for most of my work Solr would be sufficient and I want to store data just in case we want to reindex and as a backup. Regards, Ayush Date:

Question about Solr Cloud

2012-11-16 Thread Cool Techi
Hi, I have just started working with Solr cloud and have a few questions related to the same, 1) In the start script we provide the the following, what's the purpose of providing this. -Dbootstrap_confdir=./solr/collection1/conf Since we don't yet have a config in zookeeper, this parameter

New data not indexing, after data deletion.

2012-10-18 Thread Cool Techi
Hi, We have a huge index size, running to around 350Gb+, we yesterday deleted some data on it. The deletion completed successfully, but post the deletion new data was not being indexed. We restarted the server, but neither the tomcat logs or Solr logs are giving any indication of why this

Solr Sharding Or Solr Cloud

2012-10-09 Thread Cool Techi
Hi, We have reached a state where a single solr server is not proving to be enough and are exploring options of sharding or solr cloud. Just wanted to check the pros and cons of each one of them if there are any. What would be the best size of the shards or Regards, R

Solr on https

2012-09-11 Thread Cool Techi
Hi, We are trying to run solr on https, these are few of the issues or problems that are coming up. Just wanted to understand if anyone else is facing these problems, we have some shards running on https, but in shards parameter in solr we don't specify the protocol, how can we achieve