Overseer Leader gone

Hi All, I have a cluster that has the overseer leader gone. This is on Solr 4.10.3 version. Its completely gone from zookeeper and bouncing any instance does not start a new election process. Anyone experience this issue before and any ideas to fix this. Thanks, Rishi.

Re: Multiple index.timestamp directories using up disk space

rename and deletion of the directories fails. If so we could monitor our logs to get a better idea for the root cause. At present we can only react when things go wrong based on disk space alarms. Thanks, Rishi. -- View this message in context: http://lucene.472066.n3.nabble.com/Multiple-index

Re: Multiple index.timestamp directories using up disk space

of assumptions which should usually hold good, you can still come up with a mechanism to drop existing files, but those won't hold good in case of serious issues with the cloud, you could end up losing data. That's worse than using a bit more disk space! On 4 May 2015 11:56, Rishi Easwaran rishi.easwa

Solr/ Solr Cloud meetup at Aol

Hi All, Aol is hosting a meetup in Dulles VA. The topic this time is Solr/ Solr Cloud. http://www.meetup.com/Code-Brew/events/53217/ Thanks, Rishi.

Re: Multiple index.timestamp directories using up disk space

are left with it is to clean up the entire index to free up disk space, and allow a replica to sync from scratch. Thanks, Rishi. -Original Message- From: Shawn Heisey apa...@elyograg.org To: solr-user solr-user@lucene.apache.org Sent: Tue, May 5, 2015 10:55 am Subject: Re: Multiple

Re: Solr Cloud reclaiming disk space from deleted documents

Sadly with the size of our complex, spiting and adding more HW is not a viable long term solution. I guess the options we have are to run optimize regularly and/or become aggressive in our merges proactively even before solr cloud gets into this situation. Thanks, Rishi

Re: Multiple index.timestamp directories using up disk space

it delete the old information and replicate from scratch, not requiring more disk space. Is the concern data loss (a case when both leader and follower lose data)?. Thanks, Rishi. -Original Message- From: Mark Miller markrmil...@gmail.com To: solr-user solr-user

Re: Multiple index.timestamp directories using up disk space

. But what I am talking about is copy of a whole index as is into a new directory. The new directory has no relation to the older index directory or its segments, so not sure what merges are going on across directories/indexes, and why solr needs the older index. Thanks, Rishi

Re: Solr Cloud reclaiming disk space from deleted documents

by the replica. I was searching around for optimize behaviour of solr cloud and could not find much information. Does anyone have experience running optimize for solr cloud in a loaded production env? Thanks, Rishi. -Original Message- From: Shawn Heisey apa...@elyograg.org

Multiple index.timestamp directories using up disk space

recovering. Usually this requires a manual intervention of bouncing the instance and wiping the disk clean to allow for a clean recovery. Any ideas on how to prevent solr from creating multiple copies of index directory. Thanks, Rishi.

Re: Solr Cloud reclaiming disk space from deleted documents

space usage may peak to 2x-3x of it's normal size until optimization completes. Is it a problem? Not if optimization occurs over shards serially and your index is broken to many small shards. On Apr 18, 2015 1:54 AM, Rishi Easwaran rishi.easwa...@aol.com wrote: Thanks Shawn for the quick reply

Re: Solr Cloud reclaiming disk space from deleted documents

factor Thanks, Rishi. -Original Message- From: Shawn Heisey apa...@elyograg.org To: solr-user solr-user@lucene.apache.org Sent: Mon, Apr 20, 2015 11:25 am Subject: Re: Solr Cloud reclaiming disk space from deleted documents On 4/20/2015 8:44 AM, Rishi Easwaran wrote: Yeah I noticed

Solr Cloud reclaiming disk space from deleted documents

=maxMergeCount15/int /mergeScheduler ramBufferSizeMB64/ramBufferSizeMB /indexConfig Any suggestions on which which tunable to adjust, mergeFactor, mergeScheduler thread counts etc would be great. Thanks, Rishi.

Re: Solr Cloud reclaiming disk space from deleted documents

Thanks Shawn for the quick reply. Our indexes are running on SSD, so 3 should be ok. Any recommendation on bumping it up? I guess will have to run optimize for entire solr cloud and see if we can reclaim space. Thanks, Rishi. -Original Message- From: Shawn Heisey apa

Re: Basic Multilingual search capability

. Just one clarification, when you say ICUFilterFactory am I correct in thinking its ICUFodingFilterFactory. Thanks, Rishi. -Original Message- From: Tom Burton-West tburt...@umich.edu To: solr-user solr-user@lucene.apache.org Sent: Wed, Feb 25, 2015 4:33 pm Subject: Re: Basic

Re: Basic Multilingual search capability

forward to trying out once its integrated to main. Thanks, Rishi. -Original Message- From: Trey Grainger solrt...@gmail.com To: solr-user solr-user@lucene.apache.org Sent: Tue, Feb 24, 2015 1:40 am Subject: Re: Basic Multilingual search capability Hi Rishi, I don't generally recommend

Re: Basic Multilingual search capability

Hi Alex, Thanks for the suggestions. These steps will definitely help out with our use case. Thanks for the idea about the lengthFilter to protect our system. Thanks, Rishi. -Original Message- From: Alexandre Rafalovitch arafa...@gmail.com To: solr-user solr-user

Re: Strange search behaviour when upgrading to 4.10.3

65] 0 7 1 ALNUM 1 Version 4.6 SF text raw_bytes type start end position message [6d 65 73 73 61 67 65] ALNUM 0 7 1 Thanks, Rishi. -Original Message- From: Shawn Heisey apa...@elyograg.org To: solr-user solr-user@lucene.apache.org Sent

Basic Multilingual search capability

/How-to-implement-multilingual-word-components-fields-schema-td4157140.html#a4158923 https://issues.apache.org/jira/browse/SOLR-6492 Thanks, Rishi.

Re: Basic Multilingual search capability

to tokenize email addresses (ex:he...@aol.com- i think standardTokenizer already does this), filenames (здравствуйте.pdf), but maybe we can use filters to accomplish that. Thanks, Rishi. -Original Message- From: Alexandre Rafalovitch arafa...@gmail.com To: solr-user solr-user

Re: Basic Multilingual search capability

://cwiki.apache.org/confluence/display/solr/Tokenizers#Tokenizers-ICUTokenizer) This tokenizer processes multilingual text and tokenizes it appropriately based on its script attribute. or am I missing something? Thanks, Rishi. -Original Message- From: Walter Underwood wun

Re: Strange search behaviour when upgrading to 4.10.3

/UniversalLexer.jflex From the looks of it the text is being indexed as a single token and not broken across whitespace. Thanks, Rishi. -Original Message- From: Shawn Heisey apa...@elyograg.org To: solr-user solr-user@lucene.apache.org Sent: Fri, Feb 20, 2015 11:52 am Subject: Re: Strange

Re: Strange search behaviour when upgrading to 4.10.3

: Strange search behaviour when upgrading to 4.10.3 On 2/20/2015 9:37 AM, Rishi Easwaran wrote: We are trying to upgrade from Solr 4.6 to 4.10.3. When testing search 4.10.3 search results are not being returned, actually looks like only the first word in a sentence is getting indexed. Ex: inserting

Strange search behaviour when upgrading to 4.10.3

, Rishi.

SOLR Talk at AOL Dulles Campus.

All, There is a tech talk on AOL Dulles campus tomorrow. Do swing by if you can and share it with your colleagues and friends. www.meetup.com/Code-Brew/events/192361672/ There will be free food and beer served at this event :) Thanks, Rishi.

Re: SOLR Cloud 4.6 - PERFORMANCE WARNING: Overlapping onDeckSearchers=2

@lucene.apache.org Sent: Sun, Mar 30, 2014 5:51 pm Subject: Re: SOLR Cloud 4.6 - PERFORMANCE WARNING: Overlapping onDeckSearchers=2 On 3/30/2014 2:59 PM, Rishi Easwaran wrote: RAM shouldn't be a problem. I have a box with 144GB RAM, running 12 instances with 4GB Java heap each. There are 9 instances

Re: SOLR Cloud 4.6 - PERFORMANCE WARNING: Overlapping onDeckSearchers=2

...@elyograg.org To: solr-user solr-user@lucene.apache.org Sent: Fri, Mar 28, 2014 8:35 pm Subject: Re: SOLR Cloud 4.6 - PERFORMANCE WARNING: Overlapping onDeckSearchers=2 On 3/28/2014 4:07 PM, Rishi Easwaran wrote: Shawn, I changed the autoSoftCommit value to 15000 (15 sec). My index size

Re: SOLR Cloud 4.6 - PERFORMANCE WARNING: Overlapping onDeckSearchers=2

Hi Dmitry, I thought auto soft commit was for NRT search (shouldn't it be optimized for search performance), if i have to wait 10 mins how is it NRT? or am I missing something? Thanks, Rishi. -Original Message- From: Dmitry Kan solrexp...@gmail.com To: solr-user solr-user

Re: SOLR Cloud 4.6 - PERFORMANCE WARNING: Overlapping onDeckSearchers=2

/ queryResultMaxDocsCached200/queryResultMaxDocsCached I think still something is going on. I mean 15s on SSD drives is a long time to handle a 4GB index. Thanks, Rishi. -Original Message- From: Shawn Heisey s...@elyograg.org To: solr-user solr-user@lucene.apache.org Sent: Fri, Mar 28, 2014 3

SOLR Cloud 4.6 - PERFORMANCE WARNING: Overlapping onDeckSearchers=2

maxDocs1/maxDocs maxTime6/maxTime openSearcherfalse/openSearcher /autoCommit autoSoftCommit maxTime1000/maxTime /autoSoftCommit Any idea why its warning every second, the only config that has 1 second is softcommit. Thanks, Rishi.

Re: Solr Cloud Hangs consistently .

in, which is very small for a server app. One of our install script had changed. I had to up the ulimits - -n,-u,-v and for now no other issues seen. -Original Message- From: Rishi Easwaran rishi.easwa...@aol.com To: solr-user solr-user@lucene.apache.org Sent: Tue, Jun 18, 2013 10:40

Re: Solr Cloud Hangs consistently .

that solr community uses (preferably with jmeter), we are write heavy so at the moment focusing on inserts only. Thanks, Rishi. -Original Message- From: Yago Riveiro yago.rive...@gmail.com To: solr-user solr-user@lucene.apache.org Sent: Mon, Jun 17, 2013 6:19 pm Subject: Re: Solr Cloud

Re: SOLR Cloud - Disable Transaction Logs

18, 2013 at 2:18 AM, Rishi Easwaran rishi.easwa...@aol.comwrote: Shalin, Just some thoughts. Near Real time replication- don't we use solrCmdDistributor, which send requests immediately to replicas with a clonedRequest, as an option can't we achieve something similar form CloudSolrserver

Re: SOLR Cloud - Disable Transaction Logs

at any given time should be pretty low. Why have tLogs if all replicas on an update get the request anyway, In theory 1 replica must be able to commit eventually. NRT is an optional feature and probably not tied to Cloud, correct? Thanks, Rishi. -Original Message- From: Erick

Solr Cloud Hangs consistently .

the community would be great, I got some heap dumps and stack dumps, but haven't found a smoking gun yet. If I can provide anything else to diagnose this issue. just let me know. Thanks, Rishi.

Re: Solr Cloud Hangs consistently .

Mark, I got a few stack dumps of the instance that was stuck ssdtest-d03:8011 http://apaste.info/cofK http://apaste.info/sv4M http://apaste.info/cxUf I can get dumps of others if needed. Thanks, Rishi. -Original Message- From: Mark Miller markrmil...@gmail.com To: solr-user

Re: Solr Cloud Hangs consistently .

FYI..you can ignore http4ClientExpiryService thread in the stack dump. Its a dummy executor service, i created to test out something, unrelated to this issue. -Original Message- From: Rishi Easwaran rishi.easwa...@aol.com To: solr-user solr-user@lucene.apache.org Sent: Mon

SOLR Cloud - Disable Transaction Logs

of my index. I understand from the previous discussions, that it was intended for update durability and realtime get. But, unless I am missing something an ability to disable it in SOLR cloud if not needed would be good. Thanks, Rishi.

Re: SOLR Cloud - Disable Transaction Logs

writes and acknowledge. durability should be high. Peer-Sync and Recovery - Can we achieve that merging indexes from leader as needed, instead of replaying the transaction logs? Rishi. -Original Message- From: Shalin Shekhar Mangar shalinman...@gmail.com To: solr-user solr-user

Spread the word - Opening at AOL Mail Team in Dulles VA

://www.linkedin.com/jobs?viewJob=jobId=6073910 If interested, send your current resume to rishi.easwa...@aol.com. I will take it to my Director. This position is in Dulles, VA. Thanks, Rishi.

Re: Solr Cloud Hangs consistently .

and easily reproducible issue on SOLR cloud. Thanks, Rishi. -Original Message- From: Yago Riveiro yago.rive...@gmail.com To: solr-user solr-user@lucene.apache.org Sent: Mon, Jun 17, 2013 5:15 pm Subject: Re: Solr Cloud Hangs consistently . I can confirm that the deadlock

Re: shardkey

can use select?q=xyzshard.keys=uniquekey to focus your search to hit only the shard that has your shard.key Thanks, Rishi. -Original Message- From: Joshi, Shital shital.jo...@gs.com To: 'solr-user@lucene.apache.org' solr-user@lucene.apache.org Sent: Wed, Jun 12, 2013 10:01 am

Solr Composite Unique key from existing fields in schema

prevent us from creating and storing an extra field. Thanks, Rishi.

Re: Solr Composite Unique key from existing fields in schema

, docid). I used the standard Solr example schema, so I used dynamic fields for the two ids, but use your own field names. -- Jack Krupansky -Original Message- From: Rishi Easwaran Sent: Tuesday, May 28, 2013 11:12 AM To: solr-user@lucene.apache.org Subject: Solr Composite Unique key from

Re: Solr Composite Unique key from existing fields in schema

compositeId1-12345. If I reverse the input field name=userid12345/field field name=docid1/field I get the following compositeId 12345-1 . In this case the compositeId is not unique and I am getting duplicates. Thanks, Rishi. -Original Message- From: Jack Krupansky j

Re: Solr Composite Unique key from existing fields in schema

in the ID should be purely dependent on the order of the field names in the processor configuration: str name=sourcedocid_s/str str name=sourceuserid_s/str -- Jack Krupansky -Original Message- From: Rishi Easwaran Sent: Tuesday, May 28, 2013 2:54 PM To: solr-user@lucene.apache.org

Re: Solr Composite Unique key from existing fields in schema

schema.xml, would like to avoid the overhead of storing this field in my index. Thanks, Rishi. -Original Message- From: Jack Krupansky j...@basetechnology.com To: solr-user solr-user@lucene.apache.org Sent: Tue, May 28, 2013 4:33 pm Subject: Re: Solr Composite Unique key from existing

Re: Upgrading from SOLR 3.5 to 4.2.1 Results.

Sure Shalin, hopefully soon. -Original Message- From: Shalin Shekhar Mangar shalinman...@gmail.com To: solr-user solr-user@lucene.apache.org Sent: Sat, May 18, 2013 11:35 pm Subject: Re: Upgrading from SOLR 3.5 to 4.2.1 Results. Awesome news Rishi! Looking forward to your

Re: Upgrading from SOLR 3.5 to 4.2.1 Results.

We use commodity H/W which we procured over the years as our complex grew. Running on jdk6 with tomcat 5. (Planning to upgrade to jdk7 and tomcat7 soon). We run them with about 4GB heap. Using CMS GC. -Original Message- From: adityab aditya_ba...@yahoo.com To: solr-user

Re: Upgrading from SOLR 3.5 to 4.2.1 Results.

pm Subject: Re: Upgrading from SOLR 3.5 to 4.2.1 Results. Hi Rishi, Have you done any tests with Solr 4.3 ? Regards, Cordialement, BOUHLEL Noureddine On 17 May 2013 21:29, Rishi Easwaran rishi.easwa...@aol.com wrote: Hi All, Its Friday 3:00pm, warm sunny outside and it was a good

Upgrading from SOLR 3.5 to 4.2.1 Results.

are looking at prototyping SOLR Cloud for our search system, upgrade java and tomcat, tune our application further. Lots of fun stuff :) Have a great weekend everyone. Thanks, Rishi.

Re: SOLR Cloud Collection Management quesiotn.

distributed, what is the determining criteria. Thanks, Rishi. -Original Message- From: Anshum Gupta ans...@anshumgupta.net To: solr-user solr-user@lucene.apache.org Sent: Tue, May 14, 2013 9:42 pm Subject: Re: SOLR Cloud Collection Management quesiotn. Hi Rishi, If you have your

SOLR Cloud Collection Management quesiotn.

replicas (1 leader 1 replica) for each shard. Now I want to add extra replicas to each shard in my cluster without out changing the replicationFactor used to create the collection. Any ideas on how to go about doing that. Thanks, Rishi.

Re: SOLR Cloud Collection Management quesiotn.

/solr/admin/cores?action=CREATEname=testCloud1_shard2_replica3collection=testCloud1shard=shard2collection.configName=myconf Is there an easier way to do this. Any ideas. Thanks, Rishi. -Original Message- From: Rishi Easwaran rishi.easwa...@aol.com To: solr-user solr-user@lucene.apache.org