Re: SolrCloud setup - any advice?

2013-09-19 Thread Shreejay Nair
Hi Neil, Although you haven't mentioned it, just wanted to confirm - do you have soft commits enabled? Also what's the version of solr you are using for the solr cloud setup? 4.0.0 had lots of memory and zk related issues. What's the warmup time for your caches? Have you tried disabling the

Re: What do you use for solr's logging analysis?

2013-08-11 Thread Shreejay Nair
in the next few weeks. . There are plenty of other such log analysis tools. It all depends on your particular use case. --Shreejay On Sunday, August 11, 2013, adfel70 wrote: Hi I'm looking at a tool that could help me perform solr logging analysis. I use SolrCloud on multiple servers, so the tool

Re: commit vs soft-commit

2013-08-11 Thread Shreejay Nair
at Nabble.com. -- -- Shreejay Nair Sent from my mobile device. Please excuse brevity and typos.

Re: Need help on Solr

2013-06-20 Thread Shreejay
org.apache.solr.common.SolrException: [schema.xml] Duplicate field definition for 'id' You might have defined an id field in the schema file. The out of box schema file already contains an id field . -- Shreejay On Thursday, June 20, 2013 at 9:16, Abhishek Bansal wrote: Hello, I am

Re: ngroups does not show correct number of groups when used in SolrCloud

2013-06-14 Thread Shreejay
. -- Shreejay On Friday, June 14, 2013 at 5:11, Markus.Mirsberger wrote: Hi, I just noticed (after long time testing and finally looking into the docu :p) that the ngroups parameter does not show the correct number of groups when used in anything else than a single shard environment (in my

Re: How spell checker used if indexed document is containing misspelled words

2013-06-14 Thread Shreejay
Hi, Have you tried this? http://wiki.apache.org/solr/SpellCheckComponent#spellcheck.onlyMorePopular Of course this is assuming that your corpus has correct words occurring more frequently than incorrect ones! -- Shreejay On Friday, June 14, 2013 at 2:49, venkatesham.gu...@igate.com

Re: out of memory during indexing do to large incoming queue

2013-06-02 Thread Shreejay
/solr/SolrPerformanceFactors#Optimization_Considerations -- Shreejay On Sunday, June 2, 2013 at 7:16, Yoni Amir wrote: Hello, I am receiving OutOfMemoryError during indexing, and after investigating the heap dump, I am still missing some information, and I thought this might be a good

Re: Highlighting fields

2013-05-31 Thread Shreejay
Are the fields you are trying to highlight stored? If yes then can you show the exact query you are using? Which version of solr? And which highlighter? ( you can paste the relevant highlight section from solr config file) -- Shreejay On Thursday, May 30, 2013 at 22:56, Sagar Chaturvedi

Re: Highlighting fields

2013-05-31 Thread Shreejay
Didn't notice the original message. Sorry about that. -- Shreejay On Friday, May 31, 2013 at 5:55, Jack Krupansky wrote: Please do not respond to hijacked message threads, other than to encourage the sender to start a new message thread. -- Jack Krupansky -Original Message

Re: Tool to read Solr4.2 index

2013-05-22 Thread Shreejay
This might help http://wiki.apache.org/solr/LukeRequestHandler -- Shreejay Nair Sent from my mobile device. Please excuse brevity and typos. On Wednesday, May 22, 2013 at 13:47, gpssolr2020 wrote: Hi All, We can use lukeall4.0 for reading Solr3.x index . Like that do we have anything

Re: seeing lots of autowarming messages in log during DIH indexing

2013-05-20 Thread Shreejay
your indexing is over then you can specify openSearcher=false while doing a commit. That should speed up your indexing a lot. -- Shreejay Nair Sent from my mobile device. Please excuse brevity and typos. On Monday, May 20, 2013 at 7:16, geeky2 wrote: hello, we are tracking down some

Re: seeing lots of autowarming messages in log during DIH indexing

2013-05-20 Thread shreejay
geeky2 wrote you mean i would add this switch to my script that kicks of the dataimport? exmaple: OUTPUT=$(curl -v http://${SERVER}.intra.searshc.com:${PORT}/solrpartscat/${CORE}/dataimport -F command=full-import -F clean=${CLEAN} -F commit=${COMMIT} -F optimize=${OPTIMIZE} -F

Re: replication without automated polling, just manual trigger?

2013-05-15 Thread Shreejay Nair
You can disable polling so that the slave never polls the Master(In Solr 4.3 you can disable it from the Admin interface). . And you can trigger a replication using the HTTP API http://wiki.apache.org/solr/SolrReplication#HTTP_API or again, use the Admin interface to trigger a manual replication.

Request to be added to ContributorsGroup

2013-05-13 Thread Shreejay Nair
Hello Wiki Admins, Request you to please add me to the ContributorsGroup. I have been using Solr for a few years now and I would like to contribute back by adding more information to the wiki Pages. Wiki User Name : Shreejay --Shreejay

Re: Frequent OOM - (Unknown source in logs).

2013-05-09 Thread shreejay
We ended up using a Solr 4.0 (now 4.2) without the cloud option. And it seems to be holding good. -- View this message in context: http://lucene.472066.n3.nabble.com/Frequent-OOM-Unknown-source-in-logs-tp4029361p4061945.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Frequent OOM - (Unknown source in logs).

2012-12-28 Thread shreejay
Hi Otis, Following is the setup: 6 Solr individual servers (VMs) running on Jetty. 3 Shards. Each shard with a leader and replica. *Solr Version *: /Solr 4.0 (with a patch from Solr-2592)./ *OS*: /CentOS release 5.8 (Final)/ *Java*: /java version 1.6.0_32 Java(TM) SE Runtime Environment

Frequent OOM - (Unknown source in logs).

2012-12-27 Thread shreejay
Hello, I am seeing frequent OOMs for the past 2 days on a SolrCloud Cluster (Solr4.0 with a patch from Solr-2592) setup (3 shards, each shard with 2 instances. Each instance is running CentOS with 30GB memory, 500GB disk space), with a separate Zoo Keeper ensemble of 3. Here is the stacktrace:

Commit and OpenSearcher not working as expected.

2012-12-16 Thread shreejay
in the Wiki, that keeping openSearcher=false is recommended for solrcloud. http://wiki.apache.org/solr/SolrConfigXml#Update_Handler_Section Is there some place else where openSearcher has to be set while calling a commit? --Shreejay -- View this message in context: http://lucene.472066.n3

Re: Commit and OpenSearcher not working as expected.

2012-12-16 Thread shreejay
Hi Mark, That was a typo in my post. I am using openSearcher only. But still see the same log files. /update/?commit=trueopenSearcher=false -- View this message in context: http://lucene.472066.n3.nabble.com/Commit-and-OpenSearcher-not-working-as-expected-tp4027419p4027451.html Sent from

Re: Commit and OpenSearcher not working as expected.

2012-12-16 Thread shreejay
in the log files. I am not sure why it is being called? Does solrCloud ignore openSearcher=false? --Shreejay shreejay wrote Hi Mark, That was a typo in my post. I am using openSearcher only. But still see the same log files. /update/?commit=trueopenSearcher=false -- View this message

A SPI class of type org.apache.lucene.codecs.Codec with name 'Lucene41' does not exist.

2012-12-11 Thread shreejay
\apache\lucene\codecs and compiling it suffice ? -- Shreejay -- View this message in context: http://lucene.472066.n3.nabble.com/A-SPI-class-of-type-org-apache-lucene-codecs-Codec-with-name-Lucene41-does-not-exist-tp4026118.html Sent from the Solr - User mailing list archive at Nabble.com.

SolrCloud OOM heap space

2012-12-10 Thread shreejay
start.jar If anyone has faced similar issues please let me know. --Shreejay -- View this message in context: http://lucene.472066.n3.nabble.com/SolrCloud-OOM-heap-space-tp4025821.html Sent from the Solr - User mailing list archive at Nabble.com.

RE: SolrCloud OOM heap space

2012-12-10 Thread shreejay
Thanks Markus. Is this issue only on 4.x and 5.x branches? I am currently running a v recent build of 4.x branch with an applied patch. I just want to make sure that this is not an issue with 4.0. In which case I can think of applying my patch to 4.0 instead of 4x or 5x. --Shreejay

RE: SolrCloud OOM heap space

2012-12-10 Thread shreejay
Thanks Marcus. I will apply the patch to the 4x branch I have, and report back. -- View this message in context: http://lucene.472066.n3.nabble.com/SolrCloud-OOM-heap-space-tp4025821p4025858.html Sent from the Solr - User mailing list archive at Nabble.com.

Solr Nightly build server down ?

2012-12-05 Thread shreejay
Hi All, Is the server hosting nightly builds of Solr down? https://builds.apache.org/job/Solr-Artifacts-4.x/lastSuccessfulBuild/artifact/solr/package/ If anyone knows an alternate link to download the nightly build please let me know. --Shreejay -- View this message in context: http

Solr 4.0 ngroups issue workaround

2012-12-05 Thread shreejay
-indexing data so that all documents with same group field are on the same server, has anyone else tried or used any alternate methods? I wanted to see if there would be any other options before re-indexing. Thanks. --Shreejay -- View this message in context: http://lucene.472066.n3.nabble.com

Re: Solr4.0 / SolrCloud queries

2012-11-19 Thread shreejay
, JVM - 8 GB While typing his post I did a Reload from the Core Admin page, and both servers (Shard1-Server2 and Shard2-Server1)came back up again. Has anyone else encountered these issues? Any steps to prevent these? Thanks. --Shreejay -- View this message in context: http://lucene

Re: Solr4.0 / SolrCloud queries

2012-11-13 Thread shreejay
Thanks Mark. I meant ConcurrentMergeScheduler and ramBufferSizeMB (not maxBuffer). These are my settings for Merge. / ramBufferSizeMB960/ramBufferSizeMB mergeFactor40/mergeFactor mergeScheduler class=org.apache.lucene.index.ConcurrentMergeScheduler/ / --Shreejay Mark Miller-3

Re: Solr4.0 / SolrCloud queries

2012-11-09 Thread shreejay
the Merge settings by keeping a maxBuffer = 960, a merge Factor = 40 and ConcurrentMergePolicy. I am also going to check the infoStream option so I can see how the indexing is going on. Thanks for your inputs. --Shreejay -- View this message in context: http://lucene.472066.n3.nabble.com

Re: Solr4.0 / SolrCloud queries

2012-11-04 Thread shreejay
will not be an issue this time due to the memory changes. I will post more info once I am done. Thanks once again. --Shreejay -- View this message in context: http://lucene.472066.n3.nabble.com/Solr4-0-SolrCloud-queries-tp4016825p4018176.html Sent from the Solr - User mailing list archive at Nabble.com.

Solr4.0 / SolrCloud queries

2012-10-29 Thread shreejay
this issue either. --Shreejay -- View this message in context: http://lucene.472066.n3.nabble.com/Solr4-0-SolrCloud-queries-tp4016825.html Sent from the Solr - User mailing list archive at Nabble.com.

NewSearcher old cache

2012-10-11 Thread shreejay
on the Solr Server. Can I specify these queries in NewSearcher and FirstSearcher also? Or are the queries supposed to be simple queries? Thanks. --Shreejay -- View this message in context: http://lucene.472066.n3.nabble.com/NewSearcher-old-cache-tp4013225.html Sent from the Solr - User mailing