Re: Request for help:-Solr - Indexer causes java.lang.OutOfMemoryError: Java heap spac

2015-10-15 Thread Shawn Heisey
On 10/15/2015 2:37 AM, HanumanthaRao K wrote: > this is hanumantharao. I am getting the error when parsing and indexing > content using solr. if you know please help me on the same. > > > I am using solr for index as well as

Re: Run Solr 5.3.0 as a Service on Windows using NSSM

2015-10-15 Thread Zheng Lin Edwin Yeo
Hi Adrian, The main Solr is able to startup, but the cores cannot be loaded. I can get to the admin page once in a while (not always the case), and if I can get there, it will says there's no cores available. Otherwise, the browser will just say "This page can't be displayed". If I use the URL

Re: slow queries

2015-10-15 Thread Lorenzo Fundaró
On 14 October 2015 at 20:35, Pushkar Raste wrote: > You may want to start solr with following settings to enable logging GC > details. Here are some flags you might want to enable. > > -Xloggc:/gc.log > -XX:+PrintGCDetails > -XX:+PrintGCDateStamps >

DIH parallel processing

2015-10-15 Thread nabil Kouici
Hi All, I'm using DIH to index more than 15M from Sql Server to Solr. This take more than 2 hours. Big amount of this time is consumed by data fetching from database. I'm thinking about a solution to have parallel (thread) loud in the same DIH. Each thread load a part of data. Do you have any

Request for help:-Solr - Indexer causes java.lang.OutOfMemoryError: Java heap spac

2015-10-15 Thread HanumanthaRao K
Dear Solr Team, this is hanumantharao. I am getting the error when parsing and indexing content using solr. if you know please help me on the same. I am using solr for index as well as content search. when I am trying with

Re: AutoComplete Feature in Solr

2015-10-15 Thread Alessandro Benedetti
I would suggest you to read this in details : *DocumentDictionaryFactory* > A dictionary with terms, weights, and an optional payload taken from the > index. > This dictionary implementation takes the following parameters in addition > to parameters described for the Suggester generally and for

Re: DIH parallel processing

2015-10-15 Thread Charlie Hull
On 15/10/2015 09:57, nabil Kouici wrote: Hi All, I'm using DIH to index more than 15M from Sql Server to Solr. This take more than 2 hours. Big amount of this time is consumed by data fetching from database. I'm thinking about a solution to have parallel (thread) loud in the same DIH. Each

Re: Replication and soft commits for NRT searches

2015-10-15 Thread MOIS Martin (MORPHO)
Hello, the background for my question is that one of the requirements for our injection tool is that it should report that a new document has been successfully enrolled to the cluster only if it is available on all replicas. The automated integration test for this feature will submit a

Re: partial search EdgeNGramFilterFactory

2015-10-15 Thread Alessandro Benedetti
let's analyse your query requirement : On 15 October 2015 at 03:08, Brian Narsi wrote: > > 1) cardinal healthcare products > 2) cardinal healthcare > 3) postoperative cardinal healthcare > 4) surgical cardinal products > > > q=SellerName:cardinal - all 4 records returned >

Re: Grouping facets: Possible to get facet results for each Group?

2015-10-15 Thread Alessandro Benedetti
It will not be an impediment, if you have a flat document with single valued field interested, you can use Pivot Facets and apply stats over the facets as well. Take a look to the modern Json faceting approach Yonik introduced. Since I start using it I strongly recommend it, it's amazingly clear

Tokenize ShingleFilterFactory results and apply filters to tokens

2015-10-15 Thread vitaly bulgakov
I want to rephrase my question I asked in another post. As far as I understand filter ShingleFilterFactory creates shingle as strings. But I want to apply more filters (like EdgeNgrams) to each token of a shingle. For example from "Home Improvement Service" I have two shingles: "Home

RE: DIH parallel processing

2015-10-15 Thread Davis, Daniel (NIH/NLM) [C]
This is also what I have done, but I agree with the notion of using something external to load the data. -Original Message- From: Dyer, James [mailto:james.d...@ingramcontent.com] Sent: Thursday, October 15, 2015 9:24 AM To: solr-user@lucene.apache.org Subject: RE: DIH parallel

SolrCloud 4.4 shard range has become null

2015-10-15 Thread ilansch
Hi, We have 3 servers and load balancer. on each server we run 1 shard with a leader and replica + zookeeper host lately i receive exception "No active slice servicing hash code f02c79de in collection1" I viewed clusterstate.json and saw that shard3 range has been set to null, after investigation

Problem with custom function on binary content

2015-10-15 Thread Robert Krüger
Hi, I am trying to implement a custom function that evaluates fields stored as type "binary" (BinaryField). I have my ValueSourceParser set up and I can retrieve the arguments of my function correctly and have a reference to the SchemaField. Now I am a bit stuck, how I can retrieve the binary

Re: Grouping facets: Possible to get facet results for each Group?

2015-10-15 Thread Peter Sturge
Great - can't wait to try this out! Many thanks for your help on pointing me towards this new faceting feature. Thanks, Peter On Thu, Oct 15, 2015 at 10:04 AM, Alessandro Benedetti < benedetti.ale...@gmail.com> wrote: > It will not be an impediment, if you have a flat document with single >

simple test on solr 5.2.1 wrong leader elected on startup

2015-10-15 Thread Matteo Grolla
Hi, I'm doing this test collection test is replicated on two solr nodes running on 8983, 8984 using external zk 1)turn on solr 8984 2)add,commit a doc x con solr 8983 3)turn off solr 8983 4)turn on solr 8984 5)shortly after (leader still not elected) turn on solr 8983 6)8984 is elected as

Re: simple test on solr 5.2.1 wrong leader elected on startup

2015-10-15 Thread Alessandro Benedetti
Hi Matteo, On 15 October 2015 at 16:16, Matteo Grolla wrote: > Hi, > I'm doing this test > collection test is replicated on two solr nodes running on 8983, 8984 > using external zk > > 1)turn OFF solr 8984 > 2)add,commit a doc x con solr 8983 > 3)turn OFF solr

Solr Migration 1.4.1 -> 5.2.1

2015-10-15 Thread fabigol
Hi, i catch an old project working with Solr 1.4.1, jbossPortal and java 1.5. I try to migrate my solr version to solr 5.2.1 work with java 1.7. The solr indexation works but i fail to display the new results on my application. I want to know if i must update the jar in my project or if the old

Re: Solr Migration 1.4.1 -> 5.2.1

2015-10-15 Thread Erick Erickson
Solr does not guarantee backwards compatibility more than one major version back. That is, Solr 3.x is guaranteed to at least read Solr 1.4 indexes (there was no Solr 2.x). Solr 4x can read 3x but not 1.x. Solr 5x can read 4x indexes, but not 3x You really only have two choices here. You _could_

Re: slow queries

2015-10-15 Thread Erick Erickson
Also check the Zookeeper config file settings for Zookeeper's keep-alive, in some versions that was set to 15 seconds. Still shouldn't be tripped by a 4 second GC pause. Best, Erick On Thu, Oct 15, 2015 at 7:33 AM, Lorenzo Fundaró wrote: > On 15 October 2015 at

RE: DIH parallel processing

2015-10-15 Thread Dyer, James
Nabil, What we do is have multiple dih request handlers configured in solrconfig.xml. Then in the sql query we put something like "where mod(id, ${partition})=0". Then an external script calls a full import on each request handler at the same time and monitors the response. This isn't the

Re: slow queries

2015-10-15 Thread Eric Torti
Hi, Lorenzo, I don't think this has a direct relation to your problem but it looks like you're setting -DzkClientTimeout twice. From what I know about setting VM arguments twice, you're probably ending up with the last one being enforced. Just something to be aware of I guess. I don't think

Re: slow queries

2015-10-15 Thread Lorenzo Fundaró
On 15 October 2015 at 15:59, Eric Torti wrote: > Hi, Lorenzo, > > I don't think this has a direct relation to your problem but it looks > like you're setting -DzkClientTimeout twice. From what I know about > Thanks, I am aware of this double setting, but I also think the

Re: Request for help:-Solr - Indexer causes java.lang.OutOfMemoryError: Java heap spac

2015-10-15 Thread Zheng Lin Edwin Yeo
You can increase the Java heap memory maximum by setting the -Xmx parameter when you start Solr, if you are using Solr 5.1 and below. (Eg: -Xmx4096M) For Solr 5.2 and above, set the -m parameters (Eg: -m 4g) Regards, Edwin On 15 October 2015 at 21:09, Shawn Heisey wrote:

Recursively scan documents for indexing in a folder in SolrJ

2015-10-15 Thread Zheng Lin Edwin Yeo
Hi, I understand that in SimplePostTool (post.jar), there is this command to automatically detect content types in a folder, and recursively scan it for documents for indexing into a collection: bin/post -c gettingstarted afolder/ This has been useful for me to do mass indexing of all the files

Re: simple test on solr 5.2.1 wrong leader elected on startup

2015-10-15 Thread Matteo Grolla
Don't think so, the default behaviour at 4), to my knowledge,is to wait 3 minutes (leaderVoteWait) for all replicas to come up to avoid electing a leader with stale data. So the observed behaviour is unexpected to me I created a cluster of 2 nodes copying the server dir to node1 and node2 and

Solr Suggest and weightField

2015-10-15 Thread dboychuck
I am trying to figure out how to give weights to my suggestions but I can find no documentation on how to do this correctly. Here is my configuration: solrconfig.xml mySuggester DocumentDictionaryFactory FuzzyLookupFactory suggest popularity textSuggest

Re: Tokenize ShingleFilterFactory results and apply filters to tokens

2015-10-15 Thread Koji Sekiguchi
Hi Vitaly, I'm not sure I understand you correctly, why don't you put EdgeNGramFilter just after ShingleFilter? That is: Koji On 2015/10/15 22:47, vitaly bulgakov wrote: I want to rephrase my question I asked in another post. As far as I understand filter ShingleFilterFactory creates

Filtering on a Field with Suggestion

2015-10-15 Thread Salman Ansari
Hi guys, I am working with Solr suggester as explained in this article. https://cwiki.apache.org/confluence/display/solr/Suggester The suggester is working fine but I want to filter the results based on a filed (which is type). I have tried to follow what was written at the end of the article

Re: How to disable the admin interface

2015-10-15 Thread Ganesh
Hi See if this article helps you. http://www.findbestopensource.com/article-detail/restrict-solr-admin-access It has settings with regard to tomcat. Regards Ganesh On 10/6/2015 2:21 AM, Shawn Heisey wrote: On 10/4/2015 3:07 PM, Siddhartha Singh Sandhu wrote: I am on page with you guys

Re: Replication and soft commits for NRT searches

2015-10-15 Thread Erick Erickson
bq: the background for my question is that one of the requirements for our injection tool is that it should report that a new document has been successfully enrolled to the cluster only if it is available on all replicas Frankly, this is the tail wagging the dog. SolrCloud is designed to

RE: Run Solr 5.3.0 as a Service on Windows using NSSM

2015-10-15 Thread Adrian Liew
Hi Edwin, Solr 5.3.0 seems to be working for me using NSSM. I am operating on a Windows Server 2012. I did put start -f -p 8983. Are you getting errors? Is Solr not starting up? Best regards, Adrian -Original Message- From: Zheng Lin Edwin Yeo [mailto:edwinye...@gmail.com] Sent:

Autostart Zookeeper and Solr using scripting

2015-10-15 Thread Adrian Liew
Hi, I am trying to implement some scripting to detect if all Zookeepers have started in a cluster, then restart the solr servers. Has anyone achieved this yet through scripting? I also saw there is the ZookeeperClient that is available in .NET via a nuget package. Not sure if this could be

Re: Solr Migration 1.4.1 -> 5.2.1

2015-10-15 Thread Shawn Heisey
On 10/15/2015 9:53 AM, fabigol wrote: > i catch an old project working with Solr 1.4.1, jbossPortal and java 1.5. > I try to migrate my solr version to solr 5.2.1 work with java 1.7. > The solr indexation works but i fail to display the new results on my > application. > I want to know if i must