Re: spellcheck.count v/s spellcheck.alternativeTermCount

2015-02-17 Thread Nitin Solanki
zero documents in your dictionary field have hope in them - The spellchecker will try to return you up to 10 suggestions for hope, but only up to 5 suggestions for life James Dyer Ingram Content Group -Original Message- From: Nitin Solanki [mailto:nitinml...@gmail.com] Sent

Collations problem even term is available in documents.

2015-02-17 Thread Nitin Solanki
Hi, I am misspelling a query hota hai to hota hain. Inside collations, hota hai is not coming, instead of that hot main, home have. etc are coming. I have 37 documents where hota hai is present. *URL: *localhost:8983/solr/wikingram/spell?q=gram_ci:hota

Collations are not using suggestions to build collations

2015-02-17 Thread Nitin Solanki
Hi, I want to build collations using suggestions of the query. But collations are building without using suggestions, they are using its own suggesters*(misspellingsAndCorrections)* and don't know from where these suggestions are coming. You can see the result by seeing below response

Re: spellcheck.count v/s spellcheck.alternativeTermCount

2015-02-17 Thread Nitin Solanki
Any help please? On Tue, Feb 17, 2015 at 4:57 PM, Nitin Solanki nitinml...@gmail.com wrote: Hello Everyone, I got confusion between spellcheck.count and spellcheck.alternativeTermCount in Solr. Any help in details?

Re: spellcheck.count v/s spellcheck.alternativeTermCount

2015-02-17 Thread Nitin Solanki
suggestions when the terms is in the dictionary. James Dyer Ingram Content Group -Original Message- From: Nitin Solanki [mailto:nitinml...@gmail.com] Sent: Tuesday, February 17, 2015 5:27 AM To: solr-user@lucene.apache.org Subject: spellcheck.count v/s spellcheck.alternativeTermCount

Re: Collations are not working fine.

2015-02-17 Thread Nitin Solanki
you query: q=gram_ci:gone wthh thes wintwt=jsonindent=trueshards.qt=/spell James Dyer Ingram Content Group -Original Message- From: Nitin Solanki [mailto:nitinml...@gmail.com] Sent: Friday, February 13, 2015 1:05 AM To: solr-user@lucene.apache.org Subject: Re: Collations

Re: Collations are not working fine.

2015-02-17 Thread Nitin Solanki
, Dyer, James james.d...@ingramcontent.com wrote: Nitin, Can you post the full spellcheck response when you query: q=gram_ci:gone wthh thes wintwt=jsonindent=trueshards.qt=/spell James Dyer Ingram Content Group -Original Message- From: Nitin Solanki [mailto:nitinml

Sort collation on hits.

2015-02-17 Thread Nitin Solanki
Hi, All I want to sort the collations on hits in descending order. How to do ?

Re: Collations are not working fine.

2015-02-17 Thread Nitin Solanki
=gram_ci:gone wthh thes wintwt=jsonindent=trueshards.qt=/spell James Dyer Ingram Content Group -Original Message- From: Nitin Solanki [mailto:nitinml...@gmail.com] Sent: Friday, February 13, 2015 1:05 AM To: solr-user@lucene.apache.org Subject: Re: Collations are not working fine

spellcheck.count v/s spellcheck.alternativeTermCount

2015-02-17 Thread Nitin Solanki
Hello Everyone, I got confusion between spellcheck.count and spellcheck.alternativeTermCount in Solr. Any help in details?

Re: alternativeTermCount and WordBreakSolrSpellChecker combination not working

2015-02-13 Thread Nitin Solanki
Hi O. Klein, How you sorted the suggestion on frequency? I think, You used str name=comparatorClass freq /str to sort suggestions of frequency. Are you using sharding/multiple servers in Solr because on single node, comparatorClass is working but on multiple servers, it is not

Re: Collations are not working fine.

2015-02-12 Thread Nitin Solanki
Hi James Dyer, I did the same as you told me. Used WordBreakSolrSpellChecker instead of shingles. But still collations are not coming or working. For instance, I tried to get collation of gone with the wind by searching gone wthh thes wint on field=gram_ci but didn't

Re: Collations are not working fine.

2015-02-09 Thread Nitin Solanki
of solrconfig.xml, schema.xml and also the full query url you are using and the full spellcheck response. James Dyer Ingram Content Group -Original Message- From: Nitin Solanki [mailto:nitinml...@gmail.com] Sent: Monday, February 09, 2015 7:47 AM To: solr-user@lucene.apache.org Subject

Re: Collations are not working fine.

2015-02-09 Thread Nitin Solanki
AM, Nitin Solanki nitinml...@gmail.com wrote: I am working on spell checking in Solr. I have implemented Suggestions and collations in my spell checker component. Most of the time collations work fine but in few case it fails. *Working*: I tried query:*gone wthh thes wnd

Does comparatorClass not work in Shards?

2015-02-09 Thread Nitin Solanki
I want to sort the suggestions on frequency. Default, they are sorting on score. *Working (Single Node):* str name=comparatorClassfreq/str It is working on single node. Suggestions are sorted on frequency. *Not Working (Multiple Nodes):* str name=comparatorClassfreq/str I tried the same property

How hits are calculate in Collations?

2015-02-09 Thread Nitin Solanki
Hi, Please anybody can explain me what is hits in collations and how they are calculated? Sometimes, I get the collation and sometimes not. *Problem:* *1)* URL : http://localhost:8983/solr/wikingram/spell?q=gram_ci:*salmn khn*wt=jsonindent=trueshards.qt=/spellrows=1 Output : No

Collations are not working fine.

2015-02-09 Thread Nitin Solanki
I am working on spell checking in Solr. I have implemented Suggestions and collations in my spell checker component. Most of the time collations work fine but in few case it fails. *Working*: I tried query:*gone wthh thes wnd*: In this wnd doesn't give suggestion wind but collation is coming

suggestions are not sorting on frequency using comparatorFreq=freq(Not working)

2015-02-06 Thread Nitin Solanki
http://stackoverflow.com/questions/28368378/suggestions-are-not-sorting-on-frequency-using-comparatorfreq-freqnot-working# I have created 2 nodes having *2 shards* in Solr. I am doing *spell correction technique*. I want to *sort* the *suggestions* of *query(abple)* on the basis on *frequency*.

Re: Solr Logging files get high

2015-02-03 Thread Nitin Solanki
| g+: plus.google.com/appinions https://plus.google.com/u/0/b/112002776285509593336/112002776285509593336/posts w: appinions.com http://www.appinions.com/ On Tue, Feb 3, 2015 at 12:51 AM, Nitin Solanki nitinml...@gmail.com wrote: Hi Michael Della and Michael Sokolov, *size of tlog

comparatorClass is not reflected on all nodes in Solr

2015-02-03 Thread Nitin Solanki
I am created Solr cloud having 4 nodes. I want to sort the suggestion on frequency. For this, I have added a line into solrconfig.xml is *str name=comparatorClassfreq/str* but it is not working and not reflecting on all nodes. Even I do the below steps.: sudo

Solr Logging files get high

2015-02-02 Thread Nitin Solanki
Hi, My solr logs directory has been get high. It is seriously problem or It harms my solr performance in both cases indexing as well as searching.

Re: Solr ate all Memory and throws -bash: cannot create temp file for here-document: No space left on device on Server

2015-02-02 Thread Nitin Solanki
Which 20GB, You are asking? Indexed data size is 2.(dot)04GB. I checked index data using sudo du -hs test_azure_mapping/nitin/solr/node*/solr/wikingram_shard* On Mon, Feb 2, 2015 at 2:54 PM, Toke Eskildsen t...@statsbiblioteket.dk wrote: On Mon, 2015-02-02 at 09:59 +0100, Nitin Solanki wrote

Re: Solr ate all Memory and throws -bash: cannot create temp file for here-document: No space left on device on Server

2015-02-02 Thread Nitin Solanki
t...@statsbiblioteket.dk wrote: On Mon, 2015-02-02 at 10:36 +0100, Nitin Solanki wrote: Which 20GB, You are asking? Indexed data size is 2.(dot)04GB. Yes, but at http://stackoverflow.com/questions/28273340/solr-ate-all-memory-and-throws-bash-cannot-create-temp-file-for-here-document you

Re: Solr Logging files get high

2015-02-02 Thread Nitin Solanki
/ 112002776285509593336/posts w: appinions.com http://www.appinions.com/ On Mon, Feb 2, 2015 at 7:42 AM, Nitin Solanki nitinml...@gmail.com wrote: Hi, My solr logs directory has been get high. It is seriously problem or It harms my solr performance in both cases indexing as well

Fwd: Solr Logging files get high

2015-02-02 Thread Nitin Solanki
Hi Michael Della and Michael Sokolov, *size of tlog :-* 56K/mnt/nitin/solr/node1/solr/wikingram_shard3_replica1/data/tlog/ 56K/mnt/nitin/solr/node1/solr/wikingram_shard7_replica1/data/tlog/ 56K/mnt/nitin/solr/node2/solr/wikingram_shard4_replica1/data/tlog/ 52K

Solr ate all Memory and throws -bash: cannot create temp file for here-document: No space left on device on Server

2015-02-02 Thread Nitin Solanki
I have been started *solr* for *long time approx 2 weeks* then I saw that Solr ate around *22 GB* from *28 GB RAM* of my *Server*. Please check explanation of error on http://stackoverflow.com/questions/28273340/solr-ate-all-memory-and-throws-bash-cannot-create-temp-file-for-here-document

Re: Solr ate all Memory and throws -bash: cannot create temp file for here-document: No space left on device on Server

2015-02-02 Thread Nitin Solanki
at 2:10 PM, Toke Eskildsen t...@statsbiblioteket.dk wrote: On Mon, 2015-02-02 at 09:11 +0100, Nitin Solanki wrote: I have been started *solr* for *long time approx 2 weeks* then I saw that Solr ate around *22 GB* from *28 GB RAM* of my *Server*. I am guessing your index is about 20GB? Solr's

Re: Stop word suggestions are coming when I indexed sentence using ShingleFilterFactory

2015-01-28 Thread Nitin Solanki
tells it to suggest for terms that exist in the index. I take it also you're using shingles to get word-break suggestions? You might have better luck with this using WordBreakSolrSpellchecker instead of shingles. James Dyer Ingram Content Group -Original Message- From: Nitin

Stop word suggestions are coming when I indexed sentence using ShingleFilterFactory

2015-01-27 Thread Nitin Solanki
Hi, I am getting the suggestion of both correct words and misspell words but not getting, stop words suggestions. Why? Even I am not using solr.StopFilterFactory. Schema.xml : *field name=gram type=textSpell indexed=true stored=true required=true multiValued=false/* fieldType

Want multiple df field on suggestion component.

2015-01-26 Thread Nitin Solanki
Hi, I have created 2 fields ngram and count. ngram = Stores 1 to 5 grams of words or phrase. count = Stores frequency of each ngram. Applying df field on ngram in Suggestion component. When I get the suggestion of misspell word, word and freq are coming but now I need to use count

Re: Count total frequency of a word in a SOLR index

2015-01-23 Thread Nitin Solanki
On Fri, Jan 23, 2015 at 1:53 PM, Mikhail Khludnev mkhlud...@griddynamics.com wrote: https://cwiki.apache.org/confluence/display/solr/Function+Queries totaltermfreq() of you need to sum term freq on docs from resultset? On Fri, Jan 23, 2015 at 10:56 AM, Nitin Solanki nitinml...@gmail.com

Re: Count total frequency of a word in a SOLR index

2015-01-23 Thread Nitin Solanki
by prefix, then the second request can gather totaltermfreqs. On Fri, Jan 23, 2015 at 11:51 AM, Nitin Solanki nitinml...@gmail.com wrote: Thanks Mikhail Khludnev.. I tried this: * http://localhost:8983/solr/collection1/spell?q=gram:%22the%22rows=1fl=totaltermfreq(gram,the) http

Count total frequency of a word in a SOLR index

2015-01-22 Thread Nitin Solanki
I indexed some text_file files in Solr as it is. Applied *StandardTokenizerFactory* and *ShingleFilterFactory* on text_file field *Configuration of Schema.xml structure below :* field name=id type=string indexed=true stored=true required=true multiValued=false / field name=text_file

Re: How much maximum data can we hard commit in Solr?

2015-01-21 Thread Nitin Solanki
Thanks. Great Explanation.. One more thing I want to ask. Which is best doing only hard commit or both hard and soft commit? I want to index 21 GB of data. On Wed, Jan 21, 2015 at 7:48 PM, Shawn Heisey apa...@elyograg.org wrote: On 1/21/2015 6:01 AM, Nitin Solanki wrote: How much of maximum

If I change schema.xml then reIndex is neccessary in Solr or not?

2015-01-21 Thread Nitin Solanki
I *indexed* *2GB* of data. Now I want to *change* the *type* of *field* from *textSpell* to *string* type into *schema.xml.* Detail Explanation on Stackoverflow. Below is the link:

Re: If I change schema.xml then reIndex is neccessary in Solr or not?

2015-01-21 Thread Nitin Solanki
Ok. Thanx On Thu, Jan 22, 2015 at 11:38 AM, Gora Mohanty g...@mimirtech.com wrote: On 22 January 2015 at 11:23, Nitin Solanki nitinml...@gmail.com wrote: I *indexed* *2GB* of data. Now I want to *change* the *type* of *field* from *textSpell* to *string* type into Yes, one would need

Add user-defined field into suggestions block.

2015-01-21 Thread Nitin Solanki
I am working on solr spell checker along with suggester. I am saving document like this : {ngram:the,count:10} {ngram:the age,count:5} {ngram:the age of,count:3} where *ngram* is unique key and applied *StandardTokenizer* and *ShingleFactoryFilter*(1 to 5 size). So, when I search word *the* it

How much maximum data can we hard commit in Solr?

2015-01-21 Thread Nitin Solanki
How much of maximum data we can commit on Solr using hard commit without using Soft commit. maxTime is 1000 in autoCommit Details explanation is on Stackoverflow http://stackoverflow.com/questions/28067853/how-much-maximum-data-can-we-hard-commit-in-solr .

Fwd: Issue : Replacing ID with another will degrade performance in Solr?

2015-01-20 Thread Nitin Solanki
but no able to get correct solution. Please help me. Thanks and Regards, Nitin Solanki.

Re: shards per disk

2015-01-20 Thread Nitin Solanki
Hey Nimrod, Nice try. I just want to know that these 8 shards are each on different system or do you implemented sharding on single system and each shard with different port? On Tue, Jan 20, 2015 at 7:54 PM, Nimrod Cohen nimrod.co...@nice.com wrote: Hi I done some performance test, and I

Re: Issue : Replacing ID with another will degrade performance in Solr?

2015-01-20 Thread Nitin Solanki
is tokenized as a unique key. As I mentioned on stack overflow, it is a bad idea. Yes, it will impact performance as well as lead to duplicate documents. Switch to a string or int/long field and you should be fine regardless of what it is named. On Tue, Jan 20, 2015 at 8:28 AM, Nitin Solanki

Re: Issue : Replacing ID with another will degrade performance in Solr?

2015-01-20 Thread Nitin Solanki
/2015 11:11 AM, Nitin Solanki wrote: Thanks a lot Shawn. There is any way to reduce time to retrieve suggestions fast. I know almost nothing about how to use the suggester and spellcheck features of Solr. I do know that the suggester is based on spellcheck. I have a spellcheck config in my

Re: Leaders in Recovery Failed state

2015-01-20 Thread Nitin Solanki
I am also facing the same issue. My solr version is 4.10.2 On Tue, Jan 20, 2015 at 11:33 PM, Erick Erickson erickerick...@gmail.com wrote: What version of Solr? On Tue, Jan 20, 2015 at 7:07 AM, anand.mahajan an...@zerebral.co.in wrote: Hi all, I have a cluster with 36 Shards and 3

Re: Issue : Replacing ID with another will degrade performance in Solr?

2015-01-20 Thread Nitin Solanki
Thanks a lot Shawn. There is any way to reduce time to retrieve suggestions fast. On Tue, Jan 20, 2015 at 9:33 PM, Shawn Heisey apa...@elyograg.org wrote: On 1/20/2015 7:18 AM, Nitin Solanki wrote: Thanks and sorry for Stackoverflow. You are saying that use string type. But I have used

Re: Issue : Replacing ID with another will degrade performance in Solr?

2015-01-20 Thread Nitin Solanki
Anyone has answer of question which I have asked on 20th Jan 2015 at 7:48 PM On Tue, Jan 20, 2015 at 11:59 PM, Nitin Solanki nitinml...@gmail.com wrote: Okay. No Problem. Please somebody check my question which I have mailed on 20th Jan 2015 at 7:48 PM where I have posted my question along

Issue : Replacing ID with another will degrade performance in Solr?

2015-01-19 Thread Nitin Solanki
but no able to get correct solution. Please help me. Thanks and Regards, Nitin Solanki.

<    1   2