solr.war built from solr 4.7.2 not working

2015-05-07 Thread Rahul Singh
Hi, I have tried to deploy solr.war from building it from 4.7.2 but it is showing the below mentioned error. Has anyone faced the same? any lead would also be appreciated. Error Message: { responseHeader: { status: 500, QTime: 33 }, error: { msg: parsing error, trace:

schema modification issue

2015-05-07 Thread User Zolr
Hi there, I have come accross a problem that when using managed schema in SolrCloud, adding fields into schema would SOMETIMES end up prompting Can't find resource 'schema.xml' in classpath or '/configs/collectionName', cwd=/export/solr/solr-5.1.0/server, there is of course no schema.xml in

Re: Limit the documents for each shard in solr cloud

2015-05-07 Thread Jilani Shaik
Hi Daniel, Thanks for the detailed explanation. My understanding is also similar to you that we should not provide limit over the shard for number of documents that it can index. Usually it will depend on shard routing provided by Solr and I am not expecting any change to document routing

[ Clustering ] Request handler rows - Clustering rows

2015-05-07 Thread Alessandro Benedetti
Hi guys, was thinking to the clustering and the integration of the clustering search component in an existing request handler. I am talking about Online clustering ( the clustering of search results). Once you configure the search component with the engine definition, clustering will happen

oracle and java.sql.SQLException: READ_COMMITTED and SERIALIZABLE are the only valid transaction levels

2015-05-07 Thread Siarhei Padolski
Hello, I’m trying to import data using a read only account to an Oracle database. My data-config.xml is: dataConfig dataSource name=jdbc driver=oracle.jdbc.OracleDriver url=jdbc:oracle:oci8:@//localhost:10010:CONNECTION user=ATLAS_PANDABIGMON_R password=Lutini72

Re: Trying to get AnalyzingInfixSuggester to work in Solr?

2015-05-07 Thread O. Olson
Thank you Erick. I'm sorry I did not mention this earlier, but I am still on Solr 4.10.3. Once I upgrade to Solr 5.0+ , I would consider your suggestion in your blog post. O. O. Erick Erickson wrote Uh, you mean because I forgot to pate in the URL? Siih... Anyway, the URL is irrelevant

Re: Negative Boosting documents with a certain word

2015-05-07 Thread Chris Hostetter
: Right now, I specify the boost for my request handler as: : requestHandler name=/select class=solr.SearchHandler : . : str name=boostln(qty)/str : : /requestHandler : : Is there a way to specify this boost in the Solrconfig.xml? : : I tried: str name=boost(*:*

Solr Multilingual Indexing with one field- Guidance

2015-05-07 Thread Kuntal Ganguly
Our current production index size is 1.5 TB with 3 shards. Currently we have the following field type: fieldType name=text_ngram class=solr.TextField positionIncrementGap=100 analyzer type=query tokenizer class=solr.KeywordTokenizerFactory/ filter class=solr.LowerCaseFilterFactory/ /analyzer

Fwd: Solr Multilingual Indexing with one field

2015-05-07 Thread Kuntal Ganguly
Our current production index size is 1.5 TB with 3 shards. Currently we have the following field type: fieldType name=text_ngram class=solr.TextField positionIncrementGap=100 analyzer type=query tokenizer class=solr.KeywordTokenizerFactory/ filter class=solr.LowerCaseFilterFactory/ /analyzer

Re: oracle and java.sql.SQLException: READ_COMMITTED and SERIALIZABLE are the only valid transaction levels

2015-05-07 Thread Shawn Heisey
On 5/7/2015 11:59 AM, Siarhei Padolski wrote: I’m trying to import data using a read only account to an Oracle database. My data-config.xml is: dataConfig dataSource name=jdbc driver=oracle.jdbc.OracleDriver url=jdbc:oracle:oci8:@//localhost:10010:CONNECTION

Getting error while building Solr

2015-05-07 Thread Aniket Kumar
Hi , I am getting below exception while running ant compile command. [ivy:retrieve] ERROR: impossible to acquire lock for net.sourceforge.nekohtml#nekohtml;1.9.17 [ivy:retrieve] tried C:\Users\ani\.ivy2\local\net.sourceforge.nekohtml\nekohtml\1.9.17\ivys\ivy.xml [ivy:retrieve]

Re: Getting error while building Solr

2015-05-07 Thread Erick Erickson
Upon occasion I've had to purge my ivy cache. On a Mac just 'rm -rf ~/.ivy2/cache' brute force and you'll download a lot of jars when you compile, but simple to test. Erick On Thu, May 7, 2015 at 11:56 AM, Aniket Kumar 008aniketku...@gmail.com wrote: Hi , I am getting below exception while

Re: JSON Facet Analytics API in Solr 5.1

2015-05-07 Thread Frank li
Hi Yonik, I am reading your blog. It is helpful. One question for you, for following example, curl http://localhost:8983/solr/query -d 'q=*:*rows=0 json.facet={ categories:{ type : terms, field : cat, sort : { x : desc}, facet:{ x : avg(price), y :

Re: SolrCloud indexing

2015-05-07 Thread Vincenzo D'Amore
Thanks Shawn. Just to make the picture more clear, I'm trying to understand why a 3 node solrcloud cluster and a old style solr server take same time to index same documents. But in the wiki is written: If the machine is a leader, SolrCloud determines which shard the document should go to,

Re: SolrCloud 4.8 and Java 8

2015-05-07 Thread Erick Erickson
that should be fine. In fact, the current trunk (eventual 6.0) _requires_ Java 8. Best, Erick On Thu, May 7, 2015 at 3:36 PM, Vincenzo D'Amore v.dam...@gmail.com wrote: Hi all, may be this is a silly question, but just to be sure: is there any contraindication to run solrcloud with Java 8?

Re: Not able to Add docValues in Solr

2015-05-07 Thread pras.venkatesh
Thanks for your reply, I was under the impression that clusterstate.json and aliases.json are the two files that the zookeeper maintains. Did not know that schema.xml is also maintained by zookeeper.Yes I am running solrCloud. should I use the zookeeper client to re-upload? -- View this

Re: Limit the documents for each shard in solr cloud

2015-05-07 Thread Daniel Collins
Not sure I understand your problem. If you have 20m documents, and 8 shards, then each shard is (broadly speaking) only going to have 2.5m docs each, so I don't follow the 5m limit? That is with the default routing/hashing, obviously you can write your own hash algorithm or you can shard at your

Re: SolrCloud indexing

2015-05-07 Thread Vincenzo D'Amore
Thanks Erick. I'm not sure I got your answer. I try to recap, when the raw document has to be indexed, it will be forwarded to shard leader. Shard leader indexes the document for that shard, and then forwards the indexed document to any replicas. I want just be sure that when the raw document is

Re: Proximity searching in percentage

2015-05-07 Thread Alessandro Benedetti
Hi ! Currently Solr builds FST to provide proper fuzzy search or spellcheck suggestions based on the string distance . The current default algorithm is the Levenstein distance ( that returns the number of edit as distance metric). In your case you should calculate client side, the edit you want to

Re: Proximity searching in percentage

2015-05-07 Thread Zheng Lin Edwin Yeo
Thank you for the information. I've currently using the fuzzy search and set the edit distance value to ~0.79, and this has allowed a 20% error rate. (ie for words with 5 characters, it allows 1 mis-spelled character, and for words with 10 characters, it allows 2 mis-speed characters). However,

Re: solr.war built from solr 4.7.2 not working

2015-05-07 Thread Rahul Singh
response inline. On Thu, May 7, 2015 at 7:01 PM, Shawn Heisey apa...@elyograg.org wrote: On 5/7/2015 3:43 AM, Rahul Singh wrote: I have tried to deploy solr.war from building it from 4.7.2 but it is showing the below mentioned error. Has anyone faced the same? any lead would also be

Re: A defect in Schema API with Add a New Copy Field Rule?

2015-05-07 Thread Steve Rowe
On May 6, 2015, at 8:25 PM, Yonik Seeley ysee...@gmail.com wrote: On Wed, May 6, 2015 at 8:10 PM, Steve Rowe sar...@gmail.com wrote: It’s by design that you can copyField the same source/dest multiple times - according to Yonik (not sure where this was discussed), this capability has

Re: solr.war built from solr 4.7.2 not working

2015-05-07 Thread Shawn Heisey
On 5/7/2015 3:43 AM, Rahul Singh wrote: I have tried to deploy solr.war from building it from 4.7.2 but it is showing the below mentioned error. Has anyone faced the same? any lead would also be appreciated. Error Message: { responseHeader: { status: 500, QTime: 33 },

Re: Limit the documents for each shard in solr cloud

2015-05-07 Thread Erick Erickson
bq: We will not be able to limit the documents per shard in Solr Cloud. As Solr will accept all the documents as long as space is there for it to index. True, end of story ;). How does Solr know it will run out of space? It hits an exception, there's really no this doesn't look like it will fit

Re: A defect in Schema API with Add a New Copy Field Rule?

2015-05-07 Thread Steven White
Thanks Steve and Yonik. This now makes sense. Updating the doc will be of a big help. With regards to deleting a copy-field, what I found is that if I have N instances of the same copy-field, I have to issue N deletes to remove them all. This behavior matches with the add and need to be kept.

Re: JSON Facet Analytics API in Solr 5.1

2015-05-07 Thread Frank li
This one does not have problem, but how do I include sort in this facet query. Basically, I want to write a solr query which can sort the facet count ascending. Something like http://localhost:8983/solr /demo/query?q=applejson.facet={field=price sort='count asc'}

Re: JSON Facet Analytics API in Solr 5.1

2015-05-07 Thread Frank li
Is there any book to read so I won't ask such dummy questions? Thanks. On Thu, May 7, 2015 at 2:32 PM, Frank li fudon...@gmail.com wrote: This one does not have problem, but how do I include sort in this facet query. Basically, I want to write a solr query which can sort the facet count

Re: Not able to Add docValues in Solr

2015-05-07 Thread Shawn Heisey
On 5/7/2015 3:51 PM, pras.venkatesh wrote: I am trying to enable Doc Values for certain fields in Solr schema which helps with memory management while sorting the results and here is configuration I have field name=ip_addr type=string indexed=true stored=true omitNorms=true docValues=true /

Re: solr 3.6.2 under tomcat 8 missing corename in path

2015-05-07 Thread Shawn Heisey
On 5/7/2015 11:03 AM, Tim Dunphy wrote: When I browse to /solr I see a link that points me to /solr/admin. And when I click on that link is when I see the error: *missing core name in path* I think what my problem is, is that I am not listing the cores correctly in the solr.xml file.

Re: SolrCloud indexing

2015-05-07 Thread Erick Erickson
bq: ...forwards the index notation to itself and any replicas... That's just odd phrasing. All that means is that the document sent through the indexing process on the leader and all followers for a shard and is indexed independently on each. This is as opposed to the old master/slave situation

Not able to Add docValues in Solr

2015-05-07 Thread pras.venkatesh
I am trying to enable Doc Values for certain fields in Solr schema which helps with memory management while sorting the results and here is configuration I have field name=ip_addr type=string indexed=true stored=true omitNorms=true docValues=true / And field type defined this way. fieldType

Re: JSON Facet Analytics API in Solr 5.1

2015-05-07 Thread Yonik Seeley
On Thu, May 7, 2015 at 4:47 PM, Frank li fudon...@gmail.com wrote: Hi Yonik, I am reading your blog. It is helpful. One question for you, for following example, curl http://localhost:8983/solr/query -d 'q=*:*rows=0 json.facet={ categories:{ type : terms, field : cat,

SolrCloud 4.8 and Java 8

2015-05-07 Thread Vincenzo D'Amore
Hi all, may be this is a silly question, but just to be sure: is there any contraindication to run solrcloud with Java 8? Thanks for your patience, Vincenzo -- Vincenzo D'Amore email: v.dam...@gmail.com skype: free.dev mobile: +39 349 8513251

Re: SolrCloud 4.8 and Java 8

2015-05-07 Thread Shawn Heisey
On 5/7/2015 4:36 PM, Vincenzo D'Amore wrote: may be this is a silly question, but just to be sure: is there any contraindication to run solrcloud with Java 8? Solr 4.8 should work very well running on Java 8. I would recommend the latest Java 8 from Oracle, version 8u45. There are supposed to

Re: Trying to get AnalyzingInfixSuggester to work in Solr?

2015-05-07 Thread Rajesh Hazari
Good to know that its working as expected. I have some couple of question on your autosuggest implementation. I see that you are using SpellcheckComponent instead of SuggestComponent are you using this intentionally if not plz read this

Re: Specify HTTP instead of AJP on tomcat

2015-05-07 Thread Shawn Heisey
On 5/7/2015 9:24 AM, Aki Balogh wrote: I'm seeing the following error while indexing: May 06, 2015 10:52:32 PM org.apache.jk.common.MsgAjp processHeader SEVERE: BAD packet signature 18245 May 06, 2015 10:52:32 PM org.apache.jk.common.ChannelSocket processConnection SEVERE: Error, processing

Re: Trying to get AnalyzingInfixSuggester to work in Solr?

2015-05-07 Thread Alessandro Benedetti
When working with Suggesters I suggest to take a deep look to this guide : http://lucidworks.com/blog/solr-suggester/ It was really helpful. Cheers 2015-05-07 16:58 GMT+01:00 Rajesh Hazari rajeshhaz...@gmail.com: Good to know that its working as expected. I have some couple of question on

Re: getting frequent CorruptIndexException and inconsistent data though core is active

2015-05-07 Thread adfel70
Anyone has any inputs on this? -- View this message in context: http://lucene.472066.n3.nabble.com/getting-frequent-CorruptIndexException-and-inconsistent-data-though-core-is-active-tp4204129p4204347.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Trying to get AnalyzingInfixSuggester to work in Solr?

2015-05-07 Thread O. Olson
Thank you Erick. I have no clue what you are referring to when you used to word this? Are you referring to my question in my original email/message? Erick Erickson wrote Have you seen this? I tried to make something end-to-end with assorted gotchas identified Best, Erick --

Specify HTTP instead of AJP on tomcat

2015-05-07 Thread Aki Balogh
Hello, I'm seeing the following error while indexing: May 06, 2015 10:52:32 PM org.apache.jk.common.MsgAjp processHeader SEVERE: BAD packet signature 18245 May 06, 2015 10:52:32 PM org.apache.jk.common.ChannelSocket processConnection SEVERE: Error, processing connection

Re: Limit the documents for each shard in solr cloud

2015-05-07 Thread Jack Krupansky
Wait a minute, guys... aren't we in the 21st century, where disk is ultra-cheap and ultra plentiful? So... what's the REAL problem here? Seriously, when multi-terabyte drives are so common on servers and Solr really doesn't work well with more than 100 to 250 million docs per server anyway, which

Re: Limit the documents for each shard in solr cloud

2015-05-07 Thread Jack Krupansky
A leader is also a replica - SolrCloud is not a master/slave architecture. Any replica can be elected to be the leader, but that is only temporary and can change over time. You can place multiple shards on a single node, but was that really your intention? Generally, number of nodes equals

Re: Trying to get AnalyzingInfixSuggester to work in Solr?

2015-05-07 Thread O. Olson
Thank you Rajesh for your persistence. I now got it to work. In my original email/message, I mentioned that I use 'text_general' as defined in the examples: http://svn.apache.org/viewvc/lucene/dev/trunk/solr/example/example-DIH/solr/db/conf/schema.xml?view=markup I'm sorry I did not mention this

I was asked to wait on state recovering for shard.... but I still do not see the request state

2015-05-07 Thread adfel70
Hi I have a cluster of 16 shards, 3 replicas. I keep getting situations where a whole shard breaks. the leader is at down state and says: I was asked to wait on state recovering for shard but i still do not see the requested state. I see state: recovering live:true leader from ZK:http://...

Re: Trying to get AnalyzingInfixSuggester to work in Solr?

2015-05-07 Thread Erick Erickson
Uh, you mean because I forgot to pate in the URL? Siih... Anyway, the URL is irrelevant now that you've solved your problem, but in case you're interested: http://lucidworks.com/blog/solr-suggester/ Sorry for the confusion. Erick On Thu, May 7, 2015 at 9:12 AM, Alessandro Benedetti

Re: Limit the documents for each shard in solr cloud

2015-05-07 Thread Daniel Collins
Jilani, you did say My team needs that option if at all possible, my first response would be why?. Why do they want to limit the number of documents per shard, what's the rationale/use case behind that requirement? Once we understand that, we can explain why its a bad idea. :) I suspect I'm

Re: solr 3.6.2 under tomcat 8 missing corename in path

2015-05-07 Thread Tim Dunphy
Hi Shawn, The URL must include the core name. Your defaultCoreName is collection1, and I'm guessing you don't have a core named collection1. Try browsing to just /solr instead of /solr/admin ... you should get a list of links for valid cores, each of which will take you to the admin page

Re: SolrCloud indexing

2015-05-07 Thread Shawn Heisey
On 5/7/2015 3:04 AM, Vincenzo D'Amore wrote: Thanks Erick. I'm not sure I got your answer. I try to recap, when the raw document has to be indexed, it will be forwarded to shard leader. Shard leader indexes the document for that shard, and then forwards the indexed document to any replicas.

Re: Trying to get AnalyzingInfixSuggester to work in Solr?

2015-05-07 Thread O. Olson
Thank you Rajesh, Alessandro and Erick. I apparently did not have much knowledge about the Suggester - in fact I had no clue that there is a difference between the SpellcheckComponent and the SuggestComponent. I would be reading about this, esp. Erick blog post on Lucidworks. O. O. Rajesh