Search results not as expected.

2014-06-18 Thread Modassar Ather
Hi, I have two documents indexed. With following query I am getting a search result based on AND clauses. *ab:(system entity)* : Number of results returned 1, as expected. *ab:(system entity)* *AND ab:authorization* : Number of results returned 1, as expected. But following query returns a

Re: Match in MultiValueField

2014-06-18 Thread Ahmet Arslan
Hi, So you have a query=foo bar and you want to retrieve f1yes foo/f1 ? In other words you want to learn which fields caused a match. May be you can use dynamic fields (instead of multivalued) and use debugQuery=true response to extract that information f1_1no foo1/f1_1  f1_2yes foo/f1_2 

Basic Authentication for Admin GUI

2014-06-18 Thread Thomas Fischer
Hello, I'm trying to set up a basic authentication for the admin function in the new solr GUI. For this I have to give the appropriate url-pattern, e.g. url-pattern//url-pattern will match every URL in my solr server. But the GUI now runs all administrative tasks under /#/ and there is no

VelocityResponseWriter in solr

2014-06-18 Thread Vivekanand Ittigi
Hi, I want to use VelocityResponseWriter in solr. I've indexed a website( for example http://www.biginfolabs.com/). If i type a query http://localhost:8983/solr/collection1/select?q=santhoswt=xmlindent=true http://localhost:8983/solr/collection1/select?q=*%3A*wt=xmlindent=true I will get all the

Solr and OpenNLP - Error loading class 'solr.OpenNLPTokenizerFactory'

2014-06-18 Thread Bhadra Mani
Hi All, Using link https://wiki.apache.org/solr/OpenNLP#Deployment_to_Solr Followed the steps. bin/trainall.sh - It keept running while I executed next step go to trunk-dir/solr and run 'ant test-contrib' (This has 2 test suite failed.) Later created war file using 'ant dist' (Build Successful)

Fwd: Solr and OpenNLP - Error loading class 'solr.OpenNLPTokenizerFactory'

2014-06-18 Thread Bhadra Mani
I am facing this issue https://issues.apache.org/jira/browse/SOLR-3625 but adding to solrconfig.xml doesnot work. it is on 4.8.1 Thanks, Bhadra -- Forwarded message -- From: Bhadra Mani bhadram...@gmail.com Date: Wed, Jun 18, 2014 at 4:46 PM Subject: Solr and OpenNLP - Error

Re: Converting XML response of Search query into HTML.

2014-06-18 Thread Venkata krishna
Thanks for quick responses, Ahemt , i have tried by removing ampersand then xml response has not converted to html response it is in just xml only. Erik , according to your suggestion i used VelocityResponseWriter. like this manner query.set(wt, velocity);

Re: Document security filtering in distributed solr (with multi shard)

2014-06-18 Thread Ali Nazemian
Any idea would be appropriate. On Tue, Jun 17, 2014 at 5:44 PM, Ali Nazemian alinazem...@gmail.com wrote: Dear Alexandre, Yeah I saw that, but what is the best way of doing that from the performance point of view? I think of one solution myself: Suppose we have a RDBMS for users that

Re: Document security filtering in distributed solr (with multi shard)

2014-06-18 Thread Alexandre Rafalovitch
The performance you should usually test yourself. Especially, since you probably want some sort of cashing. But post-filters were specifically designed to be used for expensive operations (and you can order them too to apply in sequence). They should also work distributed, though each shard will

Re: Converting XML response of Search query into HTML.

2014-06-18 Thread Erik Hatcher
The ‘’ is only for separating parameters when building a URL, but omit the ‘’ when using SolrJ. You’ll probably need to do a little bit of SolrJ trickery to get the response back as text, such that SolrJ doesn’t try to interpret the response as XML or javabin. Erik On Jun 18, 2014,

What is causing snapshots?

2014-06-18 Thread Tom Van den Abbeele
Hi all, I'm trying to figure out what is causing several snapshots a day on a multi-core solr 3.5.0 instance deployed in Jboss with replication via the ReplicationHandler. Currently the parameters indicate there will be made a backup after an optimize, but at the moment there are no automatic

Re: VelocityResponseWriter in solr

2014-06-18 Thread Erik Hatcher
You’ll see that all the fields are visible when you either use /browse?wt=xml or /browse?debugQuery=true, so the values are all there (via fl=*). The default non-debug view only shows a few fields, but you can adjust the template(s) used to render things how you’d like. The main template to

Solr 4.8 result page desplay changes and highlighting

2014-06-18 Thread vicky
Hi Everyone, I just installed solr 4.8 release and playing with DIH and Velocity configuration. I am trying to change result page columns to display more # of fields and type of format to tabular since I have 1 rows to display on one page if I can in out of box configuration. I also tried

Re: Highlighting not working

2014-06-18 Thread vicky
Were you ever able to resolve this issue? I am having same issue and highligh is not working for me on solr 4.8? -- View this message in context: http://lucene.472066.n3.nabble.com/Highlighting-not-working-tp4112659p4142513.html Sent from the Solr - User mailing list archive at Nabble.com.

add new Fields with SolrJ without changing schema.xml

2014-06-18 Thread benjelloun
Hello, I need to add new Fields with SolrJ without changing schema.xml. this is my code java : HttpSolrServer server = new HttpSolrServer(http://localhost:8080/solr;); SolrInputDocument doc = new SolrInputDocument(); doc.addField(id, id); doc.addField(Titre, nomdocument); the id and Titre are

Calculating filterCache size

2014-06-18 Thread Benjamin Wiens
Hi, I'm looking for a formula to calculate filterCache size in the RAM. The best estimation I can find is here http://stackoverflow.com/questions/2004/solr-filter-cache-fastlrucache-takes-too-much-memory-and-results-in-out-of-mem An index of 1.000.000 would thus take 12,5 GB in the RAM with

Leader Selection Error

2014-06-18 Thread Gurfan
Hi, We have a SolrCloud 4.7.1 setup having some leader and some replica. If a leader goes down then it tries to elect the leader between the replica`s. Between the replica`s some replica`s gets into recovery mode. In this activity an error is thrown we are not the leader. The server went into 40

Re: Calculating filterCache size

2014-06-18 Thread Erick Erickson
You pretty much have it. Actually, the number you want is the maxDoc figure from the admin UI screen. The formula will be maxDoc/8 bytes + (some overhead but not enough to matter), for EVERY entry. You'll never fit 100B docs on a single machine anyway. Lucene has a hard limit of 2B docs, and I've

Re: add new Fields with SolrJ without changing schema.xml

2014-06-18 Thread Erick Erickson
bq: I need to add new Fields with SolrJ without changing schema.xml You have three options: 1 change the schema.xml file. but you say you can't. Why not? 2 use dynamic fields. If you're lucky, you have the stock schema.xml and can use them. They'll require some suffix to match the pattern though.

Re: add new Fields with SolrJ without changing schema.xml

2014-06-18 Thread benjelloun
Hello, i'm using this configuration on solrconfig.xml: schemaFactory class=ManagedIndexSchemaFactory bool name=mutabletrue/bool str name=managedSchemaResourceNamemanaged-schema/str /schemaFactory Can you please give me an exemple on SolrJ for adding a new field. thanks,

RE: Highlighting not working

2014-06-18 Thread Teague James
Vicky, I resolved this by making sure that the field that is searched has stored=true. By default text is searched, which is the destination of the copyFields and is not stored. If you change your copyField destination to a field that is stored and use that field as the default search field then

Re: add new Fields with SolrJ without changing schema.xml

2014-06-18 Thread benjelloun
Hello, this is what i want to do: public static void addNewField(Boolean uniqueId,String type, Boolean indexed,Boolean stored,Boolean multivalued,Boolean sortmissinglast,Boolean required){ . .

Re: Converting XML response of Search query into HTML.

2014-06-18 Thread Venkata krishna
Hi Erik, I have tried by removing '' and i got response as in text format but i don't want response in text form. We need to get response as in html form with out any exception(Expected mime type application/xml but got text/html).So could you please provide any suggestion. Thanks, venkata

Re: add new Fields with SolrJ without changing schema.xml

2014-06-18 Thread Walter Underwood
Why can't you change schema.xml? --wunder On Jun 18, 2014, at 8:56 AM, benjelloun anass@gmail.com wrote: Hello, this is what i want to do: public static void addNewField(Boolean uniqueId,String type, Boolean indexed,Boolean stored,Boolean multivalued,Boolean

Re: Calculating filterCache size

2014-06-18 Thread Benjamin Wiens
Thanks Erick! So let's say I have a config of filterCache class=solr.FastLRUCache size=1 initialSize=1 autowarmCount=5000/ MaxDocuments = 1,000,000 So according to your formula, filterCache should roughly have the potential to consume this much RAM: ((1,000,000 / 8) + 128) * (10,000) =

Limit Porter stemmer to plural stemming only?

2014-06-18 Thread Jacob, Jerry (RIS-ATL)
Hi, Can you please share the Java code for Plural Only Porter Stemmer for English if you don't mind? Thanks, Jerry

Re: Calculating filterCache size

2014-06-18 Thread Shawn Heisey
On 6/18/2014 10:57 AM, Benjamin Wiens wrote: Thanks Erick! So let's say I have a config of filterCache class=solr.FastLRUCache size=1 initialSize=1 autowarmCount=5000/ MaxDocuments = 1,000,000 So according to your formula, filterCache should roughly have the potential to

Re: MergeReduceIndexerTool takes a lot of time for a limited number of documents

2014-06-18 Thread Wolfgang Hoschek
Consider giving the MR tasks more RAM, for example via hadoop jar /opt/cloudera/parcels/CDH/lib/solr/contrib/mr/search-mr-*-job.jar org.apache.solr.hadoop.MapReduceIndexerTool -D 'mapred.child.java.opts=-Xmx2000m’ ... Wolfgang. On May 26, 2014, at 10:48 AM, Costi Muraru costimur...@gmail.com

Synonyms - 20th and 20

2014-06-18 Thread Jae Joo
I have a synonyms.txt file which has 20th,twentieth Once I apply the synonym, I see 20th, twentieth and 20 for 20th. Does anyone know where 20 comes from? How can I have only 20th and twentieth? Thanks, Jae

Re: Synonyms - 20th and 20

2014-06-18 Thread Diego Fernandez
What tokenizer and filters are you using? Diego Fernandez - 爱国 Software Engineer US GSS Supportability - Diagnostics - Original Message - I have a synonyms.txt file which has 20th,twentieth Once I apply the synonym, I see 20th, twentieth and 20 for 20th. Does anyone know where 20

Looking for migration stories to an HDFS-backed Solr Cloud

2014-06-18 Thread Michael Della Bitta
Hi everyone, We're considering a migration to an HDFS-backed Solr Cloud, both from our 4.2-based Solr Cloud, and a legacy 3.6 classic replication setup. In the end, we hope to unify these two and upgrade to 4.8.1, or 4.9 if that's out in time. I'm wondering how many of you have experience with

RE: Solr maximum Optimal Index Size per Shard

2014-06-18 Thread Toke Eskildsen
Toke Eskildsen [t...@statsbiblioteket.dk] wrote: [Toke: SSDs with 2.7TB of index on a 256GB machine] tl;dr: for small result sets ( 1M hits) on unwarmed searches with simple queries, response time is below 100ms. If we enable faceting with plain Solr, this jumps to about 1 second. I did a

Re: Warning message logs on startup after upgrading to 4.8.1

2014-06-18 Thread Chris Hostetter
: WARN o.a.s.r.ManagedResource- No stored data found for : /schema/analysis/stopwords/english : WARN o.a.s.r.ManagedResource- No stored data found for : /schema/analysis/synonyms/english : : I fixed these by commenting out the managed_en field type in my : schema, see

Why aren't my nested documents nesting?

2014-06-18 Thread Vinay B,
Probably a silly error. Can someone point out my mistake? Code and output gists at https://gist.github.com/anonymous/fb9cdb5b44e76b2c308d Thanks Code: SolrInputDocument solrDoc = new SolrInputDocument(); solrDoc.addField(id, documentId); solrDoc.addField(content_type,

What's the best way to specify nested child documents using UpdateRequest

2014-06-18 Thread Vinay B,
SolrJ allows a direct linkage between parent and child document using SolrInputDocument.addChildDocument(...) . We, however, construct our request via a raw UpdateRequest() as that gives us a bit more flexibility. I'm investigating how best to add nested docs using this approach. From my

Re: Debug different Results from different Request Handlers

2014-06-18 Thread O. Olson
Thank you Erik (and to steffkes who helped me on the IRC #Solr Chat). Sorry for the delay in responding, but I got this to work. Your suggestion about adding debug=true to the query helped me. Since I was adding this to the Velocity request handler, I could not see the debug results,

ICUTokenizer or StandardTokenizer or ??? for text_all type field that might include non-whitespace langs

2014-06-18 Thread Allison, Timothy B.
All, In one index I’m working with, the setup is the typical langid mapping to language specific fields. There is also a text_all field that everything is copied to. The documents can contain a wide variety of languages including non-whitespace languages. We’ll be using the ICUTokenFilter

Re: ICUTokenizer or StandardTokenizer or ??? for text_all type field that might include non-whitespace langs

2014-06-18 Thread Alexandre Rafalovitch
I don't think the text_all field would work too well for multilingual setup. Any reason you cannot use edismax to search over a bunch of fields instead? Regards, Alex. Personal website: http://www.outerthoughts.com/ Current project: http://www.solr-start.com/ - Accelerating your Solr

Re: What's the best way to specify nested child documents using UpdateRequest

2014-06-18 Thread Mikhail Khludnev
On Thu, Jun 19, 2014 at 3:32 AM, Vinay B, vybe3...@gmail.com wrote: I'm hoping that despite this, that the child can be modified updated later on, without affecting the main document. Nope. You have to rewrite whole block. -- Sincerely yours Mikhail Khludnev Principal Engineer, Grid

Re: Why aren't my nested documents nesting?

2014-06-18 Thread Mikhail Khludnev
because you need you query by special query parser http://blog.griddynamics.com/2013/09/solr-block-join-support.html to nest the output you need https://issues.apache.org/jira/browse/SOLR-5285 On Thu, Jun 19, 2014 at 3:20 AM, Vinay B, vybe3...@gmail.com wrote: Probably a silly error. Can