Re: Sorting fields of text_general fieldType

2012-08-03 Thread Lance Norskog
Give us some pairs of titles which sort the wrong way. On Thu, Aug 2, 2012 at 10:06 AM, Anupam Bhattacharya anupam...@gmail.com wrote: The approach used to work perfectly. But recently i realized that it is not working for more than 30 indexed records. I am using SOLR 3.5 version. Is

Re: Sorting fields of text_general fieldType

2012-08-03 Thread Anupam Bhattacharya
Few titles are as following: Embattled JPMorgan boss survives power challenge - Jakarta Globe Kitten Survives 6500-Mile Trip in China-US Container - Jakarta Globe Guard survives hail of bullets - Jakarta Post On Fri, Aug 3, 2012 at 1:09 PM, Lance Norskog goks...@gmail.com wrote: Give us some

Re: How to update a core using SolrJ

2012-08-03 Thread Chantal Ackermann
Hi Roy, the example URL is correct if your core is available under that name (configured in solr.xml) and has started without errors. I think I observed that it makes a different whether there is a trailing slash or not (but that was a while ago, so maybe that has changed). If you can reach

Tuning caching of geofilt queries

2012-08-03 Thread Thomas Heigl
Hey all, Our production system is heavily optimized for caching and nearly all parts of queries are satisfied by filter caches. The only filter that varies a lot from user to user is the location and distance. Currently we use the default location field type and index lat/long coordinates as we

Re: split on white space and then EdgeNGramFilterFactory

2012-08-03 Thread Rajani Maski
Yes this works, Thank you. Regards Rajani On Thu, Aug 2, 2012 at 6:04 PM, Jack Krupansky j...@basetechnology.comwrote: Only do the ngram filter at index time. So, add a query-time analyzer to that field type but without the ngram filter. Also, add debugQuery to your query request to see

search hit on multivalued fields

2012-08-03 Thread Mark , N
I have a multivalued field Tex which is indexed , for example : F1: some value F2: some value Text = ( content of f1,f2) When user search , I am checking only a Text field but i would also need to display to users which Field ( F1 or F2 ) resulted the search hit Is it possible in SOLR ?

Highlighting error InvalidTokenOffsetsException: Token oedipus exceeds length of provided text sized 11

2012-08-03 Thread Justin Engelman
I have an autocomplete index that I return highlighting information for but am getting an error with certain search strings and fields on Solr 3.5. I’ve narrowed it down to a specific field matching with a specific search string. And I’ve tried making a few different changes to the schema and

Re: Highlighting error InvalidTokenOffsetsException: Token oedipus exceeds length of provided text sized 11

2012-08-03 Thread Robert Muir
On Fri, Aug 3, 2012 at 12:38 AM, Justin Engelman jus...@smalldemons.com wrote: I have an autocomplete index that I return highlighting information for but am getting an error with certain search strings and fields on Solr 3.5. try the 3.6 release: * LUCENE-3642, SOLR-2891, LUCENE-3717: Fixed

Re: Special suggestions requirement

2012-08-03 Thread Michael Della Bitta
I could be crazy, but it sounds to me like you need a trie, not a search index: http://en.wikipedia.org/wiki/Trie But in any case, what you want to do should be achievable. It seems like you need to do EdgeNgrams and facet on the results, where facet.counts 1 to exclude the actual part numbers,

Re: search hit on multivalued fields

2012-08-03 Thread Jack Krupansky
You can include the fields in your fl list and then check those field values explicitly in the client, or you could add debugQuery=true to your request and check for which field the term matched in. The latter requires that you have the analyzed term (or check for closest matching term). --

Re: Adding new field before import- using post.jar

2012-08-03 Thread Jack Krupansky
1. Google for XSLT tools. 2. Write a script that loads the XML, adds the fields, and writes the updated XML. 3. Same as #2, but using Java. 4. If the fields are constants, set default values in the schema and then the documents will automatically get those values when added. Take the default

Re: Adding new field before import- using post.jar

2012-08-03 Thread Erik Hatcher
I hate to also add: 6. Use DataImportHandler It can index Solr XML, and could add field values, either statically or by template glue if you need to combine multiple field values somehow. And in 4.0 you'll be able to use: 7: scripting update processor Erik On Aug 3, 2012, at

Re: synonym file

2012-08-03 Thread Jack Krupansky
The Lucene FST guys made a big improvement in synonym filtering in Lucene/Solr 4.0 using FSTs. Or are you already using that? Or if you are stuck with pre-4.0, you could do a preprocessor that efficiently generates boolean queries for the synonym expansions. That should give you more decent

Re: synonym file

2012-08-03 Thread Michael McCandless
Actually FST (and SynFilter based on it) was backported to 3.x. Mike McCandless http://blog.mikemccandless.com On Fri, Aug 3, 2012 at 11:28 AM, Jack Krupansky j...@basetechnology.com wrote: The Lucene FST guys made a big improvement in synonym filtering in Lucene/Solr 4.0 using FSTs. Or are

Re: synonym file

2012-08-03 Thread Jack Krupansky
I see that the new FSTSynonymFilterFactory is only delegated for Lucene 3.4 and later. I vaguely recall that there was also a recent improvement in loading of files for filters. -- Jack Krupansky -Original Message- From: Michael McCandless Sent: Friday, August 03, 2012 11:32 AM

Can't get synonyms working

2012-08-03 Thread Andy Newby
Hi, I'm trying to work out why Synonyms won't work for my installation of Solr. Its a basic install (just using the example set, and have tweaked the fields to what I need). The files are all in: (schema.xml, synonyms.txt etc), but for some reason its not working:

Re: Can't get synonyms working

2012-08-03 Thread Jack Krupansky
You used the replacement rule format. You probably simply want the equivalent rule format: car, mascot And, you probably only want to do this at index time. This would mean that both car and mascot will be indexed at any position where either term occurs. And at query time you don't need a

Using Solr-319 with Solr 3.6.0

2012-08-03 Thread Himanshu Jindal
Hi, I am trying to implement a solr based search engine for japanese language. I am having trouble adding synonym supprt for japanese language. I am using text_ja for my indexed text and I have the following entry in schema.xml for it. fieldType name=text_ja class=solr.TextField

IndexDocValues in Solr

2012-08-03 Thread roz dev
Changing the Subject Line to make it easier to understand the topic of the message is there any plan to expose IndexDocValues as part of Solr 4? Any thoughts? -Saroj On Thu, Aug 2, 2012 at 5:10 PM, roz dev rozde...@gmail.com wrote: As we all know, FIeldCache can be costly if we have lots of

Re: Using Solr-319 with Solr 3.6.0

2012-08-03 Thread Robert Muir
On Fri, Aug 3, 2012 at 12:57 PM, Himanshu Jindal himanshujin...@gmail.com wrote: filter class=solr.SynonymFilterFactory synonyms=synonyms_ja.txt ignoreCase=true expand=true tokenFactory=solr.JapaneseTokenizerFactory randomAttribute=randomValue/ I think you have a typo here, it should be

Re: search hit on multivalued fields

2012-08-03 Thread Mikhail Khludnev
Mark, It's not clear what are you want to do. Let's say you requested rows=100 and found 1000 docs. What do you need to show in addition to search result? - matched field on every of 100 snippets - or 400 with F1 and 600 with F2 - or what On Fri, Aug 3, 2012 at 6:41 PM, Jack Krupansky

SolrCloud - load balancing

2012-08-03 Thread sausarkar
Do anyone know if query using CommonsHttpSolrServer on SolrCloud is automatically load balanced? I am trying to load test using solrmeter on one if the node I am seeing all the nodes seems to be hit. Any clues -- View this message in context:

Re: SolrCloud - load balancing

2012-08-03 Thread Jack Krupansky
You can use CloudSolrServer - SolrJ client class to communicate with SolrCloud. Instances of this class communicate with Zookeeper to discover Solr endpoints for SolrCloud collections, and then use the LBHttpSolrServer to issue requests.

Re: SolrCloud - load balancing

2012-08-03 Thread sausarkar
actually I noticing that the CommonsHttpSolrServer seems to load balancing by hitting all servers in the cluster, just wanted to confirm if that is the case. -- View this message in context: http://lucene.472066.n3.nabble.com/SolrCloud-load-balancing-tp3999143p3999145.html Sent from the Solr -

Re: Configuration for distributed search

2012-08-03 Thread Erick Erickson
Hmmm, the zero results could be that you're searching against the default text field and you don't have conway in that field. the default search field has recently been deprecated, so try specifying a field in your search The debugQuery=on worked fine for me, so I'm not sure what's happening

Re: SolrCloud - load balancing

2012-08-03 Thread Mark Miller
Right - though I'm not sure it load balances offhand - I think it might just do the fail over part rather than the round robin . I was looking at it the other day and need to investigate. I also think it should be weighting towards sending to leaders - eg ideally it should load balance across the

Re: How config multicore using solr cloud feature

2012-08-03 Thread Mark Miller
Configure all your cores as you would in a single node setup. Then use -Dbootstrap_config=true rather than the bootstrap option where you point at one directory and give a config set name. That will bootstrap all of your cores with the config they have locally, naming the config sets created after

Re: separation of indexes to optimize facet queries without fulltext

2012-08-03 Thread Mark Miller
Yes, you can have multiple indexes with solrcloud, same as with stand alone. We call them collections. On Thu, Jul 26, 2012 at 3:40 PM, Daniel Brügge daniel.brue...@googlemail.com wrote: Hi Chris, thanks for the answer. the plan is that in lots of queries I just need faceted values and

Re: SolrCloud - load balancing

2012-08-03 Thread Mark Miller
Okay - it does basically cycle through the servers. I forgot, it shuffles the server list every time. So it's okay for searching - but we want to make it smarter for indexing. First perhaps by favoring leaders, and then hashing itself and sending directly to the right leader. Sent from my

Re: SolrCloud - load balancing

2012-08-03 Thread sausarkar
Hi Mark, You are referring to the CloudSolrServer not CommonsHttpSolrServer right? does the CommonsHttpSolrServer also round robin? Do you recommend any tool for load testing SolrCloud? Thanks, Sauvik -- View this message in context:

Re: How do you get the document name from Open Text?

2012-08-03 Thread Ahmet Arslan
I'm using Solr 4.0 with ManifoldCF .5.1 crawling Open Text v10.5. I have the cats/atts turned on in Open Text and I can see them all in the Solr index. However, the id is just the URL to download the doc from open text and the document name either from Open Text or the document

Re: AW: AW: auto completion search with solr using NGrams in SOLR

2012-08-03 Thread aniljayanti
Hi thanks, which doing searching i will search either with empname or title only. And also not using any asterics in the query. ex : if i search with mic result should come like michale jackson michale border michale smith want the result just like google search. can us suggest me wht are