RE: schema-based Index-time field boosting

2009-12-03 Thread Ian Smith
Aaaargh! OK, I would like a document with (eg.) a title containing a term to score higher than one on (eg.) a summary containing the same term, all other things being equal. You seem to be arguing against field boosting in general, and I don't understand why! May as well let this drop since

Re: schema-based Index-time field boosting

2009-12-03 Thread Erik Hatcher
Ian - now you're talking *term* boosting, which is a dynamic query- time factor, not something specified at index time. Here's what I suggest as a starting point for this sort of thing, in Solr request format: http://localhost:8983/solr/select? defType=dismaxq=appleqf=name^2+manu

Behavior of filter query

2009-12-03 Thread gunjan_versata
Hi, I am working on SOLR 1.4. And am trying to implement the multi select feature on my site. I dont want the faceting counts but only results. I tried diff variations in my query : They are:

Re: Behavior of filter query

2009-12-03 Thread gunjan_versata
Guess I found the problem.. By using fq=%2B bla blo seems to be fixing the problem... Can anyone tell me why is it necessary? also, which query is the best amongst all? -Gunjan gunjan_versata wrote: Hi, I am working on SOLR 1.4. And am trying to implement the multi select feature

How to instruct MoreLikeThisHandler to sort results

2009-12-03 Thread Sascha Szott
Hi Folks, is there any way to instruct MoreLikeThisHandler to sort results? I was wondering that MLTHandler recognizes faceting parameters among others, but it ignores the sort parameter. Best, Sascha

Facet query with special characters

2009-12-03 Thread Peter 4U
Hello, I've encountered some strange behaviour in Solr facet querying, and I've not been able to find anything on this on the web. Perhaps someone can shed some light on this? The problem: When performing a facet query where part of the value portion has a special character (a minus sign in

Re: Retrieving large num of docs

2009-12-03 Thread Raghuveer Kancherla
Hi Hoss, I was experimenting with various queries to solve this problem and in one such test I remember that requesting only the ID did not change the retrieval time. To be sure, I tested it again using the curl command today and it confirms my previous observation. Also, enableLazyFieldLoading

weird behavior between 2 enviorments

2009-12-03 Thread Joel Nylund
I have 2 environments one works great for this query: my osx environment: http://localhost:8983/solr/select?q=countryName:%22Bosnia%20and%20Herzegovina%22 - returns 2 results my linux environment: http://localhost:8983/solr/select?q=countryName:%22Bosnia%20and%20Herzegovina%22 -

Problem with searching with first capital letter

2009-12-03 Thread Yurish
I have a problem with SOLR searching. When i`am searching query: dog* everything is ok, but when query is Dog*(with first capital letter), i get no results. Any advice? My config: fieldType name=text class=solr.TextField positionIncrementGap=100 analyzer type=index tokenizer

Re: weird behavior between 2 enviorments

2009-12-03 Thread Yonik Seeley
Are you querying both systems from the same browser / client? Try adding debugQuery=true and see of the query parses the same for both (could be the browser/client doing extra escaping or something). -Yonik http://www.lucidimagination.com On Thu, Dec 3, 2009 at 10:14 AM, Joel Nylund

Re: schema-based Index-time field boosting

2009-12-03 Thread Walter Underwood
An index-time boost means this document is a better answer, regardless of the query. To weight title matches higher than summary matches, use field boosts at query time. They work great. There is no need to modify Solr to get that behavior. wunder On Dec 3, 2009, at 12:37 AM, Ian Smith

RE: Facet query with special characters

2009-12-03 Thread Peter 4U
Hello Solr Forum, I believe I have found a solution (workaround?) for performing an explicit (non-wildcarded) field query with values that contain special (escaped) characters. Instead of: field:value-with-escape-chars change this to: field:[value-with-escape-chars TO

Re: weird behavior between 2 enviorments

2009-12-03 Thread Yonik Seeley
The schemas probably aren't the same. Looks like one has position increments enabled for the stopword filter in the field type, and one doesn't. -Yonik http://www.lucidimagination.com On Thu, Dec 3, 2009 at 11:00 AM, Joel Nylund jnyl...@yahoo.com wrote: same client, here are the debug

replacing all the Field names with a default string of the Document

2009-12-03 Thread Phanindra Reva
Hello All, I am in a situation to replace all the Fields-Names ( with a default string VALUE ) present in a document before its being indexed. But I do need Document as it is ( with unchanged filed names ) for all the parts like analysis, payload assigning, etc. So I can not modify

Re: Problem with searching with first capital letter

2009-12-03 Thread Erick Erickson
http://wiki.apache.org/solr/AnalyzersTokenizersTokenFilters http://wiki.apache.org/solr/AnalyzersTokenizersTokenFiltersOn wildcard and fuzzy searches, no text analysis is performed on the search word. HTH Erick On Thu, Dec 3, 2009 at 10:19 AM, Yurish yuris...@inbox.lv wrote: I have a problem

Issues with alphanumeric search terms

2009-12-03 Thread con
Hi My solr deployment is giving correct results for normal search terms like john. But when i search with john55 or 55 it will return all the search terms, including those which neither contains john nor 55. Below is the fieldtype defined for this field. fieldType name=mytype

Re: weird behavior between 2 enviorments

2009-12-03 Thread Joel Nylund
thanks that was it Joel On Dec 3, 2009, at 11:06 AM, Yonik Seeley wrote: The schemas probably aren't the same. Looks like one has position increments enabled for the stopword filter in the field type, and one doesn't. -Yonik http://www.lucidimagination.com On Thu, Dec 3, 2009 at 11:00 AM,

debugging javascript DIH

2009-12-03 Thread Joel Nylund
is there a way to print to std out or anything from my javascript DIH transformer? thanks Joel

RE: no error delta fail with DataImportHandler

2009-12-03 Thread Thomas Woodard
Unfortunately that isn't it. I have tried id, product_id, and PRODUCT_ID, and they all produce the same result. It finds the modified item, but then does nothing. INFO: Running ModifiedRowKey() for Entity: product Dec 3, 2009 9:25:25 AM org.apache.solr.handler.dataimport.JdbcDataSource$1 call

Concurrent Merge Scheduler MaxThread Count

2009-12-03 Thread Giovanni Fernandez-Kincade
I'm having trouble getting Solr to use more than one thread during index optimizations. I have the following in my solrconfig.xml: mergeScheduler class=org.apache.lucene.index.ConcurrentMergeScheduler int name=maxThreadCount6/int /mergeScheduler I had the same problem some

Re: How to instruct MoreLikeThisHandler to sort results

2009-12-03 Thread Bill Au
I had open a Jira and submitted a patch for this: https://issues.apache.org/jira/browse/SOLR-1545 Bill On Thu, Dec 3, 2009 at 7:47 AM, Sascha Szott sz...@zib.de wrote: Hi Folks, is there any way to instruct MoreLikeThisHandler to sort results? I was wondering that MLTHandler recognizes

Re: deleteById without solrj?

2009-12-03 Thread Tom Hill
http://wiki.apache.org/solr/UpdateXmlMessages#A.22delete.22_by_ID_and_by_Query On Thu, Dec 3, 2009 at 11:57 AM, Joel Nylund jnyl...@yahoo.com wrote: Is there a url based approach to delete a document? thanks Joel

Re: java.lang.NumberFormatException: For input string:

2009-12-03 Thread darniz
its strange i had a dismaxhandler and it had an empty value for ps field i added a default value like 100 and the error disappeared. markrmiller wrote: Can you share the config files? darniz wrote: Hello All, i am getting this exception when i start solr. when i use hte original

SnapPuller executing on master?

2009-12-03 Thread Otis Gospodnetic
Hello, If I'm on a master (Solr 1.4), why would I see the following in the logs, if I'm running the master Solr JVM with -Denable.master=true: SEVERE: Master at: http://solrbox:8080/solr/foocore/replication is not available. Index fetch failed. Exception: Read timed out I checked the

Re: dismax query syntax to replace standard query

2009-12-03 Thread Ian Sugar
I believe you need to use the fq parameter with dismax (not to be confused with qf) to add a filter query in addition to the q parameter. So your text search value goes in q parameter (which searches on the fields you configure) and the rest of the query goes in the fq. Would that work? On Thu,

Re: Retrieving large num of docs

2009-12-03 Thread Otis Gospodnetic
Hm, hm, interesting. I was looking into something like this the other day (BIG indexed+stored text fields). After seeing enableLazyFieldLoading=true in solrconfig and after seeing fl didn't include those big fields, I though hm, so Lucene/Solr will not be pulling those large fields from disk,

Stopping Starting

2009-12-03 Thread Lee Smith
Hello All I am just starting out today with solr and looking for some advice but I first have a problem. I ran the start command ie. user:~/solr/example$ java -jar start.jar Which worked perfect and started to explore the interface. But my terminal window dropped and I it has stopped

Re: dismax query syntax to replace standard query

2009-12-03 Thread Yonik Seeley
For more complex queries (including full well-formed lucene queries), there's the newly committed extended dismax parser in 1.5-dev (trunk) http://issues.apache.org/jira/browse/SOLR-1553 -Yonik http://www.lucidimagination.com On Thu, Dec 3, 2009 at 4:14 PM, Ian Sugar iansu...@gmail.com wrote:

Re: Stopping Starting

2009-12-03 Thread Yonik Seeley
On Thu, Dec 3, 2009 at 4:57 PM, Lee Smith l...@weblee.co.uk wrote: Hello All I am just starting out today with solr and looking for some advice but I first have a problem. I ran the start command ie. user:~/solr/example$ java -jar start.jar Which worked perfect and started to explore the

Re: Windows 7 / Java 64bit / solr 1.4 - solr.solr.home problem

2009-12-03 Thread Lance Norskog
I just tested this on trunk and it works. Crazy. I'm on Vista 64 Java 1.6.0_14-b08. I have had security configuration problems and disabled some of it. You might try removing the unpacked solr from example/work/. Have you tried the full path? c:/nginx/... I run this from trunk/example. What

Re: question about schemas

2009-12-03 Thread Lance Norskog
You can make a separate facet field which contains a range of buckets: 10, 20, 50, or 100 means that the field has a value 0-10, 11-20, 21-50, or 51-100. You could use a separate filter query with values for these buckets. Filter queries are very fast in Solr 1.4 and this would limit your range

Re: how is score computed with hsin functionquery?

2009-12-03 Thread Lance Norskog
If you use the DataImportHandler you can add your own Javascript code to do the degree-radian conversion. On Wed, Dec 2, 2009 at 8:54 AM, gdeconto gerald.deco...@topproducer.com wrote: Grant Ingersoll-6 wrote: ... Yep.  Also note that I added deg() and rad() functions, but for the most

Re: how is score computed with hsin functionquery?

2009-12-03 Thread gdeconto
Lance Norskog-2 wrote: If you use the DataImportHandler you can add your own Javascript code to do the degree-radian conversion. Thx Lance, but I am not sure what you mean -- View this message in context:

Re: Webinar: An Introduction to Basics of Search and Relevancy with Apache Solr hosted by Lucid Imagination

2009-12-03 Thread Lance Norskog
All of the Lucid webinars are available: http://www.lucidimagination.com/Community/Hear-from-the-Experts/Podcasts-and-Videos On Wed, Dec 2, 2009 at 2:14 PM, Sulman sulmansar...@gmail.com wrote: Yeah, screen cast or video of talk will be good for those who missed it. Highly recommend it..

Re: High add/delete rate and index fragmentation

2009-12-03 Thread Lance Norskog
#1: Yes, compared to relational DBs, Solr/Lucene in general are biased towards slow indexing and fast queries. It automatically merges segments and keeps fragmentation down. The rate of merging can be controlled. #2: The standard architecture is with a master that only does indexing and one or

Re: Behavior of filter query

2009-12-03 Thread Lance Norskog
The second makes 2 large docsets and ands them together against the query. The third makes the intersection of the two filter queries, The third will use the least memory and run the fastest. The first is the slowest because it has to find each docid and check it against the filter query docset.

Re: Facet query with special characters

2009-12-03 Thread Lance Norskog
Backslash is the escape character for colon, hyphen, parentheses, brackets, curly braces, tilde, caret. (Did I miss any?) On Thu, Dec 3, 2009 at 7:59 AM, Peter 4U pete...@hotmail.com wrote: Hello Solr Forum, I believe I have found a solution (workaround?) for performing an explicit

Re: how is score computed with hsin functionquery?

2009-12-03 Thread Lance Norskog
http://wiki.apache.org/solr/DataImportHandler http://wiki.apache.org/solr/DataImportHandler#ScriptTransformer The DIH is a tool inside solr that scripts pulling documents from different data sources, transforming them and then indexing them. On Thu, Dec 3, 2009 at 3:10 PM, gdeconto

Re: Windows 7 / Java 64bit / solr 1.4 - solr.solr.home problem

2009-12-03 Thread Vladan Popovic
I tried it on Vista 32 Java 1.6.0_17-b04 and it works without a problem. Actually on all other computers in the office there is no problem - I am the only one using Windows 7 I did try with full path and it didn't work as well. Here's the result: Directory: C:\nginx\solr Mode

Document Decay

2009-12-03 Thread brad anderson
Hi, I'm looking for a way to have the score of documents decay over time. I want older documents to have a lower score than newer documents. I noted the ReciprocalFloatFunction class. In an example it seemed to be doing just this when you set the function to be:

Re: Issues with alphanumeric search terms

2009-12-03 Thread Erick Erickson
h, I don't think you want LowerCaseTokenizerFactory.. from: http://wiki.apache.org/solr/AnalyzersTokenizersTokenFilters#solr.LowerCaseTokenizerFactory Creates org.apache.lucene.analysis.LowerCaseTokenizer. Creates tokens by lowercasing all letters and dropping non-letters. Example: I can't

Re: Stopping Starting

2009-12-03 Thread Israel Ekpo
On Thu, Dec 3, 2009 at 5:01 PM, Yonik Seeley yo...@lucidimagination.comwrote: On Thu, Dec 3, 2009 at 4:57 PM, Lee Smith l...@weblee.co.uk wrote: Hello All I am just starting out today with solr and looking for some advice but I first have a problem. I ran the start command ie.

Re: no error delta fail with DataImportHandler

2009-12-03 Thread Noble Paul നോബിള്‍ नोब्ळ्
probably you can try out this http://wiki.apache.org/solr/DataImportHandlerFaq#fullimportdelta and it may give you more info on what is happeining On Thu, Dec 3, 2009 at 10:58 PM, Thomas Woodard gtfo...@hotmail.com wrote: Unfortunately that isn't it. I have tried id, product_id, and

[PECL-DEV] [ANNOUNCEMENT] solr-0.9.8 (beta) Released

2009-12-03 Thread Israel Ekpo
The new PECL package solr-0.9.8 (beta) has been released at http://pecl.php.net/. Release notes - - Fixed config.w32 for Windows build support. (Pierre, Pierrick) - Windows .dll now available at http://downloads.php.net/pierre (Pierre) - Fixed Bug #16943 Segmentation Fault from

Re: Problem with searching with first capital letter

2009-12-03 Thread Yurish
Thank`s for your reply. Now I understood my problem. Erick Erickson wrote: http://wiki.apache.org/solr/AnalyzersTokenizersTokenFilters http://wiki.apache.org/solr/AnalyzersTokenizersTokenFiltersOn wildcard and fuzzy searches, no text analysis is performed on the search word. HTH Erick

Re: Issues with alphanumeric search terms

2009-12-03 Thread con
I have added filter class=solr.WordDelimiterFilterFactory catenateAll=1 / to both index and query but still getting same behaviour. Is there any other that i am missing? con wrote: Yes. I meant all the indexed documents. With debugQuery=on, i got the following result: