Issue in Range Search Query

Hi, I am searching for all the records in the index where author's last name starts with a or b. I am giving my query like au_last_name:[a* TO b*] But it is returning all the other records where last name starts with E, P or other letter. Please suggest how I can achieve this. I dont want to

RE: Not getting the proper result.

Thanks Grant, I used the analysis page in the example, the StandardTokenizerFactory does not split by dots, It is passing the L.I.C as it is to solr.StandardFilterFactory and this Filter class also did not split or remove the dots. My question is I read in the wiki page (

RE: Not getting the proper result.

Did you try creating your indexes again after modifying the schema.xml The way Solr search is, whatever string you have Radha C. wrote: Thanks Grant, I used the analysis page in the example, the StandardTokenizerFactory does not split by dots, It is passing the L.I.C as it is to

Unexpected sorting results when sorting with mutivalued filed

Hi, I have indexes with a multivalued field authorLastName. I query them with sort=authorLastName asc and get the results as - Index# authorLastName 1 Antonakos 2 Keller 3 Antonakos Mansfield However Index#3 has a value starting with A

RE: Not getting the proper result.

Thanks for your reply. Yes, I restarted the servlet container, and run my java code to reindex again, I tested with analysis page also. StandardFilterFactory is not removing dots in the L.I.C. Below is the analyser output. Sohould I use WhiteSpaceTokenizerFactory with the StandardFilterFactory ?

Increasing the number of results

Hello all, I am writing an application using solr and I am having a problem in increasing the number of results. Everytime I pass a search parameter I get only 10 results. How can I increase the number of results? Thanks, Regards, Sajith Vimukthi Weerakoon.

Increase the number of results in the example jetty server app

Hello all, I want to increase the number of results shown in the example jetty app for more thn 10. Can some1 tell me how to configure the configuration file so that we can get more results than this. Thanks, Regards, Sajith Vimukthi Weerakoon.

indexed fields vs stored fields

Hello List, I know about indexing fields but little unclear about the difference between index field and stored field. Can anyone explain me whta does mean by index and stored fields? and What does mean by storing large fields outside of Solr (need to set store=false in schema.xml ) ? Thanks

Re: indexed fields vs stored fields

indexed = can be searched (mean you can use this to query). This undergoes tokenization filter etc stored = can be retrieved . No modification to the data. This is stored verbatim On Tue, Mar 31, 2009 at 4:39 PM, Radha C. cra...@ceiindia.com wrote: Hello List, I know about indexing fields but

RE: Increase the number of results in the example jetty server app

you can control the number of response documents from the query url q=teststart=0rows=20 And refer to the documentation provided in http://lucene.apache.org/solr/tutorial.html#Getting+Started for any example demo related questions. -Original Message- From: Sajith Weerakoon

RE: indexed fields vs stored fields

Thanks Paul, So I set stored=false to a field in schema.xml, and I tried to search that field value. It is identified properly and getting the number of response with empty document values. This is how it works. But What if I want that field value which is not stored in solr? Suppose If I

Re: [solr-user] Upgrade from 1.2 to 1.3 gives 3x slowdown

svn co -r REV_NUM https://svn.apache.org/repos/asf/lucene/solr/trunk solr-REV_NUM -Grant On Mar 30, 2009, at 4:55 PM, Fergus McMenemie wrote: Can you verify that rev 701485 still performs reasonably well? This is from October 2008 and I get similar results to the earlier rev. Am now

Your attention is needed! Solr to be used with a web application.

I am a new bee to Solr and till date my experience with Solr is great. 1. I am trying to use Solr v1.3 in a web application which is deployed into Tomcatv6.0. I am doing this with reference to the example-DIH thats provided with the solr download. 2. The web application(with name TestSolr)

Transformers in dataconfig xml

Hi, Is there any documentation available for usage of transformers in dataimport. If so can anyone tell me the url ? Thanks

solr 1.4 IndexReaders are in read-only mode

Hi, How can I be sure about that my IndexReaders are in read-only mode? Thanks a lot , -- View this message in context: http://www.nabble.com/solr-1.4-IndexReaders-are-in-read-only-mode-tp22804955p22804955.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Issue in Range Search Query

On Tue, Mar 31, 2009 at 11:30 AM, dabboo ag...@sapient.com wrote: Hi, I am searching for all the records in the index where author's last name starts with a or b. I am giving my query like au_last_name:[a* TO b*] But it is returning all the other records where last name starts with E, P

Re: indexed fields vs stored fields

On Tue, Mar 31, 2009 at 5:52 PM, Radha C. cra...@ceiindia.com wrote: Suppose If I have an large field and I am not storing the field in solr due to performance factor, How can I handle this field or How can I get the value of the field through search ? How to store large fields outside of

Re: Transformers in dataconfig xml

http://wiki.apache.org/solr/DIHCustomTransformer On Tue, Mar 31, 2009 at 7:38 PM, Radha C. cra...@ceiindia.com wrote: Hi, Is there any documentation available for usage of transformers in dataimport. If so can anyone tell me the url ? Thanks -- --Noble Paul

Re: Unexpected sorting results when sorting with mutivalued filed

On Tue, Mar 31, 2009 at 2:18 PM, tushar kapoor tushar_kapoor...@rediffmail.com wrote: I have indexes with a multivalued field authorLastName. I query them with sort=authorLastName asc and get the results as - Index# authorLastName 1 Antonakos 2 Keller 3

Re: Issue in Range Search Query

Would [a TO bzzz] work? On Tue, Mar 31, 2009 at 10:46 AM, Shalin Shekhar Mangar shalinman...@gmail.com wrote: On Tue, Mar 31, 2009 at 11:30 AM, dabboo ag...@sapient.com wrote: Hi, I am searching for all the records in the index where author's last name starts with a or b. I am

Re: Your attention is needed! Solr to be used with a web application.

On Tue, Mar 31, 2009 at 7:04 PM, Udaya ukvign...@gmail.com wrote: 3. The solr configuration xml files are placed inside the directory structure C:\web1\solr1\test\DIH\conf. 5.I have set the java option in tomcat configuration as -Dsolr.solr.home=C:\web1\solr1\test(It is here that the

Re: [solr-user] Upgrade from 1.2 to 1.3 gives 3x slowdown

Can you try adding overwrite=false and running against the latest version? My current working theory is that Solr/Lucene has changed how deletes are handled such that work that was deferred before is now not deferred as often. In fact, you are not seeing this cost paid (or at least not

RE: indexed fields vs stored fields

Thanks, We have tons of records with CLOB fields. _ From: Shalin Shekhar Mangar [mailto:shalinman...@gmail.com] Sent: Tuesday, March 31, 2009 8:21 PM To: solr-user@lucene.apache.org; cra...@ceiindia.com Subject: Re: indexed fields vs stored fields On Tue, Mar 31, 2009 at 5:52 PM,

RE: Transformers in dataconfig xml

Thanks much -Original Message- From: Noble Paul നോബിള്‍ नोब्ळ् [mailto:noble.p...@gmail.com] Sent: Tuesday, March 31, 2009 8:22 PM To: solr-user@lucene.apache.org; cra...@ceiindia.com Subject: Re: Transformers in dataconfig xml http://wiki.apache.org/solr/DIHCustomTransformer On Tue,

How to configure multible unique keys in schema.xml

Hi, Is it possible to configure/index separate set of tables with one solr core.( groupA- 6 related tables and groupB - 8 related tables and group AB are unrelated ) ? Is it so, how to include/index the table's unique keys in the schema.xml? Can anyone please provide me any documentation link.

Re: Querying Different Index Types in a single request

Hi, There are 4 different sets of indices - 2 of which have a similar schema and the other 2 have completely different schemas. The intent would be to use a combination of a federated distributed search if possible. The initial user query - is only for data from a distributed search.

Re: solr 1.4 IndexReaders are in read-only mode

sunnyfr wrote: Hi, How can I be sure about that my IndexReaders are in read-only mode? Thanks a lot , I think the feature was introduced in Solr 1.3. https://issues.apache.org/jira/browse/SOLR-730 Or you can see CHANGES.txt... Koji

DIH; Hardcode field value/replacement based on source column

I am trying to find a clean way to *hardcode* a field/column to a specific value during the DIH process. It does seems to be possible but I am getting an slightly invalid constant value in my index. field column=content_type_s sourceColName=title_t regex=(.*) replaceWith=Video / However, the

Re: Increasing the number of results

If you're using the GET interface, add the rows parameter to your URL. See http://wiki.apache.org/solr/CommonQueryParameters See also the start parameter. 2009/3/31 Sajith Weerakoon saji...@zone24x7.com: Hello all, I am writing an application using solr and I am having a problem in

Re: DIH; Hardcode field value/replacement based on source column

Wesley, I'm not sure but if what you want is to have Video in the field I would do something in the sql query. I use postgres and I needed all my calendar event items to have event in the field named content. So I used the following as my sql query: select *,'event' as content from events That

Re: DIH; Hardcode field value/replacement based on source column

On Tue, Mar 31, 2009 at 9:20 PM, Wesley Small wesley.sm...@mtvstaff.comwrote: I am trying to find a clean way to *hardcode* a field/column to a specific value during the DIH process. It does seems to be possible but I am getting an slightly invalid constant value in my index. field

RE: Hijacking Search Requests

Thanks Noble Paul for the valuable tip. A servlet filter sounds like a great solution here. -Original Message- From: Noble Paul നോബിള്‍ नोब्ळ् [mailto:noble.p...@gmail.com] Sent: Tuesday, March 31, 2009 1:29 AM To: solr-user@lucene.apache.org Subject: Re: Hijacking Search Requests you

Merging Solr Indexes

Hi, As part of speeding up the index process I'm thinking of spawning multiple threads which will write to different temporary SolrCores. Once the index process is done I want to merge all the indexes in temporary cores to a master core. For ex., if I want one SolrCore per day then every index

How to create a query directly (bypassing the query-parser)?

Hi everybody, after reading the documentation on the Solr site, I have the following newbie-ish question: On the Lucene query parser syntax page ( http://lucene.apache.org/java/2_4_0/queryparsersyntax.html) linked to from the Solr query syntax page, they mention: If you are programmatically

Re: DIH; Hardcode field value/replacement based on source column

Hmmm, I am sure I have seen this as well! field column=id regex=(.*) replaceWith=$1#${x.imgvurl} sourceColName=fileAbsolutePath/ I get the #${x.imgvurl} added twice. Fergus. On 3/31/09 11:50 AM, Wesley Small wesley.sm...@mtvstaff.com wrote: I am trying to find a clean way to *hardcode* a

Problems with synonyms

Hello there. How are you guys? We're having problems with synonyms here and I thought that maybe you guys could help us on how SOLR works for synonyms. The problem is the following: I'd like to setup a synonym like dba, database administrator. Instead of increasing the number of results

Re: Problems with synonyms

Hi, Vernon! We tried both approaches: OR and AND. In both cases, the results were smaller when the synonyms was set up, with no change at all when it comes to synonyms. Any other ideas? Is it likely to be a bug? Best, Leonardo Vernon Chapman escreveu: Leonardo, I am no expert but I

Re: Problems with synonyms

Leonardo, The only other thing I can think of is check the Field type in the schema.xml file make sure that you are using the same filters. For example if in your index analyzer you use the solr.SynonymFilterFactory filter make sure your query analyzer also uses the same filter class. Other

Re: DIH; Hardcode field value/replacement based on source column

On Wed, Apr 1, 2009 at 12:13 AM, Fergus McMenemie fer...@twig.me.uk wrote: Hmmm, I am sure I have seen this as well! field column=id regex=(.*) replaceWith=$1#${x.imgvurl} sourceColName=fileAbsolutePath/ I get the #${x.imgvurl} added twice. Indeed. I wrote the following test: Pattern p

Re: Problems with synonyms

This is a known limitation of using the SynonymFilter and expanding to variants of different sizes at query time. See the notes for SynonymFilterFactory here: http://wiki.apache.org/solr/AnalyzersTokenizersTokenFilters#head-2c461ac74b4ddd82e453dc68fcfc92da77358d46 -Yonik

Re: Problems with synonyms

It looks like you are using synonyms at query time. Don't do that, it works very strangely. Only use them at index time. That does the right matching and also gives the right idf for scoring. More details are here: http://wiki.apache.org/solr/AnalyzersTokenizersTokenFilters#head-2c461ac74b4

Re: Problems with synonyms

It's okay to not use the SynonymFilter for querying and for indexing. In fact, you would really only want to use one or the other: either index all synonyms, or query for them, but not both. I have read that there are issues with multi-word synonyms and my guess is that this is where your problem

Re: Problems with synonyms

Walter, Thanks for clarifying my mistake there. I wouldn't want to send someone down the wrong path. Thanks Vernon On 3/31/09 4:17 PM, Walter Underwood wunderw...@netflix.com wrote: It looks like you are using synonyms at query time. Don't do that, it works very strangely. Only use them at

Querying for multi-word synonyms

Hi list, I've been working the last couple days on some synonym functionality and I've been reading about the limitations regarding query-time multi-word synonyms. All recommended solutions that I've come across so far suggest using the SynonymFilter at index time rather than at query time.

Re: How to create a query directly (bypassing the query-parser)?

On Mar 31, 2009, at 2:13 PM, Development Team wrote: On the Lucene query parser syntax page ( http://lucene.apache.org/java/2_4_0/queryparsersyntax.html) linked to from the Solr query syntax page, they mention: If you are programmatically generating a query string and then parsing it with

SingleInstanceLock: write.lock

Hi, I am new to Solr and am having an issue with the following SingleInstanceLock: write.lock. We have solr 1.3 running under tomcat 1.6.0_11. We have an index of users that are online at any given time (Usually around 4000 users). The records from solr are deleted and repopulated at

Re: Deleting documents

assuming you really have a great reason for not using SolrJ, searching for missing content stream would probably have lead you to discover that you need to specify a Content-Type when POSTing to Solr so it understands your request. (we could probably make the error message better, but for now

Re: How to create a query directly (bypassing the query-parser)?

2009/3/31 Erik Hatcher e...@ehatchersolutions.com: On Mar 31, 2009, at 2:13 PM, Development Team wrote: On the Lucene query parser syntax page ( http://lucene.apache.org/java/2_4_0/queryparsersyntax.html) linked to from the Solr query syntax page, they mention: If you are programmatically

Defining DataDir in Multi-Core

Hi, I'm trying to set up cores dynamically. I want to use the same schema.xml and solrconfig.xml for all the created cores, so plan to pass the same instance directory, but different dir directory. Here is what I got in solr.xml by default (I didn't want define any core here, but looks like we

Re: Spelling Component

Hi, The $SOLR_URL/solr/biblio/ looks suspicious. Should that be $SOLR_URL/solr/ ? Also note that you are using the old SpellCheck RequestHandler, and we not have a SpellCheckComponent - http://wiki.apache.org/solr/SpellCheckComponent Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr -

Re: OOM at MultiSegmentReader.norms

Vivek, No need for any RAMBuffer stuff, just use the appropriate ramBufferSizeMB value in solrconfig.xml. This will only help with indexing, though! Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message From: vivek sar vivex...@gmail.com To:

Re: Merging Solr Indexes

Let me start with 4) Have you tried simply using multiple threads to send your docs to a single Solr instance/core? You should get about the same performance as what you are trying with your approach below, but without the headache of managing multiple cores and index merging (not yet

Re: DIH; Hardcode field value/replacement based on source column

use TemplateTransformer field column=content_type_s template=Video / On Tue, Mar 31, 2009 at 9:20 PM, Wesley Small wesley.sm...@mtvstaff.com wrote: I am trying to find a clean way to *hardcode* a field/column to a specific value during the DIH process.  It does seems to be possible but I am

Re: DIH; Hardcode field value/replacement based on source column

iterestingly field column=id regex=^(.*)$ replaceWith=$1#${x.imgvurl} sourceColName=fileAbsolutePath/ seems to work On Wed, Apr 1, 2009 at 12:13 AM, Fergus McMenemie fer...@twig.me.uk wrote: Hmmm, I am sure I have seen this as well!  field column=id regex=(.*) replaceWith=$1#${x.imgvurl}

Re: Defining DataDir in Multi-Core

which version of Solr are you using? if you are using one from trunk , you can pass the dataDir as an extra parameter? On Wed, Apr 1, 2009 at 7:41 AM, vivek sar vivex...@gmail.com wrote: Hi,  I'm trying to set up cores dynamically. I want to use the same schema.xml and solrconfig.xml for all

Re: Your attention is needed! Solr to be used with a web application.

Shalin Shekhar Mangar wrote: On Tue, Mar 31, 2009 at 7:04 PM, Udaya ukvign...@gmail.com wrote: 3. The solr configuration xml files are placed inside the directory structure C:\web1\solr1\test\DIH\conf. 5.I have set the java option in tomcat configuration as

Re: Your attention is needed! Solr to be used with a web application.

do you really need a multicore configuration? start with a single core first. On Wed, Apr 1, 2009 at 10:31 AM, Udaya ukvign...@gmail.com wrote: Shalin Shekhar Mangar wrote: On Tue, Mar 31, 2009 at 7:04 PM, Udaya ukvign...@gmail.com wrote: 3.   The solr configuration xml files are placed

Re: [solr-user] Upgrade from 1.2 to 1.3 gives 3x slowdown

Grant, I am messing with the script, and with your tip I expect I can make it recurse over as many releases as needed. I did run it again using the full file, this time using my Imac:- 643465took 22min 14sec 2008-04-01 734796 73min 58sec