Re: Your attention is needed! Solr to be used with a web application.

Hi Noble Paul, I am a beginner in solr pls don't mistake me if I am wrong, Multicore in the sense using Database and HTTPdatasource(like web site or rss feed) or any other combination of datasources to get data, is it right? If yes then I am not trying to do it. I am only tying to configure the

Runtime exception when adding documents using solrj

Hi All, I am trying to index documents by using solrj client. I have written a simple code below, { CommonsHttpSolrServer server = new CommonsHttpSolrServer(http://localhost:8080/solr/update;); SolrInputDocument doc1=new SolrInputDocument();

Re: Runtime exception when adding documents using solrj

which version of Solr are you using? On Wed, Apr 1, 2009 at 12:01 PM, Radha C. cra...@ceiindia.com wrote: Hi All, I am trying to index documents by using solrj client. I have written a simple code below, { CommonsHttpSolrServer server = new

RE: Runtime exception when adding documents using solrj

I am using Solr 1.3 version _ From: Noble Paul നോബിള്‍ नोब्ळ् [mailto:noble.p...@gmail.com] Sent: Wednesday, April 01, 2009 12:16 PM To: solr-user@lucene.apache.org; cra...@ceiindia.com Subject: Re: Runtime exception when adding documents using solrj which version of Solr are you

Re: Defining DataDir in Multi-Core

I'm using the latest released one - Solr 1.3. The wiki says passing dataDir to CREATE action (web service) should work, but that doesn't seem to be working. -vivek 2009/3/31 Noble Paul നോബിള്‍ नोब्ळ् noble.p...@gmail.com: which version of Solr are you using? if you are using one from trunk ,

Re: Merging Solr Indexes

Thanks Otis. Could you write to same core (same index) from multiple threads at the same time? I thought each writer would lock the index so other can not write at the same time. I'll try it though. Another reason of putting indexes in separate core was to limit the index size. Our index can grow

RE: Runtime exception when adding documents using solrj

Can anyone please tell me , what is the issue with the below java code.. -Original Message- From: Radha C. [mailto:cra...@ceiindia.com] Sent: Wednesday, April 01, 2009 12:28 PM To: solr-user@lucene.apache.org Subject: RE: Runtime exception when adding documents using solrj I am

Re: Defining DataDir in Multi-Core

On Wed, Apr 1, 2009 at 1:48 PM, vivek sar vivex...@gmail.com wrote: I'm using the latest released one - Solr 1.3. The wiki says passing dataDir to CREATE action (web service) should work, but that doesn't seem to be working. That is a Solr 1.4 feature (not released yet). -- Regards, Shalin

Re: Runtime exception when adding documents using solrj

the url is wrong try this CommonsHttpSolrServer server = new CommonsHttpSolrServer(http://localhost:8080/solr/;); On Wed, Apr 1, 2009 at 2:04 PM, Radha C. cra...@ceiindia.com wrote: Can anyone please tell me , what is the issue with the below java code.. -Original Message- From:

performance tests with DataImportHandler and full-import

Hey there, I am doing performance tests with full-import command from DataImportHandler. I have configured 20 cores with 1 Gig index each (about a milion docs per index). If I start doing full-imports indexing from a mysql table SEQUENCIALY with cron jobs as frequently as possible it will work

RE: Runtime exception when adding documents using solrj

Thanks Paul, I changed the URL but I am getting another error - Bad request , Any help will be appriciated. Exception in thread main org.apache.solr.common.SolrException: Bad Request Bad Request request: http://localhost:8080/solr/update?wt=javabin at

RE: Runtime exception when adding documents using solrj

Thanks Paul, I resolved it, I missed one field declaration in schema.xml. Now I added, and it works. -Original Message- From: Noble Paul നോബിള്‍ नोब्ळ् [mailto:noble.p...@gmail.com] Sent: Wednesday, April 01, 2009 3:52 PM To: solr-user@lucene.apache.org; cra...@ceiindia.com Subject:

Re: Runtime exception when adding documents using solrj

Can u take a look at the Solr logs and see what is hapening? On Wed, Apr 1, 2009 at 3:19 PM, Radha C. cra...@ceiindia.com wrote: Thanks Paul, I changed the URL but I am getting another error - Bad request , Any help will be appriciated. Exception in thread main

Re: performance tests with DataImportHandler and full-import

I guess Solr itself is hogging more memory. May be you can try reloading the core before each import. On Wed, Apr 1, 2009 at 3:19 PM, Marc Sturlese marc.sturl...@gmail.com wrote: Hey there, I am doing performance tests with full-import command from DataImportHandler. I have configured 20

RE: Problems with synonyms

Hi Leonardo, I've been using the synonym filter at index time (expand = true) and it works just fine. Also use OR as the default operator. Once you do it at index time there is no point doing it at query time (which in fact is likely to be the reason of your problems). Have a look at the

Indexing fields of xml file using solrj

Hi All, I want to index the document fields in a xml file to index using solrj. I know how to index the document fields using doc.addfield(). But I dont know how to post the xml document instead of adding each field in solrj. Can I index xml file using solrj? Can anyone help me in how to do

DIH Date conversion from a source column skews time

I have noticed that setting a dynamic date field from source column changes the time within the date. Can anyone confirm this? For example, the document I import has the following xml field. field name=original_air_date_d2002-12-18T00:00:00Z/field In my data-inport-config file I define the

Re: Indexing fields of xml file using solrj

Hello, I believe what you want is DirectXMLRequest. http://lucene.apache.org/solr/api/org/apache/solr/client/solrj/request/DirectXmlRequest.html Cheers, Giovanni On 4/1/09, Radha C. cra...@ceiindia.com wrote: Hi All, I want to index the document fields in a xml file to index using solrj.

Re: Indexing fields of xml file using solrj

On Wed, Apr 1, 2009 at 5:17 PM, Radha C. cra...@ceiindia.com wrote: Hi All, I want to index the document fields in a xml file to index using solrj. I know how to index the document fields using doc.addfield(). But I dont know how to post the xml document instead of adding each field in solrj.

multicore

Hi, I need to create multiple cores for my project. I need to know: how to have multiple cores ? can we start all cores from single startup file or we need to start all independently? I need a way by which I can start all of them in one go. Thanks Neha DISCLAIMER == This

Re: multicore

Hello, the starting point is here: http://wiki.apache.org/solr/CoreAdmin Cheers, Giovanni On 4/1/09, Neha Bhardwaj neha_bhard...@persistent.co.in wrote: Hi, I need to create multiple cores for my project. I need to know: how to have multiple cores ? can we start all cores from

RE: Indexing fields of xml file using solrj

Thanks shalin, I need to index the xml which is in solr's format only. I want to index that xnl directly using solrj same like how we post using curl. Is there any API class is available for that? Can you please provide me any reference link? -Original Message- From: Shalin Shekhar

Re: [solr-user] Upgrade from 1.2 to 1.3 gives 3x slowdown

Grant, Redoing the work with your patch applied does not seem to make a difference! Is this the expected result? I did run it again using the full file, this time using my Imac:- 643465took 22min 14sec 2008-04-01 734796 73min 58sec

Re: Indexing fields of xml file using solrj

I understand Shalin is a guru and I am nobody but... http://lucene.apache.org/solr/api/org/apache/solr/client/solrj/request/DirectXmlRequest.html Is what you need if you want to use Solrj... :-) On 4/1/09, Radha C. cra...@ceiindia.com wrote: Thanks shalin, I need to index the xml which is

FW: multicore

From: Neha Bhardwaj [mailto:neha_bhard...@persistent.co.in] Sent: Wednesday, April 01, 2009 6:52 PM To: 'solr-user@lucene.apache.org' Subject: multicore Hi, I need to create multiple cores for my project. I need to know: how to have multiple cores ? can we start all cores from

RE: Indexing fields of xml file using solrj

Hey No, Actually I did not look at your response email. But I saw your email after I responded to shalin and you gave me a correct answer. Thanks a lot. So I started coding it also, I thought to reply to u once I executed successfully. Here is my code, DirectXmlRequest xmlreq = new

Re: how to improve concurrent request performance and stress testing

Thanks for all this help, But I guess it can't be optimal with a lot of update, my slave get back from the master 20 000docs updated every 20minutes, it's made to try to warmup have a big cache and everything go fast with that amount of update I guess ...? zqzuk wrote: Hi, try to

Re: FW: multicore

how to have multiple cores ? You need a solr.xml file in the root of your solr home. In this solr.xml you will inicalize the cores. In this same folder you will have a folder per core with its /conf and /data. Every core has it's own solrconfig.xml and schema.xml. If you grap a nighlty build

Re: Indexing fields of xml file using solrj

Hello, you can try with: SolrConfig.config.getResourceLoader().getInstanceDir() Let me know if it works. Cheers, Giovanni On 4/1/09, Radha C. cra...@ceiindia.com wrote: Hey No, Actually I did not look at your response email. But I saw your email after I responded to shalin and you gave

RE: getting solr home path dynamically

Hi, No luck, I tried as follows, my solr home is there out of of my solrj client. I think it is looking for the config at CWD, config = new SolrConfig(); String dir= config.getResourceLoader().getDataDir(); ( I used getInstanceDir() also ) //File f = new File( home,

Re: getting solr home path dynamically

On Apr 1, 2009, at 10:55 AM, Radha C. wrote: But I am having trouble in identifying the xml location, I am having the input xml in $solrhome/inputdata/example.xml, Do you have any idea about how to get solrhome location dynamically by using any solrj API class? Using SolrJ remotely, you

Re: Encoding problem

Thanks,I detected that same problem. I have CP 1252 system file encoding and was recording data-config.xml file in UTF-8. DIH was reading using the default encoding. One possible workarround was using InputStream and OutputStream like DIH, but the files won't be in UTF-8 if the system has

Re: Merging Solr Indexes

Hi, Yes, you can write to the same index from multiple threads. You still need to keep track of the index size manually, whether you create 1 or N indices/cores. I'd go with a single index first. Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message

Re: SingleInstanceLock: write.lock

Hi, Are you sure there really is/was enough free space? Were you monitoring the disk space when this error happened? Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message From: davidb dav...@mate1inc.com To: solr-user@lucene.apache.org Sent:

Re: Wildcard searches

Hi, Another option for 1) is to use n-grams with token begin/end symbols. Then you won't need to use wildcards at all, but you'll have a larger index. 2) may be added to Lucene in the near future, actually, I saw a related JIRA issue. But in the mean time, yes, you coul dimplement it via a

Quick Indexing Method???

Hello, I am new to Solr. I looked at getting started document. Can somebody show me how to index text file. I've tried other method, it just takes too much time. I am aware that Solr take XML files. I'm trying to find the *quickiest*method to index text, binary, or pcap file. Preferably,

Re: Quick Indexing Method???

What about building an XML with text fields as everyones does ? :) On Wed, Apr 1, 2009 at 6:17 PM, Alex Vu alex.v...@gmail.com wrote: Hello, I am new to Solr. I looked at getting started document. Can somebody show me how to index text file. I've tried other method, it just takes too

Re: Defining DataDir in Multi-Core

Thanks Shalin. Is it available in the latest nightly build? Is there any other way I can create cores dynamically (using CREATE service) which will use the same schema.xml and solrconfig.xml, but write to different data directories? Thanks, -vivek On Wed, Apr 1, 2009 at 1:55 AM, Shalin Shekhar

Solr Stats and Their Meaning

Is there any documentation for some of the Solr admin stats? I'm not sure if these numbers are good or bad. We have a pretty small index (numDocs : 25253, maxDoc : 25312) org.apache.solr.handler.StandardRequestHandler requests : 11 errors : 0 avgTimePerRequest : 80.36364

Re: Defining DataDir in Multi-Core

Hi, I tried the latest nightly build (04-01-09) - it takes the dataDir property now, but it's creating the Data dir at the wrong location. For ex., I've the following in solr.xml, solr persistent=true cores adminPath=/admin/cores core name=core0 instanceDir=/Users/opal/temp/chat/solr

Re: DIH Date conversion from a source column skews time

Was there any follow up to this issue I found? Is this a legitimate bug with the time of day changing? I could try to solve this by executing same xpath statement twice. field column=original_air_date_d xpath=/add/doc/fie...@name='original_air_date_d'] / field column=temp_original_air_date_s

Re: DIH; Hardcode field value/replacement based on source column

Thanks for the feedback. The templateTransformer is pretty straightforward solution. Perfect. Wesley. On 4/1/09 12:14 AM, Noble Paul നോബിള്‍ नोब्ळ् noble.p...@gmail.com wrote: use TemplateTransformer field column=content_type_s template=Video / On Tue, Mar 31, 2009 at 9:20 PM,

Re: Merging Solr Indexes

There is a jira issue on supporting index merge: https://issues.apache.org/jira/browse/SOLR-1051. But I agree with Otis that you should go with a single index first. Cheers, Ning On Wed, Apr 1, 2009 at 12:06 PM, Otis Gospodnetic otis_gospodne...@yahoo.com wrote: Hi, Yes, you can write to

Re: [solr-user] Upgrade from 1.2 to 1.3 gives 3x slowdown

On Apr 1, 2009, at 9:39 AM, Fergus McMenemie wrote: Grant, Redoing the work with your patch applied does not seem to make a difference! Is this the expected result? No, I didn't expect Solr 1095 to fix the problem. Overwrite = false + 1095, does, however, AFAICT by your last line,

Re: Quick Indexing Method???

On Wed, Apr 1, 2009 at 9:47 PM, Alex Vu alex.v...@gmail.com wrote: Hello, I am new to Solr.  I looked at getting started document. Can somebody show me how to index text file.   I've tried other method, it just takes too much time. I am aware that Solr take XML files.  I'm trying to find

Re: Runtime exception when adding documents using solrj

Hi, I'm trying to add the list of POJO objects (using annotations) using solrj, but the server.addBeans(...) is throwing this exception, org.apache.solr.common.SolrException: Bad Request Bad Request request: http://localhost:8080/solr/core0/update?wt=javabinversion=2.2 Note, I'm using

Re: Runtime exception when adding documents using solrj

On Thu, Apr 2, 2009 at 1:13 AM, vivek sar vivex...@gmail.com wrote: Hi,  I'm trying to add the list of POJO objects (using annotations) using solrj, but the server.addBeans(...) is throwing this exception, org.apache.solr.common.SolrException: Bad Request Bad Request request:

Re: Runtime exception when adding documents using solrj

Thanks Shalin. I added that in the solrconfig.xml, but now I get this exception, org.apache.solr.common.SolrException: Not Found Not Found request: http://localhost:8080/solr/core0/update?wt=javabinversion=2.2 I do have the core0 under the solr.home. The core0 directory also contains the conf

Additive filter queries

I have a design question for all of those who might be willing to provide an answer. We are looking for a way to do a type of additive filters. Our documents are comprised of a single item of a specified color. We will use shoes as an example. Each document contains a multivalued ³size² field

spectrum of Lucene queries in solr?

Hello list, I am surprised not to find any equivalent to the classical Lucene queries in Solr... I must have badly looked... E.g. where can I get a BooleanQuery, a PrefixQuery, a FuzzyQuery, or even a few spanqueries? thanks in advance paul smime.p7s Description: S/MIME cryptographic

java.lang.ClassCastException: java.lang.Long using Solrj

Hi, I'm using solrj (released v 1.3) to add my POJO objects (server.addbeans(...)), but I'm getting this exception, java.lang.ClassCastException: java.lang.Long at org.apache.solr.common.util.NamedListCodec.unmarshal(NamedListCodec.java:89) at

Re: spectrum of Lucene queries in solr?

Paul, I'm not sure I understand what you're looking for exactly. Solr supports Lucene's QueryParser by default for /select?q=... so you get the breadth of what it supports including boolean, prefix, fuzzy, and more. QueryParser has never supported span queries though. There is also a

Re: Runtime exception when adding documents using solrj

On Thu, Apr 2, 2009 at 2:34 AM, vivek sar vivex...@gmail.com wrote: Thanks Shalin. I added that in the solrconfig.xml, but now I get this exception, org.apache.solr.common.SolrException: Not Found Not Found request: http://localhost:8080/solr/core0/update?wt=javabinversion=2.2 I do have

Re: DIH Date conversion from a source column skews time

I guess dateFormat does the job properly but the returned value is changed according to timezone. can y try this out add an extra field which converts the date to toString() field column=original_air_date_d_str template=${entityname.original_air_date_d}/ this would add an extra field as string

Re: Unexpected sorting results when sorting with mutivalued filed

Shalin Shekhar Mangar wrote: On Tue, Mar 31, 2009 at 2:18 PM, tushar kapoor tushar_kapoor...@rediffmail.com wrote: I have indexes with a multivalued field authorLastName. I query them with sort=authorLastName asc and get the results as - Index# authorLastName 1