Re: solr 1.3 multi language?

2008-10-20 Thread sunnyfr
Hi Can somebdoy please show me an example for one language ? I would like to know if for example I define my text_fr like below, if I need to define in analyzer if it's type index or request, does my way to define below is enough ??? fieldtype name=text_fr class=solr.TextField

search not working correctly

2008-10-20 Thread prerna07
Hi, I have some indexes with string values upload. Search on q=upload and q=upl* gives me all results. Issues : Search on q=upl gives me ZERO result. Do i need to append query with some other parameter or solr search does not work in this scenario? Thanks, Prerna -- View this message in

MySql - Solr 1.3 - Full import, how to make request pack smaller?

2008-10-20 Thread sunnyfr
Hi I don't have a problem of memory but It's a production database and I stuck other service on it because I've too much request on it, how can I make it maybe longer but taking less resources of MySql? Thanks a lot, -- View this message in context:

bin folder with multi core? solr1.3

2008-10-20 Thread sunnyfr
Hi I would like to know if you really need to put the bin folder in every core? Thanks a lot, -- View this message in context: http://www.nabble.com/bin-folder-with-multi-core--solr1.3-tp20066472p20066472.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: solr 1.3 snapshooter doesn't work, commit never ending

2008-10-20 Thread sunnyfr
It was actually my user in script.src, I finally let it empty it worked, just story of right. Geoffrey Young wrote: sunnyfr wrote: I tried last evening before leaving and this morning time elapsed was very important like you can notice above and no snapshot, no error in the logs.

Re: search not working correctly

2008-10-20 Thread Shalin Shekhar Mangar
If upl is not a token in the index, then a simple query will not return any document. You should use upl* if you want to match documents containing the term upload. However, do you really want to search for incomplete words? On Mon, Oct 20, 2008 at 2:40 PM, prerna07 [EMAIL PROTECTED] wrote:

Re: error when post xml data to solr

2008-10-20 Thread cricdigs
I get the same error sometimes. I believe it happens when my xml exceeds 4 KB. Is there an upper limit somewhere. I am using Solr1.3 and using SolrJ to do the post. Any ideas as to how I can increase the limit? Thanks! 李学健 wrote: hi, all when i post an xml file to solr, some errors

Re: search not working correctly

2008-10-20 Thread prerna07
Yes, We want search on these incomplete words. Thanks, Shalin Shekhar Mangar wrote: If upl is not a token in the index, then a simple query will not return any document. You should use upl* if you want to match documents containing the term upload. However, do you really want to search

Re: MySql - Solr 1.3 - Full import, how to make request pack smaller?

2008-10-20 Thread sunnyfr
sorry but bested entities is not an expression that i know, I'm french, what does that means ... is it when in one request you have several table and inner join between them ? Noble Paul നോബിള്‍ नोब्ळ् wrote: do you have a nested entities? Then there is chance of firing too many requests to

Re: Sorting performance

2008-10-20 Thread christophe
Will do so. Thanks. Are there any metrics on how to compute memory requirements (based on doc average size, number of sorted fields, number of indexed documents + number of new document / day) ? Thanks Christophe Mark Miller wrote: You need to setup a warming query that sorts so that the

Re: bin folder with multi core? solr1.3

2008-10-20 Thread Shalin Shekhar Mangar
If you want replication for every core, put the bin directory in each core. On Mon, Oct 20, 2008 at 3:33 PM, sunnyfr [EMAIL PROTECTED] wrote: Hi I would like to know if you really need to put the bin folder in every core? Thanks a lot, -- View this message in context:

Re: Sorting performance

2008-10-20 Thread christophe
When I start indexing new documents, searches are taking long time again: is the sort cache flushed when new documents are indexed ? Thanks Christophe Mark Miller wrote: You need to setup a warming query that sorts so that the initial long query is done behind the scenes. Users first query

query parsing issue + behavior as OR (solr 1.4-dev)

2008-10-20 Thread Sunil Sarje
I am working with nightly build of Oct 17, 2008 and found the issue that something wrong with LuceneQParserPlugin; It takes + as OR e.g. q=first_name:joe+last_name:smith is behaving as OR instead of AND. Default operator is set to AND in schema.xml solrQueryParser defaultOperator=AND/ Is

Re: Sorting performance

2008-10-20 Thread Erick Erickson
Caches are specific to opening a searcher. So whenever you open a reader, the caches are rebuilt for that server. If you are picking up your changes, you MUST be opening a new reader so yes, indeed, your caches are being flushed. You can get around this by firing a few warmup queries at the

Re: Sorting performance

2008-10-20 Thread Mark Miller
christophe wrote: When I start indexing new documents, searches are taking long time again: is the sort cache flushed when new documents are indexed ? When you commit, a new Reader will be opened (or reopened) so that the freshly added docs can be seen. This would make the first search slow

Re: Sorting performance

2008-10-20 Thread christophe
Hum. this mean I have to wait before I index new documents and avoid indexing when they are created (I have about 50 000 new documents created each day and I was planning to make those searchable ASAP). Too bad there is no way to have a centralized cache that can be shared AND updated when

Re: search not working correctly

2008-10-20 Thread Norberto Meijome
On Mon, 20 Oct 2008 03:24:36 -0700 (PDT) prerna07 [EMAIL PROTECTED] wrote: Yes, We want search on these incomplete words. Look into the NGram token factory . works a treat - I don't think it's explained a lot in the wiki, but has been discussed in this list in the past, and you also have

Re: Synonym format not working

2008-10-20 Thread Norberto Meijome
On Mon, 20 Oct 2008 00:08:07 -0700 (PDT) prerna07 [EMAIL PROTECTED] wrote: The issue with synonym arise when i have number in synonym defination: ccc =1,2 gives following result in debugQuery= true : str name=parsedqueryMultiPhraseQuery(all: (1 ) (2 ccc ) 3)/str

Re: query parsing issue + behavior as OR (solr 1.4-dev)

2008-10-20 Thread Norberto Meijome
On Mon, 20 Oct 2008 06:21:06 -0700 (PDT) Sunil Sarje [EMAIL PROTECTED] wrote: I am working with nightly build of Oct 17, 2008 and found the issue that something wrong with LuceneQParserPlugin; It takes + as OR Sunil, please do not hijack the thread :

Re: solr1.3 - testing language ?

2008-10-20 Thread Norberto Meijome
On Mon, 20 Oct 2008 06:25:09 -0700 (PDT) sunnyfr [EMAIL PROTECTED] wrote: I implemented multi language search, but I didn't finished the website in PHP, how can I check it works properly? maybe by sending to SOLR the queries you plan your PHP frontend to generate ? _

Re: Sorting performance

2008-10-20 Thread Norberto Meijome
On Mon, 20 Oct 2008 16:28:23 +0300 christophe [EMAIL PROTECTED] wrote: Hum. this mean I have to wait before I index new documents and avoid indexing when they are created (I have about 50 000 new documents created each day and I was planning to make those searchable ASAP). you can

Re: error with delta import

2008-10-20 Thread Florian Aumeier
sorry to bother you again, but the delta import still does not work for me :-( We tried: * delta-import by full-import entity name=articles-delta rootEntity=false query=your-delta-query-here with entity=articles-deltaclean=false * delta-import by full-import with simplified query *

Re: MySql - Solr 1.3 - Full import, how to make request pack smaller?

2008-10-20 Thread Noble Paul നോബിള്‍ नोब्ळ्
do you have a nested entities? Then there is chance of firing too many requests to MySql. If you have nested entities try using CachedSqlEntityProcessor for the inner ones (only for the inner ones). i am assuming you have enough RAM to support this --Noble On Mon, Oct 20, 2008 at 3:13 PM,

solr1.3 - testing language ?

2008-10-20 Thread sunnyfr
Hi, Do you know how can I check properly languages ? I implemented multi language search, but I didn't finished the website in PHP, how can I check it works properly? Thanks a lot -- View this message in context: http://www.nabble.com/solr1.3---testing-language---tp20067497p20067497.html Sent

Re: Advice on analysis/filtering?

2008-10-20 Thread Norberto Meijome
On Thu, 16 Oct 2008 16:09:17 +0200 Jarek Zgoda [EMAIL PROTECTED] wrote: They came to such expectations seeing Solr's own Spellcheck at work - if it can suggest correct versions, it should be able to sanitize broken words in documents and search them using sanitized input. For me, this

Re: Sorting performance

2008-10-20 Thread christophe
The problem is that I will have hundreds of users doing queries, and a continuous flow of document coming in. So a delay in warming up a cache could be acceptable if I do it a few times per day. But not on a too regular basis (right now, the first query that loads the cache takes 150s).

Turkish stemmer solr 1.3

2008-10-20 Thread sunnyfr
Hi, Just to be sure, Turkish snowball has been add to solr 1.3, I don't know who update the wiki but it should be wrote there : http://wiki.apache.org/solr/AnalyzersTokenizersTokenFilters#head-a2459ced90486d38acf0e809b628baf0e1f54e84 Is there other language added in the version 1.3, maybe

The method getSolrServer() is undefined

2008-10-20 Thread Artur Zeiler
Hi, I'm new to Solr and have get the following error when i want to add Data to the Server instance: SolrServer server = getSolrServer(); // The method getSolrServer() is undefined for the type Upload Here is the complete Code: import java.io.IOException; import

Japonish language seems to don't work on solr 1.3

2008-10-20 Thread sunnyfr
Hi, I don't get what am I doing wrong but when I request : .com:8180/solr/video/select/?q=初恋+-+村下孝蔵version=2.2start=0rows=10indent=on my result is : response − lst name=responseHeader int name=status0/int int name=QTime0/int − lst name=params str name=indenton/str str name=start0/str str

Getting a document by primary key

2008-10-20 Thread Jonathan Ariel
I'm developing my own request handler and given a document primary key I would like to get it from the index. Which is the best and fastest way to do this? I will execute this request handler several times and this should work really fast. Sorry if it's a basic question. Thanks! Jonathan

Re: solr1.3 - testing language ?

2008-10-20 Thread sunnyfr
ok so straight by the admin part ! it should work .. so it doesn't Norberto Meijome-6 wrote: On Mon, 20 Oct 2008 06:25:09 -0700 (PDT) sunnyfr [EMAIL PROTECTED] wrote: I implemented multi language search, but I didn't finished the website in PHP, how can I check it works properly?

Re: Getting a document by primary key

2008-10-20 Thread Otis Gospodnetic
Jonathan, http://./.?q=your PK field here:doc PK here should be fine. Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message From: Jonathan Ariel [EMAIL PROTECTED] To: solr-user@lucene.apache.org Sent: Monday, October 20, 2008 11:09:35 AM

Re: How to tokenize/analyze docs for the spellchecker - at indexing and query time

2008-10-20 Thread Martin Grotzke
Thanx for your help so far, I just wanted to post my results here... In short: Now I use the ShingleFilter to create shingles when copying my fields into my field spellMultiWords. For query time, I implemented a MultiWordSpellingQueryConverter that just leaves the query as is, so that there's

immediatley commit of docs doesnt work in multiCore case

2008-10-20 Thread Parisa
Hi, I want to see the doc that is committed as soon as I commit it in my search result so I did as you suggest : solrUrl = http://mySolrServer:8080/solr/core1/;; CommonsHttpSolrServer server = new CommonsHttpSolrServer(solrUrl); server.setParser(new XMLResponseParser()); UpdateRequest req

Re: Getting a document by primary key

2008-10-20 Thread Jonathan Ariel
Thanks Otis, but since I'm working on my own RequestHandler I need the actual code that I should execute on the SolrIndexSearcher or IndexReader to get the document. Right now I'm doing the following: public Document getDocumentByUniqueKey(String id, SolrIndexSearcher searcher,

RE: Japonish language seems to don't work on solr 1.3

2008-10-20 Thread sunnyfr
Hi Todd, It does definitly work better, it was the server.xml file, sorry I should have checked, but I still have a dodgy problem, it's like it doesn't encode it in the good way, Because if I'm looking for straight in the URL ... :8180/solr/video/select/?q=豐田真奈美 My result is : response lst

Problem implementing a BinaryQueryResponseWriter

2008-10-20 Thread Feak, Todd
I switched from dev group for this specific question, in case other users have similar issue. I'm implementing my own BinaryQueryResponseWriter. I've implemented the interface and successfully plugged it into the Solr configuration. However, the application always calls the Writer method on

RE: Japonish language seems to don't work on solr 1.3

2008-10-20 Thread Feak, Todd
That looks like the data in the index is incorrectly encoded. If the inserts into your index came in via HTTP GET and your Tomcat wasn't configured for UTF-8 at the time, I could see it going into the index corrupted. But I'm not sure if that's even possible (depends on Update) Is it hard to

Re: Getting a document by primary key

2008-10-20 Thread Otis Gospodnetic
Well, there will always be a perf hotspot somewhere, I think the question is whether that code gets you to your desired query rate or not. I'll sit and wait to see what others say. Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message From: Jonathan

RE: Japonish language seems to don't work on solr 1.3

2008-10-20 Thread sunnyfr
I did create again my index ? I'm using mySql when I request japon video I've got result correctly. And yes I did try to index again data, it takes one minute so it's not a problem, but now I don't know what can I do? -- View this message in context:

RE: Japonish language seems to don't work on solr 1.3

2008-10-20 Thread sunnyfr
So maybe when I import my data from mysql I loose it. ?? sunnyfr wrote: I did create again my index ? I'm using mySql when I request japon video I've got result correctly. And yes I did try to index again data, it takes one minute so it's not a problem, but now I don't know what can I do?

Re: Problem implementing a BinaryQueryResponseWriter

2008-10-20 Thread Shalin Shekhar Mangar
Hi Todd, Did you add your response writer in solrconfig.xml? queryResponseWriter name=xml class=org.apache.solr.request.XMLResponseWriter default=true/ On Mon, Oct 20, 2008 at 9:35 PM, Feak, Todd [EMAIL PROTECTED] wrote: I switched from dev group for this specific question, in case other

RE: Problem implementing a BinaryQueryResponseWriter

2008-10-20 Thread Feak, Todd
Yes. I've gotten it to the point where my class is called, but the wrong method on it is called. -Todd -Original Message- From: Shalin Shekhar Mangar [mailto:[EMAIL PROTECTED] Sent: Monday, October 20, 2008 12:19 PM To: solr-user@lucene.apache.org Subject: Re: Problem implementing a

Re: Problem implementing a BinaryQueryResponseWriter

2008-10-20 Thread Grant Ingersoll
I'd start by having a look at SolrDispatchFilter and put in a debug breakpoint at: QueryResponseWriter responseWriter = core.getQueryResponseWriter(solrReq); response.setContentType(responseWriter.getContentType(solrReq, solrRsp)); if (Method.HEAD

RE: Problem implementing a BinaryQueryResponseWriter

2008-10-20 Thread Feak, Todd
I found out what's going on. My test queries from existing Solr (not 1.3.0) that I am using have *2* select in the URL. http://host:port/select/select?q=foo . Not sure why, but that's a separate issue. The result is that it is following a codepath that bypasses this decision point, and it falls

Re: solr1.3 - testing language ?

2008-10-20 Thread Norberto Meijome
On Mon, 20 Oct 2008 08:16:50 -0700 (PDT) sunnyfr [EMAIL PROTECTED] wrote: ok so straight by the admin part ! Hi Johanna - not sure what you mean by 'the admin part'. it should work .. so it doesn't if you tell us what you did (what url you called) , what you expect to receive back (sample

Re: Problem implementing a BinaryQueryResponseWriter

2008-10-20 Thread Ryan McKinley
do you have handleSelect set to true in solrconfig? requestDispatcher handleSelect=true ... if not, it would use a Servlet that is now deprecated On Oct 20, 2008, at 4:52 PM, Feak, Todd wrote: I found out what's going on. My test queries from existing Solr (not 1.3.0) that I am

RE: Sorting performance

2008-10-20 Thread Lance Norskog
Accd to previous posters on this topic, sorting requires an array with an entry per document in the entire index. Each entry has 32 bits for the 'int' type, and 32 bits plus the field representation length for other types. Not knowing Lucene internals I have a hard time believing that it really

RE: Japonish language seems to don't work on solr 1.3

2008-10-20 Thread Lance Norskog
Also the MySQL table may not be in UTF-8 mode. -Original Message- From: Feak, Todd [mailto:[EMAIL PROTECTED] Sent: Monday, October 20, 2008 9:48 AM To: solr-user@lucene.apache.org Subject: RE: Japonish language seems to don't work on solr 1.3 I would look real closely at the data

trying to make highlight fragmentor return entire HTML element

2008-10-20 Thread Dev Donomo
Hello, I'm indexing HTML files and would like the highlighted fragment to return an entire span element where the hightlight is contained. For example, one of my documents is htmlbody ...span class=myfragmenthere's some text/span... /body/html When the query is some text I would like the

Re: error with delta import

2008-10-20 Thread Noble Paul നോബിള്‍ नोब्ळ्
On Tue, Oct 21, 2008 at 12:56 AM, Shalin Shekhar Mangar [EMAIL PROTECTED] wrote: Your data-config looks fine except for one thing -- you do not need to escape '' character in an XML attribute. It maybe throwing off the parsing code in DataImportHandler. not really '' is fine in attribute

Re: error with delta import

2008-10-20 Thread Noble Paul നോബിള്‍ नोब्ळ्
you are still doing a delta import . with the modified data-config you must do a command=full-import On Mon, Oct 20, 2008 at 7:31 PM, Florian Aumeier [EMAIL PROTECTED] wrote: sorry to bother you again, but the delta import still does not work for me :-( We tried: * delta-import by

Issue with Query Parsing '+' works as 'OR'

2008-10-20 Thread Sunil Sarje
I am working with nightly build of Oct 17, 2008 and found the issue that something wrong with Query Parsing; It takes + as OR e.g. q=first_name:joe+last_name:smith is behaving as OR instead of AND. Default operator is set to AND in schema.xml solrQueryParser defaultOperator=AND/ Is there any

Re: MySql - Solr 1.3 - Full import, how to make request pack smaller?

2008-10-20 Thread Noble Paul നോബിള്‍ नोब्ळ्
nested entity means one entity inside othere as follows entity name=e1 ... entity name=e2 ... /entity /entity In this case for each row in e1 one query is executed on e2 On Mon, Oct 20, 2008 at 6:01 PM, sunnyfr [EMAIL PROTECTED] wrote: sorry but bested entities is not an

solr 374- error on commit

2008-10-20 Thread Sunil Sarje
Getting following exception when i try to commit the index 2nd time onwards. fyi..I am sending commit command via http post just to reload the index. at java.lang.Thread.run(Thread.java:595) y: org.apache.lucene.store.AlreadyClosedException: this Directory is clo at